An ecologic comparison study of the impact of economic disadvantage on Texas Assessment of Knowledge and Skills performance, graduation rates, and readiness for higher education for students attending public and charter schools in Texas from 2004 to 2006

Purpose. No Child Left Behind aimed to "improve the academic achievement of the disadvantaged." The primary research question considered how academic achievement of those from economic disadvantage compared to those not from disadvantage? ^ Economically disadvantaged students can potentially have added academic disadvantage. Research shows low academic achievement can potentially result in drug abuse, youth violence, and teen pregnancy. ^ Methods. To compare the student populations, measures included TAKS results and academic indicator data collected by the Texas Education Agency. ^ Results. T-test analyses showed a significant difference between the economically and non-economically disadvantaged student populations in meeting the TAKS passing standard, graduation, and preparation for higher education.^ Conclusions. The achievement gap between students remained as indicated by the Texas testing program. More research and time are needed to observe if the desired impact on those from economic disadvantage will be reflected by academic achievement data.^

A process evaluation of a health literacy intervention targeting pediatric providers' communication skills at the Texas Children's Health Plan

Background. Health literacy is an important determinant for quality health care, and affects communication between patients and physicians. Poor communication may result in negative effects in health. Improved communication between patients and physicians could positively affect health outcomes. Communication skills are teachable.^ Objectives. (1) to evaluate the process involved in the design and implementation of a health literacy intervention targeting pediatric providers’ communication skills at the Texas Children’s Health Plan in Houston, Texas; and (2) to describe lessons learned from this process that may be used in future attempts to address the issue of health literacy and health communication. ^ Design/methods. The process evaluation of the implementation of a health literacy strategy at the Texas Children’s Health Plan (TCHP) consisted of a critical analysis of all documents and minutes from meetings of the team of investigators. It also involved a secondary analysis of data collected between December 2006 and June 2007. Descriptive statistics, paired t-test and Wilcoxon-signed-rank test were employed in analyzing the data. This information was complemented with a limited review of existing literature on communication skills training programs. ^ Results. The design of the educational intervention followed recommendations from experts in the field of health literacy. The delivery of the intervention was possible and benefited from existing resources and logistics within the TCHP. Very few targeted providers participated in two offerings of the workshop (6.6% and 1.7% respectively). After the educational intervention, providers showed increased knowledge of health literacy facts and its effects in health (p=0.001); increased awareness of the low health literacy problem (p=0.003); increased expectations for change in practice (p=0.002), and intent to use health literacy strategies for communication immediately following the intervention (p=0.001). Low participation indicated the need for further investigation of barriers to, and means for successful implementation of programs aimed to improving health communication. ^ Conclusions. A short, focused intervention utilizing health literacy strategies for communication appeared effective in increasing knowledge and intentions for change in a small group of pediatric providers. ^

A project to improve the information seeking skills and increase the use of evidence-based research in public health practice

The ability of public health practitioners (PHPs) to work efficiently and effectively is negatively impacted by their lack of knowledge of the broad range of evidence-based practice information resources and tools that can be utilized to guide them in their development of health policies and programs. This project, a three-hour continuing education hands-on workshop with supporting resources, was designed to increase knowledge and skills of these resources. The workshop was presented as a pre-conference continuing education program for the Texas Public Health Association (TPHA) 2008 Annual Conference. Topics included: identification of evidence-based practice resources to aid in the development of policies and programs; identification of sources of publicly available data; utilization of data for community assessments; and accessing and searching the literature through a collection of databases available to all citizens of Texas. Supplemental resources included a blog that served as a gateway to the resources explored during the presentation, a community assessment workbook that incorporates both Healthy People 2010 objectives and links to reliable sources of data, and handouts providing additional instruction on the use of the resources covered during the workshop.^ Before- and after-workshop surveys based on Kirkpatrick's 4-level model of evaluation and the Theory of Planned Behavior were administered. Of the questions related to the trainer, the workshop, and the usefulness of the workshop, participants gave "Good" to "Excellent" responses to all one question. Confidence levels overall increased a statistically significant amount; measurements of attitude, social norms, and control showed no significant differences before and after the workshop. Lastly, participants indicated they were likely to use resources shown during the workshop within a one to three month time period on average. ^ The workshop and creation of supplemental resources served as a pilot for a funded project that will be continued with the development and delivery of four 4-week long webinar-based training sessions to be completed by December 2008. ^

The five language skills in the EFL classroom

Este artículo analiza la importancia de integrar la cultura de la lengua meta con las cuatro destrezas lingüísticas tradicionales en la clase de inglés como lengua extranjera en el marco de dos posturas pedagógicas que integran las destrezas lingüísticas: una perspectiva que hace hincapié en el contenido del material auténtico a incorporar en la clase de inglés como lengua extranjera por sobre el sistema lingüístico, y la otra perspectiva que parte de la asignación de tareas que integran contenido de la materia a estudiar con las destrezas lingüísticas propiamente dichas. El artículo también destaca la importancia de las denominadas WebQuests como herramientas pedagógicas que ofrecen invalorables oportunidades para desarrollar las destrezas lingüísticas en un ambiente propicio que promociona el aprendizaje cooperativo y autónomo en la clase de inglés como lengua extranjera.

Model of ICT skills and new professional profile of the Guidance Counsellors in some European countries

El artículo analiza la utilización de las Tecnologías de la Información y Comunicación en el escenario de algunos países europeos en el ámbito de la Orientación Educativa y Profesional.

Transferable skills following WAIS-II verbal comprehension index

In this document the results and the reflections brought about by the research for the standardization of the verbal comprehension index of Wechsler scale subtests for measuring adult intelligence, WAIS -III for the general population from 16 to 24 years for the city of La Plata , using the collective administration modality are reported In this opportunity, the performance of 229 students from secondary school from 16 to 18 years, both genders, is being analyzed in the information subtest, as well as that of 155 university and non-university tertiary students from 19 to 24 years, both genders in the same subtest The information subtest is of particular interest because of the implication of previous knowledges in the text comprehension and the personal transferable skills. Given the responses, the analysis allow to make some observations a) there are no statistically significant differences between the individual and the collective administration, by gender and b) the average of correct responses for both age groups is the same but the score distribution shows a greater homogeneity in the group from 16 to18 years.

Model of ICT skills and new professional profile of the Guidance Counsellors in some European countries

El artículo analiza la utilización de las Tecnologías de la Información y Comunicación en el escenario de algunos países europeos en el ámbito de la Orientación Educativa y Profesional.

Transferable skills following WAIS-II verbal comprehension index

In this document the results and the reflections brought about by the research for the standardization of the verbal comprehension index of Wechsler scale subtests for measuring adult intelligence, WAIS -III for the general population from 16 to 24 years for the city of La Plata , using the collective administration modality are reported In this opportunity, the performance of 229 students from secondary school from 16 to 18 years, both genders, is being analyzed in the information subtest, as well as that of 155 university and non-university tertiary students from 19 to 24 years, both genders in the same subtest The information subtest is of particular interest because of the implication of previous knowledges in the text comprehension and the personal transferable skills. Given the responses, the analysis allow to make some observations a) there are no statistically significant differences between the individual and the collective administration, by gender and b) the average of correct responses for both age groups is the same but the score distribution shows a greater homogeneity in the group from 16 to18 years.

Transferable skills following WAIS-II verbal comprehension index

In this document the results and the reflections brought about by the research for the standardization of the verbal comprehension index of Wechsler scale subtests for measuring adult intelligence, WAIS -III for the general population from 16 to 24 years for the city of La Plata , using the collective administration modality are reported In this opportunity, the performance of 229 students from secondary school from 16 to 18 years, both genders, is being analyzed in the information subtest, as well as that of 155 university and non-university tertiary students from 19 to 24 years, both genders in the same subtest The information subtest is of particular interest because of the implication of previous knowledges in the text comprehension and the personal transferable skills. Given the responses, the analysis allow to make some observations a) there are no statistically significant differences between the individual and the collective administration, by gender and b) the average of correct responses for both age groups is the same but the score distribution shows a greater homogeneity in the group from 16 to18 years.

Model of ICT skills and new professional profile of the Guidance Counsellors in some European countries

El artículo analiza la utilización de las Tecnologías de la Información y Comunicación en el escenario de algunos países europeos en el ámbito de la Orientación Educativa y Profesional.

Enhancing skills in solving open-ended problems using game-based exercises

Some requirements for engineering programmes, such as an ability to use the techniques, skills and modern engineering tools necessary for engineering practice, as well as an understanding of professional and ethical responsibility or an ability to communicate effectively, need new activities designed for measuring students’ progress. Negotiations take place continuously at any stage of a project and, so, the ability of engineers and managers to effectively carry out a negotiation is crucial for the success or failure of projects and businesses. Since it involves communication between individuals motivated to come together in an agreement for mutual benefit, it can be used to enhance these personal abilities. The main objective of this study was to evaluate the adequacy of mixing playing sessions and theory to maximise the students’ strategic vision in combination with negotiating skills. Results show that the combination of playing with theoretical training teaches students to strategise through analysis and discussion of alternatives. The outcome is then more optimised.

Methods and Tools for Objective Assessment of Psychomotor Skills in Laparoscopic Surgery

Training and assessment paradigms for laparoscopic surgical skills are evolving from traditional mentor–trainee tutorship towards structured, more objective and safer programs. Accreditation of surgeons requires reaching a consensus on metrics and tasks used to assess surgeons’ psychomotor skills. Ongoing development of tracking systems and software solutions has allowed for the expansion of novel training and assessment means in laparoscopy. The current challenge is to adapt and include these systems within training programs, and to exploit their possibilities for evaluation purposes. This paper describes the state of the art in research on measuring and assessing psychomotor laparoscopic skills. It gives an overview on tracking systems as well as on metrics and advanced statistical and machine learning techniques employed for evaluation purposes. The later ones have a potential to be used as an aid in deciding on the surgical competence level, which is an important aspect when accreditation of the surgeons in particular, and patient safety in general, are considered. The prospective of these methods and tools make them complementary means for surgical assessment of motor skills, especially in the early stages of training. Successful examples such as the Fundamentals of Laparoscopic Surgery should help drive a paradigm change to structured curricula based on objective parameters. These may improve the accreditation of new surgeons, as well as optimize their already overloaded training schedules.

Negotiation Games: Acquiring Skills by Playing

This paper shows the research done at the School of Industrial Engineers (ETSII) of the Technical University of Madrid (UPM), in two consecutive academic courses. In this negotiation game each team is formed by three students playing different roles, with a different degree of complexity. The game is played three different times changing the conditions and doing the Zones of Possible Agreement (ZOPA) smaller so the negotiation is going “harder” and it was more difficult for the team to achieve an agreement. Roles were distributed according to the student’s experience, since it was understood that difficulty of the roles was different, especially when there was set a time limit for negotiation. The combination of playing and training has shown that students without particularly good negotiating skills at the beginning of the experiment attained better final results than those who have natural negotiating skills, but no benefit of training.

Conceptual framework for the design, implementation and validation of psychomotor skills’ assessment systems in minimally invasive surgery

Las técnicas de cirugía de mínima invasión (CMI) se están consolidando hoy en día como alternativa a la cirugía tradicional, debido a sus numerosos beneficios para los pacientes. Este cambio de paradigma implica que los cirujanos deben aprender una serie de habilidades distintas de aquellas requeridas en cirugía abierta. El entrenamiento y evaluación de estas habilidades se ha convertido en una de las mayores preocupaciones en los programas de formación de cirujanos, debido en gran parte a la presión de una sociedad que exige cirujanos bien preparados y una reducción en el número de errores médicos. Por tanto, se está prestando especial atención a la definición de nuevos programas que permitan el entrenamiento y la evaluación de las habilidades psicomotoras en entornos seguros antes de que los nuevos cirujanos puedan operar sobre pacientes reales. Para tal fin, hospitales y centros de formación están gradualmente incorporando instalaciones de entrenamiento donde los residentes puedan practicar y aprender sin riesgos. Es cada vez más común que estos laboratorios dispongan de simuladores virtuales o simuladores físicos capaces de registrar los movimientos del instrumental de cada residente. Estos simuladores ofrecen una gran variedad de tareas de entrenamiento y evaluación, así como la posibilidad de obtener información objetiva de los ejercicios. Los diferentes estudios de validación llevados a cabo dan muestra de su utilidad; pese a todo, los niveles de evidencia presentados son en muchas ocasiones insuficientes. Lo que es más importante, no existe un consenso claro a la hora de definir qué métricas son más útiles para caracterizar la pericia quirúrgica. El objetivo de esta tesis doctoral es diseñar y validar un marco de trabajo conceptual para la definición y validación de entornos para la evaluación de habilidades en CMI, en base a un modelo en tres fases: pedagógica (tareas y métricas a emplear), tecnológica (tecnologías de adquisición de métricas) y analítica (interpretación de la competencia en base a las métricas). Para tal fin, se describe la implementación práctica de un entorno basado en (1) un sistema de seguimiento de instrumental fundamentado en el análisis del vídeo laparoscópico; y (2) la determinación de la pericia en base a métricas de movimiento del instrumental. Para la fase pedagógica se diseñó e implementó un conjunto de tareas para la evaluación de habilidades psicomotoras básicas, así como una serie de métricas de movimiento. La validación de construcción llevada a cabo sobre ellas mostró buenos resultados para tiempo, camino recorrido, profundidad, velocidad media, aceleración media, economía de área y economía de volumen. Adicionalmente, los resultados obtenidos en la validación de apariencia fueron en general positivos en todos los grupos considerados (noveles, residentes, expertos). Para la fase tecnológica, se introdujo el EVA Tracking System, una solución para el seguimiento del instrumental quirúrgico basado en el análisis del vídeo endoscópico. La precisión del sistema se evaluó a 16,33ppRMS para el seguimiento 2D de la herramienta en la imagen; y a 13mmRMS para el seguimiento espacial de la misma. La validación de construcción con una de las tareas de evaluación mostró buenos resultados para tiempo, camino recorrido, profundidad, velocidad media, aceleración media, economía de área y economía de volumen. La validación concurrente con el TrEndo® Tracking System por su parte presentó valores altos de correlación para 8 de las 9 métricas analizadas. Finalmente, para la fase analítica se comparó el comportamiento de tres clasificadores supervisados a la hora de determinar automáticamente la pericia quirúrgica en base a la información de movimiento del instrumental, basados en aproximaciones lineales (análisis lineal discriminante, LDA), no lineales (máquinas de soporte vectorial, SVM) y difusas (sistemas adaptativos de inferencia neurodifusa, ANFIS). Los resultados muestran que en media SVM presenta un comportamiento ligeramente superior: 78,2% frente a los 71% y 71,7% obtenidos por ANFIS y LDA respectivamente. Sin embargo las diferencias estadísticas medidas entre los tres no fueron demostradas significativas. En general, esta tesis doctoral corrobora las hipótesis de investigación postuladas relativas a la definición de sistemas de evaluación de habilidades para cirugía de mínima invasión, a la utilidad del análisis de vídeo como fuente de información y a la importancia de la información de movimiento de instrumental a la hora de caracterizar la pericia quirúrgica. Basándose en estos cimientos, se han de abrir nuevos campos de investigación que contribuyan a la definición de programas de formación estructurados y objetivos, que puedan garantizar la acreditación de cirujanos sobradamente preparados y promocionen la seguridad del paciente en el quirófano. Abstract Minimally invasive surgery (MIS) techniques have become a standard in many surgical sub-specialties, due to their many benefits for patients. However, this shift in paradigm implies that surgeons must acquire a complete different set of skills than those normally attributed to open surgery. Training and assessment of these skills has become a major concern in surgical learning programmes, especially considering the social demand for better-prepared professionals and for the decrease of medical errors. Therefore, much effort is being put in the definition of structured MIS learning programmes, where practice with real patients in the operating room (OR) can be delayed until the resident can attest for a minimum level of psychomotor competence. To this end, skills’ laboratory settings are being introduced in hospitals and training centres where residents may practice and be assessed on their psychomotor skills. Technological advances in the field of tracking technologies and virtual reality (VR) have enabled the creation of new learning systems such as VR simulators or enhanced box trainers. These systems offer a wide range of tasks, as well as the capability of registering objective data on the trainees’ performance. Validation studies give proof of their usefulness; however, levels of evidence reported are in many cases low. More importantly, there is still no clear consensus on topics such as the optimal metrics that must be used to assess competence, the validity of VR simulation, the portability of tracking technologies into real surgeries (for advanced assessment) or the degree to which the skills measured and obtained in laboratory environments transfer to the OR. The purpose of this PhD is to design and validate a conceptual framework for the definition and validation of MIS assessment environments based on a three-pillared model defining three main stages: pedagogical (tasks and metrics to employ), technological (metric acquisition technologies) and analytical (interpretation of competence based on metrics). To this end, a practical implementation of the framework is presented, focused on (1) a video-based tracking system and (2) the determination of surgical competence based on the laparoscopic instruments’ motionrelated data. The pedagogical stage’s results led to the design and implementation of a set of basic tasks for MIS psychomotor skills’ assessment, as well as the definition of motion analysis parameters (MAPs) to measure performance on said tasks. Validation yielded good construct results for parameters such as time, path length, depth, average speed, average acceleration, economy of area and economy of volume. Additionally, face validation results showed positive acceptance on behalf of the experts, residents and novices. For the technological stage the EVA Tracking System is introduced. EVA provides a solution for tracking laparoscopic instruments from the analysis of the monoscopic video image. Accuracy tests for the system are presented, which yielded an average RMSE of 16.33pp for 2D tracking of the instrument on the image and of 13mm for 3D spatial tracking. A validation experiment was conducted using one of the tasks and the most relevant MAPs. Construct validation showed significant differences for time, path length, depth, average speed, average acceleration, economy of area and economy of volume; especially between novices and residents/experts. More importantly, concurrent validation with the TrEndo® Tracking System presented high correlation values (>0.7) for 8 of the 9 MAPs proposed. Finally, the analytical stage allowed comparing the performance of three different supervised classification strategies in the determination of surgical competence based on motion-related information. The three classifiers were based on linear (linear discriminant analysis, LDA), non-linear (support vector machines, SVM) and fuzzy (adaptive neuro fuzzy inference systems, ANFIS) approaches. Results for SVM show slightly better performance than the other two classifiers: on average, accuracy for LDA, SVM and ANFIS was of 71.7%, 78.2% and 71% respectively. However, when confronted, no statistical significance was found between any of the three. Overall, this PhD corroborates the investigated research hypotheses regarding the definition of MIS assessment systems, the use of endoscopic video analysis as the main source of information and the relevance of motion analysis in the determination of surgical competence. New research fields in the training and assessment of MIS surgeons can be proposed based on these foundations, in order to contribute to the definition of structured and objective learning programmes that guarantee the accreditation of well-prepared professionals and the promotion of patient safety in the OR.

EVA: Laparoscopic instrument tracking based on endoscopic video analysis for psychomotor skills assessment

INTRODUCTION: The EVA (Endoscopic Video Analysis) tracking system a new tracking system for extracting motions of laparoscopic instruments based on non-obtrusive video tracking was developed. The feasibility of using EVA in laparoscopic settings has been tested in a box trainer setup. METHODS: EVA makes use of an algorithm that employs information of the laparoscopic instrument's shaft edges in the image, the instrument's insertion point, and the camera's optical centre to track the 3D position of the instrument tip. A validation study of EVA comprised a comparison of the measurements achieved with EVA and the TrEndo tracking system. To this end, 42 participants (16 novices, 22 residents, and 4 experts) were asked to perform a peg transfer task in a box trainer. Ten motion-based metrics were used to assess their performance. RESULTS: Construct validation of the EVA has been obtained for seven motion-based metrics. Concurrent validation revealed that there is a strong correlation between the results obtained by EVA and the TrEndo for metrics such as path length (p=0,97), average speed (p=0,94) or economy of volume (p=0,85), proving the viability of EVA. CONCLUSIONS: EVA has been successfully used in the training setup showing potential of endoscopic video analysis to assess laparoscopic psychomotor skills. The results encourage further implementation of video tracking in training setups and in image guided surgery.