The new final Clinical Skills examination in human medicine in Switzerland: Essential steps of exam development, implementation and evaluation, and central insights from the perspective of the national Working Group

Objective: Since 2011, the new national final examination in human medicine has been implemented in Switzerland, with a structured clinical-practical part in the OSCE format. From the perspective of the national Working Group, the current article describes the essential steps in the development, implementation and evaluation of the Federal Licensing Examination Clinical Skills (FLE CS) as well as the applied quality assurance measures. Finally, central insights gained from the last years are presented. Methods: Based on the principles of action research, the FLE CS is in a constant state of further development. On the foundation of systematically documented experiences from previous years, in the Working Group, unresolved questions are discussed and resulting solution approaches are substantiated (planning), implemented in the examination (implementation) and subsequently evaluated (reflection). The presented results are the product of this iterative procedure. Results: The FLE CS is created by experts from all faculties and subject areas in a multistage process. The examination is administered in German and French on a decentralised basis and consists of twelve interdisciplinary stations per candidate. As important quality assurance measures, the national Review Board (content validation) and the meetings of the standardised patient trainers (standardisation) have proven worthwhile. The statistical analyses show good measurement reliability and support the construct validity of the examination. Among the central insights of the past years, it has been established that the consistent implementation of the principles of action research contributes to the successful further development of the examination. Conclusion: The centrally coordinated, collaborative-iterative process, incorporating experts from all faculties, makes a fundamental contribution to the quality of the FLE CS. The processes and insights presented here can be useful for others planning a similar undertaking. Keywords: national final examination, licensing examination, summative assessment, OSCE, action research

Encouragement to Increase the Use of Psychosocial Skills in the Diagnosis and Therapy of Patients With Functional Dysphonia.

Clinicians believe that psychosocial factors play a causal role in the etiology of many forms of functional dysphonia (FD). But for decades, all attempts to confirm such causation have failed. This paper aims to show the logic of this failure, to discuss the possibilities of employing psychology in therapy nonetheless, and to encourage clinicians to use their psychosocial knowledge and skills. The failure to confirm psychic and social factors as causal in the etiology of FD is basically a consequence of a principal shortcoming of evidence-based medicine (EBM). As the gold standard for validity, reliability, and objectivity in medical research, EBM is based on calculability and hence the processing of quantitative data. But life paths and life situations are best or sometimes only expressible in qualitative, experiential, and idiographic terms. Thus EBM-guided evaluation undervalues most psychosocial studies. This report of an experienced multidisciplinary voice team proposes alternative pathways for integrating psychosocial knowledge into the diagnosis and the treatment of FD. The difference between the fields of activity of psychotherapists and speech-language pathologists is discussed, and the latter group is shown the potential benefits of using more of their psychosocial knowledge and skills.

Predicting psychotherapy outcome based on therapist interpersonal skills: A five-year longitudinal study of a therapist assessment protocol

Objective: In the past decade, variation in outcomes between therapists (i.e., therapist effects) have become increasingly recognized as an important factor in psychotherapy. Less is known, however, about what accounts for differences between therapists. The present study investigates the possibility that therapists' basic therapy-related interpersonal skills may impact outcomes. Method: To examine this, psychotherapy postgraduate trainees completed both an observer- and an expert-rated behavioral assessment: the Therapy-Related Interpersonal Behaviors (TRIB). TRIB scores were used to predict trainees' outcomes over the course of the subsequent five years. Results: Results indicate that trainees' with more positively rated interpersonal behaviors assessed in the observer-rated group format but not in a single expert-rated format showed superior outcomes over the five-year period. This effect remained controlling for therapist characteristics (therapist gender, theoretical orientation [cognitive behavioral or psychodynamic], amount of supervision, patient's order within therapist's caseload), and patient characteristics (patient age, gender, number of comorbid diagnoses, global severity, and personality disorder diagnosis). Conclusions: These findings underscore the importance of therapists' interpersonal skills as a predictor of outcome and source of therapist effects. The potential utility of assessing therapists' and therapists-in-training interpersonal skills are discussed.

An ecologic comparison study of the impact of economic disadvantage on Texas Assessment of Knowledge and Skills performance, graduation rates, and readiness for higher education for students attending public and charter schools in Texas from 2004 to 2006

Purpose. No Child Left Behind aimed to "improve the academic achievement of the disadvantaged." The primary research question considered how academic achievement of those from economic disadvantage compared to those not from disadvantage? ^ Economically disadvantaged students can potentially have added academic disadvantage. Research shows low academic achievement can potentially result in drug abuse, youth violence, and teen pregnancy. ^ Methods. To compare the student populations, measures included TAKS results and academic indicator data collected by the Texas Education Agency. ^ Results. T-test analyses showed a significant difference between the economically and non-economically disadvantaged student populations in meeting the TAKS passing standard, graduation, and preparation for higher education.^ Conclusions. The achievement gap between students remained as indicated by the Texas testing program. More research and time are needed to observe if the desired impact on those from economic disadvantage will be reflected by academic achievement data.^

Transferable skills following WAIS-II verbal comprehension index

In this document the results and the reflections brought about by the research for the standardization of the verbal comprehension index of Wechsler scale subtests for measuring adult intelligence, WAIS -III for the general population from 16 to 24 years for the city of La Plata , using the collective administration modality are reported In this opportunity, the performance of 229 students from secondary school from 16 to 18 years, both genders, is being analyzed in the information subtest, as well as that of 155 university and non-university tertiary students from 19 to 24 years, both genders in the same subtest The information subtest is of particular interest because of the implication of previous knowledges in the text comprehension and the personal transferable skills. Given the responses, the analysis allow to make some observations a) there are no statistically significant differences between the individual and the collective administration, by gender and b) the average of correct responses for both age groups is the same but the score distribution shows a greater homogeneity in the group from 16 to18 years.

Transferable skills following WAIS-II verbal comprehension index

In this document the results and the reflections brought about by the research for the standardization of the verbal comprehension index of Wechsler scale subtests for measuring adult intelligence, WAIS -III for the general population from 16 to 24 years for the city of La Plata , using the collective administration modality are reported In this opportunity, the performance of 229 students from secondary school from 16 to 18 years, both genders, is being analyzed in the information subtest, as well as that of 155 university and non-university tertiary students from 19 to 24 years, both genders in the same subtest The information subtest is of particular interest because of the implication of previous knowledges in the text comprehension and the personal transferable skills. Given the responses, the analysis allow to make some observations a) there are no statistically significant differences between the individual and the collective administration, by gender and b) the average of correct responses for both age groups is the same but the score distribution shows a greater homogeneity in the group from 16 to18 years.

Transferable skills following WAIS-II verbal comprehension index

In this document the results and the reflections brought about by the research for the standardization of the verbal comprehension index of Wechsler scale subtests for measuring adult intelligence, WAIS -III for the general population from 16 to 24 years for the city of La Plata , using the collective administration modality are reported In this opportunity, the performance of 229 students from secondary school from 16 to 18 years, both genders, is being analyzed in the information subtest, as well as that of 155 university and non-university tertiary students from 19 to 24 years, both genders in the same subtest The information subtest is of particular interest because of the implication of previous knowledges in the text comprehension and the personal transferable skills. Given the responses, the analysis allow to make some observations a) there are no statistically significant differences between the individual and the collective administration, by gender and b) the average of correct responses for both age groups is the same but the score distribution shows a greater homogeneity in the group from 16 to18 years.

Methods and Tools for Objective Assessment of Psychomotor Skills in Laparoscopic Surgery

Training and assessment paradigms for laparoscopic surgical skills are evolving from traditional mentor–trainee tutorship towards structured, more objective and safer programs. Accreditation of surgeons requires reaching a consensus on metrics and tasks used to assess surgeons’ psychomotor skills. Ongoing development of tracking systems and software solutions has allowed for the expansion of novel training and assessment means in laparoscopy. The current challenge is to adapt and include these systems within training programs, and to exploit their possibilities for evaluation purposes. This paper describes the state of the art in research on measuring and assessing psychomotor laparoscopic skills. It gives an overview on tracking systems as well as on metrics and advanced statistical and machine learning techniques employed for evaluation purposes. The later ones have a potential to be used as an aid in deciding on the surgical competence level, which is an important aspect when accreditation of the surgeons in particular, and patient safety in general, are considered. The prospective of these methods and tools make them complementary means for surgical assessment of motor skills, especially in the early stages of training. Successful examples such as the Fundamentals of Laparoscopic Surgery should help drive a paradigm change to structured curricula based on objective parameters. These may improve the accreditation of new surgeons, as well as optimize their already overloaded training schedules.

Negotiation Games: Acquiring Skills by Playing

This paper shows the research done at the School of Industrial Engineers (ETSII) of the Technical University of Madrid (UPM), in two consecutive academic courses. In this negotiation game each team is formed by three students playing different roles, with a different degree of complexity. The game is played three different times changing the conditions and doing the Zones of Possible Agreement (ZOPA) smaller so the negotiation is going “harder” and it was more difficult for the team to achieve an agreement. Roles were distributed according to the student’s experience, since it was understood that difficulty of the roles was different, especially when there was set a time limit for negotiation. The combination of playing and training has shown that students without particularly good negotiating skills at the beginning of the experiment attained better final results than those who have natural negotiating skills, but no benefit of training.

Conceptual framework for the design, implementation and validation of psychomotor skills’ assessment systems in minimally invasive surgery

Las técnicas de cirugía de mínima invasión (CMI) se están consolidando hoy en día como alternativa a la cirugía tradicional, debido a sus numerosos beneficios para los pacientes. Este cambio de paradigma implica que los cirujanos deben aprender una serie de habilidades distintas de aquellas requeridas en cirugía abierta. El entrenamiento y evaluación de estas habilidades se ha convertido en una de las mayores preocupaciones en los programas de formación de cirujanos, debido en gran parte a la presión de una sociedad que exige cirujanos bien preparados y una reducción en el número de errores médicos. Por tanto, se está prestando especial atención a la definición de nuevos programas que permitan el entrenamiento y la evaluación de las habilidades psicomotoras en entornos seguros antes de que los nuevos cirujanos puedan operar sobre pacientes reales. Para tal fin, hospitales y centros de formación están gradualmente incorporando instalaciones de entrenamiento donde los residentes puedan practicar y aprender sin riesgos. Es cada vez más común que estos laboratorios dispongan de simuladores virtuales o simuladores físicos capaces de registrar los movimientos del instrumental de cada residente. Estos simuladores ofrecen una gran variedad de tareas de entrenamiento y evaluación, así como la posibilidad de obtener información objetiva de los ejercicios. Los diferentes estudios de validación llevados a cabo dan muestra de su utilidad; pese a todo, los niveles de evidencia presentados son en muchas ocasiones insuficientes. Lo que es más importante, no existe un consenso claro a la hora de definir qué métricas son más útiles para caracterizar la pericia quirúrgica. El objetivo de esta tesis doctoral es diseñar y validar un marco de trabajo conceptual para la definición y validación de entornos para la evaluación de habilidades en CMI, en base a un modelo en tres fases: pedagógica (tareas y métricas a emplear), tecnológica (tecnologías de adquisición de métricas) y analítica (interpretación de la competencia en base a las métricas). Para tal fin, se describe la implementación práctica de un entorno basado en (1) un sistema de seguimiento de instrumental fundamentado en el análisis del vídeo laparoscópico; y (2) la determinación de la pericia en base a métricas de movimiento del instrumental. Para la fase pedagógica se diseñó e implementó un conjunto de tareas para la evaluación de habilidades psicomotoras básicas, así como una serie de métricas de movimiento. La validación de construcción llevada a cabo sobre ellas mostró buenos resultados para tiempo, camino recorrido, profundidad, velocidad media, aceleración media, economía de área y economía de volumen. Adicionalmente, los resultados obtenidos en la validación de apariencia fueron en general positivos en todos los grupos considerados (noveles, residentes, expertos). Para la fase tecnológica, se introdujo el EVA Tracking System, una solución para el seguimiento del instrumental quirúrgico basado en el análisis del vídeo endoscópico. La precisión del sistema se evaluó a 16,33ppRMS para el seguimiento 2D de la herramienta en la imagen; y a 13mmRMS para el seguimiento espacial de la misma. La validación de construcción con una de las tareas de evaluación mostró buenos resultados para tiempo, camino recorrido, profundidad, velocidad media, aceleración media, economía de área y economía de volumen. La validación concurrente con el TrEndo® Tracking System por su parte presentó valores altos de correlación para 8 de las 9 métricas analizadas. Finalmente, para la fase analítica se comparó el comportamiento de tres clasificadores supervisados a la hora de determinar automáticamente la pericia quirúrgica en base a la información de movimiento del instrumental, basados en aproximaciones lineales (análisis lineal discriminante, LDA), no lineales (máquinas de soporte vectorial, SVM) y difusas (sistemas adaptativos de inferencia neurodifusa, ANFIS). Los resultados muestran que en media SVM presenta un comportamiento ligeramente superior: 78,2% frente a los 71% y 71,7% obtenidos por ANFIS y LDA respectivamente. Sin embargo las diferencias estadísticas medidas entre los tres no fueron demostradas significativas. En general, esta tesis doctoral corrobora las hipótesis de investigación postuladas relativas a la definición de sistemas de evaluación de habilidades para cirugía de mínima invasión, a la utilidad del análisis de vídeo como fuente de información y a la importancia de la información de movimiento de instrumental a la hora de caracterizar la pericia quirúrgica. Basándose en estos cimientos, se han de abrir nuevos campos de investigación que contribuyan a la definición de programas de formación estructurados y objetivos, que puedan garantizar la acreditación de cirujanos sobradamente preparados y promocionen la seguridad del paciente en el quirófano. Abstract Minimally invasive surgery (MIS) techniques have become a standard in many surgical sub-specialties, due to their many benefits for patients. However, this shift in paradigm implies that surgeons must acquire a complete different set of skills than those normally attributed to open surgery. Training and assessment of these skills has become a major concern in surgical learning programmes, especially considering the social demand for better-prepared professionals and for the decrease of medical errors. Therefore, much effort is being put in the definition of structured MIS learning programmes, where practice with real patients in the operating room (OR) can be delayed until the resident can attest for a minimum level of psychomotor competence. To this end, skills’ laboratory settings are being introduced in hospitals and training centres where residents may practice and be assessed on their psychomotor skills. Technological advances in the field of tracking technologies and virtual reality (VR) have enabled the creation of new learning systems such as VR simulators or enhanced box trainers. These systems offer a wide range of tasks, as well as the capability of registering objective data on the trainees’ performance. Validation studies give proof of their usefulness; however, levels of evidence reported are in many cases low. More importantly, there is still no clear consensus on topics such as the optimal metrics that must be used to assess competence, the validity of VR simulation, the portability of tracking technologies into real surgeries (for advanced assessment) or the degree to which the skills measured and obtained in laboratory environments transfer to the OR. The purpose of this PhD is to design and validate a conceptual framework for the definition and validation of MIS assessment environments based on a three-pillared model defining three main stages: pedagogical (tasks and metrics to employ), technological (metric acquisition technologies) and analytical (interpretation of competence based on metrics). To this end, a practical implementation of the framework is presented, focused on (1) a video-based tracking system and (2) the determination of surgical competence based on the laparoscopic instruments’ motionrelated data. The pedagogical stage’s results led to the design and implementation of a set of basic tasks for MIS psychomotor skills’ assessment, as well as the definition of motion analysis parameters (MAPs) to measure performance on said tasks. Validation yielded good construct results for parameters such as time, path length, depth, average speed, average acceleration, economy of area and economy of volume. Additionally, face validation results showed positive acceptance on behalf of the experts, residents and novices. For the technological stage the EVA Tracking System is introduced. EVA provides a solution for tracking laparoscopic instruments from the analysis of the monoscopic video image. Accuracy tests for the system are presented, which yielded an average RMSE of 16.33pp for 2D tracking of the instrument on the image and of 13mm for 3D spatial tracking. A validation experiment was conducted using one of the tasks and the most relevant MAPs. Construct validation showed significant differences for time, path length, depth, average speed, average acceleration, economy of area and economy of volume; especially between novices and residents/experts. More importantly, concurrent validation with the TrEndo® Tracking System presented high correlation values (>0.7) for 8 of the 9 MAPs proposed. Finally, the analytical stage allowed comparing the performance of three different supervised classification strategies in the determination of surgical competence based on motion-related information. The three classifiers were based on linear (linear discriminant analysis, LDA), non-linear (support vector machines, SVM) and fuzzy (adaptive neuro fuzzy inference systems, ANFIS) approaches. Results for SVM show slightly better performance than the other two classifiers: on average, accuracy for LDA, SVM and ANFIS was of 71.7%, 78.2% and 71% respectively. However, when confronted, no statistical significance was found between any of the three. Overall, this PhD corroborates the investigated research hypotheses regarding the definition of MIS assessment systems, the use of endoscopic video analysis as the main source of information and the relevance of motion analysis in the determination of surgical competence. New research fields in the training and assessment of MIS surgeons can be proposed based on these foundations, in order to contribute to the definition of structured and objective learning programmes that guarantee the accreditation of well-prepared professionals and the promotion of patient safety in the OR.

Strengthening communication skills in an innovative context of engineering project management learning

This document presents an innovative, formal educational initiative that is aimed at enhancing the development of engineering students’ specific competences when studying Project Management (PM) subject. The framework of the experience combines (1) theoretical concepts, (2) the development of a real-case project carried out by multidisciplinary groups of three different universities, (3) the use of software web 2.0 tools and (4) group and individual assignments of students that play different roles (project managers and team members). Under this scenario, the study focuses on monitoring the communication competence in the ever growing PM virtual environment. Factors such as corporal language, technical means, stage, and PM specific vocabulary among others have been considered in order to assess the students’ performance on this issue. As a main contribution, the paper introduces an ad-hoc rubric that, based on previous investigations, has been adapted and tested for the first time to this new and specific context. Additionally, the research conducted has provided some interesting findings that suggest further actions to improve and better define future rubrics, oriented to communication or even other competences. As specific PM subject concerns, it has been detected that students playing the role of Project Managers strengthen their competences more than those ones that play the role of Team Members. It has also been detected that students have more difficulty assimilating concepts related to risk and quality management. However those concepts related with scope, time or cost areas of knowledge have been better assimilated by the students.

Soft Skills: A Comparative Analysis Between Online and Classroom Teaching

Currently the Spanish universities are making a great effort to effectively incorporate the development and assessment of generic skills in their training programs. Information and communications technologies (ICT) offer a wide range of possibilities but create uncertainty among teachers about the process and results. It is considered of interest to conduct a study to analyze the extent to which social skills like commitment, communication and teamwork are acquired by students and teachers. It seeks to ascertain the influence of the learning context, online or classroom training, in the development of these personal skills among the participants in the sample. For this study two universities have been chosen, Universidad a Distancia de Madrid (UDIMA) offering online training environment, and Universidad Politécnica de Madrid (UPM) with classroom training modality. A total of 257 individuals, 230 students and 27 teachers have answered the survey called Evalsoft. This instrument was designed in the project with the same name by a research team from Universidad Complutense of Madrid (UCM). Some interesting conclusions can be highlighted: it is in the online context where there are higher levels of commitment and teamwork than in the classroom modality; teachers have higher social skills that students and these improve with age. Sex and the training program appear to influence these social skills.

National policies for technical change: Where are the increasing returns to economic research?

Improvements over the past 30 years in statistical data, analysis, and related theory have strengthened the basis for science and technology policy by confirming the importance of technical change in national economic performance. But two important features of scientific and technological activities in the Organization for Economic Cooperation and Development countries are still not addressed adequately in mainstream economics: (i) the justification of public funding for basic research and (ii) persistent international differences in investment in research and development and related activities. In addition, one major gap is now emerging in our systems of empirical measurement—the development of software technology, especially in the service sector. There are therefore dangers of diminishing returns to the usefulness of economic research, which continues to rely completely on established theory and established statistical sources. Alternative propositions that deserve serious consideration are: (i) the economic usefulness of basic research is in the provision of (mainly tacit) skills rather than codified and applicable information; (ii) in developing and exploiting technological opportunities, institutional competencies are just as important as the incentive structures that they face; and (iii) software technology developed in traditional service sectors may now be a more important locus of technical change than software technology developed in “high-tech” manufacturing.

Age-related losses of cognitive function and motor skills in mice are associated with oxidative protein damage in the brain.

The hypothesis that age-associated impairment of cognitive and motor functions is due to oxidative molecular damage was tested in the mouse. In a blind study, senescent mice (aged 22 months) were subjected to a battery of behavioral tests for motor and cognitive functions and subsequently assayed for oxidative molecular damage as assessed by protein carbonyl concentration in different regions of the brain. The degree of age-related impairment in each mouse was determined by comparison to a reference group of young mice (aged 4 months) tested concurrently on the behavioral battery. The age-related loss of ability to perform a spatial swim maze task was found to be positively correlated with oxidative molecular damage in the cerebral cortex, whereas age-related loss of motor coordination was correlated with oxidative molecular damage within the cerebellum. These results support the view that oxidative stress is a causal factor in brain senescence. Furthermore, the findings suggest that age-related declines of cognitive and motor performance progress independently, and involve oxidative molecular damage within different regions of the brain.

A Transdiagnostic Social Skills Intervention; Using a Structured Story to Teach Children How to Ask a Friend to Play

An (independent samples comparison) controlled study was conducted to assess the efficacy of a novel approach to social skills training for children in a local socialization group at Knippenberg, Patterson & Associates (KPA). The treatment condition involved the combination of a Structured Story (i.e., novel bibliotherapy technique for children with social skills deficits), and a behavioral rehearsal (or role-play) segment, where the children practiced the target social skill featured in the Structure Story. The control group did not receive the Structured Story nor the behavioral rehearsal. Children in both groups engaged in ten-minutes of free play that was videorecorded for later observation and scoring by the principal investigator. Two target behaviors were assessed; asking a friend to play, and duration of joint play between two or more peers. The results did not show significant differences for either target variable between the group that received the novel intervention and the control group. Limitations of the current study and implications for further research are discussed.