Quality assurance of simulated patient feedback in communication training for fourth-year medical students

Introduction In our program, simulated patients (SPs) give feedback to medical students in the course of communication skills training. To ensure effective training, quality control of the SPs’ feedback should be implemented. At other institutions, medical students evaluate the SPs’ feedback for quality control (Bouter et al., 2012). Thinking about implementing quality control for SPs’ feedback in our program, we wondered whether the evaluation by students would result in the same scores as evaluation by experts. Methods Consultations simulated by 4th-year medical students with SPs were video taped including the SP’s feedback to the students (n=85). At the end of the training sessions students rated the SPs’ performance using a rating instrument called Bernese Assessment for Role-play and Feedback (BARF) containing 11 items concerning feedback quality. Additionally the videos were evaluated by 3 trained experts using the BARF. Results The experts showed a high interrater agreement when rating identical feedbacks (ICCunjust=0.953). Comparing the rating of students and experts, high agreement was found with regard to the following items: 1. The SP invited the student to reflect on the consultation first, Amin (= minimal agreement) 97% 2. The SP asked the student what he/she liked about the consultation, Amin = 88%. 3. The SP started with positive feedback, Amin = 91%. 4. The SP was comparing the student with other students, Amin = 92%. In contrast the following items showed differences between the rating of experts and students: 1. The SP used precise situations for feedback, Amax (=maximal agreement) 55%, Students rated 67 of SPs’ feedbacks to be perfect with regard to this item (highest rating on a 5 point Likert scale), while only 29 feedbacks were rated this way by the experts. 2. The SP gave precise suggestions for improvement, Amax 75%, 62 of SPs’ feedbacks obtained the highest rating from students, while only 44 of SPs’ feedbacks achieved the highest rating in the view of the experts. 3. The SP speaks about his/her role in the third person, Amax 60%. Students rated 77 feedbacks with the highest score, while experts judged only 43 feedbacks this way. Conclusion Although evaluation by the students was in agreement with that of experts concerning some items, students rated the SPs’ feedback more often with the optimal score than experts did. Moreover it seems difficult for students to notice when SPs talk about the role in the first instead of the third person. Since precision and talking about the role in the third person are important quality criteria of feedback, this result should be taken into account when thinking about students’ evaluation of SPs’ feedback for quality control. Bouter, S., E. van Weel-Baumgarten, and S. Bolhuis. 2012. Construction and Validation of the Nijmegen Evaluation of the Simulated Patient (NESP): Assessing Simulated Patients’ Ability to Role-Play and Provide Feedback to Students. Academic Medicine: Journal of the Association of American Medical Colleges

3D Computerized Occlusion Rating of Embolized Experimental Aneurysms Using Noninvasive 1.5T MR Imaging

For embolized cerebral aneurysms, the initial occlusion rate is the most powerful parameter to predict aneurysm rerupture and recanalization. However, the occlusion rate is only estimated subjectively in clinical routine. To minimize subjective bias, computer occlusion-rating (COR) was successfully validated for 2D images. To minimize the remaining inaccuracy of 2D-COR, COR was applied to 1.5T 3D MR imaging.

Competencies in arts therapies: A rating of importance, training and performance by practitioners and referring professionals in Switzerland

This survey was conducted in developing a final specialized examination for all arts therapists in Switzerland by the Council of Swiss Arts Therapy Associations (CSATA). Forty-eight generic key competencies (GKC) were sent to all 1235 arts therapists in five different disciplines in Switzerland (response 47.5%) and to 384 referring professionals and employers (RPE) listed by therapists (response 42%). The mean importance of GKC was rated high (4 points of 5) by practitioners and RPE. Different opinions on importance of GKC in disciplines included artistic ability and psychotherapeutic relative to medical orientation. The training of competencies was rated lower by practitioners (3.48 points) and different in the eight competence categories and five disciplines. Areas of weak training were identified. The performance of GKC was rated by referring professionals equally to its importance (mean +0.3 points) and showed a good understanding of competencies by RPE. Judging of performance was difficult for RPE in more than 20% of items. The results provide criteria for detailed outcome assessments and the advancement of a final examination for arts therapists in Switzerland.

Learning to drive: learners' self-reported cognitive failure level predicts driving instructor's observation rating of driving performance

OBJECTIVES Evidence increases that cognitive failure may be used to screen for drivers at risk. Until now, most studies have relied on driving learners. This exploratory pilot study examines self-report of cognitive failure in driving beginners and error during real driving as observed by driving instructors. METHODS Forty-two driving learners of 14 driving instructors filled out a work-related cognitive failure questionnaire. Driving instructors observed driving errors during the next driving lesson. In multiple linear regression analysis, driving errors were regressed on cognitive failure with the number of driving lessons as an estimator of driving experience controlled. RESULTS Higher cognitive failure predicted more driving errors (p < .01) when age, gender and driving experience were controlled in analysis. CONCLUSIONS Cognitive failure was significantly associated with observed driving errors. Systematic research on cognitive failure in driving beginners is recommended.

An innovative blended learning approach using virtual patients as preparation for skills laboratory training: perceptions of students and tutors

BACKGROUND Currently only a few reports exist on how to prepare medical students for skills laboratory training. We investigated how students and tutors perceive a blended learning approach using virtual patients (VPs) as preparation for skills training. METHODS Fifth-year medical students (N=617) were invited to voluntarily participate in a paediatric skills laboratory with four specially designed VPs as preparation. The cases focused on procedures in the laboratory using interactive questions, static and interactive images, and video clips. All students were asked to assess the VP design. After participating in the skills laboratory 310 of the 617 students were additionally asked to assess the blended learning approach through established questionnaires. Tutors' perceptions (N=9) were assessed by semi-structured interviews. RESULTS From the 617 students 1,459 VP design questionnaires were returned (59.1%). Of the 310 students 213 chose to participate in the skills laboratory; 179 blended learning questionnaires were returned (84.0%). Students provided high overall acceptance ratings of the VP design and blended learning approach. By using VPs as preparation, skills laboratory time was felt to be used more effectively. Tutors perceived students as being well prepared for the skills laboratory with efficient uses of time. CONCLUSION The overall acceptance of the blended learning approach was high among students and tutors. VPs proved to be a convenient cognitive preparation tool for skills training.

The influence of students' prior clinical skills and context characteristics on mini-CEX scores in clerkships - a multilevel analysis.

BACKGROUND In contrast to objective structured clinical examinations (OSCEs), mini-clinical evaluation exercises (mini-CEXs) take place at the clinical workplace. As both mini-CEXs and OSCEs assess clinical skills, but within different contexts, this study aims at analyzing to which degree students' mini-CEX scores can be predicted by their recent OSCE scores and/or context characteristics. METHODS Medical students participated in an end of Year 3 OSCE and in 11 mini-CEXs during 5 different clerkships of Year 4. The students' mean scores of 9 clinical skills OSCE stations and mean 'overall' and 'domain' mini-CEX scores, averaged over all mini-CEXs of each student were computed. Linear regression analyses including random effects were used to predict mini-CEX scores by OSCE performance and characteristics of clinics, trainers, students and assessments. RESULTS A total of 512 trainers in 45 clinics provided 1783 mini-CEX ratings for 165 students; OSCE results were available for 144 students (87 %). Most influential for the prediction of 'overall' mini-CEX scores was the trainers' clinical position with a regression coefficient of 0.55 (95 %-CI: 0.26-0.84; p < .001) for residents compared to heads of department. Highly complex tasks and assessments taking place in large clinics significantly enhanced 'overall' mini-CEX scores, too. In contrast, high OSCE performance did not significantly increase 'overall' mini-CEX scores. CONCLUSION In our study, Mini-CEX scores depended rather on context characteristics than on students' clinical skills as demonstrated in an OSCE. Ways are discussed which focus on either to enhance the scores' validity or to use narrative comments only.

Should I Stay or Should I Go? Career Choice Intentions of Students with Family Business Background

Personal and motivational patterns of intentional founders have been researched in great depth; however, antecedents to career choices of intentional successors have been conspicuously missing in entrepreneurship research. By drawing on theory of planned behavior, we investigate how intentional founders, successors, and employees differ in terms of locus of control and entrepreneurial self-efficacy as well as independence and innovation motives. We find that transitive likelihood of career intent depends on degree of entrepreneurial self-efficacy and the independence motive. Unexpectedly, we see that high levels of internal locus of control lead to a preference of employment, which challenges traditional entrepreneurship research and suggests that the feasibility of an entrepreneurial career path does not automatically make it desirable. Our findings suggest that students with family business background are pessimistic about being in control in an entrepreneurial career, but optimistic about their efficacy to pursue an entrepreneurial career.

An investigation of computer literacy and attitudes amongst Greek post-graduate dental students

An accurate assessment of the computer skills of students is a pre-requisite for the success of any e-learning interventions. The aim of the present study was to assess objectively the computer literacy and attitudes in a group of Greek post-graduate students, using a task-oriented questionnaire developed and validated in the University of Malmö, Sweden. 50 post-graduate students in the Athens University School of Dentistry in April 2005 took part in the study. A total competence score of 0-49 was calculated. Socio-demographic characteristics were recorded. Attitudes towards computer use were assessed. Descriptive statistics and linear regression modeling were employed for data analysis. Total competence score was normally distributed (Shapiro-Wilk test: W = 0.99, V = 0.40, P = 0.97) and ranged from 5 to 42.5, with a mean of 22.6 (+/-8.4). Multivariate analysis revealed 'gender', 'e-mail ownership' and 'enrollment in non-clinical programs' as significant predictors of computer literacy. Conclusively, computer literacy of Greek post-graduate dental students was increased amongst males, students in non-clinical programs and those with more positive attitudes towards the implementation of computer assisted learning.

Exploring students' well-being by taking a variety of looks into the classroom

The article first gives an introduction to well-being in school. Second, it argues for different perspectives to explore students’ well-being in the classroom, that is, a more general approach of well-being in school and a more specific approach of students’ individual well-being. Both views will be introduced and discussed in terms of their psychological and educational relevance. The empirical part of this article is based on a quantitative study including 2014 students of secondary I level schools1 and on a qualitative study consisting of 1358 emotional episodes reported by 58 adolescent students three times for two weeks. The results illustrate the potential of a multi-faceted approach to the affective aspects of school life by combining different views of student well-being.