Quality assurance of simulated patient feedback in communication training for fourth-year medical students

Introduction In our program, simulated patients (SPs) give feedback to medical students in the course of communication skills training. To ensure effective training, quality control of the SPs’ feedback should be implemented. At other institutions, medical students evaluate the SPs’ feedback for quality control (Bouter et al., 2012). Thinking about implementing quality control for SPs’ feedback in our program, we wondered whether the evaluation by students would result in the same scores as evaluation by experts. Methods Consultations simulated by 4th-year medical students with SPs were video taped including the SP’s feedback to the students (n=85). At the end of the training sessions students rated the SPs’ performance using a rating instrument called Bernese Assessment for Role-play and Feedback (BARF) containing 11 items concerning feedback quality. Additionally the videos were evaluated by 3 trained experts using the BARF. Results The experts showed a high interrater agreement when rating identical feedbacks (ICCunjust=0.953). Comparing the rating of students and experts, high agreement was found with regard to the following items: 1. The SP invited the student to reflect on the consultation first, Amin (= minimal agreement) 97% 2. The SP asked the student what he/she liked about the consultation, Amin = 88%. 3. The SP started with positive feedback, Amin = 91%. 4. The SP was comparing the student with other students, Amin = 92%. In contrast the following items showed differences between the rating of experts and students: 1. The SP used precise situations for feedback, Amax (=maximal agreement) 55%, Students rated 67 of SPs’ feedbacks to be perfect with regard to this item (highest rating on a 5 point Likert scale), while only 29 feedbacks were rated this way by the experts. 2. The SP gave precise suggestions for improvement, Amax 75%, 62 of SPs’ feedbacks obtained the highest rating from students, while only 44 of SPs’ feedbacks achieved the highest rating in the view of the experts. 3. The SP speaks about his/her role in the third person, Amax 60%. Students rated 77 feedbacks with the highest score, while experts judged only 43 feedbacks this way. Conclusion Although evaluation by the students was in agreement with that of experts concerning some items, students rated the SPs’ feedback more often with the optimal score than experts did. Moreover it seems difficult for students to notice when SPs talk about the role in the first instead of the third person. Since precision and talking about the role in the third person are important quality criteria of feedback, this result should be taken into account when thinking about students’ evaluation of SPs’ feedback for quality control. Bouter, S., E. van Weel-Baumgarten, and S. Bolhuis. 2012. Construction and Validation of the Nijmegen Evaluation of the Simulated Patient (NESP): Assessing Simulated Patients’ Ability to Role-Play and Provide Feedback to Students. Academic Medicine: Journal of the Association of American Medical Colleges

[Knowledge, attitude and reservations of medical students about organ transplantation: results of a survey during the first year of study]

AIM: Establish a list of first year medical students' attitudes, doubts, and knowledge in the fields of organ transplantation and donation. METHOD: Anonymized questionnaire handed out to students during class lectures. RESULTS: 183 questionnaires were distributed and 117 returned (participation: 64%). The average age of the students was 21.6 +/- 2.7 years (range 18 to 38 years); the sample included 71 women (60.7%) and 48 men (39.3%). Only 2 students (2%) were not interested in the subject of organ donation. The students knew very little of the legal aspects of organ donation and 1/4 of them thought there was even a Federal law regarding organ transplantation. When asked if they knew whether a law existed in the Canton of Berne, 44% replied yes, but only 24 (20%) knew that this is contradictory. There was no gender difference in the answers to these question. From 57 students (48%) 246 individual comments on doubts and concerns were analyzed. In this respect, the students mainly questioned whether the donor was truly dead when donation took place (n = 48), if illegal transplantation could be eliminated (n = 44) and if transplantation was truly necessary (n = 43). Some also mentioned religious/ethical doubts (n = 42). In regard to organ donation by a living individual, 27 students were concerned about the health of this donor. 20 students had doubts regarding the pressure possibly applied by family members and friends and as many voiced doubts in regard to premature diagnosis of brain death of potential donors. Only 2 students were concerned about the post-mortem presentation. 45 students (48%) indicated discomfort with the donation of certain organs. They ranked the kidney as the first organ to donate, followed by the pancreas, heart, cornea, intestine, lung and liver. CONCLUSION: The interest in organ donation and transplantation is already strong in fist year medical students in the pre-clinical stage. However, differences from lay public are not readably detectable at this stage of medical training. Adequate information could influence future physicians in their mediatory role.

Further concerns about self-assessment: are medical students aware of their progress in clinical skills during clerkship

Background: Medical students do not accurately self-assess their competence. However, little is known about the awareness of change of competence over time. The aim of this study was to evaluate if students are aware of their progress. Summary of work: Twenty-two fourth year medical students had self- and expert-assessments of their clinical skills in musculoskeletal medicine in an OSCE like station (4 point Likert scale) at the beginning (t0) and end (t1) of their eight weeks clerkship in internal medicine. Thirteen students were assigned to the intervention of a 6x1 hour practical examination course; nine took part in the regular clinical clerkship activities only and served as controls. Summary of results/Conclusions: The intervention students significantly improved their skills (from 2.78 ± 0.36 to 3.30 ± 0.36, p<0.05) in contrast to the control students (from 3.11 ± 0.58 to 2.83 ± 0.49, n.s.). At t0, 19 students, at t1 21 out of 22 students underestimated their competence. Correlations between the change of self- and expert-assessment were r=0.43, p<0.05 (all), r=0.47, n.s. (control) and r=-0.12, n.s. (intervention), respectively. Take-home message: Medical students improving their clinical skills by an interactive course in addition to their regular clerkship activities are not aware of their progress

An innovative blended learning approach using virtual patients as preparation for skills laboratory training: perceptions of students and tutors

BACKGROUND Currently only a few reports exist on how to prepare medical students for skills laboratory training. We investigated how students and tutors perceive a blended learning approach using virtual patients (VPs) as preparation for skills training. METHODS Fifth-year medical students (N=617) were invited to voluntarily participate in a paediatric skills laboratory with four specially designed VPs as preparation. The cases focused on procedures in the laboratory using interactive questions, static and interactive images, and video clips. All students were asked to assess the VP design. After participating in the skills laboratory 310 of the 617 students were additionally asked to assess the blended learning approach through established questionnaires. Tutors' perceptions (N=9) were assessed by semi-structured interviews. RESULTS From the 617 students 1,459 VP design questionnaires were returned (59.1%). Of the 310 students 213 chose to participate in the skills laboratory; 179 blended learning questionnaires were returned (84.0%). Students provided high overall acceptance ratings of the VP design and blended learning approach. By using VPs as preparation, skills laboratory time was felt to be used more effectively. Tutors perceived students as being well prepared for the skills laboratory with efficient uses of time. CONCLUSION The overall acceptance of the blended learning approach was high among students and tutors. VPs proved to be a convenient cognitive preparation tool for skills training.

Optional course "Homeopathically potentised substances: placebos or effective?" for medical students at the University of Bern, Switzerland

Background Apart from compulsory lectures on classical homeopathy (CH), traditional Chinese medicine/acupuncture, neural therapy and anthroposophically extended medicine (AEM), our institute at the University of Bern offers several optional practical courses for medical students. The aim of this course during autumn 2011 and spring 2012 was to discuss basic research, observational and clinical studies in the fields of CH and AEM, so that students i) learned how to read and appraise scientific publications, ii) learned how complementary medicine can be investigated with scientific methods, and iii) were able to form their own opinion about the possible specific effects and effectiveness of homeopathically potentised substances. Methods Introductory lectures on AEM, CH and study design were given to 12 second year medical students. The students appraised 12 research articles and presented the results in class, followed by discussions with experts in the fields of basic and clinical research from our institute. A company producing homeopathic remedies was visited and students could practise potentization procedures and trituration. At the end of the course, students compiled posters with arguments in favour of and against specific effects and effectiveness as well as their own conclusions. The course was evaluated using a written questionnaire with closed and open questions. Results Previous knowledge about CH and AEM was scarce among the students. It slightly increased during the course, and the course itself fostered their interest on the topic. This course was chosen by most students, because they were genuinely interested in the topic (and not because other courses they had wanted to visit were fully booked). The students especially valued the discussions, the various perspectives presented to them, and experiencing a potentization process. Conclusion Medical students were interested to learn more about homeopathically potentised substances. The contradictory study results made it difficult for them to form their own opinion. Apart from appraising articles, the students would have liked to meet and talk to patients.

General practitioner teachers’ job satisfaction and their medical students' wish to join the field – a correlational study

Background There will be increasing competition for young physicians worldwide as more and more physicians retire. While enthusiasm towards GP work is important for GP teachers as role models, satisfaction within the profession has declined. This study aims to determine if medical students’ desire to become GPs is related to the job satisfaction of their teaching GPs and explore the factors tied to this job satisfaction. Methods In this cross-sectional, correlational study, teaching GPs of the University of Bern and the fourth year medical students completing internships with them filled in separate questionnaires. Results Whether or not the GP teacher is perceived by a student to be satisfied with her/his job is correlated to that student’s satisfaction with the internship, which in turn, is correlated with student’s wish to be a GP after the internship. Results show which factors are most related to GP job satisfaction and the effect of working hours and their composition. Conclusions Medical students’ perception of their GP teachers’ job satisfaction positively affect their wish to become GPs, and their satisfaction with their internships adds to this. Enhancing the positive aspects of GP work, such as recognition, and improving negative ones, such as administrative duties, are necessary to attract medical students into the GP field.

Evaluation of Medical Students’ Attitudes and Performance of Basic Surgery Skills in a Training Program Using Fresh Human skin, Excised During Body Contouring Surgeries

BACKGROUND: Learning surgical skills in the operating room may be a challenge for medical students. Therefore, more approaches using simulation to enable students to develop their practical skills are required. OBJECTIVES: We hypothesized that (1) there would be a need for additional surgical training for medical students in the pre-final year, and (2) our basic surgery skills training program using fresh human skin would improve medical students' surgical skills. DESIGN: We conducted a preliminary survey of medical students to clarify the need for further training in basic surgery procedures. A new approach using simulation to teach surgical skills on human skin was set up. The procedural skills of 15 randomly selected students were assessed in the operating room before and after participation in the simulation, using Objective Structured Assessment of Technical Skills. Furthermore, subjective assessment was performed based on students' self-evaluation. The data were analyzed using SPSS, version 21 (SPSS, Inc., Chicago, IL). SETTING: The study took place at the Inselspital, Bern University Hospital. PARTICIPANTS: A total of 186 pre-final-year medical students were enrolled into the preliminary survey; 15 randomly selected medical students participated in the basic surgical skills training course on the fresh human skin operating room. RESULTS: The preliminary survey revealed the need for a surgical skills curriculum. The simulation approach we developed showed significant (p < 0.001) improvement for all 12 surgical skills, with mean cumulative precourse and postcourse values of 31.25 ± 5.013 and 45.38 ± 3.557, respectively. The self-evaluation contained positive feedback as well. CONCLUSION: Simulation of surgery using human tissue samples could help medical students become more proficient in handling surgical instruments before stepping into a real surgical situation. We suggest further studies evaluating our proposed teaching method and the possibility of integrating this simulation approach into the medical school curriculum.

Prevalence and severity of dental fluorosis among students from João Pessoa, PB, Brazil

The aim of this study was to determine the prevalence and severity of dental fluorosis among 12-15-year-old students from João Pessoa, PB, Brazil before starting a program of artificial fluoridation of drinking water. The use of fluoridated dentifrice was also surveyed. A sample of 1,402 students was randomly selected. However, 31 students refused to participate and 257 were not permanent residents in João Pessoa, thus leaving a final sample of 1,114 students. Clinical exams were carried out by two calibrated dentists (Kappa = 0.78) under natural indirect light. Upper and lower front teeth were cleaned with gauze and dried, and then examined using the TF index for fluorosis. A questionnaire on dentifrice ingestion and oral hygiene habits was applied to the students. The results revealed that fluorosis prevalence in this age group was higher than expected (29.2%). Most fluorosis cases were TF = 1 (66.8%), and the most severe cases were TF = 4 (2.2%). The majority of the students reported that they had been using fluoridated dentifrices since childhood; 95% of the participants preferred brands with a 1,500 ppm F concentration, and 40% remembered that they usually ingested or still ingest dentifrice during brushing. It was concluded that dental fluorosis prevalence among students in João Pessoa is higher than expected for an area with non-fluoridated water. However, although most students use fluoridated dentifrices, and almost half ingest slurry while brushing, the majority of cases had little aesthetic relevance from the professionals' point of view, thus suggesting that fluorosis is not a public health problem in the locality.

Influence of examiner's clinical experience on the reproducibility and accuracy of radiographic examination in detecting occlusal caries

The aim of this in vitro study was to assess the influence of varying examiner's clinical experience on the reproducibility and accuracy of radiographic examination for occlusal caries detection. Standardized bitewing radiographs were obtained from 166 permanent molars. Radiographic examination was performed by final-year dental students from two universities (A, n = 5; B, n = 5) and by dentists with 5 to 7 years of experience who work in two different countries (C, n = 5; D, n = 5). All examinations were repeated after 1-week interval. The teeth were histologically prepared and assessed for caries extension. For intraexaminer reproducibility, the unweighted kappa values were: A (0.11-0.40), B (0.12-0.33), C (0.47-0.58), and D (0.42-0.71). Interexaminer reproducibility statistics were computed based on means ± SD of unweighted kappa values: A (0.07 ± 0.05), B (0.12 ± 0.09), C (0.24 ± 0.08), and D (0.33 ± 0.10). Sensitivity, specificity, and accuracy were calculated at D(1) and D(3) thresholds and compared by performing McNemar test (p = 0.05). D(1) sensitivity ranged between 0.29 and 0.75 and specificity between 0.24 and 0.85. D(3) specificity was moderate to high (between 0.62 and 0.95) for all groups, with statistically significant difference between the dentists groups (C and D). Sensitivity was low to moderate (between 0.21 and 0.57) with statistically significant difference for groups B and D. Accuracy was similar for all groups (0.55). Spearman's correlations were: A (0.12), B (0.24), C (0.30), and D (0.38). In conclusion, the reproducibility of radiographic examination was influenced by the examiner's clinical experience, training, and dental education as well as the accuracy in detecting occlusal caries.

[Survival, clinical data and quality of life 10 years after heart transplantation: a prospective study]

AIM: To study prospectively patients after heart transplantation with respect to quality of life, mortality, morbidity, and clinical parameters before and up to 10 years after the operation. METHODS: Sixty patients (47.9 +/- 10.9 years, 57 men, 3 women) were transplanted at the University of Vienna Hospital, Department for Heart and Thorax Surgery and were included in this study. They were assessed when set on the waiting list, then exactly one, 5 and 10 years after the transplantation. The variables evaluated included physical and emotional complaints, well-being, mortality and morbidity. In the sample of patients who survived 10 years (n = 23), morbidity (infections, malignancies, graft arteriosclerosis, and rejection episodes) as well as quality of life were evaluated. RESULTS: Actuarial survival rates were 83.3, 66.7, 48.3% at 1, 5, and 10 years after transplantation, respectively. During the first year, infections were the most important reasons for premature death. As a cause of mortality, malignancies were found between years 1 and 5, and graft arteriosclerosis between years 5 and 10. Physical complaints diminished significantly after the operation, but grew significantly during the period from 5 to 10 years (p < 0.001). However, trembling (p < 0.05) and paraesthesies (p < 0.01) diminished continuously. Emotional complaints such as depression and dysphoria (both p < 0.05) increased until the tenth year after their nadir at year 1. In long-time survivors, 3 malignancies (lung, skin, thyroidea) were diagnosed 6 to 9 years postoperatively. Three patients (13%) had signs of graft arteriosclerosis at year 10; 9 (40%) patients suffered from rejection episodes during the course of 10 years. There were no serious rejection episodes deserving immediate therapy. Quality of life at 10 years is good in these patients. CONCLUSIONS: Heart transplantation is a successful therapy for patients with terminal heart disease. Long-term survivors feel well after 10 years and report a good quality of life.

Repeat chlamydia screening among adolescents: cohort study in a school-based programme in New Orleans

OBJECTIVES To describe uptake of chlamydia screening, determine rates of repeated yearly screening and investigate determinants of repeated participation in an organised school-based screening programme. METHODS The authors analysed data from 1995 to 2005 from female and male students in up to 13 schools in New Orleans, Louisiana, USA. The authors calculated proportions of students tested among all enrolled students and among those with parental consent and the percentage of positive chlamydia tests in each school year. The authors used random effects logistic regression to examine the effect of past screening history on subsequent participation. RESULTS 35 041 students were registered for at least one school year. Overall coverage was >30% in all school years. Among all students registered for 4 years, 10.6% (95% CI 9.3% to 12.0%) of women and 12.7% (95% CI 11.2% to 14.2%) of men had a test every year. Among students with parental consent for 4 years, 49.3% (95% CI 44.6% to 54.1%) of women and 59.3% (95% CI 54.5% to 64.0%) of men had a test every year. Among students registered for 2 or more years, those with a previous positive chlamydia test were less likely to have a subsequent test (female adjusted OR 0.77, 95% CI 0.67 to 0.88 and male adjusted OR 0.84, 95% CI 0.69 to 1.02). Chlamydia positivity increased over time. CONCLUSIONS High levels of uptake can be achieved in school-based chlamydia screening programmes, but repeated yearly screening is difficult to sustain over time.

Learner preferences regarding integrating, sequencing and aligning virtual patients with other activities in the undergraduate medical curriculum: A focus group study

CONTEXT: E-learning resources, such as virtual patients (VPs), can be more effective when they are integrated in the curriculum. To gain insights that can inform guidelines for the curricular integration of VPs, we explored students' perceptions of scenarios with integrated and non-integrated VPs aimed at promoting clinical reasoning skills. METHODS: During their paediatric clerkship, 116 fifth-year medical students were given at least ten VPs embedded in eight integrated scenarios and as non-integrated add-ons. The scenarios differed in the sequencing and alignment of VPs and related educational activities, tutor involvement, number of VPs, relevance to assessment and involvement of real patients. We sought students' perceptions on the VP scenarios in focus group interviews with eight groups of 4-7 randomly selected students (n = 39). The interviews were recorded, transcribed and analysed qualitatively. RESULTS: The analysis resulted in six themes reflecting students' perceptions of important features for effective curricular integration of VPs: (i) continuous and stable online access, (ii) increasing complexity, adapted to students' knowledge, (iii) VP-related workload offset by elimination of other activities, (iv) optimal sequencing (e.g.: lecture--1 to 2 VP(s)--tutor-led small group discussion--real patient) and (V) optimal alignment of VPs and educational activities, (vi) inclusion of VP topics in assessment. CONCLUSIONS: The themes appear to offer starting points for the development of a framework to guide the curricular integration of VPs. Their impact needs to be confirmed by studies using quantitative controlled designs.

Clinical and haematological predictors of antibiotic prescribing for acute cough in adults in Swiss practices - an observational study.

BackgroundAcute cough is a common problem in general practice and is often caused by a self-limiting, viral infection. Nonetheless, antibiotics are often prescribed in this situation, which may lead to unnecessary side effects and, even worse, the development of antibiotic resistant microorganisms worldwide. This study assessed the role of point-of-care C-reactive protein (CRP) testing and other predictors of antibiotic prescription in patients who present with acute cough in general practice.MethodsPatient characteristics, symptoms, signs, and laboratory and X-ray findings from 348 patients presenting to 39 general practitioners with acute cough, as well as the GPs themselves, were recorded by fourth-year medical students during their three-week clerkships in general practice. Patient and clinician characteristics of those prescribed and not-prescribed antibiotics were compared using a mixed-effects model.ResultsOf 315 patients included in the study, 22% were prescribed antibiotics. The two groups of patients, those prescribed antibiotics and those treated symptomatically, differed significantly in age, demand for antibiotics, days of cough, rhinitis, lung auscultation, haemoglobin level, white blood cell count, CRP level and the GP¿s license to self-dispense antibiotics. After regression analysis, only the CRP level, the white blood cell count and the duration of the symptoms were statistically significant predictors of antibiotic prescription.ConclusionsThe antibiotic prescription rate of 22% in adult patients with acute cough in the Swiss primary care setting is low compared to other countries. GPs appear to use point-of-care CRP testing in addition to the duration of clinical symptoms to help them decide whether or not to prescribe antibiotics.

Individual Video Training iVT - Development of a National Infrastructure for Video-Supported Learning

Introduction: Video‐Supported Learning is particularly effective when it comes to skills and behaviors. Video registration of patient‐physician interviews, class room instruction or practical skills allow it to learners themselves, their peers, and their tutors to assess the quality of the learner's performance, to give specific feedback, and to make suggestions for improvement. Methods: In Switzerland, four pedagogical universities and two medical faculties joined to initiate the development of a national infrastructure for Video Supported Learning. The goal was to have a system that is simple to use, has most steps automated, provides the videos over the Internet, and has a sophisticated access control. Together with SWITCH, the national IT‐Support‐Organisation for Swiss Universities, the program iVT (Individual Video Training) was developed by integrating two preexisting technologies. The first technology is SWITCHcast, a podcast system. With SWITCHcast, videos are automatically uploaded to a server as soon as the registration is over. There the videos are processed and converted to different formats. The second technology is the national Single Logon System AAI (Authentification and Authorization Infrastructure) that enables iVT to link each video with the corresponding learner. The learner starts the registration with his Single Logon. Thus, the video can unambiguously be assigned. Via his institution's Learning Management System (LMS), the learner can access his video and give access to his video to peers and tutors. Results: iVT is now used at all involved institutions. The system works flawlessly. In Bern, we use iVT for the communications skills training in the forth and sixth year. Since students meet with patient actors alone, iVT is also used to certify attendance. Students are encouraged to watch the videos of the interview and the feedback of the patient actor. The offer to discuss a video with a tutor was not used by the students. Discussion: We plan to expand the use of iVT by making peer assessment compulsory. To support this, annotation capabilities are currently added to iVT. We also want to use iVT in training of practical skills, again for self as well as for peer assessment.  At present, we use iVT for quality control of patient actor's performance.