Quality assurance of simulated patient feedback in communication training for fourth-year medical students

Introduction In our program, simulated patients (SPs) give feedback to medical students in the course of communication skills training. To ensure effective training, quality control of the SPs’ feedback should be implemented. At other institutions, medical students evaluate the SPs’ feedback for quality control (Bouter et al., 2012). Thinking about implementing quality control for SPs’ feedback in our program, we wondered whether the evaluation by students would result in the same scores as evaluation by experts. Methods Consultations simulated by 4th-year medical students with SPs were video taped including the SP’s feedback to the students (n=85). At the end of the training sessions students rated the SPs’ performance using a rating instrument called Bernese Assessment for Role-play and Feedback (BARF) containing 11 items concerning feedback quality. Additionally the videos were evaluated by 3 trained experts using the BARF. Results The experts showed a high interrater agreement when rating identical feedbacks (ICCunjust=0.953). Comparing the rating of students and experts, high agreement was found with regard to the following items: 1. The SP invited the student to reflect on the consultation first, Amin (= minimal agreement) 97% 2. The SP asked the student what he/she liked about the consultation, Amin = 88%. 3. The SP started with positive feedback, Amin = 91%. 4. The SP was comparing the student with other students, Amin = 92%. In contrast the following items showed differences between the rating of experts and students: 1. The SP used precise situations for feedback, Amax (=maximal agreement) 55%, Students rated 67 of SPs’ feedbacks to be perfect with regard to this item (highest rating on a 5 point Likert scale), while only 29 feedbacks were rated this way by the experts. 2. The SP gave precise suggestions for improvement, Amax 75%, 62 of SPs’ feedbacks obtained the highest rating from students, while only 44 of SPs’ feedbacks achieved the highest rating in the view of the experts. 3. The SP speaks about his/her role in the third person, Amax 60%. Students rated 77 feedbacks with the highest score, while experts judged only 43 feedbacks this way. Conclusion Although evaluation by the students was in agreement with that of experts concerning some items, students rated the SPs’ feedback more often with the optimal score than experts did. Moreover it seems difficult for students to notice when SPs talk about the role in the first instead of the third person. Since precision and talking about the role in the third person are important quality criteria of feedback, this result should be taken into account when thinking about students’ evaluation of SPs’ feedback for quality control. Bouter, S., E. van Weel-Baumgarten, and S. Bolhuis. 2012. Construction and Validation of the Nijmegen Evaluation of the Simulated Patient (NESP): Assessing Simulated Patients’ Ability to Role-Play and Provide Feedback to Students. Academic Medicine: Journal of the Association of American Medical Colleges

Evaluation of Medical Students’ Attitudes and Performance of Basic Surgery Skills in a Training Program Using Fresh Human skin, Excised During Body Contouring Surgeries

BACKGROUND: Learning surgical skills in the operating room may be a challenge for medical students. Therefore, more approaches using simulation to enable students to develop their practical skills are required. OBJECTIVES: We hypothesized that (1) there would be a need for additional surgical training for medical students in the pre-final year, and (2) our basic surgery skills training program using fresh human skin would improve medical students' surgical skills. DESIGN: We conducted a preliminary survey of medical students to clarify the need for further training in basic surgery procedures. A new approach using simulation to teach surgical skills on human skin was set up. The procedural skills of 15 randomly selected students were assessed in the operating room before and after participation in the simulation, using Objective Structured Assessment of Technical Skills. Furthermore, subjective assessment was performed based on students' self-evaluation. The data were analyzed using SPSS, version 21 (SPSS, Inc., Chicago, IL). SETTING: The study took place at the Inselspital, Bern University Hospital. PARTICIPANTS: A total of 186 pre-final-year medical students were enrolled into the preliminary survey; 15 randomly selected medical students participated in the basic surgical skills training course on the fresh human skin operating room. RESULTS: The preliminary survey revealed the need for a surgical skills curriculum. The simulation approach we developed showed significant (p < 0.001) improvement for all 12 surgical skills, with mean cumulative precourse and postcourse values of 31.25 ± 5.013 and 45.38 ± 3.557, respectively. The self-evaluation contained positive feedback as well. CONCLUSION: Simulation of surgery using human tissue samples could help medical students become more proficient in handling surgical instruments before stepping into a real surgical situation. We suggest further studies evaluating our proposed teaching method and the possibility of integrating this simulation approach into the medical school curriculum.

The population health performance of medical students at two medical schools

Public Health and medicine are complimentary disciplines dedicated to the health and well-being of humankind. Worldwide, medical school accreditation bodies require the inclusion of population health in medical education. In 2003, the Institutes of Medicine (IOM) recommended that all medical students receive basic public health training in population-based prevention. The purpose of this study was to (1) examine the public health clinical performance of third-year medical students at two independent medical schools, (2) compare the public health clinical practice performance of the schools, and (3) identify underlying predictors of high and low public health clinical performance at one of the medical schools. ^ This study is unique in its analysis and report of observed medical student public health clinical practices. The cohort consisted of 751 third-year medical students who completed a required clinical performance exam using trained standardized patients. Medical student performance scores on 24 consensus public health items derived from nine patient cases were analyzed.^ The analysis showed nearly identical results for both medical schools at the 60%, 65%, and 70% pass rate. Students performed poorly on items associated with prevention, behavioral science, and surveillance. Factors associated with high student performance included being from an underrepresented minority, matching to a primary care residency, and high class ranking. A review of medical school curriculum at both schools revealed a lack of training in four public health domains. Nationally, 32% of medical students reported inadequate training in public health in the year 2006.^ These findings suggest more dedicated teaching time for public health domains is needed at the medical schools represented in this study. Finally, more research is needed to assess attainment of public health knowledge and skills for medical students nationwide if we are to meet the recommendations of the IOM. ^

US medical students' knowledge of obstetric fistula in developing countries

Obstetric fistula is a devastating child birth injury affecting millions of women worldwide. This paper explores the knowledge and understanding of medical students at the University of Texas Health Science Center at San Antonio regarding this global public health issue. Obstetric fistula has been eradicated in most industrialized nations, and has therefore faded from view of many modern medical organizations. The United Nations Population Fund has launched a “Campaign to End Fistula” in an attempt to bring global awareness to this preventable and treatable condition. Based on a survey administered to medical students at UTHSCSA, a baseline understanding of this disorder based on current curriculum is reviewed, with the objective of improving future physicians’ awareness of obstetric fistula. Despite a low survey response rate, there was a significant association between greater knowledge about causes, treatment, and complications of obstetric fistula and advanced years in medical school. However, the fourth year medical students averaged only a 70.5 percent of correct responses on the survey, indicating room for improvement in addressing this topic during medical school. ^

Knowledge of medical abortion among Brazilian medical students

OBJECTIVE: To assess the knowledge of Brazilian medical students regarding medical abortion (MA) and the use of misoprostol for MA, and to investigate factors influencing their knowledge. METHODS: All students from 3 medical schools in São Paulo State were invited to complete a pretested structured questionnaire with precoded response categories. A set of 12 statements on the use and effects of misoprostol for MA assessed their level of knowledge. Of about 1260 students invited to participate in the study, 874 completed the questionnaire, yielding a response rate of 69%. The Ï (2) test was used for the bivariate analysis, which was followed by multiple regression analysis. RESULTS: Although all students in their final year of medical school had heard of misoprostol for termination of pregnancy, and 88% reported having heard how to use it, only 8% showed satisfactory knowledge of its use and effects. Academic level was the only factor associated with the indicators of knowledge investigated. CONCLUSION: The very poor knowledge of misoprostol use for MA demonstrated by the medical students surveyed at 3 medical schools makes the review and updating of the curriculum urgently necessary.

Development and evaluation of a community based, multiagency course for medical students: descriptive survey

Objective: To develop and evaluate an effective, community based, multiagency course (involving doctors, nurses, non-health statutory workers, and voluntary organisations) for all Leicester medical students, in response to the General Medical Council’s recommendation of preparing the doctors of tomorrow to handle society’s medical problems.

A two-year experience teaching computer literacy to first-year medical students using skill-based cohorts

Because it is widely accepted that providing information online will play a major role in both the teaching and practice of medicine in the near future, a short formal course of instruction in computer skills was proposed for the incoming class of students entering medical school at the State University of New York at Stony Brook. The syllabus was developed on the basis of a set of expected outcomes, which was accepted by the dean of medicine and the curriculum committee for classes beginning in the fall of 1997. Prior to their arrival, students were asked to complete a self-assessment survey designed to elucidate their initial skill base; the returned surveys showed students to have computer skills ranging from complete novice to that of a systems engineer. The classes were taught during the first three weeks of the semester to groups of students separated on the basis of their knowledge of and comfort with computers. Areas covered included computer basics, e-mail management, MEDLINE, and Internet search tools. Each student received seven hours of hands-on training followed by a test. The syllabus and emphasis of the classes were tailored to the initial skill base but the final test was given at the same level to all students. Student participation, test scores, and course evaluations indicated that this noncredit program was successful in achieving an acceptable level of comfort in using a computer for almost all of the student body.

Text-book of organic chemistry for medical students.

Mode of access: Internet.

The peaks of medical history; an outline of the evolution of medicine for the use of medical students and practitioners,

"Bibliographical notes": p. 95-100