Rarely selected distractors in high stakes medical multiple-choice examinations and their recognition by item authors: A simulation and survey

Background Many medical exams use 5 options for multiple choice questions (MCQs), although the literature suggests that 3 options are optimal. Previous studies on this topic have often been based on non-medical examinations, so we sought to analyse rarely selected, 'non-functional' distractors (NF-D) in high stakes medical examinations, and their detection by item authors as well as psychometric changes resulting from a reduction in the number of options. Methods Based on Swiss Federal MCQ examinations from 2005-2007, the frequency of NF-D (selected by <1% or <5% of the candidates) was calculated. Distractors that were chosen the least or second least were identified and candidates who chose them were allocated to the remaining options using two extreme assumptions about their hypothetical behaviour: In case rarely selected distractors were eliminated, candidates could randomly choose another option - or purposively choose the correct answer, from which they had originally been distracted. In a second step, 37 experts were asked to mark the least plausible options. The consequences of a reduction from 4 to 3 or 2 distractors - based on item statistics or on the experts' ratings - with respect to difficulty, discrimination and reliability were modelled. Results About 70% of the 5-option-items had at least 1 NF-D selected by <1% of the candidates (97% for NF-Ds selected by <5%). Only a reduction to 2 distractors and assuming that candidates would switch to the correct answer in the absence of a 'non-functional' distractor led to relevant differences in reliability and difficulty (and to a lesser degree discrimination). The experts' ratings resulted in slightly greater changes compared to the statistical approach. Conclusions Based on item statistics and/or an expert panel's recommendation, the choice of a varying number of 3-4 (or partly 2) plausible distractors could be performed without marked deteriorations in psychometric characteristics.

Stress and burnout among Swiss dental residents

Stress and burnout have been well-documented in graduate medical and undergraduate dental education, but studies among dental graduate students and residents are sparse. The purpose of this investigation was to examine perceived stressors and three dimensions of burnout among dental residents enrolled in the University of Bern, Switzerland. Thirty-six residents enrolled in five specialty programmes were administered the Graduate Dental Environment Stress (GDES30) questionnaire and the Maslach Burnout Inventory (MBI). Individual stress items and overall GDES30 scores were used to quantify perceived stress. To measure burnout, proportions of burnout "cases" and MBI subscale scores were computed in the domains of emotional exhaustion (EE), depersonalization (DP) and reduced personal accomplishment (PA). Analyses relied on descriptive and bi-variate methods. The mean GDES30 score was 2.1 (SD = 0.4). "Lack of leisure time", "meeting the research requirement of the programme" and "completing graduation requirements" emerged as the top three stressors. Thirty-six percent of respondents were burnout "cases" on the PA scale, while this proportion was 17% for EE and 8% for DP. Both stress and burnout levels increased according to year of study, whereas younger residents and females had consistently higher stress and burnout scores compared to older ones and males. Overall, low levels of perceived stress and burnout were found among this group of Swiss dental residents.

Further concerns about self-assessment: are medical students aware of their progress in clinical skills during clerkship

Background: Medical students do not accurately self-assess their competence. However, little is known about the awareness of change of competence over time. The aim of this study was to evaluate if students are aware of their progress. Summary of work: Twenty-two fourth year medical students had self- and expert-assessments of their clinical skills in musculoskeletal medicine in an OSCE like station (4 point Likert scale) at the beginning (t0) and end (t1) of their eight weeks clerkship in internal medicine. Thirteen students were assigned to the intervention of a 6x1 hour practical examination course; nine took part in the regular clinical clerkship activities only and served as controls. Summary of results/Conclusions: The intervention students significantly improved their skills (from 2.78 ± 0.36 to 3.30 ± 0.36, p<0.05) in contrast to the control students (from 3.11 ± 0.58 to 2.83 ± 0.49, n.s.). At t0, 19 students, at t1 21 out of 22 students underestimated their competence. Correlations between the change of self- and expert-assessment were r=0.43, p<0.05 (all), r=0.47, n.s. (control) and r=-0.12, n.s. (intervention), respectively. Take-home message: Medical students improving their clinical skills by an interactive course in addition to their regular clerkship activities are not aware of their progress

Simulator Network project report: a tool for improvement of teaching materials and targeted resource usage in Skills Labs

During the last decade, medical education in the German-speaking world has been striving to become more practice-oriented. This is currently being achieved in many schools through the implementation of simulation-based instruction in Skills Labs. Simulators are thus an essential part of this type of medical training, and their acquisition and operation by a Skills Lab require a large outlay of resources. Therefore, the Practical Skills Committee of the Medical Education Society (GMA) introduced a new project, which aims to improve the flow of information between the Skills Labs and enable a transparent assessment of the simulators via an online database (the Simulator Network).

Consequences of insecurity in emergency telephone consultations: an experimental study in medical students.

QUESTION UNDER STUDY Handling emergency telephone consultations (ETCs) is a challenging and very important task for doctors. The aims of the study were to document insecurity in medical students during ETCs and to identify the reasons for that insecurity. We hypothesised that insecurity is associated with advising more urgent action (e.g. advice to call for an ambulance) in ETCs. METHODS We used ETCs with simulated patients (SPs), with each student randomly allocated two of four possible cases. After the training, 137 students reported on any insecurity that they had in the various ETC phases. We analysed the reasons for insecurity using descriptive statistics. The association between the students' advice that urgent action was needed and their insecurity was analysed with Spearman rank correlation. RESULTS Overall, 95% of the students felt insecure in at least one phase of their ETC. History taking was the phase in which students felt most insecure (63.1%), followed by the phase of analysing the information given by the patient (44.9%). Perceived insecurity was associated with more urgent advice in one case scenario (abdominal pain; correlation r = 0.46; p <0.01). The other two cases (child with fever; chest pain) also had a positive, but not statistically significant, correlation trend (p <0.12; p <0.08). CONCLUSIONS Insecurity is highly prevalent among medical students in their ETC decision-making. ETC training in medical schools, with a focus on structured history taking and formulating discriminating questions, might help decrease insecurity in ETCs. Medical education should also teach management of insecurity.

Effects of geriatric clinical skills training on the attitudes of medical students.

BACKGROUND Physicians' attitudes, knowledge and skills are powerful determinants of quality of care for older patients. Previous studies found that using educational interventions to improve attitude is a difficult task. No previous study sought to determine if a skills-oriented educational intervention improved student attitudes towards elderly patients. METHODS This study evaluated the effect of a geriatric clinical skills training (CST) on attitudes of University of Bern medical students in their first year of clinical training. The geriatric CST consisted of four 2.5-hour teaching sessions that covered central domains of geriatric assessment (e.g., cognition, mobility), and a textbook used by students to self-prepare. Students' attitudes were the primary outcome, and were assessed with the 14-item University of California at Los Angeles Geriatrics Attitudes Scale (UCLA-GAS) in a quasi-randomized fashion, either before or after geriatric CST. RESULTS A total of 154 medical students participated. Students evaluated before the CST had a median UCLA-GAS overall scale of 49 (interquartile range 44-53). After the CST, the scores increased slightly, to 51 (interquartile range 47-54; median difference 2, 95% confidence interval 0-4, P = 0.062). Of the four validated UCLA-GAS subscales, only the resource distribution subscale was significantly higher in students evaluated after the geriatric CST (median difference 1, 95% confidence interval 0-2, P = 0.005). CONCLUSIONS Teaching that targets specific skills may improve the attitudes of medical students towards elderly patients, though the improvement was slight. The addition of attitude-building elements may improve the effectiveness of future skills-oriented educational interventions.

The mini-clinical evaluation exercise during medical clerkships: are learning needs and learning goals aligned?

OBJECTIVES The generation of learning goals (LGs) that are aligned with learning needs (LNs) is one of the main purposes of formative workplace-based assessment. In this study, we aimed to analyse how often trainer–student pairs identified corresponding LNs in mini-clinical evaluation exercise (mini-CEX) encounters and to what degree these LNs aligned with recorded LGs, taking into account the social environment (e.g. clinic size) in which the mini-CEX was conducted. METHODS Retrospective analyses of adapted mini-CEX forms (trainers’ and students’ assessments) completed by all Year 4 medical students during clerkships were performed. Learning needs were defined by the lowest score(s) assigned to one or more of the mini-CEX domains. Learning goals were categorised qualitatively according to their correspondence with the six mini-CEX domains (e.g. history taking, professionalism). Following descriptive analyses of LNs and LGs, multi-level logistic regression models were used to predict LGs by identified LNs and social context variables. RESULTS A total of 512 trainers and 165 students conducted 1783 mini-CEXs (98% completion rate). Concordantly, trainer–student pairs most often identified LNs in the domains of ‘clinical reasoning’ (23% of 1167 complete forms), ‘organisation/efficiency’ (20%) and ‘physical examination’ (20%). At least one ‘defined’ LG was noted on 313 student forms (18% of 1710). Of the 446 LGs noted in total, the most frequently noted were ‘physical examination’ (49%) and ‘history taking’ (21%). Corresponding LNs as well as social context factors (e.g. clinic size) were found to be predictors of these LGs. CONCLUSIONS Although trainer–student pairs often agreed in the LNs they identified, many assessments did not result in aligned LGs. The sparseness of LGs, their dependency on social context and their partial non-alignment with students’ LNs raise questions about how the full potential of the mini-CEX as not only a ‘diagnostic’ but also an ‘educational’ tool can be exploited.

An investigation into the factors that encourage learner participation in a large group medical classroom

BACKGROUND: Effective lectures often incorporate activities that encourage learner participation. A challenge for educators is how to facilitate this in the large group lecture setting. This study investigates the individual student characteristics involved in encouraging (or dissuading) learners to interact, ask questions, and make comments in class. METHODS: Students enrolled in a Doctor of Veterinary Medicine program at Ross University School of Veterinary Medicine, St Kitts, were invited to complete a questionnaire canvassing their participation in the large group classroom. Data from the questionnaire were analyzed using Excel (Microsoft, Redmond, WA, USA) and the R software environment (http://www.r-project.org/). RESULTS: One hundred and ninety-two students completed the questionnaire (response rate, 85.7%). The results showed statistically significant differences between male and female students when asked to self-report their level of participation (P=0.011) and their confidence to participate (P<0.001) in class. No statistically significant difference was identified between different age groups of students (P=0.594). Student responses reflected that an "aversion to public speaking" acted as the main deterrent to participating during a lecture. Female participants were 3.56 times more likely to report a fear of public speaking than male participants (odds ratio 3.56, 95% confidence interval 1.28-12.33, P=0.01). Students also reported "smaller sizes of class and small group activities" and "other students participating" as factors that made it easier for them to participate during a lecture. CONCLUSION: In this study, sex likely played a role in learner participation in the large group veterinary classroom. Male students were more likely to participate in class and reported feeling more confident to participate than female students. Female students in this study commonly identified aversion to public speaking as a factor which held them back from participating in the large group lecture setting. These are important findings for veterinary and medical educators aiming to improve learner participation in the classroom. Potential ways of addressing this challenge include addition of small group activities and audience response systems during lectures, and inclusion of training interventions in public speaking at an early stage of veterinary and medical curricula.

Medical educators: How they define themselves - Results of an international web survey.

BACKGROUND Little is known about medical educators' self-definition. AIMS The aim of this study is to survey an international community of medical educators focusing on the medical educators' self-definition. METHODS Within a comprehensive, web-based survey, an open question on the participants' views of how they would define a "medical educator" was sent to 2200 persons on the mailing list of the Association for Medical Education in Europe. The free text definitions were analysed using qualitative thematic analysis. RESULTS Of the, 200 medical educators invited to participate, 685 (31.1%) provided a definition of a "medical educator". The qualitative analysis of the free text definitions revealed that medical educators defined themselves in 13 roles, primarily as "Professional Expert", "Facilitator", "Information Provider", "Enthusiast", "Faculty Developer", "Mentor", "Undergraduate and Postgraduate Trainer", "Curriculum Developer", "Assessor and Assessment Creator", and "Researcher". CONCLUSIONS Our survey revealed that medical educators predominantly define themselves as "Professional Experts" and identified 12 further self-defined roles of a medical educator, several of which not to have been reported previously. The results can be used to further the understanding of our professional identity.

Undergraduate palliative care teaching in Swiss medical faculties: a nationwide survey and improved learning objectives

BACKGROUND In 2007, a first survey on undergraduate palliative care teaching in Switzerland has revealed major heterogeneity of palliative care content, allocation of hours and distribution throughout the 6 year curriculum in Swiss medical faculties. This second survey in 2012/13 has been initiated as part of the current Swiss national strategy in palliative care (2010 - 2015) to serve as a longitudinal monitoring instrument and as a basis for redefinition of palliative care learning objectives and curriculum planning in our country. METHODS As in 2007, a questionnaire was sent to the deans of all five medical faculties in Switzerland in 2012. It consisted of eight sections: basic background information, current content and hours in dedicated palliative care blocks, current palliative care content in other courses, topics related to palliative care presented in other courses, recent attempts at improving palliative care content, palliative care content in examinations, challenges, and overall summary. Content analysis was performed and the results matched with recommendations from the EAPC for undergraduate training in palliative medicine as well as with recommendations from overseas countries. RESULTS There is a considerable increase in palliative care content, academic teaching staff and hours in all medical faculties compared to 2007. No Swiss medical faculty reaches the range of 40 h dedicated specifically to palliative care as recommended by the EAPC. Topics, teaching methods, distribution throughout different years and compulsory attendance still differ widely. Based on these results, the official Swiss Catalogue of Learning Objectives (SCLO) was complemented with 12 new learning objectives for palliative and end of life care (2013), and a national basic script for palliative care was published (2015). CONCLUSION Performing periodic surveys of palliative care teaching at national medical faculties has proven to be a useful tool to adapt the national teaching framework and to improve the recognition of palliative medicine as an integral part of medical training.

The "Profiles" document: a modern revision of the objectives of undergraduate medical studies in Switzerland

The Joint Commission of the Swiss Medical Schools (SMIFK/CIMS) decided in 2000 to establish a Swiss Catalogue of Learning Objectives (SCLO) for undergraduate medical training, which was adapted from a similar Dutch blueprint. A second version of the SCLO was developed and launched in 2008. The catalogue is a prerequisite for the accreditation of the curricula of the six Swiss medical faculties and defines the contents of the Federal Licensing Examination (FLE). Given the evolution of the field of medicine and of medical education, the SMIFK/CIMS has decided to embark on a total revision of the SCLO. This article presents the proposed structure and content of Profiles, a new document which, in the future, will direct the format of undergraduate studies and of the FLE. Profiles stands for the Principal Relevant Objectives for Integrative Learning and Education in Switzerland. It is currently being developed by a group of experts from the six Swiss faculties as well as representatives of other institutions involved in these developments. The foundations of Profiles are grounded in the evolution of medical practice and of public health and are based on up-to-date teaching concepts, such as EPAs (entrustable professional activities). An introduction will cover the concepts and a tutorial will be displayed. Three main chapters will provide a description of the seven 2015 CanMEDS roles, a list of core EPAs and a series of ≈250 situations embracing the most frequent and current conditions affecting health. As Profiles is still a work in progress, it is hoped that this paper will attract the interest of all individuals involved in the training of medical students.

Publication activities of German junior researchers in academic medicine: which factors impact impact factors?

Previous studies have shown medical students in Germany to have little interest in research while at the same time there is a lack of physician scientists. This study’s aim is to investigate factors influencing publication productivity of physicians during and after finishing their medical doctorate. We conducted a PubMed search for physicians having received their doctoral degree at Ludwig-Maxmilians-University Munich Faculty of Medicine between 2011 and 2013 (N = 924) and identified the appropriate impact factor (IF) for each journal the participants had published in. Gender, age, final grade of the doctorate, participation in a structured doctoral study program and joint publication activities between graduate and academic supervisor were defined as factors. For analyses we used nonparametric procedures. Men show significantly more publications than women. Before their doctoral graduation men publish 1.98 (SD ± 3.64) articles on average, women 1.15 (±2.67) (p < 0.0001, d = 0.27). After completion of the doctorate (up to 06/2015), 40 % of men still publish, while only 24.3 % of women (p < 0.0001, φ = 0.17) continue to publish. No differences were found concerning the value of IFs. Similar results were found regarding the variable ‘participation in a structured doctoral study program’. Until doctoral graduation, program participants publish 2.82 (±5.41) articles, whereas participants doing their doctorate individually only publish 1.39 (±2.87) articles (p < 0.0001, d = 0.46). These differences persist in publication activities after graduation (45.5 vs. 29.7 %, p = 0.008, φ = 0.09). A structured doctorate seems to have positive influence on IFs (4.33 ± 2.91 vs. 3.37 ± 2.82, p = 0.006, d = 0.34). Further significant results concern the variables ‘final grade’ and ‘age’: An early doctoral graduation and an excellent or very good grade for the doctoral thesis positively influence publication productivity. Finally, joint publication activities between the graduate and his/her academic supervisor result in significantly higher IFs (3.64 ± 3.03 vs. 2.84 ± 2.25, p = 0.007, d = 0.28). The study’s results support the assumption about women’s underrepresentation in science as well as the relevance of structured doctoral study programs for preparing and recruiting young academics in medicine for scientific careers. Promoting women and further development of structured doctoral study programs are highly recommended.

Sustained impact of electronic alerts on rate of prophylaxis against venous thromboembolism

Advanced electronic alerts (eAlerts) and computerised physician order entry (CPOE) increase adequate thromboprophylaxis orders among hospitalised medical patients. It remains unclear whether eAlerts maintain their efficacy over time, after withdrawal of continuing medical education (CME) on eAlerts and on thromboprophylaxis indications from the study staff. We analysed 5,317 hospital cases from the University Hospital Zurich during 2006-2009: 1,854 cases from a medical ward with eAlerts (interventiongroup) and 3,463 cases from a surgical ward without eAlerts (controlgroup). In the intervention group, an eAlert with hospital-specific venous thromboembolism (VTE) prevention guidelines was issued in the electronic patient chart 6 hours after admission if no pharmacological or mechanical thromboprophylaxis had been ordered. Data were analysed for three phases: pre-implementation (phase 1), eAlert implementation with CME (phase 2), and post-implementation without CME (phase3). The rates of thromboprophylaxis in the intervention group were 43.4% in phase 1 and 66.7% in phase 2 (p<0.001), and increased further to 73.6% in phase3 (p=0.011). Early thromboprophylaxis orders within 12 hours after admission were more often placed in phase 2 and 3 as compared to phase 1 (67.1% vs. 52.1%, p<0.001). In the surgical control group, the thromboprophylaxis rates in the three phases were 88.6%, 90.7%, 90.6% (p=0.16). Advanced eAlerts may provide sustained efficacy over time, with stable rates of thromboprophylaxis orders among hospitalised medical patients.