Rarely selected distractors in high stakes medical multiple-choice examinations and their recognition by item authors: A simulation and survey

Background Many medical exams use 5 options for multiple choice questions (MCQs), although the literature suggests that 3 options are optimal. Previous studies on this topic have often been based on non-medical examinations, so we sought to analyse rarely selected, 'non-functional' distractors (NF-D) in high stakes medical examinations, and their detection by item authors as well as psychometric changes resulting from a reduction in the number of options. Methods Based on Swiss Federal MCQ examinations from 2005-2007, the frequency of NF-D (selected by <1% or <5% of the candidates) was calculated. Distractors that were chosen the least or second least were identified and candidates who chose them were allocated to the remaining options using two extreme assumptions about their hypothetical behaviour: In case rarely selected distractors were eliminated, candidates could randomly choose another option - or purposively choose the correct answer, from which they had originally been distracted. In a second step, 37 experts were asked to mark the least plausible options. The consequences of a reduction from 4 to 3 or 2 distractors - based on item statistics or on the experts' ratings - with respect to difficulty, discrimination and reliability were modelled. Results About 70% of the 5-option-items had at least 1 NF-D selected by <1% of the candidates (97% for NF-Ds selected by <5%). Only a reduction to 2 distractors and assuming that candidates would switch to the correct answer in the absence of a 'non-functional' distractor led to relevant differences in reliability and difficulty (and to a lesser degree discrimination). The experts' ratings resulted in slightly greater changes compared to the statistical approach. Conclusions Based on item statistics and/or an expert panel's recommendation, the choice of a varying number of 3-4 (or partly 2) plausible distractors could be performed without marked deteriorations in psychometric characteristics.

Multiple tree-ring proxies (earlywood width, latewood width and δ13C) from pedunculate oak (Quercus robur L.), Hungary

The aim of this study was to analyse the effects of climatic factors (i.e. monthly mean temperature and total precipitation) on radial growth (earlywood width, latewood width, and total ringwidth) and on latewood stable carbon isotope composition in a pedunculate oak (Quercus robur L) stand in northeastern Hungary. Earlywood widths showed the weakest common variance and lack of statistically significant relationship to monthly precipitation and temperature. Latewood width showed the strongest common chronological signal. Correlation analysis with the monthly climate series pointed out the strongest positive/negative correlation with June precipitation for latewood width/stable carbon isotope ratio. These parameters shared the strongest climatic response also for seasonal scale since the highest correlation coefficients, 0.49 and -0.62 for latewood width and stable carbon isotope ratio, respectively, were obtained for both with a 10-month precipitation total (from previous November to current August of the growing season). A combined parameter, derived as difference between latewood width and stable carbon isotope indices showed improved statistical relationship compared to the hydroclimatic calibration target both for local and regional spatial scales. Spatial correlation analysis indicated that the hydroclimatic signal encoded in these moisture sensitive tree-ring parameters from Bakta Forest is expected to be representative for the northeastern Carpathians and for the large part of the Great Hungarian Plain. In addition, the hydroclimatic signal of latewood width chronology was compared to three independent records. Results showed that neither the strength nor the rank of the similarity of the local hydroclimate signals were stable throughout the past two centuries. Future palaeo(hydro)climatological efforts targeting the Carpathian(-Balkan) region are recommended to track carefully the spatial domains for which a given, local, proxy-derived hydroclimate reconstruction might provide useful information.

Eine sozialtopographische Analyse der Wohngebiete von Nuzi

The archaeological evidence from Late Bronze Age Nuzi has ever since the publication of R.F.S. Starr’s final report in 1939 experienced few attention, leaving the interpretation of the inner structure of this extraordinarily extensively excavated settlement to a thriving philological research. This paper presents a macroscopic spatial analysis of mobile inventories in the domestic areas. Based on the comparison with stationary installations and the formal architectural structure a revised socio-topography is proposed. The combination with the evidence from the investigations of the private archives elucidates the great potential for the consideration of multiple approaches in the future research on the function, meaning and sociology of spaces in Near Eastern Archaeology.

Computerbasierte Prüfung von klinischem Denken in der klinischen Ausbildung: Ein Mixed-Method Vergleich von Key Feature Problemen mit fallbasierten Multiple Choice Typ A Fragen

Fragestellung/Einleitung: Es ist unklar inwiefern Unterschiede bestehen im Einsatz von Key Feature Problemen (KFP) mit Long Menu Fragen und fallbasierten Typ A Fragen (FTA) für die Überprüfung des klinischen Denkens (Clinical Reasoning) in der klinischen Ausbildung von Medizinstudierenden. Methoden: Medizinstudierende des fünften Studienjahres nahmen an ihrer klinischen Pädiatrie-Rotation teil, die mit einer summativen Prüfung endete. Die Überprüfung des Wissen wurde pro Prüfung elektronisch mit 6-9 KFP [1], [3], 9-20 FTA und 9-28 nichtfallbasierten Multiple Choice Fragen (NFTA) durchgeführt. Jedes KFP bestand aus einer Fallvignette und drei Key Features und nutzen ein sog. Long Menu [4] als Antwortformat. Wir untersuchten die Perzeption der KFP und FTA in Focus Gruppen [2] (n of students=39). Weiterhin wurden die statistischen Kennwerte der KFP und FTA von 11 Prüfungen (n of students=377) verglichen. Ergebnisse: Die Analyse der Fokusgruppen resultierte in vier Themen, die die Perzeption der KFP und deren Vergleich mit FTA darstellten: KFP wurden als 1. realistischer, 2. schwerer, und 3. motivierender für das intensive Selbststudium des klinischen Denkens als FTA aufgenommen und zeigten 4. insgesamt eine gute Akzeptanz sofern gewisse Voraussetzungen berücksichtigt werden. Die statistische Auswertung zeigte keinen Unterschied im Schwierigkeitsgrad; jedoch zeigten die KFP eine höhere Diskrimination und Reliabilität (G-coefficient) selbst wenn für die Prüfungszeit korrigiert wurde. Die Korrelation der verschiedenen Prüfungsteile war mittel. Diskussion/Schlussfolgerung: Die Studierenden erfuhren die KFP als motivierenden für das Selbststudium des klinischen Denkens. Statistisch zeigten die KFP eine grössere Diskrimination und höhere Relibilität als die FTA. Der Einbezug von KFP mit Long Menu in Prüfungen des klinischen Studienabschnitts erscheint vielversprechend und einen „educational effect“ zu haben.