Rarely selected distractors in high stakes medical multiple-choice examinations and their recognition by item authors: A simulation and survey

Background Many medical exams use 5 options for multiple choice questions (MCQs), although the literature suggests that 3 options are optimal. Previous studies on this topic have often been based on non-medical examinations, so we sought to analyse rarely selected, 'non-functional' distractors (NF-D) in high stakes medical examinations, and their detection by item authors as well as psychometric changes resulting from a reduction in the number of options. Methods Based on Swiss Federal MCQ examinations from 2005-2007, the frequency of NF-D (selected by <1% or <5% of the candidates) was calculated. Distractors that were chosen the least or second least were identified and candidates who chose them were allocated to the remaining options using two extreme assumptions about their hypothetical behaviour: In case rarely selected distractors were eliminated, candidates could randomly choose another option - or purposively choose the correct answer, from which they had originally been distracted. In a second step, 37 experts were asked to mark the least plausible options. The consequences of a reduction from 4 to 3 or 2 distractors - based on item statistics or on the experts' ratings - with respect to difficulty, discrimination and reliability were modelled. Results About 70% of the 5-option-items had at least 1 NF-D selected by <1% of the candidates (97% for NF-Ds selected by <5%). Only a reduction to 2 distractors and assuming that candidates would switch to the correct answer in the absence of a 'non-functional' distractor led to relevant differences in reliability and difficulty (and to a lesser degree discrimination). The experts' ratings resulted in slightly greater changes compared to the statistical approach. Conclusions Based on item statistics and/or an expert panel's recommendation, the choice of a varying number of 3-4 (or partly 2) plausible distractors could be performed without marked deteriorations in psychometric characteristics.

Greek Economists for Reform.com

This blog publishes articles by leading academic economists on issues relevant to economic policy and reforms in Greece. The crisis in Greece is also a time of opportunity: ambitious reforms can be undertaken that will not only stave off bankruptcy, but also modernize Greece’s economy and raise the productivity and incomes of Greek citizens on a sustainable basis. The articles in this blog aim to offer constructive proposals and impartial analysis of potential, proposed or implemented reforms that are based on the principles of modern economics and on lessons from recent cutting-edge research.

Caprine PRNP polymorphisms at codons 171, 211, 222 and 240 in a Greek herd and their association with classical scrapie

The association between PRNP variation and scrapie incidence was investigated in a highly affected Greek goat herd. Four mutations were identified at codons 171Q/R, 211R/Q, 222Q/K and 240P/S. Lysine at codon 222 was found to be associated with the protection from natural scrapie (P=0.0111). Glutamine at codon 211 was observed in eight animals, all of them being scrapie-negative, indicating a possible protective role of this polymorphism although statistical analysis failed to support it (P=0.1074). A positive association (P=0.0457) between scrapie-affected goats and the wild-type Q(171)R(211)Q(222)S(240) allele is presented for the first time. In addition, a novel R(171)RQS allele, which is identical to the A(136)R(154)R(171) allele that has been associated with resistance to classical scrapie in sheep, was observed in low frequency. Resistant alleles that include K(222) and Q(211) are absent or rare in sheep and can provide the basis for the development of a feasible breeding programme for scrapie eradication in goats.