Rarely selected distractors in high stakes medical multiple-choice examinations and their recognition by item authors: A simulation and survey

Background Many medical exams use 5 options for multiple choice questions (MCQs), although the literature suggests that 3 options are optimal. Previous studies on this topic have often been based on non-medical examinations, so we sought to analyse rarely selected, 'non-functional' distractors (NF-D) in high stakes medical examinations, and their detection by item authors as well as psychometric changes resulting from a reduction in the number of options. Methods Based on Swiss Federal MCQ examinations from 2005-2007, the frequency of NF-D (selected by <1% or <5% of the candidates) was calculated. Distractors that were chosen the least or second least were identified and candidates who chose them were allocated to the remaining options using two extreme assumptions about their hypothetical behaviour: In case rarely selected distractors were eliminated, candidates could randomly choose another option - or purposively choose the correct answer, from which they had originally been distracted. In a second step, 37 experts were asked to mark the least plausible options. The consequences of a reduction from 4 to 3 or 2 distractors - based on item statistics or on the experts' ratings - with respect to difficulty, discrimination and reliability were modelled. Results About 70% of the 5-option-items had at least 1 NF-D selected by <1% of the candidates (97% for NF-Ds selected by <5%). Only a reduction to 2 distractors and assuming that candidates would switch to the correct answer in the absence of a 'non-functional' distractor led to relevant differences in reliability and difficulty (and to a lesser degree discrimination). The experts' ratings resulted in slightly greater changes compared to the statistical approach. Conclusions Based on item statistics and/or an expert panel's recommendation, the choice of a varying number of 3-4 (or partly 2) plausible distractors could be performed without marked deteriorations in psychometric characteristics.

The eight-item modified Medical Outcomes Study Social Support Survey: psychometric evaluation showed excellent performance

Evaluation and validation of the psychometric properties of the eight-item modified Medical Outcomes Study Social Support Survey (mMOS-SS).

Validation of a single item to assess daytime sleepiness for the Swiss Transplant Cohort Study

Context-Daytime sleepiness in kidney transplant recipients has emerged as a potential predictor of impaired adherence to the immunosuppressive medication regimen. Thus there is a need to assess daytime sleepiness in clinical practice and transplant registries.Objective-To evaluate the validity of a single-item measure of daytime sleepiness integrated in the Swiss Transplant Cohort Study (STCS), using the American Educational Research Association framework.Methods-Using a cross-sectional design, we enrolled a convenience sample of 926 home-dwelling kidney transplant recipients (median age, 59.69 years; 25%-75% quartile [Q25-Q75], 50.27-59.69), 63% men; median time since transplant 9.42 years (Q25-Q75, 4.93-15.85). Daytime sleepiness was assessed by using a single item from the STCS and the 8 items of the validated Epworth Sleepiness Scale. Receiver operating characteristic curve analysis was used to determine the cutoff for the STCS daytime sleepiness item against the Epworth Sleepiness Scale score.Results-Based on the receiver operating characteristic curve analysis, a score greater than 4 on the STCS daytime sleepiness item is recommended to detect daytime sleepiness. Content validity was high as all expert reviews were unanimous. Concurrent validity was moderate (Spearman ϱ, 0.531; P< .001) and convergent validity with depression and poor sleep quality although low, was significant (ϱ, 0.235; P<.001 and ϱ, 0.318, P=.002, respectively). For the group difference validity: kidney transplant recipients with moderate, severe, and extremely severe depressive symptom scores had 3.4, 4.3, and 5.9 times higher odds of having daytime sleepiness, respectively, as compared with recipients without depressive symptoms.Conclusion-The accumulated evidence provided evidence for the validity of the STCS daytime sleepiness item as a simple screening scale for daytime sleepiness.

The self-administered 24-item geriatric pain measure (GPM-24-SA): psychometric properties in three European populations of community-dwelling older adults

OBJECTIVE: To explore the feasibility and psychometric properties of a self-administered version of the 24-item Geriatric Pain Measure (GPM-24-SA). DESIGN: Secondary analysis of baseline data from the Prevention in Older People-Assessment in Generalists' practices trial, an international multi-center study of a health-risk appraisal system. PARTICIPANTS: One thousand seventy-two community dwelling nondisabled older adults self-reporting pain from London, UK; Hamburg, Germany; and Solothurn, Switzerland. OUTCOME MEASURES: GPM-24-SA as part of a multidimensional Health Risk Appraisal Questionnaire including self-reported demographic and health-related information. RESULTS: Among the 1,072 subjects, 655 had complete GPM-24-SA data, 404 had 30% missing GPM-24-SA data. In psychometric analyses across the three European populations with complete GPM-24-SA data, the measure exhibited stable internal consistency, good convergent, divergent and discriminant validity, and produced stable pain measurements. However, factor analysis indicated differences in the GPM-24-SA across sites with discrepancies mainly related to items of a single subscale that failed to load appropriately. Analyses including imputation for subjects with

Item Sum: A New Technique for Asking Quantitative Sensitive Questions

This article contributes to an ongoing debate about how to measure sensitive topics in population surveys. We propose a novel technique that can be applied to the measurement of quantitative sensitive variables: the item sum technique (IST). This method is closely related to the item count technique, which was developed for the measurement of dichotomous sensitive items. First, we provide a description of our new technique and discuss how data collected by the IST can be analyzed. Second, we present the results of a CATI survey on undeclared work in Germany, in which the IST has been applied. Using an experimental design, we compare the IST to direct questioning. Our empirical results indicate that the IST is a promising data-collection technique for sensitive questions. We conclude by discussing the limitations of the new technique and outlining possible improvements for future studies.

Entwicklung der Fünf-Item-Kurzskala STAI-SKD zur Messung von Zustandsangst

Das State-Trait-Angstinventar (STAI) ist eines der am häufigsten eingesetzten Erhebungsinstrumente im Bereich der Angstdiagnostik. Die STAI-Skala zur Erfassung von Zustandsangst umfasst 20 Items. Unter bestimmten Erhebungsbedingungen erweist es sich als relativ schwierig, eine große Menge an Items zu bearbeiten oder aber es steht nicht ausreichend Testzeit zur Verfügung. Daher war es das Ziel der vorliegenden Studie, eine Kurzform der State-Version des STAI zu entwickeln. An einer Stichprobe von N = 65 Studierenden wurde aufgrund inhaltlicher und statistischer Kriterien eine Kurzform der State-Version des STAI, das STAI-SKD, mit fünf Items generiert. Eine konfirmatorische Faktorenanalyse an einer zweiten Stichprobe von N = 191 Studierenden zeigte, dass das STAI-SKD die Angstkomponenten Emotionality und Worry abbildet. Die Beziehungen des STAI-SKD zu positivem und negativem Affekt sowie dessen Veränderungssensitivität fielen in einer dritten Stichprobe (N = 80 Studierende) erwartungsgemäß aus. Die neue Kurzform der State-Version des STAI erlaubt eine ökonomische Erfassung der Zustandsangst.