Rarely selected distractors in high stakes medical multiple-choice examinations and their recognition by item authors: A simulation and survey

Background Many medical exams use 5 options for multiple choice questions (MCQs), although the literature suggests that 3 options are optimal. Previous studies on this topic have often been based on non-medical examinations, so we sought to analyse rarely selected, 'non-functional' distractors (NF-D) in high stakes medical examinations, and their detection by item authors as well as psychometric changes resulting from a reduction in the number of options. Methods Based on Swiss Federal MCQ examinations from 2005-2007, the frequency of NF-D (selected by <1% or <5% of the candidates) was calculated. Distractors that were chosen the least or second least were identified and candidates who chose them were allocated to the remaining options using two extreme assumptions about their hypothetical behaviour: In case rarely selected distractors were eliminated, candidates could randomly choose another option - or purposively choose the correct answer, from which they had originally been distracted. In a second step, 37 experts were asked to mark the least plausible options. The consequences of a reduction from 4 to 3 or 2 distractors - based on item statistics or on the experts' ratings - with respect to difficulty, discrimination and reliability were modelled. Results About 70% of the 5-option-items had at least 1 NF-D selected by <1% of the candidates (97% for NF-Ds selected by <5%). Only a reduction to 2 distractors and assuming that candidates would switch to the correct answer in the absence of a 'non-functional' distractor led to relevant differences in reliability and difficulty (and to a lesser degree discrimination). The experts' ratings resulted in slightly greater changes compared to the statistical approach. Conclusions Based on item statistics and/or an expert panel's recommendation, the choice of a varying number of 3-4 (or partly 2) plausible distractors could be performed without marked deteriorations in psychometric characteristics.

The eight-item modified Medical Outcomes Study Social Support Survey: psychometric evaluation showed excellent performance

Evaluation and validation of the psychometric properties of the eight-item modified Medical Outcomes Study Social Support Survey (mMOS-SS).

Comparison of inversion recovery and contrast-enhanced T1-weighted fat-suppressed sequences for the staging of cervical lymphoma

In a retrospective analysis with two readers blinded to the clinical information, coronal short tau inversion recovery (STIR) images were compared to contrast-enhanced fat-saturated T1-weighted imaging (T1 CEfs) in 51 cases of cervical lymphoma. Interrater reliability was good to excellent. Although sensitivity and subjective quality of the STIR sequence were higher than those of the T1 CEfs sequence (sensitivity 85%/72%, respectively), specificity (82%/95%) as well as positive likelihood ratio (4.65/15.93) was much lower. Therefore, contrast-enhanced sequences should be included in the primary staging of lymphoma.

Validation of a single item to assess daytime sleepiness for the Swiss Transplant Cohort Study

Context-Daytime sleepiness in kidney transplant recipients has emerged as a potential predictor of impaired adherence to the immunosuppressive medication regimen. Thus there is a need to assess daytime sleepiness in clinical practice and transplant registries.Objective-To evaluate the validity of a single-item measure of daytime sleepiness integrated in the Swiss Transplant Cohort Study (STCS), using the American Educational Research Association framework.Methods-Using a cross-sectional design, we enrolled a convenience sample of 926 home-dwelling kidney transplant recipients (median age, 59.69 years; 25%-75% quartile [Q25-Q75], 50.27-59.69), 63% men; median time since transplant 9.42 years (Q25-Q75, 4.93-15.85). Daytime sleepiness was assessed by using a single item from the STCS and the 8 items of the validated Epworth Sleepiness Scale. Receiver operating characteristic curve analysis was used to determine the cutoff for the STCS daytime sleepiness item against the Epworth Sleepiness Scale score.Results-Based on the receiver operating characteristic curve analysis, a score greater than 4 on the STCS daytime sleepiness item is recommended to detect daytime sleepiness. Content validity was high as all expert reviews were unanimous. Concurrent validity was moderate (Spearman ϱ, 0.531; P< .001) and convergent validity with depression and poor sleep quality although low, was significant (ϱ, 0.235; P<.001 and ϱ, 0.318, P=.002, respectively). For the group difference validity: kidney transplant recipients with moderate, severe, and extremely severe depressive symptom scores had 3.4, 4.3, and 5.9 times higher odds of having daytime sleepiness, respectively, as compared with recipients without depressive symptoms.Conclusion-The accumulated evidence provided evidence for the validity of the STCS daytime sleepiness item as a simple screening scale for daytime sleepiness.

Comparison of delayed gadolinium enhanced MRI of cartilage (dGEMRIC) using inversion recovery and fast T1 mapping sequences

The delayed Gadolinium Enhanced MRI of Cartilage (dGEMRIC) technique has shown promising results in pilot clinical studies of early osteoarthritis. Currently, its broader acceptance is limited by the long scan time and the need for postprocessing to calculate the T1 maps. A fast T1 mapping imaging technique based on two spoiled gradient echo images was implemented. In phantom studies, an appropriate flip angle combination optimized for center T1 of 756 to 955 ms yielded excellent agreement with T1 measured using the inversion recovery technique in the range of 200 to 900 ms, of interest in normal and diseased cartilage. In vivo validation was performed by serially imaging 26 hips using the inversion recovery and the Fast 2 angle T1 mapping techniques (center T1 756 ms). Excellent correlation with Pearson correlation coefficient R2 of 0.74 was seen and Bland-Altman plots demonstrated no systematic bias.

The self-administered 24-item geriatric pain measure (GPM-24-SA): psychometric properties in three European populations of community-dwelling older adults

OBJECTIVE: To explore the feasibility and psychometric properties of a self-administered version of the 24-item Geriatric Pain Measure (GPM-24-SA). DESIGN: Secondary analysis of baseline data from the Prevention in Older People-Assessment in Generalists' practices trial, an international multi-center study of a health-risk appraisal system. PARTICIPANTS: One thousand seventy-two community dwelling nondisabled older adults self-reporting pain from London, UK; Hamburg, Germany; and Solothurn, Switzerland. OUTCOME MEASURES: GPM-24-SA as part of a multidimensional Health Risk Appraisal Questionnaire including self-reported demographic and health-related information. RESULTS: Among the 1,072 subjects, 655 had complete GPM-24-SA data, 404 had 30% missing GPM-24-SA data. In psychometric analyses across the three European populations with complete GPM-24-SA data, the measure exhibited stable internal consistency, good convergent, divergent and discriminant validity, and produced stable pain measurements. However, factor analysis indicated differences in the GPM-24-SA across sites with discrepancies mainly related to items of a single subscale that failed to load appropriately. Analyses including imputation for subjects with

Visual vector inversion during memory antisaccades--a TMS study

In the memory antisaccade task, subjects are instructed to look at an imaginary point precisely at the opposite side of a peripheral visual stimulus presented short time previously. To perform this task accurately, the visual vector, i.e., the distance between a central fixation point and the peripheral stimulus, must be inverted from one visual hemifield to the other. Recent data in humans and monkeys suggest that the posterior parietal cortex (PPC) might be critically involved in the process of visual vector inversion. In the present study, we investigated the temporal dynamics of visual vector inversion in the human PPC by using transcranial magnetic stimulation (TMS). In six healthy subjects, single pulse TMS was applied over the right PPC during a memory antisaccade task at four different time intervals: 100 ms, 217 ms, 333 ms, or 450 ms after target onset. The results indicate that for rightward antisaccades, i.e., when the visual target was presented in the left screen-half, TMS had a significant effect on saccade gain when applied 100 ms after target onset, but not later. For leftward antisaccades, i.e., when the visual target was presented in the right screen-half, a significant TMS effect on gain was found for the 333 ms and 450 ms conditions, but not for the earlier ones. This double dissociation of saccade gain suggests that the initial process of vector inversion can be disrupted 100 ms after onset of the visual stimulus and that TMS interfered with motor saccade planning based on an inversed vector signal at 333 ms and 450 ms after stimulus onset.

KrigInv: An efficient and user-friendly implementation of batch-sequential inversion strategies based on kriging

Several strategies relying on kriging have recently been proposed for adaptively estimating contour lines and excursion sets of functions under severely limited evaluation budget. The recently released R package KrigInv 3 is presented and offers a sound implementation of various sampling criteria for those kinds of inverse problems. KrigInv is based on the DiceKriging package, and thus benefits from a number of options concerning the underlying kriging models. Six implemented sampling criteria are detailed in a tutorial and illustrated with graphical examples. Different functionalities of KrigInv are gradually explained. Additionally, two recently proposed criteria for batch-sequential inversion are presented, enabling advanced users to distribute function evaluations in parallel on clusters or clouds of machines. Finally, auxiliary problems are discussed. These include the fine tuning of numerical integration and optimization procedures used within the computation and the optimization of the considered criteria.

Net CO 2 surface emissions at Bern, Switzerland inferred from ambient observations of CO 2 , δ(O 2 /N 2 ), and 222 Rn using a customized radon tracer inversion

The 222Radon tracer method is a powerful tool to estimate local and regional surface emissions of, e.g., greenhouse gases. In this paper we demonstrate that in practice, the method as it is commonly used, produces inaccurate results in case of nonhomogeneously spread emission sources, and we propose a different approach to account for this. We have applied the new methodology to ambient observations of CO2 and 222Radon to estimate CO2 surface emissions for the city of Bern, Switzerland. Furthermore, by utilizing combined measurements of CO2 and δ(O2/N2) we obtain valuable information about the spatial and temporal variability of the main emission sources. Mean net CO2 emissions based on 2 years of observations are estimated at (11.2 ± 2.9) kt km−2 a−1. Oxidative ratios indicate a significant influence from the regional biosphere in summer/spring and fossil fuel combustion processes in winter/autumn. Our data indicate that the emissions from fossil fuels are, to a large degree, related to the combustion of natural gas which is used for heating purposes.

Item Sum: A New Technique for Asking Quantitative Sensitive Questions

This article contributes to an ongoing debate about how to measure sensitive topics in population surveys. We propose a novel technique that can be applied to the measurement of quantitative sensitive variables: the item sum technique (IST). This method is closely related to the item count technique, which was developed for the measurement of dichotomous sensitive items. First, we provide a description of our new technique and discuss how data collected by the IST can be analyzed. Second, we present the results of a CATI survey on undeclared work in Germany, in which the IST has been applied. Using an experimental design, we compare the IST to direct questioning. Our empirical results indicate that the IST is a promising data-collection technique for sensitive questions. We conclude by discussing the limitations of the new technique and outlining possible improvements for future studies.