Rarely selected distractors in high stakes medical multiple-choice examinations and their recognition by item authors: A simulation and survey

Background Many medical exams use 5 options for multiple choice questions (MCQs), although the literature suggests that 3 options are optimal. Previous studies on this topic have often been based on non-medical examinations, so we sought to analyse rarely selected, 'non-functional' distractors (NF-D) in high stakes medical examinations, and their detection by item authors as well as psychometric changes resulting from a reduction in the number of options. Methods Based on Swiss Federal MCQ examinations from 2005-2007, the frequency of NF-D (selected by <1% or <5% of the candidates) was calculated. Distractors that were chosen the least or second least were identified and candidates who chose them were allocated to the remaining options using two extreme assumptions about their hypothetical behaviour: In case rarely selected distractors were eliminated, candidates could randomly choose another option - or purposively choose the correct answer, from which they had originally been distracted. In a second step, 37 experts were asked to mark the least plausible options. The consequences of a reduction from 4 to 3 or 2 distractors - based on item statistics or on the experts' ratings - with respect to difficulty, discrimination and reliability were modelled. Results About 70% of the 5-option-items had at least 1 NF-D selected by <1% of the candidates (97% for NF-Ds selected by <5%). Only a reduction to 2 distractors and assuming that candidates would switch to the correct answer in the absence of a 'non-functional' distractor led to relevant differences in reliability and difficulty (and to a lesser degree discrimination). The experts' ratings resulted in slightly greater changes compared to the statistical approach. Conclusions Based on item statistics and/or an expert panel's recommendation, the choice of a varying number of 3-4 (or partly 2) plausible distractors could be performed without marked deteriorations in psychometric characteristics.

Picture Recognition of Food by Macaques (Macaca silenus)

Pictorial representations of three-dimensional objects are often used to investigate animal cognitive abilities; however, investigators rarely evaluate whether the animals conceptualize the two-dimensional image as the object it is intended to represent. We tested for picture recognition in lion-tailed macaques by presenting five monkeys with digitized images of familiar foods on a touch screen. Monkeys viewed images of two different foods and learned that they would receive a piece of the one they touched first. After demonstrating that they would reliably select images of their preferred foods on one set of foods, animals were transferred to images of a second set of familiar foods. We assumed that if the monkeys recognized the images, they would spontaneously select images of their preferred foods on the second set of foods. Three monkeys selected images of their preferred foods significantly more often than chance on their first transfer session. In an additional test of the monkeys' picture recognition abilities, animals were presented with pairs of food images containing a medium-preference food paired with either a high-preference food or a low-preference food. The same three monkeys selected the medium-preference foods significantly more often when they were paired with low-preference foods and significantly less often when those same foods were paired with high-preference foods. Our novel design provided convincing evidence that macaques recognized the content of two-dimensional images on a touch screen. Results also suggested that the animals understood the connection between the two-dimensional images and the three-dimensional objects they represented.

Melody recognition at fast and slow tempos: Effects of age, experience, and familiarity

Eighty-one listeners defined by three age ranges (18–30, 31–59, and over 60 years) and three levels of musical experience performed an immediate recognition task requiring the detection of alterations in melodies. On each trial, a brief melody was presented, followed 5 sec later by a test stimulus that either was identical to the target or had two pitches changed, for a same–different judgment. Each melody pair was presented at 0.6 note/sec, 3.0 notes/sec, or 6.0 notes/sec. Performance was better with familiar melodies than with unfamiliar melodies. Overall performance declined slightly with age and improved substantially with increasing experience, in agreement with earlier results in an identification task. Tempo affected performance on familiar tunes (moderate was best), but not on unfamiliar tunes. We discuss these results in terms of theories of dynamic attending, cognitive slowing, and working memory in aging.

Levels-of-processing effects on "remember" responses in recognition for familiar and unfamiliar tunes

We investigated the effect of level-of-processing manipulations on “remember” and “know” responses in episodic melody recognition (Experiments 1 and 2) and how this effect is modulated by item familiarity (Experiment 2). In Experiment 1, participants performed 2 conceptual and 2 perceptual orienting tasks while listening to familiar melodies: judging the mood, continuing the tune, tracing the pitch contour, and counting long notes. The conceptual mood task led to higher d' rates for “remember” but not “know” responses. In Experiment 2, participants either judged the mood or counted long notes of tunes with high and low familiarity. A level-of-processing effect emerged again in participants’ “remember” d' rates regardless of melody familiarity. Results are discussed within the distinctive processing framework.

Recognition of familiar and unfamiliar music in normal aging and Alzheimer's disease

We tested normal young and elderly adults and elderly Alzheimer’s disease (AD) patients on recognition memory for tunes. In Experiment 1, AD patients and age-matched controls received a study list and an old/new recognition test of highly familiar, traditional tunes, followed by a study list and test of novel tunes. The controls performed better than did the AD patients. The controls showed the “mirror effect” of increased hits and reduced false alarms for traditional versus novel tunes, whereas the patients false-alarmed as often to traditional tunes as to novel tunes. Experiment 2 compared young adults and healthy elderly persons using a similar design. Performance was lower in the elderly group, but both younger and older subjects showed the mirror effect. Experiment 3 produced confusion between preexperimental familiarity and intraexperimental familiarity by mixing traditional and novel tunes in the study lists and tests. Here, the subjects in both age groups resembled the patients of Experiment 1 in failing to show the mirror effect. Older subjects again performed more poorly, and they differed qualitatively from younger subjects in setting stricter criteria for more nameable tunes. Distinguishing different sources of global familiarity is a factor in tune recognition, and the data suggest that this type of source monitoring is impaired in AD and involves different strategies in younger and older adults.

Aging and experience in the recognition of musical transpositions

The authors examined the effects of age, musical experience, and characteristics of musical stimuli on a melodic short-term memory task in which participants had to recognize whether a tune was an exact transposition of another tune recently presented. Participants were musicians and nonmusicians between ages 18 and 30 or 60 and 80. In 4 experiments, the authors found that age and experience affected different aspects of the task, with experience becoming more influential when interference was provided during the task. Age and experience interacted only weakly, and neither age nor experience influenced the superiority of tonal over atonal materials. Recognition memory for the sequences did not reflect the same pattern of results as the transposition task. The implications of these results for theories of aging, experience, and music cognition are discussed.

The role of olfactory cues in the sequential radiation of a gall-boring beetle, Mordellistena convicta

1. Herbivorous insects often have close associations with specific host plants, and their preferences for mating and ovipositing on a specific host-plant species can reproductively isolate populations, facilitating ecological speciation. Volatile emissions from host plants can play a major role in assisting herbivores to locate their natal host plants and thus facilitate assortative mating and host-specific oviposition. 2. The present study investigated the role of host-plant volatiles in host fidelity and oviposition preference of the gall-boring, inquiline beetle, Mordellistena convicta LeConte (Coleoptera: Mordellidae), using Y-tube olfactometers. Previous studies suggest that the gall-boring beetle is undergoing sequential host-associated divergence by utilising the resources that are created by the diverging populations of the gall fly, Eurosta solidaginis Fitch (Diptera: Tephritidae), which induces galls on the stems of goldenrods including Solidago altissima L. (Asteraceae) and Solidago gigantea Ait. 3. Our results show that M. convicta adults are attracted to galls on their natal host plant, avoid the alternate host galls, and do not respond to volatile emissions from their host-plant stems. 4. These findings suggest that the gall-boring beetles can orient to the volatile chemicals from host galls, and that beetles can use them to identify suitable sites for mating and/or oviposition. Host-associated mating and oviposition likely play a role in the sequential radiation of the gall-boring beetle.

Olfactory function improves following hemodialysis

Olfactory function has been shown to be affected in chronic kidney disease; however, studies are contradictory and little is known on the effects of dialysis. To resolve these issues we tested olfactory function in 24 healthy controls and in 28 patients with chronic kidney disease receiving hemodialysis (20 patients) or peritoneal dialysis (the other 8). As assays for olfactory function we measured smell identification, n-butanol and acetic acid thresholds, Kt/V urea, percentage reduced urea, and weights before and after dialysis. Olfactory function was also self-rated by the participants. Compared to healthy controls, predialysis olfactory function was moderately but significantly decreased in the two dialysis groups, with hemodialysis patients being more affected. Patients self-rated olfactory function similar to that of healthy controls, suggesting that patients are unaware of the olfactory decrease. Olfactory function was significantly improved by one hemodialysis session. Neither body mass index, total volume loss, nor any other dialysis parameter correlated with olfactory function or its restitution following hemodialysis. The observed pattern of improvement suggests underlying mixed peripheral and central mechanisms. Thus, olfactory dysfunction in patients with chronic kidney disease is readily reversible by hemodialysis.

Patient adjustment to reduced olfactory function

To compare the importance of olfaction in daily life between patients with olfactory disorders and healthy normosmic individuals.