Rarely selected distractors in high stakes medical multiple-choice examinations and their recognition by item authors: A simulation and survey

Background Many medical exams use 5 options for multiple choice questions (MCQs), although the literature suggests that 3 options are optimal. Previous studies on this topic have often been based on non-medical examinations, so we sought to analyse rarely selected, 'non-functional' distractors (NF-D) in high stakes medical examinations, and their detection by item authors as well as psychometric changes resulting from a reduction in the number of options. Methods Based on Swiss Federal MCQ examinations from 2005-2007, the frequency of NF-D (selected by <1% or <5% of the candidates) was calculated. Distractors that were chosen the least or second least were identified and candidates who chose them were allocated to the remaining options using two extreme assumptions about their hypothetical behaviour: In case rarely selected distractors were eliminated, candidates could randomly choose another option - or purposively choose the correct answer, from which they had originally been distracted. In a second step, 37 experts were asked to mark the least plausible options. The consequences of a reduction from 4 to 3 or 2 distractors - based on item statistics or on the experts' ratings - with respect to difficulty, discrimination and reliability were modelled. Results About 70% of the 5-option-items had at least 1 NF-D selected by <1% of the candidates (97% for NF-Ds selected by <5%). Only a reduction to 2 distractors and assuming that candidates would switch to the correct answer in the absence of a 'non-functional' distractor led to relevant differences in reliability and difficulty (and to a lesser degree discrimination). The experts' ratings resulted in slightly greater changes compared to the statistical approach. Conclusions Based on item statistics and/or an expert panel's recommendation, the choice of a varying number of 3-4 (or partly 2) plausible distractors could be performed without marked deteriorations in psychometric characteristics.

Anomalous global effects induced by 'blind' distractors in visual hemifield defects

Previous research has revealed that a stimulus presented in the blind visual field of participants with visual hemifield defects can evoke oculomotor competition, in the absence of awareness. Here we studied three cases to determine whether a distractor in a blind hemifield would be capable of inducing a global effect, a shift of saccade endpoint when target and distractor are close to each other, in participants with lesions of the optic radiations or striate cortex. We found that blind field distractors significantly shifted saccadic endpoints in two of three participants with lesions of either the striate cortex or distal optic radiations. The direction of the effect was paradoxical, however, in that saccadic endpoints shifted away from blind field distractors, whereas endpoints shifted towards distractors in the visible hemifields, which is the normal global effect. These results provide further evidence that elements presented in the blind visual field can generate modulatory interactions in the oculomotor system, which may differ from interactions in normal vision.

Assessing distractors and teamwork during surgery: developing an event-based method for direct observation

OBJECTIVE: To develop a behavioural observation method to simultaneously assess distractors and communication/teamwork during surgical procedures through direct, on-site observations; to establish the reliability of the method for long (>3 h) procedures. METHODS: Observational categories for an event-based coding system were developed based on expert interviews, observations and a literature review. Using Cohen's κ and the intraclass correlation coefficient, interobserver agreement was assessed for 29 procedures. Agreement was calculated for the entire surgery, and for the 1st hour. In addition, interobserver agreement was assessed between two tired observers and between a tired and a non-tired observer after 3 h of surgery. RESULTS: The observational system has five codes for distractors (door openings, noise distractors, technical distractors, side conversations and interruptions), eight codes for communication/teamwork (case-relevant communication, teaching, leadership, problem solving, case-irrelevant communication, laughter, tension and communication with external visitors) and five contextual codes (incision, last stitch, personnel changes in the sterile team, location changes around the table and incidents). Based on 5-min intervals, Cohen's κ was good to excellent for distractors (0.74-0.98) and for communication/teamwork (0.70-1). Based on frequency counts, intraclass correlation coefficient was excellent for distractors (0.86-0.99) and good to excellent for communication/teamwork (0.45-0.99). After 3 h of surgery, Cohen's κ was 0.78-0.93 for distractors, and 0.79-1 for communication/teamwork. DISCUSSION: The observational method developed allows a single observer to simultaneously assess distractors and communication/teamwork. Even for long procedures, high interobserver agreement can be achieved. Data collected with this method allow for investigating separate or combined effects of distractions and communication/teamwork on surgical performance and patient outcomes.

Caloric vestibular stimulation modulates affective control and mood

BACKGROUND: Clinical evidence suggests a link between vestibular dysfunctions and mood disorders. No study has yet investigated mood and affective control during vestibular stimulation in healthy participants. OBJECTIVE: We predicted a modulating effect of caloric vestibular stimulation (CVS) on affective control measured in an affective Go/NoGo task (AGN). METHODS: Thirty-two participants performed an AGN task while they were exposed to cold left or right ear CVS (20 °C) and sham stimulation (37 °C). In each block, either positive or negative pictures (taken from the International Affective Picture System) were defined as targets. Participants had to respond to targets (Go), and withhold responses to distractors (NoGo). RESULTS: The sensitivity index d' (hits - false alarms) was used to measure affective control. Affective control improved during right ear CVS when viewing positive stimuli (P = .005), but decreased during left ear CVS when compared to sham stimulation (P = .009). CVS had a similar effect on positive mood ratings (Positive and Negative Affect Schedule). Positive mood ratings decreased during left ear CVS when compared to sham stimulation, but there was no effect after right ear CVS. DISCUSSION: The results suggest that CVS, depending on side of stimulation, has a modulating effect on mood and affective control. The results complement previous findings in manic patients and provide new evidence for the clinical potential of CVS.

Development and evaluation of a new instrument to measure visual exploration behavior

Effective visual exploration is required for many activities of daily living and instruments to assess visual exploration are important for the evaluation of the visual and the oculomotor system. In this article, the development of a new instrument to measure central and peripheral target recognition is described. The measurement setup consists of a hemispherical projection which allows presenting images over a large area of ±90° horizontal and vertical angle. In a feasibility study with 14 younger (21–49 years) and 12 older (50–78 years) test persons, 132 targets and 24 distractors were presented within naturalistic color photographs of everyday scenes at 10°, 30°, and 50° eccentricity. After the experiment, both younger and older participants reported in a questionnaire that the task is easy to understand, fun and that it measures a competence that is relevant for activities of daily living. A main result of the pilot study was that younger participants recognized more targets with smaller reaction times than older participants. The group differences were most pronounced for peripheral target detection. This test is feasible and appropriate to assess the functional field of view in younger and older adults.

Teamwork reduces physiological stress in junior surgeons

Objective: The quality of teamwork depends not only on communication skills but also on team familiarity and hierarchical structures. The aim of the present study is to evaluate the physiological impact of close teamwork between senior and junior surgeons performing elective open abdominal surgery for six months in stable teams. Methods: Physiological measurements of the main and junior surgeons were taken in a total of 40 procedures. Cumulative stress was assessed by the mea- surements of urine catecholamines (Adrenaline, Noradrenaline, Dopamine, Metanephrine, Normetanephrine). Heart rate variability was measured to assess temporal aspects of stress. The procedures were observed by a trained team of work psychologists. Direct observations of distractors, team inter- actions and communication were performed. Specific questionnaires were filled by members of the surgical team that include surgeons, nurses and anesthetists. Results: In junior surgeons, physiological stress is reduced over a period of close collaboration. Case-related communication is not stressful. However, tension within the surgical team is associated with increased levels of cat- echolamine in the urine of the senior surgeon. The difficulty of the oper- ation impacts on heart-rate variability of the junior but not of the senior surgeon. Conclusion: Junior surgeons may require months of teamwork within one stable team in order to reduce levels of physiological stress. Senior surgeons are more resistant to stressful clinical situations compared to junior surgeons but are vulnerable to tension within the surgical team.

Detecting single-target changes in multiple object tracking: The case of peripheral vision.

In sports games, it is often necessary to perceive a large number of moving objects (e.g., the ball and players). In this context, the role of peripheral vision for processing motion information in the periphery is often discussed especially when motor responses are required. In an attempt to test the basal functionality of peripheral vision in those sports-games situations, a Multiple Object Tracking (MOT) task that requires to track a certain number of targets amidst distractors, was chosen. Participants’ primary task was to recall four targets (out of 10 rectangular stimuli) after six seconds of quasi-random motion. As a second task, a button had to be pressed if a target change occurred (Exp 1: stop vs. form change to a diamond for 0.5 s; Exp 2: stop vs. slowdown for 0.5 s). While eccentricities of changes (5-10° vs. 15-20°) were manipulated, decision accuracy (recall and button press correct), motor response time as well as saccadic reaction time were calculated as dependent variables. Results show that participants indeed used peripheral vision to detect changes, because either no or very late saccades to the changed target were executed in correct trials. Moreover, a saccade was more often executed when eccentricities were small. Response accuracies were higher and response times were lower in the stop conditions of both experiments while larger eccentricities led to higher response times in all conditions. Summing up, it could be shown that monitoring targets and detecting changes can be processed by peripheral vision only and that a monitoring strategy on the basis of peripheral vision may be the optimal one as saccades may be afflicted with certain costs. Further research is planned to address the question whether this functionality is also evident in sports tasks.

Detecting single-target changes in multiple object tracking: The case of peripheral vision

In sports games, it is often necessary to perceive a large number of moving objects (e.g., the ball and players). In this context, the role of peripheral vision for processing motion information in the periphery is often discussed especially when motor responses are required. In an attempt to test the capability of using peripheral vision in those sports-games situations, a Multiple-Object-Tracking task that requires to track a certain number of targets amidst distractors, was chosen to determine the sensitivity of detecting target changes with peripheral vision only. Participants’ primary task was to recall four targets (out of 10 rectangular stimuli) after six seconds of quasi-random motion. As a second task, a button had to be pressed if a target change occurred (Exp 1: stop vs. form change to a diamond for 0.5 s; Exp 2: stop vs. slowdown for 0.5 s). Eccentricities of changes (5-10° vs. 15-20°) were manipulated, decision accuracy (recall and button press correct), motor response time and saccadic reaction time (change onset to saccade onset) were calculated and eye-movements were recorded. Results show that participants indeed used peripheral vision to detect changes, because either no or very late saccades to the changed target were executed in correct trials. Moreover, a saccade was more often executed when eccentricities were small. Response accuracies were higher and response times were lower in the stop conditions of both experiments while larger eccentricities led to higher response times in all conditions. Summing up, it could be shown that monitoring targets and detecting changes can be processed by peripheral vision only and that a monitoring strategy on the basis of peripheral vision may be the optimal one as saccades may be afflicted with certain costs. Further research is planned to address the question whether this functionality is also evident in sports tasks.

Noise peaks influence communication in the operating room. An observational study

Noise peaks are powerful distractors. This study focuses on the impact of noise peaks on surgical teams' communication during 109 long abdominal surgeries. We related measured noise peaks during 5-min intervals to the amount of observed communication during the same interval. Results show that noise peaks are associated with less case-relevant communication; this effect is moderated by the level of surgical experience; case-relevant communications decrease under high noise peak conditions among junior, but not among senior surgeons. However, case-irrelevant communication did not decrease under high noise level conditions, rather there was a trend to more case-irrelevant communication under high noise peaks. The results support the hypothesis that noise peaks impair communication because they draw on attentional resources rather than impairing understanding of communication. As case-relevant communication is important for surgical performance, exposure to high noise peaks in the OR should be minimised especially for less experienced surgeons. Practitioner Summary: This study investigated whether noise during surgeries influenced the communication within surgical teams. During abdominal surgeries, noise levels were measured and communication was observed. Results showed that high noise peaks reduced the frequency of patient-related communication, but did not reduce patient-irrelevant communication. Noise may negatively affect team coordination in surgeries.