Can a novel web-based computer test predict poor simulated driving performance? A pilot study with healthy and cognitive-impaired participants

BACKGROUND Driving a car is a complex instrumental activity of daily living and driving performance is very sensitive to cognitive impairment. The assessment of driving-relevant cognition in older drivers is challenging and requires reliable and valid tests with good sensitivity and specificity to predict safe driving. Driving simulators can be used to test fitness to drive. Several studies have found strong correlation between driving simulator performance and on-the-road driving. However, access to driving simulators is restricted to specialists and simulators are too expensive, large, and complex to allow easy access to older drivers or physicians advising them. An easily accessible, Web-based, cognitive screening test could offer a solution to this problem. The World Wide Web allows easy dissemination of the test software and implementation of the scoring algorithm on a central server, allowing generation of a dynamically growing database with normative values and ensures that all users have access to the same up-to-date normative values. OBJECTIVE In this pilot study, we present the novel Web-based Bern Cognitive Screening Test (wBCST) and investigate whether it can predict poor simulated driving performance in healthy and cognitive-impaired participants. METHODS The wBCST performance and simulated driving performance have been analyzed in 26 healthy younger and 44 healthy older participants as well as in 10 older participants with cognitive impairment. Correlations between the two tests were calculated. Also, simulated driving performance was used to group the participants into good performers (n=70) and poor performers (n=10). A receiver-operating characteristic analysis was calculated to determine sensitivity and specificity of the wBCST in predicting simulated driving performance. RESULTS The mean wBCST score of the participants with poor simulated driving performance was reduced by 52%, compared to participants with good simulated driving performance (P<.001). The area under the receiver-operating characteristic curve was 0.80 with a 95% confidence interval 0.68-0.92. CONCLUSIONS When selecting a 75% test score as the cutoff, the novel test has 83% sensitivity, 70% specificity, and 81% efficiency, which are good values for a screening test. Overall, in this pilot study, the novel Web-based computer test appears to be a promising tool for supporting clinicians in fitness-to-drive assessments of older drivers. The Web-based distribution and scoring on a central computer will facilitate further evaluation of the novel test setup. We expect that in the near future, Web-based computer tests will become a valid and reliable tool for clinicians, for example, when assessing fitness to drive in older drivers.

Impact of a stress coping strategy on perceived stress levels and performance during a simulated cardiopulmonary resuscitation: a randomized controlled trial

Background Cardiopulmonary resuscitation (CPR) causes significant stress, which may cause deficiencies in attention and increase distractibility. This may lead to misjudgements of priorities and delays in CPR performance, which may further increase mental stress (vicious cycle). This study assessed the impact of a task-focusing strategy on perceived stress levels and performance during a simulated CPR scenario. Methods This prospective, randomized-controlled trial was conducted at the simulator-center of the University Hospital Basel, Switzerland. A total of 124 volunteer medical students were randomized to receive a 10 minute instruction to cope with stress by loudly posing two taskfocusing questions (“what is the patient’s condition?”, “what immediate action is needed?”) when feeling overwhelmed by stress (intervention group) or a control group. The primary outcome was the perceived levels of stress and feeling overwhelmed (stress/overload); secondary outcomes were hands-on time, time to start CPR and number of leadership statements. Results Participants in the intervention group reported significantly less stress/overload levels compared to the control group (mean difference: -0.6 (95%CI −1.3, -0.1), p=0.04). Higher stress/overload was associated with less hands-on time. Leadership statements did not differ between groups, but the number of leadership statements did relate to performance. Hands-on time was longer in the intervention- group, but the difference was not statistically different (difference 5.5 (95%CI −3.1, 14.2), p=0.2); there were no differences in time to start CPR (difference −1.4 (95%CI −8.4, 5.7), p=0.71). Conclusions A brief stress-coping strategy moderately decreased perceived stress without significantly affecting performance in a simulated CPR. Further studies should investigate more intense interventions for reducing stress.

Manipulations to reduce simulator-related transient adverse health effects during simulated driving

User comfort during simulated driving is of key importance, since reduced comfort can confound the experiment and increase dropout rates. A common comfort-affecting factor is simulator-related transient adverse health effect (SHE). In this study, we propose and evaluate methods to adapt a virtual driving scene to reduce SHEs. In contrast to the manufacturer-provided high-sensory conflict scene (high-SCS), we developed a low-sensory conflict scene (low-SCS). Twenty young, healthy participants drove in both the high-SCS and the low-SCS scene for 10 min on two different days (same time of day, randomized order). Before and after driving, participants rated SHEs by completing the Simulator Sickness Questionnaire (SSQ). During driving, several physiological parameters were recorded. After driving in the high-SCS, the SSQ score increased in average by 129.4 (122.9 %, p = 0.002) compared to an increase of 5.0 (3.4 %, p = 0.878) after driving in the low-SCS. In the low-SCS, skin conductance decreased by 13.8 % (p < 0.01) and saccade amplitudes increased by 16.1 % (p < 0.01). Results show that the investigated methods reduce SHEs in a younger population, and the low-SCS is well accepted by the users. We expect that these measures will improve user comfort.

The role of subpolar deep water formation and Nordic Seas overflows in simulated multidecadal variability of the Atlantic meridional overturning circulation

We investigate the respective role of variations in subpolar deep water formation and Nordic Seas overflows for the decadal to multidecadal variability of the Atlantic meridional overturning circulation (AMOC). This is partly done by analysing long (order of 1000 years) control simulations with five coupled climate models. For all models, the maximum influence of variations in subpolar deep water formation is found at about 45° N, while the maximum influence of variations in Nordic Seas overflows is rather found at 55 to 60° N. Regarding the two overflow branches, the influence of variations in the Denmark Strait overflow is, for all models, substantially larger than that of variations in the overflow across the Iceland–Scotland Ridge. The latter might, however, be underestimated, as the models in general do not realistically simulate the flow path of the Iceland–Scotland overflow water south of the Iceland–Scotland Ridge. The influence of variations in subpolar deep water formation is, on multimodel average, larger than that of variations in the Denmark Strait overflow. This is true both at 45° N, where the maximum standard deviation of decadal to multidecadal AMOC variability is located for all but one model, and at the more classical latitude of 30° N. At 30° N, variations in subpolar deep water formation and Denmark Strait overflow explain, on multimodel average, about half and one-third respectively of the decadal to multidecadal AMOC variance. Apart from analysing multimodel control simulations, we have performed sensitivity experiments with one of the models, in which we suppress the variability of either subpolar deep water formation or Nordic Seas overflows. The sensitivity experiments indicate that variations in subpolar deep water formation and Nordic Seas overflows are not completely independent. We further conclude from these experiments that the decadal to multidecadal AMOC variability north of about 50° N is mainly related to variations in Nordic Seas overflows. At 45° N and south of this latitude, variations in both subpolar deep water formation and Nordic Seas overflows contribute to the AMOC variability, with neither of the processes being very dominant compared to the other.

Approaches to Ensure Quality Standards for Standardized/ Simulated Patient Performance in High Stakes Objective Structured Clinical Exams (OSCEs)

Introduction To meet the quality standards for high-stakes OSCEs, it is necessary to ensure high quality standardized performance of the SPs involved.[1] One of the ways this can be assured is through the assessment of the quality of SPs` performance in training and during the assessment. There is some literature concerning validated instruments that have been used to assess SP performance in formative contexts but very little related to high stakes contexts.[2], [3], [4]. Content and structure During this workshop different approaches to quality control for SPs` performance, developed in medicine, pharmacy and nursing OSCEs, will be introduced. Participants will have the opportunity to use these approaches in simulated interactions. Advantages and disadvantages of these approaches will be discussed. Anticipated outcomes By the end of this session, participants will be able to discuss the rationale for quality control of SPs` performance in high stakes OSCEs, outline key factors in creating strategies for quality control, identify various strategies for assuring quality control, and reflect on applications to their own practice. Who should attend The workshop is designed for those interested in quality assurance of SP performance in high stakes OSCEs. Level All levels are welcome. References Adamo G. 2003. Simulated and standardized patients in OSCEs: achievements and challenges:1992-2003. Med Teach. 25(3), 262- 270. Wind LA, Van Dalen J, Muijtjens AM, Rethans JJ. Assessing simulated patients in an educational setting: the MaSP (Maastricht Assessment of Simulated Patients). Med Educ 2004, 38(1):39-44. Bouter S, van Weel-Baumgarten E, Bolhuis S. Construction and validation of the Nijmegen Evaluation of the Simulated Patient (NESP): Assessing Simulated Patients' ability to role-play and provide feedback to students. Acad Med: Journal of the Association of American Medical Colleges 2012. May W, Fisher D, Souder D: Development of an instrument to measure the quality of standardized/simulated patient verbal feedback. Med Educ 2012, 2(1).

Quality assurance of simulated patient feedback in communication training for fourth-year medical students

Introduction In our program, simulated patients (SPs) give feedback to medical students in the course of communication skills training. To ensure effective training, quality control of the SPs’ feedback should be implemented. At other institutions, medical students evaluate the SPs’ feedback for quality control (Bouter et al., 2012). Thinking about implementing quality control for SPs’ feedback in our program, we wondered whether the evaluation by students would result in the same scores as evaluation by experts. Methods Consultations simulated by 4th-year medical students with SPs were video taped including the SP’s feedback to the students (n=85). At the end of the training sessions students rated the SPs’ performance using a rating instrument called Bernese Assessment for Role-play and Feedback (BARF) containing 11 items concerning feedback quality. Additionally the videos were evaluated by 3 trained experts using the BARF. Results The experts showed a high interrater agreement when rating identical feedbacks (ICCunjust=0.953). Comparing the rating of students and experts, high agreement was found with regard to the following items: 1. The SP invited the student to reflect on the consultation first, Amin (= minimal agreement) 97% 2. The SP asked the student what he/she liked about the consultation, Amin = 88%. 3. The SP started with positive feedback, Amin = 91%. 4. The SP was comparing the student with other students, Amin = 92%. In contrast the following items showed differences between the rating of experts and students: 1. The SP used precise situations for feedback, Amax (=maximal agreement) 55%, Students rated 67 of SPs’ feedbacks to be perfect with regard to this item (highest rating on a 5 point Likert scale), while only 29 feedbacks were rated this way by the experts. 2. The SP gave precise suggestions for improvement, Amax 75%, 62 of SPs’ feedbacks obtained the highest rating from students, while only 44 of SPs’ feedbacks achieved the highest rating in the view of the experts. 3. The SP speaks about his/her role in the third person, Amax 60%. Students rated 77 feedbacks with the highest score, while experts judged only 43 feedbacks this way. Conclusion Although evaluation by the students was in agreement with that of experts concerning some items, students rated the SPs’ feedback more often with the optimal score than experts did. Moreover it seems difficult for students to notice when SPs talk about the role in the first instead of the third person. Since precision and talking about the role in the third person are important quality criteria of feedback, this result should be taken into account when thinking about students’ evaluation of SPs’ feedback for quality control. Bouter, S., E. van Weel-Baumgarten, and S. Bolhuis. 2012. Construction and Validation of the Nijmegen Evaluation of the Simulated Patient (NESP): Assessing Simulated Patients’ Ability to Role-Play and Provide Feedback to Students. Academic Medicine: Journal of the Association of American Medical Colleges

Age-dependent visual exploration during simulated day- and night driving on a motorway: a cross-sectional study

BACKGROUND: Central and peripheral vision is needed for object detection. Previous research has shown that visual target detection is affected by age. In addition, light conditions also influence visual exploration. The aim of the study was to investigate the effects of age and different light conditions on visual exploration behavior and on driving performance during simulated driving. METHODS: A fixed-base simulator with 180 degree field of view was used to simulate a motorway route under daylight and night conditions to test 29 young subjects (25-40 years) and 27 older subjects (65-78 years). Drivers' eye fixations were analyzed and assigned to regions of interests (ROI) such as street, road signs, car ahead, environment, rear view mirror, side mirror left, side mirror right, incoming car, parked car, road repair. In addition, lane-keeping and driving speed were analyzed as a measure of driving performance. RESULTS: Older drivers had longer fixations on the task relevant ROI, but had a lower frequency of checking mirrors when compared to younger drivers. In both age groups, night driving led to a less fixations on the mirror. At the performance level, older drivers showed more variation in driving speed and lane-keeping behavior, which was especially prominent at night. In younger drivers, night driving had no impact on driving speed or lane-keeping behavior. CONCLUSIONS: Older drivers' visual exploration behavior are more fixed on the task relevant ROI, especially at night, when driving performance becomes more heterogeneous than in younger drivers.

Effect of an intervertebral disk spacer on stiffness after monocortical screw/polymethylmethacrylate fixation in simulated and cadaveric canine cervical vertebral columns.

OBJECTIVE To determine the biomechanical effect of an intervertebral spacer on construct stiffness in a PVC model and cadaveric canine cervical vertebral columns stabilized with monocortical screws/polymethylmethacrylate (PMMA). STUDY DESIGN Biomechanical study. SAMPLE POPULATION PVC pipe; cadaveric canine vertebral columns. METHODS PVC model-PVC pipe was used to create a gap model mimicking vertebral endplate orientation and disk space width of large-breed canine cervical vertebrae; 6 models had a 4-mm gap with no spacer (PVC group 1); 6 had a PVC pipe ring spacer filling the gap (PCV group 2). Animals-large breed cadaveric canine cervical vertebral columns (C2-C7) from skeletally mature dogs without (cadaveric group 1, n = 6, historical data) and with an intervertebral disk spacer (cadaveric group 2, n = 6) were used. All PVC models and cadaver specimens were instrumented with monocortical titanium screws/PMMA. Stiffness of the 2 PVC groups was compared in extension, flexion, and lateral bending using non-destructive 4-point bend testing. Stiffness testing in all 3 directions was performed of the unaltered C4-C5 vertebral motion unit in cadaveric spines and repeated after placement of an intervertebral cortical allograft ring and instrumentation. Data were compared using a linear mixed model approach that also incorporated data from previously tested spines with the same screw/PMMA construct but without disk spacer (cadaveric group 1). RESULTS Addition of a spacer increased construct stiffness in both the PVC model (P < .001) and cadaveric vertebral columns (P < .001) compared to fixation without a spacer. CONCLUSIONS Addition of an intervertebral spacer significantly increased construct stiffness of monocortical screw/PMMA fixation.