Virtual Reality zur Untersuchung neuronaler Prozesse : Entwicklung und Validierung einer adaptiven Hirn-Computer-Schnittstelle zur dynamischen Interaktion mit Virtual Reality Paradigmen

Magdeburg, Univ., Fak. für Informatik, Diss., 2013

Exploration of the visual system : Part 2. In vivo analysis methods : virtual-reality optomotor system, fundus examination and fluorescent angiography

The mouse has emerged as an animal model for many diseases. At IRO, we have used this animal to understand the development of many eye diseases and treatment of some of them. Precise evaluation of vision is a prerequisite for both these approaches. In this unit we describe three ways to measure vision: testing the optokinetic response, and evaluating the fundus by direct observation and by fluorescent angiography.

Performance on a Virtual Reality Angled Laparoscope Task Correlates with Spatial Ability of Trainees

The aim of the present study was to investigate whether trainees' performance on a virtual reality angled laparoscope navigation task correlates with scores obtained on a validated conventional test of spatial ability. 56 participants of a surgery workshop performed an angled laparoscope navigation task on the Xitact LS 500 virtual reality Simulator. Performance parameters were correlated with the score of a validated paper-and-pencil test of spatial ability. Performance at the conventional spatial ability test significantly correlated with performance at the virtual reality task for overall task score (p < 0.001), task completion time (p < 0.001) and economy of movement (p = 0.035), not for endoscope travel speed (p = 0.947). In conclusion, trainees' performance in a standardized virtual reality camera navigation task correlates with their innate spatial ability. This VR session holds potential to serve as an assessment tool for trainees.

Video Gaming in Children Improves Performance on a Virtual Reality Trainer but Does Not yet Make a Laparoscopic Surgeon.

Background: In children, video game experience improves spatial performance, a predictor of surgical performance. This study aims at comparing laparoscopic virtual reality (VR) task performance of children with different levels of experience in video games and residents. Participants and methods: A total of 32 children (8.4 to 12.1 years), 20 residents, and 14 board-certified surgeons (total n = 66) performed several VR and 2 conventional tasks (cube/spatial and pegboard/fine motor). Performance between the groups was compared (primary outcome). VR performance was correlated with conventional task performance (secondary outcome). Results: Lowest VR performance was found in children with low video game experience, followed by those with high video game experience, residents, and board-certified surgeons. VR performance correlated well with the spatial test and moderately with the fine motor test. Conclusions: The use of computer games can be considered not only as pure entertainment but may also contribute to the development of skills relevant for adequate performance in VR laparoscopic tasks. Spatial skills are relevant for VR laparoscopic task performance.

Personality traits and virtual reality performance.

BACKGROUND: Surgeons' personalities have been described as different from those of the general population, but this was based on small descriptive studies limited by the choice of evaluation instrument. Furthermore, although the importance of the human factor in team performance has been recognized, the effect of personality traits on technical performance is unknown. This study aimed to compare surgical residents' personality traits with those of the general population and to evaluate whether an association exists between their personality traits and technical performance using a virtual reality (VR) laparoscopy simulator. METHODS: In this study, 95 participants (54 residents with basic, 29 with intermediate laparoscopic experience, and 12 students) underwent personality assessment using the NEO-Five Factor Inventory and performed five VR tasks of the Lap Mentor? basic tasks module. The residents' personality traits were compared with those of the general population, and the association between VR performance and personality traits was investigated. RESULTS: Surgical residents showed personality traits different from those of the general population, demonstrating lower neuroticism, higher extraversion and conscientiousness, and male residents showed greater openness. In the multivariable analysis, adjusted for gender and surgical experience, none of the personality traits was found to be an independent predictor of technical performance. CONCLUSIONS: Surgical residents present distinct personality traits that differ from those of the general population. These traits were not found to be associated with technical performance in a virtual environment. The traits may, however, play an important role in team performance, which in turn is highly relevant for optimal surgical performance.

Assessment of construct validity of a virtual reality laparoscopy simulator.

BACKGROUND: The aim of this study was to assess whether virtual reality (VR) can discriminate between the skills of novices and intermediate-level laparoscopic surgical trainees (construct validity), and whether the simulator assessment correlates with an expert's evaluation of performance. METHODS: Three hundred and seven (307) participants of the 19th-22nd Davos International Gastrointestinal Surgery Workshops performed the clip-and-cut task on the Xitact LS 500 VR simulator (Xitact S.A., Morges, Switzerland). According to their previous experience in laparoscopic surgery, participants were assigned to the basic course (BC) or the intermediate course (IC). Objective performance parameters recorded by the simulator were compared to the standardized assessment by the course instructors during laparoscopic pelvitrainer and conventional surgery exercises. RESULTS: IC participants performed significantly better on the VR simulator than BC participants for the task completion time as well as the economy of movement of the right instrument, not the left instrument. Participants with maximum scores in the pelvitrainer cholecystectomy task performed the VR trial significantly faster, compared to those who scored less. In the conventional surgery task, a significant difference between those who scored the maximum and those who scored less was found not only for task completion time, but also for economy of movement of the right instrument. CONCLUSIONS: VR simulation provides a valid assessment of psychomotor skills and some basic aspects of spatial skills in laparoscopic surgery. Furthermore, VR allows discrimination between trainees with different levels of experience in laparoscopic surgery establishing construct validity for the Xitact LS 500 clip-and-cut task. Virtual reality may become the gold standard to assess and monitor surgical skills in laparoscopic surgery.

Evaluation of Virtual Reality Snowplow Simulator Training: A Literature Review, September 2006

Each winter, the Iowa Department of Transportation (Iowa DOT) maintenance operators are primarily responsible for plowing snow off federal and state roads. Drivers typically work long shifts under treacherous conditions. In addition to properly navigating the vehicle, drivers are required to operate several plowing mechanisms simultaneously, such as plow controls and salt sprayers. However, operators have few opportunities during the year to practice and refine their skills. An ideal training program would provide operators with the opportunity to practice these skills under realistic yet safe conditions, as well as provide basic training to novice or less-experienced operators. Recent technological advancements have made driving simulators a desirable training and research tool. This literature review discusses much of the recent research establishing simulator fidelity and espousing its applicability. Additionally, this report provides a summary of behavioral and eye tracking research involving driving simulators. Other research topics include comparisons between novice and expert drivers’ behavioral patterns, methods for avoiding cybersickness in virtual environments, and a synopsis of current personality measures with respect to job performance and driving performance. This literature review coincides with a study designed to examine the effectiveness of virtual reality snowplow simulator training for current maintenance operators, using the TranSim VS III truck and snowplow simulator recently purchased by the Iowa DOT.

Evaluation of Virtual Reality Snowplow Simulator Training, January 2007

Each winter, Iowa Department of Transportation (Iowa DOT) maintenance operators are responsible for plowing snow off federal and state roads in Iowa. Drivers typically work long shifts under treacherous conditions. In addition to properly navigating the vehicle, drivers are required to operate several plowing mechanisms simultaneously, such as plow controls and salt spreaders. There is little opportunity for practicing these skills in real-world situations. A virtual reality training program would provide operators with the opportunity to practice these skills under realistic yet safe conditions, as well as provide basic training to novice or less-experienced operators. In order to provide such training to snowplow operators in Iowa, the Iowa DOT purchased a snowplow simulator. The Iowa DOT commissioned a study through Iowa State University designed to (1) assess the use of this simulator as a training tool and (2) examine personality and other characteristics associated with being an experienced snowplow operator. The results of this study suggest that Iowa DOT operators of all ages and levels of experience enjoyed and seemed to benefit from virtual reality snowplow simulator training. Simulator sickness ratings were relatively low, implying that the simulator is appropriate for training a wide range of Iowa DOT operators. Many reported that simulator training was the most useful aspect of training for them.

Access to a simulator is not enough: the benefits of virtual reality training based on peer-group-derived benchmarks--a randomized controlled trial.

BACKGROUND: Virtual reality (VR) simulators are widely used to familiarize surgical novices with laparoscopy, but VR training methods differ in efficacy. In the present trial, self-controlled basic VR training (SC-training) was tested against training based on peer-group-derived benchmarks (PGD-training). METHODS: First, novice laparoscopic residents were randomized into a SC group (n = 34), and a group using PGD-benchmarks (n = 34) for basic laparoscopic training. After completing basic training, both groups performed 60 VR laparoscopic cholecystectomies for performance analysis. Primary endpoints were simulator metrics; secondary endpoints were program adherence, trainee motivation, and training efficacy. RESULTS: Altogether, 66 residents completed basic training, and 3,837 of 3,960 (96.8 %) cholecystectomies were available for analysis. Course adherence was good, with only two dropouts, both in the SC-group. The PGD-group spent more time and repetitions in basic training until the benchmarks were reached and subsequently showed better performance in the readout cholecystectomies: Median time (gallbladder extraction) showed significant differences of 520 s (IQR 354-738 s) in SC-training versus 390 s (IQR 278-536 s) in the PGD-group (p < 0.001) and 215 s (IQR 175-276 s) in experts, respectively. Path length of the right instrument also showed significant differences, again with the PGD-training group being more efficient. CONCLUSIONS: Basic VR laparoscopic training based on PGD benchmarks with external assessment is superior to SC training, resulting in higher trainee motivation and better performance in simulated laparoscopic cholecystectomies. We recommend such a basic course based on PGD benchmarks before advancing to more elaborate VR training.

Acting Rehearsal in Collaborative Multimodal Mixed Reality Environments

This paper presents the use of our multimodal mixed reality telecommunication system to support remote acting rehearsal. The rehearsals involved two actors, located in London and Barcelona, and a director in another location in London. This triadic audiovisual telecommunication was performed in a spatial and multimodal collaborative mixed reality environment based on the 'destination-visitor' paradigm, which we define and put into use. We detail our heterogeneous system architecture, which spans the three distributed and technologically asymmetric sites, and features a range of capture, display, and transmission technologies. The actors' and director's experience of rehearsing a scene via the system are then discussed, exploring successes and failures of this heterogeneous form of telecollaboration. Overall, the common spatial frame of reference presented by the system to all parties was highly conducive to theatrical acting and directing, allowing blocking, gross gesture, and unambiguous instruction to be issued. The relative inexpressivity of the actors' embodiments was identified as the central limitation of the telecommunication, meaning that moments relying on performing and reacting to consequential facial expression and subtle gesture were less successful.

Acting rehearsal in collaborative multimodal mixed reality environments

This paper presents the use of our multimodal mixed reality telecommunication system to support remote acting rehearsal. The rehearsals involved two actors, located in London and Barcelona, and a director in another location in London. This triadic audiovisual telecommunication was performed in a spatial and multimodal collaborative mixed reality environment based on the 'destination-visitor' paradigm, which we define and put into use. We detail our heterogeneous system architecture, which spans the three distributed and technologically asymmetric sites, and features a range of capture, display, and transmission technologies. The actors' and director's experience of rehearsing a scene via the system are then discussed, exploring successes and failures of this heterogeneous form of telecollaboration. Overall, the common spatial frame of reference presented by the system to all parties was highly conducive to theatrical acting and directing, allowing blocking, gross gesture, and unambiguous instruction to be issued. The relative inexpressivity of the actors' embodiments was identified as the central limitation of the telecommunication, meaning that moments relying on performing and reacting to consequential facial expression and subtle gesture were less successful.

Impact of examinees' stereopsis and near visual acuity on laparoscopic virtual reality performance.

PURPOSE: Laparoscopic surgery represents specific challenges, such as the reduction of a three-dimensional anatomic environment to two dimensions. The aim of this study was to investigate the impact of the loss of the third dimension on laparoscopic virtual reality (VR) performance. METHODS: We compared a group of examinees with impaired stereopsis (group 1, n = 28) to a group with accurate stereopsis (group 2, n = 29). The primary outcome was the difference between the mean total score (MTS) of all tasks taken together and the performance in task 3 (eye-hand coordination), which was a priori considered to be the most dependent on intact stereopsis. RESULTS: The MTS and performance in task 3 tended to be slightly, but not significantly, better in group 2 than in group 1 [MTS: -0.12 (95 % CI -0.32, 0.08; p = 0.234); task 3: -0.09 (95 % CI -0.29, 0.11; p = 0.385)]. The difference of MTS between simulated impaired stereopsis between group 2 (by attaching an eye patch on the adominant eye in the 2nd run) and the first run of group 1 was not significant (MTS: p = 0.981; task 3: p = 0.527). CONCLUSION: We were unable to demonstrate an impact of impaired examinees' stereopsis on laparoscopic VR performance. Individuals with accurate stereopsis seem to be able to compensate for the loss of the third dimension in laparoscopic VR simulations.

How to report multiple outcome metrics in virtual reality simulation

Background Virtual reality (VR) simulation is increasingly used in surgical disciplines. Since VR simulators measure multiple outcomes, standardized reporting is needed. Methods We present an algorithm for combining multiple VR outcomes into dimension summary measures, which are then integrated into a meaningful total score. We reanalyzed the data of two VR studies applying the algorithm. Results The proposed algorithm was successfully applied to both VR studies. Conclusions The algorithm contributes to standardized and transparent reporting in VR-related research.

How soccer players head the ball: a test of optic acceleration cancellation theory with virtual reality

We measured the movements of soccer players heading a football in a fully immersive virtual reality environment. In mid-flight the ball’s trajectory was altered from its normal quasi-parabolic path to a linear one, producing a jump in the rate of change of the angle of elevation of gaze (α) from player to ball. One reaction time later the players adjusted their speed so that the rate of change of α increased when it had been reduced and reduced it when it had been increased. Since the result of the player’s movement was to regain a value of the rate of change close to that before the disturbance, the data suggest that the players have an expectation of, and memory for, the pattern that the rate of change of α will follow during the flight. The results support the general claim that players intercepting balls use servo control strategies and are consistent with the particular claim of Optic Acceleration Cancellation theory that the servo strategy is to allow α to increase at a steadily decreasing rate.