Integrating eye tracking in virtual reality for stroke rehabilitation

This thesis reports on research done for the integration of eye tracking technology into virtual reality environments, with the goal of using it in rehabilitation of patients who suffered from stroke. For the last few years, eye tracking has been a focus on medical research, used as an assistive tool  to help people with disabilities interact with new technologies  and as an assessment tool  to track the eye gaze during computer interactions. However, tracking more complex gaze behaviors and relating them to motor deficits in people with disabilities is an area that has not been fully explored, therefore it became the focal point of this research. During the research, two exploratory studies were performed in which eye tracking technology was integrated in the context of a newly created virtual reality task to assess the impact of stroke. Using an eye tracking device and a custom virtual task, the system developed is able to monitor the eye gaze pattern changes over time in patients with stroke, as well as allowing their eye gaze to function as an input for the task. Based on neuroscientific hypotheses of upper limb motor control, the studies aimed at verifying the differences in gaze patterns during the observation and execution of the virtual goal-oriented task in stroke patients (N=10), and also to assess normal gaze behavior in healthy participants (N=20). Results were found consistent and supported the hypotheses formulated, showing that eye gaze could be used as a valid assessment tool on these patients. However, the findings of this first exploratory approach are limited in order to fully understand the effect of stroke on eye gaze behavior. Therefore, a novel model-driven paradigm is proposed to further understand the relation between the neuronal mechanisms underlying goal-oriented actions and eye gaze behavior.

Library in virtual reality: An innovative way for accessing, disseminating, and sharing information

This paper focuses on Virtual Reality (VR) as a very powerful technology that can be applied to the libraries, aiming at contributing to the activities of accessing, disseminating, and sharing information. The paper presents the VR concept and describes some libraries in virtual reality under utilization in different countries. In the final considerations, it is pointed out the use of virtual reality to develop libraries as collaborative virtual environments.

An in vitro comparison of subjective image quality of panoramic views acquired via 2D or 3D imaging

Objectives: The objective of this study is to compare subjective image quality and diagnostic validity of cone-beam CT (CBCT) panoramic reformatting with digital panoramic radiographs. Materials and methods: Four dry human skulls and two formalin-fixed human heads were scanned using nine different CBCTs, one multi-slice CT (MSCT) and one standard digital panoramic device. Panoramic views were generated from CBCTs in four slice thicknesses. Seven observers scored image quality and visibility of 14 anatomical structures. Four observers repeated the observation after 4 weeks. Results: Digital panoramic radiographs showed significantly better visualization of anatomical structures except for the condyle. Statistical analysis of image quality showed that the 3D imaging modalities (CBCTs and MSCT) were 7.3 times more likely to receive poor scores than the 2D modality. Yet, image quality from NewTom VGi® and 3D Accuitomo 170® was almost equivalent to that of digital panoramic radiographs with respective odds ratio estimates of 1.2 and 1.6 at 95% Wald confidence limits. A substantial overall agreement amongst observers was found. Intra-observer agreement was moderate to substantial. Conclusions: While 2D-panoramic images are significantly better for subjective diagnosis, 2/3 of the 3D-reformatted panoramic images are moderate or good for diagnostic purposes. Clinical relevance: Panoramic reformattings from particular CBCTs are comparable to digital panoramic images concerning the overall image quality and visualization of anatomical structures. This clinically implies that a 3D-derived panoramic view can be generated for diagnosis with a recommended 20-mm slice thickness, if CBCT data is a priori available for other purposes.

Influence of Information and Instructions on Human Behavior in Tunnel Accidents: A Virtual Reality Study

Human behavior is a major factor modulating the consequences of road tunnel accidents. We investigated the effect of information and instruction on drivers' behavior as well as the usability of virtual environments to simulate such emergency situations. Tunnel safety knowledge of the general population was assessed using an online questionnaire, and tunnel safety behavior was investigated in a virtual reality experiment. Forty-four participants completed three drives through a virtual road tunnel and were confronted with a traffic jam, no event, and an accident blocking the road. Participants were randomly assigned to a control group (no intervention), an informed group who read a brochure containing safety information prior to the tunnel drives, or an informed and instructed group who read the same brochure and received additional instructions during the emergency situation. Informed participants showed better and quicker safety behavior than the control group. Self-reports of anxiety were assessed three times during each drive. Anxiety was elevated during and after the emergency situation. The findings demonstrate problematic safety behavior in the control group and that knowledge of safety information fosters adequate behavior in tunnel emergencies. Enhanced anxiety ratings during the emergency situation indicate external validity of the virtual environment.

Feeling present in arousing virtual reality worlds: prefrontal brain regions differentially orchestrate presence experience in adults and children

Virtual reality (VR) is a powerful tool for simulating aspects of the real world. The success of VR is thought to depend on its ability to evoke a sense of "being there", that is, the feeling of "Presence". In view of the rapid progress in the development of increasingly more sophisticated virtual environments (VE), the importance of understanding the neural underpinnings of presence is growing. To date however, the neural correlates of this phenomenon have received very scant attention. An fMRI-based study with 52 adults and 25 children was therefore conducted using a highly immersive VE. The experience of presence in adult subjects was found to be modulated by two major strategies involving two homologous prefrontal brain structures. Whereas the right DLPFC controlled the sense of presence by down-regulating the activation in the egocentric dorsal visual processing stream, the left DLPFC up-regulated widespread areas of the medial prefrontal cortex known to be involved in self-reflective and stimulus-independent thoughts. In contrast, there was no evidence of these two strategies in children. In fact, anatomical analyses showed that these two prefrontal areas have not yet reached full maturity in children. Taken together, this study presents the first findings that show activation of a highly specific neural network orchestrating the experience of presence in adult subjects, and that the absence of activity in this neural network might contribute to the generally increased susceptibility of children for the experience of presence in VEs.

Collaboration in 3D virtual worlds : a protocol for case study research

Three-dimensional virtual worlds have been growing fast in number of users, and are used for the most diverse purposes. In collaboration, they are used with good results due to features such as immersion, interaction capabilities, use of avatar embodiment, and physical space. In the particular cases of avatar embodiment and physical space, these features support nonverbal communication, but its impact on collaboration is not well known. In this work we present a protocol for case study research and its creation process, which aims to assert itself as a tool to collect data on how nonverbal communication influences collaboration in three-dimensional virtual worlds. We define the propositions and units of analysis, and a pilot case to validate them. Then, two cases are analysed under the created protocol. Most of the propositions found chains of evidences supporting them.

Evaluation of Virtual Reality Snowplow Simulator Training: A Literature Review, September 2006

Each winter, the Iowa Department of Transportation (Iowa DOT) maintenance operators are primarily responsible for plowing snow off federal and state roads. Drivers typically work long shifts under treacherous conditions. In addition to properly navigating the vehicle, drivers are required to operate several plowing mechanisms simultaneously, such as plow controls and salt sprayers. However, operators have few opportunities during the year to practice and refine their skills. An ideal training program would provide operators with the opportunity to practice these skills under realistic yet safe conditions, as well as provide basic training to novice or less-experienced operators. Recent technological advancements have made driving simulators a desirable training and research tool. This literature review discusses much of the recent research establishing simulator fidelity and espousing its applicability. Additionally, this report provides a summary of behavioral and eye tracking research involving driving simulators. Other research topics include comparisons between novice and expert drivers’ behavioral patterns, methods for avoiding cybersickness in virtual environments, and a synopsis of current personality measures with respect to job performance and driving performance. This literature review coincides with a study designed to examine the effectiveness of virtual reality snowplow simulator training for current maintenance operators, using the TranSim VS III truck and snowplow simulator recently purchased by the Iowa DOT.

Predictors of smoking craving during virtual reality exposure

Cue exposure treatment (CET) consists of controlled and repeated exposure to drugrelated stimuli in order to reduce cue-reactivity. Virtual reality (VR) has proved to be a promising tool for exposition. However, identifying the variables that can modulate the efficacy of this technique is essential for selecting the most appropriate exposure modality. The aim of this study was to determine the relation between several individual variables and self-reported craving in smokers exposed to VR environments. Fortysix smokers were exposed to seven complex virtual environments that reproduce typical situations in which people smoke. Self-reported craving was selected as the criterion variable and three types of variables were selected as the predictor variables: related to nicotine dependence, related to anxiety and impulsivity, and related to the sense of presence in the virtual environments. Sense of presence was the only predictor of self-reported craving in all the experimental virtual environments. Nicotine dependence variables added predictive power to the model only in the virtual breakfast at home. No relation was found between anxiety or impulsivity and self-reported craving. Virtual reality technology can be very helpful for improving CET for substance use disorders. However, the use of virtual environments would make sense only insofar as the sense of presence was high. Otherwise, the effectiveness of exposure might be affected. © 2012 by the Massachusetts Institute of Technology.

Cue-elicited anxiety and craving for food using virtual reality scenarios

Cue exposure therapy has been reported to be an effective intervention for reducing binge eating behavior in patients with eating disorders and obesity. However, in vivo food exposure conducted in the therapist's office presents logistical problems and lacks ecological validity. This study proposes the use of virtual reality technology as an alternative to in vivo exposure, and assesses the ability of different virtual environments to elicit anxiety and craving for food in a non-clinical sample. The results show that exposure to virtual environments provokes changes in reported craving for food. High-calorie food cues are the ones that elicit the highest increases in craving.

Differential effects of two virtual reality interventions: distraction versus pain control

There is evidence that virtual reality (VR) pain distraction is effective at improving pain-related outcomes. However, more research is needed to investigate VR environments with other pain-related goals. The main aim of this study was to compare the differential effects of two VR environments on a set of pain-related and cognitive variables during a cold pressor experiment. One of these environments aimed to distract attention away from pain (VRD), whereas the other was designed to enhance pain control (VRC). Participants were 77 psychology students, who were randomly assigned to one of the following three conditions during the cold pressor experiment: (a) VRD, (b) VRC, or (c) Non-VR (control condition). Data were collected regarding both pain-related variables (intensity, tolerance, threshold, time perception, and pain sensitivity range) and cognitive variables (self-efficacy and catastrophizing). Results showed that in comparison with the control condition, the VRC intervention significantly increased pain tolerance, the pain sensitivity range, and the degree of time underestimation. It also increased self-efficacy in tolerating pain and led to a reduction in reported helplessness. The VRD intervention significantly increased the pain threshold and pain tolerance in comparison with the control condition, but it did not affect any of the cognitive variables. Overall, the intervention designed to enhance control seems to have a greater effect on the cognitive variables assessed. Although these results need to be replicated in further studies, the findings suggest that the VRC intervention has considerable potential in terms of increasing self-efficacy and modifying the negative thoughts that commonly accompany pain problems.

Special Issue on Virtual Reality Technologies for Disability and Rehabilitation

The papers presented in this issue provide a glimpse of the International Conference on Disability, Virtual Reality and Associated Technologies (ICDVRAT) research community, illustrating advances in virtual reality and associated technologies facilitating interaction in physical and digital environments for individuals and practitioners in disability and rehabilitation. We hope that you will find this issue of interest and recommend this journal and use it to communicate this research to a broader public.

Minimising the latency induced by consistency control, within a large scale multi-user distributed virtual reality system

Where users are interacting in a distributed virtual environment, the actions of each user must be observed by peers with sufficient consistency and within a limited delay so as not to be detrimental to the interaction. The consistency control issue may be split into three parts: update control; consistent enactment and evolution of events; and causal consistency. The delay in the presentation of events, termed latency, is primarily dependent on the network propagation delay and the consistency control algorithms. The latency induced by the consistency control algorithm, in particular causal ordering, is proportional to the number of participants. This paper describes how the effect of network delays may be reduced and introduces a scalable solution that provides sufficient consistency control while minimising its effect on latency. The principles described have been developed at Reading over the past five years. Similar principles are now emerging in the simulation community through the HLA standard. This paper attempts to validate the suggested principles within the schema of distributed simulation and virtual environments and to compare and contrast with those described by the HLA definition documents.

A Real-time, Predictive Architecture for Distributed Virtual Reality

User interaction within a virtual environment may take various forms: a teleconferencing application will require users to speak to each other (Geak, 1993), with computer supported co-operative working; an Engineer may wish to pass an object to another user for examination; in a battle field simulation (McDonough, 1992), users might exchange fire. In all cases it is necessary for the actions of one user to be presented to the others sufficiently quickly to allow realistic interaction. In this paper we take a fresh look at the approach of virtual reality operating systems by tackling the underlying issues of creating real-time multi-user environments.