Simple virtual reality display of fetal volume ultrasound

Three-dimensional (3D) ultrasound volume acquisition, analysis and display of fetal structures have enhanced their visualization and greatly improved the general understanding of their anatomy and pathology. The dynamic display of volume data generally depends on proprietary software, usually supplied with the ultrasound system, and on the operator's ability to maneuver the dataset digitally. We have used relatively simple tools and an established storage, display and manipulation format to generate non-linear virtual reality object movies of prenatal images (including moving sequences and 3D-rendered views) that can be navigated easily and interactively on any current computer. This approach permits a viewing or learning experience that is superior to watching a linear movie passively.

Virtual reality ultrasound imaging of the normal and abnormal fetal central nervous system

OBJECTIVES: In fetal ultrasound imaging, teaching and experience are of paramount importance to improve prenatal detection rates of fetal abnormalities. Yet both aspects depend on exposure to normal and, in particular, abnormal 'specimens'. We aimed to generate a number of simple virtual reality (VR) objects of the fetal central nervous system for use as educational tools. METHODS: We applied a recently proposed algorithm for the generation of fetal VR object movies to the normal and abnormal fetal brain and spine. Interactive VR object movies were generated from ultrasound volume data from normal fetuses and fetuses with typical brain or spine anomalies. Pathognomonic still images from all object movies were selected and annotated to enable recognition of these features in the object movies. RESULTS: Forty-six virtual reality object movies from 22 fetuses (two with normal and 20 with abnormal brains) were generated in an interactive display format (QuickTime) and key images were annotated. The resulting .mov files are available for download from the website of this journal. CONCLUSIONS: VR object movies can be generated from educational ultrasound volume datasets, and may prove useful for teaching and learning normal and abnormal fetal anatomy.

Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study

Background: Dementia is a multifaceted disorder that impairs cognitive functions, such as memory, language, and executive functions necessary to plan, organize, and prioritize tasks required for goal-directed behaviors. In most cases, individuals with dementia experience difficulties interacting with physical and social environments. The purpose of this study was to establish ecological validity and initial construct validity of a fire evacuation Virtual Reality Day-Out Task (VR-DOT) environment based on performance profiles as a screening tool for early dementia. Objective: The objectives were (1) to examine the relationships among the performances of 3 groups of participants in the VR-DOT and traditional neuropsychological tests employed to assess executive functions, and (2) to compare the performance of participants with mild Alzheimer’s-type dementia (AD) to those with amnestic single-domain mild cognitive impairment (MCI) and healthy controls in the VR-DOT and traditional neuropsychological tests used to assess executive functions. We hypothesized that the 2 cognitively impaired groups would have distinct performance profiles and show significantly impaired independent functioning in ADL compared to the healthy controls. Methods: The study population included 3 groups: 72 healthy control elderly participants, 65 amnestic MCI participants, and 68 mild AD participants. A natural user interface framework based on a fire evacuation VR-DOT environment was used for assessing physical and cognitive abilities of seniors over 3 years. VR-DOT focuses on the subtle errors and patterns in performing everyday activities and has the advantage of not depending on a subjective rating of an individual person. We further assessed functional capacity by both neuropsychological tests (including measures of attention, memory, working memory, executive functions, language, and depression). We also evaluated performance in finger tapping, grip strength, stride length, gait speed, and chair stands separately and while performing VR-DOTs in order to correlate performance in these measures with VR-DOTs because performance while navigating a virtual environment is a valid and reliable indicator of cognitive decline in elderly persons. Results: The mild AD group was more impaired than the amnestic MCI group, and both were more impaired than healthy controls. The novel VR-DOT functional index correlated strongly with standard cognitive and functional measurements, such as mini-mental state examination (MMSE; rho=0.26, P=.01) and Bristol Activities of Daily Living (ADL) scale scores (rho=0.32, P=.001). Conclusions: Functional impairment is a defining characteristic of predementia and is partly dependent on the degree of cognitive impairment. The novel virtual reality measures of functional ability seem more sensitive to functional impairment than qualitative measures in predementia, thus accurately differentiating from healthy controls. We conclude that VR-DOT is an effective tool for discriminating predementia and mild AD from controls by detecting differences in terms of errors, omissions, and perseverations while measuring ADL functional ability.

Using virtual reality to teach special populations how to cope in crisis: the case of a virtual earthquake

The unique characteristics of special populations such as pre-school children and Down syndrome kids in crisis and their distorted self-image were never studied before, because of the difficulty of crisis reproduction. This study proposes a VR setting that tries to model some special population's behaviour in the time of crises and offers them a training scenario. The sample population consisted of 30 pre-school children and 20 children with Down syndrome. The VR setting involved a high-speed PC, a VPL EyePhone 1, a MR toolkit, a vibrations plate, a motion capture system and other sensors. The system measured and modelled the typical behaviour of these special populations in a Virtual Earthquake scenario with sight and sound and calculated a VR anthropomorphic model that reproduced their behaviour and emotional state. Afterwards one group received an emotionally enhanced VR self-image as feedback for their training, one group received a plain VR self-image and another group received verbal instructions. The findings strongly suggest that the training was a lot more biased by the emotionally enhanced VR self-image than the other approaches. These findings could highlight the special role of the self-image to therapy and training and the interesting role of imagination to emotions, motives and learning. Further studies could be done with various scenarios in order to measure the best-biased behaviour and establish the most natural and affective VR model. This presentation is going to highlight the main findings and some theories behind them.

Feeling present in arousing virtual reality worlds: prefrontal brain regions differentially orchestrate presence experience in adults and children

Virtual reality (VR) is a powerful tool for simulating aspects of the real world. The success of VR is thought to depend on its ability to evoke a sense of "being there", that is, the feeling of "Presence". In view of the rapid progress in the development of increasingly more sophisticated virtual environments (VE), the importance of understanding the neural underpinnings of presence is growing. To date however, the neural correlates of this phenomenon have received very scant attention. An fMRI-based study with 52 adults and 25 children was therefore conducted using a highly immersive VE. The experience of presence in adult subjects was found to be modulated by two major strategies involving two homologous prefrontal brain structures. Whereas the right DLPFC controlled the sense of presence by down-regulating the activation in the egocentric dorsal visual processing stream, the left DLPFC up-regulated widespread areas of the medial prefrontal cortex known to be involved in self-reflective and stimulus-independent thoughts. In contrast, there was no evidence of these two strategies in children. In fact, anatomical analyses showed that these two prefrontal areas have not yet reached full maturity in children. Taken together, this study presents the first findings that show activation of a highly specific neural network orchestrating the experience of presence in adult subjects, and that the absence of activity in this neural network might contribute to the generally increased susceptibility of children for the experience of presence in VEs.

Neural correlate of spatial presence in an arousing and noninteractive virtual reality: an EEG and psychophysiology study

Using electroencephalography (EEG), psychophysiology, and psychometric measures, this is the first study which investigated the neurophysiological underpinnings of spatial presence. Spatial presence is considered a sense of being physically situated within a spatial environment portrayed by a medium (e.g., television, virtual reality). Twelve healthy children and 11 healthy adolescents were watching different virtual roller coaster scenarios. During a control session, the roller coaster cab drove through a horizontal roundabout track. The following realistic roller coaster rides consisted of spectacular ups, downs, and loops. Low-resolution brain electromagnetic tomography (LORETA) and event-related desynchronization (ERD) were used to analyze the EEG data. As expected, we found that, compared to the control condition, experiencing a virtual roller coaster ride evoked in both groups strong SP experiences, increased electrodermal reactions, and activations in parietal brain areas known to be involved in spatial navigation. In addition, brain areas that receive homeostatic afferents from somatic and visceral sensations of the body were strongly activated. Most interesting, children (as compared to adolescents) reported higher spatial presence experiences and demonstrated a different frontal activation pattern. While adolescents showed increased activation in prefrontal areas known to be involved in the control of executive functions, children demonstrated a decreased activity in these brain regions. Interestingly, recent neuroanatomical and neurophysiological studies have shown that the frontal brain continues to develop to adult status well into adolescence. Thus, the result of our study implies that the increased spatial presence experience in children may result from the not fully developed control functions of the frontal cortex.

Virtual reality and the role of the prefrontal cortex in adults and children

In this review, the neural underpinnings of the experience of presence are outlined. Firstly, it is shown that presence is associated with activation of a distributed network, which includes the dorsal and ventral visual stream, the parietal cortex, the premotor cortex, mesial temporal areas, the brainstem and the thalamus. Secondly, the dorsolateral prefrontal cortex (DLPFC) is identified as a key node of the network as it modulates the activity of the network and the associated experience of presence. Thirdly, children lack the strong modulatory influence of the DLPFC on the network due to their unmatured frontal cortex. Fourthly, it is shown that presence-related measures are influenced by manipulating the activation in the DLPFC using transcranial direct current stimulation (tDCS) while participants are exposed to the virtual roller coaster ride. Finally, the findings are discussed in the context of current models explaining the experience of presence, the rubber hand illusion, and out-of-body experiences.

The influence of parent's body mass index on peer selection: An experimental approach using virtual reality

Relatively little is known about the influence of psychosocial factors, such as familial role modeling and social network on the development and maintenance of childhood obesity. We investigated peer se- lection using an immersive virtual reality environment. In a virtual schoolyard, children were confronted with normal weight and overweight avatars either eating or playing. Fifty-seven children aged 7–13 participated. Interpersonal distance to the avatars, child's BMI, self-perception, eating behavior and parental BMI were assessed. Parental BMI was the strongest predictor for the children's minimal distance to the avatars. Specifically, a higher mothers' BMI was associated with greater interpersonal distance and children approached closer to overweight eating avatars. A higher father's BMI was associated with a lower interpersonal distance to the avatars. These children approached normal weight playing and overweight eating avatar peers closest. The importance of parental BMI for the child's social approach/ avoidance behavior can be explained through social modeling mechanisms. Differential effects of pa- ternal and maternal BMI might be due to gender specific beauty ideals. Interventions to promote social interaction with peer groups could foster weight stabilization or weight loss in children.

Seeing and identifying with a virtual body decreases pain perception

Pain and the conscious mind (or the self) are experienced in our body. Both are intimately linked to the subjective quality of conscious experience. Here, we used virtual reality technology and visuo-tactile conflicts in healthy subjects to test whether experimentally induced changes of bodily self-consciousness (self-location; self-identification) lead to changes in pain perception. We found that visuo-tactile stroking of a virtual body but not of a control object led to increased pressure pain thresholds and self-location. This increase was not modulated by the synchrony of stroking as predicted based on earlier work. This differed for self-identification where we found as predicted that synchrony of stroking increased self-identification with the virtual body (but not a control object), and positively correlated with an increase in pain thresholds. We discuss the functional mechanisms of self-identification, self-location, and the visual perception of human bodies with respect to pain perception.

An interactive surgical planning tool for acetabular fractures: initial results

Background Acetabular fractures still are among the most challenging fractures to treat because of complex anatomy, involved surgical access to fracture sites and the relatively low incidence of these lesions. Proper evaluation and surgical planning is necessary to achieve anatomic reduction of the articular surface and stable fixation of the pelvic ring. The goal of this study was to test the feasibility of preoperative surgical planning in acetabular fractures using a new prototype planning tool based on an interactive virtual reality-style environment. Methods 7 patients (5 male and 2 female; median age 53 y (25 to 92 y)) with an acetabular fracture were prospectively included. Exclusion criterions were simple wall fractures, cases with anticipated surgical dislocation of the femoral head for joint debridement and accurate fracture reduction. According to the Letournel classification 4 cases had two column fractures, 2 cases had anterior column fractures and 1 case had a T-shaped fracture including a posterior wall fracture. The workflow included following steps: (1) Formation of a patient-specific bone model from preoperative computed tomography scans, (2) interactive virtual fracture reduction with visuo-haptic feedback, (3) virtual fracture fixation using common osteosynthesis implants and (4) measurement of implant position relative to landmarks. The surgeon manually contoured osteosynthesis plates preoperatively according to the virtually defined deformation. Screenshots including all measurements for the OR were available. The tool was validated comparing the preoperative planning and postoperative results by 3D-superimposition. Results Preoperative planning was feasible in all cases. In 6 of 7 cases superimposition of preoperative planning and postoperative follow-up CT showed a good to excellent correlation. In one case part of the procedure had to be changed due to impossibility of fracture reduction from an ilioinguinal approach. In 3 cases with osteopenic bone patient-specific prebent fixation plates were helpful in guiding fracture reduction. Additionally, anatomical landmark based measurements were helpful for intraoperative navigation. Conclusion The presented prototype planning tool for pelvic surgery was successfully integrated in a clinical workflow to improve patient-specific preoperative planning, giving visual and haptic information about the injury and allowing a patient-specific adaptation of osteosynthesis implants to the virtually reduced pelvis.

A system for 3-D reconstruction of a patient-specific surface model from calibrated X-ray images

This paper presents a system for 3-D reconstruction of a patient-specific surface model from calibrated X-ray images. Our system requires two X-ray images of a patient with one acquired from the anterior-posterior direction and the other from the axial direction. A custom-designed cage is utilized in our system to calibrate both images. Starting from bone contours that are interactively identified from the X-ray images, our system constructs a patient-specific surface model of the proximal femur based on a statistical model based 2D/3D reconstruction algorithm. In this paper, we present the design and validation of the system with 25 bones. An average reconstruction error of 0.95 mm was observed.