Virtual reality ultrasound imaging of the normal and abnormal fetal central nervous system

OBJECTIVES: In fetal ultrasound imaging, teaching and experience are of paramount importance to improve prenatal detection rates of fetal abnormalities. Yet both aspects depend on exposure to normal and, in particular, abnormal 'specimens'. We aimed to generate a number of simple virtual reality (VR) objects of the fetal central nervous system for use as educational tools. METHODS: We applied a recently proposed algorithm for the generation of fetal VR object movies to the normal and abnormal fetal brain and spine. Interactive VR object movies were generated from ultrasound volume data from normal fetuses and fetuses with typical brain or spine anomalies. Pathognomonic still images from all object movies were selected and annotated to enable recognition of these features in the object movies. RESULTS: Forty-six virtual reality object movies from 22 fetuses (two with normal and 20 with abnormal brains) were generated in an interactive display format (QuickTime) and key images were annotated. The resulting .mov files are available for download from the website of this journal. CONCLUSIONS: VR object movies can be generated from educational ultrasound volume datasets, and may prove useful for teaching and learning normal and abnormal fetal anatomy.

Landmark-based augmented reality system for paranasal and transnasal endoscopic surgeries

BACKGROUND: In this paper we present a landmark-based augmented reality (AR) endoscope system for endoscopic paranasal and transnasal surgeries along with fast and automatic calibration and registration procedures for the endoscope. METHODS: Preoperatively the surgeon selects natural landmarks or can define new landmarks in CT volume. These landmarks are overlaid, after proper registration of preoperative CT to the patient, on the endoscopic video stream. The specified name of the landmark, along with selected colour and its distance from the endoscope tip, is also augmented. The endoscope optics are calibrated and registered by fast and automatic methods. Accuracy of the system is evaluated in a metallic grid and cadaver set-up. RESULTS: Root mean square (RMS) error of the system is 0.8 mm in a controlled laboratory set-up (metallic grid) and was 2.25 mm during cadaver studies. CONCLUSIONS: A novel landmark-based AR endoscope system is implemented and its accuracy is evaluated. Augmented landmarks will help the surgeon to orientate and navigate the surgical field. Studies prove the capability of the system for the proposed application. Further clinical studies are planned in near future.

Reconstructive Dreams: A Pragmatic Fantastic After Postmodernism

This dissertation focuses on the use of fantastic elements in the work of a young generation of writers which explore the possibilities of literary development after and beyond postmodernism. By overtly declaring the fictionality of their fantastic stories by means of frame narratives, texts like Jonathan Safran Foer’s Everything is Illuminated (2002), Michael Chabon’s The Amazing Adventures of Kavalier and Clay (2000), Mark Danielewski’s House of Leaves (2000), David Mitchell’s number9dream (2001) and Yann Martel’s Life of Pi (2001) reassess the communicative value of genre boundaries in an attempt to move beyond postmodern relativity and breakdown of communicability. This clear focus on pragmatic concerns marks a shift in the use of the fantastic which calls for a reconsideration of some of the general critical assumptions about the workings of the mode. Though the relation between reality and fiction remains a central issue, the main concern shifts away from such epistemological and ontological considerations, towards questions concerning the pragmatic function of literary fiction in general and different genres in particular. Instead of dwelling on the typically postmodern concerns about the fictionality of reality and the instability of meaning, the works under discussion emphasise the constructive role fiction plays in dealing with reality, the uses to which it can be put and the functions it fulfils in fashioning our being in the world. Drawing on Iser’s theory of the fictive, Irmtraud Huber therefore suggests a reconceptualisation of the fantastic mode, which newly foregrounds its underlying pragmatic structure. She bring this adapted understanding to bear in a close textual analysis of the above mentioned literary texts, with the aim to account for their use of the mode in their commitment to a larger literary endeavour of a new generation that engages with the inheritance of postmodernism and struggles to come into its own.

Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study

Background: Dementia is a multifaceted disorder that impairs cognitive functions, such as memory, language, and executive functions necessary to plan, organize, and prioritize tasks required for goal-directed behaviors. In most cases, individuals with dementia experience difficulties interacting with physical and social environments. The purpose of this study was to establish ecological validity and initial construct validity of a fire evacuation Virtual Reality Day-Out Task (VR-DOT) environment based on performance profiles as a screening tool for early dementia. Objective: The objectives were (1) to examine the relationships among the performances of 3 groups of participants in the VR-DOT and traditional neuropsychological tests employed to assess executive functions, and (2) to compare the performance of participants with mild Alzheimer’s-type dementia (AD) to those with amnestic single-domain mild cognitive impairment (MCI) and healthy controls in the VR-DOT and traditional neuropsychological tests used to assess executive functions. We hypothesized that the 2 cognitively impaired groups would have distinct performance profiles and show significantly impaired independent functioning in ADL compared to the healthy controls. Methods: The study population included 3 groups: 72 healthy control elderly participants, 65 amnestic MCI participants, and 68 mild AD participants. A natural user interface framework based on a fire evacuation VR-DOT environment was used for assessing physical and cognitive abilities of seniors over 3 years. VR-DOT focuses on the subtle errors and patterns in performing everyday activities and has the advantage of not depending on a subjective rating of an individual person. We further assessed functional capacity by both neuropsychological tests (including measures of attention, memory, working memory, executive functions, language, and depression). We also evaluated performance in finger tapping, grip strength, stride length, gait speed, and chair stands separately and while performing VR-DOTs in order to correlate performance in these measures with VR-DOTs because performance while navigating a virtual environment is a valid and reliable indicator of cognitive decline in elderly persons. Results: The mild AD group was more impaired than the amnestic MCI group, and both were more impaired than healthy controls. The novel VR-DOT functional index correlated strongly with standard cognitive and functional measurements, such as mini-mental state examination (MMSE; rho=0.26, P=.01) and Bristol Activities of Daily Living (ADL) scale scores (rho=0.32, P=.001). Conclusions: Functional impairment is a defining characteristic of predementia and is partly dependent on the degree of cognitive impairment. The novel virtual reality measures of functional ability seem more sensitive to functional impairment than qualitative measures in predementia, thus accurately differentiating from healthy controls. We conclude that VR-DOT is an effective tool for discriminating predementia and mild AD from controls by detecting differences in terms of errors, omissions, and perseverations while measuring ADL functional ability.

Using virtual reality to teach special populations how to cope in crisis: the case of a virtual earthquake

The unique characteristics of special populations such as pre-school children and Down syndrome kids in crisis and their distorted self-image were never studied before, because of the difficulty of crisis reproduction. This study proposes a VR setting that tries to model some special population's behaviour in the time of crises and offers them a training scenario. The sample population consisted of 30 pre-school children and 20 children with Down syndrome. The VR setting involved a high-speed PC, a VPL EyePhone 1, a MR toolkit, a vibrations plate, a motion capture system and other sensors. The system measured and modelled the typical behaviour of these special populations in a Virtual Earthquake scenario with sight and sound and calculated a VR anthropomorphic model that reproduced their behaviour and emotional state. Afterwards one group received an emotionally enhanced VR self-image as feedback for their training, one group received a plain VR self-image and another group received verbal instructions. The findings strongly suggest that the training was a lot more biased by the emotionally enhanced VR self-image than the other approaches. These findings could highlight the special role of the self-image to therapy and training and the interesting role of imagination to emotions, motives and learning. Further studies could be done with various scenarios in order to measure the best-biased behaviour and establish the most natural and affective VR model. This presentation is going to highlight the main findings and some theories behind them.

Feeling present in arousing virtual reality worlds: prefrontal brain regions differentially orchestrate presence experience in adults and children

Virtual reality (VR) is a powerful tool for simulating aspects of the real world. The success of VR is thought to depend on its ability to evoke a sense of "being there", that is, the feeling of "Presence". In view of the rapid progress in the development of increasingly more sophisticated virtual environments (VE), the importance of understanding the neural underpinnings of presence is growing. To date however, the neural correlates of this phenomenon have received very scant attention. An fMRI-based study with 52 adults and 25 children was therefore conducted using a highly immersive VE. The experience of presence in adult subjects was found to be modulated by two major strategies involving two homologous prefrontal brain structures. Whereas the right DLPFC controlled the sense of presence by down-regulating the activation in the egocentric dorsal visual processing stream, the left DLPFC up-regulated widespread areas of the medial prefrontal cortex known to be involved in self-reflective and stimulus-independent thoughts. In contrast, there was no evidence of these two strategies in children. In fact, anatomical analyses showed that these two prefrontal areas have not yet reached full maturity in children. Taken together, this study presents the first findings that show activation of a highly specific neural network orchestrating the experience of presence in adult subjects, and that the absence of activity in this neural network might contribute to the generally increased susceptibility of children for the experience of presence in VEs.

Neural correlate of spatial presence in an arousing and noninteractive virtual reality: an EEG and psychophysiology study

Using electroencephalography (EEG), psychophysiology, and psychometric measures, this is the first study which investigated the neurophysiological underpinnings of spatial presence. Spatial presence is considered a sense of being physically situated within a spatial environment portrayed by a medium (e.g., television, virtual reality). Twelve healthy children and 11 healthy adolescents were watching different virtual roller coaster scenarios. During a control session, the roller coaster cab drove through a horizontal roundabout track. The following realistic roller coaster rides consisted of spectacular ups, downs, and loops. Low-resolution brain electromagnetic tomography (LORETA) and event-related desynchronization (ERD) were used to analyze the EEG data. As expected, we found that, compared to the control condition, experiencing a virtual roller coaster ride evoked in both groups strong SP experiences, increased electrodermal reactions, and activations in parietal brain areas known to be involved in spatial navigation. In addition, brain areas that receive homeostatic afferents from somatic and visceral sensations of the body were strongly activated. Most interesting, children (as compared to adolescents) reported higher spatial presence experiences and demonstrated a different frontal activation pattern. While adolescents showed increased activation in prefrontal areas known to be involved in the control of executive functions, children demonstrated a decreased activity in these brain regions. Interestingly, recent neuroanatomical and neurophysiological studies have shown that the frontal brain continues to develop to adult status well into adolescence. Thus, the result of our study implies that the increased spatial presence experience in children may result from the not fully developed control functions of the frontal cortex.

Virtual reality and the role of the prefrontal cortex in adults and children

In this review, the neural underpinnings of the experience of presence are outlined. Firstly, it is shown that presence is associated with activation of a distributed network, which includes the dorsal and ventral visual stream, the parietal cortex, the premotor cortex, mesial temporal areas, the brainstem and the thalamus. Secondly, the dorsolateral prefrontal cortex (DLPFC) is identified as a key node of the network as it modulates the activity of the network and the associated experience of presence. Thirdly, children lack the strong modulatory influence of the DLPFC on the network due to their unmatured frontal cortex. Fourthly, it is shown that presence-related measures are influenced by manipulating the activation in the DLPFC using transcranial direct current stimulation (tDCS) while participants are exposed to the virtual roller coaster ride. Finally, the findings are discussed in the context of current models explaining the experience of presence, the rubber hand illusion, and out-of-body experiences.