How we experience immersive virtual environments: the concept of presence and its measurement

This paper reviews the concept of presence in immersive virtual environments, the sense of being there signalled by people acting and responding realistically to virtual situations and events. We argue that presence is a unique phenomenon that must be distinguished from the degree of engagement, involvement in the portrayed environment. We argue that there are three necessary conditions for presence: the (a) consistent low latency sensorimotor loop between sensory data and proprioception; (b) statistical plausibility: images must be statistically plausible in relation to the probability distribution of images over natural scenes. A constraint on this plausibility is the level of immersion;(c) behaviour-response correlations: Presence may be enhanced and maintained over time by appropriate correlations between the state and behaviour of participants and responses within the environment, correlations that show appropriate responses to the activity of the participants. We conclude with a discussion of methods for assessing whether presence occurs, and in particular recommend the approach of comparison with ground truth and give some examples of this.

Socially anxious and confident men interact with a forward virtual woman: an experiment study

Male volunteers entered an immersive virtual reality that depicted a party, where they were approached by a lone virtual woman who initiated a conversation. The goal was to study how socially anxious and socially confident men would react to this event. Interest focused on whether the socially anxious participants would exhibit sustained anxiety during the conversation or whether this would diminish over time, and differ from the responses of the more socially confident men.

Visual realism enhances realistic response in an immersive virtual environment

Participants in an immersive virtual environment interact with the scene from an egocentric point of view that is, where there bodies appear to be located rather than from outside as if looking through a window. People interact through normal body movements, such as head-turning,reaching, and bending, and within the tracking limitations move through the environment or effect changes within it in natural ways.

Visual realism enhances realistic response in an immersive virtual environment - Part2

Does realistic lighting in an immersive virtual reality application enhance presence, where participants feel that they are in the scene and behave correspondingly? Our previous study indicated that presence is more likely with real-time ray tracing compared with ray casting, but we could not separate the effects of overall quality of illumination from the dynamic effects of real-time shadows and reflections. Here we describe an experiment where 20 people experienced a scene rendered with global or local illumination. However, in both conditions there were dynamically changing shadows and reflections. We found that the quality of illumination did not impact presence, so that the earlier result must have been due to dynamic shadows and reflections. However, global illumination resulted in greater plausibility - participants were more likely to respond as if the virtual events were real. We conclude that global illumination does impact the responses of participants and is worth the effort.

Identifying Specific Cues and Contexts Related to Smoking Craving for the Development of Effective Virtual Environments

Craving is considered the main variable associated with relapse after smoking cessation. Cue Exposure Therapy (CET) consists of controlled and repeated exposure to drug-related cues with the aim of extinguishing craving responses. Some virtual reality (VR) environments, such as virtual bars or parties, have previously shown their efficacy as tools for eliciting smoking craving. However, in order to adapt this technology to smoking cessation interventions, there is a need for more diverse environments that enhance the probability of generalization of extinction in real life. The main objective of this study was to identify frequent situations that produce smoking craving, as well as detecting specific craving cues in those contexts. Participants were 154 smokers who responded to an ad hoc self-administered inventory for assessing craving level in 12 different situations. Results showed that having a drink in a bar/pub at night, after having lunch/dinner in a restaurant and having a coffee in a cafe or after lunch/dinner at home were reported as the most craving-inducing scenarios. Some differences were found with regard to participants' gender, age, and number of cigarettes smoked per day. Females, younger people, and heavier smokers reported higher levels of craving in most situations. In general, the most widely cited specific cues across the contexts were people smoking, having a coffee, being with friends, and having finished eating. These results are discussed with a view to their consideration in the design of valid and reliable VR environments that could be used in the treatment of nicotine addicts who wish to give up smoking.

A Threat to a virtual hand elicits motor cortex activation

We report an experiment where participants observed an attack on their virtual body as experienced in an immersive virtual reality (IVR) system. Participants sat by a table with their right hand resting upon it. In IVR, they saw a virtual table that was registered with the real one, and they had a virtual body that substituted their real body seen from a first person perspective. The virtual right hand was collocated with their real right hand. Event-related brain potentials were recorded in two conditions, one where the participant"s virtual hand was attacked with a knife and a control condition where the knife only struck the virtual table. Significantly greater P450 potentials were obtained in the attack condition confirming our expectations that participants had a strong illusion of the virtual hand being their own, which was also strongly supported by questionnaire responses. Higher levels of subjective virtual hand ownership correlated with larger P450 amplitudes. Mu-rhythm event-related desynchronization in the motor cortex and readiness potential (C3-C4) negativity were clearly observed when the virtual hand was threatened as would be expected, if the real hand was threatened and the participant tried to avoid harm. Our results support the idea that event-related potentials may provide a promising non-subjective measure of virtual embodiment. They also support previous experiments on pain observation and are placed into context of similar experiments and studies of body perception and body ownership within cognitive neuroscience.

A Threat to a virtual hand elicits motor cortex activation

We report an experiment where participants observed an attack on their virtual body as experienced in an immersive virtual reality (IVR) system. Participants sat by a table with their right hand resting upon it. In IVR, they saw a virtual table that was registered with the real one, and they had a virtual body that substituted their real body seen from a first person perspective. The virtual right hand was collocated with their real right hand. Event-related brain potentials were recorded in two conditions, one where the participant"s virtual hand was attacked with a knife and a control condition where the knife only struck the virtual table. Significantly greater P450 potentials were obtained in the attack condition confirming our expectations that participants had a strong illusion of the virtual hand being their own, which was also strongly supported by questionnaire responses. Higher levels of subjective virtual hand ownership correlated with larger P450 amplitudes. Mu-rhythm event-related desynchronization in the motor cortex and readiness potential (C3-C4) negativity were clearly observed when the virtual hand was threatened as would be expected, if the real hand was threatened and the participant tried to avoid harm. Our results support the idea that event-related potentials may provide a promising non-subjective measure of virtual embodiment. They also support previous experiments on pain observation and are placed into context of similar experiments and studies of body perception and body ownership within cognitive neuroscience.

The relationship between virtual body ownership and temperature sensitivity.

In the rubber hand illusion tactile stimulation seen on a rubber hand, that is synchronous with tactile stimulation felt on the hidden real hand, can lead to an illusion of ownership over the rubber hand. This illusion has been shown to produce a temperature decrease in the hidden hand, suggesting that such illusory ownership produces disownership of the real hand. Here we apply immersive virtual reality (VR) to experimentally investigate this with respect to sensitivity to temperature change. Forty participants experienced immersion in a VR with a virtual body (VB) seen from a first person perspective. For half the participants the VB was consistent in posture and movement with their own body, and in the other half there was inconsistency. Temperature sensitivity on the palm of the hand was measured before and during the virtual experience. The results show that temperature sensitivity decreased in the consistent compared to the inconsistent condition. Moreover, the change in sensitivity was significantly correlated with the subjective illusion of virtual arm ownership but modulated by the illusion of ownership over the full virtual body. This suggests that a full body ownership illusion results in a unification of the virtual and real bodies into one overall entity - with proprioception and tactile sensations on the real body integrated with the visual presence of the virtual body. The results are interpreted in the framework of a"body matrix" recently introduced into the literature.

Measuring the effects through time of the influence of visuomotor and visuotactile synchronous stimulation on a virtual body ownership illusion

Previous studies have examined the experience of owning a virtual surrogate body or body part through specific combinations of cross-modal multisensory stimulation. Both visuomotor (VM) and visuotactile (VT) synchronous stimulation have been shown to be important for inducing a body ownership illusion, each tested separately or both in combination. In this study we compared the relative importance of these two cross-modal correlations, when both are provided in the same immersive virtual reality setup and the same experiment. We systematically manipulated VT and VM contingencies in order to assess their relative role and mutual interaction. Moreover, we present a new method for measuring the induced body ownership illusion through time, by recording reports of breaks in the illusion of ownership ("breaks") throughout the experimental phase. The balance of the evidence, from both questionnaires and analysis of the breaks, suggests that while VM synchronous stimulation contributes the greatest to the attainment of the illusion, a disruption of either (through asynchronous stimulation) contributes equally to the probability of a break in the illusion.

Clinical validation of a virtual environment for normalizing eating patterns in eating disorders

The purpose of the present study was to examine the clinical validation of a Virtual Reality Environment (VRE) designed to normalize eating patterns in Eating Disorders (ED). The efficacy of VR in eliciting emotions, sense of presence and reality of the VRE were explored in 22 ED patients and 37 healthy eating individuals. The VRE (non-immersive) consisted of a kitchen room where participants had to eat a virtual pizza. In order to assess the sense of presence and reality produced by the VRE, participants answered seven questions with a Likert scale (0-10) during the experience, and then filled out the Reality Judgment and Presence Questionnaire (RJPQ) and ITC-Sense of Presence Inventory (ITC-SOPI). The results showed that the VRE induced a sense of presence and was felt as real for both groups, without differences in the experience of 'ease' with the VRE, sense of physical space, or the ecological validity assigned to the virtual kitchen and eating virtually. However, the ED patients reported paying more attention and experiencing greater emotional involvement and dysphoria after virtual eating. The results suggest that the VRE was clinically meaningful to the ED patients and might be a relevant therapy tool for normalizing their eating patterns.

Realidade virtual e robótica em cirurgia: aonde chegamos e para onde vamos?

Minimally Invasive Surgery, Telesurgery, Robotics and Virtual Reality represent the technological frontiers that have revolutionized operating practices nowadays. These new technologies aim at improving the quality of assistance offered to patients; thus, they demand from the medical staff more effective measures as far as scientific research, training and expenditure of time and financial resources are concerned. In the past, surgeons have led several medical revolutions, such as the use of antiseptic surgical methods by Semelweiss, the use of anesthesia by Warren, antibiotic therapy, the transplants and the onset of the minimally invasive surgery by Mouret and Perissat. The objective of this article is to present the outreach of this new technology which comprises minimal access, computing, robotics and teletransmission. We have concluded that the new technologies developed in the medical field in the last decades, will offer new options and challenges for the treatment of the surgical patient, leading the scientific knowledge to a new era, the one of the virtual environment.

Virtual technology and haptic interface solutions for design and control of mobile working machines

Commercially available haptic interfaces are usable for many purposes. However, as generic devices they are not the most suitable for the control of heavy duty mobile working machines like mining machines, container handling equipment and excavators. Alternative mechanical constructions for a haptic controller are presented and analysed. A virtual reality environment (VRE) was built to test the proposed haptic controller mechanisms. Verification of an electric motor emulating a hydraulic pump in the electro-hydraulic system of a mobile working machine is carried out. A real-time simulator using multi-body-dynamics based software with hardware-in-loop (HIL) setup was used for the tests. Recommendations for further development of a haptic controller and emulator electric motor are given.

How real is movement in virtual environments ?

Mémoire numérisé par la Division de la gestion de documents et des archives de l'Université de Montréal.

El pensamiento sublime en 3D. Proyecto experimental de Instalación Museográfica Virtual

Entre los años 2005 y 2006, se realizaron en Madrid dos interesantes encuentros internacionales denominados Tecnologías para una Museografía Avanzada, promovidos por el Consejo Internacional de Museos (ICOM), donde representantes de diversas instituciones culturales explicaban las influencias enriquecedoras que han aportado a sus exposiciones los nuevos medios tecnológicos en conjunto con la didáctica y la Museografía Interactiva como elementos mediadores de discurso. Representantes y Directores de instituciones como el Museo de Historia de Valencia (MHV), el Museo Arqueológico Provincial de Alicante (MARQ) o el Museo de la Cultura Bizantina de Grecia por ejemplo, han presentado las propuestas que en este contexto les ha permitido comunicar ideas refrescantes y nuevas estrategias para la compresión de diversos tipos de patrimonios. La premisa expuesta por ellos enfatizaba el pensamiento de que las nuevas tecnologías aunadas a la Museografía Interactiva, constituyen un apoyo didáctico a la hora de transmitir significados provenientes de los objetos patrimoniales para desarrollar y ampliar la comprensión del visitante en relación a los contenidos de las exposiciones. A este respecto, llama la atención la ausencia de museos especializados en Arte ante este tipo de discursos innovadores que suelen provocar en los visitantes soluciones educativas in situ, otorgando nuevos enfoques de las cosas, de la historia, de los objetos y de las generaciones pasadas.

A distributed environment for virtual and/or real experiments for underwater robots

This paper presents the distributed environment for virtual and/or real experiments for underwater robots (DEVRE). This environment is composed of a set of processes running on a local area network composed of three sites: 1) the onboard AUV computer; 2) a surface computer used as human-machine interface (HMI); and 3) a computer used for simulating the vehicle dynamics and representing the virtual world. The HMI can be transparently linked to the real sensors and actuators dealing with a real mission. It can also be linked with virtual sensors and virtual actuators, dealing with a virtual mission. The aim of DEVRE is to assist engineers during the software development and testing in the lab prior to real experiments