Effects of P300-based BCI use on reported presence in a virtual environment

Brain-computer interfaces (BCIs) are becoming more and more popular as an input device for virtual worlds and computer games. Depending on their function, a major drawback is the mental workload associated with their use and there is significant effort and training required to effectively control them. In this paper, we present two studies assessing how mental workload of a P300-based BCI affects participants" reported sense of presence in a virtual environment (VE). In the first study, we employ a BCI exploiting the P300 event-related potential (ERP) that allows control of over 200 items in a virtual apartment. In the second study, the BCI is replaced by a gaze-based selection method coupled with wand navigation. In both studies, overall performance is measured and individual presence scores are assessed by means of a short questionnaire. The results suggest that there is no immediate benefit for visualizing events in the VE triggered by the BCI and that no learning about the layout of the virtual space takes place. In order to alleviate this, we propose that future P300-based BCIs in VR are set up so as require users to make some inference about the virtual space so that they become aware of it,which is likely to lead to higher reported presence.

The contribution of real-time mirror reflections of motor actions on virtual body ownership in an immersive virtual environment

This paper reports an experiment that investigated people"s body ownership of an avatar that was observed in a virtual mirror. Twenty subjects were recruited in a within-groups study where 10 first experienced a virtual character that synchronously reflected their upper-body movements as seen in a virtual mirror, and then an asynchronous condition where the mirror avatar displayed prerecorded actions, unrelated to those of the participant. The other 10 subjects experienced the conditions in the opposite order. In both conditions the participant could carry out actions that led to elevation above ground level, as seen from their first person perspective and correspondingly in the mirror. A rotating virtual fan eventually descended to 2m above the ground. The hypothesis was that synchronous mirror reflection would result in higher subjective sense of ownership. A questionnaire analysis showed that the body ownership illusion was significantly greater for thesynchronous than asynchronous condition. Additionally participants in the synchronous condition avoided collision with the descending fan significantly more often than those in the asynchronous condition. The results of this experiment are put into context within similar experiments on multisensory correlation and body ownership within cognitive neuroscience.

Bystander responses to a violent incident in an immersive virtual environment

Under what conditions will a bystander intervene to try to stop a violent attack by one person on another? It is generally believed that the greater the size of the crowd of bystanders, the less the chance that any of them will intervene. A complementary model is that social identity is critical as an explanatory variable. For example, when the bystander shares common social identity with the victim the probability of intervention is enhanced, other things being equal. However, it is generally not possible to study such hypotheses experimentally for practical and ethical reasons. Here we show that an experiment that depicts a violent incident at life-size in immersive virtual reality lends support to the social identity explanation. 40 male supporters of Arsenal Football Club in England were recruited for a two-factor between-groups experiment: the victim was either an Arsenal supporter or not (in-group/out-group), and looked towards the participant for help or not during the confrontation. The response variables were the numbers of verbal and physical interventions by the participant during the violent argument. The number of physical interventions had a significantly greater mean in the ingroup condition compared to the out-group. The more that participants perceived that the Victim was looking to them for help the greater the number of interventions in the in-group but not in the out-group. These results are supported by standard statistical analysis of variance, with more detailed findings obtained by a symbolic regression procedure based on genetic programming. Verbal interventions made during their experience, and analysis of post-experiment interview data suggest that in-group members were more prone to confrontational intervention compared to the out-group who were more prone to make statements to try to diffuse the situation.

Visual realism enhances realistic response in an immersive virtual environment

Participants in an immersive virtual environment interact with the scene from an egocentric point of view that is, where there bodies appear to be located rather than from outside as if looking through a window. People interact through normal body movements, such as head-turning,reaching, and bending, and within the tracking limitations move through the environment or effect changes within it in natural ways.

Visual realism enhances realistic response in an immersive virtual environment - Part2

Does realistic lighting in an immersive virtual reality application enhance presence, where participants feel that they are in the scene and behave correspondingly? Our previous study indicated that presence is more likely with real-time ray tracing compared with ray casting, but we could not separate the effects of overall quality of illumination from the dynamic effects of real-time shadows and reflections. Here we describe an experiment where 20 people experienced a scene rendered with global or local illumination. However, in both conditions there were dynamically changing shadows and reflections. We found that the quality of illumination did not impact presence, so that the earlier result must have been due to dynamic shadows and reflections. However, global illumination resulted in greater plausibility - participants were more likely to respond as if the virtual events were real. We conclude that global illumination does impact the responses of participants and is worth the effort.

Studying social interactions through immersive virtual environment technology: Virtues, pitfalls, and future challenges

Thegoalofthepresentreviewistoexplainhowimmersivevirtualenvironmenttechnology(IVET)canbeusedforthestudyofsocialinteractionsandhowtheuseofvirtualhumansinimmersivevirtualenvironmentscanadvanceresearchandapplicationinmanydifferentfields.Researchersstudyingindividualdifferencesinsocialinteractionsaretypicallyinterestedinkeepingthebehaviorandtheappearanceoftheinteractionpartnerconstantacrossparticipants.WithIVETresearchershavefullcontrolovertheinteractionpartners,canstandardizethemwhilestillkeepingthesimulationrealistic.Virtualsimulationsarevalid:growingevidenceshowsthatindeedstudiesconductedwithIVETcanreplicatesomewell-knownfindingsofsocialpsychology.Moreover,IVETallowsresearcherstosubtlymanipulatecharacteristicsoftheenvironment(e.g.,visualcuestoprimeparticipants)orofthesocialpartner(e.g.,his/herrace)toinvestigatetheirinfluencesonparticipants'behaviorandcognition.Furthermore,manipulationsthatwouldbedifficultorimpossibleinreallife(e.g.,changingparticipants'height)canbeeasilyobtainedwithIVET.Besidetheadvantagesfortheoreticalresearch,weexplorethemostrecenttrainingandclinicalapplicationsofIVET,itsintegrationwithothertechnologies(e.g.,socialsensing)andfuturechallengesforresearchers(e.g.,makingthecommunicationbetweenvirtualhumansandparticipantssmoother).

Clinical validation of a virtual environment for normalizing eating patterns in eating disorders

The purpose of the present study was to examine the clinical validation of a Virtual Reality Environment (VRE) designed to normalize eating patterns in Eating Disorders (ED). The efficacy of VR in eliciting emotions, sense of presence and reality of the VRE were explored in 22 ED patients and 37 healthy eating individuals. The VRE (non-immersive) consisted of a kitchen room where participants had to eat a virtual pizza. In order to assess the sense of presence and reality produced by the VRE, participants answered seven questions with a Likert scale (0-10) during the experience, and then filled out the Reality Judgment and Presence Questionnaire (RJPQ) and ITC-Sense of Presence Inventory (ITC-SOPI). The results showed that the VRE induced a sense of presence and was felt as real for both groups, without differences in the experience of 'ease' with the VRE, sense of physical space, or the ecological validity assigned to the virtual kitchen and eating virtually. However, the ED patients reported paying more attention and experiencing greater emotional involvement and dysphoria after virtual eating. The results suggest that the VRE was clinically meaningful to the ED patients and might be a relevant therapy tool for normalizing their eating patterns.

Habilitats comunicatives per a l’aprenentatge en l’entorn virtual = Communicative skills for learning in a virtual environment

The virtual learning environments are an option in permanent training with great possibilities for adults who look for studies that are compatible with their jobs and with their family life. So as to participate in determined learning as much in attitudes as knowledge and skills. The article is dedicated to analysing the necessary linguistic habits for moving within an environment of this type and offers didactic proposals that can facilitate the active participation in a virtual course and widen the perspectives of the control of new channels of communication with objectives that are different to learning

Novel virtual environment and real-time simulation based methods for improving life-cycle efficiency of non-road mobile machinery

Virtual environments and real-time simulators (VERS) are becoming more and more important tools in research and development (R&D) process of non-road mobile machinery (NRMM). The virtual prototyping techniques enable faster and more cost-efficient development of machines compared to use of real life prototypes. High energy efficiency has become an important topic in the world of NRMM because of environmental and economic demands. The objective of this thesis is to develop VERS based methods for research and development of NRMM. A process using VERS for assessing effects of human operators on the life-cycle efficiency of NRMM was developed. Human in the loop simulations are ran using an underground mining loader to study the developed process. The simulations were ran in the virtual environment of the Laboratory of Intelligent Machines of Lappeenranta University of Technology. A physically adequate real-time simulation model of NRMM was shown to be reliable and cost effective in testing of hardware components by the means of hardware-in-the-loop (HIL) simulations. A control interface connecting integrated electro-hydraulic energy converter (IEHEC) with virtual simulation model of log crane was developed. IEHEC consists of a hydraulic pump-motor and an integrated electrical permanent magnet synchronous motorgenerator. The results show that state of the art real-time NRMM simulators are capable to solve factors related to energy consumption and productivity of the NRMM. A significant variation between the test drivers is found. The results show that VERS can be used for assessing human effects on the life-cycle efficiency of NRMM. HIL simulation responses compared to that achieved with conventional simulation method demonstrate the advances and drawbacks of various possible interfaces between the simulator and hardware part of the system under study. Novel ideas for arranging the interface are successfully tested and compared with the more traditional one. The proposed process for assessing the effects of operators on the life-cycle efficiency will be applied for wider group of operators in the future. Driving styles of the operators can be analysed statistically from sufficient large result data. The statistical analysis can find the most life-cycle efficient driving style for the specific environment and machinery. The proposed control interface for HIL simulation need to be further studied. The robustness and the adaptation of the interface in different situations must be verified. The future work will also include studying the suitability of the IEHEC for different working machines using the proposed HIL simulation method.

Generating Aesthetically Pleasing Images in a Virtual Environment using Particle Swarm Optimization

This research focuses on generating aesthetically pleasing images in virtual environments using the particle swarm optimization (PSO) algorithm. The PSO is a stochastic population based search algorithm that is inspired by the flocking behavior of birds. In this research, we implement swarms of cameras flying through a virtual world in search of an image that is aesthetically pleasing. Virtual world exploration using particle swarm optimization is considered to be a new research area and is of interest to both the scientific and artistic communities. Aesthetic rules such as rule of thirds, subject matter, colour similarity and horizon line are all analyzed together as a multi-objective problem to analyze and solve with rendered images. A new multi-objective PSO algorithm, the sum of ranks PSO, is introduced. It is empirically compared to other single-objective and multi-objective swarm algorithms. An advantage of the sum of ranks PSO is that it is useful for solving high-dimensional problems within the context of this research. Throughout many experiments, we show that our approach is capable of automatically producing images satisfying a variety of supplied aesthetic criteria.

VERA: virtual environment for research in archaeology

The VERA (Virtual Environment for Research in Archaeology) project is based on a research excavation of part of the large Roman town at Silchester, which aims to trace the site's development from its origins before the Roman conquest to its abandonment in the fifth century A.D. [1]. The VERA project aims to investigate how archaeologists use Information Technology (IT) in the context of a field excavation, and also for post-excavation analysis. VERA is a two-year project funded by the JISC VRE 2 programme that involves researchers from the University of Reading, University College London, and York Archaeological Trust. The overall aim of the project is to assess and introduce new tools and technologies that can aid the archaeological processes of gathering, recording and later analysis of data on the finds and artefacts discovered. The researchers involved in the project have a mix of skills, ranging from those related to archaeology, and computer science, though to ones involving usability and user assessment. This paper reports on the status of the research and development work undertaken in the project so far; this includes addressing various programming hurdles, on-site experiments and experiences, and the outcomes of usability and assessment studies.

Use of auditory cues for wayfinding assistance in virtual environment: music aids route decision

This paper addresses the crucial problem of wayfinding assistance in the Virtual Environments (VEs). A number of navigation aids such as maps, agents, trails and acoustic landmarks are available to support the user for navigation in VEs, however it is evident that most of the aids are visually dominated. This work-in-progress describes a sound based approach that intends to assist the task of 'route decision' during navigation in a VE using music. Furthermore, with use of musical sounds it aims to reduce the cognitive load associated with other visually as well as physically dominated tasks. To achieve these goals, the approach exploits the benefits provided by music to ease and enhance the task of wayfinding, whilst making the user experience in the VE smooth and enjoyable.