A robotic system to train activities of daily living in a virtual environment

In the past decade, several arm rehabilitation robots have been developed to assist neurological patients during therapy. Early devices were limited in their number of degrees of freedom and range of motion, whereas newer robots such as the ARMin robot can support the entire arm. Often, these devices are combined with virtual environments to integrate motivating game-like scenarios. Several studies have shown a positive effect of game-playing on therapy outcome by increasing motivation. In addition, we assume that practicing highly functional movements can further enhance therapy outcome by facilitating the transfer of motor abilities acquired in therapy to daily life. Therefore, we present a rehabilitation system that enables the training of activities of daily living (ADL) with the support of an assistive robot. Important ADL tasks have been identified and implemented in a virtual environment. A patient-cooperative control strategy with adaptable freedom in timing and space was developed to assist the patient during the task. The technical feasibility and usability of the system was evaluated with seven healthy subjects and three chronic stroke patients.

A virtual environment for the assessment and the rehabilitation of the visuo-constructional ability in dementia patients

This study proposes a VE that offers a reliable diagnosis of the stage of cognitive decline in dementia patients and assists the delay of this decline in terms of the visuo-constructional ability. The proposed VE, in the case of the assessment, presents a visuo-constructional completion task, which requires spatial perception, motor memory and the perception of the target object. In the case of the rehabilitation the VE uses sound as audio-feedback that, with the aid of the music perception, tends to develop an enhancement in the visuo-construction ability of the dementia patients that can be generalized even outside of the VE. The study examined 30 subjects that were normal controls (N), 30 patients suffering from memory disorders (Age-Associated Memory Impairment--AAMI) and 30 suffering from Alzheimer's Disease (AD). The results showed that there is a significant correlation between the performance in the visuo-constructional task and the dementia diagnosis. It also seems that the visuo-constructional ability of the (AD) patients can be statistically improved by the audio experience in the VE. The empirical results of this study offer an alternative diagnosis and treatment of dementia patients and could share some light in the brain sub-systems that are responsible for the visuo-constructional ability. Further studies are required in order to investigate the nature of this phenomenon more.

Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study

Background: Dementia is a multifaceted disorder that impairs cognitive functions, such as memory, language, and executive functions necessary to plan, organize, and prioritize tasks required for goal-directed behaviors. In most cases, individuals with dementia experience difficulties interacting with physical and social environments. The purpose of this study was to establish ecological validity and initial construct validity of a fire evacuation Virtual Reality Day-Out Task (VR-DOT) environment based on performance profiles as a screening tool for early dementia. Objective: The objectives were (1) to examine the relationships among the performances of 3 groups of participants in the VR-DOT and traditional neuropsychological tests employed to assess executive functions, and (2) to compare the performance of participants with mild Alzheimer’s-type dementia (AD) to those with amnestic single-domain mild cognitive impairment (MCI) and healthy controls in the VR-DOT and traditional neuropsychological tests used to assess executive functions. We hypothesized that the 2 cognitively impaired groups would have distinct performance profiles and show significantly impaired independent functioning in ADL compared to the healthy controls. Methods: The study population included 3 groups: 72 healthy control elderly participants, 65 amnestic MCI participants, and 68 mild AD participants. A natural user interface framework based on a fire evacuation VR-DOT environment was used for assessing physical and cognitive abilities of seniors over 3 years. VR-DOT focuses on the subtle errors and patterns in performing everyday activities and has the advantage of not depending on a subjective rating of an individual person. We further assessed functional capacity by both neuropsychological tests (including measures of attention, memory, working memory, executive functions, language, and depression). We also evaluated performance in finger tapping, grip strength, stride length, gait speed, and chair stands separately and while performing VR-DOTs in order to correlate performance in these measures with VR-DOTs because performance while navigating a virtual environment is a valid and reliable indicator of cognitive decline in elderly persons. Results: The mild AD group was more impaired than the amnestic MCI group, and both were more impaired than healthy controls. The novel VR-DOT functional index correlated strongly with standard cognitive and functional measurements, such as mini-mental state examination (MMSE; rho=0.26, P=.01) and Bristol Activities of Daily Living (ADL) scale scores (rho=0.32, P=.001). Conclusions: Functional impairment is a defining characteristic of predementia and is partly dependent on the degree of cognitive impairment. The novel virtual reality measures of functional ability seem more sensitive to functional impairment than qualitative measures in predementia, thus accurately differentiating from healthy controls. We conclude that VR-DOT is an effective tool for discriminating predementia and mild AD from controls by detecting differences in terms of errors, omissions, and perseverations while measuring ADL functional ability.

Modulating presence and impulsiveness by external stimulation of the brain

BACKGROUND "The feeling of being there" is one possible way to describe the phenomenon of feeling present in a virtual environment and to act as if this environment is real. One brain area, which is hypothesized to be critically involved in modulating this feeling (also called presence) is the dorso-lateral prefrontal cortex (dlPFC), an area also associated with the control of impulsive behavior. METHODS In our experiment we applied transcranial direct current stimulation (tDCS) to the right dlPFC in order to modulate the experience of presence while watching a virtual roller coaster ride. During the ride we also registered electro-dermal activity. Subjects also performed a test measuring impulsiveness and answered a questionnaire about their presence feeling while they were exposed to the virtual roller coaster scenario. RESULTS Application of cathodal tDCS to the right dlPFC while subjects were exposed to a virtual roller coaster scenario modulates the electrodermal response to the virtual reality stimulus. In addition, measures reflecting impulsiveness were also modulated by application of cathodal tDCS to the right dlPFC. CONCLUSION Modulating the activation with the right dlPFC results in substantial changes in responses of the vegetative nervous system and changed impulsiveness. The effects can be explained by theories discussing the top-down influence of the right dlPFC on the "impulsive system".

Virtual Cilicia Project. How to use Google Earth as a visualization environment in an archaeological context

Over the past few years, archaeology has experienced a rapid development in geophysical prospection and remote sensing techniques. At the same time, the focus of archaeological research has shifted to landscape evelopment and human interaction. To impart the results, new methods and techniques are necessary. Virtual globes such as Google Earth offer fascinating methods of giving interested amateurs the possibility to interactively explore ancient cities and landscapes. Thanks to the increasing usage of GIS in cultural heritage, the implementation of interactive three dimensional learning opportunities becomes less and less tedious, but the non-linear narrative story telling medium demands for a special adaption of the content. This paper summarizes the experience gained during the realization of the “Virtual Cilicia Project” and outlines the future potential of virtual globes in the field of cultural heritage.

Sonic intelligence as a virtual therapeutic environment

This paper reports on the results of a research project, on comparing one virtual collaborative environment with a first-person visual immersion (first-perspective interaction) and a second one where the user interacts through a sound-kinetic virtual representation of himself (avatar), as a stress-coping environment in real-life situations. Recent developments in coping research are proposing a shift from a trait-oriented approach of coping to a more situation-specific treatment. We defined as real-life situation a target-oriented situation that demands a complex coping skills inventory of high self-efficacy and internal or external "locus of control" strategies. The participants were 90 normal adults with healthy or impaired coping skills, 25-40 years of age, randomly spread across two groups. There was the same number of participants across groups and gender balance within groups. All two groups went through two phases. In Phase I, Solo, one participant was assessed using a three-stage assessment inspired by the transactional stress theory of Lazarus and the stress inoculation theory of Meichenbaum. In Phase I, each participant was given a coping skills measurement within the time course of various hypothetical stressful encounters performed in two different conditions and a control group. In Condition A, the participant was given a virtual stress assessment scenario relative to a first-person perspective (VRFP). In Condition B, the participant was given a virtual stress assessment scenario relative to a behaviorally realistic motion controlled avatar with sonic feedback (VRSA). In Condition C, the No Treatment Condition (NTC), the participant received just an interview. In Phase II, all three groups were mixed and exercised the same tasks but with two participants in pairs. The results showed that the VRSA group performed notably better in terms of cognitive appraisals, emotions and attributions than the other two groups in Phase I (VRSA, 92%; VRFP, 85%; NTC, 34%). In Phase II, the difference again favored the VRSA group against the other two. These results indicate that a virtual collaborative environment seems to be a consistent coping environment, tapping two classes of stress: (a) aversive or ambiguous situations, and (b) loss or failure situations in relation to the stress inoculation theory. In terms of coping behaviors, a distinction is made between self-directed and environment-directed strategies. A great advantage of the virtual collaborative environment with the behaviorally enhanced sound-kinetic avatar is the consideration of team coping intentions in different stages. Even if the aim is to tap transactional processes in real-life situations, it might be better to conduct research using a sound-kinetic avatar based collaborative environment than a virtual first-person perspective scenario alone. The VE consisted of two dual-processor PC systems, a video splitter, a digital camera and two stereoscopic CRT displays. The system was programmed in C++ and VRScape Immersive Cluster from VRCO, which created an artificial environment that encodes the user's motion from a video camera, targeted at the face of the users and physiological sensors attached to the body.

Adapting a driving simulator to study pedestrians' street-crossing decisions: A feasibility study

The decision when to cross a street safely is a challenging task that poses high demands on perception and cognition. Both can be affected by normal aging, neurodegenerative disorder, and brain injury, and there is an increasing interest in studying street-crossing decisions. In this article, we describe how driving simulators can be modified to study pedestrians' street-crossing decisions. The driving simulator's projection system and the virtual driving environment were used to present street-crossing scenarios to the participants. New sensors were added to measure when the test person starts to cross the street. Outcome measures were feasibility, usability, task performance, and visual exploration behavior, and were measured in 15 younger persons, 15 older persons, and 5 post-stroke patients. The experiments showed that the test is feasible and usable, and the selected difficulty level was appropriate. Significant differences in the number of crashes between young participants and patients (p = .001) as well as between healthy older participants and patients (p = .003) were found. When the approaching vehicle's speed is high, significant differences between younger and older participants were found as well (p = .038). Overall, the new test setup was well accepted, and we demonstrated that driving simulators can be used to study pedestrians' street-crossing decisions.