Parameterising ecological validity and integrating individual differences within second-person neuroscience

This commentary situates the second person account within a broader framework of ecological validity for experimental paradigms in social cognitive neuroscience. It then considers how individual differences at psychological and genetic levels can be integrated within the proposed framework.

Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study

Background: Dementia is a multifaceted disorder that impairs cognitive functions, such as memory, language, and executive functions necessary to plan, organize, and prioritize tasks required for goal-directed behaviors. In most cases, individuals with dementia experience difficulties interacting with physical and social environments. The purpose of this study was to establish ecological validity and initial construct validity of a fire evacuation Virtual Reality Day-Out Task (VR-DOT) environment based on performance profiles as a screening tool for early dementia. Objective: The objectives were (1) to examine the relationships among the performances of 3 groups of participants in the VR-DOT and traditional neuropsychological tests employed to assess executive functions, and (2) to compare the performance of participants with mild Alzheimer’s-type dementia (AD) to those with amnestic single-domain mild cognitive impairment (MCI) and healthy controls in the VR-DOT and traditional neuropsychological tests used to assess executive functions. We hypothesized that the 2 cognitively impaired groups would have distinct performance profiles and show significantly impaired independent functioning in ADL compared to the healthy controls. Methods: The study population included 3 groups: 72 healthy control elderly participants, 65 amnestic MCI participants, and 68 mild AD participants. A natural user interface framework based on a fire evacuation VR-DOT environment was used for assessing physical and cognitive abilities of seniors over 3 years. VR-DOT focuses on the subtle errors and patterns in performing everyday activities and has the advantage of not depending on a subjective rating of an individual person. We further assessed functional capacity by both neuropsychological tests (including measures of attention, memory, working memory, executive functions, language, and depression). We also evaluated performance in finger tapping, grip strength, stride length, gait speed, and chair stands separately and while performing VR-DOTs in order to correlate performance in these measures with VR-DOTs because performance while navigating a virtual environment is a valid and reliable indicator of cognitive decline in elderly persons. Results: The mild AD group was more impaired than the amnestic MCI group, and both were more impaired than healthy controls. The novel VR-DOT functional index correlated strongly with standard cognitive and functional measurements, such as mini-mental state examination (MMSE; rho=0.26, P=.01) and Bristol Activities of Daily Living (ADL) scale scores (rho=0.32, P=.001). Conclusions: Functional impairment is a defining characteristic of predementia and is partly dependent on the degree of cognitive impairment. The novel virtual reality measures of functional ability seem more sensitive to functional impairment than qualitative measures in predementia, thus accurately differentiating from healthy controls. We conclude that VR-DOT is an effective tool for discriminating predementia and mild AD from controls by detecting differences in terms of errors, omissions, and perseverations while measuring ADL functional ability.

Ecological validity in neuropsychological assessment: A case for greater consideration in research with neurologically intact populations

The focus of the discipline of neuropsychology is shifting towards a greater emphasis on understanding the relationship between assessment results and performance of everyday tasks (ecological validity). To date, the literature has highlighted the importance of this concept in the assessment of patients with brain injury or disease (e.g. in rehabilitation and forensic settings). This paper presents the argument that there is another important area in which the ecological validity of neuropsychological assessments should be considered: in clinical outcomes studies using neurologically intact participants. For example, determining the extent to which a medical procedure or intervention affects performance of everyday cognitive tasks can provide useful information that can potentially guide decision-making regarding treatment options. It is argued that tests designed with ecological validity in mind (the verisimilitude approach), as opposed to traditional tests, may be most effective at predicting everyday functioning. Explanations are proposed as to why researchers may be reluctant to use tests with verisimilitude in favor of more traditional measures. (c) 2006 National Academy of Neuropsychology. Published by Elsevier Ltd. All rights reserved.

Modelling ecological cognitive rehabilitation therapies for building virtual environments in brain injury

Brain Injury (BI) has become one of the most common causes of neurological disability in developed countries. Cognitive disorders result in a loss of independence and patients? quality of life. Cognitive rehabilitation aims to promote patients? skills to achieve their highest degree of personal autonomy. New technologies such as virtual reality or interactive video allow developing rehabilitation therapies based on reproducible Activities of Daily Living (ADLs), increasing the ecological validity of the therapy. However, the lack of frameworks to formalize and represent the definition of this kind of therapies can be a barrier for widespread use of interactive virtual environments in clinical routine.

Decision-Making Deficits Linked to Real-life Social Dysfunction in Crack Cocaine-Dependent Individuals

Crack cocaine-dependent individuals (CCDI) present abnormalities in both social adjustment and decision making, but few studies have examined this association. This study investigated cognitive and social performance of 30 subjects (CCDI x controls); CCDI were abstinent for 2 weeks. We used the Social Adjustment Scale (SAS), Wisconsin Card Sorting Test (WCST), and Iowa Gambling Task (IGT). Disadvantageous choices on the IGT were associated with higher levels of social dysfunction in CCDI, suggesting the ecological validity of the IGT. Social dysfunction and decision making may be linked to the same underlying prefrontal dysfunction, but the nature of this association should be further investigated. (Am J Addict 2010;00: 1-9).

Sensorimotor synchronization when walking side by side with a point light walker

[Excerpt] Synchronization of periodic movements like side-by-side walking [7] is frequently modeled by coupled oscillators [5] and the coupling strength is defined quantitatively [3]. In contrast, in most studies on sensorimotor synchronization (SMS), simple movements like finger taps are synchronized with simple stimuli like metronomes [4]. While the latter paradigm simplifies matters and allows for the assessment of the relative weights of sensory modalities through systematic variation of the stimuli [1], it might lack ecological validity. Conversely, using more complex movements and stimuli might complicate the specification of mechanisms underlying coupling. We merged the positive aspects of both approaches to study the contribution of auditory and visual information on synchronization during side-by-side walking. As stimuli, we used Point Light Walkers (PLWs) and auralized steps sound; both were constructed from previously captured walking individuals [2][6]. PLWs were retro-projected on a screen and matched according to gender, hip height, and velocity. The participant walked for 7.20m side by side with 1) a PLW, 2) steps sound, or 3) both displayed in temporal congruence. Instruction to participants was to synchronize with the available stimuli. [...]

Biased thinking assessed by external observers in borderline personality disorder

Objectives. Biased thinking (to some extent overlapping with the concepts of cognitive distortions and cognitive errors) is a key concept in cognitive therapy of Borderline Personality Disorder (BPD). Specific contents and cognitive processes related to BPD functioning are known. However, most studies are based on self-report measures which present a number of important limitations, in particular the difficulty in assessing non-conscious processes infused by affect. So far, no studies were conducted using valid observer-rated methodology addressing the question of biased thinking in BPD as it unfolds spontaneously in session. Design. This is a controlled interview study comparing two matched groups, BPD patients and healthy controls. Methods. A total of N= 25 clinical dynamic interviews with patients presenting with BPD were transcribed and rated using the Cognitive Errors Rating Scale (Drapeau, Perry, & Dunkley, 2008); their cognitive profiles were compared to those of N= 25 healthy controls who underwent the same procedure. Results. Overall, results indicated that no between-group difference in the frequency of specific biases was found. However, heightened levels of negative cognitive biases, in particular over-generalizing and fortune-telling, were associated with BPD. Furthermore, negative over-generalizing was associated with the number of BPD symptoms. Conclusions. These results have high levels of ecological validity and are promising for the refinement of cognitive theory of BPD. Clinical implications for assessment and intervention are discussed.

Improving Information Problem Solving skills in Secondary Education through embedded instruction

This empirical study consists in an investigation of the effects, on the development of Information Problem Solving (IPS) skills, of a long-term embedded, structured and supported instruction in Secondary Education. Forty secondary students of 7th and 8th grades (13–15 years old) participated in the 2-year IPS instruction designed in this study. Twenty of them participated in the IPS instruction, and the remaining twenty were the control group. All the students were pre- and post-tested in their regular classrooms, and their IPS process and performance were logged by means of screen capture software, to warrant their ecological validity. The IPS constituent skills, the web search sub-skills and the answers given by each participant were analyzed. The main findings of our study suggested that experimental students showed a more expert pattern than the control students regarding the constituent skill ‘defining the problem’ and the following two web search sub-skills: ‘search terms’ typed in a search engine, and ‘selected results’ from a SERP. In addition, scores of task performance were statistically better in experimental students than in control group students. The paper contributes to the discussion of how well-designed and well-embedded scaffolds could be designed in instructional programs in order to guarantee the development and efficiency of the students’ IPS skills by using net information better and participating fully in the global knowledge society.

The Use of virtual reality in the study of people's responses to violent incidents

This paper reviews experimental methods for the study of the responses of people to violence in digital media, and in particular considers the issues of internal validity and ecological validity or generalisability of results to events in the real world. Experimental methods typically involve a significant level of abstraction from reality, with participants required to carry out tasks that are far removed from violence in real life, and hence their ecological validity is questionable. On the other hand studies based on fi eld data, while having ecological validity, cannot control multiple confounding variables that may have an impact on observed results, so that their internal validity is questionable. It is argued that immersive virtual reality may provide a unifi cation of these two approaches. Since people tend to respond realistically to situations and events that occur in virtual reality, and since virtual reality simulations can be completely controlled for experimental purposes, studies of responses to violence within virtual reality are likely to have both ecological and internal validity. This depends on a property that we call"plausibility"- including the fi delity of the depicted situation with prior knowledge and expectations. We illustrate this with data from a previously published experiment, a virtual reprise of Stanley Milgram"s 1960s obedience experiment, and also with pilot data from a new study being developed that looks at bystander responses to violent incidents.

Social sensing for psychology: Automated interpersonal behavior assessment

In this article, we show how the use of state-of-the-art methods in computer science based on machine perception and learning allows the unobtrusive capture and automated analysis of interpersonal behavior in real time (social sensing). Given the high ecological validity of the behavioral sensing, the ease of behavioral-cue extraction for large groups over long observation periods in the field, the possibility of investigating completely new research questions, and the ability to provide people with immediate feedback on behavior, social sensing will fundamentally impact psychology.

Cue-elicited anxiety and craving for food using virtual reality scenarios

Cue exposure therapy has been reported to be an effective intervention for reducing binge eating behavior in patients with eating disorders and obesity. However, in vivo food exposure conducted in the therapist's office presents logistical problems and lacks ecological validity. This study proposes the use of virtual reality technology as an alternative to in vivo exposure, and assesses the ability of different virtual environments to elicit anxiety and craving for food in a non-clinical sample. The results show that exposure to virtual environments provokes changes in reported craving for food. High-calorie food cues are the ones that elicit the highest increases in craving.

Clinical validation of a virtual environment for normalizing eating patterns in eating disorders

The purpose of the present study was to examine the clinical validation of a Virtual Reality Environment (VRE) designed to normalize eating patterns in Eating Disorders (ED). The efficacy of VR in eliciting emotions, sense of presence and reality of the VRE were explored in 22 ED patients and 37 healthy eating individuals. The VRE (non-immersive) consisted of a kitchen room where participants had to eat a virtual pizza. In order to assess the sense of presence and reality produced by the VRE, participants answered seven questions with a Likert scale (0-10) during the experience, and then filled out the Reality Judgment and Presence Questionnaire (RJPQ) and ITC-Sense of Presence Inventory (ITC-SOPI). The results showed that the VRE induced a sense of presence and was felt as real for both groups, without differences in the experience of 'ease' with the VRE, sense of physical space, or the ecological validity assigned to the virtual kitchen and eating virtually. However, the ED patients reported paying more attention and experiencing greater emotional involvement and dysphoria after virtual eating. The results suggest that the VRE was clinically meaningful to the ED patients and might be a relevant therapy tool for normalizing their eating patterns.