Parameterising ecological validity and integrating individual differences within second-person neuroscience

This commentary situates the second person account within a broader framework of ecological validity for experimental paradigms in social cognitive neuroscience. It then considers how individual differences at psychological and genetic levels can be integrated within the proposed framework.

Descriptive analysis of landings during international netball competition: enhancing ecological validity of laboratory testing environments

Non-contact landings have been identified as a common activity associated with injury in netball. Investigating injury risk factors during landing via laboratory-based analysis warrants the performance of sportspecific landing tasks with the inclusion of “game- like” factors to enhance ecological validity of testing protocols. Understanding how players perform landing tasks in a competitive environment is, therefore, essential.

The purpose of this study was to perform a descriptive analysis of in-game landings performed by netball players, with regard to the landing techniques used and game events surrounding these landings; with the intent of providing information to enhance the ecological validity of laboratory-based testing environments. Landings were categorised according to landing technique and game events surrounding the landing.

Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study

Background: Dementia is a multifaceted disorder that impairs cognitive functions, such as memory, language, and executive functions necessary to plan, organize, and prioritize tasks required for goal-directed behaviors. In most cases, individuals with dementia experience difficulties interacting with physical and social environments. The purpose of this study was to establish ecological validity and initial construct validity of a fire evacuation Virtual Reality Day-Out Task (VR-DOT) environment based on performance profiles as a screening tool for early dementia. Objective: The objectives were (1) to examine the relationships among the performances of 3 groups of participants in the VR-DOT and traditional neuropsychological tests employed to assess executive functions, and (2) to compare the performance of participants with mild Alzheimer’s-type dementia (AD) to those with amnestic single-domain mild cognitive impairment (MCI) and healthy controls in the VR-DOT and traditional neuropsychological tests used to assess executive functions. We hypothesized that the 2 cognitively impaired groups would have distinct performance profiles and show significantly impaired independent functioning in ADL compared to the healthy controls. Methods: The study population included 3 groups: 72 healthy control elderly participants, 65 amnestic MCI participants, and 68 mild AD participants. A natural user interface framework based on a fire evacuation VR-DOT environment was used for assessing physical and cognitive abilities of seniors over 3 years. VR-DOT focuses on the subtle errors and patterns in performing everyday activities and has the advantage of not depending on a subjective rating of an individual person. We further assessed functional capacity by both neuropsychological tests (including measures of attention, memory, working memory, executive functions, language, and depression). We also evaluated performance in finger tapping, grip strength, stride length, gait speed, and chair stands separately and while performing VR-DOTs in order to correlate performance in these measures with VR-DOTs because performance while navigating a virtual environment is a valid and reliable indicator of cognitive decline in elderly persons. Results: The mild AD group was more impaired than the amnestic MCI group, and both were more impaired than healthy controls. The novel VR-DOT functional index correlated strongly with standard cognitive and functional measurements, such as mini-mental state examination (MMSE; rho=0.26, P=.01) and Bristol Activities of Daily Living (ADL) scale scores (rho=0.32, P=.001). Conclusions: Functional impairment is a defining characteristic of predementia and is partly dependent on the degree of cognitive impairment. The novel virtual reality measures of functional ability seem more sensitive to functional impairment than qualitative measures in predementia, thus accurately differentiating from healthy controls. We conclude that VR-DOT is an effective tool for discriminating predementia and mild AD from controls by detecting differences in terms of errors, omissions, and perseverations while measuring ADL functional ability.

Ecological validity in neuropsychological assessment: A case for greater consideration in research with neurologically intact populations

The focus of the discipline of neuropsychology is shifting towards a greater emphasis on understanding the relationship between assessment results and performance of everyday tasks (ecological validity). To date, the literature has highlighted the importance of this concept in the assessment of patients with brain injury or disease (e.g. in rehabilitation and forensic settings). This paper presents the argument that there is another important area in which the ecological validity of neuropsychological assessments should be considered: in clinical outcomes studies using neurologically intact participants. For example, determining the extent to which a medical procedure or intervention affects performance of everyday cognitive tasks can provide useful information that can potentially guide decision-making regarding treatment options. It is argued that tests designed with ecological validity in mind (the verisimilitude approach), as opposed to traditional tests, may be most effective at predicting everyday functioning. Explanations are proposed as to why researchers may be reluctant to use tests with verisimilitude in favor of more traditional measures. (c) 2006 National Academy of Neuropsychology. Published by Elsevier Ltd. All rights reserved.

Modelling ecological cognitive rehabilitation therapies for building virtual environments in brain injury

Brain Injury (BI) has become one of the most common causes of neurological disability in developed countries. Cognitive disorders result in a loss of independence and patients? quality of life. Cognitive rehabilitation aims to promote patients? skills to achieve their highest degree of personal autonomy. New technologies such as virtual reality or interactive video allow developing rehabilitation therapies based on reproducible Activities of Daily Living (ADLs), increasing the ecological validity of the therapy. However, the lack of frameworks to formalize and represent the definition of this kind of therapies can be a barrier for widespread use of interactive virtual environments in clinical routine.

Representative learning design and functionality of research and practice in sport

Egon Brunswik proposed the concept of “representative design” for psychological experimentation, which has historically been overlooked or confused with another of Brunswik’s terms, ecological validity. In this article, we reiterate the distinc­tion between these two important concepts and highlight the relevance of the term representative design for sports psychology, practice, and experimental design. We draw links with ideas on learning design in the constraints-led approach to motor learning and nonlinear pedagogy. We propose the adoption of a new term, repre­sentative learning design, to help sport scientists, experimental psychologists, and pedagogues recognize the potential application of Brunswik’s original concepts, and to ensure functionality and action fidelity in training and learning environments.

Using photography in ‘The Restaurant of the Future’. A useful way to assess portion selection and plate cleaning?

Laboratory-based studies of human dietary behaviour benefit from highly controlled conditions; however, this approach can lack ecological validity. Identifying a reliable method to capture and quantify natural dietary behaviours represents an important challenge for researchers. In this study, we scrutinised cafeteria-style meals in the ‘Restaurant of the Future.’ Self-selected meals were weighed and photographed, both before and after consumption. Using standard portions of the same foods, these images were independently coded to produce accurate and reliable estimates of (i) initial self-served portions, and (ii) food remaining at the end of the meal. Plate cleaning was extremely common; in 86% of meals at least 90% of self-selected calories were consumed. Males ate a greater proportion of their self-selected meals than did females. Finally, when participants visited the restaurant more than once, the correspondence between selected portions was better predicted by the weight of the meal than by its energy content. These findings illustrate the potential benefits of meal photography in this context. However, they also highlight significant limitations, in particular, the need to exclude large amounts of data when one food obscures another.

The need for ‘representative task design’ in evaluating efficacy of skills tests in sport : a comment on Russell, Benton and Kingsley (2010)

Russell, Benton and Kingsley (2010) recently suggested a new association football test comprising three different tasks for the evaluation of players' passing, dribbling and shooting skills. Their stated intention was to enhance ‘ecological validity’ of current association football skills tests allowing generalisation of results from the new protocols to performance constraints that were ‘representative’ of experiences during competitive game situations. However, in this comment we raise some concerns with their use of the term ‘ecological validity’ to allude to aspects of ‘representative task design’. We propose that in their paper the authors confused understanding of environmental properties, performance achievement and generalisability of the test and its outcomes. Here, we argue that the tests designed by Russell and colleagues did not include critical sources of environmental information, such as the active role of opponents, which players typically use to organise their actions during performance. Static tasks which are not representative of the competitive performance environment may lead to different emerging patterns of movement organisation and performance outcomes, failing to effectively evaluate skills performance in sport.

Representative learning design in dynamic interceptive actions

The overarching aim of this thesis was to investigate how processes of perception and action emerge under changing informational constraints during performance of multi-articular interceptive actions. Interceptive actions provide unique opportunities to study processes of perception and action in dynamic performance environments. The movement model used to exemplify the functionally coupled relationship between perception and action, from an ecological dynamics perspective, was cricket batting. Ecological dynamics conceptualises the human body as a complex system composed of many interacting sub-systems, and perceptual and motor system degrees of freedom, which leads to the emergence of patterns of behaviour under changing task constraints during performance. The series of studies reported in the Chapters of this doctoral thesis contributed to understanding of human behaviour by providing evidence of key properties of complex systems in human movement systems including self-organisation under constraints and meta-stability. Specifically, the studies: i) demonstrated how movement organisation (action) and visual strategies (perception) of dynamic human behaviour are constrained by changing ecological (especially informational) task constraints; (ii) provided evidence for the importance of representative design in experiments on perception and action; and iii), provided a principled theoretical framework to guide learning design in acquisition of skill in interceptive actions like cricket batting.

Brain networks subserving the evaluation of static and dynamic facial expressions

Because moving depictions of face emotion have greater ecological validity than their static counterparts, it has been suggested that still photographs may not engage ‘authentic’ mechanisms used to recognize facial expressions in everyday life. To date, however, no neuroimaging studies have adequately addressed the question of whether the processing of static and dynamic expressions rely upon different brain substrates. To address this, we performed an functional magnetic resonance imaging (fMRI) experiment wherein participants made emotional expression discrimination and Sex discrimination judgements to static and moving face images. Compared to Sex discrimination, Emotion discrimination was associated with widespread increased activation in regions of occipito-temporal, parietal and frontal cortex. These regions were activated both by moving and by static emotional stimuli, indicating a general role in the interpretation of emotion. However, portions of the inferior frontal gyri and supplementary/pre-supplementary motor area showed task by motion interaction. These regions were most active during emotion judgements to static faces. Our results demonstrate a common neural substrate for recognizing static and moving facial expressions, but suggest a role for the inferior frontal gyrus in supporting simulation processes that are invoked more strongly to disambiguate static emotional cues.

Expanded review criteria : the case of nonpharmacological interventions in dementia

This paper challenges the assumptions underlying many reviews and offers alternative criteria for examining evidence for nonpharmacological interventions. We evaluated 27 reviews examining interventions for persons with dementia as they relate to the issues of selection based on randomized controlled trial (RCT) design. Reviews were described by type of intervention, level of cognitive function, and criteria for inclusion. Of the 27 reviews, 46% required RCTs for inclusion and most had stringent inclusion criteria. This resulted in poor utilization of the literature and low ecological validity. Eliminating most of the available data poses a critical problem to clinical and research development. Studies meeting strict methodological criteria may not generalize to the greater population or may exclude sub-populations and interventions. Limitations of double-blind RCTs and potential design solutions are set forth based on appropriate populations, problems, interventions, and settings characteristics.

A systematic review of instruments for assessment of capacity in activities of daily living in children with developmental co-ordination disorder

Children with developmental co-ordination disorder (DCD) face evident motor difficulties in activities of daily living (ADL). Assessment of their capacity in ADL is essential for diagnosis and intervention, in order to limit the daily consequences of the disorder. The aim of this study is to systematically review potential instruments for standardized and objective assessment of children's capacity in ADL, suited for children with DCD. As a first step, databases of MEDLINE, EMBASE, CINAHL and PsycINFO were searched to identify studies that described instruments with potential for assessment of capacity in ADL. Second, instruments were included for review when two independent reviewers agreed that the instruments: (1) are standardized and objective; (2) assess at activity level and comprise items that reflect ADL, and; (3) are applicable to school-aged children that can move independently. Out of 1507 publications, 66 publications were selected, describing 39 instruments. Seven of these instruments were found to fulfil the criteria and were included for review: the Bruininks-Oseretsky Test of Motor Performance-2 (BOT2); the Do-Eat (Do-Eat); the Movement Assessment Battery for Children-2 (MABC2); the school-Assessment of Motor and Process Skills (schoolAMPS); the Tuffts Assessment of Motor Performance (TAMP); the Test of Gross Motor Development (TGMD); and the Functional Independence Measure for Children (WeeFIM). As a third step, for the included instruments, suitability for children with DCD was discussed based on the ADL comprised, ecological validity and other psychometric properties. We concluded that current instruments do not provide comprehensive and ecologically valid assessment of capacity in ADL as required for children with DCD.