Using Virtual Reality to Analyze Sports Performance

Improving performance in sports requires a better understanding of the perception-action loop employed by athletes. Because of its inherent limitations, video playback doesn't permit this type of in-depth analysis. Interactive, immersive virtual reality can overcome these limitations and foster a better understanding of sports performance.

An Affordance Based Approach to Decision Making in Sport: Discussing a Novel Methodological Framework

Decision making is a fundamental clement of any sport, particularly open, fast, dynamic team sports such as football, basketball and rugby. At the elite level, athletes appear to consistently make good decisions in situations that are highly temporally constrained. To further understand how this is done has been the aim of researchers within the perception-action field for several decades. The purpose of this article is to present novel contributions, both theoretical and methodological, that are pushing the boundaries of this area of research. The theoretical framework (Ecological psychology) within which the work is posited will be described, followed by a description of Virtual Reality (VR) technology and how it relates to the theoretical aims. Finally, an applied example will be summarised in order to demonstrate how the theoretical approach and the methodological approach come together in practice.

Modelling the control of interceptive actions

In recent years, several phenomenological dynamical models have been formulated that describe how perceptual variables are incorporated in the control of motor variables. We call these short-route models as they do not address how perception-action patterns might be constrained by the dynamical properties of the sensory, neural and musculoskeletal subsystems of the human action system. As an alternative, we advocate a long-route modelling approach in which the dynamics of these subsystems are explicitly addressed and integrated to reproduce interceptive actions. The approach is exemplified through a discussion of a recently developed model for interceptive actions consisting of a neural network architecture for the online generation of motor outflow commands, based on time-to-contact information and information about the relative positions and velocities of hand and ball. This network is shown to be consistent with both behavioural and neurophysiological data. Finally, some problems are discussed with regard to the question of how the motor outflow commands (i.e. the intended movement) might be modulated in view of the musculoskeletal dynamics.

Sensory-motor problems in Autism

Despite being largely characterised as a social and cognitive disorder, strong evidence indicates the presence of significant sensory-motor problems in Autism Spectrum Disorder (ASD). This paper outlines our progression from initial, broad assessment using the Movement Assessment Battery for Children (M-ABC) to subsequent targeted kinematic assessment. In particular, pronounced ASD impairment seen in the broad categories of manual dexterity and ball skills was found to be routed in specific difficulties on isolated tasks, which were translated into focused experimental assessment. Kinematic results from both subsequent studies highlight impaired use of perception-action coupling to guide, adapt and tailor movement to task demands, resulting in inflexible and rigid motor profiles. In particular difficulties with the use of temporal adaption are shown, with "hyperdexterity" witnessed in ballistic movement profiles, often at the cost of spatial accuracy and task performance. By linearly progressing from the use of a standardised assessment tool to targeted kinematic assessment, clear and defined links are drawn between measureable difficulties and underlying sensory-motor assessment. Results are specifically viewed in-light of perception-action coupling and its role in early infant development suggesting that rather than being 'secondary' level impairment, sensory-motor problems may be fundamental in the progression of ASD. This logical and systematic process thus allows a further understanding into the potential route of observable motor problems in ASD; a vital step if underlying motor problems are to be considered a fundamental aspect of autism and allow a route of non-invasive preliminary diagnosis.

(Dis‑)Harmony in movement: effects of musical dissonance on movement timing and form

While the origins of consonance and dissonance in terms of acoustics, psychoacoustics and physiology have been debated for centuries, their plausible effects on movement synchronization have largely been ignored. The present study aims to address this by investigating whether, and if so how, consonant/dissonant pitch intervals affect the spatiotemporal properties of regular reciprocal aiming movements. We compared movements synchronized either to consonant or to dissonant sounds, and showed that they were differently influenced by the degree of consonance of the sound presented. Interestingly, the difference was present after the sound stimulus was removed. In this case, the performance measured after consonant sound exposure was found to be more stable and accurate, with a higher percentage of information/movement coupling (tau-coupling) and a higher degree of movement circularity when compared to performance measured after the exposure to dissonant sounds. We infer that the neural resonance representing consonant tones leads to finer perception/action coupling which in turn may help explain the prevailing preference for these types of tones.

Movement and Perceptual Strategies to Intercept Virtual Sound Sources

To intercept a moving object, one needs to be in the right place at the right time. In order to do this, it is necessary to pick up and use perceptual information that specifies the time to arrival of an object at an interception point. In the present study, we examined the ability to intercept a laterally moving virtual sound object by controlling the displacement of a sliding handle and tested whether and how the interaural time difference (ITD) could be the main source of perceptual information for successfully intercepting the virtual object. The results revealed that in order to accomplish the task, one might need to vary the duration of the movement, control the hand velocity and time to reach the peak velocity (speed coupling), while the adjustment of movement initiation did not facilitate performance. Furthermore, the overall performance was more successful when subjects employed a time-to-contact (tau) coupling strategy. This result shows that prospective information is available in sound for guiding goal-directed actions.

Création sonore et cinéma contemporain : la pensée et la pratique du mixage

Notre thèse décrit et analyse les conditions esthétiques, matérielles et idéelles qui rendent possibles les agencements sonores du cinéma contemporain. Au cours des 30 dernières années, le raffinement des outils de manipulation du son, l’importance grandissante du concepteur sonore et le nouvel espace de cohabitation des sons (favorisé par le Dolby et la diffusion multicanal) sont des facteurs qui ont transformé la création et l’écoute du son au cinéma. Ces transformations révèlent un nouveau paradigme : le mixage s’est graduellement imposé comme le geste perceptif et créateur qui rend compte de la sensibilité contemporaine. Notre thèse explore les effets de la pensée du mixage (qui procède par résonance, simultanéité, dosage et modulation) sur notre écoute et notre compréhension de l'expérience cinématographique. À l'aide de paroles de concepteurs sonores (Murch, Beaugrand, Thom, Allard…), de textes théoriques sur le son filmique (Cardinal, Chion, Campan), de documentaires sur des musiciens improvisateurs (Lussier, Glennie, Frith), de films de fiction à la dimension sonore affirmée (Denis, Van Sant), de textes philosophiques sur la perception (Leibniz, James, Straus, Szendy…), d'analyses du dispositif sonore cinématographique, notre thèse rend audibles des tensions, des récurrences, de nouveaux agencements, des problèmes actuels et inactuels qui forgent et orientent l'écoute du théoricien, du créateur et de l'auditeur. En interrogeant la dimension sonore de la perception, de l’action, de l’espace et de la pensée, cette thèse a pour objectif de modifier la façon dont on écoute, crée et pense le son au cinéma.

Interacting software-agents to support a kind of expert supervision systems

Expert supervision systems are software applications specially designed to automate process monitoring. The goal is to reduce the dependency on human operators to assure the correct operation of a process including faulty situations. Construction of this kind of application involves an important task of design and development in order to represent and to manipulate process data and behaviour at different degrees of abstraction for interfacing with data acquisition systems connected to the process. This is an open problem that becomes more complex with the number of variables, parameters and relations to account for the complexity of the process. Multiple specialised modules tuned to solve simpler tasks that operate under a co-ordination provide a solution. A modular architecture based on concepts of software agents, taking advantage of the integration of diverse knowledge-based techniques, is proposed for this purpose. The components (software agents, communication mechanisms and perception/action mechanisms) are based on ICa (Intelligent Control architecture), software middleware supporting the build-up of applications with software agent features

Hierarchical Prediction Machines and Big Data Analytics

An emerging consensus in cognitive science views the biological brain as a hierarchically-organized predictive processing system. This is a system in which higher-order regions are continuously attempting to predict the activity of lower-order regions at a variety of (increasingly abstract) spatial and temporal scales. The brain is thus revealed as a hierarchical prediction machine that is constantly engaged in the effort to predict the flow of information originating from the sensory surfaces. Such a view seems to afford a great deal of explanatory leverage when it comes to a broad swathe of seemingly disparate psychological phenomena (e.g., learning, memory, perception, action, emotion, planning, reason, imagination, and conscious experience). In the most positive case, the predictive processing story seems to provide our first glimpse at what a unified (computationally-tractable and neurobiological plausible) account of human psychology might look like. This obviously marks out one reason why such models should be the focus of current empirical and theoretical attention. Another reason, however, is rooted in the potential of such models to advance the current state-of-the-art in machine intelligence and machine learning. Interestingly, the vision of the brain as a hierarchical prediction machine is one that establishes contact with work that goes under the heading of 'deep learning'. Deep learning systems thus often attempt to make use of predictive processing schemes and (increasingly abstract) generative models as a means of supporting the analysis of large data sets. But are such computational systems sufficient (by themselves) to provide a route to general human-level analytic capabilities? I will argue that they are not and that closer attention to a broader range of forces and factors (many of which are not confined to the neural realm) may be required to understand what it is that gives human cognition its distinctive (and largely unique) flavour. The vision that emerges is one of 'homomimetic deep learning systems', systems that situate a hierarchically-organized predictive processing core within a larger nexus of developmental, behavioural, symbolic, technological and social influences. Relative to that vision, I suggest that we should see the Web as a form of 'cognitive ecology', one that is as much involved with the transformation of machine intelligence as it is with the progressive reshaping of our own cognitive capabilities.

The informational turn in Philosophy: any novelty in the study of Mind?

The concept of information is analyzed starting from Adams' hypothesis in The Informational Turn in Philosophy, according to which there has been a far-reaching turn in Philosophy following the publication of Turing's article "Computing Machinery and Intelligence". Adams maintains that new guidelines are being indicated in philosophical research, having the concept of "information" as the basis for treatment of classical problems, such as the relationships between mind-body, perception-action, and the nature of knowledge, amongst others. Partially agreeing with Adams, we believe, however, that his hypothesis faces difficulties, the most fundamental of which concerns the different meanings given to the concept of information. We argue that even though the concept of information underlying the mechanicist proposal of Turing, according to which "to think is to compute", is indeed being employed in Philosophy, this is not because of its mechanistic nature, but mainly due to the representationist presupposition dominant in this area. From this point of view, the informational turn in philosophy would not provide any great novelty, given that since the earliest days philosophical approaches to the nature of mind have always been mainly representationist. The novelty would not lie specifically in the Turing thesis, but in reflections on the nature of information, especially ecological information, and its relation to action.