Spatial Perception and Cognition in Multichannel Audio for Electroacoustic Music

Listeners experience electroacoustic music as full of significance and meaning, and they experience spatiality as one of the factors contributing to its meaningfulness. If we want to understand spatiality in electroacoustic music, we must understand how the listener’s mental processes give rise to the experience of meaning. In electroacoustic music as in everyday life, these mental processes unite the peripheral auditory system with human spatial cognition. In the discussion that follows we consider a range of the listener’s mental processes relating space and meaning from the perceptual attributes of spatial imagery to the spatial reference frames for places and navigation. When considering multichannel loudspeaker systems in particular, an important part of the discussion is focused on the distinctive and idiomatic ways in which this particular mode of sound production contributes to and situates meaning. These idiosyncrasies include the phenomenon of image dispersion, the important consequences of the precedence effect and the influence of source characteristics on spatial imagery. These are discussed in close relation to the practicalities of artistic practice and to the potential for artistic meaning experienced by the listener.

Following instructions from working memory: Why does action at encoding and recall help?

Two experiments investigated the consequences of action at encoding and recall on the ability to follow sequences of instructions. Children aged 7–9 years recalled sequences of spoken action commands under presentation and recall conditions that either did or did not involve their physical performance. In both experiments, recall was enhanced by carrying out the instructions as they were being initially presented and also by performing them at recall. In contrast, the accuracy of instruction-following did not improve above spoken presentation alone, either when the instructions were silently read or heard by the child (Experiment 1), or when the child repeated the spoken instructions as they were presented (Experiment 2). These findings suggest that the enactment advantage at presentation does not simply reflect a general benefit of a dual exposure to instructions, and that it is not a result of their self-production at presentation. The benefits of action-based recall were reduced following enactment during presentation, suggesting that the positive effects of action at encoding and recall may have a common origin. It is proposed that the benefits of physical movement arise from the existence of a short-term motor store that maintains the temporal, spatial, and motoric features of either planned or already executed actions.

Using Virtual Reality to Analyze Sports Performance

Improving performance in sports requires a better understanding of the perception-action loop employed by athletes. Because of its inherent limitations, video playback doesn't permit this type of in-depth analysis. Interactive, immersive virtual reality can overcome these limitations and foster a better understanding of sports performance.

An Affordance Based Approach to Decision Making in Sport: Discussing a Novel Methodological Framework

Decision making is a fundamental clement of any sport, particularly open, fast, dynamic team sports such as football, basketball and rugby. At the elite level, athletes appear to consistently make good decisions in situations that are highly temporally constrained. To further understand how this is done has been the aim of researchers within the perception-action field for several decades. The purpose of this article is to present novel contributions, both theoretical and methodological, that are pushing the boundaries of this area of research. The theoretical framework (Ecological psychology) within which the work is posited will be described, followed by a description of Virtual Reality (VR) technology and how it relates to the theoretical aims. Finally, an applied example will be summarised in order to demonstrate how the theoretical approach and the methodological approach come together in practice.

Modelling the control of interceptive actions

In recent years, several phenomenological dynamical models have been formulated that describe how perceptual variables are incorporated in the control of motor variables. We call these short-route models as they do not address how perception-action patterns might be constrained by the dynamical properties of the sensory, neural and musculoskeletal subsystems of the human action system. As an alternative, we advocate a long-route modelling approach in which the dynamics of these subsystems are explicitly addressed and integrated to reproduce interceptive actions. The approach is exemplified through a discussion of a recently developed model for interceptive actions consisting of a neural network architecture for the online generation of motor outflow commands, based on time-to-contact information and information about the relative positions and velocities of hand and ball. This network is shown to be consistent with both behavioural and neurophysiological data. Finally, some problems are discussed with regard to the question of how the motor outflow commands (i.e. the intended movement) might be modulated in view of the musculoskeletal dynamics.

Sensory-motor problems in Autism

Despite being largely characterised as a social and cognitive disorder, strong evidence indicates the presence of significant sensory-motor problems in Autism Spectrum Disorder (ASD). This paper outlines our progression from initial, broad assessment using the Movement Assessment Battery for Children (M-ABC) to subsequent targeted kinematic assessment. In particular, pronounced ASD impairment seen in the broad categories of manual dexterity and ball skills was found to be routed in specific difficulties on isolated tasks, which were translated into focused experimental assessment. Kinematic results from both subsequent studies highlight impaired use of perception-action coupling to guide, adapt and tailor movement to task demands, resulting in inflexible and rigid motor profiles. In particular difficulties with the use of temporal adaption are shown, with "hyperdexterity" witnessed in ballistic movement profiles, often at the cost of spatial accuracy and task performance. By linearly progressing from the use of a standardised assessment tool to targeted kinematic assessment, clear and defined links are drawn between measureable difficulties and underlying sensory-motor assessment. Results are specifically viewed in-light of perception-action coupling and its role in early infant development suggesting that rather than being 'secondary' level impairment, sensory-motor problems may be fundamental in the progression of ASD. This logical and systematic process thus allows a further understanding into the potential route of observable motor problems in ASD; a vital step if underlying motor problems are to be considered a fundamental aspect of autism and allow a route of non-invasive preliminary diagnosis.

(Dis‑)Harmony in movement: effects of musical dissonance on movement timing and form

While the origins of consonance and dissonance in terms of acoustics, psychoacoustics and physiology have been debated for centuries, their plausible effects on movement synchronization have largely been ignored. The present study aims to address this by investigating whether, and if so how, consonant/dissonant pitch intervals affect the spatiotemporal properties of regular reciprocal aiming movements. We compared movements synchronized either to consonant or to dissonant sounds, and showed that they were differently influenced by the degree of consonance of the sound presented. Interestingly, the difference was present after the sound stimulus was removed. In this case, the performance measured after consonant sound exposure was found to be more stable and accurate, with a higher percentage of information/movement coupling (tau-coupling) and a higher degree of movement circularity when compared to performance measured after the exposure to dissonant sounds. We infer that the neural resonance representing consonant tones leads to finer perception/action coupling which in turn may help explain the prevailing preference for these types of tones.

Movement and Perceptual Strategies to Intercept Virtual Sound Sources

To intercept a moving object, one needs to be in the right place at the right time. In order to do this, it is necessary to pick up and use perceptual information that specifies the time to arrival of an object at an interception point. In the present study, we examined the ability to intercept a laterally moving virtual sound object by controlling the displacement of a sliding handle and tested whether and how the interaural time difference (ITD) could be the main source of perceptual information for successfully intercepting the virtual object. The results revealed that in order to accomplish the task, one might need to vary the duration of the movement, control the hand velocity and time to reach the peak velocity (speed coupling), while the adjustment of movement initiation did not facilitate performance. Furthermore, the overall performance was more successful when subjects employed a time-to-contact (tau) coupling strategy. This result shows that prospective information is available in sound for guiding goal-directed actions.

Artificial gravity reveals that economy of action determines the stability of sensorimotor coordination.

Background
When we move along in time with a piece of music, we synchronise the downward phase of our gesture with the beat. While it is easy to demonstrate this tendency, there is considerable debate as to its neural origins. It may have a structural basis, whereby the gravitational field acts as an orientation reference that biases the formulation of motor commands. Alternatively, it may be functional, and related to the economy with which motion assisted by gravity can be generated by the motor system.
Methodology/Principal Findings
We used a robotic system to generate a mathematical model of the gravitational forces acting upon the hand, and then to reverse the effect of gravity, and invert the weight of the limb. In these circumstances, patterns of coordination in which the upward phase of rhythmic hand movements coincided with the beat of a metronome were more stable than those in which downward movements were made on the beat. When a normal gravitational force was present, movements made down-on-the-beat were more stable than those made up-on-the-beat.
Conclusions/Significance
The ubiquitous tendency to make a downward movement on a musical beat arises not from the perception of gravity, but as a result of the economy of action that derives from its exploitation.

Influence of predominant patterns of coordination on the exploitation of interaction torques in a two-joint rhythmic arm movement

In this study we investigate the coordination between rhythmic flexion-extension (FE) and supination-pronation (SP) movements at the elbow joint-complex, while manipulating the intersegmental dynamics by means of a 2-degrees of freedom (df) robot arm. We hypothesized that constraints imposed by the structure of the neuromuscular-skeletal system would (1) result in predominant pattern(s) of coordination in the absence of interaction torques and (2) influence the capabilities of participants to exploit artificially induced interaction torques. Two experiments were conducted in which different conditions of interaction torques were applied on the SP-axis as a function of FE movements. These conditions promoted different patterns of coordination between the 2-df. Control trials conducted in the absence of interaction torques revealed that both the in-phase (supination synchronized with flexion) and the anti-phase (pronation synchronized with flexion) patterns were spontaneously established by participants. The predominance of these patterns of coordination is explained in terms of the mechanical action of bi-articular muscles acting at the elbow joint-complex, and in terms of the reflexes that link the activity of the muscles involved. Results obtained in the different conditions of interaction torques revealed that those neuromuscular-skeletal constraints either impede or favor the exploitation of intersegmental dynamics depending on the context. Interaction torques were indeed found to be exploited to a greater extent in conditions in which the profiles of interaction torques favored one of the two predominant patterns of coordination (i.e., in-phase or anti-phase) as opposed to other patterns of coordination (e.g., 90 degrees or 270 degrees). Those results are discussed in relation to recent studies reporting exploitation of interaction torques in the context of rhythmic movements.

Bimanual coordination: constraints imposed by the relative timing of homologous muscle activation

It has often been supposed that patterns of rhythmic bimanual coordination in which homologous muscles are engaged simultaneously, are performed in a more stable manner than those in which the same muscles are activated in an alternating fashion. In order to assess the efficacy of this constraint, the present study investigated the effect of forearm posture (prone or supine) on bimanual abduction-adduction movements of the wrist in isodirectional and non-isodirectional modes of coordination. Irrespective of forearm posture, non-isodirectional coordination was observed to be more stable than isodirectional coordination. In the latter condition, there was a more severe deterioration of coordination accuracy/stability as a function of cycling frequency than in the former condition. With elevations in cycling frequency, the performers recruited extra mechanical degrees of freedom, principally via flexion-extension of the wrist, which gave rise to increasing motion in the vertical plane. The increases in movement amplitude in the vertical plane were accompanied by decreasing amplitude in the horizontal plane. In agreement with previous studies, the present findings confirm that the relative timing of homologous muscle activation acts as a principal constraint upon the stability of interlimb coordination. Furthermore, it is argued that the use of manipulations of limb posture to investigate the role of other classes of constraint (e.g. perceptual) should be approached with caution because such manipulations affect the mapping between muscle activation patterns, movement dynamics and kinematics.

Interaction of directional, neuromuscular and egocentric constraints on the stability of preferred bimanual coordination patterns

We investigated how the relative direction of limb movements in external space (iso- and non-isodirectionality), muscular constraints (the relative timing of homologous muscle activation) and the egocentric frame of reference (moving simultaneously toward/away the longitudinal axis of the body) contribute to the stability of coordinated movements. In the first experiment, we attempted to determine the respective stability of isodirectional and non-isodirectional movements in between-persons coordination. In a second experiment, we determined the effect of the relative direction in external space, and of muscular constraints, on pattern stability during a within-person bimanual coordination task. In the third experiment we dissociated the effects on pattern stability of the muscular constraints, relative direction and egocentric frame of reference. The results showed that (1) simultaneous activation of homologous muscles resulted in more stable performance than simultaneous activation of non-homologous muscles during within-subject coordination, and that (2) isodirectional movements were more stable than non-isodirectional movements during between-persons coordination, confirming the role of the relative direction of the moving limbs in the stability of bimanual coordination. Moreover, the egocentric constraint was to some extent found distinguishable from the effect of the relative direction of the moving limbs in external space, and from the effect of the relative timing of muscle activation. In summary, the present study showed that relative direction of the moving limbs in external space and muscular constraints may interact either to stabilize or destabilize coordination patterns. (C) 2003 Published by Elsevier B.V.

Haptic information stabilizes and destabilizes coordination dynamics

Goal-directed, coordinated movements in humans emerge from a variety of constraints that range from 'high-level' cognitive strategies based oil perception of the task to 'low-level' neuromuscular-skeletal factors such as differential contributions to coordination from flexor and extensor muscles. There has been a tendency in the literature to dichotomize these sources of constraint, favouring one or the other rather than recognizing and understanding their mutual interplay. In this experiment, subjects were required to coordinate rhythmic flexion and extension movements with an auditory metronome, the rate of which was systematically increased. When subjects started in extension on the beat of the metronome, there was a small tendency to switch to flexion at higher rates, but not vice versa. When subjects: were asked to contact a physical stop, the location of which was either coincident with or counterphase to the auditor) stimulus, two effects occurred. When haptic contact was coincident with sound, coordination was stabilized for both flexion and extension. When haptic contact was counterphase to the metronome, coordination was actually destabilized, with transitions occurring from both extension to flexion on the beat and from flexion to extension on the beat. These results reveal the complementary nature of strategic and neuromuscular factors in sensorimotor coordination. They also suggest the presence of a multimodal neural integration process-which is parametrizable by rate and context - in which intentional movement, touch and sound are bound into a single, coherent unit.

Let your feet do the walking: constraints on the stability of bipedal coordination

In this paper we consider whether the behaviour of the neural circuitry that controls lower limb movements in humans is shaped primarily by the spatiotemporal characteristics of bipedal gait patterns, or by selective pressures that are sensitive to considerations of balance and energetics. During the course of normal locomotion, the full dynamics of the neural circuitry are masked by the inertial properties of the limbs. In the present study, participants executed bipedal movements in conditions in which their feet were either unloaded or subject to additional inertial loads. Two patterns of rhythmic coordination were examined. In the in-phase mode, participants were required to flex their ankles and extend their ankles in synchrony. In the out-of-phase mode, the participants flexed one ankle while extending the other and vice versa. The frequency of movement was increased systematically throughout each experimental trial. All participants were able to maintain both the in-phase and the out-of-phase mode of coordination, to the point at which they could no longer increase their frequency of movement. Transitions between the two modes were not observed, and the stability of the out-of-phase and in-phase modes of coordination was equivalent at all movement frequencies. These findings indicate that, in humans, the behaviour of the neural circuitry underlying coordinated movements of the lower limbs is not constrained strongly by the spatiotemporal symmetries of bipedal gait patterns.