Seeing music performance: Visual influences on perception and experience

Drawing from ethnographic, empirical, and historical/cultural perspectives, we examine the extent to which visual aspects of music contribute to the communication that takes place between performers and their listeners. First, we introduce a framework for understanding how media and genres shape aural and visual experiences of music. Second, we present case studies of two performances, and describe the relation between visual and aural aspects of performance. Third, we report empirical evidence that visual aspects of performance reliably influence perceptions of musical structure (pitch related features) and affective interpretations of music. Finally, we trace new and old media trajectories of aural and visual dimensions of music, and highlight how our conceptions, perceptions and appreciation of music are intertwined with technological innovation and media deployment strategies.

Probing expert anticipation with the temporal occlusion paradigm: Experimental investigations of some methodological issues

Two experiments were conducted to examine whether the conclusions drawn regarding the timing of anticipatory information pick-up from temporal occlusion studies are influenced by whether (a) the viewing period is of variable or fixed duration and (b) the task is a laboratory-based one with simple responses or a natural one requiring a coupled, interceptive movement response. Skilled and novice tennis players either made pencil-and-paper predictions of service direction (Experiment 1) or attempted to hit return strokes (Experiment 2) to tennis serves while their vision was temporally occluded in either a traditional progressive mode (where more information was revealed in each subsequent occlusion condition) or a moving window mode (where the visual display was only available for a fixed duration with this window shifted to different phases of the service action). Conclusions regarding the timing of information pick-up were generally consistent across display mode and across task setting lending support to the veracity and generalisability of findings regarding perceptual expertise in existing laboratory-based progressive temporal occlusion studies.

Capacity limits for the detection of changing visual features

Capacity limits in visual attention have traditionally been studied using static arrays of elements from which an observer must detect a target defined by a certain visual feature or combination of features. In the current study we use this visual search paradigm, with accuracy as the dependent variable, to examine attentional capacity limits for different visual features undergoing change over time. In Experiment 1, detectability of a single changing target was measured under conditions where the type of change (size, speed, colour), the magnitude of change, the set size and homogeneity of the unchanging distractors were all systematically varied. Psychometric function slopes were calculated for different experimental conditions and ‘change thresholds’extracted from these slopes were used in Experiment 2, in which multiple supra-threshold changes were made, simultaneously, either to a single or to two or three different stimulus elements. These experiments give an objective psychometric paradigm for measuring changes in visual features over time. Results favour object-based accounts of visual attention, and show consistent differences in the allocation of attentional capacity to different perceptual dimensions.

Experimental muscle pain changes feedforward postural responses of the trunk muscles

Many studies have identified changes in trunk muscle recruitment in clinical low back pain (LBP). However, due to the heterogeneity of the LBP population these changes have been variable and it has been impossible to identify a cause-effect relationship. Several studies have identified a consistent change in the feed-forward postural response of transversus abdominis (TrA), the deepest abdominal muscle, in association with arm movements in chronic LBP. This study aimed to determine whether the feedforward recruitment of the trunk muscles in a postural task could be altered by acute experimentally induced LBP. Electromyographic (EMG) recordings of the abdominal and paraspinal muscles were made during arm movements in a control trial, following the injection of isotonic (non-painful) and hypertonic (painful) saline into the longissimus muscle at L4, and during a 1-h follow-up. Movements included rapid arm flexion in response to a light and repetitive arm flexion-extension. Temporal and spatial EMG parameters were measured. The onset and amplitude of EMG of most muscles was changed in a variable manner during the period of experimentally induced pain. However, across movement trials and subjects the activation of TrA was consistently reduced in amplitude or delayed. Analyses in the time and frequency domain were used to confirm these findings. The results suggest that acute experimentally induced pain may affect feedforward postural activity of the trunk muscles. Although the response was variable, pain produced differential changes in the motor control of the trunk muscles, with consistent impairment of TrA activity.

Avoidance of obstacles in the absence of visual awareness

The spatial character of our reaching movements is extremely sensitive to potential obstacles in the workspace. We recently found that this sensitivity was retained by most patients with left visual neglect when reaching between two objects, despite the fact that they tended to ignore the leftward object when asked to bisect the space between them. This raises the possibility that obstacle avoidance does not require a conscious awareness of the obstacle avoided. We have now tested this hypothesis in a patient with visual extinction following right temporoparietal damage. Extinction is an attentional disorder in which patients fail to report stimuli on the side of space opposite a brain lesion under conditions of bilateral stimulation. Our patient avoided obstacles during reaching, to exactly the same degree, regardless of whether he was able to report their presence. This implicit processing of object location, which may depend on spared superior parietal-lobe pathways, demonstrates that conscious awareness is not necessary for normal obstacle avoidance.

"mind the gap": The size-distance dissociation in visual neglect is a cueing effect

There is a growing body of evidence that the processes mediating the allocation of spatial attention within objects may be separable from those governing attentional distribution between objects. In the neglect literature, a related proposal has been made regarding the perception of (within-object) sizes and (between-object) distances. This proposal follows observations that, in size-matching and bisection tasks, neglect is more strongly expressed when patients are required to attend to the sizes of discrete objects than to the (unfilled) distances between objects. These findings are consistent with a partial dissociation between size and distance processing, but a simpler alternative must also be considered. Whilst a neglect patient may fail to explore the full extent of a solid stimulus, the estimation of an unfilled distance requires that both endpoints be inspected before the task can be attempted at all. The attentional cueing implicit in distance estimation tasks might thus account for their superior performance by neglect patients. We report two bisection studies that address this issue. The first confirmed, amongst patients with left visual neglect, a reliable reduction of rightward error for unfilled gap stimuli as compared with solid lines. The second study assessed the cause of this reduction, deconfounding the effects of stimulus type (lines vs. gaps) and attentional cueing, by applying an explicit cueing manipulation to line and gap bisection tasks. Under these matched cueing conditions, all patients performed similarly on line and gap bisection tasks, suggesting that the reduction of neglect typically observed for gap stimuli may be attributable entirely to cueing effects. We found no evidence that a spatial extent, once fully attended, is judged any differently according to whether it is filled or unfilled.

Perception of faces and bodies: Similar or different?

Human faces and bodies are both complex and interesting perceptual objects, and both convey important social information. Given these similarities between faces and bodies, we can ask how similar are the visual processing mechanisms used to recognize them. It has long been argued that faces are subject to dedicated and unique perceptual processes, but until recently, relatively little research has focused on how we perceive the human. body. Some recent paradigms indicate that faces and bodies are processed differently; others show similarities in face and body perception. These similarities and differences depend on the type of perceptual task and the level of processing involved. Future research should take these issues into account.

Visual-auditory integration during speech imitation in autism

Children with autistic spectrum disorder (ASD) may have poor audio-visual integration, possibly reflecting dysfunctional 'mirror neuron' systems which have been hypothesised to be at the core of the condition. In the present study, a computer program, utilizing speech synthesizer software and a 'virtual' head (Baldi), delivered speech stimuli for identification in auditory, visual or bimodal conditions. Children with ASD were poorer than controls at recognizing stimuli in the unimodal conditions, but once performance on this measure was controlled for, no group difference was found in the bimodal condition. A group of participants with ASD were also trained to develop their speech-reading ability. Training improved visual accuracy and this also improved the children's ability to utilize visual information in their processing of speech. Overall results were compared to predictions from mathematical models based on integration and non-integration, and were most consistent with the integration model. We conclude that, whilst they are less accurate in recognizing stimuli in the unimodal condition, children with ASD show normal integration of visual and auditory speech stimuli. Given that training in recognition of visual speech was effective, children with ASD may benefit from multi-modal approaches in imitative therapy and language training. (C) 2004 Elsevier Ltd. All rights reserved.

The effect of stimulus modality and task difficulty on attentional modulation of blink startle

The effects of the sensory modality of the lead Stimulus and of task difficulty on attentional modulation of the electrical and acoustic blink reflex were examined. Participants performed a discrimination and counting task with either two acoustic, two visual, or two tactile lead stimuli. In Experiment 1, facilitation of the electrically elicited blink was greater during task-relevant than during task-irrelevant lead stimuli. Increasing task difficulty enhanced magnitude facilitation for acoustic lead stimuli. In Experiment 2, acoustic blink facilitation was greater during task-relevant lead stimuli, but was unaffected by task difficulty. Experiment 3 showed that a further increase in task difficulty did not affect acoustic blink facilitation during visual lead stimuli. The observation that blink reflexes are facilitated by attention in the present task domain is consistent across a range of stimulus modality and task difficulty conditions.

Attentional blink reflex modulation in a continuous performance task is modality specific

Four experiments investigated the attentional modulation of acoustic blinks during continuous spatial tracking tasks. Experiment 1 found blink magnitude inhibition in a visual tracking task. Experiment 2 replicated this finding and also found blink latency slowing. Experiment 3 varied the difficulty of the task and found larger blink inhibition in the easy condition. Blink latency slowing did not differ and was significant at both difficulty levels. Experiment 4 employed less difficult visual and acoustic tracking tasks at two levels of task load. Blink magnitude inhibition during the visual and facilitation during the acoustic task was significant during high load in both modality groups. Blink latency was slowed in all visual task conditions and shortened in the difficult acoustic task. These results indicate that attentional blink modulation in a continuous spatial tracking task is modality specific.

Snakes and cats in the flower bed: Fast detection is not specific to pictures of fear-relevant animals

The observation that snakes and spiders are found faster among flowers and mushrooms than vice versa and that this search advantage is independent of set size supports the notion that fear-relevant stimuli are processed preferentially in a dedicated fear module. Experiment I replicated the faster identification of snakes and spiders but also found a set size effect in a blocked, but not in a mixed-trial, sequence. Experiment 2 failed to find faster identification of snake and spider deviants relative to other animals among flowers and mushrooms and provided evidence for a search advantage for pictures of animals, irrespective of their fear relevance. These findings suggest that results from the present visual search task cannot support the notion of preferential processing of fear relevance.

The effects of lead stimulus and reflex stimulus modality on modulation of the blink reflex at very short, short, and long lead intervals

The blink reflex is modulated if a weak lead stimulus precedes the blink-eliciting stimulus. In two experiments, we examined the effects of the sensory modality of the lead and blink-eliciting stimuli on blink modulation. Acoustic, visual, or tactile lead stimuli were followed by an acoustic (Experiment 1) or an electrotactile (Experiment 2) blink-eliciting stimulus at lead intervals of -30, 0, 30, 60, 120, 240, 360, and 4,500 msec. The inhibition of blink magnitude at the short (60- to 360-msec) lead intervals and the facilitation of blink magnitude at the long (4,500-msec) lead interval observed for each lead stimulus modality was relatively unaffected by the blink-eliciting stimulus modality. The facilitation of blink magnitude at the very short (-30- to 30-msec) lead intervals was dependent on the combination of the lead and the blink-eliciting stimulus modalities. Modality specific and nonspecific processes operate at different levels of perceptual processing.

Effects of visual occlusion and fatigue on motor performance in water

The purpose of this study was to test the effects of visual occlusion and fatigue on the motor performance of vertical skills in synchronized swimming. Experienced synchronized swimmers (n = 12) were randomly assigned to either an exercise or nonexercise (control) activity group. Subjective ratings of fatigue were obtained from the swimmers who then each performed four vertical skills under alternating conditions of vision and visual occlusion before and after either a swimming (designed to induce fatigue) or nonphysical activity. A main effect of activity (p < .03) was found for two measures of performance accuracy (lateral and anterior total distance traveled) but not for lateral and anterior maximum deviation from vertical, indicating that fatigue played a role in executing the skills. The data also indicate that the maintenance of a stationary position is a skill of greater difficulty than maintaining a true vertical. In contrast with previous research findings on synchronized swimmers, a significant effect of vision in all conditions was found, with performance decrements in the conditions of visual occlusion showing that vision provided important sensory input for the swimmers.