Differential patterns of multisensory interactions in core and belt areas of human auditory cortex

The auditory cortex is anatomically segregated into a central core and a peripheral belt region, which exhibit differences in preference to bandpassed noise and in temporal patterns of response to acoustic stimuli. While it has been shown that visual stimuli can modify response magnitude in auditory cortex, little is known about differential patterns of multisensory interactions in core and belt. Here, we used functional magnetic resonance imaging and examined the influence of a short visual stimulus presented prior to acoustic stimulation on the spatial pattern of blood oxygen level-dependent signal response in auditory cortex. Consistent with crossmodal inhibition, the light produced a suppression of signal response in a cortical region corresponding to the core. In the surrounding areas corresponding to the belt regions, however, we found an inverse modulation with an increasing signal in centrifugal direction. Our data suggest that crossmodal effects are differentially modulated according to the hierarchical core-belt organization of auditory cortex.

Out-of-Body Experiences and Other Complex Dissociation Experiences in a Patient with Unilateral Peripheral Vestibular Damage and Deficient Multisensory Integration

Out-of-body experiences (OBEs) are illusory perceptions of one's body from an elevated disembodied perspective. Recent theories postulate a double disintegration process in the personal (visual, proprioceptive and tactile disintegration) and extrapersonal (visual and vestibular disintegration) space as the basis of OBEs. Here we describe a case which corroborates and extends this hypothesis. The patient suffered from peripheral vestibular damage and presented with OBEs and lucid dreams. Analysis of the patient's behaviour revealed a failure of visuo-vestibular integration and abnormal sensitivity to visuo-tactile conflicts that have previously been shown to experimentally induce out-of-body illusions (in healthy subjects). In light of these experimental findings and the patient's symptomatology we extend an earlier model of the role of vestibular signals in OBEs. Our results advocate the involvement of subcortical bodily mechanisms in the occurrence of OBEs.

Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools

Primate multisensory object perception involves distributed brain regions. To investigate the network character of these regions of the human brain, we applied data-driven group spatial independent component analysis (ICA) to a functional magnetic resonance imaging (fMRI) data set acquired during a passive audio-visual (AV) experiment with common object stimuli. We labeled three group-level independent component (IC) maps as auditory (A), visual (V), and AV, based on their spatial layouts and activation time courses. The overlap between these IC maps served as definition of a distributed network of multisensory candidate regions including superior temporal, ventral occipito-temporal, posterior parietal and prefrontal regions. During an independent second fMRI experiment, we explicitly tested their involvement in AV integration. Activations in nine out of these twelve regions met the max-criterion (A < AV > V) for multisensory integration. Comparison of this approach with a general linear model-based region-of-interest definition revealed its complementary value for multisensory neuroimaging. In conclusion, we estimated functional networks of uni- and multisensory functional connectivity from one dataset and validated their functional roles in an independent dataset. These findings demonstrate the particular value of ICA for multisensory neuroimaging research and using independent datasets to test hypotheses generated from a data-driven analysis.

Brain responses to auditory and visual stimulus offset: Shared representations of temporal edges

Edges are crucial for the formation of coherent objects from sequential sensory inputs within a single modality. Moreover, temporally coincident boundaries of perceptual objects across different sensory modalities facilitate crossmodal integration. Here, we used functional magnetic resonance imaging in order to examine the neural basis of temporal edge detection across modalities. Onsets of sensory inputs are not only related to the detection of an edge but also to the processing of novel sensory inputs. Thus, we used transitions from input to rest (offsets) as convenient stimuli for studying the neural underpinnings of visual and acoustic edge detection per se. We found, besides modality-specific patterns, shared visual and auditory offset-related activity in the superior temporal sulcus and insula of the right hemisphere. Our data suggest that right hemispheric regions known to be involved in multisensory processing are crucial for detection of edges in the temporal domain across both visual and auditory modalities. This operation is likely to facilitate cross-modal object feature binding based on temporal coincidence. Hum Brain Mapp, 2008. (c) 2008 Wiley-Liss, Inc.

Self-motion perception training: thresholds improve in the light but not in the dark

We investigated perceptual learning in self-motion perception. Blindfolded participants were displaced leftward or rightward by means of a motion platform and asked to indicate the direction of motion. A total of eleven participants underwent 3,360 practice trials, distributed over twelve (Experiment 1) or 6 days (Experiment 2). We found no improvement in motion discrimination in both experiments. These results are surprising since perceptual learning has been demonstrated for visual, auditory, and somatosensory discrimination. Improvements in the same task were found when visual input was provided (Experiment 3). The multisensory nature of vestibular information is discussed as a possible explanation of the absence of perceptual learning in darkness.

Restoring tactile awareness through the rubber hand illusion in cervical spinal cord injury

BACKGROUND Bodily sensations are an important component of corporeal awareness. Spinal cord injury can leave affected body parts insentient and unmoving, leading to specific disturbances in the mental representation of one's own body and the sense of self. OBJECTIVE Here, we explored how illusions induced by multisensory stimulation influence immediate sensory signals and tactile awareness in patients with spinal cord injuries. METHODS The rubber hand illusion paradigm was applied to 2 patients with chronic and complete spinal cord injury of the sixth cervical spine, with severe somatosensory impairments in 2 of 5 fingers. RESULTS Both patients experienced a strong illusion of ownership of the rubber hand during synchronous, but not asynchronous, stroking. They also, spontaneously reported basic tactile sensations in their previously numb fingers. Tactile awareness from seeing the rubber hand was enhanced by progressively increasing the stimulation duration. CONCLUSIONS Multisensory illusions directly and specifically modulate the reemergence of sensory memories and enhance tactile sensation, despite (or as a result of) prior deafferentation. When sensory inputs are lost, and are later illusorily regained, the brain updates a coherent body image even several years after the body has become permanently unable to feel. This particular example of neural plasticity represents a significant opportunity to strengthen the sense of the self and the feelings of embodiment in patients with spinal cord injury.

Spatial cognition, body representation and affective processes: the role of vestibular information beyond ocular reflexes and control of posture

A growing number of studies in humans demonstrate the involvement of vestibular information in tasks that are seemingly remote from well-known functions such as space constancy or postural control. In this review article we point out three emerging streams of research highlighting the importance of vestibular input: (1) Spatial Cognition: Modulation of vestibular signals can induce specific changes in spatial cognitive tasks like mental imagery and the processing of numbers. This has been shown in studies manipulating body orientation (changing the input from the otoliths), body rotation (changing the input from the semicircular canals), in clinical findings with vestibular patients, and in studies carried out in microgravity. There is also an effect in the reverse direction; top-down processes can affect perception of vestibular stimuli. (2) Body Representation: Numerous studies demonstrate that vestibular stimulation changes the representation of body parts, and sensitivity to tactile input or pain. Thus, the vestibular system plays an integral role in multisensory coordination of body representation. (3) Affective Processes and Disorders: Studies in psychiatric patients and patients with a vestibular disorder report a high comorbidity of vestibular dysfunctions and psychiatric symptoms. Recent studies investigated the beneficial effect of vestibular stimulation on psychiatric disorders, and how vestibular input can change mood and affect. These three emerging streams of research in vestibular science are—at least in part—associated with different neuronal core mechanisms. Spatial transformations draw on parietal areas, body representation is associated with somatosensory areas, and affective processes involve insular and cingulate cortices, all of which receive vestibular input. Even though a wide range of different vestibular cortical projection areas has been ascertained, their functionality still is scarcely understood.

Internal Models, Vestibular Cognition, and Mental Imagery: Conceptual Considerations

Vestibular cognition has recently gained attention. Despite numerous experimental and clinical demonstrations, it is not yet clear what vestibular cognition really is. For future research in vestibular cognition, adopting a computational approach will make it easier to explore the underlying mech- anisms. Indeed, most modeling approaches in vestibular science include a top-down or a priori component. We review recent Bayesian optimal observer models, and discuss in detail the conceptual value of prior assumptions, likelihood and posterior estimates for research in vestibular cognition. We then consider forward models in vestibular processing, which are required in order to distinguish between sensory input that is induced by active self-motion, and sensory input that is due to passive self-motion. We suggest that forward models are used not only in the service of estimating sensory states but they can also be drawn upon in an offline mode (e.g., spatial perspective transformations), in which interaction with sensory input is not desired. A computational approach to vestibular cogni- tion will help to discover connections across studies, and it will provide a more coherent framework for investigating vestibular cognition.