The emotional power of music: How music enhances the feeling of affective pictures

Music is an intriguing stimulus widely used in movies to increase the emotional experience. However, no brain imaging study has to date examined this enhancement effect using emotional pictures (the modality mostly used in emotion research) and musical excerpts. Therefore, we designed this functional magnetic resonance imaging study to explore how musical stimuli enhance the feeling of affective pictures. In a classical block design carefully controlling for habituation and order effects, we presented fearful and sad pictures (mostly taken from the IAPS) either alone or combined with congruent emotional musical excerpts (classical pieces). Subjective ratings clearly indicated that the emotional experience was markedly increased in the combined relative to the picture condition. Furthermore, using a second-level analysis and regions of interest approach, we observed a clear functional and structural dissociation between the combined and the picture condition. Besides increased activation in brain areas known to be involved in auditory as well as in neutral and emotional visual-auditory integration processes, the combined condition showed increased activation in many structures known to be involved in emotion processing (including for example amygdala, hippocampus, parahippocampus, insula, striatum, medial ventral frontal cortex, cerebellum, fusiform gyrus). In contrast, the picture condition only showed an activation increase in the cognitive part of the prefrontal cortex, mainly in the right dorsolateral prefrontal cortex. Based on these findings, we suggest that emotional pictures evoke a more cognitive mode of emotion perception, whereas congruent presentations of emotional visual and musical stimuli rather automatically evoke strong emotional feelings and experiences.

Rapid adaptation of visual search in simulated hemianopia

Patients with homonymous hemianopia have altered visual search patterns, but it is unclear how rapidly this develops and whether it reflects a strategic adaptation to altered perception or plastic changes to tissue damage. To study the temporal dynamics of adaptation alone, we used a gaze-contingent display to simulate left or right hemianopia in 10 healthy individuals as they performed 25 visual search trials. Visual search was slower and less accurate in hemianopic than in full-field viewing. With full-field viewing, there were improvements in search speed, fixation density, and number of fixations over the first 9 trials, then stable performance. With hemianopic viewing, there was a rapid shift of fixation into the blind field over the first 5-7 trials, followed by continuing gradual improvements in completion time, number of fixations, and fixation density over all 25 trials. We conclude that in the first minutes after onset of hemianopia, there is a biphasic pattern of adaptation to altered perception: an early rapid qualitative change that shifts visual search into the blind side, followed by more gradual gains in the efficiency of using this new strategy, a pattern that has parallels in other studies of motor learning.

Development of a novel fMRI compatible visual perception prototype battery to test older people with and without dementia

Background: Visuoperceptual deficits in dementia are common and can reduce quality of life. Testing of visuoperceptual function is often confounded by impairments in other cognitive domains and motor dysfunction. We aimed to develop, pilot, and test a novel visuocognitive prototype test battery which addressed these issues, suitable for both clinical and functional imaging use. Methods: We recruited 23 participants (14 with dementia, 6 of whom had extrapyramidal motor features, and 9 age-matched controls). The novel Newcastle visual perception prototype battery (NEVIP-B-Prototype) included angle, color, face, motion and form perception tasks, and an adapted response system. It allows for individualized task difficulties. Participants were tested outside and inside the 3T functional magnetic resonance imaging (fMRI) scanner. Functional magnetic resonance imaging data were analyzed using SPM8. Results: All participants successfully completed the task inside and outside the scanner. Functional magnetic resonance imaging analysis showed activation regions corresponding well to the regional specializations of the visual association cortex. In both groups, there was significant activity in the ventral occipital-temporal region in the face and color tasks, whereas the motion task activated the V5 region. In the control group, the angle task activated the occipitoparietal cortex. Patients and controls showed similar levels of activation, except on the angle task for which occipitoparietal activation was lower in patients than controls. Conclusion: Distinct visuoperceptual functions can be tested in patients with dementia and extrapyramidal motor features when tests use individualized thresholds, adapted tasks, and specialized response systems.

Cognitive binding in schizophrenia: weakened integration of temporal intersensory information

Cognitive functioning is based on binding processes, by which different features and elements of neurocognition are integrated and coordinated. Binding is an essential ingredient of, for instance, Gestalt perception. We have implemented a paradigm of causality perception based on the work of Albert Michotte, in which 2 identical discs move from opposite sides of a monitor, steadily toward, and then past one another. Their coincidence generates an ambiguous percept of either "streaming" or "bouncing," which the subjects (34 schizophrenia spectrum patients and 34 controls with mean age 27.9 y) were instructed to report. The latter perception is a marker of the binding processes underlying perceived causality (type I binding). In addition to this visual task, acoustic stimuli were presented at different times during the task (150 ms before and after visual coincidence), which can modulate perceived causality. This modulation by intersensory and temporally delayed stimuli is viewed as a different type of binding (type II). We show here, using a mixed-effects hierarchical analysis, that type II binding distinguishes schizophrenia spectrum patients from healthy controls, whereas type I binding does not. Type I binding may even be excessive in some patients, especially those with positive symptoms; Type II binding, however, was generally attenuated in patients. The present findings point to ways in which the disconnection (or Gestalt) hypothesis of schizophrenia can be refined, suggesting more specific markers of neurocognitive functioning and potential targets of treatment.

Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools

Primate multisensory object perception involves distributed brain regions. To investigate the network character of these regions of the human brain, we applied data-driven group spatial independent component analysis (ICA) to a functional magnetic resonance imaging (fMRI) data set acquired during a passive audio-visual (AV) experiment with common object stimuli. We labeled three group-level independent component (IC) maps as auditory (A), visual (V), and AV, based on their spatial layouts and activation time courses. The overlap between these IC maps served as definition of a distributed network of multisensory candidate regions including superior temporal, ventral occipito-temporal, posterior parietal and prefrontal regions. During an independent second fMRI experiment, we explicitly tested their involvement in AV integration. Activations in nine out of these twelve regions met the max-criterion (A < AV > V) for multisensory integration. Comparison of this approach with a general linear model-based region-of-interest definition revealed its complementary value for multisensory neuroimaging. In conclusion, we estimated functional networks of uni- and multisensory functional connectivity from one dataset and validated their functional roles in an independent dataset. These findings demonstrate the particular value of ICA for multisensory neuroimaging research and using independent datasets to test hypotheses generated from a data-driven analysis.

Increased phase synchronization during continuous face integration measured simultaneously with EEG and fMRI

Gamma zero-lag phase synchronization has been measured in the animal brain during visual binding. Human scalp EEG studies used a phase locking factor (trial-to-trial phase-shift consistency) or gamma amplitude to measure binding but did not analyze common-phase signals so far. This study introduces a method to identify networks oscillating with near zero-lag phase synchronization in human subjects.

Dorsal rather than ventral visual pathways discriminate freezing status in Parkinson's disease

BACKGROUND: Although visuospatial deficits have been linked with freezing of gait (FOG) in Parkinson's disease (PD), the specific effects of dorsal and ventral visual pathway dysfunction on FOG is not well understood. METHOD: We assessed visuospatial function in FOG using an angle discrimination test (dorsal visual pathway bias) and overlapping figure test (ventral visual pathway bias), and recorded overall response time, mean fixation duration and dwell time. Covariate analysis was conducted controlling for disease duration, motor severity, contrast sensitivity and attention with Bonferroni adjustments for multiple comparisons. RESULTS: Twenty seven people with FOG, 27 people without FOG and 24 controls were assessed. Average fixation duration during angle discrimination distinguished freezing status: [F (1, 43) = 4.77 p < 0.05] (1-way ANCOVA). CONCLUSION: Results indicate a preferential dysfunction of dorsal occipito-parietal pathways in FOG, independent of disease severity, attentional deficit, and contrast sensitivity.

Brain responses to auditory and visual stimulus offset: Shared representations of temporal edges

Edges are crucial for the formation of coherent objects from sequential sensory inputs within a single modality. Moreover, temporally coincident boundaries of perceptual objects across different sensory modalities facilitate crossmodal integration. Here, we used functional magnetic resonance imaging in order to examine the neural basis of temporal edge detection across modalities. Onsets of sensory inputs are not only related to the detection of an edge but also to the processing of novel sensory inputs. Thus, we used transitions from input to rest (offsets) as convenient stimuli for studying the neural underpinnings of visual and acoustic edge detection per se. We found, besides modality-specific patterns, shared visual and auditory offset-related activity in the superior temporal sulcus and insula of the right hemisphere. Our data suggest that right hemispheric regions known to be involved in multisensory processing are crucial for detection of edges in the temporal domain across both visual and auditory modalities. This operation is likely to facilitate cross-modal object feature binding based on temporal coincidence. Hum Brain Mapp, 2008. (c) 2008 Wiley-Liss, Inc.

Visual vector inversion during memory antisaccades--a TMS study

In the memory antisaccade task, subjects are instructed to look at an imaginary point precisely at the opposite side of a peripheral visual stimulus presented short time previously. To perform this task accurately, the visual vector, i.e., the distance between a central fixation point and the peripheral stimulus, must be inverted from one visual hemifield to the other. Recent data in humans and monkeys suggest that the posterior parietal cortex (PPC) might be critically involved in the process of visual vector inversion. In the present study, we investigated the temporal dynamics of visual vector inversion in the human PPC by using transcranial magnetic stimulation (TMS). In six healthy subjects, single pulse TMS was applied over the right PPC during a memory antisaccade task at four different time intervals: 100 ms, 217 ms, 333 ms, or 450 ms after target onset. The results indicate that for rightward antisaccades, i.e., when the visual target was presented in the left screen-half, TMS had a significant effect on saccade gain when applied 100 ms after target onset, but not later. For leftward antisaccades, i.e., when the visual target was presented in the right screen-half, a significant TMS effect on gain was found for the 333 ms and 450 ms conditions, but not for the earlier ones. This double dissociation of saccade gain suggests that the initial process of vector inversion can be disrupted 100 ms after onset of the visual stimulus and that TMS interfered with motor saccade planning based on an inversed vector signal at 333 ms and 450 ms after stimulus onset.

About the role of visual field defects in pure alexia

Pure alexia is an acquired reading disorder characterized by a disproportionate prolongation of reading time as a function of word length. Although the vast majority of cases reported in the literature show a right-sided visual defect, little is known about the contribution of this low-level visual impairment to their reading difficulties. The present study was aimed at investigating this issue by comparing eye movement patterns during text reading in six patients with pure alexia with those of six patients with hemianopic dyslexia showing similar right-sided visual field defects. We found that the role of the field defect in the reading difficulties of pure alexics was highly deficit-specific. While the amplitude of rightward saccades during text reading seems largely determined by the restricted visual field, other visuo-motor impairments-particularly the pronounced increases in fixation frequency and viewing time as a function of word length-may have little to do with their visual field defect. In addition, subtracting the lesions of the hemianopic dyslexics from those found in pure alexics revealed the largest group differences in posterior parts of the left fusiform gyrus, occipito-temporal sulcus and inferior temporal gyrus. These regions included the coordinate assigned to the centre of the visual word form area in healthy adults, which provides further evidence for a relation between pure alexia and a damaged visual word form area. Finally, we propose a list of three criteria that may improve the differential diagnosis of pure alexia and allow appropriate therapy recommendations.

Analysis of eye and head coordination in a visual peripheral recognition task

Coordinated eye and head movements simultaneously occur to scan the visual world for relevant targets. However, measuring both eye and head movements in experiments allowing natural head movements may be challenging. This paper provides an approach to study eye-head coordination: First, we demonstra- te the capabilities and limits of the eye-head tracking system used, and compare it to other technologies. Second, a beha- vioral task is introduced to invoke eye-head coordination. Third, a method is introduced to reconstruct signal loss in video- based oculography caused by cornea reflection artifacts in order to extend the tracking range. Finally, parameters of eye- head coordination are identified using EHCA (eye-head co- ordination analyzer), a MATLAB software which was developed to analyze eye-head shifts. To demonstrate the capabilities of the approach, a study with 11 healthy subjects was performed to investigate motion behavior. The approach presented here is discussed as an instrument to explore eye-head coordination, which may lead to further insights into attentional and motor symptoms of certain neurological or psychiatric diseases, e.g., schizophrenia.

Vertikale Integration und Unternehmenserfolg: eine empirische Untersuchung in der Formel 1

Die neue Theorie der Unternehmung befasst sich unter anderem mit der zentralen Frage, wie sich vertikale Integrationsentscheidungen auf das Investitionsverhalten von Unternehmen und deren Gewinne auswirken. In der Formel 1 kann seit dem Jahr 2002 eine Tendenz zur Gründung oder Übernahme von Rennställen durch große Automobilkonzerne beobachtet werden, die bisher nur als Motorenlieferanten auftraten. Die vorliegende Untersuchung zeigt, dass die vertikale Vorwärtsintegration von Automobilkonzernen den Teamerfolg in der Formel 1 steigert. Es wird insbesondere deutlich, dass vertikal integrierte Teams höhere Investitionen tätigen und dadurch die Qualität der Fahrer und die technische Qualität der Rennwagen verbessern. Diese Faktoren wirken signifikant auf den Rennerfolg. According to the (new) theory of the firm vertically integrated firms might under certain conditions outperform disintegrated firms. In particular, in a situation with high transaction specific investments and measurement problems concerning individual performance an underinvestment problem may arise. In this paper we show for Formula One motor racing that integrated firms solve arising underinvestment problems more efficiently than disintegrated firms and that the decision to integrate positively affect the firm’s performance.

Testing visual perception in dementia with Lewy bodies and Alzheimer disease

OBJECTIVE Visuoperceptual deficits are common in dementia with Lewy bodies (DLB) and Alzheimer disease (AD). Testing visuoperception in dementia is complicated by decline in other cognitive domains and extrapyramidal features. To overcome these issues, we developed a computerized test, the Newcastle visuoperception battery (NEVIP), which is independent of motor function and has minimal cognitive load.We aimed to test its utility to identify visuoperceptual deficits in people with dementia. PARTICIPANTS AND MEASUREMENTS We recruited 28 AD and 26 DLB participants with 35 comparison participants of similar age and education. The NEVIP was used to test angle, color, and form discrimination along with motion perception to obtain a composite visuoperception score. RESULTS Those with DLB performed significantly worse than AD participants on the composite visuoperception score (Mann-Whitney U = 142, p = 0.01). Visuoperceptual deficits (defined as 2 SD below the performance of comparisons) were present in 71% of the DLB group and 40% of the AD group. Performance was not significantly correlated with motor impairment, but was significantly related to global cognitive impairment in DLB (rs = -0.689, p <0.001), but not in AD. CONCLUSION Visuoperceptual deficits can be detected in both DLB and AD participants using the NEVIP, with the DLB group performing significantly worse than AD. Visuoperception scores obtained by the NEVIP are independent of participant motor deficits and participants are able to comprehend and perform the tasks.

The quiet eye without a target: The primacy of visual information processing

Motor-performance-enhancing effects of long final fixations before movement initiation – a phenomenon called Quiet Eye (QE) – have repeatedly been demonstrated. Drawing on the information-processing framework, it is assumed that the QE supports information processing revealed by the close link between QE duration and task demands concerning, in particular, response selection and movement parameterisation. However, the question remains whether the suggested mechanism also holds for processes referring to stimulus identification. Thus, in a series of two experiments, performance in a targeting task was tested as a function of experimentally manipulated visual processing demands as well as experimentally manipulated QE durations. The results support the suggested link because a performance-enhancing QE effect was found under increased visual processing demands only: Whereas QE duration did not affect performance as long as positional information was preserved (Experiment 1), in the full vs. no target visibility comparison, QE efficiency turned out to depend on information processing time as soon as the interval falls below a certain threshold (Experiment 2). Thus, the results rather contradict alternative, e.g., posture-based explanations of QE effects and support the assumption that the crucial mechanism behind the QE phenomenon is rooted in the cognitive domain.