Larger visual stimuli are perceived to last longer from time to time: The internal clock is not affected by nontemporal visual stimulus size

Performance on interval timing is often explained by the assumption of an internal clock based on neural counting. According to this account, a neural pacemaker generates pulses, and the number of pulses relating to a physical time interval is recorded by a counter. Thus, the number of accumulated pulses is the internal representation of this interval. Several studies demonstrated that large visual stimuli are perceived to last longer than smaller ones presented for the same duration. The present study was designed to investigate whether nontemporal visual stimulus size directly affects the internal clock. For this purpose, a temporal reproduction task was applied. Sixty participants were randomly assigned to one of two experimental conditions with stimulus size being experimentally varied within either the target or the reproduction interval. A direct effect of nontemporal stimulus size on the pacemaker-counter system should become evident irrespective of whether stimulus size was experimentally varied within the target or the reproduction interval. An effect of nontemporal stimulus size on reproduced duration only occurred when stimulus size was varied during the target interval. This finding clearly argues against the notion that nontemporal visual stimulus size directly affects the internal clock. Furthermore, our findings ruled out a decisional bias as a possible cause of the observed differential effect of stimulus size on reproduced duration. Rather the effect of stimulus size appeared to originate from the memory stage of temporal information processing at which the timing signal from the pacemaker-counter component is encoded in reference memory.

Stimulus predictability reduces responses in primary visual cortex

In this functional magnetic resonance imaging study we tested whether the predictability of stimuli affects responses in primary visual cortex (V1). The results of this study indicate that visual stimuli evoke smaller responses in V1 when their onset or motion direction can be predicted from the dynamics of surrounding illusory motion. We conclude from this finding that the human brain anticipates forthcoming sensory input that allows predictable visual stimuli to be processed with less neural activation at early stages of cortical processing.

Higher Visual Functions in the Upper and Lower Visual Fields: a pilot study in healthy subjects

Visual perception is not identical in the upper and lower visual hemifields. The mechanisms behind this difference can be found at the retinal, cortical, or higher attentional level. In this study, a new visual test battery, that involves real-time comparisons of complex visual stimuli, such as shape of objects, and speed of moving dot patterns, in the upper and lower visual hemifields, is presented. This study represents, to our knowledge, the first to implement such a visual test battery in an immersive environment composed of a hemisphere, in order to present visual stimuli in precise regions of the visual field. Ten healthy volunteers were tested in this pilot study. The results showed a higher accuracy in the image matching when the visual test was performed in the lower visual hemifield.

Visual-auditory differences in duration discrimination of intervals in the subsecond and second range

A common finding in time psychophysics is that temporal acuity is much better for auditory than for visual stimuli. The present study aimed to examine modality-specific differences in duration discrimination within the conceptual framework of the Distinct Timing Hypothesis. This theoretical account proposes that durations in the lower milliseconds range are processed automatically while longer durations are processed by a cognitive mechanism. A sample of 46 participants performed two auditory and visual duration discrimination tasks with extremely brief (50-ms standard duration) and longer (1000-ms standard duration) intervals. Better discrimination performance for auditory compared to visual intervals could be established for extremely brief and longer intervals. However, when performance on duration discrimination of longer intervals in the 1-s range was controlled for modality-specific input from the sensory-automatic timing mechanism, the visual-auditory difference disappeared completely as indicated by virtually identical Weber fractions for both sensory modalities. These findings support the idea of a sensory-automatic mechanism underlying the observed visual-auditory differences in duration discrimination of extremely brief intervals in the millisecond range and longer intervals in the 1-s range. Our data are consistent with the notion of a gradual transition from a purely modality-specific, sensory-automatic to a more cognitive, amodal timing mechanism. Within this transition zone, both mechanisms appear to operate simultaneously but the influence of the sensory-automatic timing mechanism is expected to continuously decrease with increasing interval duration.

Vestibular deficits do not underlie looping behavior in achiasmatic fish

Zebrafish belladonna (bel) mutants carry a mutation in the lhx2 gene that encodes a Lim domain homeobox transcription factor, leading to a defect in the retinotectal axon pathfinding. As a result, a large fraction of homozygous bel mutants is achiasmatic. Achiasmatic bel mutants display ocular motor instabilities, both reserved optokinetic response (OKR) and spontaneous eye oscillations, and an unstable swimming behavior, described as looping. All these unstable behaviors have been linked to the underlying optic nerve projection defect. Looping has been investigated under different visual stimuli and shown to be vision dependent and contrast sensitive. In addition, looping correlates perfectly with reversed OKR and the spontaneous oscillations of the eyes. Hence, it has been hypothesized that looping is a compensatory response to the perception of self-motion induced by the spontaneous eye oscillations. However, both ocular and postural instabilities could also be caused by a yet unidentified vestibular deficit. Here, we performed a preliminary test of the vestibular function in achiasmatic bel larval mutants in order to clarify the potential role of a vestibular deficit in looping. We found that the vestibular ocular reflex (VOR) is normally directed in both bel mutants and wild types and therefore exclude the possibility that nystagmus and looping in reverse to the rotating optokinetic drum can be attributed to an underlying vestibular deficit.

Spike-triggered reaction-time EEG as a possible assessment tool for driving ability

The impact of interictal epileptic activity (IEA) on driving is a rarely investigated issue. We analyzed the impact of IEA on reaction time in a pilot study. Reactions to simple visual stimuli (light flash) in the Flash test or complex visual stimuli (obstacle on a road) in a modified car driving computer game, the Steer Clear, were measured during IEA bursts and unremarkable electroencephalography (EEG) periods. Individual epilepsy patients showed slower reaction times (RTs) during generalized IEA compared to RTs during unremarkable EEG periods. RT differences were approximately 300 ms (p < 0.001) in the Flash test and approximately 200 ms (p < 0.001) in the Steer Clear. Prior work suggested that RT differences >100 ms may become clinically relevant. This occurred in 40% of patients in the Flash test and in up to 50% in the Steer Clear. When RT were pooled, mean RT differences were 157 ms in the Flash test (p < 0.0001) and 116 ms in the Steer Clear (p < 0.0001). Generalized IEA of short duration seems to impair brain function, that is, the ability to react. The reaction-time EEG could be used routinely to assess driving ability.

Unmasking the contribution of low-level features to the guidance of attention

The role of low-level stimulus-driven control in the guidance of overt visual attention has been difficult to establish because low- and high-level visual content are spatially correlated within natural visual stimuli. Here we show that impairment of parietal cortical areas, either permanently by a lesion or reversibly by repetitive transcranial magnetic stimulation (rTMS), leads to fixation of locations with higher values of low-level features as compared to control subjects or in a no-rTMS condition. Moreover, this unmasking of stimulus-driven control crucially depends on the intrahemispheric balance between top-down and bottom-up cortical areas. This result suggests that although in normal behavior high-level features might exert a strong influence, low-level features do contribute to guide visual selection during the exploration of complex natural stimuli.

Differential patterns of multisensory interactions in core and belt areas of human auditory cortex

The auditory cortex is anatomically segregated into a central core and a peripheral belt region, which exhibit differences in preference to bandpassed noise and in temporal patterns of response to acoustic stimuli. While it has been shown that visual stimuli can modify response magnitude in auditory cortex, little is known about differential patterns of multisensory interactions in core and belt. Here, we used functional magnetic resonance imaging and examined the influence of a short visual stimulus presented prior to acoustic stimulation on the spatial pattern of blood oxygen level-dependent signal response in auditory cortex. Consistent with crossmodal inhibition, the light produced a suppression of signal response in a cortical region corresponding to the core. In the surrounding areas corresponding to the belt regions, however, we found an inverse modulation with an increasing signal in centrifugal direction. Our data suggest that crossmodal effects are differentially modulated according to the hierarchical core-belt organization of auditory cortex.

From emotion perception to emotion experience: Emotions evoked by pictures and classical music.

Most previous neurophysiological studies evoked emotions by presenting visual stimuli. Models of the emotion circuits in the brain have for the most part ignored emotions arising from musical stimuli. To our knowledge, this is the first emotion brain study which examined the influence of visual and musical stimuli on brain processing. Highly arousing pictures of the International Affective Picture System and classical musical excerpts were chosen to evoke the three basic emotions of happiness, sadness and fear. The emotional stimuli modalities were presented for 70 s either alone or combined (congruent) in a counterbalanced and random order. Electroencephalogram (EEG) Alpha-Power-Density, which is inversely related to neural electrical activity, in 30 scalp electrodes from 24 right-handed healthy female subjects, was recorded. In addition, heart rate (HR), skin conductance responses (SCR), respiration, temperature and psychometrical ratings were collected. Results showed that the experienced quality of the presented emotions was most accurate in the combined conditions, intermediate in the picture conditions and lowest in the sound conditions. Furthermore, both the psychometrical ratings and the physiological involvement measurements (SCR, HR, Respiration) were significantly increased in the combined and sound conditions compared to the picture conditions. Finally, repeated measures ANOVA revealed the largest Alpha-Power-Density for the sound conditions, intermediate for the picture conditions, and lowest for the combined conditions, indicating the strongest activation in the combined conditions in a distributed emotion and arousal network comprising frontal, temporal, parietal and occipital neural structures. Summing up, these findings demonstrate that music can markedly enhance the emotional experience evoked by affective pictures.

Neural correlates of a 'pessimistic' attitude when anticipating events of unknown emotional valence

Since we do not know what future holds for us, we prepare for expected emotional events in order to deal with a pleasant or threatening environment. From an evolutionary perspective, it makes sense to be particularly prepared for the worst-case scenario. We were interested to evaluate whether this assumption is reflected in the central nervous information processing associated with expecting visual stimuli of unknown emotional valence. While being scanned with functional magnetic resonance imaging, healthy subjects were cued to expect and then perceive visual stimuli with a known emotional valence as pleasant, unpleasant, and neutral, as well as stimuli of unknown valence that could have been either pleasant or unpleasant. While anticipating pictures of unknown valence, the activity of emotion processing brain areas was similar to activity associated with expecting unpleasant pictures, but there were no areas in which the activity was similar to the activity when expecting pleasant pictures. The activity of the revealed regions, including bilateral insula, right inferior frontal gyrus, medial thalamus, and red nucleus, further correlated with the individual ratings of mood: the worse the mood, the higher the activity. These areas are supposedly involved in a network for internal adaptation and preparation processes in order to act according to potential or certain unpleasant events. Their activity appears to reflect a 'pessimistic' bias by anticipating the events of unknown valence to be unpleasant.

Interactions between dorsolateral and ventromedial prefrontal cortex underlie context-dependent stimulus valuation in goal-directed choice.

External circumstances and internal bodily states often change and require organisms to flexibly adapt valuation processes to select the optimal action in a given context. Here, we investigate the neurobiology of context-dependent valuation in 22 human subjects using functional magnetic resonance imaging. Subjects made binary choices between visual stimuli with three attributes (shape, color, and pattern) that were associated with monetary values. Context changes required subjects to deviate from the default shape valuation and to integrate a second attribute in order to comply with the goal to maximize rewards. Critically, this binary choice task did not involve any conflict between opposing monetary, temporal, or social preferences. We tested the hypothesis that interactions between regions of dorsolateral and ventromedial prefrontal cortex (dlPFC; vmPFC) implicated in self-control choices would also underlie the more general function of context-dependent valuation. Consistent with this idea, we found that the degree to which stimulus attributes were reflected in vmPFC activity varied as a function of context. In addition, activity in dlPFC increased when context changes required a reweighting of stimulus attribute values. Moreover, the strength of the functional connectivity between dlPFC and vmPFC was associated with the degree of context-specific attribute valuation in vmPFC at the time of choice. Our findings suggest that functional interactions between dlPFC and vmPFC are a key aspect of context-dependent valuation and that the role of this network during choices that require self-control to adjudicate between competing outcome preferences is a specific application of this more general neural mechanism.

A Vertical Asymmetry in Saccades

Visual exploration of natural scenes imposes demands that differ between the upper and the lower visual hemifield. Yet little is known about how ocular motor performance is affected by the location of visual stimuli or the direction of a behavioural response. We compared saccadic latencies between upper and lower hemifield in a variety of conditions, including short-latency prosaccades, long-latency prosaccades, antisaccades, memory-guided sac- cades and saccades with increased attentional and selection demand. All saccade types, except memory guided saccades, had shorter latencies when saccades were directed to- wards the upper field as compared to downward saccades (p<0.05). This upper field reaction time advantage probably arises in ocular motor rather than visual processing. It may originate in structures involved in motor preparation rather than execution.

Enhanced associative memory for colour (but not shape or location) in synaesthesia

People with grapheme-colour synaesthesia have been shown to have enhanced memory on a range of tasks using both stimuli that induce synaesthesia (e.g. words) and, more surprisingly, stimuli that do not (e.g. certain abstract visual stimuli). This study examines the latter by using multi-featured stimuli consisting of shape, colour and location conjunctions (e.g. shape A + colour A + location A; shape B + colour B + location B) presented in a recognition memory paradigm. This enables distractor items to be created in which one of these features is ‘unbound’ with respect to the others (e.g. shape A + colour B + location A; shape A + colour A + location C). Synaesthetes had higher recognition rates suggesting an enhanced ability to bind certain visual features together into memory. Importantly, synaesthetes’ false alarm rates were lower only when colour was the unbound feature, not shape or location. We suggest that synaesthetes are “colour experts” and that enhanced perception can lead to enhanced memory in very specific ways; but, not for instance, an enhanced ability to form associations per se. The results support contemporary models that propose a continuum between perception and memory.

Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools

Primate multisensory object perception involves distributed brain regions. To investigate the network character of these regions of the human brain, we applied data-driven group spatial independent component analysis (ICA) to a functional magnetic resonance imaging (fMRI) data set acquired during a passive audio-visual (AV) experiment with common object stimuli. We labeled three group-level independent component (IC) maps as auditory (A), visual (V), and AV, based on their spatial layouts and activation time courses. The overlap between these IC maps served as definition of a distributed network of multisensory candidate regions including superior temporal, ventral occipito-temporal, posterior parietal and prefrontal regions. During an independent second fMRI experiment, we explicitly tested their involvement in AV integration. Activations in nine out of these twelve regions met the max-criterion (A < AV > V) for multisensory integration. Comparison of this approach with a general linear model-based region-of-interest definition revealed its complementary value for multisensory neuroimaging. In conclusion, we estimated functional networks of uni- and multisensory functional connectivity from one dataset and validated their functional roles in an independent dataset. These findings demonstrate the particular value of ICA for multisensory neuroimaging research and using independent datasets to test hypotheses generated from a data-driven analysis.