Behind the scenes of functional brain imaging: A historical and physiological perspective

At the forefront of cognitive neuroscience research in normal humans are the new techniques of functional brain imaging: positron emission tomography and magnetic resonance imaging. The signal used by positron emission tomography is based on the fact that changes in the cellular activity of the brain of normal, awake humans and laboratory animals are accompanied almost invariably by changes in local blood flow. This robust, empirical relationship has fascinated scientists for well over a hundred years. Because the changes in blood flow are accompanied by lesser changes in oxygen consumption, local changes in brain oxygen content occur at the sites of activation and provide the basis for the signal used by magnetic resonance imaging. The biological basis for these signals is now an area of intense research stimulated by the interest in these tools for cognitive neuroscience research.

Event-related functional MRI: Past, present, and future

The past two decades have seen an enormous growth in the field of human brain mapping. Investigators have extensively exploited techniques such as positron emission tomography and MRI to map patterns of brain activity based on changes in cerebral hemodynamics. However, until recently, most studies have investigated equilibrium changes in blood flow measured over time periods upward of 1 min. The advent of high-speed MRI methods, capable of imaging the entire brain with a temporal resolution of a few seconds, allows for brain mapping based on more transient aspects of the hemodynamic response. Today it is now possible to map changes in cerebrovascular parameters essentially in real time, conferring the ability to observe changes in brain state that occur over time periods of seconds. Furthermore, because robust hemodynamic alterations are detectable after neuronal stimuli lasting only a few tens of milliseconds, a new class of task paradigms designed to measure regional responses to single sensory or cognitive events can now be studied. Such “event related” functional MRI should provide for fundamentally new ways to interrogate brain function, and allow for the direct comparison and ultimately integration of data acquired by using more traditional behavioral and electrophysiological methods.

Event-related brain potentials in the study of visual selective attention

Event-related brain potentials (ERPs) provide high-resolution measures of the time course of neuronal activity patterns associated with perceptual and cognitive processes. New techniques for ERP source analysis and comparisons with data from blood-flow neuroimaging studies enable improved localization of cortical activity during visual selective attention. ERP modulations during spatial attention point toward a mechanism of gain control over information flow in extrastriate visual cortical pathways, starting about 80 ms after stimulus onset. Paying attention to nonspatial features such as color, motion, or shape is manifested by qualitatively different ERP patterns in multiple cortical areas that begin with latencies of 100–150 ms. The processing of nonspatial features seems to be contingent upon the prior selection of location, consistent with early selection theories of attention and with the hypothesis that spatial attention is “special.”

Functional and structural mapping of human cerebral cortex: Solutions are in the surfaces

The human cerebral cortex is notorious for the depth and irregularity of its convolutions and for its variability from one individual to the next. These complexities of cortical geography have been a chronic impediment to studies of functional specialization in the cortex. In this report, we discuss ways to compensate for the convolutions by using a combination of strategies whose common denominator involves explicit reconstructions of the cortical surface. Surface-based visualization involves reconstructing cortical surfaces and displaying them, along with associated experimental data, in various complementary formats (including three-dimensional native configurations, two-dimensional slices, extensively smoothed surfaces, ellipsoidal representations, and cortical flat maps). Generating these representations for the cortex of the Visible Man leads to a surface-based atlas that has important advantages over conventional stereotaxic atlases as a substrate for displaying and analyzing large amounts of experimental data. We illustrate this by showing the relationship between functionally specialized regions and topographically organized areas in human visual cortex. Surface-based warping allows data to be mapped from individual hemispheres to a surface-based atlas while respecting surface topology, improving registration of identifiable landmarks, and minimizing unwanted distortions. Surface-based warping also can aid in comparisons between species, which we illustrate by warping a macaque flat map to match the shape of a human flat map. Collectively, these approaches will allow more refined analyses of commonalities as well as individual differences in the functional organization of primate cerebral cortex.

Imaging neuroscience: Principles or maps?

This article reviews some recent trends in imaging neuroscience. A distinction is made between making maps of functional responses in the brain and discerning the rules or principles that underlie their organization. After considering developments in the characterization of brain imaging data, several examples are presented that highlight the context-sensitive nature of neuronal responses that we measure. These contexts can be endogenous and physiological, reflecting the fact that each cortical area, or neuronal population, expresses its dynamics in the context of interactions with other areas. Conversely, these contexts can be experimental or psychological and can have a profound effect on the regional effects elicited. In this review we consider experimental designs and analytic strategies that go beyond cognitive subtraction and speculate on how functional imaging can be used to address both the details and principles underlying functional integration and specialization in the brain.

Spatially independent activity patterns in functional MRI data during the Stroop color-naming task

A method is given for determining the time course and spatial extent of consistently and transiently task-related activations from other physiological and artifactual components that contribute to functional MRI (fMRI) recordings. Independent component analysis (ICA) was used to analyze two fMRI data sets from a subject performing 6-min trials composed of alternating 40-sec Stroop color-naming and control task blocks. Each component consisted of a fixed three-dimensional spatial distribution of brain voxel values (a “map”) and an associated time course of activation. For each trial, the algorithm detected, without a priori knowledge of their spatial or temporal structure, one consistently task-related component activated during each Stroop task block, plus several transiently task-related components activated at the onset of one or two of the Stroop task blocks only. Activation patterns occurring during only part of the fMRI trial are not observed with other techniques, because their time courses cannot easily be known in advance. Other ICA components were related to physiological pulsations, head movements, or machine noise. By using higher-order statistics to specify stricter criteria for spatial independence between component maps, ICA produced improved estimates of the temporal and spatial extent of task-related activation in our data compared with principal component analysis (PCA). ICA appears to be a promising tool for exploratory analysis of fMRI data, particularly when the time courses of activation are not known in advance.

Functional analysis of primary visual cortex (V1) in humans

Human area V1 offers an excellent opportunity to study, using functional MRI, a range of properties in a specific cortical visual area, whose borders are defined objectively and convergently by retinotopic criteria. The retinotopy in V1 (also known as primary visual cortex, striate cortex, or Brodmann’s area 17) was defined in each subject by using both stationary and phase-encoded polar coordinate stimuli. Data from V1 and neighboring retinotopic areas were displayed on flattened cortical maps. In additional tests we revealed the paired cortical representations of the monocular “blind spot.” We also activated area V1 preferentially (relative to other extrastriate areas) by presenting radial gratings alternating between 6% and 100% contrast. Finally, we showed evidence for orientation selectivity in V1 by measuring transient functional MRI increases produced at the change in response to gratings of differing orientations. By systematically varying the orientations presented, we were able to measure the bandwidth of the orientation “transients” (45°).

The representation of the ipsilateral visual field in human cerebral cortex

Previous studies of cortical retinotopy focused on influences from the contralateral visual field, because ascending inputs to cortex are known to be crossed. Here, functional magnetic resonance imaging was used to demonstrate and analyze an ipsilateral representation in human visual cortex. Moving stimuli, in a range of ipsilateral visual field locations, revealed activity: (i) along the vertical meridian in retinotopic (presumably lower-tier) areas; and (ii) in two large branches anterior to that, in presumptive higher-tier areas. One branch shares the anterior vertical meridian representation in human V3A, extending superiorly toward parietal cortex. The second branch runs antero-posteriorly along lateral visual cortex, overlying motion-selective area MT. Ipsilateral stimuli sparing the region around the vertical meridian representation also produced signal reductions (perhaps reflecting neural inhibition) in areas showing contralaterally driven retinotopy. Systematic sampling across a range of ipsilateral visual field extents revealed significant increases in ipsilateral activation in V3A and V4v, compared with immediately posterior areas V3 and VP. Finally, comparisons between ipsilateral stimuli of different types but equal retinotopic extent showed clear stimulus specificity, consistent with earlier suggestions of a functional segregation of motion vs. form processing in parietal vs. temporal cortex, respectively.

On the role of selective attention in visual perception

What is the role of selective attention in visual perception? Before answering this question, it is necessary to differentiate between attentional mechanisms that influence the identification of a stimulus from those that operate after perception is complete. Cognitive neuroscience techniques are particularly well suited to making this distinction because they allow different attentional mechanisms to be isolated in terms of timing and/or neuroanatomy. The present article describes the use of these techniques in differentiating between perceptual and postperceptual attentional mechanisms and then proposes a specific role of attention in visual perception. Specifically, attention is proposed to resolve ambiguities in neural coding that arise when multiple objects are processed simultaneously. Evidence for this hypothesis is provided by two experiments showing that attention—as measured electrophysiologically—is allocated to visual search targets only under conditions that would be expected to lead to ambiguous neural coding.

Frontoparietal cortical networks for directing attention and the eye to visual locations: Identical, independent, or overlapping neural systems?

Functional anatomical and single-unit recording studies indicate that a set of neural signals in parietal and frontal cortex mediates the covert allocation of attention to visual locations, as originally proposed by psychological studies. This frontoparietal network is the source of a location bias that interacts with extrastriate regions of the ventral visual system during object analysis to enhance visual processing. The frontoparietal network is not exclusively related to visual attention, but may coincide or overlap with regions involved in oculomotor processing. The relationship between attention and eye movement processes is discussed at the psychological, functional anatomical, and cellular level of analysis.

Neural components of topographical representation

Studies of patients with focal brain damage suggest that topographical representation is subserved by dissociable neural subcomponents. This article offers a condensed review of the literature of “topographical disorientation” and describes several functional MRI studies designed to test hypotheses generated by that review. Three hypotheses are considered: (i) The parahippocampal cortex is critically involved in the acquisition of exocentric spatial information in humans; (ii) separable, posterior, dorsal, and ventral cortical regions subserve the perception and long term representation of position and identity, respectively, of landmarks; and (iii) there is a distinct area of the ventral occipitotemporal cortex that responds maximally to building stimuli and may play a role in the perception of salient landmarks. We conclude with a discussion of the inferential limitations of neuroimaging and lesion studies. It is proposed that combining these two approaches allows for inferences regarding the computational involvement of a neuroanatomical substrate in a given cognitive process although neither method can strictly support this conclusion alone.

The neural development and organization of letter recognition: Evidence from functional neuroimaging, computational modeling, and behavioral studies

Although much of the brain’s functional organization is genetically predetermined, it appears that some noninnate functions can come to depend on dedicated and segregated neural tissue. In this paper, we describe a series of experiments that have investigated the neural development and organization of one such noninnate function: letter recognition. Functional neuroimaging demonstrates that letter and digit recognition depend on different neural substrates in some literate adults. How could the processing of two stimulus categories that are distinguished solely by cultural conventions become segregated in the brain? One possibility is that correlation-based learning in the brain leads to a spatial organization in cortex that reflects the temporal and spatial clustering of letters with letters in the environment. Simulations confirm that environmental co-occurrence does indeed lead to spatial localization in a neural network that uses correlation-based learning. Furthermore, behavioral studies confirm one critical prediction of this co-occurrence hypothesis, namely, that subjects exposed to a visual environment in which letters and digits occur together rather than separately (postal workers who process letters and digits together in Canadian postal codes) do indeed show less behavioral evidence for segregated letter and digit processing.

The effects of practice on the functional anatomy of task performance

The effects of practice on the functional anatomy observed in two different tasks, a verbal and a motor task, are reviewed in this paper. In the first, people practiced a verbal production task, generating an appropriate verb in response to a visually presented noun. Both practiced and unpracticed conditions utilized common regions such as visual and motor cortex. However, there was a set of regions that was affected by practice. Practice produced a shift in activity from left frontal, anterior cingulate, and right cerebellar hemisphere to activity in Sylvian-insular cortex. Similar changes were also observed in the second task, a task in a very different domain, namely the tracing of a maze. Some areas were significantly more activated during initial unskilled performance (right premotor and parietal cortex and left cerebellar hemisphere); a different region (medial frontal cortex, “supplementary motor area”) showed greater activity during skilled performance conditions. Activations were also found in regions that most likely control movement execution irrespective of skill level (e.g., primary motor cortex was related to velocity of movement). One way of interpreting these results is in a “scaffolding-storage” framework. For unskilled, effortful performance, a scaffolding set of regions is used to cope with novel task demands. Following practice, a different set of regions is used, possibly representing storage of particular associations or capabilities that allow for skilled performance. The specific regions used for scaffolding and storage appear to be task dependent.

The acquisition of skilled motor performance: Fast and slow experience-driven changes in primary motor cortex

Behavioral and neurophysiological studies suggest that skill learning can be mediated by discrete, experience-driven changes within specific neural representations subserving the performance of the trained task. We have shown that a few minutes of daily practice on a sequential finger opposition task induced large, incremental performance gains over a few weeks of training. These gains did not generalize to the contralateral hand nor to a matched sequence of identical component movements, suggesting that a lateralized representation of the learned sequence of movements evolved through practice. This interpretation was supported by functional MRI data showing that a more extensive representation of the trained sequence emerged in primary motor cortex after 3 weeks of training. The imaging data, however, also indicated important changes occurring in primary motor cortex during the initial scanning sessions, which we proposed may reflect the setting up of a task-specific motor processing routine. Here we provide behavioral and functional MRI data on experience-dependent changes induced by a limited amount of repetitions within the first imaging session. We show that this limited training experience can be sufficient to trigger performance gains that require time to become evident. We propose that skilled motor performance is acquired in several stages: “fast” learning, an initial, within-session improvement phase, followed by a period of consolidation of several hours duration, and then “slow” learning, consisting of delayed, incremental gains in performance emerging after continued practice. This time course may reflect basic mechanisms of neuronal plasticity in the adult brain that subserve the acquisition and retention of many different skills.

Rapidly induced auditory plasticity: The ventriloquism aftereffect

Cortical representational plasticity has been well documented after peripheral and central injuries or improvements in perceptual and motor abilities. This has led to inferences that the changes in cortical representations parallel and account for the improvement in performance during the period of skill acquisition. There have also been several examples of rapidly induced changes in cortical neuronal response properties, for example, by intracortical microstimulation or by classical conditioning paradigms. This report describes similar rapidly induced changes in a cortically mediated perception in human subjects, the ventriloquism aftereffect, which presumably reflects a corresponding change in the cortical representation of acoustic space. The ventriloquism aftereffect describes an enduring shift in the perception of the spatial location of acoustic stimuli after a period of exposure of spatially disparate and simultaneously presented acoustic and visual stimuli. Exposure of a mismatch of 8° for 20–30 min is sufficient to shift the perception of acoustic space by approximately the same amount across subjects and acoustic frequencies. Given that the cerebral cortex is necessary for the perception of acoustic space, it is likely that the ventriloquism aftereffect reflects a change in the cortical representation of acoustic space. Comparisons between the responses of single cortical neurons in the behaving macaque monkey and the stimulus parameters that give rise to the ventriloquism aftereffect suggest that the changes in the cortical representation of acoustic space may begin as early as the primary auditory cortex.