Blind separation of auditory event-related brain responses into independent components

Averaged event-related potential (ERP) data recorded from the human scalp reveal electroencephalographic (EEG) activity that is reliably time-locked and phase-locked to experimental events. We report here the application of a method based on information theory that decomposes one or more ERPs recorded at multiple scalp sensors into a sum of components with fixed scalp distributions and sparsely activated, maximally independent time courses. Independent component analysis (ICA) decomposes ERP data into a number of components equal to the number of sensors. The derived components have distinct but not necessarily orthogonal scalp projections. Unlike dipole-fitting methods, the algorithm does not model the locations of their generators in the head. Unlike methods that remove second-order correlations, such as principal component analysis (PCA), ICA also minimizes higher-order dependencies. Applied to detected—and undetected—target ERPs from an auditory vigilance experiment, the algorithm derived ten components that decomposed each of the major response peaks into one or more ICA components with relatively simple scalp distributions. Three of these components were active only when the subject detected the targets, three other components only when the target went undetected, and one in both cases. Three additional components accounted for the steady-state brain response to a 39-Hz background click train. Major features of the decomposition proved robust across sessions and changes in sensor number and placement. This method of ERP analysis can be used to compare responses from multiple stimuli, task conditions, and subject states.

Neural fate of seen and unseen faces in visuospatial neglect: A combined event-related functional MRI and event-related potential study

To compare neural activity produced by visual events that escape or reach conscious awareness, we used event-related MRI and evoked potentials in a patient who had neglect and extinction after focal right parietal damage, but intact visual fields. This neurological disorder entails a loss of awareness for stimuli in the field contralateral to a brain lesion when stimuli are simultaneously presented on the ipsilateral side, even though early visual areas may be intact, and single contralateral stimuli may still be perceived. Functional MRI and event-related potential study were performed during a task where faces or shapes appeared in the right, left, or both fields. Unilateral stimuli produced normal responses in V1 and extrastriate areas. In bilateral events, left faces that were not perceived still activated right V1 and inferior temporal cortex and evoked nonsignificantly reduced N1 potentials, with preserved face-specific negative potentials at 170 ms. When left faces were perceived, the same stimuli produced greater activity in a distributed network of areas including right V1 and cuneus, bilateral fusiform gyri, and left parietal cortex. Also, effective connectivity between visual, parietal, and frontal areas increased during perception of faces. These results suggest that activity can occur in V1 and ventral temporal cortex without awareness, whereas coupling with dorsal parietal and frontal areas may be critical for such activity to afford conscious perception.

Can medial temporal lobe regions distinguish true from false? An event-related functional MRI study of veridical and illusory recognition memory

To investigate the types of memory traces recovered by the medial temporal lobe (MTL), neural activity during veridical and illusory recognition was measured with the use of functional MRI (fMRI). Twelve healthy young adults watched a videotape segment in which two speakers alternatively presented lists of associated words, and then the subjects performed a recognition test including words presented in the study lists (True items), new words closely related to studied words (False items), and new unrelated words (New items). The main finding was a dissociation between two MTL regions: whereas the hippocampus was similarly activated for True and False items, suggesting the recovery of semantic information, the parahippocampal gyrus was more activated for True than for False items, suggesting the recovery of perceptual information. The study also yielded a dissociation between two prefrontal cortex (PFC) regions: whereas bilateral dorsolateral PFC was more activated for True and False items than for New items, possibly reflecting monitoring of retrieved information, left ventrolateral PFC was more activated for New than for True and False items, possibly reflecting semantic processing. Precuneus and lateral parietal regions were more activated for True and False than for New items. Orbitofrontal cortex and cerebellar regions were more activated for False than for True items. In conclusion, the results suggest that activity in anterior MTL regions does not distinguish True from False, whereas activity in posterior MTL regions does.

Event-related functional MRI: Past, present, and future

The past two decades have seen an enormous growth in the field of human brain mapping. Investigators have extensively exploited techniques such as positron emission tomography and MRI to map patterns of brain activity based on changes in cerebral hemodynamics. However, until recently, most studies have investigated equilibrium changes in blood flow measured over time periods upward of 1 min. The advent of high-speed MRI methods, capable of imaging the entire brain with a temporal resolution of a few seconds, allows for brain mapping based on more transient aspects of the hemodynamic response. Today it is now possible to map changes in cerebrovascular parameters essentially in real time, conferring the ability to observe changes in brain state that occur over time periods of seconds. Furthermore, because robust hemodynamic alterations are detectable after neuronal stimuli lasting only a few tens of milliseconds, a new class of task paradigms designed to measure regional responses to single sensory or cognitive events can now be studied. Such “event related” functional MRI should provide for fundamentally new ways to interrogate brain function, and allow for the direct comparison and ultimately integration of data acquired by using more traditional behavioral and electrophysiological methods.

Event-related brain potentials in the study of visual selective attention

Event-related brain potentials (ERPs) provide high-resolution measures of the time course of neuronal activity patterns associated with perceptual and cognitive processes. New techniques for ERP source analysis and comparisons with data from blood-flow neuroimaging studies enable improved localization of cortical activity during visual selective attention. ERP modulations during spatial attention point toward a mechanism of gain control over information flow in extrastriate visual cortical pathways, starting about 80 ms after stimulus onset. Paying attention to nonspatial features such as color, motion, or shape is manifested by qualitatively different ERP patterns in multiple cortical areas that begin with latencies of 100–150 ms. The processing of nonspatial features seems to be contingent upon the prior selection of location, consistent with early selection theories of attention and with the hypothesis that spatial attention is “special.”

Segregating the functions of human hippocampus

It is now accepted that hippocampal lesions impair episodic memory. However, the precise functional role of the hippocampus in episodic memory remains elusive. Recent functional imaging data implicate the hippocampus in processing novelty, a finding supported by human in vivo recordings and event-related potential studies. Here we measure hippocampal responses to novelty, using functional MRI (fMRI), during an item-learning paradigm generated from an artificial grammar system. During learning, two distinct types of novelty were periodically introduced: perceptual novelty, pertaining to the physical characteristics of stimuli (in this case visual characteristics), and exemplar novelty, reflecting semantic characteristics of stimuli (in this case grammatical status within a rule system). We demonstrate a left anterior hippocampal response to both types of novelty and adaptation of these responses with stimulus familiarity. By contrast to these novelty effects, we also show bilateral posterior hippocampal responses with increasing exemplar familiarity. These results suggest a functional dissociation within the hippocampus with respect to the relative familiarity of study items. Neural responses in anterior hippocampus index generic novelty, whereas posterior hippocampal responses index familiarity to stimuli that have behavioral relevance (i.e., only exemplar familiarity). These findings add to recent evidence for functional segregation within the human hippocampus during learning.

Brain mechanisms of quantity are similar in 5-year-old children and adults

Both 5-year-old children and adults determine the quantity of a number by the use of a similar parietal lobe mechanism. Event related potentials indicate that input from Arabic digits and from dot patterns reach areas involved in determining quantity about 200 ms after input. However, voluntary key presses indicating the relation of the input to the quantity five take almost three times as long in children. The ability to trace the networks of brain areas involved in the learning of school subjects should aid in the design and testing of educational methods.

Functional neuroanatomical double dissociation of mnemonic and executive control processes contributing to working memory performance

We used event-related functional MRI to investigate the neural bases of two categories of mental processes believed to contribute to performance of an alphabetization working memory task: memory storage and memory manipulation. Our delayed-response tasks required memory for the identity and position-in-the-display of items in two- or five-letter memory sets (to identify load-sensitive regions) or memory for the identity and relative position-in-the-alphabet of items in five-letter memory sets (to identify manipulation-sensitive regions). Results revealed voxels in the left perisylvian cortex of five of five subjects showing load sensitivity (as contrasted with alphabetization-sensitive voxels in this region in only one subject) and voxels of dorsolateral prefrontal cortex in all subjects showing alphabetization sensitivity (as contrasted with load-sensitive voxels in this region in two subjects). This double dissociation was reliable at the group level. These data are consistent with the hypothesis that the nonmnemonic executive control processes that can contribute to working memory function are primarily prefrontal cortex-mediated whereas mnemonic processes necessary for working memory storage are primarily posteriorly mediated. More broadly, they support the view that working memory is a faculty that arises from the coordinated interaction of computationally and neuroanatomically dissociable processes.

Parsing executive processes: Strategic vs. evaluative functions of the anterior cingulate cortex

Event-related functional MRI and a version of the Stroop color naming task were used to test two conflicting theories of anterior cingulate cortex (ACC) function during executive processes of cognition. A response-related increase in ACC activity was present when strategic processes were less engaged, and conflict high, but not when strategic processes were engaged and conflict reduced. This is inconsistent with the widely held view that the ACC implements strategic processes to reduce cognitive conflicts, such as response competition. Instead, it suggests that the ACC serves an evaluative function, detecting cognitive states such as response competition, which may lead to poor performance, and representing the knowledge that strategic processes need to be engaged.

The roles of prefrontal brain regions in components of working memory: Effects of memory load and individual differences

Using an event-related functional MRI design, we explored the relative roles of dorsal and ventral prefrontal cortex (PFC) regions during specific components (Encoding, Delay, Response) of a working memory task under different memory-load conditions. In a group analysis, effects of increased memory load were observed only in dorsal PFC in the encoding period. Activity was lateralized to the right hemisphere in the high but not the low memory-load condition. Individual analyses revealed variability in activation patterns across subjects. Regression analyses indicated that one source of variability was subjects’ memory retrieval rate. It was observed that dorsal PFC plays a differentially greater role in information retrieval for slower subjects, possibly because of inefficient retrieval processes or a reduced quality of mnemonic representations. This study supports the idea that dorsal and ventral PFC play different roles in component processes of working memory.

Memory's echo: Vivid remembering reactivates sensory-specific cortex

A fundamental question in human memory is how the brain represents sensory-specific information during the process of retrieval. One hypothesis is that regions of sensory cortex are reactivated during retrieval of sensory-specific information (1). Here we report findings from a study in which subjects learned a set of picture and sound items and were then given a recall test during which they vividly remembered the items while imaged by using event-related functional MRI. Regions of visual and auditory cortex were activated differentially during retrieval of pictures and sounds, respectively. Furthermore, the regions activated during the recall test comprised a subset of those activated during a separate perception task in which subjects actually viewed pictures and heard sounds. Regions activated during the recall test were found to be represented more in late than in early visual and auditory cortex. Therefore, results indicate that retrieval of vivid visual and auditory information can be associated with a reactivation of some of the same sensory regions that were activated during perception of those items.

The role of prefrontal cortex and posterior parietal cortex in task switching

Human ability to switch from one cognitive task to another involves both endogenous preparation without an external stimulus and exogenous adjustment in response to the external stimulus. In an event-related functional MRI study, participants performed pairs of two tasks that are either the same (task repetition) or different (task switch) from each other. On half of the trials, foreknowledge about task repetition or task switch was available. On the other half, it was not. Endogenous preparation seems to involve lateral prefrontal cortex (BA 46/45) and posterior parietal cortex (BA 40). During preparation, higher activation increases in inferior lateral prefrontal cortex and superior posterior parietal cortex were associated with foreknowledge than with no foreknowledge. Exogenous adjustment seems to involve superior prefrontal cortex (BA 8) and posterior parietal cortex (BA 39/40) in general. During a task switch with no foreknowledge, activations in these areas were relatively higher than during a task repetition with no foreknowledge. These results suggest that endogenous preparation and exogenous adjustment for a task switch may be independent processes involving different brain areas.

Functional neuroimaging studies of encoding, priming, and explicit memory retrieval

Human functional neuroimaging techniques provide a powerful means of linking neural level descriptions of brain function and cognition. The exploration of the functional anatomy underlying human memory comprises a prime example. Three highly reliable findings linking memory-related cognitive processes to brain activity are discussed. First, priming is accompanied by reductions in the amount of neural activation relative to naive or unprimed task performance. These reductions can be shown to be both anatomically and functionally specific and are found for both perceptual and conceptual task components. Second, verbal encoding, allowing subsequent conscious retrieval, is associated with activation of higher order brain regions including areas within the left inferior and dorsal prefrontal cortex. These areas also are activated by working memory and effortful word generation tasks, suggesting that these tasks, often discussed as separable, might rely on interdependent processes. Finally, explicit (intentional) retrieval shares much of the same functional anatomy as the encoding and word generation tasks but is associated with the recruitment of additional brain areas, including the anterior prefrontal cortex (right > left). These findings illustrate how neuroimaging techniques can be used to study memory processes and can both complement and extend data derived through other means. More recently developed methods, such as event-related functional MRI, will continue this progress and may provide additional new directions for research.

Imaging the functioning human brain

One of the most exciting methodological advances for brain research field arises in functional brain imaging, which enables us to localize and characterize neural activity and biochemical events in the living human brain. Recently developed event-related functional MRI makes it possible to visualize the brain activity associated with cognitive processes with the temporal resolution of the hemodynamic response. In addition, the high sensitivity and selectivity of positron-emission tomography allow us to probe the neurochemical processes at the molecular level. Positron-emission tomography also has been applied to investigate the effects of therapeutic drugs as well as the effects of drugs of abuse.

Brain activity evidence for recognition without recollection after early hippocampal damage

Amnesic patients with early and seemingly isolated hippocampal injury show relatively normal recognition memory scores. The cognitive profile of these patients raises the possibility that this recognition performance is maintained mainly by stimulus familiarity in the absence of recollection of contextual information. Here we report electrophysiological data on the status of recognition memory in one of the patients, Jon. Jon's recognition of studied words lacks the event-related potential (ERP) index of recollection, viz., an increase in the late positive component (500–700 ms), under conditions that elicit it reliably in normal subjects. On the other hand, a decrease of the ERP amplitude between 300 and 500 ms, also reliably found in normal subjects, is well preserved. This so-called N400 effect has been linked to stimulus familiarity in previous ERP studies of recognition memory. In Jon, this link is supported by the finding that his recognized and unrecognized studied words evoked topographically distinct ERP effects in the N400 time window. These data suggest that recollection is more dependent on the hippocampal formation than is familiarity, consistent with the view that the hippocampal formation plays a special role in episodic memory, for which recollection is so critical.