Component Neural Systems for the Creation of Emotional Memories during Free Viewing of a Complex, Real-World Event.

To investigate the neural systems that contribute to the formation of complex, self-relevant emotional memories, dedicated fans of rival college basketball teams watched a competitive game while undergoing functional magnetic resonance imaging (fMRI). During a subsequent recognition memory task, participants were shown video clips depicting plays of the game, stemming either from previously-viewed game segments (targets) or from non-viewed portions of the same game (foils). After an old-new judgment, participants provided emotional valence and intensity ratings of the clips. A data driven approach was first used to decompose the fMRI signal acquired during free viewing of the game into spatially independent components. Correlations were then calculated between the identified components and post-scanning emotion ratings for successfully encoded targets. Two components were correlated with intensity ratings, including temporal lobe regions implicated in memory and emotional functions, such as the hippocampus and amygdala, as well as a midline fronto-cingulo-parietal network implicated in social cognition and self-relevant processing. These data were supported by a general linear model analysis, which revealed additional valence effects in fronto-striatal-insular regions when plays were divided into positive and negative events according to the fan's perspective. Overall, these findings contribute to our understanding of how emotional factors impact distributed neural systems to successfully encode dynamic, personally-relevant event sequences.

The short and long of it: neural correlates of temporal-order memory for autobiographical events.

Previous functional neuroimaging studies of temporal-order memory have investigated memory for laboratory stimuli that are causally unrelated and poor in sensory detail. In contrast, the present functional magnetic resonance imaging (fMRI) study investigated temporal-order memory for autobiographical events that were causally interconnected and rich in sensory detail. Participants took photographs at many campus locations over a period of several hours, and the following day they were scanned while making temporal-order judgments to pairs of photographs from different locations. By manipulating the temporal lag between the two locations in each trial, we compared the neural correlates associated with reconstruction processes, which we hypothesized depended on recollection and contribute mainly to short lags, and distance processes, which we hypothesized to depend on familiarity and contribute mainly to longer lags. Consistent with our hypotheses, parametric fMRI analyses linked shorter lags to activations in regions previously associated with recollection (left prefrontal, parahippocampal, precuneus, and visual cortices), and longer lags with regions previously associated with familiarity (right prefrontal cortex). The hemispheric asymmetry in prefrontal cortex activity fits very well with evidence and theories regarding the contributions of the left versus right prefrontal cortex to memory (recollection vs. familiarity processes) and cognition (systematic vs. heuristic processes). In sum, using a novel photo-paradigm, this study provided the first evidence regarding the neural correlates of temporal-order for autobiographical events.

The spatiotemporal dynamics of autobiographical memory: neural correlates of recall, emotional intensity, and reliving.

We sought to map the time course of autobiographical memory retrieval, including brain regions that mediate phenomenological experiences of reliving and emotional intensity. Participants recalled personal memories to auditory word cues during event-related functional magnetic resonance imaging (fMRI). Participants pressed a button when a memory was accessed, maintained and elaborated the memory, and then gave subjective ratings of emotion and reliving. A novel fMRI approach based on timing differences capitalized on the protracted reconstructive process of autobiographical memory to segregate brain areas contributing to initial access and later elaboration and maintenance of episodic memories. The initial period engaged hippocampal, retrosplenial, and medial and right prefrontal activity, whereas the later period recruited visual, precuneus, and left prefrontal activity. Emotional intensity ratings were correlated with activity in several regions, including the amygdala and the hippocampus during the initial period. Reliving ratings were correlated with activity in visual cortex and ventromedial and inferior prefrontal regions during the later period. Frontopolar cortex was the only brain region sensitive to emotional intensity across both periods. Results were confirmed by time-locked averages of the fMRI signal. The findings indicate dynamic recruitment of emotion-, memory-, and sensory-related brain regions during remembering and their dissociable contributions to phenomenological features of the memories.

Activation in mesolimbic and visuospatial neural circuits elicited by smoking cues: evidence from functional magnetic resonance imaging.

OBJECTIVE: The authors sought to increase understanding of the brain mechanisms involved in cigarette addiction by identifying neural substrates modulated by visual smoking cues in nicotine-deprived smokers. METHOD: Event-related functional magnetic resonance imaging (fMRI) was used to detect brain activation after exposure to smoking-related images in a group of nicotine-deprived smokers and a nonsmoking comparison group. Subjects viewed a pseudo-random sequence of smoking images, neutral nonsmoking images, and rare targets (photographs of animals). Subjects pressed a button whenever a rare target appeared. RESULTS: In smokers, the fMRI signal was greater after exposure to smoking-related images than after exposure to neutral images in mesolimbic dopamine reward circuits known to be activated by addictive drugs (right posterior amygdala, posterior hippocampus, ventral tegmental area, and medial thalamus) as well as in areas related to visuospatial attention (bilateral prefrontal and parietal cortex and right fusiform gyrus). In nonsmokers, no significant differences in fMRI signal following exposure to smoking-related and neutral images were detected. In most regions studied, both subject groups showed greater activation following presentation of rare target images than after exposure to neutral images. CONCLUSIONS: In nicotine-deprived smokers, both reward and attention circuits were activated by exposure to smoking-related images. Smoking cues are processed like rare targets in that they activate attentional regions. These cues are also processed like addictive drugs in that they activate mesolimbic reward regions.

Less wiring, more firing: low-performing older adults compensate for impaired white matter with greater neural activity.

The reliable neuroimaging finding that older adults often show greater activity (over-recruitment) than younger adults is typically attributed to compensation. Yet, the neural mechanisms of over-recruitment in older adults (OAs) are largely unknown. Rodent electrophysiology studies have shown that as number of afferent fibers within a circuit decreases with age, the fibers that remain show higher synaptic field potentials (less wiring, more firing). Extrapolating to system-level measures in humans, we proposed and tested the hypothesis that greater activity in OAs compensates for impaired white-matter connectivity. Using a neuropsychological test battery, we measured individual differences in executive functions associated with the prefrontal cortex (PFC) and memory functions associated with the medial temporal lobes (MTLs). Using event-related functional magnetic resonance imaging, we compared activity for successful versus unsuccessful trials during a source memory task. Finally, we measured white-matter integrity using diffusion tensor imaging. The study yielded 3 main findings. First, low-executive OAs showed greater success-related activity in the PFC, whereas low-memory OAs showed greater success-related activity in the MTLs. Second, low-executive OAs displayed white-matter deficits in the PFC, whereas low-memory OAs displayed white-matter deficits in the MTLs. Finally, in both prefrontal and MTL regions, white-matter decline and success-related activations occurred in close proximity and were negatively correlated. This finding supports the less-wiring-more-firing hypothesis, which provides a testable account of compensatory over-recruitment in OAs.

Cross-hemispheric collaboration and segregation associated with task difficulty as revealed by structural and functional connectivity.

Although it is known that brain regions in one hemisphere may interact very closely with their corresponding contralateral regions (collaboration) or operate relatively independent of them (segregation), the specific brain regions (where) and conditions (how) associated with collaboration or segregation are largely unknown. We investigated these issues using a split field-matching task in which participants matched the meaning of words or the visual features of faces presented to the same (unilateral) or to different (bilateral) visual fields. Matching difficulty was manipulated by varying the semantic similarity of words or the visual similarity of faces. We assessed the white matter using the fractional anisotropy (FA) measure provided by diffusion tensor imaging (DTI) and cross-hemispheric communication in terms of fMRI-based connectivity between homotopic pairs of cortical regions. For both perceptual and semantic matching, bilateral trials became faster than unilateral trials as difficulty increased (bilateral processing advantage, BPA). The study yielded three novel findings. First, whereas FA in anterior corpus callosum (genu) correlated with word-matching BPA, FA in posterior corpus callosum (splenium-occipital) correlated with face-matching BPA. Second, as matching difficulty intensified, cross-hemispheric functional connectivity (CFC) increased in domain-general frontopolar cortex (for both word and face matching) but decreased in domain-specific ventral temporal lobe regions (temporal pole for word matching and fusiform gyrus for face matching). Last, a mediation analysis linking DTI and fMRI data showed that CFC mediated the effect of callosal FA on BPA. These findings clarify the mechanisms by which the hemispheres interact to perform complex cognitive tasks.

Metacognition in monkeys during an oculomotor task.

This study investigated whether rhesus monkeys show evidence of metacognition in a reduced, visual oculomotor task that is particularly suitable for use in fMRI and electrophysiology. The 2-stage task involved punctate visual stimulation and saccadic eye movement responses. In each trial, monkeys made a decision and then made a bet. To earn maximum reward, they had to monitor their decision and use that information to bet advantageously. Two monkeys learned to base their bets on their decisions within a few weeks. We implemented an operational definition of metacognitive behavior that relied on trial-by-trial analyses and signal detection theory. Both monkeys exhibited metacognition according to these quantitative criteria. Neither external visual cues nor potential reaction time cues explained the betting behavior; the animals seemed to rely exclusively on internal traces of their decisions. We documented the learning process of one monkey. During a 10-session transition phase, betting switched from random to a decision-based strategy. The results reinforce previous findings of metacognitive ability in monkeys and may facilitate the neurophysiological investigation of metacognitive functions.

A Dynamic Directional Model for Effective Brain Connectivity using Electrocorticographic (ECoG) Time Series.

We introduce a dynamic directional model (DDM) for studying brain effective connectivity based on intracranial electrocorticographic (ECoG) time series. The DDM consists of two parts: a set of differential equations describing neuronal activity of brain components (state equations), and observation equations linking the underlying neuronal states to observed data. When applied to functional MRI or EEG data, DDMs usually have complex formulations and thus can accommodate only a few regions, due to limitations in spatial resolution and/or temporal resolution of these imaging modalities. In contrast, we formulate our model in the context of ECoG data. The combined high temporal and spatial resolution of ECoG data result in a much simpler DDM, allowing investigation of complex connections between many regions. To identify functionally segregated sub-networks, a form of biologically economical brain networks, we propose the Potts model for the DDM parameters. The neuronal states of brain components are represented by cubic spline bases and the parameters are estimated by minimizing a log-likelihood criterion that combines the state and observation equations. The Potts model is converted to the Potts penalty in the penalized regression approach to achieve sparsity in parameter estimation, for which a fast iterative algorithm is developed. The methods are applied to an auditory ECoG dataset.

Inhibition-Induced Forgetting Results from Resource Competition between Response Inhibition and Memory Encoding Processes.

UNLABELLED: Response inhibition is a key component of executive control, but its relation to other cognitive processes is not well understood. We recently documented the "inhibition-induced forgetting effect": no-go cues are remembered more poorly than go cues. We attributed this effect to central-resource competition, whereby response inhibition saps attention away from memory encoding. However, this proposal is difficult to test with behavioral means alone. We therefore used fMRI in humans to test two neural predictions of the "common resource hypothesis": (1) brain regions associated with response inhibition should exhibit greater resource demands during encoding of subsequently forgotten than remembered no-go cues; and (2) this higher inhibitory resource demand should lead to memory encoding regions having less resources available during encoding of subsequently forgotten no-go cues. Participants categorized face stimuli by gender in a go/no-go task and, following a delay, performed a surprise recognition memory test for those faces. Replicating previous findings, memory was worse for no-go than for go stimuli. Crucially, forgetting of no-go cues was predicted by high inhibitory resource demand, as quantified by the trial-by-trial ratio of activity in neural "no-go" versus "go" networks. Moreover, this index of inhibitory demand exhibited an inverse trial-by-trial relationship with activity in brain regions responsible for the encoding of no-go cues into memory, notably the ventrolateral prefrontal cortex. This seesaw pattern between the neural resource demand of response inhibition and activity related to memory encoding directly supports the hypothesis that response inhibition temporarily saps attentional resources away from stimulus processing. SIGNIFICANCE STATEMENT: Recent behavioral experiments showed that inhibiting a motor response to a stimulus (a "no-go cue") impairs subsequent memory for that cue. Here, we used fMRI to test whether this "inhibition-induced forgetting effect" is caused by competition for neural resources between the processes of response inhibition and memory encoding. We found that trial-by-trial variations in neural inhibitory resource demand predicted subsequent forgetting of no-go cues and that higher inhibitory demand was furthermore associated with lower concurrent activation in brain regions responsible for successful memory encoding of no-go cues. Thus, motor inhibition and stimulus encoding appear to compete with each other: when more resources have to be devoted to inhibiting action, less are available for encoding sensory stimuli.

When Working Memory and Attention Compete: Characterizing the Dynamic Interdependence between our Mental Workspace and External Environment

All of us are taxed with juggling our inner mental lives with immediate external task demands. For many years, the temporary maintenance of internal information was considered to be handled by a dedicated working memory (WM) system. It has recently become increasingly clear, however, that such short-term internal activation interacts with attention focused on external stimuli. It is unclear, however, exactly why these two interact, at what level of processing, and to what degree. Because our internal maintenance and external attention processes co-occur with one another, the manner of their interaction has vast implications for functioning in daily life. The work described here has employed original experimental paradigms combining WM and attention task elements, functional magnetic resonance imaging (fMRI) to illuminate the associated neural processes, and transcranial magnetic stimulation (TMS) to clarify the causal substrates of attentional brain function. These studies have examined a mechanism that might explain why (and when) the content of WM can involuntarily capture visual attention. They have, furthermore, tested whether fundamental attentional selection processes operate within WM, and whether they are reciprocal with attention. Finally, they have illuminated the neural consequences of competing attentional demands. The findings indicate that WM shares representations, operating principles, and cognitive resources with externally-oriented attention.

Improvement in visual search with practice: mapping learning-related changes in neurocognitive stages of processing.

Practice can improve performance on visual search tasks; the neural mechanisms underlying such improvements, however, are not clear. Response time typically shortens with practice, but which components of the stimulus-response processing chain facilitate this behavioral change? Improved search performance could result from enhancements in various cognitive processing stages, including (1) sensory processing, (2) attentional allocation, (3) target discrimination, (4) motor-response preparation, and/or (5) response execution. We measured event-related potentials (ERPs) as human participants completed a five-day visual-search protocol in which they reported the orientation of a color popout target within an array of ellipses. We assessed changes in behavioral performance and in ERP components associated with various stages of processing. After practice, response time decreased in all participants (while accuracy remained consistent), and electrophysiological measures revealed modulation of several ERP components. First, amplitudes of the early sensory-evoked N1 component at 150 ms increased bilaterally, indicating enhanced visual sensory processing of the array. Second, the negative-polarity posterior-contralateral component (N2pc, 170-250 ms) was earlier and larger, demonstrating enhanced attentional orienting. Third, the amplitude of the sustained posterior contralateral negativity component (SPCN, 300-400 ms) decreased, indicating facilitated target discrimination. Finally, faster motor-response preparation and execution were observed after practice, as indicated by latency changes in both the stimulus-locked and response-locked lateralized readiness potentials (LRPs). These electrophysiological results delineate the functional plasticity in key mechanisms underlying visual search with high temporal resolution and illustrate how practice influences various cognitive and neural processing stages leading to enhanced behavioral performance.

The role of stimulus salience and attentional capture across the neural hierarchy in a stop-signal task.

Inhibitory motor control is a core function of cognitive control. Evidence from diverse experimental approaches has linked this function to a mostly right-lateralized network of cortical and subcortical areas, wherein a signal from the frontal cortex to the basal ganglia is believed to trigger motor-response cancellation. Recently, however, it has been recognized that in the context of typical motor-control paradigms those processes related to actual response inhibition and those related to the attentional processing of the relevant stimuli are highly interrelated and thus difficult to distinguish. Here, we used fMRI and a modified Stop-signal task to specifically examine the role of perceptual and attentional processes triggered by the different stimuli in such tasks, thus seeking to further distinguish other cognitive processes that may precede or otherwise accompany the implementation of response inhibition. In order to establish which brain areas respond to sensory stimulation differences by rare Stop-stimuli, as well as to the associated attentional capture that these may trigger irrespective of their task-relevance, we compared brain activity evoked by Stop-trials to that evoked by Go-trials in task blocks where Stop-stimuli were to be ignored. In addition, region-of-interest analyses comparing the responses to these task-irrelevant Stop-trials, with those to typical relevant Stop-trials, identified separable activity profiles as a function of the task-relevance of the Stop-signal. While occipital areas were mostly blind to the task-relevance of Stop-stimuli, activity in temporo-parietal areas dissociated between task-irrelevant and task-relevant ones. Activity profiles in frontal areas, in turn, were activated mainly by task-relevant Stop-trials, presumably reflecting a combination of triggered top-down attentional influences and inhibitory motor-control processes.

Mapping the semantic structure of cognitive neuroscience.

Cognitive neuroscience, as a discipline, links the biological systems studied by neuroscience to the processing constructs studied by psychology. By mapping these relations throughout the literature of cognitive neuroscience, we visualize the semantic structure of the discipline and point to directions for future research that will advance its integrative goal. For this purpose, network text analyses were applied to an exhaustive corpus of abstracts collected from five major journals over a 30-month period, including every study that used fMRI to investigate psychological processes. From this, we generate network maps that illustrate the relationships among psychological and anatomical terms, along with centrality statistics that guide inferences about network structure. Three terms--prefrontal cortex, amygdala, and anterior cingulate cortex--dominate the network structure with their high frequency in the literature and the density of their connections with other neuroanatomical terms. From network statistics, we identify terms that are understudied compared with their importance in the network (e.g., insula and thalamus), are underspecified in the language of the discipline (e.g., terms associated with executive function), or are imperfectly integrated with other concepts (e.g., subdisciplines like decision neuroscience that are disconnected from the main network). Taking these results as the basis for prescriptive recommendations, we conclude that semantic analyses provide useful guidance for cognitive neuroscience as a discipline, both by illustrating systematic biases in the conduct and presentation of research and by identifying directions that may be most productive for future research.

Cumulative stress in childhood is associated with blunted reward-related brain activity in adulthood.

Early life stress (ELS) is strongly associated with negative outcomes in adulthood, including reduced motivation and increased negative mood. The mechanisms mediating these relations, however, are poorly understood. We examined the relation between exposure to ELS and reward-related brain activity, which is known to predict motivation and mood, at age 26, in a sample followed since kindergarten with annual assessments. Using functional neuroimaging, we assayed individual differences in the activity of the ventral striatum (VS) during the processing of monetary rewards associated with a simple card-guessing task, in a sample of 72 male participants. We examined associations between a cumulative measure of ELS exposure and VS activity in adulthood. We found that greater levels of cumulative stress during childhood and adolescence predicted lower reward-related VS activity in adulthood. Extending this general developmental pattern, we found that exposure to stress early in development (between kindergarten and grade 3) was significantly associated with variability in adult VS activity. Our results provide an important demonstration that cumulative life stress, especially during this childhood period, is associated with blunted reward-related VS activity in adulthood. These differences suggest neurobiological pathways through which a history of ELS may contribute to reduced motivation and increased negative mood.

The neural dynamics of stimulus and response conflict processing as a function of response complexity and task demands.

Both stimulus and response conflict can disrupt behavior by slowing response times and decreasing accuracy. Although several neural activations have been associated with conflict processing, it is unclear how specific any of these are to the type of stimulus conflict or the amount of response conflict. Here, we recorded electrical brain activity, while manipulating the type of stimulus conflict in the task (spatial [Flanker] versus semantic [Stroop]) and the amount of response conflict (two versus four response choices). Behaviorally, responses were slower to incongruent versus congruent stimuli across all task and response types, along with overall slowing for higher response-mapping complexity. The earliest incongruency-related neural effect was a short-duration frontally-distributed negativity at ~200 ms that was only present in the Flanker spatial-conflict task. At longer latencies, the classic fronto-central incongruency-related negativity 'N(inc)' was observed for all conditions, but was larger and ~100 ms longer in duration with more response options. Further, the onset of the motor-related lateralized readiness potential (LRP) was earlier for the two vs. four response sets, indicating that smaller response sets enabled faster motor-response preparation. The late positive complex (LPC) was present in all conditions except the two-response Stroop task, suggesting this late conflict-related activity is not specifically related to task type or response-mapping complexity. Importantly, across tasks and conditions, the LRP onset at or before the conflict-related N(inc), indicating that motor preparation is a rapid, automatic process that interacts with the conflict-detection processes after it has begun. Together, these data highlight how different conflict-related processes operate in parallel and depend on both the cognitive demands of the task and the number of response options.