Neural mechanisms for visual memory and their role in attention

Recent studies show that neuronal mechanisms for learning and memory both dynamically modulate and permanently alter the representations of visual stimuli in the adult monkey cortex. Three commonly observed neuronal effects in memory-demanding tasks are repetition suppression, enhancement, and delay activity. In repetition suppression, repeated experience with the same visual stimulus leads to both short- and long-term suppression of neuronal responses in subpopulations of visual neurons. Enhancement works in an opposite fashion, in that neuronal responses are enhanced for objects with learned behavioral relevance. Delay activity is found in tasks in which animals are required to actively hold specific information “on-line” for short periods. Repetition suppression appears to be an intrinsic property of visual cortical areas such as inferior temporal cortex and is thought to be important for perceptual learning and priming. By contrast, enhancement and delay activity may depend on feedback to temporal cortex from prefrontal cortex and are thought to be important for working memory. All of these mnemonic effects on neuronal responses bias the competitive interactions that take place between stimulus representations in the cortex when there is more than one stimulus in the visual field. As a result, memory will often determine the winner of these competitions and, thus, will determine which stimulus is attended.

Invariance of brain-wave representations of simple visual images and their names

In two experiments, electric brain waves of 14 subjects were recorded under several different conditions to study the invariance of brain-wave representations of simple patches of colors and simple visual shapes and their names, the words blue, circle, etc. As in our earlier work, the analysis consisted of averaging over trials to create prototypes and test samples, to both of which Fourier transforms were applied, followed by filtering and an inverse transformation to the time domain. A least-squares criterion of fit between prototypes and test samples was used for classification. The most significant results were these. By averaging over different subjects, as well as trials, we created prototypes from brain waves evoked by simple visual images and test samples from brain waves evoked by auditory or visual words naming the visual images. We correctly recognized from 60% to 75% of the test-sample brain waves. The general conclusion is that simple shapes such as circles and single-color displays generate brain waves surprisingly similar to those generated by their verbal names. These results, taken together with extensive psychological studies of auditory and visual memory, strongly support the solution proposed for visual shapes, by Bishop Berkeley and David Hume in the 18th century, to the long-standing problem of how the mind represents simple abstract ideas.

Positron-emission tomography imaging of long-term shape recognition challenges

Long-term visual memory performance was impaired by two types of challenges: a diazepam challenge on acquisition and a sensory challenge on recognition. Using positron-emission tomography regional cerebral blood flow imaging, we studied the effect of these challenges on regional brain activation during the delayed recognition of abstract visual shapes as compared with a baseline fixation task. Both challenges induced a significant decrease in differential activation in the left fusiform gyrus, suggesting that this region is involved in the automatic or volitional comparison of incoming and stored stimuli. In contrast, thalamic differential activation increased in response to memory challenges. This increase might reflect enhanced retrieval attempts as a compensatory mechanism for restoring recognition performance.

Long-term modifications of synaptic efficacy in the human inferior and middle temporal cortex.

The primate temporal cortex has been demonstrated to play an important role in visual memory and pattern recognition. It is of particular interest to investigate whether activity-dependent modification of synaptic efficacy, a presumptive mechanism for learning and memory, is present in this cortical region. Here we address this issue by examining the induction of synaptic plasticity in surgically resected human inferior and middle temporal cortex. The results show that synaptic strength in the human temporal cortex could undergo bidirectional modifications, depending on the pattern of conditioning stimulation. High frequency stimulation (100 or 40 Hz) in layer IV induced long-term potentiation (LTP) of both intracellular excitatory postsynaptic potentials and evoked field potentials in layers II/III. The LTP induced by 100 Hz tetanus was blocked by 50-100 microM DL-2-amino-5-phosphonovaleric acid, suggesting that N-methyl-D-aspartate receptors were responsible for its induction. Long-term depression (LTD) was elicited by prolonged low frequency stimulation (1 Hz, 15 min). It was reduced, but not completely blocked, by DL-2-amino-5-phosphonovaleric acid, implying that some other mechanisms in addition to N-methyl-DL-aspartate receptors were involved in LTD induction. LTD was input-specific, i.e., low frequency stimulation of one pathway produced LTD of synaptic transmission in that pathway only. Finally, the LTP and LTD could reverse each other, suggesting that they can act cooperatively to modify the functional state of cortical network. These results suggest that LTP and LTD are possible mechanisms for the visual memory and pattern recognition functions performed in the human temporal cortex.

A perceptual memory for low-contrast visual signals

Detection of a visual signal can be facilitated by simultaneous presentation of a similar subthreshold signal. Here we show that the facilitatory effect of a subthreshold signal can persist for more than 16 s. Presenting a near-threshold Gabor signal (prime) produced a phase-independent increase in contrast sensitivity (40%) to similar successive signals (target) for a period of up to 16 s. This effect was obtained only when both prime and target were presented to the same eye. We further show that the memory trace is inactivated by presenting high-contrast signals before the target. These results suggest that activated neurons in the primary visual cortex retain a near-threshold memory trace that persists until reactivated.

A neural system for human visual working memory

Working memory is the process of actively maintaining a representation of information for a brief period of time so that it is available for use. In monkeys, visual working memory involves the concerted activity of a distributed neural system, including posterior areas in visual cortex and anterior areas in prefrontal cortex. Within visual cortex, ventral stream areas are selectively involved in object vision, whereas dorsal stream areas are selectively involved in spatial vision. This domain specificity appears to extend forward into prefrontal cortex, with ventrolateral areas involved mainly in working memory for objects and dorsolateral areas involved mainly in working memory for spatial locations. The organization of this distributed neural system for working memory in monkeys appears to be conserved in humans, though some differences between the two species exist. In humans, as compared with monkeys, areas specialized for object vision in the ventral stream have a more inferior location in temporal cortex, whereas areas specialized for spatial vision in the dorsal stream have a more superior location in parietal cortex. Displacement of both sets of visual areas away from the posterior perisylvian cortex may be related to the emergence of language over the course of brain evolution. Whereas areas specialized for object working memory in humans and monkeys are similarly located in ventrolateral prefrontal cortex, those specialized for spatial working memory occupy a more superior and posterior location within dorsal prefrontal cortex in humans than in monkeys. As in posterior cortex, this displacement in frontal cortex also may be related to the emergence of new areas to serve distinctively human cognitive abilities.

Distinct neural correlates of visual long-term memory for spatial location and object identity: a positron emission tomography study in humans.

The purpose of the present study was to investigate by using positron emission tomography (PET) whether the cortical pathways that are involved in visual perception of spatial location and object identity are also differentially implicated in retrieval of these types of information from episodic long-term memory. Subjects studied a set of displays consisting of three unique representational line drawings arranged in different spatial configurations. Later, while undergoing PET scanning, subjects' memory for spatial location and identity of the objects in the displays was tested and compared to a perceptual baseline task involving the same displays. In comparison to the baseline task, each of the memory tasks activated both the dorsal and the ventral pathways in the right hemisphere but not to an equal extent. There was also activation of the right prefrontal cortex. When PET scans of the memory tasks were compared to each other, areas of activation were very circumscribed and restricted to the right hemisphere: For retrieval of object identity, the area was in the inferior temporal cortex in the region of the fusiform gyrus (area 37), whereas for retrieval of spatial location, it was in the inferior parietal lobule in the region of the supramarginal gyrus (area 40). Thus, our study shows that distinct neural pathways are activated during retrieval of information about spatial location and object identity from long-term memory.

Functional organization of spatial and nonspatial working memory processing within the human lateral frontal cortex

The present study used functional magnetic resonance imaging to demonstrate that performance of visual spatial and visual nonspatial working memory tasks involve the same regions of the lateral prefrontal cortex when all factors unrelated to the type of stimulus material are appropriately controlled. These results provide evidence that spatial and nonspatial working memory may not be mediated, respectively, by mid-dorsolateral and mid-ventrolateral regions of the frontal lobe, as widely assumed, and support the alternative notion that specific regions of the lateral prefrontal cortex make identical executive functional contributions to both spatial and nonspatial working memory.

Memory-enhancing effects of secreted forms of the β-amyloid precursor protein in normal and amnestic mice

When administered intracerebroventricularly to mice performing various learning tasks involving either short-term or long-term memory, secreted forms of the β-amyloid precursor protein (APPs751 and APPs695) have potent memory-enhancing effects and block learning deficits induced by scopolamine. The memory-enhancing effects of APPs were observed over a wide range of extremely low doses (0.05-5,000 pg intracerebroventricularly), blocked by anti-APPs antisera, and observed when APPs was administered either after the first training session in a visual discrimination or a lever-press learning task or before the acquisition trial in an object recognition task. APPs had no effect on motor performance or exploratory activity. APPs695 and APPs751 were equally effective in the object recognition task, suggesting that the memory-enhancing effect of APPs does not require the Kunitz protease inhibitor domain. These data suggest an important role for APPss on memory processes.

Memory fields of neurons in the primate prefrontal cortex

Many prefrontal (PF) neurons convey information about both an object’s identity (what) and its location (where). To explore how they represent conjunctions of what and where, we explored the receptive fields of their mnemonic activity (i.e., their “memory fields”) by requiring monkeys to remember both an object and its location at many positions throughout a wide portion of central vision. Many PF neurons conveyed object information and had highly localized memory fields that emphasized the contralateral, but not necessarily foveal, visual field. These results indicate that PF neurons can simultaneously convey precise location and object information and thus may play a role in constructing a unified representation of a visual scene.

Reactivation of encoding-related brain activity during memory retrieval

Neuronal models predict that retrieval of specific event information reactivates brain regions that were active during encoding of this information. Consistent with this prediction, this positron-emission tomography study showed that remembering that visual words had been paired with sounds at encoding activated some of the auditory brain regions that were engaged during encoding. After word-sound encoding, activation of auditory brain regions was also observed during visual word recognition when there was no demand to retrieve auditory information. Collectively, these observations suggest that information about the auditory components of multisensory event information is stored in auditory responsive cortex and reactivated at retrieval, in keeping with classical ideas about “redintegration,” that is, the power of part of an encoded stimulus complex to evoke the whole experience.

Memory's echo: Vivid remembering reactivates sensory-specific cortex

A fundamental question in human memory is how the brain represents sensory-specific information during the process of retrieval. One hypothesis is that regions of sensory cortex are reactivated during retrieval of sensory-specific information (1). Here we report findings from a study in which subjects learned a set of picture and sound items and were then given a recall test during which they vividly remembered the items while imaged by using event-related functional MRI. Regions of visual and auditory cortex were activated differentially during retrieval of pictures and sounds, respectively. Furthermore, the regions activated during the recall test comprised a subset of those activated during a separate perception task in which subjects actually viewed pictures and heard sounds. Regions activated during the recall test were found to be represented more in late than in early visual and auditory cortex. Therefore, results indicate that retrieval of vivid visual and auditory information can be associated with a reactivation of some of the same sensory regions that were activated during perception of those items.

Visual habit formation in monkeys with neurotoxic lesions of the ventrocaudal neostriatum

Visual habit formation in monkeys, assessed by concurrent visual discrimination learning with 24-h intertrial intervals (ITI), was found earlier to be impaired by removal of the inferior temporal visual area (TE) but not by removal of either the medial temporal lobe or inferior prefrontal convexity, two of TE's major projection targets. To assess the role in this form of learning of another pair of structures to which TE projects, namely the rostral portion of the tail of the caudate nucleus and the overlying ventrocaudal putamen, we injected a neurotoxin into this neostriatal region of several monkeys and tested them on the 24-h ITI task as well as on a test of visual recognition memory. Compared with unoperated monkeys, the experimental animals were unaffected on the recognition test but showed an impairment on the 24-h ITI task that was highly correlated with the extent of their neostriatal damage. The findings suggest that TE and its projection areas in the ventrocaudal neostriatum form part of a circuit that selectively mediates visual habit formation.

Tracking memory's trace

There is strong converging evidence that the intermediate and medial part of the hyperstriatum ventrale of the chick brain is a memory store for information acquired through the learning process of imprinting. Neurons in this memory system come, through imprinting, to respond selectively to the imprinting stimulus (IS) neurons and so possess the properties of a memory trace. Therefore, the responses of the intermediate and medial part of the hyperstriatum ventrale neurons to a visual imprinting stimulus were determined before, during, and after training. Of the total recorded population, the proportions of IS neurons shortly after each of two 1-h training sessions were significantly higher (approximately 2 times) than the pretraining proportion. However, ≈4.5 h later this proportion had fallen significantly and did not differ significantly from the pretraining proportion. Nevertheless, ≈21.5 h after the end of training, the proportion of IS neurons was at its highest (approximately 3 times the pretraining level). No significant fluctuations occurred in the proportions of neurons responding to the alternative stimulus. In addition, nonmonotonic changes were found commonly in the activity of 230 of the neurons tracked individually from before training to shortly after the end of training. Thus the pattern of change in responsiveness both at the population level and at the level of individual neurons was highly nonmonotonic. Such a pattern of change is not consistent with simple models of memory based on synaptic strengthening to asymptote. A model is proposed that accounts for the changes in the population responses to the imprinting stimulus in terms of changes in the responses of individual neurons.

Memory systems analyses of mnemonic disorders in aging and age-related diseases

The effects upon memory of normal aging and two age-related neurodegenerative diseases, Alzheimer disease (AD) and Parkinson disease, are analyzed in terms of memory systems, specific neural networks that mediate specific mnemonic processes. An occipital memory system mediating implicit visual-perceptual memory appears to be unaffected by aging or AD. A frontal system that may mediate implicit conceptual memory is affected by AD but not by normal aging. Another frontal system that mediates aspects of working and strategic memory is affected by Parkinson disease and, to a lesser extent, by aging. The aging effect appears to occur during all ages of the adult life-span. Finally, a medial-temporal system that mediates declarative memory is affected by the late onset of AD. Studies of intact and impaired memory in age-related diseases suggest that normal aging has markedly different effects upon different memory systems.