Both the dorsal hippocampus and the dorsolateral striatum are needed for rat navigation in the Morris water maze

The multiple memory systems theory proposes that the hippocampus and the dorsolateral striatum are the core structures of the spatial/relational and stimulus-response (S-R) memory systems, respectively. This theory is supported by double dissociation studies showing that the spatial and cue (S-R) versions of the Morris water maze are impaired by lesions in the dorsal hippocarnpus and dorsal striatum, respectively. In the present study we further investigated whether adult male Wistar rats bearing double and bilateral electrolytic lesions in the dorsal hippocampus and dorsolateral striatum were as impaired as rats bearing single lesions in just one of these structures in learning both versions of the water maze. Such a prediction, based on the multiple memory systems theory, was not confirmed. Compared to the controls, the animals with double lesions exhibited no improvement at all in the spatial version and learned the cued version very slowly. These results suggest that, instead of independent systems competing for holding control over navigational behaviour, the hippocampus and dorsal striatum both play critical roles in navigation based on spatial or cue-based strategies. (C) 2011 Elsevier B.V. All rights reserved.

Spatial Learning and Stress Response of Male Rats Prenatally Exposed to Dexamethasone

Dexamethasone is routinely administered to women at risk for a preterm birth in order to enhance fetal lung development and reduce uterine contractions. Research has demonstrated possible behavioral abnormalities in adulthood as a result of dexamethasone treatment. Using nonlinear mixed effects modeling, this study found thatprenatal dexamethasone treatment impaired spatial learning and memory of adult male Sprague-Dawley rats. Prenatal dexamethasone treatment also led to more anxiety related behaviors on Elevated Plus Maze testing 1.5 hours after a stress challenge. Because theassumptions underlying the independent samples t-test were violated, the randomization test was used to compare groups on the Elevated Plus Maze.

Maternal and Postweaning High-Fat Diets Disturb Hippocampal Gene Expression, Learning, and Memory Function

We tested the hypothesis that excess saturated fat consumption during pregnancy, lactation, and/or postweaning alters the expression of genes mediating hippocampal synaptic efficacy and impairs spatial learning and memory in adulthood. Dams were fed control chow or a diet high in saturated fat before mating, during pregnancy, and into lactation. Offspring were weaned to either standard chow or a diet high in saturated fat. The Morris Water Maze was used to evaluate spatial learning and memory. Open field testing was used to evaluate motor activity. Hippocampal gene expression in adult males was measured using RT-PCR and ELISA. Offspring from high fat-fed dams took longer, swam farther, and faster to try and find the hidden platform during the 5-day learning period. Control offspring consuming standard chow spent the most time in memory quadrant during the probe test. Offspring from high fat-fed dams consuming excess saturated fat spent the least. The levels of mRNA and protein for brain-derived neurotrophic factor and activity-regulated cytoskeletal-associated protein were significantly decreased by maternal diet effects. Nerve growth factor mRNA and protein levels were significantly reduced in response to both maternal and postweaning high-fat diets. Expression levels for the N-methyl-D-aspartate receptor (NMDA) receptor subunit NR2B as well as synaptophysin were significantly decreased in response to both maternal and postweaning diets. Synaptotagmin was significantly increased in offspring from high fat-fed dams. These data support the hypothesis that exposure to excess saturated fat during hippocampal development is associated with complex patterns of gene expression and deficits in learning and memory.

The free radical scavenger alpha-phenyl-tert-butyl nitrone aggravates hippocampal apoptosis and learning deficits in experimental pneumococcal meningitis

The effect of adjuvant therapy with the radical scavenger alpha-phenyl-tert-butyl nitrone (PBN; 100 mg/kg given intraperitoneally every 8 h for 5 days) on brain injury and learning function was evaluated in an infant rat model of pneumococcal meningitis. Meningitis led to cortical necrotic injury (median, 3.97% [range, 0%-38.9%] of the cortex), which was reduced to a median of 0% (range, 0%-30.9%) of the cortex (P<.001) by PBN. However, neuronal apoptosis in the hippocampal dentate gyrus was increased by PBN, compared with that by saline (median score, 1.15 [range, 0.04-1.73] vs. 0.31 [range, 0-0.92]; P<.001). Learning function 3 weeks after cured infection, as assessed by the Morris water maze, was decreased, compared with that in uninfected control animals (P<.001). Parallel to the increase in hippocampal apoptosis, PBN further impaired learning in infected animals, compared with that in saline-treated animals (P<.02). These results contrast with those of an earlier study, in which PBN reduced cortical and hippocampal neuronal injury in group B streptococcal meningitis. Thus, in pneumococcal meningitis, antioxidant therapy with PBN aggravates hippocampal injury and learning deficits.

Code-specific learning rules improve action selection by populations of spiking neurons

Population coding is widely regarded as a key mechanism for achieving reliable behavioral decisions. We previously introduced reinforcement learning for population-based decision making by spiking neurons. Here we generalize population reinforcement learning to spike-based plasticity rules that take account of the postsynaptic neural code. We consider spike/no-spike, spike count and spike latency codes. The multi-valued and continuous-valued features in the postsynaptic code allow for a generalization of binary decision making to multi-valued decision making and continuous-valued action selection. We show that code-specific learning rules speed up learning both for the discrete classification and the continuous regression tasks. The suggested learning rules also speed up with increasing population size as opposed to standard reinforcement learning rules. Continuous action selection is further shown to explain realistic learning speeds in the Morris water maze. Finally, we introduce the concept of action perturbation as opposed to the classical weight- or node-perturbation as an exploration mechanism underlying reinforcement learning. Exploration in the action space greatly increases the speed of learning as compared to exploration in the neuron or weight space.

Dexamethasone aggravates hippocampal apoptosis and learning deficiency in pneumococcal meningitis in infant rats.

In an infant rat model of pneumococcal meningitis the effect of dexamethasone on neuronal injury in the hippocampus and on learning disability after recovery from the disease was examined. Treatment with dexamethasone or vehicle was started 18 h after infection, concomitant with antibiotics. Neuronal apoptosis in the hippocampal dentate gyrus 34 h after infection was significantly aggravated by dexamethasone treatment compared with vehicle controls (p = 0.02). Three weeks after acute pneumococcal meningitis, learning capacity of animals was assessed in the Morris water maze. The results showed a significantly impaired learning performance of infected animals treated with dexamethasone compared with vehicle controls (p = 0.01). Dexamethasone had no effect on hippocampal injury or learning in uninfected controls. Thus, dexamethasone as adjuvant therapy increased hippocampal cell injury and reduced learning capacity in this model of pneumococcal meningitis in infant rats.

Glutamate infused posttraining into the hippocampus or caudate-putamen differentially strengthens place and response learning

A cross-maze task that can be acquired through either place or response learning was used to examine the hypothesis that posttraining neurochemical manipulation of the hippocampus or caudate-putamen can bias an animal toward the use of a specific memory system. Male Long-Evans rats received four trials per day for 7 days, a probe trial on day 8, further training on days 9–15, and an additional probe trial on day 16. Training occurred in a cross-maze task in which rats started from a consistent start-box (south), and obtained food from a consistent goal-arm (west). On days 4–6 of training, rats received posttraining intrahippocampal (1 μg/0.5 μl) or intracaudate (2 μg/0.5 μl) injections of either glutamate or saline (0.5 μl). On days 8 and 16, a probe trial was given in which rats were placed in a novel start-box (north). Rats selecting the west goal-arm were designated “place” learners, and those selecting the east goal-arm were designated “response” learners. Saline-treated rats predominantly displayed place learning on day 8 and response learning on day 16, indicating a shift in control of learned behavior with extended training. Rats receiving intrahippocampal injections of glutamate predominantly displayed place learning on days 8 and 16, indicating that manipulation of the hippocampus produced a blockade of the shift to response learning. Rats receiving intracaudate injections of glutamate displayed response learning on days 8 and 16, indicating an accelerated shift to response learning. The findings suggest that posttraining intracerebral glutamate infusions can (i) modulate the distinct memory processes mediated by the hippocampus and caudate-putamen and (ii) bias the brain toward the use of a specific memory system to control learned behavior and thereby influence the timing of the switch from the use of cognitive memory to habit learning to guide behavior.

Running enhances neurogenesis, learning, and long-term potentiation in mice

Running increases neurogenesis in the dentate gyrus of the hippocampus, a brain structure that is important for memory function. Consequently, spatial learning and long-term potentiation (LTP) were tested in groups of mice housed either with a running wheel (runners) or under standard conditions (controls). Mice were injected with bromodeoxyuridine to label dividing cells and trained in the Morris water maze. LTP was studied in the dentate gyrus and area CA1 in hippocampal slices from these mice. Running improved water maze performance, increased bromodeoxyuridine-positive cell numbers, and selectively enhanced dentate gyrus LTP. Our results indicate that physical activity can regulate hippocampal neurogenesis, synaptic plasticity, and learning.

Ts1Cje, a partial trisomy 16 mouse model for Down syndrome, exhibits learning and behavioral abnormalities

A mouse model for Down syndrome, Ts1Cje, has been developed. This model has made possible a step in the genetic dissection of the learning, behavioral, and neurological abnormalities associated with segmental trisomy for the region of mouse chromosome 16 homologous with the so-called “Down syndrome region” of human chromosome segment 21q22. Tests of learning in the Morris water maze and assessment of spontaneous locomotor activity reveal distinct learning and behavioral abnormalities, some of which are indicative of hippocampal dysfunction. The triplicated region in Ts1Cje, from Sod1 to Mx1, is smaller than that in Ts65Dn, another segmental trisomy 16 mouse, and the learning deficits in Ts1Cje are less severe than those in Ts65Dn. In addition, degeneration of basal forebrain cholinergic neurons, which was observed in Ts65Dn, was absent in Ts1Cje.

Preserved neuron number in the hippocampus of aged rats with spatial learning deficits.

Hippocampal neuron loss is widely viewed as a hallmark of normal aging. Moreover, neuronal degeneration is thought to contribute directly to age-related deficits in learning and memory supported by the hippocampus. By taking advantage of improved methods for quantifying neuron number, the present study reports evidence challenging these long-standing concepts. The status of hippocampal-dependent spatial learning was evaluated in young and aged Long-Evans rats using the Morris water maze, and the total number of neurons in the principal cell layers of the dentate gyrus and hippocampus was quantified according to the optical fractionator technique. For each of the hippocampal fields, neuron number was preserved in the aged subjects as a group and in aged individuals with documented learning and memory deficits indicative of hippocampal dysfunction. The findings demonstrate that hippocampal neuronal degeneration is not an inevitable consequence of normal aging and that a loss of principal neurons in the hippocampus fails to account for age-related learning and memory impairment. The observed preservation of neuron number represents an essential foundation for identifying the neurobiological effects of hippocampal aging that account for cognitive decline.

Electroconvulsive shock and lidocaine reveal rapid consolidation of spatial working memory in the water maze.

Head trauma leading to concussion and electroconvulsive shock (ECS) in humans causes amnesia for events that occurred shortly before the injury (retrograde amnesia). The present experiment investigated the amnesic effect of lidocaine and ECS in 25 rats trained on a working memory version of the Morris water task. Each day, the escape platform was moved to a new location; learning was evidenced by a decrease in the latency to find the platform from the first to the second trial. "Consolidation" of this newly encoded spatial engram was disrupted by bilateral inactivation of the dorsal hippocampus with 1 microliter of 4% lidocaine applied as soon as possible after the first trial. When trial 2 was given after recovery from the lidocaine (30 min after the injection), a normal decrease in latency indicated that the new engram was not disrupted. When trial 2 was given under the influence of lidocaine (5 min after injection), absence of latency decrease demonstrated both the success of the inactivation and the importance of hippocampus for the task. To examine the role of events immediately after learning, ECS (30 or 100 mA, 50 Hz, 1.2 sec) was applied 0 sec to 45 sec after a single escape to the new platform location. A 2-h delay between ECS and trial 2 allowed the effects of ECS to dissipate. ECS applied 45 sec or 30 sec after trial 1 caused no retrograde amnesia: escape latencies on trial 2 were the same as in control rats. However, ECS applied 0 sec or 15 sec after trial 1 induced clear retrograde amnesia: escape latencies on trial 2 were no shorter than on trial 1. It is concluded that the consolidation of a newly formed memory for spatial location can only be disrupted by ECS within 30 sec after learning.

Spatial learning with a minislab in the dorsal hippocampus.

We have determined the volume and location of hippocampal tissue required for normal acquisition of a spatial memory task. Ibotenic acid was used to make bilateral symmetric lesions of 20-100% of hippocampal volume. Even a small transverse block (minislab) of the hippocampus (down to 26% of the total) could support spatial learning in a water maze, provided it was at the septal (dorsal) pole of the hippocampus. Lesions of the septal pole, leaving 60% of the hippocampi intact, caused a learning deficit, although normal electrophysiological responses, synaptic plasticity, and preserved acetylcholinesterase staining argue for adequate function of the remaining tissue. Thus, with an otherwise normal brain, hippocampal-dependent spatial learning only requires a minislab of dorsal hippocampal tissue.

Age-related learning deficits in transgenic mice expressing the 751-amino acid isoform of human beta-amyloid precursor protein.

The beta-amyloid precursor protein (beta-APP), from which the beta-A4 peptide is derived, is considered to be central to the pathogenesis of Alzheimer disease (AD). Transgenic mice expressing the 751-amino acid isoform of human beta-APP (beta-APP751) have been shown to develop early AD-like histopathology with diffuse deposits of beta-A4 and aberrant tau protein expression in the brain, particularly in the hippocampus, cortex, and amygdala. We now report that beta-APP751 transgenic mice exhibit age-dependent deficits in spatial learning in a water-maze task and in spontaneous alternation in a Y maze. These deficits were mild or absent in 6-month-old transgenic mice but were severe in 12-month-old transgenic mice compared to age-matched wild-type control mice. No other behavioral abnormalities were observed. These mice therefore model the progressive learning and memory impairment that is a cardinal feature of AD. These results provide evidence for a relationship between abnormal expression of beta-APP and cognitive impairments.

Transient prenatal vitamin D deficiency is associated with subtle alterations in learning and memory functions in adult rats

Based on clues from epidemiology, low prenatal vitamin D has been proposed as a candidate risk factor for schizophrenia. Recent animal experiments have demonstrated that transient prenatal vitamin D deficiency is associated with persistent alterations in brain morphology and neurotrophin expression. In order to explore the utility of the vitamin D animal model of schizophrenia, we examined different types of learning and memory in adult rats exposed to transient prenatal vitamin D deficiency. Compared to control animals, the prenatally deplete animals had a significant impairment of latent inhibition, a feature often associated with schizophrenia. In addition, the deplete group was (a) significantly impaired on hole board habituation and (b) significantly better at maintaining previously learnt rules of brightness discrimination in a Y-chamber. In contrast, the prenatally deplete animals showed no impairment on the spatial learning task in the radial maze, nor on two-way active avoidance learning in the shuttle-box. The results indicate that transient prenatal vitamin D depletion in the rat is associated with subtle and discrete alterations in learning and memory. The behavioural phenotype associated with this animal model may provide insights into the neurobiological correlates of the cognitive impairments of schizophrenia. (c) 2005 Elsevier B.V. All rights reserved.

Learning to play Pac-Man: An evolutionary, rule-based approach

Pac-Man is a well-known, real-time computer game that provides an interesting platform for research. We describe an initial approach to developing an artificial agent that replaces the human to play a simplified version of Pac-Man. The agent is specified as a simple finite state machine and ruleset. with parameters that control the probability of movement by the agent given the constraints of the maze at some instant of time. In contrast to previous approaches, the agent represents a dynamic strategy for playing Pac-Man, rather than a pre-programmed maze-solving method. The agent adaptively "learns" through the application of population-based incremental learning (PBIL) to adjust the agents' parameters. Experimental results are presented that give insight into some of the complexities of the game, as well as highlighting the limitations and difficulties of the representation of the agent.