A biophysical model of synaptic plasticity and metaplasticity can account for the dynamics of the backward shift of hippocampal place fields.

Hippocampal place cells in the rat undergo experience-dependent changes when the rat runs stereotyped routes. One such change, the backward shift of the place field center of mass, has been linked by previous modeling efforts to spike-timing-dependent plasticity (STDP). However, these models did not account for the termination of the place field shift and they were based on an abstract implementation of STDP that ignores many of the features found in cortical plasticity. Here, instead of the abstract STDP model, we use a calcium-dependent plasticity (CaDP) learning rule that can account for many of the observed properties of cortical plasticity. We use the CaDP learning rule in combination with a model of metaplasticity to simulate place field dynamics. Without any major changes to the parameters of the original model, the present simulations account both for the initial rapid place field shift and for the subsequent slowing down of this shift. These results suggest that the CaDP model captures the essence of a general cortical mechanism of synaptic plasticity, which may underlie numerous forms of synaptic plasticity observed both in vivo and in vitro.

Learning -dependent plasticity of movement representations in the primate primary motor cortex

Primary motor cortex (M1) is involved in the production of voluntary movement and contains a complete functional representation, or map, of the skeletal musculature. This functional map can be altered by pathological experiences, such as peripheral nerve injury or stroke, by pharmacological manipulation, and by behavioral experience. The process by which experience-dependent alterations of cortical function occur is termed plasticity. In this thesis, plasticity of M1 functional organization as a consequence of behavioral experience was examined in adult primates (squirrel monkeys). Maps of movement representations were derived under anesthesia using intracortical microstimulation, whereby a microelectrode was inserted into the cortex to electrically stimulate corticospinal neurons at low current levels and evoke movements of the forelimb, principally of the hand. Movement representations were examined before and at several times after training on behavioral tasks that emphasized use of the fingers. Two behavioral tasks were utilized that dissociated the repetition of motor activity from the acquisition of motor skills. One task was easy to perform, and as such promoted repetitive motor activity without learning. The other task was more difficult, requiring the acquisition of motor skills for successful performance. Kinematic analysis indicated that monkeys used a consistent set of forelimb movements during pellet extractions. Functional mapping revealed that repetitive motor activity during the easier task did not produce plastic changes in movement representations. Instead, map plasticity, in the form of selective expansions of task-related movement representations, was only produced following skill acquisition on the difficult task. Additional studies revealed that, in general, map plasticity persisted without further training for up to three months, in parallel with the retention of task-related motor skills. Also, extensive additional training on the small well task produced further improvements in performance, and further changes in movement maps. In sum, these experiments support the following three conclusions regarding the role of M1 in motor learning. First, behaviorally-driven plasticity is learning-dependent, not activity-dependent. Second, plastic changes in M1 functional representations represent a neural correlate of acquired motor skills. Third, the persistence of map plasticity suggests that M1 is part of the neural substrate for the memory of motor skills. ^

Cerebellar mechanisms for motor learning: Testing predictions from a large-scale computer simulation

The cerebellum is the major brain structure that contributes to our ability to improve movements through learning and experience. We have combined computer simulations with behavioral and lesion studies to investigate how modification of synaptic strength at two different sites within the cerebellum contributes to a simple form of motor learning—Pavlovian conditioning of the eyelid response. These studies are based on the wealth of knowledge about the intrinsic circuitry and physiology of the cerebellum and the straightforward manner in which this circuitry is engaged during eyelid conditioning. Thus, our simulations are constrained by the well-characterized synaptic organization of the cerebellum and further, the activity of cerebellar inputs during simulated eyelid conditioning is based on existing recording data. These simulations have allowed us to make two important predictions regarding the mechanisms underlying cerebellar function, which we have tested and confirmed with behavioral studies. The first prediction describes the mechanisms by which one of the sites of synaptic modification, the granule to Purkinje cell synapses (gr → Pkj) of the cerebellar cortex, could generate two time-dependent properties of eyelid conditioning—response timing and the ISI function. An empirical test of this prediction using small, electrolytic lesions of the cerebellar cortex revealed the pattern of results predicted by the simulations. The second prediction made by the simulations is that modification of synaptic strength at the other site of plasticity, the mossy fiber to deep nuclei synapses (mf → nuc), is under the control of Purkinje cell activity. The analysis predicts that this property should confer mf → nuc synapses with resistance to extinction. Thus, while extinction processes erase plasticity at the first site, residual plasticity at mf → nuc synapses remains. The residual plasticity at the mf → nuc site confers the cerebellum with the capability for rapid relearning long after the learned behavior has been extinguished. We confirmed this prediction using a lesion technique that reversibly disconnected the cerebellar cortex at various stages during extinction and reacquisition of eyelid responses. The results of these studies represent significant progress toward a complete understanding of how the cerebellum contributes to motor learning. ^

Learning reward timing in cortex through reward dependent expression of synaptic plasticity.

The ability to represent time is an essential component of cognition but its neural basis is unknown. Although extensively studied both behaviorally and electrophysiologically, a general theoretical framework describing the elementary neural mechanisms used by the brain to learn temporal representations is lacking. It is commonly believed that the underlying cellular mechanisms reside in high order cortical regions but recent studies show sustained neural activity in primary sensory cortices that can represent the timing of expected reward. Here, we show that local cortical networks can learn temporal representations through a simple framework predicated on reward dependent expression of synaptic plasticity. We assert that temporal representations are stored in the lateral synaptic connections between neurons and demonstrate that reward-modulated plasticity is sufficient to learn these representations. We implement our model numerically to explain reward-time learning in the primary visual cortex (V1), demonstrate experimental support, and suggest additional experimentally verifiable predictions.

Spike timing dependent plasticity: a consequence of more fundamental learning rules.

Spike timing dependent plasticity (STDP) is a phenomenon in which the precise timing of spikes affects the sign and magnitude of changes in synaptic strength. STDP is often interpreted as the comprehensive learning rule for a synapse - the "first law" of synaptic plasticity. This interpretation is made explicit in theoretical models in which the total plasticity produced by complex spike patterns results from a superposition of the effects of all spike pairs. Although such models are appealing for their simplicity, they can fail dramatically. For example, the measured single-spike learning rule between hippocampal CA3 and CA1 pyramidal neurons does not predict the existence of long-term potentiation one of the best-known forms of synaptic plasticity. Layers of complexity have been added to the basic STDP model to repair predictive failures, but they have been outstripped by experimental data. We propose an alternate first law: neural activity triggers changes in key biochemical intermediates, which act as a more direct trigger of plasticity mechanisms. One particularly successful model uses intracellular calcium as the intermediate and can account for many observed properties of bidirectional plasticity. In this formulation, STDP is not itself the basis for explaining other forms of plasticity, but is instead a consequence of changes in the biochemical intermediate, calcium. Eventually a mechanism-based framework for learning rules should include other messengers, discrete change at individual synapses, spread of plasticity among neighboring synapses, and priming of hidden processes that change a synapse's susceptibility to future change. Mechanism-based models provide a rich framework for the computational representation of synaptic plasticity.

Molecular mechanisms underlying a cellular analog of operant reward learning.

Operant conditioning is a ubiquitous but mechanistically poorly understood form of associative learning in which an animal learns the consequences of its behavior. Using a single-cell analog of operant conditioning in neuron B51 of Aplysia, we examined second-messenger pathways engaged by activity and reward and how they may provide a biochemical association underlying operant learning. Conditioning was blocked by Rp-cAMP, a peptide inhibitor of PKA, a PKC inhibitor, and by expressing a dominant-negative isoform of Ca2+-dependent PKC (apl-I). Thus, both PKA and PKC were necessary for operant conditioning. Injection of cAMP into B51 mimicked the effects of operant conditioning. Activation of PKC also mimicked conditioning but was dependent on both cAMP and PKA, suggesting that PKC acted at some point upstream of PKA activation. Our results demonstrate how these molecules can interact to mediate operant conditioning in an individual neuron important for the expression of the conditioned behavior.

Learning in the cerebellar nucleus is necessary for acquisition of Pavlovian eyelid conditioning

The cumulative work presented here supports the hypothesis that plasticity in the cerebellar cortex and cerebellar nuclei mediates a simple associative form of motor teaming-Pavlovian eyelid conditioning. It was previously demonstrated that focal ablative lesions of cerebellar anterior lobe or pharmacological block of the cerebellar cortex output disrupted the timing of the conditioned eyeblink response, unmasking a response with a relatively fixed and very short latency to onset. The results of this thesis demonstrate that the short-latency responses are due to associative learning. Unpaired training does not support the acquisition of short-latency responses while the rate of acquisition of short-latency responses during paired training is approximately the same as that of timed conditioned responses. The acquisition of short-latency responses is dependent on an intact cerebellar cortex. Both ablative lesions of the cerebellar cortex and inactivation of cerebellar cortex output with picrotoxin block the acquisition of short-latency responses. However, once the short-latency responses are acquired neither disconnection of cerebellar cortex nor inactivation of the cerebellar nucleus block reacquisition. The results are consistent with the proposal that plasticity in the cerebellar cortex is necessary for learning the timing of conditioned responses, plasticity in the interpositus nucleus mediates the short latency responses, and cerebellar cortical output and mossy fiber input are necessary for the acquisition of short latency responses. ^

Waking Up to Sleep Medicine Education

Background: Sleep disorders are an important cause of morbidity among our population with billions of dollars spent on direct and indirect costs attributed to sleep disorders. In spite of raising prevalence and morbidity, surveys have shown inadequate education in sleep medicine at all levels at medical school. According to national sleep disorders research plan data, in 1990 about 37 % of medical schools did not offer any sleep education and of the schools which offered it, the average time devoted to sleep medicine was about 2 hours. Sleep disorders have found to be uniformly under diagnosed in primary care settings. [See PDF for complete abstract]

SIGNALING MECHANISMS THAT CONTROL GAP JUNCTIONAL COUPLING BETWEEN RETINAL NEURONS

Gap junctions between neurons form the structural substrate for electrical synapses. Connexin 36 (Cx36, and its non-mammalian ortholog connexin 35) is the major neuronal gap junction protein in the central nervous system (CNS), and contributes to several important neuronal functions including neuronal synchronization, signal averaging, network oscillations, and motor learning. Connexin 36 is strongly expressed in the retina, where it is an obligatory component of the high-sensitivity rod photoreceptor pathway. A fundamental requirement of the retina is to adapt to broadly varying inputs in order to maintain a dynamic range of signaling output. Modulation of the strength of electrical coupling between networks of retinal neurons, including the Cx36-coupled AII amacrine cell in the primary rod circuit, is a hallmark of retinal luminance adaptation. However, very little is known about the mechanisms regulating dynamic modulation of Cx36-mediated coupling. The primary goal of this work was to understand how cellular signaling mechanisms regulate coupling through Cx36 gap junctions. We began by developing and characterizing phospho-specific antibodies against key regulatory phosphorylation sites on Cx36. Using these tools we showed that phosphorylation of Cx35 in fish models varies with light adaptation state, and is modulated by acute changes in background illumination. We next turned our focus to the well-studied and readily identifiable AII amacrine cell in mammalian retina. Using this model we showed that increased phosphorylation of Cx36 is directly related to increased coupling through these gap junctions, and that the dopamine-stimulated uncoupling of the AII network is mediated by dephosphorylation of Cx36 via protein kinase A-stimulated protein phosphatase 2A activity. We then showed that increased phosphorylation of Cx36 on the AII amacrine network is driven by depolarization of presynaptic ON-type bipolar cells as well as background light increments. This increase in phosphorylation is mediated by activation of extrasynaptic NMDA receptors associated with Cx36 gap junctions on AII amacrine cells and by Ca2+-calmodulin-dependent protein kinase II activation. Finally, these studies indicated that coupling is regulated locally at individual gap junction plaques. This work provides a framework for future study of regulation of Cx36-mediated coupling, in which increased phosphorylation of Cx36 indicates increased neuronal coupling.

Tracking the Flow of Information through the Hippocampal Formation in the Rat

The hippocampus receives input from upper levels of the association cortex and is implicated in many mnemonic processes, but the exact mechanisms by which it codes and stores information is an unresolved topic. This work examines the flow of information through the hippocampal formation while attempting to determine the computations that each of the hippocampal subfields performs in learning and memory. The formation, storage, and recall of hippocampal-dependent memories theoretically utilize an autoassociative attractor network that functions by implementing two competitive, yet complementary, processes. Pattern separation, hypothesized to occur in the dentate gyrus (DG), refers to the ability to decrease the similarity among incoming information by producing output patterns that overlap less than the inputs. In contrast, pattern completion, hypothesized to occur in the CA3 region, refers to the ability to reproduce a previously stored output pattern from a partial or degraded input pattern. Prior to addressing the functional role of the DG and CA3 subfields, the spatial firing properties of neurons in the dentate gyrus were examined. The principal cell of the dentate gyrus, the granule cell, has spatially selective place fields; however, the behavioral correlates of another excitatory cell, the mossy cell of the dentate polymorphic layer, are unknown. This report shows that putative mossy cells have spatially selective firing that consists of multiple fields similar to previously reported properties of granule cells. Other cells recorded from the DG had single place fields. Compared to cells with multiple fields, cells with single fields fired at a lower rate during sleep, were less likely to burst, and were more likely to be recorded simultaneously with a large population of neurons that were active during sleep and silent during behavior. These data suggest that single-field and multiple-field cells constitute at least two distinct cell classes in the DG. Based on these characteristics, we propose that putative mossy cells tend to fire in multiple, distinct locations in an environment, whereas putative granule cells tend to fire in single locations, similar to place fields of the CA1 and CA3 regions. Experimental evidence supporting the theories of pattern separation and pattern completion comes from both behavioral and electrophysiological tests. These studies specifically focused on the function of each subregion and made implicit assumptions about how environmental manipulations changed the representations encoded by the hippocampal inputs. However, the cell populations that provided these inputs were in most cases not directly examined. We conducted a series of studies to investigate the neural activity in the entorhinal cortex, dentate gyrus, and CA3 in the same experimental conditions, which allowed a direct comparison between the input and output representations. The results show that the dentate gyrus representation changes between the familiar and cue altered environments more than its input representations, whereas the CA3 representation changes less than its input representations. These findings are consistent with longstanding computational models proposing that (1) CA3 is an associative memory system performing pattern completion in order to recall previous memories from partial inputs, and (2) the dentate gyrus performs pattern separation to help store different memories in ways that reduce interference when the memories are subsequently recalled.

Long-lasting synaptic potentiation induced by depolarization under conditions that eliminate detectable Ca2+ signals.

Activity-dependent alterations of synaptic transmission important for learning and memory are often induced by Ca(2+) signals generated by depolarization. While it is widely assumed that Ca(2+) is the essential transducer of depolarization into cellular plasticity, little effort has been made to test whether Ca(2+)-independent responses to depolarization might also induce memory-like alterations. It was recently discovered that peripheral axons of nociceptive sensory neurons in Aplysia display long-lasting hyperexcitability triggered by conditioning depolarization in the absence of Ca(2+) entry (using nominally Ca(2+)-free solutions containing EGTA, "0Ca/EGTA") or the absence of detectable Ca(2+) transients (adding BAPTA-AM, "0Ca/EGTA/BAPTA-AM"). The current study reports that depolarization of central ganglia to approximately 0 mV for 2 min in these same solutions induced hyperexcitability lasting >1 h in sensory neuron processes near their synapses onto motor neurons. Furthermore, conditioning depolarization in these solutions produced a 2.5-fold increase in excitatory postsynaptic potential (EPSP) amplitude 1-3 h afterward despite a drop in motor neuron input resistance. Depolarization in 0 Ca/EGTA produced long-term potentiation (LTP) of the EPSP lasting > or = 1 days without changing postsynaptic input resistance. When re-exposed to extracellular Ca(2+) during synaptic tests, prior exposure to 0Ca/EGTA or to 0Ca/EGTA/BAPTA-AM decreased sensory neuron survival. However, differential effects on neuronal health are unlikely to explain the observed potentiation because conditioning depolarization in these solutions did not alter survival rates. These findings suggest that unrecognized Ca(2+)-independent signals can transduce depolarization into long-lasting synaptic potentiation, perhaps contributing to persistent synaptic alterations following large, sustained depolarizations that occur during learning, neural injury, or seizures.

More than synaptic plasticity: role of nonsynaptic plasticity in learning and memory.

Decades of research on the cellular mechanisms of memory have led to the widely held view that memories are stored as modifications of synaptic strength. These changes involve presynaptic processes, such as direct modulation of the release machinery, or postsynaptic processes, such as modulation of receptor properties. Parallel studies have revealed that memories might also be stored by nonsynaptic processes, such as modulation of voltage-dependent membrane conductances, which are expressed as changes in neuronal excitability. Although in some cases nonsynaptic changes can function as part of the engram itself, they might also serve as mechanisms through which a neural circuit is set to a permissive state to facilitate synaptic modifications that are necessary for memory storage.

Ca++/calmodulin-dependent protein kinase II: Messenger RNA in developing rat brain

Ca$\sp{++}$/calmodulin-dependent protein kinase II (CaM-KII) is highly concentrated in mammalian brain, comprising as much as 2% of the total protein in some regions. In forebrain, CaM-KII has been shown to be enriched in postsynaptic structures where it has been implicated in maintaining cytoskeletal structure, and more recently in signal transduction mechanisms and processes underlying learning and memory. CaM-KII appears to exist as a holoenzyme composed of two related yet distinct subunits, alpha and beta. The ratio of the subunits in the holoenzyme varies with different brain regions and to some degree with subcellular fractions. The two subunits also display distinct developmental profiles. Levels of alpha subunit are not evident at birth but increase dramatically during postnatal development, while levels of beta subunit are readily detected at birth and only gradual increase postnatally. The distinct regional, subcellular and developmental distribution of the two subunits of CaM-KII have prompted us to examine factors involved in regulating the synthesis of the subunit proteins.^ This dissertation addresses the regional and developmental expression of the mRNAs for the individual subunits using in situ hybridization histochemistry and northern slot-blot analysis. By comparing the developmental profile of each mRNA with that of its respective protein, we have determined that initiation of gene transcription is likely the primary site for regulating CaM-KII protein levels. Furthermore, the distinct cytoarchitecture of the hippocampus has allowed us to demonstrate that the alpha, but not beta subunit mRNA is localized in dendrites of certain forebrain neurons. The localization of alpha subunit mRNA at postsynaptic structures, in concert with the accumulation of subunit protein, suggests that dendritic synthesis of CaM-KII alpha subunit may be important for maintaining postsynaptic structure and/or function. ^

Neural analogs of associative learning in {\it Aplysia\/}: Experimental and theoretical approaches

A change in synaptic strength arising from the activation of two neuronal pathways at approximately the same time is a form of associative plasticity and may underlie classical conditioning. Previously, a cellular analog of a classical conditioning protocol has been demonstrated to produce short-term associative plasticity at the connections between sensory and motor neurons in Aplysia. A similar training protocol produced long-term (24 hour) enhancement of excitatory postsynaptic potentials (EPSPs). EPSPs produced by sensory neurons in which activity was paired with a reinforcing stimulus were significantly larger than unpaired controls 24 hours after training. To examined whether the associative plasticity observed at these synapses may be involved in higher-order forms of classical conditioning, a neural analog of contingency was developed. In addition, computer simulations were used to analyze whether the associative plasticity observed in Aplysia could, in theory, account for second-order conditioning and blocking. ^

Modulatory effects of bag cell peptides in {\it Aplysia}: Behavioral and electrophysiological studies

Reproductive hormones have effects on the nervous system not directly related to reproductive function. In the rat, for example, luteinizing hormone releasing hormone has dramatic effects on learning and memory. The present work attempts to examine the effects of reproductive hormones on non-reproductive behaviors and the neural loci and mechanisms underlying these effects in Aplysia, an animal whose behaviors, reproductive hormones and neural circuitry have been well characterized.^ In Aplysia, the neurosecretory bag cells release several peptides that are responsible for eliciting egg laying. The effects of these peptides on the defensive tail-siphon withdrawal reflex, as well as sensitization of this reflex, were examined. Sensitization, a simple form of nonassociative learning, refers to the behavioral enhancement of a response to a test stimulus after the presentation of a strong stimulus, that may last minutes (short-term) or days (long-term). An extract of the bag cells (BCE) inhibited the baseline siphon component of the tail-siphon withdrawal reflex and suppressed long-term, but not short-term, sensitization of the reflex. Preliminary experiments suggest that BCE also affects the tail component of the tail-siphon withdrawal reflex.^ To determine the neural mechanisms underlying the inhibition of the baseline reflex, electrophysiological studies were performed using an in vitro analogue of the tail-siphon withdrawal reflex to examine the ability of BCE, as well as the individual bag cell peptides (BCPs), to modulate the circuitry of the reflex. Bag cell extract attenuated the synaptic strength of the monosynaptic connections between tail sensory neurons and tail motor neurons. When individually applied only $\beta$-BCP produced a similar attenuation. This effect of $\beta$-BCP was not dependent on changes in duration of the presynaptic action potential.^ An in vitro analogue of long-term sensitization training was developed to examine the mechanisms by which the BCPs may affect long-term sensitization of the tail-siphon withdrawal reflex. This analogue exhibited both short- and long-term facilitation of the connections between the tail sensory and motor neurons.^ The results of these behavioral and electrophysiological experiments suggest that the BCPs inhibit the tail-siphon withdrawal reflex, at least in part, by modulating the synaptic strength of the connections between the sensory neurons and motor neurons underlying the reflex. One candidate for this effect is $\beta$-BCP. Thus, the peptides which elicit egg laying may also serve other functions such as the inhibition of defensive reflexes. In addition, these experiments raise the possibility that BCPs may exert a long lasting effect ($>$24 hr), suppressing long-term sensitization of the tail-siphon withdrawal reflex. ^