Neural analogs of associative learning in {\it Aplysia\/}: Experimental and theoretical approaches

A change in synaptic strength arising from the activation of two neuronal pathways at approximately the same time is a form of associative plasticity and may underlie classical conditioning. Previously, a cellular analog of a classical conditioning protocol has been demonstrated to produce short-term associative plasticity at the connections between sensory and motor neurons in Aplysia. A similar training protocol produced long-term (24 hour) enhancement of excitatory postsynaptic potentials (EPSPs). EPSPs produced by sensory neurons in which activity was paired with a reinforcing stimulus were significantly larger than unpaired controls 24 hours after training. To examined whether the associative plasticity observed at these synapses may be involved in higher-order forms of classical conditioning, a neural analog of contingency was developed. In addition, computer simulations were used to analyze whether the associative plasticity observed in Aplysia could, in theory, account for second-order conditioning and blocking. ^

In vitro analog of classical conditioning of feeding behavior in aplysia.

The feeding behavior of Aplysia californica can be classically conditioned using tactile stimulation of the lips as a conditioned stimulus (CS) and food as an unconditioned stimulus (US). Moreover, several neural correlates of classical conditioning have been identified. The present study extended previous work by developing an in vitro analog of classical conditioning and by investigating pairing-specific changes in neuronal and synaptic properties. The preparation consisted of the isolated cerebral and buccal ganglia. Electrical stimulation of a lip nerve (AT4) and a branch of the esophageal nerve (En2) served as the CS and US, respectively. Three protocols were used: paired, unpaired, and US alone. Only the paired protocol produced a significant increase in CS-evoked fictive feeding. At the cellular level, classical conditioning enhanced the magnitude of the CS-evoked synaptic input to pattern-initiating neuron B31/32. In addition, paired training enhanced both the magnitude of the CS-evoked synaptic input and the CS-evoked spike activity in command-like neuron CBI-2. The in vitro analog of classical conditioning reproduced all of the cellular changes that previously were identified following behavioral conditioning and has led to the identification of several new learning-related neural changes. In addition, the pairing-specific enhancement of the CS response in CBI-2 indicates that some aspects of associative plasticity may occur at the level of the cerebral sensory neurons.

Tracking the Flow of Information through the Hippocampal Formation in the Rat

The hippocampus receives input from upper levels of the association cortex and is implicated in many mnemonic processes, but the exact mechanisms by which it codes and stores information is an unresolved topic. This work examines the flow of information through the hippocampal formation while attempting to determine the computations that each of the hippocampal subfields performs in learning and memory. The formation, storage, and recall of hippocampal-dependent memories theoretically utilize an autoassociative attractor network that functions by implementing two competitive, yet complementary, processes. Pattern separation, hypothesized to occur in the dentate gyrus (DG), refers to the ability to decrease the similarity among incoming information by producing output patterns that overlap less than the inputs. In contrast, pattern completion, hypothesized to occur in the CA3 region, refers to the ability to reproduce a previously stored output pattern from a partial or degraded input pattern. Prior to addressing the functional role of the DG and CA3 subfields, the spatial firing properties of neurons in the dentate gyrus were examined. The principal cell of the dentate gyrus, the granule cell, has spatially selective place fields; however, the behavioral correlates of another excitatory cell, the mossy cell of the dentate polymorphic layer, are unknown. This report shows that putative mossy cells have spatially selective firing that consists of multiple fields similar to previously reported properties of granule cells. Other cells recorded from the DG had single place fields. Compared to cells with multiple fields, cells with single fields fired at a lower rate during sleep, were less likely to burst, and were more likely to be recorded simultaneously with a large population of neurons that were active during sleep and silent during behavior. These data suggest that single-field and multiple-field cells constitute at least two distinct cell classes in the DG. Based on these characteristics, we propose that putative mossy cells tend to fire in multiple, distinct locations in an environment, whereas putative granule cells tend to fire in single locations, similar to place fields of the CA1 and CA3 regions. Experimental evidence supporting the theories of pattern separation and pattern completion comes from both behavioral and electrophysiological tests. These studies specifically focused on the function of each subregion and made implicit assumptions about how environmental manipulations changed the representations encoded by the hippocampal inputs. However, the cell populations that provided these inputs were in most cases not directly examined. We conducted a series of studies to investigate the neural activity in the entorhinal cortex, dentate gyrus, and CA3 in the same experimental conditions, which allowed a direct comparison between the input and output representations. The results show that the dentate gyrus representation changes between the familiar and cue altered environments more than its input representations, whereas the CA3 representation changes less than its input representations. These findings are consistent with longstanding computational models proposing that (1) CA3 is an associative memory system performing pattern completion in order to recall previous memories from partial inputs, and (2) the dentate gyrus performs pattern separation to help store different memories in ways that reduce interference when the memories are subsequently recalled.

Molecular mechanisms underlying a cellular analog of operant reward learning.

Operant conditioning is a ubiquitous but mechanistically poorly understood form of associative learning in which an animal learns the consequences of its behavior. Using a single-cell analog of operant conditioning in neuron B51 of Aplysia, we examined second-messenger pathways engaged by activity and reward and how they may provide a biochemical association underlying operant learning. Conditioning was blocked by Rp-cAMP, a peptide inhibitor of PKA, a PKC inhibitor, and by expressing a dominant-negative isoform of Ca2+-dependent PKC (apl-I). Thus, both PKA and PKC were necessary for operant conditioning. Injection of cAMP into B51 mimicked the effects of operant conditioning. Activation of PKC also mimicked conditioning but was dependent on both cAMP and PKA, suggesting that PKC acted at some point upstream of PKA activation. Our results demonstrate how these molecules can interact to mediate operant conditioning in an individual neuron important for the expression of the conditioned behavior.

Characterization of the interactions between two sites of plasticity engaged during eyelid conditioning

Here, we investigate the involvement of two sites of plasticity in the learning and expression of a simple associative motor behavior—the classically conditioned eyelid response. While previous studies clearly demonstrate that lesions of the anterior interpositus nucleus of the cerebellum abolish learned responses and prevent subsequent learning, studies investigating the effects of lesions of the cerebellar cortex on learning and retention have produced discrepant results. We complement ablative lesion studies of the cortex with the use of reversible, pharmacological blockade of cerebellar cortical transmission to investigate the role of the cerebellar cortex in eyelid conditioning. We demonstrate that both pharmacological blockade as well as focused ablative lesions of the cortex abolish timed responses and unmask responses with a fixed, short latency that are not displayed by the intact animal. Pharmacological blockade of cerebellar cortex output at various stages of acquisition and extinction reveals appropriate, learning dependent changes in the amplitude and probability of short latency responses during training. Acquisition of both short latency as well as timed responses is prevented by ablative lesions of the anterior lobe of the cerebellar cortex. These convergent results from technically distinct methods of removing the influence of the cerebellar cortex from conditioned behavior are consistent with the proposal that (1) eyelid conditioning engages two cerebellar sites of plasticity-one in the cortex and one in the anterior interpositus nucleus, (2) plasticity in the cerebellar cortex is necessary for proper response timing, (3) plasticity in the nucleus mediates the short latency responses unmasked by lesions of the cerebellar cortex, and (4) cerebellar cortical output is necessary for the induction of plasticity in the nucleus. ^

Behavioral and cellular analysis of classical conditioning of feeding behavior in Aplysia

In classical conditioning, an associative form of learning, animals learn to associate two stimuli. Cellular and molecular mechanisms for the induction and consolidation of associative learning and memory at the level of single cells and synaptic connections have been studied in both vertebrate and invertebrate animals. The majority of studies, however, relied on aversive stimuli to induce learning. This bias may limit the extent to which identified mechanisms generalize to other forms of associative learning and memory, such as appetitive forms. The goal of the present study was to develop a classical conditioning procedure for the marine mollusk Aplysia californica using appetitive reinforcement, and to analyze associative learning using behavioral and electrophysiological techniques. ^ Using tactile stimulation of the lips as the conditional stimulus (CS) and food as the unconditional stimulus (US) a training protocol was developed that reliably induced classical conditioning of feeding behavior. Memory persisted for at least 24 hours. The gross organization of reinforcement-mediating pathways was analyzed in additional behavioral experiments. Moreover, neurophysiological correlates of classical conditioning were identified and characterized in an in vitro preparation containing the circuitry for feeding behavior. In vitro stimulation of a nerve (AT4) that may mediate the CS during training, resulted in a greater number of buccal motor patterns (BMPs) in brains from conditioned animals, as compared to control animals. The majority of these BMPs were ingestion-like, consistent with the increased number of bites in response to the CS after classical conditioning. Moreover, classical conditioning correlated with increased excitatory synaptic input to BMP-initiating neuron B31/32, in response to stimulation of AT 4, as compared to controls. The expression of the correlates of classical conditioning identified in this study was specific to stimulation of AT 4, which is consistent the stimulus specificity that is characteristic for classical conditioning. ^ The identification of cellular correlates of classical conditioning documented here provides the basis for future, more detailed analyses of an appetitive form of associative learning and memory, that may extend the working knowledge of the cellular and molecular mechanisms for associative plasticity in general. ^

Learning in the cerebellar nucleus is necessary for acquisition of Pavlovian eyelid conditioning

The cumulative work presented here supports the hypothesis that plasticity in the cerebellar cortex and cerebellar nuclei mediates a simple associative form of motor teaming-Pavlovian eyelid conditioning. It was previously demonstrated that focal ablative lesions of cerebellar anterior lobe or pharmacological block of the cerebellar cortex output disrupted the timing of the conditioned eyeblink response, unmasking a response with a relatively fixed and very short latency to onset. The results of this thesis demonstrate that the short-latency responses are due to associative learning. Unpaired training does not support the acquisition of short-latency responses while the rate of acquisition of short-latency responses during paired training is approximately the same as that of timed conditioned responses. The acquisition of short-latency responses is dependent on an intact cerebellar cortex. Both ablative lesions of the cerebellar cortex and inactivation of cerebellar cortex output with picrotoxin block the acquisition of short-latency responses. However, once the short-latency responses are acquired neither disconnection of cerebellar cortex nor inactivation of the cerebellar nucleus block reacquisition. The results are consistent with the proposal that plasticity in the cerebellar cortex is necessary for learning the timing of conditioned responses, plasticity in the interpositus nucleus mediates the short latency responses, and cerebellar cortical output and mossy fiber input are necessary for the acquisition of short latency responses. ^

Cellular mechanisms of operant and classical conditioning

The ability to associate a predictive stimulus with a subsequent salient event (i.e., classical conditioning) and the ability to associate an expressed behavior with the consequences (i.e., operant conditioning) allow for a predictive understanding of a changing environment. Although they are operationally distinct, there has been considerable debate whether at some fundamental level classical and operant conditioning are mechanistically distinct or similar. Feeding behavior of Aplysia (i.e., biting) was chosen as the model system and was successfully conditioned with appetitive forms of both operant and classical conditioning. The neuronal circuitry responsible for feeding is well understood and is suitable for cellular analyses, thus providing for a mechanistic comparison between these two forms of associative learning. ^ Neuron B51 is part of the feeding circuitry of Aplysia and is critical for the expression of ingestive behaviors. B51 also is a locus of plasticity following both operant and classical conditioning. Both in vivo and in vitro operant conditioning increased the input resistance and the excitability of B51. No pairing-specific changes in the input resistance were observed following both in vivo and in vitro classical conditioning. However, classical conditioning decreased the excitability of B51. Thus, both operant and classical conditioning modified the threshold level for activation of neuron B51, but in opposite directions, revealing key differences in the cellular mechanisms underlying these two forms of associative learning. ^ Next, the cellular mechanisms underlying operant conditioning were investigated in more detail using a single-cell analogue. The single-cell analogue successfully recapitulated the previous in vivo and in vitro operant conditioning results by increasing the input resistance and the excitability of B51. Both PKA and PKC were necessary for operant conditioning. Dopamine appears to be the transmitter mediating the reinforcement signal in this form of conditioning. A D1 dopamine receptor antibody revealed that the D1receptor localizes to the axon hillock, which is also the region that gives the strongest response when iontophoresing dopamine. ^ The studies presented herein, thus, provide for a greater understanding of the mechanisms underlying both of these forms of associative learning and demonstrate that they likely operate through distinct cellular mechanisms. ^

Forebrain-cerebellum interactions revealed by trace eyelid conditioning

While it is commonly assumed that brain systems receive and process information from other brain systems, there are few examples of tractable behaviors that allow such interactions to be studied. With the experiments presented in this dissertation we provide evidence that trace eyelid conditioning, a simple form of associative learning, is mediated by cerebellar learning in response to the output of persistent neural activity in the prefrontal cortex (PFC) and thus may be useful in analyses of PFC-cerebellar interactions. In a series of stimulation and reversible inactivation experiments we provide evidence that trace eyelid conditioning is mediated by cerebellar learning in response to a learned forebrain-driven input. Specifically, we provide evidence that this input is driven by the medial PFC and persists through the stimulus free trace interval of trace eyelid conditioning. In the next set of experiments we show that directly presenting the cerebellum with a pattern of input that mimics the classic persistent activity of PFC neurons reconstitutes trace eyelid conditioning, as assessed by a number of stringent tests. Finally, in set of reversible inactivation experiments, we provide evidence that bidirectional learning during trace eyelid conditioning involves the omission of the persistent, PFC-driven input that the cerebellum learns and responds to during trace eyelid conditioning. Given that persistent activity in PFC is often associated with working memory, these experiments suggest that trace eyelid conditioning may be useful in analyses of working memory mechanisms, cerebellar information processing and their interaction. To facilitate future analyses, we conclude with a working hypothesis of forebrain-cerebellum interactions during trace eyelid conditioning that addresses how persistent activity in PFC is induced and how the cerebellum decodes and uses PFC-driven input. ^

Application of cell line based genomic predictors to predict response to targeted therapies in breast cancer

Cancer cell lines can be treated with a drug and the molecular comparison of responders and non-responders may yield potential predictors that could be tested in the clinic. It is a bioinformatics challenge to apply the cell line-derived multivariable response predictors to patients who respond to therapy. Using the gene expression data from 23 breast cancer cell lines, I developed three predictors of dasatinib sensitivity by selecting differentially expressed genes and applying different classification algorithms. The performance of these predictors on independent cell lines with known dasatinib response was tested. The predictor based on weighted voting method has the best overall performance. It correctly predicted dasatinib sensitivity in 11 out of 12 (92%) breast and 17 out of 23 (74%) lung cancer cell lines. These predictors were then applied to the gene expression data from 133 breast cancer patients in an attempt to predict how the patients might respond to dasatinib therapy. Two predictors identified 13 patients in common to be dasatinib sensitive. Sixty two percent of these cases are triple negative (ER-negative, HER2-negative and PR-negative) and 76% are double negative. The result is consistent with the findings from other studies, which identified a target population for dasatinib treatment to be triple negative or basal breast cancer subtype. In conclusion, we think that the cell line-derived dasatinib classifiers can be applied to the human patients. ^

Immunologic characteristics of immunogenic variants generated by {\it in vitro\/} treatment of a methylcholanthrene-induced murine fibrosarcoma MCA-F with 1 methyl-3-nitro-1-nitrosoguanidine, 5 -aza-2$\sp\prime$-deoxycytidine, or ultraviolet radiation

This study addresses the questions of whether the frequency of generation and in vivo cross-reactivity of highly immunogenic tumor clones induced in a single parental murine fibrosarcoma cell line MCA-F is more closely related to the agent used to induce the Imm$\sp{+}$ clone or whether these characteristics are independent of the agents used. These questions were addressed by treating the parental tumor cell line MCA-F with UV-B radiation (UV-B), 1-methyl-3-nitro-1-nitrosoguanidine (MNNG), or 5-aza-2$\sp\prime$-deoxycytidine (5-azaCdR). The frequency of Imm$\sp{+}$ variant generation was similarly high for the three different agents, suggesting that the frequency of Imm$\sp{+}$ generation was related more closely to the cell line than to the inducing agent used. Cross-reactivity was tested with two Imm$\sp{+}$ clones from each treatment group in a modified immunoprotection assay that selectively engendered antivariant, but not antiparental immunity. Under these conditions each clone, except one, immunized against itself. The MNNG-induced clones engendered stronger antivariant immunity but a weaker variant cross-reactive immunity could also be detected.^ This study also characterized the lymphocyte populations responsible for antivariant and antiparental immunity in vivo. Using the local adoptive transfer assay (LATA) and antibody plus complement depletion of T-cell subsets, we showed that immunity induced by the Imm$\sp{+}$ variants against the parent MCA-F was transferred by the Thy1.2$\sp{+}$, L3T4a$\sp{+}$, Lyt2.1$\sp{-}$ (CD4$\sp{+}$) population, without an apparent contribution by Thy1.2$\sp{+}$, L3T4a$\sp{-}$, Lyt2.1$\sp{+}$ (CD8$\sp{+}$) cells. A role for Lyt2.1$\sp{+}$T lymphocytes in antivariant, but not antiparent immunity was supported by the results of LATA and CTL assays. Immunization with low numbers of viable Imm$\sp{+}$ cells, or with high numbers of non viable Imm$\sp{+}$ cells engendered only antivariant immunity without parental cross-protection. The associative recognition of parental antigens and variant neoantigens resulting in strong antiparent immunity was investigated using somatic cells hybrids of Imm$\sp{+}$ variants of MCA-F and an antigenically distinct tumor MCA-D. An unexpected result of these latter experiments was the expression of a unique tumor-specific antigen by the hybrid cells. These studies demonstrate that the parental tumor-specific antigen and the variant neoantigen must be coexpressed on the cell surface to engender parental cross-protective immunity. (Abstract shortened with permission of author.) ^