Behavioural and neural correlates of operant conditioning in Lymnaea stagnalis : role of previous experience during development /

The freshwater mollusc Lymnaea stagnalis was utilized in this study to further the understanding of how network properties change as a result of associative learning, and to determine whether or not this plasticity is dependent on previous experience during development. The respiratory and neural correlates of operant conditioning were first determined in normally reared Lymnaea. The same procedure was then applied to differentially reared Lymnaea, that is, animals that had never experienced aerial respiration during their development. The aim was to determine whether these animals would demonstrate the same responses to the training paradigm. In normally reared animals, a behavioural reduction in aerial respiration was accompanied by numerous changes within the neural network. Specifically, I provide evidence of changes at the level of the respiratory central pattern generator and the motor output. In the differentially reared animals, there was little behavioural data to suggest learning and memory. There were, however, significant differences in the network parameters, similar to those observed in normally reared animals. This demonstrated an effect of operant conditioning on differentially reared animals. In this thesis, I have identified additional correlates of operant conditioning in normally reared animals and provide evidence of associative learning in differentially reared animals. I conclude plasticity is not dependent on previous experience, but is rather ontogenetically programmed within the neural network.

Operant conditioning of H-reflex changes synaptic terminals on primate motoneurons.

Operant conditioning of the primate triceps surae H-reflex, the electrical analog of the spinal stretch reflex, creates a memory trace that includes changes in the spinal cord. To define the morphological correlates of this plasticity, we analyzed the synaptic terminal coverage of triceps surae motoneurons from animals in which the triceps surae H-reflex in one leg had been increased (HRup mode) or decreased (HRdown mode) by conditioning and compared them to each other and to motoneurons from unconditioned animals. Motoneurons were labeled by intramuscular injection of cholera toxin-horseradish peroxidase. A total of 5055 terminals on the cell bodies and proximal dendrites of 114 motoneurons from 14 animals were studied by electron microscopy. Significant differences were found between HRup and HRdown animals and between HRup and naive (i.e., unconditioned) animals. F terminals (i.e., putative inhibitory terminals) were smaller and their active zone coverage on the cell body was lower on motoneurons from the conditioned side of HRup animals than on motoneurons from the conditioned side of HRdown animals. C terminals (i.e., terminals associated with postsynaptic cisterns and rough endoplasmic reticulum) were smaller and the number of C terminals in each C complex (i.e., a group of contiguous C terminals) was larger on motoneurons from the conditioned side of HRup animals than on motoneurons either from the conditioned side of HRdown animals or from naive animals. Because the treatment of HRup and HRdown animals differed only in the reward contingency, the results imply that the two contingencies had different effects on motoneuron synaptic terminals. In combination with other recent data, they show that H-reflex conditioning produces a complex pattern of spinal cord plasticity that includes changes in motoneuron physiological properties as well as in synaptic terminals. Further delineation of this pattern should reveal the contribution of the structural changes described here to the learned change in behavior.

Types and amplitudes of touch as reinforcing stimuli in operant conditioning of infant behavior

The reinforcing effects of diverse tactile stimuli were examined in this study. The study had two purposes. First, this study expanded on the Pelaez-Nogueras, Field, Gewirtz, Cigales, Gonzalez, Sanchez and Clasky (1997) finding that stroking increases infants' gaze duration, and smiling and vocalization frequencies more than tickling/poking. Instead of presenting poking and tickling as a single stimulus combination, this study separated poking and tickling in order to measure the effects of each component separately. Further, the effects of poking, tickling/tapping and stroking intensity (i.e., tactile pressure) were compared by having both mild and intense conditions. Second, this study compared the reinforcing efficacy of mother-delivered tactile stimulation to that of infant-originated tactile exploration. Twelve infants from 2- to 5-months of age participated in this study. The experiment was conducted using a repeated measures A-B-A-C-A-D reversal design. The A phases signified baselines and reversals. The B, C, and D phases consisted of alternating treatments (either mild stroking vs. mild poking vs. mild tickling/tapping, intense stroking vs. intense poking vs. intense tickling/tapping, or mother-delivered tactile stimulation vs. infant-originated tactile exploration). Three experimental hypotheses were assessed: (1) infant leg kick rate would be greater when it produced stroking or tickling/tapping (presumptive positive reinforcers), than when it produced poking (a possible punisher), regardless of tactile pressure; (2) infant leg kick rate would be greater when it produced a more intense level of stroking or tickling/tapping and lower when it produced intense poking compared to mild poking; (3) infant leg-kick rate would be greater for mother-delivered tactile stimulation than for infant-originated tactile exploration. Visual inspection and inferential statistical methods were used to analyze the results. The data supported the first two hypotheses. Mixed support emerged for the third hypothesis. This study made several important contributions to the field of psychology. First, this was the first study to quantify the pressure of tactile stimulation, via a pressure meter developed by the researcher. Additionally, the results of this study yielded valuable information about the effects of different modalities of touch. ^

Extending in vitro conditioning in Aplysia to analyze operant and classical processes in the same preparation.

Operant and classical conditioning are major processes shaping behavioral responses in all animals. Although the understanding of the mechanisms of classical conditioning has expanded significantly, the understanding of the mechanisms of operant conditioning is more limited. Recent developments in Aplysia are helping to narrow the gap in the level of understanding between operant and classical conditioning, and have raised the possibility of studying the neuronal processes underlying the interaction of operant and classical components in a relatively complex learning task. In the present study, we describe a first step toward realizing this goal, by developing a single in vitro preparation in which both operant and classical conditioning can be studied concurrently. The new paradigm reproduced previously published results, even under more conservative and homogenous selection criteria and tonic stimulation regime. Moreover, the observed learning was resistant to delay, shortening, and signaling of reinforcement.

Cellular mechanisms of operant and classical conditioning

The ability to associate a predictive stimulus with a subsequent salient event (i.e., classical conditioning) and the ability to associate an expressed behavior with the consequences (i.e., operant conditioning) allow for a predictive understanding of a changing environment. Although they are operationally distinct, there has been considerable debate whether at some fundamental level classical and operant conditioning are mechanistically distinct or similar. Feeding behavior of Aplysia (i.e., biting) was chosen as the model system and was successfully conditioned with appetitive forms of both operant and classical conditioning. The neuronal circuitry responsible for feeding is well understood and is suitable for cellular analyses, thus providing for a mechanistic comparison between these two forms of associative learning. ^ Neuron B51 is part of the feeding circuitry of Aplysia and is critical for the expression of ingestive behaviors. B51 also is a locus of plasticity following both operant and classical conditioning. Both in vivo and in vitro operant conditioning increased the input resistance and the excitability of B51. No pairing-specific changes in the input resistance were observed following both in vivo and in vitro classical conditioning. However, classical conditioning decreased the excitability of B51. Thus, both operant and classical conditioning modified the threshold level for activation of neuron B51, but in opposite directions, revealing key differences in the cellular mechanisms underlying these two forms of associative learning. ^ Next, the cellular mechanisms underlying operant conditioning were investigated in more detail using a single-cell analogue. The single-cell analogue successfully recapitulated the previous in vivo and in vitro operant conditioning results by increasing the input resistance and the excitability of B51. Both PKA and PKC were necessary for operant conditioning. Dopamine appears to be the transmitter mediating the reinforcement signal in this form of conditioning. A D1 dopamine receptor antibody revealed that the D1receptor localizes to the axon hillock, which is also the region that gives the strongest response when iontophoresing dopamine. ^ The studies presented herein, thus, provide for a greater understanding of the mechanisms underlying both of these forms of associative learning and demonstrate that they likely operate through distinct cellular mechanisms. ^

Learning processes and the neural analysis of conditioning

Classical and operant conditioning principles, such as the behavioral discrepancy-derived assumption that reinforcement always selects antecedent stimulus and response relations, have been studied at the neural level, mainly by observing the strengthening of neuronal responses or synaptic connections. A review of the literature on the neural basis of behavior provided extensive scientific data that indicate a synthesis between the two conditioning processes based mainly on stimulus control in learning tasks. The resulting analysis revealed the following aspects. Dopamine acts as a behavioral discrepancy signal in the midbrain pathway of positive reinforcement, leading toward the nucleus accumbens. Dopamine modulates both types of conditioning in the Aplysia mollusk and in mammals. In vivo and in vitro mollusk preparations show convergence of both types of conditioning in the same motor neuron. Frontal cortical neurons are involved in behavioral discrimination in reversal and extinction procedures, and these neurons preferentially deliver glutamate through conditioned stimulus or discriminative stimulus pathways. Discriminative neural responses can reliably precede operant movements and can also be common to stimuli that share complex symbolic relations. The present article discusses convergent and divergent points between conditioning paradigms at the neural level of analysis to advance our knowledge on reinforcement.

Effects of drugs that potentiate GABA on extinction of positively-reinforced operant behaviour

Extinction following positively reinforced operant conditioning reduces response frequency, at least in part through the aversive or frustrative effects of non-reinforcement. According to J.A. Gray's theory, non-reinforcement activates the behavioural inhibition system which in turn causes anxiety. As predicted, anxiolytic drugs including benzodiazepines affect the operant extinction process. Recent studies have shown that reducing GABA-mediated neurotransmission retards extinction of aversive conditioning. We have shown in a series of studies that anxiolytic compounds that potentiate GABA facilitate extinction of positively reinforced fixed-ratio operant behaviour in C57B1/6 male mice. This effect does not occur in the early stages of extinction, nor is it dependent on cumulative effects of the compound administered. Potentiation of GABA at later stages has the effect of increasing sensitivity to the extinction contingency and facilitates the inhibition of the behaviour that is no longer required. The GABAergic hypnotic, zolpidem, has the same selective effects on operant extinction in this procedure. The effects of zolpidem are not due to sedative action. There is evidence across our series of experiments that different GABA-A subtype receptors are involved in extinction facilitation and anxiolysis. Consequently, this procedure may not be an appropriate model for anxiolytic drug action, but it may be a useful technique for analysing the neural bases of extinction and designing therapeutic interventions in humans where failure to extinguish inappropriate behaviours can lead to pathological conditions such as post-traumatic stress disorder.

Molecular mechanisms underlying a cellular analog of operant reward learning.

Operant conditioning is a ubiquitous but mechanistically poorly understood form of associative learning in which an animal learns the consequences of its behavior. Using a single-cell analog of operant conditioning in neuron B51 of Aplysia, we examined second-messenger pathways engaged by activity and reward and how they may provide a biochemical association underlying operant learning. Conditioning was blocked by Rp-cAMP, a peptide inhibitor of PKA, a PKC inhibitor, and by expressing a dominant-negative isoform of Ca2+-dependent PKC (apl-I). Thus, both PKA and PKC were necessary for operant conditioning. Injection of cAMP into B51 mimicked the effects of operant conditioning. Activation of PKC also mimicked conditioning but was dependent on both cAMP and PKA, suggesting that PKC acted at some point upstream of PKA activation. Our results demonstrate how these molecules can interact to mediate operant conditioning in an individual neuron important for the expression of the conditioned behavior.

Influence of the reinforcement magnitude on omission effects

Reinforcement Omission Effects (ROEs), indicated by higher rate of responses after nonreinforced trials in a partial reinforcement schedule, have been interpreted as behavioral transient facilitation after nonreinforcement induced by primary frustration, and/or behavioral transient inhibition after reinforcement induced by demotivation or temporal control. The size of the ROEs should depend directly on the reinforcement magnitude. The present experiment aimed to clarify the relationship between reinforcement magnitude and the omission effects manipulating the magnitude linked to discriminative stimuli in a partial reinforcement FI schedule. The results showed that response rates were higher after omission than after reinforcement delivery. Besides, response rates were highest immediately after the reinforcement omission of a larger magnitude than of a smaller magnitude. These data are interpreted in terms of ROEs multiple process behavioral facilitation after nonreinforcement, and behavioral transient inhibition after reinforcement. (C) 2011 Elsevier B.V. All rights reserved.

Serial conditional discrimination and temporal bisection in rats selectively lesioned in the dentate gyrus

In positive serial conditional discrimination, animals respond during a target stimulus when it is preceded by a feature stimulus, but they do not respond when the same target stimulus is presented alone. Moreover, the feature and target stimuli are separated from each other by an empty interval. The present work aimed to investigate if two durations (4 or 16s) of the same feature stimulus (light) could modulate the operant responses of rats to different levers (A and B) during a 5-s target stimulus (tone). In the present study, lever A was associated with the 4-s light, and lever B was associated with the 16-s light. A 5-s empty interval was included between the light and the tone. In the same training procedure, the rats were also presented with the 5-s tone without the preceding light stimuli. In these trials, the responses were not reinforced. We evaluated the hippocampal involvement of these behavioral processes by selectively lesioning the dentate gyrus with colchicine. Once trained, the rats were submitted to a test using probe trials without reinforcement. They were presented with intermediate durations of the feature stimulus (light) to obtain a temporal bisection curve recorded during the exposure to the target stimuli. The rats from both groups learned to respond with high rates during tones preceded by light and with low rates during tones presented alone, which indicated acquisition of the serial conditional discrimination. The rats were able to discriminate between the 4- and 16-s lights by correctly choosing lever A or B. In the test, the temporal bisection curves from both experimental groups showed a bisection point at the arithmetic mean between 4 and 16s. Such processes were not impaired by the dentate gyrus lesion. Thus, our results showed that different durations of a feature stimulus could result in conditional properties. However, this processing did not appear to depend on the dentate gyrus alone. (C) 2011 Published by Elsevier B.V.

Aprendizaje durante la ontogenia temprana: Estudio de la participación del sistema opioide en la modulación de aprendizajes mediados por el etanol. LEARNING AND EARLY ONTOGENY: ANALYSIS OF THE INVOLVEMENT OF OPIOID SYSTEM IN FETAL AND INFANTILE ETHANOL-MEDIATED EXPERIENCIES.

Este plan de trabajos es continuidad de una línea de investigación centrada en evaluar los mecanismos responsables de la adquisición, expresión y persistencia de experiencias con el etanol. A partir de ello, indagar acerca de los efectos de esta experiencia sobre comportamientos de búsqueda y autoadministración de etanol en neonatos e infantes de rata. Se pretende analizar la participación del sistema opiáceo en los mecanismos implicados en una memoria fetal y/o infantil, generada como consecuencia de la exposición etílica. En una primera etapa, nos proponemos establecer de qué manera experiencias prenatales con la droga modulan el patrón de auto-administración de alcohol y otros reforzadores, como sacarosa. En este primer bloque de experimentos realizaremos manipulaciones fetales para determinar con mayor grado de especificidad la posible acción del sistema opiáceo en los mecanismos de adquisición de una memoria etílica prenatal. Se realizarán administraciones de etanol y el antagonista opiáceo, directamente a nivel fetal, y se evaluará esta experiencia en un paradigma de condicionamiento neonatal positivo, mediado por la droga. De acuerdo a la evidencia previa, esperamos que la exposición prenatal con la droga facilite la expresión de conductas de consumo y búsqueda del etanol o hacia las claves que señalizan al psicotrópico, tanto durante la infancia como en el neonato. A su vez, cuando la droga es presentada bajo los efectos de un antagonista opiáceo esperamos que estas conductas muestren un perfil similar a las desplegadas por sujetos controles. El segundo bloque de experimentos ha sido ideado con el objeto de indagar acerca de la posible participación del sistema opiáceo en la modulación de los aspectos reforzantes de la droga, a través de un esquema de auto-administración etílica infantil. Se utilizará un paradigma de condicionamiento instrumental adaptado para ratas infantes que consta de dos instancias, una de adquisición de la conducta instrumental (DPs 14-17) en la cual los animales reciben un pulso de refuerzo, como consecuencia de la ejecución de la conducta operante. En una segunda fase se analiza el patrón de búsqueda del reforzador ya que se registra la respuesta instrumental, sin que ocurra el refuerzo por la misma. Para analizar la participación del sistema opiáceo, durante la fase de adquisición de la conducta operante (DPs 16 y 17) los animales serán re-expuestos a mínimas cantidades del reforzador, bajo los efectos de un antagonista opiáceo, momentos previos al ensayo instrumental correspondiente para cada uno de estos días (Exp. 3). Esperamos que el bloqueo del sistema opiáceo, durante esta re-exposición al etanol, sea suficiente para disminuir el patrón de respuesta instrumental hacia el refuerzo etílico. Un último experimento incorporará un tercer evento de re-exposición al etanol -bajo los efectos del antagonista- previo al ensayo de extinción de la conducta instrumental (DP 18). Este nuevo evento tiene por objeto analizar la participación de este sistema neurobiológico en los mecanismos de búsqueda de etanol. Si el sistema opiáceo participa en la modulación de patrones tanto de búsqueda como consumatorios del reforzamiento por etanol, se espera que la re-exposición a la droga bajo los efectos del antagonista, inhiba estas respuestas tanto durante la sesión de adquisición, como de extinción de la conducta operante. Este proyecto intenta profundizar en el conocimiento de los mecanismos que regulan reconocimiento, aceptación, búsqueda y consumo de etanol, como consecuencia de experiencias tempranas con la droga. A su vez, es importante identificar y estudiar los sistemas neurobiológicos involucrados en estos mecanismos. Es por ello que se intenta determinar el rol que ejerce el sistema opiáceo en la adquisición de estas experiencias etílicas a nivel fetal e infantil, que se conoce promueven la búsqueda y el consumo de la droga. Our work is directed to analyze the involvement of the opioid system in the generation of pre- and early postnatal ethanol-related memories. As a first step, maternal manipulations with ethanol will be done. Infants will be evaluated in a paradigm of infantile self-administration of different reinforcers (ethanol, sucrose or water), employing a model of operant conditioning adapted to infant rats. A second experiment will be conducted in order to analyze if a central administration of ethanol, directly to the fetus, modifies subsequent patterns of neonatal conditioned responses to an artificial nipple, mediated by ethanol reinforcing effects. Fetal presentation of ethanol will be accompanied with the injection of an opioid antagonist in order to analyze the involvement of this system in acquisition processes of a fetal ethanol-mediated memory. A second set of studies will be conducted to analyze appetitive and consummatory behaviors in an infant model of ethanol self-administration. Involvement of opioid system in the acquisition or expression of this experience will be also inquired. Infant rats (PDs14-17) have to display a target behavior (nose-poke) to gain access to 5% sucrose or 3.75% ethanol. On PD18 an extinction session will be included. At PDs16-17, 6-hr before training, pups will be re-exposed to ethanol under opioid antagonism effects (naloxone). In a follow up experiment, a re-exposure trial will be included at PD18. Prior extinction, pups will receive naloxone and will be re-exposed to ethanol. We aim to observe if opioid system is modulating etha¬nol reinforcing effects, in terms of both appetitive and consummatory behaviors.

Evidence for a compulsive-like behavior in rats exposed to alternate access to highly preferred palatable food.

Converging evidence suggests that recurrent excessive calorie restriction causes binge eating by promoting behavioral disinhibition and overeating. This interpretation suggests that cognitive adaptations may surpass physiological regulations of metabolic needs after recurrent cycles of dieting and binging. Intermittent access to palatable food has long been studied in rats, but the consequences of such diet cycling procedures on the cognitive control of food seeking remain unclear. Female Wistar rats were divided in two groups matched for food intake and body weight. One group received standard chow pellets 7 days/week, whereas the second group was given chow pellets for 5 days and palatable food for 2 days over seven consecutive weeks. Rats were also trained for operant conditioning. Intermittent access to palatable food elicited binging behavior and reduced intake of normal food. Rats with intermittent access to palatable food failed to exhibit anxiety-like behaviors in the elevated plus maze, but displayed reduced locomotor activity in the open field and developed a blunted corticosterone response following an acute stress across the diet procedure. Trained under a progressive ratio schedule, both groups exhibited the same motivation for sweetened food pellets. However, in contrast to controls, rats with a history of dieting and binging exhibited a persistent compulsive-like behavior when access to preferred pellets was paired with mild electrical foot shock punishments. These results highlight the intricate development of anxiety-like disorders and cognitive deficits leading to a loss of control over preferred food intake after repetitive cycles of intermittent access to palatable food.

DWI and complex brain network analysis predicts vascular cognitive impairment in spontaneous hypertensive rats undergoing executive function tests

The identification of biomarkers of vascular cognitive impairment is urgent for its early diagnosis. The aim of this study was to detect and monitor changes in brain structure and connectivity, and to correlate them with the decline in executive function. We examined the feasibility of early diagnostic magnetic resonance imaging (MRI) to predict cognitive impairment before onset in an animal model of chronic hypertension: Spontaneously Hypertensive Rats. Cognitive performance was tested in an operant conditioning paradigm that evaluated learning, memory, and behavioral flexibility skills. Behavioral tests were coupled with longitudinal diffusion weighted imaging acquired with 126 diffusion gradient directions and 0.3 mm(3) isometric resolution at 10, 14, 18, 22, 26, and 40 weeks after birth. Diffusion weighted imaging was analyzed in two different ways, by regional characterization of diffusion tensor imaging (DTI) indices, and by assessing changes in structural brain network organization based on Q-Ball tractography. Already at the first evaluated times, DTI scalar maps revealed significant differences in many regions, suggesting loss of integrity in white and gray matter of spontaneously hypertensive rats when compared to normotensive control rats. In addition, graph theory analysis of the structural brain network demonstrated a significant decrease of hierarchical modularity, global and local efficacy, with predictive value as shown by regional three-fold cross validation study. Moreover, these decreases were significantly correlated with the behavioral performance deficits observed at subsequent time points, suggesting that the diffusion weighted imaging and connectivity studies can unravel neuroimaging alterations even overt signs of cognitive impairment become apparent.

Perturbing the impulse activity of a single identified neuron augments the formation of long-term memory in a molluscan semi-intact preparation /

The aim of this study was to investigate the neural correlates of operant conditioning in a semi-intact preparation of the pond snail, Lymnaea stagnalis. Lymnaea learns, via operant conditioning, to reduce its aerial respiratory behaviour in response to an aversive tactile stimulus to its open pneumostome. This thesis demonstrates the successful conditioning of na'ive semiintact preparations to show learning in the dish. Furthermore, these conditioned preparations show long-term memory that persists for at least 18 hours. As the neurons that generate this behaviour have been previously identified I can, for the first time, monitor neural activity during both learning and long-term memory consolidation in the same preparation. In particular, I record from the respiratory neuron Right Pedal Dorsal 1 (RPeD 1) which is part of the respiratory central pattern generator. In this study, I demonstrate that preventing RPeDl impulse activity between training sessions reduces the number of sessions needed to produce long-term memory in the present semi-intact preparation.

The role of retinoic acid in long-term memory formation and synaptic plasticity in the mollusc Lymnaea stagnalis

The active metabolite of vitamin A, retinoic acid (RA), is involved in memory formation and hippocampal plasticity in vertebrates. A similar role for retinoid signaling in learning and memory formation has not previously been examined in an invertebrate species. However, the conservation of retinoid signaling between vertebrates and invertebrates is supported by the presence of retinoid signaling machinery in invertebrates. For example, in the mollusc Lymnaea stagnalis the metabolic enzymes and retinoid receptors have been cloned from the CNS. In this study I demonstrated that impairing retinoid signaling in Lymnaea by either inhibiting RALDH activity or using retinoid receptor antagonists, prevented the formation of long-term memory (LTM). However, learning and intermediate-term memory were not affected. An additional finding was that exposure to constant darkness (due to the light-sensitive nature of RA) itself enhanced memory formation. This memory-promoting effect of darkness was sufficient to overcome the inhibitory effects of RALDH inhibition, but not that of a retinoid receptor antagonist, suggesting that environmental light conditions may influence retinoid signaling. Since RA also influences synaptic plasticity underlying hippocampal-dependent memory formation, I also examined whether RA would act in a trophic manner to influence synapse formation and/or synaptic transmission between invertebrate neurons. However, I found no evidence to support an effect of RA on post-tetanic potentiation of a chemical synapse. Retinoic acid did, however, reduce transmission at electrical synapses in a cell-specific manner. Overall, these studies provide the first evidence for a role of RA in the formation of implicit long-term memories in an invertebrate species and suggest that the role of retinoid signaling in memory formation has an ancient origin.