Behavioural and neural correlates of operant conditioning in Lymnaea stagnalis : role of previous experience during development /

The freshwater mollusc Lymnaea stagnalis was utilized in this study to further the understanding of how network properties change as a result of associative learning, and to determine whether or not this plasticity is dependent on previous experience during development. The respiratory and neural correlates of operant conditioning were first determined in normally reared Lymnaea. The same procedure was then applied to differentially reared Lymnaea, that is, animals that had never experienced aerial respiration during their development. The aim was to determine whether these animals would demonstrate the same responses to the training paradigm. In normally reared animals, a behavioural reduction in aerial respiration was accompanied by numerous changes within the neural network. Specifically, I provide evidence of changes at the level of the respiratory central pattern generator and the motor output. In the differentially reared animals, there was little behavioural data to suggest learning and memory. There were, however, significant differences in the network parameters, similar to those observed in normally reared animals. This demonstrated an effect of operant conditioning on differentially reared animals. In this thesis, I have identified additional correlates of operant conditioning in normally reared animals and provide evidence of associative learning in differentially reared animals. I conclude plasticity is not dependent on previous experience, but is rather ontogenetically programmed within the neural network.

Operant conditioning of H-reflex changes synaptic terminals on primate motoneurons.

Operant conditioning of the primate triceps surae H-reflex, the electrical analog of the spinal stretch reflex, creates a memory trace that includes changes in the spinal cord. To define the morphological correlates of this plasticity, we analyzed the synaptic terminal coverage of triceps surae motoneurons from animals in which the triceps surae H-reflex in one leg had been increased (HRup mode) or decreased (HRdown mode) by conditioning and compared them to each other and to motoneurons from unconditioned animals. Motoneurons were labeled by intramuscular injection of cholera toxin-horseradish peroxidase. A total of 5055 terminals on the cell bodies and proximal dendrites of 114 motoneurons from 14 animals were studied by electron microscopy. Significant differences were found between HRup and HRdown animals and between HRup and naive (i.e., unconditioned) animals. F terminals (i.e., putative inhibitory terminals) were smaller and their active zone coverage on the cell body was lower on motoneurons from the conditioned side of HRup animals than on motoneurons from the conditioned side of HRdown animals. C terminals (i.e., terminals associated with postsynaptic cisterns and rough endoplasmic reticulum) were smaller and the number of C terminals in each C complex (i.e., a group of contiguous C terminals) was larger on motoneurons from the conditioned side of HRup animals than on motoneurons either from the conditioned side of HRdown animals or from naive animals. Because the treatment of HRup and HRdown animals differed only in the reward contingency, the results imply that the two contingencies had different effects on motoneuron synaptic terminals. In combination with other recent data, they show that H-reflex conditioning produces a complex pattern of spinal cord plasticity that includes changes in motoneuron physiological properties as well as in synaptic terminals. Further delineation of this pattern should reveal the contribution of the structural changes described here to the learned change in behavior.

Types and amplitudes of touch as reinforcing stimuli in operant conditioning of infant behavior

The reinforcing effects of diverse tactile stimuli were examined in this study. The study had two purposes. First, this study expanded on the Pelaez-Nogueras, Field, Gewirtz, Cigales, Gonzalez, Sanchez and Clasky (1997) finding that stroking increases infants' gaze duration, and smiling and vocalization frequencies more than tickling/poking. Instead of presenting poking and tickling as a single stimulus combination, this study separated poking and tickling in order to measure the effects of each component separately. Further, the effects of poking, tickling/tapping and stroking intensity (i.e., tactile pressure) were compared by having both mild and intense conditions. Second, this study compared the reinforcing efficacy of mother-delivered tactile stimulation to that of infant-originated tactile exploration. Twelve infants from 2- to 5-months of age participated in this study. The experiment was conducted using a repeated measures A-B-A-C-A-D reversal design. The A phases signified baselines and reversals. The B, C, and D phases consisted of alternating treatments (either mild stroking vs. mild poking vs. mild tickling/tapping, intense stroking vs. intense poking vs. intense tickling/tapping, or mother-delivered tactile stimulation vs. infant-originated tactile exploration). Three experimental hypotheses were assessed: (1) infant leg kick rate would be greater when it produced stroking or tickling/tapping (presumptive positive reinforcers), than when it produced poking (a possible punisher), regardless of tactile pressure; (2) infant leg kick rate would be greater when it produced a more intense level of stroking or tickling/tapping and lower when it produced intense poking compared to mild poking; (3) infant leg-kick rate would be greater for mother-delivered tactile stimulation than for infant-originated tactile exploration. Visual inspection and inferential statistical methods were used to analyze the results. The data supported the first two hypotheses. Mixed support emerged for the third hypothesis. This study made several important contributions to the field of psychology. First, this was the first study to quantify the pressure of tactile stimulation, via a pressure meter developed by the researcher. Additionally, the results of this study yielded valuable information about the effects of different modalities of touch. ^

Extending in vitro conditioning in Aplysia to analyze operant and classical processes in the same preparation.

Operant and classical conditioning are major processes shaping behavioral responses in all animals. Although the understanding of the mechanisms of classical conditioning has expanded significantly, the understanding of the mechanisms of operant conditioning is more limited. Recent developments in Aplysia are helping to narrow the gap in the level of understanding between operant and classical conditioning, and have raised the possibility of studying the neuronal processes underlying the interaction of operant and classical components in a relatively complex learning task. In the present study, we describe a first step toward realizing this goal, by developing a single in vitro preparation in which both operant and classical conditioning can be studied concurrently. The new paradigm reproduced previously published results, even under more conservative and homogenous selection criteria and tonic stimulation regime. Moreover, the observed learning was resistant to delay, shortening, and signaling of reinforcement.

Cellular mechanisms of operant and classical conditioning

The ability to associate a predictive stimulus with a subsequent salient event (i.e., classical conditioning) and the ability to associate an expressed behavior with the consequences (i.e., operant conditioning) allow for a predictive understanding of a changing environment. Although they are operationally distinct, there has been considerable debate whether at some fundamental level classical and operant conditioning are mechanistically distinct or similar. Feeding behavior of Aplysia (i.e., biting) was chosen as the model system and was successfully conditioned with appetitive forms of both operant and classical conditioning. The neuronal circuitry responsible for feeding is well understood and is suitable for cellular analyses, thus providing for a mechanistic comparison between these two forms of associative learning. ^ Neuron B51 is part of the feeding circuitry of Aplysia and is critical for the expression of ingestive behaviors. B51 also is a locus of plasticity following both operant and classical conditioning. Both in vivo and in vitro operant conditioning increased the input resistance and the excitability of B51. No pairing-specific changes in the input resistance were observed following both in vivo and in vitro classical conditioning. However, classical conditioning decreased the excitability of B51. Thus, both operant and classical conditioning modified the threshold level for activation of neuron B51, but in opposite directions, revealing key differences in the cellular mechanisms underlying these two forms of associative learning. ^ Next, the cellular mechanisms underlying operant conditioning were investigated in more detail using a single-cell analogue. The single-cell analogue successfully recapitulated the previous in vivo and in vitro operant conditioning results by increasing the input resistance and the excitability of B51. Both PKA and PKC were necessary for operant conditioning. Dopamine appears to be the transmitter mediating the reinforcement signal in this form of conditioning. A D1 dopamine receptor antibody revealed that the D1receptor localizes to the axon hillock, which is also the region that gives the strongest response when iontophoresing dopamine. ^ The studies presented herein, thus, provide for a greater understanding of the mechanisms underlying both of these forms of associative learning and demonstrate that they likely operate through distinct cellular mechanisms. ^

Effects of drugs that potentiate GABA on extinction of positively-reinforced operant behaviour

Extinction following positively reinforced operant conditioning reduces response frequency, at least in part through the aversive or frustrative effects of non-reinforcement. According to J.A. Gray's theory, non-reinforcement activates the behavioural inhibition system which in turn causes anxiety. As predicted, anxiolytic drugs including benzodiazepines affect the operant extinction process. Recent studies have shown that reducing GABA-mediated neurotransmission retards extinction of aversive conditioning. We have shown in a series of studies that anxiolytic compounds that potentiate GABA facilitate extinction of positively reinforced fixed-ratio operant behaviour in C57B1/6 male mice. This effect does not occur in the early stages of extinction, nor is it dependent on cumulative effects of the compound administered. Potentiation of GABA at later stages has the effect of increasing sensitivity to the extinction contingency and facilitates the inhibition of the behaviour that is no longer required. The GABAergic hypnotic, zolpidem, has the same selective effects on operant extinction in this procedure. The effects of zolpidem are not due to sedative action. There is evidence across our series of experiments that different GABA-A subtype receptors are involved in extinction facilitation and anxiolysis. Consequently, this procedure may not be an appropriate model for anxiolytic drug action, but it may be a useful technique for analysing the neural bases of extinction and designing therapeutic interventions in humans where failure to extinguish inappropriate behaviours can lead to pathological conditions such as post-traumatic stress disorder.

Molecular mechanisms underlying a cellular analog of operant reward learning.

Operant conditioning is a ubiquitous but mechanistically poorly understood form of associative learning in which an animal learns the consequences of its behavior. Using a single-cell analog of operant conditioning in neuron B51 of Aplysia, we examined second-messenger pathways engaged by activity and reward and how they may provide a biochemical association underlying operant learning. Conditioning was blocked by Rp-cAMP, a peptide inhibitor of PKA, a PKC inhibitor, and by expressing a dominant-negative isoform of Ca2+-dependent PKC (apl-I). Thus, both PKA and PKC were necessary for operant conditioning. Injection of cAMP into B51 mimicked the effects of operant conditioning. Activation of PKC also mimicked conditioning but was dependent on both cAMP and PKA, suggesting that PKC acted at some point upstream of PKA activation. Our results demonstrate how these molecules can interact to mediate operant conditioning in an individual neuron important for the expression of the conditioned behavior.

阿片药物依赖的神经机制---内侧前额叶与药物的心理依赖

Mental dependence, characterized by craving and impulsive seeking behavior, is the matter of intensive study in the field of drug addiction. The mesolimbic dopamine system has been suggested to play an important role in rewarding of drugs and relapse. Although chronic drug use can induce neuroadaptations of the mesolimbic system and changes of drug reinforcement, these mechanisms cannot fully account for the craving and the compulsive drug-using behavior of addicts. Acknowledging the reinforcement effects of drugs, most previous studies have studied the impact of environmental cues and conditioned learning on addiction behavior, often using established classical or operant conditioning model. These studies, however, paid little attention to the role of cognitive control and emotion in addiction. These mental factors that are believed to have an important influence on conditioned learning. The medial prefrontal cortex (mPFC) has close anatomic and functional connections with the mesolimbic dopamine system. A number of the cognitive neurological studies demonstrate that mPFC is involved in motivation, emotional regulation, monitoring of responses and other executive functions. Thus we speculated that the function of abnormality in mPFC following chronic drug use would cause related to the abnormal behavior in addicts including impulse and emotional changes. In the present study of a series of experiments, we used functional magnetic resonance imaging to examine the hemodynamic response of the mPFC and related circuits to various cognitive and emotional stimuli in heroin addicts and to explore the underlying dopamine neuromechnism by microinjection of tool drugs into the mPFC in laboratory animals. In the first experiment, we found that heroin patients, relative to the normal controls, took a much shorter time and committed more errors in completing the more demanding of cognitive regulation in the reverse condition of the task, while the neural activity in anterior cingulate cortex (ACC) was attenuated. In the second experiment, the scores of the heroin patients in self-rating depression scale (SDS) and Self-rating anxiety scale (SAS) were significantly higher than the normal controls and they rated the negative pictures more aversive than the normal controls. Being congruent with the behavioral results, hemodynamic response to negative pictures showed significant difference between the two groups in bilateral ventral mPFC (VMPFC), amygdala, and right thalamus. The VMPFC of patients showed increased activation than normal controls, whereas activation in the amygdala of patients was weaker than that in normal subjects. Our third experiment showed that microinjection of D1 receptor agonist SKF38393 into the mPFC of rats decreased hyperactivity, which was induced by morphine injection, in contrast, D1 receptor antagonist SCH23390 increased the hyperactivity, These findings suggest: (1) The behavior and neural activity in ACC of addicts changed in chronic drug users. Their impulsive behavior might result from the abnormal neural activity in the mPFC especially the ACC. (2) Heroine patients were more depress and anxiety than normal controls. The dysfunction of the mPFC---amygdala circuit of heroine addicts might be related to the abnormal emotion response. (3) Dopamine in the mPFC has an inhibitory effect on morphine induced behavior. The hyperactivity induced by chronic morphine was reduced by dopamine increase with D1 receptor agonist, confirm the first experiment that the neuroadaption of mPFC system induced by chronic morphine administration appears to be the substrate the impulse behavior of drug users.

Perturbing the impulse activity of a single identified neuron augments the formation of long-term memory in a molluscan semi-intact preparation /

The aim of this study was to investigate the neural correlates of operant conditioning in a semi-intact preparation of the pond snail, Lymnaea stagnalis. Lymnaea learns, via operant conditioning, to reduce its aerial respiratory behaviour in response to an aversive tactile stimulus to its open pneumostome. This thesis demonstrates the successful conditioning of na'ive semiintact preparations to show learning in the dish. Furthermore, these conditioned preparations show long-term memory that persists for at least 18 hours. As the neurons that generate this behaviour have been previously identified I can, for the first time, monitor neural activity during both learning and long-term memory consolidation in the same preparation. In particular, I record from the respiratory neuron Right Pedal Dorsal 1 (RPeD 1) which is part of the respiratory central pattern generator. In this study, I demonstrate that preventing RPeDl impulse activity between training sessions reduces the number of sessions needed to produce long-term memory in the present semi-intact preparation.

The role of retinoic acid in long-term memory formation and synaptic plasticity in the mollusc Lymnaea stagnalis

The active metabolite of vitamin A, retinoic acid (RA), is involved in memory formation and hippocampal plasticity in vertebrates. A similar role for retinoid signaling in learning and memory formation has not previously been examined in an invertebrate species. However, the conservation of retinoid signaling between vertebrates and invertebrates is supported by the presence of retinoid signaling machinery in invertebrates. For example, in the mollusc Lymnaea stagnalis the metabolic enzymes and retinoid receptors have been cloned from the CNS. In this study I demonstrated that impairing retinoid signaling in Lymnaea by either inhibiting RALDH activity or using retinoid receptor antagonists, prevented the formation of long-term memory (LTM). However, learning and intermediate-term memory were not affected. An additional finding was that exposure to constant darkness (due to the light-sensitive nature of RA) itself enhanced memory formation. This memory-promoting effect of darkness was sufficient to overcome the inhibitory effects of RALDH inhibition, but not that of a retinoid receptor antagonist, suggesting that environmental light conditions may influence retinoid signaling. Since RA also influences synaptic plasticity underlying hippocampal-dependent memory formation, I also examined whether RA would act in a trophic manner to influence synapse formation and/or synaptic transmission between invertebrate neurons. However, I found no evidence to support an effect of RA on post-tetanic potentiation of a chemical synapse. Retinoic acid did, however, reduce transmission at electrical synapses in a cell-specific manner. Overall, these studies provide the first evidence for a role of RA in the formation of implicit long-term memories in an invertebrate species and suggest that the role of retinoid signaling in memory formation has an ancient origin.

Évaluation de l’effet du neurofeedback sur les capacités d’inhibition d’enfants ayant un Trouble déficitaire de l’attention avec hyperactivité

Le neurofeedback (NF) suscite actuellement un vif intérêt dans la prise en charge du trouble déficitaire de l’attention avec hyperactivité (TDAH) chez l’enfant. Proposée comme méthode alternative à la médication par de nombreux cliniciens, notamment aux États-Unis, le NF est une intervention non-invasive de type électrophysiologique qui repose sur l’apprentissage par conditionnement opérant de l’autorégulation d’ondes cérébrales déviantes. Les études empiriques qui étayent cette pratique font toutefois l’objet de virulentes critiques de la part de spécialistes dans le domaine du TDAH en raison de résultats systématiquement positifs mais non spécifiques, auxquels s’ajoutent de nombreuses lacunes méthodologiques. Les travaux de cette thèse visent à appliquer une méthodologie stricte de type essai clinique contrôlé avec assignation aléatoire afin d’isoler les effets particuliers du NF, en appliquant un protocole d’entraînement propre au déficit primaire sous-tendant le TDAH, soit l’inhibition motrice, dans le but d’évaluer la spécificité de cette intervention. Dans un premier temps, les connaissances relatives à la nosologie du TDAH, à ses principaux traitements, au NF et aux capacités d’inhibition chez l’enfant ayant un TDAH sont présentées (Chapitre 1). Ensuite, les études réalisées dans le cadre de cette thèse sont exposées. Dans l’étude initiale, la spécificité du NF est évaluée sur les capacités d’inhibition grâce à des mesures subjectives, soit des questionnaires de comportements complétés par les parents, ainsi que des mesures objectives, à savoir des tâches neuropsychologiques (Chapitre 2). Afin de préciser davantage les conséquences d’un entraînement à l’autorégulation d’ondes cérébrales, l’étude subséquente s’est intéressée à l’impact neurophysiologiques de l’amélioration des capacités d’inhibition, par le biais d’une étude en potentiels évoqués employant une tâche de performance continue de type Stop-signal (Chapitre 3). Les principaux résultats reflètent un recrutement sous optimal, avec une puissance statistique insuffisante pour réaliser des statistiques quantitatives de groupe. Néanmoins, l’appréciation des données selon une approche d’étude de cas multiples permet de mettre en évidence la présence d’une réponse placebo sur les capacités d’inhibition suite à un entraînement en NF. Finalement, les implications de la taille de l’échantillon, ainsi que les limites et les critiques de ces études sont discutées au Chapitre 4.

An Introduction to Behaviour Analysis

Behaviour Analysis is a distinct philospophy of science. Individuals new to the approach often find difficulty in understanding the basic principles involved. This presentation, aimed at Final Year undergraduates, is designed to provide an introduction to the principles of operant conditioning (e.g., reinforcement, punishment, and extinction), making clear that these words describe functional, rather than structural, relations.

Efectividad del tratamiento con neurofeedback en trastornos del estado del ánimo, ansiedad y fibromialgia: una revisión de literatura

El neurofeedback es una técnica no invasiva en la que se pretende corregir, mediante condicionamiento operante, ondas cerebrales que se encuentren alteradas en el electroencefalograma. Desde 1967, se han conducido numerosas investigaciones relacionadas con los efectos de la técnica en el tratamiento de alteraciones psicológicas. Sin embargo, a la fecha no existen revisiones sistemáticas que reúnan los temas que serán aquí tratados. El aporte de este trabajo es la revisión de 56 artículos, publicados entre los años 1995 y 2013 y la evaluación metodológica de 29 estudios incluidos en la revisión. La búsqueda fue acotada a la efectividad del neurofeedback en el tratamiento de depresión, ansiedad, trastorno obsesivo compulsivo (TOC), ira y fibromialgia. Los hallazgos demuestran que el neurofeedback ha tenido resultados positivos en el tratamiento de estos trastornos, sin embargo, es una técnica que aún está en desarrollo, con unas bases teóricas no muy bien establecidas y cuyos resultados necesitan de diseños metodológicamente más sólidos que ratifiquen su validez.

Cross-situational and supervised learning in the emergence of communication

Scenarios for the emergence or bootstrap of a lexicon involve the repeated interaction between at least two agents who must reach a consensus on how to name N objects using H words. Here we consider minimal models of two types of learning algorithms: cross-situational learning, in which the individuals determine the meaning of a word by looking for something in common across all observed uses of that word, and supervised operant conditioning learning, in which there is strong feedback between individuals about the intended meaning of the words. Despite the stark differences between these learning schemes, we show that they yield the same communication accuracy in the limits of large N and H, which coincides with the result of the classical occupancy problem of randomly assigning N objects to H words.

Elevers läsvanor : En kvalitativ studie av fyra fordonselevers läsvanor

The following study was conducted at an upper secondary school in Sweden and attempts to explore the question of what influences male pupils’ reading habits. Many quantitative international studies, including PISA, PIRLS and IEA Reading Literacy, have sought to answer this question, but only partially succeeded due to the limitations of their methods. Therefore, this study seeks to explore this question in more depth using qualitative methods, including interviews and classroom observations, but also minor tests. Two facts which the previously mentioned international studies have found is that boys and particularly immigrant boys tend to have worse reading results than their counterparts. It is therefore the aim of this study to study four male students in upper secondary school; of which two are native Swedes and the other two are unaccompanied refugee children; one from Afghanistan and the other from Morocco. The findings of this study are as follows. Firstly, necessity was found to be the single most important factor for the reading habits of these four pupils; especially the two refugees. Both refugees learnt to read under harsh circumstances in madrassas in their respective home countries. Moreover, the Moroccan pupil learnt to speak and read Spanish fluently during his seven years as a homeless child. Furthermore, in the absence of necessity, interest was found to be decisive in determining the pupils’ reading habits. In addition to this, the study theorizes that an interest in reading generally arises before the ability to read and not vice versa. However, teachers can in fact affect their pupils’ reading habits even in upper secondary school.