Extending in vitro conditioning in Aplysia to analyze operant and classical processes in the same preparation.

Operant and classical conditioning are major processes shaping behavioral responses in all animals. Although the understanding of the mechanisms of classical conditioning has expanded significantly, the understanding of the mechanisms of operant conditioning is more limited. Recent developments in Aplysia are helping to narrow the gap in the level of understanding between operant and classical conditioning, and have raised the possibility of studying the neuronal processes underlying the interaction of operant and classical components in a relatively complex learning task. In the present study, we describe a first step toward realizing this goal, by developing a single in vitro preparation in which both operant and classical conditioning can be studied concurrently. The new paradigm reproduced previously published results, even under more conservative and homogenous selection criteria and tonic stimulation regime. Moreover, the observed learning was resistant to delay, shortening, and signaling of reinforcement.

Molecular mechanisms underlying a cellular analog of operant reward learning.

Operant conditioning is a ubiquitous but mechanistically poorly understood form of associative learning in which an animal learns the consequences of its behavior. Using a single-cell analog of operant conditioning in neuron B51 of Aplysia, we examined second-messenger pathways engaged by activity and reward and how they may provide a biochemical association underlying operant learning. Conditioning was blocked by Rp-cAMP, a peptide inhibitor of PKA, a PKC inhibitor, and by expressing a dominant-negative isoform of Ca2+-dependent PKC (apl-I). Thus, both PKA and PKC were necessary for operant conditioning. Injection of cAMP into B51 mimicked the effects of operant conditioning. Activation of PKC also mimicked conditioning but was dependent on both cAMP and PKA, suggesting that PKC acted at some point upstream of PKA activation. Our results demonstrate how these molecules can interact to mediate operant conditioning in an individual neuron important for the expression of the conditioned behavior.

Operant and Respondent Procedures to Establish Social Stimuli as Reinforcers in Children with Autism

According to the DSM-IV- TR (American Psychiatric Association, 2000), one of the core deficits in autism is in the impairment of social interaction. Some have suggested that underlying these deficits is the reality that individuals with autism do not find social stimuli to be as reinforcing as other types of stimuli (Dawson, 2008). An interesting and growing body of literature supports the notion that symptoms in autism may be caused by a general reduction in social motivation (Chevallier et al., 2012). A review of the literature suggests that social orienting and social motivation are low in individuals with autism, and including social motivation as a target for therapeutic intervention should be pursued (Helt et al., 2008). Through our understanding of learning processes, researchers in behavior analysis and related fields have been able to use conditioning procedures to change the function of neutral or ineffective stimuli, including tokens (Ayllon & Azrin, 1968), facial expressions (Gewirtz & Pelaez-Nogueras, 1992) and praise (Dozier et al., 2012). The current study aimed to use operant and respondent procedures to condition social stimuli that were empirically shown to not be reinforcing prior to conditioning. Further, this study aimed to compare the two procedures in their effectiveness to condition social stimuli to function as reinforcers, and in their maintenance of effects over time. Using a multiple-baseline, multi-element design, one social stimulus was conditioned under each procedure to compare the different response rates following conditioning. Finally, the study sought to determine if conditioning social stimuli to function as reinforcers had any effect on the social functioning of young children with autism. Six children diagnosed with autism between the ages of 18 months and 3 years participated. Results show that the respondent procedure (pairing) resulted in more robust and enduring effects than the operant procedure (Sd procedure). Results of a social communication assessment (ESCS, Mundy et al., 2003) before and after conditioning demonstrate gains in all areas of social communication, particularly in the areas of initiating and responding to joint attention.

The administration of atomoxetine during alcohol deprivation induces a time-limited increase in alcohol consumption after relapse.

The administration of selective serotonin reuptake inhibitors (SSRIs) typically used as antidepressants increases alcohol consumption after an alcohol deprivation period in rats. However, the appearance of this effect after the treatment with selective noradrenaline reuptake inhibitors (SNRIs) has not been studied. In the present work we examined the effects of a 15-d treatment with the SNRI atomoxetine (1, 3 and 10 mg/kg, i.p.) in male rats trained to drink alcohol solutions in a 4-bottle choice test. The treatment with atomoxetine (10 mg/kg, i.p.) during an alcohol deprivation period increased alcohol consumption after relapse. This effect only lasted one week, disappearing thereafter. Treatment with atomoxetine did not cause a behavioral sensitized response to a challenge dose of amphetamine (1.5 mg/kg, i.p.), indicating the absence of a supersensitive dopaminergic transmission. This effect is markedly different from that of SSRI antidepressants that produced both long-lasting increases in alcohol consumption and behavioral sensitization. Clinical implications are discussed.

Reinforcing properties of fencamfamine: Involvement of dopamine and opioid receptors

Fencamfamine (FCF) is a psychostimulant classified as an indirect dopamine agonist. The conditioning place preference (CPP) paradigm was used to investigate the reinforcing properties of FCF. After initial preferences had been determined, animals were conditioned with FCF (1.75, 3.5, or 7.0 mg/kg; IP). Only at the dose of 3.5 mg/kg FCF produced a significant place preference. Pretreatment with SCH23390 (0.05 mg/kg, SC) or naloxone (1.0 mg/kg SC) 10 min before FCF (3.5 mg/kg; IP) blocked both FCF-induced hyperactivity and CPP. Pretreatment with metoclopramide (10.0 mg/kg; IP) or pimozide (1.0 mg/kg, IP), respectively, 30 min or 4 h before FCF (3.5 mg/kg; IP), which blocked the FCF-induced locomotor activity, failed to influence place conditioning produced by FCF. In conclusion, the present study suggests that dopamine D 1 and opioid receptors are related to FCF reinforcing effect, while dopamine D 2 subtype receptor was ineffective in modifying FCF-induced CPP.

Behavioural and neural correlates of operant conditioning in Lymnaea stagnalis : role of previous experience during development /

The freshwater mollusc Lymnaea stagnalis was utilized in this study to further the understanding of how network properties change as a result of associative learning, and to determine whether or not this plasticity is dependent on previous experience during development. The respiratory and neural correlates of operant conditioning were first determined in normally reared Lymnaea. The same procedure was then applied to differentially reared Lymnaea, that is, animals that had never experienced aerial respiration during their development. The aim was to determine whether these animals would demonstrate the same responses to the training paradigm. In normally reared animals, a behavioural reduction in aerial respiration was accompanied by numerous changes within the neural network. Specifically, I provide evidence of changes at the level of the respiratory central pattern generator and the motor output. In the differentially reared animals, there was little behavioural data to suggest learning and memory. There were, however, significant differences in the network parameters, similar to those observed in normally reared animals. This demonstrated an effect of operant conditioning on differentially reared animals. In this thesis, I have identified additional correlates of operant conditioning in normally reared animals and provide evidence of associative learning in differentially reared animals. I conclude plasticity is not dependent on previous experience, but is rather ontogenetically programmed within the neural network.

Cellular mechanisms of operant and classical conditioning

The ability to associate a predictive stimulus with a subsequent salient event (i.e., classical conditioning) and the ability to associate an expressed behavior with the consequences (i.e., operant conditioning) allow for a predictive understanding of a changing environment. Although they are operationally distinct, there has been considerable debate whether at some fundamental level classical and operant conditioning are mechanistically distinct or similar. Feeding behavior of Aplysia (i.e., biting) was chosen as the model system and was successfully conditioned with appetitive forms of both operant and classical conditioning. The neuronal circuitry responsible for feeding is well understood and is suitable for cellular analyses, thus providing for a mechanistic comparison between these two forms of associative learning. ^ Neuron B51 is part of the feeding circuitry of Aplysia and is critical for the expression of ingestive behaviors. B51 also is a locus of plasticity following both operant and classical conditioning. Both in vivo and in vitro operant conditioning increased the input resistance and the excitability of B51. No pairing-specific changes in the input resistance were observed following both in vivo and in vitro classical conditioning. However, classical conditioning decreased the excitability of B51. Thus, both operant and classical conditioning modified the threshold level for activation of neuron B51, but in opposite directions, revealing key differences in the cellular mechanisms underlying these two forms of associative learning. ^ Next, the cellular mechanisms underlying operant conditioning were investigated in more detail using a single-cell analogue. The single-cell analogue successfully recapitulated the previous in vivo and in vitro operant conditioning results by increasing the input resistance and the excitability of B51. Both PKA and PKC were necessary for operant conditioning. Dopamine appears to be the transmitter mediating the reinforcement signal in this form of conditioning. A D1 dopamine receptor antibody revealed that the D1receptor localizes to the axon hillock, which is also the region that gives the strongest response when iontophoresing dopamine. ^ The studies presented herein, thus, provide for a greater understanding of the mechanisms underlying both of these forms of associative learning and demonstrate that they likely operate through distinct cellular mechanisms. ^

Operant conditioning of H-reflex changes synaptic terminals on primate motoneurons.

Operant conditioning of the primate triceps surae H-reflex, the electrical analog of the spinal stretch reflex, creates a memory trace that includes changes in the spinal cord. To define the morphological correlates of this plasticity, we analyzed the synaptic terminal coverage of triceps surae motoneurons from animals in which the triceps surae H-reflex in one leg had been increased (HRup mode) or decreased (HRdown mode) by conditioning and compared them to each other and to motoneurons from unconditioned animals. Motoneurons were labeled by intramuscular injection of cholera toxin-horseradish peroxidase. A total of 5055 terminals on the cell bodies and proximal dendrites of 114 motoneurons from 14 animals were studied by electron microscopy. Significant differences were found between HRup and HRdown animals and between HRup and naive (i.e., unconditioned) animals. F terminals (i.e., putative inhibitory terminals) were smaller and their active zone coverage on the cell body was lower on motoneurons from the conditioned side of HRup animals than on motoneurons from the conditioned side of HRdown animals. C terminals (i.e., terminals associated with postsynaptic cisterns and rough endoplasmic reticulum) were smaller and the number of C terminals in each C complex (i.e., a group of contiguous C terminals) was larger on motoneurons from the conditioned side of HRup animals than on motoneurons either from the conditioned side of HRdown animals or from naive animals. Because the treatment of HRup and HRdown animals differed only in the reward contingency, the results imply that the two contingencies had different effects on motoneuron synaptic terminals. In combination with other recent data, they show that H-reflex conditioning produces a complex pattern of spinal cord plasticity that includes changes in motoneuron physiological properties as well as in synaptic terminals. Further delineation of this pattern should reveal the contribution of the structural changes described here to the learned change in behavior.

Types and amplitudes of touch as reinforcing stimuli in operant conditioning of infant behavior

The reinforcing effects of diverse tactile stimuli were examined in this study. The study had two purposes. First, this study expanded on the Pelaez-Nogueras, Field, Gewirtz, Cigales, Gonzalez, Sanchez and Clasky (1997) finding that stroking increases infants' gaze duration, and smiling and vocalization frequencies more than tickling/poking. Instead of presenting poking and tickling as a single stimulus combination, this study separated poking and tickling in order to measure the effects of each component separately. Further, the effects of poking, tickling/tapping and stroking intensity (i.e., tactile pressure) were compared by having both mild and intense conditions. Second, this study compared the reinforcing efficacy of mother-delivered tactile stimulation to that of infant-originated tactile exploration. Twelve infants from 2- to 5-months of age participated in this study. The experiment was conducted using a repeated measures A-B-A-C-A-D reversal design. The A phases signified baselines and reversals. The B, C, and D phases consisted of alternating treatments (either mild stroking vs. mild poking vs. mild tickling/tapping, intense stroking vs. intense poking vs. intense tickling/tapping, or mother-delivered tactile stimulation vs. infant-originated tactile exploration). Three experimental hypotheses were assessed: (1) infant leg kick rate would be greater when it produced stroking or tickling/tapping (presumptive positive reinforcers), than when it produced poking (a possible punisher), regardless of tactile pressure; (2) infant leg kick rate would be greater when it produced a more intense level of stroking or tickling/tapping and lower when it produced intense poking compared to mild poking; (3) infant leg-kick rate would be greater for mother-delivered tactile stimulation than for infant-originated tactile exploration. Visual inspection and inferential statistical methods were used to analyze the results. The data supported the first two hypotheses. Mixed support emerged for the third hypothesis. This study made several important contributions to the field of psychology. First, this was the first study to quantify the pressure of tactile stimulation, via a pressure meter developed by the researcher. Additionally, the results of this study yielded valuable information about the effects of different modalities of touch. ^

Learning processes and the neural analysis of conditioning

Classical and operant conditioning principles, such as the behavioral discrepancy-derived assumption that reinforcement always selects antecedent stimulus and response relations, have been studied at the neural level, mainly by observing the strengthening of neuronal responses or synaptic connections. A review of the literature on the neural basis of behavior provided extensive scientific data that indicate a synthesis between the two conditioning processes based mainly on stimulus control in learning tasks. The resulting analysis revealed the following aspects. Dopamine acts as a behavioral discrepancy signal in the midbrain pathway of positive reinforcement, leading toward the nucleus accumbens. Dopamine modulates both types of conditioning in the Aplysia mollusk and in mammals. In vivo and in vitro mollusk preparations show convergence of both types of conditioning in the same motor neuron. Frontal cortical neurons are involved in behavioral discrimination in reversal and extinction procedures, and these neurons preferentially deliver glutamate through conditioned stimulus or discriminative stimulus pathways. Discriminative neural responses can reliably precede operant movements and can also be common to stimuli that share complex symbolic relations. The present article discusses convergent and divergent points between conditioning paradigms at the neural level of analysis to advance our knowledge on reinforcement.

Operant serial feature-positive conditional discrimination with composite features and different topography responses

In a serial feature-positive conditional discrimination procedure the properties of a target stimulus A are defined by the presence or not of a feature stimulus X preceding it. In the present experiment, composite features preceded targets associated with two different topography operant responses (right and left bar pressing); matching and non-matching-to-sample arrangements were also used. Five water-deprived Wistar rats were trained in 6 different trials: X-R®Ar and X-L®Al, in which X and A were same modality visual stimuli and the reinforcement was contingent to pressing either the right (r) or left (l) bar that had the light on during the feature (matching-to-sample); Y-R®Bl and Y-L®Br, in which Y and B were same modality auditory stimuli and the reinforcement was contingent to pressing the bar that had the light off during the feature (non-matching-to-sample); A- and B- alone. After 100 training sessions, the animals were submitted to transfer tests with the targets used plus a new one (auditory click). Average percentages of stimuli with a response were measured. Acquisition occurred completely only for Y-L®Br+; however, complex associations were established along training. Transfer was not complete during the tests since concurrent effects of extinction and response generalization also occurred. Results suggest the use of both simple conditioning and configurational strategies, favoring the most recent theories of conditional discrimination learning. The implications of the use of complex arrangements for discussing these theories are considered.

Effects of drugs that potentiate GABA on extinction of positively-reinforced operant behaviour

Extinction following positively reinforced operant conditioning reduces response frequency, at least in part through the aversive or frustrative effects of non-reinforcement. According to J.A. Gray's theory, non-reinforcement activates the behavioural inhibition system which in turn causes anxiety. As predicted, anxiolytic drugs including benzodiazepines affect the operant extinction process. Recent studies have shown that reducing GABA-mediated neurotransmission retards extinction of aversive conditioning. We have shown in a series of studies that anxiolytic compounds that potentiate GABA facilitate extinction of positively reinforced fixed-ratio operant behaviour in C57B1/6 male mice. This effect does not occur in the early stages of extinction, nor is it dependent on cumulative effects of the compound administered. Potentiation of GABA at later stages has the effect of increasing sensitivity to the extinction contingency and facilitates the inhibition of the behaviour that is no longer required. The GABAergic hypnotic, zolpidem, has the same selective effects on operant extinction in this procedure. The effects of zolpidem are not due to sedative action. There is evidence across our series of experiments that different GABA-A subtype receptors are involved in extinction facilitation and anxiolysis. Consequently, this procedure may not be an appropriate model for anxiolytic drug action, but it may be a useful technique for analysing the neural bases of extinction and designing therapeutic interventions in humans where failure to extinguish inappropriate behaviours can lead to pathological conditions such as post-traumatic stress disorder.

Subtype-selective GABAergic drugs facilitate extinction of mouse operant behaviour

Several recent studies have shown that reducing gamma-aminobutyric acid (GABA)-mediated neurotransmission retards extinction of aversive conditioning. However, relatively little is known about the effect of GABA on extinction of appetitively motivated tasks. We examined the effect of chlordiazepoxide (CDP), a classical benzodiazepine (BZ) and two novel subtype-selective BZs when administered to male C57Bl/6 mice during extinction following training on a discrete-trial fixed-ratio 5 (FR5) food reinforced lever-press procedure. Initially CDP had no effect, but after several extinction sessions CDP significantly facilitated extinction, i.e. slowed responding, compared with vehicle-treated mice. This effect was not due to drug accumulation because mice switched from vehicle treatment to CDP late in extinction showed facilitation immediately. Likewise, this effect could not be attributed to sedation because the dose of CDP used (15 mg/kg i.p.) did not suppress locomotor activity. The two novel subtype-selective BZ partial agonists, L-838417 and TP13, selectively facilitated extinction in similar fashion to CDP. The non-GABAergic anxiolytic buspirone was also tested and found to have similar effects when administered at a non-sedating dose. These studies demonstrate that GABA-mediated processes are important during extinction of an appetitively motivated task, but only after the animals have experienced several extinction sessions.

Operant measurement of auditory threshold in prelingually deaf users of cochlear implants: II

Two experiments evaluated an operant procedure for establishing stimulus control using auditory and electrical stimuli as a baseline for measuring the electrical current threshold of electrodes implanted in the cochlea. Twenty-one prelingually deaf children, users of cochlear implants, learned a Go/No Go auditory discrimination task (i.e., pressing a button in the presence of the stimulus but not in its absence). When the simple discrimination baseline became stable, the electrical current was manipulated in descending and ascending series according to an adapted staircase method. Thresholds were determined for three electrodes, one in each location in the cochlea (basal, medial, and apical). Stimulus control was maintained within a certain range of decreasing electrical current but was eventually disrupted. Increasing the current recovered stimulus control, thus allowing the determination of a range of electrical currents that could be defined as the threshold. The present study demonstrated the feasibility of the operant procedure combined with a psychophysical method for threshold assessment, thus contributing to the routine fitting and maintenance of cochlear implants within the limitations of a hospital setting.

Operant and respondent procedures to establish social stimuli as reinforcers in children with autism

According to the DSM-IV- TR (American Psychiatric Association, 2000), one of the core deficits in autism is in the impairment of social interaction. Some have suggested that underlying these deficits is the reality that individuals with autism do not find social stimuli to be as reinforcing as other types of stimuli (Dawson, 2008). An interesting and growing body of literature supports the notion that symptoms in autism may be caused by a general reduction in social motivation (Chevallier et al., 2012). A review of the literature suggests that social orienting and social motivation are low in individuals with autism, and including social motivation as a target for therapeutic intervention should be pursued (Helt et al., 2008). Through our understanding of learning processes, researchers in behavior analysis and related fields have been able to use conditioning procedures to change the function of neutral or ineffective stimuli, including tokens (Ayllon & Azrin, 1968), facial expressions (Gewirtz & Pelaez-Nogueras, 1992) and praise (Dozier et al., 2012). The current study aimed to use operant and respondent procedures to condition social stimuli that were empirically shown to not be reinforcing prior to conditioning. Further, this study aimed to compare the two procedures in their effectiveness to condition social stimuli to function as reinforcers, and in their maintenance of effects over time. Using a multiple-baseline, multi-element design, one social stimulus was conditioned under each procedure to compare the different response rates following conditioning. Finally, the study sought to determine if conditioning social stimuli to function as reinforcers had any effect on the social functioning of young children with autism. Six children diagnosed with autism between the ages of 18 months and 3 years participated. Results show that the respondent procedure (pairing) resulted in more robust and enduring effects than the operant procedure (Sd procedure). Results of a social communication assessment (ESCS, Mundy et al., 2003) before and after conditioning demonstrate gains in all areas of social communication, particularly in the areas of initiating and responding to joint attention.^