Unconditioned responses and functional fear networks in human classical conditioning.

Human imaging studies examining fear conditioning have mainly focused on the neural responses to conditioned cues. In contrast, the neural basis of the unconditioned response and the mechanisms by which fear modulates inter-regional functional coupling have received limited attention. We examined the neural responses to an unconditioned stimulus using a partial-reinforcement fear conditioning paradigm and functional MRI. The analysis focused on: (1) the effects of an unconditioned stimulus (an electric shock) that was either expected and actually delivered, or expected but not delivered, and (2) on how related brain activity changed across conditioning trials, and (3) how shock expectation influenced inter-regional coupling within the fear network. We found that: (1) the delivery of the shock engaged the red nucleus, amygdale, dorsal striatum, insula, somatosensory and cingulate cortices, (2) when the shock was expected but not delivered, only the red nucleus, the anterior insular and dorsal anterior cingulate cortices showed activity increases that were sustained across trials, and (3) psycho-physiological interaction analysis demonstrated that fear led to increased red nucleus coupling to insula but decreased hippocampus coupling to the red nucleus, thalamus and cerebellum. The hippocampus and the anterior insula may serve as hubs facilitating the switch between engagement of a defensive immediate fear network and a resting network.

In vitro analog of classical conditioning of feeding behavior in aplysia.

The feeding behavior of Aplysia californica can be classically conditioned using tactile stimulation of the lips as a conditioned stimulus (CS) and food as an unconditioned stimulus (US). Moreover, several neural correlates of classical conditioning have been identified. The present study extended previous work by developing an in vitro analog of classical conditioning and by investigating pairing-specific changes in neuronal and synaptic properties. The preparation consisted of the isolated cerebral and buccal ganglia. Electrical stimulation of a lip nerve (AT4) and a branch of the esophageal nerve (En2) served as the CS and US, respectively. Three protocols were used: paired, unpaired, and US alone. Only the paired protocol produced a significant increase in CS-evoked fictive feeding. At the cellular level, classical conditioning enhanced the magnitude of the CS-evoked synaptic input to pattern-initiating neuron B31/32. In addition, paired training enhanced both the magnitude of the CS-evoked synaptic input and the CS-evoked spike activity in command-like neuron CBI-2. The in vitro analog of classical conditioning reproduced all of the cellular changes that previously were identified following behavioral conditioning and has led to the identification of several new learning-related neural changes. In addition, the pairing-specific enhancement of the CS response in CBI-2 indicates that some aspects of associative plasticity may occur at the level of the cerebral sensory neurons.

Behavioral and cellular analysis of classical conditioning of feeding behavior in Aplysia

In classical conditioning, an associative form of learning, animals learn to associate two stimuli. Cellular and molecular mechanisms for the induction and consolidation of associative learning and memory at the level of single cells and synaptic connections have been studied in both vertebrate and invertebrate animals. The majority of studies, however, relied on aversive stimuli to induce learning. This bias may limit the extent to which identified mechanisms generalize to other forms of associative learning and memory, such as appetitive forms. The goal of the present study was to develop a classical conditioning procedure for the marine mollusk Aplysia californica using appetitive reinforcement, and to analyze associative learning using behavioral and electrophysiological techniques. ^ Using tactile stimulation of the lips as the conditional stimulus (CS) and food as the unconditional stimulus (US) a training protocol was developed that reliably induced classical conditioning of feeding behavior. Memory persisted for at least 24 hours. The gross organization of reinforcement-mediating pathways was analyzed in additional behavioral experiments. Moreover, neurophysiological correlates of classical conditioning were identified and characterized in an in vitro preparation containing the circuitry for feeding behavior. In vitro stimulation of a nerve (AT4) that may mediate the CS during training, resulted in a greater number of buccal motor patterns (BMPs) in brains from conditioned animals, as compared to control animals. The majority of these BMPs were ingestion-like, consistent with the increased number of bites in response to the CS after classical conditioning. Moreover, classical conditioning correlated with increased excitatory synaptic input to BMP-initiating neuron B31/32, in response to stimulation of AT 4, as compared to controls. The expression of the correlates of classical conditioning identified in this study was specific to stimulation of AT 4, which is consistent the stimulus specificity that is characteristic for classical conditioning. ^ The identification of cellular correlates of classical conditioning documented here provides the basis for future, more detailed analyses of an appetitive form of associative learning and memory, that may extend the working knowledge of the cellular and molecular mechanisms for associative plasticity in general. ^

Cellular mechanisms of operant and classical conditioning

The ability to associate a predictive stimulus with a subsequent salient event (i.e., classical conditioning) and the ability to associate an expressed behavior with the consequences (i.e., operant conditioning) allow for a predictive understanding of a changing environment. Although they are operationally distinct, there has been considerable debate whether at some fundamental level classical and operant conditioning are mechanistically distinct or similar. Feeding behavior of Aplysia (i.e., biting) was chosen as the model system and was successfully conditioned with appetitive forms of both operant and classical conditioning. The neuronal circuitry responsible for feeding is well understood and is suitable for cellular analyses, thus providing for a mechanistic comparison between these two forms of associative learning. ^ Neuron B51 is part of the feeding circuitry of Aplysia and is critical for the expression of ingestive behaviors. B51 also is a locus of plasticity following both operant and classical conditioning. Both in vivo and in vitro operant conditioning increased the input resistance and the excitability of B51. No pairing-specific changes in the input resistance were observed following both in vivo and in vitro classical conditioning. However, classical conditioning decreased the excitability of B51. Thus, both operant and classical conditioning modified the threshold level for activation of neuron B51, but in opposite directions, revealing key differences in the cellular mechanisms underlying these two forms of associative learning. ^ Next, the cellular mechanisms underlying operant conditioning were investigated in more detail using a single-cell analogue. The single-cell analogue successfully recapitulated the previous in vivo and in vitro operant conditioning results by increasing the input resistance and the excitability of B51. Both PKA and PKC were necessary for operant conditioning. Dopamine appears to be the transmitter mediating the reinforcement signal in this form of conditioning. A D1 dopamine receptor antibody revealed that the D1receptor localizes to the axon hillock, which is also the region that gives the strongest response when iontophoresing dopamine. ^ The studies presented herein, thus, provide for a greater understanding of the mechanisms underlying both of these forms of associative learning and demonstrate that they likely operate through distinct cellular mechanisms. ^

Extending in vitro conditioning in Aplysia to analyze operant and classical processes in the same preparation.

Operant and classical conditioning are major processes shaping behavioral responses in all animals. Although the understanding of the mechanisms of classical conditioning has expanded significantly, the understanding of the mechanisms of operant conditioning is more limited. Recent developments in Aplysia are helping to narrow the gap in the level of understanding between operant and classical conditioning, and have raised the possibility of studying the neuronal processes underlying the interaction of operant and classical components in a relatively complex learning task. In the present study, we describe a first step toward realizing this goal, by developing a single in vitro preparation in which both operant and classical conditioning can be studied concurrently. The new paradigm reproduced previously published results, even under more conservative and homogenous selection criteria and tonic stimulation regime. Moreover, the observed learning was resistant to delay, shortening, and signaling of reinforcement.

Learning processes and the neural analysis of conditioning

Classical and operant conditioning principles, such as the behavioral discrepancy-derived assumption that reinforcement always selects antecedent stimulus and response relations, have been studied at the neural level, mainly by observing the strengthening of neuronal responses or synaptic connections. A review of the literature on the neural basis of behavior provided extensive scientific data that indicate a synthesis between the two conditioning processes based mainly on stimulus control in learning tasks. The resulting analysis revealed the following aspects. Dopamine acts as a behavioral discrepancy signal in the midbrain pathway of positive reinforcement, leading toward the nucleus accumbens. Dopamine modulates both types of conditioning in the Aplysia mollusk and in mammals. In vivo and in vitro mollusk preparations show convergence of both types of conditioning in the same motor neuron. Frontal cortical neurons are involved in behavioral discrimination in reversal and extinction procedures, and these neurons preferentially deliver glutamate through conditioned stimulus or discriminative stimulus pathways. Discriminative neural responses can reliably precede operant movements and can also be common to stimuli that share complex symbolic relations. The present article discusses convergent and divergent points between conditioning paradigms at the neural level of analysis to advance our knowledge on reinforcement.

Conditioned inhibition of autonomic Pavlovian conditioning in humans

The present study aimed to demonstrate conditioned inhibition of Pavlovian conditioning of autonomic responses in humans. Subjects (N = 21) were presented initially with four geometric shapes (A, B, C and D). An electric shock served as the unconditioned stimulus (US) during acquisition. Conditional stimuli lasted for 8 s and US onset coincided with CS offset. Subjects were trained with A-US, C-US, and AC-US pairings and AB alone and B alone presentations. The subsequent summation test consisted of C-US pairings and CB alone and CD alone presentations. Conditioning was evident in self-reported US expectancy and first and second interval electrodermal responses. Evidence for conditioned inhibition during the summation test was found in US expectancy and second interval electrodermal responses. (C) 1997 Elsevier Science B.V.

Enhancement of sensorimotor connections by conditioning-related stimulation in Aplysia depends upon postsynaptic Ca2+.

Classical conditioning of Aplysia's siphon-withdrawal reflex is thought to be due to a presynaptic mechanism-activity-dependent presynaptic facilitation of sensorimotor connections. Recent experiments with sensorimotor synapses in dissociated cell culture, however, provide an alternative cellular mechanism for classical conditioning-Hebbian long-term potentiation (LTP) of sensorimotor connections. Induction of Hebbian LTP of these connections is mediated by activation of N-methyl-D-aspartate-related receptors and requires the postsynaptic elevation of intracellular Ca2+. To determine whether the enhancement of sensorimotor synapses during classical conditioning in Aplysia-like LTP of sensorimotor synapses in culture-also depends upon the elevation of postsynaptic Ca2+, we carried out experiments involving the cellular analog of classical conditioning of siphon withdrawal. We examined changes in the strength of monosynaptic siphon sensorimotor connections in the abdominal ganglion of Aplysia following paired presentations of sensory neuron activation and tail nerve shock. This training regimen resulted in significant enhancement of the monosynaptic sensorimotor excitatory postsynaptic potential, as compared with the sensorimotor excitatory postsynaptic potential in preparations that received only test stimulation. Infusing the motor neuron with 1,2-bis(2-aminophenoxy)ethane-N,N-N',N'-tetraacetic acid, a specific chelator of intracellular Ca2+, prior to paired stimulation training blocked this synaptic enhancement. Our results implicate a postsynaptic, possibly Hebbian, mechanism in classical conditioning in Aplysia.

Functional anatomy of human eyeblink conditioning determined with regional cerebral glucose metabolism and positron-emission tomography.

Relative cerebral glucose metabolism was examined with positron-emission tomography (PET) as a measure of neuronal activation during performance of the classically conditioned eyeblink response in 12 young adult subjects. Each subject received three sessions: (i) a control session with PET scan in which unpaired presentations of the tone conditioned stimulus and corneal airpuff unconditioned stimulus were administered, (ii) a paired training session to allow associative learning to occur, and (iii) a paired test session with PET scan. Brain regions exhibiting learning-related activation were identified as those areas that showed significant differences in glucose metabolism between the unpaired control condition and well-trained state in the 9 subjects who met the learning criterion. Areas showing significant activation included bilateral sites in the inferior cerebellar cortex/deep nuclei, anterior cerebellar vermis, contralateral cerebellar cortex and pontine tegmentum, ipsilateral inferior thalamus/red nucleus, ipsilateral hippocampal formation, ipsilateral lateral temporal cortex, and bilateral ventral striatum. Among all subjects, including those who did not meet the learning criterion, metabolic changes in ipsilateral cerebellar nuclei, bilateral cerebellar cortex, anterior vermis, contralateral pontine tegmentum, ipsilateral hippocampal formation, and bilateral striatum correlated with degree of learning. The localization to cerebellum and its associated brainstem circuitry is consistent with neurobiological studies in the rabbit model of eyeblink classical conditioning and neuropsychological studies in brain-damaged humans. In addition, these data support a role for the hippocampus in conditioning and suggest that the ventral striatum may also be involved.

Effects of Enriched Physical and Social Environments on Motor Performance, Associative Learning, and Hippocampal Neurogenesis in Mice.

We have studied the motor abilities and associative learning capabilities of adult mice placed in different enriched environments. Three-month-old animals were maintained for a month alone (AL), alone in a physically enriched environment (PHY), and, finally, in groups in the absence (SO) or presence (SOPHY) of an enriched environment. The animals' capabilities were subsequently checked in the rotarod test, and for classical and instrumental learning. The PHY and SOPHY groups presented better performances in the rotarod test and in the acquisition of the instrumental learning task. In contrast, no significant differences between groups were observed for classical eyeblink conditioning. The four groups presented similar increases in the strength of field EPSPs (fEPSPs) evoked at the hippocampal CA3-CA1 synapse across classical conditioning sessions, with no significant differences between groups. These trained animals were pulse-injected with bromodeoxyuridine (BrdU) to determine hippocampal neurogenesis. No significant differences were found in the number of NeuN/BrdU double-labeled neurons. We repeated the same BrdU study in one-month-old mice raised for an additional month in the above-mentioned four different environments. These animals were not submitted to rotarod or conditioned tests. Non-trained PHY and SOPHY groups presented more neurogenesis than the other two groups. Thus, neurogenesis seems to be related to physical enrichment at early ages, but not to learning acquisition in adult mice.

Blocking and unblocking in a navigation task

Rodrigo, Chamizo, McLaren, & Mackintosh (1997) demonstrated the blocking effect in a navigational task using a swimming pool: rats initially trained to use three landmarks (ABC) to find an invisible platform learned less about a fourth landmark (X) added later than did rats trained from the outset with these four landmarks (ABCX). The aim of the experiment reported here was to demonstrate unblocking using a similar procedure as in the previous work. Three groups of rats were initially trained to find an invisible platfom in the presence of three landmarks: ABC for the Blocking and Unblocking groups and LMN for the Control group. Then, all animals were trained to find the platform in the presence of four landmarks, ABCX. In this second training, unlike animals in the Blocking group to which only a new landmark (X) was added in comparison to the first training, the animals in the Unblocking group also had a change in the platform position. In the Control group, both the four landmarks and the platform position were totally new at the beginning of this second training. As in Rodrigo et al. (1997) a blocking effect was found: rats in the Blocking group learned less with respect to the added landmark (X) than did animals in the Control group. However, rats in the Unblocking group learned about the added landmark (X) as well as did animals in the Control group. The results are interpreted as an unblocking effect due to a change in the platform position between the two phases of training, similarly to what is normal in classical conditioning experiments, in which a change in the conditions of reinforcement between the two training phases of a blocking design produce an attenuation or elimination of this effect. These results are explained within an error-correcting connectionist account of spatial navigation (McLaren, 2002).

Persistent attenuation and enhancement of the earthworm main muscle contraction generator response induced by repeated stimulation of a peripheral neuron

Responses evoked in the earthworm, Amynthas hawayanus, main muscle contraction generator M-2 (postsynaptic mechanical-stimulus-sensitive) neuron by threshold mechanical stimuli in 2-s intertrial intervals (ITI) were used as the control or unconditioned responses (UR). Their attenuation induced by decreasing these intervals in non-associative conditioning and their enhancement induced by associating the unconditioned stimuli (US) to a train of short (0.1 s) hyperpolarizing electrical substitutive conditioning stimuli (SCS) in the Peri-Kästchen (PK) neuron were measured in four parameters, i.e., peak numbers (N) and amplitude ()averaged from 120 responses, sum of these amplitudes (SAMP) and the highest peak amplitude (V) over a period of 4 min. Persistent attenuation similar to habituation was induced by decreasing the control ITI to 0.5 s and 2.0 s in non-associative conditioning within less than 4 min. Dishabituation was induced by randomly pairing one of these habituated US to an electrical stimulus in the PK neuron. All four parameters of the UR were enhanced by forward (SCS-US), but not backward (US-SCS), association of the US with 25, 100 and 250-Hz trains of SCS with 40-ms interstimulus intervals (ISI) for 4 min and persisted for another 4 min after turning off the SCS. The enhancement of these parameters was proportional to the SCS frequencies in the train. No UR was evoked by the SCS when the US was turned off after 4 min of classical conditioning.

Pharmacology of human experimental anxiety

This review covers the effect of drugs affecting anxiety using four psychological procedures for inducing experimental anxiety applied to healthy volunteers and patients with anxiety disorders. The first is aversive conditioning of the skin conductance responses to tones. The second is simulated public speaking, which consists of speaking in front of a video camera, with anxiety being measured with psychometric scales. The third is the Stroop Color-Word test, in which words naming colors are painted in the same or in a different shade, the incongruence generating a cognitive conflict. The last test is a human version of a thoroughly studied animal model of anxiety, fear-potentiated startle, in which the eye-blink reflex to a loud noise is recorded. The evidence reviewed led to the conclusion that the aversive conditioning and potentiated startle tests are based on classical conditioning of anticipatory anxiety. Their sensitivity to benzodiazepine anxiolytics suggests that these models generate an emotional state related to generalized anxiety disorder. On the other hand, the increase in anxiety determined by simulated public speaking is resistant to benzodiazepines and sensitive to drugs affecting serotonergic neurotransmission. This pharmacological profile, together with epidemiological evidence indicating its widespread prevalence, suggests that the emotional state generated by public speaking represents a species-specific response that may be related to social phobia and panic disorder. Because of scant pharmacological data, the status of the Stroop Color-Word test remains uncertain. In spite of ethical and economic constraints, human experimental anxiety constitutes a valuable tool for the study of the pathophysiology of anxiety disorders.

Exploring the impact of celebrity endorsement and product class involvement on advertising effectiveness: an eye tracking approach

Celebrity endorsement has increased in popularity over the past decades and companies are willing to spend increasingly excessive amounts of money into it. Even though multiple studies support celebrity endorsement, further research on its impact on advertising effectiveness is called for. Fur-ther, the role of consumers’ product class involvement in advertising needs to be further studied. The purpose of this study is to explore if consumers’ product class involvement and exposure to celebrity endorsers affect consumers brand recall. Supported by earlier studies, brand recall was used as a measure for advertising effectiveness in this study. In general, a psychological approach was chosen for building the theoretical framework. Concept of classical conditioning was presented in order to understand why people act how they do. Balanced theory and meaning transfer model were presented in order to study how celebrities can be used effectively in advertising context. Further, the importance of product class involvement in advertising effectiveness was evaluated. Hypotheses were formulated based on a literature review of the existing research. Because of the versatility of the research design, a mixed methods approach for this study was adopted. Empirical part of the study was conducted in three stages. First, a pre-test was conducted in order to choose suitable product endorsers for the advertisement stimuli used in the experiment. Second, an eye-tracking experiment with 30 test subjects was conducted in order to study how people view advertisements and whether the familiarity of the product endorser and consumers’ product class involvement affects brand recall. For the experiment, a fictional brand was created in order to avoid bias on brand recall. Third, qualitative interviews for 15 test subjects were conducted in the post-experiment stage in order to gain deeper understating of the phenomenon and to make sense of the findings from the experiment. Findings from this study support celebrity endorsement by suggesting that a famous spokesperson does not steal attention from brand information more than a non-celebrity product endorser. As a result, the use of a celebrity endorser did not decrease brand recall. Results support earlier research as consumer’ higher product class involvement resulted in a better brand recall. Findings from the interviews suggest that consumers have positive perceptions of celebrity endorsement in general. However, the celebrity–brand congruence is a crucial factor when creating attitudes towards the advertisement. Future research ideas were presented based on the limitations and results of this study

Modèle informatique du coapprentissage des ganglions de la base et du cortex : l'apprentissage par renforcement et le développement de représentations

Tout au long de la vie, le cerveau développe des représentations de son environnement permettant à l’individu d’en tirer meilleur profit. Comment ces représentations se développent-elles pendant la quête de récompenses demeure un mystère. Il est raisonnable de penser que le cortex est le siège de ces représentations et que les ganglions de la base jouent un rôle important dans la maximisation des récompenses. En particulier, les neurones dopaminergiques semblent coder un signal d’erreur de prédiction de récompense. Cette thèse étudie le problème en construisant, à l’aide de l’apprentissage machine, un modèle informatique intégrant de nombreuses évidences neurologiques. Après une introduction au cadre mathématique et à quelques algorithmes de l’apprentissage machine, un survol de l’apprentissage en psychologie et en neuroscience et une revue des modèles de l’apprentissage dans les ganglions de la base, la thèse comporte trois articles. Le premier montre qu’il est possible d’apprendre à maximiser ses récompenses tout en développant de meilleures représentations des entrées. Le second article porte sur l'important problème toujours non résolu de la représentation du temps. Il démontre qu’une représentation du temps peut être acquise automatiquement dans un réseau de neurones artificiels faisant office de mémoire de travail. La représentation développée par le modèle ressemble beaucoup à l’activité de neurones corticaux dans des tâches similaires. De plus, le modèle montre que l’utilisation du signal d’erreur de récompense peut accélérer la construction de ces représentations temporelles. Finalement, il montre qu’une telle représentation acquise automatiquement dans le cortex peut fournir l’information nécessaire aux ganglions de la base pour expliquer le signal dopaminergique. Enfin, le troisième article évalue le pouvoir explicatif et prédictif du modèle sur différentes situations comme la présence ou l’absence d’un stimulus (conditionnement classique ou de trace) pendant l’attente de la récompense. En plus de faire des prédictions très intéressantes en lien avec la littérature sur les intervalles de temps, l’article révèle certaines lacunes du modèle qui devront être améliorées. Bref, cette thèse étend les modèles actuels de l’apprentissage des ganglions de la base et du système dopaminergique au développement concurrent de représentations temporelles dans le cortex et aux interactions de ces deux structures.