RWMODEL II: Computer simulation of the Rescorla-Wagner model of Pavlovian conditioning

RWMODEL II simulates the Rescorla-Wagner model of Pavlovian conditioning. It is written in Delphi and runs under Windows 3.1 and Windows 95. The program was designed for novice and expert users and can be employed in teaching, as well as in research. It is user friendly and requires a minimal level of computer literacy but is sufficiently flexible to permit a wide range of simulations. It allows the display of empirical data, against which predictions from the model can be validated.

Occasion setting in Pavlovian ambiguous target discriminations

Rats were trained in a Pavlovian serial ambiguous target discrimination, in which a target cue was reinforced if it was preceded by one stimulus (P -> T+) but was not reinforced if it was preceded by another stimulus (N -> T-). Test performance indicated that stimulus control by these features was weaker than that acquired by features trained within separate serial feature positive (P -> T+, T-) and serial feature negative (N -> W-, W+) discriminations. The form of conditioned responding and the patterns of transfer observed suggested that the serial ambiguous target discrimination was solved by occasion setting. The data are discussed in terms of the use of retrospective coding strategies when solving Pavlovian serial conditional discriminations, and the acquisition of special properties by both feature and target stimuli. (C) 2008 Published by Elsevier B.V.

Conditioned inhibition of autonomic Pavlovian conditioning in humans

The present study aimed to demonstrate conditioned inhibition of Pavlovian conditioning of autonomic responses in humans. Subjects (N = 21) were presented initially with four geometric shapes (A, B, C and D). An electric shock served as the unconditioned stimulus (US) during acquisition. Conditional stimuli lasted for 8 s and US onset coincided with CS offset. Subjects were trained with A-US, C-US, and AC-US pairings and AB alone and B alone presentations. The subsequent summation test consisted of C-US pairings and CB alone and CD alone presentations. Conditioning was evident in self-reported US expectancy and first and second interval electrodermal responses. Evidence for conditioned inhibition during the summation test was found in US expectancy and second interval electrodermal responses. (C) 1997 Elsevier Science B.V.

Effect of instructed extinction on verbal and autonomic indices of Pavlovian learning with fear-relevant and fear-irrelevant conditional stimuli

We investigated the effects of conditional stimulus fear-relevance and of instructed extinction on human Pavlovian conditioning as indexed by electrodermal responses and verbal ratings of conditional stimulus unpleasantness. Half of the participants (n = 64) were trained with pictures of snakes and spiders (fear-relevant) as conditional stimuli, whereas the others were trained with pictures of flowers and mushrooms (fear-irrelevant) in a differential aversive Pavlovian conditioning procedure. Half of the participants in each group were instructed after the completion of acquisition that no more unconditional stimuli were to be presented. Extinction of differential electrodermal responses required more trials after training with fear-relevant pictures. Moreover, there was some evidence that verbal instructions did not affect extinction of second interval electrodermal responses to fear-relevant pictures. However, neither fear-relevance nor instructions affected the changes in rated conditional stimulus pleasantness. This dissociation across measures is interpreted as reflecting renewal of Pavlovian learning.

Latent inhibition and schizophrenia: Pavlovian conditioning of autonomic responses

Latent inhibition (LI) is an important model for understanding cognitive deficits in schizophrenia, Disruption of LI is thought to result from an inability to ignore irrelevant stimuli. The study investigated LI in schizophrenic patients by using Pavlovian conditioning of electrodermal responses in a complete within-subject design. Thirty-two schizophrenic patients, ( 16 acute. unmedicated and 16 medicated patients) and 16 healthy control subjects (matched with respect to age and gender) participated in the study. The experiment consisted of two stages: preexposure and conditioning. During preexposure two visual stimuli were presented, one of which served as the to-be-conditioned stimulus (CSp +) and the other one was the not-to-be-conditioned stimulus (CSp -) during the following conditioning ( = acquisition). During acquisition. two novel visual stimuli (CSn + and CSn -) were introduced. A reaction time task was used as the unconditioned stimulus (US). LI was defined as the difference in response differentiation observed between proexposed and non-preexposed sets of CS + and CS -. During preexposure. the schizophrenic patients did not differ in electrodermal responding from the control subjects, neither concerning the extent of orienting nor the course of habituation. The exposure to novel stimuli at the beginning of the acquisition elicited reduced orienting responses in unmedicated patients compared to medicated patients and control subjects, LI was observed in medicated schizophrenic patients and healthy controls. but not in acute unmedicated patients. Furthermore LI was found to be correlated with the duration of illness: it was attenuated in patients who had suffered their first psychotic episode. (C) 2002 Elsevier Science B.V. All rights reserved.

Comparison of Pavlovian serial conditional discrimination in rats and hamsters in the same experimental situation

The present study compares behavioral changes between two distinct rodent groups, hamsters (Mesocricetus auratus) and Wistar rats, when submitted in the same homogeneous experimental situations to a serial conditional discrimination procedure which involves water deprivation and the processing of temporal variables. Both hamsters and rats acquired serial positive conditional discrimination as indicated by higher frequencies of magazine-oriented behavior during the tone followed by reinforcement (T+) and preceded by the feature stimulus light (L) and during the empty interval, than during the tone alone not followed by reinforcement (T-). Rats' frequencies of magazine-oriented behavior were high during T+ and T-, initially during training, and decreased during T- as the training progressed. However, the hamsters' frequencies of magazine-oriented behavior started very low and increased only during T+ as the training progressed. Comparison of the frequencies of magazine-oriented behavior during the empty interval in relation to the frequencies during the preceding L period showed that rats' frequencies remained very high and hamsters' frequencies increased during training. These results suggest that rats and hamsters have different behavioral strategies for the acquisition of a conditional discrimination. The results of the comparisons made in these experiments support the view of the importance of an ecological psychology approach to the understanding of complex learning in animals.

Acquisition of Pavlovian Fear Conditioning Using beta-Adrenoceptor Activation of the Dorsal Premammillary Nucleus as an Unconditioned Stimulus to Mimic Live Predator-Threat Exposure

In the present work, we sought to mimic the internal state changes in response to a predator threat by pharmacologically stimulating the brain circuit involved in mediating predator fear responses, and explored whether this stimulation would be a valuable unconditioned stimulus (US) in an olfactory fear conditioning paradigm (OFC). The dorsal premammillary nucleus (PMd) is a key brain structure in the neural processing of anti-predatory defensive behavior and has also been shown to mediate the acquisition and expression of anti-predatory contextual conditioning fear responses. Rats were conditioned by pairing the US, which was an intra-PMd microinjection of isoproterenol (ISO; beta-adrenoceptor agonist), with amyl acetate odor-the conditioned stimulus (CS). ISO (10 and 40 nmol) induced the acquisition of the OFC and the second-order association by activation of beta-1 receptors in the PMd. Furthermore, similar to what had been found for contextual conditioning to a predator threat, atenolol (beta-1 receptor antagonist) in the PMd also impaired the acquisition and expression of OFC promoted by ISO. Considering the strong glutamatergic projections from the PMd to the dorsal periaqueductal gray (dPAG), we tested how the glutamatergic blockade of the dPAG would interfere with the OFC induced by ISO. Accordingly, microinjections of NMDA receptor antagonist (AP5, 6 nmol) into the dPAG were able to block both the acquisition, and partially, the expression of the OFC. In conclusion, we have found that PMd beta-1 adrenergic stimulation is a good model to mimic predatory threat-induced internal state changes, and works as a US able to mobilize the same systems involved in the acquisition and expression of predator-related contextual conditioning. Neuropsychopharmacology (2011) 36, 926-939; doi:10.1038/npp.2010.231; published online 5 January 2011

Learning in the cerebellar nucleus is necessary for acquisition of Pavlovian eyelid conditioning

The cumulative work presented here supports the hypothesis that plasticity in the cerebellar cortex and cerebellar nuclei mediates a simple associative form of motor teaming-Pavlovian eyelid conditioning. It was previously demonstrated that focal ablative lesions of cerebellar anterior lobe or pharmacological block of the cerebellar cortex output disrupted the timing of the conditioned eyeblink response, unmasking a response with a relatively fixed and very short latency to onset. The results of this thesis demonstrate that the short-latency responses are due to associative learning. Unpaired training does not support the acquisition of short-latency responses while the rate of acquisition of short-latency responses during paired training is approximately the same as that of timed conditioned responses. The acquisition of short-latency responses is dependent on an intact cerebellar cortex. Both ablative lesions of the cerebellar cortex and inactivation of cerebellar cortex output with picrotoxin block the acquisition of short-latency responses. However, once the short-latency responses are acquired neither disconnection of cerebellar cortex nor inactivation of the cerebellar nucleus block reacquisition. The results are consistent with the proposal that plasticity in the cerebellar cortex is necessary for learning the timing of conditioned responses, plasticity in the interpositus nucleus mediates the short latency responses, and cerebellar cortical output and mossy fiber input are necessary for the acquisition of short latency responses. ^

Evaluative learning in human Pavlovian conditioning: Extinct, but still there?

Previous studies of human affective learning, the acquisition of likes and dislikes, provided evidence that extinction training does not affect changes in conditional stimulus (CS) valence as indexed by paper/pencil ratings. Experiment 1 (N = 32) investigated whether this is an artifact of the CS valence assessment, which is taken in test sessions before and after training. Pleasantness ratings were collected in pre/post training tests and, for half of the participants, on-line during training. Rated unpleasantness of the CS that preceded the aversive US (CS+) increased during acquisition and decreased during extinction back to neutral. However, as in previous studies, post extinction paper/pencil ratings revealed the maintenance of rated CS+ unpleasantness. Experiment 2 (N = 34) replicated this finding for two measures of CS valence, paper/pencil and the continuous measure used during training. The present results indicate that previous reports of failures to find extinction of affective learning may reflect renewal rather than maintenance of acquired CS valence across extinction training. (C) 2003 Elsevier Science (USA). All rights reserved.

The effects of unconditional stimulus valence and conditioning paradigm on verbal, skeleto-motor, and autonomic indices of human Pavlovian conditioning

The effects of unconditional stimulus (US) valence (aversive electro-tactile stimulus vs. nonaversive imperative stimulus of a RT task) and conditioning paradigm (delay vs. trace) on affective learning as indexed by verbal ratings of conditional stimulus (CS) pleasantness and blink startle modulation and on relational learning as indexed by electrodermal responses were investigated. Affective learning was not affected by the conditioning paradigm; however, electrodermal responses and blink latency shortening indicated delayed learning in the trace procedure. Changes in rated CS pleasantness were found with the aversive US, but not with the non-aversive US. Differential conditioning as indexed by electrodermal responses and startle modulation was found regardless of US valence. The finding of significant differential blink modulation and electrodermal responding in the absence of a change in rated CS pleasantness as a result of conditioning with a non-aversive US was replicated in a second experiment. These results seem to indicate that startle modulation during conditioning is mediated by the arousal level of the anticipated US, rather than by the valence of the CS. (C) 2002 Elsevier Science (USA). All rights reserved.

Effects of stimulus modality and task condition on blink startle modification and on electrodermal responses

Participants in Experiments 1 and 2 performed a discrimination and counting task to assess the effect of lead stimulus modality on attentional modification of the acoustic startle reflex. Modality of the discrimination stimuli was changed across subjects. Electrodermal responses were larger during task-relevant stimuli than during task-irrelevant stimuli in all conditions. Larger blink magnitude facilitation was found during auditory and visual task-relevant stimuli, but not for tactile stimuli. Experiment 3 used acoustic, visual, and tactile conditioned stimuli (CSs) in differential conditioning with an aversive unconditioned stimulus (US). Startle magnitude facilitation and electrodermal responses were larger during a CS that preceded the US than during a CS that was presented alone regardless of lead stimulus modality. Although not unequivocal, the present data pose problems for attentional accounts of blink modification that emphasize the importance of lead stimulus modality.

Aquisition and extinction of two characteristics consistent with fear relevance

Fear relevance, the potential of a stimulus to become quickly associated with fear, is a characteristic assumed to have an evolutionary basis and to result in preferential processing. Previous research has shown that fear relevant stimuli share a number of characteristics, negative valence and preferential identification in a visual search task, for instance. The present research examined whether these two characteristics can be acquired by non-fear relevant stimuli (geometric shapes) as a result of Pavlovian fear conditioning. Two experiments employed an aversive learning paradigm with geometric shape CSs and a shock US, with stimulus ratings, affective priming and visual search performance assessed before and after acquisition and after extinction. Differential electrodermal responses, larger during CS1 than CS, were present during acquisition but not during extinction. Affective priming results suggest that the CS1 acquired negative valence during acquisition, which was lost during extinction. However, negative valence as indexed by more negative ratings for CS1 than for CS shapes seemed to survive extinction. Preferential attentional processing as indexed by faster detection of CS1 among CS shapes than vice versa on the visual search task also remained. The current research confirmed that characteristics of fear relevant stimuli can be acquired in an aversive learning episode and that they may be extinguished. This supports the proposal that fear relevance may be malleable through learning.

Effects of microinjections of apomorphine and haloperidol into the inferior colliculus on the latent inhibition of the conditioned emotional response

Electrical or chemical stimulation of the inferior colliculus (IC) induces fear-like behaviors. More recently, consistent evidence has shown that electrical stimulation of the central nucleus of the IC supports Pavlovian conditioning and latent inhibition (Li). LI is characterized by retardation in conditioning and also by an impaired ability to ignore irrelevant stimuli, after a non-reinforced pre-exposure to the conditioned stimulus. LI has been proposed as a behavioral model of cognitive abnormalities seen in schizophrenia. The aim of the present study was to determine whether dopaminergic mechanisms in the IC are involved in LI of the conditioned emotional response (CER). To induce LI, a group of rats was pre-exposed (PE) to six tones in two sessions, while rats that were not pre-exposed (NPE) had two sessions without tone presentations. The conditioning consisted of two tone presentations to the animal, followed immediately by a foot shock. PE and NPE rats received IC microinjections of physiological saline, the dopaminergic agonist apomorphine (9.0 mu g/0.5 mu L/side), or the dopaminergic antagonist haloperidol (0.5 mu g/0.5 mu L/side) before both pre-exposure and conditioning. During the test, the PE rats that received saline or haloperidol had a lower suppression of the licking response compared to NPE rats that received vehicle or haloperidol, indicating that latent inhibition was induced. There was no significant difference in the suppression ratio in rats that received apomorphine injections into the IC, indicating reduced latent inhibition. These results suggest that dopamine-mediated mechanisms of the IC are involved in the development of LI. (C) 2008 Elsevier Inc. All rights reserved.