LEARNING IMPULSE CONTROL IN A NOVEL ANIMAL MODEL: SYNAPTIC, CELLULAR, AND PHARMACOLOGICAL SUBSTRATES

Impulse control, an executive process that restrains inappropriate actions, is impaired in numerous psychiatric conditions. This thesis reports three experiments that utilized a novel animal model of impulse control, the response inhibition (RI) task, to examine the substrates that underlie learning this task. In the first experiment, rats were trained to withhold responding on the RI task, and then euthanized for electrophysiological testing. Training in the RI task increased the AMPA/NMDA ratio at the synapses of pyramidal neurons in the prelimbic, but not infralimbic, region of the medial prefrontal cortex. This enhancement paralleled performance as subjects underwent acquisition and extinction of the inhibitory response. AMPA/NMDA was elevated only in neurons that project to the ventral striatum. Thus, this experiment identified a synaptic correlate of impulse control. In the second experiment, a separate group of rats were trained in the RI task prior to electrophysiological testing. Training in the RI task produced a decrease in membrane excitability in prelimbic, but not infralimbic, neurons as measured by maximal spiking evoked in response to increasing current injection. Importantly, this decrease was strongly correlated with successful inhibition in the task. Fortuitously, subjects trained in an operant control condition showed elevated infralimbic, but not prelimbic, excitability, which was produced by learning an anticipatory signal that predicted imminent reward availability. These experiments revealed two cellular correlates of performance, corresponding to learning two different associations under distinct task conditions. In the final experiment, rats were trained on the RI task under three conditions: Short (4-s), long (60-s), or unpredictable (1-s to 60-s) premature phases. These conditions produced distinct errors on the RI task. Interestingly, amphetamine increased premature responding in the short and long conditions, but decreased premature responding in the unpredictable condition. This dissociation may arise from interactions between amphetamine and underlying cognitive processes, such as attention, timing, and conditioned avoidance. In summary, this thesis showed that learning to inhibit a response produces distinct synaptic, cellular, and pharmacological changes. It is hoped that these advances will provide a starting point for future therapeutic interventions of disorders of impulse control.

The Optimality of Decision Making During Motor Learning

In our daily lives, we often must predict how well we are going to perform in the future based on an evaluation of our current performance and an assessment of how much we will improve with practice. Such predictions can be used to decide whether to invest our time and energy in learning and, if we opt to invest, what rewards we may gain. This thesis investigated whether people are capable of tracking their own learning (i.e. current and future motor ability) and exploiting that information to make decisions related to task reward. In experiment one, participants performed a target aiming task under a visuomotor rotation such that they initially missed the target but gradually improved. After briefly practicing the task, they were asked to select rewards for hits and misses applied to subsequent performance in the task, where selecting a higher reward for hits came at a cost of receiving a lower reward for misses. We found that participants made decisions that were in the direction of optimal and therefore demonstrated knowledge of future task performance. In experiment two, participants learned a novel target aiming task in which they were rewarded for target hits. Every five trials, they could choose a target size which varied inversely with reward value. Although participants’ decisions deviated from optimal, a model suggested that they took into account both past performance, and predicted future performance, when making their decisions. Together, these experiments suggest that people are capable of tracking their own learning and using that information to make sensible decisions related to reward maximization.

Role of Dopamine D2 Receptors in the Consolidation of Amphetamine-Cue Memory in Conditioned Activity in Rats

The neurotransmitter dopamine (DA) plays an essential role in reward-related incentive learning, whereby neutral stimuli gain the ability to elicit approach and other responses. In an incentive learning paradigm called conditioned activity, animals receive a stimulant drug in a specific environment over the course of several days. When then placed in that environment drug-free, they generally display a conditioned hyperactive response. Modulating DA transmission at different time points during the paradigm has been shown to disrupt or enhance conditioning effects. For instance, blocking DA D2 receptors before sessions generally impedes the acquisition of conditioned activity. To date, no studies have examined the role of D2 receptors in the consolidation phase of conditioned activity; this phase occurs immediately after acquisition and involves the stabilization of memories for long-term storage. To investigate this possible role, I trained Wistar rats (N = 108) in the conditioned activity paradigm produced by amphetamine (2.0 mg/kg, intraperitoneally) to examine the effects of the D2 antagonist haloperidol (doses 0.10, 0.25, 0.50, 0.75, 1.0, & 2.0 mg/kg, intraperitoneally) administered 5 min after conditioning sessions. Two positive control groups received haloperidol 1 h before conditioning sessions (doses 1.0 mg/kg and 2.0 mg/kg). The results revealed that post-session haloperidol at all doses tested did not disrupt the consolidation of conditioned activity, while pre-session haloperidol at 2.0 mg/kg prevented acquisition, with the 1.0 mg/kg group trending toward a block. Additionally, post-session haloperidol did not diminish activity during conditioning days, unlike pre-session haloperidol. One possible reason for these findings is that the consolidation phase may have begun earlier than when haloperidol was administered, since the conditioned activity paradigm uses longer learning sessions than those generally used in consolidation studies. Future studies may test if conditioned activity can be achieved with shorter sessions; if so, haloperidol would then be re-tested at an earlier time point. D2 receptor second messenger systems may also be investigated in consolidation. Since drug-related incentive stimuli can evoke cravings in those with drug addiction, a better understanding of the mechanisms of incentive learning may lead to the development of solutions for these individuals.