Cocaine reward models: Conditioned place preference can be established in dopamine- and in serotonin-transporter knockout mice

Cocaine and methylphenidate block uptake by neuronal plasma membrane transporters for dopamine, serotonin, and norepinephrine. Cocaine also blocks voltage-gated sodium channels, a property not shared by methylphenidate. Several lines of evidence have suggested that cocaine blockade of the dopamine transporter (DAT), perhaps with additional contributions from serotonin transporter (5-HTT) recognition, was key to its rewarding actions. We now report that knockout mice without DAT and mice without 5-HTT establish cocaine-conditioned place preferences. Each strain displays cocaine-conditioned place preference in this major mouse model for assessing drug reward, while methylphenidate-conditioned place preference is also maintained in DAT knockout mice. These results have substantial implications for understanding cocaine actions and for strategies to produce anticocaine medications.

VMAT2 knockout mice: Heterozygotes display reduced amphetamine-conditioned reward, enhanced amphetamine locomotion, and enhanced MPTP toxicity

The brain vesicular monoamine transporter (VMAT2) pumps monoamine neurotransmitters and Parkinsonism-inducing dopamine neurotoxins such as 1-methyl-4-phenyl-phenypyridinium (MPP+) from neuronal cytoplasm into synaptic vesicles, from which amphetamines cause their release. Amphetamines and MPP+ each also act at nonvesicular sites, providing current uncertainties about the contributions of vesicular actions to their in vivo effects. To assess vesicular contributions to amphetamine-induced locomotion, amphetamine-induced reward, and sequestration and resistance to dopaminergic neurotoxins, we have constructed transgenic VMAT2 knockout mice. Heterozygous VMAT2 knockouts are viable into adult life and display VMAT2 levels one-half that of wild-type values, accompanied by smaller changes in monoaminergic markers, heart rate, and blood pressure. Weight gain, fertility, habituation, passive avoidance, and locomotor activities are similar to wild-type littermates. In these heterozygotes, amphetamine produces enhanced locomotion but diminished behavioral reward, as measured by conditioned place preference. Administration of the MPP+ precursor N-methyl-4-phenyl-1,2,3,6-tetrahydropyridine to heterozygotes produces more than twice the dopamine cell losses found in wild-type mice. These mice provide novel information about the contributions of synaptic vesicular actions of monoaminergic drugs and neurotoxins and suggest that intact synaptic vesicle function may contribute more to amphetamine-conditioned reward than to amphetamine-induced locomotion.

Molecular mechanisms of cocaine reward: Combined dopamine and serotonin transporter knockouts eliminate cocaine place preference

Cocaine blocks uptake by neuronal plasma membrane transporters for dopamine (DAT), serotonin (SERT), and norepinephrine (NET). Cocaine reward/reinforcement has been linked to actions at DAT or to blockade of SERT. However, knockouts of neither DAT, SERT, or NET reduce cocaine reward/reinforcement, leaving substantial uncertainty about cocaine's molecular mechanisms for reward. Conceivably, the molecular bases of cocaine reward might display sufficient redundancy that either DAT or SERT might be able to mediate cocaine reward in the other's absence. To test this hypothesis, we examined double knockout mice with deletions of one or both copies of both the DAT and SERT genes. These mice display viability, weight gain, histologic features, neurochemical parameters, and baseline behavioral features that allow tests of cocaine influences. Mice with even a single wild-type DAT gene copy and no SERT copies retain cocaine reward/reinforcement, as measured by conditioned place-preference testing. However, mice with no DAT and either no or one SERT gene copy display no preference for places where they have previously received cocaine. The serotonin dependence of cocaine reward in DAT knockout mice is thus confirmed by the elimination of cocaine place preference in DAT/SERT double knockout mice. These results provide insights into the brain molecular targets necessary for cocaine reward in knockout mice that develop in their absence and suggest novel strategies for anticocaine medication development.

Decreased brain reward produced by ethanol withdrawal.

Abstinence from chronic administration of various drugs of abuse such as ethanol, opiates, and psychostimulants results in withdrawal syndromes largely unique to each drug class. However, one symptom that appears common to these withdrawal syndromes in humans is a negative affective/motivational state. Prior work in rodents has shown that elevations in intracranial self-stimulation (ICSS) reward thresholds provide a quantitative index that serves as a model for the negative affective state during withdrawal from psychostimulants and opiates. The current study sought to determine whether ICSS threshold elevations also accompany abstinence from chronic ethanol exposure sufficient to induce physical dependence. Rats prepared with stimulating electrodes in the lateral hypothalamus were trained in a discrete-trial current-intensity ICSS threshold procedure; subsequently they were subjected to chronic ethanol administration in ethanol vapor chambers (average blood alcohol level of 197 mg/dl). A time-dependent elevation in ICSS thresholds was observed following removal from the ethanol, but not the control, chambers. Thresholds were significantly elevated for 48 hr after cessation of ethanol exposure, with peak elevations observed at 6-8 hr. Blood alcohol levels were directly correlated with the magnitude of peak threshold elevation. Ratings of traditional overt signs of withdrawal showed a similar time course of expression and resolution. The results suggest that decreased function of reward systems (elevations in reward thresholds) is a common element of withdrawal from chronic administration of several diverse classes of abused drugs.

Grasshopper crop and midgut extract effects on plants: an example of reward feedback.

Acid extracts and a resultant fraction from solid-phase extraction (SPE) of Romalea guttata crop and midgut tissues induce sorghum (Sorghum bicolor var. Rio) coleoptile growth in 24-h incubations an average of 49% above untreated controls. When combined with plant auxin, indole-3-acetic acid (IAA), the SPE fraction shows a synergistic reaction, yielding increases in coleoptile growth that average 295% above untreated controls and 8% above IAA standards. The interaction lowered the point of maximum sensitivity of IAA 3 orders of magnitude, resulting in a new IAA physiological set point at 10(-7) g/ml. This synergism suggests that contents in animal regurgitants making their way into plant tissue during feeding may produce a positive feedback in plant growth and development following herbivory. Such a process, also known as reward feedback, may exert major controls on ecosystem-level relationships in nature.

Cladistic association analysis of Y chromosome effects on alcohol dependence and related personality traits

Association between Y chromosome haplotype variation and alcohol dependence and related personality traits was investigated in a large sample of psychiatrically diagnosed Finnish males. Haplotypes were constructed for 359 individuals using alleles at eight loci (seven microsatellite loci and a nucleotide substitution in the DYZ3 alphoid satellite locus). A cladogram linking the 102 observed haplotype configurations was constructed by using parsimony with a single-step mutation model. Then, a series of contingency tables nested according to the cladogram hierarchy were used to test for association between Y haplotype and alcohol dependence. Finally, using only alcohol-dependent subjects, we tested for association between Y haplotype and personality variables postulated to define subtypes of alcoholism—antisocial personality disorder, novelty seeking, harm avoidance, and reward dependence. Significant association with alcohol dependence was observed at three Y haplotype clades, with significance levels of P = 0.002, P = 0.020, and P = 0.010. Within alcohol-dependent subjects, no relationship was revealed between Y haplotype and antisocial personality disorder, novelty seeking, harm avoidance, or reward dependence. These results demonstrate, by using a fully objective association design, that differences among Y chromosomes contribute to variation in vulnerability to alcohol dependence. However, they do not demonstrate an association between Y haplotype and the personality variables thought to underlie the subtypes of alcoholism.

Response-reinforcement learning is dependent on N-methyl-d-aspartate receptor activation in the nucleus accumbens core

The nucleus accumbens, a site within the ventral striatum, is best known for its prominent role in mediating the reinforcing effects of drugs of abuse such as cocaine, alcohol, and nicotine. Indeed, it is generally believed that this structure subserves motivated behaviors, such as feeding, drinking, sexual behavior, and exploratory locomotion, which are elicited by natural rewards or incentive stimuli. A basic rule of positive reinforcement is that motor responses will increase in magnitude and vigor if followed by a rewarding event. It is likely, therefore, that the nucleus accumbens may serve as a substrate for reinforcement learning. However, there is surprisingly little information concerning the neural mechanisms by which appetitive responses are learned. In the present study, we report that treatment of the nucleus accumbens core with the selective competitive N-methyl-d-aspartate (NMDA) antagonist 2-amino-5-phosphonopentanoic acid (AP-5; 5 nmol/0.5 μl bilaterally) impairs response-reinforcement learning in the acquisition of a simple lever-press task to obtain food. Once the rats learned the task, AP-5 had no effect, demonstrating the requirement of NMDA receptor-dependent plasticity in the early stages of learning. Infusion of AP-5 into the accumbens shell produced a much smaller impairment of learning. Additional experiments showed that AP-5 core-treated rats had normal feeding and locomotor responses and were capable of acquiring stimulus-reward associations. We hypothesize that stimulation of NMDA receptors within the accumbens core is a key process through which motor responses become established in response to reinforcing stimuli. Further, this mechanism, may also play a critical role in the motivational and addictive properties of drugs of abuse.

A hierarchical neuronal network for planning behavior

Planning a goal-directed sequence of behavior is a higher function of the human brain that relies on the integrity of prefrontal cortical areas. In the Tower of London test, a puzzle in which beads sliding on pegs must be moved to match a designated goal configuration, patients with lesioned prefrontal cortex show deficits in planning a goal-directed sequence of moves. We propose a neuronal network model of sequence planning that passes this test and, when lesioned, fails in a way that mimics prefrontal patients’ behavior. Our model comprises a descending planning system with hierarchically organized plan, operation, and gesture levels, and an ascending evaluative system that analyzes the problem and computes internal reward signals that index the correct/erroneous status of the plan. Multiple parallel pathways connecting the evaluative and planning systems amend the plan and adapt it to the current problem. The model illustrates how specialized hierarchically organized neuronal assemblies may collectively emulate central executive or supervisory functions of the human brain.

A neuronal model of a global workspace in effortful cognitive tasks

A minimal hypothesis is proposed concerning the brain processes underlying effortful tasks. It distinguishes two main computational spaces: a unique global workspace composed of distributed and heavily interconnected neurons with long-range axons, and a set of specialized and modular perceptual, motor, memory, evaluative, and attentional processors. Workspace neurons are mobilized in effortful tasks for which the specialized processors do not suffice. They selectively mobilize or suppress, through descending connections, the contribution of specific processor neurons. In the course of task performance, workspace neurons become spontaneously coactivated, forming discrete though variable spatio-temporal patterns subject to modulation by vigilance signals and to selection by reward signals. A computer simulation of the Stroop task shows workspace activation to increase during acquisition of a novel task, effortful execution, and after errors. We outline predictions for spatio-temporal activation patterns during brain imaging, particularly about the contribution of dorsolateral prefrontal cortex and anterior cingulate to the workspace.

Abolition of morphine-immunosuppression in mice lacking the μ-opioid receptor gene

Opiates are potent analgesic and addictive compounds. They also act on immune responses, and morphine, the prototypic opiate, has been repeatedly described as an immunosuppressive drug. Pharmacological studies have suggested that the inhibitory action of opiates on immunity is mediated by multiple opioid receptor sites but molecular evidence has remained elusive. Recently, three genes encoding μ- (MOR), δ-, and κ-opioid receptors have been cloned. To investigate whether the μ-opioid receptor is functionally implicated in morphine immunosuppression in vivo, we have examined immune responses of mice with a genetic disruption of the MOR gene. In the absence of drug, there was no difference between wild-type and mutant mice with regard to a large number of immunological endpoints, suggesting that the lack of MOR-encoded protein has little consequence on immune status. Chronic morphine administration induced lymphoid organ atrophy, diminished the ratio of CD4+CD8+ cells in the thymus and strongly reduced natural killer activity in wild-type mice. None of these effects was observed in MOR-deficient mice after morphine treatment. This demonstrates that the MOR gene product represents a major molecular target for morphine action on the immune system. Because our previous studies of MOR-deficient mice have shown that this receptor protein is also responsible for morphine analgesia, reward, and physical dependence, the present results imply that MOR-targeted therapeutic drugs that are developed for the treatment of pain or opiate addiction may concomitantly influence immune responses.

Preferential localization of self-stimulation sites in striosomes/patches in the rat striatum

Histological sections of the mammalian striatum reveal a “matrix” that is histochemically distinguishable from patches, or “striosomes”. The latter are cross sections of a compartment that consists primarily of tube-shaped structures radiating through the matrix. As a test of the hypothesis that the function of the striosome/patch compartment includes the mediation of behaviors related to reward, the present study examined electrical self-stimulation of the caudoputamen in rats with electrodes in either of the two compartments. Rats acquired and maintained bar-pressing responses that were contingent on stimulation through electrodes making contact with striosomes/patches more reliably than animals with electrodes terminating exclusively in the matrix. The results provide in vivo evidence that the striosome/patch compartment is functionally differentiated from the matrix compartment: Stimulation centered in or around the striosome/patch compartment but not in the matrix led to rapid acquisition of a new behavior.

Cocaine-predictive stimulus induces drug-seeking behavior and neural activation in limbic brain regions after multiple months of abstinence: Reversal by D1 antagonists

The conditioning of cocaine's subjective actions with environmental stimuli may be a critical factor in long-lasting relapse risk associated with cocaine addiction. To study the significance of learning factors in persistent addictive behavior as well as the neurobiological basis of this phenomenon, rats were trained to associate discriminative stimuli (SD) with the availability of i.v. cocaine vs. nonrewarding saline solution, and then placed on extinction conditions during which the i.v. solutions and SDs were withheld. The effects of reexposure to the SD on the recovery of responding at the previously cocaine-paired lever and on Fos protein expression then were determined in two groups. One group was tested immediately after extinction, whereas rats in the second group were confined to their home cages for an additional 4 months before testing. In both groups, the cocaine SD, but not the non-reward SD, elicited strong recovery of responding and increased Fos immunoreactivity in the basolateral amygdala and medial prefrontal cortex (areas Cg1/Cg3). The response reinstatement and Fos expression induced by the cocaine SD were both reversed by selective dopamine D1 receptor antagonists. The undiminished efficacy of the cocaine SD to elicit drug-seeking behavior after 4 months of abstinence parallels the long-lasting nature of conditioned cue reactivity and cue-induced cocaine craving in humans, and confirms a significant role of learning factors in the long-lasting addictive potential of cocaine. Moreover, the results implicate D1-dependent neural mechanisms within the medial prefrontal cortex and basolateral amygdala as substrates for cocaine-seeking behavior elicited by cocaine-predictive environmental stimuli.

Negative frequency-dependent selection maintains a dramatic flower color polymorphism in the rewardless orchid Dactylorhiza sambucina (L.) Soò

The orchid Dactylorhiza sambucina shows a stable and dramatic flower-color polymorphism, with both yellow- and purple-flowered individuals present in natural populations throughout the range of the species in Europe. The evolutionary significance of flower-color polymorphisms found in many rewardless orchid species has been discussed at length, but the mechanisms responsible for their maintenance remain unclear. Laboratory experiments have suggested that behavioral responses by pollinators to lack of reward availability might result in a reproductive advantage for rare-color morphs. Consequently, we performed an experiment varying the relative frequency of the two color morphs of D. sambucina to test whether rare morph advantage acted in the natural habitat of the species. We show here clear evidence from this manipulative experiment that rare-color morphs have reproductive advantage through male and female components. This is the first demonstration, to our knowledge, that negative frequency-dependent selection through pollinator preference for rare morphs can cause the maintenance of a flower-color polymorphism.

Operant conditioning of H-reflex changes synaptic terminals on primate motoneurons.

Operant conditioning of the primate triceps surae H-reflex, the electrical analog of the spinal stretch reflex, creates a memory trace that includes changes in the spinal cord. To define the morphological correlates of this plasticity, we analyzed the synaptic terminal coverage of triceps surae motoneurons from animals in which the triceps surae H-reflex in one leg had been increased (HRup mode) or decreased (HRdown mode) by conditioning and compared them to each other and to motoneurons from unconditioned animals. Motoneurons were labeled by intramuscular injection of cholera toxin-horseradish peroxidase. A total of 5055 terminals on the cell bodies and proximal dendrites of 114 motoneurons from 14 animals were studied by electron microscopy. Significant differences were found between HRup and HRdown animals and between HRup and naive (i.e., unconditioned) animals. F terminals (i.e., putative inhibitory terminals) were smaller and their active zone coverage on the cell body was lower on motoneurons from the conditioned side of HRup animals than on motoneurons from the conditioned side of HRdown animals. C terminals (i.e., terminals associated with postsynaptic cisterns and rough endoplasmic reticulum) were smaller and the number of C terminals in each C complex (i.e., a group of contiguous C terminals) was larger on motoneurons from the conditioned side of HRup animals than on motoneurons either from the conditioned side of HRdown animals or from naive animals. Because the treatment of HRup and HRdown animals differed only in the reward contingency, the results imply that the two contingencies had different effects on motoneuron synaptic terminals. In combination with other recent data, they show that H-reflex conditioning produces a complex pattern of spinal cord plasticity that includes changes in motoneuron physiological properties as well as in synaptic terminals. Further delineation of this pattern should reveal the contribution of the structural changes described here to the learned change in behavior.