Learning reward timing in cortex through reward dependent expression of synaptic plasticity.

The ability to represent time is an essential component of cognition but its neural basis is unknown. Although extensively studied both behaviorally and electrophysiologically, a general theoretical framework describing the elementary neural mechanisms used by the brain to learn temporal representations is lacking. It is commonly believed that the underlying cellular mechanisms reside in high order cortical regions but recent studies show sustained neural activity in primary sensory cortices that can represent the timing of expected reward. Here, we show that local cortical networks can learn temporal representations through a simple framework predicated on reward dependent expression of synaptic plasticity. We assert that temporal representations are stored in the lateral synaptic connections between neurons and demonstrate that reward-modulated plasticity is sufficient to learn these representations. We implement our model numerically to explain reward-time learning in the primary visual cortex (V1), demonstrate experimental support, and suggest additional experimentally verifiable predictions.

Molecular mechanisms underlying a cellular analog of operant reward learning.

Operant conditioning is a ubiquitous but mechanistically poorly understood form of associative learning in which an animal learns the consequences of its behavior. Using a single-cell analog of operant conditioning in neuron B51 of Aplysia, we examined second-messenger pathways engaged by activity and reward and how they may provide a biochemical association underlying operant learning. Conditioning was blocked by Rp-cAMP, a peptide inhibitor of PKA, a PKC inhibitor, and by expressing a dominant-negative isoform of Ca2+-dependent PKC (apl-I). Thus, both PKA and PKC were necessary for operant conditioning. Injection of cAMP into B51 mimicked the effects of operant conditioning. Activation of PKC also mimicked conditioning but was dependent on both cAMP and PKA, suggesting that PKC acted at some point upstream of PKA activation. Our results demonstrate how these molecules can interact to mediate operant conditioning in an individual neuron important for the expression of the conditioned behavior.

Blood-oxygen-level-dependent (BOLD) signal changes in total cortex and subcortex, pain, reward, and vigilance regions during mechanical pressure pain after morphine administration

Morphine is the most common clinical choice in the management of severe pain. Although the molecular mechanisms of morphine have already been characterized, the cerebral circuits by which it attenuates the sensation of pain have not yet been studied in humans. The objective of this two-arm (morphine versus placebo), between-subjects study was to examine whether morphine affects pain via pain-related cortical circuits, but also via reward regions that relate to the motivational state, as well as prefrontal regions that relate to vigilance as a result of morphine's sedative effects. Cortical activity was measured by the blood-oxygen-level-dependent (BOLD) signal changes using functional magnetic resonance imaging (fMRI). ^ The novelty of this study is at three levels: (i) to develop a methodology that will assess the average BOLD signal across subjects for the pain, reward, and vigilance cortical systems; (ii) to examine whether the reward and/or sedative effects of morphine are contributing factors to cortical regions associated with the motivational state and vigilance; and (iii) to propose a neuroanatomical model related to the opioid-sensitive effects of reward and sedation as a function of cortical activity related to pain in an effort to assess future analgesics. ^ Consistent with our hypotheses, our findings showed that the decrease in total pain-related volume activated between the post- and the pre-treatment morphine group was about 78%, while the post-treatment placebo group displayed only a 5% decrease when compared to pre-treatment levels of activation. The volume increase in reward regions was 451% in the post-treatment compared to the pre-treatment morphine condition. Finally, the volumetric decrease in vigilance regions was 63% in the posttreatment compared to the pre-treatment morphine condition. ^ These findings imply that changes in the blood flow of the reward and vigilance regions may be contributing factors in producing the analgesic effect under morphine administration. Future studies need to replicate this study in a higher resolution fMRI environment and to assess the proposed neuroanatomical model in patient populations. The necessity of pain research is apparent, since pain cuts across different diseases especially chronic ones, and thus, is recognized as a vital public health developing area. ^

ROLE OF DOPAMINE OF NUCLEUS ACCUMBENS IN BEHAVIORAL SENSITIZATION TO METHYLPHENIDATE

Behavioral sensitization is defined as the subsequent augmentation of the locomotor response to a drug following repeated administrations of the drug. It is believed to occur due to alterations in the motive circuit in the brain by stressors, central nervous system stimulants, and similar stimuli. The motive circuit (or mesocorticolimbic system) consists of several interconnected nuclei that determine the behavioral response to significant biological stimuli. A final target of the mesocorticolimbic system is the nucleus accumbens (NAc), which is a key structure linking motivation and action. In particular, the dopaminergic innervations of the Nac are considered to be essential in regulating motivated states of behavior such as goal-directed actions, stimulus-reward associations and reinforcement by addictive substances. Therefore, the objective of this study was to investigate the role of dopaminergic afferents of the NAc in the behavioral sensitization elicited by chronic treatment with methylphenidate (MPD), a psychostimulant that is widely used to treat attention deficit hyperactivity disorder. The dopaminergic afferents can be selectively destroyed using catecholamine neurotoxin 6-hydroxydopamine (6-OHDA). In order to determine whether destruction of dopaminergic afferents of the NAc prevents sensitization, I compared locomotor activity in rats that had received infusions of 6-hydroxydopamine (6-OHDA) into the NAc with that of control and sham-operated animals. All groups of rats received six days of single daily MPD injections after measuring their pre and post surgery locomotor baseline. Following the consecutive MPD injections, there was a washout period of 4 days, where no injections were given. Then, a rechallenge injection of MPD was given. Behavioral responses after repeated MPD were compared to those after acute MPD to assess behavioral sensitization. Expression of sensitization to MPD was not prevented by 6-OHDA infusion into the NAc. Moreover, two distinct responses were seen to the acute injection of MPD: one group of rats had essentially no response to acute MPD, while the other had an augmented (‘sensitized’-like) acute response. Among rats with 6-OHDA infusions, the animals with diminished acute response to MPD had intact behavioral sensitization to repeated MPD, while the animals with increased acute response to MPD did not exhibit further sensitization to it. This suggests that the acute and chronic effects of MPD have distinct underlying neural circuitries.

Dominance of the proximal coordinate frame in determining the locations of hippocampal place cell activity during navigation.

The place-specific activity of hippocampal cells provides downstream structures with information regarding an animal's position within an environment and, perhaps, the location of goals within that environment. In rodents, recent research has suggested that distal cues primarily set the orientation of the spatial representation, whereas the boundaries of the behavioral apparatus determine the locations of place activity. The current study was designed to address possible biases in some previous research that may have minimized the likelihood of observing place activity bound to distal cues. Hippocampal single-unit activity was recorded from six freely moving rats as they were trained to perform a tone-initiated place-preference task on an open-field platform. To investigate whether place activity was bound to the room- or platform-based coordinate frame (or both), the platform was translated within the room at an "early" and at a "late" phase of task acquisition (Shift 1 and Shift 2). At both time points, CA1 and CA3 place cells demonstrated room-associated and/or platform-associated activity, or remapped in response to the platform shift. Shift 1 revealed place activity that reflected an interaction between a dominant platform-based (proximal) coordinate frame and a weaker room-based (distal) frame because many CA1 and CA3 place fields shifted to a location intermediate to the two reference frames. Shift 2 resulted in place activity that became more strongly bound to either the platform- or room-based coordinate frame, suggesting the emergence of two independent spatial frames of reference (with many more cells participating in platform-based than in room-based representations).

Development of micro-electrospray mass spectrometry for ultra high sensitivity and application in the study of drugs of abuse on endogenous \lbrack Met\rbrack $\sp5$-enkephalin release

A micro-electrospray interface was developed specifically for the neurobiological applications described in this dissertation. Incorporation of a unique nano-flow liquid chromatography micro-electrospray "needle" into the micro-electrospray interface (micro-ES/MS) increased the sensitivity of the mass spectrometric assay by $\sim$1000 fold and thus permitted the first analysis of specific neuroactive compounds in brain extracellular fluid collected by in vivo microdialysis (Md).^ Initial in vivo data presented deals with the pharmacodynamics of a novel GABA$\sb{\rm B}$ antagonist and the availability of the compound in its parent (unmetabolized) form to the brain of the anesthetized rat. Next, the first structurally specific endogenous release of (Met) $\sp5$-enkephalin was demonstrated in unanesthetized freely-moving animals (release of $\sim$6.5 fmole of (Met) $\sp5$-enkephalin into the dialysate by direct neuronal depolarization). The Md/micro-ES/MS system was used to test the acute effects of drugs of abuse on the endogenous release of (Met) $\sp5$-enkephalin from the globus pallidus/ventral pallidum brain region in rats. Four drugs known to be abused by man (morphine, cocaine, methamphetamine and diazepam) were tested. Morphine and cocaine both elicited a two-fold or more increase in the release of (Met) $\sp5$-enkephalin over vehicle controls. Diazepam elicited a small decrease in (Met) $\sp5$-enkephalin levels and methamphetamine showed no significant effect on (Met) $\sp5$-enkephalin. These results imply that (Met) $\sp5$-enkephalin may be involved in the reward pathway of certain drugs of abuse. ^

Behavioral effects of plasma tryptophan depletion in aggressive and nonaggressive men

Serotonin (5-HT) neurotransmission deficits have been implicated in impulsive aggression. A Trp-free beverage of amino acids competitively inhibits Trp uptake into the brain for 5-HT synthesis and also lowers endogenous plasma Trp for several hours. This has worsened mood and/or increased aggressive behavior, especially in hostile persons or those with histories of depression. In 24 community-recruited men (12 each with and without significant aggression histories), aggressive and impulsive behavior in the laboratory was assessed before and after plasma Trp depletion and Trp loading. In the aggression model, subjects were provoked by periodic subtractions of participation earnings, and these subtractions were blamed on a ficitious other participant. Aggression was measured as the responses the subject made to subtract money from his antagonist. Impulsiveness was operationalized as: (1) the choice of smaller reward after a shorter delay over having to wait longer to receive a larger reward, and (2) “false alarm” commission errors in a modified Continuous Performance Task, which represent a failure to inhibit responding to stimuli similar (but not identical) to target stimuli. Finally, plasma cortisol and Trp were measured under each condition immediately following a aggression testing session when subjects were highly provoked. I hypothesized that 5-HT may tonically modulate (inhibit) the hypothalmnic-pituitary-adrenal stress response, such that Trp depletion may enhance the cortisol response to high provocation in aggressive men. ^ Trp depletion had no effect in the laboratory tasks purported to measure impulsive behavior, and failed to cause increases in aggressive behavior under low provocation conditions. Under higher provocation, however, aggressive responses we re elevated under Trp-depleted conditions relative to Trp-loaded conditions in aggressive men, whereas the reverse was true in nonaggressive men. Cortisol levels nonsignificantly paralled the group differences in aggression under Trp-depleted and Trp-loaded conditions. Aggressive men achieved lower plasma Trp levels after Trp loading than did nonaggressive men, possibly due to heavy alcohol use histories. The high post-loading plasma Trp levels in nonaggressive men tended also to correlate with their aggressive responding rates, due perhaps to increases in other psychoactive Trp metabolites. ^

The opioid antagonist naltrexone and its pharmacological role in treating alcohol dependence: A literature review

Naltrexone, an opioid antagonist, was the second drug approved for treatment of alcohol dependence in the U.S. Its approval followed two landmark studies published in the U.S. in 1992. [1, 2] These studies showed that a combined treatment of naltrexone and behavioral therapy reduced alcohol consumption in alcoholics. Opioid antagonists decrease craving for alcohol and help to reduce drinking by blocking opioid peptide receptors in the body that are active in a dopamine chemical reward system. ^ Despite their usefulness, opioid antagonists have been underutilized. Health providers not educated in the use of opioid antagonists hold the view that opioid antagonist therapy is ineffective. However, it is apparent from the relevant literature that this therapy, when properly understood and targeted, has the potential to make a positive contribution in treating alcohol dependent patients. ^ This thesis will review the scientific literature and the present body of knowledge regarding opioid antagonists (naltrexone) and their pharmacological role in treating alcohol dependence.^

Relationship between parental feeding practices and weight status in a lower socioeconomic pre-school population

High prevalence of overweight and obesity among preschool children in the low income population is consistently documented in research with one of every seven low-income, preschool-aged children classified as obese. Parental feeding practices have the potential to be contributing factors to the obesity epidemic. However, the impact of parental feeding practices on obesity in preschool age children has not been well explored. The purpose of this study was to determine relationships between the parental feeding practices of using dessert, sweets or candy as a reward for finishing foods, restricting dessert if the child does not finish their plate at dinner, asking the child to consume everything on their plate at dinner, and having family dinners to obesity in low income, preschool age children.^ A cross-sectional secondary data analysis was completed using the STATA 11 statistical software. Descriptive statistics were completed to summarize demographic and BMI data of participants, as well as parental feeding behavior variables. Pearson’s correlation was implemented to determine a correlation between parental feeding behavior variables and BMI z scores. Predictive relationships between the variables were explored through multivariable linear regression analysis. Regression analyses were also completed factoring in the confounders of gender, age, and ethnicity.^ Results revealed (1) no significant correlations or predictive trends between the use of rewards, forced consumption, or family dinner and BMI in low income preschool age children, and (2) a significant negative correlation and predictive trend between restriction of desserts and BMI in low income preschool age children. Since the analysis supported the null hypothesis for the practices of reward use, forced consumption, and family dinner, these practices are not considered risk factors for obese level BMIs. The inverse association found for practice of restriction and BMI suggests it is unnecessary to discourage parents from using restriction. Limitations of the study included the sample size, reliability of the answers provided on the Healthy Home Survey by participant guardians, and generalizability of the sample to the larger population.^

Relationships of impulsivity and physical fighting history to alcohol -induced aggression in women

Research suggests women respond to the aggression-inducing effects of alcohol in a manner similar to men. Highly aggressive men are more prone to alcohol-induced aggression, but this relationship is less clear for women. This study examined whether alcohol consumption would differentially affect laboratory-measured aggression in a sample of aggressive and non-aggressive women and how those differences might be related to components of impulsive behavior. In 39 women recruited from the community (two groups: with and without histories of physical fighting) ages 21–40, laboratory aggressive behavior was assessed following placebo and 0.80 g/kg alcohol consumption (all women experienced both conditions). Baseline laboratory impulsive behavior of three impulsivity models was later assessed in the same women. In the aggression model (PSAP), participants were provoked by periodic subtractions of money, which were blamed on a fictitious partner. Aggression was operationalized as the responses the participant made to subtract money from that partner. The three components of impulsivity that were tested included: (1) response initiation (IMT/DMT), premature responses made prior to the completion of stimulus processing, (2) response inhibition (GoStop), a failure to inhibit an already initiated response, and (3) consequence sensitivity (SKIP and TCIP), the choice for a smaller-sooner reward over a larger-later reward. I hypothesized that, compared to women with no history of physical fighting, women with a history of physical fighting would exhibit higher rates of alcohol-induced laboratory aggression and higher rates of baseline impulsive responding (particularly for the IMT/DMT), which would also be related to the alcohol-induced increases aggression. Consistent with studies in men, the aggressive women showed strong associations between laboratory aggression and self-report measures, while the non-aggressive women did not. However, unlike men, following alcohol consumption it was the non-aggressive women's laboratory aggression that was related to their self-reports of aggression and impulsivity. Additionally, response initiation measures of impulsivity distinguished the two groups, while response inhibition and consequence sensitivity measures did not; commission error rates on the IMT/DMT were higher in the aggressive women compared to the non-aggressive women. Regression analyses of the behavioral measures showed no relationship between the aggression and impulsivity performance of the two groups. These results suggest that the behavioral (and potentially biological) mechanism underlying aggressive behavior of women is different than that of men. ^