Neural basis of the undermining effect of monetary reward on intrinsic motivation

Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This “undermining effect” has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value.

Transcriptional dysregulation of coding and non-coding genes in cellular models of Huntington's disease

HD (Huntington's disease) is a late onset heritable neurodegenerative disorder that is characterized by neuronal dysfunction and death, particularly in the cerebral cortex and medium spiny neurons of the striatum. This is followed by progressive chorea, dementia and emotional dysfunction, eventually resulting in death. HD is caused by an expanded CAG repeat in the first exon of the HD gene that results in an abnormally elongated polyQ (polyglutamine) tract in its protein product, Htt (Huntingtin). Wild-type Htt is largely cytoplasmic; however, in HD, proteolytic N-terminal fragments of Htt form insoluble deposits in both the cytoplasm and nucleus, provoking the idea that mutHtt (mutant Htt) causes transcriptional dysfunction. While a number of specific transcription factors and co-factors have been proposed as mediators of mutHtt toxicity, the causal relationship between these Htt/transcription factor interactions and HD pathology remains unknown. Previous work has highlighted REST [RE1 (repressor element 1)-silencing transcription factor] as one such transcription factor. REST is a master regulator of neuronal genes, repressing their expression. Many of its direct target genes are known or suspected to have a role in HD pathogenesis, including BDNF (brain-derived neurotrophic factor). Recent evidence has also shown that REST regulates transcription of regulatory miRNAs (microRNAs), many of which are known to regulate neuronal gene expression and are dysregulated in HD. Thus repression of miRNAs constitutes a second, indirect mechanism by which REST can alter the neuronal transcriptome in HD. We will describe the evidence that disruption to the REST regulon brought about by a loss of interaction between REST and mutHtt may be a key contributory factor in the widespread dysregulation of gene expression in HD.

Anhedonia and reward-circuit connectivity distinguish nonresponders from responders to dorsomedial prefrontal rTMS in major depression

Background Depression is a heterogeneous mental illness. Neurostimulation treatments, by targeting specific nodes within the brain’s emotion-regulation network, may be useful both as therapies and as probes for identifying clinically relevant depression subtypes. Methods Here, we applied 20 sessions of magnetic resonance imaging-guided repetitive transcranial magnetic stimulation (rTMS) to the dorsomedial prefrontal cortex in 47 unipolar or bipolar patients with a medication-resistant major depressive episode. Results Treatment response was strongly bimodal, with individual patients showing either minimal or marked improvement. Compared with responders, nonresponders showed markedly higher baseline anhedonia symptomatology (including pessimism, loss of pleasure, and loss of interest in previously enjoyed activities) on item-by-item examination of Beck Depression Inventory-II and Quick Inventory of Depressive Symptomatology ratings. Congruently, on baseline functional magnetic resonance imaging, nonresponders showed significantly lower connectivity through a classical reward pathway comprising ventral tegmental area, striatum, and a region in ventromedial prefrontal cortex. Responders and nonresponders also showed opposite patterns of hemispheric lateralization in the connectivity of dorsomedial and dorsolateral regions to this same ventromedial region. Conclusions The results suggest distinct depression subtypes, one with preserved hedonic function and responsive to dorsomedial rTMS and another with disrupted hedonic function, abnormally lateralized connectivity through ventromedial prefrontal cortex, and unresponsive to dorsomedial rTMS. Future research directly comparing the effects of rTMS at different targets, guided by neuroimaging and clinical presentation, may clarify whether hedonia/reward circuit integrity is a reliable marker for optimizing rTMS target selection.

Autistic traits modulate frontostriatal connectivity during processing of rewarding faces

Deficits in facial mimicry have been widely reported in autism. Some studies have suggested that these deficits are restricted to spontaneous mimicry and do not extend to volitional mimicry. We bridge these apparently inconsistent observations, by testing the impact of reward value on neural indices of mimicry, and how autistic traits modulate this impact. Neutral faces were conditioned with high and low reward. Subsequently, functional connectivity between the ventral striatum (VS) and inferior frontal gyrus (IFG) was measured whilst neurotypical adults (n = 30) watched happy expressions made by these conditioned faces. We found greater VS-IFG connectivity in response to high-reward vs. low-reward happy faces. This difference was negatively proportional to autistic traits, suggesting that reduced spontaneous mimicry of social stimuli seen in autism, maybe related to a failure in the modulation of the mirror system by the reward system rather than a circumscribed deficit in the mirror system.

Social equality in the number of choice options is represented in the ventromedial prefrontal cortex

A distinct aspect of the sense of fairness in humans is that we care not only about equality in material rewards but also about equality in non-material values. One such value is the opportunity to choose freely among many options, often regarded as a fundamental right to economic freedom. In modern developed societies, equal opportunities in work, living, and lifestyle are enforced by anti-discrimination laws. Despite the widespread endorsement of equal opportunity, no studies have explored how people assign value to it. We used functional magnetic resonance imaging to identify the neural substrates for subjective valuation of equality in choice opportunity. Participants performed a two-person choice task in which the number of choices available was varied across trials independently of choice outcomes. By using this procedure, we manipulated the degree of equality in choice opportunity between players and dissociated it from the value of reward outcomes and their equality. We found that activation in the ventromedial prefrontal cortex tracked the degree to which the number of options between the two players was equal. In contrast, activation in the ventral striatum tracked the number of options available to participants themselves but not the equality between players. Our results demonstrate that the vmPFC, a key brain region previously implicated in the processing of social values, is also involved in valuation of equality in choice opportunity between individuals. These findings may provide valuable insight into the human ability to value equal opportunity, a characteristic long emphasized in politics, economics, and philosophy.

Effects of pramipexole on the processing of rewarding and aversive taste stimuli

Rationale: Pramipexole, a D2/D3 dopamine receptor agonist, has been implicated in the development of impulse control disorders in patients with Parkinson's disease. Investigation of single doses of pramipexole in healthy participants in reward-based learning tasks has shown inhibition of the neural processing of reward, presumptively through stimulation of dopamine autoreceptors. Objectives: This study aims to examine the effects of pramipexole on the neural response to the passive receipt of rewarding and aversive sight and taste stimuli. Methods: We used functional magnetic resonance imaging to examine the neural responses to the sight and taste of pleasant (chocolate) and aversive (mouldy strawberry) stimuli in 16 healthy volunteers who received a single dose of pramipexole (0.25 mg) and placebo in a double-blind, within-subject, design. Results: Relative to placebo, pramipexole treatment reduced blood oxygen level-dependent activation to the chocolate stimuli in the areas known to play a key role in reward, including the ventromedial prefrontal cortex, the orbitofrontal cortex, striatum, thalamus and dorsal anterior cingulate cortex. Pramipexole also reduced activation to the aversive condition in the dorsal anterior cingulate cortex. There were no effects of pramipexole on the subjective ratings of the stimuli. Conclusions: Our results are consistent with an ability of acute, low-dose pramipexole to diminish dopamine-mediated responses to both rewarding and aversive taste stimuli, perhaps through an inhibitory action of D2/3 autoreceptors on phasic burst activity of midbrain dopamine neurones. The ability of pramipexole to inhibit aversive processing might potentiate its adverse behavioural effects and could also play a role in its proposed efficacy in treatment-resistant depression.

The D2 antagonist sulpiride modulates the neural processing of both rewarding and aversive stimuli in healthy volunteers.

Rationale: Animal studies indicate that dopamine pathways in the ventral striatum code for the motivational salience of both rewarding and aversive stimuli, but evidence for this mechanism in humans is less established. We have developed a functional magnetic resonance imaging (fMRI) model which permits examination of the neural processing of both rewarding and aversive stimuli. Objectives: The aim of the study was to determine the effect of the dopamine receptor antagonist, sulpiride, on the neural processing of rewarding and aversive stimuli in healthy volunteers. Methods: We studied 30 healthy participants who were randomly allocated to receive a single dose of sulpiride (400 mg) or placebo, in a double-blind, parallel-group design. We used fMRI to measure the neural response to rewarding (taste or sight of chocolate) and aversive stimuli (sight of mouldy strawberries or unpleasant strawberry taste) 4 h after drug treatment. Results: Relative to placebo, sulpiride reduced blood oxygenation level-dependent responses to chocolate stimuli in the striatum (ventral striatum) and anterior cingulate cortex. Sulpiride also reduced lateral orbitofrontal cortex and insula activations to the taste and sight of the aversive condition. Conclusions: These results suggest that acute dopamine receptor blockade modulates mesolimbic and mesocortical neural activations in response to both rewarding and aversive stimuli in healthy volunteers. This effect may be relevant to the effects of dopamine receptor antagonists in the treatment of psychosis and may also have implications for the possible antidepressant properties of sulpiride.

Reduced neural response to reward following 7 days treatment with the cannabinoid CB1 antagonist rimonabant in healthy volunteers

Reduced subjective experience of reward (anhedonia) is a key symptom of major depression. The anti-obesity drug and cannabinoid type 1 receptor (CB(1)) antagonist, rimonabant, is associated with significant rates of depression and anxiety in clinical use and was recently withdrawn from the market because of these adverse effects. Using a functional magnetic resonance imaging (fMRI) model of reward we hypothesized that rimonabant would impair reward processing. Twenty-two healthy participants were randomly allocated to receive rimonabant (20 mg), or placebo, for 7 d in a double-blind, parallel group design. We used fMRI to measure the neural response to rewarding (sight and/or flavour of chocolate) and aversive (sight of mouldy strawberries and/or an unpleasant strawberry taste) stimuli on the final day of drug treatment. Rimonabant reduced the neural response to chocolate stimuli in key reward areas such as the ventral striatum and the orbitofrontal cortex. Rimonabant also decreased neural responses to the aversive stimulus condition in the caudate nucleus and ventral striatum, but increased lateral orbitofrontal activations to the aversive sight and taste of strawberry condition. Our findings are the first to show that the anti-obesity drug rimonabant inhibits the neural processing of rewarding food stimuli in humans. This plausibly underlies its ability to promote weight loss, but may also indicate a mechanism for inducing anhedonia which could lead to the increased risk of depressive symptomatology seen in clinical use. fMRI may be a useful method of screening novel agents for unwanted effects on reward and associated clinical adverse reactions.

Cognitive influences on the affective representation of touch and the sight of touch in the human brain

We show that the affective experience of touch and the sight of touch can be modulated by cognition, and investigate in an fMRI study where top-down cognitive modulations of bottom-up somatosensory and visual processing of touch and its affective value occur in the human brain. The cognitive modulation was produced by word labels, 'Rich moisturizing cream' or 'Basic cream', while cream was being applied to the forearm, or was seen being applied to a forearm. The subjective pleasantness and richness were modulated by the word labels, as were the fMRI activations to touch in parietal cortex area 7, the insula and ventral striatum. The cognitive labels influenced the activations to the sight of touch and also the correlations with pleasantness in the pregenual cingulate/orbitofrontal cortex and ventral striatum. Further evidence of how the orbitofrontal cortex is involved in affective aspects of touch was that touch to the forearm [which has C fiber Touch (CT) afferents sensitive to light touch] compared with touch to the glabrous skin of the hand (which does not) revealed activation in the mid-orbitofrontal cortex. This is of interest as previous studies have suggested that the CT system is important in affiliative caress-like touch between individuals.

Enhanced affective brain representations of chocolate in cravers vs. non-cravers

To examine the neural circuitry involved in food craving, in making food particularly appetitive and thus in driving wanting and eating, we used fMRI to measure the response to the flavour of chocolate, the sight of chocolate and their combination in cravers vs. non-cravers. Statistical parametric mapping (SPM) analyses showed that the sight of chocolate produced more activation in chocolate cravers than non-cravers in the medial orbitofrontal cortex and ventral striatum. For cravers vs. non-cravers, a combination of a picture of chocolate with chocolate in the mouth produced a greater effect than the sum of the components (i.e. supralinearity) in the medial orbitofrontal cortex and pregenual cingulate cortex. Furthermore, the pleasantness ratings of the chocolate and chocolate-related stimuli had higher positive correlations with the fMRI blood oxygenation level-dependent signals in the pregenual cingulate cortex and medial orbitofrontal cortex in the cravers than in the non-cravers. To our knowledge, this is the first study to show that there are differences between cravers and non-cravers in their responses to the sensory components of a craved food in the orbitofrontal cortex, ventral striatum and pregenual cingulate cortex, and that in some of these regions the differences are related to the subjective pleasantness of the craved foods. Understanding individual differences in brain responses to very pleasant foods helps in the understanding of the mechanisms that drive the liking for specific foods and thus intake of those foods.

Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task

In probabilistic decision tasks, an expected value (EV) of a choice is calculated, and after the choice has been made, this can be updated based on a temporal difference (TD) prediction error between the EV and the reward magnitude (RM) obtained. The EV is measured as the probability of obtaining a reward x RM. To understand the contribution of different brain areas to these decision-making processes, functional magnetic resonance imaging activations related to EV versus RM (or outcome) were measured in a probabilistic decision task. Activations in the medial orbitofrontal cortex were correlated with both RM and with EV and confirmed in a conjunction analysis to extend toward the pregenual cingulate cortex. From these representations, TD reward prediction errors could be produced. Activations in areas that receive from the orbitofrontal cortex including the ventral striatum, midbrain, and inferior frontal gyrus were correlated with the TD error. Activations in the anterior insula were correlated negatively with EV, occurring when low reward outcomes were expected, and also with the uncertainty of the reward, implicating this region in basic and crucial decision-making parameters, low expected outcomes, and uncertainty.

Disorder-specific functional abnormalities during temporal discounting in youth with Attention Deficit Hyperactivity Disorder (ADHD), Autism and comorbid ADHD and Autism

Attention Deficit Hyperactivity Disorder (ADHD) and Autism Spectrum Disorder (ASD) are often comorbid and share cognitive abnormalities in temporal foresight. A key question is whether shared cognitive phenotypes are based on common or different underlying pathophysiologies and whether comorbid patients have additive neurofunctional deficits, resemble one of the disorders or have a different pathophysiology. We compared age- and IQ-matched boys with non-comorbid ADHD (18), non-comorbid ASD (15), comorbid ADHD and ASD (13) and healthy controls (18) using functional magnetic resonance imaging (fMRI) during a temporal discounting task. Only the ASD and the comorbid groups discounted delayed rewards more steeply. The fMRI data showed both shared and disorder-specific abnormalities in the three groups relative to controls in their brain-behaviour associations. The comorbid group showed both unique and more severe brain-discounting associations than controls and the non-comorbid patient groups in temporal discounting areas of ventromedial and lateral prefrontal cortex, ventral striatum and anterior cingulate, suggesting that comorbidity is neither an endophenocopy of the two pure disorders nor an additive pathology.

Exogenous alpha-Synuclein decreases raft partitioning of Cav2.2 channels inducing dopamine release

alpha-Synuclein is thought to regulate neurotransmitter release through multiple interactions with presynaptic proteins, cytoskeletal elements, ion channels, and synaptic vesicles membrane. alpha-Synuclein is abundant in the presynaptic compartment, and its release from neurons and glia has been described as responsible for spreading of alpha-synuclein-derived pathology. alpha-Synuclein-dependent dysregulation of neurotransmitter release might occur via its action on surface-exposed calcium channels. Here, we provide electrophysiological and biochemical evidence to show that alpha-synuclein, applied to rat neurons in culture or striatal slices, selectively activates Cav2.2 channels, and said activation correlates with increased neurotransmitter release. Furthermore, in vivo perfusion of alpha-synuclein into the striatum also leads to acute dopamine release. We further demonstrate that alpha-synuclein reduces the amount of plasma membrane cholesterol and alters the partitioning of Cav2.2 channels, which move from raft to cholesterol-poor areas of the plasma membrane. We provide evidence for a novel mechanism through which alpha-synuclein acts from the extracellular milieu to modulate neurotransmitter release and propose a unifying hypothesis for the mechanism of alpha-synuclein action on multiple targets: the reorganization of plasma membrane microdomains.

Motor imagery-induced EEG patterns in individuals with spinal cord injury and their impact on brain–computer interface accuracy

Objective. Assimilating the diagnosis complete spinal cord injury (SCI) takes time and is not easy, as patients know that there is no ‘cure’ at the present time. Brain–computer interfaces (BCIs) can facilitate daily living. However, inter-subject variability demands measurements with potential user groups and an understanding of how they differ to healthy users BCIs are more commonly tested with. Thus, a three-class motor imagery (MI) screening (left hand, right hand, feet) was performed with a group of 10 able-bodied and 16 complete spinal-cord-injured people (paraplegics, tetraplegics) with the objective of determining what differences were present between the user groups and how they would impact upon the ability of these user groups to interact with a BCI. Approach. Electrophysiological differences between patient groups and healthy users are measured in terms of sensorimotor rhythm deflections from baseline during MI, electroencephalogram microstate scalp maps and strengths of inter-channel phase synchronization. Additionally, using a common spatial pattern algorithm and a linear discriminant analysis classifier, the classification accuracy was calculated and compared between groups. Main results. It is seen that both patient groups (tetraplegic and paraplegic) have some significant differences in event-related desynchronization strengths, exhibit significant increases in synchronization and reach significantly lower accuracies (mean (M) = 66.1%) than the group of healthy subjects (M = 85.1%). Significance. The results demonstrate significant differences in electrophysiological correlates of motor control between healthy individuals and those individuals who stand to benefit most from BCI technology (individuals with SCI). They highlight the difficulty in directly translating results from healthy subjects to participants with SCI and the challenges that, therefore, arise in providing BCIs to such individuals

Motor imagery induced EEG patterns in spinal cord injury patients and their impact on Brain-Computer Interface accuracy

OBJECTIVE: Assimilating the diagnosis complete spinal cord injury (SCI) takes time and is not easy, as patients know that there is no 'cure' at the present time. Brain-computer interfaces (BCIs) can facilitate daily living. However, inter-subject variability demands measurements with potential user groups and an understanding of how they differ to healthy users BCIs are more commonly tested with. Thus, a three-class motor imagery (MI) screening (left hand, right hand, feet) was performed with a group of 10 able-bodied and 16 complete spinal-cord-injured people (paraplegics, tetraplegics) with the objective of determining what differences were present between the user groups and how they would impact upon the ability of these user groups to interact with a BCI. APPROACH: Electrophysiological differences between patient groups and healthy users are measured in terms of sensorimotor rhythm deflections from baseline during MI, electroencephalogram microstate scalp maps and strengths of inter-channel phase synchronization. Additionally, using a common spatial pattern algorithm and a linear discriminant analysis classifier, the classification accuracy was calculated and compared between groups. MAIN RESULTS: It is seen that both patient groups (tetraplegic and paraplegic) have some significant differences in event-related desynchronization strengths, exhibit significant increases in synchronization and reach significantly lower accuracies (mean (M) = 66.1%) than the group of healthy subjects (M = 85.1%). SIGNIFICANCE: The results demonstrate significant differences in electrophysiological correlates of motor control between healthy individuals and those individuals who stand to benefit most from BCI technology (individuals with SCI). They highlight the difficulty in directly translating results from healthy subjects to participants with SCI and the challenges that, therefore, arise in providing BCIs to such individuals.