Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task

In probabilistic decision tasks, an expected value (EV) of a choice is calculated, and after the choice has been made, this can be updated based on a temporal difference (TD) prediction error between the EV and the reward magnitude (RM) obtained. The EV is measured as the probability of obtaining a reward x RM. To understand the contribution of different brain areas to these decision-making processes, functional magnetic resonance imaging activations related to EV versus RM (or outcome) were measured in a probabilistic decision task. Activations in the medial orbitofrontal cortex were correlated with both RM and with EV and confirmed in a conjunction analysis to extend toward the pregenual cingulate cortex. From these representations, TD reward prediction errors could be produced. Activations in areas that receive from the orbitofrontal cortex including the ventral striatum, midbrain, and inferior frontal gyrus were correlated with the TD error. Activations in the anterior insula were correlated negatively with EV, occurring when low reward outcomes were expected, and also with the uncertainty of the reward, implicating this region in basic and crucial decision-making parameters, low expected outcomes, and uncertainty.

Disorder-specific functional abnormalities during temporal discounting in youth with Attention Deficit Hyperactivity Disorder (ADHD), Autism and comorbid ADHD and Autism

Attention Deficit Hyperactivity Disorder (ADHD) and Autism Spectrum Disorder (ASD) are often comorbid and share cognitive abnormalities in temporal foresight. A key question is whether shared cognitive phenotypes are based on common or different underlying pathophysiologies and whether comorbid patients have additive neurofunctional deficits, resemble one of the disorders or have a different pathophysiology. We compared age- and IQ-matched boys with non-comorbid ADHD (18), non-comorbid ASD (15), comorbid ADHD and ASD (13) and healthy controls (18) using functional magnetic resonance imaging (fMRI) during a temporal discounting task. Only the ASD and the comorbid groups discounted delayed rewards more steeply. The fMRI data showed both shared and disorder-specific abnormalities in the three groups relative to controls in their brain-behaviour associations. The comorbid group showed both unique and more severe brain-discounting associations than controls and the non-comorbid patient groups in temporal discounting areas of ventromedial and lateral prefrontal cortex, ventral striatum and anterior cingulate, suggesting that comorbidity is neither an endophenocopy of the two pure disorders nor an additive pathology.

Reply to: punishing food: what brain activity can tell us about the representation of food in recovered anorexia nervosa

Eating disorders are characterized by aberrant cognitions and behaviors around food. We used a novel functional magnetic resonance imaging task in a sample of recovered anorexia nervosa subjects to study the neural response to both pleasant and aversive food tastes and pictures compared with a group of matched female subjects who had never had the disorder. We report that individuals recovered from anorexia nervosa have an increased neural response to rewarding and aversive food stimuli, in the form of chocolate (e.g., in the ventral striatum) and moldy strawberries (e.g., in the caudate).

Enhanced neural response to anticipation, effort and consummation of reward and aversion during Bupropion treatment

Background We have previously shown that the selective serotonergic re-uptake inhibitor, citalopram, reduces the neural response to reward and aversion in healthy volunteers. We suggest that this inhibitory effect might underlie the emotional blunting reported by patients on these medications. Bupropion is a dopaminergic and noradrenergic re-uptake inhibitor and has been suggested to have more therapeutic effects on reward-related deficits. However, how bupropion affects the neural responses to reward and aversion is unclear. Methods 17 healthy volunteers (9 female, 8 male) received 7 days of bupropion (150 mg/day) and 7 days of placebo treatment, in a double-blind crossover design. Our functional Magnetic Resonance Imaging task consisted of 3 phases; an anticipatory phase (pleasant or unpleasant cue), an effort phase (button presses to achieve a pleasant taste or to avoid an unpleasant taste) and a consummatory phase (pleasant or unpleasant tastes). Volunteers also rated wanting, pleasantness and intensity of the tastes. Results Relative to placebo, bupropion increased activity during the anticipation phase in the ventral medial prefrontal cortex (vmPFC) and caudate. During the effort phase, bupropion increased activity in the vmPFC, striatum, dorsal anterior cingulate cortex and primary motor cortex. Bupropion also increased medial orbitofrontal cortex, amygdala and ventral striatum activity during the consummatory phase. Conclusions Our results are the first to show that bupropion can increase neural responses during the anticipation, effort and consummation of rewarding and aversive stimuli. This supports the notion that bupropion might be beneficial for depressed patients with reward-related deficits and blunted affect.

Neural signals of “Intensity” but not “Wanting” or “Liking” of rewards may be trait markers for depression

We have shown previously that particpants “at risk” of depression have decreased neural processing of reward suggesting this might be a neural biomarker for depression. However, how the neural signal related to subjective experiences of reward (wanting, liking, intensity) might differ as trait markers for depression, is as yet unknown. Using SPM8 parametric modulation analysis the neural signal related to the subjective report of wanting, liking and intensity was compared between 25 young people with a biological parent with depression (FH) and 25 age/gender matched controls. In a second study the neural signal related to the subjective report of wanting, liking and intensity was compared between 13 unmedicated recovered depressed (RD) patients and 14 healthy age/gender matched controls. The analysis revealed differences in the neural signal for wanting, liking and intensity ratings in the ventral striatum, dmPFC and caudate respectively in the RD group compared to controls . Despite no differences in the FH groups neural signal for wanting and liking there was a difference in the neural signal for intensity ratings in the dACC and anterior insula compared to controls. These results suggest that the neural substrates tracking the intensity but not the wanting or liking for rewards and punishers might be a trait marker for depression.

Maternal immune activation in late gestation enhances locomotor response to acute but not chronic amphetamine treatment in male mice offspring: Role of the D1 receptor

Exposure to elevated levels of maternal cytokines can lead to functional abnormalities of the dopaminergic system in the adult offspring, including enhanced amphetamine (AMPH)-induced locomotion. Therefore, it seems reasonable to consider that offspring of challenged mothers would behave differently in models of addictive behavior, such as behavioral sensitization. Thus, we sought to evaluate the effects of prenatal exposure to lipopolysaccharide (LPS) on the locomotor response to acute and chronic AMPH treatment in male mice offspring. For this purpose, LPS (Escherichia coli 0127:B8; 120 mu g/kg) was administered intraperitoneally to pregnant Swiss mice on gestational day 17. At adulthood, male offspring were studied under one of the following conditions: (1) locomotor response to acute AMPH treatment (2.5 or 5.0 mg/kg) in an open field test; (2) behavioral sensitization paradigm, which consists of a daily injection of AMPH (1.0 mg/kg) for 10 days and observation of locomotion in the open field on days 1, 5, 10 (development phase), 15 and 17 (expression phase). The LPS stimulated offspring showed enhancement of the locomotor-stimulant effect after an acute AMPH challenge in comparison to baseline and saline pre-treated mice. They also showed development of behavioral sensitization earlier than the saline pre-treated group, although no changes between saline and LPS pre-treated groups were observed on development or expression of locomotor behavioral sensitization to AMPH. Furthermore, there was up-regulation of D1 receptor protein level within striatum in the LPS-stimulated offspring which was strongly correlated with increased grooming behavior. Taken together, our results indicate that motor and dopaminergic alterations caused by maternal immune activation are restricted to the acute AMPH challenge, mostly due to up-regulation of the D1 receptor within the mesolimbic and nigrostriatal pathways, but no locomotor differences were observed for behavioral sensitization to AMPH. (C) 2012 Elsevier B.V. All rights reserved.

Functional and neural mechanisms of intertemporal choice

People are daily faced with intertemporal choice, i.e., choices differing in the timing of their consequences, frequently preferring smaller-sooner rewards over larger-delayed ones, reflecting temporal discounting of the value of future outcomes. This dissertation addresses two main goals. New evidence about the neural bases of intertemporal choice is provided. Following the disruption of either the medial orbitofrontal cortex or the insula, the willingness to wait for larger-delayed outcomes is affected in odd directions, suggesting the causal involvement of these areas in regulating the value computation of rewards available with different timings. These findings were also supported by a reported imaging study. Moreover, this dissertation provides new evidence about how temporal discounting can be modulated at a behavioral level through different manipulations, e.g., allowing individuals to think about the distant time, pairing rewards with aversive events, or changing their perceived spatial position. A relationship between intertemporal choice, moral judgements and aging is also discussed. All these findings link together to support a unitary neural model of temporal discounting according to which signals coming from several cortical (i.e., medial orbitofrontal cortex, insula) and subcortical regions (i.e., amygdala, ventral striatum) are integrated to represent the subjective value of both earlier and later rewards, under the top-down regulation of dorsolateral prefrontal cortex. The present findings also support the idea that the process of outcome evaluation is strictly related to the ability to pre-experience and envision future events through self-projection, the anticipation of visceral feelings associated with receiving rewards, and the psychological distance from rewards. Furthermore, taking into account the emotions and the state of arousal at the time of decision seems necessary to understand impulsivity associated with preferring smaller-sooner goods in place of larger-later goods.

Dopaminergic modulation of the reward system in schizophrenia: A placebo-controlled dopamine depletion fMRI study

Background The brain reward circuitry innervated by dopamine is critically disturbed in schizophrenia. This study aims to investigate the role of dopamine-related brain activity during prediction of monetary reward and loss in first episode schizophrenia patients. Methods We measured blood–oxygen-level dependent (BOLD) activity in 10 patients with schizophrenia (SCH) and 12 healthy controls during dopamine depletion with α-methylparatyrosine (AMPT) and during a placebo condition (PLA). Results AMPT reduced the activation of striatal and cortical brain regions in SCH. In SCH vs. controls reduced activation was found in the AMPT condition in several regions during anticipation of reward and loss, including areas of the striatum and frontal cortex. In SCH vs. controls reduced activation of the superior temporal gyrus and posterior cingulate was observed in PLA during anticipation of rewarding stimuli. PLA patients had reduced activation in the ventral striatum, frontal and cingulate cortex in anticipation of loss. The findings of reduced dopamine-related brain activity during AMPT were verified by reduced levels of dopamine in urine, homovanillic-acid in plasma and increased prolactin levels. Conclusions Our results indicate that dopamine depletion affects functioning of the cortico-striatal reward circuitry in SCH. The findings also suggest that neuronal functions associated with dopamine neurotransmission and attribution of salience to reward predicting stimuli are altered in schizophrenia.

"When we like what we know – A parametric fMRI analysis of beauty and familiarity"

This paper presents a neuroscientific study of aesthetic judgments on written texts. In an fMRI experiment participants read a number of proverbs without explicitly evaluating them. In a post-scan rating they rated each item for familiarity and beauty. These individual ratings were correlated with the functional data to investigate the neural correlates of implicit aesthetic judgments. We identified clusters in which BOLD activity was correlated with individual post-scan beauty ratings. This indicates that some spontaneous aesthetic evaluation takes place during reading, even if not required by the task. Positive correlations were found in the ventral striatum and in medial prefrontal cortex, likely reflecting the rewarding nature of sentences that are aesthetically pleasing. On the contrary, negative correlations were observed in the classic left frontotemporal reading network. Midline structures and bilateral temporo-parietal regions correlated positively with familiarity, suggesting a shift from the task-network towards the default network with increasing familiarity.

Comparative Behavioral and Neural Effects of Tryptophan and Catecholamine Depletion in Remitted Depression

Background: Despite immense efforts into development of new antidepressant drugs, the increases of serotoninergic and catechominergic neurotransmission have remained the two major pharmacodynamic principles of current drug treatments for depression. Consequently, psychopathological or biological markers that predict response to drugs that selectively increase serotonin and/or catecholamine neurotransmission hold the potential to optimize the prescriber’s selection among currently available treatment options. The aim of this study was to elucidate the differential symptomatology and neurophysiology in response to reductions in serotonergic versus catecholaminergic neurotransmission in subjects at high risk of depression recurrence. Methods: Using identical neuroimaging procedures with [18F] fluorodeoxyglucose positron emission tomography after tryptophan depletion (TD) and catecholamine depletion (CD), subjects with remitted depression were compared to healthy controls in a double-blind, randomized, crossover design. Results: While TD induced significantly more depressed mood, sadness and hopelessness than CD, CD induced more inactivity, concentration difficulties, lassitude and somatic anxiety than TD. CD specifically increased glucose metabolism in the bilateral ventral striatum and decreased glucose metabolism in the bilateral orbitofrontal cortex, whereas TD specifically increased metabolism in the right prefrontal cortex and the posterior cingulate cortex (PCC). While we found direct associations between changes in brain metabolism and induced depressive symptoms following CD, the relationship between neural activity and symptoms was less clear after TD. Conclusions: In conclusion, this study showed that serotonin and catecholamines play common and differential roles in the pathophysiology of depression.

Neural patterns underlying social comparisons of personal performance

Humans often evaluate their abilities by comparing their personal performance with that of others. For this process, it is critical whether the comparison turns out in one's favor or against it. Here, we investigate how social comparisons of performance are encoded and integrated on the neural level. We collected functional magnetic resonance images while subjects answered questions in a knowledge quiz that was related to their profession. After each question, subjects received a feedback about their personal performance, followed by a feedback about the performance of a reference group who had been quizzed beforehand. Based on the subjects' personal performance, we divided trials in downward and upward comparisons. We found that upward comparisons correlated with activity in the dorsolateral prefrontal cortex and the anterior insula. Downward comparisons were associated with increased activation in the ventral striatum (VS), the medial orbitofrontal cortex and the ventral anterior cingulate cortex (ACC). The extent to which subjects outperformed the reference group modulated the activity in the VS and in the dorsal ACC. We suggest that the co-activation of the VS and the dorsal ACC contributes to the integration of downward comparisons into the evaluation of personal performance.

Neural correlates of anticipation risk reflect risk preferences

Individual risk preferences have a large influence on decisions, such as financial investments, career and health choices, or gambling. Decision making under risk has been studied both behaviorally and on a neural level. It remains unclear, however, how risk attitudes are encoded and integrated with choice. Here, we investigate how risk preferences are reflected in neural regions known to process risk. We collected functional magnetic resonance images of 56 human subjects during a gambling task (Preuschoff et al., 2006). Subjects were grouped into risk averters and risk seekers according to the risk preferences they revealed in a separate lottery task. We found that during the anticipation of high-risk gambles, risk averters show stronger responses in ventral striatum and anterior insula compared to risk seekers. In addition, risk prediction error signals in anterior insula, inferior frontal gyrus, and anterior cingulate indicate that risk averters do not dissociate properly between gambles that are more or less risky than expected. We suggest this may result in a general overestimation of prospective risk and lead to risk avoidance behavior. This is the first study to show that behavioral risk preferences are reflected in the passive evaluation of risky situations. The results have implications on public policies in the financial and health domain.

BDNF Val66Met polymorphism influence on striatal blood-level-dependent response to monetary feedback depends on valence and agency

Animal work implicates the brain-derived neurotrophic factor (BDNF) in function of the ventral striatum (VS), a region known for its role in processing valenced feedback. Recent evidence in humans shows that BDNF Val66Met polymorphism modulates VS activity in anticipation of monetary feedback. However, it remains unclear whether the polymorphism impacts the processing of self-attributed feedback differently from feedback attributed to an external agent. In this study, we emphasize the importance of the feedback attribution because agency is central to computational accounts of the striatum and cognitive accounts of valence processing. We used functional magnetic resonance imaging and a task, in which financial gains/losses are either attributable to performance (self-attributed, SA) or chance (externally-attributed, EA) to ask whether BDNF Val66Met polymorphism predicts VS activity. We found that BDNF Val66Met polymorphism influenced how feedback valence and agency information were combined in the VS and in the right inferior frontal junction (IFJ). Specifically, Met carriers' VS response to valenced feedback depended on agency information, while Val/Val carriers' VS response did not. This context-specific modulation of valence effectively amplified VS responses to SA losses in Met carriers. The IFJ response to SA losses also differentiated Val/Val from Met carriers. These results may point to a reduced allocation of attention and altered motivational salience to SA losses in Val/Val compared to Met carriers. Implications for major depressive disorder are discussed.

Serotonin versus catecholamine deficiency: behavioral and neural effects of experimental depletion in remitted depression

Despite immense efforts into development of new antidepressant drugs, the increases of serotoninergic and catecholaminergic neurotransmission have remained the two major pharmacodynamic principles of current drug treatments for depression. Consequently, psychopathological or biological markers that predict response to drugs that selectively increase serotonin and/or catecholamine neurotransmission hold the potential to optimize the prescriber's selection among currently available treatment options. The aim of this study was to elucidate the differential symptomatology and neurophysiology in response to reductions in serotonergic versus catecholaminergic neurotransmission in subjects at high risk of depression recurrence. Using identical neuroimaging procedures with [(18)F] fluorodeoxyglucose positron emission tomography after tryptophan depletion (TD) and catecholamine depletion (CD), subjects with remitted depression were compared with healthy controls in a double-blind, randomized, crossover design. Although TD induced significantly more depressed mood, sadness and hopelessness than CD, CD induced more inactivity, concentration difficulties, lassitude and somatic anxiety than TD. CD specifically increased glucose metabolism in the bilateral ventral striatum and decreased glucose metabolism in the bilateral orbitofrontal cortex, whereas TD specifically increased metabolism in the right prefrontal cortex and the posterior cingulate cortex. Although we found direct associations between changes in brain metabolism and induced depressive symptoms following CD, the relationship between neural activity and symptoms was less clear after TD. In conclusion, this study showed that serotonin and catecholamines have common and differential roles in the pathophysiology of depression.

Amygdala response to self-critical stimuli and symptom improvement in psychotherapy for depression

Background: Cognitive–behavioural therapy is efficacious in the treatment of major depressive disorder but response rates are still far from satisfactory. Aims: To better understand brain responses to individualised emotional stimuli and their association with outcome, to enhance treatment. Method: Functional magnetic resonance imaging data were collected prior to individual psychotherapy. Differences in brain activity during passive viewing of individualised self-critical material in 23 unmedicated out-patients with depression and 28 healthy controls were assessed. The associations between brain activity, cognitive and emotional change, and outcome were analysed in 21 patients. Results: Patients showed enhanced activity in the amygdala and ventral striatum compared with the control group. Non-response to therapy was associated with enhanced activity in the right amygdala compared with those who responded, and activity in this region was negatively associated with outcome. Emotional but not cognitive changes mediated this association. Conclusions: Amygdala hyperactivity may lessen symptom improvement in psychotherapy for depression through attenuating emotional skill acquisition.