Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task

In probabilistic decision tasks, an expected value (EV) of a choice is calculated, and after the choice has been made, this can be updated based on a temporal difference (TD) prediction error between the EV and the reward magnitude (RM) obtained. The EV is measured as the probability of obtaining a reward x RM. To understand the contribution of different brain areas to these decision-making processes, functional magnetic resonance imaging activations related to EV versus RM (or outcome) were measured in a probabilistic decision task. Activations in the medial orbitofrontal cortex were correlated with both RM and with EV and confirmed in a conjunction analysis to extend toward the pregenual cingulate cortex. From these representations, TD reward prediction errors could be produced. Activations in areas that receive from the orbitofrontal cortex including the ventral striatum, midbrain, and inferior frontal gyrus were correlated with the TD error. Activations in the anterior insula were correlated negatively with EV, occurring when low reward outcomes were expected, and also with the uncertainty of the reward, implicating this region in basic and crucial decision-making parameters, low expected outcomes, and uncertainty.

How reward and emotional stimuli induce different reactions across the menstrual cycle

Despite widespread belief that moods are affected by the menstrual cycle, researchers on emotion and reward have not paid much attention to the menstrual cycle until recently. However, recent research has revealed different reactions to emotional stimuli and to rewarding stimuli across the different phases of the menstrual cycle. The current paper reviews the emerging literature on how ovarian hormone fluctuation during the menstrual cycle modulates reactions to emotional stimuli and to reward. Behavioral and neuroimaging studies in humans suggest that estrogen and progesterone have opposing influences. That is, it appears that estrogen enhances reactions to reward, but progesterone counters the facilitative effects of estrogen and decreases reactions to rewards. In contrast, reactions to emotionally arousing stimuli (particularly negative stimuli) appear to be decreased by estrogen but enhanced by progesterone. Potential factors that can modulate the effects of the ovarian hormones (e.g., an inverse quadratic function of hormones’ effects; the structural changes of the hippocampus across the menstrual cycle) are also discussed.

Brain activity in advantageous and disadvantageous situations: implications for reward/punishment sensitivity in different situations

OBJECTIVE: This study modeled win and lose trials in a simple gambling task to examine the effect of entire win-lose situations (WIN, LOSS, or TIE) on single win/lose trials and related neural underpinnings. METHODS: The behavior responses and brain activities of 17 participants were recorded by an MRI scanner while they performed a gambling task. Different conditions were compared to determine the effect of the task on the behavior and brain activity of the participants. Correlations between brain activity and behavior were calculated to support the imaging results. RESULTS: In win trials, LOSS caused less intense posterior cingulate activity than TIE. In lose trials, LOSS caused more intense activity in the right superior temporal gyrus, bilateral superior frontal gyrus, bilateral anterior cingulate, bilateral insula cortex, and left orbitofrontal cortex than WIN and TIE. CONCLUSIONS: The experiences of the participants in win trials showed great similarity among different win-lose situations. However, the brain activity and behavior responses of the participants in lose trials indicated that they experienced stronger negative emotion in LOSS. The participants also showed an increased desire to win in LOSS than in WIN or TIE conditions.

Building employee relationships through corporate social responsibility: the moderating role of social cynicism and reward for application

We explore the role of deeply held beliefs, known as social axioms, in the context of employee–organization relationships. Specifically, we examine how the beliefs identified as social cynicism and reward for application moderate the relationship between employees’ work-related experiences, perceptions of CSR, attitudes, and behavioral intentions toward their firm. Utilizing a sample of 130 retail employees, we find that CSR affects more positively employees low on social cynicism and reduces distrust more so than with cynical employees. Employees exhibiting strong reward for application are less positively affected by CSR, whereas their experiences of other work-related factors are more likely to reduce distrust. Our findings suggest the need for a differentiated view of CSR in the context of employee studies and offer suggestions for future research and management practice.

Neural effects of cannabinoid CB1 neutral antagonist tetrahydrocannabivarin (THCv) on food reward and aversion in healthy volunteers

Disturbances in the regulation of reward and aversion in the brain may underlie disorders such as obesity and eating disorders. We previously showed that the cannabis receptor subtype (CB1) inverse agonist rimonabant, an antiobesity drug withdrawn due to depressogenic side effects, diminished neural reward responses yet increased aversive responses (Horder et al., 2010). Unlike rimonabant, tetrahydrocannabivarin is a neutral CB1 receptor antagonist (Pertwee, 2005) and may therefore produce different modulations of the neural reward system. We hypothesized that tetrahydrocannabivarin would, unlike rimonabant, leave intact neural reward responses but augment aversive responses. Methods: We used a within-subject, double-blind design. Twenty healthy volunteers received a single dose of tetrahydrocannabivarin (10mg) and placebo in randomized order on 2 separate occasions. We measured the neural response to rewarding (sight and/or flavor of chocolate) and aversive stimuli (picture of moldy strawberries and/or a less pleasant strawberry taste) using functional magnetic resonance imaging. Volunteers rated pleasantness, intensity, and wanting for each stimulus. Results: There were no significant differences between groups in subjective ratings. However, tetrahydrocannabivarin increased responses to chocolate stimuli in the midbrain, anterior cingulate cortex, caudate, and putamen. Tetrahydrocannabivarin also increased responses to aversive stimuli in the amygdala, insula, mid orbitofrontal cortex, caudate, and putamen. Conclusions: Our findings are the first to show that treatment with the CB1 neutral antagonist tetrahydrocannabivarin increases neural responding to rewarding and aversive stimuli. This effect profile suggests therapeutic activity in obesity, perhaps with a lowered risk of depressive side effects. Keywords: reward, THCv, obesity, fMRI, cannabinoid

Satiation attenuates BOLD activity in brain regions involved in reward and increases activity in dorsolateral prefrontal cortex: an fMRI study in healthy volunteers

BACKGROUND: Neural responses to rewarding food cues are significantly different in the fed vs. fasted (>8 h food-deprived) state. However, the effect of eating to satiety after a shorter (more natural) intermeal interval on neural responses to both rewarding and aversive cues has not been examined. OBJECTIVE: With the use of a novel functional magnetic resonance imaging (fMRI) task, we investigated the effect of satiation on neural responses to both rewarding and aversive food tastes and pictures. DESIGN: Sixteen healthy participants (8 men, 8 women) were scanned on 2 separate test days, before and after eating a meal to satiation or after not eating for 4 h (satiated vs. premeal). fMRI blood oxygen level-dependent (BOLD) signals to the sight and/or taste of the stimuli were recorded. RESULTS: A whole-brain cluster-corrected analysis (P < 0.05) showed that satiation attenuated the BOLD response to both stimulus types in the ventromedial prefrontal cortex (vmPFC), orbitofrontal cortex, nucleus accumbens, hypothalamus, and insula but increased BOLD activity in the dorsolateral prefrontal cortex (dlPFC; local maxima corrected to P ≤ 0.001). A psychophysiological interaction analysis showed that the vmPFC was more highly connected to the dlPFC when individuals were exposed to food stimuli when satiated than when not satiated. CONCLUSIONS: These results suggest that natural satiation attenuates activity in reward-related brain regions and increases activity in the dlPFC, which may reflect a "top down" cognitive influence on satiation. This trial was registered at clinicaltrials.gov as NCT02298049.

Reward, rest, and antidepressant drug action

Purpose of the study: Reduced subjective experience of reward (anhedonia) is a key symptom of major depression. We have developed a human model of reward processing to investigate the neural correlates of anhedonia. Methods: We report the data from studies that examined reward processing using functional magnetic resonance imaging (fMRI) in those vulnerable to depression. We also report the effects of antidepressant medications on our neural model of reward processing and on the resting state in healthy volunteers. Results: Our results thus far indicate that deficits in reward processing are apparent in those vulnerable to depression, and also that antidepressant medication modulates reward processing and resting state functional connectivity in parts of the brain consistent with serotonin and catecholamine transmitter pathways in healthy volunteers. Conclusions: We conclude that this type of human model of reward processing might be useful in detecting biomarkers for depression and also in illuminating why antidepressant medications may not be very effective in treating anhedonia.

The plasticity of the mirror system: how reward learning modulates cortical motor simulation of others

Cortical motor simulation supports the understanding of others' actions and intentions. This mechanism is thought to rely on the mirror neuron system (MNS), a brain network that is active both during action execution and observation. Indirect evidence suggests that alpha/beta suppression, an electroencephalographic (EEG) index of MNS activity, is modulated by reward. In this study we aimed to test the plasticity of the MNS by directly investigating the link between alpha/beta suppression and reward. 40 individuals from a general population sample took part in an evaluative conditioning experiment, where different neutral faces were associated with high or low reward values. In the test phase, EEG was recorded while participants viewed videoclips of happy expressions made by the conditioned faces. Alpha/beta suppression (identified using event-related desynchronisation of specific independent components) in response to rewarding faces was found to be greater than for non-rewarding faces. This result provides a mechanistic insight into the plasticity of the MNS and, more generally, into the role of reward in modulating physiological responses linked to empathy.

Imbalanced functional link between executive control network and reward network explain the online-game seeking behaviors in Internet gaming disorder

Literatures have shown that Internet gaming disorder (IGD) subjects show impaired executive control and enhanced reward sensitivities than healthy controls. However, how these two networks jointly affect the valuation process and drive IGD subjects' online-game-seeking behaviors remains unknown. Thirty-five IGD and 36 healthy controls underwent a resting-states scan in the MRI scanner. Functional connectivity (FC) was examined within control and reward network seeds regions, respectively. Nucleus accumbens (NAcc) was selected as the node to find the interactions between these two networks. IGD subjects show decreased FC in the executive control network and increased FC in the reward network when comparing with the healthy controls. When examining the correlations between the NAcc and the executive control/reward networks, the link between the NAcc - executive control network is negatively related with the link between NAcc - reward network. The changes (decrease/increase) in IGD subjects' brain synchrony in control/reward networks suggest the inefficient/overly processing within neural circuitry underlying these processes. The inverse proportion between control network and reward network in IGD suggest that impairments in executive control lead to inefficient inhibition of enhanced cravings to excessive online game playing. This might shed light on the mechanistic understanding of IGD.

Autistic traits moderate the impact of reward learning on social behaviour

A deficit in empathy has been suggested to underlie social behavioural atypicalities in autism. A parallel theoretical account proposes that reduced social motivation (i.e., low responsivity to social rewards) can account for the said atypicalities. Recent evidence suggests that autistic traits modulate the link between reward and proxy metrics related to empathy. Using an evaluative conditioning paradigm to associate high and low rewards with faces, a previous study has shown that individuals high in autistic traits show reduced spontaneous facial mimicry of faces associated with high vs. low reward. This observation raises the possibility that autistic traits modulate the magnitude of evaluative conditioning. To test this, we investigated (a) if autistic traits could modulate the ability to implicitly associate a reward value to a social stimulus (reward learning/conditioning, using the Implicit Association Task, IAT); (b) if the learned association could modulate participants’ prosocial behaviour (i.e., social reciprocity, measured using the cyberball task); (c) if the strength of this modulation was influenced by autistic traits. In 43 neurotypical participants, we found that autistic traits moderated the relationship of social reward learning on prosocial behaviour but not reward learning itself. This evidence suggests that while autistic traits do not directly influence social reward learning, they modulate the relationship of social rewards with prosocial behaviour

Investigating subtypes of reward processing deficits as trait markers for depression

Background: Anhedonia, the loss of pleasure in usually enjoyable activities, is a central feature of major depressive disorder (MDD). The aim of the present study was to examine whether young people at a familial risk of depression display signs of anticipatory, motivational or consummatory anhedonia, which would indicate that these deficits may be trait markers for MDD. Methods: The study was completed by 22 participants with a family history of depression (FH+) and 21 controls (HC). Anticipatory anhedonia was assessed by asking participants to rate their anticipated liking of pleasant and unpleasant foods which they imagined tasting when cued with images of the foods. Motivational anhedonia was measured by requiring participants to perform key presses to obtain pleasant chocolate taste rewards or to avoid unpleasant apple tastes. Additionally, physical consummatory anhedonia was examined by instructing participants to rate the pleasantness of the acquired tastes. Moreover, social consummatory anhedonia was investigated by asking participants to make preference-based choices between neutral facial expressions, genuine smiles, and polite smiles. Results: It was found that the FH+ group’s anticipated liking of unpleasant foods was significantly lower than that of the control group. By contrast, no group differences in the pleasantness ratings of the actually experienced tastes or in the amount of performed key presses were observed. However, controls preferred genuine smiles over neutral expressions more often than they preferred polite smiles over neutral expressions, while this pattern was not seen in the FH+ group. Conclusion: These findings suggest that FH+ individuals demonstrate an altered anticipatory response to negative stimuli and show signs of social consummatory anhedonia, which may be trait markers for depression.

University teaching: recognition and reward

Teaching in universities has increased in importance in recent years which, in part, is a consequence of the change in funding of universities from block grants to student tuition fees. Various initiatives have been made which serve to raise the profile of teaching and give it greater recognition. It is also important that teaching is recognised even more fully and widely, and crucially that it is rewarded accordingly. We propose a mechanism for recognising and rewarding university teaching that is based on a review process that is supported by documented evidence whose outcomes can be fed into performance and development reviews, and used to inform decisions about reward and promotion, as well as the review of probationary status where appropriate.

Providing extrinsic reward for test performance undermines long-term memory acquisition

Based on numerous studies showing that testing studied material can improve long-term retention more than restudying the same material, it is often suggested that the number of tests in education should be increased to enhance knowledge acquisition. However, testing in real-life educational settings often entails a high degree of extrinsic motivation of learners due to the common practice of placing important consequences on the outcome of a test. Such an effect on the motivation of learners may undermine the beneficial effects of testing on long-term memory because it has been shown that extrinsic motivation can reduce the quality of learning. To examine this issue, participants learned foreign language vocabulary words, followed by an immediate test in which one-third of the words were tested and one-third restudied. To manipulate extrinsic motivation during immediate testing, participants received either monetary reward contingent on test performance or no reward. After 1 week, memory for all words was tested. In the immediate test, reward reduced correct recall and increased commission errors, indicating that reward reduced the number of items that can benefit from successful retrieval. The results in the delayed test revealed that reward additionally reduced the gain received from successful retrieval because memory for initially successfully retrieved words was lower in the reward condition. However, testing was still more effective than restudying under reward conditions because reward undermined long-term memory for concurrently restudied material as well. These findings indicate that providing performance–contingent reward in a test can undermine long-term knowledge acquisition.

Enhanced neural response to anticipation, effort and consummation of reward and aversion during Bupropion treatment

Background We have previously shown that the selective serotonergic re-uptake inhibitor, citalopram, reduces the neural response to reward and aversion in healthy volunteers. We suggest that this inhibitory effect might underlie the emotional blunting reported by patients on these medications. Bupropion is a dopaminergic and noradrenergic re-uptake inhibitor and has been suggested to have more therapeutic effects on reward-related deficits. However, how bupropion affects the neural responses to reward and aversion is unclear. Methods 17 healthy volunteers (9 female, 8 male) received 7 days of bupropion (150 mg/day) and 7 days of placebo treatment, in a double-blind crossover design. Our functional Magnetic Resonance Imaging task consisted of 3 phases; an anticipatory phase (pleasant or unpleasant cue), an effort phase (button presses to achieve a pleasant taste or to avoid an unpleasant taste) and a consummatory phase (pleasant or unpleasant tastes). Volunteers also rated wanting, pleasantness and intensity of the tastes. Results Relative to placebo, bupropion increased activity during the anticipation phase in the ventral medial prefrontal cortex (vmPFC) and caudate. During the effort phase, bupropion increased activity in the vmPFC, striatum, dorsal anterior cingulate cortex and primary motor cortex. Bupropion also increased medial orbitofrontal cortex, amygdala and ventral striatum activity during the consummatory phase. Conclusions Our results are the first to show that bupropion can increase neural responses during the anticipation, effort and consummation of rewarding and aversive stimuli. This supports the notion that bupropion might be beneficial for depressed patients with reward-related deficits and blunted affect.

The effects of difficulty and gain versus loss on vocal physiology and acoustics

To examine the basis of emotional changes to the voice, physiological and electroglottal measures were combined with acoustic speech analysis of 30 men performing a computer task in which they lost or gained points under two levels of difficulty. Predictions of the main effects of difficulty and reward on the voice were not borne out by the data. Instead, vocal changes depended largely on interactions between gain versus loss and difficulty. The rate at which the vocal folds open and close (fundamental frequency; f0) was higher for loss than for gain when difficulty was high, but not when difficulty was low. Electroglottal measures revealed that f0 changes corresponded to shorter glottal open times for the loss conditions. Longer closed and shorter open phases were consistent with raised laryngeal tension in difficult loss conditions. Similarly, skin conductance indicated higher sympathetic arousal in loss than gain conditions, particularly when difficulty was high. The results provide evidence of the physiological basis of affective vocal responses, confirming the utility of measuring physiology and voice in the study of emotion.