Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task

In probabilistic decision tasks, an expected value (EV) of a choice is calculated, and after the choice has been made, this can be updated based on a temporal difference (TD) prediction error between the EV and the reward magnitude (RM) obtained. The EV is measured as the probability of obtaining a reward x RM. To understand the contribution of different brain areas to these decision-making processes, functional magnetic resonance imaging activations related to EV versus RM (or outcome) were measured in a probabilistic decision task. Activations in the medial orbitofrontal cortex were correlated with both RM and with EV and confirmed in a conjunction analysis to extend toward the pregenual cingulate cortex. From these representations, TD reward prediction errors could be produced. Activations in areas that receive from the orbitofrontal cortex including the ventral striatum, midbrain, and inferior frontal gyrus were correlated with the TD error. Activations in the anterior insula were correlated negatively with EV, occurring when low reward outcomes were expected, and also with the uncertainty of the reward, implicating this region in basic and crucial decision-making parameters, low expected outcomes, and uncertainty.

Umami: a delicious flavor formed by convergence of taste and olfactory pathways in the human brain

Umami taste is produced by glutamate acting on a fifth taste system. However, glutamate presented alone as a taste stimulus is not highly pleasant, and does not act synergistically with other tastes (sweet, salt, bitter and sour). We show here that when glutamate is given in combination with a consonant, savory, odour (vegetable), the resulting flavor can be much more pleasant. Moreover, we showed using functional brain imaging with fMRI that the glutamate taste and savory odour combination produced much greater activation of the medial orbitofrontal cortex and pregenual cingulate cortex than the sum of the activations by the taste and olfactory components presented separately. Supralinear effects were much less (and significantly less) evident for sodium chloride and vegetable odour. Further, activations in these brain regions were correlated with the pleasantness and fullness of the flavor, and with the consonance of the taste and olfactory components. Supralinear effects of glutamate taste and savory odour were not found in the insular primary taste cortex. We thus propose that glutamate acts by the nonlinear effects it can produce when combined with a consonant odour in multimodal cortical taste-olfactory convergence regions. We propose the concept that umami can be thought of as a rich and delicious flavor that is produced by a combination of glutamate taste and a consonant savory odour. Glutamate is thus a flavor enhancer because of the way that it can combine supralinearly with consonant odours in cortical areas where the taste and olfactory pathways converge far beyond the receptors.

Brain activity in advantageous and disadvantageous situations: implications for reward/punishment sensitivity in different situations

OBJECTIVE: This study modeled win and lose trials in a simple gambling task to examine the effect of entire win-lose situations (WIN, LOSS, or TIE) on single win/lose trials and related neural underpinnings. METHODS: The behavior responses and brain activities of 17 participants were recorded by an MRI scanner while they performed a gambling task. Different conditions were compared to determine the effect of the task on the behavior and brain activity of the participants. Correlations between brain activity and behavior were calculated to support the imaging results. RESULTS: In win trials, LOSS caused less intense posterior cingulate activity than TIE. In lose trials, LOSS caused more intense activity in the right superior temporal gyrus, bilateral superior frontal gyrus, bilateral anterior cingulate, bilateral insula cortex, and left orbitofrontal cortex than WIN and TIE. CONCLUSIONS: The experiences of the participants in win trials showed great similarity among different win-lose situations. However, the brain activity and behavior responses of the participants in lose trials indicated that they experienced stronger negative emotion in LOSS. The participants also showed an increased desire to win in LOSS than in WIN or TIE conditions.

Neural effects of cannabinoid CB1 neutral antagonist tetrahydrocannabivarin (THCv) on food reward and aversion in healthy volunteers

Disturbances in the regulation of reward and aversion in the brain may underlie disorders such as obesity and eating disorders. We previously showed that the cannabis receptor subtype (CB1) inverse agonist rimonabant, an antiobesity drug withdrawn due to depressogenic side effects, diminished neural reward responses yet increased aversive responses (Horder et al., 2010). Unlike rimonabant, tetrahydrocannabivarin is a neutral CB1 receptor antagonist (Pertwee, 2005) and may therefore produce different modulations of the neural reward system. We hypothesized that tetrahydrocannabivarin would, unlike rimonabant, leave intact neural reward responses but augment aversive responses. Methods: We used a within-subject, double-blind design. Twenty healthy volunteers received a single dose of tetrahydrocannabivarin (10mg) and placebo in randomized order on 2 separate occasions. We measured the neural response to rewarding (sight and/or flavor of chocolate) and aversive stimuli (picture of moldy strawberries and/or a less pleasant strawberry taste) using functional magnetic resonance imaging. Volunteers rated pleasantness, intensity, and wanting for each stimulus. Results: There were no significant differences between groups in subjective ratings. However, tetrahydrocannabivarin increased responses to chocolate stimuli in the midbrain, anterior cingulate cortex, caudate, and putamen. Tetrahydrocannabivarin also increased responses to aversive stimuli in the amygdala, insula, mid orbitofrontal cortex, caudate, and putamen. Conclusions: Our findings are the first to show that treatment with the CB1 neutral antagonist tetrahydrocannabivarin increases neural responding to rewarding and aversive stimuli. This effect profile suggests therapeutic activity in obesity, perhaps with a lowered risk of depressive side effects. Keywords: reward, THCv, obesity, fMRI, cannabinoid

Aberrant brain responses to emotionally valent words is normalised after cognitive behavioural therapy in female depressed adolescents

AbstractBackground Depression in adolescence is debilitating with high recurrence in adulthood, yet its pathophysiological mechanism remains enigmatic. To examine the interaction between emotion, cognition and treatment, functional brain responses to sad and happy distractors in an affective go/no-go task were explored before and after Cognitive Behavioural Therapy (CBT) in depressed female adolescents, and healthy participants. Methods Eighty-two Depressed and 24 healthy female adolescents, aged 12 to 17 years, performed a functional magnetic resonance imaging (fMRI) affective go/no-go task at baseline. Participants were instructed to withhold their responses upon seeing happy or sad words. Among these participants, 13 patients had CBT over approximately 30 weeks. These participants and 20 matched controls then repeated the task. Results At baseline, increased activation in response to happy relative to neutral distractors was observed in the orbitofrontal cortex in depressed patients which was normalized after CBT. No significant group differences were found behaviourally or in brain activation in response to sad distractors. Improvements in symptoms (mean: 9.31, 95% CI: 5.35-13.27) were related at trend-level to activation changes in orbitofrontal cortex. Limitations In the follow-up section, a limited number of post-CBT patients were recruited. Conclusions To our knowledge, this is the first fMRI study addressing the effect of CBT in adolescent depression. Although a bias toward negative information is widely accepted as a hallmark of depression, aberrant brain hyperactivity to positive distractors was found and normalised after CBT. Research, assessment and treatment focused on positive stimuli could be a future consideration. Moreover, a pathophysiological mechanism distinct from adult depression may be suggested and awaits further exploration.

Resting-state functional connectivity following a single dose treatment with CB1 neutral antagonist tetrahydrocannabivarin (THCv) in healthy volunteers

BACKGROUND: The cannabinoid cannabinoid type 1 (CB1) neutral antagonist tetrahydrocannabivarin (THCv) has been suggested as a possible treatment for obesity, but without the depressogenic side-effects of inverse antagonists such as Rimonabant. However, how THCv might affect the resting state functional connectivity of the human brain is as yet unknown. METHOD: We examined the effects of a single 10mg oral dose of THCv and placebo in 20 healthy volunteers in a randomized, within-subject, double-blind design. Using resting state functional magnetic resonance imaging and seed-based connectivity analyses, we selected the amygdala, insula, orbitofrontal cortex, and dorsal medial prefrontal cortex (dmPFC) as regions of interest. Mood and subjective experience were also measured before and after drug administration using self-report scales. RESULTS: Our results revealed, as expected, no significant differences in the subjective experience with a single dose of THCv. However, we found reduced resting state functional connectivity between the amygdala seed region and the default mode network and increased resting state functional connectivity between the amygdala seed region and the dorsal anterior cingulate cortex and between the dmPFC seed region and the inferior frontal gyrus/medial frontal gyrus. We also found a positive correlation under placebo for the amygdala-precuneus connectivity with the body mass index, although this correlation was not apparent under THCv. CONCLUSION: Our findings are the first to show that treatment with the CB1 neutral antagonist THCv decreases resting state functional connectivity in the default mode network and increases connectivity in the cognitive control network and dorsal visual stream network. This effect profile suggests possible therapeutic activity of THCv for obesity, where functional connectivity has been found to be altered in these regions.

Enhanced neural response to anticipation, effort and consummation of reward and aversion during Bupropion treatment

Background We have previously shown that the selective serotonergic re-uptake inhibitor, citalopram, reduces the neural response to reward and aversion in healthy volunteers. We suggest that this inhibitory effect might underlie the emotional blunting reported by patients on these medications. Bupropion is a dopaminergic and noradrenergic re-uptake inhibitor and has been suggested to have more therapeutic effects on reward-related deficits. However, how bupropion affects the neural responses to reward and aversion is unclear. Methods 17 healthy volunteers (9 female, 8 male) received 7 days of bupropion (150 mg/day) and 7 days of placebo treatment, in a double-blind crossover design. Our functional Magnetic Resonance Imaging task consisted of 3 phases; an anticipatory phase (pleasant or unpleasant cue), an effort phase (button presses to achieve a pleasant taste or to avoid an unpleasant taste) and a consummatory phase (pleasant or unpleasant tastes). Volunteers also rated wanting, pleasantness and intensity of the tastes. Results Relative to placebo, bupropion increased activity during the anticipation phase in the ventral medial prefrontal cortex (vmPFC) and caudate. During the effort phase, bupropion increased activity in the vmPFC, striatum, dorsal anterior cingulate cortex and primary motor cortex. Bupropion also increased medial orbitofrontal cortex, amygdala and ventral striatum activity during the consummatory phase. Conclusions Our results are the first to show that bupropion can increase neural responses during the anticipation, effort and consummation of rewarding and aversive stimuli. This supports the notion that bupropion might be beneficial for depressed patients with reward-related deficits and blunted affect.

Effects of Delta9-tetrahydrocannabivarin on [35S]GTPgammaS binding in mouse brain cerebellum and piriform cortex membranes

BACKGROUND AND PURPOSE: We have recently shown that the phytocannabinoid Delta9-tetrahydrocannabivarin (Delta9-THCV) and the CB1 receptor antagonist AM251 increase inhibitory neurotransmission in mouse cerebellum and also exhibit anticonvulsant activity in a rat piriform cortical (PC) model of epilepsy. Possible mechanisms underlying cannabinoid actions in the CNS include CB1 receptor antagonism (by displacing endocannabinergic tone) or inverse agonism at constitutively active CB1 receptors. Here, we investigate the mode of cannabinoid action in [35S]GTPgammaS binding assays. EXPERIMENTAL APPROACH: Effects of Delta9-THCV and AM251 were tested either alone or against WIN55,212-2-induced increases in [35S]GTPgammaS binding in mouse cerebellar and PC membranes. Effects on non-CB receptor expressing CHO-D2 cell membranes were also investigated. KEY RESULTS :Delta9-THCV and AM251 both acted as potent antagonists of WIN55,212-2-induced increases in [35S]GTPgammaS binding in cerebellar and PC membranes (Delta9-THCV: pA2=7.62 and 7.44 respectively; AM251: pA2=9.93 and 9.88 respectively). At micromolar concentrations, Delta9-THCV or AM251 alone caused significant decreases in [35S]GTPgammaS binding; Delta9-THCV caused larger decreases than AM251. When applied alone in CHO-D2 membranes, Delta9-THCV and AM251 also caused concentration-related decreases in G protein activity. CONCLUSIONS AND IMPLICATIONS: Delta9-THCV and AM251 act as CB1 receptors antagonists in the cerebellum and PC, with AM251 being more potent than Delta9-THCV in both brain regions. Individually, Delta9-THCV or AM251 exhibited similar potency at CB1 receptors in the cerebellum and the PC. At micromolar concentrations, Delta9-THCV and AM251 caused a non-CB receptor-mediated depression of basal [35S]GTPgammaS binding.

Sox1-deficient mice suffer from epilepsy associated with abnormal ventral forebrain development and olfactory cortex hyperexcitability

Mutations in several classes of embryonically-expressed transcription factor genes are associated with behavioral disorders and epilepsies. However, there is little known about how such genetic and neurodevelopmental defects lead to brain dysfunction. Here we present the characterization of an epilepsy syndrome caused by the absence of the transcription factor SOX1 in mice. In vivo electroencephalographic recordings from SOX1 mutants established a correlation between behavioral changes and cortical output that was consistent with a seizure origin in the limbic forebrain. In vitro intracellular recordings from three major forebrain regions, neocortex, hippocampus and olfactory (piriform) cortex (OC) showed that only the OC exhibits abnormal enhanced synaptic excitability and spontaneous epileptiform discharges. Furthermore, the hyperexcitability of the OC neurons was present in mutants prior to the onset of seizures but was completely absent from both the hippocampus and neocortex of the same animals. The local inhibitory GABAergic neurotransmission remained normal in the OC of SOX1-deficient brains, but there was a severe developmental deficit of OC postsynaptic target neurons, mainly GABAergic projection neurons within the olfactory tubercle and the nucleus accumbens shell. Our data show that SOX1 is essential for ventral telencephalic development and suggest that the neurodevelopmental defect disrupts local neuronal circuits leading to epilepsy in the SOX1-deficient mice

Cholinergic modulation of intrinsic fibre-evoked excitatory transmission contains a nicotinic component in immature but not adult rat piriform cortex, in vitro

The piriform cortex (PC) is highly prone to epileptogenesis, particularly in immature animals, where decreased muscarinic modulation of PC intrinsic fibre excitatory neurotransmission is implicated as a likely cause. However, whether higher levels of acetylcholine (ACh) release occur in immature vs. adult PC remains unclear. We investigated this using in vitro extracellular electrophysiological recording techniques. Intrinsic fibre-evoked extracellular field potentials (EFPs) were recorded from layers II to III in PC brain slices prepared from immature (P14-18) and adult (P>40) rats. Adult and immature PC EFPs were suppressed by eserine (1muM) or neostigmine (1muM) application, with a greater suppression in immature ( approximately 40%) than adult ( approximately 30%) slices. Subsequent application of atropine (1muM) reversed EFP suppression, producing supranormal ( approximately 12%) recovery in adult slices, suggesting that suppression was solely muscarinic ACh receptor-mediated and that some 'basal' cholinergic 'tone' was present. Conversely, atropine only partially reversed anticholinesterase effects in immature slices, suggesting the presence of additional non-muscarinic modulation. Accordingly, nicotine (50muM) caused immature field suppression ( approximately 30%) that was further enhanced by neostigmine, whereas it had no effect on adult EFPs. Unlike atropine, nicotinic antagonists, mecamylamine and methyllycaconitine, induced immature supranormal field recovery ( approximately 20%) following anticholinesterase-induced suppression (with no effect on adult slices), confirming that basal cholinergic 'tone' was also present. We suggest that nicotinic inhibitory cholinergic modulation occurs in the immature rat PC intrinsic excitatory fibre system, possibly to complement the existing, weak muscarinic modulation, and could be another important developmentally regulated system governing immature PC susceptibility towards epileptogenesis.

Developmental changes in presynaptic muscarinic modulation of excitatory and inhibitory neurotransmission in rat piriform cortex in vitro: relevance to epileptiform bursting susceptibility

Suppression of depolarizing postsynaptic potentials and isolated GABA-A receptor-mediated fast inhibitory postsynaptic potentials by the muscarinic acetylcholine receptor agonist, oxotremorine-M (10 microM), was investigated in adult and immature (P14-P30) rat piriform cortical (PC) slices using intracellular recording. Depolarizing postsynaptic potentials evoked by layers II-III stimulation underwent concentration-dependent inhibition in oxotremorine-M that was most likely presynaptic and M2 muscarinic acetylcholine receptor-mediated in immature, but M1-mediated in adult (P40-P80) slices; percentage inhibition was smaller in immature than in adult piriform cortex. In contrast, compared with adults, layer Ia-evoked depolarizing postsynaptic potentials in immature piriform cortex slices in oxotremorine-M, showed a prolonged multiphasic depolarization with superimposed fast transients and spikes, and an increased 'all-or-nothing' character. Isolated N-methyl-d-aspartate receptor-mediated layer Ia depolarizing postsynaptic potentials (although significantly larger in immature slices) were however, unaffected by oxotremorine-M, but blocked by dl-2-amino-5-phosphonovaleric acid. Fast inhibitory postsynaptic potentials evoked by layer Ib or layers II-III-fiber stimulation in immature slices were significantly smaller than in adults, despite similar estimated mean reversal potentials ( approximately -69 and -70 mV respectively). In oxotremorine-M, only layer Ib-fast inhibitory postsynaptic potentials were suppressed; suppression was again most likely presynaptic M2-mediated in immature slices, but M1-mediated in adults. The degree of fast inhibitory postsynaptic potential suppression was however, greater in immature than in adult piriform cortex. Our results demonstrate some important physiological and pharmacological differences between excitatory and inhibitory synaptic systems in adult and immature piriform cortex that could contribute toward the increased susceptibility of this region to muscarinic agonist-induced epileptiform activity in immature brain slices.

Further characterization of muscarinic agonist-induced epileptiform bursting activity in immature rat piriform cortex, in vitro

The characteristics of muscarinic acetylcholine receptor agonist-induced epileptiform bursting seen in immature rat piriform cortex slices in vitro were further investigated using intracellular recording, with particular focus on its postnatal age-dependence (P+14-P+30), pharmacology, site(s) of origin and the likely contribution of the muscarinic acetylcholine receptor agonist-induced post-stimulus slow afterdepolarization and gap junction functionality toward its generation. The muscarinic agonist, oxotremorine-M (10 microM), induced rhythmic bursting only in immature piriform cortex slices; however, paroxysmal depolarizing shift amplitude, burst duration and burst incidence were inversely related to postnatal age. No significant age-dependent changes in neuronal membrane properties or postsynaptic muscarinic responsiveness accounted for this decline. Burst incidence was higher when recorded in anterior and posterior regions of the immature piriform cortex. In adult and immature neurones, oxotremorine-M effects were abolished by M1-, but not M2-muscarinic acetylcholine receptor-selective antagonists. Rostrocaudal lesions, between piriform cortex layers I and II, or layer III and endopiriform nucleus in adult or immature slices did not influence oxotremorine-M effects; however, the slow afterdepolarization in adult (but not immature) lesioned slices was abolished. Gap junction blockers (carbenoxolone or octanol) disrupted muscarinic bursting and diminished the slow afterdepolarization in immature slices, suggesting that gap junction connectivity was important for bursting. Our data show that neural networks within layers II-III function as primary oscillatory circuits for burst initiation in immature rat piriform cortex during persistent muscarinic receptor activation. Furthermore, we propose that muscarinic slow afterdepolarization induction and gap junction communication could contribute towards the increased epileptiform susceptibility of this brain area.

A novel component of cannabis extract potentiates excitatory synaptic transmission in rat olfactory cortex in vitro

Cannabis is a potential treatment for epilepsy, although the few human studies supporting this use have proved inconclusive. Previously, we showed that a standardized cannabis extract (SCE), isolated Delta(9)-tetrahydrocannabinol (Delta(9)-THC), and even Delta(9)-THC-free SCE inhibited muscarinic agonist-induced epileptiform bursting in rat olfactory cortical brain slices, acting via CB1 receptors. The present work demonstrates that although Delta(9)-THC (1microM) significantly depressed evoked depolarizing postsynaptic potentials (PSPs) in rat olfactory cortex neurones, both SCE and Delta(9)-THC-free SCE significantly potentiated evoked PSPs (all results were fully reversed by the CB1 receptor antagonist SR141716A, 1microM); interestingly, the potentiation by Delta(9)-THC-free SCE was greater than that produced by SCE. On comparing the effects of Delta(9)-THC-free SCE upon evoked PSPs and artificial PSPs (aPSPs; evoked electrotonically following brief intracellular current injection), PSPs were enhanced, whereas aPSPs were unaffected, suggesting that the effect was not due to changes in background input resistance. Similar recordings made using CB1 receptor-deficient knockout mice (CB1(-/-)) and wild-type littermate controls revealed cannabinoid or extract-induced changes in membrane resistance, cell excitability and synaptic transmission in wild-type mice that were similar to those seen in rat neurones, but no effect on these properties were seen in CB1(-/-) cells. It appears that the unknown extract constituent(s) effects over-rode the suppressive effects of Delta(9)-THC on excitatory neurotransmitter release, which may explain some patients' preference for herbal cannabis rather than isolated Delta(9)-THC (due to attenuation of some of the central Delta(9)-THC side effects) and possibly account for the rare incidence of seizures in some individuals taking cannabis recreationally

Inverse amygdala and medial prefrontal cortex responses to surprised faces

Here we show inverse fMRI activation patterns in amygdala and medial prefrontal cortex (mPFC) depending upon whether subjects interpreted surprised facial expressions positively or negatively. More negative interpretations of surprised faces were associated with greater signal changes in the right ventral amygdala, while more positive interpretations were associated with greater signal changes in the ventral mPFC. Accordingly, signal change within these two areas was inversely correlated. Thus, individual differences in the judgment of surprised faces are related to a systematic inverse relationship between amygdala and mPFC activity, a circuitry that the animal literature suggests is critical to the assessment of stimuli that predict potential positive vs negative outcomes.

Individual differences in the effects of perceived controllability on pain perception: critical role of the prefrontal cortex

The degree to which perceived controllability alters the way a stressor is experienced varies greatly among individuals. We used functional magnetic resonance imaging to examine the neural activation associated with individual differences in the impact of perceived controllability on self-reported pain perception. Subjects with greater activation in response to uncontrollable (UC) rather than controllable (C) pain in the pregenual anterior cingulate cortex (pACC), periaqueductal gray (PAG), and posterior insula/SII reported higher levels of pain during the UC versus C conditions. Conversely, subjects with greater activation in the ventral lateral prefrontal cortex (VLPFC) in anticipation of pain in the UC versus C conditions reported less pain in response to UC versus C pain. Activation in the VLPFC was significantly correlated with the acceptance and denial subscales of the COPE inventory [Carver, C. S., Scheier, M. F., & Weintraub, J. K. Assessing coping strategies: A theoretically based approach. Journal of Personality and Social Psychology, 56, 267–283, 1989], supporting the interpretation that this anticipatory activation was associated with an attempt to cope with the emotional impact of uncontrollable pain. A regression model containing the two prefrontal clusters (VLPFC and pACC) predicted 64% of the variance in pain rating difference, with activation in the two additional regions (PAG and insula/SII) predicting almost no additional variance. In addition to supporting the conclusion that the impact of perceived controllability on pain perception varies highly between individuals, these findings suggest that these effects are primarily top-down, driven by processes in regions of the prefrontal cortex previously associated with cognitive modulation of pain and emotion regulation.