The plasticity of the mirror system: how reward learning modulates cortical motor simulation of others

Cortical motor simulation supports the understanding of others' actions and intentions. This mechanism is thought to rely on the mirror neuron system (MNS), a brain network that is active both during action execution and observation. Indirect evidence suggests that alpha/beta suppression, an electroencephalographic (EEG) index of MNS activity, is modulated by reward. In this study we aimed to test the plasticity of the MNS by directly investigating the link between alpha/beta suppression and reward. 40 individuals from a general population sample took part in an evaluative conditioning experiment, where different neutral faces were associated with high or low reward values. In the test phase, EEG was recorded while participants viewed videoclips of happy expressions made by the conditioned faces. Alpha/beta suppression (identified using event-related desynchronisation of specific independent components) in response to rewarding faces was found to be greater than for non-rewarding faces. This result provides a mechanistic insight into the plasticity of the MNS and, more generally, into the role of reward in modulating physiological responses linked to empathy.

Reproductive biology of Echinodorus longipetalus (Alismataceae): Sexual morphs, breeding system and pollinators

The floral biology, pollinators and breeding system of Echinodorus longipetalus Micheli were studied in a marshy area of the district of Taquaritinga (State of Sao Paulo), southeastern Brazil. E. longipetalus is gynodioecious and as far as is known, this is the first record of unisexual flowers, besides perfect flowers, in Echinodorus. Proportion of female individuals in the studied population is 50% and produces 31% more flowers than hermaphrodites. Perfect and pistillate flowers of E. longipetalus are similar in appearance and are pollinated by several species of Hymenoptera (mainly by Xylocopa (Neoxylocopa) suspecta Moure & Camargo). Perfect flowers offer pollen as a reward. Pistillate flowers attract floral visitors by deceit with their staminodes that resemble the stamens of the perfect flowers. Visits to pistillate flowers are quick (1-2 s), while visits to perfect flowers last up to 120 s. The perfect flowers are self-compatible and produce fruits through spontaneous self-pollination (control flowers), whereas the pistillate ones only set fruits through cross-pollinations. Perfect and pistillate flowers set more fruits under natural conditions than in manual treatments, respectively. Although the pistillate and perfect flowers bear a strong similarity, the selective pollinator behavior seems to be responsible for the increase of fruit set in perfect flowers. (C) 2008 Elsevier B.V. All rights reserved.

Effects of bariatric surgery on the central nervous system and eating behavior in humans: a systematic review on the neuroimaging studies

INTRODUCTION: Neuroimaging studies suggest that obese people might show hyperactivity of brain areas regarding reward processing, and hypoactivity of brain areas concerning cognitive control, when exposed to food cues. Although the effects of bariatric surgery on the central nervous system and eating behavior are well known, few studies have used neuroimage techniques with the aim of investigating the central effects of bariatric surgery in humans. OBJECTIVES: This paper systematically and critically reviews studies using functional neuroimaging to investigate changes on the patterns of activation of central areas related to the regulation of eating behavior after bariatric surgery. METHOD: A search on the databases Medline, Web of Science, Lilacs and Science Direct on Line, was conducted in February 2013, using the keywords "Neuroimaging", "Positron-Emission Tomography", "Magnetic Resonance Imaging", "Gastric Bypass", "Gastroplasty", "Jejunoileal Bypass", "Bariatric Surgery". RESULTS: Seven manuscripts were included; the great majority studied the central effects of Roux en Y gastric bypass, using positron emission tomography or functional magnetic resonance. CONCLUSIONS: Bariatric surgery might normalize the activity of central areas concerned with reward and incentive salience processing, as the nucleus accumbens and mesencephalic tegmental ventral area, as well as circuitries processing behavioral inhibition, as the dorsolateral prefrontal cortex.

Task-dependent modulation of reward and novelty processing in human ventral striatum and midbrain

Magdeburg, Univ., Fak. für Naturwiss., Diss., 2008

Integration of appetitive and aversive reinforcers and the neuromodulation of reward seeking and pain avoidance

Magdeburg, Univ., Fak. für Naturwiss., Diss., 2010

Reward- and attention-related determinants of color selection in human visual cortex

Magdeburg, Univ., Fak. für Naturwiss., Diss., 2015

Role of the hypocretin system in cocaine- and alcohol-related behaviors : evidence from hypocretin-deficient mice

RésuméL'addiction aux drogues est une maladie multifactorieile affectant toutes les strates de notre société. Cependant, la vulnérabilité à développer une addiction dépend de facteurs environnementaux, génétiques et psychosociaux. L'addiction aux drogues est décrite comme étant une maladie chronique avec un taux élevé de rechutes. Elle se caractérise par un besoin irrépressible de consommer une drogue et une augmentation progressive de la consommation en dépit des conséquences néfastes. Les mécanismes cérébraux responsables des dépendances aux drogues ne sont que partiellement élucidés, malgré une accumulation croissante d'évidences démontrant des adaptations au niveau moléculaire et cellulaire au sein des systèmes dopaminergique et glutamatergique. L'identification de nouveaux facteurs neurobiologiques responsables de la vulnérabilité aux substances d'abus est cruciale pour le développement de nouveaux traitements thérapeutiques capables d'atténuer et de soulager les symptômes liés à la dépendance aux drogues.Au cours des dernières années, de nombreuses études ont démontré qu'un nouveau circuit cérébral, le système hypocrétinergique, était impliqué dans plusieurs fonctions physiologiques, tel que l'éveil, le métabolisme énergétique, la motivation, le stress et les comportements liés aux phénomènes de récompense. Le système hypocrétinergique est composé d'environ 3000-4000 neurones issus de l'hypothalamus latéral projetant dans tout ie cerveau. Des souris transgéniques pour le gène des hypocrétines ont été générées et leur phénotype correspond à celui des animaux sauvages, excepté le fait qu'elles soient atteintes d'attaques de sommeil similaires à celles observées chez les patients narcoleptiques. H semblerait que les hypocrétines soient requises pour l'acquisition et l'expression de la dépendance aux drogues. Cependant, le mécanisme précis reste encore à être élucidé. Dans ce rapport, nous rendons compte des comportements liés aux phénomènes de récompense liés à l'alcool et à la cocaine chez les souris knock-out (KO), hétérozygotes (HET) et sauvages (WT).Nous avons, dans un premier temps, évalué l'impact d'injections répétées de cocaïne (15 mg/kg, ip) sur la sensibilisation locomotrice et sur le conditionnement place préférence. Nous avons pu observer que les souris WT, HET et KO exprimaient une sensibilisation locomotrice induite par une administration chronique de cocaïne, cependant les souris déficientes en hypocrétines démontraient une sensibilisation retardée et atténuée. Π est intéressant de mentionner que les mâles HET exprimaient une sensibilisation comportementale intermédiaire. Après normalisation des données, toutes les souris exprimaient une amplitude de sensibilisation similaire, excepté les souris mâles KO qui affichaient, le premier jour de traitement, une sensibilisation locomotrice réduite et retardée, reflétant un phénotype hypoactif plutôt qu'une altération de la réponse aux traitements chroniques de cocaïne. Contre toute attente, toutes les souris femelles exprimaient un pattern similaire de sensibilisation locomotrice à la cocaïne. Nous avons ensuite évalué l'effet d'un conditionnement comportemental à un environnement associé à des injections répétées de cocaine (15 mg / kg ip). Toutes les souris, quelque soit leur sexe ou leur génotype, ont manifesté une préférence marquée pour l'environnement apparié à la cocaïne. Après deux semaines d'abstinence à la cocaïne, les mâles et les femelles déficientes en hypocrétines n'exprimaient plus aucune préférence pour le compartiment précédemment associé à la cocaïne. Alors que les souris WT et HET maintenaient leur préférence pour le compartiment associé à la cocaïne. Pour finir, à l'aide d'un nouveau paradigme appelé IntelliCage®, nous avons pu évaluer la consommation de liquide chez les femelles WT, HET et KO. Lorsqu'il n'y avait que de l'eau disponible, nous avons observé que les femelles KO avaient tendance à moins explorer les quatre coins de la cage. Lorsque les souris étaient exposées à quatre types de solutions différentes (eau, ImM quinine ou 0.2% saccharine, alcool 8% et alcool 16%), les souris KO avaient tendance à moins consommer l'eau sucrée et les solutions alcoolisées. Cependant, après normalisation des données, aucune différence significative n'a pu être observée entre les différents génotypes, suggérant que la consommation réduite d'eau sucrée ou d'alcool peut être incombée à l'hypoactivité des souris KO.Ces résultats confirment que le comportement observé chez les souris KO serait dû à des compensations développementales, puisque la sensibilisation locomotrice et le conditionnement comportemental à la cocaïne étaient similaires aux souris HET et WT. En ce qui concerne la consommation de liquide, les souris KO avaient tendance à consommer moins d'eau sucrée et de solutions alcoolisées. Le phénotype hypoactif des souris déficientes en hypocrétine est probablement responsable de leur tendance à moins explorer leur environnement. Il reste encore à déterminer si l'expression de ce phénotype est la conséquence d'un état de vigilance amoindri ou d'une motivation diminuée à la recherche de récompense. Nos résultats suggèrent que les souris déficientes en hypocrétine affichent une motivation certaine à la recherche de récompense lorsqu'elles sont exposées à des environnements où peu d'efforts sont à fournir afin d'obtenir une récompense.AbstractDrug addiction is a multifactorial disorder affecting human beings regardless their education level, their economic status, their origin or even their gender, but the vulnerability to develop addiction depends on environmental, genetic and psychosocial dispositions. Drug addiction is defined as a chronic relapsing disorder characterized by compulsive drug seeking, with loss of control over drug intake and persistent maladaptive decision making in spite of adverse consequences. The brain mechanisms responsible for drug abuse remain partially unknown despite accumulating evidence delineating molecular and cellular adaptations within the glutamatergic and the dopaminergic systems. However, these adaptations do not fully explain the complex brain disease of drug addiction. The identification of other neurobiological factors responsible for the vulnerability to substance abuse is crucial for the development of promising therapeutic treatments able to alleviate signs of drug dependence.For the past few years, growing evidence demonstrated that a recently discovered brain circuit, the hypocretinergic system, is implicated in many physiological functions, including arousal, energy metabolism, motivation, stress and reward-related behaviors. The hypocretin system is composed of a few thousands neurons arising from the lateral hypothalamus and projecting to the entire brain. Hypocretin- deficient mice have been generated, and unexpectedly, their phenotype resembles that of wild type mice excepting sleep attacks strikingly similar to those of human narcolepsy patients. Evidence suggesting that hypocretins are required for the acquisition and the expression of drug addiction has also been reported; however the precise mechanism by which hypocretins modulate drug seeking behaviors remains a matter of debate. Here, we report alcohol and cocaine reward-related behaviors in hypocretin-deficient mice (KO), as well as heterozygous (HET) and wild type (WT) littermates.We first evaluated the impact of repeated cocaine injections (15 mg/kg, ip) on locomotor sensitization and conditioned place preference. We observed that WT, HET and KO mice exhibited behavioral sensitization following repeated cocaine administrations, but hypocretin deficient males displayed a delayed and attenuated response to chronic cocaine administrations. Interestingly, HET males exhibited an intermediate pattern of behavioral sensitization. However, after standardization of the post-injection data versus the period of habituation prior to cocaine injections, all mice displayed similar amplitudes of behavioral sensitization, except a reduced response in KO males on the first day, suggesting that the delayed and reduced cocaine-induced locomotor sensitization may reflect a hypoactive phenotype and probably not an altered response to repeated cocaine administrations. Unexpectedly, all female mice exhibited similar patterns of cocaine-induced behavioral sensitization. We then assessed the behavioral conditioning for an environment repeatedly paired with cocaine injections (15 mg/kg ip). All mice, whatever their gender or genotype, exhibited a robust preference for the environment previously paired with cocaine administrations. Noteworthy, following two weeks of cocaine abstinence, hypocretin-deficient males and females no longer exhibited any preference for the compartment previously paired with cocaine rewards whereas both WT and HET mice continued manifesting a robust preference. We finally assessed drinking behaviors in WT, HET and KO female mice using a novel paradigm, the IntelliCages®. We report here that KO females tended to less explore the four cage comers where water was easily available. When exposed to four different kinds of liquid solutions (water, ImM quinine or saccharine 0.2%, alcohol 8% and alcohol 16%), KO mice tended to less consume the sweet and the alcoholic beverages. However, after data standardization, no significant differences were noticed between genotypes suggesting that the hypoactive phenotype is most likely accountable for the trend regarding the reduced sweet or alcohol intake in KO.Taken together, the present findings confirm that the behavior seen in Hcrt KO mice likely reflects developmental compensations since only a slightly altered cocaine-induced behavioral sensitization and a normal behavioral conditioning with cocaine were observed in these mice compared to HET and WT littermates. With regards to drinking behaviors, KO mice barely displayed any behavioral changes but a trend for reducing sweet and alcoholic beverages. Overall, the most striking observation is the constant hypoactive phenotype seen in the hypocretin-deficient mice that most likely is accountable for their reduced tendency to explore the environment. Whether this hypoactive phenotype is due to a reduced alertness or reduced motivation for reward seeking remains debatable, but our findings suggest that the hypocretin-deficient mice barely display any altered motivation for reward seeking in environments where low efforts are required to access to a reward.

Dopamine reverses reward insensitivity in apathy following globus pallidus lesions.

Apathy is a complex, behavioural disorder associated with reduced spontaneous initiation of actions. Although present in mild forms in some healthy people, it is a pathological state in conditions such as Alzheimer's and Parkinson's disease where it can have profoundly devastating effects. Understanding the mechanisms underlying apathy is therefore of urgent concern but this has proven difficult because widespread brain changes in neurodegenerative diseases make interpretation difficult and there is no good animal model. Here we present a very rare case with profound apathy following bilateral, focal lesions of the basal ganglia, with globus pallidus regions that connect with orbitofrontal (OFC) and ventromedial prefrontal cortex (VMPFC) particularly affected. Using two measures of oculomotor decision-making we show that apathy in this individual was associated with reward insensitivity. However, reward sensitivity could be established partially with levodopa and more effectively with a dopamine receptor agonist. Concomitantly, there was an improvement in the patient's clinical state, with reduced apathy, greater motivation and increased social interactions. These findings provide a model system to study a key neuropsychiatric disorder. They demonstrate that reward insensitivity associated with basal ganglia dysfunction might be an important component of apathy that can be reversed by dopaminergic modulation.

The hypocretins and the reward function: what have we learned so far?

A general consensus acknowledges that drug consumption (including alcohol, tobacco, and illicit drugs) constitutes the leading cause of preventable death worldwide. But the global burden of drug abuse extends the mortality statistics. Indeed, the comorbid long-term debilitating effects of the disease also significantly deteriorate the quality of life of individuals suffering from addiction disorders. Despite the large body of evidence delineating the cellular and molecular adaptations induced by chronic drug consumption, the brain mechanisms responsible for drug craving and relapse remain insufficiently understood, and even the most recent developments in the field have not brought significant improvement in the management of drug dependence. Though, recent preclinical evidence suggests that disrupting the hypocretin (orexin) system may serve as an anticraving medication therapy. Here, we discuss how the hypocretins, which orchestrate normal wakefulness, metabolic health and the execution of goal-oriented behaviors, may be compromised and contribute to elicit compulsive drug seeking. We propose an overview on the most recent studies demonstrating an important role for the hypocretin neuropeptide system in the regulation of drug reward and the prevention of drug relapse, and we question the relevance of disrupting the hypocretin system to alleviate symptoms of drug addiction.

Reward networks in the brain as captured by connectivity measures

An assortment of human behaviors is thought to be driven by rewards including reinforcement learning, novelty processing, learning, decision making, economic choice, incentive motivation, and addiction. In each case the ventral tegmental area/ventral striatum (nucleus accumbens) (VTAVS) system has been implicated as a key structure by functional imaging studies, mostly on the basis of standard, univariate analyses. Here we propose that standard functional magnetic resonance imaging analysis needs to be complemented by methods that take into account the differential connectivity of the VTAVS system in the different behavioral contexts in order to describe reward based processes more appropriately. We fi rst consider the wider network for reward processing as it emerged from animal experimentation. Subsequently, an example for a method to assess functional connectivity is given. Finally, we illustrate the usefulness of such analyses by examples regarding reward valuation, reward expectation and the role of reward in addiction.

Neural basis of the undermining effect of monetary reward on intrinsic motivation

Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This “undermining effect” has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value.

Dopamine-related deficit in reward learning after catecholamine depletion in unmedicated, remitted subjects with bulimia nervosa

Disturbances in reward processing have been implicated in bulimia nervosa (BN). Abnormalities in processing reward-related stimuli might be linked to dysfunctions of the catecholaminergic neurotransmitter system, but findings have been inconclusive. A powerful way to investigate the relationship between catecholaminergic function and behavior is to examine behavioral changes in response to experimental catecholamine depletion (CD). The purpose of this study was to uncover putative catecholaminergic dysfunction in remitted subjects with BN who performed a reinforcement-learning task after CD. CD was achieved by oral alpha-methyl-para-tyrosine (AMPT) in 19 unmedicated female subjects with remitted BN (rBN) and 28 demographically matched healthy female controls (HC). Sham depletion administered identical capsules containing diphenhydramine. The study design consisted of a randomized, double-blind, placebo-controlled crossover, single-site experimental trial. The main outcome measures were reward learning in a probabilistic reward task analyzed using signal-detection theory. Secondary outcome measures included self-report assessments, including the Eating Disorder Examination-Questionnaire. Relative to healthy controls, rBN subjects were characterized by blunted reward learning in the AMPT-but not in placebo-condition. Highlighting the specificity of these findings, groups did not differ in their ability to perceptually distinguish between stimuli. Increased CD-induced anhedonic (but not eating disorder) symptoms were associated with a reduced response bias toward a more frequently rewarded stimulus. In conclusion, under CD, rBN subjects showed reduced reward learning compared with healthy control subjects. These deficits uncover disturbance of the central reward processing systems in rBN related to altered brain catecholamine levels, which might reflect a trait-like deficit increasing vulnerability to BN.

A comprehensive analysis of sexual dimorphism in the midbrain dopamine system

Thesis (Ph.D.)--University of Washington, 2016-06

Conceptual distinctions among Carver and White's (1994) BAS scales: A reward-reactivity versus trait impulsivity perspective

The 'BIS/BAS scales' (Carver & White, 1994) is the most widely cited inventory for assessing Gray's (1982,1991) Reinforcement Sensitivity Theory (RST) of personality. A peculiarity of this instrument is its three-factor representation of Gray's Behavioural Activation System (BAS), which mediates reactions to reward. While the BAS was initially proposed as the causal basis of Impulsivity, recent arguments suggest that Impulsivity is related to but distinct from reward-reactivity. In this paper, two studies examined Carver and White's BAS scales in terms of factor structure, and convergent/divergent validity when predicting proxies of Impulsivity and reward-reactivity. Confirmatory Factor Analysis revealed structural distinctions between the three BAS scales, and multivariate regression suggested that two of the scales (Drive and Reward-Responsiveness) reflect key concepts of the BAS, while the third (Fun-Seeking) has a broader focus, being equally related to reward-reactivity and Impulsivity. (c) 2005 Elsevier Ltd. All rights reserved.