Characterization of the neural mechanisms supporting the implementation of cognitive control in human decision making

Humans are particularly adept at modifying their behavior in accordance with changing environmental demands. Through various mechanisms of cognitive control, individuals are able to tailor actions to fit complex short- and long-term goals. The research described in this thesis uses functional magnetic resonance imaging to characterize the neural correlates of cognitive control at two levels of complexity: response inhibition and self-control in intertemporal choice. First, we examined changes in neural response associated with increased experience and skill in response inhibition; successful response inhibition was associated with decreased neural response over time in the right ventrolateral prefrontal cortex, a region widely implicated in cognitive control, providing evidence for increased neural efficiency with learned automaticity. We also examined a more abstract form of cognitive control using intertemporal choice. In two experiments, we identified putative neural substrates for individual differences in temporal discounting, or the tendency to prefer immediate to delayed rewards. Using dynamic causal models, we characterized the neural circuit between ventromedial prefrontal cortex, an area involved in valuation, and dorsolateral prefrontal cortex, a region implicated in self-control in intertemporal and dietary choice, and found that connectivity from dorsolateral prefrontal cortex to ventromedial prefrontal cortex increases at the time of choice, particularly when delayed rewards are chosen. Moreover, estimates of the strength of connectivity predicted out-of-sample individual rates of temporal discounting, suggesting a neurocomputational mechanism for variation in the ability to delay gratification. Next, we interrogated the hypothesis that individual differences in temporal discounting are in part explained by the ability to imagine future reward outcomes. Using a novel paradigm, we imaged neural response during the imagining of primary rewards, and identified negative correlations between activity in regions associated the processing of both real and imagined rewards (lateral orbitofrontal cortex and ventromedial prefrontal cortex, respectively) and the individual temporal discounting parameters estimated in the previous experiment. These data suggest that individuals who are better able to represent reward outcomes neurally are less susceptible to temporal discounting. Together, these findings provide further insight into role of the prefrontal cortex in implementing cognitive control, and propose neurobiological substrates for individual variation.

Neural and computational representations of decision variables

These studies explore how, where, and when representations of variables critical to decision-making are represented in the brain. In order to produce a decision, humans must first determine the relevant stimuli, actions, and possible outcomes before applying an algorithm that will select an action from those available. When choosing amongst alternative stimuli, the framework of value-based decision-making proposes that values are assigned to the stimuli and that these values are then compared in an abstract “value space” in order to produce a decision. Despite much progress, in particular regarding the pinpointing of ventromedial prefrontal cortex (vmPFC) as a region that encodes the value, many basic questions remain. In Chapter 2, I show that distributed BOLD signaling in vmPFC represents the value of stimuli under consideration in a manner that is independent of the type of stimulus it is. Thus the open question of whether value is represented in abstraction, a key tenet of value-based decision-making, is confirmed. However, I also show that stimulus-dependent value representations are also present in the brain during decision-making and suggest a potential neural pathway for stimulus-to-value transformations that integrates these two results.

More broadly speaking, there is both neural and behavioral evidence that two distinct control systems are at work during action selection. These two systems compose the “goal-directed system”, which selects actions based on an internal model of the environment, and the “habitual” system, which generates responses based on antecedent stimuli only. Computational characterizations of these two systems imply that they have different informational requirements in terms of input stimuli, actions, and possible outcomes. Associative learning theory predicts that the habitual system should utilize stimulus and action information only, while goal-directed behavior requires that outcomes as well as stimuli and actions be processed. In Chapter 3, I test whether areas of the brain hypothesized to be involved in habitual versus goal-directed control represent the corresponding theorized variables.

The question of whether one or both of these neural systems drives Pavlovian conditioning is less well-studied. Chapter 4 describes an experiment in which subjects were scanned while engaged in a Pavlovian task with a simple non-trivial structure. After comparing a variety of model-based and model-free learning algorithms (thought to underpin goal-directed and habitual decision-making, respectively), it was found that subjects’ reaction times were better explained by a model-based system. In addition, neural signaling of precision, a variable based on a representation of a world model, was found in the amygdala. These data indicate that the influence of model-based representations of the environment can extend even to the most basic learning processes.

Knowledge of the state of hidden variables in an environment is required for optimal inference regarding the abstract decision structure of a given environment and therefore can be crucial to decision-making in a wide range of situations. Inferring the state of an abstract variable requires the generation and manipulation of an internal representation of beliefs over the values of the hidden variable. In Chapter 5, I describe behavioral and neural results regarding the learning strategies employed by human subjects in a hierarchical state-estimation task. In particular, a comprehensive model fit and comparison process pointed to the use of "belief thresholding". This implies that subjects tended to eliminate low-probability hypotheses regarding the state of the environment from their internal model and ceased to update the corresponding variables. Thus, in concert with incremental Bayesian learning, humans explicitly manipulate their internal model of the generative process during hierarchical inference consistent with a serial hypothesis testing strategy.

Cytokine pathway disruption in a mouse model of schizophrenia induced by Munc18-1a overexpression in the brain

Background: An accumulating body of evidence points to the significance of neuroinflammation and immunogenetics in schizophrenia, and an imbalance of cytokines in the central nervous system (CNS) has been suggested to be associated with the disorder. Munc18-overexpressing mice (Munc18-OE) have provided a model for the study of the alterations that may underlie the symptoms of subjects with schizophrenia. The aim of the present study was to elucidate the involvement of neuroinflammation and cytokine imbalance in this model. Methods: Cytokines were evaluated in the cortex and the striatum of Munc18-OE and wild-type (WT) mice by enzyme-linked immunosorbent assay (ELISA). Protein levels of specific microglia and macrophage, astrocytic and neuroinflammation markers were quantified by western blot in the cortex and the striatum of Munc18-OE and WT mice. Results: Each cytokine evaluated (Interferon-gamma (IFN-gamma), Tumor Necrosis Factor-alpha (TNF-alpha), Interleukin-2 (IL-2) and CCL2 chemokine) was present at higher levels in the striatum of Munc18-OE mice than WT. Cortical TNF-alpha and IL-2 levels were significantly lower in Munc18-OE mice than WT mice. The microglia and macrophage marker CD11b was lower in the cortexes of Munc18-OE mice than WT, but no differences were observed in the striatum. Glial Fibrillary Acidic Protein (GFAP) and Nuclear Factor-kappaB (NF-kappa B)p65 levels were not different between the groups. Interleukin-1beta (IL-1 beta) and IL-6 levels were beneath detection limits. Conclusions: The disrupted levels of cytokines detected in the brain of Munc18-OE mice was found to be similar to clinical reports and endorses study of this type for analysis of this aspect of the disorder. The lower CD11b expression in the cortex but not in the striatum of the Munc18-OE mice may reflect differences in physiological activity. The cytokine expression pattern observed in Munc18-OE mice is similar to a previously published model of schizophrenia caused by maternal immune activation. Together, these data suggest a possible role for an immune imbalance in this disorder.

Alcohol-Related Brain Damage in Humans

Chronic excessive alcohol intoxications evoke cumulative damage to tissues and organs. We examined prefrontal cortex (Brodmann's area (BA) 9) from 20 human alcoholics and 20 age, gender, and postmortem delay matched control subjects. H & E staining and light microscopy of prefrontal cortex tissue revealed a reduction in the levels of cytoskeleton surrounding the nuclei of cortical and subcortical neurons, and a disruption of subcortical neuron patterning in alcoholic subjects. BA 9 tissue homogenisation and one dimensional polyacrylamide gel electrophoresis (PAGE) proteomics of cytosolic proteins identified dramatic reductions in the protein levels of spectrin beta II, and alpha- and beta-tubulins in alcoholics, and these were validated and quantitated by Western blotting. We detected a significant increase in a-tubulin acetylation in alcoholics, a non-significant increase in isoaspartate protein damage, but a significant increase in protein isoaspartyl methyltransferase protein levels, the enzyme that triggers isoaspartate damage repair in vivo. There was also a significant reduction in proteasome activity in alcoholics. One dimensional PAGE of membrane-enriched fractions detected a reduction in beta-spectrin protein levels, and a significant increase in transmembranous alpha 3 (catalytic) subunit of the Na+, K+-ATPase in alcoholic subjects. However, control subjects retained stable oligomeric forms of a-subunit that were diminished in alcoholics. In alcoholics, significant loss of cytosolic alpha-and beta-tubulins were also seen in caudate nucleus, hippocampus and cerebellum, but to different levels, indicative of brain regional susceptibility to alcohol-related damage. Collectively, these protein changes provide a molecular basis for some of the neuronal and behavioural abnormalities attributed to alcoholics

Efeito da estimulação transcraniana por corrente contínua sobre o desempenho físico: análise das respostas cerebrais, metabólicas e perceptivas durante e após exercícios aeróbio e de força

Estimulação transcraniana por corrente contínua (ETCC) sobre áreas corticais pré-selecionadas, tem aumentado o desempenho físico de diferentes populações. Porém, lacunas persistem no tocante aos mecanismos subjacentes à estes efeitos. Assim, a presente tese objetivou: a) investigar os efeitos da ETCC anódica (aETCC) e placebo (Sham) no córtex motor (CM) de indivíduos saudáveis sobre o desempenho de força máxima; b) comparar os efeitos da ETCC sobre a produção de força máxima e estabilidadade da força durante exercícios máximo e submáximo em sujeitos hemiparéticos e saudáveis; c) investigar o efeito da ETCC sobre a conectividade funcional inter-hemisférica (coerência eletroencefalográfica cEEG) do córtex pré-frontal (CPF), desempenho aeróbio e dispêndio energético (EE) durante e após exercício máximo e submáximo. No 1 estudo, 14 adultos saudáveis executaram 2 sessões de exercício máximo de força (EMF) dos músculos flexores e extensores do joelho dominante (3 séries de 10 rep máximas), precedidos por aETCC ou Sham (2mA; 20 mim). aETCC não foi capaz de aumentar o trabalho total e pico de torque (PT), resistência à fadiga ou atividade eletromiográfica durante o EMF. No 2 estudo, 10 hemiparéticos e 9 sujeitos saudáveis receberam aETCC e Sham no CM. O PT e a estabilidade da força (coeficiente de variação - CV) foram avaliados durante protocolo máximo e submáximo de extensão e flexão unilateral do joelho (1 série de 3 reps a 100% do PT e 2 séries de 10 reps a 50% do PT). Nenhuma diferença no PT foi observada nos dois grupos. Diminuições no CV foram obervadas durante a extensão (~25-35%, P<0.001) e flexão de joelho (~22-33%, P<0.001) após a aETCC comparada com Sham nos hemiparéticos, entretanto, somente o CV na extensão de joelhos diminuiu (~13-27%, P<0.001) nos saudáveis, o que sugere que aETCC pode melhorar o CV, mas não o PT em sujeitos hemiparéticos. No 3 estudo, 9 adultos saudáveis realizaram 2 testes incrementais máximos precedidos por aETCC ou Sham sobre o CPF com as respostas cardiorrespiratórias, percepção de esforço (PSE) e cEEG do CPF sendo monitoradas. O VO2 de pico (42.64.2 vs. 38.23.3 mL.kg.min-1; P=0,02), potência total (252.776.5 vs. 23773.3 W; P=0,05) e tempo de exaustão (531.1140 vs. 486.7115.3 seg; P=0,04) foram maiores após aETCC do que a Sham. Nenhuma diferença foi encontrada para FC e PSE em função da carga de trabalho (P>0,05). A cEEG do CPF aumentou após aETCC vs. repouso (0.700.40 vs. 0.380.05; P=0,001), mas não após Sham vs. repouso (0.360.49 vs. 0.330.50; P=0,06), sugerindo que a aETCC pode retardar a fadiga aumentando a conectividade funcional entre os hemisférios do CPF e desempenho aeróbio durante exercício exaustivo. No 4 estudo, o VO2 e EE foram avaliados em 11 adultos saudáveis antes, durante a aETCC ou Sham no CPF e 30 min após exercício aeróbio submáximo isocalórico (~200kcal). Diferenças não foram observadas no VO2 vs. repouso durante aETCC e Sham (P=0.95 e P=0.85). Porém, a associação entre exercício e aETCC aumentou em ~19% o EE após ao menos, 30 min de recuperação após exercício quando comparada a Sham (P<0,05).

恒河猴大脑前额叶cDNA 文库的构建

为筛选出与认知、记忆相关的脑部表达基因及基因家族,利用TRIzol试剂从恒河猴大脑前额叶组织抽提总RNA,再用纯化试剂盒从总RNA中成功纯化出mRNA。按照Stratagene公司的cDNASynthesisKit(200401)、ZAP-cDNASynthesisKit(200400)和ZAP-cDNAGigapackⅢGoldCloningKit(200450)三个试剂盒的操作说明,构建了恒河猴大脑前额叶组织的cDNA文库。文库总库容为2·0×106克隆;绝大多数的cDNA插入片段≥0·5kb,平均长度≈1·0kb;cDNA片段与噬菌体载体重组率为97·3%。文库各项指标均达要求,为克隆大脑PFC区表达基因、测定基因编码区序列、揭示具有多种剪切组合模式等提供了可靠资源,也为相关基因表达调控的研究提供了方便。

Differential amplitude modulation of auditory evoked cortical potentials associated with brain state in the freely moving rhesus monkey

We simultaneously recorded auditory evoked potentials (AEP) from the temporal cortex (TCx), the dorsolateral prefrontal cortex (dPFCx) and the parietal cortex (PCx) in the freely moving rhesus monkey to investigate state-dependent changes of the AEP. AEPs obtained during passive wakefulness, active wakefulness (AW), slow wave sleep and rapid-eye-movement sleep (REM) were compared. Results showed that AEP from all three cerebral areas were modulated by brain states. However, the amplitude of AEP from dPFCx and PCx significantly appeared greater attenuation than that from the TCx during AW and REM. These results indicate that the modulation of brain state on AEP from all three cerebral areas investigated is not uniform, which suggests that different cerebral areas have differential functional contributions during sleep-wake cycle. (C) 2002 Elsevier Science Ireland Ltd.. All rights reserved.

A microelectrode drive for long term recording of neurons in freely moving and chaired monkeys

An electrode drive is described for recordings of neurons in freely moving and chaired monkeys during the performance of behavioural tasks. The electrode drives are implanted for periods of up to 6 months, and can advance up to 42 electrodes using 14 independent drive mechanisms. The drive samples 288 points within a 12 mm x 12 min region, with 15 min of electrode travel. Major advantages are that recordings are made in freely moving monkeys, and these recordings can be compared with those in chaired experiments; waveforms of single neurons are stable, enabling prolonged recordings of the same neurons across periods of days; recordings can be made throughout the brain, including the dorsolateral prefrontal cortex and hippocampus; the drive accommodates both sharp microelectrodes and fine wire assemblies such as tetrodes. (C) 2003 Elsevier Science B.V; All rights reserved.

RESERPINE IMPAIRS SPATIAL WORKING-MEMORY PERFORMANCE IN MONKEYS - REVERSAL BY THE ALPHA-2-ADRENERGIC AGONIST CLONIDINE

Repeated daily treatment with the catecholamine-depleting agent, reserpine, dramatically reduced performance on the delayed response task, a test of spatial working memory that depends upon the integrity of the prefrontal cortex. Delayed response performance fell from an average of 27.2/30 trials correct before reserpine treatment to an average of 20.4/30 trials correct after repeated reserpine administration. Injection of the alpha2-adrenergic agonist, clonidine (0.0001-0.05 mg/kg), to chronic reserpine-treated monkeys significantly restored performance on the delayed response task; performance after an optimal dose averaged 27.8/30 trials correct. Clonidine's beneficial effects on delayed response performance were longlasting; monkeys remained improved for more than 24 h after a single clonidine injection. The finding that clonidine is efficacious in reserpinized animals supports the hypothesis that alpha2-adrenergic agonists improve cognitive function through actions at postsynaptic, alpha2-adrenergic receptors on non-adrenergic cells. In contrast to the delayed response task, reserpine had little effect on performance of a visual discrimination task, a reference memory task which does not depend on the prefrontal cortex. These results emphasize the importance of postsynaptic alpha2-adrenergic mechanisms in the regulation of working memory,

DOPAMINE D-1 RECEPTOR MECHANISMS IN THE COGNITIVE PERFORMANCE OF YOUNG-ADULT AND AGED MONKEYS

Dopamine (DA) D-1 receptor compounds were examined in monkeys for effects on the working memory functions of the prefrontal cortex and on the fine motor abilities of the primary motor cortex. The D-1 antagonist, SCH23390, the partial D-1 agonist, SKF38393, and the full D-1 agonist, dihydrexidine, were characterized in young control monkeys, and in aged monkeys with naturally occurring catecholamine depletion. In addition, SKF38393 was tested in young monkeys experimentally depleted of catecholamines with chronic reserpine treatment. Injections of SCH23390 significantly impaired the memory performance of young control monkeys, but did not impair aged monkeys with presumed catecholamine depletion. Conversely, the partial agonist, SKF38393, improved the depleted monkeys (aged or reserpine-treated) but did not improve young control animals. The full agonist, dihydrexidine, did improve memory performance in young control monkeys, as well as in a subset of aged monkeys. Consistent with D, receptor mechanisms, agonist-induced improvements were blocked by SCH23390. Drug effects on memory performance occurred independently of effects on fine motor performance. These results underscore the importance of DA D-1 mechanisms in cognitive function, and provide functional evidence of DA system degeneration in aged monkeys. Finally, high doses of D-1 agonists impaired memory performance in aged monkeys, suggesting that excessive D-1 stimulation may be deleterious to cognitive function.

Dose-dependent effects of the dopamine D1 receptor agonists A77636 or SKF81297 on spatial working memory in aged monkeys

With advancing age, monkeys develop deficits in spatial working memory resembling those induced by lesions of the prefrontal cortex (PFC). Aged monkeys also exhibit marked loss of dopamine from the PFC, a transmitter known to be important for proper PFC cognitive function. Previous results suggest that D1 agonist treatment can improve spatial working memory abilities in aged monkeys. However, this research was limited by the use of drugs with either partial agonist actions or significant D2 receptor actions. In our study, the selective dopamine D1 receptor full agonists A77636 and SKF81297 were examined in aged monkeys for effects on the working memory functions of the PFC. Both compounds produced a significant, dose-related effect on delayed response performance without evidence of side effects: low doses improved performance although higher doses impaired or had no effect on performance. Both the improvement and impairment in performance were reversed by pretreatment with the D1 receptor antagonist, SCH23390. These findings are consistent with previous results demonstrating that there is a narrow range of D1 receptor stimulation for optimal PFC cognitive function, and suggest that very low doses of D1 receptor agonists may have cognitive-enhancing actions in the elderly.

Extract of Ginkgo biloba leaves reverses yohimbine-induced spatial working memory deficit in rats

Extract of Ginkgo biloba is used to alleviate age-related decline in cognitive function, which may be associated with the loss of catecholamines in the prefrontal cortex. The purpose of this study was to verify whether alpha-2 adrenergic activity is involved in the facilitative effects of extract of Ginkgo biloba on prefrontal cognitive function. Male Wistar rats were trained to reach criterion in the delayed alternation task (0, 25, and 50-s delay intervals). A pilot study found that 3 or 4 mg/kg of yohimbine (intraperitoneal) reduced the choice accuracy of the delayed alternation task in a dose and delay-dependent manner, without influencing motor ability or perseverative behaviour. Acute oral pre-treatment with doses of 50, 100, or 200 mg/kg (but not 25 mg/kg) of extract of Ginkgo biloba prevented the reduction in choice accuracy induced by 4 mg/kg yohimbine. These data suggest that the prefrontal cognition-enhancing effects of extract of Ginkgo biloba are related to its actions on alpha-2-adrenoceptors.

The effects of centrally administered fluorocitrate via inhibiting glial cells on working memory in rats

Although prefrontal and hippocampal neurons are critical for spatial working memory, the function of glial cells in spatial working memory remains uncertain. In this study we investigated the function of glial cells in rats' working memory. The glial cell

Dopamine and performance in a reinforcement learning task: evidence from Parkinson's disease.

The role dopamine plays in decision-making has important theoretical, empirical and clinical implications. Here, we examined its precise contribution by exploiting the lesion deficit model afforded by Parkinson's disease. We studied patients in a two-stage reinforcement learning task, while they were ON and OFF dopamine replacement medication. Contrary to expectation, we found that dopaminergic drug state (ON or OFF) did not impact learning. Instead, the critical factor was drug state during the performance phase, with patients ON medication choosing correctly significantly more frequently than those OFF medication. This effect was independent of drug state during initial learning and appears to reflect a facilitation of generalization for learnt information. This inference is bolstered by our observation that neural activity in nucleus accumbens and ventromedial prefrontal cortex, measured during simultaneously acquired functional magnetic resonance imaging, represented learnt stimulus values during performance. This effect was expressed solely during the ON state with activity in these regions correlating with better performance. Our data indicate that dopamine modulation of nucleus accumbens and ventromedial prefrontal cortex exerts a specific effect on choice behaviour distinct from pure learning. The findings are in keeping with the substantial other evidence that certain aspects of learning are unaffected by dopamine lesions or depletion, and that dopamine plays a key role in performance that may be distinct from its role in learning.

Neural mechanisms of belief inference during cooperative games.

Humans have the arguably unique ability to understand the mental representations of others. For success in both competitive and cooperative interactions, however, this ability must be extended to include representations of others' belief about our intentions, their model about our belief about their intentions, and so on. We developed a "stag hunt" game in which human subjects interacted with a computerized agent using different degrees of sophistication (recursive inferences) and applied an ecologically valid computational model of dynamic belief inference. We show that rostral medial prefrontal (paracingulate) cortex, a brain region consistently identified in psychological tasks requiring mentalizing, has a specific role in encoding the uncertainty of inference about the other's strategy. In contrast, dorsolateral prefrontal cortex encodes the depth of recursion of the strategy being used, an index of executive sophistication. These findings reveal putative computational representations within prefrontal cortex regions, supporting the maintenance of cooperation in complex social decision making.