Neural and computational representations of decision variables

These studies explore how, where, and when representations of variables critical to decision-making are represented in the brain. In order to produce a decision, humans must first determine the relevant stimuli, actions, and possible outcomes before applying an algorithm that will select an action from those available. When choosing amongst alternative stimuli, the framework of value-based decision-making proposes that values are assigned to the stimuli and that these values are then compared in an abstract “value space” in order to produce a decision. Despite much progress, in particular regarding the pinpointing of ventromedial prefrontal cortex (vmPFC) as a region that encodes the value, many basic questions remain. In Chapter 2, I show that distributed BOLD signaling in vmPFC represents the value of stimuli under consideration in a manner that is independent of the type of stimulus it is. Thus the open question of whether value is represented in abstraction, a key tenet of value-based decision-making, is confirmed. However, I also show that stimulus-dependent value representations are also present in the brain during decision-making and suggest a potential neural pathway for stimulus-to-value transformations that integrates these two results.

More broadly speaking, there is both neural and behavioral evidence that two distinct control systems are at work during action selection. These two systems compose the “goal-directed system”, which selects actions based on an internal model of the environment, and the “habitual” system, which generates responses based on antecedent stimuli only. Computational characterizations of these two systems imply that they have different informational requirements in terms of input stimuli, actions, and possible outcomes. Associative learning theory predicts that the habitual system should utilize stimulus and action information only, while goal-directed behavior requires that outcomes as well as stimuli and actions be processed. In Chapter 3, I test whether areas of the brain hypothesized to be involved in habitual versus goal-directed control represent the corresponding theorized variables.

The question of whether one or both of these neural systems drives Pavlovian conditioning is less well-studied. Chapter 4 describes an experiment in which subjects were scanned while engaged in a Pavlovian task with a simple non-trivial structure. After comparing a variety of model-based and model-free learning algorithms (thought to underpin goal-directed and habitual decision-making, respectively), it was found that subjects’ reaction times were better explained by a model-based system. In addition, neural signaling of precision, a variable based on a representation of a world model, was found in the amygdala. These data indicate that the influence of model-based representations of the environment can extend even to the most basic learning processes.

Knowledge of the state of hidden variables in an environment is required for optimal inference regarding the abstract decision structure of a given environment and therefore can be crucial to decision-making in a wide range of situations. Inferring the state of an abstract variable requires the generation and manipulation of an internal representation of beliefs over the values of the hidden variable. In Chapter 5, I describe behavioral and neural results regarding the learning strategies employed by human subjects in a hierarchical state-estimation task. In particular, a comprehensive model fit and comparison process pointed to the use of "belief thresholding". This implies that subjects tended to eliminate low-probability hypotheses regarding the state of the environment from their internal model and ceased to update the corresponding variables. Thus, in concert with incremental Bayesian learning, humans explicitly manipulate their internal model of the generative process during hierarchical inference consistent with a serial hypothesis testing strategy.

The role of the IL-1 type 1 receptor in the life, death and differentiation of adult hippocampal neural precursor cells

Neurogenesis occurs in two distinct regions of the adult brain; the subgranular zone (SGZ) of the dentate gyrus (DG) in the hippocampus, and the subventricular zone (SVZ) lining the lateral ventricles. It is now well-known that adult hippocampal neurogenesis can be modulated by a number of intrinsic and extrinsic factors e.g. local signalling molecules, exercise, environmental enrichment and learning. Moreover, levels of adult hippocampal neurogenesis decrease with age, at least in rodents, and alterations in hippocampal neurogenesis have been reported in animal models and human studies of neuropsychiatric and neurodegenerative conditions. Neuroinflammation is a common pathological feature of these conditions and is also a potent modulator of adult hippocampal neurogenesis. Recently, the orphan nuclear receptor TLX has been identified as an important regulator of adult hippocampal neurogenesis as its expression is necessary to maintain the neural precursor cell (NPC) pool in the adult DG. Likewise, exposure of animals to voluntary exercise has been consistently demonstrated to promote adult hippocampal neurogenesis. Lentivirus (LV)- mediated gene transfer is a useful tool to elucidate gene function and to explore potential therapeutic candidates across an array of conditions as it facilitates sustained gene expression in both dividing and post-mitotic cell populations. Both intrinsic and extrinsic factors are important regulators of adult hippocampal neurogenesis. Examining how these factors are affected by an inflammatory stimulus, and the subsequent effects on adult hippocampal neurogenesis provides important information for the development of novel treatment strategies for neuropsychiatric and neurodegenerative conditions in which adult hippocampal neurogenesis is impaired. The aims of the series of experiments presented in this thesis were to examine the effect of the pro-inflammatory cytokine interleukin-1β (IL-1β) on adult hippocampal NPCs both in vitro and in vivo. In vitro, we have shown that IL-1β reduces proliferation of adult hippocampal NPCs in a dose and time-dependent manner. In addition, we have demonstrated that TLX expression is reduced by IL-1β. Blockade of IL-1β signalling prevented both the IL-1β-induced reduction in cell proliferation and TLX expression. In vivo, we examined the effect of short term and long term exposure to LV-IL-1β in sedentary mice and in mice exposed to voluntary running. We demonstrated that impaired hippocampal neurogenesis is only evident after long term exposure to IL-1β. In mice exposed to voluntary running, hippocampal neurogenesis is significantly increased following short-term but not long-term exposure to running. Moreover, short-term running effectively prevents any IL-1β-induced effects on hippocampal neurogenesis; however, no such effects are seen following long-term exposure to running.

Identifying novel molecular mechanisms of ghrelin receptor signalling underlying neural control of food intake: interaction with stress and impulsivity

The gut-hormone, ghrelin, activates the centrally expressed growth hormone secretagogue 1a (GHS-R1a) receptor, or ghrelin receptor. The ghrelin receptor is a G-protein coupled receptor (GPCR) expressed in several brain regions, including the arcuate nucleus (Arc), lateral hypothalamus (LH), ventral tegmental area (VTA), nucleus accumbens (NAcc) and amygdala. Activation of the GHS-R1a mediates a multitude of biological activities, including release of growth hormone and food intake. The ghrelin signalling system also plays a key role in the hedonic aspects of food intake and activates the dopaminergic mesolimbic circuit involved in reward signalling. Recently, ghrelin has been shown to be involved in mediating a stress response and to mediate stress-induced food reward behaviour via its interaction with the HPA-axis at the level of the anterior pituitary. Here, we focus on the role of the GHS-R1a receptor in reward behaviour, including the motivation to eat, its anxiogenic effects, and its role in impulsive behaviour. We investigate the functional selectivity and pharmacology of GHS-R1a receptor ligands as well as crosstalk of the GHS-R1a receptor with the serotonin 2C (5-HT2C) receptor, which represent another major target in the regulation of eating behaviour, stress-sensitivity and impulse control disorders. We demonstrate, to our knowledge for the first time, the direct impact of GHS-R1a signalling on impulsive responding in a 2-choice serial reaction time task (2CSRTT) and show a role for the 5-HT2C receptor in modulating amphetamine-associated impulsive action. Finally, we investigate differential gene expression patterns in the mesocorticolimbic pathway, specifically in the NAcc and PFC, between innate low- and high-impulsive rats. Together, these findings are poised to have important implications in the development of novel treatment strategies to combat eating disorders, including obesity and binge eating disorders as well as impulse control disorders, including, substance abuse and addiction, attention deficit hyperactivity disorder (ADHD) and mood disorders.

Neural modelling, control and optimisation of an industrial grinding process

This paper describes the development of neural model-based control strategies for the optimisation of an industrial aluminium substrate disk grinding process. The grindstone removal rate varies considerably over a stone life and is a highly nonlinear function of process variables. Using historical grindstone performance data, a NARX-based neural network model is developed. This model is then used to implement a direct inverse controller and an internal model controller based on the process settings and previous removal rates. Preliminary plant investigations show that thickness defects can be reduced by 50% or more, compared to other schemes employed. (c) 2004 Elsevier Ltd. All rights reserved.

Improving neural network training solutions using regularisation

This paper describes the application of regularisation to the training of feedforward neural networks, as a means of improving the quality of solutions obtained. The basic principles of regularisation theory are outlined for both linear and nonlinear training and then extended to cover a new hybrid training algorithm for feedforward neural networks recently proposed by the authors. The concept of functional regularisation is also introduced and discussed in relation to MLP and RBF networks. The tendency for the hybrid training algorithm and many linear optimisation strategies to generate large magnitude weight solutions when applied to ill-conditioned neural paradigms is illustrated graphically and reasoned analytically. While such weight solutions do not generally result in poor fits, it is argued that they could be subject to numerical instability and are therefore undesirable. Using an illustrative example it is shown that, as well as being beneficial from a generalisation perspective, regularisation also provides a means for controlling the magnitude of solutions. (C) 2001 Elsevier Science B.V. All rights reserved.

The presence of a culturally similar or dissimilar social partner affects neural responses to emotional stimuli

Background: Emotional responding is sensitive to social context; however, little emphasis has been placed on the mechanisms by which social context effects changes in emotional responding.

Objective: We aimed to investigate the effects of social context on neural responses to emotional stimuli to inform on the mechanisms underpinning context-linked changes in emotional responding.

Design: We measured event-related potential (ERP) components known to index specific emotion processes and self-reports of explicit emotion regulation strategies and emotional arousal. Female Chinese university students observed positive, negative, and neutral photographs, whilst alone or accompanied by a culturally similar (Chinese) or dissimilar researcher (British).

Results: There was a reduction in the positive versus neutral differential N1 amplitude (indexing attentional capture by positive stimuli) in the dissimilar relative to alone context. In this context, there was also a corresponding increase in amplitude of a frontal late positive potential (LPP) component (indexing engagement of cognitive control resources). In the similar relative to alone context, these effects on differential N1 and frontal LPP amplitudes were less pronounced, but there was an additional decrease in the amplitude of a parietal LPP component (indexing motivational relevance) in response to positive stimuli. In response to negative stimuli, the differential N1 component was increased in the similar relative to dissimilar and alone (trend) context.

Conclusion: These data suggest that neural processes engaged in response to emotional stimuli are modulated by social context. Possible mechanisms for the social-context-linked changes in attentional capture by emotional stimuli include a context-directed modulation of the focus of attention, or an altered interpretation of the emotional stimuli based on additional information proportioned by the context.

Current therapeutic strategies to mitigate the eNOS dysfunction in ischaemic stroke

Impairment of endothelial nitric oxide synthase (eNOS) activity is implicated in the pathogenesis of endothelial dysfunction in many diseases including ischaemic stroke. The modulation of eNOS during and/or following ischaemic injury often represents a futile compensatory mechanism due to a significant decrease in nitric oxide (NO) bioavailability coupled with dramatic increases in the levels of reactive oxygen species that further neutralise NO. However, applications of a number of therapeutic agents alone or in combination have been shown to augment eNOS activity under a variety of pathological conditions by potentiating the expression and/or activity of Akt/eNOS/NO pathway components. The list of these therapeutic agents include NO donors, statins, angiotensin-converting enzyme inhibitors, calcium channel blockers, phosphodiesterase-3 inhibitors, aspirin, dipyridamole and ellagic acid. While most of these compounds exhibit anti-platelet properties and are able to up-regulate eNOS expression in endothelial cells and platelets, others suppress eNOS uncoupling and tetrahydrobiopterin (an eNOS stabiliser) oxidation. As the number of therapeutic molecules that modulate the expression and activity of eNOS increases, further detailed research is required to reveal their mode of action in preventing and/or reversing the endothelial dysfunction.

A stochastic programming approach for the development of offering strategies for a wind power producer

A stochastic programming approach is proposed in this paper for the development of offering strategies for a wind power producer. The optimization model is characterized by making the analysis of several scenarios and treating simultaneously two kinds of uncertainty: wind power and electricity market prices. The approach developed allows evaluating alternative production and offers strategies to submit to the electricity market with the ultimate goal of maximizing profits. An innovative comparative study is provided, where the imbalances are treated differently. Also, an application to two new realistic case studies is presented. Finally, conclusions are duly drawn.

Perinatal choline supplementation reveals a dissociation between two types of spatial strategies.

Choline supplementation improving memory functions in rodents is assumed to increase the synthesis and release of acetylcholine in the brain. We have found that a combined pre- and postnatal supplementation results in long-lasting facilitation of spatial memory in juvenile rats when training was conducted in presence of a local salient cue. The present work was aimed at analysing the effects of peri- and postnatal choline supplementation on spatial abilities of naive adult rats. Rats given a perinatal choline supplementation were trained in various cued procedures of the Morris navigation task when aged 5 months. The treatment had a specific effect of reducing the escape latency of the rats when the platform was at a fixed position in space and surrounded by a suspended cue. This effect was associated with an increased spatial bias when the cue and platform were removed. In this condition, the control rats showed impaired spatial discrimination following the removal of the target cue, most likely due to an overshadowing of the distant environmental cues. This impairment was not observed in the treated rats. Further training with the suspended cue at unpredictable places in the pool revealed longer escape latencies in the control than in the treated rats suggesting that this procedure induced a selective perturbation of the normal but not of the treated rats. A special probe trial with the cue at an irrelevant position and no escape platform revealed a significant bias of the control rats toward the cue and of the treated rats toward the uncued spatial escape position. This behavioural dissociation suggests that a salient cue associated with the target induces an alternative "non spatial" guidance strategy in normal rats, with the risk of overshadowing of the more distant spatial cues. In this condition, the choline supplementation facilities a spatial reliance on the cue, that is an overall facilitation of learning a set of spatial relations between several visual cues. As a consequence, the improved escape in presence of the cue is associated with a stronger memory of the spatial position following disappearance of the cue. This and previous observations suggest that a specific spatial attention process relies on the buffering of highly salient visual cues.to facilitate integration of their relative position in the environment.

Programming Hippocampal Neural Stem/Progenitor Cells into Oligodendrocytes Enhances Remyelination in the Adult Brain after Injury.

Demyelinating diseases are characterized by a loss of oligodendrocytes leading to axonal degeneration and impaired brain function. Current strategies used for the treatment of demyelinating disease such as multiple sclerosis largely rely on modulation of the immune system. Only limited treatment options are available for treating the later stages of the disease, and these treatments require regenerative therapies to ameliorate the consequences of oligodendrocyte loss and axonal impairment. Directed differentiation of adult hippocampal neural stem/progenitor cells (NSPCs) into oligodendrocytes may represent an endogenous source of glial cells for cell-replacement strategies aiming to treat demyelinating disease. Here, we show that Ascl1-mediated conversion of hippocampal NSPCs into mature oligodendrocytes enhances remyelination in a diphtheria-toxin (DT)-inducible, genetic model for demyelination. These findings highlight the potential of targeting hippocampal NSPCs for the treatment of demyelinated lesions in the adult brain.

Cross-Linguistic Transfer (CLT) in Bilingual Speakers : Neural Correlates of Language Learning

Le but de cette thèse est d'étudier les corrélats comportementaux et neuronaux du transfert inter-linguistique (TIL) dans l'apprentissage d’une langue seconde (L2). Compte tenu de nos connaissances sur l'influence de la distance linguistique sur le TIL (Paradis, 1987, 2004; Odlin, 1989, 2004, 2005; Gollan, 2005; Ringbom, 2007), nous avons examiné l'effet de facilitation de la similarité phonologique à l’aide de la résonance magnétique fonctionnelle entre des langues linguistiquement proches (espagnol-français) et des langues linguistiquement éloignées (persan-français). L'étude I rapporte les résultats obtenus pour des langues linguistiquement proches (espagnol-français), alors que l'étude II porte sur des langues linguistiquement éloignées (persan-français). Puis, les changements de connectivité fonctionnelle dans le réseau langagier (Price, 2010) et dans le réseau de contrôle supplémentaire impliqué dans le traitement d’une langue seconde (Abutalebi & Green, 2007) lors de l’apprentissage d’une langue linguistiquement éloignée (persan-français) sont rapportés dans l’étude III. Les résultats des analyses d’IRMF suivant le modèle linéaire général chez les bilingues de langues linguistiquement proches (français-espagnol) montrent que le traitement des mots phonologiquement similaires dans les deux langues (cognates et clangs) compte sur un réseau neuronal partagé par la langue maternelle (L1) et la L2, tandis que le traitement des mots phonologiquement éloignés (non-clang-non-cognates) active des structures impliquées dans le traitement de la mémoire de travail et d'attention. Toutefois, chez les personnes bilingues de L1-L2 linguistiquement éloignées (français-persan), même les mots phonologiquement similaires à travers les langues (cognates et clangs) activent des régions connues pour être impliquées dans l'attention et le contrôle cognitif. Par ailleurs, les mots phonologiquement éloignés (non-clang-non-cognates) activent des régions usuellement associées à la mémoire de travail et aux fonctions exécutives. Ainsi, le facteur de distance inter-linguistique entre L1 et L2 module la charge cognitive sur la base du degré de similarité phonologiques entres les items en L1 et L2. Des structures soutenant les processus impliqués dans le traitement exécutif sont recrutées afin de compenser pour des demandes cognitives. Lorsque la compétence linguistique en L2 augmente et que les tâches linguistiques exigent ainsi moins d’effort, la demande pour les ressources cognitives diminue. Tel que déjà rapporté (Majerus, et al, 2008; Prat, et al, 2007; Veroude, et al, 2010; Dodel, et al, 2005; Coynel, et al ., 2009), les résultats des analyses de connectivité fonctionnelle montrent qu’après l’entraînement la valeur d'intégration (connectivité fonctionnelle) diminue puisqu’il y a moins de circulation du flux d'information. Les résultats de cette recherche contribuent à une meilleure compréhension des aspects neurocognitifs et de plasticité cérébrale du TIL ainsi que l'impact de la distance linguistique dans l'apprentissage des langues. Ces résultats ont des implications dans les stratégies d'apprentissage d’une L2, les méthodes d’enseignement d’une L2 ainsi que le développement d'approches thérapeutiques chez des patients bilingues qui souffrent de troubles langagiers.

Validación diagnóstica del test neural 1 para el síndrome de túnel del carpo

El objetivo de este estudio fue realizar una prueba de validez diagnostica del test neural 1 para el diagnóstico del Síndrome de Túnel del Carpo (STC) utilizando como prueba de referencia o de oro el test de conducción nerviosa. En este estudio participaron 115 sujetos, 230 manos con sospecha clínica de STC quienes fueron evaluados con el test de conducción nerviosa y el test neural 1. Se encontró una sensibilidad del 93.0% (IC 95%:88,21-96,79) y una especificidad del 6,67% (IC 95%:0,0-33,59), razón de verosimilitud positiva fue de 1,00 y razón de verosimilitud negativa de 1,05. Valor predictivo positivo de 86,9% y un valor predictivo negativo de 12,5%. Se concluye que el test neural 1 es una prueba clínica de alta sensibilidad y baja especificidad de gran utilidad para el monitoreo e identificación del STC. Es un procedimiento para el diagnóstico clínico de bajo costo que puede incluirse en los exámenes de rutina de los trabajadores como complemento a las pruebas clínicas sugeridas por las Gatiso para dar mayor precisión a la identificación temprana del STC. Se sugiere combinarla con otros test de mayor especificidad para ser aplicada en trabajadores en condiciones de riesgo o que presenten síntomas en miembros superiores y realizar otros estudios en donde participen sujetos sin diagnóstico clínico del STC.

Neural stem cells and cell replacement therapy: making the right cells

The past few years have seen major advances in the field of NSC (neural stem cell) research with increasing emphasis towards its application in cell-replacement therapy for neurological disorders. However, the clinical application of NSCs will remain largely unfeasible until a comprehensive understanding of the cellular and molecular mechanisms of NSC fate specification is achieved. With this understanding will come an increased possibility to exploit the potential of stem cells in order to manufacture transplantable NSCs able to provide a safe and effective therapy for previously untreatable neurological disorders. Since the pathology of each of these disorders is determined by the loss or damage of a specific neural cell population, it may be necessary to generate a range of NSCs able to replace specific neurons or glia rather than generating a generic NSC population. Currently, a diverse range of strategies is being investigated with this goal in mind. In this review, we focus on the relationship between NSC specification and differentiation and discuss how this information may be used to direct NSCs towards a particular fate.

Neural representation of reward in recovered depressed patients

These findings support the view that abnormal neural responses to reward may be an endophenotype for depression and a potential target for intervention and prevention strategies.

Efficient animal-serum free 3D cultivation method for adult human neural crest-derived stem cell therapeutics

Due to their broad differentiation potential and their persistence into adulthood, human neural crest-derived stem cells (NCSCs) harbour great potential for autologous cellular therapies, which include the treatment of neurodegenerative diseases and replacement of complex tissues containing various cell types, as in the case of musculoskeletal injuries. The use of serum-free approaches often results in insufficient proliferation of stem cells and foetal calf serum implicates the use of xenogenic medium components. Thus, there is much need for alternative cultivation strategies. In this study we describe for the first time a novel, human blood plasma based semi-solid medium for cultivation of human NCSCs. We cultivated human neural crest-derived inferior turbinate stem cells (ITSCs) within a blood plasma matrix, where they revealed higher proliferation rates compared to a standard serum-free approach. Three-dimensionality of the matrix was investigated using helium ion microscopy. ITSCs grew within the matrix as revealed by laser scanning microscopy. Genetic stability and maintenance of stemness characteristics were assured in 3D cultivated ITSCs, as demonstrated by unchanged expression profile and the capability for self-renewal. ITSCs pre-cultivated in the 3D matrix differentiated efficiently into ectodermal and mesodermal cell types, particularly including osteogenic cell types. Furthermore, ITSCs cultivated as described here could be easily infected with lentiviruses directly in substrate for potential tracing or gene therapeutic approaches. Taken together, the use of human blood plasma as an additive for a completely defined medium points towards a personalisable and autologous cultivation of human neural crest-derived stem cells under clinical grade conditions.