A model for the evolution of reinforcement learning in fluctuating games

Many species are able to learn to associate behaviours with rewards as this gives fitness advantages in changing environments. Social interactions between population members may, however, require more cognitive abilities than simple trial-and-error learning, in particular the capacity to make accurate hypotheses about the material payoff consequences of alternative action combinations. It is unclear in this context whether natural selection necessarily favours individuals to use information about payoffs associated with nontried actions (hypothetical payoffs), as opposed to simple reinforcement of realized payoff. Here, we develop an evolutionary model in which individuals are genetically determined to use either trial-and-error learning or learning based on hypothetical reinforcements, and ask what is the evolutionarily stable learning rule under pairwise symmetric two-action stochastic repeated games played over the individual's lifetime. We analyse through stochastic approximation theory and simulations the learning dynamics on the behavioural timescale, and derive conditions where trial-and-error learning outcompetes hypothetical reinforcement learning on the evolutionary timescale. This occurs in particular under repeated cooperative interactions with the same partner. By contrast, we find that hypothetical reinforcement learners tend to be favoured under random interactions, but stable polymorphisms can also obtain where trial-and-error learners are maintained at a low frequency. We conclude that specific game structures can select for trial-and-error learning even in the absence of costs of cognition, which illustrates that cost-free increased cognition can be counterselected under social interactions.

Resident health-related quality of life in Swiss nursing homes.

BACKGROUND: Health-related quality of life (HRQOL) levels and their determinants in those living in nursing homes are unclear. The aim of this study was to investigate different HRQOL domains as a function of the degree of cognitive impairment and to explore associations between them and possible determinants of HRQOL. METHOD: Five HRQOL domains using the Minimum Data Set - Health Status Index (MDS-HSI) were investigated in a large sample of nursing home residents depending on cognitive performance levels derived from the Cognitive Performance Scale. Large effect size associations between clinical variables and the different HRQOL domains were looked for. RESULTS: HRQOL domains are impaired to variable degrees but with similar profiles depending on the cognitive performance level. Basic activities of daily living are a major factor associated with some but not all HRQOL domains and vary little with the degree of cognitive impairment. LIMITATIONS: This study is limited by the general difficulties related to measuring HRQOL in patients with cognitive impairment and the reduced number of variables considered among those potentially influencing HRQOL. CONCLUSION: HRQOL dimensions are not all linearly associated with increasing cognitive impairment in NH patients. Longitudinal studies are required to determine how the different HRQOL domains evolve over time in NH residents.

Does chronic nicotine consumption influence visual backward masking in schizophrenia and schizotypy ?

Nicotine consumption is higher for people within the schizophrenia spectrum compared to controls. This observation supports the self-medication hypothesis, that nicotine relieves symptoms in, for example, schizophrenia patients. We tested whether performance in an endophenotype of schizophrenia (visual backward masking, VBM) is modulated by nicotine consumption in i) smoking and non-smoking schizophrenia patients, their first-degree relatives, and age-matched controls, ii) non-smoking and smoking university students, and iii) non-smoking, early and late onset nicotine smokers. Overall, our results confirmed that VBM deficits are an endophenotype of schizophrenia, i.e., deficits were highest in patients, followed by their relatives, students scoring high in Cognitive Disorganisation, and controls. Moreover, we found i) beneficial effects of chronic nicotine consumption on VBM performance, in particular with increasing age, and ii) little impact of clinical status. alone or in interactionwith nicotine consumption on VBMperformance. Given the younger age of undergraduate students (up to 30 years) versus controls and patients (up to 66 years),we propose that age-dependent VBMdeficits emergewhen schizotypy effects are targeted in populations of a larger age range, but that nicotine consumption might counteract these deficits (supporting the self-medication hypothesis).

Multicontrast MRI Quantification of Focal Inflammation and Degeneration in Multiple Sclerosis.

INTRODUCTION: Local microstructural pathology in multiple sclerosis patients might influence their clinical performance. This study applied multicontrast MRI to quantify inflammation and neurodegeneration in MS lesions. We explored the impact of MRI-based lesion pathology in cognition and disability. METHODS: 36 relapsing-remitting MS subjects and 18 healthy controls underwent neurological, cognitive, behavioural examinations and 3 T MRI including (i) fluid attenuated inversion recovery, double inversion recovery, and magnetization-prepared gradient echo for lesion count; (ii) T1, T2, and T2(*) relaxometry and magnetisation transfer imaging for lesion tissue characterization. Lesions were classified according to the extent of inflammation/neurodegeneration. A generalized linear model assessed the contribution of lesion groups to clinical performances. RESULTS: Four lesion groups were identified and characterized by (1) absence of significant alterations, (2) prevalent inflammation, (3) concomitant inflammation and microdegeneration, and (4) prevalent tissue loss. Groups 1, 3, 4 correlated with general disability (Adj-R (2) = 0.6; P = 0.0005), executive function (Adj-R (2) = 0.5; P = 0.004), verbal memory (Adj-R (2) = 0.4; P = 0.02), and attention (Adj-R (2) = 0.5; P = 0.002). CONCLUSION: Multicontrast MRI provides a new approach to infer in vivo histopathology of plaques. Our results support evidence that neurodegeneration is the major determinant of patients' disability and cognitive dysfunction.

Naturaliser la procréation médicalement assistée : sens commun et représentations en dialogue

La constante évolution des biotechnologies de la procréation médicalement assistée (PMA) introduit des nouveautés qui perturbent les représentations de la famille et du « naturel » de la procréation notamment. Ces nouveautés engendrent des préoccupations aussi bien sociales qu'individuelles sur la légitimité et les conditions du recours à la PMA. Partant d'une approche dialogique de la communication, du langage et de la cognition ainsi que de la théorie des représentations sociales, nous faisons l'hypothèse que ces perturbations sont traitées différemment selon l'activité communicative dans laquelle les individus sont engagés. Nous avons alors travaillé à partir de deux corpus de données relevant d'un type d'activité communicative différent : un corpus de presse, de l'ordre d'un discours générique, portant sur la grossesse dite « tardive » (post-ménopause) et un corpus d'entretiens de recherche, de l'ordre d'un discours singulier, avec des couples qui ont recouru à la PMA, et portant sur la cryoconservation des zygotes. Nous appuyant sur les méthodes de l'analyse thématique et de l'analyse de discours, nous centrons notre examen sur les représentations sociales de la maternité (corpus de presse) et du « naturel » (corpus d'entretiens). Nous analysons ce que ces discours permettent d'accomplir socialement, étudions le rapport qu'ils établissent à l'ordre social et symbolique et interrogeons leurs fonctions en termes de processus de « naturalisation » de la PMA. Nos résultats montrent que les nouveautés de la PMA forcent les individus à se (re)positionner dans le champ des valeurs et des normes, lis montrent aussi que, dans ce contexte, les représentations sociales existantes sont mobilisées de différentes manières en fonction des visées argumentatives poursuivies. Ceci impliquant, par ailleurs, si ce n'est une transformation, du moins un renouvellement des représentations. Ils indiquent en outre que, bien que le discours de presse et celui des entretiens ne servent pas exactement les mêmes objectifs, leurs effets de « naturalisation » de la PMA sont comparables en termes de (re)construction de la norme. D'un point de vue dialogique, ils permettent aussi d'avancer que les polémiques sociales et individuelles sont non seulement articulées mais se co-constituent. Ils témoignent aussi du fait que la référence au « naturel » renvoie, plus qu'à un problème de perturbation de la « nature », à l'idée d'une menace de l'ordre social et symbolique. De ce point de vue, les réflexions sur les pratiques de PMA méritent d'être menées par la psychologie sociale et les sciences humaines et sociales plus largement. -- The constant evolution of biotechnologies of medically assisted procreation (MAP) introduces novelties that disturb representations of the family and, notably, of what is considered « natural » in procreation. These novelties give rise to social and individual questions about the legitimacy and the conditions of the use of MAP. Drawing upon a dialogical approach to communication, language and cognition, as well as social representations theory, a hypothesis is advanced that these disturbances are handled differently, depending on the communicative activity individuals are engaged in. Two corpuses of data, representing different communicative activity types, were used: a press corpus, reflecting a generic discourse on "late" pregnancy (post-menopause), and a research interviews corpus, reflecting particular discourses developed by couples who used MAP and have cryopreserved zygotes. Using methods of thematic and discourse analysis, the study focuses on social representations of pregnancy (press corpus) and of the "natural" (interviews corpus). The analysis questions what these discourses enable to achieve socially, how they relate to the social and symbolic order, as well as their function in "naturalising" MAP. The results show that MAP novelties force individuals to (re)position themselves in the field of values and norms. They also show that, in this context, existing social representations are mobilised in different ways depending on the argumentative aims that are being pursued. This implies, if not a transformation, at minimum a renewal of representations. Additionally the results indicate that, although press and interviews discourses might not serve the same aims, their effects on "naturalising" MAP are comparable in terms of (re)constructing the norm. From a dialogical perspective, the findings also allow us to argue that social and individual polemics are not only articulated with one another but are effectively co-constituted. They also evidence the fact that the reference to the "natural" brings forth, more than a problem of disturbing "nature", a threat to the social and symbolic order. From this perspective, reflections on MAP practices deserve further attention within social psychology and social and human sciences at large.

The 16p11.2 rearrangments genetic paradigms for obesity and neurodevelopmental disorders.

Recent discoveries of recurrent and reciprocal Copy Number Variants (CNVs) using genome- wide studies have led to a new understanding of the etiology of neuropsychiatric disorders. CNVs represent loss (deletion) or gain (duplication) of genomic material. This thesis work is focused on CNVs at the 16p11.2 BP4-BP5 locus, which are among the most frequent etiologies of neurodevelopmental disorders and have been associated with Autism Spectrum Disorders (ASD), schizophrenia, cognitive impairment, alterations of brain size as well as obesity and underweight. Because deletion and duplication of the 16p11.2 locus occur frequently and recurrently (with the same breakpoints), CNVs at this locus represent a powerful paradigm to understand how a genomic region may modulate cognitive and behavioral traits as well as the relationship and shared mechanisms between distinct psychiatric diagnoses such as ASD and schizophrenia. The present dissertation includes three studies: 1) The first project aims at identifying structural brain-imaging endophenotypes in 16p11.2 CNVs carriers at risk for ASD and schizophrenia. The results show that gene dosage at the 16p11.2 locus modulates global brain volumes and neural circuitry, including the reward system, language and social cognition circuits. 2) The second investigates the neuropsychological profile in 16p11.2 deletion and duplication carriers. While deletion carriers show specific deficits in language and inhibition, the profile of duplication carriers is devoid of specific weaknesses and presents enhanced performance in a verbal memory task. 3) The third study on food-related behaviors in 16p11.2 deletion and duplication carriers shows that alterations of the reponse to satiety are present in CNV carriers before the onset of obesity, pointing toward a potential mechanism driving the Body Mass Index increase in deletion carriers. Dysfunctions in the reward system and dopaminergic circuitries could represent a common mechanism playing a role in the phenotype and could be investigated in future studies. Our data strongly suggest that complex cognitive traits correlate to gene dosage in humans. Larger studies including expression data would allow elucidating the contribution of specific genes to these different gene dosage effects. In conclusion, a systematic and careful investigation of cognitive, behavioral and intermediate phenotypes using a gene dosage paradigm has allowed us to advance our understanding of the 16p11.2 BP4-BP5 locus and its effects on neurodevelopment. -- La récente découverte de variations du nombre de copies (CNVs pour 'copy number variants') dans le génome humain a amélioré nos connaissances sur l'étiologie des troubles neuropsychiatriques. Un CNV représente une perte (délétion) ou un gain (duplication) de matériel génétique sur un segment chromosomique. Ce travail de thèse est focalisé sur les CNVs réciproques (délétion et duplication) dans la région 16p11.2 BP4-BP5. Ces CNVs sont une cause fréquente de troubles neurodéveloppementaux et ont été associés à des phénotypes « en miroir » tels que obésité/sous-poids ou macro/microcéphalie mais aussi aux troubles du spectre autistique (TSA), à la schizophrénie et au retard de développement/déficience intellectuelle. La fréquence et la récurrence de la délétion et de la duplication aux mêmes points de cassure font de ces CNVs un paradigme unique pour étudier la relation entre dosage génique et les traits cognitifs et comportementaux, ainsi que les mécanismes partagés par des troubles psychiatriques apparemment distincts tels que les TSA et la schizophrénie. Ce travail de thèse comporte trois études distinctes : 1) l'étude en neuroimagerie structurelle identifie les endophénotypes chez les porteurs de la délétion ou de la duplication. Les résultats montrent une influence du dosage génique sur le volume cérébral total et certaines structures dans les systèmes de récompense, du langage et de la cognition sociale. 2) L'étude des profils neuropsychologiques chez les porteurs de la délétion ou de la duplication montre que la délétion est associée à des troubles spécifiques du langage et de l'inhibition alors que les porteurs de la duplication ne montrent pas de faiblesse spécifique mais des performances mnésiques verbales supérieures à leur niveau cognitif global. 3) L'étude sur les comportements alimentaires met en évidence une altération de la réponse à la satiété qui est présente avant l'apparition de l'obésité. Un dysfonctionnement dans le système de récompense et les circuits dopaminergiques pourrait représenter un mécanisme commun aux différents phénotypes observés chez ces individus porteurs de CNVs au locus 16p11.2. En conclusion, l'utilisation du dosage génique comme outil d'investigation des phénotypes cliniques et endophénotypes nous a permis de mieux comprendre le rôle de la région 16p11.2 BP4-BP5 dans le neurodéveloppement.

Development of the ability to inhibit a prepotent response: influence of working memory and processing speed.

This study aimed to examine developmental trends in response inhibition during childhood and to control for possible developmental influence of other basic cognitive processes (such as working memory and processing speed). In addition, we explored the relationships between response inhibition, working memory, and processing speed, as they are thought to be integral to cognitive control. Therefore, we assessed these three cognitive abilities in 159 children aged from 5 to 12. Results showed an improvement in response inhibition ability from 5 to 10 years of age. This improvement remained significant after controlling for the influence of working memory and processing speed. Furthermore, the developmental relationships showed an early differentiation between response inhibition, working memory, and processing speed. Thus, these processes were independent and need to be treated as such in further studies.

A New Outlook on Mental Illnesses: Glial Involvement Beyond the Glue.

Mental illnesses have long been perceived as the exclusive consequence of abnormalities in neuronal functioning. Until recently, the role of glial cells in the pathophysiology of mental diseases has largely been overlooked. However recently, multiple lines of evidence suggest more diverse and significant functions of glia with behavior-altering effects. The newly ascribed roles of astrocytes, oligodendrocytes and microglia have led to their examination in brain pathology and mental illnesses. Indeed, abnormalities in glial function, structure and density have been observed in postmortem brain studies of subjects diagnosed with mental illnesses. In this review, we discuss the newly identified functions of glia and highlight the findings of glial abnormalities in psychiatric disorders. We discuss these preclinical and clinical findings implicating the involvement of glial cells in mental illnesses with the perspective that these cells may represent a new target for treatment.

Progressive multifocal leukoencephalopathy in common variable immunodeficiency: mitigated course under mirtazapine and mefloquine.

Demonstration of survival and outcome of progressive multifocal leukoencephalopathy (PML) in a 56-year-old patient with common variable immunodeficiency, consisting of severe hypogammaglobulinemia and CD4+ T lymphocytopenia, during continuous treatment with mirtazapine (30 mg/day) and mefloquine (250 mg/week) over 23 months. Regular clinical examinations including Rankin scale and Barthel index, nine-hole peg and box and block tests, Berg balance, 10-m walking tests, and Montreal Cognitive Assessment (MoCA) were done. Laboratory diagnostics included complete blood count and JC virus (JCV) concentration in cerebrospinal fluid (CSF). The noncoding control region (NCCR) of JCV, important for neurotropism and neurovirulence, was sequenced. Repetitive MRI investigated the course of brain lesions. JCV was detected in increasing concentrations (peak 2568 copies/ml CSF), and its NCCR was genetically rearranged. Under treatment, the rearrangement changed toward the archetype sequence, and later JCV DNA became undetectable. Total brain lesion volume decreased (8.54 to 3.97 cm(3)) and atrophy increased. Barthel (60 to 100 to 80 points) and Rankin (4 to 2 to 3) scores, gait stability, and box and block (7, 35, 25 pieces) and nine-hole peg (300, 50, 300 s) test performances first improved but subsequently worsened. Cognition and walking speed remained stable. Despite initial rapid deterioration, the patient survived under continuous treatment with mirtazapine and mefloquine even though he belongs to a PML subgroup that is usually fatal within a few months. This course was paralleled by JCV clones with presumably lower replication capability before JCV became undetectable. Neurological deficits were due to PML lesions and progressive brain atrophy.

Delirium in the elderly: Current problems with increasing geriatric age.

Delirium is an acute disorder of attention and cognition seen relatively commonly in people aged 65 yr or older. The prevalence is estimated to be between 11 and 42 per cent for elderly patients on medical wards. The prevalence is also high in nursing homes and long term care (LTC) facilities. The consequences of delirium could be significant such as an increase in mortality in the hospital, long-term cognitive decline, loss of autonomy and increased risk to be institutionalized. Despite being a common condition, it remains under-recognised, poorly understood and not adequately managed. Advanced age and dementia are the most important risk factors. Pain, dehydration, infections, stroke and metabolic disturbances, and surgery are the most common triggering factors. Delirium is preventable in a large proportion of cases and therefore, it is also important from a public health perspective for interventions to reduce further complications and the substantial costs associated with these. Since the aetiology is, in most cases, multfactorial, it is important to consider a multi-component approach to management, both pharmacological and non-pharmacological. Detection and treatment of triggering causes must have high priority in case of delirium. The aim of this review is to highlight the importance of delirium in the elderly population, given the increasing numbers of ageing people as well as increasing geriatric age.

A single-blind, randomised controlled trial on the effects of lithium and quetiapine monotherapy on the trajectory of cognitive functioning in first episode mania: A 12-month follow-up study.

BACKGROUND: Cognitive deficits have been reported during the early stages of bipolar disorder; however, the role of medication on such deficits remains unclear. The aim of this study was to compare the effects of lithium and quetiapine monotherapy on cognitive performance in people following first episode mania. METHODS: The design was a single-blind, randomised controlled trial on a cohort of 61 participants following first episode mania. Participants received either lithium or quetiapine monotherapy as maintenance treatment over a 12-month follow-up period. The groups were compared on performance outcomes using an extensive cognitive assessment battery conducted at baseline, month 3 and month 12 follow-up time-points. RESULTS: There was a significant interaction between group and time in phonemic fluency at the 3-month and 12-month endpoints, reflecting greater improvements in performance in lithium-treated participants relative to quetiapine-treated participants. After controlling for multiple comparisons, there were no other significant interactions between group and time for other measures of cognition. CONCLUSION: Although the effects of lithium and quetiapine treatment were similar for most cognitive domains, the findings imply that early initiation of lithium treatment may benefit the trajectory of cognition, specifically verbal fluency in young people with bipolar disorder. Given that cognition is a major symptomatic domain of bipolar disorder and has substantive effects on general functioning, the ability to influence the trajectory of cognitive change is of considerable clinical importance.