Hierarchical Reinforcement Learning in Behavior and the Brain

Dissertation presented to obtain the Ph.D degree in Biology, Neuroscience

Abnormal interactions between context, memory structure, and mood in schizophrenia: an ERP investigation

This study used event-related potentials to examine interactions between mood, sentence context, and semantic memory structure in schizophrenia. Seventeen male chronic schizophrenia and 15 healthy control subjects read sentence pairs after positive, negative, or neutral mood induction. Sentences ended with expected words (EW), within-category violations (WCV), or between-category violations (BCV). Across all moods, patients showed sensitivity to context indexed by reduced N400 to EW relative to both WCV and BCV. However, they did not show sensitivity to the semantic memory structure. N400 abnormalities were particularly enhanced under a negative mood in schizophrenia. These findings suggest abnormal interactions between mood, context processing, and connections within semantic memory in schizophrenia, and a specific role of negative mood in modulating semantic processes in this disease.

Emotional modulation of memory encoding and performance monitoring

Performance monitoring, ERN, CRN, Pe, Memory, Llist learning, Emotion, IAPS, N2, Reinforcement Learning Hypothesis, Conflict Monitoring Hypothesis

Cognition and psychopathology in nonagenarians and centenarians living in geriatric nursing homes in Switzerland: a focus on anosognosia.

BACKGROUND: The number of nonagenarians and centenarians is rising dramatically, and many of them live in nursing homes. Very little is known about psychiatric symptoms and cognitive abilities other than memory in this population. This exploratory study focuses on anosognosia and its relationship with common psychiatric and cognitive symptoms. METHODS: Fifty-eight subjects aged 90 years or older were recruited from geriatric nursing homes and divided into five groups according to Mini-Mental State Examination scores. Assessment included the five-word test, executive clock-drawing task, lexical and categorical fluencies, Anosognosia Questionnaire-Dementia, Neuropsychiatric Inventory, and Charlson Comorbidity Index. RESULTS: Subjects had moderate cognitive impairment, with mean ± SD Mini-Mental State Examination being 15.41 ± 7.04. Anosognosia increased with cognitive impairment and was associated with all cognitive domains, as well as with apathy and agitation. Subjects with mild global cognitive decline seemed less anosognosic than subjects with the least or no impairment. Neither anosognosia nor psychopathological features were related to physical conditions. CONCLUSIONS: Anosognosia in oldest-old nursing home residents was mostly mild. It was associated with both cognitive and psychopathological changes, but whether anosognosia is causal to the observed psychopathological features requires further investigation.

Social Cognition and Behavior in Relationship Context

Social information processing (SIP; Crick & Dodge, 1994) and social-cognitive learning theories have been often used to understand children’s problem behaviors, such as aggression. According to these theories, children’s thinking guides their subsequent behaviors. Although most of us agree that social behavior and underlying thought processes are context-dependent, personality and social development researchers have usually engaged in searching for stable patterns of dispositions and behaviors, ignoring (or treating as error) the variance across different situations and relationship types. This, however, can result in erroneous conclusions and question the interpretation of previous findings. Four studies were conducted to explore the influence of relationship context on children’s social-cognitive evaluations and behavior. Samples were fourth to sixth graders from Estonia and Finland. Social cognitions were assessed by presenting children with hypothetical vignettes where the previously identified relationship partner’s behavior had a negative consequence for the child (Studies I, II, and IV), followed by questions measuring different social-cognitive processes (e.g., hostile attributions, behavioral strategies, outcome expectations and self-efficacy beliefs for aggression). In addition, in Studies II and IV, children provided information about their behavior within a specific relationship context. In Study III, an affective priming paradigm was employed where participants were presented with a short display of photographs of children’s liked and disliked classmates, and unknown peers. The results of this thesis suggest that children’s thinking and behavior are largely influenced by the affective valence of the relationship. Moreover, cognitions guide behavior within the relationship. The current findings offer a fruitful avenue for studying the heterogeneity of peer interactions.

Content and Language Integration as a part of a degree reform at Tampere University of Technology

Tampere University of Technology is undergoing a degree reform that started in 2013. One of the major changes in the reform was the integration of compulsory Finnish, Swedish and English language courses to substance courses at the bachelor level. The integration of content and language courses aims at higher quality language learning, more fluency in studies, and increased motivation toward language studies. In addition, integration is an opportunity to optimize the use of resources and to offer courses that are more tailored to the students' field of study and to the skills needed in working life. The reform also aims to increase and develop co-operation between different departments at the university and to develop scientific follow up. This paper gives an overview of the integration process conducted at TUT and gives examples of adjunct CLIL implementations in three different languages.

Pharmacological effects and behavioral interventions on memory consolidation and reconsolidation

In this article, we will review some behavioral, pharmacological and neurochemical studies from our laboratory on mice, which might contribute to our understanding of the complex processes of memory consolidation and reconsolidation. We discuss the post-training (memory consolidation) and post-reactivation (memory reconsolidation) effects of icv infusions of hemicholinium, a central inhibitor of acetylcholine synthesis, of intraperitoneal administration of L-NAME, a non-specific inhibitor of nitric oxide synthase, of intrahippocampal injections of an inhibitor of the transcription factor NF-κB, and the exposure of mice to a new learning situation on retention performance of an inhibitory avoidance response. All treatments impair long-term memory consolidation and retrieval-induced memory processes different from extinction, probably in accordance with the "reconsolidation hypothesis".

Visual word learning in good and poor readers

Forty students from regular, grade five classes were divided into two groups of twenty, a good reader group and a' poor reader group, on the basis. of their reading scores on Canadian Achievement Tests. .The subjects took. part in four experimental conditions iM which they .learned lists of pronounceable and unprono~nceable pseudowords, some with semantic referents, and responded to questions designed tci test visual perceptu~l learning and lexical ·and semantic association learning. It' was hypothesized "that the good reade~ group would be able to make use of graphemic and phonemic redundancy patterns in order to improv~·visuSl perceptual learning and lexical and semantic association lea~ningto a greater extent. than would .the poor reader gr6up. The data supported this hypothesis, and also indicated that, although the poor readers were less adept at using familiar sound and letter patterns, they were more dependent on· such pa~terns as an aid to visual recognition memory and semantic recall than were the good readers. It wa.s postulated that poor readers are in a double- ~ . bind situatio~ of having to choose between using weak graphemic-semantic associations or gr~pheme-phoneme associations which are also weak and which have hindered them in developing automaticity in. reading.

The role of retinoic acid in long-term memory formation and synaptic plasticity in the mollusc Lymnaea stagnalis

The active metabolite of vitamin A, retinoic acid (RA), is involved in memory formation and hippocampal plasticity in vertebrates. A similar role for retinoid signaling in learning and memory formation has not previously been examined in an invertebrate species. However, the conservation of retinoid signaling between vertebrates and invertebrates is supported by the presence of retinoid signaling machinery in invertebrates. For example, in the mollusc Lymnaea stagnalis the metabolic enzymes and retinoid receptors have been cloned from the CNS. In this study I demonstrated that impairing retinoid signaling in Lymnaea by either inhibiting RALDH activity or using retinoid receptor antagonists, prevented the formation of long-term memory (LTM). However, learning and intermediate-term memory were not affected. An additional finding was that exposure to constant darkness (due to the light-sensitive nature of RA) itself enhanced memory formation. This memory-promoting effect of darkness was sufficient to overcome the inhibitory effects of RALDH inhibition, but not that of a retinoid receptor antagonist, suggesting that environmental light conditions may influence retinoid signaling. Since RA also influences synaptic plasticity underlying hippocampal-dependent memory formation, I also examined whether RA would act in a trophic manner to influence synapse formation and/or synaptic transmission between invertebrate neurons. However, I found no evidence to support an effect of RA on post-tetanic potentiation of a chemical synapse. Retinoic acid did, however, reduce transmission at electrical synapses in a cell-specific manner. Overall, these studies provide the first evidence for a role of RA in the formation of implicit long-term memories in an invertebrate species and suggest that the role of retinoid signaling in memory formation has an ancient origin.

Bodies, stories, cities : learning to read and write (in) Montréal with Gail Scott

Cette lecture, tant critique, comparative, et théorique que pédagogique, s’ancre dans le constat, premièrement, qu’il advient aux étudiantEs en littérature de se (re)poser la question des coûts et complicités qu’apprendre à lire et à écrire présuppose aujourd’hui; deuxièmement, que nos pratiques littéraires se trament au sein de lieux empreints de différences, que l’on peut nommer, selon le contexte, métaphore, récit, ville; et, troisièmement, que les efforts et investissements requis sont tout autant couteux et interminable qu’un plaisir et une nécessité politique. Ces conclusions tendent vers l’abstrait et le théorique, mais le langage en lequel elles sont articulées, langage corporel et urbain, de la dépendance et de la violence, cherche d’autant plus une qualité matérielle et concrète. Or, l’introduction propose un survol des lectures et comparaisons de Heroine de Gail Scott qui centre ce projet; identifie les contextes institutionnels, historiques, et personnels qui risquent, ensuite, de décentrer celui-ci. Le premier chapitre permet de cerner le matérialisme littéraire qui me sert de méthode par laquelle la littérature, à la fois, sollicite et offre une réponse à ces interrogations théoriques. Inspirée de l’œuvre de Gail Scott et Réjean Ducharme, premièrement, et de Walter Benjamin, Elisabeth Grosz, et Pierre Macherey ensuite, ‘matérialisme’ fait référence à cette collection de figures de pratiques littéraires et urbaines qui proviennent, par exemple, de Georges Perec, Michel DeCerteau, Barbara Johnson, et Patricia Smart, et qui invitent ensuite une réflexions sur les relations entre corporalité et narrativité, entre la nécessité et la contingence du littéraire. De plus, une collection de figures d’un Montréal littéraire et d’une cité pédagogique, acquis des œuvres de Zygmunt Bauman, Partricia Godbout, et Lewis Mumford, constitue en effet un vocabulaire nous permettant de mieux découvrir (et donc enseigner) ce que lire et apprendre requiert. Le deuxième chapitre propose une lecture comparée de Heroine et des romans des auteures québécoises Anne Dandurand, Marie Gagnon, et Tess Fragoulis, dans le contexte, premièrement, les débats entourant l’institutionnalisation de la littérature (anglo)Québécoise et, deuxièmement, des questions pédagogiques et politiques plus larges et plus urgentes que nous pose, encore aujourd’hui, cette violence récurrente qui s’acharna, par exemple, sur la Polytechnique en 1989. Or, cette intersection de la violence meurtrière, la pratique littéraire, et la pédagogie qui en résulte se pose et s’articule, encore, par le biais d’une collection de figures de styles. En fait, à travers le roman de Scott et de l’œuvre critique qui en fait la lecture, une série de craques invite à reconnaître Heroine comme étant, ce que j’appelle, un récit de dépendance, au sein duquel se concrétise une temporalité récursive et une logique d’introjection nous permettant de mieux comprendre la violence et, par conséquent, le pouvoir d’une pratique littéraire sur laquelle, ensuite, j’appuie ma pédagogie en devenir. Jetant, finalement, un regard rétrospectif sur l’oeuvre dans son entier, la conclusion de ce projet se tourne aussi vers l’avant, c’est-à-dire, vers ce que mes lectures dites matérialistes de la littérature canadienne et québécoise contribuent à mon enseignement de la langue anglaise en Corée du Sud. C’est dans ce contexte que les propos de Jacques Rancière occasionnent un dernier questionnement quant à l’historique des débats et des structures pédagogiques en Corée, d’une part, et, de l’autre, les conclusions que cette lecture de la fiction théorique de Gail Scott nous livre.

Social Networking Sites as Technology Enhanced Learning Communities towards autonomous language learning

The following contribution pretends to cope with the demands of a globalised, post-modern environment through the design and implementation of an online international project where an SNS is used in order to join English as Second Language (ESL) students from different parts of the world. The design of the project appears around the implementation of the Bologna process in the Faculty of Education from the University of Girona where the basic prerequisite of all students to acquire English at the level B1 of the Common European Portfolio makes English a compulsory competence for communication among its higher education candidates in order to develop in the world. Together with the University of Girona, there is the International Educational and Resources Network (iEARN) which promotes the participation of schools around the world in online international projects

Gender stereotyping and decision processes: extending and reversing the gender bias in fame judgements

M. R. Banaji and A. G. Greenwald (1995) demonstrated a gender bias in fame judgments—that is, an increase in judged fame due to prior processing that was larger for male than for female names. They suggested that participants shift criteria between judging men and women, using the more liberal criterion for judging men. This "criterion-shift" account appeared problematic for a number of reasons. In this article, 3 experiments are reported that were designed to evaluate the criterion-shift account of the gender bias in the false-fame effect against a distribution-shift account. The results were consistent with the criterion-shift account, and they helped to define more precisely the situations in which people may be ready to shift their response criterion on an item-by-item basis. In addition, the results were incompatible with an interpretation of the criterion shift as an artifact of the experimental situation in the experiments reported by M. R. Banaji and A. G. Greenwald. (PsycINFO Database Record (c) 2010 APA, all rights reserved)

Fast and frugal framing effects?

Three experiments examine whether simple pair-wise comparison judgments, involving the “recognition heuristic” (Goldstein & Gigerenzer, 2002), are sensitive to implicit cues to the nature of the comparison required. Experiments 1 & 2 show that participants frequently choose the recognized option of a pair if asked to make “larger” judgments but are significantly less likely to choose the unrecognized option when asked to make “smaller” judgments. Experiment 3 demonstrates that, overall, participants consider recognition to be a more reliable guide to judgments of a magnitude criterion than lack of recognition and that this intuition drives the framing effect. These results support the idea that, when making pair-wise comparison judgments, inferring that the recognized item is large is simpler than inferring that the unrecognized item is small.

Modeling distributions of immediate memory effects: No strategies needed?

Many models of immediate memory predict the presence or absence of various effects, but none have been tested to see whether they predict an appropriate distribution of effect sizes. The authors show that the feature model (J. S. Nairne, 1990) produces appropriate distributions of effect sizes for both the phonological confusion effect and the word-length effect. The model produces the appropriate number of reversals, when participants are more accurate with similar items or long items, and also correctly predicts that participants performing less well overall demonstrate smaller and less reliable phonological similarity and word-length effects and are more likely to show reversals. These patterns appear within the model without the need to assume a change in encoding or rehearsal strategy or the deployment of a different storage buffer. The implications of these results and the wider applicability of the distributionmodeling approach are discussed.

Towards a developmental memory-based and embodied cognitive architecture

A novel memory-based embodied cognitive architecture is introduced – the MBC architecture. It is founded upon neuropsychological theory, and may be applied to investigating the interplay of embodiment, autonomy, and environmental interaction as related to the development of cognition.