A model for the evolution of reinforcement learning in fluctuating games

Many species are able to learn to associate behaviours with rewards as this gives fitness advantages in changing environments. Social interactions between population members may, however, require more cognitive abilities than simple trial-and-error learning, in particular the capacity to make accurate hypotheses about the material payoff consequences of alternative action combinations. It is unclear in this context whether natural selection necessarily favours individuals to use information about payoffs associated with nontried actions (hypothetical payoffs), as opposed to simple reinforcement of realized payoff. Here, we develop an evolutionary model in which individuals are genetically determined to use either trial-and-error learning or learning based on hypothetical reinforcements, and ask what is the evolutionarily stable learning rule under pairwise symmetric two-action stochastic repeated games played over the individual's lifetime. We analyse through stochastic approximation theory and simulations the learning dynamics on the behavioural timescale, and derive conditions where trial-and-error learning outcompetes hypothetical reinforcement learning on the evolutionary timescale. This occurs in particular under repeated cooperative interactions with the same partner. By contrast, we find that hypothetical reinforcement learners tend to be favoured under random interactions, but stable polymorphisms can also obtain where trial-and-error learners are maintained at a low frequency. We conclude that specific game structures can select for trial-and-error learning even in the absence of costs of cognition, which illustrates that cost-free increased cognition can be counterselected under social interactions.

DWI and complex brain network analysis predicts vascular cognitive impairment in spontaneous hypertensive rats undergoing executive function tests

The identification of biomarkers of vascular cognitive impairment is urgent for its early diagnosis. The aim of this study was to detect and monitor changes in brain structure and connectivity, and to correlate them with the decline in executive function. We examined the feasibility of early diagnostic magnetic resonance imaging (MRI) to predict cognitive impairment before onset in an animal model of chronic hypertension: Spontaneously Hypertensive Rats. Cognitive performance was tested in an operant conditioning paradigm that evaluated learning, memory, and behavioral flexibility skills. Behavioral tests were coupled with longitudinal diffusion weighted imaging acquired with 126 diffusion gradient directions and 0.3 mm(3) isometric resolution at 10, 14, 18, 22, 26, and 40 weeks after birth. Diffusion weighted imaging was analyzed in two different ways, by regional characterization of diffusion tensor imaging (DTI) indices, and by assessing changes in structural brain network organization based on Q-Ball tractography. Already at the first evaluated times, DTI scalar maps revealed significant differences in many regions, suggesting loss of integrity in white and gray matter of spontaneously hypertensive rats when compared to normotensive control rats. In addition, graph theory analysis of the structural brain network demonstrated a significant decrease of hierarchical modularity, global and local efficacy, with predictive value as shown by regional three-fold cross validation study. Moreover, these decreases were significantly correlated with the behavioral performance deficits observed at subsequent time points, suggesting that the diffusion weighted imaging and connectivity studies can unravel neuroimaging alterations even overt signs of cognitive impairment become apparent.

Verbal learning in mild cognitive impairment and alzheimer's disease : behavioural and neural approaches

The main focus of the present thesis was at verbal episodic memory processes that are particularly vulnerable to preclinical and clinical Alzheimer’s disease (AD). Here these processes were studied by a word learning paradigm, cutting across the domains of memory and language learning studies. Moreover, the differentiation between normal aging, mild cognitive impairment (MCI) and AD was studied by the cognitive screening test CERAD. In study I, the aim was to examine how patients with amnestic MCI differ from healthy controls in the different CERAD subtests. Also, the sensitivity and specificity of the CERAD screening test to MCI and AD was examined, as previous studies on the sensitivity and specificity of the CERAD have not included MCI patients. The results indicated that MCI is characterized by an encoding deficit, as shown by the overall worse performance on the CERAD Wordlist learning test compared with controls. As a screening test, CERAD was not very sensitive to MCI. In study II, verbal learning and forgetting in amnestic MCI, AD and healthy elderly controls was investigated with an experimental word learning paradigm, where names of 40 unfamiliar objects (mainly archaic tools) were trained with or without semantic support. The object names were trained during a 4-day long period and a follow-up was conducted one week, 4 weeks and 8 weeks after the training period. Manipulation of semantic support was included in the paradigm because it was hypothesized that semantic support might have some beneficial effects in the present learning task especially for the MCI group, as semantic memory is quite well preserved in MCI in contrast to episodic memory. We found that word learning was significantly impaired in MCI and AD patients, whereas forgetting patterns were similar across groups. Semantic support showed a beneficial effect on object name retrieval in the MCI group 8 weeks after training, indicating that the MCI patients’ preserved semantic memory abilities compensated for their impaired episodic memory. The MCI group performed equally well as the controls in the tasks tapping incidental learning and recognition memory, whereas the AD group showed impairment. Both the MCI and the AD group benefited less from phonological cueing than the controls. Our findings indicate that acquisition is compromised in both MCI and AD, whereas long13 term retention is not affected to the same extent. Incidental learning and recognition memory seem to be well preserved in MCI. In studies III and IV, the neural correlates of naming newly learned objects were examined in healthy elderly subjects and in amnestic MCI patients by means of positron emission tomography (PET) right after the training period. The naming of newly learned objects by healthy elderly subjects recruited a left-lateralized network, including frontotemporal regions and the cerebellum, which was more extensive than the one related to the naming of familiar objects (study III). Semantic support showed no effects on the PET results for the healthy subjects. The observed activation increases may reflect lexicalsemantic and lexical-phonological retrieval, as well as more general associative memory mechanisms. In study IV, compared to the controls, the MCI patients showed increased anterior cingulate activation when naming newly learned objects that had been learned without semantic support. This suggests a recruitment of additional executive and attentional resources in the MCI group.

Preadjunct questions as a learning strategy for older adults

This study investigated the effectiveness of comprehension level preadjunct questions as a learning strategy for older adults in a classroom setting. Fifty-five adults from 55 to 70 years of age were randomly assigned to two groups, the preadjunct question group and a no-question control group. They viewed a video on high blood pressure and completed a recall posttest immediately after viewing the video and again seven days tater. Results demonstrated that there was no significant difference between groups. However, the no-question control group obtained a higher mean score on both the immediate and delayed recall tests than did the preadjunct question group. Nevertheless, significant differences in posttest scores were found related to educational levels and prior knowledge about high blood pressure. Results obtained were explained in terms of resource theory of cognitive aging.

Verbal ability, previous practice and load on short-term memory as determiners of differences in a complex learning task: an experimental study

Traditional psychometric theory and practice classify people according to broad ability dimensions but do not examine how these mental processes occur. Hunt and Lansman (1975) proposed a 'distributed memory' model of cognitive processes with emphasis on how to describe individual differences based on the assumption that each individual possesses the same components. It is in the quality of these components ~hat individual differences arise. Carroll (1974) expands Hunt's model to include a production system (after Newell and Simon, 1973) and a response system. He developed a framework of factor analytic (FA) factors for : the purpose of describing how individual differences may arise from them. This scheme is to be used in the analysis of psychometric tes ts . Recent advances in the field of information processing are examined and include. 1) Hunt's development of differences between subjects designated as high or low verbal , 2) Miller's pursuit of the magic number seven, plus or minus two, 3) Ferguson's examination of transfer and abilities and, 4) Brown's discoveries concerning strategy teaching and retardates . In order to examine possible sources of individual differences arising from cognitive tasks, traditional psychometric tests were searched for a suitable perceptual task which could be varied slightly and administered to gauge learning effects produced by controlling independent variables. It also had to be suitable for analysis using Carroll's f ramework . The Coding Task (a symbol substitution test) found i n the Performance Scale of the WISe was chosen. Two experiments were devised to test the following hypotheses. 1) High verbals should be able to complete significantly more items on the Symbol Substitution Task than low verbals (Hunt, Lansman, 1975). 2) Having previous practice on a task, where strategies involved in the task may be identified, increases the amount of output on a similar task (Carroll, 1974). J) There should be a sUbstantial decrease in the amount of output as the load on STM is increased (Miller, 1956) . 4) Repeated measures should produce an increase in output over trials and where individual differences in previously acquired abilities are involved, these should differentiate individuals over trials (Ferguson, 1956). S) Teaching slow learners a rehearsal strategy would improve their learning such that their learning would resemble that of normals on the ,:same task. (Brown, 1974). In the first experiment 60 subjects were d.ivided·into high and low verbal, further divided randomly into a practice group and nonpractice group. Five subjects in each group were assigned randomly to work on a five, seven and nine digit code throughout the experiment. The practice group was given three trials of two minutes each on the practice code (designed to eliminate transfer effects due to symbol similarity) and then three trials of two minutes each on the actual SST task . The nonpractice group was given three trials of two minutes each on the same actual SST task . Results were analyzed using a four-way analysis of variance . In the second experiment 18 slow learners were divided randomly into two groups. one group receiving a planned strategy practioe, the other receiving random practice. Both groups worked on the actual code to be used later in the actual task. Within each group subjects were randomly assigned to work on a five, seven or nine digit code throughout. Both practice and actual tests consisted on three trials of two minutes each. Results were analyzed using a three-way analysis of variance . It was found in t he first experiment that 1) high or low verbal ability by itself did not produce significantly different results. However, when in interaction with the other independent variables, a difference in performance was noted . 2) The previous practice variable was significant over all segments of the experiment. Those who received previo.us practice were able to score significantly higher than those without it. J) Increasing the size of the load on STM severely restricts performance. 4) The effect of repeated trials proved to be beneficial. Generally, gains were made on each successive trial within each group. S) In the second experiment, slow learners who were allowed to practice randomly performed better on the actual task than subjeots who were taught the code by means of a planned strategy. Upon analysis using the Carroll scheme, individual differences were noted in the ability to develop strategies of storing, searching and retrieving items from STM, and in adopting necessary rehearsals for retention in STM. While these strategies may benef it some it was found that for others they may be harmful . Temporal aspects and perceptual speed were also found to be sources of variance within individuals . Generally it was found that the largest single factor i nfluencing learning on this task was the repeated measures . What e~ables gains to be made, varies with individuals . There are environmental factors, specific abilities, strategy development, previous learning, amount of load on STM , perceptual and temporal parameters which influence learning and these have serious implications for educational programs .

The effects of simple procedural, cognitive procedural and declarative learning on sleep /

Sleep spindles have been found to increase following an intense period of learning on a combination of motor tasks. It is not clear whether these changes are task specific, or a result of learning in general. The current study investigated changes in sleep spindles and spectral power following learning on cognitive procedural (C-PM), simple procedural (S-PM) or declarative (DM) learning tasks. It was hypothesized that S-PM learning would result in increases in Sigma power during Non-REM sleep, whereas C-PM and DM learning would not affect Sigma power. It was also hypothesized that DM learning would increase Theta power during REM sleep, whereas S-PM and C-PM learning would not affect Theta power. Thirty-six participants spent three consecutive nights in the sleep laboratory. Baseline polysomnographic recordings were collected on night 2. Participants were randomly assigned to one of four conditions: C-PM, S-PM, DM or control (C). Memory task training occurred on night 3 followed by polysomnographic recording. Re-testing on respective memory tasks occurred one-week following training. EEG was sampled at 256Hz from 16 sites during sleep. Artifact-free EEG from each sleep stage was submitted to power spectral analysis. The C-PM group made significantly fewer errors, the DM group recalled more, and the S-PM improved on performance from test to re-test. There was a significant night by group interaction for the duration of Stage 2 sleep. Independent t-tests revealed that the S-PM group had significantly more Stage 2 sleep on the test night than the C group. The C-PM and the DM group did not differ from controls in the duration of Stage 2 sleep on test night. There was no significant change in the duration of slow wave sleep (SWS) or REM sleep. Sleep spindle density (spindles/minute) increased significantly from baseline to test night following S-PM learning, but not for C-PM, DM or C groups. This is the first study to have shown that the same pattern of results was found for spindles in SWS. Low Sigma power (12-14Hz) increased significantly during SWS following S-PM learning but not for C-PM, DM or C groups. This effect was maximal at Cz, and the largest increase in Sigma power was at Oz. It was also found that Theta power increased significantly during REM sleep following DM learning, but not for S-PM, C-PM or C groups. This effect was maximal at Cz and the largest change in Theta power was observed at Cz. These findings are consistent with the previous research that simple procedural learning is consolidated during Stage 2 sleep, and provide additional data to suggest that sleep spindles across all non-REM stages and not just Stage 2 sleep may be a mechanism for brain plasticity. This study also provides the first evidence to suggest that Theta activity during REM sleep is involved in memory consolidation.

Service Learning in Higher Education: A Road Map

As institutions of higher education struggle to stay relevant, competitive, accessible, and flexible, they are scrambling to attend to a shift in focus for new students. This shift involves experiential learning. The purpose of this major research paper was to examine the existing structures, to seek gaps in the experiential learning programs, and to devise a framework to move forward. The specific focus was on experiential learning at Brock University in the Faculty of Applied Health Sciences. The methodology was underscored with cognitive constructivism and appreciative theory. Data collection involved content analysis steps established by Krippendorff (2004) and Weber (1985). Data analysis involved the four dimensions of reflection designed by LaBoskey, including the purpose, context, content, and procedures. The results developed understandings on the state of formal processes and pathways within service learning. A tool kit was generated that defines service learning and offers an overview of the types of service learning typically employed. The tool kit acts as a reference guide for those interested in implementing experiential learning courses. Importantly, the results also provided 10 key points in experiential learning courses by Emily Allan. A flow chart illustrates the connections among each of the 10 points, and then they are described in full to establish a strategy for the way forward in experiential learning.

Adult Learning in the Transformational Environments of the Digital Revolution: Connecting Theory and Practice

The purpose of this study was to investigate the learning preferences and the post-secondary educational experiences of a group of Net-Gen adult learners, aged between 18 and 35, currently working in the knowledge economy workplace, and their assessment of how adequately they were prepared to meet the requirements of the knowledge economy workplace. This study utilized an explanatory mixed-method research design. Participants completed a questionnaire providing information on their self-reported learning style preferences, their use of digital tools for formal and informal learning, their use of digital technologies in postsecondary educational experiences, and their use of digital technologies in their workplace. Four volunteers from the questionnaire respondents were selected to participate in interviews based on the diversity of their experiences in higher education, including digital environments, and the diversity of their knowledge economy workplaces. Data collected from the questionnaire were analyzed for descriptive and demographic statistics, and categorized so that common patterns could be identified from information gathered from the online questionnaire and interviews. Findings based on this study indicated that these Net-Gen adult learners were fluent with all types of digital technologies in collaborative environments, expecting their educational experiences to provide a similar experience. Participants clearly expressed an understanding that digital/collaborative aptitudes are essential to successful employment in the knowledge economy workplace. The findings of this study indicated that the majority of participants felt that their post-secondary educational experiences did not adequately prepare them to meet the expectations of this type of working environment.

Actitudes de los directivos en torno a la adopción del e-learning como herramienta de trabajo en las empresas

El desarrollo del presente documento constituye una investigación sobre las actitudes de los directivos frente a la adopción del e-learning como herramienta de trabajo en las organizaciones de Bogotá. Para ello se realizó una encuesta a 101 directivos, tomando como base el tipo de muestreo de conveniencia; esto con el objetivo de identificar sus actitudes frente al uso del e-learning y su influencia dentro de la organización. Como resultado se obtuvo que las actitudes de los directivos influencian en el uso de herramientas e-learning, así como también en las acciones que promueven su uso y en las actitudes de los empleados; por otro lado se identificó que las creencias relacionadas con la apropiación de herramientas e-learning y los factores facilitadores del uso de estas, influencian en las actitudes de los directivos. Lo anterior, corresponde a los análisis llevados a cabo a partir de los resultados contrastados con los estudios empíricos hallados y el marco teórico desarrollado.

Learning mathematics : issues, theory and classroom practice.

Recurso para profesores de matemáticas de primaria y secundaria. El texto considera las cuestiones relativas a cómo los estudiantes aprenden matemáticas. Cada uno de los once capítulos trata un tema particular que ilustra la interacción entre la teoría y la práctica. Esta edición cuenta con dos nuevos capítulos: uno relacionado con la cognición y la transferencia del aprendizaje, y otro que examina la importancia del modelo de aprendizaje en las matemáticas.

Play=learning : how play motivates and enhances children's cognitive and social-emotional growth.

En este recurso para estudiantes e investigadores en psicología del desarrollo, expertos en desarrollo infantil y aprendizaje piden reconsiderar las formas de juego que facilita el desarrollo en todos los campos ya que el juego proporciona a los niños la oportunidad de maximizar sus capacidades de atención, aprender a llevarse bien con sus compañeros, cultivar su creatividad, trabajar a través de sus emociones y obtener las habilidades académicas que son la base para el aprendizaje futuro.

Using problem-based learning for introducing producer theory and market structure in intermediate microeconomics

This paper shows how instructors can use the problem‐based learning method to introduce producer theory and market structure in intermediate microeconomics courses. The paper proposes a framework where different decision problems are presented to students, who are asked to imagine that they are the managers of a firm who need to solve a problem in a particular business setting. In this setting, the instructors’ role is to provide both guidance to facilitate student learning and content knowledge on a just‐in‐time basis

Food for thought: the role of dietary flavonoids in enhancing human memory, learning and neuro-cognitive performance

Emerging evidence suggests that dietary-derived flavonoids have the potential to improve human memory and neuro-cognitive performance via their ability to protect vulnerable neurons, enhance existing neuronal function and stimulate neuronal regeneration. Long-term potentiation (LTP) is widely considered to be one of the major mechanisms underlying memory acquisition, consolidation and storage in the brain and is known to be controlled at the molecular level by the activation of a number of neuronal signalling pathways. These pathways include the phosphatidylinositol-3 kinase/protein kinase B/Akt (Akt), protein kinase C, protein kinase A, Ca-calmodulin kinase and mitogen-activated protein kinase pathways. Growing evidence suggests that flavonoids exert effects on LTP, and consequently memory and cognitive performance, through their interactions with these signalling pathways. Of particular interest is the ability of flavonoids to activate the extracellular signal-regulated kinase and the Akt signalling pathways leading to the activation of the cAMP-response element-binding protein, a transcription factor responsible for increasing the expression of a number of neurotrophins important in LTP and long-term memory. One such neurotrophin is brain-derived neurotrophic factor, which is known to be crucial in controlling synapse growth, in promoting an increase in dendritic spine density and in enhancing synaptic receptor density. The present review explores the potential of flavonoids and their metabolite forms to promote memory and learning through their interactions with neuronal signalling pathways pivotal in controlling LTP and memory in human subjects.

Inverse problems in dynamic cognitive modeling

Inverse problems for dynamical system models of cognitive processes comprise the determination of synaptic weight matrices or kernel functions for neural networks or neural/dynamic field models, respectively. We introduce dynamic cognitive modeling as a three tier top-down approach where cognitive processes are first described as algorithms that operate on complex symbolic data structures. Second, symbolic expressions and operations are represented by states and transformations in abstract vector spaces. Third, prescribed trajectories through representation space are implemented in neurodynamical systems. We discuss the Amari equation for a neural/dynamic field theory as a special case and show that the kernel construction problem is particularly ill-posed. We suggest a Tikhonov-Hebbian learning method as regularization technique and demonstrate its validity and robustness for basic examples of cognitive computations.