A model for the evolution of reinforcement learning in fluctuating games

Many species are able to learn to associate behaviours with rewards as this gives fitness advantages in changing environments. Social interactions between population members may, however, require more cognitive abilities than simple trial-and-error learning, in particular the capacity to make accurate hypotheses about the material payoff consequences of alternative action combinations. It is unclear in this context whether natural selection necessarily favours individuals to use information about payoffs associated with nontried actions (hypothetical payoffs), as opposed to simple reinforcement of realized payoff. Here, we develop an evolutionary model in which individuals are genetically determined to use either trial-and-error learning or learning based on hypothetical reinforcements, and ask what is the evolutionarily stable learning rule under pairwise symmetric two-action stochastic repeated games played over the individual's lifetime. We analyse through stochastic approximation theory and simulations the learning dynamics on the behavioural timescale, and derive conditions where trial-and-error learning outcompetes hypothetical reinforcement learning on the evolutionary timescale. This occurs in particular under repeated cooperative interactions with the same partner. By contrast, we find that hypothetical reinforcement learners tend to be favoured under random interactions, but stable polymorphisms can also obtain where trial-and-error learners are maintained at a low frequency. We conclude that specific game structures can select for trial-and-error learning even in the absence of costs of cognition, which illustrates that cost-free increased cognition can be counterselected under social interactions.

Neuropathic Pain Phenotype Does Not Involve the NLRP3 Inflammasome and Its End Product Interleukin-1β in the Mice Spared Nerve Injury Model.

The NACHT, LRR and PYD domains-containing protein 3 (NLRP3) inflammasome is one of the main sources of interleukin-1β (IL-1β) and is involved in several inflammatory-related pathologies. To date, its relationship with pain has not been studied in depth. The aim of our study was to elucidate the role of NLRP3 inflammasome and IL-1β production on neuropathic pain. Results showed that basal pain sensitivity is unaltered in NLRP3-/- mice as well as responses to formalin test. Spared nerve injury (SNI) surgery induced the development of mechanical allodynia and thermal hyperalgesia in a similar way in both genotypes and did not modify mRNA levels of the NLRP3 inflammasome components in the spinal cord. Intrathecal lipopolysaccharide (LPS) injection increases apoptosis-associated speck like protein (ASC), caspase-1 and IL-1β expression in both wildtype and NLRP3-/- mice. Those data suggest that NLRP3 is not involved in neuropathic pain and also that other sources of IL-1β are implicated in neuroinflammatory responses induced by LPS.

A mouse peritonitis model for the study of glycopeptide efficacy in GISA infections

In recent years, the emergence of Staphylococcus aureus strains with reduced susceptibility to glycopeptides has raised considerable concern. We studied the efficacy of vancomycin and teicoplanin, as well as cloxacillin and cefotaxime, against the infection caused by four S. aureus strains with different glycopeptide and β-lactam susceptibilities (strains A, B, C, and D; MICs for vancomycin of 1, 2, 4, and 8 µg/ml respectively), using a modified model of mouse peritonitis. This optimized model appeared to be straightforward and reproducible, and was able to detect low differences in bacterial killing between antibiotics and also between different S. aureus strains. Bactericidal activities in peritoneal fluid for vancomycin, teicoplanin, cloxacillin, and cefotaxime decreased from -2.98, -2.36, -3.22, and -3.57 log10 cfu/ml, respectively, in infection by strain A (MICs for vancomycin and cloxacillin of 1 and 0.38 µg/ml, respectively) to -1.22, -0.65, -1.04, and +0.24 in peritonitis due to strain D (MICs for vancomycin and cloxacillin of 8 and 1,024 µg/ml). Our data confirm the superiority of β-lactams against methicillin-susceptible S. aureus and show that bactericidal activity of glycopeptides decreases significantly with slight increases in MICs; this finding suggests a reduced efficacy of glycopeptides in the treatment of serious glycopeptide-intermediate S. aureus infections

A mouse peritonitis model for the study of glycopeptide efficacy in GISA infections

In recent years, the emergence of Staphylococcus aureus strains with reduced susceptibility to glycopeptides has raised considerable concern. We studied the efficacy of vancomycin and teicoplanin, as well as cloxacillin and cefotaxime, against the infection caused by four S. aureus strains with different glycopeptide and β-lactam susceptibilities (strains A, B, C, and D; MICs for vancomycin of 1, 2, 4, and 8 µg/ml respectively), using a modified model of mouse peritonitis. This optimized model appeared to be straightforward and reproducible, and was able to detect low differences in bacterial killing between antibiotics and also between different S. aureus strains. Bactericidal activities in peritoneal fluid for vancomycin, teicoplanin, cloxacillin, and cefotaxime decreased from -2.98, -2.36, -3.22, and -3.57 log10 cfu/ml, respectively, in infection by strain A (MICs for vancomycin and cloxacillin of 1 and 0.38 µg/ml, respectively) to -1.22, -0.65, -1.04, and +0.24 in peritonitis due to strain D (MICs for vancomycin and cloxacillin of 8 and 1,024 µg/ml). Our data confirm the superiority of β-lactams against methicillin-susceptible S. aureus and show that bactericidal activity of glycopeptides decreases significantly with slight increases in MICs; this finding suggests a reduced efficacy of glycopeptides in the treatment of serious glycopeptide-intermediate S. aureus infections

Synaptic depression and slow oscillatory activity in a biophysical network model of the cerebral cortex

Short-term synaptic depression (STD) is a form of synaptic plasticity that has a large impact on network computations. Experimental results suggest that STD is modulated by cortical activity, decreasing with activity in the network and increasing during silent states. Here, we explored different activity-modulation protocols in a biophysical network model for which the model displayed less STD when the network was active than when it was silent, in agreement with experimental results. Furthermore, we studied how trains of synaptic potentials had lesser decay during periods of activity (UP states) than during silent periods (DOWN states), providing new experimental predictions. We next tackled the inverse question of what is the impact of modifying STD parameters on the emergent activity of the network, a question difficult to answer experimentally. We found that synaptic depression of cortical connections had a critical role to determine the regime of rhythmic cortical activity. While low STD resulted in an emergent rhythmic activity with short UP states and long DOWN states, increasing STD resulted in longer and more frequent UP states interleaved with short silent periods. A still higher synaptic depression set the network into a non-oscillatory firing regime where DOWN states no longer occurred. The speed of propagation of UP states along the network was not found to be modulated by STD during the oscillatory regime; it remained relatively stable over a range of values of STD. Overall, we found that the mutual interactions between synaptic depression and ongoing network activity are critical to determine the mechanisms that modulate cortical emergent patterns.

Dendritic Spine Abnormalities in Hippocampal CA1 Pyramidal Neurons Underlying Memory Deficits in the SAMP8 Mouse Model of Alzheimer's Disease

SAMP8 is a strain of mice with accelerated senescence. These mice have recently been the focus of attention as they show several alterations that have also been described in Alzheimer"s disease (AD) patients. The number of dendritic spines, spine plasticity, and morphology are basic to memory formation. In AD, the density of dendritic spines is severely decreased. We studied memory alterations using the object recognition test. We measured levels of synaptophysin as a marker of neurotransmission and used Golgi staining to quantify and characterize the number and morphology of dendritic spines in SAMP8 mice and in SAMR1 as control animals. While there were no memory differences at 3 months of age, the memory of both 6- and 9-month-old SAMP8 mice was impaired in comparison with age-matched SAMR1 mice or young SAMP8 mice. In addition, synaptophysin levels were not altered in young SAMP8 animals, but SAMP8 aged 6 and 9 months had less synaptophysin than SAMR1 controls and also less than 3-month-old SAMP8 mice. Moreover, while spine density remained stable with age in SAMR1 mice, the number of spines started to decrease in SAMP8 animals at 6 months, only to get worse at 9 months. Our results show that from 6 months onwards SAMP8 mice show impaired memory. This age coincides with that at which the levels of synaptophysin and spine density decrease. Thus, we conclude that together with other studies that describe several alterations at similar ages, SAMP8 mice are a very suitable model for studying AD.

Adaptation of a Gaussia princeps Luciferase reporter system in Candida albicans for in vivo detection in the Galleria mellonella infection model.

For the past 10 years, mini-host models and in particular the greater wax moth Galleria mellonella have tended to become a surrogate for murine models of fungal infection mainly due to cost, ethical constraints and ease of use. Thus, methods to better assess the fungal pathogenesis in G. mellonella need to be developed. In this study, we implemented the detection of Candida albicans cells expressing the Gaussia princeps luciferase in its cell wall in infected larvae of G. mellonella. We demonstrated that detection and quantification of luminescence in the pulp of infected larvae is a reliable method to perform drug efficacy and C. albicans virulence assays as compared to fungal burden assay. Since the linearity of the bioluminescent signal, as compared to the CFU counts, has a correlation of R(2) = 0.62 and that this method is twice faster and less labor intensive than classical fungal burden assays, it could be applied to large scale studies. We next visualized and followed C. albicans infection in living G. mellonella larvae using a non-toxic and water-soluble coelenterazine formulation and a CCD camera that is commonly used for chemoluminescence signal detection. This work allowed us to follow for the first time C. albicans course of infection in G. mellonella during 4 days.

A cognitive hierarchy model of behavior in the action commitment game

We apply the cognitive hierarchy model of Camerer et al. (Q J Econ 119(3):861-898, 2004)-where players have different levels of reasoning-to Huck et al. (Games Econ Behav 38:240-264, 2002) discrete version of Hamilton and Slutsky (Games Econ Behav 2:29-46, 1990) action commitment game-a duopoly with endogenous timing of entry. We show that, for an empirically reasonable average number of thinking steps, the model rules out Stackelberg equilibria, generates Cournot outcomes including delay, and outcomes where the first mover commits to a quantity higher than Cournot but lower than Stackelberg leader. We show that a cognitive hierarchy model with quantal responses can explain the most important features of the experimental data on the action commitment game in (2002). In order to gauge the success of the model in fitting the data, we compare it to a noisy Nash model. We find that the cognitive hierarchy model with quantal responses fits the data better than the noisy Nash model.

Spinal Cord T-Cell Infiltration in the Rat Spared Nerve Injury Model: A Time Course Study.

The immune system is involved in the development of neuropathic pain. In particular, the infiltration of T-lymphocytes into the spinal cord following peripheral nerve injury has been described as a contributor to sensory hypersensitivity. We used the spared nerve injury (SNI) model of neuropathic pain in Sprague Dawley adult male rats to assess proliferation, and/or protein/gene expression levels for microglia (Iba1), T-lymphocytes (CD2) and cytotoxic T-lymphocytes (CD8). In the dorsal horn ipsilateral to SNI, Iba1 and BrdU stainings revealed microglial reactivity and proliferation, respectively, with different durations. Iba1 expression peaked at D4 and D7 at the mRNA and protein level, respectively, and was long-lasting. Proliferation occurred almost exclusively in Iba1 positive cells and peaked at D2. Gene expression observation by RT-qPCR array suggested that T-lymphocytes attracting chemokines were upregulated after SNI in rat spinal cord but only a few CD2/CD8 positive cells were found. A pronounced infiltration of CD2/CD8 positive T-cells was seen in the spinal cord injury (SCI) model used as a positive control for lymphocyte infiltration. Under these experimental conditions, we show early and long-lasting microglia reactivity in the spinal cord after SNI, but no lymphocyte infiltration was found.

El aprendizaje reflexivo en la formación inicial del profesorado: un modelo para aprender a enseñar matemáticas = Reflective learning in the early formation of teachers: a model to learn to teach maths

In this study we analize the application of the reflective learning during initial formation mathematics teachers. This model is based on the sociocultural theories of the human learning and assumes that the interaction and the contrast make possible the coconstruction and the active reconstruction of knowledge.In order to make the study, it was left from a sample of 29 teaching students. The qualitative analysis allowed to identify factors that facilitate the incorporation of the reflective learning in university teaching, as well as the degree of effectiveness of this model to learn to teach mathematics

On Topological Solitons in The Faddeev-Skyrme Model and its Extensions

The topological solitons of two classical field theories, the Faddeev-Skyrme model and the Ginzburg-Landau model are studied numerically and analytically in this work. The aim is to gain information on the existence and properties of these topological solitons, their structure and behaviour under relaxation. First, the conditions and mechanisms leading to the possibility of topological solitons are explored from the field theoretical point of view. This leads one to consider continuous deformations of the solutions of the equations of motion. The results of algebraic topology necessary for the systematic treatment of such deformations are reviewed and methods of determining the homotopy classes of topological solitons are presented. The Faddeev-Skyrme and Ginzburg-Landau models are presented, some earlier results reviewed and the numerical methods used in this work are described. The topological solitons of the Faddeev-Skyrme model, Hopfions, are found to follow the same mechanisms of relaxation in three different domains with three different topological classifications. For two of the domains, the necessary but unusual topological classification is presented. Finite size topological solitons are not found in the Ginzburg-Landau model and a scaling argument is used to suggest that there are indeed none unless a certain modification to the model, due to R. S. Ward, is made. In that case, the Hopfions of the Faddeev-Skyrme model are seen to be present for some parameter values. A boundary in the parameter space separating the region where the Hopfions exist and the area where they do not exist is found and the behaviour of the Hopfion energy on this boundary is studied.

An Interface Damage Model for the Simulation of Delamination Under Variable-Mode Ratio in Composite Materials

A thermodynamically consistent damage model for the simulation of progressive delamination under variable mode ratio is presented. The model is formulated in the context of the Damage Mechanics. The constitutive equation that results from the definition of the free energy as a function of a damage variable is used to model the initiation and propagation of delamination. A new delamination initiation criterion is developed to assure that the formulation can account for changes in the loading mode in a thermodynamically consistent way. The formulation proposed accounts for crack closure effets avoiding interfacial penetration of two adjacent layers aftercomplete decohesion. The model is implemented in a finite element formulation. The numerical predictions given by the model are compared with experimental results

Probing the (empirical) quantum structure embedded in the periodic table with an effective Bohr model

The atomic shell structure can be observed by inspecting the experimental periodic properties of the Periodic Table. The (quantum) shell structure emerges from these properties and in this way quantum mechanics can be explicitly shown considering the (semi-)quantitative periodic properties. These periodic properties can be obtained with a simple effective Bohr model. An effective Bohr model with an effective quantum defect (u) was considered as a probe in order to show the quantum structure embedded in the Periodic Table. u(Z) shows a quasi-smoothed dependence of Z, i.e., u(Z) ≈ Z2/5 - 1.