Hierarchical active inference for cognitive architectures

This thesis explores the methods based on the free energy principle and active inference for modelling cognition. Active inference is an emerging framework for designing intelligent agents where psychological processes are cast in terms of Bayesian inference. Here, I appeal to it to test the design of a set of cognitive architectures, via simulation. These architectures are defined in terms of generative models where an agent executes a task under the assumption that all cognitive processes aspire to the same objective: the minimization of variational free energy. Chapter 1 introduces the free energy principle and its assumptions about self-organizing systems. Chapter 2 describes how from the mechanics of self-organization can emerge a minimal form of cognition able to achieve autopoiesis. In chapter 3 I present the method of how I formalize generative models for action and perception. The architectures proposed allow providing a more biologically plausible account of more complex cognitive processing that entails deep temporal features. I then present three simulation studies that aim to show different aspects of cognition, their associated behavior and the underlying neural dynamics. In chapter 4, the first study proposes an architecture that represents the visuomotor system for the encoding of actions during action observation, understanding and imitation. In chapter 5, the generative model is extended and is lesioned to simulate brain damage and neuropsychological patterns observed in apraxic patients. In chapter 6, the third study proposes an architecture for cognitive control and the modulation of attention for action selection. At last, I argue how active inference can provide a formal account of information processing in the brain and how the adaptive capabilities of the simulated agents are a mere consequence of the architecture of the generative models. Cognitive processing, then, becomes an emergent property of the minimization of variational free energy.

Self-organized criticality and synchronization in a coupled map lattice model of integrate-and-fire oscillators

We introduce two coupled map lattice models with nonconservative interactions and a continuous nonlinear driving. Depending on both the degree of conservation and the convexity of the driving we find different behaviors, ranging from self-organized criticality, in the sense that the distribution of events (avalanches) obeys a power law, to a macroscopic synchronization of the population of oscillators, with avalanches of the size of the system.

Network of recurrent events for the Olami-Feder-Christensen model

We numerically study the dynamics of a discrete spring-block model introduced by Olami, Feder, and Christensen (OFC) to mimic earthquakes and investigate to what extent this simple model is able to reproduce the observed spatiotemporal clustering of seismicity. Following a recently proposed method to characterize such clustering by networks of recurrent events [J. Davidsen, P. Grassberger, and M. Paczuski, Geophys. Res. Lett. 33, L11304 (2006)], we find that for synthetic catalogs generated by the OFC model these networks have many nontrivial statistical properties. This includes characteristic degree distributions, very similar to what has been observed for real seismicity. There are, however, also significant differences between the OFC model and earthquake catalogs, indicating that this simple model is insufficient to account for certain aspects of the spatiotemporal clustering of seismicity.

Self-organized distribution of periodicity and chaos in an electrochemical oscillator

We report a detailed numerical investigation of a prototype electrochemical oscillator, in terms of high-resolution phase diagrams for an experimentally relevant section of the control (parameter) space. The prototype model consists of a set of three autonomous ordinary differential equations which captures the general features of electrochemical oscillators characterized by a partially hidden negative differential resistance in an N-shaped current-voltage stationary curve. By computing Lyapunov exponents, we provide a detailed discrimination between chaotic and periodic phases of the electrochemical oscillator. Such phases reveal the existence of an intricate structure of domains of periodicity self-organized into a chaotic background. Shrimp-like periodic regions previously observed in other discrete and continuous systems were also observed here, which corroborate the universal nature of the occurrence of such structures. In addition, we have also found a structured period distribution within the order region. Finally we discuss the possible experimental realization of comparable phase diagrams.

Generation of self-similar Gaussian time series by means of the DWT and DWPT variance maps

Due to the several kinds of services that use the Internet and data networks infra-structures, the present networks are characterized by the diversity of types of traffic that have statistical properties as complex temporal correlation and non-gaussian distribution. The networks complex temporal correlation may be characterized by the Short Range Dependence (SRD) and the Long Range Dependence - (LRD). Models as the fGN (Fractional Gaussian Noise) may capture the LRD but not the SRD. This work presents two methods for traffic generation that synthesize approximate realizations of the self-similar fGN with SRD random process. The first one employs the IDWT (Inverse Discrete Wavelet Transform) and the second the IDWPT (Inverse Discrete Wavelet Packet Transform). It has been developed the variance map concept that allows to associate the LRD and SRD behaviors directly to the wavelet transform coefficients. The developed methods are extremely flexible and allow the generation of Gaussian time series with complex statistical behaviors.

Studies of solute self-association by sedimentation equilibrium: allowance for effects of thermodynamic non-ideality beyond the consequences of nearest-neighbor interactions

A sedimentation equilibrium study of a-chymotrypsin self-association in acetate-chloride buffer, pH 4.1 I 0.05, has been used to illustrate determination of a dimerization constant under conditions where thermodynamic non-ideality is manifested beyond the consequences of nearest-neighbor interactions. Because the expressions for the experimentally determinable interaction parameters comprise a mixture of equilibrium constant and excluded volume terms, the assignment of reasonable magnitudes to the relevant virial coefficients describing non-associative cluster formation is essential for the evaluation of a reliable estimate of the dimerization constant. Determination of these excluded volume parameters by numerical integration over the potential-of-mean-force is shown to be preferable to their calculation by approximate analytical solutions of the integral for this relatively small enzyme monomer with high net charge (+ 10) under conditions of low ionic strength (0.05 M). (C) 2001 Elsevier Science B.V. All rights reserved.

Effect of surface plasmon resonance in TiO2/Au thin films on the fluorescence of self-assembled CdTe QDs structure

The exceptional properties of localised surface plasmons (LSPs), such as local field enhancement and confinement effects, resonant behavior, make them ideal candidates to control the emission of luminescent nanoparticles. In the present work, we investigated the LSP effect on the steady-state and time-resolved emission properties of quantum dots (QDs) by organizing the dots into self-assembled dendrite structures deposited on plasmonic nanostructures. Self-assembled structures consisting of water-soluble CdTe mono-size QDs, were developed on the surface of co-sputtered TiO2 thin films doped with Au nanoparticles (NPs) annealed at different temperatures. Their steady-state fluorescence properties were probed by scanning the spatially resolved emission spectra and the energy transfer processes were investigated by the fluorescence lifetime imaging (FLIM) microscopy. Our results indicate that a resonant coupling between excitons confined in QDs and LSPs in Au NPs located beneath the self-assembled structure indeed takes place and results in (i) a shift of the ground state luminescence towards higher energies and onset of emission from excited states in QDs, and (ii) a decrease of the ground state exciton lifetime (fluorescence quenching).

An algorithmic approach to estimating the minimal number of periodic points for smooth self-maps of simply-connected manifolds

For a given self-map f of M, a closed smooth connected and simply-connected manifold of dimension m ≥ 4, we provide an algorithm for estimating the values of the topological invariant Dm r [f], which equals the minimal number of r-periodic points in the smooth homotopy class of f. Our results are based on the combinatorial scheme for computing Dm r [f] introduced by G. Graff and J. Jezierski [J. Fixed Point Theory Appl. 13 (2013), 63–84]. An open-source implementation of the algorithm programmed in C++ is publicly available at http://www.pawelpilarczyk.com/combtop/.

Fine structural variations of alphabetaTCRs selected by vaccination with natural versus altered self-antigen in melanoma patients.

Immunotherapy of cancer is often performed with altered "analog" peptide Ags optimized for HLA class I binding, resulting in enhanced immunogenicity, but the induced T cell responses require further evaluation. Recently, we demonstrated fine specificity differences and enhanced recognition of naturally presented Ag by T cells after vaccination with natural Melan-A/MART-1 peptide, as compared with analog peptide. In this study, we compared the TCR primary structures of 1489 HLA-A*0201/Melan-A(26-35)-specific CD8 T cells derived from both cohorts of patients. Although a strong preference for TRAV12-2 segment usage was present in nearly all patients, usage of particular TRAJ gene segments and CDR3alpha composition differed slightly after vaccination with natural vs analog peptide. Moreover, TCR beta-chain repertoires were broader after natural than analog peptide vaccination. In all patients, we observed a marked conservation of the CDR3beta amino acid composition with recurrent sequences centered on a glycyl-leucyl/valyl/alanyl-glycyl motif. In contrast to viral-specific TCR repertoires, such "public" motifs were primarily expressed by nondominant T cell clonotypes, which contrasted with "private" CDR3beta signatures frequently found in T cell clonotypes that dominated repertoires of individual patients. Interestingly, no differences in functional avidity were observed between public and private T cell clonotypes. Collectively, our data indicate that T cell repertoires generated against natural or analog Melan-A peptide exhibited slightly distinct but otherwise overlapping and structurally conserved TCR features, suggesting that the differences in binding affinity/avidity of TCRs toward pMHC observed in the two cohorts of patients are caused by subtle structural TCR variations.

Desarrollo de una colección de Líneas Casi Isogénicas (NIL) para el estudio de caracteres de interés agronómico en especies del género Fragaria

Fragaria vesca posee varias características que la hacen interesante como especie modelo en la familia Rosaceae. Además, su naturaleza diploide permite sortear la complejidad genética de la fresa cultivada. Considerando que los genomas de las especies diploides y octoploides de Fragaria mantienen una relación de sintenia y colinearidad, estamos desarrollando una colección de Líneas Casi Isogénicas (NIL) en Fragaria diploide, usando Fragaria bucharica, una variedad asiática, como donante de introgresiones y Fragaria vesca var. Reine des Vallées, una variedad francesa comúnmente cultivada en España para usos industriales, como parental recurrente. Para obtener introgresiones de F. bucharica en un fondo genético homogéneo de F. vesca, se desarrolló un retrocruzamiento y se obtuvo una población BC1 que fue analizada para la presencia de alelos de F. bucharica a lo largo de los 7 grupos de ligamiento (LG) del mapa de referencia de Fragaria. Los individuos con bajo número de introgresiones de gran tamaño, que en conjunto abarcaron todo el genoma de F. bucharica, fueron seleccionados y retrocruzados con el parental recurrente. La descendencia fue analizada para los loci segregantes y los individuos BC2 con 1 ó 2 introgresiones fueron seleccionados como líneas donadoras de introgresiones de las NIL. Hasta el momento se han descrito tres fenotipos dominantes diferentes bajo condiciones de invernadero en varias NIL heterozigóticas: Las plantas con introgresiones en LG2 presentan estolones. Las plantas con introgresiones en LG1 y LG3 presentan floración temprana. Las plantas con introgresiones en LG6 presentan floración estacional. Actualmente se está trabajando en la selección y caracterización de introgresiones de pequeño tamaño mediante la autofecundación de las líneas seleccionadas. La caracterización fenotípica de los recombinantes seleccionados permitirá localizar y estimar los patrones de herencia de los genes implicados en los caracteres descritos, además de la identificación de nuevos caracteres recesivos que aparecerán en homozigosis.

Recurrent idiopathic neuroretinitis: natural history and effect of treatment.

BACKGROUND: Previous reports have emphasized the self-limited nature of idiopathic neuroretinitis. There is less information about a subgroup of patients who suffer recurrent episodes with worse visual outcome. We sought to better characterize the clinical features of recurrent idiopathic neuroretinitis including the effects of immunosuppressive treatment. METHODS: Retrospective chart review of neuroretinitis patients from a single institution from 1983 to 2008. Inclusion criteria included two or more episodes of acute visual loss with disc oedema and macular exudates in a star pattern. Cases due to a specific infectious or inflammatory aetiology were excluded. RESULTS: Forty-one patients were included with an average follow up of 67 months. Median age at the time of the first episode was 28 years (range 10-54 years). Attacks were bilateral sequential in 34 patients (83%). We documented a total of 147 episodes in 75 eyes with an average of 3.6 attacks per patient. The average interval between attacks was 3 years. Visual field loss had a nerve fibre bundle pattern in most cases. Only 36% of eyes retained 6/12 or better visual acuity and greater than two-thirds of their visual field. Long-term immunosuppressive treatment in 13 patients decreased the attack rate by 72%. CONCLUSIONS: Recurrent idiopathic neuroretinitis typically affects young adults, with no gender preference. Recovery is limited and visual loss is cumulative with repeated attacks, often resulting in severe permanent visual loss. Immunosuppressive treatment appears to lessen the attack frequency.

Capturing and Organizing Prior Student Learning with the OCW Backpack

The purpose of this paper is to present an approach for students to have non-traditional learning assessed for credit and introduce a tool that facilitates this process. The OCW Backpack system can connect self-learners with KNEXT assessment services to obtain college credit for prior learning. An ex post facto study based on historical data collected over the past two years at Kaplan University (KU) is presented to validate the portfolio assessment process. Cumulative GPA was compared for students who received experiential credit for learning derived from personal or professional experience with a matched sample of students with no experiential learning credits. The study found that students who received experiential credits perform better than the matched sample students on GPA. The findings validate the KU portfolio assessment process. Additionally, the results support the capability of the OCW Backpack to capture the critical information necessary to evaluate non-traditional learning for university credit.

Exome sequencing identifies recurrent somatic MAP2K1 and MAP2K2 mutations in melanoma.

We performed exome sequencing to detect somatic mutations in protein-coding regions in seven melanoma cell lines and donor-matched germline cells. All melanoma samples had high numbers of somatic mutations, which showed the hallmark of UV-induced DNA repair. Such a hallmark was absent in tumor sample-specific mutations in two metastases derived from the same individual. Two melanomas with non-canonical BRAF mutations harbored gain-of-function MAP2K1 and MAP2K2 (MEK1 and MEK2, respectively) mutations, resulting in constitutive ERK phosphorylation and higher resistance to MEK inhibitors. Screening a larger cohort of individuals with melanoma revealed the presence of recurring somatic MAP2K1 and MAP2K2 mutations, which occurred at an overall frequency of 8%. Furthermore, missense and nonsense somatic mutations were frequently found in three candidate melanoma genes, FAT4, LRP1B and DSC1.

Self-Expanding Versus Balloon-Expandable Stents in Acute Myocardial Infarction: Results From the APPOSITION II Study: Self-Expanding Stents in ST-Segment Elevation Myocardial Infarction.

OBJECTIVES: This study sought to investigate whether self-expanding stents are more effective than balloon-expandable stents for reducing stent malapposition at 3 days after implantation in patients with ST-segment elevation myocardial infarction undergoing primary percutaneous coronary intervention. BACKGROUND: Acute myocardial infarction is associated with vasoconstriction and large thrombus burden. Resolution of vasoconstriction and thrombus load during the first hours to days after primary percutaneous coronary intervention may lead to stent undersizing and malapposition, which may subsequently lead to stent thrombosis or restenosis. In addition, aggressive stent deployment may cause distal embolization. METHODS: Eighty patients with ST-segment elevation myocardial infarction undergoing primary percutaneous coronary intervention were randomized to receive a self-expanding stent (STENTYS, STENTYS SA, Paris, France) (n = 43) or a balloon-expandable stent (VISION, Abbott Vascular, Santa Clara, California; or Driver, Medtronic, Minneapolis, Minnesota) (n = 37) at 9 European centers. The primary endpoint was the proportion of stent strut malapposition at 3 days after implantation measured by optical coherence tomography. Secondary endpoints included major adverse cardiac events (cardiac death, recurrent myocardial infarction, emergent bypass surgery, or clinically driven target lesion revascularization). RESULTS: At 3 days after implantation, on a per-strut basis, a lower rate of malapposed stent struts was observed by optical coherence tomography in the self-expanding stent group than in the balloon-expandable group (0.58% vs. 5.46%, p < 0.001). On a per-patient basis, none of the patients in the self-expanding stent group versus 28% in the balloon-expandable group presented ≥5% malapposed struts (p < 0.001). At 6 months, major adverse cardiac events were 2.3% versus 0% in the self-expanding and balloon-expandable groups, respectively (p = NS). CONCLUSIONS: Strut malapposition at 3 days is significantly lower in ST-segment elevation myocardial infarction patients allocated to self-expanding stents when than in those allocated to balloon-expandable stents. The impact of this difference on clinical outcome and the risk of late stent thrombosis need to be evaluated further. (Randomized Comparison Between the STENTYS Self-expanding Coronary Stent and a Balloon-expandable Stent in Acute Myocardial Infarction [APPOSITION II]; NCT01008085).