Efficient learning of reactive robot behaviors with a Neural-Q_learning approach

The purpose of this paper is to propose a Neural-Q_learning approach designed for online learning of simple and reactive robot behaviors. In this approach, the Q_function is generalized by a multi-layer neural network allowing the use of continuous states and actions. The algorithm uses a database of the most recent learning samples to accelerate and guarantee the convergence. Each Neural-Q_learning function represents an independent, reactive and adaptive behavior which maps sensorial states to robot control actions. A group of these behaviors constitutes a reactive control scheme designed to fulfill simple missions. The paper centers on the description of the Neural-Q_learning based behaviors showing their performance with an underwater robot in a target following task. Real experiments demonstrate the convergence and stability of the learning system, pointing out its suitability for online robot learning. Advantages and limitations are discussed

Semi-online neural-Q_leaming for real-time robot learning

Reinforcement learning (RL) is a very suitable technique for robot learning, as it can learn in unknown environments and in real-time computation. The main difficulties in adapting classic RL algorithms to robotic systems are the generalization problem and the correct observation of the Markovian state. This paper attempts to solve the generalization problem by proposing the semi-online neural-Q_learning algorithm (SONQL). The algorithm uses the classic Q_learning technique with two modifications. First, a neural network (NN) approximates the Q_function allowing the use of continuous states and actions. Second, a database of the most representative learning samples accelerates and stabilizes the convergence. The term semi-online is referred to the fact that the algorithm uses the current but also past learning samples. However, the algorithm is able to learn in real-time while the robot is interacting with the environment. The paper shows simulated results with the "mountain-car" benchmark and, also, real results with an underwater robot in a target following behavior

Estimulacion magnetica trascraneal en el desempeno motor en enfermedades del sistema nervioso central: Revision Sistematica

Introducción: El uso de la estimulación cerebral no invasiva en procesos de rehabilitación es de gran interés, por cuanto con mediación tecnológica se generan nuevas posibilidades de recuperación motora, a partir de la activación de la corteza cerebral. El objetivo del estudio es establecer la evidencia del uso terapéutico de la EMT, relacionado con el desempeño motor de pacientes con enfermedades del sistema nervioso central. Metodología: Se realizó una revisión sistemática de la literatura. Se incluyeron 10 estudios en el análisis cualitativo que incluyó la evaluación de calidad con la escala de Jadad y del riesgo de sesgo con la herramienta Cochrane. Fueron excluidos 1613 estudios. Se aplicó el protocolo del estudio para la extracción, revisión y validez de los estudios incluidos. Resultados: La evidencia disponible muestra resultados positivos del uso terapéutico de la EMT en el desempeño motor en aspectos como la aceleración, la fuerza de pinza y de agarre, la estabilidad y la fuerza muscular, así como una mejor velocidad de la marcha y una disminución en la frecuencia y severidad de los espasmos. Discusión: La EMT puede constituir una estrategia terapéutica para mejorar el desempeño motor en pacientes con ECV, Lesión Medular y enfermedad de Parkinson, que requiere más investigación por la heterogeneidad de los diseños y medidas de descenlace utilizados, así como por la alta variabilidad interindividual que hace complejo estandarizar los protocolos de su uso terapéutico.

Molecular basis of circadian behaviour Lecture

For BIOL2040. Originally in Blackboard and uploaded to Edshare for linking in Efolio site.

Data-Driven Text Generation using Neural Networks & Provenance is Complicated and Boring — Is there a solution?

Title: Data-Driven Text Generation using Neural Networks Speaker: Pavlos Vougiouklis, University of Southampton Abstract: Recent work on neural networks shows their great potential at tackling a wide variety of Natural Language Processing (NLP) tasks. This talk will focus on the Natural Language Generation (NLG) problem and, more specifically, on the extend to which neural network language models could be employed for context-sensitive and data-driven text generation. In addition, a neural network architecture for response generation in social media along with the training methods that enable it to capture contextual information and effectively participate in public conversations will be discussed. Speaker Bio: Pavlos Vougiouklis obtained his 5-year Diploma in Electrical and Computer Engineering from the Aristotle University of Thessaloniki in 2013. He was awarded an MSc degree in Software Engineering from the University of Southampton in 2014. In 2015, he joined the Web and Internet Science (WAIS) research group of the University of Southampton and he is currently working towards the acquisition of his PhD degree in the field of Neural Network Approaches for Natural Language Processing. Title: Provenance is Complicated and Boring — Is there a solution? Speaker: Darren Richardson, University of Southampton Abstract: Paper trails, auditing, and accountability — arguably not the sexiest terms in computer science. But then you discover that you've possibly been eating horse-meat, and the importance of provenance becomes almost palpable. Having accepted that we should be creating provenance-enabled systems, the challenge of then communicating that provenance to casual users is not trivial: users should not have to have a detailed working knowledge of your system, and they certainly shouldn't be expected to understand the data model. So how, then, do you give users an insight into the provenance, without having to build a bespoke system for each and every different provenance installation? Speaker Bio: Darren is a final year Computer Science PhD student. He completed his undergraduate degree in Electronic Engineering at Southampton in 2012.

Is there a common genetic basis for autoimmune diseases?

Autoimmune diseases (ADs) represent a diverse collection of diseases in terms of their demographic profile and primary clinical manifestations. The commonality between them however, is the damage to tissues and organs that arises from the response to self-antigens. The presence of shared pathophysiological mechanisms within ADs has stimulated searches for common genetic roots to these diseases. Two approaches have been undertaken to sustain the “common genetic origin” theory of ADs. Firstly, a clinical genetic analysis showed that autoimmunity aggregates within families of probands diagnosed with primary Sjögren's (pSS) syndrome or type 1 diabetes mellitus (T1D). A literature review supported the establishment of a familiar cluster of ADs depending upon the proband's disease phenotype. Secondly, in a same and well-defined population, a large genetic association study indicated that a number of polymorphic genes (i.e. HLA-DRB1, TNF and PTPN22) influence the susceptibility for acquiring different ADs. Likewise, association and linkage studies in different populations have revealed that several susceptibility loci overlap in ADs, and clinical studies have shown that frequent clustering of several ADs occurs. Thus, the genetic factors for ADs consist of two types: those which are common to many ADs (acting in epistatic pleitropy) and those that are specific to a given disorder. Their identification and functional characterization will allow us to predict their effect as well as to indicate potential new therapeutic interventions. Both autoimmunity family history and the co-occurrence of ADs in affected probands should be considered when performing genetic association and linkage studies.

Genetic basis of Sjögren's syndrome. How strong is the evidence?

Sjögren's syndrome (SS) is a late-onset chronic autoimmune disease (AID) affecting the exocrine glands, mainly the salivary and lachrymal. Genetic studies on twins with primary SS have not been performed, and only a few case reports describing twins have been published. The prevalence of primary SS in siblings has been estimated to be 0.09% while the reported general prevalence of the disease is approximately 0.1%. The observed aggregation of AIDs in families of patients with primary SS is nevertheless supportive for a genetic component in its etiology. In the absence of chromosomal regions identified by linkage studies, research has focused on candidate gene approaches (by biological plausibility) rather than on positional approaches. Ancestral haplotype 8.1 as well as TNF, IL10 and SSA1 loci have been consistently associated with the disease although they are not specific for SS. In this review, the genetic component of SS is discussed on the basis of three known observations: (a) age at onset and sex-dependent presentation, (b) familial clustering of the disease, and (c) dissection of the genetic component. Since there is no strong evidence for a specific genetic component in SS, a large international and collaborative study would be suitable to assess the genetics of this disorder.

Neural networks of human nature and nurture

Neural network methods have facilitated the unification of several unfortunate splits in psychology, including nature versus nurture. We review the contributions of this methodology and then discuss tentative network theories of caring behavior, of uncaring behavior, and of how the frontal lobes are involved in the choices between them. The implications of our theory are optimistic about the prospects of society to encourage the human potential for caring. 

Biological Basis and Clinical Application of Serum Tumor Markers

Cancer is the result of the accumulation of changes in molecules with important functions in processes such as cell proliferation, apoptosis, cell death and gene repair. Molecules, substances or altered pathways constitute tumor markers or biomarkers useful in clinical monitoring of cancer patients, because they have demonstrated to be suitable for the valuation of the patient’s treatment and it efficiency. Determination of tumor markers has not been very successful due to the low sensitivity and specificity of the techniques used and the requirement of large volumes of biological samples or the use of invasive methods for collecting them. The serum tumor markers arise, as a useful tool to obtain information about the disease progress and constitute as a scientific challenge to improve its applicability in early diagnosis, prognosis, monitoring of the disease and evaluation of therapeutic efficacy.

Validación diagnóstica del test neural 1 para el síndrome de túnel del carpo

El objetivo de este estudio fue realizar una prueba de validez diagnostica del test neural 1 para el diagnóstico del Síndrome de Túnel del Carpo (STC) utilizando como prueba de referencia o de oro el test de conducción nerviosa. En este estudio participaron 115 sujetos, 230 manos con sospecha clínica de STC quienes fueron evaluados con el test de conducción nerviosa y el test neural 1. Se encontró una sensibilidad del 93.0% (IC 95%:88,21-96,79) y una especificidad del 6,67% (IC 95%:0,0-33,59), razón de verosimilitud positiva fue de 1,00 y razón de verosimilitud negativa de 1,05. Valor predictivo positivo de 86,9% y un valor predictivo negativo de 12,5%. Se concluye que el test neural 1 es una prueba clínica de alta sensibilidad y baja especificidad de gran utilidad para el monitoreo e identificación del STC. Es un procedimiento para el diagnóstico clínico de bajo costo que puede incluirse en los exámenes de rutina de los trabajadores como complemento a las pruebas clínicas sugeridas por las Gatiso para dar mayor precisión a la identificación temprana del STC. Se sugiere combinarla con otros test de mayor especificidad para ser aplicada en trabajadores en condiciones de riesgo o que presenten síntomas en miembros superiores y realizar otros estudios en donde participen sujetos sin diagnóstico clínico del STC.

Búsqueda de selección en el polimorfismo 677C>T (c.665C>T) del gen de la metilentetrahidrofolato reductasa (MTHFR) en una población Colombiana

Se realizó un estudio genético – poblacional en dos grupos etarios de población colombiana con la finalidad de evaluar las diferencias genéticas relacionadas con el polimorfismo MTHFR 677CT en busca de eventos genéticos que soporten la persistencia de este polimorfismo en la especie humana debido que este ha sido asociado con múltiples enfermedades. De esta manera se genotipificaron los individuos, se analizaron los genotipos, frecuencias alélicas y se realizaron diferentes pruebas genéticas-poblacionales. Contrario a lo observado en poblaciones Colombianas revisadas se identificó la ausencia del Equilibrio Hardy-Weinberg en el grupo de los niños y estructuras poblacionales entre los adultos lo que sugiere diferentes historias demográficas y culturales entre estos dos grupos poblacionales al tiempo, lo que soporta la hipótesis de un evento de selección sobre el polimorfismo en nuestra población. De igual manera nuestros datos fueron analizados junto con estudios previos a nivel nacional y mundial lo cual sustenta que el posible evento selectivo es debido a que el aporte de ácido fólico se ha incrementado durante las últimas dos décadas como consecuencia de las campañas de fortificación de las harinas y suplementación a las embarazadas con ácido fólico, por lo tanto aquí se propone un modelo de selección que se ajusta a los datos encontrados en este trabajo se establece una relación entre los patrones nutricionales de la especie humana a través de la historia que explica las diferencias en frecuencias de este polimorfismo a nivel espacial y temporal.  

Convergencia de vías de señalización en un modelo de apoptosis

La sepsis es un evento inflamatorio generalizado del organismo inducido por un daño causado generalmente por un agente infeccioso. El patógeno más frecuentemente asociado con esta entidad es el Staphylococcus aureus, responsable de la inducción de apoptosis en células endoteliales debida a la producción de ceramida. Se ha descrito el efecto protector de la proteína C activada (PCA) en sepsis y su relación con la disminución de la apoptosis de las células endoteliales. En este trabajo se analizó la activación de las quinasas AKT, ASK1, SAPK/JNK y p38 en un modelo de apoptosis endotelial usando las técnicas de Western Blotting y ELISA. Las células endoteliales (EA.hy926), se trataron con C2-ceramida (130μM) en presencia de inhibidores químicos de cada una de estas quinasas y PCA. La supervivencia de las células en presencia de inhibidores químicos y PCA fue evaluada por medio de ensayos de activación de las caspasas 3, 7 y 9, que verificaban la muerte celular por apoptosis. Los resultados evidencian que la ceramida reduce la activación de AKT y aumenta la activación de las quinasas ASK, SAPK/JNK y p38, en tanto que PCA ejerce el efecto contrario. Adicionalmente se encontró que la tiorredoxina incrementa la activación/fosforilación de AKT, mientras que la quinasa p38 induce la defosforilación de AKT.

Language teaching : theoretical basis and curricular design.

Este libro intenta ofrecer una panorámica diferente de la enseñanza de idiomas y llenar el vacío con el que con mucha frecuencia se encuentran los opositores al cuerpo de Enseñanza de Escuelas Oficiales de Idiomas y de Secundaria cuando deciden buscar información sobre un amplio temario. Esta obra combina una base teórica, que cubre aspectos sobre las teorías del lenguaje y de la enseñanza, con un diseño curricular práctico. La primera parte consta de cuatro bloques: 1) El proceso de comunicación, funciones del lenguaje y comunicación oral y escrita. 2) Competencia comunicativa y enseñanza comunicativa del inglés. 3) Teorías sobre el aprendizaje y la adquisición de un idioma extranjero, el concepto de interlenguaje y el tratamiento de error. 4) Evolución de la enseñanza de idiomas. La segunda parte trata del diseño curricular: los objetivos principales que se persiguen en la enseñanza de un idioma, los contenidos, la metodología a seguir con los estudiantes y criterios de evaluación. Es un tratado basado en la propia experiencia personal de la autora como profesora de inglés.

Basis set superposition error-counterpoise corrected potential energy surfaces : application to hydrogen peroxide ... X (X=F-, Cl-, Br-, Li+, Na+) complexes

Møller-Plesset (MP2) and Becke-3-Lee-Yang-Parr (B3LYP) calculations have been used to compare the geometrical parameters, hydrogen-bonding properties, vibrational frequencies and relative energies for several X- and X+ hydrogen peroxide complexes. The geometries and interaction energies were corrected for the basis set superposition error (BSSE) in all the complexes (1-5), using the full counterpoise method, yielding small BSSE values for the 6-311 + G(3df,2p) basis set used. The interaction energies calculated ranged from medium to strong hydrogen-bonding systems (1-3) and strong electrostatic interactions (4 and 5). The molecular interactions have been characterized using the atoms in molecules theory (AIM), and by the analysis of the vibrational frequencies. The minima on the BSSE-counterpoise corrected potential-energy surface (PES) have been determined as described by S. Simón, M. Duran, and J. J. Dannenberg, and the results were compared with the uncorrected PES

Systematic study of the static electrical properties of the CO molecule: influence of the basis set size and correlation energy

The influence of the basis set size and the correlation energy in the static electrical properties of the CO molecule is assessed. In particular, we have studied both the nuclear relaxation and the vibrational contributions to the static molecular electrical properties, the vibrational Stark effect (VSE) and the vibrational intensity effect (VIE). From a mathematical point of view, when a static and uniform electric field is applied to a molecule, the energy of this system can be expressed in terms of a double power series with respect to the bond length and to the field strength. From the power series expansion of the potential energy, field-dependent expressions for the equilibrium geometry, for the potential energy and for the force constant are obtained. The nuclear relaxation and vibrational contributions to the molecular electrical properties are analyzed in terms of the derivatives of the electronic molecular properties. In general, the results presented show that accurate inclusion of the correlation energy and large basis sets are needed to calculate the molecular electrical properties and their derivatives with respect to either nuclear displacements or/and field strength. With respect to experimental data, the calculated power series coefficients are overestimated by the SCF, CISD, and QCISD methods. On the contrary, perturbation methods (MP2 and MP4) tend to underestimate them. In average and using the 6-311 + G(3df) basis set and for the CO molecule, the nuclear relaxation and the vibrational contributions to the molecular electrical properties amount to 11.7%, 3.3%, and 69.7% of the purely electronic μ, α, and β values, respectively