Autonomous underwater vehicle control using reinforcement learning policy search methods

Autonomous underwater vehicles (AUV) represent a challenging control problem with complex, noisy, dynamics. Nowadays, not only the continuous scientific advances in underwater robotics but the increasing number of subsea missions and its complexity ask for an automatization of submarine processes. This paper proposes a high-level control system for solving the action selection problem of an autonomous robot. The system is characterized by the use of reinforcement learning direct policy search methods (RLDPS) for learning the internal state/action mapping of some behaviors. We demonstrate its feasibility with simulated experiments using the model of our underwater robot URIS in a target following task

Towards Direct Policy Search Reinforcement Learning for Robot Control

This paper proposes a high-level reinforcement learning (RL) control system for solving the action selection problem of an autonomous robot. Although the dominant approach, when using RL, has been to apply value function based algorithms, the system here detailed is characterized by the use of direct policy search methods. Rather than approximating a value function, these methodologies approximate a policy using an independent function approximator with its own parameters, trying to maximize the future expected reward. The policy based algorithm presented in this paper is used for learning the internal state/action mapping of a behavior. In this preliminary work, we demonstrate its feasibility with simulated experiments using the underwater robot GARBI in a target reaching task

Automatic self-configuration of the logical network using distributed software agents

We present a system for dynamic network resource configuration in environments with bandwidth reservation. The proposed system is completely distributed and automates the mechanisms for adapting the logical network to the offered load. The system is able to manage dynamically a logical network such as a virtual path network in ATM or a label switched path network in MPLS or GMPLS. The system design and implementation is based on a multi-agent system (MAS) which make the decisions of when and how to change a logical path. Despite the lack of a centralised global network view, results show that MAS manages the network resources effectively, reducing the connection blocking probability and, therefore, achieving better utilisation of network resources. We also include details of its architecture and implementation

Assessment of Severe Apnoea through Voice Analysis, Automatic Speech, and Speaker Recognition Techniques

This study is part of an ongoing collaborative effort between the medical and the signal processing communities to promote research on applying standard Automatic Speech Recognition (ASR) techniques for the automatic diagnosis of patients with severe obstructive sleep apnoea (OSA). Early detection of severe apnoea cases is important so that patients can receive early treatment. Effective ASR-based detection could dramatically cut medical testing time. Working with a carefully designed speech database of healthy and apnoea subjects, we describe an acoustic search for distinctive apnoea voice characteristics. We also study abnormal nasalization in OSA patients by modelling vowels in nasal and nonnasal phonetic contexts using Gaussian Mixture Model (GMM) pattern recognition on speech spectra. Finally, we present experimental findings regarding the discriminative power of GMMs applied to severe apnoea detection. We have achieved an 81% correct classification rate, which is very promising and underpins the interest in this line of inquiry.

Interacting software-agents to support a kind of expert supervision systems

Expert supervision systems are software applications specially designed to automate process monitoring. The goal is to reduce the dependency on human operators to assure the correct operation of a process including faulty situations. Construction of this kind of application involves an important task of design and development in order to represent and to manipulate process data and behaviour at different degrees of abstraction for interfacing with data acquisition systems connected to the process. This is an open problem that becomes more complex with the number of variables, parameters and relations to account for the complexity of the process. Multiple specialised modules tuned to solve simpler tasks that operate under a co-ordination provide a solution. A modular architecture based on concepts of software agents, taking advantage of the integration of diverse knowledge-based techniques, is proposed for this purpose. The components (software agents, communication mechanisms and perception/action mechanisms) are based on ICa (Intelligent Control architecture), software middleware supporting the build-up of applications with software agent features

Andalusian Health Repository: Promoting the scientific health output among professionals and providing citizens with quality health information

The Andalusian Public Health System (Sistema Sanitario Público de Andalucía -SSPA) Repository is the open environment where all the scientific output generated by the SSPA professionals, resulting from their medical care, research and administrative activities, is comprehensively collected and managed. This repository possesses special features which determined its development: the SSPA organization and its purpose as a health institution, the specific sets of documents that it generates and the stakeholders involved in it. The repository uses DSpace 1.6.2, to which several changes were implemented in order to achieve the SSPA initial goals and requirements. The main changes were: the addition of specific qualifiers to the Metadata Dublin Core scheme, the modification of the submission form, the integration of the MeSH Thesaurus as controlled vocabulary and the optimization of the advanced search tool. Another key point during the setting up of the repository was the initial batch ingest of the documents.

Endocannabinoid system and psychiatry: in search of a neurobiological basis for detrimental and potential therapeutic effects.

Public concern on mental health has noticeably increased given the high prevalence of neuropsychiatric disorders. Cognition and emotionality are the most affected functions in neuropsychiatric disorders, i.e., anxiety disorders, depression, and schizophrenia. In this review, most relevant literature on the role of the endocannabinoid (eCB) system in neuropsychiatric disorders will be presented. Evidence from clinical and animal studies is provided for the participation of CB1 and CB2 receptors (CB1R and CB2R) in the above mentioned neuropsychiatric disorders. CBRs are crucial in some of the emotional and cognitive impairments reported, although more research is required to understand the specific role of the eCB system in neuropsychiatric disorders. Cannabidiol (CBD), the main non-psychotropic component of the Cannabis sativa plant, has shown therapeutic potential in several neuropsychiatric disorders. Although further studies are needed, recent studies indicate that CBD therapeutic effects may partially depend on facilitation of eCB-mediated neurotransmission. Last but not least, this review includes recent findings on the role of the eCB system in eating disorders. A deregulation of the eCB system has been proposed to be in the bases of several neuropsychiatric disorders, including eating disorders. Cannabis consumption has been related to the appearance of psychotic symptoms and schizophrenia. In contrast, the pharmacological manipulation of this eCB system has been proposed as a potential strategy for the treatment of anxiety disorders, depression, and anorexia nervosa. In conclusion, the eCB system plays a critical role in psychiatry; however, detrimental consequences of manipulating this endogenous system cannot be underestimated over the potential and promising perspectives of its therapeutic manipulation.

Projecte de software per a la gestió d'entitats culturals

Aquest projecte es basa en la necessitat d’un grup d’entitats culturals de Blanes de tenir un software de gestió integral d’entitats que faciliti el seu funcionament diari. Siguin un esbart, una colla castellera o una coral, generen unes dades molt semblants que permeten dissenyar unes eines genèriques que totes elles poden utilitzar. El software desenvolupat permetrà gestionar les següents dades: socis, actuacions, repertori, participants i galeries d’imatges

Search for a platelet-activating factor receptor in the Trypanosoma cruzi proteome: a potential target for Chagas disease chemotherapy

Chagas disease (CD) causes the highest burden of parasitic diseases in the Western Hemisphere and is therefore a priority for drug research and development. Platelet-activating factor (PAF) causes the CD parasite Trypanosoma cruzi to differentiate, which suggests that the parasite may express PAF receptors. Here, we explored the T. cruzi proteome for PAF receptor-like proteins. From a total of 23,000 protein sequences, we identified 29 hypothetical proteins that are predicted to have seven transmembrane domains (TMDs), which is the main characteristic of the G protein-coupled receptors (GPCRs), including the PAF receptor. The TMDs of these sequences were independently aligned with domains from 25 animal PAF receptors and the sequences were analysed for conserved residues. The conservation score mean values for the TMDs of the hypothetical proteins ranged from 31.7-44.1%, which suggests that if the putative T. cruzi PAF receptor is among the sequences identified, the TMDs are not highly conserved. These results suggest that T. cruzi contains several GPCR-like proteins and that one of these GPCRs may be a PAF receptor. Future studies may further validate the PAF receptor as a target for CD chemotherapy.

Análisis y diseño del software para la gestión integral de un área quirúrgica hospitalaria

Este proyecto consiste en la elaboración de las fases de análisis y diseño técnico de un software que permite la gestión integral del área quirúrgica de un centro hospitalario.

Variability of ascending aorta diameter measurements as assessed with electrocardiography-gated multidetector computerized tomography and computer assisted diagnosis software.

Recently, morphometric measurements of the ascending aorta have been done with ECG-gated multidector computerized tomography (MDCT) to help the development of future novel transcatheter therapies (TCT); nevertheless, the variability of such measurements remains unknown. Thirty patients referred for ECG-gated CT thoracic angiography were evaluated. Continuous reformations of the ascending aorta, perpendicular to the centerline, were obtained automatically with a commercially available computer aided diagnosis (CAD). Then measurements of the maximal diameter were done with the CAD and manually by two observers (separately). Measurements were repeated one month later. The Bland-Altman method, Spearman coefficients, and a Wilcoxon signed-rank test were used to evaluate the variability, the correlation, and the differences between observers. The interobserver variability for maximal diameter between the two observers was up to 1.2 mm with limits of agreement [-1.5, +0.9] mm; whereas the intraobserver limits were [-1.2, +1.0] mm for the first observer and [-0.8, +0.8] mm for the second observer. The intraobserver CAD variability was 0.8 mm. The correlation was good between observers and the CAD (0.980-0.986); however, significant differences do exist (P<0.001). The maximum variability observed was 1.2 mm and should be considered in reports of measurements of the ascending aorta. The CAD is as reproducible as an experienced reader.

Estudi dels mètodes d'estimació de la tipologia de la xarxa en un protocol UUP basat en xarxes socials

En aquest projecte es presenta un mecanisme per garantir la privacitat de les cerques que fan els usuaris als motors de cerca aprofitant el potencial de les xarxes socials.

Optimización de los recursos de red de una organización mediante el uso de un servidor dedicado basado en software libre

Estudio de optimización de recursos de red basado en la utilización de un servidor dedicado gestionado mediante software libre.

Sistema de Administración de Propiedades Proyecto de Software Libre Wakodi

El trabajo se centra en proporcionar una solución informática para la Administración de Propiedades haciendo uso de nuevas tecnologías y a su vez dotar de las herramientas necesarias para la construcción de una comunidad. El desarrollo de la solución pasa por la descripción de las herramientas empleadas y las etapas para su construcción, que incluyen el análisis, diseño, implementación y posterior implantación. Se hace énfasis en el Framework elegido para demostrar las ventajas de su aplicación. En la construcción de la comunidad se describen las herramientas utilizadas para la difusión del proyecto que incluyen la publicación de una página del proyecto, el uso de redes sociales y páginas publicitarias y la puesta en marcha de un software de colaboración para la administración del desarrollo del proyecto.