Hybrid coordination of reinforcement learning-based behaviors for AUV control

This paper proposes a hybrid coordination method for behavior-based control architectures. The hybrid method takes advantages of the robustness and modularity in competitive approaches as well as optimized trajectories in cooperative ones. This paper shows the feasibility of applying this hybrid method with a 3D-navigation to an autonomous underwater vehicle (AUV). The behaviors are learnt online by means of reinforcement learning. A continuous Q-learning implemented with a feed-forward neural network is employed. Realistic simulations were carried out. The results obtained show the good performance of the hybrid method on behavior coordination as well as the convergence of the behaviors

Modeling and control of electromechanical systems

The material presented in the these notes covers the sessions Modelling of electromechanical systems, Passive control theory I and Passive control theory II of the II EURON/GEOPLEX Summer School on Modelling and Control of Complex Dynamical Systems.We start with a general description of what an electromechanical system is from a network modelling point of view. Next, a general formulation in terms of PHDS is introduced, and some of the previous electromechanical systems are rewritten in this formalism. Power converters, which are variable structure systems (VSS), can also be given a PHDS form.We conclude the modelling part of these lectures with a rather complex example, showing the interconnection of subsystems from several domains, namely an arrangement to temporally store the surplus energy in a section of a metropolitan transportation system based on dc motor vehicles, using either arrays of supercapacitors or an electric poweredflywheel. The second part of the lectures addresses control of PHD systems. We first present the idea of control as power connection of a plant and a controller. Next we discuss how to circumvent this obstacle and present the basic ideas of Interconnection and Damping Assignment (IDA) passivity-based control of PHD systems.

DAI-DEPUR: an integrated and distributed architecture for wastewater treatment plants supervision

The activated sludge process - the main biological technology usually applied towastewater treatment plants (WWTP) - directly depends on live beings (microorganisms), and therefore on unforeseen changes produced by them. It could be possible to get a good plant operation if the supervisory control system is able to react to the changes and deviations in the system and can take thenecessary actions to restore the system’s performance. These decisions are oftenbased both on physical, chemical, microbiological principles (suitable to bemodelled by conventional control algorithms) and on some knowledge (suitable to be modelled by knowledge-based systems). But one of the key problems in knowledge-based control systems design is the development of an architecture able to manage efficiently the different elements of the process (integrated architecture), to learn from previous cases (spec@c experimental knowledge) and to acquire the domain knowledge (general expert knowledge). These problems increase when the process belongs to an ill-structured domain and is composed of several complex operational units. Therefore, an integrated and distributed AIarchitecture seems to be a good choice. This paper proposes an integrated and distributed supervisory multi-level architecture for the supervision of WWTP, that overcomes some of the main troubles of classical control techniques and those of knowledge-based systems applied to real world systems

A mixed H2/H∞-based semiactive control for vibration mitigation in flexible structures

In this paper, we address this problem through the design of a semiactive controller based on the mixed H2/H∞ control theory. The vibrations caused by the seismic motions are mitigated by a semiactive damper installed in the bottom of the structure. It is meant by semiactive damper, a device that absorbs but cannot inject energy into the system. Sufficient conditions for the design of a desired control are given in terms of linear matrix inequalities (LMIs). A controller that guarantees asymptotic stability and a mixed H2/H∞ performance is then developed. An algorithm is proposed to handle the semiactive nature of the actuator. The performance of the controller is experimentally evaluated in a real-time hybrid testing facility that consists of a physical specimen (a small-scale magnetorheological damper) and a numerical model (a large-scale three-story building)

Differences based on fine motor behaviour in Parkinson's patients compared to an age matched control group in proprioceptive and visuo-proprioceptive test conditions

Personality differences based on fine motor precision performance were studied in early stage Parkinson's patients and an age-matched control group under two different test conditions: proprioceptive + visual information and proprioceptive information alone. A comparative data analysis for deviations of three measured movement types (transversal, frontal and sagittal) was done for both hands (dominant and non-dominant) with relation to personality dimensions. There were found significant differences between the two groups in decision making dimension and emotionality. After splitting the data for gender subgroups, some significant differences were found for men but not for women. The differences in fine motor task performance varied, being better in some directions for the Parkinson"s patients and worse in others. The findings may suggest that medication has both positive and negative effects on motor performance and provoke personality changes, being more pronounced in men.

Model-based objects recognition in industrial environments for autonomous vehicles control

Behavior-based navigation of autonomous vehicles requires the recognition of the navigable areas and the potential obstacles. In this paper we describe a model-based objects recognition system which is part of an image interpretation system intended to assist the navigation of autonomous vehicles that operate in industrial environments. The recognition system integrates color, shape and texture information together with the location of the vanishing point. The recognition process starts from some prior scene knowledge, that is, a generic model of the expected scene and the potential objects. The recognition system constitutes an approach where different low-level vision techniques extract a multitude of image descriptors which are then analyzed using a rule-based reasoning system to interpret the image content. This system has been implemented using a rule-based cooperative expert system

Population-based multicase-control study in common tumors in Spain (MCC-Spain): rationale and study design

INTRODUCTION: We present the protocol of a large population-based case-control study of 5 common tumors in Spain (MCC-Spain) that evaluates environmental exposures and genetic factors. METHODS: Between 2008-2013, 10,183 persons aged 20-85 years were enrolled in 23 hospitals and primary care centres in 12 Spanish provinces including 1,115 cases of a new diagnosis of prostate cancer, 1,750 of breast cancer, 2,171 of colorectal cancer, 492 of gastro-oesophageal cancer, 554 cases of chronic lymphocytic leukaemia (CLL) and 4,101 population-based controls matched by frequency to cases by age, sex and region of residence. Participation rates ranged from 57% (stomach cancer) to 87% (CLL cases) and from 30% to 77% in controls. Participants completed a face-to-face computerized interview on sociodemographic factors, environmental exposures, occupation, medication, lifestyle, and personal and family medical history. In addition, participants completed a self-administered food-frequency questionnaire and telephone interviews. Blood samples were collected from 76% of participants while saliva samples were collected in CLL cases and participants refusing blood extractions. Clinical information was recorded for cases and paraffin blocks and/or fresh tumor samples are available in most collaborating hospitals. Genotyping was done through an exome array enriched with genetic markers in specific pathways. Multiple analyses are planned to assess the association of environmental, personal and genetic risk factors for each tumor and to identify pleiotropic effects. DISCUSSION: This study, conducted within the Spanish Consortium for Biomedical Research in Epidemiology & Public Health (CIBERESP), is a unique initiative to evaluate etiological factors for common cancers and will promote cancer research and prevention in Spain.

Estudi de casos pel control de síntesi d’instruments musicals virtuals mitjançant la veu cantada

Report for the scientific sojourn carried out at the Music Technology Area (Sound Processing and Control Lab), Faculty of Music, McGill University, Montreal, Canada, from October to December 2005.The aim of this research is to study the singing voice for controlling virtual musical instrument synthesis. It includes analysis and synthesis algorithms based on spectral audio processing. After digitalising the acoustic voice signal in the computer, a number of expressive descriptors of the singer are extracted. This process is achieved synchronously, thus all the nuance of the singer performance have been tracked. In a second stage, the extracted parameters are mapped to a sound synthesizer, the so-called digital musical instruments. In order achieve it, several tests with music students of the Faculty of Music, McGill University have been developed. These experiments have contributed to evaluate the system and to derive new control strategies to integrate: clarinet synthesis, bass guitar, visual representation of voice signals.

MB-MDR: Model-Based Multifactor Dimensionality Reduction for detecting interactions in high-dimensional genomic data

L’anàlisi de l’efecte dels gens i els factors ambientals en el desenvolupament de malalties complexes és un gran repte estadístic i computacional. Entre les diverses metodologies de mineria de dades que s’han proposat per a l’anàlisi d’interaccions una de les més populars és el mètode Multifactor Dimensionality Reduction, MDR, (Ritchie i al. 2001). L’estratègia d’aquest mètode és reduir la dimensió multifactorial a u mitjançant l’agrupació dels diferents genotips en dos grups de risc: alt i baix. Tot i la seva utilitat demostrada, el mètode MDR té alguns inconvenients entre els quals l’agrupació excessiva de genotips pot fer que algunes interaccions importants no siguin detectades i que no permet ajustar per efectes principals ni per variables confusores. En aquest article il•lustrem les limitacions de l’estratègia MDR i d’altres aproximacions no paramètriques i demostrem la conveniència d’utilitzar metodologies parametriques per analitzar interaccions en estudis cas-control on es requereix l’ajust per variables confusores i per efectes principals. Proposem una nova metodologia, una versió paramètrica del mètode MDR, que anomenem Model-Based Multifactor Dimensionality Reduction (MB-MDR). La metodologia proposada té com a objectiu la identificació de genotips específics que estiguin associats a la malaltia i permet ajustar per efectes marginals i variables confusores. La nova metodologia s’il•lustra amb dades de l’Estudi Espanyol de Cancer de Bufeta.

Enrutament i control de flux en xarxes híbrides satèl·lit-terrestre

Les xarxes híbrides satèl·lit-terrestre ofereixen connectivitat a zones remotes i aïllades i permeten resoldre nombrosos problemes de comunicacions. No obstant, presenten diversos reptes, ja que realitzen la comunicació per un canal mòbil terrestre i un canal satèl·lit contigu. Un d'aquests reptes és trobar mecanismes per realitzar eficientment l'enrutament i el control de flux, de manera conjunta. L'objectiu d'aquest projecte és simular i estudiar algorismes existents que resolguin aquests problemes, així com proposar-ne de nous, mitjançant diverses tècniques d'optimització convexa. A partir de les simulacions realitzades en aquest estudi, s'han analitzat àmpliament els diversos problemes d'enrutament i control de flux, i s'han avaluat els resultats obtinguts i les prestacions dels algorismes emprats. En concret, s'han implementat de manera satisfactòria algorismes basats en el mètode de descomposició dual, el mètode de subgradient, el mètode de Newton i el mètode de la barrera logarítmica, entre d'altres, per tal de resoldre els problemes d'enrutament i control de flux plantejats.

Model based fault diagnosis with application to an automotive engine

Report for the scientific sojourn at the University of Linköping between April to July 2007. Monitoring of the air intake system of an automotive engine is important to meet emission related legislative diagnosis requirements. During the research the problem of fault detection in the air intake system was stated as a constraint satisfaction problem over continuous domains with a big number of variables and constraints. This problem was solved using Interval-based Consistency Techniques. Interval-based consistency techniques are shown to be particularly efficient for checking the consistency of the Analytical Redundancy Relations (ARRs), dealing with uncertain measurements and parameters, and using experimental data. All experiments were performed on a four-cylinder turbo-charged spark-ignited SAAB engine located in the research laboratory at Vehicular System Group - University of Linköping.

Desarrollo y aplicación de estrategias de control avanzado en procesos biológicos de tratamiento de efluentes contaminados

En este proyecto se ha desarrollado estrategias de control avanzadas para plantas de depuración de aguas residuales urbanas que eliminan conjuntamente materia orgánica, nitrógeno y fósforo. Las estrategias se han basado en el estudio multivariable del comportamiento del sistema, que ha producido subsidios para la utilización de lazos de control feedforward, de control predictivo y de un control de costes que automáticamente enviaba las consignas más adecuadas para los controladores de proceso. Para el desarrollo de las estrategias, se ha creado un sistema virtual de simulación (simulador) de plantas de depuradoras, basado en datos de literatura. Para el caso de una planta real, se ha desarrollado un simulador de la planta de Manresa (Catalunya). Sin embargo, el sistema de Manresa se ha utilizado exclusivamente para auxiliar los ingenieros de la planta en la tomada de decisiones de cambio de configuración para que la eliminación de fósforo se dé por la ruta biológica y no por la ruta química. La implementación de los simuladores ha permitido hacer muchas pruebas que en una planta real demandarían mucho tiempo y consumirían muchos recursos energéticos y financieros. Las estrategias de control más elaboradas han podido ahorrar hasta 150.000,00 Euros por año en relación a la operación de la planta sin el control automático. Cuanto a los estudios del modelo de la planta real, se concluyó que la eliminación biológica de fósforo puede sustituir el actual proceso químico de eliminación de fósforo, bajando los costes operacionales (costes del agente precipitante).

Instrumentació i control d'actuadors fluídics per a sistemes analítics: sistema de regulació d'una microbomba de precisió a mode de xeringa

En aquest projecte s’ha implementat un sistema de control per a les bombes microfluídiques LPVX de The Lee Company funcionant a mode de xeringa. El sistema consisteix en un circuit controlador basat en el microxip UDN 296 B de Allegro MicroSystems, que conté dos Ponts en H per a controlar motors pas a pas i dos mòduls de Modulació d’Amplada de Polsos (PWM), governat a partir d’un programa de control com a instrument virtual dissenyat sota l’entorn LabVIEW. El programa de control permet indicar la quantitat de volum a aspirar o dispensar per la bomba i escollir entre una execució simple o una de continuada, podent-ne controlar en aquest segona opció el temps entre execució i execució. El programa també permet visualitzar el procés mitjançant la obtenció de la imatge d’una webcam amb DirectShow. Finalment també permet el control remot de l’Instrument Virtual a través de la xarxa d’Internet.

Modelització i control d'un reactor de producció d'hidrogen per a l'alimentació de piles de combustible

Les piles de combustible permeten la transformació eficient de l’energia química de certs combustibles a energia elèctrica a través d’un procés electroquímic. De les diferents tecnologies de piles de combustible, les piles de combustible de tipus PEM són les més competitives i tenen una gran varietat d’aplicacions. No obstant, han de ser alimentades únicament per hidrogen. Per altra banda, l’etanol, un combustible interessant en el marc dels combustibles renovables, és una possible font d’hidrogen. Aquest treball estudia la reformació d’etanol per a l’obtenció d’hidrogen per a alimentar piles de combustible PEM. Només existeixen algunes publicacions que tractin l’obtenció d’hidrogen a partir d’etanol, i aquestes no inclouen l’estudi dinàmic del sistema. Els objectius del treball són el modelat i l’estudi dinàmic de reformadors d’etanol de baixa temperatura. Concretament, proposa un model dinàmic d’un reformador catalític d’etanol amb vapor basat en un catalitzador de cobalt. Aquesta reformació permet obtenir valors alts d’eficiència i valors òptims de monòxid de carboni que evitaran l’enverinament d’una la pila de combustible de tipus PEM. El model, no lineal, es basa en la cinètica obtinguda de diferents assaigs de laboratori. El reformador modelat opera en tres etapes: deshidrogenació d’etanol a acetaldehid i hidrogen, reformat amb vapor d’acetaldehid, i la reacció WGS (Water Gas Shift). El treball també estudia la sensibilitat i controlabilitat del sistema, caracteritzant així el sistema que caldrà controlar. L’anàlisi de controlabilitat es realitza sobre la resposta de dinàmica ràpida obtinguda del balanç de massa del reformador. El model no lineal és linealitzat amb la finalitat d’aplicar eines d’anàlisi com RGA, CN i MRI. El treball ofereix la informació necessària per a avaluar la possible implementació en un laboratori de piles de combustibles PEM alimentades per hidrogen provinent d’un reformador d’etanol.

Can You Home Again? Desertion and Control of Hometowns in Civil Wars

What allows an armed group in a civil war to prevent desertion? This paper addresses this question with a focus on control in the rearguard. Most past studies focus on motivations for desertion. They explain desertion in terms of where soldiers stand in relation to the macro themes of the war, or in terms of an inability to provide positive incentives to overcome the collective action problem. However, since individuals decide whether and how to participate in civil wars for multiple reasons, responding to a variety of local conditions in an environment of threat and violence, a focus only on macro-level motivations is incomplete. The opportunities side of the ledger deserves more attention. I therefore turn my attention to how control by an armed group eliminates soldiers’ opportunities to desert. In particular, I consider the control that an armed group maintains over soldiers’ hometowns, treating geographic terrain as an important exogenous indicator of the ease of control. Rough terrain at home affords soldiers and their families and friends advantages in ease of hiding, the difficulty of using force, and local knowledge. Based on an original dataset of soldiers from Santander Province in the Spanish Civil War, gathered from archival sources, I find statistical evidence that the rougher the terrain in a soldier’s home municipality, the more likely he is to desert. I find complementary qualitative evidence indicating that soldiers from rough-terrain communities took active advantage of their greater opportunities for evasion. This finding has important implications for the way observers interpret different soldiers’ decisions to desert or remain fighting, for the prospect that structural factors may shape the cohesion of armed groups, and for the possibility that local knowledge may be a double-edged sword, making soldiers simultaneously good at fighting and good at deserting.