Semi-online neural-Q_leaming for real-time robot learning

Reinforcement learning (RL) is a very suitable technique for robot learning, as it can learn in unknown environments and in real-time computation. The main difficulties in adapting classic RL algorithms to robotic systems are the generalization problem and the correct observation of the Markovian state. This paper attempts to solve the generalization problem by proposing the semi-online neural-Q_learning algorithm (SONQL). The algorithm uses the classic Q_learning technique with two modifications. First, a neural network (NN) approximates the Q_function allowing the use of continuous states and actions. Second, a database of the most representative learning samples accelerates and stabilizes the convergence. The term semi-online is referred to the fact that the algorithm uses the current but also past learning samples. However, the algorithm is able to learn in real-time while the robot is interacting with the environment. The paper shows simulated results with the "mountain-car" benchmark and, also, real results with an underwater robot in a target following behavior

Towards a real-time vision-based navigation system for a small-class UUV

This paper deals with the problem of navigation for an unmanned underwater vehicle (UUV) through image mosaicking. It represents a first step towards a real-time vision-based navigation system for a small-class low-cost UUV. We propose a navigation system composed by: (i) an image mosaicking module which provides velocity estimates; and (ii) an extended Kalman filter based on the hydrodynamic equation of motion, previously identified for this particular UUV. The obtained system is able to estimate the position and velocity of the robot. Moreover, it is able to deal with visual occlusions that usually appear when the sea bottom does not have enough visual features to solve the correspondence problem in a certain area of the trajectory

Matrix-assisted laser desorption ionization time-of-flight mass spectrometry and PCR-based rapid diagnosis of Staphylococcus aureus bacteraemia.

Effective empirical treatment is of paramount importance to improve the outcome of patients with Staphylococcus aureus bacteraemia. We aimed to evaluate a PCR-based rapid diagnosis of methicillin resistance (GeneXpert MRSA) after early detection of S. aureus bacteraemia using matrix-assisted laser desorption ionization time-of-flight mass spectrometry (MALDI-TOF MS). Patients with a first episode of S. aureus bacteraemia identified using MALDI-TOF MS were randomized in a prospective interventional open study between October 2010 and August 2012. In the control group, antibiotic susceptibility testing was performed after MALDI-TOF MS identification on blood culture pellets. In the intervention group, a GeneXpert MRSA was performed after S. aureus identification. The primary outcome was the performance of GeneXpert MRSA directly on blood cultures. We then assessed the impact of early diagnosis of methicillin resistance on the empirical treatment. In all, 197 episodes of S. aureus bacteraemia were included in the study, of which 106 were included in the intervention group. Median time from MALDI-TOF MS identification to GeneXpert MRSA result was 97 min (range 25-250). Detection of methicillin resistance using GeneXpert MRSA had a sensitivity of 99% and a specificity of 100%. There was less unnecessary coverage of MRSA in the intervention group (17.1% versus 29.2%, p 0.09). GeneXpert MRSA was highly reliable in diagnosing methicillin resistance when performed directly on positive blood cultures. This could help to avoid unnecessary prescriptions of anti-MRSA agents and promote the introduction of earlier adequate coverage in unsuspected cases.

A new approach to real time traffic sign recognition based on colour information

The automatic interpretation of conventional traffic signs is very complex and time consuming. The paper concerns an automatic warning system for driving assistance. It does not interpret the standard traffic signs on the roadside; the proposal is to incorporate into the existing signs another type of traffic sign whose information will be more easily interpreted by a processor. The type of information to be added is profuse and therefore the most important object is the robustness of the system. The basic proposal of this new philosophy is that the co-pilot system for automatic warning and driving assistance can interpret with greater ease the information contained in the new sign, whilst the human driver only has to interpret the "classic" sign. One of the codings that has been tested with good results and which seems to us easy to implement is that which has a rectangular shape and 4 vertical bars of different colours. The size of these signs is equivalent to the size of the conventional signs (approximately 0.4 m2). The colour information from the sign can be easily interpreted by the proposed processor and the interpretation is much easier and quicker than the information shown by the pictographs of the classic signs

Accumulation des carbohydrates chez les sexués de plusieurs espèces de fourmis en relation avec l'existence ou l'absence d'un vol nuptial

The dispersal strategy of ants generally makes use of a nuptial flight to bring together the sexes. The energy necessary to accomplish this flight comes from stored carbohydrates. However, in some species, one of the sexes does not fly and mating occurs in the nest. This is the case in Iridomyrmex humilis and Cataglyphis cursor, in which the virgin queens possess wings but not leave the natal nest. We show in this work that the winged females of these two species accumulate very little carbohydrate during the maturation period occuring between emergence and mating: expressed as a percentage of dry weight at the time of mating, the total carbohydrates reach only 3.2% in I. humilis and 2.1% in C. cursor. In contrast, the males of these species which fly, possess three to four times more carbohydrates (13.0% and 6.2%, respectively). These latter values are very similar to those found for both sexes of species employing nuptial flights, such several species of wood ants (Formica rufa, F. polyctena, F. lugubris ), Lasius (L. niger , L. flavus ) or Myrmica scabrinodis also studied here. It appears that the absence of the mating flight is associated with reduced levels of carbohydrates, specially glycogen

Documenting a time-bound, circular view of hierarchies: a microanalysis of parent-infant dyadic interaction.

This article presents a new theory that separates the levels of communication and relates them circularly, namely, by separating time from space/meaning variables. Documenting this proposition requires sequential microdescriptions--a far-out project in the field of family therapy. In an extensive study of clinical and nonclinical families, starting with available microanalytic data on nonverbal parent-infant dialogue, distinct time organizations have been found to modify the degree of circularity between the levels of interaction according to the observed types of engagement, that is, consensual, conflictual, and paradoxical. The double description of the dyad as a totality versus the dyad as a framing/developing organization imparts crucial information on how development proceeds in dyadic, co-evolutive systems, and presumably in larger ones too. In this perspective, a model is elaborated and then applied to a case description in our therapeutic consultation.

Fine-tuning the space, time, and host distribution of mycobacteria in wildlife.

BACKGROUND We describe the diversity of two kinds of mycobacteria isolates, environmental mycobacteria and Mycobacterium bovis collected from wild boar, fallow deer, red deer and cattle in Doñana National Park (DNP, Spain), analyzing their association with temporal, spatial and environmental factors. RESULTS High diversity of environmental mycobacteria species and M. bovis typing patterns (TPs) were found. When assessing the factors underlying the presence of the most common types of both environmental mycobacteria and M. bovis TPs in DNP, we evidenced (i) host species differences in the occurrence, (ii) spatial structuration and (iii) differences in the degree of spatial association of specific types between host species. Co-infection of a single host by two M. bovis TPs occurred in all three wild ungulate species. In wild boar and red deer, isolation of one group of mycobacteria occurred more frequently in individuals not infected by the other group. While only three TPs were detected in wildlife between 1998 and 2003, up to 8 different ones were found during 2006-2007. The opposite was observed in cattle. Belonging to an M. bovis-infected social group was a significant risk factor for mycobacterial infection in red deer and wild boar, but not for fallow deer. M. bovis TPs were usually found closer to water marshland than MOTT. CONCLUSIONS The diversity of mycobacteria described herein is indicative of multiple introduction events and a complex multi-host and multi-pathogen epidemiology in DNP. Significant changes in the mycobacterial isolate community may have taken place, even in a short time period (1998 to 2007). Aspects of host social organization should be taken into account in wildlife epidemiology. Wildlife in DNP is frequently exposed to different species of non-tuberculous, environmental mycobacteria, which could interact with the immune response to pathogenic mycobacteria, although the effects are unknown. This research highlights the suitability of molecular typing for surveys at small spatial and temporal scales.

Niche dynamics in space and time.

Niche conservatism, the tendency of a species niche to remain unchanged over time, is often assumed when discussing, explaining or predicting biogeographical patterns. Unfortunately, there has been no basis for predicting niche dynamics over relevant timescales, from tens to a few hundreds of years. The recent application of species distribution models (SDMs) and phylogenetic methods to analysis of niche characteristics has provided insight to niche dynamics. Niche shifts and conservatism have both occurred within the last 100 years, with recent speciation events, and deep within clades of species. There is increasing evidence that coordinated application of these methods can help to identify species which likely fulfill one key assumption in the predictive application of SDMs: an unchanging niche. This will improve confidence in SDM-based predictions of the impacts of climate change and species invasions on species distributions and biodiversity.

Multivariate ARIMA Compositional Time Series Analysis

A compositional time series is obtained when a compositional data vector is observed atdifferent points in time. Inherently, then, a compositional time series is a multivariatetime series with important constraints on the variables observed at any instance in time.Although this type of data frequently occurs in situations of real practical interest, atrawl through the statistical literature reveals that research in the field is very much in itsinfancy and that many theoretical and empirical issues still remain to be addressed. Anyappropriate statistical methodology for the analysis of compositional time series musttake into account the constraints which are not allowed for by the usual statisticaltechniques available for analysing multivariate time series. One general approach toanalyzing compositional time series consists in the application of an initial transform tobreak the positive and unit sum constraints, followed by the analysis of the transformedtime series using multivariate ARIMA models. In this paper we discuss the use of theadditive log-ratio, centred log-ratio and isometric log-ratio transforms. We also presentresults from an empirical study designed to explore how the selection of the initialtransform affects subsequent multivariate ARIMA modelling as well as the quality ofthe forecasts

Compositional Time Series: An Application

The composition of the labour force is an important economic factor for a country.Often the changes in proportions of different groups are of interest.I this paper we study a monthly compositional time series from the Swedish LabourForce Survey from 1994 to 2005. Three models are studied: the ILR-transformed series,the ILR-transformation of the compositional differenced series of order 1, and the ILRtransformationof the compositional differenced series of order 12. For each of thethree models a VAR-model is fitted based on the data 1994-2003. We predict the timeseries 15 steps ahead and calculate 95 % prediction regions. The predictions of thethree models are compared with actual values using MAD and MSE and the predictionregions are compared graphically in a ternary time series plot.We conclude that the first, and simplest, model possesses the best predictive power ofthe three models

Real-time PCR-based quantification of Toxoplasma gondii in tissue samples of serologically positive outdoor chickens

This study aimed to quantify Toxoplasma gondii in tissue samples of serologically positive chickens using real-time polymerase chain reaction (PCR). Of 65 chickens evaluated, 28 were positive for T. gondii antibodies. Brain and heart samples were collected from 26 seropositive chickens and DNA was extracted using Trizol® and amplified using real-time PCR with SYBR® Green. Parasite DNA was detected in 24 of the 26 samples analyzed; the number of positive tissue samples and the parasite quantity did not differ between tissue types. The results confirmed the analytical sensitivity of parasite detection in chicken tissue samples and demonstrated the possibility of using other molecular systems for genotypic analysis.

Detection of human bocavirus and human metapneumovirus by real-time PCR from patients with respiratory symptoms in Southern Brazil

The introduction of newer molecular methods has led to the discovery of new respiratory viruses, such as human metapneumovirus (hMPV) and human bocavirus (hBoV), in respiratory tract specimens. We have studied the occurrence of hMPV and hBoV in the Porto Alegre (PA) metropolitan area, one of the southernmost cities of Brazil, evaluating children with suspected lower respiratory tract infection from May 2007-June 2008. A real-time polymerase chain reaction method was used for amplification and detection of hMPV and hBoV and to evaluate coinfections with respiratory syncytial virus (RSV), influenza A and B, parainfluenza 1, 2 and 3, human rhinovirus and human adenovirus. Of the 455 nasopharyngeal aspirates tested, hMPV was detected in 14.5% of samples and hBoV in 13.2%. A unique causative viral agent was identified in 46.2% samples and the coinfection rate was 43.7%. For hBoV, 98.3% of all positive samples were from patients with mixed infections. Similarly, 84.8% of all hMPV-positive results were also observed in mixed infections. Both hBoV and hMPV usually appeared with RSV. In summary, this is the first confirmation that hMPV and hBoV circulate in PA; this provides evidence of frequent involvement of both viruses in children with clinical signs of acute viral respiratory tract infection, although they mainly appeared as coinfection agents.

Intra- and intersexual selection and their potential consequences on fitness-relevant traits in several fish species

Résumé : Les mécanismes de sélection sexuelle, en particulier la compétition entre mâles (sélection inter-sexuelle) et le choix des femelles (sélection intra-sexuelle), peuvent fortement influencer le succès reproducteur d'un individu, c'est-à-dire son nombre de descendants. On observe ainsi que les mâles dominants et les mâles élaborant des caractères sexuels secondaires marqués ont un succès reproducteur élevé. Toutefois, le succès reproducteur ne suffit pas pour garantir une contribution génétique élevée, parce que la fitness dépend également de la performance des descendants (c'est-à-dire de leur survie et de leur propre succès reproducteur). Si cette performance dépend en partie des gènes paternels, les males ont un avantage certain à signaler leur qualité aux femelles afin d'atteindre des taux de reproduction élevé. Ce mécanisme de signalisation est connu sous le nom de 'good genes hypothesis', toutefois très peu d'études ont clairement démontré le lien entre la qualité génétique des individus et la signalisation. De plus, la performance des descendants peut aussi dépendre des effets génétiques de compatibilité entre mâles et femelles ('compatible genes'). C'est-à-dire que certains allèles paternels n'apporteraient un avantage aux descendants qu'en combinaison avec certains allèles maternels. Nous avons déterminé, durant la période de reproduction, le statut de dominance des mâles pour deux espèces de poissons d'eau douce : la truite (Salmo trotta) et le vairon (Phoxinus phoxinus), puis nous avons évalué la relation entre le succès reproducteur et le statut de dominance et/ou la quantité de signalisation des caractères sexuels secondaires. Nous avons également fécondés artificiellement des oeufs de truites et de corégones (Coregonus palaea), en croisant chaque mâle avec chaque femelle (full-factorial breeding design). Ce type de design autorise la quantification précise des effets génétiques et permet de séparer les effets de 'good genes' et de 'compatible genes'. Cela a été fait sous différentes intensités de stress bactérien, ainsi que dans des conditions naturelles, et nous avons pu ainsi tester si certains indicateurs de qualité génétique des mâles ('good genes') étaient liés a) à la dominance et/ou b) à l'expression des caractères sexuels secondaires des mâles comme l'intensité mélanique ou la taille des tubercules sexuels. En outre, nous cherchons à savoir si la survie des descendants est liée à certaines combinaison des gènes du complexe d'histocompatibilité majeur (MHC) et/ou à la parenté génétique des parents, les deux traits étant soupçonnés d'avoir des influences génétique de compatibilité (`compatible genes') à la performance des descendants. Nous avons constaté que la dominance des mâles est directement liée à la taille et au poids des mâles (truites, vairons), mais également aux caractères sexuels secondaires (tubercules). De plus, les mâles vairons dominant ont eu un succès de fécondation plus élevés que les mâles subordonnés. Nous montrons que les truites et corégones mâles diffèrent dans leur qualité génétique, qui a été mesurée avéc la survie embryonnaire, le temps avant l'éclosion et enfin la croissance juvénile. Contrairement aux prédictions, la dominance (ou les traits indicatifs de dominance) n'était liée à la qualité génétique, dans aucun des traitements, et ne fonctionne donc pas comme indicateur de qualité. Par contre, la qualité génétique était liée aux caractères sexuels secondaires, particulièrement par la teinte mélanique chez les truites. Les embryons de truites issus de pères sombres survivaient mieux que ceux issus de pères clairs dans des environnements difficiles, de plus leur croissance était plus élevée lors de leur première année dans des conditions naturelles. La taille des juvéniles lors de leur première année est un trait important lié au succès dans la compétition pour des ressources telles qu'abri ou nourriture. De plus, les femelles truites peuvent augmenter la survie de leurs descendants en choisissant des mâles selon leur type de MHC ou selon leur degré de parenté. En outre, chez les corégones, la morphologie des tubercules sexuels ne semble pas signaler la qualité génétique. Nous avons également remarqué que l'exposition à des pathogènes non-létaux pouvait influencer la performance des alevins à court et long terme, probablement en affaiblissant leur système immunitaire. Cette thèse montre que les mâles diffèrent dans leur qualité génétique et que différents mécanismes de sélection inter- ou intra-sexuelle (par exemple la préférence pour des mâles sombres, pour des génotypes MHC ou pour des couples avec degré de parenté basse) pouvait avoir un effet positif sur la qualité des descendants, bien que cet effet génétique pouvait changer au cours du temps et entre différents environnements. Contrairement à nos attentes, le résultat de la compétition intra-sexuelle (la hiérarchie de dominance entre mâles) n'était pas lié à la qualité génétique individuelle ('good genes'). Dans ce sens, ce travail permet également de contribuer à l'explication du fait que la sélection sexuelle, de par sa forte sélection directionnelle, ne conduit pas à la diminution de la variance génétique, mais plutôt à la maintenance du polymorphisme génétique. Summary : Sexual selection mechanisms, especially male-male competition (inteasexual selection) and female mate choice (inteasexual selection), can strongly influence individual mating success, often resulting in dominant males and males with elaborate secondary sexual characters having higher fertilisation success. However, siring a high number of offspring alone does not guarantee high individual fitness, as fitness does also strongly depend on offspring performance (i.e. survival, fecundity). If this superiority in offspring performance depends on paternally inherited genes, the fathers are expected to signal this potential indirect benefit to females in order to attain high mating rates. This mechanism is also known as the 'good genes' hypothesis of sexual selection but until now most studies failed to conclusively show the relation of an individual genetic quality and its potential signalling traits. Further, offspring performance could also depend on compatible gene effects. These are alleles that increase offspring performance only in combination with other specific alleles. We first determined male dominance status from intrasexual competition during mating season for brown trout (Salmo trutta) and European minnows (Phoxinus phoxinus). For minnows we additionally checked if dominance and/or secondary sexual traits were linked to fertilisation success. Further, we artificially fertilised brown trout and alpine whitefish (Coregonus palaea) eggs, following full factorial breeding designs, enabling to properly measure `good gene' and `compatible gene' effects on offspring performance. This was done under different intensities of natural stressors, as well as under natural conditions. This procedure allowed us to test if the obtained male genetic quality measures (good genes effects) were indicated by a) dominance or lay traits linked to dominance and/or by b) secondary sexual characteristics such as melanin-based male skin darkness or breeding tubercles. Further, we investigated if offspring survival was linked to the MHC (major histocompatibility complex) gene combinations and/or to the parental genetic relatedness, as both traits were shown to have 'compatible gene' effects that may influence offspring performance. We found that male dominance in intrasexual competition was positively linked to body size, body weight (brown trout, minnows) but also to elaborate secondary sexual characteristics (breeding tubercles in minnows). Further, dominant minnow males did have an increased fertilisation success compared to subordinate ones. We show that brown trout and whitefish males do usually differ in their genetic quality, which was measured as embryo survival, hatching timing and finally as juvenile growth. Contrary to prediction male dominance or dominance indicating traits do not function as a quality signal as they were not linked to genetic quality. This result was constant when measuring genetic quality under different levels of natural stressors and under natural conditions (brown trout). On the other hand genetic quality seemed to be indicated by secondary sexual characteristics, specifically by melanin-based skin darkness in brown trout as brown trout embryos sired by darker fathers had increased survival rates when raised under harsh conditions and. they grew larger as juveniles after one year of growth in a natural stream, which is an important trait influencing success of juveniles in competition for hidings, food and other resources. Furthermore, brown trout females may increase the survival of their embryos when choosing males according to their MHC genotypes or to the general genetic relatedness between themselves and their potential mates. In whitefish on the other hand breeding tubercle morphology did not seem to signal genetic quality. Eventually, we saw that anon-lethal exposure to pathogens might influence short term and long term offspring performance probably by weakening an exposed individual's immune system. This thesis shows that males usually differ in their genetic quality and that different inter- or intrasexual selection mechanisms (e.g. mate selection favouring dark males, preference for MHC genotype combinations or for unrelated mates) may have strong positive effects on genetically dependent offspring performance but that such genetìc effects can change over time and environments. In contrast to our a priori expectations, the outcome of intrasexual selection, namely male dominance hierarchies, with dominant males often having high fertilisation success, was not linked to individual genetic quality (`good genes'). In this sense the present thesis may also be a helpful contribution to understand why sexual selection does not lead to rapid loss of genetic variation by strong directional selection but could even lead to the maintenance of genetic variation in natural populations.

Real-time molecular epidemiology of tuberculosis by direct genotyping of smear-positive clinical specimens.

We applied MIRU-VNTR (mycobacterial interspersed repetitive-unit-variable-number tandem-repeat typing) to directly analyze the bacilli present in 61 stain-positive specimens from tuberculosis patients. A complete MIRU type (24 loci) was obtained for all but one (no amplification in one locus) of the specimens (98.4%), and the allelic values fully correlated with those obtained from the corresponding cultures. Our study is the first to demonstrate that real-time genotyping of Mycobacterium tuberculosis can be achieved, fully transforming the way in which molecular epidemiology techniques can be integrated into control programs.