A distributed environment for virtual and/or real experiments for underwater robots

This paper presents the distributed environment for virtual and/or real experiments for underwater robots (DEVRE). This environment is composed of a set of processes running on a local area network composed of three sites: 1) the onboard AUV computer; 2) a surface computer used as human-machine interface (HMI); and 3) a computer used for simulating the vehicle dynamics and representing the virtual world. The HMI can be transparently linked to the real sensors and actuators dealing with a real mission. It can also be linked with virtual sensors and virtual actuators, dealing with a virtual mission. The aim of DEVRE is to assist engineers during the software development and testing in the lab prior to real experiments

Studies about the atomic capabilities concept for linear control systems in physical multi-agent environments

This paper shows the impact of the atomic capabilities concept to include control-oriented knowledge of linear control systems in the decisions making structure of physical agents. These agents operate in a real environment managing physical objects (e.g. their physical bodies) in coordinated tasks. This approach is presented using an introspective reasoning approach and control theory based on the specific tasks of passing a ball and executing the offside manoeuvre between physical agents in the robotic soccer testbed. Experimental results and conclusions are presented, emphasising the advantages of our approach that improve the multi-agent performance in cooperative systems

Gradient-based reinforcement learning techniques for underwater robotics behavior learning

Darrerament, l'interès pel desenvolupament d'aplicacions amb robots submarins autònoms (AUV) ha crescut de forma considerable. Els AUVs són atractius gràcies al seu tamany i el fet que no necessiten un operador humà per pilotar-los. Tot i això, és impossible comparar, en termes d'eficiència i flexibilitat, l'habilitat d'un pilot humà amb les escasses capacitats operatives que ofereixen els AUVs actuals. L'utilització de AUVs per cobrir grans àrees implica resoldre problemes complexos, especialment si es desitja que el nostre robot reaccioni en temps real a canvis sobtats en les condicions de treball. Per aquestes raons, el desenvolupament de sistemes de control autònom amb l'objectiu de millorar aquestes capacitats ha esdevingut una prioritat. Aquesta tesi tracta sobre el problema de la presa de decisions utilizant AUVs. El treball presentat es centra en l'estudi, disseny i aplicació de comportaments per a AUVs utilitzant tècniques d'aprenentatge per reforç (RL). La contribució principal d'aquesta tesi consisteix en l'aplicació de diverses tècniques de RL per tal de millorar l'autonomia dels robots submarins, amb l'objectiu final de demostrar la viabilitat d'aquests algoritmes per aprendre tasques submarines autònomes en temps real. En RL, el robot intenta maximitzar un reforç escalar obtingut com a conseqüència de la seva interacció amb l'entorn. L'objectiu és trobar una política òptima que relaciona tots els estats possibles amb les accions a executar per a cada estat que maximitzen la suma de reforços totals. Així, aquesta tesi investiga principalment dues tipologies d'algoritmes basats en RL: mètodes basats en funcions de valor (VF) i mètodes basats en el gradient (PG). Els resultats experimentals finals mostren el robot submarí Ictineu en una tasca autònoma real de seguiment de cables submarins. Per portar-la a terme, s'ha dissenyat un algoritme anomenat mètode d'Actor i Crític (AC), fruit de la fusió de mètodes VF amb tècniques de PG.

The automation and evaluation of nested clade phylogeographic analysis

Nested clade phylogeographic analysis (NCPA) is a popular method for reconstructing the demographic history of spatially distributed populations from genetic data. Although some parts of the analysis are automated, there is no unique and widely followed algorithm for doing this in its entirety, beginning with the data, and ending with the inferences drawn from the data. This article describes a method that automates NCPA, thereby providing a framework for replicating analyses in an objective way. To do so, a number of decisions need to be made so that the automated implementation is representative of previous analyses. We review how the NCPA procedure has evolved since its inception and conclude that there is scope for some variability in the manual application of NCPA. We apply the automated software to three published datasets previously analyzed manually and replicate many details of the manual analyses, suggesting that the current algorithm is representative of how a typical user will perform NCPA. We simulate a large number of replicate datasets for geographically distributed, but entirely random-mating, populations. These are then analyzed using the automated NCPA algorithm. Results indicate that NCPA tends to give a high frequency of false positives. In our simulations we observe that 14% of the clades give a conclusive inference that a demographic event has occurred, and that 75% of the datasets have at least one clade that gives such an inference. This is mainly due to the generation of multiple statistics per clade, of which only one is required to be significant to apply the inference key. We survey the inferences that have been made in recent publications and show that the most commonly inferred processes (restricted gene flow with isolation by distance and contiguous range expansion) are those that are commonly inferred in our simulations. However, published datasets typically yield a richer set of inferences with NCPA than obtained in our random-mating simulations, and further testing of NCPA with models of structured populations is necessary to examine its accuracy.

The automation of nested clade phylogeographic analysis

ANeCA is a fully automated implementation of Nested Clade Phylogeographic Analysis. This was originally developed by Templeton and colleagues, and has been used to infer, from the pattern of gene sequence polymorphisms in a geographically structured population, the historical demographic processes that have shaped its evolution. Until now it has been necessary to perform large parts of the procedure manually. We provide a program that will take data in Nexus sequential format, and directly output a set of inferences. The software also includes TCS v1.18 and GeoDis v2.2 as part of automation.

Stress-induced changes in the Schizosaccharomyces pombe proteome using two-dimensional difference gel electrophoresis, mass spectrometry and a novel integrated robotics platform

Robotic and manual methods have been used to obtain identification of significantly changing proteins regulated when Schizosaccharomyces pombe is exposed to oxidative stress. Differently treated S. pombe cells were lysed, labelled with CyDye and analysed by two-dimensional difference gel electrophoresis. Gel images analysed off-line, using the DeCyder image analysis software [GE Healthcare, Amersham, UK] allowed selection of significantly regulated proteins. Proteins displaying differential expression were excised robotically for manual digestion and identified by matrix-assisted laser desorption/ionisation - mass spectrometry (MALDI-MS). Additionally the same set of proteins displaying differential expression were automatically cut and digested using a prototype robotic platform. Automated MALDI-MS, peak label assignment and database searching were utilised to identify as many proteins as possible. The results achieved by the robotic system were compared to manual methods. The identification of all significantly altered proteins provides an annotated peroxide stress-related proteome that can be used as a base resource against which other stress-induced proteomic changes can be compared.

Stress-induced changes in the Schizosaccharomyces pombe proteome using two-dimensional difference gel electrophoresis, mass spectrometry and a novel integrated robotics platform

Robotic and manual methods have been used to obtain identification of significantly changing proteins regulated when Schizosaccharomyces pombe is exposed to oxidative stress. Differently treated S. pombe cells were lysed, labelled with CyDye (TM) and analysed by two-dimensional difference gel. electrophoresis. Gel images analysed off-line, using the DeCyder (TM) image analysis software [GE Healthcare, Amersham, UK] allowed selection of significantly regulated proteins. Proteins displaying differential expression were excised robotically for manual digestion and identified by matrix-assisted laser desorption/ionisation - mass spectrometry (MALDI-MS). Additionally the same set of proteins displaying differential expression were automatically cut and digested using a prototype robotic platform. Automated MALDI-MS, peak label assignment and database searching were utilised to identify as many proteins as possible. The results achieved by the robotic system were compared to manual methods. The identification of all significantly altered proteins provides an annotated peroxide stress-related proteome that can be used as a base resource against which other stress-induced proteomic changes can be compared.

Reaching for the skies: Time and turbulence in digital technologies and practices

This research examines dynamics associated with new representational technologies in complex organizations through a study of the use of a Single Model Environment, prototyping and simulation tools in the mega-project to construct Terminal 5 at Heathrow Airport, London. The ambition of the client, BAA. was to change industrial practices reducing project costs and time to delivery through new contractual arrangements and new digitally-enabled collaborative ways of working. The research highlights changes over time and addresses two areas of 'turbulence' in the use of: 1) technologies, where there is a dynamic tension between desires to constantly improve, change and update digital technologies and the need to standardise practices, maintaining and defending the overall integrity of the system; and 2) representations, where dynamics result from the responsibilities and liabilities associated with sharing of digital representations and a lack of trust in the validity of data from other firms. These dynamics are tracked across three stages of this well-managed and innovative project and indicate the generic need to treat digital infrastructure as an ongoing strategic issue.

MTR: the multi-tasking rover - a new concept in rover design

In this paper we present the novel concepts incorporated in a planetary surface exploration rover design that is currently under development. The Multitasking Rover (MTR) aims to demonstrate functionality that will cover many of the current and future needs such as rough-terrain mobility, modularity and upgradeability. The rover system has enhanced mobility characteristics. It operates in conjunction with Science Packs (SPs) and Tool Packs (TPs)-modules attached to the main frame of the rover, which are either special tools or science instruments and alter the operation capabilities of the system.

A comparison of the Oxford and Manus intelligent hand prostheses

Historically, commercial hand prosthesis have adopted a low level of innovation mainly due to the strict conditions such a system must undergo. The difficult feedback to the prosthesis user has limited the functional range of commercial systems. Nevertheless, the use of advanced sensors in combination with performing hand mechanisms and microcontrollers could lead to more natural and functional prototypes. The Oxford and Manus intelligent hand prostheses are examples of innovative approaches. This paper compares and contrasts the technological solutions implemented in both systems to address the design conditions.

Robot-human interaction - practical experiments with a cyborg

This paper presents results to indicate the potential applications of a direct connection between the human nervous system and a computer network. Actual experimental results obtained from a human subject study are given, with emphasis placed on the direct interaction between the human nervous system and possible extra-sensory input. An brief overview of the general state of neural implants is given, as well as a range of application areas considered. An overall view is also taken as to what may be possible with implant technology as a general purpose human-computer interface for the future.