From First Contact to Close Encounters: A Developmentally Deep Perceptual System for a Humanoid Robot

This thesis presents a perceptual system for a humanoid robot that integrates abilities such as object localization and recognition with the deeper developmental machinery required to forge those competences out of raw physical experiences. It shows that a robotic platform can build up and maintain a system for object localization, segmentation, and recognition, starting from very little. What the robot starts with is a direct solution to achieving figure/ground separation: it simply 'pokes around' in a region of visual ambiguity and watches what happens. If the arm passes through an area, that area is recognized as free space. If the arm collides with an object, causing it to move, the robot can use that motion to segment the object from the background. Once the robot can acquire reliable segmented views of objects, it learns from them, and from then on recognizes and segments those objects without further contact. Both low-level and high-level visual features can also be learned in this way, and examples are presented for both: orientation detection and affordance recognition, respectively. The motivation for this work is simple. Training on large corpora of annotated real-world data has proven crucial for creating robust solutions to perceptual problems such as speech recognition and face detection. But the powerful tools used during training of such systems are typically stripped away at deployment. Ideally they should remain, particularly for unstable tasks such as object detection, where the set of objects needed in a task tomorrow might be different from the set of objects needed today. The key limiting factor is access to training data, but as this thesis shows, that need not be a problem on a robotic platform that can actively probe its environment, and carry out experiments to resolve ambiguity. This work is an instance of a general approach to learning a new perceptual judgment: find special situations in which the perceptual judgment is easy and study these situations to find correlated features that can be observed more generally.

Safe Distributed Coordination of Heterogeneous Robots through Dynamic Simple Temporal Networks

Research on autonomous intelligent systems has focused on how robots can robustly carry out missions in uncertain and harsh environments with very little or no human intervention. Robotic execution languages such as RAPs, ESL, and TDL improve robustness by managing functionally redundant procedures for achieving goals. The model-based programming approach extends this by guaranteeing correctness of execution through pre-planning of non-deterministic timed threads of activities. Executing model-based programs effectively on distributed autonomous platforms requires distributing this pre-planning process. This thesis presents a distributed planner for modelbased programs whose planning and execution is distributed among agents with widely varying levels of processor power and memory resources. We make two key contributions. First, we reformulate a model-based program, which describes cooperative activities, into a hierarchical dynamic simple temporal network. This enables efficient distributed coordination of robots and supports deployment on heterogeneous robots. Second, we introduce a distributed temporal planner, called DTP, which solves hierarchical dynamic simple temporal networks with the assistance of the distributed Bellman-Ford shortest path algorithm. The implementation of DTP has been demonstrated successfully on a wide range of randomly generated examples and on a pursuer-evader challenge problem in simulation.

Trajectory and Force Control of a Direct Drive Arm

Using the MIT Serial Link Direct Drive Arm as the main experimental device, various issues in trajectory and force control of manipulators were studied in this thesis. Since accurate modeling is important for any controller, issues of estimating the dynamic model of a manipulator and its load were addressed first. Practical and effective algorithms were developed fro the Newton-Euler equations to estimate the inertial parameters of manipulator rigid-body loads and links. Load estimation was implemented both on PUMA 600 robot and on the MIT Serial Link Direct Drive Arm. With the link estimation algorithm, the inertial parameters of the direct drive arm were obtained. For both load and link estimation results, the estimated parameters are good models of the actual system for control purposes since torques and forces can be predicted accurately from these estimated parameters. The estimated model of the direct drive arm was them used to evaluate trajectory following performance by feedforward and computed torque control algorithms. The experimental evaluations showed that the dynamic compensation can greatly improve trajectory following accuracy. Various stability issues of force control were studied next. It was determined that there are two types of instability in force control. Dynamic instability, present in all of the previous force control algorithms discussed in this thesis, is caused by the interaction of a manipulator with a stiff environment. Kinematics instability is present only in the hybrid control algorithm of Raibert and Craig, and is caused by the interaction of the inertia matrix with the Jacobian inverse coordinate transformation in the feedback path. Several methods were suggested and demonstrated experimentally to solve these stability problems. The result of the stability analyses were then incorporated in implementing a stable force/position controller on the direct drive arm by the modified resolved acceleration method using both joint torque and wrist force sensor feedbacks.

Design and Development of 3-DOF Modular Micro Parallel Kinematic Manipulator

This paper presents the research and development of a 3-legged micro Parallel Kinematic Manipulator (PKM) for positioning in micro-machining and assembly operations. The structural characteristics associated with parallel manipulators are evaluated and the PKMs with translational and rotational movements are identified. Based on these identifications, a hybrid 3-UPU (Universal Joint-Prismatic Joint-Universal Joint) parallel manipulator is designed and fabricated. The principles of the operation and modeling of this micro PKM is largely similar to a normal size Stewart Platform (SP). A modular design methodology is introduced for the construction of this micro PKM. Calibration results of this hybrid 3-UPU PKM are discussed in this paper.

Semi-online neural-Q_leaming for real-time robot learning

Reinforcement learning (RL) is a very suitable technique for robot learning, as it can learn in unknown environments and in real-time computation. The main difficulties in adapting classic RL algorithms to robotic systems are the generalization problem and the correct observation of the Markovian state. This paper attempts to solve the generalization problem by proposing the semi-online neural-Q_learning algorithm (SONQL). The algorithm uses the classic Q_learning technique with two modifications. First, a neural network (NN) approximates the Q_function allowing the use of continuous states and actions. Second, a database of the most representative learning samples accelerates and stabilizes the convergence. The term semi-online is referred to the fact that the algorithm uses the current but also past learning samples. However, the algorithm is able to learn in real-time while the robot is interacting with the environment. The paper shows simulated results with the "mountain-car" benchmark and, also, real results with an underwater robot in a target following behavior

PRIM an Open Mobile Robot Platform. Motivation, Present and Future Trends

This paper is focused on the robot mobile platform PRIM (platform robot information multimedia). This robot has been made in order to cover two main needs of our group, on one hand the need for a full open mobile robotic platform that is very useful in fulfilling the teaching and research activity of our school community, and on the other hand with the idea of introducing an ethical product which would be useful as mobile multimedia information point as a service tool. This paper introduces exactly how the system is made up and explains just what the philosophy is behind this work. The navigation strategies and sensor fusion, where machine vision system is the most important one, are oriented towards goal achievement and are the key to the behaviour of the robot

Plane-to-plane positioning from image-based visual servoing and structured light

In this paper we face the problem of positioning a camera attached to the end-effector of a robotic manipulator so that it gets parallel to a planar object. Such problem has been treated for a long time in visual servoing. Our approach is based on linking to the camera several laser pointers so that its configuration is aimed to produce a suitable set of visual features. The aim of using structured light is not only for easing the image processing and to allow low-textured objects to be treated, but also for producing a control scheme with nice properties like decoupling, stability, well conditioning and good camera trajectory

Studies about the atomic capabilities concept for linear control systems in physical multi-agent environments

This paper shows the impact of the atomic capabilities concept to include control-oriented knowledge of linear control systems in the decisions making structure of physical agents. These agents operate in a real environment managing physical objects (e.g. their physical bodies) in coordinated tasks. This approach is presented using an introspective reasoning approach and control theory based on the specific tasks of passing a ball and executing the offside manoeuvre between physical agents in the robotic soccer testbed. Experimental results and conclusions are presented, emphasising the advantages of our approach that improve the multi-agent performance in cooperative systems

Ejercicio y resultados clínicos en pacientes con enfermedad de Parkinson: una revisión sistemática y metaanálisis

Antecedentes. La enfermedad de Parkinson (EP) es la segunda enfermedad neurodegenerativa más común en el mundo, la cual afecta el componente físico, psicológico y social de los individuos que la padecen. Numerosos estudios han abordado los beneficios de diferentes programas de ejercicio, llegando a ser una estrategia no-farmacológica efectiva para aminorar el deterioro funcional de los pacientes con EP. Objetivo. Determinar los efectos de las diferentes modalidades de ejercicio físico en los principales desenlaces clínicos en pacientes con EP. Métodos. Se consultaron las bases de datos MEDLINE, EMBASE, Scopus, CENTRAL y PEDro desde febrero de 1990 hasta febrero de 2014 para identificar Ensayos Clínicos Aleatorizados (ECA) publicados. Además, se examinaron las listas de referencias de otras revisiones y de estudios identificados. La extracción de datos se realizó por dos autores independientes. Se empleó un modelo de efectos aleatorios en presencia de heterogeneidad estadística (I2>50%). El sesgo de publicación fue evaluado mediante el gráfico de embudo. Resultados: Un total de 18 estudios fueron incluidos. Se encontraron diferencias estadísticamente significativas en las intervenciones con ejercicio y las siguientes medidas de resultado, severidad de los síntomas motores (MDS-UPDRS) DME 1.44, IC 95% [-2.09 a -0.78] (p<0.001) I2= 87,9% y el equilibrio DME 0,52 IC 95% [0,30 a 0,74] (p<0.001) I2= 85,6%. En el análisis de subgrupos en la modalidad de ejercicio aeróbico, en MDS-UPDRS DME -1,28, IC 95% [-1,98 a -0,59] (p<0.001), 3 calidad de vida DME -1,91 IC 95% [-2,76 a -1,07] (p<0.001), equilibrio DME 0,54 IC 95% [0,31 a 0,77] (p<0.001), 10-m WT DME 0,15 IC 95% [0,06 a 0,25] (p<0.001) y Vo2 máximo DME -1,09 IC 95% [-1,31 a -0,88] (p=0.001), 6MWT DME 40,46 IC 95% [11,28 a 69,65] (p=0.007). Conclusiones: El ejercicio aeróbico produjo mejoras significativas en MDS UPDRS, equilibrio, calidad de vida, 10-m WT y y Vo2 máximo; mientras que el ejercicio combinado mejoró la fuerza.

Resultados de la cirugía laparoscópica comparada con la cirugía abierta en el cáncer colorrectal. Revisión sistemática

Determinar el efecto de la cirugía laparoscópica versus cirugía abierta sobre la supervivencia en el manejo de pacientes del cáncer colorectal.

Gradient-based reinforcement learning techniques for underwater robotics behavior learning

Darrerament, l'interès pel desenvolupament d'aplicacions amb robots submarins autònoms (AUV) ha crescut de forma considerable. Els AUVs són atractius gràcies al seu tamany i el fet que no necessiten un operador humà per pilotar-los. Tot i això, és impossible comparar, en termes d'eficiència i flexibilitat, l'habilitat d'un pilot humà amb les escasses capacitats operatives que ofereixen els AUVs actuals. L'utilització de AUVs per cobrir grans àrees implica resoldre problemes complexos, especialment si es desitja que el nostre robot reaccioni en temps real a canvis sobtats en les condicions de treball. Per aquestes raons, el desenvolupament de sistemes de control autònom amb l'objectiu de millorar aquestes capacitats ha esdevingut una prioritat. Aquesta tesi tracta sobre el problema de la presa de decisions utilizant AUVs. El treball presentat es centra en l'estudi, disseny i aplicació de comportaments per a AUVs utilitzant tècniques d'aprenentatge per reforç (RL). La contribució principal d'aquesta tesi consisteix en l'aplicació de diverses tècniques de RL per tal de millorar l'autonomia dels robots submarins, amb l'objectiu final de demostrar la viabilitat d'aquests algoritmes per aprendre tasques submarines autònomes en temps real. En RL, el robot intenta maximitzar un reforç escalar obtingut com a conseqüència de la seva interacció amb l'entorn. L'objectiu és trobar una política òptima que relaciona tots els estats possibles amb les accions a executar per a cada estat que maximitzen la suma de reforços totals. Així, aquesta tesi investiga principalment dues tipologies d'algoritmes basats en RL: mètodes basats en funcions de valor (VF) i mètodes basats en el gradient (PG). Els resultats experimentals finals mostren el robot submarí Ictineu en una tasca autònoma real de seguiment de cables submarins. Per portar-la a terme, s'ha dissenyat un algoritme anomenat mètode d'Actor i Crític (AC), fruit de la fusió de mètodes VF amb tècniques de PG.

A Newton method for pose refinement of 3D models

Different optimization methods can be employed to optimize a numerical estimate for the match between an instantiated object model and an image. In order to take advantage of gradient-based optimization methods, perspective inversion must be used in this context. We show that convergence can be very fast by extrapolating to maximum goodness-of-fit with Newton's method. This approach is related to methods which either maximize a similar goodness-of-fit measure without use of gradient information, or else minimize distances between projected model lines and image features. Newton's method combines the accuracy of the former approach with the speed of convergence of the latter.

Stress-induced changes in the Schizosaccharomyces pombe proteome using two-dimensional difference gel electrophoresis, mass spectrometry and a novel integrated robotics platform

Robotic and manual methods have been used to obtain identification of significantly changing proteins regulated when Schizosaccharomyces pombe is exposed to oxidative stress. Differently treated S. pombe cells were lysed, labelled with CyDye and analysed by two-dimensional difference gel electrophoresis. Gel images analysed off-line, using the DeCyder image analysis software [GE Healthcare, Amersham, UK] allowed selection of significantly regulated proteins. Proteins displaying differential expression were excised robotically for manual digestion and identified by matrix-assisted laser desorption/ionisation - mass spectrometry (MALDI-MS). Additionally the same set of proteins displaying differential expression were automatically cut and digested using a prototype robotic platform. Automated MALDI-MS, peak label assignment and database searching were utilised to identify as many proteins as possible. The results achieved by the robotic system were compared to manual methods. The identification of all significantly altered proteins provides an annotated peroxide stress-related proteome that can be used as a base resource against which other stress-induced proteomic changes can be compared.

Stress-induced changes in the Schizosaccharomyces pombe proteome using two-dimensional difference gel electrophoresis, mass spectrometry and a novel integrated robotics platform

Robotic and manual methods have been used to obtain identification of significantly changing proteins regulated when Schizosaccharomyces pombe is exposed to oxidative stress. Differently treated S. pombe cells were lysed, labelled with CyDye (TM) and analysed by two-dimensional difference gel. electrophoresis. Gel images analysed off-line, using the DeCyder (TM) image analysis software [GE Healthcare, Amersham, UK] allowed selection of significantly regulated proteins. Proteins displaying differential expression were excised robotically for manual digestion and identified by matrix-assisted laser desorption/ionisation - mass spectrometry (MALDI-MS). Additionally the same set of proteins displaying differential expression were automatically cut and digested using a prototype robotic platform. Automated MALDI-MS, peak label assignment and database searching were utilised to identify as many proteins as possible. The results achieved by the robotic system were compared to manual methods. The identification of all significantly altered proteins provides an annotated peroxide stress-related proteome that can be used as a base resource against which other stress-induced proteomic changes can be compared.

Cooperative transport of extended payloads

In this paper we present experimental results for the dual robot transport of an extended payload. Two robotic rovers that were designed specifically for the extended payload transport task are described. Each rover incorporates a 4-DOF robot arm incorporating three active joints (one of which is a gripper), a passive wrist, and a mobile base which employs a rocker-bogie design. A set of behaviours has been developed to support the performance of the task, integrating simple sensing with controls. We describe the behaviours and their integration within the overall task structure. The experimental results presented focus on the manipulation elements of the task, but incorporate a complete cycle of pick-up, traversal, and putdown.