Towards Direct Policy Search Reinforcement Learning for Robot Control

This paper proposes a high-level reinforcement learning (RL) control system for solving the action selection problem of an autonomous robot. Although the dominant approach, when using RL, has been to apply value function based algorithms, the system here detailed is characterized by the use of direct policy search methods. Rather than approximating a value function, these methodologies approximate a policy using an independent function approximator with its own parameters, trying to maximize the future expected reward. The policy based algorithm presented in this paper is used for learning the internal state/action mapping of a behavior. In this preliminary work, we demonstrate its feasibility with simulated experiments using the underwater robot GARBI in a target reaching task

Positioning an underwater vehicle through image mosaicking

Mosaics have been commonly used as visual maps for undersea exploration and navigation. The position and orientation of an underwater vehicle can be calculated by integrating the apparent motion of the images which form the mosaic. A feature-based mosaicking method is proposed in this paper. The creation of the mosaic is accomplished in four stages: feature selection and matching, detection of points describing the dominant motion, homography computation and mosaic construction. In this work we demonstrate that the use of color and textures as discriminative properties of the image can improve, to a large extent, the accuracy of the constructed mosaic. The system is able to provide 3D metric information concerning the vehicle motion using the knowledge of the intrinsic parameters of the camera while integrating the measurements of an ultrasonic sensor. The experimental results of real images have been tested on the GARBI underwater vehicle

Detection of matchings in a sequence of underwater images through texture analysis

This paper presents an approach to ameliorate the reliability of the correspondence points relating two consecutive images of a sequence. The images are especially difficult to handle, since they have been acquired by a camera looking at the sea floor while carried by an underwater robot. Underwater images are usually difficult to process due to light absorption, changing image radiance and lack of well-defined features. A new approach based on gray-level region matching and selective texture analysis significantly improves the matching reliability

Proposal of a parallel architecture for a motion detection algorithm

This paper proposes a parallel architecture for estimation of the motion of an underwater robot. It is well known that image processing requires a huge amount of computation, mainly at low-level processing where the algorithms are dealing with a great number of data. In a motion estimation algorithm, correspondences between two images have to be solved at the low level. In the underwater imaging, normalised correlation can be a solution in the presence of non-uniform illumination. Due to its regular processing scheme, parallel implementation of the correspondence problem can be an adequate approach to reduce the computation time. Taking into consideration the complexity of the normalised correlation criteria, a new approach using parallel organisation of every processor from the architecture is proposed

Model-based objects recognition in man-made environments

We describe a model-based objects recognition system which is part of an image interpretation system intended to assist autonomous vehicles navigation. The system is intended to operate in man-made environments. Behavior-based navigation of autonomous vehicles involves the recognition of navigable areas and the potential obstacles. The recognition system integrates color, shape and texture information together with the location of the vanishing point. The recognition process starts from some prior scene knowledge, that is, a generic model of the expected scene and the potential objects. The recognition system constitutes an approach where different low-level vision techniques extract a multitude of image descriptors which are then analyzed using a rule-based reasoning system to interpret the image content. This system has been implemented using CEES, the C++ embedded expert system shell developed in the Systems Engineering and Automatic Control Laboratory (University of Girona) as a specific rule-based problem solving tool. It has been especially conceived for supporting cooperative expert systems, and uses the object oriented programming paradigm

Behaviours implemented using a vision system based on coded light projection

In a search for new sensor systems and new methods for underwater vehicle positioning based on visual observation, this paper presents a computer vision system based on coded light projection. 3D information is taken from an underwater scene. This information is used to test obstacle avoidance behaviour. In addition, the main ideas for achieving stabilisation of the vehicle in front of an object are presented

An overview of the advantages and constraints of coded pattern projection techniques for autonomous navigation

The absolute necessity of obtaining 3D information of structured and unknown environments in autonomous navigation reduce considerably the set of sensors that can be used. The necessity to know, at each time, the position of the mobile robot with respect to the scene is indispensable. Furthermore, this information must be obtained in the least computing time. Stereo vision is an attractive and widely used method, but, it is rather limited to make fast 3D surface maps, due to the correspondence problem. The spatial and temporal correspondence among images can be alleviated using a method based on structured light. This relationship can be directly found codifying the projected light; then each imaged region of the projected pattern carries the needed information to solve the correspondence problem. We present the most significant techniques, used in recent years, concerning the coded structured light method

Manteniment de vehicles autopropulsats : fam??lia professional. Garantia social : iniciaci?? professional. Cicles formatius grau mitj??. Cicles formatius grau superior

Material cofinanciado por el Fondo Social Europeo. Este material forma parte de una carpeta titulada Formaci??n profesional: oferta educativa, compuesta por un conjunto de folletos y un cd-rom

El currículum i la premsa escrita : dos vehicles de comunicació per a l'aprenentatge. ' El currículum y la prensa escrita: dos vehículos de comunicación para el aprendizaje'.

Mostrar que la incorporación de aprendizajes que tengan que ver con el conocimiento y uso de la prensa diaria en los currículums de enseñanza formal no universitaria, optimiza diferentes elementos del sistema educativo y da respuesta a objetivos básicos de la educación del alumno.. La prensa como facilitadora de la comprensión y la comunicación entre profesor-alumno, y en el ámbito general del currículum escolar.. Realiza un análisis teórico sobre el tema del currículum y la prensa. Presenta el modelo teórico con la descripción de cada fase que se desarrolla. Lleva a cabo un vaciado de información en revistas infantiles y juveniles catalanas y de diarios. Propone la adaptación del modelo a otras realidades culturales. Comenta las conclusiones y marca las pautas para continuar este trabajo del modelo propuesto.El resultado positivo y la experiencia durante ocho años del proyecto 'L'Avui Eina Didàctica a l'Escola' lleva a cabo antes de la investigación, es la base del desarrollo de esta investigación.. Revistas y diarios.. La prensa debe ser un elemento de refuerzo para conseguir éxito en los en los estudios y formación del alumnado. Es un elemento optimizador y retroalimentador dels diseño, la planificación y la implementación de objetivos y contenidos del currículum. También es un soporte en la adquisición de competencias intelectuales y afectivas..

Manteniment de vehicles autopropulsats. 'Mantenimiento de vehículos autopropulsados'.

Materiales curriculares sobre vehículos autopropulsados para profesorado de FP. Se desarrollan los capítulos siguientes: 1. Carrocería, 2. Electromecánica de vehículos y 3. Automoción. Para cada contenido se ofrece un volumen con el currículum especificado y otro volumen con orientaciones para su desarrollo. En total consta de 6 volúmenes reunidos en una misma carpeta.

Prediction of human adaptation and performance in underwater environments

Resumen tomado de la publicaci??n

Social Networking Sites as Technology Enhanced Learning Communities towards autonomous language learning

The following contribution pretends to cope with the demands of a globalised, post-modern environment through the design and implementation of an online international project where an SNS is used in order to join English as Second Language (ESL) students from different parts of the world. The design of the project appears around the implementation of the Bologna process in the Faculty of Education from the University of Girona where the basic prerequisite of all students to acquire English at the level B1 of the Common European Portfolio makes English a compulsory competence for communication among its higher education candidates in order to develop in the world. Together with the University of Girona, there is the International Educational and Resources Network (iEARN) which promotes the participation of schools around the world in online international projects

Didactics–promoting collaborative work and personal learning environment. Critical, creative and autonomous roles in a competitive society

School has evolved from a place where knowledge is provided to a place where learners are helped to develop their professional and social skills. Consequently, education must evolve through big challenges in order to face the changes of society in the XXIst century

A Multi-agent Architecture with Distributed Coordination for an Autonomous Robot

Aquest treball proposa una nova arquitectura de control amb coordinació distribuïda per a un robot mòbil (ARMADiCo). La metodologia de coordinació distribuïda consisteix en dos passos: el primer determina quin és l'agent que guanya el recurs basat en el càlcul privat de la utilitat i el segon, com es fa el canvi del recurs per evitar comportaments abruptes del robot. Aquesta arquitectura ha estat concebuda per facilitar la introducció de nous components hardware i software, definint un patró de disseny d'agents que captura les característiques comunes dels agents. Aquest patró ha portat al desenvolupament d'una arquitectura modular dins l'agent que permet la separació dels diferents mètodes utilitzats per aconseguir els objectius, la col·laboració, la competició i la coordinació de recursos. ARMADiCo s'ha provat en un robot Pioneer 2DX de MobileRobots Inc.. S'han fet diversos experiments i els resultats han demostrat que s'han aconseguit les característiques proposades per l'arquitectura.

Servei de retirada de vehicles de la via pública del terme municipal de València basat en localització GPS i comunicacions GPRS

L’objectiu d’aquest projecte és dotar a Servicleop d’un programari que li permeti millorar la gestió dels serveis de retirada de vehicles de la via pública, que actualment s’efectua a través del canal de veu. Això s’aconseguirà mitjançant l’ús de cartografia digital i localització GPS, que permetrà optimitzar l’assignació de retirades al saber quina grua es troba en millor disposició, i PDAs que es comunicaran amb un centre de control a través de GPRS des del qual s’assignaran aquest serveis. S’oferiran facilitats sempre que sigui possible en la introducció de dades, disminuint les probabilitats de cometre errors, i tot el procés quedarà enregistrat automàticament en base de dades per a poder generar estadístiques o informes. el projecte parteix d’un altre projecte intern de Knosos anomenat Micronav.Net Serveis, en el qual també he treballat molt activament i que ofereix una solució genèrica similar a la requerida per Servicleop, empresa a la que va destinada el sistema que es presenta en aquest projecte final de carrera