Eldi: an agent based museum robot

[EN]In this paper we will present Eldi, a mobile robot that has been in daily operation at the Elder Museum of Science and Technology at Las Palmas de Gran Canaria since December 1999. This is an ongoing project that was organized in three di erent stages, describing here the one that has been accomplished. The initial phase, termed \The Player", the second stage, actually under development, has been called "The Cicerone" and in a nal phase, termed \The Vagabond", Eldi will be allowed to move erratically across the Museum. This paper will focus on the accomplished rst stage to succinctly describe the physical robot and the environment and demos developed. Finally we will summarize some important lessons learnt.

Experiences with a museum robot

In this paper we will present Eldi, a mobile robot that has been in daily operation at the Elder Museum of S ien e and Te hnology at Las Palmas de Gran Canaria sin e last De ember. This is an ongoing pro je t that was organized in three di erent stages of whi h only the rst one has been a omplished. The initial phase, termed \The Player", the se ond stage, a tually under development, has been alled "The Ci erone" and in a nal phase, termed \The Vagabond", Eldi will be allowed to move errati ally a ross the Museum...

A comparison of sound localisation techniques using cross-correlation and spiking neural networks for mobile robotics

This paper outlines the development of a crosscorrelation algorithm and a spiking neural network (SNN) for sound localisation based on real sound recorded in a noisy and dynamic environment by a mobile robot. The SNN architecture aims to simulate the sound localisation ability of the mammalian auditory pathways by exploiting the binaural cue of interaural time difference (ITD). The medial superior olive was the inspiration for the SNN architecture which required the integration of an encoding layer which produced biologically realistic spike trains, a model of the bushy cells found in the cochlear nucleus and a supervised learning algorithm. The experimental results demonstrate that biologically inspired sound localisation achieved using a SNN can compare favourably to the more classical technique of cross-correlation.

Teleoperación de un robot móvil mediante dispositivos Android

Resumen: En el siguiente trabajo se aborda un problema para solventar la comunicación con los robots del departamento MAPIR de la Universidad de Málaga, anteriormente sólo podían ser teleoperados mediante comandos escritos en Skype, así que se procede a diseñar un cliente móvil para Android que nos permite conectarse en tiempo real a un robot, obtener la imagen de lo que su cámara capta y además permitir su teleoperación. Por su parte, el robot corre un servidor que administra esos datos al cliente para trabajar conjuntamente. Dicho trabajo se desarrolla haciendo uso de nuevas tecnologias y protocolos como es WebRTC (de Google) para el intercambio de imágenes y del lado del servidor, se ha usado NodeJS.

An idiotypic immune network as a short-term learning architecture for mobile robots

A combined Short-Term Learning (STL) and Long-Term Learning (LTL) approach to solving mobile robot navigation problems is presented and tested in both real and simulated environments. The LTL consists of rapid simulations that use a Genetic Algorithm to derive diverse sets of behaviours. These sets are then transferred to an idiotypic Artificial Immune System (AIS), which forms the STL phase, and the system is said to be seeded. The combined LTL-STL approach is compared with using STL only, and with using a handdesigned controller. In addition, the STL phase is tested when the idiotypic mechanism is turned off. The results provide substantial evidence that the best option is the seeded idiotypic system, i.e. the architecture that merges LTL with an idiotypic AIS for the STL. They also show that structurally different environments can be used for the two phases without compromising transferability.

ViDRILO: The Visual and Depth Robot Indoor Localization with Objects information dataset

In this article we describe a semantic localization dataset for indoor environments named ViDRILO. The dataset provides five sequences of frames acquired with a mobile robot in two similar office buildings under different lighting conditions. Each frame consists of a point cloud representation of the scene and a perspective image. The frames in the dataset are annotated with the semantic category of the scene, but also with the presence or absence of a list of predefined objects appearing in the scene. In addition to the frames and annotations, the dataset is distributed with a set of tools for its use in both place classification and object recognition tasks. The large number of labeled frames in conjunction with the annotation scheme make this dataset different from existing ones. The ViDRILO dataset is released for use as a benchmark for different problems such as multimodal place classification and object recognition, 3D reconstruction or point cloud data compression.

Uma contribuição ao estudo de sinais de EEG para avaliar estados emocionais e mentais de crianças com autismo na interação com robô móvel

O Transtorno do Espectro do Autismo (TEA) caracteriza-se por uma série de distúrbios cognitivos e neurocomportamentais e sua prevalência mundial é estimada em 1 criança com TEA a cada 160 crianças com típico desenvolvimento (TD). Indivíduos com TEA apresentam dificuldade em interpretar as emoções alheias e em expressar sentimentos. As emoções podem ser associadas à manifestação de sinais fisiológicos, e, dentre eles, os sinais cerebrais têm sido muito abordados. A detecção dos sinais cerebrais de crianças com TEA pode ser benéfica para o esclarecimento de suas emoções e expressões. Atualmente, muitas pesquisas integram a robótica ao tratamento pedagógico do TEA, através da interação com crianças com esse transtorno, estimulando habilidades sociais, como a imitação e a comunicação. A avaliação dos estados mentais de crianças com TEA durante a sua interação com um robô móvel é promissora e assume um aspecto inovador. Assim, os objetivos deste trabalho foram captar sinais cerebrais de crianças com TEA e de crianças com TD, como grupo controle, para o estudo de seus estados emocionais e para avaliar seus estados mentais durante a interação com um robô móvel, e avaliar também a interação dessas crianças com o robô, através de escalas quantitativas. A técnica de registro dos sinais cerebrais escolhida foi a eletroencefalografia (EEG), a qual utiliza eletrodos colocados de forma não invasiva e não dolorosa sobre o couro cabeludo da criança. Os métodos para avaliar a eficiência do uso da robótica nessa interação foram baseados em duas escalas internacionais quantitativas: Escala de Alcance de Metas (do inglês Goal Attainment Scaling - GAS) e Escala de Usabilidade de Sistemas (do inglês System Usability Scale - SUS). Os resultados obtidos mostraram que, pela técnica de EEG, foi possível classificar os estados emocionais de crianças com TD e com TEA e analisar a atividade cerebral durante o início da interação com o robô, através dos ritmos alfa e beta. Com as avaliações GAS e SUS, verificou-se que o robô móvel pode ser considerado uma potencial ferramenta terapêutica para crianças com TEA.

Navegação de um robô autónomo semi-industrial usando diferentes técnicas sensoriais

Mestrado em Engenharia Electrotécnica e de Computadores

Algoritmo neurogenético com vistas para o planejamento de rotas de robôs móveis autônomos

Pós-graduação em Ciência da Computação - IBILCE

Planeamento de rota em ambiente desconhecido

Dissertação para a obtenção do grau de Mestre em Engenharia Electrotécnica Ramo de Automação e Electrónica Industrial

Auxiliary mechanisms for telerobotics

Dissertação apresentada na Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa para obtenção do grau de Mestre em Engenharia Electrotécnica e de Computadores

Enhanced PCA-based localization using depth maps with missing data

In this paper a new method for self-localization of mobile robots, based on a PCA positioning sensor to operate in unstructured environments, is proposed and experimentally validated. The proposed PCA extension is able to perform the eigenvectors computation from a set of signals corrupted by missing data. The sensor package considered in this work contains a 2D depth sensor pointed upwards to the ceiling, providing depth images with missing data. The positioning sensor obtained is then integrated in a Linear Parameter Varying mobile robot model to obtain a self-localization system, based on linear Kalman filters, with globally stable position error estimates. A study consisting in adding synthetic random corrupted data to the captured depth images revealed that this extended PCA technique is able to reconstruct the signals, with improved accuracy. The self-localization system obtained is assessed in unstructured environments and the methodologies are validated even in the case of varying illumination conditions.

Combining sparse and dense methods in 6D Visual Odometry

13th International Conference on Autonomous Robot Systems (Robotica), 2013, Lisboa

Perspectives and approaches for the internet of things

Dissertação para obtenção do Grau de Mestre em Engenharia Electrotécnica e de Computadores

Object recognition for autonomous objects: comparison of two approaches

Report for the scientific sojourn at the Swiss Federal Institute of Technology Zurich, Switzerland, between September and December 2007. In order to make robots useful assistants for our everyday life, the ability to learn and recognize objects is of essential importance. However, object recognition in real scenes is one of the most challenging problems in computer vision, as it is necessary to deal with difficulties. Furthermore, in mobile robotics a new challenge is added to the list: computational complexity. In a dynamic world, information about the objects in the scene can become obsolete before it is ready to be used if the detection algorithm is not fast enough. Two recent object recognition techniques have achieved notable results: the constellation approach proposed by Lowe and the bag of words approach proposed by Nistér and Stewénius. The Lowe constellation approach is the one currently being used in the robot localization project of the COGNIRON project. This report is divided in two main sections. The first section is devoted to briefly review the currently used object recognition system, the Lowe approach, and bring to light the drawbacks found for object recognition in the context of indoor mobile robot navigation. Additionally the proposed improvements for the algorithm are described. In the second section the alternative bag of words method is reviewed, as well as several experiments conducted to evaluate its performance with our own object databases. Furthermore, some modifications to the original algorithm to make it suitable for object detection in unsegmented images are proposed.