Pose estimation of a humanoid robot using images from a mobile external camera

NOGUEIRA, Marcelo B. ; MEDEIROS, Adelardo A. D. ; ALSINA, Pablo J. Pose Estimation of a Humanoid Robot Using Images from an Mobile Extern Camera. In: IFAC WORKSHOP ON MULTIVEHICLE SYSTEMS, 2006, Salvador, BA. Anais... Salvador: MVS 2006, 2006.

Real-Time Visual SLAM Using Pre - Existing Floor Lines as Landmarks and a Single Camera

SANTANA, André M.; SANTIAGO, Gutemberg S.; MEDEIROS, Adelardo A. D. Real-Time Visual SLAM Using Pre-Existing Floor Lines as Landmarks and a Single Camera. In: CONGRESSO BRASILEIRO DE AUTOMÁTICA, 2008, Juiz de Fora, MG. Anais... Juiz de Fora: CBA, 2008.

Pose estimation of a humanoid robot using images from a mobile external camera

NOGUEIRA, Marcelo B. ; MEDEIROS, Adelardo A. D. ; ALSINA, Pablo J. Pose Estimation of a Humanoid Robot Using Images from an Mobile Extern Camera. In: IFAC WORKSHOP ON MULTIVEHICLE SYSTEMS, 2006, Salvador, BA. Anais... Salvador: MVS 2006, 2006.

Real-Time Visual SLAM Using Pre - Existing Floor Lines as Landmarks and a Single Camera

SANTANA, André M.; SANTIAGO, Gutemberg S.; MEDEIROS, Adelardo A. D. Real-Time Visual SLAM Using Pre-Existing Floor Lines as Landmarks and a Single Camera. In: CONGRESSO BRASILEIRO DE AUTOMÁTICA, 2008, Juiz de Fora, MG. Anais... Juiz de Fora: CBA, 2008.

Demanda química de oxigênio, clorofila a e comunidade fitoplanctônica como indicadores da qualidade da água no Canal do Pataxó/RN

The current study examined spatial-temporal modifications and water quality through chemical and biotic indicators during both dry (January, February and November 2006) and wet seasons (March to June 2006). This study was carried out in Armando Ribeiro Gonçalves Reservoir, RN, Canal do Pataxó and after the water station treatment (WST). The physical-chemical parameters were measured in situ and inorganic nutrients, chlorophyll a and Free Oxygen Demand (FOD) were analyzed in laboratory conditions. Quali quantitative analyses of phytoplankton were carried out utilizing Sedgwick-Rafter camera. Results indicate that DQO concentrations were low. FOD concentrations in the reservoir were comparatively higher in the dry season (5.21 mgL-1; 5.64 mgL-1 e 6.05 mgL-1) in relation to the wet season (4.52 mgL-1; 4.12 mgL-1 e 4.92 mgL-1), in surface, intermediate and bottom waters, respectively. FOD values were inferior to 1.0mgL-1in both Canal do Pataxó and after WST, which is considered adequate for public use reservoirs. Although FOD concentrations were low, Armando Ribeiro Gonçalves Reservoir, Canal do Pataxó and WST were classified as euthophizied, mesotrophic ad oligotrophic, respectively, considering the Index of Trophic State Criteria. Chlorophyll a concentrations in the study reservoir were higher in the surface (199.2 µgL-1) during the wet season, whereas in Canal do Pataxó concentrations decreased from 1.56 µgL-1 to 0.028 µgL-1, and after WST values were low (0.059 µgL-1). Dominance of cianobacterias, such as Planktotrhix agardhii (dry season) and Microcystis sp (wet season) was registered in all three areas. In the reservoir and Canal do Pataxó, density of cianobacterias, such as P. agardhii and Microcistys sp., was superior to the values allowed by the Health ministry (HM). However, after WST, density values of cianobacteria were inferior to values established by the HM

Estudo da adesão de pinos endodônticos modificados superficialmente por plasma de oxigênio

The work presents the effect of plasma treatment when applied in fibers or carbon/glass posts in the adhesion fiber/resin and posts/cement. This has for objective the modification of the surface of the fibers, as well as the wettability of the posts, seeking the improvement of the adhesion and of the connection fiber/resin in the processing of polymeric composites reinforced with the same ones. 120 posts (Reforpost) were used and 30 meters of fibers of carbon and of glass (Fibrex), of the company Angelus. The samples were divided in three groups of 40 specimens: GROUP I - 20 posts of glass fiber and 20 of carbon without treatment to it shapes, GROUP II -20 posts of glass fiber and 20 of carbon treated to it shapes in the surface and GROUP III - 20 posts of glass fiber and 20 of carbon make with fibers in natura after plasma treatment. The plasma treatment was accomplished with oxygen and with temperature in the camera fixed at 200°C, for one hour of exhibition. The posts and the fibers were characterized before and after the treatment. The wettability was measure by pendent drop method, and interface fiber/resin and posts/cement were observed by optical and electronic microscopy. It was observed that both wettability and texture were increased with plasma treatment

Construção, caracterização e aplicação de eletrodos para descarga por arco de cátodo oco

The system built to characterize electrodes and, consequently, deposited fine films are constituted by a hollow cathode that works to discharges and low pressures (approximately 10-3 to 5 mbar), a source DC (0 to 1200 V), a cylindrical camera of closed borossilicato for flanges of stainless steel with an association of vacuum bombs mechanical and spread. In the upper flange it is connected the system of hollow cathode, which possesses an entrance of gas and two entrances for its refrigeration, the same is electrically isolated of the rest of the equipment and it is polarized negatively. In front of the system of hollow cathode there is a movable sample in stainless steel with possibility of moving in the horizontal and vertical. In the vertical, the sample can vary its distance between 0 and 70 mm and, in the horizontal, can leave completely from the front of the hollow cathode. The sample and also the cathode hollow are equipped with cromel-alumel termopares with simultaneous reading of the temperatures during the time of treatment. In this work copper electrodes, bronze, titanium, iron, stainless steel, powder of titanium, powder of titanium and silício, glass and ceramic were used. The electrodes were investigated relating their geometry change and behavior of the plasma of the cavity of hollow cathode and channel of the gas. As the cavity of hollow cathode, the analyzed aspects were the diameter and depth. With the channel of the gas, we verified the diameter. In the two situations, we investigated parameters as flow of the gas, pressure, current and applied tension in the electrode, temperature, loss of mass of the electrode with relationship at the time of use. The flow of gas investigated in the electrodes it was fastened in a work strip from 15 to 6 sccm, the constant pressure of work was among 2.7 to 8 x 10-2 mbar. The applied current was among a strip of work from 0,8 to 0,4 A, and their respective tensions were in a strip from 400 to 220 V. Fixing the value of the current, it was possible to lift the curve of the behavior of the tension with the time of use. That curves esteem in that time of use of the electrode to its efficiency is maximum. The temperatures of the electrodes were in the dependence of that curves showing a maximum temperature when the tension was maximum, yet the measured temperatures in the samples showed to be sensitive the variation of the temperature in the electrodes. An accompaniment of the loss of mass of the electrode relating to its time of use showed that the electrodes that appeared the spherical cavities lost more mass in comparison with the electrodes in that didn't appear. That phenomenon is only seen for pressures of 10-2 mbar, in these conditions a plasma column is formed inside of the channel of the gas and in certain points it is concentrated in form of spheres. Those spherical cavities develop inside of the channel of the gas spreading during the whole extension of the channel of the gas. The used electrodes were cut after they could not be more used, however among those electrodes, films that were deposited in alternate times and the electrodes that were used to deposit films in same times, those films were deposited in the glass substrata, alumina, stainless steel 420, stainless steel 316, silício and steel M2. As the eletros used to deposit films in alternate time as the ones that they were used to deposit in same times, the behavior of the thickness of the film obeyed the curve of the tension with relationship the time of use of the electrode, that is, when the tension was maximum, the thickness of the film was also maximum and when the tension was minimum, the thickness was minimum and in the case where the value of the tension was constant, the thickness of the film tends to be constant. The fine films that were produced they had applications with nano stick, bio-compatibility, cellular growth, inhibition of bacterias, cut tool, metallic leagues, brasagem, pineapple fiber and ornamental. In those films it was investigated the thickness, the adherence and the uniformity characterized by sweeping electronic microscopy. Another technique developed to assist the production and characterization of the films produced in that work was the caloteste. It uses a sphere and abrasive to mark the sample with a cap impression, with that cap form it is possible to calculate the thickness of the film. Through the time of life of the cathode, it was possible to evaluate the rate of waste of its material for the different work conditions. Values of waste rate up to 3,2 x 10-6 g/s were verified. For a distance of the substratum of 11 mm, the deposited film was limited to a circular area of 22 mm diameter mm for high pressures and a circular area of 75 mm for pressure strip. The obtained films presented thickness around 2,1 µm, showing that the discharge of arch of hollow cathode in argon obeys a curve characteristic of the tension with the time of life of the eletrodo. The deposition rate obtained in this system it is of approximately 0,18 µm/min

Navegação cooperativa de um robô humanóide e um robô com rodas usando informação visual

This work presents a cooperative navigation systemof a humanoid robot and a wheeled robot using visual information, aiming to navigate the non-instrumented humanoid robot using information obtained from the instrumented wheeled robot. Despite the humanoid not having sensors to its navigation, it can be remotely controlled by infra-red signals. Thus, the wheeled robot can control the humanoid positioning itself behind him and, through visual information, find it and navigate it. The location of the wheeled robot is obtained merging information from odometers and from landmarks detection, using the Extended Kalman Filter. The marks are visually detected, and their features are extracted by image processing. Parameters obtained by image processing are directly used in the Extended Kalman Filter. Thus, while the wheeled robot locates and navigates the humanoid, it also simultaneously calculates its own location and maps the environment (SLAM). The navigation is done through heuristic algorithms based on errors between the actual and desired pose for each robot. The main contribution of this work was the implementation of a cooperative navigation system for two robots based on visual information, which can be extended to other robotic applications, as the ability to control robots without interfering on its hardware, or attaching communication devices

Um método para determinação da profundidade combinando visão estéreo e autocalibração para aplicação em robótica móvel

This work proposes a method to determine the depth of objects in a scene using a combination between stereo vision and self-calibration techniques. Determining the rel- ative distance between visualized objects and a robot, with a stereo head, it is possible to navigate in unknown environments. Stereo vision techniques supply a depth measure by the combination of two or more images from the same scene. To achieve a depth estimates of the in scene objects a reconstruction of this scene geometry is necessary. For such reconstruction the relationship between the three-dimensional world coordi- nates and the two-dimensional images coordinates is necessary. Through the achievement of the cameras intrinsic parameters it is possible to make this coordinates systems relationship. These parameters can be gotten through geometric camera calibration, which, generally is made by a correlation between image characteristics of a calibration pattern with know dimensions. The cameras self-calibration allows the achievement of their intrinsic parameters without using a known calibration pattern, being possible their calculation and alteration during the displacement of the robot in an unknown environment. In this work a self-calibration method based in the three-dimensional polar coordinates to represent image features is presented. This representation is determined by the relationship between images features and horizontal and vertical opening cameras angles. Using the polar coordinates it is possible to geometrically reconstruct the scene. Through the proposed techniques combination it is possible to calculate a scene objects depth estimate, allowing the robot navigation in an unknown environment

Sistema de supervisão aérea baseado em navegação visual para detecção de anomalias em instalações de petróleo e gás

This work deals with the development of a prototype of a helicopter quadrotor for monitoring applications in oil facilities. Anomaly detection problems can be resolved through monitoringmissions performed by a suitably instrumented quadrotor, i.e. infrared thermosensors should be embedded. The proposed monitoring system aims to reduce accidents as well as to make possible the use of non-destructive techniques for detection and location of leaks caused by corrosion. To this end, the implementation of a prototype, its stabilization and a navigation strategy have been proposed. The control strategy is based on dividing the problem into two control hierarchical levels: the lower level stabilizes the angles and the altitude of the vehicle at the desired values, while the higher one provide appropriate references signals to the lower level in order the quadrotor performs the desired movements. The navigation strategy for helicopter quadrotor is made using information provided by a acquisition image system (monocular camera) embedded onto the helicopter. Considering that the low-level control has been solved, the proposed vision-based navigation technique treats the problem as high level control strategies, such as, relative position control, trajectory generation and trajectory tracking. For the position control we use a control technique for visual servoing based on image features. The trajectory generation is done in a offline step, which is a visual trajectory composed of a sequence of images. For the trajectory tracking problem is proposed a control strategy by continuous servovision, thus enabling a navigation strategy without metric maps. Simulation and experimental results are presented to validate the proposal

Localização de robôs móveis autônomos utilizando fusão sensorial de odometria e visão monocular

The development and refinement of techniques that make simultaneous localization and mapping (SLAM) for an autonomous mobile robot and the building of local 3-D maps from a sequence of images, is widely studied in scientific circles. This work presents a monocular visual SLAM technique based on extended Kalman filter, which uses features found in a sequence of images using the SURF descriptor (Speeded Up Robust Features) and determines which features can be used as marks by a technique based on delayed initialization from 3-D straight lines. For this, only the coordinates of the features found in the image and the intrinsic and extrinsic camera parameters are avaliable. Its possible to determine the position of the marks only on the availability of information of depth. Tests have shown that during the route, the mobile robot detects the presence of characteristics in the images and through a proposed technique for delayed initialization of marks, adds new marks to the state vector of the extended Kalman filter (EKF), after estimating the depth of features. With the estimated position of the marks, it was possible to estimate the updated position of the robot at each step, obtaining good results that demonstrate the effectiveness of monocular visual SLAM system proposed in this paper

Posicionamento e movimentação de um robô humanóide utilizando imagens de uma câmera móvel externa

This work proposes a method to localize a simple humanoid robot, without embedded sensors, using images taken from an extern camera and image processing techniques. Once the robot is localized relative to the camera, supposing we know the position of the camera relative to the world, we can compute the position of the robot relative to the world. To make the camera move in the work space, we will use another mobile robot with wheels, which has a precise locating system, and will place the camera on it. Once the humanoid is localized in the work space, we can take the necessary actions to move it. Simultaneously, we will move the camera robot, so it will take good images of the humanoid. The mainly contributions of this work are: the idea of using another mobile robot to aid the navigation of a humanoid robot without and advanced embedded electronics; chosing of the intrinsic and extrinsic calibration methods appropriated to the task, especially in the real time part; and the collaborative algorithm of simultaneous navigation of the robots

Odometria visual baseada em técnicas de structure from motion

Visual Odometry is the process that estimates camera position and orientation based solely on images and in features (projections of visual landmarks present in the scene) extraced from them. With the increasing advance of Computer Vision algorithms and computer processing power, the subarea known as Structure from Motion (SFM) started to supply mathematical tools composing localization systems for robotics and Augmented Reality applications, in contrast with its initial purpose of being used in inherently offline solutions aiming 3D reconstruction and image based modelling. In that way, this work proposes a pipeline to obtain relative position featuring a previously calibrated camera as positional sensor and based entirely on models and algorithms from SFM. Techniques usually applied in camera localization systems such as Kalman filters and particle filters are not used, making unnecessary additional information like probabilistic models for camera state transition. Experiments assessing both 3D reconstruction quality and camera position estimated by the system were performed, in which image sequences captured in reallistic scenarios were processed and compared to localization data gathered from a mobile robotic platform

Técnicas visuais de localização e mapeamento simultâneos sem extração de primitivas geométricas da imagem

In Simultaneous Localization and Mapping (SLAM - Simultaneous Localization and Mapping), a robot placed in an unknown location in any environment must be able to create a perspective of this environment (a map) and is situated in the same simultaneously, using only information captured by the robot s sensors and control signals known. Recently, driven by the advance of computing power, work in this area have proposed to use video camera as a sensor and it came so Visual SLAM. This has several approaches and the vast majority of them work basically extracting features of the environment, calculating the necessary correspondence and through these estimate the required parameters. This work presented a monocular visual SLAM system that uses direct image registration to calculate the image reprojection error and optimization methods that minimize this error and thus obtain the parameters for the robot pose and map of the environment directly from the pixels of the images. Thus the steps of extracting and matching features are not needed, enabling our system works well in environments where traditional approaches have difficulty. Moreover, when addressing the problem of SLAM as proposed in this work we avoid a very common problem in traditional approaches, known as error propagation. Worrying about the high computational cost of this approach have been tested several types of optimization methods in order to find a good balance between good estimates and processing time. The results presented in this work show the success of this system in different environments

Desenvolvimento de esquema de controle com realimentação visual para um robô manipulador

This work proposes a kinematic control scheme, using visual feedback for a robot arm with five degrees of freedom. Using computational vision techniques, a method was developed to determine the cartesian 3d position and orientation of the robot arm (pose) using a robot image obtained through a camera. A colored triangular label is disposed on the robot manipulator tool and efficient heuristic rules are used to obtain the vertexes of that label in the image. The tool pose is obtained from those vertexes through numerical methods. A color calibration scheme based in the K-means algorithm was implemented to guarantee the robustness of the vision system in the presence of light variations. The extrinsic camera parameters are computed from the image of four coplanar points whose cartesian 3d coordinates, related to a fixed frame, are known. Two distinct poses of the tool, initial and final, obtained from image, are interpolated to generate a desired trajectory in cartesian space. The error signal in the proposed control scheme consists in the difference between the desired tool pose and the actual tool pose. Gains are applied at the error signal and the signal resulting is mapped in joint incrementals using the pseudoinverse of the manipulator jacobian matrix. These incrementals are applied to the manipulator joints moving the tool to the desired pose