Combining visual features and Growing Neural Gas networks for robotic 3D SLAM

The use of 3D data in mobile robotics provides valuable information about the robot’s environment. Traditionally, stereo cameras have been used as a low-cost 3D sensor. However, the lack of precision and texture for some surfaces suggests that the use of other 3D sensors could be more suitable. In this work, we examine the use of two sensors: an infrared SR4000 and a Kinect camera. We use a combination of 3D data obtained by these cameras, along with features obtained from 2D images acquired from these cameras, using a Growing Neural Gas (GNG) network applied to the 3D data. The goal is to obtain a robust egomotion technique. The GNG network is used to reduce the camera error. To calculate the egomotion, we test two methods for 3D registration. One is based on an iterative closest points algorithm, and the other employs random sample consensus. Finally, a simultaneous localization and mapping method is applied to the complete sequence to reduce the global error. The error from each sensor and the mapping results from the proposed method are examined.

Molecularly imprinted silica films prepared by electroassisted deposition for the selective detection of dopamine

Dopamine (DA) can be detected by electrochemical oxidation in conventional electrodes. However, the presence of other oxidizable species (interferents) usually present in physiological fluids at high concentrations (like ascorbic acid) makes very difficult its electrochemical detection. In the present work, glassy carbon electrodes have been modified with molecularly imprinted silica (MIS) films prepared by electroassisted deposition of sol–gel precursors. The production of MIS films was performed by adding the template molecule (DA) to the precursor sol. The molecular impression of silica was assessed showing a high coherency allowing a filtering capacity in the molecular scale. The MIS-modified electrodes present a high selectivity for the detection of DA in neutral or acidic solutions. The MIS-modified electrodes allow the amperometric determination of dopamine in solutions containing ascorbic acid with molar ratios lower than 1:50,000.

Real-time monitoring of electrochemically active biofilm developing behavior on bioanode by using EQCM and ATR/FTIR

In the current study, the relationship between current and biomass and bio-adhesion mechanism of electrogenic biofilm on electrode were investigated using EQCM and ATR-SEIRAS linking electrochemistry. The results indicated that cellular biomass of biofilm on QCM-crystal surface showed maximum value of 6.0 μg/cm2 in initial batch and 11.5 μg/cm2 in the second batch on mature biofilm, producing a similar maximum current density of 110 μA/μg. Especially, the optimum cell biomass linking high electricity production ratio (110 μA/μg) occurred before maximum biomass coming, implying that over-growth mature biofilm is not an optimum state for enhancing power output of MFCs. On the other hand, the spectra using ATR-SEIRAS technique linking electrochemistry obviously exhibited water structure adsorption change at early biofilm formation and meanwhile the water adsorption accompanied the adsorbed bacteria and the bound cells population on the electrode increased with time. Meanwhile, the direct contact of bacteria and electrode via outer-membrane protein can be confirmed via a series spectra shift at amide I and amide II modes and water movement from negative bands displacing by adsorbed bacteria. Our study provided supplementary information about the interaction between the microbes and electrode beyond traditional electrochemistry.

Parallel Computational Intelligence-Based Multi-Camera Surveillance System

In this work, we present a multi-camera surveillance system based on the use of self-organizing neural networks to represent events on video. The system processes several tasks in parallel using GPUs (graphic processor units). It addresses multiple vision tasks at various levels, such as segmentation, representation or characterization, analysis and monitoring of the movement. These features allow the construction of a robust representation of the environment and interpret the behavior of mobile agents in the scene. It is also necessary to integrate the vision module into a global system that operates in a complex environment by receiving images from multiple acquisition devices at video frequency. Offering relevant information to higher level systems, monitoring and making decisions in real time, it must accomplish a set of requirements, such as: time constraints, high availability, robustness, high processing speed and re-configurability. We have built a system able to represent and analyze the motion in video acquired by a multi-camera network and to process multi-source data in parallel on a multi-GPU architecture.

Calibración de cámaras de tiempo de vuelo: ajuste adaptativo del tiempo de integración y análisis de la frecuencia de modulación

La percepción de profundidad se hace imprescindible en muchas tareas de manipulación, control visual y navegación de robots. Las cámaras de tiempo de vuelo (ToF: Time of Flight) generan imágenes de rango que proporcionan medidas de profundidad en tiempo real. No obstante, el parámetro distancia que calculan estas cámaras es fuertemente dependiente del tiempo de integración que se configura en el sensor y de la frecuencia de modulación empleada por el sistema de iluminación que integran. En este artículo, se presenta una metodología para el ajuste adaptativo del tiempo de integración y un análisis experimental del comportamiento de una cámara ToF cuando se modifica la frecuencia de modulación. Este método ha sido probado con éxito en algoritmos de control visual con arquitectura ‘eye-in-hand’ donde el sistema sensorial está compuesto por una cámara ToF. Además, la misma metodología puede ser aplicada en otros escenarios de trabajo.

Towards a real-time 3D object recognition pipeline on mobile GPGPU computing platforms using low-cost RGB-D sensors

In this project, we propose the implementation of a 3D object recognition system which will be optimized to operate under demanding time constraints. The system must be robust so that objects can be recognized properly in poor light conditions and cluttered scenes with significant levels of occlusion. An important requirement must be met: the system must exhibit a reasonable performance running on a low power consumption mobile GPU computing platform (NVIDIA Jetson TK1) so that it can be integrated in mobile robotics systems, ambient intelligence or ambient assisted living applications. The acquisition system is based on the use of color and depth (RGB-D) data streams provided by low-cost 3D sensors like Microsoft Kinect or PrimeSense Carmine. The range of algorithms and applications to be implemented and integrated will be quite broad, ranging from the acquisition, outlier removal or filtering of the input data and the segmentation or characterization of regions of interest in the scene to the very object recognition and pose estimation. Furthermore, in order to validate the proposed system, we will create a 3D object dataset. It will be composed by a set of 3D models, reconstructed from common household objects, as well as a handful of test scenes in which those objects appear. The scenes will be characterized by different levels of occlusion, diverse distances from the elements to the sensor and variations on the pose of the target objects. The creation of this dataset implies the additional development of 3D data acquisition and 3D object reconstruction applications. The resulting system has many possible applications, ranging from mobile robot navigation and semantic scene labeling to human-computer interaction (HCI) systems based on visual information.

Organic distributed feedback laser to monitor solvent extraction upon thermal annealing in solution-processed polymer films

Solution-processed polymer films are used in multiple technological applications. The presence of residual solvent in the film, as a consequence of the preparation method, affects the material properties, so films are typically subjected to post-deposition thermal annealing treatments aiming at its elimination. Monitoring the amount of solvent eliminated as a function of the annealing parameters is important to design a proper treatment to ensure complete solvent elimination, crucial to obtain reproducible and stable material properties and therefore, device performance. Here we demonstrate, for the first time to our knowledge, the use of an organic distributed feedback (DFB) laser to monitor with high precision the amount of solvent extracted from a spin-coated polymer film as a function of the thermal annealing time. The polymer film of interest, polystyrene in the present work, is doped with a small amount of a laser dye as to constitute the active layer of the laser device and deposited over a reusable DFB resonator. It is shown that solvent elimination translates into shifts in the DFB laser wavelength, as a consequence of changes in film thickness and refractive index. The proposed method is expected to be applicable to other types of annealing treatments, polymer-solvent combinations or film deposition methods, thus constituting a valuable tool to accurately control the quality and reproducibility of solution-processed polymer thin films.