RetinaStudio: A bioinspired framework to encode visual information

The retina is a very complex neural structure, which performs spatial, temporal, and chromatic processing on visual information and converts it into a compact ‘digital’ format composed of neural impulses. This paper presents a new compiler-based framework able to describe, simulate and validate custom retina models. The framework is compatible with the most usual neural recording and analysis tools, taking advantage of the interoperability with these kinds of applications. Furthermore it is possible to compile the code to generate accelerated versions of the visual processing models compatible with COTS microprocessors, FPGAs or GPUs. The whole system represents an ongoing work to design and develop a functional visual neuroprosthesis. Several case studies are described to assess the effectiveness and usefulness of the framework.

Colour changes by laser irradiation of reddish building limestones

We have used X-ray photoelectron spectroscopy (XPS) as a novel method to investigate the causes of colour changes in a reddish limestone under irradiation by a Q-switched Nd:YAG 1064 nm laser. We irradiated clean dry and wet surfaces of Pidramuelle Roja, a building stone frequently used in the Asturian heritage, at fluences ranging from 0.12 to 1.47 J cm−2. We measured the colour coordinates and undertook XPS analysis of the state of oxidation of iron both before and after irradiation. Visible colour changes and potential aesthetic damage occurred on dry surfaces from a fluence of 0.31 J cm−2, with the stone showing a greening effect and very intense darkening. The colour change on dry surfaces was considerably higher than on wet surfaces, which at the highest fluence (1.47 J cm−2) was also above the human visual detection threshold. The use of XPS demonstrated that the change in colour (chroma and hue) is associated with a reduction in the iron oxidation state on dry surfaces during laser irradiation. This points out to a potential routinary use of XPS to analyse causes of colour changes during laser cleaning in other types of coloured building stones.

3D visual sensing of human hand for remote operation of a robotic hand

New low cost sensors and open free libraries for 3D image processing are making important advances in robot vision applications possible, such as three-dimensional object recognition, semantic mapping, navigation and localization of robots, human detection and/or gesture recognition for human-machine interaction. In this paper, a novel method for recognizing and tracking the fingers of a human hand is presented. This method is based on point clouds from range images captured by a RGBD sensor. It works in real time and it does not require visual marks, camera calibration or previous knowledge of the environment. Moreover, it works successfully even when multiple objects appear in the scene or when the ambient light is changed. Furthermore, this method was designed to develop a human interface to control domestic or industrial devices, remotely. In this paper, the method was tested by operating a robotic hand. Firstly, the human hand was recognized and the fingers were detected. Secondly, the movement of the fingers was analysed and mapped to be imitated by a robotic hand.

RGBD Human-Hand recognition for the Interaction with Robot-Hand

New low cost sensors and the new open free libraries for 3D image processing are permitting to achieve important advances for robot vision applications such as tridimensional object recognition, semantic mapping, navigation and localization of robots, human detection and/or gesture recognition for human-machine interaction. In this paper, a method to recognize the human hand and to track the fingers is proposed. This new method is based on point clouds from range images, RGBD. It does not require visual marks, camera calibration, environment knowledge and complex expensive acquisition systems. Furthermore, this method has been implemented to create a human interface in order to move a robot hand. The human hand is recognized and the movement of the fingers is analyzed. Afterwards, it is imitated from a Barret hand, using communication events programmed from ROS.