3D Visual Data-Driven Spatiotemporal Deformations for Non-Rigid Object Grasping Using Robot Hands

Sensing techniques are important for solving problems of uncertainty inherent to intelligent grasping tasks. The main goal here is to present a visual sensing system based on range imaging technology for robot manipulation of non-rigid objects. Our proposal provides a suitable visual perception system of complex grasping tasks to support a robot controller when other sensor systems, such as tactile and force, are not able to obtain useful data relevant to the grasping manipulation task. In particular, a new visual approach based on RGBD data was implemented to help a robot controller carry out intelligent manipulation tasks with flexible objects. The proposed method supervises the interaction between the grasped object and the robot hand in order to avoid poor contact between the fingertips and an object when there is neither force nor pressure data. This new approach is also used to measure changes to the shape of an object’s surfaces and so allows us to find deformations caused by inappropriate pressure being applied by the hand’s fingers. Test was carried out for grasping tasks involving several flexible household objects with a multi-fingered robot hand working in real time. Our approach generates pulses from the deformation detection method and sends an event message to the robot controller when surface deformation is detected. In comparison with other methods, the obtained results reveal that our visual pipeline does not use deformations models of objects and materials, as well as the approach works well both planar and 3D household objects in real time. In addition, our method does not depend on the pose of the robot hand because the location of the reference system is computed from a recognition process of a pattern located place at the robot forearm. The presented experiments demonstrate that the proposed method accomplishes a good monitoring of grasping task with several objects and different grasping configurations in indoor environments.

Evaluation of sampling method effects in 3D non-rigid registration

Since the beginning of 3D computer vision problems, the use of techniques to reduce the data to make it treatable preserving the important aspects of the scene has been necessary. Currently, with the new low-cost RGB-D sensors, which provide a stream of color and 3D data of approximately 30 frames per second, this is getting more relevance. Many applications make use of these sensors and need a preprocessing to downsample the data in order to either reduce the processing time or improve the data (e.g., reducing noise or enhancing the important features). In this paper, we present a comparison of different downsampling techniques which are based on different principles. Concretely, five different downsampling methods are included: a bilinear-based method, a normal-based, a color-based, a combination of the normal and color-based samplings, and a growing neural gas (GNG)-based approach. For the comparison, two different models have been used acquired with the Blensor software. Moreover, to evaluate the effect of the downsampling in a real application, a 3D non-rigid registration is performed with the data sampled. From the experimentation we can conclude that depending on the purpose of the application some kernels of the sampling methods can improve drastically the results. Bilinear- and GNG-based methods provide homogeneous point clouds, but color-based and normal-based provide datasets with higher density of points in areas with specific features. In the non-rigid application, if a color-based sampled point cloud is used, it is possible to properly register two datasets for cases where intensity data are relevant in the model and outperform the results if only a homogeneous sampling is used.

Uso de nubes de puntos 3D para identificación y caracterización de familias de discontinuidades planas en afloramientos rocosos y evaluación de la calidad geomecánica

En este trabajo se estudia el uso de las nubes de puntos en 3D, es decir, un conjunto de puntos en un sistema de referencia cartesiano en R3, para la identificación y caracterización de las discontinuidades que afloran en un macizo rocoso y su aplicación al campo de la Mecánica de Rocas. Las nubes de puntos utilizadas se han adquirido mediante tres técnicas: sintéticas, 3D laser scanner y la técnica de fotogrametría digital Structure From Motion (SfM). El enfoque está orientado a la extracción y caracterización de familias de discontinuidades y su aplicación a la evaluación de la calidad de un talud rocoso mediante la clasificación geomecánica Slope Mass Rating (SMR). El contenido de la misma está dividido en tres bloques, como son: (1) metodología de extracción de discontinuidades y clasificación de la nube de puntos 3D; (2) análisis de espaciados normales en nubes de puntos 3D; y (3) análisis de la evaluación de la calidad geomecánica de taludes rocoso mediante la clasificación geomecánica SMR a partir de nubes de puntos 3D. La primera línea de investigación consiste en el estudio de las nubes de puntos 3D con la finalidad de extraer y caracterizar las discontinuidades planas presentes en la superficie de un macizo rocoso. En primer lugar, se ha recopilado información de las metodologías existentes y la disponibilidad de programas para su estudio. Esto motivó la decisión de investigar y diseñar un proceso de clasificación novedoso, que muestre todos los pasos para su programación e incluso ofreciendo el código programado a la comunidad científica bajo licencia GNU GPL. De esta forma, se ha diseñado una novedosa metodología y se ha programado un software que analiza nubes de puntos 3D de forma semi-automática, permitiendo al usuario interactuar con el proceso de clasificación. Dicho software se llama Discontinuity Set Extractor (DSE). El método se ha validado empleando nubes de puntos sintéticas y adquiridas con 3D laser scanner. En primer lugar, este código analiza la nube de puntos efectuando un test de coplanaridad para cada punto y sus vecinos próximos para, a continuación, calcular el vector normal de la superficie en el punto estudiado. En segundo lugar, se representan los polos de los vectores normales calculados en el paso previo en una falsilla estereográfica. A continuación se calcula la densidad de los polos y los polos con mayor densidad o polos principales. Estos indican las orientaciones de la superficie más representadas, y por tanto las familias de discontinuidades. En tercer lugar, se asigna a cada punto una familia en dependencia del ángulo formado por el vector normal del punto y el de la familia. En este punto el usuario puede visualizar la nube de puntos clasificada con las familias de discontinuidades que ha determinado para validar el resultado intermedio. En cuarto lugar, se realiza un análisis cluster en el que se determina la agrupación de puntos según planos para cada familia (clusters). A continuación, se filtran aquellos que no tengan un número de puntos suficiente y se determina la ecuación de cada plano. Finalmente, se exportan los resultados de la clasificación a un archivo de texto para su análisis y representación en otros programas. La segunda línea de investigación consiste en el estudio del espaciado entre discontinuidades planas que afloran en macizos rocosos a partir de nubes de puntos 3D. Se desarrolló una metodología de cálculo de espaciados a partir de nubes de puntos 3D previamente clasificadas con el fin de determinar las relaciones espaciales entre planos de cada familia y calcular el espaciado normal. El fundamento novedoso del método propuesto es determinar el espaciado normal de familia basándonos en los mismos principios que en campo, pero sin la restricción de las limitaciones espaciales, condiciones de inseguridad y dificultades inherentes al proceso. Se consideraron dos aspectos de las discontinuidades: su persistencia finita o infinita, siendo la primera el aspecto más novedoso de esta publicación. El desarrollo y aplicación del método a varios casos de estudio permitió determinar su ámbito de aplicación. La validación se llevó a cabo con nubes de puntos sintéticas y adquiridas con 3D laser scanner. La tercera línea de investigación consiste en el análisis de la aplicación de la información obtenida con nubes de puntos 3D a la evaluación de la calidad de un talud rocoso mediante la clasificación geomecánica SMR. El análisis se centró en la influencia del uso de orientaciones determinadas con distintas fuentes de información (datos de campo y técnicas de adquisición remota) en la determinación de los factores de ajuste y al valor del índice SMR. Los resultados de este análisis muestran que el uso de fuentes de información y técnicas ampliamente aceptadas pueden ocasionar cambios en la evaluación de la calidad del talud rocoso de hasta una clase geomecánica (es decir, 20 unidades). Asimismo, los análisis realizados han permitido constatar la validez del índice SMR para cartografiar zonas inestables de un talud. Los métodos y programas informáticos desarrollados suponen un importante avance científico para el uso de nubes de puntos 3D para: (1) el estudio y caracterización de las discontinuidades de los macizos rocosos y (2) su aplicación a la evaluación de la calidad de taludes en roca mediante las clasificaciones geomecánicas. Asimismo, las conclusiones obtenidas y los medios y métodos empleados en esta tesis doctoral podrán ser contrastadas y utilizados por otros investigadores, al estar disponibles en la web del autor bajo licencia GNU GPL.

Methodology based on registration techniques for representing subjects and their deformations acquired from general purpose 3D sensors

In this thesis a methodology for representing 3D subjects and their deformations in adverse situations is studied. The study is focused in providing methods based on registration techniques to improve the data in situations where the sensor is working in the limit of its sensitivity. In order to do this, it is proposed two methods to overcome the problems which can difficult the process in these conditions. First a rigid registration based on model registration is presented, where the model of 3D planar markers is used. This model is estimated using a proposed method which improves its quality by taking into account prior knowledge of the marker. To study the deformations, it is proposed a framework to combine multiple spaces in a non-rigid registration technique. This proposal improves the quality of the alignment with a more robust matching process that makes use of all available input data. Moreover, this framework allows the registration of multiple spaces simultaneously providing a more general technique. Concretely, it is instantiated using colour and location in the matching process for 3D location registration.

Theoretical insights on electron donor-acceptor interactions involving carbon dioxide

Electron donor-acceptor (EDA) interactions are widely involved in chemistry and their understanding is essential to design new technological applications in a variety of fields ranging from material sciences and chemical engineering to medicine. In this work, we study EDA complexes of carbon dioxide with ketones using several ab initio and Density Functional Theory methods. Energy contributions to the interaction energy have been analyzed in detail using both variational and perturbational treatments. Dispersion energy has been shown to play a key role in explaining the high stability of a non-conventional structure, which can roughly be described by a cooperative EDA interaction.

Non-spectral interferences due to the presence of sulfuric acid in inductively coupled plasma mass spectrometry

Results of a systematic study concerning non-spectral interferences from sulfuric acid containing matrices on a large number of elements in inductively coupled plasma–mass spectrometry (ICP-MS) are presented in this work. The signals obtained with sulfuric acid solutions of different concentrations (up to 5% w w− 1) have been compared with the corresponding signals for a 1% w w− 1− nitric acid solution at different experimental conditions (i.e., sample uptake rates, nebulizer gas flows and r.f. powers). The signals observed for 128Te+, 78Se+ and 75As+ were significantly higher when using sulfuric acid matrices (up to 2.2-fold for 128Te+ and 78Se+ and 1.8-fold for 75As+ in the presence of 5 w w-1 sulfuric acid) for the whole range of experimental conditions tested. This is in agreement with previously reported observations. The signal for 31P+ is also higher (1.1-fold) in the presence of sulfuric acid. The signal enhancements for 128Te+, 78Se+, 75As+ and 31P+ are explained in relation to an increase in the analyte ion population as a result of charge transfer reactions involving S+ species in the plasma. Theoretical data suggest that Os, Sb, Pt, Ir, Zn and Hg could also be involved in sulfur-based charge transfer reactions, but no experimental evidence has been found. The presence of sulfuric acid gives rise to lower ion signals (about 10–20% lower) for the other nuclides tested, thus indicating the negative matrix effect caused by changes in the amount of analyte loading of the plasma. The elemental composition of a certified low-density polyethylene sample (ERM-EC681K) was determined by ICP-MS after two different sample digestion procedures, one of them including sulfuric acid. Element concentrations were in agreement with the certified values, irrespective of the acids used for the digestion. These results demonstrate that the use of matrix-matched standards allows the accurate determination of the tested elements in a sulfuric acid matrix.

Model Probability in Self-organising Maps

Growing models have been widely used for clustering or topology learning. Traditionally these models work on stationary environments, grow incrementally and adapt their nodes to a given distribution based on global parameters. In this paper, we present an enhanced unsupervised self-organising network for the modelling of visual objects. We first develop a framework for building non-rigid shapes using the growth mechanism of the self-organising maps, and then we define an optimal number of nodes without overfitting or underfitting the network based on the knowledge obtained from information-theoretic considerations. We present experimental results for hands and we quantitatively evaluate the matching capabilities of the proposed method with the topographic product.

Detección automática con snakes y representación 3D sobre imágenes cerebrales

Comunicación presentada en la VI Conferencia de la Asociación Española para la Inteligencia Artificial (CAEPIA'95), Alicante, 15-17 noviembre 1995.

Injury incidence in judokas at the Spanish National University Championship

Background and Study Aim: Understanding injury incidence rates will be a great help with regards to preventing potential future damages. It is for this reason that this study suggests studying a large number of variables. The purpose of research is the relationship of events (empirical variables) that are usually taken into account in developing injury prevention programs during the battles and training in judo tournament. Material and methods: In this research project, 57 male judokas taking part in the Spanish National University Championship in 2009 were asked to complete a retrospective questionnaire. We analysed the following events: the most commonly injured body regions, the medical diagnosis, how and when the injury happened, the type of injury, the side of the body and the type of medical attention received. For the statistical analysis, we used the SPSS statistics programme to apply the Chi-square test in order to determine the significance levels for non-parametric tests from p<.05. Results: Significant differences were found in the most commonly injured body region, the shoulder/clavicle (p<.05), and in the most common diagnosis, the sprain (p<.05). Impact injuries (p<.05) are the most common and training (p<.05) is the most dangerous time. About the type of injury, 78.38% are new injuries (p<.05) and 69.05% affect the right hand side of the body (p<.05). Doctors are the most consulted specialists, but the physiotherapists obtained the best marks. Have been out due to injury for over 21 days 36.36% of the participants, but not for the entire season. Conclusions: The most common diagnosis in university student judokas coincides with those of elite judokas, with the sprain being the most common. University student judokas have a higher rate of shoulder/clavicle injuries, while professional judokas are prone to a higher rate of knee injuries. Training is the most common moment in which injuries occur, both in university student judokas and professional judokas. New injuries are the most common types of injuries in university student judokas and, while doctors are the most consulted specialists, the physiotherapists obtained the best marks.

Primary school teacher’s noticing of students’ mathematical thinking in problem solving

Professional noticing of students’ mathematical thinking in problem solving involves the identification of noteworthy mathematical ideas of students’ mathematical thinking and its interpretation to make decisions in the teaching of mathematics. The goal of this study is to begin to characterize pre-service primary school teachers’ noticing of students’ mathematical thinking when students solve tasks that involve proportional and non-proportional reasoning. From the analysis of how pre-service primary school teachers notice students’ mathematical thinking, we have identified an initial framework with four levels of development. This framework indicates a possible trajectory in the development of primary teachers’ professional noticing.

Vertical crustal motion along the Mediterranean and Black Sea coast derived from ocean altimetry and tide gauge data

Tide gauge (TG) data along the northern Mediterranean and Black Sea coasts are compared to the sea-surface height (SSH) anomaly obtained from ocean altimetry (TOPEX/Poseidon and ERS-1/2) for a period of nine years (1993–2001). The TG measures the SSH relative to the ground whereas the altimetry does so with respect to the geocentric reference frame; therefore their difference would be in principle a vertical ground motion of the TG sites, though there are different error sources for this estimate as is discussed in the paper. In this study we estimate such vertical ground motion, for each TG site, from the slope of the SSH time series of the (non-seasonal) difference between the TG record and the altimetry measurement at a point closest to the TG. Where possible, these estimates are further compared with those derived from nearby continuous Global Positioning System (GPS) data series. These results on vertical ground motion along the Mediterranean and Black Sea coasts provide useful source data for studying, contrasting, and constraining tectonic models of the region. For example, in the eastern coast of the Adriatic Sea and in the western coast of Greece, a general subsidence is observed which may be related to the Adriatic lithosphere subducting beneath the Eurasian plate along the Dinarides fault.

Dynamic investigation of an ancient masonry bell tower with operational modal analysis: a non-destructive experimental technique to obtain the dynamic characteristics of a structure

This paper shows the results of an experimental analysis on the bell tower of “Chiesa della Maddalena” (Mola di Bari, Italy), to better understand the structural behavior of slender masonry structures. The research aims to calibrate a numerical model by means of the Operational Modal Analysis (OMA) method. In this way realistic conclusions about the dynamic behavior of the structure are obtained. The choice of using an OMA derives from the necessity to know the modal parameters of a structure with a non-destructive testing, especially in case of cultural-historical value structures. Therefore by means of an easy and accurate process, it is possible to acquire in-situ environmental vibrations. The data collected are very important to estimate the mode shapes, the natural frequencies and the damping ratios of the structure. To analyze the data obtained from the monitoring, the Peak Picking method has been applied to the Fast Fourier Transforms (FFT) of the signals in order to identify the values of the effective natural frequencies and damping factors of the structure. The main frequencies and the damping ratios have been determined from measurements at some relevant locations. The responses have been then extrapolated and extended to the entire tower through a 3-D Finite Element Model. In this way, knowing the modes of vibration, it has been possible to understand the overall dynamic behavior of the structure.