Geometric 3D point cloud compression

The use of 3D data in mobile robotics applications provides valuable information about the robot’s environment but usually the huge amount of 3D information is unmanageable by the robot storage and computing capabilities. A data compression is necessary to store and manage this information but preserving as much information as possible. In this paper, we propose a 3D lossy compression system based on plane extraction which represent the points of each scene plane as a Delaunay triangulation and a set of points/area information. The compression system can be customized to achieve different data compression or accuracy ratios. It also supports a color segmentation stage to preserve original scene color information and provides a realistic scene reconstruction. The design of the method provides a fast scene reconstruction useful for further visualization or processing tasks.

Discontinuity spacing analysis in rock masses using 3D point clouds

The complete characterization of rock masses implies the acquisition of information of both, the materials which compose the rock mass and the discontinuities which divide the outcrop. Recent advances in the use of remote sensing techniques – such as Light Detection and Ranging (LiDAR) – allow the accurate and dense acquisition of 3D information that can be used for the characterization of discontinuities. This work presents a novel methodology which allows the calculation of the normal spacing of persistent and non-persistent discontinuity sets using 3D point cloud datasets considering the three dimensional relationships between clusters. This approach requires that the 3D dataset has been previously classified. This implies that discontinuity sets are previously extracted, every single point is labeled with its corresponding discontinuity set and every exposed planar surface is analytically calculated. Then, for each discontinuity set the method calculates the normal spacing between an exposed plane and its nearest one considering 3D space relationship. This link between planes is obtained calculating for every point its nearest point member of the same discontinuity set, which provides its nearest plane. This allows calculating the normal spacing for every plane. Finally, the normal spacing is calculated as the mean value of all the normal spacings for each discontinuity set. The methodology is validated through three cases of study using synthetic data and 3D laser scanning datasets. The first case illustrates the fundamentals and the performance of the proposed methodology. The second and the third cases of study correspond to two rock slopes for which datasets were acquired using a 3D laser scanner. The second case study has shown that results obtained from the traditional and the proposed approaches are reasonably similar. Nevertheless, a discrepancy between both approaches has been found when the exposed planes members of a discontinuity set were hard to identify and when the planes pairing was difficult to establish during the fieldwork campaign. The third case study also has evidenced that when the number of identified exposed planes is high, the calculated normal spacing using the proposed approach is minor than those using the traditional approach.

3DCOMET: 3D compression methods test dataset

The use of 3D data in mobile robotics applications provides valuable information about the robot’s environment. However usually the huge amount of 3D information is difficult to manage due to the fact that the robot storage system and computing capabilities are insufficient. Therefore, a data compression method is necessary to store and process this information while preserving as much information as possible. A few methods have been proposed to compress 3D information. Nevertheless, there does not exist a consistent public benchmark for comparing the results (compression level, distance reconstructed error, etc.) obtained with different methods. In this paper, we propose a dataset composed of a set of 3D point clouds with different structure and texture variability to evaluate the results obtained from 3D data compression methods. We also provide useful tools for comparing compression methods, using as a baseline the results obtained by existing relevant compression methods.

Contributions to 3D Data Registration and Representation

Nowadays, new computers generation provides a high performance that enables to build computationally expensive computer vision applications applied to mobile robotics. Building a map of the environment is a common task of a robot and is an essential part to allow the robots to move through these environments. Traditionally, mobile robots used a combination of several sensors from different technologies. Lasers, sonars and contact sensors have been typically used in any mobile robotic architecture, however color cameras are an important sensor due to we want the robots to use the same information that humans to sense and move through the different environments. Color cameras are cheap and flexible but a lot of work need to be done to give robots enough visual understanding of the scenes. Computer vision algorithms are computational complex problems but nowadays robots have access to different and powerful architectures that can be used for mobile robotics purposes. The advent of low-cost RGB-D sensors like Microsoft Kinect which provide 3D colored point clouds at high frame rates made the computer vision even more relevant in the mobile robotics field. The combination of visual and 3D data allows the systems to use both computer vision and 3D processing and therefore to be aware of more details of the surrounding environment. The research described in this thesis was motivated by the need of scene mapping. Being aware of the surrounding environment is a key feature in many mobile robotics applications from simple robotic navigation to complex surveillance applications. In addition, the acquisition of a 3D model of the scenes is useful in many areas as video games scene modeling where well-known places are reconstructed and added to game systems or advertising where once you get the 3D model of one room the system can add furniture pieces using augmented reality techniques. In this thesis we perform an experimental study of the state-of-the-art registration methods to find which one fits better to our scene mapping purposes. Different methods are tested and analyzed on different scene distributions of visual and geometry appearance. In addition, this thesis proposes two methods for 3d data compression and representation of 3D maps. Our 3D representation proposal is based on the use of Growing Neural Gas (GNG) method. This Self-Organizing Maps (SOMs) has been successfully used for clustering, pattern recognition and topology representation of various kind of data. Until now, Self-Organizing Maps have been primarily computed offline and their application in 3D data has mainly focused on free noise models without considering time constraints. Self-organising neural models have the ability to provide a good representation of the input space. In particular, the Growing Neural Gas (GNG) is a suitable model because of its flexibility, rapid adaptation and excellent quality of representation. However, this type of learning is time consuming, specially for high-dimensional input data. Since real applications often work under time constraints, it is necessary to adapt the learning process in order to complete it in a predefined time. This thesis proposes a hardware implementation leveraging the computing power of modern GPUs which takes advantage of a new paradigm coined as General-Purpose Computing on Graphics Processing Units (GPGPU). Our proposed geometrical 3D compression method seeks to reduce the 3D information using plane detection as basic structure to compress the data. This is due to our target environments are man-made and therefore there are a lot of points that belong to a plane surface. Our proposed method is able to get good compression results in those man-made scenarios. The detected and compressed planes can be also used in other applications as surface reconstruction or plane-based registration algorithms. Finally, we have also demonstrated the goodness of the GPU technologies getting a high performance implementation of a CAD/CAM common technique called Virtual Digitizing.

Digital image processing techniques for pavement macro-texture analysis

Road surface macro-texture is an indicator used to determine the skid resistance levels in pavements. Existing methods of quantifying macro-texture include the sand patch test and the laser profilometer. These methods utilise the 3D information of the pavement surface to extract the average texture depth. Recently, interest in image processing techniques as a quantifier of macro-texture has arisen, mainly using the Fast Fourier Transform (FFT). This paper reviews the FFT method, and then proposes two new methods, one using the autocorrelation function and the other using wavelets. The methods are tested on pictures obtained from a pavement surface extending more than 2km's. About 200 images were acquired from the surface at approx. 10m intervals from a height 80cm above ground. The results obtained from image analysis methods using the FFT, the autocorrelation function and wavelets are compared with sensor measured texture depth (SMTD) data obtained from the same paved surface. The results indicate that coefficients of determination (R2) exceeding 0.8 are obtained when up to 10% of outliers are removed.

Supine to standing Cobb Angle change in idiopathic scoliosis: The effect of endplate preselection

Introduction Standing radiographs are the ‘gold standard’ for clinical assessment of adolescent idiopathic scoliosis (AIS), with the Cobb Angle used to measure the severity and progression of the scoliotic curve. Supine imaging modalities can provide valuable 3D information on scoliotic anatomy, however, due to changes in gravitational loading direction, the geometry of the spine alters between the supine and standing position which in turn affects the Cobb Angle measurement. Previous studies have consistently reported a 7-10° [1-3] Cobb Angle increase from supine to standing, however, none have reported the effect of endplate pre-selection and which (if any) curve parameters affect the supine to standing Cobb Angle difference. Methods Female AIS patients with right-sided thoracic major curves were included in the retrospective study. Clinically measured Cobb Angles from existing standing coronal radiographs and fulcrum bending radiographs [4] were compared to existing low-dose supine CT scans taken within 3 months of the reference radiograph. Reformatted coronal CT images were used to measure Cobb Angle variability with and without endplate pre-selection (end-plates selected on the radiographs used on the CT images). Inter and intra-observer measurement variability was assessed. Multi-linear regression was used to investigate whether there was a relationship between supine to standing Cobb Angle change and patient characteristics (SPSS, v.21, IBM, USA). Results Fifty-two patients were included, with mean age of 14.6 (SD 1.8) years; all curves were Lenke Type 1 with mean Cobb Angle on supine CT of 42° (SD 6.4°) and 52° (SD 6.7°) on standing radiographs. The mean fulcrum bending Cobb Angle for the group was 22.6° (SD 7.5°). The 10° increase from supine to standing is consistent with existing literature. Pre-selecting vertebral endplates was found to increase the Cobb Angle difference by a mean 2° (range 0-9°). Multi-linear regression revealed a statistically significant relationship between supine to standing Cobb Angle change with: fulcrum flexibility (p=0.001), age (p=0.027) and standing Cobb Angle (p<0.001). In patients with high fulcrum flexibility scores, the supine to standing Cobb Angle change was as great as 20°.The 95% confidence intervals for intra-observer and inter-observer measurement variability were 3.1° and 3.6°, respectively. Conclusion There is a statistically significant relationship between supine to standing Cobb Angle change and fulcrum flexibility. Therefore, this difference can be considered a measure of spinal flexibility. Pre-selecting vertebral endplates causes only minor changes.

BIM support for disaster response

The introduction of Building Information Modelling (BIM) to the design, construction and operation of buildings is changing the way that the building construction industry works. BIM involves the development of a full 3D virtual model of a building which not only contains the 3D information necessary to show the building as it will appear, but also contains significant additional data about each component in the building. BIM represents both physical and virtual objects in a building. This includes the rooms and spaces within and around the building. The additional data stored on each part of the building can support building maintenance opera- tions and, more importantly from the perspective of this paper, support the generation and running of simula- tions of the operation of the building and behaviour of people within it under both normal and emergency scenarios. The initial discussion is around the use of BIM to support the design of resilient buildings which references the various codes and standards that define current best practice. The remainder of the discussion uses various recent events as the basis for discussion on how BIM could have been used to support rapid recovery and re- building.

Supine to standing Cobb angle change in idiopathic scoliosis : the effect of endplate pre-selection

Background Supine imaging modalities provide valuable 3D information on scoliotic anatomy, but the altered spine geometry between the supine and standing positions affects the Cobb angle measurement. Previous studies report a mean 7°-10° Cobb angle increase from supine to standing, but none have reported the effect of endplate pre-selection or whether other parameters affect this Cobb angle difference. Methods Cobb angles from existing coronal radiographs were compared to those on existing low-dose CT scans taken within three months of the reference radiograph for a group of females with adolescent idiopathic scoliosis. Reformatted coronal CT images were used to measure supine Cobb angles with and without endplate pre-selection (end-plates selected from the radiographs) by two observers on three separate occasions. Inter and intra-observer measurement variability were assessed. Multi-linear regression was used to investigate whether there was a relationship between supine to standing Cobb angle change and eight variables: patient age, mass, standing Cobb angle, Risser sign, ligament laxity, Lenke type, fulcrum flexibility and time delay between radiograph and CT scan. Results Fifty-two patients with right thoracic Lenke Type 1 curves and mean age 14.6 years (SD 1.8) were included. The mean Cobb angle on standing radiographs was 51.9° (SD 6.7). The mean Cobb angle on supine CT images without pre-selection of endplates was 41.1° (SD 6.4). The mean Cobb angle on supine CT images with endplate pre-selection was 40.5° (SD 6.6). Pre-selecting vertebral endplates increased the mean Cobb change by 0.6° (SD 2.3, range −9° to 6°). When free to do so, observers chose different levels for the end vertebrae in 39% of cases. Multi-linear regression revealed a statistically significant relationship between supine to standing Cobb change and fulcrum flexibility (p = 0.001), age (p = 0.027) and standing Cobb angle (p < 0.001). The 95% confidence intervals for intra-observer and inter-observer measurement variability were 3.1° and 3.6°, respectively. Conclusions Pre-selecting vertebral endplates causes minor changes to the mean supine to standing Cobb change. There is a statistically significant relationship between supine to standing Cobb change and fulcrum flexibility such that this difference can be considered a potential alternative measure of spinal flexibility.

Supine to standing cobb angle change in idiopathic scoliosis: The effect of endplate preselection

INTRODUCTION Standing radiographs are the ‘gold standard’ for clinical assessment of adolescent idiopathic scoliosis (AIS), with the Cobb Angle used to measure the severity and progression of the scoliotic curve. Supine imaging modalities can provide valuable 3D information on scoliotic anatomy, however, due to changes in gravitational loading direction, the geometry of the spine alters between the supine and standing position which in turn affects the Cobb Angle measurement. Previous studies have consistently reported a 7-10° [1-3] Cobb Angle increase from supine to standing, however, none have reported the effect of endplate pre-selection and which (if any) curve parameters affect the supine to standing Cobb Angle difference. CONCLUSION There is a statistically significant relationship between supine to standing Cobb Angle change and fulcrum flexibility. Therefore, this difference can be considered a measure of spinal flexibility. Pre-selecting vertebral endplates causes only minor changes.

Morphological and functional characterisation of the burrow systems of six earthworm species (Lumbricidae)

Earthworm burrow systems are generally described based on postulated behaviours associated with the three ecological types. In this study, we used X-ray tomography to obtain 3D information on the burrowing behaviour of six very common anecic (Aporrectodea nocturna and Lumbricus terrestris) and endogeic (Aporrectodea rosea, Allolobophora chlorotica, Aporrectodea caliginosa, Aporrectodea icterica) earthworm species, introduced into repacked soil cores for 6 weeks. A simple water infiltration test, the Beerkan method, was also used to assess some functional properties of these burrow systems. Endogeic worms make larger burrow systems, which are more highly branched, less continuous and of smaller diameter, than those of anecic worms. Among the anecic species, L. terrestris burrow systems are shorter (9.2 vs 21.2 m) with a higher number (14.5 vs 23.5) of less branched burrows (12.2 vs 20.2 branches m(-1)), which are also wider (7.78 vs 5.16 mm) than those of A. nocturna. In comparison, the burrow systems made by endogeic species appeared similar to each other. However, A. rosea burrows were short and narrow, whereas A. icterica had a longer burrow system (15.7 m), more intense bioturbation intensity (refilled macropores or soil lateral compaction around them) and thus a greater number of burrows. Regarding water infiltration, anecic burrow systems were far more efficient due to open burrows linking the top and bottom of the cores. For endogeic species, we observed a linear relationship between burrow length and the water infiltration rate (R (2) = 0.49, p < 0.01). Overall, the three main characteristics significantly influencing water infiltration were burrow length, burrow number and bioturbation volume. This last characteristic highlighted the effect of burrow refilling by casts.

基于光谱分析的主动式距离图像获取方法

Rainbow三维摄像机是一种基于光谱分析的快速三维信息获取方法。该方法利用连续变化的彩色光谱照射景物 ,彩色CCD摄像机摄取的景物图像将呈现有规律的颜色变化 ,而且不同的颜色 (波长 )构成了不同的空间颜色面。通过标定这些颜色面和摄像机成象模型 ,即可计算出图像中各点的三维坐标。

基于光谱分析的主动式距离图象获取方法

Ｒａｉｎｂｏｗ 三维摄像机是一种基于光谱分析的快速三维信息获取方法。该方法利用连续变化的彩色光谱照射景物，彩色ＣＣＤ 摄像机摄取的景物图象将呈现有规律的颜色变化，而且不同的颜色（波长）构成了不同的空间颜色面。通过标定这些颜色面和摄像机成象模型，即可计算出图象中各点的三维坐标。该文重点讨论实现该方法的标定技术和颜色分类技术，最后给出实验结果。

Mandelbrot集与Julia集的图象生成算法

介绍一种在计算机上生成Ｍａｎｄｅｌｂｒｏｔ集和Ｊｕｌｉａ集图象的简易算法。该算法对计算机的软硬件要求均不高，在普通的微机以及工作站上均可实现。

一种基于立体视觉的多视点建模方法

论述了一种基于立体视觉的建模方法。该方法利用立体视觉系统在不同视点对景物观测所获得的局部三维几何模型，通过空间特征点匹配和坐标变换将局部模型融合，从而建立景物的完整描述。文章重点介绍了一种基于空间向量的坐标变换求解方法。

A spatio-temporal 2D-models framework for human pose recovery in monocular sequences

This paper addresses the pose recovery problem of a particular articulated object: the human body. In this model-based approach, the 2D-shape is associated to the corresponding stick figure allowing the joint segmentation and pose recovery of the subject observed in the scene. The main disadvantage of 2D-models is their restriction to the viewpoint. To cope with this limitation, local spatio-temporal 2D-models corresponding to many views of the same sequences are trained, concatenated and sorted in a global framework. Temporal and spatial constraints are then considered to build the probabilistic transition matrix (PTM) that gives a frame to frame estimation of the most probable local models to use during the fitting procedure, thus limiting the feature space. This approach takes advantage of 3D information avoiding the use of a complex 3D human model. The experiments carried out on both indoor and outdoor sequences have demonstrated the ability of this approach to adequately segment pedestrians and estimate their poses independently of the direction of motion during the sequence. (c) 2008 Elsevier Ltd. All rights reserved.