Using image quality metrics to detect smoke-affected laser data

Field robots often rely on laser range finders (LRFs) to detect obstacles and navigate autonomously. Despite recent progress in sensing technology and perception algorithms, adverse environmental conditions, such as the presence of smoke, remain a challenging issue for these robots. In this paper, we investigate the possibility to improve laser-based perception applications by anticipating situations when laser data are affected by smoke, using supervised learning and state-of-the-art visual image quality analysis. We propose to train a k-nearest-neighbour (kNN) classifier to recognise situations where a laser scan is likely to be affected by smoke, based on visual data quality features. This method is evaluated experimentally using a mobile robot equipped with LRFs and a visual camera. The strengths and limitations of the technique are identified and discussed, and we show that the method is beneficial if conservative decisions are the most appropriate.

Laser-radar data fusion with Gaussian Process Implicit Surfaces

This work considers the problem of building high-fidelity 3D representations of the environment from sensor data acquired by mobile robots. Multi-sensor data fusion allows for more complete and accurate representations, and for more reliable perception, especially when different sensing modalities are used. In this paper, we propose a thorough experimental analysis of the performance of 3D surface reconstruction from laser and mm-wave radar data using Gaussian Process Implicit Surfaces (GPIS), in a realistic field robotics scenario. We first analyse the performance of GPIS using raw laser data alone and raw radar data alone, respectively, with different choices of covariance matrices and different resolutions of the input data. We then evaluate and compare the performance of two different GPIS fusion approaches. The first, state-of-the-art approach directly fuses raw data from laser and radar. The alternative approach proposed in this paper first computes an initial estimate of the surface from each single source of data, and then fuses these two estimates. We show that this method outperforms the state of the art, especially in situations where the sensors react differently to the targets they perceive.

Obstacle detection for a mining vehicle using a 2D laser

This paper discusses a number of key issues for the development of robust obstacle detection systems for autonomous mining vehicles. Strategies for obstacle detection are described and an overview of the state-of-the-art in obstacle detection for outdoor autonomous vehicles using lasers is presented, with their applicability to the mining environment noted. The development of an obstacle detection system for a mining vehicle is then detailed. This system uses a 2D laser scanner as the prime sensor and combines dead-reckoning data with laser data to create local terrain maps. The slope of the terrain maps is then used to detect potential obstacles.

Uso de dados fotogramétricos no refinamento geométrico de contornos de telhados de edifícios extraídos de dados laser

In this paper, a methodology is proposed for the geometric refinement of laser scanning building roof contours using high-resolution aerial images and Markov Random Field (MRF) models. The proposed methodology takes for granted that the 3D description of each building roof reconstructed from the laser scanning data (i.e., a polyhedron) is topologically correct and that it is only necessary to improve its accuracy. Since roof ridges are accurately extracted from laser scanning data, our main objective is to use high-resolution aerial images to improve the accuracy of roof outlines. In order to meet this goal, the available roof contours are first projected onto the image-space. After that, the projected polygons and the straight lines extracted from the image are used to establish an MRF description, which is based on relations ( relative length, proximity, and orientation) between the two sets of straight lines. The energy function associated with the MRF is minimized by using a modified version of the brute force algorithm, resulting in the grouping of straight lines for each roof object. Finally, each grouping of straight lines is topologically reconstructed based on the topology of the corresponding laser scanning polygon projected onto the image-space. The preliminary results showed that the proposed methodology is promising, since most sides of the refined polygons are geometrically better than corresponding projected laser scanning straight lines.

Reconstrução de contornos e cumeeiras de telhados de edifícios a partir de imagens aéreas de alta-resolução e poliedros representativos de edifícios extraídos de dados LASER

Pós-graduação em Ciências Cartográficas - FCT

Extração de feições retas e cálculo de entidades pontuais a partir de dados LASER para o ajustamento relativo de faixas

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Refinamento geométrico de contornos e cumeeiras de telhados de edifícios extraídos de dados laser com uso de imagem aérea

In this paper, a method is proposed to refine the LASER 3D roofs geometrically by using a high-resolution aerial image and Markov Random Field (MRF) models. In order to do so, a MRF description for grouping straight lines is developed, assuming that each projected side contour and ridge is topologically correct and that it is only necessary to improve its accuracy. Although the combination of laser data with data from image is most justified for refining roof contour, the structure of ridges can give greater robustness in the topological description of the roof structure. The MRF model is formulated based on relationships (length, proximity, and orientation) between the straight lines extracted from the image and projected polygon and also on retangularity and corner injunctions. The energy function associated with MRF is minimized by the genetic algorithm optimization method, resulting in the grouping of straight lines for each roof object. Finally, each grouping of straight lines is topologically reconstructed based on the topology of the corresponding LASER scanning polygon projected onto the image-space. The results obtained were satisfactory. This method was able to provide polygons roof refined buildings in which most of its contour sides and ridges were geometrically improved.

Precise orbit determination and analysis from satellite altimetry and laser ranging

For optimum utilization of satellite-borne instrumentation, it is necessary to know precisely the orbital position of the spacecraft. The aim of this thesis is therefore two-fold - firstly to derive precise orbits with particular emphasis placed on the altimetric satellite SEASAT and secondly, to utilize the precise orbits, to improve upon atmospheric density determinations for satellite drag modelling purposes. Part one of the thesis, on precise orbit determinations, is particularly concerned with the tracking data - satellite laser ranging, altimetry and crossover height differences - and how this data can be used to analyse errors in the orbit, the geoid and sea-surface topography. The outcome of this analysis is the determination of a low degree and order model for sea surface topography. Part two, on the other hand, mainly concentrates on using the laser data to analyse and improve upon current atmospheric density models. In particular, the modelling of density changes associated with geomagnetic disturbances comes under scrutiny in this section. By introducing persistence modelling of a geomagnetic event and solving for certain geomagnetic parameters, a new density model is derived which performs significantly better than the state-of-the-art models over periods of severe geomagnetic storms at SEASAT heights. This is independently verified by application of the derived model to STARLETTE orbit determinations.

Airborne laser quantification of Florida shoreline and beach volume change caused by hurricanes

This dissertation combines three separate studies that measure coastal change using airborne laser data. The initial study develops a method for measuring subaerial and subaqueous volume change incrementally alongshore, and compares those measurements to shoreline change in order to quantify their relationship in Palm Beach County, Florida. A poor correlation (R2 = 0.39) was found between shoreline and volume change before the hurricane season in the northern section of Palm Beach County because of beach nourishment and inlet dynamics. However, a relatively high R2 value of 0.78 in the southern section of Palm Beach County was found due to little disturbance from tidal inlets and coastal engineering projects. The shoreline and volume change caused by the 2004 hurricane season was poorly correlated with R 2 values of 0.02 and 0.42 for the north and south sections, respectively. The second study uses airborne laser data to investigate if there is a significant relationship between shoreline migration before and after Hurricane Ivan near Panama City, Florida. In addition, the relationship between shoreline change and subaerial volume was quantified and a new method for quantifying subaqueous sediment change was developed. No significant spatial relationship was found between shoreline migration before and after the hurricane. Utilization of a single coefficient to represent all relationships between shoreline and subaerial volume change was found to be problematic due to the spatial variability in the linear relationship. Differences in bathymetric data show only a small portion of sediment was transported beyond the active zone and most sediment remained within the active zone despite the occurrence of a hurricane. The third study uses airborne laser bathymetry to measure the offshore limit of change, and compares that location with calculated depth of closures and subaqueous geomorphology. There appears to be strong geologic control of the depth of closure in Broward and Miami-Dade Counties. North of Hillsboro Inlet, hydrodynamics control the geomorphology which in turn indicates the location of the depth of closure.

Airborne Laser Quantification of Florida Shoreline and Beach Volume Change Caused by Hurricanes

This dissertation combines three separate studies that measure coastal change using airborne laser data. The initial study develops a method for measuring subaerial and subaqueous volume change incrementally alongshore, and compares those measurements to shoreline change in order to quantify their relationship in Palm Beach County, Florida. A poor correlation (R2 = 0.39) was found between shoreline and volume change before the hurricane season in the northern section of Palm Beach County because of beach nourishment and inlet dynamics. However, a relatively high R2 value of 0.78 in the southern section of Palm Beach County was found due to little disturbance from tidal inlets and coastal engineering projects. The shoreline and volume change caused by the 2004 hurricane season was poorly correlated with R2 values of 0.02 and 0.42 for the north and south sections, respectively. The second study uses airborne laser data to investigate if there is a significant relationship between shoreline migration before and after Hurricane Ivan near Panama City, Florida. In addition, the relationship between shoreline change and subaerial volume was quantified and a new method for quantifying subaqueous sediment change was developed. No significant spatial relationship was found between shoreline migration before and after the hurricane. Utilization of a single coefficient to represent all relationships between shoreline and subaerial volume change was found to be problematic due to the spatial variability in the linear relationship. Differences in bathymetric data show only a small portion of sediment was transported beyond the active zone and most sediment remained within the active zone despite the occurrence of a hurricane. The third study uses airborne laser bathymetry to measure the offshore limit of change, and compares that location with calculated depth of closures and subaqueous geomorphology. There appears to be strong geologic control of the depth of closure in Broward and Miami-Dade Counties. North of Hillsboro Inlet, hydrodynamics control the geomorphology which in turn indicates the location of the depth of closure.

Augmenting traversability maps with ultra-wideband radar to enhance obstacle detection in vegetated environments

Operating in vegetated environments is a major challenge for autonomous robots. Obstacle detection based only on geometric features causes the robot to consider foliage, for example, small grass tussocks that could be easily driven through, as obstacles. Classifying vegetation does not solve this problem since there might be an obstacle hidden behind the vegetation. In addition, dense vegetation typically needs to be considered as an obstacle. This paper addresses this problem by augmenting probabilistic traversability map constructed from laser data with ultra-wideband radar measurements. An adaptive detection threshold and a probabilistic sensor model are developed to convert the radar data to occupancy probabilities. The resulting map captures the fine resolution of the laser map but clears areas from the traversability map that are induced by obstacle-free foliage. Experimental results validate that this method is able to improve the accuracy of traversability maps in vegetated environments.

Topographic model of Greenland (elevation lines in PanMap and ASCII format)

In this paper, a new high-resolution elevation model of Greenland, including the ice sheet as well as the ice free regions, is presented. It is the first published full coverage model, computed with an average resolution of 2 km and providing an unprecedented degree of detail. The topography is modeled from a wide selection of data sources, including satellite radar altimetry from Geosat and ERS 1, airborne radar altimetry and airborne laser altimetry over the ice sheet, and photogrammetric and manual map scannings in the ice free region. The ice sheet model accuracy is evaluated by omitting airborne laser data from the analysis and treating them as ground truth observations. The mean accuracy of the ice sheet elevations is estimated to be 12-13 m, and it is found that on surfaces of a slope between 0.2° and 0.8°, corresponding to approximately 50% of the ice sheet, the model presents a 40% improvement over models based on satellite altimetry alone. On coastal bedrock, the model is compared with stereo triangulated reference points, and it is found that the model accuracy is of the order of 25-35 m in areas covered by stereo photogrammetry scannings and between 200 and 250 m elsewhere.

Laser-camera data discrepancies and reliable perception in outdoor robotics

This work aims to promote integrity in autonomous perceptual systems, with a focus on outdoor unmanned ground vehicles equipped with a camera and a 2D laser range finder. A method to check for inconsistencies between the data provided by these two heterogeneous sensors is proposed and discussed. First, uncertainties in the estimated transformation between the laser and camera frames are evaluated and propagated up to the projection of the laser points onto the image. Then, for each pair of laser scan-camera image acquired, the information at corners of the laser scan is compared with the content of the image, resulting in a likelihood of correspondence. The result of this process is then used to validate segments of the laser scan that are found to be consistent with the image, while inconsistent segments are rejected. Experimental results illustrate how this technique can improve the reliability of perception in challenging environmental conditions, such as in the presence of airborne dust.

Ultrasonic Guided Wave Based Damage Detection Using Low-dimensional Data from Laser Doppler Scan

In the current state of the art, it remains an open problem to detect damage with partial ultrasonic scan data and with measurements at coarser spatial scale when the location of damage is not known. In the present paper, a recent development of finite element based model reduction scheme in frequency domain that employs master degrees of freedom covering the surface scan region of interests is reported in context of non-contact ultrasonic guided wave based inspection. The surface scan region of interest is grouped into master and slave degrees of freedom. A finite element wise damage factor is derived which represents damage state over distributed areas or sharp condition of inter-element boundaries (for crack). Laser Doppler Vibrometer (LDV) scan data obtained from plate type structure with inaccessible surface line crack are considered along with the developed reduced order damage model to analyze the extent of scan data dimensional reduction. The proposed technique has useful application in problems where non-contact monitoring of complex structural parts are extremely important and at the same time LDV scan has to be done on accessible surfaces only.