Application of Visual-Inertial SLAM for 3D Mapping of Underground Environments

The underground scenarios are one of the most challenging environments for accurate and precise 3d mapping where hostile conditions like absence of Global Positioning Systems, extreme lighting variations and geometrically smooth surfaces may be expected. So far, the state-of-the-art methods in underground modelling remain restricted to environments in which pronounced geometric features are abundant. This limitation is a consequence of the scan matching algorithms used to solve the localization and registration problems. This paper contributes to the expansion of the modelling capabilities to structures characterized by uniform geometry and smooth surfaces, as is the case of road and train tunnels. To achieve that, we combine some state of the art techniques from mobile robotics, and propose a method for 6DOF platform positioning in such scenarios, that is latter used for the environment modelling. A visual monocular Simultaneous Localization and Mapping (MonoSLAM) approach based on the Extended Kalman Filter (EKF), complemented by the introduction of inertial measurements in the prediction step, allows our system to localize himself over long distances, using exclusively sensors carried on board a mobile platform. By feeding the Extended Kalman Filter with inertial data we were able to overcome the major problem related with MonoSLAM implementations, known as scale factor ambiguity. Despite extreme lighting variations, reliable visual features were extracted through the SIFT algorithm, and inserted directly in the EKF mechanism according to the Inverse Depth Parametrization. Through the 1-Point RANSAC (Random Sample Consensus) wrong frame-to-frame feature matches were rejected. The developed method was tested based on a dataset acquired inside a road tunnel and the navigation results compared with a ground truth obtained by post-processing a high grade Inertial Navigation System and L1/L2 RTK-GPS measurements acquired outside the tunnel. Results from the localization strategy are presented and analyzed.

Online Robust 3D Mapping Using Structure from Motion Cues

This paper presents a complete solution for creating accurate 3D textured models from monocular video sequences. The methods are developed within the framework of sequential structure from motion, where a 3D model of the environment is maintained and updated as new visual information becomes available. The camera position is recovered by directly associating the 3D scene model with local image observations. Compared to standard structure from motion techniques, this approach decreases the error accumulation while increasing the robustness to scene occlusions and feature association failures. The obtained 3D information is used to generate high quality, composite visual maps of the scene (mosaics). The visual maps are used to create texture-mapped, realistic views of the scene

Online Robust 3D Mapping Using Structure from Motion Cues

This paper presents a complete solution for creating accurate 3D textured models from monocular video sequences. The methods are developed within the framework of sequential structure from motion, where a 3D model of the environment is maintained and updated as new visual information becomes available. The camera position is recovered by directly associating the 3D scene model with local image observations. Compared to standard structure from motion techniques, this approach decreases the error accumulation while increasing the robustness to scene occlusions and feature association failures. The obtained 3D information is used to generate high quality, composite visual maps of the scene (mosaics). The visual maps are used to create texture-mapped, realistic views of the scene

Optimierung der laserinduzierten Plasmaspektroskopie an Metallen durch Femtosekunden-Doppelpulse für die Entwicklung eines hochauflösenden 3D-Rasterabbildungsverfahrens

Die laserinduzierte Plasmaspektroskopie (LIPS) ist eine spektrochemische Elementanalyse zur Bestimmung der atomaren Zusammensetzung einer beliebigen Probe. Für die Analyse ist keine spezielle Probenpräparation nötig und kann unter atmosphärischen Bedingungen an Proben in jedem Aggregatzustand durchgeführt werden. Femtosekunden Laserpulse bieten die Vorteile einer präzisen Ablation mit geringem thermischen Schaden sowie einer hohen Reproduzierbarkeit. Damit ist fs-LIPS ein vielversprechendes Werkzeug für die Mikroanalyse technischer Proben, insbesondere zur Untersuchung ihres Ermüdungsverhaltens. Dabei ist interessant, wie sich die initiierten Mikrorisse innerhalb der materialspezifschen Struktur ausbreiten. In der vorliegenden Arbeit sollte daher ein schnelles und einfach zu handhabendes 3D-Rasterabbildungsverfahren zur Untersuchung der Rissausbreitung in TiAl, einer neuen Legierungsklasse, entwickelt werden. Dazu wurde fs-LIPS (30 fs, 785 nm) mit einem modifizierten Mikroskopaufbau (Objektiv: 50x/NA 0.5) kombiniert, welcher eine präzise, automatisierte Probenpositionierung ermöglicht. Spektrochemische Sensitivität und räumliches Auflösungsvermögen wurden in energieabhängigen Einzel- und Multipulsexperimenten untersucht. 10 Laserpulse pro Position mit einer Pulsenergie von je 100 nJ führten in TiAl zum bestmöglichen Kompromiss aus hohem S/N-Verhältnis von 10:1 und kleinen Lochstrukturen mit inneren Durchmessern von 1.4 µm. Die für das Verfahren entscheidende laterale Auflösung, dem minimalen Lochabstand bei konstantem LIPS-Signal, beträgt mit den obigen Parametern 2 µm und ist die bislang höchste bekannte Auflösung einer auf fs-LIPS basierenden Mikro-/Mapping-Analyse im Fernfeld. Fs-LIPS Scans von Teststrukturen sowie Mikrorissen in TiAl demonstrieren eine spektrochemische Sensitivität von 3 %. Scans in Tiefenrichtung erzielen mit denselben Parametern eine axiale Auflösung von 1 µm. Um die spektrochemische Sensitivität von fs-LIPS zu erhöhen und ein besseres Verständnis für die physikalischen Prozesse während der Laserablation zu erhalten, wurde in Pump-Probe-Experimenten untersucht, in wieweit fs-Doppelpulse den laserinduzierten Abtrag sowie die Plasmaemission beeinflussen. Dazu wurden in einem Mach-Zehnder-Interferometer Pulsabstände von 100 fs bis 2 ns realisiert, Gesamtenergie und Intensitätsverhältnis beider Pulse variiert sowie der Einfluss der Materialparameter untersucht. Sowohl das LIPS-Signal als auch die Lochstrukturen zeigen eine Abhängigkeit von der Verzögerungszeit. Diese wurden in vier verschiedene Regimes eingeteilt und den physikalischen Prozessen während der Laserablation zugeordnet: Die Thermalisierung des Elektronensystems für Pulsabstände unter 1 ps, Schmelzprozesse zwischen 1 und 10 ps, der Beginn des Abtrags nach mehreren 10 ps und die Expansion der Plasmawolke nach über 100 ps. Dabei wird das LIPS-Signal effizient verstärkt und bei 800 ps maximal. Die Lochdurchmesser ändern sich als Funktion des Pulsabstands wenig im Vergleich zur Tiefe. Die gesamte Abtragsrate variiert um maximal 50 %, während sich das LIPS-Signal vervielfacht: Für Ti und TiAl typischerweise um das Dreifache, für Al um das 10-fache. Die gemessenen Transienten zeigen eine hohe Reproduzierbarkeit, jedoch kaum eine Energie- bzw. materialspezifische Abhängigkeit. Mit diesen Ergebnissen wurde eine gezielte Optimierung der DP-LIPS-Parameter an Al durchgeführt: Bei einem Pulsabstand von 800 ps und einer Gesamtenergie von 65 nJ (vierfach über der Ablationsschwelle) wurde eine 40-fache Signalerhöhung bei geringerem Rauschen erzielt. Die Lochdurchmesser vergrößerten sich dabei um 44 % auf (650±150) nm, die Lochtiefe um das Doppelte auf (100±15) nm. Damit war es möglich, die spektrochemische Sensitivität von fs-LIPS zu erhöhen und gleichzeitig die hohe räumliche Auflösung aufrecht zu erhalten.

Proposta metodológica para o imageamento digital e modelagem virtual 3d de um bloco de rochas travertinas

In this paper we present the methodological procedures involved in the digital imaging in mesoscale of a block of travertines rock of quaternary age, originating from the city of Acquasanta, located in the Apennines, Italy. This rocky block, called T-Block, was stored in the courtyard of the Laboratório Experimental Petróleo "Kelsen Valente" (LabPetro), of Universidade Estadual de Campinas (UNICAMP), so that from it were performed Scientific studies, mainly for research groups universities and research centers working in brazilian areas of reservoir characterization and 3D digital imaging. The purpose of this work is the development of a Model Solid Digital, from the use of non-invasive techniques of digital 3D imaging of internal and external surfaces of the T-Block. For the imaging of the external surfaces technology has been used LIDAR (Light Detection and Range) and the imaging surface Interior was done using Ground Penetrating Radar (GPR), moreover, profiles were obtained with a Gamma Ray Gamae-spectômetro laptop. The goal of 3D digital imaging involved the identification and parameterization of surface geological and sedimentary facies that could represent heterogeneities depositional mesoscale, based on study of a block rocky with dimensions of approximately 1.60 m x 1.60 m x 2.70 m. The data acquired by means of terrestrial laser scanner made available georeferenced spatial information of the surface of the block (X, Y, Z), and varying the intensity values of the return laser beam and high resolution RGB data (3 mm x 3 mm), total points acquired 28,505,106. This information was used as an aid in the interpretation of radargrams and are ready to be displayed in rooms virtual reality. With the GPR was obtained 15 profiles of 2.3 m and 2 3D grids, each with 24 sections horizontal of 1.3 and 14 m vertical sections of 2.3 m, both the Antenna 900 MHz to about 2600 MHz antenna. Finally, the use of GPR associated with Laser Scanner enabled the identification and 3D mapping of 3 different radarfácies which were correlated with three sedimentary facies as had been defined at the outset. The 6 profiles showed gamma a low amplitude variation in the values of radioactivity. This is likely due to the fact of the sedimentary layers profiled have the same mineralogical composition, being composed by carbonate sediments, with no clay in siliciclastic pellitic layers or other mineral carrier elements radioactive

A study of a soft computing based method for 3D scenario reconstruction

Several recent works deal with 3D data in mobile robotic problems, e.g., mapping. Data comes from any kind of sensor (time of flight, Kinect or 3D lasers) that provide a huge amount of unorganized 3D data. In this paper we detail an efficient approach to build complete 3D models using a soft computing method, the Growing Neural Gas (GNG). As neural models deal easily with noise, imprecision, uncertainty or partial data, GNG provides better results than other approaches. The GNG obtained is then applied to a sequence. We present a comprehensive study on GNG parameters to ensure the best result at the lowest time cost. From this GNG structure, we propose to calculate planar patches and thus obtaining a fast method to compute the movement performed by a mobile robot by means of a 3D models registration algorithm. Final results of 3D mapping are also shown.

Using GNG to improve 3D feature extraction—Application to 6DoF egomotion

Several recent works deal with 3D data in mobile robotic problems, e.g. mapping or egomotion. Data comes from any kind of sensor such as stereo vision systems, time of flight cameras or 3D lasers, providing a huge amount of unorganized 3D data. In this paper, we describe an efficient method to build complete 3D models from a Growing Neural Gas (GNG). The GNG is applied to the 3D raw data and it reduces both the subjacent error and the number of points, keeping the topology of the 3D data. The GNG output is then used in a 3D feature extraction method. We have performed a deep study in which we quantitatively show that the use of GNG improves the 3D feature extraction method. We also show that our method can be applied to any kind of 3D data. The 3D features obtained are used as input in an Iterative Closest Point (ICP)-like method to compute the 6DoF movement performed by a mobile robot. A comparison with standard ICP is performed, showing that the use of GNG improves the results. Final results of 3D mapping from the egomotion calculated are also shown.

Portable 3D laser-camera calibration system with color fusion for SLAM

Nowadays, the use of RGB-D sensors have focused a lot of research in computer vision and robotics. These kinds of sensors, like Kinect, allow to obtain 3D data together with color information. However, their working range is limited to less than 10 meters, making them useless in some robotics applications, like outdoor mapping. In these environments, 3D lasers, working in ranges of 20-80 meters, are better. But 3D lasers do not usually provide color information. A simple 2D camera can be used to provide color information to the point cloud, but a calibration process between camera and laser must be done. In this paper we present a portable calibration system to calibrate any traditional camera with a 3D laser in order to assign color information to the 3D points obtained. Thus, we can use laser precision and simultaneously make use of color information. Unlike other techniques that make use of a three-dimensional body of known dimensions in the calibration process, this system is highly portable because it makes use of small catadioptrics that can be placed in a simple manner in the environment. We use our calibration system in a 3D mapping system, including Simultaneous Location and Mapping (SLAM), in order to get a 3D colored map which can be used in different tasks. We show that an additional problem arises: 2D cameras information is different when lighting conditions change. So when we merge 3D point clouds from two different views, several points in a given neighborhood could have different color information. A new method for color fusion is presented, obtaining correct colored maps. The system will be tested by applying it to 3D reconstruction.

A robust and fast method for 6DoF motion estimation from generalized 3D data

Nowadays, there is an increasing number of robotic applications that need to act in real three-dimensional (3D) scenarios. In this paper we present a new mobile robotics orientated 3D registration method that improves previous Iterative Closest Points based solutions both in speed and accuracy. As an initial step, we perform a low cost computational method to obtain descriptions for 3D scenes planar surfaces. Then, from these descriptions we apply a force system in order to compute accurately and efficiently a six degrees of freedom egomotion. We describe the basis of our approach and demonstrate its validity with several experiments using different kinds of 3D sensors and different 3D real environments.

Towards Mapping of Rock Walls Using a UAV-Mounted 2D Laser Scanner in GPS Denied Environments

In geotechnical engineering, the stability of rock excavations and walls is estimated by using tools that include a map of the orientations of exposed rock faces. However, measuring these orientations by using conventional methods can be time consuming, sometimes dangerous, and is limited to regions of the exposed rock that are reachable by a human. This thesis introduces a 2D, simulated, quadcopter-based rock wall mapping algorithm for GPS denied environments such as underground mines or near high walls on surface. The proposed algorithm employs techniques from the field of robotics known as simultaneous localization and mapping (SLAM) and is a step towards 3D rock wall mapping. Not only are quadcopters agile, but they can hover. This is very useful for confined spaces such as underground or near rock walls. The quadcopter requires sensors to enable self localization and mapping in dark, confined and GPS denied environments. However, these sensors are limited by the quadcopter payload and power restrictions. Because of these restrictions, a light weight 2D laser scanner is proposed. As a first step towards a 3D mapping algorithm, this thesis proposes a simplified scenario in which a simulated 1D laser range finder and 2D IMU are mounted on a quadcopter that is moving on a plane. Because the 1D laser does not provide enough information to map the 2D world from a single measurement, many measurements are combined over the trajectory of the quadcopter. Least Squares Optimization (LSO) is used to optimize the estimated trajectory and rock face for all data collected over the length of a light. Simulation results show that the mapping algorithm developed is a good first step. It shows that by combining measurements over a trajectory, the scanned rock face can be estimated using a lower-dimensional range sensor. A swathing manoeuvre is introduced as a way to promote loop closures within a short time period, thus reducing accumulated error. Some suggestions on how to improve the algorithm are also provided.

3D modelling of mango fruit skin blush in the tree canopy

The fruit of certain mango cultivars (e.g., 'Honey Gold') can develop blush on their skin. Skin blush due to red pigmentation is from the accumulation of anthocyanins. Anthocyanin biosynthesis is related to environmental determinants, including light received by the fruit. It has been observed that mango skin blush varies with position in the tree canopy. However, little investigation into this spatial relationship has been conducted. The objective of this preliminary study was to describe a 'Honey Gold' mango tree by capturing its three-dimensional (3D) architecture. A light path tracing model QuasiMC was then used to predict light received by fruit. The use of this 3D model was to better understand the relationship between mango fruit skin blush and fruit position in the canopy. The digitised mango tree mimicked the real tree at a high level of detail. Observations on mango skin blush distribution supported the proposition that sunlight exposure is an absolute requirement for anthocyanin development. No blush development occurred on shaded skin. It was affirmed that 3D mapping could allow for virtual experiments. For example, for virtual canopy thinning (e.g., 'window pruning') to admit more sunlight with a view to improve fruit blush. Improvements to 3D modelling of mango skin blush could focus on increasing accuracy, e.g., measurement of leaf light reflectance and transmission and the inclusion of the effect shading by branches.

Length of the Mitral Isthmus But Not Anatomical Location of Ablation Line Predicts Bidirectional Mitral Isthmus Block in Patients Undergoing Catheter Ablation of Persistent Atrial Fibrillation: A Randomized Controlled Trial.

INTRODUCTION: Mitral isthmus (MI) ablation is an effective option in patients undergoing ablation for persistent atrial fibrillation (AF). Achieving bidirectional conduction block across the MI is challenging, and predictors of MI ablation success remain incompletely understood. We sought to determine the impact of anatomical location of the ablation line on the efficacy of MI ablation. METHODS AND RESULTS: A total of 40 consecutive patients (87% male; 54 ± 10 years) undergoing stepwise AF ablation were included. MI ablation was performed in sinus rhythm. MI ablation was performed from the left inferior PV to either the posterior (group 1) or the anterolateral (group 2) mitral annulus depending on randomization. The length of the MI line (measured with the 3D mapping system) and the amplitude of the EGMs at 3 positions on the MI were measured in each patient. MI block was achieved in 14/19 (74%) patients in group 1 and 15/21 (71%) patients in group 2 (P = NS). Total MI radiofrequency time (18 ± 7 min vs. 17 ± 8 min; P = NS) was similar between groups. Patients with incomplete MI block had a longer MI length (34 ± 6 mm vs. 24 ± 5 mm; P < 0.001), a higher bipolar voltage along the MI (1.75 ± 0.74 mV vs. 1.05 ± 0.69 mV; P < 0.01), and a longer history of continuous AF (19 ± 17 months vs. 10 ± 10 months; P < 0.05). In multivariate analysis, decreased length of the MI was an independent predictor of successful MI block (OR 1.5; 95% CI 1.1-2.1; P < 0.05). CONCLUSIONS: Increased length but not anatomical location of the MI predicts failure to achieve bidirectional MI block during ablation of persistent AF.

Mapeamento robótico 2,5-D com representação em grade de ocupação-elevação

This work introduces a new method for environment mapping with three-dimensional information from visual information for robotic accurate navigation. Many approaches of 3D mapping using occupancy grid typically requires high computacional effort to both build and store the map. We introduce an 2.5-D occupancy-elevation grid mapping, which is a discrete mapping approach, where each cell stores the occupancy probability, the height of the terrain at current place in the environment and the variance of this height. This 2.5-dimensional representation allows that a mobile robot to know whether a place in the environment is occupied by an obstacle and the height of this obstacle, thus, it can decide if is possible to traverse the obstacle. Sensorial informations necessary to construct the map is provided by a stereo vision system, which has been modeled with a robust probabilistic approach, considering the noise present in the stereo processing. The resulting maps favors the execution of tasks like decision making in the autonomous navigation, exploration, localization and path planning. Experiments carried out with a real mobile robots demonstrates that this proposed approach yields useful maps for robot autonomous navigation

Integration of merged delayed-enhanced magnetic resonance imaging and multidetector computed tomography for the guidance of ventricular tachycardia ablation: a pilot study

BACKGROUND Delayed enhancement (DE) MRI can assess the fibrotic substrate of scar-related VT. MDCT has the advantage of inframillimetric spatial resolution and better 3D reconstructions. We sought to evaluate the feasibility and usefulness of integrating merged MDCT/MRI data in 3D-mapping systems for structure-function assessment and multimodal guidance of VT mapping and ablation. METHODS Nine patients, including 3 ischemic cardiomyopathy (ICM), 3 nonischemic cardiomyopathy (NICM), 2 myocarditis, and 1 redo procedure for idiopathic VT, underwent MRI and MDCT before VT ablation. Merged MRI/MDCT data were integrated in 3D-mapping systems and registered to high-density endocardial and epicardial maps. Low-voltage areas (<1.5 mV) and local abnormal ventricular activities (LAVA) during sinus rhythm were correlated to DE at MRI, and wall-thinning (WT) at MDCT. RESULTS Endocardium and epicardium were mapped with 391 ± 388 and 1098 ± 734 points per map, respectively. Registration of MDCT allowed visualization of coronary arteries during epicardial mapping/ablation. In the idiopathic patient, integration of MRI data identified previously ablated regions. In ICM patients, both DE at MRI and WT at MDCT matched areas of low voltage (overlap 94 ± 6% and 79 ± 5%, respectively). In NICM patients, wall-thinning areas matched areas of low voltage (overlap 63 ± 21%). In patients with myocarditis, subepicardial DE matched areas of epicardial low voltage (overlap 92 ± 12%). A total number of 266 LAVA sites were found in 7/9 patients. All LAVA sites were associated to structural substrate at imaging (90% inside, 100% within 18 mm). CONCLUSION The integration of merged MDCT and DEMRI data is feasible and allows combining substrate assessment with high-spatial resolution to better define structure-function relationship in scar-related VT.

Length of the Mitral Isthmus But Not Anatomical Location of Ablation Line Predicts Bidirectional Mitral Isthmus Block in Patients Undergoing Catheter Ablation of Persistent Atrial Fibrillation: A Randomized Controlled Trial

INTRODUCTION Mitral isthmus (MI) ablation is an effective option in patients undergoing ablation for persistent atrial fibrillation (AF). Achieving bidirectional conduction block across the MI is challenging, and predictors of MI ablation success remain incompletely understood. We sought to determine the impact of anatomical location of the ablation line on the efficacy of MI ablation. METHODS AND RESULTS A total of 40 consecutive patients (87% male; 54 ± 10 years) undergoing stepwise AF ablation were included. MI ablation was performed in sinus rhythm. MI ablation was performed from the left inferior PV to either the posterior (group 1) or the anterolateral (group 2) mitral annulus depending on randomization. The length of the MI line (measured with the 3D mapping system) and the amplitude of the EGMs at 3 positions on the MI were measured in each patient. MI block was achieved in 14/19 (74%) patients in group 1 and 15/21 (71%) patients in group 2 (P = NS). Total MI radiofrequency time (18 ± 7 min vs. 17 ± 8 min; P = NS) was similar between groups. Patients with incomplete MI block had a longer MI length (34 ± 6 mm vs. 24 ± 5 mm; P < 0.001), a higher bipolar voltage along the MI (1.75 ± 0.74 mV vs. 1.05 ± 0.69 mV; P < 0.01), and a longer history of continuous AF (19 ± 17 months vs. 10 ± 10 months; P < 0.05). In multivariate analysis, decreased length of the MI was an independent predictor of successful MI block (OR 1.5; 95% CI 1.1-2.1; P < 0.05). CONCLUSIONS Increased length but not anatomical location of the MI predicts failure to achieve bidirectional MI block during ablation of persistent AF.