Visual metrics for the evaluation of sensor data quality in outdoor perception

This paper proposes an experimental study of quality metrics that can be applied to visual and infrared images acquired from cameras onboard an unmanned ground vehicle (UGV). The relevance of existing metrics in this context is discussed and a novel metric is introduced. Selected metrics are evaluated on data collected by a UGV in clear and challenging environmental conditions, represented in this paper by the presence of airborne dust or smoke. An example of application is given with monocular SLAM estimating the pose of the UGV while smoke is present in the environment. It is shown that the proposed novel quality metric can be used to anticipate situations where the quality of the pose estimate will be significantly degraded due to the input image data. This leads to decisions of advantageously switching between data sources (e.g. using infrared images instead of visual images).

Visual metrics for the evaluation of sensor data quality in outdoor perception

This paper proposes an experimental study of quality metrics that can be applied to visual and infrared images acquired from cameras onboard an unmanned ground vehicle (UGV). The relevance of existing metrics in this context is discussed and a novel metric is introduced. Selected metrics are evaluated on data collected by a UGV in clear and challenging environmental conditions, represented in this paper by the presence of airborne dust or smoke.

Sensor Data Integrity : Multi-Sensor Perception for Unmanned Ground Vehicles

This document describes large, accurately calibrated and time-synchronised datasets, gathered in controlled environmental conditions, using an unmanned ground vehicle equipped with a wide variety of sensors. These sensors include: multiple laser scanners, a millimetre wave radar scanner, a colour camera and an infra-red camera. Full details of the sensors are given, as well as the calibration parameters needed to locate them with respect to each other and to the platform. This report also specifies the format and content of the data, and the conditions in which the data have been gathered. The data collection was made in two different situations of the vehicle: static and dynamic. The static tests consisted of sensing a fixed ’reference’ terrain, containing simple known objects, from a motionless vehicle. For the dynamic tests, data were acquired from a moving vehicle in various environments, mainly rural, including an open area, a semi-urban zone and a natural area with different types of vegetation. For both categories, data have been gathered in controlled environmental conditions, which included the presence of dust, smoke and rain. Most of the environments involved were static, except for a few specific datasets which involve the presence of a walking pedestrian. Finally, this document presents illustrations of the effects of adverse environmental conditions on sensor data, as a first step towards reliability and integrity in autonomous perceptual systems.

Design and flight testing of an integrated solar powered UAV and WSN for remote gas sensing

This paper describes a generic and integrated solar powered remote Unmanned Air Vehicles (UAV) and Wireless Sensor Network (WSN) gas sensing system. The system uses a generic gas sensing system for CH4 and CO2 concentrations using metal oxide (MoX) and non-dispersive infrared sensors, and a new solar cell encapsulation method to power the UASs as well as a data management platform to store, analyse and share the information with operators and external users. The system was successfully field tested at ground and low altitudes, collecting, storing and transmitting data in real time to a central node for analysis and 3D mapping. The system can be used in a wide range of outdoor applications, especially in agriculture, bushfires, mining studies, opening the way to a ubiquitous low cost environmental monitoring. A video of the bench and flight test performed can be seen in the following link https://www.youtube.com/watch?v=Bwas7stYIxQ.

Handheld 3D thermography using range sensing and computer vision

This thesis developed a method for real-time and handheld 3D temperature mapping using a combination of off-the-shelf devices and efficient computer algorithms. It contributes a new sensing and data processing framework to the science of 3D thermography, unlocking its potential for application areas such as building energy auditing and industrial monitoring. New techniques for the precise calibration of multi-sensor configurations were developed, along with several algorithms that ensure both accurate and comprehensive surface temperature estimates can be made for rich 3D models as they are generated by a non-expert user.

Development of gas sensing technology for ground and airborne applications powered by solar energy : methodology and experimental results

Monitoring gases for environmental, industrial and agricultural fields is a demanding task that requires long periods of observation, large quantity of sensors, data management, high temporal and spatial resolution, long term stability, recalibration procedures, computational resources, and energy availability. Wireless Sensor Networks (WSNs) and Unmanned Aerial Vehicles (UAVs) are currently representing the best alternative to monitor large, remote, and difficult access areas, as these technologies have the possibility of carrying specialised gas sensing systems, and offer the possibility of geo-located and time stamp samples. However, these technologies are not fully functional for scientific and commercial applications as their development and availability is limited by a number of factors: the cost of sensors required to cover large areas, their stability over long periods, their power consumption, and the weight of the system to be used on small UAVs. Energy availability is a serious challenge when WSN are deployed in remote areas with difficult access to the grid, while small UAVs are limited by the energy in their reservoir tank or batteries. Another important challenge is the management of data produced by the sensor nodes, requiring large amount of resources to be stored, analysed and displayed after long periods of operation. In response to these challenges, this research proposes the following solutions aiming to improve the availability and development of these technologies for gas sensing monitoring: first, the integration of WSNs and UAVs for environmental gas sensing in order to monitor large volumes at ground and aerial levels with a minimum of sensor nodes for an effective 3D monitoring; second, the use of solar energy as a main power source to allow continuous monitoring; and lastly, the creation of a data management platform to store, analyse and share the information with operators and external users. The principal outcomes of this research are the creation of a gas sensing system suitable for monitoring any kind of gas, which has been installed and tested on CH4 and CO2 in a sensor network (WSN) and on a UAV. The use of the same gas sensing system in a WSN and a UAV reduces significantly the complexity and cost of the application as it allows: a) the standardisation of the signal acquisition and data processing, thereby reducing the required computational resources; b) the standardisation of calibration and operational procedures, reducing systematic errors and complexity; c) the reduction of the weight and energy consumption, leading to an improved power management and weight balance in the case of UAVs; d) the simplification of the sensor node architecture, which is easily replicated in all the nodes. I evaluated two different sensor modules by laboratory, bench, and field tests: a non-dispersive infrared module (NDIR) and a metal-oxide resistive nano-sensor module (MOX nano-sensor). The tests revealed advantages and disadvantages of the two modules when used for static nodes at the ground level and mobile nodes on-board a UAV. Commercial NDIR modules for CO2 have been successfully tested and evaluated in the WSN and on board of the UAV. Their advantage is the precision and stability, but their application is limited to a few gases. The advantages of the MOX nano-sensors are the small size, low weight, low power consumption and their sensitivity to a broad range of gases. However, selectivity is still a concern that needs to be addressed with further studies. An electronic board to interface sensors in a large range of resistivity was successfully designed, created and adapted to operate on ground nodes and on-board UAV. The WSN and UAV created were powered with solar energy in order to facilitate outdoor deployment, data collection and continuous monitoring over large and remote volumes. The gas sensing, solar power, transmission and data management systems of the WSN and UAV were fully evaluated by laboratory, bench and field testing. The methodology created to design, developed, integrate and test these systems was extensively described and experimentally validated. The sampling and transmission capabilities of the WSN and UAV were successfully tested in an emulated mission involving the detection and measurement of CO2 concentrations in a field coming from a contaminant source; the data collected during the mission was transmitted in real time to a central node for data analysis and 3D mapping of the target gas. The major outcome of this research is the accomplishment of the first flight mission, never reported before in the literature, of a solar powered UAV equipped with a CO2 sensing system in conjunction with a network of ground sensor nodes for an effective 3D monitoring of the target gas. A data management platform was created using an external internet server, which manages, stores, and shares the data collected in two web pages, showing statistics and static graph images for internal and external users as requested. The system was bench tested with real data produced by the sensor nodes and the architecture of the platform was widely described and illustrated in order to provide guidance and support on how to replicate the system. In conclusion, the overall results of the project provide guidance on how to create a gas sensing system integrating WSNs and UAVs, how to power the system with solar energy and manage the data produced by the sensor nodes. This system can be used in a wide range of outdoor applications, especially in agriculture, bushfires, mining studies, zoology, and botanical studies opening the way to an ubiquitous low cost environmental monitoring, which may help to decrease our carbon footprint and to improve the health of the planet.

Near-infrared spectroscopic study of basic aluminum sulfate and nitrate

The tridecameric Al-polymer [AlO4Al12(OH)24(H2O)12]7+ was prepared by forced hydrolysis of Al3+ up to an OH/Al molar ratio of 2.2. Under slow evaporation crystals were formed of Al13-nitrate. Upon addition of sulfate the tridecamer crystallised as the monoclinic Al13-sulfate. These crystals have been studied using near-infrared spectroscopy and compared to Al2(SO4)3.16H2O. Although the near-infrared spectra of the Al13-sulfate and nitrate are very similar indicating similar crystal structures, there are minor differences related to the strength with which the crystal water molecules are bonded to the salt groups. The interaction between crystal water and nitrate is stronger than with the sulfate as reflected by the shift of the crystal water band positions from 6213, 4874 and 4553 cm–1 for the Al13 sulfate towards 5925, 4848 and 4532 cm–1 for the nitrate. A reversed shift from 5079 and 5037 cm–1 for the sulfate towards 5238 and 5040 cm–1 for the nitrate for the water molecules in the Al13 indicate that the nitrate-Al13 bond is weakened due to the influence of the crystal water on the nitrate. The Al-OH bond in the Al13 complex is not influenced by changing the salt group due to the shielding by the water molecules of the Al13 complex.

Thermal Treatments of Fe—Mn Alkoxide of Glycerol: Infrared absorption and emission

Synthetic Fe—Mn alkoxide of glycerol samples are submitted to controlled heating conditions and examined by IR absorption spectroscopy. On the other hand, the same sample is studied by infrared emission spectroscopy (IRES), upon heating in situ from 100 to 600°C. The spectral techniques employed in this contribution, especially IRES, show that as a result of the thermal treatments ferromagnetic oxides (manganese ferrite) are formed between 350 and 400°C. Some further spectral changes are seen at higher temperatures.

Vibrational spectroscopy of phthalocyanine and naphthalocyanine in sandwich-type (na)phthalocyaninato and porphyrinato rare earth complexes : (Part 10) The infrared and Raman characteristics of phthalocyanine in heteroleptic bis(phthalocyaninato) rare earth complexes with decreased molecular symmetry

The infrared (IR) spectroscopic data for a series of eleven heteroleptic bis(phthalocyaninato) rare earth complexes MIII(Pc)[Pc(α-OC5H11)4] (M = Sm–Lu, Y) [H2Pc = unsubstituted phthalocyanine, H2Pc(α-OC5H11)4 = 1,8,15,22-tetrakis(3-pentyloxy)phthalocyanine] have been collected with 2 cm−1 resolution. Raman spectroscopic properties in the range of 500–1800 cm−1 for these double-decker molecules have also been comparatively studied using laser excitation sources emitting at 632.8 and 785 nm. Both the IR and Raman spectra for M(Pc)[Pc(α-OC5H11)4] are more complicated than those of homoleptic bis(phthalocyaninato) rare earth analogues due to the decreased molecular symmetry of these double-decker compounds, namely C4. For this series, the IR Pc√− marker band appears as an intense absorption at 1309–1317 cm−1, attributed to the pyrrole stretching. With laser excitation at 632.8 nm, Raman vibrations derived from isoindole ring and aza stretchings in the range of 1300–1600 cm−1 are selectively intensified. In contrast, when excited with laser radiation of 785 nm, the ring radial vibrations of isoindole moieties and dihedral plane deformations between 500 and 1000 cm−1 for M(Pc)[Pc(α-OC5H11)4] intensify to become the strongest scatterings. Both techniques reveal that the frequencies of pyrrole stretching, isoindole breathing, isoindole stretchings, aza stretchings and coupling of pyrrole and aza stretchings depend on the rare earth ionic size, shifting to higher energy along with the lanthanide contraction due to the increased ring-ring interaction across the series. The assignments of the vibrational bands for these compounds have been made and discussed in relation to other unsubstituted and substituted bis(phthalocyaninato) rare earth analogues, such as M(Pc)2 and M(OOPc)2 [H2OOPc = 2,3,9,10,16,17,23,24-octakis(octyloxy)phthalocyanine].

Vibrational spectroscopy of phthalocyanine and naphthalocyanine in sandwich-type (na)phthalocyaninato and porphyrinato rare earth complexes: Part 14. The infrared and Raman characteristics of phthalocyanine in “pinwheel-like” homoleptic bis[1,8,15,22-tetrakis(3-pentyloxy)phthalocyaninato] rare earth(III) double-decker complexes

The infrared (IR) spectroscopic data and Raman spectroscopic properties for a series of 13 “pinwheel-like” homoleptic bis(phthalocyaninato) rare earth complexes M[Pc(α-OC5H11)4]2 [M = Y and Pr–Lu except Pm; H2Pc(α-OC5H11)4 = 1,8,15,22-tetrakis(3-pentyloxy)phthalocyanine] have been collected and comparatively studied. Both the IR and Raman spectra for M[Pc(α-OC5H11)4]2 are more complicated than those of homoleptic bis(phthalocyaninato) rare earth analogues, namely M(Pc)2 and M[Pc(OC8H17)8]2, but resemble (for IR) or are a bit more complicated (for Raman) than those of heteroleptic counterparts M(Pc)[Pc(α-OC5H11)4], revealing the decreased molecular symmetry of these double-decker compounds, namely S8. Except for the obvious splitting of the isoindole breathing band at 1110–1123 cm−1, the IR spectra of M[Pc(α-OC5H11)4]2 are quite similar to those of corresponding M(Pc)[Pc(α-OC5H11)4] and therefore are similarly assigned. With laser excitation at 633 nm, Raman bands derived from isoindole ring and aza stretchings in the range of 1300–1600 cm−1 are selectively intensified. The IR spectra reveal that the frequencies of pyrrole stretching and pyrrole stretching coupled with the symmetrical CH bending of –CH3 groups are sensitive to the rare earth ionic size, while the Raman technique shows that the bands due to the isoindole stretchings and the coupled pyrrole and aza stretchings are similarly affected. Nevertheless, the phthalocyanine monoanion radical Pc′− IR marker band of bis(phthalocyaninato) complexes involving the same rare earth ion is found to shift to lower energy in the order M(Pc)2 > M(Pc)[Pc(α-OC5H11)4] > M[Pc(α-OC5H11)4]2, revealing the weakened π–π interaction between the two phthalocyanine rings in the same order.

An infrared spectroscopic study of the some Autunite minerals

A series of selected autunites with phosphate as the anion have been studied using infrared spectroscopy. Each autunite mineral has its own characteristic spectrum. The spectra for different autunites with the same composition are different. It is proposed that this difference is due to the structure of water and hydrated cations in the interlayer region between the uranyl phosphate sheets. This structure is different for different autunites. The position of the water hydroxyl stretching bands is related to the strength of the hydrogen bonds as determined by hydrogen bond distance. The highly ordered structure of water is also observed in the water HOH bending modes where a high wavenumber bands are observed. The phosphate and uranyl stretching vibrations overlap and are obtained by curve resolution.

Thermal treatment of weddellite—a Raman and infrared emission spectroscopic study

Thermal transformations of natural calcium oxalate dihydrate known in mineralogy as weddellite have been undertaken using a combination of Raman microscopy and infrared emission spectroscopy. The vibrational spectroscopic data was complimented with high resolution thermogravimetric analysis combined with evolved gas mass spectrometry. TG–MS identified three mass loss steps at 114, 422 and 592 °C. In the first mass loss step water is evolved only, in the second and third steps carbon dioxide is evolved. The combination of Raman microscopy and a thermal stage clearly identifies the changes in the molecular structure with thermal treatment. Weddellite is the phase in the temperature range up to the pre-dehydration temperature of 97 °C. At this temperature, the phase formed is whewellite (calcium oxalate monohydrate) and above 114 °C the phase is the anhydrous calcium oxalate. Above 422 °C, calcium carbonate is formed. Infrared emission spectroscopy shows that this mineral decomposes at around 650 °C. Changes in the position and intensity of the C=O and C---C stretching vibrations in the Raman spectra indicate the temperature range at which these phase changes occur.