Datasets for the evaluation of multi-sensor perception in natural environments with challenging conditions

This paper presents large, accurately calibrated and time-synchronised datasets, gathered outdoors in controlled environmental conditions, using an unmanned ground vehicle (UGV), equipped with a wide variety of sensors. It discusses how the data collection process was designed, the conditions in which these datasets have been gathered, and some possible outcomes of their exploitation, in particular for the evaluation of performance of sensors and perception algorithms for UGVs.

Sensor Data Integrity : Multi-Sensor Perception for Unmanned Ground Vehicles

This document describes large, accurately calibrated and time-synchronised datasets, gathered in controlled environmental conditions, using an unmanned ground vehicle equipped with a wide variety of sensors. These sensors include: multiple laser scanners, a millimetre wave radar scanner, a colour camera and an infra-red camera. Full details of the sensors are given, as well as the calibration parameters needed to locate them with respect to each other and to the platform. This report also specifies the format and content of the data, and the conditions in which the data have been gathered. The data collection was made in two different situations of the vehicle: static and dynamic. The static tests consisted of sensing a fixed ’reference’ terrain, containing simple known objects, from a motionless vehicle. For the dynamic tests, data were acquired from a moving vehicle in various environments, mainly rural, including an open area, a semi-urban zone and a natural area with different types of vegetation. For both categories, data have been gathered in controlled environmental conditions, which included the presence of dust, smoke and rain. Most of the environments involved were static, except for a few specific datasets which involve the presence of a walking pedestrian. Finally, this document presents illustrations of the effects of adverse environmental conditions on sensor data, as a first step towards reliability and integrity in autonomous perceptual systems.

Vibrational spectroscopy of phthalocyanine and naphthalocyanine in sandwich-type (na)phthalocyaninato and porphyrinato rare earth complexes : (Part 10) The infrared and Raman characteristics of phthalocyanine in heteroleptic bis(phthalocyaninato) rare earth complexes with decreased molecular symmetry

The infrared (IR) spectroscopic data for a series of eleven heteroleptic bis(phthalocyaninato) rare earth complexes MIII(Pc)[Pc(α-OC5H11)4] (M = Sm–Lu, Y) [H2Pc = unsubstituted phthalocyanine, H2Pc(α-OC5H11)4 = 1,8,15,22-tetrakis(3-pentyloxy)phthalocyanine] have been collected with 2 cm−1 resolution. Raman spectroscopic properties in the range of 500–1800 cm−1 for these double-decker molecules have also been comparatively studied using laser excitation sources emitting at 632.8 and 785 nm. Both the IR and Raman spectra for M(Pc)[Pc(α-OC5H11)4] are more complicated than those of homoleptic bis(phthalocyaninato) rare earth analogues due to the decreased molecular symmetry of these double-decker compounds, namely C4. For this series, the IR Pc√− marker band appears as an intense absorption at 1309–1317 cm−1, attributed to the pyrrole stretching. With laser excitation at 632.8 nm, Raman vibrations derived from isoindole ring and aza stretchings in the range of 1300–1600 cm−1 are selectively intensified. In contrast, when excited with laser radiation of 785 nm, the ring radial vibrations of isoindole moieties and dihedral plane deformations between 500 and 1000 cm−1 for M(Pc)[Pc(α-OC5H11)4] intensify to become the strongest scatterings. Both techniques reveal that the frequencies of pyrrole stretching, isoindole breathing, isoindole stretchings, aza stretchings and coupling of pyrrole and aza stretchings depend on the rare earth ionic size, shifting to higher energy along with the lanthanide contraction due to the increased ring-ring interaction across the series. The assignments of the vibrational bands for these compounds have been made and discussed in relation to other unsubstituted and substituted bis(phthalocyaninato) rare earth analogues, such as M(Pc)2 and M(OOPc)2 [H2OOPc = 2,3,9,10,16,17,23,24-octakis(octyloxy)phthalocyanine].

Vibrational spectroscopy of phthalocyanine and naphthalocyanine in sandwich-type (na)phthalocyaninato and porphyrinato rare earth complexes: Part 14. The infrared and Raman characteristics of phthalocyanine in “pinwheel-like” homoleptic bis[1,8,15,22-tetrakis(3-pentyloxy)phthalocyaninato] rare earth(III) double-decker complexes

The infrared (IR) spectroscopic data and Raman spectroscopic properties for a series of 13 “pinwheel-like” homoleptic bis(phthalocyaninato) rare earth complexes M[Pc(α-OC5H11)4]2 [M = Y and Pr–Lu except Pm; H2Pc(α-OC5H11)4 = 1,8,15,22-tetrakis(3-pentyloxy)phthalocyanine] have been collected and comparatively studied. Both the IR and Raman spectra for M[Pc(α-OC5H11)4]2 are more complicated than those of homoleptic bis(phthalocyaninato) rare earth analogues, namely M(Pc)2 and M[Pc(OC8H17)8]2, but resemble (for IR) or are a bit more complicated (for Raman) than those of heteroleptic counterparts M(Pc)[Pc(α-OC5H11)4], revealing the decreased molecular symmetry of these double-decker compounds, namely S8. Except for the obvious splitting of the isoindole breathing band at 1110–1123 cm−1, the IR spectra of M[Pc(α-OC5H11)4]2 are quite similar to those of corresponding M(Pc)[Pc(α-OC5H11)4] and therefore are similarly assigned. With laser excitation at 633 nm, Raman bands derived from isoindole ring and aza stretchings in the range of 1300–1600 cm−1 are selectively intensified. The IR spectra reveal that the frequencies of pyrrole stretching and pyrrole stretching coupled with the symmetrical CH bending of –CH3 groups are sensitive to the rare earth ionic size, while the Raman technique shows that the bands due to the isoindole stretchings and the coupled pyrrole and aza stretchings are similarly affected. Nevertheless, the phthalocyanine monoanion radical Pc′− IR marker band of bis(phthalocyaninato) complexes involving the same rare earth ion is found to shift to lower energy in the order M(Pc)2 > M(Pc)[Pc(α-OC5H11)4] > M[Pc(α-OC5H11)4]2, revealing the weakened π–π interaction between the two phthalocyanine rings in the same order.

Inactivation and structural changes of E. Cloacae and B. Subtilis Endospores during IR laser water treatment

IR radiation has been studied for micro-organism inactivation of bacterial spores on metal substrates [1] and on metal and paper substrates [2]. A near-point near infrared laser water treatment apparatus for use in dental hand-pieces was also developed [3]. To date water sterilisation research using a mid-IR laser technique is very rare. According to the World Health Organisation [4], examinations for faecal indicator bacteria remain the most sensitive and specific way of assessing the hygienic quality of water. Bacteria that fall into this group are E. coli, other coliform bacteria (including E. cloacae) and to a lesser extent, faecal streptococci [5]. Protozoan cysts from organisms which cause giardiasis are the most frequently identified cause of waterborne diseases in developed countries [6,7]. The use of aerobic bacterial endospores to monitor the efficiency of various water treatments has been shown to provide a reliable and simple indicator of overall performance of water treatment[8,9].The efficacy of IR radiation for water disinfection compared to UV treatment has been further investigated in the present study. In addition FTIR spectroscopy in conjunction with Principle Component Analysis was used to characterise structural changes within the bacterial cells and endospores following IR laser treatment. Changes in carbohydrate content of E. cloacae following IR laser treatment were observed.

Near infrared spectroscopy for non-destructive evaluation of articular cartilage

There is a need for an accurate real-time quantitative system that would enhance decision-making in the treatment of osteoarthritis. To achieve this objective, significant research is required that will enable articular cartilage properties to be measured and categorized for health and functionality without the need for laboratory tests involving biopsies for pathological evaluation. Such a system would provide the capability of access to the internal condition of the cartilage matrix and thus extend the vision-based arthroscopy that is currently used beyond the subjective evaluation of surgeons. The system required must be able to non-destructively probe the entire thickness of the cartilage and its immediate subchondral bone layer. In this thesis, near infrared spectroscopy is investigated for the purpose mentioned above. The aim is to relate it to the structure and load bearing properties of the cartilage matrix to the near infrared absorption spectrum and establish functional relationships that will provide objective, quantitative and repeatable categorization of cartilage condition outside the area of visible degradation in a joint. Based on results from traditional mechanical testing, their innovative interpretation and relationship with spectroscopic data, new parameters were developed. These were then evaluated for their consistency in discriminating between healthy viable and degraded cartilage. The mechanical and physico-chemical properties were related to specific regions of the near infrared absorption spectrum that were identified as part of the research conducted for this thesis. The relationships between the tissue's near infrared spectral response and the new parameters were modeled using multivariate statistical techniques based on partial least squares regression (PLSR). With significantly high levels of statistical correlation, the modeled relationships were demonstrated to possess considerable potential in predicting the properties of unknown tissue samples in a quick and non-destructive manner. In order to adapt near infrared spectroscopy for clinical applications, a balance between probe diameter and the number of active transmit-receive optic fibres must be optimized. This was achieved in the course of this research, resulting in an optimal probe configuration that could be adapted for joint tissue evaluation. Furthermore, as a proof-of-concept, a protocol for obtaining the new parameters from the near infrared absorption spectra of cartilage was developed and implemented in a graphical user interface (GUI)-based software, and used to assess cartilage-on-bone samples in vitro. This conceptual implementation has been demonstrated, in part by the individual parametric relationship with the near infrared absorption spectrum, the capacity of the proposed system to facilitate real-time, non-destructive evaluation of cartilage matrix integrity. In summary, the potential of the optical near infrared spectroscopy for evaluating articular cartilage and bone laminate has been demonstrated in this thesis. The approach could have a spin-off for other soft tissues and organs of the body. It builds on the earlier work of the group at QUT, enhancing the near infrared component of the ongoing research on developing a tool for cartilage evaluation that goes beyond visual and subjective methods.

Hand-held monocular SLAM in thermal-infrared

Thermal-infrared imagery is relatively robust to many of the failure conditions of visual and laser-based SLAM systems, such as fog, dust and smoke. The ability to use thermal-infrared video for localization is therefore highly appealing for many applications. However, operating in thermal-infrared is beyond the capacity of existing SLAM implementations. This paper presents the first known monocular SLAM system designed and tested for hand-held use in the thermal-infrared modality. The implementation includes a flexible feature detection layer able to achieve robust feature tracking in high-noise, low-texture thermal images. A novel approach for structure initialization is also presented. The system is robust to irregular motion and capable of handling the unique mechanical shutter interruptions common to thermal-infrared cameras. The evaluation demonstrates promising performance of the algorithm in several environments.

Chitosan adhesive for laser tissue repair: In vitro characterization

Background and Objectives Laser tissue repair usually relies on hemoderivate protein solders, based on serum albumin. These solders have intrinsic limitations that impair their widespread use, such as limited tensile strength of repaired tissue, poor solder solubility, and brittleness prior to laser denaturation. Furthermore, the required activation temperature of albumin solders (between 65 and 70°C) can induce significant thermal damage to tissue. In this study, we report on the design of a new polysaccharide adhesive for tissue repair that overcomes some of the shortcomings of traditional solders. Study Design/Materials and Methods Flexible and insoluble strips of chitosan adhesive (elastic modulus ~6.8 Mpa, surface area ~34 mm2, thickness ~20 µm) were bonded onto rectangular sections of sheep intestine using a diode laser (continuous mode, 120 ± 10 mW, = λ 808 nm) through a multimode optical fiber with an irradiance of ~15 W/cm2. The adhesive was based on chitosan and also included indocyanin green dye (IG). The temperature between tissue and adhesive was measured using a small thermocouple (diameter ~0.25 mm) during laser irradiation. The repaired tissue was tested for tensile strength by a calibrated tensiometer. Murine fibroblasts were cultured in extracted media from chitosan adhesive to assess cytotoxicity via cell growth inhibition in a 48 hours period. Results Chitosan adhesive successfully repaired intestine tissue, achieving a tensile strength of 14.7 ± 4.7 kPa (mean ± SD, n = 30) at a temperature of 60-65°C. Media extracted from chitosan adhesive showed negligible toxicity to fibroblast cells under the culture conditions examined here. Conclusion A novel chitosan-based adhesive has been developed, which is insoluble, flexible, and adheres firmly to tissue upon infrared laser activation.

Non-parametric consistency test for multiple-sensing-modality data fusion

Fusing data from multiple sensing modalities, e.g. laser and radar, is a promising approach to achieve resilient perception in challenging environmental conditions. However, this may lead to \emph{catastrophic fusion} in the presence of inconsistent data, i.e. when the sensors do not detect the same target due to distinct attenuation properties. It is often difficult to discriminate consistent from inconsistent data across sensing modalities using local spatial information alone. In this paper we present a novel consistency test based on the log marginal likelihood of a Gaussian process model that evaluates data from range sensors in a relative manner. A new data point is deemed to be consistent if the model statistically improves as a result of its fusion. This approach avoids the need for absolute spatial distance threshold parameters as required by previous work. We report results from object reconstruction with both synthetic and experimental data that demonstrate an improvement in reconstruction quality, particularly in cases where data points are inconsistent yet spatially proximal.

Near-infrared spectroscopic study of basic aluminum sulfate and nitrate

The tridecameric Al-polymer [AlO4Al12(OH)24(H2O)12]7+ was prepared by forced hydrolysis of Al3+ up to an OH/Al molar ratio of 2.2. Under slow evaporation crystals were formed of Al13-nitrate. Upon addition of sulfate the tridecamer crystallised as the monoclinic Al13-sulfate. These crystals have been studied using near-infrared spectroscopy and compared to Al2(SO4)3.16H2O. Although the near-infrared spectra of the Al13-sulfate and nitrate are very similar indicating similar crystal structures, there are minor differences related to the strength with which the crystal water molecules are bonded to the salt groups. The interaction between crystal water and nitrate is stronger than with the sulfate as reflected by the shift of the crystal water band positions from 6213, 4874 and 4553 cm–1 for the Al13 sulfate towards 5925, 4848 and 4532 cm–1 for the nitrate. A reversed shift from 5079 and 5037 cm–1 for the sulfate towards 5238 and 5040 cm–1 for the nitrate for the water molecules in the Al13 indicate that the nitrate-Al13 bond is weakened due to the influence of the crystal water on the nitrate. The Al-OH bond in the Al13 complex is not influenced by changing the salt group due to the shielding by the water molecules of the Al13 complex.

Thermal Treatments of Fe—Mn Alkoxide of Glycerol: Infrared absorption and emission

Synthetic Fe—Mn alkoxide of glycerol samples are submitted to controlled heating conditions and examined by IR absorption spectroscopy. On the other hand, the same sample is studied by infrared emission spectroscopy (IRES), upon heating in situ from 100 to 600°C. The spectral techniques employed in this contribution, especially IRES, show that as a result of the thermal treatments ferromagnetic oxides (manganese ferrite) are formed between 350 and 400°C. Some further spectral changes are seen at higher temperatures.

An infrared spectroscopic study of the some Autunite minerals

A series of selected autunites with phosphate as the anion have been studied using infrared spectroscopy. Each autunite mineral has its own characteristic spectrum. The spectra for different autunites with the same composition are different. It is proposed that this difference is due to the structure of water and hydrated cations in the interlayer region between the uranyl phosphate sheets. This structure is different for different autunites. The position of the water hydroxyl stretching bands is related to the strength of the hydrogen bonds as determined by hydrogen bond distance. The highly ordered structure of water is also observed in the water HOH bending modes where a high wavenumber bands are observed. The phosphate and uranyl stretching vibrations overlap and are obtained by curve resolution.