Airborne vision-based collision-detection system

Machine vision represents a particularly attractive solution for sensing and detecting potential collision-course targets due to the relatively low cost, size, weight, and power requirements of vision sensors (as opposed to radar and TCAS). This paper describes the development and evaluation of a real-time vision-based collision detection system suitable for fixed-wing aerial robotics. Using two fixed-wing UAVs to recreate various collision-course scenarios, we were able to capture highly realistic vision (from an onboard camera perspective) of the moments leading up to a collision. This type of image data is extremely scarce and was invaluable in evaluating the detection performance of two candidate target detection approaches. Based on the collected data, our detection approaches were able to detect targets at distances ranging from 400m to about 900m. These distances (with some assumptions about closing speeds and aircraft trajectories) translate to an advanced warning of between 8-10 seconds ahead of impact, which approaches the 12.5 second response time recommended for human pilots. We overcame the challenge of achieving real-time computational speeds by exploiting the parallel processing architectures of graphics processing units found on commercially-off-the-shelf graphics devices. Our chosen GPU device suitable for integration onto UAV platforms can be expected to handle real-time processing of 1024 by 768 pixel image frames at a rate of approximately 30Hz. Flight trials using manned Cessna aircraft where all processing is performed onboard will be conducted in the near future, followed by further experiments with fully autonomous UAV platforms.

Electron beam evaporation of tungsten oxide films for gas sensors

Pure and Iron incorporated nanostructured Tungsten Oxide (WO3) thin films were investigated for gas sensing applications using noise spectroscopy. The WO3 sensor was able to detect lower concentrations (1 ppm-10 ppm) of NH3, CO, CH4 and Acetaldehyde gases at operating temperatures between 100 degrees celcius to 250 degrees celcius. The iron doped Tungsten Oxide sensor (WO3:Fe) showed some response to Acetaldehyde gas at relatively higher operating temperature (250 degrees celcius) and gas concentration of 10 ppm. The sensitivity of the WO3 sensor towards NH3, CH4 and Acetaldehyde at lower operating temperatures (50 degrees celcius - 100 degrees celcius) was significant when the sensor was photo-activated using blue-light emitting diode (Blue-LED). From the results, photo-activated WO3 thin film that operates at room temperature appeared to be a promising gas sensor. The overall results indicated that the WO3 sensor exhibited reproducibility for the detection of various gases and the WO3:Fe indicated some response towards Acetaldehyde gas.

Localization and navigation assisted by cooperating networked sensors and robots

In this paper we discuss how a network of sensors and robots can cooperate to solve important robotics problems such as localization and navigation. We use a robot to localize sensor nodes, and we then use these localized nodes to navigate robots and humans through the sensorized space. We explore these novel ideas with results from two large-scale sensor network and robot experiments involving 50 motes, two types of flying robot: an autonomous helicopter and a large indoor cable array robot, and a human-network interface. We present the distributed algorithms for localization, geographic routing, path definition and incremental navigation. We also describe how a human can be guided using a simple hand-held device that interfaces to this same environmental infrastructure.

ElectricCOW : A simulator for mobile sensors and actuators mounted on herds of cattle

ElectricCOW is a network, animal behaviour and agent simulator designed to allow detailed simulation of an ad-hoc model network built from small mote-like devices called flecks. Detailed radio communications, cattle behaviour and sensor and actuator network modelling allows a closed-loop environment, where the network can influence the behaviour of its mobile platforms.

A hidden Markov model and relative entropy rate approach to vision-based dim target detection for UAV sense-and-avoid

Uninhabited aerial vehicles (UAVs) are a cutting-edge technology that is at the forefront of aviation/aerospace research and development worldwide. Many consider their current military and defence applications as just a token of their enormous potential. Unlocking and fully exploiting this potential will see UAVs in a multitude of civilian applications and routinely operating alongside piloted aircraft. The key to realising the full potential of UAVs lies in addressing a host of regulatory, public relation, and technological challenges never encountered be- fore. Aircraft collision avoidance is considered to be one of the most important issues to be addressed, given its safety critical nature. The collision avoidance problem can be roughly organised into three areas: 1) Sense; 2) Detect; and 3) Avoid. Sensing is concerned with obtaining accurate and reliable information about other aircraft in the air; detection involves identifying potential collision threats based on available information; avoidance deals with the formulation and execution of appropriate manoeuvres to maintain safe separation. This thesis tackles the detection aspect of collision avoidance, via the development of a target detection algorithm that is capable of real-time operation onboard a UAV platform. One of the key challenges of the detection problem is the need to provide early warning. This translates to detecting potential threats whilst they are still far away, when their presence is likely to be obscured and hidden by noise. Another important consideration is the choice of sensors to capture target information, which has implications for the design and practical implementation of the detection algorithm. The main contributions of the thesis are: 1) the proposal of a dim target detection algorithm combining image morphology and hidden Markov model (HMM) filtering approaches; 2) the novel use of relative entropy rate (RER) concepts for HMM filter design; 3) the characterisation of algorithm detection performance based on simulated data as well as real in-flight target image data; and 4) the demonstration of the proposed algorithm's capacity for real-time target detection. We also consider the extension of HMM filtering techniques and the application of RER concepts for target heading angle estimation. In this thesis we propose a computer-vision based detection solution, due to the commercial-off-the-shelf (COTS) availability of camera hardware and the hardware's relatively low cost, power, and size requirements. The proposed target detection algorithm adopts a two-stage processing paradigm that begins with an image enhancement pre-processing stage followed by a track-before-detect (TBD) temporal processing stage that has been shown to be effective in dim target detection. We compare the performance of two candidate morphological filters for the image pre-processing stage, and propose a multiple hidden Markov model (MHMM) filter for the TBD temporal processing stage. The role of the morphological pre-processing stage is to exploit the spatial features of potential collision threats, while the MHMM filter serves to exploit the temporal characteristics or dynamics. The problem of optimising our proposed MHMM filter has been examined in detail. Our investigation has produced a novel design process for the MHMM filter that exploits information theory and entropy related concepts. The filter design process is posed as a mini-max optimisation problem based on a joint RER cost criterion. We provide proof that this joint RER cost criterion provides a bound on the conditional mean estimate (CME) performance of our MHMM filter, and this in turn establishes a strong theoretical basis connecting our filter design process to filter performance. Through this connection we can intelligently compare and optimise candidate filter models at the design stage, rather than having to resort to time consuming Monte Carlo simulations to gauge the relative performance of candidate designs. Moreover, the underlying entropy concepts are not constrained to any particular model type. This suggests that the RER concepts established here may be generalised to provide a useful design criterion for multiple model filtering approaches outside the class of HMM filters. In this thesis we also evaluate the performance of our proposed target detection algorithm under realistic operation conditions, and give consideration to the practical deployment of the detection algorithm onboard a UAV platform. Two fixed-wing UAVs were engaged to recreate various collision-course scenarios to capture highly realistic vision (from an onboard camera perspective) of the moments leading up to a collision. Based on this collected data, our proposed detection approach was able to detect targets out to distances ranging from about 400m to 900m. These distances, (with some assumptions about closing speeds and aircraft trajectories) translate to an advanced warning ahead of impact that approaches the 12.5 second response time recommended for human pilots. Furthermore, readily available graphic processing unit (GPU) based hardware is exploited for its parallel computing capabilities to demonstrate the practical feasibility of the proposed target detection algorithm. A prototype hardware-in- the-loop system has been found to be capable of achieving data processing rates sufficient for real-time operation. There is also scope for further improvement in performance through code optimisations. Overall, our proposed image-based target detection algorithm offers UAVs a cost-effective real-time target detection capability that is a step forward in ad- dressing the collision avoidance issue that is currently one of the most significant obstacles preventing widespread civilian applications of uninhabited aircraft. We also highlight that the algorithm development process has led to the discovery of a powerful multiple HMM filtering approach and a novel RER-based multiple filter design process. The utility of our multiple HMM filtering approach and RER concepts, however, extend beyond the target detection problem. This is demonstrated by our application of HMM filters and RER concepts to a heading angle estimation problem.

Vision based control for fixed wing UAVs inspecting locally linear infrastructure using skid-to-turn maneuvers

The following paper proposes a novel application of Skid-to-Turn maneuvers for fixed wing Unmanned Aerial Vehicles (UAVs) inspecting locally linear infrastructure. Fixed wing UAVs, following the design of manned aircraft, commonly employ Bank-to-Turn ma- neuvers to change heading and thus direction of travel. Whilst effective, banking an aircraft during the inspection of ground based features hinders data collection, with body fixed sen- sors angled away from the direction of turn and a panning motion induced through roll rate that can reduce data quality. By adopting Skid-to-Turn maneuvers, the aircraft can change heading whilst maintaining wings level flight, thus allowing body fixed sensors to main- tain a downward facing orientation. An Image-Based Visual Servo controller is developed to directly control the position of features as captured by onboard inspection sensors. This improves on the indirect approach taken by other tracking controllers where a course over ground directly above the feature is assumed to capture it centered in the field of view. Performance of the proposed controller is compared against that of a Bank-to-Turn tracking controller driven by GPS derived cross track error in a simulation environment developed to replicate the field of view of a body fixed camera.

An investigation of rail condition monitoring by Fibre Bragg Grating sensors

Condition monitoring on rails and train wheels is vitally important to the railway asset management and the rail-wheel interactions provide the crucial information of the health state of both rails and wheels. Continuous and remote monitoring is always a preference for operators. With a new generation of strain sensing devices in Fibre Bragg Grating (FBG) sensors, this study explores the possibility of continuous monitoring of the health state of the rails; and investigates the required signal processing techniques and their limitations.

A crash avoidance framework for heavy equipment control systems using 3D imaging sensors

This paper presents a preliminary crash avoidance framework for heavy equipment control systems. Safe equipment operation is a major concern on construction sites since fatal on-site injuries are an industry-wide problem. The proposed framework has potential for effecting active safety for equipment operation. The framework contains algorithms for spatial modeling, object tracking, and path planning. Beyond generating spatial models in fractions of seconds, these algorithms can successfully track objects in an environment and produce a collision-free 3D motion trajectory for equipment.

Using Fiber Bragg Grating (FBG) sensors to measure vertical displacements of bridges : a preliminary study

In many bridges, vertical displacements are the most relevant parameter for monitoring in the both short and long term. However, it is difficult to measure vertical displacements of bridges and yet they are among the most important indicators of structural behaviour. Therefore, it prompts a need to develop a simple, inexpensive and yet more practical method to measure vertical displacements of bridges. With the development of fiber-optics technologies, fiber Bragg grating (FBG) sensors have been widely used in structural health monitoring. The advantages of these sensors over the conventional sensors include multiplexing capabilities, high sample rate, small size and electro magnetic interference (EMI) immunity. In this paper, methods of vertical displacement measurements of bridges are first reviewed. Then, FBG technology is briefly introduced including principle, sensing system, characteristics and different types of FBG sensors. Finally, the methodology of vertical displacement measurements using FBG sensors is presented and a trial test is described. It is concluded that using FBG sensors is feasible to measure vertical displacements of bridges. This method can be used to understand global behaviour of bridge‘s span and can further develop for structural health monitoring techniques such as damage detection.

Porphyrin containing isoindoline nitroxides as potential fluorescence sensors of free radicals

A series of new spin-labeled porphyrin containing isoindoline nitroxide moieties were synthesized and characterized as potential free radical fluorescence sensors. Fluorescence-suppression was observed in the free-base monoradical porphyrins, whilst the free-base biradical porphyrins exhibited highly suppressed fluorescence about three times greater than the monoradical porphyrins. The observed fluorescence-suppression was attributed to enhanced intersystem crossing resulting from electronexchange between the doublet nitroxide and the excited porphyrin fluorophore. Notably, fluorescencesuppression was not as strong in the related metalated porphyrins, possibly due to insufficient spin coupling between the nitroxide and the porphyrin. Continuous wave EPR spectroscopy of the diradical porphyrins in fluid solution suggests that the nitroxyl-nitroxyl interspin distance is long enough and tumbling is fast enough not to detect dipolar coupling.

Pseudoseeds : investigating long-distance, ocean seed dispersal with wireless sensors

Recent theoretical research has shown that ocean currents and wind interact to disperse seeds over long distances among isolated landmasses. Dispersal of seeds among isolated oceanic islands, by birds, oceans and man, is a well-known phenomenon, and many widespread island plants have traits that facilitate this process. Crucially, however, there have been no mechanistic vector-based models of long-distance dispersal for seeds among isolated oceanic islands based on empirical data. Here, we propose a plan to develop seed analogues, or pseudoseeds, fitted with wireless sensor technology that will enable high-fidelity tracking as they disperse across the ocean. The pseudoseeds will be precisely designed to mimic actual seed buoyancy and morphology enabling realistic and accurate, vector-based dispersal models of ocean seed dispersal over vast geographic scales.

Reverse biased Pt/nanostructured MoO3/SiC Schottky diode based hydrogen gas sensors

Pt/nanostructured molybdenum oxide (MoO3) /SiC Schottky diode based gas sensors were fabricated for hydrogen (H2) gas sensing. Due to the enhanced performance, which is ascribed to the application of MoO3 nanostructures, these devices were used in reversed bias. MoO3 characterization by scanning electron microscopy showed morphology of randomly orientated nanoplatelets with thicknesses between 50 and 500 nm. An α-Β mixed phase crystallographic structure of MoO3 was characterized by x-ray diffraction. At 180 °C, 1.343 V voltage shift in the reverse I-V curve and a Pt/ MoO3 barrier height change of 20 meV were obtained after exposure to 1% H2 gas in synthetic air. © 2009 American Institute of Physics.