Vision based control for fixed wing UAVs inspecting locally linear infrastructure using skid-to-turn maneuvers

The following paper proposes a novel application of Skid-to-Turn maneuvers for fixed wing Unmanned Aerial Vehicles (UAVs) inspecting locally linear infrastructure. Fixed wing UAVs, following the design of manned aircraft, traditionally employ Bank-to-Turn maneuvers to change heading and thus direction of travel. Commonly overlooked is the effect these maneuvers have on downward facing body fixed sensors, which as a result of bank, point away from the feature during turns. By adopting Skid-to-Turn maneuvers, the aircraft is able change heading whilst maintaining wings level flight, thus allowing body fixed sensors to maintain a downward facing orientation. Eliminating roll also helps to improve data quality, as sensors are no longer subjected to the swinging motion induced as they pivot about an axis perpendicular to their line of sight. Traditional tracking controllers that apply an indirect approach of capturing ground based data by flying directly overhead can also see the feature off center due to steady state pitch and roll required to stay on course. An Image Based Visual Servo controller is developed to address this issue, allowing features to be directly tracked within the image plane. Performance of the proposed controller is tested against that of a Bank-to-Turn tracking controller driven by GPS derived cross track error in a simulation environment developed to simulate the field of view of a body fixed camera.

Fiber Bragg Grating sensors for railway systems

Fiber Bragg grating (FBG) sensor technology has been attracting substantial industrial interests for the last decade. FBG sensors have seen increasing acceptance and widespread use for structural sensing and health monitoring applications in composites, civil engineering, aerospace, marine, oil & gas, and smart structures. One transportation system that has been benefitted tremendously from this technology is railways, where it is of the utmost importance to understand the structural and operating conditions of rails as well as that of freight and passenger service cars to ensure safe and reliable operation. Fiberoptic sensors, mostly in the form of FBGs, offer various important characteristics, such as EMI/RFI immunity, multiplexing capability, and very long-range interrogation (up to 230 km between FBGs and measurement unit), over the conventional electrical sensors for the distinctive operational conditions in railways. FBG sensors are unique from other types of fiber-optic sensors as the measured information is wavelength-encoded, which provides self-referencing and renders their signals less susceptible to intensity fluctuations. In addition, FBGs are reflective sensors that can be interrogated from either end, providing redundancy to FBG sensing networks. These two unique features are particularly important for the railway industry where safe and reliable operations are the major concerns. Furthermore, FBGs are very versatile and transducers based on FBGs can be designed to measure a wide range of parameters such as acceleration and inclination. Consequently, a single interrogator can deal with a large number of FBG sensors to measure a multitude of parameters at different locations that spans over a large area.

Hydrogen gas sensing properties of Pt/Ta2O5 Schottky diodes based on Si and SiC substrates

In this paper, we fabricated Pt/tantalum oxide (Ta2O5) Schottky diodes for hydrogen sensing applications. Thin (4 nm) layer of Ta2O5 was deposited on silicon (Si) and silicon carbide (SiC) substrates by radio frequency (RF) sputtering technique. We compared the performance of these sensors at different elevated temperatures of 100 ∘C and 150 ∘C. At these temperatures, the sensor based on SiC exhibited a larger sensitivity while the sensor based on Si exhibited a faster response toward hydrogen gas. We discussed herein, the responses exhibited by the Pt/Ta2O5 based Schottky diodes demonstrated a promising potential for hydrogen sensing applications.

Nanostructures for sensors, electronics, energy and environment

Nanoscale science is growing evermore important on a global scale and is widely seen as playing an integral part in the growth of future world economies. The daunting energy crisis we are facing could be solved not only by new and improved ways of getting energy directly from the sun, but also by saving power thanks to advancements in electronics and sensors. New, cheap dye-sensitized and polymer solar cells hold the promise of environmentally friendly and simple production methods, along with mechanical flexibility and low weight, matching the conditions for a widespread deployment of this technology. Cheap sensors based on nanomaterials can make a fundamental contribution to the reduction of greenhouse gas emissions, allowing the creation of large sensor networks to monitor countries and cities, improving our quality of life. Nanowires and nano-platelets of metal oxides are at the forefront of the research to improve sensitivity and reduce the power consumption in gas sensors. Nanoelectronics is the next step in the electronic roadmap, with many devices currently in production already containing components smaller than 100 nm. Molecules and conducting polymers are at the forefront of this research with the goal of reducing component size through the use of cheap and environmentally friendly production methods. This, and the coming steps that will eventually bring the individual circuit element close to the ultimate limit of the atomic level, are expected to deliver better devices with reduced power consumption.

A mask-based approach for the geometric calibration of thermal-infrared cameras

Accurate and efficient thermal-infrared (IR) camera calibration is important for advancing computer vision research within the thermal modality. This paper presents an approach for geometrically calibrating individual and multiple cameras in both the thermal and visible modalities. The proposed technique can be used to correct for lens distortion and to simultaneously reference both visible and thermal-IR cameras to a single coordinate frame. The most popular existing approach for the geometric calibration of thermal cameras uses a printed chessboard heated by a flood lamp and is comparatively inaccurate and difficult to execute. Additionally, software toolkits provided for calibration either are unsuitable for this task or require substantial manual intervention. A new geometric mask with high thermal contrast and not requiring a flood lamp is presented as an alternative calibration pattern. Calibration points on the pattern are then accurately located using a clustering-based algorithm which utilizes the maximally stable extremal region detector. This algorithm is integrated into an automatic end-to-end system for calibrating single or multiple cameras. The evaluation shows that using the proposed mask achieves a mean reprojection error up to 78% lower than that using a heated chessboard. The effectiveness of the approach is further demonstrated by using it to calibrate two multiple-camera multiple-modality setups. Source code and binaries for the developed software are provided on the project Web site.

Integrated vision-based attitude estimation

For many years, computer vision has lured researchers with promises of a low-cost, passive, lightweight and information-rich sensor suitable for navigation purposes. The prime difficulty in vision-based navigation is that the navigation solution will continually drift with time unless external information is available, whether it be cues from the appearance of the scene, a map of features (whether built online or known a priori), or from an externally-referenced sensor. It is not merely position that is of interest in the navigation problem. Attitude (i.e. the angular orientation of a body with respect to a reference frame) is integral to a visionbased navigation solution and is often of interest in its own right (e.g. flight control). This thesis examines vision-based attitude estimation in an aerospace environment, and two methods are proposed for constraining drift in the attitude solution; one through a novel integration of optical flow and the detection of the sky horizon, and the other through a loosely-coupled integration of Visual Odometry and GPS position measurements. In the first method, roll angle, pitch angle and the three aircraft body rates are recovered though a novel method of tracking the horizon over time and integrating the horizonderived attitude information with optical flow. An image processing front-end is used to select several candidate lines in a image that may or may not correspond to the true horizon, and the optical flow is calculated for each candidate line. Using an Extended Kalman Filter (EKF), the previously estimated aircraft state is propagated using a motion model and a candidate horizon line is associated using a statistical test based on the optical flow measurements and location of the horizon in the image. Once associated, the selected horizon line, along with the associated optical flow, is used as a measurement to the EKF. To evaluate the accuracy of the algorithm, two flights were conducted, one using a highly dynamic Uninhabited Airborne Vehicle (UAV) in clear flight conditions and the other in a human-piloted Cessna 172 in conditions where the horizon was partially obscured by terrain, haze and smoke. The UAV flight resulted in pitch and roll error standard deviations of 0.42° and 0.71° respectively when compared with a truth attitude source. The Cessna 172 flight resulted in pitch and roll error standard deviations of 1.79° and 1.75° respectively. In the second method for estimating attitude, a novel integrated GPS/Visual Odometry (GPS/VO) navigation filter is proposed, using a structure similar to a classic looselycoupled GPS/INS error-state navigation filter. Under such an arrangement, the error dynamics of the system are derived and a Kalman Filter is developed for estimating the errors in position and attitude. Through similar analysis to the GPS/INS problem, it is shown that the proposed filter is capable of recovering the complete attitude (i.e. pitch, roll and yaw) of the platform when subjected to acceleration not parallel to velocity for both the monocular and stereo variants of the filter. Furthermore, it is shown that under general straight line motion (e.g. constant velocity), only the component of attitude in the direction of motion is unobservable. Numerical simulations are performed to demonstrate the observability properties of the GPS/VO filter in both the monocular and stereo camera configurations. Furthermore, the proposed filter is tested on imagery collected using a Cessna 172 to demonstrate the observability properties on real-world data. The proposed GPS/VO filter does not require additional restrictions or assumptions such as platform-specific dynamics, map-matching, feature-tracking, visual loop-closing, gravity vector or additional sensors such as an IMU or magnetic compass. Since no platformspecific dynamics are required, the proposed filter is not limited to the aerospace domain and has the potential to be deployed in other platforms such as ground robots or mobile phones.

Towards brain-based sensor fusion for navigating robots

Current state of the art robot mapping and navigation systems produce impressive performance under a narrow range of robot platform, sensor and environmental conditions, in contrast to animals such as rats that produce “good enough” maps that enable them to function under an incredible range of situations. In this paper we present a rat-inspired featureless sensor-fusion system that assesses the usefulness of multiple sensor modalities based on their utility and coherence for place recognition during a navigation task, without knowledge as to the type of sensor. We demonstrate the system on a Pioneer robot in indoor and outdoor environments with abrupt lighting changes. Through dynamic weighting of the sensors, the system is able to perform correct place recognition and mapping where the static sensor weighting approach fails.

A trusted ecosystem for Android applications based on context-aware access control

Private data stored on smartphones is a precious target for malware attacks. A constantly changing environment, e.g. switching network connections, can cause unpredictable threats, and require an adaptive approach to access control. Context-based access control is using dynamic environmental information, including it into access decisions. We propose an "ecosystem-in-an-ecosystem" which acts as a secure container for trusted software aiming at enterprise scenarios where users are allowed to use private devices. We have implemented a proof-of-concept prototype for an access control framework that processes changes to low-level sensors and semantically enriches them, adapting access control policies to the current context. This allows the user or the administrator to maintain fine-grained control over resource usage by compliant applications. Hence, resources local to the trusted container remain under control of the enterprise policy. Our results show that context-based access control can be done on smartphones without major performance impact.

Real-time risk monitoring in business processes : a sensor-based approach

This article proposes an approach for real-time monitoring of risks in executable business process models. The approach considers risks in all phases of the business process management lifecycle, from process design, where risks are defined on top of process models, through to process diagnosis, where risks are detected during process execution. The approach has been realized via a distributed, sensor-based architecture. At design-time, sensors are defined to specify risk conditions which when fulfilled, are a likely indicator of negative process states (faults) to eventuate. Both historical and current process execution data can be used to compose such conditions. At run-time, each sensor independently notifies a sensor manager when a risk is detected. In turn, the sensor manager interacts with the monitoring component of a business process management system to prompt the results to process administrators who may take remedial actions. The proposed architecture has been implemented on top of the YAWL system, and evaluated through performance measurements and usability tests with students. The results show that risk conditions can be computed efficiently and that the approach is perceived as useful by the participants in the tests.

A hydrogen/methane sensor based on niobium tungsten oxide nanorods synthesised by hydrothermal method

An investigation on hydrogen and methane sensing performance of hydrothermally formed niobium tungsten oxide nanorods employed in a Schottky diode structure is presented herein. By implementing tungsten into the surface of the niobium lattice, we create Nb5+ and W5+ oxide states and an abundant number of surface traps, which can collect and hold the adsorbate charge to reinforce a greater bending of the energy bands at the metal/oxide interface. We show experimentally, that extremely large voltage shifts can be achieved by these nanorods under exposure to gas at both room and high temperatures and attribute this to the strong accumulation of the dipolar charges at the interface via the surface traps. Thus, our results demonstrate that niobium tungsten oxide nanorods can be implemented for gas sensing applications, showing ultra-high sensitivities.

Hydrogen sensing properties of Pt/Lanthanum oxide- molybdenum oxide nanoplatelet/SiC based Schottky diode

An investigation of the electrical and hydrogen sensing properties of a novel Schottky diode based on a nanostructured lanthanum oxide-molybdenum oxide compound is presented herein. Molybdenum oxide (MoO3) nanoplatelets were grown on SiC substrates via thermal evaporation which was then subsequently coated with lanthanum oxide (La2O3) by RF sputtering. The current-voltage characteristics and hydrogen sensing performance (change in barrier height and sensitivity as well as the dynamic response) were examined from 25 to 300°C. At 180°C, a voltage shift of 2.23V was measured from the sensor while exposed to 1% hydrogen gas under a 100 μA constant reverse bias current. The results indicate that the presence of a La2O3 thin layer substantially improves the hydrogen sensitivity of the MoO3 nanoplatelets.

Pt/MoO3 nano-flower/SiC Schottky diode based hydrogen gas sensor

In this paper, we report the development of a novel Pt/MoO3 nano-flower/SiC Schottky diode based device for hydrogen gas sensing applications. The MoO3 nanostructured thin films were deposited on SiC substrates via thermal evaporation. Morphological characterization of the nanostructured MoO3 by scanning electron microscopy revealed randomly orientated thin nanoplatelets in a densely packed formation of nano-flowers with dimensions ranging from 250 nm to 1 μm. Current-voltage characteristics of the sensor were measured at temperatures from 25°C to 250°C. The sensor showed greater sensitivity in a reverse bias condition than in forward bias. Dynamic response of the sensor was investigated towards different concentrations of hydrogen gas in a synthetic air mixture at 250°C and a large voltage shift of 5.7 V was recorded upon exposure to 1% hydrogen.

Pt/Graphene Nano-sheet Based Hydrogen Gas Sensor

In this paper, we present gas sensing properties of Pt/graphene-like nano-sheets towards hydrogen gas. The graphene-like nano-sheets were produced via the reduction of spray-coated graphite oxide deposited on SiC substrates by hydrazine vapor. Structural and morphological characterizations of the graphene sheets were analyzed by scanning electron and atomic force microscopy. Current-voltage and dynamic responses of the sensors were investigated towards different concentrations of hydrogen gas in a synthetic air mixture at 100°C. A voltage shift of 100 mV was recorded at 1 mA reverse bias current.

Pt/anodized TiO2/SiC-based MOS device for hydrocarbon sensing

Pt/anodized TiO2/SiC based metal-oxide-semiconductor (MOS) devices were fabricated and characterized for their sensitivity towards propene (C3H6). Titanium (Ti) thin films were deposited onto the SiC substrates using a filtered cathodic vacuum arc (FCVA) method. Fluoride ions containing neutral electrolyte (0.5 wt% NH4F in ethylene glycol)were used to anodize the Ti films. The anodized films were subsequently annealed at 600 °C for 4 hrs in an oxygen rich environment to obtain TiO2. The current-voltage(I-V) characteristics of the Pt/TiO2/SiC devices were measured in different concentrations of propene. Exposure to the analyte gas caused a change in the Schottky barrier height and hence a lateral shift in the I-V characteristics. The effective change in the barrier height for 1% propene was calculated as 32.8 meV at 620°C. The dynamic response of the sensors was also investigated and a voltage shift of 157 mV was measured at 620°C during exposure to 1% propene.

Graphene-like nano-sheets based LiTaO3 surface acoustic wave NO2 gas sensor

Thin films consisting of graphene-like nano-sheets were deposited onto LiTaO3 surface acoustic wave transducers. A thickness of less than 10 nm and the existence of C-C bond were observed during the characterization of graphene-like nano-sheets. Frequency shift of 18.7 kHz and 14.9 kHz towards 8.5 ppm NO2 at two different operating temperature, 40°C and 25°C, respectively, was observed.