Image based visual servo control for fixed wing UAVs tracking linear infrastructure in wind

This paper presents an Image Based Visual Servo control design for Fixed Wing Unmanned Aerial Vehicles tracking locally linear infrastructure in the presence of wind using a body fixed imaging sensor. Visual servoing offers improved data collection by posing the tracking task as one of controlling a feature as viewed by the inspection sensor, although is complicated by the introduction of wind as aircraft heading and course angle no longer align. In this work it is shown that the effects of wind alter the desired line angle required for continuous tracking to equal the wind correction angle as would be calculated to set a desired course. A control solution is then sort by linearizing the interaction matrix about the new feature pose such that kinematics of the feature can be augmented with the lateral dynamics of the aircraft, from which a state feedback control design is developed. Simulation results are presented comparing no compensation, integral control and the proposed controller using the wind correction angle, followed by an assessment of response to atmospheric disturbances in the form of turbulence and wind gusts

Featureless visual processing for SLAM in changing outdoor environments

Vision-based SLAM is mostly a solved problem providing clear, sharp images can be obtained. However, in outdoor environments a number of factors such as rough terrain, high speeds and hardware limitations can result in these conditions not being met. High speed transit on rough terrain can lead to image blur and under/over exposure, problems that cannot easily be dealt with using low cost hardware. Furthermore, recently there has been a growth in interest in lifelong autonomy for robots, which brings with it the challenge in outdoor environments of dealing with a moving sun and lack of constant artificial lighting. In this paper, we present a lightweight approach to visual localization and visual odometry that addresses the challenges posed by perceptual change and low cost cameras. The approach combines low resolution imagery with the SLAM algorithm, RatSLAM. We test the system using a cheap consumer camera mounted on a small vehicle in a mixed urban and vegetated environment, at times ranging from dawn to dusk and in conditions ranging from sunny weather to rain. We first show that the system is able to provide reliable mapping and recall over the course of the day and incrementally incorporate new visual scenes from different times into an existing map. We then restrict the system to only learning visual scenes at one time of day, and show that the system is still able to localize and map at other times of day. The results demonstrate the viability of the approach in situations where image quality is poor and environmental or hardware factors preclude the use of visual features.

Supporting the development of inclusive products : the effects of everyday ambient illumination levels and contrast on older adults' near visual acuity

Current older adult capability data-sets fail to account for the effects of everyday environmental conditions on capability. This article details a study that investigates the effects of everyday ambient illumination conditions (overcast, 6000 lx; in-house lighting, 150 lx and street lighting, 7.5 lx) and contrast (90%, 70%, 50% and 30%) on the near visual acuity (VA) of older adults (n= 38, 65-87 years). VA was measured at a 1-m viewing distance using logarithm of minimum angle of resolution (LogMAR) acuity charts. Results from the study showed that for all contrast levels tested, VA decreased by 0.2 log units between the overcast and street lighting conditions. On average, in overcast conditions, participants could detect detail around 1.6 times smaller on the LogMAR charts compared with street lighting. VA also significantly decreased when contrast was reduced from 70% to 50%, and from 50% to 30% in each of the ambient illumination conditions. Practitioner summary: This article presents an experimental study that investigates the impact of everyday ambient illumination levels and contrast on older adults' VA. Results show that both factors have a significant effect on their VA. Findings suggest that environmental conditions need to be accounted for in older adult capability data-sets/designs.

Image-based visual navigation for mobile robots

We introduce a new image-based visual navigation algorithm that allows the Cartesian velocity of a robot to be defined with respect to a set of visually observed features corresponding to previously unseen and unmapped world points. The technique is well suited to mobile robot tasks such as moving along a road or flying over the ground. We describe the algorithm in general form and present detailed simulation results for an aerial robot scenario using a spherical camera and a wide angle perspective camera, and present experimental results for a mobile ground robot.

Aircraft collision avoidance using spherical visual predictive control and single point features

This paper presents practical vision-based collision avoidance for objects approximating a single point feature. Using a spherical camera model, a visual predictive control scheme guides the aircraft around the object along a conical spiral trajectory. Visibility, state and control constraints are considered explicitly in the controller design by combining image and vehicle dynamics in the process model, and solving the nonlinear optimization problem over the resulting state space. Importantly, range is not required. Instead, the principles of conical spiral motion are used to design an objective function that simultaneously guides the aircraft along the avoidance trajectory, whilst providing an indication of the appropriate point to stop the spiral behaviour. Our approach is aimed at providing a potential solution to the See and Avoid problem for unmanned aircraft and is demonstrated through a series.

The suitability of using accumulated plastic strain to assess the damage at the rail-wheel interfaces

Numerous Abaqus [1] finite element analyses have been carried out using various plasticity models to investigate the effect of friction force on the rail head in relation to both the development of the accumulated plastic strain (PEEQ) and the changes in the depth of PEEQ distribution in the wheel-rail contact. The normal force distribution on the rail head was assumed to be Hertzian. The tangential force was implemented as a fraction of the normal force in the subroutine. Each analysis was carried out for a single pass and the effect of various friction coefficient values has been observed.

High altitude stereo visual odometry

Stereo visual odometry has received little investigation in high altitude applications due to the generally poor performance of rigid stereo rigs at extremely small baseline-to-depth ratios. Without additional sensing, metric scale is considered lost and odometry is seen as effective only for monocular perspectives. This paper presents a novel modification to stereo based visual odometry that allows accurate, metric pose estimation from high altitudes, even in the presence of poor calibration and without additional sensor inputs. By relaxing the (typically fixed) stereo transform during bundle adjustment and reducing the dependence on the fixed geometry for triangulation, metrically scaled visual odometry can be obtained in situations where high altitude and structural deformation from vibration would cause traditional algorithms to fail. This is achieved through the use of a novel constrained bundle adjustment routine and accurately scaled pose initializer. We present visual odometry results demonstrating the technique on a short-baseline stereo pair inside a fixed-wing UAV flying at significant height (~30-100m).

Robust scale initialization for long-range stereo visual odometry

Achieving a robust, accurately scaled pose estimate in long-range stereo presents significant challenges. For large scene depths, triangulation from a single stereo pair is inadequate and noisy. Additionally, vibration and flexible rigs in airborne applications mean accurate calibrations are often compromised. This paper presents a technique for accurately initializing a long-range stereo VO algorithm at large scene depth, with accurate scale, without explicitly computing structure from rigidly fixed camera pairs. By performing a monocular pose estimate over a window of frames from a single camera, followed by adding the secondary camera frames in a modified bundle adjustment, an accurate, metrically scaled pose estimate can be found. To achieve this the scale of the stereo pair is included in the optimization as an additional parameter. Results are presented both on simulated and field gathered data from a fixed-wing UAV flying at significant altitude, where the epipolar geometry is inaccurate due to structural deformation and triangulation from a single pair is insufficient. Comparisons are made with more conventional VO techniques where the scale is not explicitly optimized, and demonstrated over repeated trials to indicate robustness.

Evidence for the adsorption of molecules at special sites located at copper/zinc oxide interfaces. Part 2. -- A fourier-transform infrared spectroscopy study of methanol adsorption on reduced and oxidised Cu/ZnO/SiO2 catalysts

FTIR spectra are reported of methanol adsorbed at 295 K on ZnO/SiO 2, on reduced Cu/ZnO/SiO2 and on Cu/ZnO/SiO2 which had been preoxidised by exposure to nitrous oxide. Methanol on ZnO/SiO2 gave methoxy species on ZnO and SiO, in addition to both strongly and weakly physisorbed methanol on SiO2. The corresponding adsorption of methanol on reduced Cu/ZnO/SiO2 also gave methoxy species on Cu and a small amount of bridging formate. Reaction of methanol with a reoxidised Cu/ZnO/SiO2 catalyst resulted in an enhanced quantity of methoxy species on Cu. Heating adsorbed species on Cu/ZnO/SiO2 at 393 K led to the loss of methoxy groups on Cu and the concomitant formation of formate species on both ZnO and Cu. The comparable reaction on a reoxidised Cu/ZnO/SiO2 catalyst gave an increased amount of formate species on ZnO and this correlated with an increased quantity of methoxy groups lost from Cu. An explanation is given in terms of adsorption of formate and formaldehyde species at special sites located at the copper/zinc oxide interface.

Evidence for the adsorption of molecules at special sites located at copper/zinc oxide interfaces: Part 1. -- A Fourier-transform infrared study of formic acid and formaldehyde adsorption on reduced and oxidised Cu/ZnO/SiO2 catalysts

Fourier-transform infrared (FTIR) spectra are reported of formic acid and formaldehyde on ZnO/SiO2, reduced Cu/ZnO/SiO2 and reoxidised Cu/ZnO/SiO2 catalyst. Formic acid adsorption on ZnO/SiO2 produced mainly bidentate zinc formate species with a lesser quantity of unidentate zinc formate. Formic acid on reduced Cu/ZnO/SiO2 catalyst resulted not only in the formation of bridging copper formate structures but also in an enhanced amount of formate relative to that for ZnO/SiO2 catalyst. Formic acid on reoxidised Cu/ZnO/SiO2 gave unidentate formate species on copper in addition to zinc formate moieties. The interaction of formaldehyde with ZnO/SiO2 catalyst resulted in the formation of zinc formate species. The same reaction on reduced Cu/ZnO/SiO2 catalyst gave bridging formate on copper and a remarkable increase in the quantity of formate species associated with the zinc oxide. Adsorption of formaldehyde on a reoxidised Cu/ZnO/SiO2 catalyst produced bridging copper formate and again an apparent increase in the concentration of zinc formate species. An explanation in terms of the adsorption of molecules at special sites located at the interface between copper and zinc oxide is given.

Evidence for the adsorption of molecules at special sites located at copper/zinc oxide interfaces. Part 3. -- Fourier-transform infrared study of methyl formate adsorption on reduced and oxidised Cu/ZnO/SiO2 catalysts

FTIR spectra are reported of methyl formate adsorbed at 295 K on ZnO/SiO2, reduced Cu/ZnO/SiO2 and on Cu/ZnO/SiO2 which had been preoxidised by exposure to nitrous oxide. Methyl formate on ZnO/SiO2 gave adsorbed zinc formate species and strongly physisorbed molecular methanol on silica. The comparable reaction of methyl formate with reduced Cu/ZnO/SiO2 catalyst produced bridging formate species on copper and a diminished quantity of zinc formate relative to that formed on ZnO/SiO2 catalyst. This effect is explained in terms of site blockage on the ZnO surface by small copper clusters. Addition of methyl formate to a reoxidised Cu/ZnO/SiO2 catalyst produced a considerably greater amount of formate species on zinc oxide and methoxy groups on copper were detected. The increase in concentration of zinc formate species was rationalised in terms of rearrangement of unidentate copper formate species to become bonded to copper and zinc oxide sites located at the interface between these two components.

Using natural user interfaces for collaborative process modelling in virtual environments

A demo video showing the BPMVM prototype using several natural user interfaces, such as multi-touch input, full-body tracking and virtual reality.

Visual guidance for fixed-wing unmanned aerial vehicles using feature tracking : application to power line inspection

This thesis presents novel vision based control solutions that enable fixed-wing Unmanned Aerial Vehicles to perform tasks of inspection over infrastructure including power lines, pipe lines and roads. This is achieved through the development of techniques that combine visual servoing with alternate manoeuvres that assist the UAV in both following and observing the feature from a downward facing camera. Control designs are developed through techniques of Image Based Visual Servoing to utilise sideslip through Skid-to-Turn and Forward-Slip manoeuvres. This allows the UAV to simultaneously track and collect data over the length of infrastructure, including straight segments and the transition where these meet.

Agreement to and compliance with advice on removing mats or rugs by older people with visual impairments

The article presents a study which investigated the reasons why advice related to the removal of mats or rags by older people with visual impairments had a low rate of acceptance. The researchers speculated that it may have been due to older people's need to maintain a sense of control and autonomy and to arrange their environments in a way that they decided or a belief that the recommended modification would not reduce the risk of falling. A telephone survey of subsample of the participants was conducted in the Visually Impaired Persons (VIP) Trial. All 30 interviewees had rugs or mats in their homes. Of the 30 participants, 20 had moved the rugs or mats as a result of recommendations, and 10 had not.

Visual front-end wars : Viola-Jones face detector vs Fourier Lucas-Kanade

The performance of visual speech recognition (VSR) systems are significantly influenced by the accuracy of the visual front-end. The current state-of-the-art VSR systems use off-the-shelf face detectors such as Viola- Jones (VJ) which has limited reliability for changes in illumination and head poses. For a VSR system to perform well under these conditions, an accurate visual front end is required. This is an important problem to be solved in many practical implementations of audio visual speech recognition systems, for example in automotive environments for an efficient human-vehicle computer interface. In this paper, we re-examine the current state-of-the-art VSR by comparing off-the-shelf face detectors with the recently developed Fourier Lucas-Kanade (FLK) image alignment technique. A variety of image alignment and visual speech recognition experiments are performed on a clean dataset as well as with a challenging automotive audio-visual speech dataset. Our results indicate that the FLK image alignment technique can significantly outperform off-the shelf face detectors, but requires frequent fine-tuning.