Aerial SLAM with a single camera using visual expectation

Micro aerial vehicles (MAVs) are a rapidly growing area of research and development in robotics. For autonomous robot operations, localization has typically been calculated using GPS, external camera arrays, or onboard range or vision sensing. In cluttered indoor or outdoor environments, onboard sensing is the only viable option. In this paper we present an appearance-based approach to visual SLAM on a flying MAV using only low quality vision. Our approach consists of a visual place recognition algorithm that operates on 1000 pixel images, a lightweight visual odometry algorithm, and a visual expectation algorithm that improves the recall of place sequences and the precision with which they are recalled as the robot flies along a similar path. Using data gathered from outdoor datasets, we show that the system is able to perform visual recognition with low quality, intermittent visual sensory data. By combining the visual algorithms with the RatSLAM system, we also demonstrate how the algorithms enable successful SLAM.

Aerial image analysis using spiking neural networks with application to power line corridor monitoring

Trees, shrubs and other vegetation are of continued importance to the environment and our daily life. They provide shade around our roads and houses, offer a habitat for birds and wildlife, and absorb air pollutants. However, vegetation touching power lines is a risk to public safety and the environment, and one of the main causes of power supply problems. Vegetation management, which includes tree trimming and vegetation control, is a significant cost component of the maintenance of electrical infrastructure. For example, Ergon Energy, the Australia’s largest geographic footprint energy distributor, currently spends over $80 million a year inspecting and managing vegetation that encroach on power line assets. Currently, most vegetation management programs for distribution systems are calendar-based ground patrol. However, calendar-based inspection by linesman is labour-intensive, time consuming and expensive. It also results in some zones being trimmed more frequently than needed and others not cut often enough. Moreover, it’s seldom practicable to measure all the plants around power line corridors by field methods. Remote sensing data captured from airborne sensors has great potential in assisting vegetation management in power line corridors. This thesis presented a comprehensive study on using spiking neural networks in a specific image analysis application: power line corridor monitoring. Theoretically, the thesis focuses on a biologically inspired spiking cortical model: pulse coupled neural network (PCNN). The original PCNN model was simplified in order to better analyze the pulse dynamics and control the performance. Some new and effective algorithms were developed based on the proposed spiking cortical model for object detection, image segmentation and invariant feature extraction. The developed algorithms were evaluated in a number of experiments using real image data collected from our flight trails. The experimental results demonstrated the effectiveness and advantages of spiking neural networks in image processing tasks. Operationally, the knowledge gained from this research project offers a good reference to our industry partner (i.e. Ergon Energy) and other energy utilities who wants to improve their vegetation management activities. The novel approaches described in this thesis showed the potential of using the cutting edge sensor technologies and intelligent computing techniques in improve power line corridor monitoring. The lessons learnt from this project are also expected to increase the confidence of energy companies to move from traditional vegetation management strategy to a more automated, accurate and cost-effective solution using aerial remote sensing techniques.

Investigation of methods for increasing the energy efficiency on unmanned aerial vehicles (UAVS)

In recent years, development of Unmanned Aerial Vehicles (UAV) has become a significant growing segment of the global aviation industry. These vehicles are developed with the intention of operating in regions where the presence of onboard human pilots is either too risky or unnecessary. Their popularity with both the military and civilian sectors have seen the use of UAVs in a diverse range of applications, from reconnaissance and surveillance tasks for the military, to civilian uses such as aid relief and monitoring tasks. Efficient energy utilisation on an UAV is essential to its functioning, often to achieve the operational goals of range, endurance and other specific mission requirements. Due to the limitations of the space available and the mass budget on the UAV, it is often a delicate balance between the onboard energy available (i.e. fuel) and achieving the operational goals. This thesis presents an investigation of methods for increasing the energy efficiency on UAVs. One method is via the development of a Mission Waypoint Optimisation (MWO) procedure for a small fixed-wing UAV, focusing on improving the onboard fuel economy. MWO deals with a pre-specified set of waypoints by modifying the given waypoints within certain limits to achieve its optimisation objectives of minimising/maximising specific parameters. A simulation model of a UAV was developed in the MATLAB Simulink environment, utilising the AeroSim Blockset and the in-built Aerosonde UAV block and its parameters. This simulation model was separately integrated with a multi-objective Evolutionary Algorithm (MOEA) optimiser and a Sequential Quadratic Programming (SQP) solver to perform single-objective and multi-objective optimisation procedures of a set of real-world waypoints in order to minimise the onboard fuel consumption. The results of both procedures show potential in reducing fuel consumption on a UAV in a ight mission. Additionally, a parallel Hybrid-Electric Propulsion System (HEPS) on a small fixedwing UAV incorporating an Ideal Operating Line (IOL) control strategy was developed. An IOL analysis of an Aerosonde engine was performed, and the most efficient (i.e. provides greatest torque output at the least fuel consumption) points of operation for this engine was determined. Simulation models of the components in a HEPS were designed and constructed in the MATLAB Simulink environment. It was demonstrated through simulation that an UAV with the current HEPS configuration was capable of achieving a fuel saving of 6.5%, compared to the ICE-only configuration. These components form the basis for the development of a complete simulation model of a Hybrid-Electric UAV (HEUAV).

Spatial sciences/ surveying student BEB801 project Capstone Mini-Conference 2011

Project as a Capstone Learning Unit: Courses of the QUT Faculty of BEE seek to enable students to practice as professionals in their respective disciplines. A major part of such practice is the instigation, management,monitoring, and reporting on an urban development project. This unit offers the student a capstone learning experience near the end of their fourth year of undergraduate study. Expose the student to a set of integrated activities, each building upon the preceding, and culminating in a 'completed' project. Students apply skills and knowledge attained earlier in the course and develop new abilities for application to a real-world problem, industry or research based, to simulate the design, development and management of a project solution. These 10-12minute seminar presentations comprise the mini-conference event that are of benefit to the wider surveying and spatial science industry.

Aerial object following using visual fuzzy servoing

This article presents a visual servoing system to follow a 3D moving object by a Micro Unmanned Aerial Vehicle (MUAV). The presented control strategy is based only on the visual information given by an adaptive tracking method based on the colour information. A visual fuzzy system has been developed for servoing the camera situated on a rotary wing MAUV, that also considers its own dynamics. This system is focused on continuously following of an aerial moving target object, maintaining it with a fixed safe distance and centred on the image plane. The algorithm is validated on real flights on outdoors scenarios, showing the robustness of the proposed systems against winds perturbations, illumination and weather changes among others. The obtained results indicate that the proposed algorithms is suitable for complex controls task, such object following and pursuit, flying in formation, as well as their use for indoor navigation

A multi-resolution image alignment technique based on direct methods for pose estimation of aerial vehicles

In this paper, we seek to expand the use of direct methods in real-time applications by proposing a vision-based strategy for pose estimation of aerial vehicles. The vast majority of approaches make use of features to estimate motion. Conversely, the strategy we propose is based on a MR (Multi- Resolution) implementation of an image registration technique (Inverse Compositional Image Alignment ICIA) using direct methods. An on-board camera in a downwards-looking configuration, and the assumption of planar scenes, are the bases of the algorithm. The motion between frames (rotation and translation) is recovered by decomposing the frame-to-frame homography obtained by the ICIA algorithm applied to a patch that covers around the 80% of the image. When the visual estimation is required (e.g. GPS drop-out), this motion is integrated with the previous known estimation of the vehicles’ state, obtained from the on-board sensors (GPS/IMU), and the subsequent estimations are based only on the vision-based motion estimations. The proposed strategy is tested with real flight data in representative stages of a flight: cruise, landing, and take-off, being two of those stages considered critical: take-off and landing. The performance of the pose estimation strategy is analyzed by comparing it with the GPS/IMU estimations. Results show correlation between the visual estimation obtained with the MR-ICIA and the GPS/IMU data, that demonstrate that the visual estimation can be used to provide a good approximation of the vehicle’s state when it is required (e.g. GPS drop-outs). In terms of performance, the proposed strategy is able to maintain an estimation of the vehicle’s state for more than one minute, at real-time frame rates based, only on visual information.

Omnidirectional bearing-only see-and-avoid for small aerial robots

Motivated by the growing interest in unmanned aerial system’s applications in indoor and outdoor settings and the standardisation of visual sensors as vehicle payload. This work presents a collision avoidance approach based on omnidirectional cameras that does not require the estimation of range between two platforms to resolve a collision encounter. It will achieve a minimum separation between the two vehicles involved by maximising the view-angle given by the omnidirectional sensor. Only visual information is used to achieve avoidance under a bearing-only visual servoing approach. We provide theoretical problem formulation, as well as results from real flight using small quadrotors.

Spatial sciences/ surveying student BEB801 project Capstone Mini-Conference 2011

Project as a Capstone Learning Unit: Courses of the QUT Faculty of BEE seek to enable students to practice as professionals in their respective disciplines. A major part of such practice is the instigation, management,monitoring, and reporting on an urban development project. This unit offers the student a capstone learning experience near the end of their fourth year of undergraduate study. Expose the student to a set of integrated activities, each building upon the preceding, and culminating in a 'completed' project. Students apply skills and knowledge attained earlier in the course and develop new abilities for application to a real-world problem, industry or research based, to simulate the design, development and management of a project solution. These 10-12minute seminar presentations comprise the mini-conference event that are of benefit to the wider surveying and spatial science industry. Additionally Includes MAPMYTOWN 2010, Bell Darling Downs, summary of QUT contributions.

Development of an autonomous unmanned aerial system to collect time-stamped samples from the atmosphere and localize potential pathogen sources

This paper presents the hardware development and testing of a new concept for air sampling via the integration of a prototype spore trap onboard an unmanned aerial system (UAS).We propose the integration of a prototype spore trap onboard a UAS to allow multiple capture of spores of pathogens in single remote locations at high or low altitude, otherwise not possible with stationary sampling devices.We also demonstrate the capability of this system for the capture of multiple time-stamped samples during a single mission.Wind tunnel testing was followed by simulation, and flight testing was conducted to measure and quantify the spread during simulated airborne air sampling operations. During autonomous operations, the onboard autopilot commands the servo to rotate the sampling device to a new indexed location once the UAS vehicle reaches the predefined waypoint or set of waypoints (which represents the region of interest). Time-stamped UAS data are continuously logged during the flight to assist with analysis of the particles collected. Testing and validation of the autopilot and spore trap integration, functionality, and performance is described. These tools may enhance the ability to detect new incursions of spores

Spatial/surveying programs repositioning within new STEM Faculty at QUT

Many of the undergraduate and postgraduate programs of the former Faculty of Built Environment and Engineering PLUS Faculty of Sciences and Technology are changing as a result of merging these two large organisations, with some disciplines relocating to faculties of Creative Industries and Health respectively. The new STEM precinct under construction has begun rising from the proverbial hole-in-the-ground. Existing Surveying and Spatial Sciences programs, assets and staff are being repositioned with the newly formed School of Earth, Environment and Biological Sciences.2011. Golden graduates morning tea organised by QUT Alumni. Technology upgrades to the Mapping Sciences lab benefits 3-D learning experiences. Second and third-year students are undertaking Work Integrated Learning (WIL) over the summer vacation period. Final year students recently presented capstone project presentations at mini-conference in the Gibson Rooms overlooking a vibrant Southbank and sparkling Brisbane River. Discussion on end of year graduation ceremony held at QPAC.

Towards an automatic system for road lane marking extraction in large-scale aerial images acquired over rural areas by hierarchical image analysis and Gabor filter

An automatic approach to road lane marking extraction from high-resolution aerial images is proposed, which can automatically detect the road surfaces in rural areas based on hierarchical image analysis. The procedure is facilitated by the road centrelines obtained from low-resolution images. The lane markings are further extracted on the generated road surfaces with 2D Gabor filters. The proposed method is applied on the aerial images of the Bruce Highway around Gympie, Queensland. Evaluation of the generated road surfaces and lane markings using four representative test fields has validated the proposed method.

Value management : an extension of quantity surveying services in Malaysia

Value Management (VM) initially started in early 1940s in the US manufacturing industry has increasingly becoming popular within the construction industry community internationally. It has been widely accepted as an important tool in the management of projects. The structured, systematic and multi-disciplinary approach in decision making process is a niche for VM in delivering better value for money project to the client investment. It would appear to be gaining some momentum as an essential management tool in the Malaysian construction sector especially in the quantity surveying practice. Quantity surveyors increasing involvement in VM provides an opportunity for the profession to re-model some of its traditional services in a more positive light and develop leading-edge skills and promote the profession. International practice has associated VM to be part of services offered in the quantity surveying practice; especially in UK has proven to be a natural progression of QS profession. The introduction of VM as early 1980’s in Malaysia combined with increasing demand for construction project to facilitate nation progress is shedding a positive light for quantity surveying profession to take lead in developing VM as one of their niche area. Therefore, the quantity surveying profession having the opportunity to take lead of this service which reflect their traditional attributes for providing the best value-for-money advise to the client. This paper shall discuss on the development of VM in Malaysia and the challenges VM face services in QS firm to remain ahead of their competitors.

Evaluating automatic road detection across a large aerial imagery collection

The automated extraction of roads from aerial imagery can be of value for tasks including mapping, surveillance and change detection. Unfortunately, there are no public databases or standard evaluation protocols for evaluating these techniques. Many techniques are further hindered by a reliance on manual initialisation, making large scale application of the techniques impractical. In this paper, we present a public database and evaluation protocol for the evaluation of road extraction algorithms, and propose an improved automatic seed finding technique to initialise road extraction, based on a combination of geometric and colour features.

Creating better learning environments by cross-disciplinary collaboration : a civil engineering and surveying linkage

Many of the teaching elements in Civil and Environmental Engineering and Spatial Science/Surveying are strongly related to multidisciplinary real-world situations. Professionals in each discipline commonly work collaboratively, knowing each other’s professional and technical limitations and requirements. Replication of such real-world situations allows students to gain an insight and acquire knowledge of professional practice for both civil engineering and spatial science disciplines. However, replication of an authentic design project is not always possible in a single unit basis where empirical project situations are often created with controlled sets of constraints, inputs and outputs. A cross-disciplinary design-based project that is designed to promote active student learning, engagement and professional integration would be the preferred option. The central aim of this collaborative project was to create positive and inclusive environments to promote engaging learning opportunities that cater for a range of learning styles with a two-way linkage involving third-year civil engineering and spatial science (surveying) students. This paper describes the cross-disciplinary project developed and delivered in 2010 and 2011. A survey was conducted at completion of the project to assess the degree of improvement in student engagement and their learning experiences. Improvements were assessed in a range of dimensions including student motivation, learning by cross-disciplinary collaboration and learning by authentic design project experiences. In this specific cross-disciplinary linkage project, the study findings showed that teaching approaches utilised have been effective in promoting active student learning and increasing engagement.

Autonomous aerial navigation and tracking of marine animals

In this paper, we describe the development of an independent and on-board visual servoing system which allows a computationally impoverished aerial vehicle to autonomously identify and track a moving surface target. Our image segmentation and target identification algorithms were developed with the specific task of monitoring whales at sea but could be adapted for other targets. Observing whales is important for many marine biology tasks and is currently performed manually from the shore or from boats. We also present hardware experiments which demonstrate the capabilities of our algorithms for object identification and tracking that enable a flying vehicle to track a moving target.