Close-quarters Quadrotor flying for a pole inspection with position based visual servoing and high-speed vision

This paper presents a 100 Hz monocular position based visual servoing system to control a quadrotor flying in close proximity to vertical structures approximating a narrow, locally linear shape. Assuming the object boundaries are represented by parallel vertical lines in the image, detection and tracking is achieved using Plücker line representation and a line tracker. The visual information is fused with IMU data in an EKF framework to provide fast and accurate state estimation. A nested control design provides position and velocity control with respect to the object. Our approach is aimed at high performance on-board control for applications allowing only small error margins and without a motion capture system, as required for real world infrastructure inspection. Simulated and ground-truthed experimental results are presented.

Nonlinear Model Predictive Control for a multi-rotor with heavy slung load

In this paper a novel controller for stable and precise operation of multi-rotors with heavy slung loads is introduced. First, simplified equations of motions for the multi-rotor and slung load are derived. The model is then used to design a Nonlinear Model Predictive Controller (NMPC) that can manage the highly nonlinear dynamics whilst accounting for system constraints. The controller is shown to simultaneously track specified waypoints whilst actively damping large slung load oscillations. A Linear-quadratic regulator (LQR) controller is also derived, and control performance is compared in simulation. Results show the improved performance of the Nonlinear Model Predictive Control (NMPC) controller over a larger flight envelope, including aggressive maneuvers and large slung load displacements. Computational cost remains relatively small, amenable to practical implementation. Such systems for small Unmanned Aerial Vehicles (UAVs) may provide significant benefit to several applications in agriculture, law enforcement and construction.

RPAS integration within an Australian ATM system : what equipment and which airspace

The Australian Civil Aviation Safety Authority (CASA) currently lists more than 100 separate entities or organisations which maintain a UAS Operator Certificate (UOC) [1]. Approved operations are overwhelmingly a permutation of aerial photography, surveillance, survey or spotting and predominantly, are restricted to Visual Line of Sight (VLOS) operations, below 400 feet, and not within 3 NM of an aerodrome. However, demand is increasing for a Remote Piloted Aerial System (RPAS) regulatory regime which facilitates more expansive operations, in particular unsegregated, Beyond Visual Line of Sight (BVLOS) operations. Despite this demand, there is national and international apprehension regarding the necessary levels of airworthiness and operational regulation required to maintain safety and minimise the risk associated with unsegregated operations. Fundamental to addressing these legitimate concerns will be the mechanisms that underpin safe separation and collision avoidance. Whilst a large body of research has been dedicated to investigating on-board, Sense and Avoid (SAA) technology necessary to meet this challenge, this paper focuses on the contribution of the NAS to separation assurance, and how it will support, as well as complicate RPAS integration. The paper collates and presents key, but historically disparate, threads of Australian RPAS and NAS related information, and distils it with a filter focused on minimising RPAS collision risk. Our ongoing effort is motivated by the need to better understand the separation assurance contribution provided by the NAS layers, in the first instance, and subsequently employ this information to identify scenarios where the coincident collision risk is demonstrably low, providing legitimate substantiation for concessions on equipage and airworthiness standards.

Editorial for the JFR special issue on low altitude flight of UAVs

This special issue of the Journal of Field Robotics focuses on low altitude flight of UAVs with a particular emphasis on fully implemented systems that were tested in relevant environments or deployed in regular operations.

Assessment of robust autonomy for unmanned systems : progress and challenges

The growing number of potential applications of Unmanned Aircraft Systems (UAS) in civilian operations and national security is putting pressure of National Airworthiness Authorities to provide a path for certification and allow UAS integration into the national airspace. The success of this integration depends not only on developments in improved UAS reliability and safety, but also on regulations for certification, and methodologies for operational performance and safety assessment. This paper focuses on the latter and describes progress in relation to a previously proposed framework for evaluating robust autonomy of UAS. The paper draws parallels between the proposed evaluation framework and the evaluation of pilots during the licensing process. It discusses how the data from the proposed evaluation can be used as an aid for decision making in certification and UAS designs. Finally, it discusses challenges associated with the evaluation.

Building the safety case for UAS operations in support of natural disaster response

A framework supporting the systematic development of safety cases for Unmanned Aircraft System (UAS) operations in a broad range of civil and commercial applications is presented. The case study application is the use of UAS for disaster response. In those States where regulations do not preclude UAS operations altogether, approvals for UAS operations can be granted on a case-by-case basis contingent on the provision of a safety case acceptable to the relevant National Airworthiness Authority (NAA). A safety case for UAS operations must show how the risks associated with the hazards have been managed to an acceptable level. The foundational components necessary for structuring and assessing these safety cases have not yet been proposed. Barrier-bow-tie models are used in this paper to structure the safety case for the two primary hazards of 1) a ground impact, and 2) a Mid-Air Collision (MAC). The models establish the set of Risk Control Variables (RCVs) available to reduce the risk. For the ground-impact risk model, seven RCVs are identified which in combination govern the probability of an accident. Similarly, ten RCVs are identified within the MAC model. The effectiveness of the RCVs and how they can implemented in terms of processes, policies, devices, practices, or other actions for each of the case-study applications are discussed. The framework presented can provide for the more systematic and consistent regulation of UAS through a "safety target" approach.

Hardware design and implementation of a MAVLink interface for an FPGA-based autonomous UAV flight control system

This paper details the initial design and planning of a Field Programmable Gate Array (FPGA) implemented control system that will enable a path planner to interact with a MAVLink based flight computer. The design is aimed at small Unmanned Aircraft Vehicles (UAV) under autonomous operation which are typically subject to constraints arising from limited on-board processing capabilities, power and size. An FPGA implementation for the de- sign is chosen for its potential to address such limitations through low power and high speed in-hardware computation. The MAVLink protocol offers a low bandwidth interface for the FPGA implemented path planner to communicate with an on-board flight computer. A control system plan is presented that is capable of accepting a string of GPS waypoints generated on-board from a previously developed in- hardware Genetic Algorithm (GA) path planner and feeding them to the open source PX4 autopilot, while simultaneously respond- ing with flight status information.

Risk perception and the public acceptance of drones

Unmanned aircraft, or drones, are a rapidly emerging sector of the aviation industry. There has been limited substantive research, however, into the public perception and acceptance of drones. This paper presents the results from two surveys of the Australian public designed to investigate (a) whether the public perceive drones to be riskier than existing manned aviation, (b) whether the terminology used to describe the technology influences public perception, and (c) what the broader concerns are that may influence public acceptance of the technology. We find that the Australian public currently hold a relatively neutral attitude towards drones. Respondents did not consider the technology to be overly unsafe, risky, beneficial, or threatening. Drones are largely viewed as being of comparable risk to that of existing manned aviation. Further, terminology had a minimal effect on the perception of the risks or acceptability of the technology. The neutral response is likely due to a lack of knowledge about the technology, which was also identified as the most prevalent public concern as opposed to the risks associated with its use. Privacy, military use and misuse (e.g., terrorism) were also significant public concerns. The results suggest that society is yet to form an opinion of drones. As public knowledge increases, the current position is likely to change. Industry communication and media coverage will likely influence the ultimate position adopted by the public, which can be difficult to change once established.

Design, modelling and measurement of a hybrid powerplant for unmanned aerial systems

Hybrid powerplants combining internal combustion engines and electric motor prime movers have been extensively developed for land- and marine-based transport systems. The use of such powerplants in airborne applications has been historically impractical due to energy and power density constraints. Improvements in battery and electric motor technology make aircraft hybrid powerplants feasible. This paper presents a technique for determining the feasibility and mechanical effectiveness of powerplant hybridisation. In this work, a prototype aircraft hybrid powerplant was designed, constructed and tested. It is shown that an additional 35% power can be supplied from the hybrid system with an overall weight penalty of 5%, for a given unmanned aerial system. A flight dynamic model was developed using the AeroSim Blockset in MATLAB Simulink. The results have shown that climb rates can be improved by 56% and endurance increased by 13% when using the hybrid powerplant concept.

Flying robots to the rescue

UAVs could one day save the lives of lost civilians and those sent to find them, and a competition in outback Australia is proving how soon that day might come. We have all seen news stories of people who ventured beyond the day-to-day reach of the community and got lost: search parties are formed, aircraft drafted in, and often large sums of money expended in the quest to find them.

The effect of autonomy transparency in human-robot interactions : a preliminary study on operator cognitive workload and situation awareness in multiple heterogeneous UAV management

The autonomous capabilities in collaborative unmanned aircraft systems are growing rapidly. Without appropriate transparency, the effectiveness of the future multiple Unmanned Aerial Vehicle (UAV) management paradigm will be significantly limited by the human agent’s cognitive abilities; where the operator’s CognitiveWorkload (CW) and Situation Awareness (SA) will present as disproportionate. This proposes a challenge in evaluating the impact of robot autonomous capability feedback, allowing the human agent greater transparency into the robot’s autonomous status - in a supervisory role. This paper presents; the motivation, aim, related works, experiment theory, methodology, results and discussions, and the future work succeeding this preliminary study. The results in this paper illustrates that, with a greater transparency of a UAV’s autonomous capability, an overall improvement in the subjects’ cognitive abilities was evident, that is, with a confidence of 95%, the test subjects’ mean CW was demonstrated to have a statistically significant reduction, while their mean SA was demonstrated to have a significant increase.

Modeling and control of a robotic power line inspection vehicle

Power line inspection is a vital function for electricity supply companies but it involves labor-intensive and expensive procedures which are tedious and error-prone for humans to perform. A possible solution is to use an unmanned aerial vehicle (UAV) equipped with video surveillance equipment to perform the inspection. This paper considers how a small, electrically driven rotorcraft conceived for this application could be controlled by visually tracking the overhead supply lines. A dynamic model for a ducted-fan rotorcraft is presented and used to control the action of an Air Vehicle Simulator (AVS), consisting of a cable-array robot. Results show how visual data can be used to determine, and hence regulate in closed loop, the simulated vehicle’s position relative to the overhead lines.

Agent-based modelling and simulation of airplane boarding processes

Passenger flow simulations are an important tool for designing and managing airports. This thesis examines the different boarding strategies for the Boeing 777 and Airbus 380 aircraft in order to investigate their current performance and to determine minimum boarding times. The most optimal strategies have been discovered and new strategies that are more efficient are proposed. The methods presented offer reduced aircraft boarding times which plays an important role for reducing the overall aircraft Turn Time for an airline.

3D reconfigurable autopilot flight system for both general aviation and unmanned aerial systems

This research project investigated and designed a modular architecture for a 3D Reconfigurable Autopilot Flight System that could be used to control actuators in both manned and unmanned aircraft. The system is based on a CAN Bus interface and allows seamless control of different types of actuators. During the course of the research the differences and similarities of autopilots for fixed-wing general aviation aircraft and unmanned aircraft were analysed focusing on the actuator interfaces. This project suggests that software and hardware used in commercial-of-the-shelf avionics could be used in manned and unmanned aviation.

Flight-training effect on the cervical muscle isometric strength of trainee pilots

External stimulus/loading initiates adaptations within skeletal muscle. It has been previously found that the cervical area has the highest loading while performing flying maneuvers under +Gz. The first purpose of this study was to examine the neck muscle response to the physical environment associated with flight training, incorporating limited exposure to +Gz force, in a Pilatus PC-9 aircraft. The second purpose was to examine the short-term range of movement (ROM) response to flight training. Isometric cervical muscle strength and ROM was monitored in 9 RAAF pilots completing an 8-mo flight-training course at Pearce Airbase in Western Australia, and in 10 controls matched for gender, age, height, and weight. Isometric cervical muscle strength and ROM were measured at baseline and at 8 mo using the multi-cervical rehabilitation unit (Hanoun Medical, Downsview, Ontario, Canada). Results indicated that an increase in pilot neck strength was limited to flexion while in a neutral position. No strength changes were recorded in any other site in the pilots or for the controls. These findings suggest that short-term exposure to the physical environment associated with flight training had a limited significant effect on increasing isometric cervical muscle strength. No significant changes were observed in pilot ROM, indicating that short-term exposure to flight does not effect ROM.