Learned stochastic mobility prediction for planning with control uncertainty on unstructured terrain

Motion planning for planetary rovers must consider control uncertainty in order to maintain the safety of the platform during navigation. Modelling such control uncertainty is difficult due to the complex interaction between the platform and its environment. In this paper, we propose a motion planning approach whereby the outcome of control actions is learned from experience and represented statistically using a Gaussian process regression model. This mobility prediction model is trained using sample executions of motion primitives on representative terrain, and predicts the future outcome of control actions on similar terrain. Using Gaussian process regression allows us to exploit its inherent measure of prediction uncertainty in planning. We integrate mobility prediction into a Markov decision process framework and use dynamic programming to construct a control policy for navigation to a goal region in a terrain map built using an on-board depth sensor. We consider both rigid terrain, consisting of uneven ground, small rocks, and non-traversable rocks, and also deformable terrain. We introduce two methods for training the mobility prediction model from either proprioceptive or exteroceptive observations, and report results from nearly 300 experimental trials using a planetary rover platform in a Mars-analogue environment. Our results validate the approach and demonstrate the value of planning under uncertainty for safe and reliable navigation.

Shared autonomy for close-quarters navigation and control of a VTOL platform

This thesis presents an approach for a vertical infrastructure inspection using a vertical take-off and landing (VTOL) unmanned aerial vehicle and shared autonomy. Inspecting vertical structure such as light and power distribution poles is a difficult task. There are challenges involved with developing such an inspection system, such as flying in close proximity to a target while maintaining a fixed stand-off distance from it. The contributions of this thesis fall into three main areas. Firstly, an approach to vehicle dynamic modeling is evaluated in simulation and experiments. Secondly, EKF-based state estimators are demonstrated, as well as estimator-free approaches such as image based visual servoing (IBVS) validated with motion capture ground truth data. Thirdly, an integrated pole inspection system comprising a VTOL platform with human-in-the-loop control, (shared autonomy) is demonstrated. These contributions are comprehensively explained through a series of published papers.

Advances in gyro-stabilisation of vessel roll motion

The use of gyro-dynamic forces to counteract the wave-induced roll motion of marine vessels in a seaway was proposed over 100 years ago. These early systems showed a remarkable performance, reporting roll reductions of up to 95% in some sailing conditions. Despite this success, further developments were not pursued since the systems were unable to provide acceptable performance over an extended envelope of sailing and environmental conditions, and the invention of fin roll stabilisers provided a satisfactory alternative. This has been attributed to simplistic controls, heavy drive systems, and large structural mass required to withstand the loads given the low strength materials available at the time. Today, advances in material strength, bearings, motor technology and mechanical design methods, together with powerful signal processing algorithms, has resulted in a revitalized interest in gyro-stabilisers for ships. Advanced control systems have enabled optimisation of restoring torques across a range of wave environments and sailing conditions through adaptive control system design. All of these improvements have resulted in increased spinning speed, lower mass, and dramatically increased stabilising performance. This brief paper provides an overview of recent developments in the design and control of gyro-stabilisers of ship roll motion. In particular, the novel Halcyon Gyro-Stabilisers are introduced, and their performance is illustrated based on a simulation case study for a naval patrol vessel. Given the growing national and global interest in small combatants and patrol vessels, modem gyro-stabilisers may offer a significant technological contribution to the age old problem of comfort and mission operability on small ships, especially at loiter speeds.

The pattern of coupling dynamics between postural motion, isotonic hand movements and physiological tremor

This study was designed to examine differences in the coupling dynamics between upper limb motion, physiological tremor and whole body postural sway in young healthy adults. Acceleration of the hand and fingers, forearm EMG activity and postural sway data were recorded. Estimation of the degree of bilateral and limb motion-postural sway coupling was determined by cross correlation, coherence and Cross-ApEn analyses. The results of the analysis revealed that, under postural tremor conditions, there was no significant coupling between limbs, muscles or sway across all metrics of coupling. In contrast, performing a rapid alternating flexion/extension movement about the wrist joint (with one or both limbs) resulted in stronger coupling between limb motion and postural sway. These results support the view that, for physiological tremor responses, the control of postural sway is maintained independent to tremor in the upper limb. However, increasing the level of movement about a distal segment of one arm (or both) leads to increased coupling throughout the body. The basis for this increased coupling would appear to be related to the enhanced neural drive to task-specific muscles within the upper limb.

The effect of repeated loading and freeze-thaw cycling on immature bovine thoracic motion segment stiffness

There is growing interest in the biomechanics of ‘fusionless’ implant constructs used for deformity correction in the thoracic spine, however, there are questions over the comparability of in vitro biomechanical studies from different research groups due to the various methods used for specimen preparation, testing and data collection. The aim of this study was to identify the effect of two key factors on the stiffness of immature bovine thoracic spine motion segments: (i) repeated cyclic loading and (ii) multiple freeze-thaw cycles, to aid in the planning and interpretation of in vitro studies. Two groups of thoracic spine motion segments from 6-8 week old calves were tested in flexion/extension, right/left lateral bending, and right/left axial rotation under moment control. Group (A) were tested with continuous repeated cyclic loading for 500 cycles with data recorded at cycles 3, 5, 10, 25, 50, 100, 200, 300, 400 and 500. Group (B) were tested after each of five freeze-thaw sequences, with data collected from the 10th load cycle in each sequence. Group A: Flexion/extension stiffness reduced significantly over the 500 load cycles (-22%; P=0.001), but there was no significant change between the 5th and 200th load cycles. Lateral bending stiffness decreased significantly (-18%; P=0.009) over the 500 load cycles, but there was no significant change in axial rotation stiffness (P=0.137). Group B: There was no significant difference between mean stiffness over the five freeze-thaw sequences in flexion/extension (P=0.813) and a near significant reduction in mean stiffness in axial rotation (-6%; P=0.07). However, there was a statistically significant increase in stiffness in lateral bending (+30%; P=0.007). Comparison of in vitro testing results for immature thoracic bovine spine segments between studies can be performed with up to 200 load cycles without significant changes in stiffness. However, when testing protocols require greater than 200 cycles, or when repeated freeze-thaw cycles are involved, it is important to account for the effect of cumulative load and freeze-thaw cycles on spine segment stiffness.

Curiosity driven reinforcement learning for motion planning on humanoids

Most previous work on artificial curiosity (AC) and intrinsic motivation focuses on basic concepts and theory. Experimental results are generally limited to toy scenarios, such as navigation in a simulated maze, or control of a simple mechanical system with one or two degrees of freedom. To study AC in a more realistic setting, we embody a curious agent in the complex iCub humanoid robot. Our novel reinforcement learning (RL) framework consists of a state-of-the-art, low-level, reactive control layer, which controls the iCub while respecting constraints, and a high-level curious agent, which explores the iCub's state-action space through information gain maximization, learning a world model from experience, controlling the actual iCub hardware in real-time. To the best of our knowledge, this is the first ever embodied, curious agent for real-time motion planning on a humanoid. We demonstrate that it can learn compact Markov models to represent large regions of the iCub's configuration space, and that the iCub explores intelligently, showing interest in its physical constraints as well as in objects it finds in its environment.

Adaptive compliance control of a multi‐legged stair‐climbing robot based on proprioceptive data

Purpose – The purpose of this paper is to describe an innovative compliance control architecture for hybrid multi‐legged robots. The approach was verified on the hybrid legged‐wheeled robot ASGUARD, which was inspired by quadruped animals. The adaptive compliance controller allows the system to cope with a variety of stairs, very rough terrain, and is also able to move with high velocity on flat ground without changing the control parameters. Design/methodology/approach – The paper shows how this adaptivity results in a versatile controller for hybrid legged‐wheeled robots. For the locomotion control we use an adaptive model of motion pattern generators. The control approach takes into account the proprioceptive information of the torques, which are applied on the legs. The controller itself is embedded on a FPGA‐based, custom designed motor control board. An additional proprioceptive inclination feedback is used to make the same controller more robust in terms of stair‐climbing capabilities. Findings – The robot is well suited for disaster mitigation as well as for urban search and rescue missions, where it is often necessary to place sensors or cameras into dangerous or inaccessible areas to get a better situation awareness for the rescue personnel, before they enter a possibly dangerous area. A rugged, waterproof and dust‐proof corpus and the ability to swim are additional features of the robot. Originality/value – Contrary to existing approaches, a pre‐defined walking pattern for stair‐climbing was not used, but an adaptive approach based only on internal sensor information. In contrast to many other walking pattern based robots, the direct proprioceptive feedback was used in order to modify the internal control loop, thus adapting the compliance of each leg on‐line.

Predictive motion planning for AUVs subject to strong time-varying currents and forecasting uncertainties

This paper presents a novel path planning method for minimizing the energy consumption of an autonomous underwater vehicle subjected to time varying ocean disturbances and forecast model uncertainty. The algorithm determines 4-Dimensional path candidates using Nonlinear Robust Model Predictive Control (NRMPC) and solutions optimised using A*-like algorithms. Vehicle performance limits are incorporated into the algorithm with disturbances represented as spatial and temporally varying ocean currents with a bounded uncertainty in their predictions. The proposed algorithm is demonstrated through simulations using a 4-Dimensional, spatially distributed time-series predictive ocean current model. Results show the combined NRMPC and A* approach is capable of generating energy-efficient paths which are resistant to both dynamic disturbances and ocean model uncertainty.

Applications of real-time machine vision to the control of mining equipment

The mining industry presents us with a number of ideal applications for sensor based machine control because of the unstructured environment that exists within each mine. The aim of the research presented here is to increase the productivity of existing large compliant mining machines by retrofitting with enhanced sensing and control technology. The current research focusses on the automatic control of the swing motion cycle of a dragline and an automated roof bolting system. We have achieved: * closed-loop swing control of an one-tenth scale model dragline; * single degree of freedom closed-loop visual control of an electro-hydraulic manipulator in the lab developed from standard components.

Design and evaluation of decision and control strategies for autonomous vision-based see and avoid systems

This paper details the design and performance assessment of a unique collision avoidance decision and control strategy for autonomous vision-based See and Avoid systems. The general approach revolves around re-positioning a collision object in the image using image-based visual servoing, without estimating range or time to collision. The decision strategy thus involves determining where to move the collision object, to induce a safe avoidance manuever, and when to cease the avoidance behaviour. These tasks are accomplished by exploiting human navigation models, spiral motion properties, expected image feature uncertainty and the rules of the air. The result is a simple threshold based system that can be tuned and statistically evaluated by extending performance assessment techniques derived for alerting systems. Our results demonstrate how autonomous vision-only See and Avoid systems may be designed under realistic problem constraints, and then evaluated in a manner consistent to aviation expectations.

An automated emergency landing system for fixed-wing aircraft: Planning and control

A number of hurdles must be overcome in order to integrate unmanned aircraft into civilian airspace for routine operations. The ability of the aircraft to land safely in an emergency is essential to reduce the risk to people, infrastructure and aircraft. To date, few field-demonstrated systems have been presented that show online re-planning and repeatability from failure to touchdown. This paper presents the development of the Guidance, Navigation and Control (GNC) component of an Automated Emergency Landing System (AELS) intended to address this gap, suited to a variety of fixed-wing aircraft. Field-tested on both a fixed-wing UAV and Cessna 172R during repeated emergency landing experiments, a trochoid-based path planner computes feasible trajectories and a simplified control system executes the required manoeuvres to guide the aircraft towards touchdown on a predefined landing site. This is achieved in zero-thrust conditions with engine forced to idle to simulate failure. During an autonomous landing, the controller uses airspeed, inertial and GPS data to track motion and maintains essential flight parameters to guarantee flyability, while the planner monitors glide ratio and re-plans to ensure approach at correct altitude. Simulations show reliability of the system in a variety of wind conditions and its repeated ability to land within the boundary of a predefined landing site. Results from field-tests for the two aircraft demonstrate the effectiveness of the proposed GNC system in live operation. Results show that the system is capable of guiding the aircraft to close proximity of a predefined keyhole in nearly 100% of cases.

Active Adaptive Gyrostabiliser Control System

A gyrostabiliser control system and method for stabilising marine vessel motion based on precession information only. The control system employs an Automatic Gain Control (AGC) precession controller (60). This system operates with a gain factor that is always being gradually minimized so as to let the gyro flywheel (12) develop as much precession as possible - the higher the precession, the higher the roll stabilising moment. This continuous gain change provides adaptation to changes in sea state and sailing conditions. The system effectively predicts the likelihood of maximum precession being reached. Should this event be detected, then the gain is rapidly increased so as to provide a breaking precession torque. Once the event has passed, the system again attempts to gradually decrease the gain.

Fault tolerant vessel stabiliser control system

A vessel stabilizer control system includes a sensor fault detection means which senses the availability of sensing signals from a gyrostabilizer precession motion sensor and a vessel roll motion sensor. The control system controls the action of a gyro-actuator which is mechanically coupled to a gyrostabilizer. The benefit of employing fault sensing of the sensors providing the process control variables is that the sensed number of available process control variables (or sensors) can be used to activate a tiered system of control modes. Each tiered control mode is designed to utilize the available process control variables to ensure safe and effective operation of the gyrostabilizer that is tolerant of sensor faults and loss of power supply. A control mode selector is provided for selecting the appropriate control mode based on the number of available process control variables.

Performance analysis and control design of a gyro-based wave energy converter

This paper analyses the performance of particular wave-energy converter that uses the gyroscopic effects of a large rotating fly-wheel in combination with a controlled power-take-off device. Controlled gyroscopic forces have been used successfully in the past to reduce the motion of marine structures. With appropriately designed power-take-off elements, gyroscopic forces can be controlled to optimise the extracted energy from the motion of marine structures.