Shared autonomy for close-quarters navigation and control of a VTOL platform

This thesis presents an approach for a vertical infrastructure inspection using a vertical take-off and landing (VTOL) unmanned aerial vehicle and shared autonomy. Inspecting vertical structure such as light and power distribution poles is a difficult task. There are challenges involved with developing such an inspection system, such as flying in close proximity to a target while maintaining a fixed stand-off distance from it. The contributions of this thesis fall into three main areas. Firstly, an approach to vehicle dynamic modeling is evaluated in simulation and experiments. Secondly, EKF-based state estimators are demonstrated, as well as estimator-free approaches such as image based visual servoing (IBVS) validated with motion capture ground truth data. Thirdly, an integrated pole inspection system comprising a VTOL platform with human-in-the-loop control, (shared autonomy) is demonstrated. These contributions are comprehensively explained through a series of published papers.

Principles of goal-directed spatial robot navigation in biomimetic models

Mobile robots and animals alike must effectively navigate their environments in order to achieve their goals. For animals goal-directed navigation facilitates finding food, seeking shelter or migration; similarly robots perform goal-directed navigation to find a charging station, get out of the rain or guide a person to a destination. This similarity in tasks extends to the environment as well; increasingly, mobile robots are operating in the same underwater, ground and aerial environments that animals do. Yet despite these similarities, goal-directed navigation research in robotics and biology has proceeded largely in parallel, linked only by a small amount of interdisciplinary research spanning both areas. Most state-of-the-art robotic navigation systems employ a range of sensors, world representations and navigation algorithms that seem far removed from what we know of how animals navigate; their navigation systems are shaped by key principles of navigation in ‘real-world’ environments including dealing with uncertainty in sensing, landmark observation and world modelling. By contrast, biomimetic animal navigation models produce plausible animal navigation behaviour in a range of laboratory experimental navigation paradigms, typically without addressing many of these robotic navigation principles. In this paper, we attempt to link robotics and biology by reviewing the current state of the art in conventional and biomimetic goal-directed navigation models, focusing on the key principles of goal-oriented robotic navigation and the extent to which these principles have been adapted by biomimetic navigation models and why.

Visual place recognition for persistent robot navigation in changing environments

This thesis demonstrates that robots can learn about how the world changes, and can use this information to recognise where they are, even when the appearance of the environment has changed a great deal. The ability to localise in highly dynamic environments using vision only is a key tool for achieving long-term, autonomous navigation in unstructured outdoor environments. The proposed learning algorithms are designed to be unsupervised, and can be generated by the robot online in response to its observations of the world, without requiring information from a human operator or other external source.

Autonomous hot metal carrier: Navigation and manipulation with a 20 tonne industrial vehicle

This paper reports work on the automation of a hot metal carrier, which is a 20 tonne forklift-type vehicle used to move molten metal in aluminium smelters. To achieve efficient vehicle operation, issues of autonomous navigation and materials handling must be addressed. We present our complete system and experiments demonstrating reliable operation. One of the most significant experiments was five-hours of continuous operation where the vehicle travelled over 8 km and conducted 60 load handling operations. Finally, an experiment where the vehicle and autonomous operation were supervised from the other side of the world via a satellite phone network are described.

Superpixel-based appearance change prediction for long-term navigation across seasons

Changing environments pose a serious problem to current robotic systems aiming at long term operation under varying seasons or local weather conditions. This paper is built on our previous work where we propose to learn to predict the changes in an environment. Our key insight is that the occurring scene changes are in part systematic, repeatable and therefore predictable. The goal of our work is to support existing approaches to place recognition by learning how the visual appearance of an environment changes over time and by using this learned knowledge to predict its appearance under different environmental conditions. We describe the general idea of appearance change prediction (ACP) and investigate properties of our novel implementation based on vocabularies of superpixels (SP-ACP). Our previous work showed that the proposed approach significantly improves the performance of SeqSLAM and BRIEF-Gist for place recognition on a subset of the Nordland dataset under extremely different environmental conditions in summer and winter. This paper deepens the understanding of the proposed SP-ACP system and evaluates the influence of its parameters. We present the results of a large-scale experiment on the complete 10 h Nordland dataset and appearance change predictions between different combinations of seasons.

Robot navigation using human cues: A robot navigation system for symbolic goal-directed exploration

In this paper we present for the first time a complete symbolic navigation system that performs goal-directed exploration to unfamiliar environments on a physical robot. We introduce a novel construct called the abstract map to link provided symbolic spatial information with observed symbolic information and actual places in the real world. Symbolic information is observed using a text recognition system that has been developed specifically for the application of reading door labels. In the study described in this paper, the robot was provided with a floor plan and a destination. The destination was specified by a room number, used both in the floor plan and on the door to the room. The robot autonomously navigated to the destination using its text recognition, abstract map, mapping, and path planning systems. The robot used the symbolic navigation system to determine an efficient path to the destination, and reached the goal in two different real-world environments. Simulation results show that the system reduces the time required to navigate to a goal when compared to random exploration.

Evaluation of internal navigation sensor suites for underground mining vehicle navigation

This paper describes a series of trials that were done at an underground mine in New South Wales, Australia. Experimental results are presented from the data obtained during the field trials and suitable sensor suites for an autonomous mining vehicle navigation system are evaluated.

Issues in autonomous navigation of underground vehicles

This paper describes current research at the Australian Centre for Field Robotics (ACFR) in collaboration with the Commonwealth Scientific and Industrial Research Organisation (CSIRO) within the Cooperative Research Centre (CRC) for Mining Technology and Equipment (CMTE) towards achieving autonomous navigation of underground vehicles, like a Load-Haul-Dump (LHD) truck. This work is being sponsored by the mining industry through the Australian Mineral Industries Research Association Limited (AMIRA). Robust and reliable autonomous navigation can only be realised by achieving high level tasks such as path-planning and obstacle avoidance. This requires determining the pose (position and orientation) of the vehicle at all times. A minimal infrastructure localisation algorithm that has been developed for this purpose is outlined and the corresponding results are presented. Further research issues that are under investigation are also outlined briefly.

Quantification of functional hand grip using electromyography and inertial sensor-derived accelerations: Clinical implications

Background Assessing hand injury is of great interest given the level of involvement of the hand with the environment. Knowing different assessment systems and their limitations generates new perspectives. The integration of digital systems (accelerometry and electromyography) as a tool to supplement functional assessment allows the clinician to know more about the motor component and its relation to movement. Therefore, the purpose of this study was the kinematic and electromyography analysis during functional hand movements. Method Ten subjects carried out six functional movements (terminal pinch, termino-lateral pinch, tripod pinch, power grip, extension grip and ball grip). Muscle activity (hand and forearm) was measured in real time using electromyograms, acquired with the Mega ME 6000, whilst acceleration was measured using the AcceleGlove. Results Electrical activity and acceleration variables were recorded simultaneously during the carrying out of the functional movements. The acceleration outcome variables were the modular vectors of each finger of the hand and the palm. In the electromyography, the main variables were normalized by the mean and by the maximum muscle activity of the thenar region, hypothenar, first interosseous dorsal, wrist flexors, carpal flexors and wrist extensors. Conclusions Knowing muscle behavior allows the clinician to take a more direct approach in the treatment. Based on the results, the tripod grip shows greater kinetic activity and the middle finger is the most relevant in this regard. Ball grip involves most muscle activity, with the thenar region playing a fundamental role in hand activity. Clinical relevance Relating muscle activation, movements, individual load and displacement offers the possibility to proceed with rehabilitation by individual component.

Comparison of kinematic variables obtained by inertial sensors among stroke survivors and healthy older adults in the Functional Reach Test: cross-sectional study

Background Balance dysfunction is one of the most common problems in people who suffer stroke. To parameterize functional tests standardized by inertial sensors have been promoted in applied medicine. The aim of this study was to compare the kinematic variables of the Functional Reach Test (FRT) obtained by two inertial sensors placed on the trunk and lumbar region between stroke survivors (SS) and healthy older adults (HOA) and to analyze the reliability of the kinematic measurements obtained. Methods Cross-sectional study. Five SS and five HOA over 65. A descriptive analysis of the average range as well as all kinematic variables recorded was developed. The intrasubject and intersubject reliability of the measured variables was directly calculated. Results In the same intervals, the angular displacement was greater in the HOA group; however, they were completed at similar times for both groups, and HOA conducted the test at a higher speed and greater acceleration in each of the intervals. The SS values were higher than HOA values in the maximum and minimum acceleration in the trunk and in the lumbar region. Conclusions The SS show less functional reach, a narrower, slower and less accelerated movement during the FRT execution, but with higher peaks of acceleration and speed when they are compared with HOA.

Parameterization and reliability of single-leg balance test assessed with inertial sensors in stroke survivors: a cross-sectional study

Background and purpose There are no published studies on the parameterisation and reliability of the single-leg stance (SLS) test with inertial sensors in stroke patients. Purpose: to analyse the reliability (intra-observer/inter-observer) and sensitivity of inertial sensors used for the SLS test in stroke patients. Secondary objective: to compare the records of the two inertial sensors (trunk and lumbar) to detect any significant differences in the kinematic data obtained in the SLS test. Methods Design: cross-sectional study. While performing the SLS test, two inertial sensors were placed at lumbar (L5-S1) and trunk regions (T7–T8). Setting: Laboratory of Biomechanics (Health Science Faculty - University of Málaga). Participants: Four chronic stroke survivors (over 65 yrs old). Measurement: displacement and velocity, Rotation (X-axis), Flexion/Extension (Y-axis), Inclination (Z-axis); Resultant displacement and velocity (V): RV=(Vx2+Vy2+Vz2)−−−−−−−−−−−−−−−−−√ Along with SLS kinematic variables, descriptive analyses, differences between sensors locations and intra-observer and inter-observer reliability were also calculated. Results Differences between the sensors were significant only for left inclination velocity (p = 0.036) and extension displacement in the non-affected leg with eyes open (p = 0.038). Intra-observer reliability of the trunk sensor ranged from 0.889-0.921 for the displacement and 0.849-0.892 for velocity. Intra-observer reliability of the lumbar sensor was between 0.896-0.949 for the displacement and 0.873-0.894 for velocity. Inter-observer reliability of the trunk sensor was between 0.878-0.917 for the displacement and 0.847-0.884 for velocity. Inter-observer reliability of the lumbar sensor ranged from 0.870-0.940 for the displacement and 0.863-0.884 for velocity. Conclusion There were no significant differences between the kinematic records made by an inertial sensor during the development of the SLS testing between two inertial sensors placed in the lumbar and thoracic regions. In addition, inertial sensors. Have the potential to be reliable, valid and sensitive instruments for kinematic measurements during SLS testing but further research is needed.

Quantification of prone thoracic manipulation using inertial sensor–derived accelerations

Objective The aim of this study was to determine the linear acceleration, time-to-peak acceleration, and effect of hand position comparing 2 clinicians completing a thoracic manipulation. Methods Thirteen volunteers received a right- and left-“handed” prone thoracic manipulation while accelerations were recorded by an inertial sensor. Peak thrust acceleration and time-to-peak thrust were measured. Results There were differences in thrust acceleration between right- and left-handed techniques for one therapist. The mean peak thrust acceleration was different between therapists, with the more practiced therapist demonstrating greater peak thrust accelerations. Time-to-peak acceleration also revealed between therapist differences, with the more practiced therapist demonstrating shorter time-to-peak acceleration. Cavitation data suggested that manipulations with greater accelerations were more likely to result in cavitation. Conclusion The results of this study suggest that with greater frequency of use, therapists are likely to achieve greater accelerations and shorter time-to-peak accelerations. Furthermore, this study showed that an inertial sensor can be used to quantify important variables during thoracic manipulation and are able to detect intertherapist differences in technique.