A helicopter named Dolly: Behavioural cloning for autonomous helicopter control

This paper considers the pros and cons of using behavioural cloning for the development of low-level helicopter automation modules. Over the course of this project several Behavioural cloning approaches have been investigated. The results of the most effective Behavioural cloning approach are then compared to PID modules designed for the same aircraft. The comparison takes into consideration development time, reliability, and control performance. It has been found that Behavioural cloning techniques employing local approximators and a wide state-space coverage during training can produce stabilising control modules in less time than tuning PID controllers. However, performance and reliabity deficits have been found to exist with the Behavioural Cloning, attributable largely to the time variant nature of the dynamics due to the operating environment, and the pilot actions being poor for teaching. The final conclusion drawn here is that tuning PID modules remains superior to behavioural cloning for low-level helicopter automation.

Helicopter automation using a low-cost sensing system

This paper details the design of an autonomous helicopter control system using a low cost sensor suite. Control is maintained using simple nested PID loops. Aircraft attitude, velocity, and height is estimated using an in-house designed IMU and vision system. Information is combined using complimentary filtering. The aircraft is shown to be stabilised and responding to high level demands on all axes, including heading, height, lateral velocity and longitudinal velocity.

Adaptation of an commercially available stabilised R/C helicopter to a fully autonomous surveillance UAV

This paper presents the development of an autonomous surveillance UAV that competed in the Ministry of Defence Grand Challenge 2008. In order to focus on higher-level mission control, the UAV is built upon an existing commercially available stabilised R/C helicopter platform. The hardware architecture is developed to allow for non-invasion integration with the existing stabilised platform, and to enable to the distributed processing of closed loop control and mission goals. The resulting control system proved highly successful and was capable of flying within 40knott gusts. The software and safety architectures were key to the success of the research and also hold the potential for use in the development of more complex system comprising of multiple UAVs.

Autonomous behaviors for an unmanned mini-aerial vehicle

This thesis aims at addressing the development of autonomous behaviors, for search and exploration with a mini-UAV (Unmanned Aerial Vehicle), or also called MAV (Mini Aerial Vehicle) prototype, in order to gather information in rescue scenarios. The platform used in this work is a four rotor helicopter, known as quad-rotor from the German company Ascending Technologies GmbH, which is later assembled with a on-board processing unit (i.e. a tiny light weight computer) and a on-board sensor suite (i.e. 2D-LIDAR and Ultrasonic Sonar). This work can be divided into two phases. In the first phase an Indoor Position Tracking system was settled in order to obtain the Cartesian coordinates (i.e. X, Y, Z) and orientation (i.e.heading) which provides the relative position and orientation of the platform. The second phase was the design and implementation of medium/high level controllers on each command input in order to autonomously control the aircraft position, which is the first step towards an autonomous hovering flight, and any autonomous behavior (e.g. Landing, Object avoidance, Follow the wall). The main work is carried out in the Laboratory ”Intelligent Systems for Emergencies and Civil Defense”, in collaboration with ”Dipartimento di Informatica e Sistemistica” of Sapienza Univ. of Rome and ”Istituto Superiore Antincendi” of the Italian Firemen Department.

Autonomous Landing of an Unmanned Aerial Vehicle using Image-Based Fuzzy Control

This paper presents a vision based autonomous landing control approach for unmanned aerial vehicles (UAV). The 3D position of an unmanned helicopter is estimated based on the homographies estimated of a known landmark. The translation and altitude estimation of the helicopter against the helipad position are the only information that is used to control the longitudinal, lateral and descend speeds of the vehicle. The control system approach consists in three Fuzzy controllers to manage the speeds of each 3D axis of the aircraft s coordinate system. The 3D position estimation was proven rst, comparing it with the GPS + IMU data with very good results. The robust of the vision algorithm against occlusions was also tested. The excellent behavior of the Fuzzy control approach using the 3D position estimation based in homographies was proved in an outdoors test using a real unmanned helicopter.

Toward Visual Autonomous Ship Board Landing of a VTOL UAV

In this paper we tackle the problem of landing a helicopter autonomously on a ship deck, using as the main sensor, an on-board colour camera. To create a test-bed, we first adequately simulate the movement of a ship landing platform on the Sea, for different Sea States, for different ships, randomly and realistically enough. We use a commercial parallel robot to get this movement. Once we had this, we developed an accurate and robust computer vision system to measure the pose of the helipad with respect to the on-board camera. To deal with the noise and the possible fails of the computer vision, a state estimator was created. With all of this, we are now able to develop and test a controller that closes the loop and finish the autonomous landing task.

Stability region bifurcations of nonlinear autonomous dynamical systems: Type-zero saddle-node bifurcations

The behavior of stability regions of nonlinear autonomous dynamical systems subjected to parameter variation is studied in this paper. In particular, the behavior of stability regions and stability boundaries when the system undergoes a type-zero sadle-node bifurcation on the stability boundary is investigated in this paper. It is shown that the stability regions suffer drastic changes with parameter variation if type-zero saddle-node bifurcations occur on the stability boundary. A complete characterization of these changes in the neighborhood of a type-zero saddle-node bifurcation value is presented in this paper. Copyright (C) 2010 John Wiley & Sons, Ltd.

Accelerating autonomous learning by using heuristic selection of actions

This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.

Success of surgery for primary aldosteronism judged by residual autonomous aldosterone production

Since February 1996 we have prospectively assessed residual adrenal autonomy by the fludrocortisone suppression test (FST) in 23 patients 3 months after unilateral adrenalectomy for Conn syndrome and in 45 patients after a longer interval. In regard to blood pressure, 36 (53%) patients were cured of hypertension and the remaining 32 (47%) patients had improved hypertension control at the time of their latest postoperative clinical assessment. In regard to the outcome of surgery, patients who achieved normal suppressibility of aldosterone were regarded as cured, and those who had greater suppressibility after surgery were considered improved. Time since surgery for the whole group averaged 26 months. By these biochemical criteria, 42 patients (62%) were cured by surgery, and the rest improved; 16 (76%) of 21 women were cured, and 26 (55%) of 47 men. The women (mean +/- SD age 47 +/- 11 years) were significantly (p < 0.05) younger than the men (52 +/- 9 Sears). Preoperative aldosterone levels before and after FST were similar in the cured and improved groups and fell significantly (p < 0.01) in both groups following surgery. After surgical reduction of autonomous aldosterone production, mean plasma renin activity levels increased sixfold in the cured group and threefold in the improved group. Surgical mortality in this group of 68 patients with Conn syndrome was zero.

The dimerization and topological specificity functions of MinE reside in a structurally autonomous C-terminal domain

Correct placement of the division septum in Escherichia coli requires the co-ordinated action of three proteins, MinC, MinD and MinE. MinC and MinD interact to form a non-specific division inhibitor that blocks septation at all potential division sites. MinE is able to antagonize MinCD in a topologically sensitive manner, as it restricts MinCD activity to the unwanted division sites at the cell poles, Here, we show that the topological specificity function of MinE residues in a structurally autonomous, trypsin-resistant domain comprising residues 31-88, Nuclear magnetic resonance (NMR) and circular dichroic spectroscopy indicate that this domain includes both alpha and beta secondary structure, while analytical ultracentrifugation reveals that it also contains a region responsible for MinE homodimerization. While trypsin digestion indicates that the anti-MinCD domain of MinE (residues 1-22) does not form a tightly folded structural domain, NMR analysis of a peptide corresponding to MinE(1-22) indicates that this region forms a nascent helix in which the peptide rapidly interconverts between disordered (random coil) and alpha-helical conformations, This suggests that the N-terminal region of MinE may be poised to adopt an alpha-helical conformation when it interacts with the target of its anti-MinCD activity, presumably MinD.

C(alpha)-HOLDER CLASSICAL SOLUTIONS FOR NON-AUTONOMOUS NEUTRAL DIFFERENTIAL EQUATIONS

In this paper we discuss the existence of alpha-Holder classical solutions for non-autonomous abstract partial neutral functional differential equations. An application is considered.

Identification of novel non-autonomous CemaT transposable elements and evidence of their mobility within the C. elegans genome

We describe here two new transposable elements, CemaT4 and CemaT5, that were identified within the sequenced genome of Caenorhabditis elegans using homology based searches. Five variants of CemaT4 were found, all non-autonomous and sharing 26 bp inverted terminal repeats (ITRs) and segments (152-367 bp) of sequence with similarity to the CemaT1 transposon of C. elegans. Sixteen copies of a short, 30 bp repetitive sequence, comprised entirely of an inverted repeat of the first 15 bp of CemaT4's ITR, were also found, each flanked by TA dinucleotide duplications, which are hallmarks of target site duplications of mariner-Tc transposon transpositions. The CemaT5 transposable element had no similarity to maT elements, except for sharing identical ITR sequences with CemaT3. We provide evidence that CemaT5 and CemaT3 are capable of excising from the C. elegans genome, despite neither transposon being capable of encoding a functional transposase enzyme. Presumably, these two transposons are cross-mobilised by an autonomous transposon that recognises their shared ITRs. The excisions of these and other non-autonomous elements may provide opportunities for abortive gap repair to create internal deletions and/or insert novel sequence within these transposons. The influence of non-autonomous element mobility and structural diversity on genome variation is discussed.