Complex behavior and perception in Drosophila emerges from iterative feedback-regulated reflexes

For a hungry fruit fly, locating and landing on a fermenting fruit where it can feed, find mates, and lay eggs, is an essential and difficult task requiring the integration of both olfactory and visual cues. Understanding how flies accomplish this will help provide a comprehensive ethological context for the expanding knowledge of their neural circuits involved in processing olfaction and vision, as well as inspire novel engineering solutions for control and estimation in computationally limited robotic applications. In this thesis, I use novel high throughput methods to develop a detailed overview of how flies track odor plumes, land, and regulate flight speed. Finally, I provide an example of how these insights can be applied to robotic applications to simplify complicated estimation problems. To localize an odor source, flies exhibit three iterative, reflex-driven behaviors. Upon encountering an attractive plume, flies increase their flight speed and turn upwind using visual cues. After losing the plume, flies begin zigzagging crosswind, again using visual cues to control their heading. After sensing an attractive odor, flies become more attracted to small visual features, which increases their chances of finding the plume source. Their changes in heading are largely controlled by open-loop maneuvers called saccades, which they direct towards and away from visual features. If a fly decides to land on an object, it begins to decelerate so as to maintain a stereotypical ratio of expansion to retinal size. Once they reach a stereotypical distance from the target, flies extend their legs in preparation for touchdown. Although it is unclear what cues they use to trigger this behavior, previous studies have indicated that it is likely under visual control. In Chapter 3, I use a nonlinear control theoretic analysis and robotic testbed to propose a novel and putative mechanism for how a fly might visually estimate distance by actively decelerating according to a visual control law. Throughout these behaviors, a common theme is the visual control of flight speed. Using genetic tools I show that the neuromodulator octopamine plays an important role in regulating flight speed, and propose a neural circuit for how this controller might be implemented in the flies brain. Two general biological and engineering principles are evident across my experiments: (1) complex behaviors, such as foraging, can emerge from the interactions of simple independent sensory-motor modules; (2) flies control their behavior in such a way that simplifies complex estimation problems.

Stochastic optimal control

H. J. Kushner has obtained the differential equation satisfied by the optimal feedback control law for a stochastic control system in which the plant dynamics and observations are perturbed by independent additive Gaussian white noise processes. However, the differentiation includes the first and second functional derivatives and, except for a restricted set of systems, is too complex to solve with present techniques.

This investigation studies the optimal control law for the open loop system and incorporates it in a sub-optimal feedback control law. This suboptimal control law's performance is at least as good as that of the optimal control function and satisfies a differential equation involving only the first functional derivative. The solution of this equation is equivalent to solving two two-point boundary valued integro-partial differential equations. An approximate solution has advantages over the conventional approximate solution of Kushner's equation.

As a result of this study, well known results of deterministic optimal control are deduced from the analysis of optimal open loop control.

Incremental Control Synthesis for Robotics in the Presence of Temporal Logic Specifications

This thesis presents methods for incrementally constructing controllers in the presence of uncertainty and nonlinear dynamics. The basic setting is motion planning subject to temporal logic specifications. Broadly, two categories of problems are treated. The first is reactive formal synthesis when so-called discrete abstractions are available. The fragment of linear-time temporal logic (LTL) known as GR(1) is used to express assumptions about an adversarial environment and requirements of the controller. Two problems of changes to a specification are posed that concern the two major aspects of GR(1): safety and liveness. Algorithms providing incremental updates to strategies are presented as solutions. In support of these, an annotation of strategies is developed that facilitates repeated modifications. A variety of properties are proven about it, including necessity of existence and sufficiency for a strategy to be winning. The second category of problems considered is non-reactive (open-loop) synthesis in the absence of a discrete abstraction. Instead, the presented stochastic optimization methods directly construct a control input sequence that achieves low cost and satisfies a LTL formula. Several relaxations are considered as heuristics to address the rarity of sampling trajectories that satisfy an LTL formula and demonstrated to improve convergence rates for Dubins car and single-integrators subject to a recurrence task.

Model-based control of a Rijke tube combustion instability

A Rijke tube is used to demonstrate model-based control of a combustion instability, where controller design is based on measurement of the unstable system. The Rijke tube used was of length 0.75m and had a grid-stabilised laminar flame in its lower half. A microphone was used as a sensor and a loudspeaker as an actuator for active control. The open loop transfer function (OLTF) required for controller design was that from the actuator to the sensor. This was measured experimentally by sending a signal with two components to the actuator. The first was a control component from an empirically designed controller, which was used to stabilise the system, thus eliminating the non-linear limit cycle. The second was a high bandwidth signal for identification of the OLTF. This approach to measuring the OLTF is generic and can be applied to large-scale combustors. The measured OLTF showed that only the fundamental mode of the tube was unstable; this was consistent with the OLTF predicted by a mathematical model of the tube, involving 1-D linear acoustic waves and a time delay heat release model. Based on the measured OLTF, a controller to stabilise the instability was designed using Nyquist techniques. This was implemented and was seen to result in an 80dB reduction in the microphone pressure spectrum. A robustness study was performed by adding an additional length to the top of the Rijke tobe. The controller was found to achieve control up to an increase in tube length of 19%. This compared favourably with the empirical controller, which lost control for an increase in tube length of less than 3%.

Tutorial on loop shaping using H-infinity robust stabilization

A new method for multivariable control was proposed in McFarlane and Glover (1988 CDC). This method involved shaping the open-loop singular values with pre and/or post compensators and then designing a controller to robustly stabilize a normalized coprime factorization of this weighted plant. The method has many attractive features including guaranteed loop shape and robust stability and performance. This talk will outline the rationale of this method and illustrate its use on a number of applications.

Implementation of semi-active damping on a tri-axle heavy-vehicle suspension

A semi-active truck damper was developed in conjunction with a commercial shock absorber manufacturer. A linearized damper model was developed for control system design purposes. Open- and closed-loop damper force tracking control was implemented, with tests showing that an open-loop approach gave the best compromise between response speed and accuracy. A hardware-in-the-loop test facility was used to investigate performance of the damper when combined with a simulated quarter-car model. The input to the vehicle model was a set of randomly generated road profiles, each profile traversed at an appropriate speed. Modified skyhook damping tests showed a simultaneous improvement over the optimum passive case of 13 per cent in vertical body acceleration and 8 per cent in dynamic tyre forces. Full-scale vehicle tests of the damper on a heavy tri-axle trailer were carried out. Implementation of modified skyhook damping yielded a simultaneous improvement over the optimum passive case of 8 per cent in vertical body acceleration and 8 per cent in dynamic tyre forces. © IMechE 2008.

A theoretical approach to the passive control of spiral vortex breakdown

Previous numerical simulations have shown that vortex breakdown starts with the formation of a steady axisymmetric bubble and that an unsteady spiralling mode then develops on top of this.We study how this spiral mode of vortex breakdown might be suppressed or promoted. We use a Lagrangian approach to identify regions of the flow which are sensitive to small open-loop steady and unsteady (harmonic) forces. We find these regions to be upstream of the vortex breakdown bubble. We investigate passive control using a small axisymmetric control ring. In this case, the steady and unsteady control forces are caused by the drag force on the control ring. We find a narrow region upstream of the bubble where the control ring will stabilise the flow and we verify this using numerical simulations. © 2012 IEEE.

Linear quadratic game and non-cooperative predictive methods for potential application to modelling driver-AFS interactive steering control

This paper is concerned with the modelling of strategic interactions between the human driver and the vehicle active front steering (AFS) controller in a path-following task where the two controllers hold different target paths. The work is aimed at extending the use of mathematical models in representing driver steering behaviour in complicated driving situations. Two game theoretic approaches, namely linear quadratic game and non-cooperative model predictive control (non-cooperative MPC), are used for developing the driver-AFS interactive steering control model. For each approach, the open-loop Nash steering control solution is derived; the influences of the path-following weights, preview and control horizons, driver time delay and arm neuromuscular system (NMS) dynamics are investigated, and the CPU time consumed is recorded. It is found that the two approaches give identical time histories as well as control gains, while the non-cooperative MPC method uses much less CPU time. Specifically, it is observed that the introduction of weight on the integral of vehicle lateral displacement error helps to eliminate the steady-state path-following error; the increase in preview horizon and NMS natural frequency and the decline in time delay and NMS damping ratio improve the path-following accuracy. © 2013 Copyright Taylor and Francis Group, LLC.

Minimalistic control of biped walking in rough terrain

Toward our comprehensive understanding of legged locomotion in animals and machines, the compass gait model has been intensively studied for a systematic investigation of complex biped locomotion dynamics. While most of the previous studies focused only on the locomotion on flat surfaces, in this article, we tackle with the problem of bipedal locomotion in rough terrains by using a minimalistic control architecture for the compass gait walking model. This controller utilizes an open-loop sinusoidal oscillation of hip motor, which induces basic walking stability without sensory feedback. A set of simulation analyses show that the underlying mechanism lies in the "phase locking" mechanism that compensates phase delays between mechanical dynamics and the open-loop motor oscillation resulting in a relatively large basin of attraction in dynamic bipedal walking. By exploiting this mechanism, we also explain how the basin of attraction can be controlled by manipulating the parameters of oscillator not only on a flat terrain but also in various inclined slopes. Based on the simulation analysis, the proposed controller is implemented in a real-world robotic platform to confirm the plausibility of the approach. In addition, by using these basic principles of self-stability and gait variability, we demonstrate how the proposed controller can be extended with a simple sensory feedback such that the robot is able to control gait patterns autonomously for traversing a rough terrain. © 2010 Springer Science+Business Media, LLC.

Improved kinematic sensing for motion control applications

New compensation methods are presented that can greatly reduce the slit errors (i.e. transition location errors) and interval errors induced due to non-idealities in optical incremental encoders (square-wave). An M/T-type, constant sample-time digital tachometer (CSDT) is selected for measuring the velocity of the sensor drives. Using this data, three encoder compensation techniques (two pseudoinverse based methods and an iterative method) are presented that improve velocity measurement accuracy. The methods do not require precise knowledge of shaft velocity. During the initial learning stage of the compensation algorithm (possibly performed in-situ), slit errors/interval errors are calculated through pseudoinversebased solutions of simple approximate linear equations, which can provide fast solutions, or an iterative method that requires very little memory storage. Subsequent operation of the motion system utilizes adjusted slit positions for more accurate velocity calculation. In the theoretical analysis of the compensation of encoder errors, encoder error sources such as random electrical noise and error in estimated reference velocity are considered. Initially, the proposed learning compensation techniques are validated by implementing the algorithms in MATLAB software, showing a 95% to 99% improvement in velocity measurement. However, it is also observed that the efficiency of the algorithm decreases with the higher presence of non-repetitive random noise and/or with the errors in reference velocity calculations. The performance improvement in velocity measurement is also demonstrated experimentally using motor-drive systems, each of which includes a field-programmable gate array (FPGA) for CSDT counting/timing purposes, and a digital-signal-processor (DSP). Results from open-loop velocity measurement and closed-loop servocontrol applications, on three optical incremental square-wave encoders and two motor drives, are compiled. While implementing these algorithms experimentally on different drives (with and without a flywheel) and on encoders of different resolutions, slit error reductions of 60% to 86% are obtained (typically approximately 80%).

Improvement of the Performance of Hysteresis Compensation in SMA Actuators by Using Inverse Preisach Model in Closed – Loop Control System

The aim of this paper is to increase the performance of hysteresis compensation for Shape Memory Alloy (SMA) actuators by using inverse Preisach model in closed — loop control system. This is used to reduce hysteresis effects and improve accuracy for the displacement of SMA actuators. Firstly, hysteresis is identified by numerical Preisach model implementation. The geometrical interpretation from first order transition curves is used for hysteresis modeling. Secondly, the inverse Preisach model is formulated and incorporated in closed-loop PID control system in order to obtain desired current-to-displacement relationship with hysteresis reducing. The experimental results for hysteresis compensation by using this method are also shown in this paper.

Self-Feedback Motion Control for Cable-Driven Parallel Manipulators

This article proposes a closed-loop control scheme based on joint-angle feedback for cable-driven parallel manipulators (CDPMs), which is able to overcome various difficulties resulting from the flexible nature of the driven cables to achieve higher control accuracy. By introducing a unique structure design that accommodates built-in encoders in passive joints, the seven degrees of freedom (7-DOF) CDPM can obtain joint angle values without external sensing devices, and it is used for feedback control together with a proper closed-loop control algorithm. The control algorithm has been derived from the time differential of the kinematic formulation, which relates the joint angular velocities to the time derivative of cable lengths. In addition, the Lyapunov stability theory and Monte Carlo method have been used to mathematically verify the self-feedback control law that has tolerance for parameter errors. With the aid of co-simulation technique, the self-feedback closed-loop control is applied on a 7-DOF CDPM and it shows higher motion accuracy than the one with an open-loop control. The trajectory tracking experiment on the motion control of the 7-DOF CDPM demonstrated a good performance of the self-feedback control method.

A Soft Sensor for Viscosity Control of Polymer Extrusion

Viscosity represents a key indicator of product quality in polymer extrusion but has traditionally been difficult to measure in-process in real-time. An innovative, yet simple, solution to this problem is proposed by a Prediction-Feedback observer mechanism. A `Prediction' model based on the operating conditions generates an open-loop estimate of the melt viscosity; this estimate is used as an input to a second, `Feedback' model to predict the pressure of the system. The pressure value is compared to the actual measured melt pressure and the error used to correct the viscosity estimate. The Prediction model captures the relationship between the operating conditions and the resulting melt viscosity and as such describes the specific material behavior. The Feedback model on the other hand describes the fundamental physical relationship between viscosity and extruder pressure and is a function of the machine geometry. The resulting system yields viscosity estimates within 1% error, shows excellent disturbance rejection properties and can be directly applied to model-based control. This is of major significance to achieving higher quality and reducing waste and set-up times in the polymer extrusion industry.

Comando de ondulador de tensão trifásico por PWM e técnica U/F com implementação por microcontrolador

Dissertação para obtenção do grau de Mestre em Engenharia Electrotécnica Ramo de Automação e Electrónica Industrial

Controlo directo de binário de uma máquina assíncrona trifásica

Dissertação para obtenção do grau de Mestre em Engenharia Electrotécnica Ramo de Automação e Electrónica Industrial