A matlab-based toolbox for the simulation and design of L1 adaptive controllers

This thesis introduces the L1 Adaptive Control Toolbox, a set of tools implemented in Matlab that aid in the design process of an L1 adaptive controller and enable the user to construct simulations of the closed-loop system to verify its performance. Following a brief review of the existing theory on L1 adaptive controllers, the interface of the toolbox is presented, including a description of the functions accessible to the user. Two novel algorithms for determining the required sampling period of a piecewise constant adaptive law are presented and their implementation in the toolbox is discussed. The detailed description of the structure of the toolbox is provided as well as a discussion of the implementation of the creation of simulations. Finally, the graphical user interface is presented and described in detail, including the graphical design tools provided for the development of the filter C(s). The thesis closes with suggestions for further improvement of the toolbox.

Effective treatment of infectious diseases: A nonlinear adaptive control theoretic approach

A nonlinear adaptive system theoretic approach is presented in this paper for effective treatment of infectious diseases that affect various organs of the human body. The generic model used does not represent any specific disease. However, it mimics the generic immunological dynamics of the human body under pathological attack, including the response to external drugs. From a system theoretic point of view, drugs can be interpreted as control inputs. Assuming a set of nominal parameters in the mathematical model, first a nonlinear controller is designed based on the principle of dynamic inversion. This treatment strategy was found to be effective in completely curing "nominal patients". However, in some cases it is ineffective in curing "realistic patients". This leads to serious (sometimes fatal) damage to the affected organ. To make the drug dosage design more effective, a model-following neuro-adaptive control design is carried out using neural networks, which are trained (adapted) online. From simulation studies, this adaptive controller is found to be effective in killing the invading microbes and healing the damaged organ even in the presence of parameter uncertainties and continuing pathogen attack.

On the Milito-Cruz adaptive control scheme for Markov chains

Milito and Cruz have introduced a novel adaptive control scheme for finite Markov chains when a finite parametrized family of possible transition matrices is available. The scheme involves the minimization of a composite functional of the observed history of the process incorporating both control and estimation aspects. We prove the a.s. optimality of a similar scheme when the state space is countable and the parameter space a compact subset ofR.

Adaptive control of vibration transmission in a strut system

In this article, theoretical and the experimental studies are reported on the adaptive control of vibration transmission in a strut system subjected to a longitudinal pulse train excitation. In the control scheme, a magneto-strictive actuator is employed at the downstream transmission point in the secondary path. The actuator dynamics is taken into account. The system boundary parameters are first estimated off-line, and later employed to simulate the system dynamics. A Delayed-X Filtered-E spectral algorithm is proposed and implemented in real time. The underlying mechanics based filter construction allows for the time varying system dynamics to be taken into account. This work should be of interest for active control of vibration and noise transmission in helicopter gearbox support struts and other systems.

Reinforcement learning with average cost for adaptive control of traffic lights at intersections

We propose for the first time two reinforcement learning algorithms with function approximation for average cost adaptive control of traffic lights. One of these algorithms is a version of Q-learning with function approximation while the other is a policy gradient actor-critic algorithm that incorporates multi-timescale stochastic approximation. We show performance comparisons on various network settings of these algorithms with a range of fixed timing algorithms, as well as a Q-learning algorithm with full state representation that we also implement. We observe that whereas (as expected) on a two-junction corridor, the full state representation algorithm shows the best results, this algorithm is not implementable on larger road networks. The algorithm PG-AC-TLC that we propose is seen to show the best overall performance.

Convergence problems in a class of model reference adaptive control systems

A class of model reference adaptive control system which make use of an augmented error signal has been introduced by Monopoli. Convergence problems in this attractive class of systems have been investigated in this paper using concepts from hyperstability theory. It is shown that the condition on the linear part of the system has to be stronger than the one given earlier. A boundedness condition on the input to the linear part of the system has been taken into account in the analysis - this condition appears to have been missed in the previous applications of hyperstability theory. Sufficient conditions for the convergence of the adaptive gain to the desired value are also given.

Adaptive control of combustion instabilities for unknown sign of the high frequency gain

A type of adaptive, closed-loop controllers known as self-tuning regulators present a robust method of eliminating thermoacoustic oscillations in modern gas turbines. These controllers are able to adapt to changes in operating conditions, and require very little pre-characterisation of the system. One piece of information that is required, however, is the sign of the system's high frequency gain (or its 'instantaneous gain'). This poses a problem: combustion systems are infinite-dimensional, and so this information is never known a priori. A possible solution is to use a Nussbaum gain, which guarantees closed-loop stability without knowledge of the sign of the high frequency gain. Despite the theory for such a controller having been developed in the 1980s, it has never, to the authors' knowledge, been demonstrated experimentally. In this paper, a Nussbaum gain is used to stabilise thermoacoustic instability in a Rijke tube. The sign of the high frequency gain of the system is not required, and the controller is robust to large changes in operating conditions - demonstrated by varying the length of the Rijke tube with time. Copyright © 2008 by Simon J. Illingworth & Aimee S. Morgans.

Adaptive control of stiffness to stabilize hand position with large loads.

The goal of this work was to investigate stability in relation to the magnitude and direction of forces applied by the hand. The endpoint stiffness and joint stiffness of the arm were measured during a postural task in which subjects exerted up to 30% maximum voluntary force in each of four directions while controlling the position of the hand. All four coefficients of the joint stiffness matrix were found to vary linearly with both elbow and shoulder torque. This contrasts with the results of a previous study, which employed a force control task and concluded that the joint stiffness coefficients varied linearly with either shoulder or elbow torque but not both. Joint stiffness was transformed into endpoint stiffness to compare the effect on stability as endpoint force increased. When the joint stiffness coefficients were modeled as varying with the net torque at only one joint, as in the previous study, we found that hand position became unstable if endpoint force exceeded about 22 N in a specific direction. This did not occur when the joint stiffness coefficients were modeled as varying with the net torque at both joints, as in the present study. Rather, hand position became increasingly more stable as endpoint force increased for all directions of applied force. Our analysis suggests that co-contraction of biarticular muscles was primarily responsible for the increased stability. This clearly demonstrates how the central nervous system can selectively adapt the impedance of the arm in a specific direction to stabilize hand position when the force applied by the hand has a destabilizing effect in that direction.