Distributed Optimal Control of Cyber-Physical Systems: Controller Synthesis, Architecture Design and System Identification

The centralized paradigm of a single controller and a single plant upon which modern control theory is built is no longer applicable to modern cyber-physical systems of interest, such as the power-grid, software defined networks or automated highways systems, as these are all large-scale and spatially distributed. Both the scale and the distributed nature of these systems has motivated the decentralization of control schemes into local sub-controllers that measure, exchange and act on locally available subsets of the globally available system information. This decentralization of control logic leads to different decision makers acting on asymmetric information sets, introduces the need for coordination between them, and perhaps not surprisingly makes the resulting optimal control problem much harder to solve. In fact, shortly after such questions were posed, it was realized that seemingly simple decentralized optimal control problems are computationally intractable to solve, with the Wistenhausen counterexample being a famous instance of this phenomenon. Spurred on by this perhaps discouraging result, a concerted 40 year effort to identify tractable classes of distributed optimal control problems culminated in the notion of quadratic invariance, which loosely states that if sub-controllers can exchange information with each other at least as quickly as the effect of their control actions propagates through the plant, then the resulting distributed optimal control problem admits a convex formulation.

The identification of quadratic invariance as an appropriate means of "convexifying" distributed optimal control problems led to a renewed enthusiasm in the controller synthesis community, resulting in a rich set of results over the past decade. The contributions of this thesis can be seen as being a part of this broader family of results, with a particular focus on closing the gap between theory and practice by relaxing or removing assumptions made in the traditional distributed optimal control framework. Our contributions are to the foundational theory of distributed optimal control, and fall under three broad categories, namely controller synthesis, architecture design and system identification.

We begin by providing two novel controller synthesis algorithms. The first is a solution to the distributed H-infinity optimal control problem subject to delay constraints, and provides the only known exact characterization of delay-constrained distributed controllers satisfying an H-infinity norm bound. The second is an explicit dynamic programming solution to a two player LQR state-feedback problem with varying delays. Accommodating varying delays represents an important first step in combining distributed optimal control theory with the area of Networked Control Systems that considers lossy channels in the feedback loop. Our next set of results are concerned with controller architecture design. When designing controllers for large-scale systems, the architectural aspects of the controller such as the placement of actuators, sensors, and the communication links between them can no longer be taken as given -- indeed the task of designing this architecture is now as important as the design of the control laws themselves. To address this task, we formulate the Regularization for Design (RFD) framework, which is a unifying computationally tractable approach, based on the model matching framework and atomic norm regularization, for the simultaneous co-design of a structured optimal controller and the architecture needed to implement it. Our final result is a contribution to distributed system identification. Traditional system identification techniques such as subspace identification are not computationally scalable, and destroy rather than leverage any a priori information about the system's interconnection structure. We argue that in the context of system identification, an essential building block of any scalable algorithm is the ability to estimate local dynamics within a large interconnected system. To that end we propose a promising heuristic for identifying the dynamics of a subsystem that is still connected to a large system. We exploit the fact that the transfer function of the local dynamics is low-order, but full-rank, while the transfer function of the global dynamics is high-order, but low-rank, to formulate this separation task as a nuclear norm minimization problem. Finally, we conclude with a brief discussion of future research directions, with a particular emphasis on how to incorporate the results of this thesis, and those of optimal control theory in general, into a broader theory of dynamics, control and optimization in layered architectures.

Controle a estrutura variável para atenuar modos ressonantes em servomecanismos.

Nesta dissertação é mostrada experimentalmente a existência de modos ressonantes em servomotores de corrente contínua sem núcleo de ferro. Até onde se sabe, não já publicações ou documentos técnicos de fabricantes que relatam esse efeito neste tipo de motor. Foi observado também que a frequência da ressonância é variável e que possivelmente depende da temperatura interna do motor. Conforme e mostrado em simulações técnicas tradicionais para o controle de motores podem não ser eficazes para lidar com esses modos ressonantes. Com o objetivo de amortecer a ressonância e obter o controle de velocidade e posição desses motores, são desenvolvidos controladores por modo deslizante baseados em funções de chaveamento obtidas por observadores de alto ganho. Esse controle e robusto a incertezas paramétricas e perturbações. Com o auxílio de simulações são mostrados os pontos fortes e limitações de cada um dos controladores.

Self-tuning regulators—a state space approach

This paper employs a state space system description to provide a pole placement scheme via state feedback. It is shown that when a recursive least squares estimation scheme is used, the feedback employed can be expressed simply in terms of the estimated system parameters. To complement the state feedback approach, a method employing both state feedback and linear output feedback is discussed. Both methods arc then compared with the previous output polynomial type feedback schemes.

Relationship between åström control and the kalman linear regulator — Caines revisited

The relationship between minimum variance and minimum expected quadratic loss feedback controllers for linear univariate discrete-time stochastic systems is reviewed by taking the approach used by Caines. It is shown how the two methods can be regarded as providing identical control actions as long as a noise-free measurement state-space model is employed.

Problem of precision missile guidance: LQR and H‡ control frameworks

Addressed here is the precision missile guidance problem where the successful intercept criterion has been defined in terms of both minimizing the miss distance and controlling the missile body attitude with respect to the target at the terminal point. We show that the H∞ control theory, when suitably modified, provides an effective framework for the precision missile guidance problem. The existence of feedback controllers (guidance laws) is investigated for the case of finite horizon and non-zero initial conditions. Both state feedback and output feedback implementations are explored.

Dynamic output feedback control of single-link flexible manipulators

This paper presents an efficient technique to design dynamic feedback control scheme for single-link flexible manipulators.  A linear model can be derived for the robotic system using the assumed-mode method.  Conventional techniques such as pole-placement or LQR require physical measurements of all systme states,  posing a stringent requirement for its implementation.  To overcome this problem, a low-order state functional observer is proposed here for reconstruction of the state feedback control action.  The observer design involves solving an optimisation problem with the objective to generate a feedback gain that is as close as possible to that of the required feedback controller.  A condition for robust stability of the closed-loop system under the observer-based control scheme is given.  The attractive features of the propsed technique are the resulted functional state observer is of a very low order and it requires only sensor measurements of only the output- the tip position of the arm.

A distributed approach to global feedback control of multi-agent systems

This paper presents a distributed approach to global state feedback control of for multi-agent systems. The proposed solution is obtained from the construction of decentralised functional observers. The required local control signal is generated asymptotically using only corresponding local output information. It is shown that a complete distribution of the control of a decentralised system having N agents can be achieved upon the satisfaction of some necessary conditions, and that the resulting controller can emulate the performance of a global state feedback controller. A step-by-step design algorithm is given. Its simplicity and correctness are illustrated through a numerical example.

Observer-based control for time-varying delay neural networks with nonlinear observation

This paper studies the problem of designing observer-based controllers for a class of delayed neural networks with nonlinear observation. The system under consideration is subject to nonlinear observation and an interval time-varying delay. The nonlinear observation output is any nonlinear Lipschitzian function and the time-varying delay is not required to be differentiable nor its lower bound be zero. By constructing a set of appropriate Lyapunov-Krasovskii functionals and utilizing the Newton-Leibniz formula, some delay-dependent stabilizability conditions which are expressed in terms of Linear Matrix Inequalities (LMIs) are derived. The derived conditions allow simultaneous computation of two bounds that characterize the exponential stability rate of the closed-loop system. The unknown observer gain and the state feedback observer-based controller are directly obtained upon the feasibility of the derived LMIs stabilizability conditions. A simulation example is presented to verify the effectiveness of the proposed result.

New H∞ control design for polytopic systems with mixed time-varying delays in state and input

This paper concerns with the problem of state-feedback H∞ control design for a class of linear systems with polytopic uncertainties and mixed time-varying delays in state and input. Our approach can be described as follows. We first construct a state-feedback controller based on the idea of parameter-dependent controller design. By constructing a new parameter-dependent Lyapunov-Krasovskii functional (LKF), we then derive new delay-dependent conditions in terms of linear matrix inequalities ensuring the exponential stability of the corresponding closed-loop system with a H∞ disturbance attenuation level. The effectiveness and applicability of the obtained results are demonstrated by practical examples.

Uma proposta de um controlador adaptativo por posicionamento de pólos e estrutura variável

There are two main approaches for using in adaptive controllers. One is the so-called model reference adaptive control (MRAC), and the other is the so-called adaptive pole placement control (APPC). In MRAC, a reference model is chosen to generate the desired trajectory that the plant output has to follow, and it can require cancellation of the plant zeros. Due to its flexibility in choosing the controller design methodology (state feedback, compensator design, linear quadratic, etc.) and the adaptive law (least squares, gradient, etc.), the APPC is the most general type of adaptive control. Traditionally, it has been developed in an indirect approach and, as an advantage, it may be applied to non-minimum phase plants, because do not involve plant zero-pole cancellations. The integration to variable structure systems allows to aggregate fast transient and robustness to parametric uncertainties and disturbances, as well. In this work, a variable structure adaptive pole placement control (VS-APPC) is proposed. Therefore, new switching laws are proposed, instead of using the traditional integral adaptive laws. Additionally, simulation results for an unstable first order system and simulation and practical results for a three-phase induction motor are shown

Variable-Structure Control Design of Switched Systems With an Application to a DC-DC Power Converter

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

LMI-based algorithm for strictly positive real systems with static output feedback

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Design of a control system using linear matrix inequalities for the active vibration control of a plate

The study of algorithms for active vibration control in smart structures is an area of interest, mainly due to the demand for better performance of mechanical systems, such as aircraft and aerospace structures. Smart structures, formed using actuators and sensors, can improve the dynamic performance with the application of several kinds of controllers. This article describes the application of a technique based on linear matrix inequalities (LMI) to design an active control system. The positioning of the actuators, the design of a robust state feedback controller and the design of an observer are all achieved using LMI. The following are considered in the controller design: limited actuator input, bounded output (energy) and robustness to parametric uncertainties. Active vibration control of a flat plate is chosen as an application example. The model is identified using experimental data by an eigensystem realization algorithm (ERA) and the placement of the two piezoelectric actuators and single sensor is determined using a finite element model (FEM) and an optimization procedure. A robust controller for active damping is designed using an LMI framework, and a reduced model with observation and control spillover effects is implemented using a computer. The simulation results demonstrate the efficacy of the approach, and show that the control system increases the damping in some of the modes.

On control and synchronization in chaotic and hyperchaotic systems via linear feedback control

This paper presents the control and synchronization of chaos by designing linear feedback controllers. The linear feedback control problem for nonlinear systems has been formulated under optimal control theory viewpoint. Asymptotic stability of the closed-loop nonlinear system is guaranteed by means of a Lyapunov function which can clearly be seen to be the solution of the Hamilton-Jacobi-Bellman equation thus guaranteeing both stability and optimality. The formulated theorem expresses explicitly the form of minimized functional and gives the sufficient conditions that allow using the linear feedback control for nonlinear system. The numerical simulations were provided in order to show the effectiveness of this method for the control of the chaotic Rossler system and synchronization of the hyperchaotic Rossler system. (C) 2007 Elsevier B.V. All rights reserved.

Active flutter suppression in a 2-D airfoil using linear matrix inequalities techniques

Flutter is an in-flight vibration of flexible structures caused by energy in the airstream absorbed by the lifting surface. This aeroelastic phenomenon is a problem of considerable interest in the aeronautic industry, because flutter is a potentially destructive instability resulting from an interaction between aerodynamic, inertial, and elastic forces. To overcome this effect, it is possible to use passive or active methodologies, but passive control adds mass to the structure and it is, therefore, undesirable. Thus, in this paper, the goal is to use linear matrix inequalities (LMIs) techniques to design an active state-feedback control to suppress flutter. Due to unmeasurable aerodynamic-lag states, one needs to use a dynamic observer. So, LMIs also were applied to design a state-estimator. The simulated model, consists of a classical flat plate in a two-dimensional flow. Two regulators were designed, the first one is a non-robust design for parametric variation and the second one is a robust control design, both designed by using LMIs. The parametric uncertainties are modeled through polytopic uncertainties. The paper concludes with numerical simulations for each controller. The open-loop and closed-loop responses are also compared and the results show the flutter suppression. The perfomance for both controllers are compared and discussed. Copyright © 2006 by ABCM.