Distributed Optimal Control of Cyber-Physical Systems: Controller Synthesis, Architecture Design and System Identification

The centralized paradigm of a single controller and a single plant upon which modern control theory is built is no longer applicable to modern cyber-physical systems of interest, such as the power-grid, software defined networks or automated highways systems, as these are all large-scale and spatially distributed. Both the scale and the distributed nature of these systems has motivated the decentralization of control schemes into local sub-controllers that measure, exchange and act on locally available subsets of the globally available system information. This decentralization of control logic leads to different decision makers acting on asymmetric information sets, introduces the need for coordination between them, and perhaps not surprisingly makes the resulting optimal control problem much harder to solve. In fact, shortly after such questions were posed, it was realized that seemingly simple decentralized optimal control problems are computationally intractable to solve, with the Wistenhausen counterexample being a famous instance of this phenomenon. Spurred on by this perhaps discouraging result, a concerted 40 year effort to identify tractable classes of distributed optimal control problems culminated in the notion of quadratic invariance, which loosely states that if sub-controllers can exchange information with each other at least as quickly as the effect of their control actions propagates through the plant, then the resulting distributed optimal control problem admits a convex formulation.

The identification of quadratic invariance as an appropriate means of "convexifying" distributed optimal control problems led to a renewed enthusiasm in the controller synthesis community, resulting in a rich set of results over the past decade. The contributions of this thesis can be seen as being a part of this broader family of results, with a particular focus on closing the gap between theory and practice by relaxing or removing assumptions made in the traditional distributed optimal control framework. Our contributions are to the foundational theory of distributed optimal control, and fall under three broad categories, namely controller synthesis, architecture design and system identification.

We begin by providing two novel controller synthesis algorithms. The first is a solution to the distributed H-infinity optimal control problem subject to delay constraints, and provides the only known exact characterization of delay-constrained distributed controllers satisfying an H-infinity norm bound. The second is an explicit dynamic programming solution to a two player LQR state-feedback problem with varying delays. Accommodating varying delays represents an important first step in combining distributed optimal control theory with the area of Networked Control Systems that considers lossy channels in the feedback loop. Our next set of results are concerned with controller architecture design. When designing controllers for large-scale systems, the architectural aspects of the controller such as the placement of actuators, sensors, and the communication links between them can no longer be taken as given -- indeed the task of designing this architecture is now as important as the design of the control laws themselves. To address this task, we formulate the Regularization for Design (RFD) framework, which is a unifying computationally tractable approach, based on the model matching framework and atomic norm regularization, for the simultaneous co-design of a structured optimal controller and the architecture needed to implement it. Our final result is a contribution to distributed system identification. Traditional system identification techniques such as subspace identification are not computationally scalable, and destroy rather than leverage any a priori information about the system's interconnection structure. We argue that in the context of system identification, an essential building block of any scalable algorithm is the ability to estimate local dynamics within a large interconnected system. To that end we propose a promising heuristic for identifying the dynamics of a subsystem that is still connected to a large system. We exploit the fact that the transfer function of the local dynamics is low-order, but full-rank, while the transfer function of the global dynamics is high-order, but low-rank, to formulate this separation task as a nuclear norm minimization problem. Finally, we conclude with a brief discussion of future research directions, with a particular emphasis on how to incorporate the results of this thesis, and those of optimal control theory in general, into a broader theory of dynamics, control and optimization in layered architectures.

Controle a estrutura variável para atenuar modos ressonantes em servomecanismos.

Nesta dissertação é mostrada experimentalmente a existência de modos ressonantes em servomotores de corrente contínua sem núcleo de ferro. Até onde se sabe, não já publicações ou documentos técnicos de fabricantes que relatam esse efeito neste tipo de motor. Foi observado também que a frequência da ressonância é variável e que possivelmente depende da temperatura interna do motor. Conforme e mostrado em simulações técnicas tradicionais para o controle de motores podem não ser eficazes para lidar com esses modos ressonantes. Com o objetivo de amortecer a ressonância e obter o controle de velocidade e posição desses motores, são desenvolvidos controladores por modo deslizante baseados em funções de chaveamento obtidas por observadores de alto ganho. Esse controle e robusto a incertezas paramétricas e perturbações. Com o auxílio de simulações são mostrados os pontos fortes e limitações de cada um dos controladores.

Asymptotic Recovery for Discrete-Time Systems

An asymptotic recovery design procedure is proposed for square, discrete-time, linear, time-invariant multivariable systems, which allows a state-feedback design to be approximately recovered by a dynamic output feedback scheme. Both the case of negligible processing time (compared to the sampling interval) and of significant processing time are discussed. In the former case, it is possible to obtain perfect. © 1985 IEEE.

BOLTZMANN MACHINES FOR SPEECH RECOGNITION.

Boltzmann machines offer a new and exciting approach to automatic speech recognition, and provide a rigorous mathematical formalism for parallel computing arrays. In this paper we briefly summarize Boltzmann machine theory, and present results showing their ability to recognize both static and time-varying speech patterns. A machine with 2000 units was able to distinguish between the 11 steady-state vowels in English with an accuracy of 85%. The stability of the learning algorithm and methods of preprocessing and coding speech data before feeding it to the machine are also discussed. A new type of unit called a carry input unit, which involves a type of state-feedback, was developed for the processing of time-varying patterns and this was tested on a few short sentences. Use is made of the implications of recent work into associative memory, and the modelling of neural arrays to suggest a good configuration of Boltzmann machines for this sort of pattern recognition.

Initial modelling and controller design for active control of spacecraft microvibrations

Microvibrations, at frequencies between 1 and 1000 Hz, generated by on board equipment, propagate throughout a spacecraft structure affecting the performance of sensitive payloads. The purpose of this work is to investigate strategies to model and reduce these dynamic disturbances by active control. Initial studies were performed by considering a mass loaded panel where the disturbance excitation source consisted of point forces, the objective being to minimise the displacement at an arbitrary output location. Piezoelectric patches acting as sensors and actuators were used. The equations of motion are derived by using Lagrange's equation with modal shapes as Ritz functions. The number of sensors/actuators and their location is variable. The set of equations obtained is then transformed into state variables and some initial controller design studies have been undertaken. These are based on feedback control implemented using a full state feedback and an observer which reconstructs the state vector from the available sensor signal. Here, the basics behind the structural modelling and controller design will be described. This preliminary analysis will also be used to identify short to medium term further work.

Rhythmic stabilization of periodic orbits in a wedge

The paper addresses the rhythmic stabilization of periodic orbits in a wedge billiard with actuated edges. The output feedback strategy, based on the sole measurement of impact times, results from the combination of a stabilizing state feedback control law and a nonlinear deadbeat state estimator. It is shown that the robustness of both the control law and the observer leads to a simple rhythmic controller achieving a large basin of attraction. Copyright © 2005 IFAC.

A perturbation approach to the stabilization of nonlinear cascade systems with time-delay

The effect of bounded input perturbations on the stability of nonlinear globally asymptotically stable delay differential equations is analyzed. We investigate under which conditions global stability is preserved and if not, whether semi-global stabilization is possible by controlling the size or shape of the perturbation. These results are used to study the stabilization of partially linear cascade systems with partial state feedback.

Trading the stability of finite zeros for global stabilization of nonlinear cascade systems

This note analyzes the stabilizability properties of nonlinear cascades in which a nonminimum phase linear system is interconnected through its output to a Stable nonlinear system. It is shown that the instability of the zeros of the linear System can be traded with the stability of the nonlinear system up to a limit fixed by the growth properties of the cascade interconnection term. Below this limit, global stabilization is achieved by smooth static-state feedback. Beyond this limit, various examples illustrate that controllability of the cascade may be lost, making it impossible to achieve large regions of attractions.

Trading the stability of finite zeros for global stabilization of nonlinear cascade systems

This paper analyzes the stabilizability properties of nonlinear cascades in which a nonminimum phase linear system is interconnected through its output to a stable nonlinear system. It is shown that the instability of the zeros of the linear system can be traded with the stability of the nonlinear system up to a limit fixed by the growth properties of the cascade interconnection term. Below this limit, global stabilization is achieved by smooth static state feedback. Beyond this limit, various examples illustrate that controllability of the cascade may be lost, making it impossible to achieve large regions of attractions.

移动机器人数学模型的近似线性化

针对机器人控制领域中一类多输入多输出(MIMO)仿射非线性系统,提出了一种基于平衡流形的近似线性化状态反馈镇定算法,并用此算法解决了一类完整约束轮式移动机器人(WMR)的镇定问题.仿真分析表明,此方法不仅能够实现系统的镇定,而且降低了因平衡工作点变动给系统稳定性带来的影响,同时也大大地简化了对非线性系统的综合设计过程,具有良好的控制效果和实用性.

基于谓词不变性的状态反馈控制在机器人遥操作中的应用

传统的基于事件遥操作系统虽然巧妙地避开了变化时延问题[8] ,但是它具有“走走停停”的特点 ,即机器人将当前状态发送出去之后直到操作者的下一个指令到来之前机器人必须保证状态没有变化。对此本文首次提出了利用基于谓词不变性的状态反馈控制来对原有的方法进行改进 ,使机器人能够对动态环境具有适应性

Control of uncertain compartmental systems

Os sistemas compartimentais são frequentemente usados na modelação de diversos processos em várias áreas, tais como a biomedicina, ecologia, farmacocinética, entre outras. Na maioria das aplicações práticas, nomeadamente, aquelas que dizem respeito à administração de drogas a pacientes sujeitos a cirurgia, por exemplo, a presença de incertezas nos parâmetros do sistema ou no estado do sistema é muito comum. Ao longo dos últimos anos, a análise de sistemas compartimentais tem sido bastante desenvolvida na literatura. No entanto, a análise da sensibilidade da estabilidade destes sistemas na presença de incertezas tem recebido muito menos atenção. Nesta tese, consideramos uma lei de controlo por realimentação do estado com restrições de positividade e analisamos a sua robustez quando aplicada a sistemas compartimentais lineares e invariantes no tempo com incertezas nos parâmetros. Além disso, para sistemas lineares e invariantes no tempo com estado inicial desconhecido, combinamos esta lei de controlo com um observador do estado e a robustez da lei de controlo resultante também é analisada. O controlo do bloqueio neuromuscular por meio da infusão contínua de um relaxante muscular pode ser modelado como um sistema compartimental de três compartimentos e tem sido objecto de estudo por diversos grupos de investigação. Nesta tese, os nossos resultados são aplicados a este problema de controlo e são fornecidas estratégias para melhorar os resultados obtidos.

Results of applying sensor fusion to a control system using optic flow

The results from applying a sensor fusion process to an adaptive controller used to balance all inverted pendulum axe presented. The goal of the sensor fusion process was to replace some of the four mechanical measurements, which are known to be sufficient inputs for a linear state feedback controller to balance the system, with optic flow variables. Results from research into the psychology of the sense of balance in humans were the motivation for the investigation of this new type of controller input. The simulated model of the inverted pendulum and the virtual reality environments used to provide the optical input are described. The successful introduction of optical information is found to require the preservation of at least two of the traditional input types and entail increased training till-le for the adaptive controller and reduced performance (measured as the time the pendulum remains upright)

Dynamic recurrent neural network for system identification and control

A dynamic recurrent neural network (DRNN) that can be viewed as a generalisation of the Hopfield neural network is proposed to identify and control a class of control affine systems. In this approach, the identified network is used in the context of the differential geometric control to synthesise a state feedback that cancels the nonlinear terms of the plant yielding a linear plant which can then be controlled using a standard PID controller.

Stable linearization using multilayer neural networks

The main limitation of linearization theory that prevents its application in practical problems is the need for an exact knowledge of the plant. This requirement is eliminated and it is shown that a multilayer network can synthesise the state feedback coefficients that linearize a nonlinear control affine plant. The stability of the linearizing closed loop can be guaranteed if the autonomous plant is asymptotically stable and the state feedback is bounded.