Stability of Switched Feedback Time-Varying Dynamic Systems Based on the Properties of the Gap Metric for Operators

The stabilization of dynamic switched control systems is focused on and based on an operator-based formulation. It is assumed that the controlled object and the controller are described by sequences of closed operator pairs (L, C) on a Hilbert space H of the input and output spaces and it is related to the existence of the inverse of the resulting input-output operator being admissible and bounded. The technical mechanism addressed to get the results is the appropriate use of the fact that closed operators being sufficiently close to bounded operators, in terms of the gap metric, are also bounded. That philosophy is followed for the operators describing the input-output relations in switched feedback control systems so as to guarantee the closed-loop stabilization.

Stochastic optimal control

H. J. Kushner has obtained the differential equation satisfied by the optimal feedback control law for a stochastic control system in which the plant dynamics and observations are perturbed by independent additive Gaussian white noise processes. However, the differentiation includes the first and second functional derivatives and, except for a restricted set of systems, is too complex to solve with present techniques.

This investigation studies the optimal control law for the open loop system and incorporates it in a sub-optimal feedback control law. This suboptimal control law's performance is at least as good as that of the optimal control function and satisfies a differential equation involving only the first functional derivative. The solution of this equation is equivalent to solving two two-point boundary valued integro-partial differential equations. An approximate solution has advantages over the conventional approximate solution of Kushner's equation.

As a result of this study, well known results of deterministic optimal control are deduced from the analysis of optimal open loop control.

Distributed Control and Optimization for Communication and Power Systems

We are at the cusp of a historic transformation of both communication system and electricity system. This creates challenges as well as opportunities for the study of networked systems. Problems of these systems typically involve a huge number of end points that require intelligent coordination in a distributed manner. In this thesis, we develop models, theories, and scalable distributed optimization and control algorithms to overcome these challenges.

This thesis focuses on two specific areas: multi-path TCP (Transmission Control Protocol) and electricity distribution system operation and control. Multi-path TCP (MP-TCP) is a TCP extension that allows a single data stream to be split across multiple paths. MP-TCP has the potential to greatly improve reliability as well as efficiency of communication devices. We propose a fluid model for a large class of MP-TCP algorithms and identify design criteria that guarantee the existence, uniqueness, and stability of system equilibrium. We clarify how algorithm parameters impact TCP-friendliness, responsiveness, and window oscillation and demonstrate an inevitable tradeoff among these properties. We discuss the implications of these properties on the behavior of existing algorithms and motivate a new algorithm Balia (balanced linked adaptation) which generalizes existing algorithms and strikes a good balance among TCP-friendliness, responsiveness, and window oscillation. We have implemented Balia in the Linux kernel. We use our prototype to compare the new proposed algorithm Balia with existing MP-TCP algorithms.

Our second focus is on designing computationally efficient algorithms for electricity distribution system operation and control. First, we develop efficient algorithms for feeder reconfiguration in distribution networks. The feeder reconfiguration problem chooses the on/off status of the switches in a distribution network in order to minimize a certain cost such as power loss. It is a mixed integer nonlinear program and hence hard to solve. We propose a heuristic algorithm that is based on the recently developed convex relaxation of the optimal power flow problem. The algorithm is efficient and can successfully computes an optimal configuration on all networks that we have tested. Moreover we prove that the algorithm solves the feeder reconfiguration problem optimally under certain conditions. We also propose a more efficient algorithm and it incurs a loss in optimality of less than 3% on the test networks.

Second, we develop efficient distributed algorithms that solve the optimal power flow (OPF) problem on distribution networks. The OPF problem determines a network operating point that minimizes a certain objective such as generation cost or power loss. Traditionally OPF is solved in a centralized manner. With increasing penetration of volatile renewable energy resources in distribution systems, we need faster and distributed solutions for real-time feedback control. This is difficult because power flow equations are nonlinear and kirchhoff's law is global. We propose solutions for both balanced and unbalanced radial distribution networks. They exploit recent results that suggest solving for a globally optimal solution of OPF over a radial network through a second-order cone program (SOCP) or semi-definite program (SDP) relaxation. Our distributed algorithms are based on the alternating direction method of multiplier (ADMM), but unlike standard ADMM-based distributed OPF algorithms that require solving optimization subproblems using iterative methods, the proposed solutions exploit the problem structure that greatly reduce the computation time. Specifically, for balanced networks, our decomposition allows us to derive closed form solutions for these subproblems and it speeds up the convergence by 1000x times in simulations. For unbalanced networks, the subproblems reduce to either closed form solutions or eigenvalue problems whose size remains constant as the network scales up and computation time is reduced by 100x compared with iterative methods.

Risk-sensitivity in sensorimotor control.

Recent advances in theoretical neuroscience suggest that motor control can be considered as a continuous decision-making process in which uncertainty plays a key role. Decision-makers can be risk-sensitive with respect to this uncertainty in that they may not only consider the average payoff of an outcome, but also consider the variability of the payoffs. Although such risk-sensitivity is a well-established phenomenon in psychology and economics, it has been much less studied in motor control. In fact, leading theories of motor control, such as optimal feedback control, assume that motor behaviors can be explained as the optimization of a given expected payoff or cost. Here we review evidence that humans exhibit risk-sensitivity in their motor behaviors, thereby demonstrating sensitivity to the variability of "motor costs." Furthermore, we discuss how risk-sensitivity can be incorporated into optimal feedback control models of motor control. We conclude that risk-sensitivity is an important concept in understanding individual motor behavior under uncertainty.

Optimal control predicts human performance on objects with internal degrees of freedom.

On a daily basis, humans interact with a vast range of objects and tools. A class of tasks, which can pose a serious challenge to our motor skills, are those that involve manipulating objects with internal degrees of freedom, such as when folding laundry or using a lasso. Here, we use the framework of optimal feedback control to make predictions of how humans should interact with such objects. We confirm the predictions experimentally in a two-dimensional object manipulation task, in which subjects learned to control six different objects with complex dynamics. We show that the non-intuitive behavior observed when controlling objects with internal degrees of freedom can be accounted for by a simple cost function representing a trade-off between effort and accuracy. In addition to using a simple linear, point-mass optimal control model, we also used an optimal control model, which considers the non-linear dynamics of the human arm. We find that the more realistic optimal control model captures aspects of the data that cannot be accounted for by the linear model or other previous theories of motor control. The results suggest that our everyday interactions with objects can be understood by optimality principles and advocate the use of more realistic optimal control models for the study of human motor neuroscience.

Optimal control: when redundancy matters.

A new experiment provides support for optimal feedback control as a theoretical basis of how the motor system responds to perturbations in a context-dependent manner.

Model-based thermoacoustic oscillation control via ℋ ∞ loop-shaping and integral quadratic constraints

Lean premixed prevaporized (LPP) technology has been widely used in the new generation of gas turbines in which reduced emissions are a priority. However, such combustion systems are susceptible to the damage of self-excited oscillations. Feedback control provide a way of preventing such dynamic stabilities. A flame dynamics assumption is proposed for a recently developed unsteady heat release model, the robust design technique, ℋ ∞ loop-shaping, is applied for the controller design and the performance of the controller is confirmed by simulations of the closed-loop system. The Integral Quadratic Constraints(IQC) method is employed to prove the stability of the closed-loop system. ©2010 IEEE.

Some biocybernetic aspects in gene expression and regulatory control

In eucaryotes, gene expression and control is a complex nonlinear process, where there are many control mechanisms and ways, both physic, chemical and informational control. By the exploration from the angle of biocybernetics, the authors suggest that gene expression is a co-control process. In this process, physic, chemical and informational feedback controls are associated and influential each other, and are cross and co-functional. The physic, chemical and informational control ways composed an order non-linear feedback control system in eucaryotes.

Computational mechanisms of sensorimotor control.

In order to generate skilled and efficient actions, the motor system must find solutions to several problems inherent in sensorimotor control, including nonlinearity, nonstationarity, delays, redundancy, uncertainty, and noise. We review these problems and five computational mechanisms that the brain may use to limit their deleterious effects: optimal feedback control, impedance control, predictive control, Bayesian decision theory, and sensorimotor learning. Together, these computational mechanisms allow skilled and fluent sensorimotor behavior.

Initial modelling and controller design for active control of spacecraft microvibrations

Microvibrations, at frequencies between 1 and 1000 Hz, generated by on board equipment, propagate throughout a spacecraft structure affecting the performance of sensitive payloads. The purpose of this work is to investigate strategies to model and reduce these dynamic disturbances by active control. Initial studies were performed by considering a mass loaded panel where the disturbance excitation source consisted of point forces, the objective being to minimise the displacement at an arbitrary output location. Piezoelectric patches acting as sensors and actuators were used. The equations of motion are derived by using Lagrange's equation with modal shapes as Ritz functions. The number of sensors/actuators and their location is variable. The set of equations obtained is then transformed into state variables and some initial controller design studies have been undertaken. These are based on feedback control implemented using a full state feedback and an observer which reconstructs the state vector from the available sensor signal. Here, the basics behind the structural modelling and controller design will be described. This preliminary analysis will also be used to identify short to medium term further work.

Diesel smoke transient control using a real-time smoke sensor

A novel real time smoke sensor is described, which is mounted in the exhaust manifold and detects the smoke by virtue of the natural electrical charge which is carried on the smoke. The somewhat obscure origin of the charge on the smoke is briefly considered, as well as the operation of the sensor itself. The use of the sensor as part of a feedback control shows that it can be very effective in reducing smoke puffs. Copyright © 1987 Society of Automotive Engineers, Inc.

Delayed control of a Moore-Greitzer axial compressor model

Several feedback control laws have appeared in the literature concerning the stabilization of the nonlinear Moore-Greitzer axial compression model. Motivated by magnitude and rate limitations imposed by the physical implementation of the control law, Larsen et al. studied a dynamic implementation of the S-controller suggested by Sepulchre and Kokotović. They showed the potential benefit of implementing the S-controller through a first-order lag: while the location of the closed-loop equilibrium achieved with the static control law was sensitive to poorly known parameters, the dynamic implementation resulted in a small limit cycle at a very desirable location, insensitive to parameter variations. In this paper, we investigate the more general case when the control is applied with a time delay. This can be seen as an extension of the model with a first-order lag. The delay can either be a result of system constraints or be deliberately implemented to achieve better system behavior. The resulting closed-loop system is a set of parameter-dependent delay differential equations. Numerical bifurcation analysis is used to study this model and investigate whether the positive results obtained for the first-order model persist, even for larger values of the delay.

Shape signifiers for control of a low-order compressor model

Rotating stall and surge, two instability mechanisms limiting the performance of aeroengines compressors, are studied on the third-order Moore-Greitzer model. The skewness of the compressor characteristic, a single parameter shape signifier, is shown to determine the key qualitative properties of feedback control.

The temporal evolution of feedback gains rapidly update to task demands.

Recent theoretical frameworks such as optimal feedback control suggest that feedback gains should modulate throughout a movement and be tuned to task demands. Here we measured the visuomotor feedback gain throughout the course of movements made to "near" or "far" targets in human subjects. The visuomotor gain showed a systematic modulation over the time course of the reach, with the gain peaking at the middle of the movement and dropping rapidly as the target is approached. This modulation depends primarily on the proportion of the movement remaining, rather than hand position, suggesting that the modulation is sensitive to task demands. Model-predictive control suggests that the gains should be continuously recomputed throughout a movement. To test this, we investigated whether feedback gains update when the task goal is altered during a movement, that is when the target of the reach jumped. We measured the visuomotor gain either simultaneously with the jump or 100 ms after the jump. The visuomotor gain nonspecifically reduced for all target jumps when measured synchronously with the jump. However, the visuomotor gain 100 ms later showed an appropriate modulation for the revised task goal by increasing for jumps that increased the distance to the target and reducing for jumps that decreased the distance. We conclude that visuomotor feedback gain shows a temporal evolution related to task demands and that this evolution can be flexibly recomputed within 100 ms to accommodate online modifications to task goals.