Oscillations in a decentralized economic network

The study of exchange markets dates back to LeonWalras's general equilibrium theory. Since then the economic market has been studied for its' equilibrium properties, fairness of allocations of private and public goods, and even the psychological incentives of participants. This paper studies the dynamics of an exchange economy built on a network of markets where consumers trade with suppliers to optimize utility. Viewing the market in as a decentralized network we study the system from the usual control theory point of view, evaluating the system's dynamic performance, stability and robustness. It is shown that certain consumer demand dynamics can lead to oscillations while others can converge to optimal allocations. © 2011 IFAC.

Sequential decision making in general state space models

Many problems in control and signal processing can be formulated as sequential decision problems for general state space models. However, except for some simple models one cannot obtain analytical solutions and has to resort to approximation. In this thesis, we have investigated problems where Sequential Monte Carlo (SMC) methods can be combined with a gradient based search to provide solutions to online optimisation problems. We summarise the main contributions of the thesis as follows. Chapter 4 focuses on solving the sensor scheduling problem when cast as a controlled Hidden Markov Model. We consider the case in which the state, observation and action spaces are continuous. This general case is important as it is the natural framework for many applications. In sensor scheduling, our aim is to minimise the variance of the estimation error of the hidden state with respect to the action sequence. We present a novel SMC method that uses a stochastic gradient algorithm to find optimal actions. This is in contrast to existing works in the literature that only solve approximations to the original problem. In Chapter 5 we presented how an SMC can be used to solve a risk sensitive control problem. We adopt the use of the Feynman-Kac representation of a controlled Markov chain flow and exploit the properties of the logarithmic Lyapunov exponent, which lead to a policy gradient solution for the parameterised problem. The resulting SMC algorithm follows a similar structure with the Recursive Maximum Likelihood(RML) algorithm for online parameter estimation. In Chapters 6, 7 and 8, dynamic Graphical models were combined with with state space models for the purpose of online decentralised inference. We have concentrated more on the distributed parameter estimation problem using two Maximum Likelihood techniques, namely Recursive Maximum Likelihood (RML) and Expectation Maximization (EM). The resulting algorithms can be interpreted as an extension of the Belief Propagation (BP) algorithm to compute likelihood gradients. In order to design an SMC algorithm, in Chapter 8 uses a nonparametric approximations for Belief Propagation. The algorithms were successfully applied to solve the sensor localisation problem for sensor networks of small and medium size.

Delayed control of a Moore-Greitzer axial compressor model

Several feedback control laws have appeared in the literature concerning the stabilization of the nonlinear Moore-Greitzer axial compression model. Motivated by magnitude and rate limitations imposed by the physical implementation of the control law, Larsen et al. studied a dynamic implementation of the S-controller suggested by Sepulchre and Kokotović. They showed the potential benefit of implementing the S-controller through a first-order lag: while the location of the closed-loop equilibrium achieved with the static control law was sensitive to poorly known parameters, the dynamic implementation resulted in a small limit cycle at a very desirable location, insensitive to parameter variations. In this paper, we investigate the more general case when the control is applied with a time delay. This can be seen as an extension of the model with a first-order lag. The delay can either be a result of system constraints or be deliberately implemented to achieve better system behavior. The resulting closed-loop system is a set of parameter-dependent delay differential equations. Numerical bifurcation analysis is used to study this model and investigate whether the positive results obtained for the first-order model persist, even for larger values of the delay.