Synchronization in climate dynamics and other extended systems

Synchronization is now well established as representing coherent behaviour between two or more otherwise autonomous nonlinear systems subject to some degree of coupling. Such behaviour has mainly been studied to date, however, in relatively low-dimensional discrete systems or networks. But the possibility of similar kinds of behaviour in continuous or extended spatiotemporal systems has many potential practical implications, especially in various areas of geophysics. We review here a range of cyclically varying phenomena within the Earth's climate system for which there may be some evidence or indication of the possibility of synchronized behaviour, albeit perhaps imperfect or highly intermittent. The exploitation of this approach is still at a relatively early stage within climate science and dynamics, in which the climate system is regarded as a hierarchy of many coupled sub-systems with complex nonlinear feedbacks and forcings. The possibility of synchronization between climate oscillations (global or local) and a predictable external forcing raises important questions of how models of such phenomena can be validated and verified, since the resulting response may be relatively insensitive to the details of the model being synchronized. The use of laboratory analogues may therefore have an important role to play in the study of natural systems that can only be observed and for which controlled experiments are impossible. We go on to demonstrate that synchronization can be observed in the laboratory, even in weakly coupled fluid dynamical systems that may serve as direct analogues of the behaviour of major components of the Earth's climate system. The potential implications and observability of these effects in the long-term climate variability of the Earth is further discussed. © 2010 Springer-Verlag Berlin Heidelberg.

Morphological computation for adaptive behavior and cognition

Traditionally, in robotics, artificial intelligence and neuroscience, there has been a focus on the study of the control or the neural system itself. Recently there has been an increasing interest in the notion of embodiment not only in robotics and artificial intelligence, but also in the neurosciences, psychology and philosophy. In this paper, we introduce the notion of morphological computation, and demonstrate how it can be exploited on the one hand for designing intelligent, adaptive robotic systems, and on the other hand for understanding natural systems. While embodiment has often been used in its trivial meaning, i.e. "intelligence requires a body", the concept has deeper and more important implications, concerned with the relation between physical and information (neural, control) processes. Morphological computation is about connecting body, brain and environment. A number of case studies are presented to illustrate the concept. We conclude with some speculations about potential lessons for neuroscience and robotics. © 2006 Elsevier B.V. All rights reserved.

Natural actor and belief critic: Reinforcement algorithm for learning parameters of dialogue systems modelled as POMDPs

This article presents a novel algorithm for learning parameters in statistical dialogue systems which are modeled as Partially Observable Markov Decision Processes (POMDPs). The three main components of a POMDP dialogue manager are a dialogue model representing dialogue state information; a policy that selects the system's responses based on the inferred state; and a reward function that specifies the desired behavior of the system. Ideally both the model parameters and the policy would be designed to maximize the cumulative reward. However, while there are many techniques available for learning the optimal policy, no good ways of learning the optimal model parameters that scale to real-world dialogue systems have been found yet. The presented algorithm, called the Natural Actor and Belief Critic (NABC), is a policy gradient method that offers a solution to this problem. Based on observed rewards, the algorithm estimates the natural gradient of the expected cumulative reward. The resulting gradient is then used to adapt both the prior distribution of the dialogue model parameters and the policy parameters. In addition, the article presents a variant of the NABC algorithm, called the Natural Belief Critic (NBC), which assumes that the policy is fixed and only the model parameters need to be estimated. The algorithms are evaluated on a spoken dialogue system in the tourist information domain. The experiments show that model parameters estimated to maximize the expected cumulative reward result in significantly improved performance compared to the baseline hand-crafted model parameters. The algorithms are also compared to optimization techniques using plain gradients and state-of-the-art random search algorithms. In all cases, the algorithms based on the natural gradient work significantly better. © 2011 ACM.

The design and implementation of dialogue control in voice operated database inquiry systems

This paper describes work performed as part of the U.K. Alvey sponsored Voice Operated Database Inquiry System (VODIS) project in the area of intelligent dialogue control. The principal aims of the work were to develop a habitable interface for the untrained user; to investigate the degree to which dialogue control can be used to compensate for deficiencies in recognition performance; and to examine the requirements on dialogue control for generating natural speech output. A data-driven methodology is described based on the use of frames in which dialogue topics are organized hierarchically. The concept of a dynamically adjustable scope is introduced to permit adaptation to recognizer performance and the use of historical and hierarchical contexts are described to facilitate the construction of contextually relevant output messages. © 1989.

Energy scattering in weakly non-linear systems.

The Chinese Tam-Tam exhibits non-linear behavior in its vibro-acoustic response. The frequency content of the response during free, unforced vibration smoothly changes, with energy being progressively smeared out over a greater bandwidth with time. This is used as a motivating case for the general study of the phenomenon of energy cascading through weak nonlinearity. Numerical models based upon the Fermi-Pasta-Ulam system of non-linearly coupled oscillators, modified with the addition of damping, have been developed. These were used to study the response of ensembles of systems with randomized natural frequencies. Results from simulations will be presented here. For un-damped systems, individual ensemble members exhibit cyclical energy exchange between linear modes, but the ensemble average displays a steady state. For the ensemble response of damped systems, lightly damped modes can exhibit an effective damping which is higher than predicated by linear theory. The presence of a non-linearity provides a path for energy flow to other modes, increasing the apparent damping spectrum at some frequencies and reducing it at others. The target of this work is a model revealing the governing parameters of a generic system of this type and leading to predictions of the ensemble response.

Reinforcement learning for parameter estimation in statistical spoken dialogue systems

Reinforcement techniques have been successfully used to maximise the expected cumulative reward of statistical dialogue systems. Typically, reinforcement learning is used to estimate the parameters of a dialogue policy which selects the system's responses based on the inferred dialogue state. However, the inference of the dialogue state itself depends on a dialogue model which describes the expected behaviour of a user when interacting with the system. Ideally the parameters of this dialogue model should be also optimised to maximise the expected cumulative reward. This article presents two novel reinforcement algorithms for learning the parameters of a dialogue model. First, the Natural Belief Critic algorithm is designed to optimise the model parameters while the policy is kept fixed. This algorithm is suitable, for example, in systems using a handcrafted policy, perhaps prescribed by other design considerations. Second, the Natural Actor and Belief Critic algorithm jointly optimises both the model and the policy parameters. The algorithms are evaluated on a statistical dialogue system modelled as a Partially Observable Markov Decision Process in a tourist information domain. The evaluation is performed with a user simulator and with real users. The experiments indicate that model parameters estimated to maximise the expected reward function provide improved performance compared to the baseline handcrafted parameters. © 2011 Elsevier Ltd. All rights reserved.

On the applicability of the lognormal distribution in random dynamical systems

This paper is concerned with the probability density function of the energy of a random dynamical system subjected to harmonic excitation. It is shown that if the natural frequencies and mode shapes of the system conform to the Gaussian Orthogonal Ensemble, then under common types of loading the distribution of the energy of the response is approximately lognormal, providing the modal overlap factor is high (typically greater than two). In contrast, it is shown that the response of a system with Poisson natural frequencies is not approximately lognormal. Numerical simulations are conducted on a plate system to validate the theoretical findings and good agreement is obtained. Simulations are also conducted on a system made from two plates connected with rotational springs to demonstrate that the theoretical findings can be extended to a built-up system. The work provides a theoretical justification of the commonly used empirical practice of assuming that the energy response of a random system is lognormal.

Stabilization and disturbance attenuation of nonlinear systems using dissipativity theory

In this paper, we survey some recent results on stabilization and disturbance attenuation for nonlinear systems using a dissipativity approach. After reviewing the basic dissipativity concept, we stress the connections between Lyapunov designs and the problem of achieving passivity by feedback. Focusing on physical models, we then illustrate how the design of stabilizing feedback can take advantage of the natural energy balance equation of the system. Here stabilization is viewed as the task of shaping the energy of the system to enforce a minimum at the desired equilibrium. Finally, we show the implications of dissipativity theory as an appropriate framework to study the nonlinear H∞ control problem. © 2002 EUCA.

On differentially dissipative dynamical systems

Dissipativity is an essential concept of systems theory. The paper provides an extension of dissipativity, named differential dissipativity, by lifting storage functions and supply rates to the tangent bundle. Differential dissipativity is connected to incremental stability in the same way as dissipativity is connected to stability. It leads to a natural formulation of differential passivity when restricting to quadratic supply rates. The paper also shows that the interconnection of differentially passive systems is differentially passive, and provides preliminary examples of differentially passive electrical systems. © IFAC.