Risk-sensitive optimal feedback control accounts for sensorimotor behavior under uncertainty.

Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models.

Feedback control and the arrow of time

The purpose of this paper is to highlight the central role that the time asymmetry of stability plays in feedback control. We show that this provides a new perspective on the use of doubly-infinite or semi-infinite time axes for signal spaces in control theory. We then focus on the implication of this time asymmetry in modeling uncertainty, regulation and robust control. We point out that modeling uncertainty and the ease of control depend critically on the direction of time. We finally discuss the relationship of this control-based time arrow with the well-known arrows of time in physics. © 2008 IEEE.

Risk-sensitive optimal feedback control accounts for sensorimotor behavior under uncertainty

Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models. © 2010 Nagengast et al.

A neuro-inspired method for data rate limited feedback control

The nervous system implements a networked control system in which the plants take the form of limbs, the controller is the brain, and neurons form the communication channels. Unlike standard networked control architectures, there is no periodic sampling, and the fundamental units of communication contain little numerical information. This paper describes a novel communication channel, modeled after spiking neurons, in which the transmitter integrates an input signal and sends out a spike when the integral reaches a threshold value. The reciever then filters the sequence of spikes to approximately reconstruct the input signal. It is shown that for appropriate choices of channel parameters, stable feedback control over these spiking channels is possible. Furthermore, good tracking performance can be achieved. The data rate of the channel increases linearly with the size of the inputs. Thus, when placed in a feedback loop, small loop gains imply a low data rate. ©2010 IEEE.

Rhythmic feedback control of a blind planar juggler

The paper considers the feedback stabilization of periodic orbits in a planar juggler. The juggler is "blind," i.e, he has no other sensing capabilities than the detection of impact times. The robustness analysis of the proposed control suggests that the arms acceleration at impact is a crucial design parameter even though it plays no role in the stability analysis. Analytical results and convergence proofs are provided for a simplified model of the juggler. The control law is then adapted to a more accurate model and validated in an experimental setup. © 2007 IEEE.

Feedback control of impact dynamics: The bouncing ball revisited

We study the the design of a tracking controller for the popular bouncing ball model: the continuous-time actuation of a table is used to control the impacts of the table with a bouncing ball. The proposed control law uses the impact times as the sole feedback information. We show that the acceleration of the table at impact plays no role in the stability analysis but is an important parameter for the robustness of the feedback system to model uncertainty, in particular to the uncertainty on the coefficient of restitution. © 2006 IEEE.

Timing feedback control of a rhythmic system

This paper addresses the question relative to the role of sensory feedback in rhythmic tasks. We study the properties of a sinusoidally vibrating wedge-billiard as a model for 2-D bounce juggling. If this wedge is actuated with an harmonic sinusoidal input, it has been shown that some periodic orbits are exponentially stable. This paper explores an intuitive method to enlarge the parametric stability region of the simplest of these orbits. Accurate processing of timing is proven to be an important key to achieve frequency-locking in rhythmic tasks. © 2005 IEEE.

Design of diesel smoke feedback control using a combination of PI control algorithm and performance optimization

A novel smoke sensor was used to realize smoke feedback control on a diesel engine. The controller design based on a combination of PI control algorithm and the engine performance optimization is described. Experimental results demonstrate how this control system behave to meet both of the speed and smoke requirements during engine transients.

Engine modelling for diesel smoke feedback control system design

A novel smoke sensor was used to measure the smoke response to the fuel rack on a diesel engine. The conventional modelling methods used for engine control were investigated. The synchronization technique and Recursive Least Square method were applied to engine modelling and two models for controller design were derived.