Feedback control and the arrow of time

The purpose of this paper is to highlight the central role that the time asymmetry of stability plays in feedback control. We show that this provides a new perspective on the use of doubly-infinite or semi-infinite time axes for signal spaces in control theory. We then focus on the implication of this time asymmetry in modeling uncertainty, regulation and robust control. We point out that modeling uncertainty and the ease of control depend critically on the direction of time. We finally discuss the relationship of this control-based time arrow with the well-known arrows of time in physics. © 2008 IEEE.

Risk-sensitive optimal feedback control accounts for sensorimotor behavior under uncertainty

Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models. © 2010 Nagengast et al.

An analysis of the cooperative mechano-sensitive feedback between intracellular signaling, focal adhesion development, and stress fiber contractility

Cells communicate with their external environment via focal adhesions and generate activation signals that in turn trigger the activity of the intracellular contractile machinery. These signals can be triggered by mechanical loading that gives rise to a cooperative feedback loop among signaling, focal adhesion formation, and cytoskeletal contractility, which in turn equilibrates with the applied mechanical loads. We devise a signaling model that couples stress fiber contractility and mechano-sensitive focal adhesion models to complete this above mentioned feedback loop. The signaling model is based on a biochemical pathway where IP3 molecules are generated when focal adhesions grow. These IP3 molecules diffuse through the cytosol leading to the opening of ion channels that disgorge Ca2+ from the endoplasmic reticulum leading to the activation of the actin/myosin contractile machinery. A simple numerical example is presented where a one-dimensional cell adhered to a rigid substrate is pulled at one end, and the evolution of the stress fiber activation signal, stress fiber concentrations, and focal adhesion distributions are investigated. We demonstrate that while it is sufficient to approximate the activation signal as spatially uniform due to the rapid diffusion of the IP3 through the cytosol, the level of the activation signal is sensitive to the rate of application of the mechanical loads. This suggests that ad hoc signaling models may not be able to capture the mechanical response of cells to a wide range of mechanical loading events. © 2011 American Society of Mechanical Engineers.

Learning feedforward commands to muscles using time-shifted sensory feedback

In adapting to changing forces in the mechanical environment, humans change the force being applied by the limb by reciprocal changes in the activation of antagonistic muscles. However, they also cocontract these muscles when interaction with the environment is mechanically unstable to increase the mechanical impedance of the limb. We have postulated that appropriate patterns of muscle activation could be learned using a simple scheme in which the naturally occurring stretch reflex is used as a template to adjust feedforward commands to muscles. Feedforward commands are modified iteratively by shifting a scaled version of the reflex response forward in time and adding it to the previous feedforward command. We show that such an algorithm can account for the principal features of changes in muscle activation observed when human subjects adapt to instabilities in the mechanical environment. © 2006.