Nash equilibria in multi-agent motor interactions.

Social interactions in classic cognitive games like the ultimatum game or the prisoner's dilemma typically lead to Nash equilibria when multiple competitive decision makers with perfect knowledge select optimal strategies. However, in evolutionary game theory it has been shown that Nash equilibria can also arise as attractors in dynamical systems that can describe, for example, the population dynamics of microorganisms. Similar to such evolutionary dynamics, we find that Nash equilibria arise naturally in motor interactions in which players vie for control and try to minimize effort. When confronted with sensorimotor interaction tasks that correspond to the classical prisoner's dilemma and the rope-pulling game, two-player motor interactions led predominantly to Nash solutions. In contrast, when a single player took both roles, playing the sensorimotor game bimanually, cooperative solutions were found. Our methodology opens up a new avenue for the study of human motor interactions within a game theoretic framework, suggesting that the coupling of motor systems can lead to game theoretic solutions.

Learning optimal adaptation strategies in unpredictable motor tasks.

Picking up an empty milk carton that we believe to be full is a familiar example of adaptive control, because the adaptation process of estimating the carton's weight must proceed simultaneously with the control process of moving the carton to a desired location. Here we show that the motor system initially generates highly variable behavior in such unpredictable tasks but eventually converges to stereotyped patterns of adaptive responses predicted by a simple optimality principle. These results suggest that adaptation can become specifically tuned to identify task-specific parameters in an optimal manner.

Investigation of anti-lock braking strategies for heavy goods vehicles

An articulated lorry was instrumented in order to measure its performance in straight-line braking. The trailer was fitted with two interchangeable tandem axle sub-chassis, one with an air suspension and the other with a steel monoleaf four-spring suspension. The brakes were only applied to the trailer axles, which were fitted with anti-lock braking systems (ABS), with the brake torque controlled in response to anticipated locking of the leading axle of the tandem. The vehicle with the air suspension was observed to have significantly better braking performance than the steel suspension, and to generate smaller inter-axle load transfer and smaller vertical dynamic tyre forces. Computer models of the two suspensions were developed, including their brakes and anti-lock systems. The models were found to reproduce most of the important features of the experimental results. It was concluded that the poor braking performance of the steel four-spring suspension was mainly due to interaction between the ABS and inter-axle load transfer effects. The effect of road roughness was investigated and it was found that vehicle stopping distances can increase significantly with increasing road roughness. Two alternative anti-lock braking control strategies were simulated. It was found that independent sensing and actuation of the ABS system on each wheel greatly reduced the difference in stopping distances between the air and steel suspensions. A control strategy based on limiting wheel slip was least susceptible to the effects of road roughness.

Effects of the user model on simulation-based learning of dialogue strategies

Over the past decade, a variety of user models have been proposed for user simulation-based reinforcement-learning of dialogue strategies. However, the strategies learned with these models are rarely evaluated in actual user trials and it remains unclear how the choice of user model affects the quality of the learned strategy. In particular, the degree to which strategies learned with a user model generalise to real user populations has not be investigated. This paper presents a series of experiments that qualitatively and quantitatively examine the effect of the user model on the learned strategy. Our results show that the performance and characteristics of the strategy are in fact highly dependent on the user model. Furthermore, a policy trained with a poor user model may appear to perform well when tested with the same model, but fail when tested with a more sophisticated user model. This raises significant doubts about the current practice of learning and evaluating strategies with the same user model. The paper further investigates a new technique for testing and comparing strategies directly on real human-machine dialogues, thereby avoiding any evaluation bias introduced by the user model. © 2005 IEEE.

An analysis of the cooperative mechano-sensitive feedback between intracellular signaling, focal adhesion development, and stress fiber contractility

Cells communicate with their external environment via focal adhesions and generate activation signals that in turn trigger the activity of the intracellular contractile machinery. These signals can be triggered by mechanical loading that gives rise to a cooperative feedback loop among signaling, focal adhesion formation, and cytoskeletal contractility, which in turn equilibrates with the applied mechanical loads. We devise a signaling model that couples stress fiber contractility and mechano-sensitive focal adhesion models to complete this above mentioned feedback loop. The signaling model is based on a biochemical pathway where IP3 molecules are generated when focal adhesions grow. These IP3 molecules diffuse through the cytosol leading to the opening of ion channels that disgorge Ca2+ from the endoplasmic reticulum leading to the activation of the actin/myosin contractile machinery. A simple numerical example is presented where a one-dimensional cell adhered to a rigid substrate is pulled at one end, and the evolution of the stress fiber activation signal, stress fiber concentrations, and focal adhesion distributions are investigated. We demonstrate that while it is sufficient to approximate the activation signal as spatially uniform due to the rapid diffusion of the IP3 through the cytosol, the level of the activation signal is sensitive to the rate of application of the mechanical loads. This suggests that ad hoc signaling models may not be able to capture the mechanical response of cells to a wide range of mechanical loading events. © 2011 American Society of Mechanical Engineers.