Learning feedforward commands to muscles using time-shifted sensory feedback

In adapting to changing forces in the mechanical environment, humans change the force being applied by the limb by reciprocal changes in the activation of antagonistic muscles. However, they also cocontract these muscles when interaction with the environment is mechanically unstable to increase the mechanical impedance of the limb. We have postulated that appropriate patterns of muscle activation could be learned using a simple scheme in which the naturally occurring stretch reflex is used as a template to adjust feedforward commands to muscles. Feedforward commands are modified iteratively by shifting a scaled version of the reflex response forward in time and adding it to the previous feedforward command. We show that such an algorithm can account for the principal features of changes in muscle activation observed when human subjects adapt to instabilities in the mechanical environment. © 2006.

Global stabilization of feedforward systems with exponentially unstable Jacobian linearization

The global stabilization of a class of feedforward systems having an exponentially unstable Jacobian linearization is achieved by a high-gain feedback saturated at a low level. The control law forces the derivatives of the state variables to small values along the closed-loop trajectories. This "slow control" design is illustrated with a benchmark example and its limitations are emphasized. © 1999 Elsevier Science B.V. All rights reserved.

Impedance control and internal model use during the initial stage of adaptation to novel dynamics in humans.

This study investigated the neuromuscular mechanisms underlying the initial stage of adaptation to novel dynamics. A destabilizing velocity-dependent force field (VF) was introduced for sets of three consecutive trials. Between sets a random number of 4-8 null field trials were interposed, where the VF was inactivated. This prevented subjects from learning the novel dynamics, making it possible to repeatedly recreate the initial adaptive response. We were able to investigate detailed changes in neural control between the first, second and third VF trials. We identified two feedforward control mechanisms, which were initiated on the second VF trial and resulted in a 50% reduction in the hand path error. Responses to disturbances encountered on the first VF trial were feedback in nature, i.e. reflexes and voluntary correction of errors. However, on the second VF trial, muscle activation patterns were modified in anticipation of the effects of the force field. Feedforward cocontraction of all muscles was used to increase the viscoelastic impedance of the arm. While stiffening the arm, subjects also exerted a lateral force to counteract the perturbing effect of the force field. These anticipatory actions indicate that the central nervous system responds rapidly to counteract hitherto unfamiliar disturbances by a combination of increased viscoelastic impedance and formation of a crude internal dynamics model.

Reflex contributions to the directional tuning of arm stiffness

It has been shown that during arm movement, humans selectively change the endpoint stiffness of their arm to compensate for the instability in an unstable environment. When the direction of the instability is rotated with respect to the direction of movement, it was found that humans modify the antisymmetric component of their endpoint stiffness. The antisymmetric component of stiffness arises due to reflex responses suggesting that the subjects may have tuned their reflex responses as part of the feedforward adaptive control. The goal of this study was to examine whether the CNS modulates the gain of the reflex response for selective tuning of endpoint impedance. Subjects performed reaching movements in three unstable force fields produced by a robotic manipulandum, each field differing only in the rotational component. After subjects had learned to compensate for the field, allowing them to make unperturbed movements to the target, the endpoint stiffness of the arm was estimated in the middle of the movements. At the same time electromyographic activity (EMG) of six arm muscles was recorded. Analysis of the EMG revealed differences across force fields in the reflex gain of these muscles consistent with stiffness changes. This study suggests that the CNS modulates the reflex gain as part of the adaptive feedforward command in which the endpoint impedance is selectively tuned to overcome environmental instability. © 2008 Springer-Verlag Berlin Heidelberg.

Single trial learning of external dynamics: What can the brain teach us about learning mechanisms?

Humans have exceptional abilities to learn new skills, manipulate tools and objects, and interact with our environment. In order to be successful at these tasks, our brain has developed learning mechanisms to deal with and compensate for the constantly changing dynamics of the world. If this mechanism or mechanisms can be understood from a computational point of view, then they can also be used to drive the adaptability and learning of robots. In this paper, we will present a new technique for examining changes in the feedforward motor command due to adaptation. This technique can then be utilized for examining motor adaptation in humans and determining a computational algorithm which explains motor learning. © 2007.

How are internal models of unstable tasks formed?

The results of recent studies suggest that humans can form internal models that they use in a feedforward manner to compensate for both stable and unstable dynamics. To examine how internal models are formed, we performed adaptation experiments in novel dynamics, and measured the endpoint force, trajectory and EMG during learning. Analysis of reflex feedback and change of feedforward commands between consecutive trials suggested a unified model of motor learning, which can coherently unify the learning processes observed in stable and unstable dynamics and reproduce available data on motor learning. To our knowledge, this algorithm, based on the concurrent minimization of (reflex) feedback and muscle activation, is also the first nonlinear adaptive controller able to stabilize unstable dynamics.

Visuomotor feedback gains upregulate during the learning of novel dynamics.

At an early stage of learning novel dynamics, changes in muscle activity are mainly due to corrective feedback responses. These feedback contributions to the overall motor command are gradually reduced as feedforward control is learned. The temporary increased use of feedback could arise simply from the large errors in early learning with either unaltered gains or even slightly downregulated gains, or from an upregulation of the feedback gains when feedforward prediction is insufficient. We therefore investigated whether the sensorimotor control system alters feedback gains during adaptation to a novel force field generated by a robotic manipulandum. To probe the feedback gains throughout learning, we measured the magnitude of involuntary rapid visuomotor responses to rapid shifts in the visual location of the hand during reaching movements. We found large increases in the magnitude of the rapid visuomotor response whenever the dynamics changed: both when the force field was first presented, and when it was removed. We confirmed that these changes in feedback gain are not simply a byproduct of the change in background load, by demonstrating that this rapid visuomotor response is not load sensitive. Our results suggest that when the sensorimotor control system experiences errors, it increases the gain of the visuomotor feedback pathways to deal with the unexpected disturbances until the feedforward controller learns the appropriate dynamics. We suggest that these feedback gains are upregulated with increased uncertainty in the knowledge of the dynamics to counteract any errors or disturbances and ensure accurate and skillful movements.

Comparisons between gigabit NRZ, CAP and optical OFDM systems over FEC enhanced POF links using LEDs

Simulations have been performed to compare the link power budget and power dissipation of carrierless amplitude and phase modulation-64 (CAP-64) and 64-quadrature amplitude modulation-orthogonal frequency division multiplexing (64-QAM-OFDM) systems over feedforward error correction (FEC) enhanced plastic optical fibre (POF) links using light emitting diodes (LEDs). It is shown that CAP-64 outperforms 64-QAM-OFDM and supports record high 2.1Gb/s over 50m POF transmission. The CAP-64 and 64-QAM-OFDM links consume similar powers which are 2 (2.5) times of that of NRZ for the single POF link (twin POF links) case. © 2012 IEEE.

Generalization in Adaptation to Stable and Unstable Dynamics

Humans skillfully manipulate objects and tools despite the inherent instability. In order to succeed at these tasks, the sensorimotor control system must build an internal representation of both the force and mechanical impedance. As it is not practical to either learn or store motor commands for every possible future action, the sensorimotor control system generalizes a control strategy for a range of movements based on learning performed over a set of movements. Here, we introduce a computational model for this learning and generalization, which specifies how to learn feedforward muscle activity in a function of the state space. Specifically, by incorporating co-activation as a function of error into the feedback command, we are able to derive an algorithm from a gradient descent minimization of motion error and effort, subject to maintaining a stability margin. This algorithm can be used to learn to coordinate any of a variety of motor primitives such as force fields, muscle synergies, physical models or artificial neural networks. This model for human learning and generalization is able to adapt to both stable and unstable dynamics, and provides a controller for generating efficient adaptive motor behavior in robots. Simulation results exhibit predictions consistent with all experiments on learning of novel dynamics requiring adaptation of force and impedance, and enable us to re-examine some of the previous interpretations of experiments on generalization. © 2012 Kadiallah et al.

Active control of the accordion modes of a submerged hull

Active vibration control of a submerged hull is presented. A submarine hull can be idealised as a ring stiffened finite cylinder with applied fluid loading. At low frequencies, rotation of the propeller results in discrete tones at the blade passing frequency and its harmonics. The low frequency axial and radial vibration modes of the submerged body can result in a high level of radiated noise. Global hull modes are difficult to attenuate since passive control techniques such as damping materials are not practical due to size and weight constraints. This work investigates active vibration control of a submarine hull for attenuation of the structural and acoustic responses. Based on a feedforward algorithm at tonal frequencies, active vibration suppression of the axial and radial hull displacements are investigated. The effect of the various control arrangements on the structure-borne radiated noise is examined. Numerical simulations of the control performance are presented.

Antiwindup design for induction motor control in the field weakening domain

Operation of induction machines in the high-speed and/or high-torque range requires field-weakening to comply with voltage and current physical limitations. This paper presents an anti-windup approach to this problem: rather than developing an ad-hoc field weakening strategy in the high-speed region, we equip an unconstrained vector-control design with an anti-windup module that automatically adjusts the current and flux set-points so that voltage and current constraints are satisfied at every operating point. The anti-windup module includes a feedforward modification of the set point aimed at maximizing the available torque in steady-state and a feedback modification of the controller based on an internal model-based antiwindup scheme. This paper includes a complete stability analysis of the proposed solution and presents encouraging experimental results on an industrial drive. © 2012 IEEE.

Controlling the phase of an oscillator: A phase response curve approach

The paper discusses elementary control strategies to control the phase of an oscillator. Both feedforward and feedback (P and PI) control laws are designed based on the phase response curve (PRC) calculated from the linearized model. The performance is evaluated on a popular model of circadian oscillations. ©2009 IEEE.