Separate representations of dynamics in rhythmic and discrete movements: evidence from motor learning.

Rhythmic and discrete arm movements occur ubiquitously in everyday life, and there is a debate as to whether these two classes of movements arise from the same or different underlying neural mechanisms. Here we examine interference in a motor-learning paradigm to test whether rhythmic and discrete movements employ at least partially separate neural representations. Subjects were required to make circular movements of their right hand while they were exposed to a velocity-dependent force field that perturbed the circularity of the movement path. The direction of the force-field perturbation reversed at the end of each block of 20 revolutions. When subjects made only rhythmic or only discrete circular movements, interference was observed when switching between the two opposing force fields. However, when subjects alternated between blocks of rhythmic and discrete movements, such that each was uniquely associated with one of the perturbation directions, interference was significantly reduced. Only in this case did subjects learn to corepresent the two opposing perturbations, suggesting that different neural resources were employed for the two movement types. Our results provide further evidence that rhythmic and discrete movements employ at least partially separate control mechanisms in the motor system.

Reynolds number influence on turbulent blocking effects of a rigid plane boundary (2nd report, direct numerical simulation using townsend's eddy forcing)

The Reynolds number influence on turbulent blocking effects by a rigid plane boundary is studied using direct numerical simulation (DNS). A new forcing method using 'simple model eddies' (Townsend 1976) for DNS of stationary homogeneous isotropic turbulence is proposed. A force field is obtained in real space by sprinkling many space-filling 'simple model eddies' whose centers are randomly but uniformly distributed in space and whose axes of rotation are random. The method is applied to a shear-free turbulent boundary layer over a rigid plane boundary and the blocking effects are investigated. The results show that stationary homogeneous isotropic turbulence is generated in real space using the present method. By using different model eddies with different sizes and rotation speeds, we could change the turbulence properties such as the integral and micro scales, the turbulent Reynolds number and the isotropy of turbulence. Turbulence intensities near the wall showed good agreements with the previous measurement and the linear analysis based on a rapid distortion theory (RDT). The splat effect (i.e., turbulence intensities of the components parallel to the boundary are amplified) occurs near the boundary and the viscous effect prohibits the splat effect at the quasi steady state at low Reynolds number.

Reynolds number influence on turbulent blocking effects of a rigid plane boundary (3rd report, direct numerical simulation on wall blocking effects for anisotropic turbulence)

The Reynolds number influence on turbulent blocking effects by a rigid plane boundary is studied using direct numerical simulation (DNS). A new forcing method proposed in the second report using Townsend's "simple model eddies" for DNS was extended to generate axisymmetric anisotropic turbulence. A force field is obtained in real space by sprinkling many space-filling "simple model eddies" whose centers are randomly but uniformly distributed in space. The axes of rotation are controlled in this study to generate axisymmetric anisotropic turbulence. The method is applied to a shear-free turbulent boundary layer over a rigid plane boundary and the blocking effects for anisotropic turbulence are investigated. The results show that stationary axisymmetric anisotropic turbulence is generated using the present method. Turbulence intensities near the wall showed good agreements with the rapid distortion theory (RDT) for small t (t ≪ TL), where TL. is the eddy turnover time. The splat effect (i. e. turbulence intensities of the components parallel to the surface are amplified) occurs near the boundary and the viscous effect attenuates the splat effect at the quasi steady state at low Reynolds number as for Isotropic turbulence. Prandtl's secondary flow of the second kind does not occur for low Reynolds number flows, which qualitatively agrees with previous observetion in a mixing-box.

A single-rate context-dependent learning process underlies rapid adaptation to familiar object dynamics.

Motor learning has been extensively studied using dynamic (force-field) perturbations. These induce movement errors that result in adaptive changes to the motor commands. Several state-space models have been developed to explain how trial-by-trial errors drive the progressive adaptation observed in such studies. These models have been applied to adaptation involving novel dynamics, which typically occurs over tens to hundreds of trials, and which appears to be mediated by a dual-rate adaptation process. In contrast, when manipulating objects with familiar dynamics, subjects adapt rapidly within a few trials. Here, we apply state-space models to familiar dynamics, asking whether adaptation is mediated by a single-rate or dual-rate process. Previously, we reported a task in which subjects rotate an object with known dynamics. By presenting the object at different visual orientations, adaptation was shown to be context-specific, with limited generalization to novel orientations. Here we show that a multiple-context state-space model, with a generalization function tuned to visual object orientation, can reproduce the time-course of adaptation and de-adaptation as well as the observed context-dependent behavior. In contrast to the dual-rate process associated with novel dynamics, we show that a single-rate process mediates adaptation to familiar object dynamics. The model predicts that during exposure to the object across multiple orientations, there will be a degree of independence for adaptation and de-adaptation within each context, and that the states associated with all contexts will slowly de-adapt during exposure in one particular context. We confirm these predictions in two new experiments. Results of the current study thus highlight similarities and differences in the processes engaged during exposure to novel versus familiar dynamics. In both cases, adaptation is mediated by multiple context-specific representations. In the case of familiar object dynamics, however, the representations can be engaged based on visual context, and are updated by a single-rate process.

Functional significance of stiffness in adaptation of multijoint arm movements to stable and unstable dynamics.

This study compared the mechanisms of adaptation to stable and unstable dynamics from the perspective of changes in joint mechanics. Subjects were instructed to make point to point movements in force fields generated by a robotic manipulandum which interacted with the arm in either a stable or an unstable manner. After subjects adjusted to the initial disturbing effects of the force fields they were able to produce normal straight movements to the target. In the case of the stable interaction, subjects modified the joint torques in order to appropriately compensate for the force field. No change in joint torque or endpoint force was required or observed in the case of the unstable interaction. After adaptation, the endpoint stiffness of the arm was measured by applying displacements to the hand in eight different directions midway through the movements. This was compared to the stiffness measured similarly during movements in a null force field. After adaptation, the endpoint stiffness under both the stable and unstable dynamics was modified relative to the null field. Adaptation to unstable dynamics was achieved by selective modification of endpoint stiffness in the direction of the instability. To investigate whether the change in endpoint stiffness could be accounted for by change in joint torque or endpoint force, we estimated the change in stiffness on each trial based on the change in joint torque relative to the null field. For stable dynamics the change in endpoint stiffness was accurately predicted. However, for unstable dynamics the change in endpoint stiffness could not be reproduced. In fact, the predicted endpoint stiffness was similar to that in the null force field. Thus, the change in endpoint stiffness seen after adaptation to stable dynamics was directly related to changes in net joint torque necessary to compensate for the dynamics in contrast to adaptation to unstable dynamics, where a selective change in endpoint stiffness occurred without any modification of net joint torque.

Different mechanisms involved in adaptation to stable and unstable dynamics.

Recently, we demonstrated that humans can learn to make accurate movements in an unstable environment by controlling magnitude, shape, and orientation of the endpoint impedance. Although previous studies of human motor learning suggest that the brain acquires an inverse dynamics model of the novel environment, it is not known whether this control mechanism is operative in unstable environments. We compared learning of multijoint arm movements in a "velocity-dependent force field" (VF), which interacted with the arm in a stable manner, and learning in a "divergent force field" (DF), where the interaction was unstable. The characteristics of error evolution were markedly different in the 2 fields. The direction of trajectory error in the DF alternated to the left and right during the early stage of learning; that is, signed error was inconsistent from movement to movement and could not have guided learning of an inverse dynamics model. This contrasted sharply with trajectory error in the VF, which was initially biased and decayed in a manner that was consistent with rapid feedback error learning. EMG recorded before and after learning in the DF and VF are also consistent with different learning and control mechanisms for adapting to stable and unstable dynamics, that is, inverse dynamics model formation and impedance control. We also investigated adaptation to a rotated DF to examine the interplay between inverse dynamics model formation and impedance control. Our results suggest that an inverse dynamics model can function in parallel with an impedance controller to compensate for consistent perturbing force in unstable environments.

Adaptation to stable and unstable dynamics achieved by combined impedance control and inverse dynamics model.

This study compared adaptation in novel force fields where trajectories were initially either stable or unstable to elucidate the processes of learning novel skills and adapting to new environments. Subjects learned to move in a null force field (NF), which was unexpectedly changed either to a velocity-dependent force field (VF), which resulted in perturbed but stable hand trajectories, or a position-dependent divergent force field (DF), which resulted in unstable trajectories. With practice, subjects learned to compensate for the perturbations produced by both force fields. Adaptation was characterized by an initial increase in the activation of all muscles followed by a gradual reduction. The time course of the increase in activation was correlated with a reduction in hand-path error for the DF but not for the VF. Adaptation to the VF could have been achieved solely by formation of an inverse dynamics model and adaptation to the DF solely by impedance control. However, indices of learning, such as hand-path error, joint torque, and electromyographic activation and deactivation suggest that the CNS combined these processes during adaptation to both force fields. Our results suggest that during the early phase of learning there is an increase in endpoint stiffness that serves to reduce hand-path error and provides additional stability, regardless of whether the dynamics are stable or unstable. We suggest that the motor control system utilizes an inverse dynamics model to learn the mean dynamics and an impedance controller to assist in the formation of the inverse dynamics model and to generate needed stability.

Impedance control balances stability with metabolically costly muscle activation.

Humans are able to stabilize their movements in environments with unstable dynamics by selectively modifying arm impedance independently of force and torque. We further investigated adaptation to unstable dynamics to determine whether the CNS maintains a constant overall level of stability as the instability of the environmental dynamics is varied. Subjects performed reaching movements in unstable force fields of varying strength, generated by a robotic manipulator. Although the force fields disrupted the initial movements, subjects were able to adapt to the novel dynamics and learned to produce straight trajectories. After adaptation, the endpoint stiffness of the arm was measured at the midpoint of the movement. The stiffness had been selectively modified in the direction of the instability. The stiffness in the stable direction was relatively unchanged from that measured during movements in a null force field prior to exposure to the unstable force field. This impedance modification was achieved without changes in force and torque. The overall stiffness of the arm and environment in the direction of instability was adapted to the force field strength such that it remained equivalent to that of the null force field. This suggests that the CNS attempts both to maintain a minimum level of stability and minimize energy expenditure.

Impedance control and internal model use during the initial stage of adaptation to novel dynamics in humans.

This study investigated the neuromuscular mechanisms underlying the initial stage of adaptation to novel dynamics. A destabilizing velocity-dependent force field (VF) was introduced for sets of three consecutive trials. Between sets a random number of 4-8 null field trials were interposed, where the VF was inactivated. This prevented subjects from learning the novel dynamics, making it possible to repeatedly recreate the initial adaptive response. We were able to investigate detailed changes in neural control between the first, second and third VF trials. We identified two feedforward control mechanisms, which were initiated on the second VF trial and resulted in a 50% reduction in the hand path error. Responses to disturbances encountered on the first VF trial were feedback in nature, i.e. reflexes and voluntary correction of errors. However, on the second VF trial, muscle activation patterns were modified in anticipation of the effects of the force field. Feedforward cocontraction of all muscles was used to increase the viscoelastic impedance of the arm. While stiffening the arm, subjects also exerted a lateral force to counteract the perturbing effect of the force field. These anticipatory actions indicate that the central nervous system responds rapidly to counteract hitherto unfamiliar disturbances by a combination of increased viscoelastic impedance and formation of a crude internal dynamics model.

QM/MM simulation of liquid water with an adaptive quantum region.

The simulation of complex chemical systems often requires a multi-level description, in which a region of special interest is treated using a computationally expensive quantum mechanical (QM) model while its environment is described by a faster, simpler molecular mechanical (MM) model. Furthermore, studying dynamic effects in solvated systems or bio-molecules requires a variable definition of the two regions, so that atoms or molecules can be dynamically re-assigned between the QM and MM descriptions during the course of the simulation. Such reassignments pose a problem for traditional QM/MM schemes by exacerbating the errors that stem from switching the model at the boundary. Here we show that stable, long adaptive simulations can be carried out using density functional theory with the BLYP exchange-correlation functional for the QM model and a flexible TIP3P force field for the MM model without requiring adjustments of either. Using a primary benchmark system of pure water, we investigate the convergence of the liquid structure with the size of the QM region, and demonstrate that by using a sufficiently large QM region (with radius 6 Å) it is possible to obtain radial and angular distributions that, in the QM region, match the results of fully quantum mechanical calculations with periodic boundary conditions, and, after a smooth transition, also agree with fully MM calculations in the MM region. The key ingredient is the accurate evaluation of forces in the QM subsystem which we achieve by including an extended buffer region in the QM calculations. We also show that our buffered-force QM/MM scheme is transferable by simulating the solvated Cl(-) ion.

Immersed Boundary Method for generalised finite volume and finite difference Navier-Stokes solvers

In Immersed Boundary Methods (IBM) the effect of complex geometries is introduced through the forces added in the Navier-Stokes solver at the grid points in the vicinity of the immersed boundaries. Most of the methods in the literature have been used with Cartesian grids. Moreover many of the methods developed in the literature do not satisfy some basic conservation properties (the conservation of torque, for instance) on non-uniform meshes. In this paper we will follow the RKPM method originated by Liu et al. [1] to build locally regularized functions that verify a number of integral conditions. These local approximants will be used both for interpolating the velocity field and for spreading the singular force field in the framework of a pressure correction scheme for the incompressible Navier-Stokes equations. We will also demonstrate the robustness and effectiveness of the scheme through various examples. Copyright © 2010 by ASME.

Measuring stiffness during arm movements in various dynamic environments

The technique presented in this paper enables a simple, accurate and unbiased measurement of hand stiffness during human arm movements. Using a computer-controlled mechanical interface, the hand is shifted relative to a prediction of the undisturbed trajectory. Stiffness is then computed as the restoring force divided by the position amplitude of the perturbation. A precise prediction algorithm insures the measurement quality. We used this technique to measure stiffness in free movements and after adaptation to a linear velocity dependent force field. The subjects compensated for the external force by co-contracting muscles selectively. The stiffness geometry changed with learning and stiffness tended to increase in the direction of the external force.

Visuomotor feedback gains upregulate during the learning of novel dynamics.

At an early stage of learning novel dynamics, changes in muscle activity are mainly due to corrective feedback responses. These feedback contributions to the overall motor command are gradually reduced as feedforward control is learned. The temporary increased use of feedback could arise simply from the large errors in early learning with either unaltered gains or even slightly downregulated gains, or from an upregulation of the feedback gains when feedforward prediction is insufficient. We therefore investigated whether the sensorimotor control system alters feedback gains during adaptation to a novel force field generated by a robotic manipulandum. To probe the feedback gains throughout learning, we measured the magnitude of involuntary rapid visuomotor responses to rapid shifts in the visual location of the hand during reaching movements. We found large increases in the magnitude of the rapid visuomotor response whenever the dynamics changed: both when the force field was first presented, and when it was removed. We confirmed that these changes in feedback gain are not simply a byproduct of the change in background load, by demonstrating that this rapid visuomotor response is not load sensitive. Our results suggest that when the sensorimotor control system experiences errors, it increases the gain of the visuomotor feedback pathways to deal with the unexpected disturbances until the feedforward controller learns the appropriate dynamics. We suggest that these feedback gains are upregulated with increased uncertainty in the knowledge of the dynamics to counteract any errors or disturbances and ensure accurate and skillful movements.

Gone in 0.6 seconds: the encoding of motor memories depends on recent sensorimotor states.

Real-world tasks often require movements that depend on a previous action or on changes in the state of the world. Here we investigate whether motor memories encode the current action in a manner that depends on previous sensorimotor states. Human subjects performed trials in which they made movements in a randomly selected clockwise or counterclockwise velocity-dependent curl force field. Movements during this adaptation phase were preceded by a contextual phase that determined which of the two fields would be experienced on any given trial. As expected from previous research, when static visual cues were presented in the contextual phase, strong interference (resulting in an inability to learn either field) was observed. In contrast, when the contextual phase involved subjects making a movement that was continuous with the adaptation-phase movement, a substantial reduction in interference was seen. As the time between the contextual and adaptation movement increased, so did the interference, reaching a level similar to that seen for static visual cues for delays >600 ms. This contextual effect generalized to purely visual motion, active movement without vision, passive movement, and isometric force generation. Our results show that sensorimotor states that differ in their recent temporal history can engage distinct representations in motor memory, but this effect decays progressively over time and is abolished by ∼600 ms. This suggests that motor memories are encoded not simply as a mapping from current state to motor command but are encoded in terms of the recent history of sensorimotor states.

Topologically invariant reaction coordinates for simulating multistate chemical reactions.

Evaluating free energy profiles of chemical reactions in complex environments such as solvents and enzymes requires extensive sampling, which is usually performed by potential of mean force (PMF) techniques. The reliability of the sampling depends not only on the applied PMF method but also the reaction coordinate space within the dynamics is biased. In contrast to simple geometrical collective variables that depend only on the positions of the atomic coordinates of the reactants, the E(gap) reaction coordinate (the energy difference obtained by evaluating a suitable force field using reactant and product state topologies) has the unique property that it is able to take environmental effects into account leading to better convergence, a more faithful description of the transition state ensemble and therefore more accurate free energy profiles. However, E(gap) requires predefined topologies and is therefore inapplicable for multistate reactions, in which the barrier between the chemically equivalent topologies is comparable to the reaction activation barrier, because undesired "side reactions" occur. In this article, we introduce a new energy-based collective variable by generalizing the E(gap) reaction coordinate such that it becomes invariant to equivalent topologies and show that it yields more well behaved free energy profiles than simpler geometrical reaction coordinates.