Specificity of reflex adaptation for task-relevant variability.

The motor system responds to perturbations with reflexes, such as the vestibulo-ocular reflex or stretch reflex, whose gains adapt in response to novel and fixed changes in the environment, such as magnifying spectacles or standing on a tilting platform. Here we demonstrate a reflex response to shifts in the hand's visual location during reaching, which occurs before the onset of voluntary reaction time, and investigate how its magnitude depends on statistical properties of the environment. We examine the change in reflex response to two different distributions of visuomotor discrepancies, both of which have zero mean and equal variance across trials. Critically one distribution is task relevant and the other task irrelevant. The task-relevant discrepancies are maintained to the end of the movement, whereas the task-irrelevant discrepancies are transient such that no discrepancy exists at the end of the movement. The reflex magnitude was assessed using identical probe trials under both distributions. We find opposite directions of adaptation of the reflex response under these two distributions, with increased reflex magnitudes for task-relevant variability and decreased reflex magnitudes for task-irrelevant variability. This demonstrates modulation of reflex magnitudes in the absence of a fixed change in the environment, and shows that reflexes are sensitive to the statistics of tasks with modulation depending on whether the variability is task relevant or task irrelevant.

Motor task variation induces structural learning.

When we have learned a motor skill, such as cycling or ice-skating, we can rapidly generalize to novel tasks, such as motorcycling or rollerblading [1-8]. Such facilitation of learning could arise through two distinct mechanisms by which the motor system might adjust its control parameters. First, fast learning could simply be a consequence of the proximity of the original and final settings of the control parameters. Second, by structural learning [9-14], the motor system could constrain the parameter adjustments to conform to the control parameters' covariance structure. Thus, facilitation of learning would rely on the novel task parameters' lying on the structure of a lower-dimensional subspace that can be explored more efficiently. To test between these two hypotheses, we exposed subjects to randomly varying visuomotor tasks of fixed structure. Although such randomly varying tasks are thought to prevent learning, we show that when subsequently presented with novel tasks, subjects exhibit three key features of structural learning: facilitated learning of tasks with the same structure, strong reduction in interference normally observed when switching between tasks that require opposite control strategies, and preferential exploration along the learned structure. These results suggest that skill generalization relies on task variation and structural learning.

Near optimal combination of sensory and motor uncertainty in time during a naturalistic perception-action task.

Most behavioral tasks have time constraints for successful completion, such as catching a ball in flight. Many of these tasks require trading off the time allocated to perception and action, especially when only one of the two is possible at any time. In general, the longer we perceive, the smaller the uncertainty in perceptual estimates. However, a longer perception phase leaves less time for action, which results in less precise movements. Here we examine subjects catching a virtual ball. Critically, as soon as subjects began to move, the ball became invisible. We study how subjects trade-off sensory and movement uncertainty by deciding when to initiate their actions. We formulate this task in a probabilistic framework and show that subjects' decisions when to start moving are statistically near optimal given their individual sensory and motor uncertainties. Moreover, we accurately predict individual subject's task performance. Thus we show that subjects in a natural task are quantitatively aware of how sensory and motor variability depend on time and act so as to minimize overall task variability.

Structure learning in a sensorimotor association task.

Learning is often understood as an organism's gradual acquisition of the association between a given sensory stimulus and the correct motor response. Mathematically, this corresponds to regressing a mapping between the set of observations and the set of actions. Recently, however, it has been shown both in cognitive and motor neuroscience that humans are not only able to learn particular stimulus-response mappings, but are also able to extract abstract structural invariants that facilitate generalization to novel tasks. Here we show how such structure learning can enhance facilitation in a sensorimotor association task performed by human subjects. Using regression and reinforcement learning models we show that the observed facilitation cannot be explained by these basic models of learning stimulus-response associations. We show, however, that the observed data can be explained by a hierarchical Bayesian model that performs structure learning. In line with previous results from cognitive tasks, this suggests that hierarchical Bayesian inference might provide a common framework to explain both the learning of specific stimulus-response associations and the learning of abstract structures that are shared by different task environments.

Marine Fisheries Stock Assessment Improvement Plan: report of the National Marine Fisheries Service National Task Force for Improving Fish Stock Assessments

This report argues for greatly increased resources in terms of data collection facilities and staff to collect, process, and analyze the data, and to communicate the results, in order for NMFS to fulfill its mandate to conserve and manage marine resources. In fact, the authors of this report had great difficulty defining the "ideal" situation to which fisheries stock assessments and management should aspire. One of the primary objectives of fisheries management is to develop sustainable harvest policies that minimize the risks of overfishing both target species and associated species. This can be achieved in a wide spectrum of ways, ranging between the following two extremes. The first is to implement only simple management measures with correspondingly simple assessment demands, which will usually mean setting fishing mortality targets at relatively low levels in order to reduce the risk of unknowingly overfishing or driving ecosystems towards undesirable system states. The second is to expand existing data collection and analysis programs to provide an adequate knowledge base that can support higher fishing mortality targets while still ensuring low risk to target and associated species and ecosystems. However, defining "adequate" is difficult, especially when scientists have not even identified all marine species, and information on catches, abundances, and life histories of many target species, and most associated species, is sparse. Increasing calls from the public, stakeholders, and the scientific community to implement ecosystem-based stock assessment and management make it even more difficult to define "adequate," especially when "ecosystem-based management" is itself not well-defined. In attempting to describe the data collection and assessment needs for the latter, the authors took a pragmatic approach, rather than trying to estimate the resources required to develop a knowledge base about the fine-scale detailed distributions, abundances, and associations of all marine species. Thus, the specified resource requirements will not meet the expectations of some stakeholders. In addition, the Stock Assessment Improvement Plan is designed to be complementary to other related plans, and therefore does not duplicate the resource requirements detailed in those plans, except as otherwise noted.

Risk sensitivity in a motor task with speed-accuracy trade-off.

When a racing driver steers a car around a sharp bend, there is a trade-off between speed and accuracy, in that high speed can lead to a skid whereas a low speed increases lap time, both of which can adversely affect the driver's payoff function. While speed-accuracy trade-offs have been studied extensively, their susceptibility to risk sensitivity is much less understood, since most theories of motor control are risk neutral with respect to payoff, i.e., they only consider mean payoffs and ignore payoff variability. Here we investigate how individual risk attitudes impact a motor task that involves such a speed-accuracy trade-off. We designed an experiment where a target had to be hit and the reward (given in points) increased as a function of both subjects' endpoint accuracy and endpoint velocity. As faster movements lead to poorer endpoint accuracy, the variance of the reward increased for higher velocities. We tested subjects on two reward conditions that had the same mean reward but differed in the variance of the reward. A risk-neutral account predicts that subjects should only maximize the mean reward and hence perform identically in the two conditions. In contrast, we found that some (risk-averse) subjects chose to move with lower velocities and other (risk-seeking) subjects with higher velocities in the condition with higher reward variance (risk). This behavior is suboptimal with regard to maximizing the mean number of points but is in accordance with a risk-sensitive account of movement selection. Our study suggests that individual risk sensitivity is an important factor in motor tasks with speed-accuracy trade-offs.

TOPS (Task optimization in the presence of signal-dependent noise) model

This paper proposes a movement trajectory planning model, which is a maximum task achievement model in which signal-dependent noise is added to the movement command. In the proposed model, two optimization criteria are combined, maximum task achievement and minimum energy consumption. The proposed model has the feature that the end-point boundary conditions for position, velocity, and acceleration need not be prespecified. Consequently, the method can be applied not only to the simple point-to-point movement, but to any task. In the method in this paper, the hand trajectory is derived by a psychophysical experiment and a numerical experiment for the case in which the target is not stationary, but is a moving region. It is shown that the trajectory predicted from the minimum jerk model or the minimum torque change model differs considerably from the results of the psychophysical experiment. But the trajectory predicted from the maximum task achievement model shows good qualitative agreement with the hand trajectory obtained from the psychophysical experiment. © 2004 Wiley Periodicals, Inc.

Speaker and noise factorisation on the AURORA4 task

For many realistic scenarios, there are multiple factors that affect the clean speech signal. In this work approaches to handling two such factors, speaker and background noise differences, simultaneously are described. A new adaptation scheme is proposed. Here the acoustic models are first adapted to the target speaker via an MLLR transform. This is followed by adaptation to the target noise environment via model-based vector Taylor series (VTS) compensation. These speaker and noise transforms are jointly estimated, using maximum likelihood. Experiments on the AURORA4 task demonstrate that this adaptation scheme provides improved performance over VTS-based noise adaptation. In addition, this framework enables the speech and noise to be factorised, allowing the speaker transform estimated in one noise condition to be successfully used in a different noise condition. © 2011 IEEE.

Reinforcement-related neurons in the primate basal forebrain respond to the learned significance of task events rather than to the hedonic attributes of reward

The objective of this study was to determine if the responses of basal forebrain neurons are related to the cognitive processes necessary for the performance of behavioural tasks, or to the hedonic attributes of the reinforcers delivered to the monkey as

Gender effect on the right-left discrimination task in a sample of heroin-dependent patients

Rationale: Discriminating right from left is an everyday cognitive ability. Repeated exposure to certain drugs, such as heroin, can produce poor performance on many cognitive tasks. However, it is yet unclear whether drug abuse impairs the ability of right-left discrimination. Objectives: The aim of the present study is to examine whether the spatial ability measured by the right-left discrimination task can be affected by heroin abuse and whether such drug effect, if it exists, is gender related. Methods: A paper-and-pen test was used. The test consists of line drawings of a person with no arm, one arm, or both arms crossing the vertical body axis of the figure. The line drawings are viewed from the back, from the front, or randomly alternating between the back and front drawings. The subjects task is to mark which is the right or left hand in the figure as fast as possible. Results: A main finding in this study was that the ability to discriminate between left and right in visual space was impaired in heroin-dependent patients. Especially, heroin-dependent females performed poorer than control females in all conditions but heroin-dependent males only performed poorly in part of conditions. Conclusions: Recent heroin abuse impairs the ability of right-left discrimination and such impairment is gender related: heroin-dependent females demonstrated greater performance deficits than males.