Reinforcement-related neurons in the primate basal forebrain respond to the learned significance of task events rather than to the hedonic attributes of reward

The objective of this study was to determine if the responses of basal forebrain neurons are related to the cognitive processes necessary for the performance of behavioural tasks, or to the hedonic attributes of the reinforcers delivered to the monkey as

Gender effect on the right-left discrimination task in a sample of heroin-dependent patients

Rationale: Discriminating right from left is an everyday cognitive ability. Repeated exposure to certain drugs, such as heroin, can produce poor performance on many cognitive tasks. However, it is yet unclear whether drug abuse impairs the ability of right-left discrimination. Objectives: The aim of the present study is to examine whether the spatial ability measured by the right-left discrimination task can be affected by heroin abuse and whether such drug effect, if it exists, is gender related. Methods: A paper-and-pen test was used. The test consists of line drawings of a person with no arm, one arm, or both arms crossing the vertical body axis of the figure. The line drawings are viewed from the back, from the front, or randomly alternating between the back and front drawings. The subjects task is to mark which is the right or left hand in the figure as fast as possible. Results: A main finding in this study was that the ability to discriminate between left and right in visual space was impaired in heroin-dependent patients. Especially, heroin-dependent females performed poorer than control females in all conditions but heroin-dependent males only performed poorly in part of conditions. Conclusions: Recent heroin abuse impairs the ability of right-left discrimination and such impairment is gender related: heroin-dependent females demonstrated greater performance deficits than males.

Effects of exposure to 50 Hz magnetic field of 1 mT on the performance of detour learning task by chicks

In the present study, we examined the effects of exposure to an extremely low-frequency magnetic field of 1 mT intensity on learning and memory in Lohmann brown domestic chicks using detour learning task. These results show that 20 h/day exposure to a low

The stress experience dependent long-term depression disassociated with stress effect on spatial memory task

Behavioral stress can either block or facilitate memory and affect the induction of long-term potentiation (LTP) and long-term depression (LTD). However, the relevance of the stress experience-dependent long-term depression (SLTD) to spatial memory task is unknown. Here we have investigated the effects of acute and sub-acute elevated platform (EP) and foot shock (FS) stress on LTD induction in CA1 region of the hippocampus of anesthetized rats and spatial memory in Morris water maze. We found that LTD was facilitated by acute EP stress, but not by sub-acute EP stress that may be due to the fast adaptation of the animals to this naturalistic mild stress. However, FS stress, an inadaptable strong stress, facilitated LTD induction both in acute and sub-acute treatment. In addition, with the same stress protocols, acute EP stress impaired spatial memory but the sub-acute EP stressed animals performed the spatial memory task as well as the controls, may due to the same reason of adaptation. However, acute FS stress slightly impaired learning but sub-acute FS even enhanced memory retrieval. Our results showed that SLTD was disassociated with the effect of stress on memory task but might be related to stress experience-dependent form of aberrant memory. (C) 2003 Elsevier Science Ireland Ltd. and the Japan Neuroscience Society. All rights reserved.

Task-dependent coordination of rapid bimanual motor responses.

Optimal feedback control postulates that feedback responses depend on the task relevance of any perturbations. We test this prediction in a bimanual task, conceptually similar to balancing a laden tray, in which each hand could be perturbed up or down. Single-limb mechanical perturbations produced long-latency reflex responses ("rapid motor responses") in the contralateral limb of appropriate direction and magnitude to maintain the tray horizontal. During bimanual perturbations, rapid motor responses modulated appropriately depending on the extent to which perturbations affected tray orientation. Specifically, despite receiving the same mechanical perturbation causing muscle stretch, the strongest responses were produced when the contralateral arm was perturbed in the opposite direction (large tray tilt) rather than in the same direction or not perturbed at all. Rapid responses from shortening extensors depended on a nonlinear summation of the sensory information from the arms, with the response to a bimanual same-direction perturbation (orientation maintained) being less than the sum of the component unimanual perturbations (task relevant). We conclude that task-dependent tuning of reflexes can be modulated online within a single trial based on a complex interaction across the arms.

Evaluating the impacts of iteration on PD processes by transforming task network models into System Dynamics models

Iteration is unavoidable in the design process and should be incorporated when planning and managing projects in order to minimize surprises and reduce schedule distortions. However, planning and managing iteration is challenging because the relationships between its causes and effects are complex. Most approaches which use mathematical models to analyze the impact of iteration on the design process focus on a relatively small number of its causes and effects. Therefore, insights derived from these analytical models may not be robust under a broader consideration of potential influencing factors. In this article, we synthesize an explanatory framework which describes the network of causes and effects of iteration identified from the literature, and introduce an analytic approach which combines a task network modeling approach with System Dynamics simulation. Our approach models the network of causes and effects of iteration alongside the process architecture which is required to analyze the impact of iteration on design process performance. We show how this allows managers to assess the impact of changes to process architecture and to management levers which influence iterative behavior, accounting for the fact that these changes can occur simultaneously and can accumulate in non-linear ways. We also discuss how the insights resulting from this analysis can be visualized for easier consumption by project participants not familiar with simulation methods. Copyright © 2010 by ASME.

Facilitation of learning induced by both random and gradual visuomotor task variation.

Motor task variation has been shown to be a key ingredient in skill transfer, retention, and structural learning. However, many studies only compare training of randomly varying tasks to either blocked or null training, and it is not clear how experiencing different nonrandom temporal orderings of tasks might affect the learning process. Here we study learning in human subjects who experience the same set of visuomotor rotations, evenly spaced between -60° and +60°, either in a random order or in an order in which the rotation angle changed gradually. We compared subsequent learning of three test blocks of +30°→-30°→+30° rotations. The groups that underwent either random or gradual training showed significant (P < 0.01) facilitation of learning in the test blocks compared with a control group who had not experienced any visuomotor rotations before. We also found that movement initiation times in the random group during the test blocks were significantly (P < 0.05) lower than for the gradual or the control group. When we fit a state-space model with fast and slow learning processes to our data, we found that the differences in performance in the test block were consistent with the gradual or random task variation changing the learning and retention rates of only the fast learning process. Such adaptation of learning rates may be a key feature of ongoing meta-learning processes. Our results therefore suggest that both gradual and random task variation can induce meta-learning and that random learning has an advantage in terms of shorter initiation times, suggesting less reliance on cognitive processes.

Film bulk acoustic resonator nanosensors for multi-task sensing

This paper shows that film bulk acoustic resonator (FBAR) arrays can be very useful sensors either to detect physical parameters such as temperature and pressure directly or to detect bio-chemicals with extremely high sensitivities by incorporating a chemisorption layer or bio-probe molecules. Furthermore, it also shows that surface acoustic wave devices can be integrated with a FBAR sensor array on the same piezoelectric substrate as the microfluidics systems to perform transportation and mixing of biosamples etc. demonstrating the possibility to fabricate integrated lab-on-a-chip detection systems, in which all the actuators and sensors are operated by acoustic wave devices. This makes the detection system simple, low cost and easy to operate and hence has great commercial potential. © 2011 Inderscience Enterprises Ltd.

Task-level control of the lateral leg spring model of cockroach locomotion

The Lateral Leg Spring model (LLS) was developed by Schmitt and Holmes to model the horizontal-plane dynamics of a running cockroach. The model captures several salient features of real insect locomotion, and demonstrates that horizontal plane locomotion can be passively stabilized by a well-tuned mechanical system, thus requiring minimal neural reflexes. We propose two enhancements to the LLS model. First, we derive the dynamical equations for a more flexible placement of the center of pressure (COP), which enables the model to capture the phase relationship between the body orientation and center-of-mass (COM) heading in a simpler manner than previously possible. Second, we propose a reduced LLS "plant model" and biologically inspired control law that enables the model to follow along a virtual wall, much like antenna-based wall following in cockroaches. © 2006 Springer.

Beyond dataset bias: Multi-task unaligned shared knowledge transfer

Many visual datasets are traditionally used to analyze the performance of different learning techniques. The evaluation is usually done within each dataset, therefore it is questionable if such results are a reliable indicator of true generalization ability. We propose here an algorithm to exploit the existing data resources when learning on a new multiclass problem. Our main idea is to identify an image representation that decomposes orthogonally into two subspaces: a part specific to each dataset, and a part generic to, and therefore shared between, all the considered source sets. This allows us to use the generic representation as un-biased reference knowledge for a novel classification task. By casting the method in the multi-view setting, we also make it possible to use different features for different databases. We call the algorithm MUST, Multitask Unaligned Shared knowledge Transfer. Through extensive experiments on five public datasets, we show that MUST consistently improves the cross-datasets generalization performance. © 2013 Springer-Verlag.

Dopamine and performance in a reinforcement learning task: evidence from Parkinson's disease.

The role dopamine plays in decision-making has important theoretical, empirical and clinical implications. Here, we examined its precise contribution by exploiting the lesion deficit model afforded by Parkinson's disease. We studied patients in a two-stage reinforcement learning task, while they were ON and OFF dopamine replacement medication. Contrary to expectation, we found that dopaminergic drug state (ON or OFF) did not impact learning. Instead, the critical factor was drug state during the performance phase, with patients ON medication choosing correctly significantly more frequently than those OFF medication. This effect was independent of drug state during initial learning and appears to reflect a facilitation of generalization for learnt information. This inference is bolstered by our observation that neural activity in nucleus accumbens and ventromedial prefrontal cortex, measured during simultaneously acquired functional magnetic resonance imaging, represented learnt stimulus values during performance. This effect was expressed solely during the ON state with activity in these regions correlating with better performance. Our data indicate that dopamine modulation of nucleus accumbens and ventromedial prefrontal cortex exerts a specific effect on choice behaviour distinct from pure learning. The findings are in keeping with the substantial other evidence that certain aspects of learning are unaffected by dopamine lesions or depletion, and that dopamine plays a key role in performance that may be distinct from its role in learning.

Dopamine and performance in a reinforcement learning task: Evidence from Parkinson's disease

The role dopamine plays in decision-making has important theoretical, empirical and clinical implications. Here, we examined its precise contribution by exploiting the lesion deficit model afforded by Parkinson's disease. We studied patients in a two-stage reinforcement learning task, while they were ON and OFF dopamine replacement medication. Contrary to expectation, we found that dopaminergic drug state (ON or OFF) did not impact learning. Instead, the critical factor was drug state during the performance phase, with patients ON medication choosing correctly significantly more frequently than those OFF medication. This effect was independent of drug state during initial learning and appears to reflect a facilitation of generalization for learnt information. This inference is bolstered by our observation that neural activity in nucleus accumbens and ventromedial prefrontal cortex, measured during simultaneously acquired functional magnetic resonance imaging, represented learnt stimulus values during performance. This effect was expressed solely during the ON state with activity in these regions correlating with better performance. Our data indicate that dopamine modulation of nucleus accumbens and ventromedial prefrontal cortex exerts a specific effect on choice behaviour distinct from pure learning. The findings are in keeping with the substantial other evidence that certain aspects of learning are unaffected by dopamine lesions or depletion, and that dopamine plays a key role in performance that may be distinct from its role in learning. © 2012 The Author.