The Dorsolateral Periaqueductal Gray and Its Role in Mediating Fear Learning to Life Threatening Events

The dorsolateral column of the periaqueductal gray (dlPAG) integrates aversive emotional experiences and represents an important site responding to life threatening situations, such as hypoxia, cardiac pain and predator threats. Previous studies have shown that the dorsal PAG also supports fear learning; and we have currently explored how the dlPAG influences associative learning. We have first shown that N-methyl-D-aspartate (NMDA) 100 pmol injection in the dlPAG works as a valuable unconditioned stimulus (US) for the acquisition of olfactory fear conditioning (OFC) using amyl acetate odor as conditioned stimulus (CS). Next, we revisited the ascending projections of the dlPAG to the thalamus and hypothalamus to reveal potential paths that could mediate associative learning during OFC. Accordingly, the most important ascending target of the dlPAG is the hypothalamic defensive circuit, and we were able to show that pharmacological inactivation using beta-adrenoceptor blockade of the dorsal premammillary nucleus, the main exit way for the hypothalamic defensive circuit to thalamo-cortical circuits involved in fear learning, impaired the acquisition of the OFC promoted by NMDA stimulation of the dlPAG. Moreover, our tracing study revealed multiple parallel paths from the dlPAG to several thalamic targets linked to cortical-hippocampal-amygdalar circuits involved in fear learning. Overall, the results point to a major role of the dlPAG in the mediation of aversive associative learning via ascending projections to the medial hypothalamic defensive circuit, and perhaps, to other thalamic targets, as well. These results provide interesting perspectives to understand how life threatening events impact on fear learning, and should be useful to understand pathological fear memory encoding in anxiety disorders.

Non-Dominated Sorting Genetic Algorithm Based on Reinforcement Learning to Optimization of Broad-Band Reflector Antennas Satellite

This paper aims to provide an improved NSGA-II (Non-Dominated Sorting Genetic Algorithm-version II) which incorporates a parameter-free self-tuning approach by reinforcement learning technique, called Non-Dominated Sorting Genetic Algorithm Based on Reinforcement Learning (NSGA-RL). The proposed method is particularly compared with the classical NSGA-II when applied to a satellite coverage problem. Furthermore, not only the optimization results are compared with results obtained by other multiobjective optimization methods, but also guarantee the advantage of no time-spending and complex parameter tuning.

A dog at the keyboard: using arbitrary signs to communicate requests

As a consequence of domestication, dogs have a special readiness for communication with humans. We here investigate whether a dog might be able to acquire and consistently produce a set of arbitrary signs in her communication with humans, as was demonstrated in ""linguistic"" individuals of several species. A female mongrel dog was submitted to a training schedule in which, after basic command training and after acquiring the verbal labels of rewarding objects or activities, she learned to ask for such objects or activities by selecting lexigrams and pressing keys on a keyboard. Systematic records taken during spontaneous interaction with one of the experimenters showed that lexigrams were used in an appropriate, intentional way, in accordance with the immediate motivational context. The dog only utilized the keyboard in the experimenter`s presence and gazed to him more frequently after key pressing than before, an indication that lexigram use did have communicative content. Results suggest that dogs may be able to learn a conventional system of signs associated to specific objects and activities, functionally analogous to spontaneous soliciting behaviors and point to the potential fruitfulness of the keyboard/lexigram procedure for studying dog communication and cognition. This is the first report to systematically analyze the learning of arbitrary sign production in dogs.

Modelling shared attention through relational reinforcement learning

Shared attention is a type of communication very important among human beings. It is sometimes reserved for the more complex form of communication being constituted by a sequence of four steps: mutual gaze, gaze following, imperative pointing and declarative pointing. Some approaches have been proposed in Human-Robot Interaction area to solve part of shared attention process, that is, the most of works proposed try to solve the first two steps. Models based on temporal difference, neural networks, probabilistic and reinforcement learning are methods used in several works. In this article, we are presenting a robotic architecture that provides a robot or agent, the capacity of learning mutual gaze, gaze following and declarative pointing using a robotic head interacting with a caregiver. Three learning methods have been incorporated to this architecture and a comparison of their performance has been done to find the most adequate to be used in real experiment. The learning capabilities of this architecture have been analyzed by observing the robot interacting with the human in a controlled environment. The experimental results show that the robotic head is able to produce appropriate behavior and to learn from sociable interaction.

Motor learning, retention and transfer after virtual-reality-based training in Parkinson's disease - effect of motor and cognitive demands of games: a longitudinal, controlled clinical study

Objectives To evaluate the learning, retention and transfer of performance improvements after Nintendo Wii Fit (TM) training in patients with Parkinson's disease and healthy elderly people. Design Longitudinal, controlled clinical study. Participants Sixteen patients with early-stage Parkinson's disease and 11 healthy elderly people. Interventions Warm-up exercises and Wii Fit training that involved training motor (shifts centre of gravity and step alternation) and cognitive skills. A follow-up evaluative Wii Fit session was held 60 days after the end of training. Participants performed a functional reach test before and after training as a measure of learning transfer. Main outcome measures Learning and retention were determined based on the scores of 10 Wii Fit games over eight sessions. Transfer of learning was assessed after training using the functional reach test. Results Patients with Parkinson's disease showed no deficit in learning or retention on seven of the 10 games, despite showing poorer performance on five games compared with the healthy elderly group. Patients with Parkinson's disease showed marked learning deficits on three other games, independent of poorer initial performance. This deficit appears to be associated with cognitive demands of the games which require decision-making, response inhibition, divided attention and working memory. Finally, patients with Parkinson's disease were able to transfer motor ability trained on the games to a similar untrained task. Conclusions The ability of patients with Parkinson's disease to learn, retain and transfer performance improvements after training on the Nintendo Wii Fit depends largely on the demands, particularly cognitive demands, of the games involved, reiterating the importance of game selection for rehabilitation purposes. (C) 2012 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.