Curiosity driven reinforcement learning for motion planning on humanoids

Most previous work on artificial curiosity (AC) and intrinsic motivation focuses on basic concepts and theory. Experimental results are generally limited to toy scenarios, such as navigation in a simulated maze, or control of a simple mechanical system with one or two degrees of freedom. To study AC in a more realistic setting, we embody a curious agent in the complex iCub humanoid robot. Our novel reinforcement learning (RL) framework consists of a state-of-the-art, low-level, reactive control layer, which controls the iCub while respecting constraints, and a high-level curious agent, which explores the iCub's state-action space through information gain maximization, learning a world model from experience, controlling the actual iCub hardware in real-time. To the best of our knowledge, this is the first ever embodied, curious agent for real-time motion planning on a humanoid. We demonstrate that it can learn compact Markov models to represent large regions of the iCub's configuration space, and that the iCub explores intelligently, showing interest in its physical constraints as well as in objects it finds in its environment.

Early maternal deprivation reduces prepulse inhibition and impairs spatial learning ability in adulthood: No further effect of post-pubertal chronic corticosterone treatment

Prolonged maternal deprivation leads to long-term alterations in hypothalamic–pituitary–adrenal (HPA) axis activity, disturbances of auditory information processing and neurochemical changes in the adult brain, some of which are similar to that observed in schizophrenia. Here we report the adult behavioural effects of maternal deprivation (12 h on postnatal days 9 and 11) in Wistar rats on paradigms of auditory information processing (prepulse inhibition), sensitivity to dopamimetics (amphetamine-induced hyper-locomotion) and cognition (T-maze delayed alternation and Morris water-maze). In addition, we examined the long-lasting effect of chronic 21-day corticosterone treatment during the post-pubertal period (i.e., postnatal days 56–76) on each of these behavioural paradigms in maternally deprived and control rats. Behavioural testing commenced 2 weeks after the termination of corticosterone treatment. Maternal deprivation led to a significant reduction in PPI and impaired spatial learning ability in adulthood, but did not affect the behavioural response to amphetamine. Post-pubertal chronic corticosterone treatment did not have any major long-lasting effects on any of the behavioural measures in either maternally deprived or control rats. Our findings further support maternal deprivation as an animal model of specific aspects of schizophrenia.