Predictive coding and the slowness principle: an information-theoretic approach.

Understanding the guiding principles of sensory coding strategies is a main goal in computational neuroscience. Among others, the principles of predictive coding and slowness appear to capture aspects of sensory processing. Predictive coding postulates that sensory systems are adapted to the structure of their input signals such that information about future inputs is encoded. Slow feature analysis (SFA) is a method for extracting slowly varying components from quickly varying input signals, thereby learning temporally invariant features. Here, we use the information bottleneck method to state an information-theoretic objective function for temporally local predictive coding. We then show that the linear case of SFA can be interpreted as a variant of predictive coding that maximizes the mutual information between the current output of the system and the input signal in the next time step. This demonstrates that the slowness principle and predictive coding are intimately related.

Foresight vehicle programme - Customer understanding processes in design

Customer feedback is normally fed into product design and engineering via quality surveys and therefore mainly comprises negative comments: complaints about things gone wrong. Whilst eradication of such problems will result in a feeling of satisfaction in existing customers, it will not instil the sense of delight required to attract conquest buyers. CUPID's aim is to conceive and evaluate ideas to stimulate product desirability through the provision of delightful features and execution. By definition, surprise and delight features cannot be foreseen, so we have to understand sensory appeal and, therefore, the "hidden" voice of the customer. Copyright © 2002 Society of Automotive Engineers, Inc.

Control of bimanual rhythmic movements: Trading efficiency for robustness depending on the context

This paper investigates how the efficiency and robustness of a skilled rhythmic task compete against each other in the control of a bimanual movement. Human subjects juggled a puck in 2D through impacts with two metallic arms, requiring rhythmic bimanual actuation. The arms kinematics were only constrained by the position, velocity and time of impacts while the rest of the trajectory did not influence the movement of the puck. In order to expose the task robustness, we manipulated the task context in two distinct manners: the task tempo was assigned at four different values (hence manipulating the time available to plan and execute each impact movement individually); and vision was withdrawn during half of the trials (hence reducing the sensory inflows). We show that when the tempo was fast, the actuation was rhythmic (no pause in the trajectory) while at slow tempo, the actuation was discrete (with pause intervals between individual movements). Moreover, the withdrawal of visual information encouraged the rhythmic behavior at the four tested tempi. The discrete versus rhythmic behavior give different answers to the efficiency/robustness trade-off: discrete movements result in energy efficient movements, while rhythmic movements impact the puck with negative acceleration, a property preserving robustness. Moreover, we report that in all conditions the impact velocity of the arms was negatively correlated with the energy of the puck. This correlation tended to stabilize the task and was influenced by vision, revealing again different control strategies. In conclusion, this task involves different modes of control that balance efficiency and robustness, depending on the context. © 2008 Springer-Verlag.

Robotics and neuroscience: A rhythmic interaction

At the crossing between motor control neuroscience and robotics system theory, the paper presents a rhythmic experiment that is amenable both to handy laboratory implementation and simple mathematical modeling. The experiment is based on an impact juggling task, requiring the coordination of two upper-limb effectors and some phase-locking with the trajectories of one or several juggled objects. We describe the experiment, its implementation and the mathematical model used for the analysis. Our underlying research focuses on the role of sensory feedback in rhythmic tasks. In a robotic implementation of our experiment, we study the minimum feedback that is required to achieve robust control. A limited source of feedback, measuring only the impact times, is shown to give promising results. A second field of investigation concerns the human behavior in the same impact juggling task. We study how a variation of the tempo induces a transition between two distinct control strategies with different sensory feedback requirements. Analogies and differences between the robotic and human behaviors are obviously of high relevance in such a flexible setup. © 2008 Elsevier Ltd. All rights reserved.

Timing feedback control of a rhythmic system

This paper addresses the question relative to the role of sensory feedback in rhythmic tasks. We study the properties of a sinusoidally vibrating wedge-billiard as a model for 2-D bounce juggling. If this wedge is actuated with an harmonic sinusoidal input, it has been shown that some periodic orbits are exponentially stable. This paper explores an intuitive method to enlarge the parametric stability region of the simplest of these orbits. Accurate processing of timing is proven to be an important key to achieve frequency-locking in rhythmic tasks. © 2005 IEEE.

Motor control is decision-making

© 2012 Elsevier Ltd. Motor behavior may be viewed as a problem of maximizing the utility of movement outcome in the face of sensory, motor and task uncertainty. Viewed in this way, and allowing for the availability of prior knowledge in the form of a probability distribution over possible states of the world, the choice of a movement plan and strategy for motor control becomes an application of statistical decision theory. This point of view has proven successful in recent years in accounting for movement under risk, inferring the loss function used in motor tasks, and explaining motor behavior in a wide variety of circumstances.

Motor effort alters changes of mind in sensorimotor decision making.

After committing to an action, a decision-maker can change their mind to revise the action. Such changes of mind can even occur when the stream of information that led to the action is curtailed at movement onset. This is explained by the time delays in sensory processing and motor planning which lead to a component at the end of the sensory stream that can only be processed after initiation. Such post-initiation processing can explain the pattern of changes of mind by asserting an accumulation of additional evidence to a criterion level, termed change-of-mind bound. Here we test the hypothesis that physical effort associated with the movement required to change one's mind affects the level of the change-of-mind bound and the time for post-initiation deliberation. We varied the effort required to change from one choice target to another in a reaching movement by varying the geometry of the choice targets or by applying a force field between the targets. We show that there is a reduction in the frequency of change of mind when the separation of the choice targets would require a larger excursion of the hand from the initial to the opposite choice. The reduction is best explained by an increase in the evidence required for changes of mind and a reduced time period of integration after the initial decision. Thus the criteria to revise an initial choice is sensitive to energetic costs.

A dedicated binding mechanism for the visual control of movement.

The human motor system is remarkably proficient in the online control of visually guided movements, adjusting to changes in the visual scene within 100 ms [1-3]. This is achieved through a set of highly automatic processes [4] translating visual information into representations suitable for motor control [5, 6]. For this to be accomplished, visual information pertaining to target and hand need to be identified and linked to the appropriate internal representations during the movement. Meanwhile, other visual information must be filtered out, which is especially demanding in visually cluttered natural environments. If selection of relevant sensory information for online control was achieved by visual attention, its limited capacity [7] would substantially constrain the efficiency of visuomotor feedback control. Here we demonstrate that both exogenously and endogenously cued attention facilitate the processing of visual target information [8], but not of visual hand information. Moreover, distracting visual information is more efficiently filtered out during the extraction of hand compared to target information. Our results therefore suggest the existence of a dedicated visuomotor binding mechanism that links the hand representation in visual and motor systems.

Minimalistic control of biped walking in rough terrain

Toward our comprehensive understanding of legged locomotion in animals and machines, the compass gait model has been intensively studied for a systematic investigation of complex biped locomotion dynamics. While most of the previous studies focused only on the locomotion on flat surfaces, in this article, we tackle with the problem of bipedal locomotion in rough terrains by using a minimalistic control architecture for the compass gait walking model. This controller utilizes an open-loop sinusoidal oscillation of hip motor, which induces basic walking stability without sensory feedback. A set of simulation analyses show that the underlying mechanism lies in the "phase locking" mechanism that compensates phase delays between mechanical dynamics and the open-loop motor oscillation resulting in a relatively large basin of attraction in dynamic bipedal walking. By exploiting this mechanism, we also explain how the basin of attraction can be controlled by manipulating the parameters of oscillator not only on a flat terrain but also in various inclined slopes. Based on the simulation analysis, the proposed controller is implemented in a real-world robotic platform to confirm the plausibility of the approach. In addition, by using these basic principles of self-stability and gait variability, we demonstrate how the proposed controller can be extended with a simple sensory feedback such that the robot is able to control gait patterns autonomously for traversing a rough terrain. © 2010 Springer Science+Business Media, LLC.

Toward a human-like biped robot with compliant legs

Conventional models of bipedal walking generally assume rigid body structures, while elastic material properties seem to play an essential role in nature. On the basis of a novel theoretical model of bipedal walking, this paper investigates a model of biped robot which makes use of minimum control and elastic passive joints inspired from the structures of biological systems. The model is evaluated in simulation and a physical robotic platform by analyzing the kinematics and ground reaction force. The experimental results show that, with a proper leg design of passive dynamics and elasticity, an attractor state of human-like walking gait patterns can be achieved through extremely simple control without sensory feedback. The detailed analysis also explains how the dynamic human-like gait can contribute to adaptive biped walking. © 2007 Elsevier B.V. All rights reserved.

Self-organization of reflexive behavior from spontaneous motor activity.

In mammals, the development of reflexes is often regarded as an innate process. However, recent findings show that fetuses are endowed with favorable conditions for ontogenetic development. In this article, we hypothesize that the circuitry of at least some mammalian reflexes can be self-organized from the sensory and motor interactions brought forth in a musculoskeletal system. We focus mainly on three reflexes: the myotatic reflex, the reciprocal inhibition reflex, and the reverse myotatic reflex. To test our hypothesis, we conducted a set of experiments on a simulated musculoskeletal system using pairs of agonist and antagonist muscles. The reflex connectivity is obtained by producing spontaneous motor activity in each muscle and by correlating the resulting sensor and motor signals. Our results show that, under biologically plausible conditions, the reflex circuitry thus obtained is consistent with that identified in relation to the analogous mammalian reflexes. In addition, they show that the reflex connectivity obtained depends on the morphology of the musculoskeletal system as well as on the environment that it is embedded in.

Hopping robot based on free vibration of an elastic curved beam

This study presents a novel approach to the design of low-cost and energy-efficient hopping robots, which makes use of free vibration of an elastic curved beam. We found that a hopping robot could benefit from an elastic curved beam in many ways such as low manufacturing cost, light body weight and small energy dissipation in mechanical interactions. A challenging problem of this design strategy, however, lies in harnessing the mechanical dynamics of free vibration in the elastic curved beam: because the free vibration is the outcome of coupled mechanical dynamics between actuation and mechanical structures, it is not trivial to systematically design mechanical structures and control architectures for stable locomotion. From this perspective, this paper investigates a case study of simple hopping robot to identify the design principles of mechanics and control. We developed a hopping robot consisting of an elastic curved beam and a small rotating mass, which was then modeled and analyzed in simulation. The experimental results show that the robot is capable of exhibiting stable hopping gait patterns by using a small actuation with no sensory feedback owing to the intrinsic stability of coupled mechanical dynamics. Furthermore, an additional analysis shows that, by exploiting free vibration of the elastic curved beam, cost of transport of the proposed hopping locomotion can be in the same rage of animals' locomotion including human running. © 2011 IEEE.

New robotics: design principles for intelligent systems.

New robotics is an approach to robotics that, in contrast to traditional robotics, employs ideas and principles from biology. While in the traditional approach there are generally accepted methods (e. g., from control theory), designing agents in the new robotics approach is still largely considered an art. In recent years, we have been developing a set of heuristics, or design principles, that on the one hand capture theoretical insights about intelligent (adaptive) behavior, and on the other provide guidance in actually designing and building systems. In this article we provide an overview of all the principles but focus on the principles of ecological balance, which concerns the relation between environment, morphology, materials, and control, and sensory-motor coordination, which concerns self-generated sensory stimulation as the agent interacts with the environment and which is a key to the development of high-level intelligence. As we argue, artificial evolution together with morphogenesis is not only "nice to have" but is in fact a necessary tool for designing embodied agents.

Twitching in sensorimotor development from sleeping rats to robots.

It is still not known how the 'rudimentary' movements of fetuses and infants are transformed into the coordinated, flexible and adaptive movements of adults. In addressing this important issue, we consider a behavior that has been perennially viewed as a functionless by-product of a dreaming brain: the jerky limb movements called myoclonic twitches. Recent work has identified the neural mechanisms that produce twitching as well as those that convey sensory feedback from twitching limbs to the spinal cord and brain. In turn, these mechanistic insights have helped inspire new ideas about the functional roles that twitching might play in the self-organization of spinal and supraspinal sensorimotor circuits. Striking support for these ideas is coming from the field of developmental robotics: when twitches are mimicked in robot models of the musculoskeletal system, the basic neural circuitry undergoes self-organization. Mutually inspired biological and synthetic approaches promise not only to produce better robots, but also to solve fundamental problems concerning the developmental origins of sensorimotor maps in the spinal cord and brain.

Learning legged locomotion

Legged locomotion of biological systems can be viewed as a self-organizing process of highly complex system-environment interactions. Walking behavior is, for example, generated from the interactions between many mechanical components (e.g., physical interactions between feet and ground, skeletons and muscle-tendon systems), and distributed informational processes (e.g., sensory information processing, sensory-motor control in central nervous system, and reflexes) [21]. An interesting aspect of legged locomotion study lies in the fact that there are multiple levels of self-organization processes (at the levels of mechanical dynamics, sensory-motor control, and learning). Previously, the self-organization of mechanical dynamics was nicely demonstrated by the so-called Passive Dynamic Walkers (PDWs; [18]). The PDW is a purely mechanical structure consisting of body, thigh, and shank limbs that are connected by passive joints. When placed on a shallow slope, it exhibits natural bipedal walking dynamics by converting potential to kinetic energy without any actuation. An important contribution of these case studies is that, if designed properly, mechanical dynamics can generate a relatively complex locomotion dynamics, on the one hand, and the mechanical dynamics induces self-stability against small disturbances without any explicit control of motors, on the other. The basic principle of the mechanical self-stability appears to be fairly general that there are several different physics models that exhibit similar characteristics in different kinds of behaviors (e.g., hopping, running, and swimming; [2, 4, 9, 16, 19]), and a number of robotic platforms have been developed based on them [1, 8, 13, 22]. © 2009 Springer London.