Learning legged locomotion

Legged locomotion of biological systems can be viewed as a self-organizing process of highly complex system-environment interactions. Walking behavior is, for example, generated from the interactions between many mechanical components (e.g., physical interactions between feet and ground, skeletons and muscle-tendon systems), and distributed informational processes (e.g., sensory information processing, sensory-motor control in central nervous system, and reflexes) [21]. An interesting aspect of legged locomotion study lies in the fact that there are multiple levels of self-organization processes (at the levels of mechanical dynamics, sensory-motor control, and learning). Previously, the self-organization of mechanical dynamics was nicely demonstrated by the so-called Passive Dynamic Walkers (PDWs; [18]). The PDW is a purely mechanical structure consisting of body, thigh, and shank limbs that are connected by passive joints. When placed on a shallow slope, it exhibits natural bipedal walking dynamics by converting potential to kinetic energy without any actuation. An important contribution of these case studies is that, if designed properly, mechanical dynamics can generate a relatively complex locomotion dynamics, on the one hand, and the mechanical dynamics induces self-stability against small disturbances without any explicit control of motors, on the other. The basic principle of the mechanical self-stability appears to be fairly general that there are several different physics models that exhibit similar characteristics in different kinds of behaviors (e.g., hopping, running, and swimming; [2, 4, 9, 16, 19]), and a number of robotic platforms have been developed based on them [1, 8, 13, 22]. © 2009 Springer London.

Finding resonance: Adaptive frequency oscillators for dynamic legged locomotion

There is much to gain from providing walking machines with passive dynamics, e.g. by including compliant elements in the structure. These elements can offer interesting properties such as self-stabilization, energy efficiency and simplified control. However, there is still no general design strategy for such robots and their controllers. In particular, the calibration of control parameters is often complicated because of the highly nonlinear behavior of the interactions between passive components and the environment. In this article, we propose an approach in which the calibration of a key parameter of a walking controller, namely its intrinsic frequency, is done automatically. The approach uses adaptive frequency oscillators to automatically tune the intrinsic frequency of the oscillators to the resonant frequency of a compliant quadruped robot The tuning goes beyond simple synchronization and the learned frequency stays in the controller when the robot is put to halt. The controller is model free, robust and simple. Results are presented illustrating how the controller can robustly tune itself to the robot, as well as readapt when the mass of the robot is changed. We also provide an analysis of the convergence of the frequency adaptation for a linearized plant, and show how that analysis is useful for determining which type of sensory feedback must be used for stable convergence. This approach is expected to explain some aspects of developmental processes in biological and artificial adaptive systems that "develop" through the embodied system-environment interactions. © 2006 IEEE.

Motor control optimization of compliant one-legged locomotion in rough terrain

While underactuated robotic systems are capable of energy efficient and rapid dynamic behavior, we still do not fully understand how body dynamics can be actively used for adaptive behavior in complex unstructured environment. In particular, we can expect that the robotic systems could achieve high maneuverability by flexibly storing and releasing energy through the motor control of the physical interaction between the body and the environment. This paper presents a minimalistic optimization strategy of motor control policy for underactuated legged robotic systems. Based on a reinforcement learning algorithm, we propose an optimization scheme, with which the robot can exploit passive elasticity for hopping forward while maintaining the stability of locomotion process in the environment with a series of large changes of ground surface. We show a case study of a simple one-legged robot which consists of a servomotor and a passive elastic joint. The dynamics and learning performance of the robot model are tested in simulation, and then transferred the results to the real-world robot. ©2007 IEEE.

One-legged locomotion with a compliant passive joint

There is an increasing attention of exploiting compliant materials for the purpose of legged locomotion, because they provide significant advantages in locomotion performance with respect to energy efficiency and stability. Toward establishing a fundamental basis for this line of research, a minimalistic locomotion model of a single legged system is explored in this paper. By analyzing the dynamic behavior of the system in simulation and a physical robotic platform, it is shown that a stable locomotion process can be achieved without the necessity of sensory feedback. In addition, further analysis characterizes the relation between motor control and the natural body dynamics determined by morphological properties such as body mass and spring constant. © 2006 The authors.

Dynamically Stable Legged Locomotion (September 1985-Septembers1989)

This report documents our work in exploring active balance for dynamic legged systems for the period from September 1985 through September 1989. The purpose of this research is to build a foundation of knowledge that can lead both to the construction of useful legged vehicles and to a better understanding of animal locomotion. In this report we focus on the control of biped locomotion, the use of terrain footholds, running at high speed, biped gymnastics, symmetry in running, and the mechanical design of articulated legs.

A literature review on the optimization of legged robots

Over the last two decades the research and development of legged locomotion robots has grown steadily. Legged systems present major advantages when compared with ‘traditional’ vehicles, because they allow locomotion in inaccessible terrain to vehicles with wheels and tracks. However, the robustness of legged robots, and especially their energy consumption, among other aspects, still lag behind mechanisms that use wheels and tracks. Therefore, in the present state of development, there are several aspects that need to be improved and optimized. Keeping these ideas in mind, this paper presents the review of the literature of different methods adopted for the optimization of the structure and locomotion gaits of walking robots. Among the distinct possible strategies often used for these tasks are referred approaches such as the mimicking of biological animals, the use of evolutionary schemes to find the optimal parameters and structures, the adoption of sound mechanical design rules, and the optimization of power-based indexes.

Resonance based multi-gaited robot locomotion

In order to understand the underlying mechanisms of animals' agility, dexterity and efficiency in motor control, there has been an increasing interest in the study of gait patterns in biological and artificial legged systems. This paper presents a novel approach to the study of gait patterns which makes use of intrinsic mechanical dynamics of robotic systems. Each of these robots consists of a U-shape elastic beam and exploits free vibration to generate different gait patterns. We developed a conceptual model for these robots, and through simulation and real-world experiments, we show three distinct mechanisms for generating four different gait patterns in these robots. © 2012 IEEE.

Impedance control for legged robots: an insight into the concepts involved

The application of impedance control strategies to modern legged locomotion is analyzed, paying special attention to the concepts behind its implementation which is not straightforward. In order to implement a functional impedance controller for a walking mechanism, the concepts of contact, impact, friction, and impedance have to be merged together. A literature review and a comprehensive analysis are presented compiling all these concepts along with a discussion on position-based versus force-based impedance control approaches, and a theoretical model of a robotic leg in contact with its environment is introduced. A theoretical control scheme for the legs of a general legged robot is also introduced, and some simulations results are presented.

Biologically inspired joint control for a humanoid robot

The GuRoo is a 1.2 m tall, 23 degree of freedom humanoid constructed at the University of Queensland for research into humanoid robotics. The key challenge being addressed by the GuRoo project is the development of appropriate learning strategies for control and coordination of the robot's many joints. The development of learning strategies is seen as a way to side-step the inherent intricacy of modeling a multi-DOF biped robot. This paper outlines the approach taken to generate an appropriate control scheme for the joints of the GuRoo. The paper demonstrates the determination of local feedback control parameters using a genetic algorithm. The feedback loop is then augmented by a predictive modulator that learns a form of feed-forward control to overcome the irregular loads experienced at each joint during the gait cycle. The predictive modulator is based on the CMAC architecture. Results from tests on the GuRoo platform show that both systems provide improvements in stability and tracking of joint control.

A novel energy efficient controllable stiffness joint

Achieving energy efficient legged locomotion is an important goal for the future of robot mobility. This paper presents a novel joint for legged locomotion that is energy efficient for two reasons. The first reason is the configuration of the elastic elements and actuator which we show analytically has lower energy losses than the typical arrangement. The second is that the joint stiffness, and hence stance duration, is controllable without requiring any energy from the actuator. Further, the joint stiffness can be changed significantly during the flight phase, from zero to highly rigid. Results obtained from a prototype hopper, demonstrate that the joint allows continuous and peak hopping via torque control. The results also demonstrate that the hopping frequency can be varied between 2.2Hz and 4.6Hz with associated stance duration of between 0.35 and 0.15 seconds.

Dragline modelling and control

Electric walking draglines are physically large and powerful machines used in the mining industry. However with the addition of suitable sensors and a controller a dragline can be considered as a numerically controlled machine or robot which can then perform parts of the operating cycle automatically. This paper presents an analysis of the electromechanical system necessary precursor to automatic control

Minimalistic control of biped walking in rough terrain

Toward our comprehensive understanding of legged locomotion in animals and machines, the compass gait model has been intensively studied for a systematic investigation of complex biped locomotion dynamics. While most of the previous studies focused only on the locomotion on flat surfaces, in this article, we tackle with the problem of bipedal locomotion in rough terrains by using a minimalistic control architecture for the compass gait walking model. This controller utilizes an open-loop sinusoidal oscillation of hip motor, which induces basic walking stability without sensory feedback. A set of simulation analyses show that the underlying mechanism lies in the "phase locking" mechanism that compensates phase delays between mechanical dynamics and the open-loop motor oscillation resulting in a relatively large basin of attraction in dynamic bipedal walking. By exploiting this mechanism, we also explain how the basin of attraction can be controlled by manipulating the parameters of oscillator not only on a flat terrain but also in various inclined slopes. Based on the simulation analysis, the proposed controller is implemented in a real-world robotic platform to confirm the plausibility of the approach. In addition, by using these basic principles of self-stability and gait variability, we demonstrate how the proposed controller can be extended with a simple sensory feedback such that the robot is able to control gait patterns autonomously for traversing a rough terrain. © 2010 Springer Science+Business Media, LLC.

Preloaded hopping with linear multi-modal actuation

For more dexterous and agile legged robot locomotion, alternative actuation has been one of the most long-awaited technologies. The goal of this paper is to investigate the use of newly developed actuator, the so-called Linear Multi-Modal Actuator (LMMA), in the context of legged robot locomotion, and analyze the behavioral performance of it. The LMMA consists of three discrete couplings which enable the system to switch between different mechanical dynamics such as instantaneous switches between series elastic and fully actuated dynamics. To test this actuator for legged locomotion, this paper introduces a one-legged robot platform we developed to implement the actuator, and explains a novel control strategy for hopping, i.e. 'preloaded hopping control'. This control strategy takes advantage of the coupling mechanism of the LMMA to preload the series elasticity during the flight phase to improve the energy efficiency of hopping locomotion. This paper shows a series of experimental results that compare the control strategy with a simple sinusoidal actuation strategy to discuss the benefits and challenges of the proposed approach. © 2013 IEEE.

Bipedal walking and running with compliant legs

Passive dynamics plays an important role in legged locomotion of the biological systems. The use of passive dynamics provides a number of advantages in legged locomotion such as energy efficiency, self-stabilization against disturbances, and generating gait patterns and behavioral diversity. Inspired from the theoretical and experimental studies in biomechanics, this paper presents a novel bipedal locomotion model for walking and running behavior which uses compliant legs. This model consists of three-segment legs, two servomotors, and four passive joints that are constrained by eight tension springs. The self-organization of two gait patterns (walking and running) is demonstrated in simulation and in a real-world robot. The analysis of joint kinematics and ground reaction force explains how a minimalistic control architecture can exploit the particular leg design for generating different gait patterns. Moreover, it is shown how the proposed model can be extended for controlling locomotion velocity and gait patterns with the simplest control architecture. © 2007 IEEE.

Exploiting body dynamics for controlling a running quadruped robot

Exploiting the body dynamics to control the behavior of robots is one of the most challenging issues, because the use of body dynamics has a significant potential in order to enhance both complexity of the robot design and the speed of movement. In this paper, we explore the control strategy of rapid four-legged locomotion by exploiting the intrinsic body dynamics. Based on the fact that a simple model of four-legged robot is known to exhibit interesting locomotion behavior, this paper analyzes the characteristics of the dynamic locomotion for the purpose of the locomotion control. The results from a series of running experiments with a robot show that, by exploiting the unique characteristics induced by the body dynamics, the forward velocity can be controlled by using a very simple method, in which only one control parameter is required. Furthermore it is also shown that a few of such different control parameters exist, each of them can control the forward velocity. Interestingly, with these parameters, the robot exhibits qualitatively different behavior during the locomotion, which could lead to our comprehensive understanding toward the behavioral diversity of adaptive robotic systems. © 2005 IEEE.