Gaussian processes for POMDP-based dialogue manager optimization

A partially observable Markov decision process (POMDP) has been proposed as a dialog model that enables automatic optimization of the dialog policy and provides robustness to speech understanding errors. Various approximations allow such a model to be used for building real-world dialog systems. However, they require a large number of dialogs to train the dialog policy and hence they typically rely on the availability of a user simulator. They also require significant designer effort to hand-craft the policy representation. We investigate the use of Gaussian processes (GPs) in policy modeling to overcome these problems. We show that GP policy optimization can be implemented for a real world POMDP dialog manager, and in particular: 1) we examine different formulations of a GP policy to minimize variability in the learning process; 2) we find that the use of GP increases the learning rate by an order of magnitude thereby allowing learning by direct interaction with human users; and 3) we demonstrate that designer effort can be substantially reduced by basing the policy directly on the full belief space thereby avoiding ad hoc feature space modeling. Overall, the GP approach represents an important step forward towards fully automatic dialog policy optimization in real world systems. © 2013 IEEE.

Semantic transform: Weakly supervised semantic inference for relating visual attributes

Relative (comparative) attributes are promising for thematic ranking of visual entities, which also aids in recognition tasks. However, attribute rank learning often requires a substantial amount of relational supervision, which is highly tedious, and apparently impractical for real-world applications. In this paper, we introduce the Semantic Transform, which under minimal supervision, adaptively finds a semantic feature space along with a class ordering that is related in the best possible way. Such a semantic space is found for every attribute category. To relate the classes under weak supervision, the class ordering needs to be refined according to a cost function in an iterative procedure. This problem is ideally NP-hard, and we thus propose a constrained search tree formulation for the same. Driven by the adaptive semantic feature space representation, our model achieves the best results to date for all of the tasks of relative, absolute and zero-shot classification on two popular datasets. © 2013 IEEE.

Minimalistic models of an energy-efficient vertical-hopping robot

The use of free vibration in elastic structure can lead to energy-efficient robot locomotion, since it significantly reduces the energy expenditure if properly designed and controlled. However, it is not well understood how to harness the dynamics of free vibration for the robot locomotion, because of the complex dynamics originated in discrete events and energy dissipation during locomotion. From this perspective, the goals of this paper are to propose a design strategy of hopping robot based on elastic curved beams and actuated rotating masses and to identify the minimalistic model that can characterize the basic principle of robot locomotion. Since the robot mainly exhibits vertical hopping, three 1-D models are examined that contain different configurations of simple spring-damper-mass components. The real-world and simulation experiments show that one of the models best characterizes the robot hopping, through analyzing the basic kinematics and negative works in actuation. Based on this model, the self-stability of hopping motion under disturbances is investigated, and design and control parameters are analyzed for the energy-efficient hopping. In addition, further analyses show that this robot can achieve the energy-efficient hopping with the variation in payload, and the source of energy dissipation of the robot hopping is investigated. © 1982-2012 IEEE.

Minimalistic models of an energy efficient vertical hopping robot

The use of free vibration in elastic structure can lead to energy efficient robot locomotion, since it significantly reduces the energy expenditure if properly designed and controlled. However, it is not well understood how to harness the dynamics of free vibration for the robot locomotion, because of the complex dynamics originated in discrete events and energy dissipation during locomotion. From this perspective, this paper explores three minimalistic models of free vibration that can characterize the basic principle of robot locomotion. Since the robot mainly exhibits vertical hopping, three one-dimensional models are examined that contain different configurations of simple spring-damper-mass components. The self-stability of these models are also investigated in simulation. The real-world and simulation experiments show that one of the models best characterizes the robot hopping, through analyzing the basic kinematics and negative works in actuation. Based on this model, the control parameters are analyzed for the energy efficient hopping. © 2013 IEEE.

Design and control of a climbing robot based on hot melt adhesion

Robust climbing in unstructured environments has been one of the long-standing challenges in robotics research. Among others, the control of large adhesion forces is still an important problem that significantly restricts the locomotion performance of climbing robots. The main contribution of this paper is to propose a novel approach to autonomous robot climbing which makes use of hot melt adhesion (HMA). The HMA material is known as an economical solution to achieve large adhesion forces, which can be varied by controlling the material temperature. For locomotion on both inclined and vertical walls, this paper investigates the basic characteristics of HMA material, and proposes a design and control of a climbing robot that uses the HMA material for attaching and detaching its body to the environment. The robot is equipped with servomotors and thermal control units to actively vary the temperature of the material, and the coordination of these components enables the robot to walk against the gravitational forces even with a relatively large body weight. A real-world platform is used to demonstrate locomotion on a vertical wall, and the experimental result shows the feasibility and overall performances of this approach. © 2013 Elsevier B.V. All rights reserved.

Towards soft self-reconfigurable robots

Modular self-reconfigurable robots have previously demonstrated that automatic control of their own body shapes enriches their behavioural functions. However, having predefined rigid modules technically limits real-world systems from being hyper-redundant and compliant. Encouraged by recent progress using elastically deformable material for robots, we propose the concept of soft self-reconfigurable robots which may become hyper-flexible during interaction with the environment. As the first attempt towards this goal, the paper proposes a novel approach using viscoelastic material Hot-Melt Adhesives (HMAs): for physical connection and disconnection control between bodies that are not necessarily predefined rigid modules. We present a model that characterizes the temperature dependency of the strength of HMA bonds, which is then validated and used in a feedback controller for automatic connection and disconnection. Using a minimalistic robot platform that is equipped with two devices handling HMAs, the performance of this method is evaluated in a pick-and-place experiment with aluminium and wooden parts. © 2012 IEEE.

Morphological computation of multi-gaited robot locomotion based on free vibration.

In recent years, there has been increasing interest in the study of gait patterns in both animals and robots, because it allows us to systematically investigate the underlying mechanisms of energetics, dexterity, and autonomy of adaptive systems. In particular, for morphological computation research, the control of dynamic legged robots and their gait transitions provides additional insights into the guiding principles from a synthetic viewpoint for the emergence of sensible self-organizing behaviors in more-degrees-of-freedom systems. This article presents a novel approach to the study of gait patterns, which makes use of the intrinsic mechanical dynamics of robotic systems. Each of the robots consists of a U-shaped elastic beam and exploits free vibration to generate different locomotion patterns. We developed a simplified physics model of these robots, and through experiments in simulation and real-world robotic platforms, we show three distinctive mechanisms for generating different gait patterns in these robots.

Resonance based multi-gaited robot locomotion

In order to understand the underlying mechanisms of animals' agility, dexterity and efficiency in motor control, there has been an increasing interest in the study of gait patterns in biological and artificial legged systems. This paper presents a novel approach to the study of gait patterns which makes use of intrinsic mechanical dynamics of robotic systems. Each of these robots consists of a U-shape elastic beam and exploits free vibration to generate different gait patterns. We developed a conceptual model for these robots, and through simulation and real-world experiments, we show three distinct mechanisms for generating four different gait patterns in these robots. © 2012 IEEE.

Enlarging regions of stable running with segmented legs

In human and animal running spring-like leg behavior is found, and similar concepts have been demonstrated by various robotic systems in the past. In general, a spring-mass model provides self-stabilizing characteristics against external perturbations originated in leg-ground interactions and motor control. Although most of these systems made use of linear spring-like legs. The question addressed in this paper is the influence of leg segmentation (i.e. the use of rotational joint and two limb-segments) to the self-stability of running, as it appears to be a common design principle in nature. This paper shows that, with the leg segmentation, the system is able to perform self-stable running behavior in significantly broader ranges of running speed and control parameters (e.g. control of angle of attack at touchdown, and adjustment of spring stiffness) by exploiting a nonlinear relationship between leg force and leg compression. The concept is investigated by using a two-segment leg model and a robotic platform, which demonstrate the plausibility in the real world. ©2008 IEEE.

Motor control optimization of compliant one-legged locomotion in rough terrain

While underactuated robotic systems are capable of energy efficient and rapid dynamic behavior, we still do not fully understand how body dynamics can be actively used for adaptive behavior in complex unstructured environment. In particular, we can expect that the robotic systems could achieve high maneuverability by flexibly storing and releasing energy through the motor control of the physical interaction between the body and the environment. This paper presents a minimalistic optimization strategy of motor control policy for underactuated legged robotic systems. Based on a reinforcement learning algorithm, we propose an optimization scheme, with which the robot can exploit passive elasticity for hopping forward while maintaining the stability of locomotion process in the environment with a series of large changes of ground surface. We show a case study of a simple one-legged robot which consists of a servomotor and a passive elastic joint. The dynamics and learning performance of the robot model are tested in simulation, and then transferred the results to the real-world robot. ©2007 IEEE.

Bipedal walking and running with compliant legs

Passive dynamics plays an important role in legged locomotion of the biological systems. The use of passive dynamics provides a number of advantages in legged locomotion such as energy efficiency, self-stabilization against disturbances, and generating gait patterns and behavioral diversity. Inspired from the theoretical and experimental studies in biomechanics, this paper presents a novel bipedal locomotion model for walking and running behavior which uses compliant legs. This model consists of three-segment legs, two servomotors, and four passive joints that are constrained by eight tension springs. The self-organization of two gait patterns (walking and running) is demonstrated in simulation and in a real-world robot. The analysis of joint kinematics and ground reaction force explains how a minimalistic control architecture can exploit the particular leg design for generating different gait patterns. Moreover, it is shown how the proposed model can be extended for controlling locomotion velocity and gait patterns with the simplest control architecture. © 2007 IEEE.

Sensing through body dynamics

It has been shown that sensory morphology and sensory-motor coordination enhance the capabilities of sensing in robotic systems. The tasks of categorization and category learning, for example, can be significantly simplified by exploiting the morphological constraints, sensory-motor couplings and the interaction with the environment. This paper argues that, in the context of sensory-motor control, it is essential to consider body dynamics derived from morphological properties and the interaction with the environment in order to gain additional insight into the underlying mechanisms of sensory-motor coordination, and more generally the nature of perception. A locomotion model of a four-legged robot is used for the case studies in both simulation and real world. The locomotion model demonstrates how attractor states derived from body dynamics influence the sensory information, which can then be used for the recognition of stable behavioral patterns and of physical properties in the environment. A comprehensive analysis of behavior and sensory information leads to a deeper understanding of the underlying mechanisms by which body dynamics can be exploited for category learning of autonomous robotic systems. © 2006 Elsevier Ltd. All rights reserved.

Predictive entropy search for efficient global optimization of black-box functions

We propose a novel information-theoretic approach for Bayesian optimization called Predictive Entropy Search (PES). At each iteration, PES selects the next evaluation point that maximizes the expected information gained with respect to the global maximum. PES codifies this intractable acquisition function in terms of the expected reduction in the differential entropy of the predictive distribution. This reformulation allows PES to obtain approximations that are both more accurate and efficient than other alternatives such as Entropy Search (ES). Furthermore, PES can easily perform a fully Bayesian treatment of the model hyperparameters while ES cannot. We evaluate PES in both synthetic and real-world applications, including optimization problems in machine learning, finance, biotechnology, and robotics. We show that the increased accuracy of PES leads to significant gains in optimization performance.

Method for improving classification performance of neural network based on fuzzy input and network inversion

In order to effectively improve the classification performance of neural network, first architecture of fuzzy neural network with fuzzy input was proposed. Next a cost function of fuzzy outputs and non-fuzzy targets was defined. Then a learning algorithm from the cost function for adjusting weights was derived. And then the fuzzy neural network was inversed and fuzzified inversion algorithm was proposed. Finally, computer simulations on real-world pattern classification problems examine the effectives of the proposed approach. The experiment results show that the proposed approach has the merits of high learning efficiency, high classification accuracy and high generalization capability.

Practical Evaluation of Security against Generalized Interpolation Attack

Interpolation attack was presented by Jakobsen and Knudsen at FSE'97. Interpolation attack is effective against ciphers that have a certain algebraic structure like the PURE cipher which is a prototype cipher, but it is difficult to apply the attack to real-world ciphers. This difficulty is due to the difficulty of deriving a low degree polynomial relation between ciphertexts and plaintexts. In other words, it is difficult to evaluate the security against interpolation attack. This paper generalizes the interpolation attack. The generalization makes easier to evaluate the security against interpolation attack. We call the generalized interpolation attack linear sum attack. We present an algorithm that evaluates the security of byte-oriented ciphers against linear sum attack. Moreover, we show the relationship between linear sum attack and higher order differential attack. In addition, we show the security of CRYPTON, E2, and RIJNDAEL against linear sum attack using the algorithm.