Determinantal Clustering Processes - A Nonparametric Bayesian Approach to Kernel Based Semi-Supervised Clustering

Semi-supervised clustering is the task of clustering data points into clusters where only a fraction of the points are labelled. The true number of clusters in the data is often unknown and most models require this parameter as an input. Dirichlet process mixture models are appealing as they can infer the number of clusters from the data. However, these models do not deal with high dimensional data well and can encounter difficulties in inference. We present a novel nonparameteric Bayesian kernel based method to cluster data points without the need to prespecify the number of clusters or to model complicated densities from which data points are assumed to be generated from. The key insight is to use determinants of submatrices of a kernel matrix as a measure of how close together a set of points are. We explore some theoretical properties of the model and derive a natural Gibbs based algorithm with MCMC hyperparameter learning. The model is implemented on a variety of synthetic and real world data sets.

The Random Forest Kernel and other kernels for big data from random partitions

We present Random Partition Kernels, a new class of kernels derived by demonstrating a natural connection between random partitions of objects and kernels between those objects. We show how the construction can be used to create kernels from methods that would not normally be viewed as random partitions, such as Random Forest. To demonstrate the potential of this method, we propose two new kernels, the Random Forest Kernel and the Fast Cluster Kernel, and show that these kernels consistently outperform standard kernels on problems involving real-world datasets. Finally, we show how the form of these kernels lend themselves to a natural approximation that is appropriate for certain big data problems, allowing $O(N)$ inference in methods such as Gaussian Processes, Support Vector Machines and Kernel PCA.

Randomized nonlinear component analysis

Copyright © (2014) by the International Machine Learning Society (IMLS) All rights reserved. Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear re-lationships in data. Although nonlinear variants of PCA and CCA have been proposed, these are computationally prohibitive in the large scale. In a separate strand of recent research, randomized methods have been proposed to construct features that help reveal nonlinear patterns in data. For basic tasks such as regression or classification, random features exhibit little or no loss in performance, while achieving drastic savings in computational requirements. In this paper we leverage randomness to design scalable new variants of nonlinear PCA and CCA; our ideas extend to key multivariate analysis tools such as spectral clustering or LDA. We demonstrate our algorithms through experiments on real- world data, on which we compare against the state-of-the-art. A simple R implementation of the presented algorithms is provided.

Bipedal walking and running with spring-like biarticular muscles.

Compliant elements in the leg musculoskeletal system appear to be important not only for running but also for walking in human locomotion as shown in the energetics and kinematics studies of spring-mass model. While the spring-mass model assumes a whole leg as a linear spring, it is still not clear how the compliant elements of muscle-tendon systems behave in a human-like segmented leg structure. This study presents a minimalistic model of compliant leg structure that exploits dynamics of biarticular tension springs. In the proposed bipedal model, each leg consists of three leg segments with passive knee and ankle joints that are constrained by four linear tension springs. We found that biarticular arrangements of the springs that correspond to rectus femoris, biceps femoris and gastrocnemius in human legs provide self-stabilizing characteristics for both walking and running gaits. Through the experiments in simulation and a real-world robotic platform, we show how behavioral characteristics of the proposed model agree with basic patterns of human locomotion including joint kinematics and ground reaction force, which could not be explained in the previous models.

Minimalistic control of biped walking in rough terrain

Toward our comprehensive understanding of legged locomotion in animals and machines, the compass gait model has been intensively studied for a systematic investigation of complex biped locomotion dynamics. While most of the previous studies focused only on the locomotion on flat surfaces, in this article, we tackle with the problem of bipedal locomotion in rough terrains by using a minimalistic control architecture for the compass gait walking model. This controller utilizes an open-loop sinusoidal oscillation of hip motor, which induces basic walking stability without sensory feedback. A set of simulation analyses show that the underlying mechanism lies in the "phase locking" mechanism that compensates phase delays between mechanical dynamics and the open-loop motor oscillation resulting in a relatively large basin of attraction in dynamic bipedal walking. By exploiting this mechanism, we also explain how the basin of attraction can be controlled by manipulating the parameters of oscillator not only on a flat terrain but also in various inclined slopes. Based on the simulation analysis, the proposed controller is implemented in a real-world robotic platform to confirm the plausibility of the approach. In addition, by using these basic principles of self-stability and gait variability, we demonstrate how the proposed controller can be extended with a simple sensory feedback such that the robot is able to control gait patterns autonomously for traversing a rough terrain. © 2010 Springer Science+Business Media, LLC.

Self-organization, embodiment, and biologically inspired robotics.

Robotics researchers increasingly agree that ideas from biology and self-organization can strongly benefit the design of autonomous robots. Biological organisms have evolved to perform and survive in a world characterized by rapid changes, high uncertainty, indefinite richness, and limited availability of information. Industrial robots, in contrast, operate in highly controlled environments with no or very little uncertainty. Although many challenges remain, concepts from biologically inspired (bio-inspired) robotics will eventually enable researchers to engineer machines for the real world that possess at least some of the desirable properties of biological organisms, such as adaptivity, robustness, versatility, and agility.

Gaussian processes for POMDP-based dialogue manager optimization

A partially observable Markov decision process (POMDP) has been proposed as a dialog model that enables automatic optimization of the dialog policy and provides robustness to speech understanding errors. Various approximations allow such a model to be used for building real-world dialog systems. However, they require a large number of dialogs to train the dialog policy and hence they typically rely on the availability of a user simulator. They also require significant designer effort to hand-craft the policy representation. We investigate the use of Gaussian processes (GPs) in policy modeling to overcome these problems. We show that GP policy optimization can be implemented for a real world POMDP dialog manager, and in particular: 1) we examine different formulations of a GP policy to minimize variability in the learning process; 2) we find that the use of GP increases the learning rate by an order of magnitude thereby allowing learning by direct interaction with human users; and 3) we demonstrate that designer effort can be substantially reduced by basing the policy directly on the full belief space thereby avoiding ad hoc feature space modeling. Overall, the GP approach represents an important step forward towards fully automatic dialog policy optimization in real world systems. © 2013 IEEE.

Semantic transform: Weakly supervised semantic inference for relating visual attributes

Relative (comparative) attributes are promising for thematic ranking of visual entities, which also aids in recognition tasks. However, attribute rank learning often requires a substantial amount of relational supervision, which is highly tedious, and apparently impractical for real-world applications. In this paper, we introduce the Semantic Transform, which under minimal supervision, adaptively finds a semantic feature space along with a class ordering that is related in the best possible way. Such a semantic space is found for every attribute category. To relate the classes under weak supervision, the class ordering needs to be refined according to a cost function in an iterative procedure. This problem is ideally NP-hard, and we thus propose a constrained search tree formulation for the same. Driven by the adaptive semantic feature space representation, our model achieves the best results to date for all of the tasks of relative, absolute and zero-shot classification on two popular datasets. © 2013 IEEE.

Minimalistic models of an energy-efficient vertical-hopping robot

The use of free vibration in elastic structure can lead to energy-efficient robot locomotion, since it significantly reduces the energy expenditure if properly designed and controlled. However, it is not well understood how to harness the dynamics of free vibration for the robot locomotion, because of the complex dynamics originated in discrete events and energy dissipation during locomotion. From this perspective, the goals of this paper are to propose a design strategy of hopping robot based on elastic curved beams and actuated rotating masses and to identify the minimalistic model that can characterize the basic principle of robot locomotion. Since the robot mainly exhibits vertical hopping, three 1-D models are examined that contain different configurations of simple spring-damper-mass components. The real-world and simulation experiments show that one of the models best characterizes the robot hopping, through analyzing the basic kinematics and negative works in actuation. Based on this model, the self-stability of hopping motion under disturbances is investigated, and design and control parameters are analyzed for the energy-efficient hopping. In addition, further analyses show that this robot can achieve the energy-efficient hopping with the variation in payload, and the source of energy dissipation of the robot hopping is investigated. © 1982-2012 IEEE.

Minimalistic models of an energy efficient vertical hopping robot

The use of free vibration in elastic structure can lead to energy efficient robot locomotion, since it significantly reduces the energy expenditure if properly designed and controlled. However, it is not well understood how to harness the dynamics of free vibration for the robot locomotion, because of the complex dynamics originated in discrete events and energy dissipation during locomotion. From this perspective, this paper explores three minimalistic models of free vibration that can characterize the basic principle of robot locomotion. Since the robot mainly exhibits vertical hopping, three one-dimensional models are examined that contain different configurations of simple spring-damper-mass components. The self-stability of these models are also investigated in simulation. The real-world and simulation experiments show that one of the models best characterizes the robot hopping, through analyzing the basic kinematics and negative works in actuation. Based on this model, the control parameters are analyzed for the energy efficient hopping. © 2013 IEEE.

Design and control of a climbing robot based on hot melt adhesion

Robust climbing in unstructured environments has been one of the long-standing challenges in robotics research. Among others, the control of large adhesion forces is still an important problem that significantly restricts the locomotion performance of climbing robots. The main contribution of this paper is to propose a novel approach to autonomous robot climbing which makes use of hot melt adhesion (HMA). The HMA material is known as an economical solution to achieve large adhesion forces, which can be varied by controlling the material temperature. For locomotion on both inclined and vertical walls, this paper investigates the basic characteristics of HMA material, and proposes a design and control of a climbing robot that uses the HMA material for attaching and detaching its body to the environment. The robot is equipped with servomotors and thermal control units to actively vary the temperature of the material, and the coordination of these components enables the robot to walk against the gravitational forces even with a relatively large body weight. A real-world platform is used to demonstrate locomotion on a vertical wall, and the experimental result shows the feasibility and overall performances of this approach. © 2013 Elsevier B.V. All rights reserved.

Towards soft self-reconfigurable robots

Modular self-reconfigurable robots have previously demonstrated that automatic control of their own body shapes enriches their behavioural functions. However, having predefined rigid modules technically limits real-world systems from being hyper-redundant and compliant. Encouraged by recent progress using elastically deformable material for robots, we propose the concept of soft self-reconfigurable robots which may become hyper-flexible during interaction with the environment. As the first attempt towards this goal, the paper proposes a novel approach using viscoelastic material Hot-Melt Adhesives (HMAs): for physical connection and disconnection control between bodies that are not necessarily predefined rigid modules. We present a model that characterizes the temperature dependency of the strength of HMA bonds, which is then validated and used in a feedback controller for automatic connection and disconnection. Using a minimalistic robot platform that is equipped with two devices handling HMAs, the performance of this method is evaluated in a pick-and-place experiment with aluminium and wooden parts. © 2012 IEEE.

Morphological computation of multi-gaited robot locomotion based on free vibration.

In recent years, there has been increasing interest in the study of gait patterns in both animals and robots, because it allows us to systematically investigate the underlying mechanisms of energetics, dexterity, and autonomy of adaptive systems. In particular, for morphological computation research, the control of dynamic legged robots and their gait transitions provides additional insights into the guiding principles from a synthetic viewpoint for the emergence of sensible self-organizing behaviors in more-degrees-of-freedom systems. This article presents a novel approach to the study of gait patterns, which makes use of the intrinsic mechanical dynamics of robotic systems. Each of the robots consists of a U-shaped elastic beam and exploits free vibration to generate different locomotion patterns. We developed a simplified physics model of these robots, and through experiments in simulation and real-world robotic platforms, we show three distinctive mechanisms for generating different gait patterns in these robots.

Resonance based multi-gaited robot locomotion

In order to understand the underlying mechanisms of animals' agility, dexterity and efficiency in motor control, there has been an increasing interest in the study of gait patterns in biological and artificial legged systems. This paper presents a novel approach to the study of gait patterns which makes use of intrinsic mechanical dynamics of robotic systems. Each of these robots consists of a U-shape elastic beam and exploits free vibration to generate different gait patterns. We developed a conceptual model for these robots, and through simulation and real-world experiments, we show three distinct mechanisms for generating four different gait patterns in these robots. © 2012 IEEE.

Enlarging regions of stable running with segmented legs

In human and animal running spring-like leg behavior is found, and similar concepts have been demonstrated by various robotic systems in the past. In general, a spring-mass model provides self-stabilizing characteristics against external perturbations originated in leg-ground interactions and motor control. Although most of these systems made use of linear spring-like legs. The question addressed in this paper is the influence of leg segmentation (i.e. the use of rotational joint and two limb-segments) to the self-stability of running, as it appears to be a common design principle in nature. This paper shows that, with the leg segmentation, the system is able to perform self-stable running behavior in significantly broader ranges of running speed and control parameters (e.g. control of angle of attack at touchdown, and adjustment of spring stiffness) by exploiting a nonlinear relationship between leg force and leg compression. The concept is investigated by using a two-segment leg model and a robotic platform, which demonstrate the plausibility in the real world. ©2008 IEEE.