A vision-based remote control

This Chapter presents a vision-based system for touch-free interaction with a display at a distance. A single camera is fixed on top of the screen and is pointing towards the user. An attention mechanism allows the user to start the interaction and control a screen pointer by moving their hand in a fist pose directed at the camera. On-screen items can be chosen by a selection mechanism. Current sample applications include browsing video collections as well as viewing a gallery of 3D objects, which the user can rotate with their hand motion. We have included an up-to-date review of hand tracking methods, and comment on the merits and shortcomings of previous approaches. The proposed tracker uses multiple cues, appearance, color, and motion, for robustness. As the space of possible observation models is generally too large for exhaustive online search, we select models that are suitable for the particular tracking task at hand. During a training stage, various off-the-shelf trackers are evaluated. From this data differentmethods of fusing them online are investigated, including parallel and cascaded tracker evaluation. For the case of fist tracking, combining a small number of observers in a cascade results in an efficient algorithm that is used in our gesture interface. The system has been on public display at conferences where over a hundred users have engaged with it. © 2010 Springer-Verlag Berlin Heidelberg.

Risk-sensitive optimal feedback control accounts for sensorimotor behavior under uncertainty

Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models. © 2010 Nagengast et al.

Monte Carlo optimization strategies for air-traffic control

The safety of the flights, and in particular conflict resolution for separation assurance, is one of the main tasks of Air Traffic Control. Conflict resolution requires decision making in the face of the considerable levels of uncertainty inherent in the motion of aircraft. We present a Monte Carlo framework for conflict resolution which allows one to take into account such levels of uncertainty through the use of a stochastic simulator. A simulation example inspired by current air traffic control practice illustrates the proposed conflict resolution strategy. Copyright © 2005 by the American Institute of Aeronautics and Astronautics, Inc. All rights reserved.

Initial modelling and controller design for active control of spacecraft microvibrations

Microvibrations, at frequencies between 1 and 1000 Hz, generated by on board equipment, propagate throughout a spacecraft structure affecting the performance of sensitive payloads. The purpose of this work is to investigate strategies to model and reduce these dynamic disturbances by active control. Initial studies were performed by considering a mass loaded panel where the disturbance excitation source consisted of point forces, the objective being to minimise the displacement at an arbitrary output location. Piezoelectric patches acting as sensors and actuators were used. The equations of motion are derived by using Lagrange's equation with modal shapes as Ritz functions. The number of sensors/actuators and their location is variable. The set of equations obtained is then transformed into state variables and some initial controller design studies have been undertaken. These are based on feedback control implemented using a full state feedback and an observer which reconstructs the state vector from the available sensor signal. Here, the basics behind the structural modelling and controller design will be described. This preliminary analysis will also be used to identify short to medium term further work.

Swimming direction reversal of flagella through ciliary motion of mastigonemes.

Bio-inspired designs can provide an answer to engineering problems such as swimming strategies at the micron or nano-scale. Scientists are now designing artificial micro-swimmers that can mimic flagella-powered swimming of micro-organisms. In an application such as lab-on-a-chip in which micro-object manipulation in small flow geometries could be achieved by micro-swimmers, control of the swimming direction becomes an important aspect for retrieval and control of the micro-swimmer. A bio-inspired approach for swimming direction reversal (a flagellum bearing mastigonemes) can be used to design such a system and is being explored in the present work. We analyze the system using a computational framework in which the equations of solid mechanics and fluid dynamics are solved simultaneously. The fluid dynamics of Stokes flow is represented by a 2D Stokeslets approach while the solid mechanics behavior is realized using Euler-Bernoulli beam elements. The working principle of a flagellum bearing mastigonemes can be broken up into two parts: (1) the contribution of the base flagellum and (2) the contribution of mastigonemes, which act like cilia. These contributions are counteractive, and the net motion (velocity and direction) is a superposition of the two. In the present work, we also perform a dimensional analysis to understand the underlying physics associated with the system parameters such as the height of the mastigonemes, the number of mastigonemes, the flagellar wave length and amplitude, the flagellum length, and mastigonemes rigidity. Our results provide fundamental physical insight on the swimming of a flagellum with mastigonemes, and it provides guidelines for the design of artificial flagellar systems.

Integrated high pressure microhydraulic actuation and control for surgical instruments

To reduce the surgical trauma to the patient, minimally invasive surgery is gaining considerable importance since the eighties. More recently, robot assisted minimally invasive surgery was introduced to enhance the surgeon's performance in these procedures. This resulted in an intensive research on the design, fabrication and control of surgical robots over the last decades. A new development in the field of surgical tool manipulators is presented in this article: a flexible manipulator with distributed degrees of freedom powered by microhydraulic actuators. The tool consists of successive flexible segments, each with two bending degrees of freedom. To actuate these compliant segments, dedicated fluidic actuators are incorporated, together with compact hydraulic valves which control the actuator motion. Especially the development of microvalves for this application was challenging, and are the main focus of this paper. The valves distribute the hydraulic power from one common high pressure supply to a series of artificial muscle actuators. Tests show that the angular stroke of the each segment of this medical instrument is 90°. © 2012 Springer Science+Business Media, LLC.

Coordinated motion design on lie groups

The present paper proposes a unified geometric framework for coordinated motion on Lie groups. It first gives a general problem formulation and analyzes ensuing conditions for coordinated motion. Then, it introduces a precise method to design control laws in fully actuated and underactuated settings with simple integrator dynamics. It thereby shows that coordination can be studied in a systematic way once the Lie group geometry of the configuration space is well characterized. Applying the proposed general methodology to particular examples allows to retrieve control laws that have been proposed in the literature on intuitive grounds. A link with Brockett's double bracket flows is also made. The concepts are illustrated on SO(3), SE(2) and SE(3). © 2010 IEEE.

Stabilization of planar collective motion with limited communication

This paper proposes a design methodology to stabilize relative equilibria in a model of identical, steered particles moving in the plane at unit speed. Relative equilibria either correspond to parallel motion of all particles with fixed relative spacing or to circular motion of all particles around the same circle. Particles exchange relative information according to a communication graph that can be undirected or directed and time-invariant or time-varying. The emphasis of this paper is to show how previous results assuming all-to-all communication can be extended to a general communication framework. © 2008 IEEE.

Stabilization of symmetric formations to motion around convex loops

We provide a cooperative control algorithm to stabilize symmetric formations to motion around closed curves suitable for mobile sensor networks. This work extends previous results for stabilization of symmetric circular formations. We study a planar particle model with decentralized steering control subject to limited communication. Because of their unique spectral properties, the Laplacian matrices of circulant graphs play a key role. We illustrate the result for a skewed superellipse, which is a type of curve that includes circles, ellipses, and rounded parallelograms. © 2007 Elsevier B.V. All rights reserved.

Alternating spatial patterns for coordinated group motion

Motivated by recent observations of fish schools, we study coordinated group motion for individuals with oscillatory speed. Neighbors that have speed oscillations with common frequency, amplitude and average but different phases, move together in alternating spatial patterns, taking turns being towards the front, sides and back of the group. We propose a model and control laws to investigate the connections between these spatial dynamics, communication when sensing is range or direction limited, and convergence of coordinated group motions. ©2007 IEEE.

Stabilization of collective motion in three dimensions: A consensus approach

This paper proposes a methodology to stabilize relative equilibria in a model of identical, steered particles moving in three-dimensional Euclidean space. Exploiting the Lie group structure of the resulting dynamical system, the stabilization problem is reduced to a consensus problem. We first derive the stabilizing control laws in the presence of all-to-all communication. Providing each agent with a consensus estimator, we then extend the results to a general setting that allows for unidirectional and time-varying communication topologies. © 2007 IEEE.

Oscillator models and collective motion

A description of the so called "particles with coupled oscillator dynamics" (PCOD) is presented which is used to model, analyze and synthesize collective motion. An oscillator model with spatial dynamics is presented to help describe how to design steering control laws while it is being used to study biological collectives. Lastly, both engineering and biological analysis were described.

Stabilization of planar collective motion: All-to-all communication

This paper proposes a design methodology to stabilize isolated relative equilibria in a model of all-to-all coupled identical particles moving in the plane at unit speed. Isolated relative equilibria correspond to either parallel motion of all particles with fixed relative spacing or to circular motion of all particles with fixed relative phases. The stabilizing feedbacks derive from Lyapunov functions that prove exponential stability and suggest almost global convergence properties. The results of the paper provide a low-order parametric family of stabilizable collectives that offer a set of primitives for the design of higher-level tasks at the group level. © 2007 IEEE.

Collective motion, sensor networks, and ocean sampling

This paper addresses the design of mobile sensor networks for optimal data collection. The development is strongly motivated by the application to adaptive ocean sampling for an autonomous ocean observing and prediction system. A performance metric, used to derive optimal paths for the network of mobile sensors, defines the optimal data set as one which minimizes error in a model estimate of the sampled field. Feedback control laws are presented that stably coordinate sensors on structured tracks that have been optimized over a minimal set of parameters. Optimal, closed-loop solutions are computed in a number of low-dimensional cases to illustrate the methodology. Robustness of the performance to the influence of a steady flow field on relatively slow-moving mobile sensors is also explored © 2006 IEEE.

Group coordination and cooperative control of steered particles in the plane

The paper overviews recent and ongoing efforts by the authors to develop a design methodology to stabilize isolated relative equilibria in a kinematic model of identical particles moving in the plane at unit speed. Isolated relative equilibria correspond to either parallel motion of all particles with fixed relative spacing or to circular motion of all particles about the same center with fixed relative headings. © Springer-Verlag Berlin Heidelberg 2006.