Estimation and inference for grasping and manipulation tasks using vision and kinesthetic sensors

This thesis presents a novel framework for state estimation in the context of robotic grasping and manipulation. The overall estimation approach is based on fusing various visual cues for manipulator tracking, namely appearance and feature-based, shape-based, and silhouette-based visual cues. Similarly, a framework is developed to fuse the above visual cues, but also kinesthetic cues such as force-torque and tactile measurements, for in-hand object pose estimation. The cues are extracted from multiple sensor modalities and are fused in a variety of Kalman filters.

A hybrid estimator is developed to estimate both a continuous state (robot and object states) and discrete states, called contact modes, which specify how each finger contacts a particular object surface. A static multiple model estimator is used to compute and maintain this mode probability. The thesis also develops an estimation framework for estimating model parameters associated with object grasping. Dual and joint state-parameter estimation is explored for parameter estimation of a grasped object's mass and center of mass. Experimental results demonstrate simultaneous object localization and center of mass estimation.

Dual-arm estimation is developed for two arm robotic manipulation tasks. Two types of filters are explored; the first is an augmented filter that contains both arms in the state vector while the second runs two filters in parallel, one for each arm. These two frameworks and their performance is compared in a dual-arm task of removing a wheel from a hub.

This thesis also presents a new method for action selection involving touch. This next best touch method selects an available action for interacting with an object that will gain the most information. The algorithm employs information theory to compute an information gain metric that is based on a probabilistic belief suitable for the task. An estimation framework is used to maintain this belief over time. Kinesthetic measurements such as contact and tactile measurements are used to update the state belief after every interactive action. Simulation and experimental results are demonstrated using next best touch for object localization, specifically a door handle on a door. The next best touch theory is extended for model parameter determination. Since many objects within a particular object category share the same rough shape, principle component analysis may be used to parametrize the object mesh models. These parameters can be estimated using the action selection technique that selects the touching action which best both localizes and estimates these parameters. Simulation results are then presented involving localizing and determining a parameter of a screwdriver.

Lastly, the next best touch theory is further extended to model classes. Instead of estimating parameters, object class determination is incorporated into the information gain metric calculation. The best touching action is selected in order to best discern between the possible model classes. Simulation results are presented to validate the theory.

Wave uplift pressures on horizontal platforms

The major objective of the study has been to investigate in detail the rapidly-varying peak uplift pressure and the slowly-varying positive and negative uplift pressures that are known to be exerted by waves against the underside of a horizontal pier or platform located above the still water level, but not higher than the crests of the incident waves.

In a "two-dimensional" laboratory study conducted in a 100-ft long by 15-in.-wide by 2-ft-deep wave tank with a horizontal smooth bottom, individually generated solitary waves struck a rigid, fixed, horizontal platform extending the width of the tank. Pressure transducers were mounted flush with the smooth soffit, or underside, of the platform. The location of the transducers could be varied.

The problem of a d equate dynamic and spatial response of the transducers was investigated in detail. It was found that unless the radius of the sensitive area of a pressure transducer is smaller than about one-third of the characteristic width of the pressure distribution, the peak pressure and the rise-time will not be recorded accurately. A procedure was devised to correct peak pressures and rise-times for this transducer defect.

The hydrodynamics of the flow beneath the platform are described qualitatively by a si1nple analysis, which relates peak pressure and positive slowly-varying pressure to the celerity of the wave front propagating beneath the platform, and relates negative slowly-varying pressure to the process by which fluid recedes from the platform after the wave has passed. As the wave front propagates beneath the platform, its celerity increases to a maximum, then decreases. The peak pressure similarly increases with distance from the seaward edge of the platform, then decreases.

Measured peak pressure head, always found to be less than five times the incident wave height above still water level, is an order of magnitude less than reported shock pressures due to waves breaking against vertical walls; the product of peak pressure and rise-time, considered as peak impulse, is of the order of 20% of reported shock impulse due to waves breaking against vertical walls. The maximum measured slowly-varying uplift pressure head is approximately equal to the incident wave height less the soffit clearance above still water level. The normalized magnitude and duration of negative pressure appears to depend principally on the ratio of soffit clearance to still water depth and on the ratio of platform length to still water depth.

Theoretical investigations of experimental gravitation

This thesis has two basic themes: the investigation of new experiments which can be used to test relativistic gravity, and the investigation of new technologies and new experimental techniques which can be applied to make gravitational wave astronomy a reality.

Advancing technology will soon make possible a new class of gravitation experiments: pure laboratory experiments with laboratory sources of non-Newtonian gravity and laboratory detectors. The key advance in techno1ogy is the development of resonant sensing systems with very low levels of dissipation. Chapter 1 considers three such systems (torque balances, dielectric monocrystals, and superconducting microwave resonators), and it proposes eight laboratory experiments which use these systems as detectors. For each experiment it describes the dominant sources of noise and the technology required.

The coupled electro-mechanical system consisting of a microwave cavity and its walls can serve as a gravitational radiation detector. A gravitational wave interacts with the walls, and the resulting motion induces transitions from a highly excited cavity mode to a nearly unexcited mode. Chapter 2 describes briefly a formalism for analyzing such a detector, and it proposes a particular design.

The monitoring of a quantum mechanical harmonic oscillator on which a classical force acts is important in a variety of high-precision experiments, such as the attempt to detect gravitational radiation. Chapter 3 reviews the standard techniques for monitoring the oscillator; and it introduces a new technique which, in principle, can determine the details of the force with arbitrary accuracy, despite the quantum properties of the oscillator.

The standard method for monitoring the oscillator is the "amplitude- and-phase" method (position or momentum transducer with output fed through a linear amplifier). The accuracy obtainable by this method is limited by the uncertainty principle. To do better requires a measurement of the type which Braginsky has called "quantum nondemolition." A well-known quantum nondemolition technique is "quantum counting," which can detect an arbitrarily weak force, but which cannot provide good accuracy in determining its precise time-dependence. Chapter 3 considers extensively a new type of quantum nondemolition measurement - a "back-action-evading" measurement of the real part X₁ (or the imaginary part X₂) of the oscillator's complex amplitude. In principle X₁ can be measured arbitrarily quickly and arbitrarily accurately, and a sequence of such measurements can lead to an arbitrarily accurate monitoring of the classical force.

Chapter 3 describes explicit gedanken experiments which demonstrate that X₁ can be measured arbitrarily quickly and arbitrarily accurately, it considers approximate back-action-evading measurements, and it develops a theory of quantum nondemolition measurement for arbitrary quantum mechanical systems.

In Rosen's "bimetric" theory of gravity the (local) speed of gravitational radiation v_g is determined by the combined effects of cosmological boundary values and nearby concentrations of matter. It is possible for v_g to be less than the speed of light. Chapter 4 shows that emission of gravitational radiation prevents particles of nonzero rest mass from exceeding the speed of gravitational radiation. Observations of relativistic particles place limits on v_g and the cosmological boundary values today, and observations of synchrotron radiation from compact radio sources place limits on the cosmological boundary values in the past.