Estimation and inference for grasping and manipulation tasks using vision and kinesthetic sensors

This thesis presents a novel framework for state estimation in the context of robotic grasping and manipulation. The overall estimation approach is based on fusing various visual cues for manipulator tracking, namely appearance and feature-based, shape-based, and silhouette-based visual cues. Similarly, a framework is developed to fuse the above visual cues, but also kinesthetic cues such as force-torque and tactile measurements, for in-hand object pose estimation. The cues are extracted from multiple sensor modalities and are fused in a variety of Kalman filters.

A hybrid estimator is developed to estimate both a continuous state (robot and object states) and discrete states, called contact modes, which specify how each finger contacts a particular object surface. A static multiple model estimator is used to compute and maintain this mode probability. The thesis also develops an estimation framework for estimating model parameters associated with object grasping. Dual and joint state-parameter estimation is explored for parameter estimation of a grasped object's mass and center of mass. Experimental results demonstrate simultaneous object localization and center of mass estimation.

Dual-arm estimation is developed for two arm robotic manipulation tasks. Two types of filters are explored; the first is an augmented filter that contains both arms in the state vector while the second runs two filters in parallel, one for each arm. These two frameworks and their performance is compared in a dual-arm task of removing a wheel from a hub.

This thesis also presents a new method for action selection involving touch. This next best touch method selects an available action for interacting with an object that will gain the most information. The algorithm employs information theory to compute an information gain metric that is based on a probabilistic belief suitable for the task. An estimation framework is used to maintain this belief over time. Kinesthetic measurements such as contact and tactile measurements are used to update the state belief after every interactive action. Simulation and experimental results are demonstrated using next best touch for object localization, specifically a door handle on a door. The next best touch theory is extended for model parameter determination. Since many objects within a particular object category share the same rough shape, principle component analysis may be used to parametrize the object mesh models. These parameters can be estimated using the action selection technique that selects the touching action which best both localizes and estimates these parameters. Simulation results are then presented involving localizing and determining a parameter of a screwdriver.

Lastly, the next best touch theory is further extended to model classes. Instead of estimating parameters, object class determination is incorporated into the information gain metric calculation. The best touching action is selected in order to best discern between the possible model classes. Simulation results are presented to validate the theory.

Genetically engineered sensors of cell signaling

Measuring electrical activity in large numbers of cells with high spatial and temporal resolution is a fundamental problem for the study of neural development and information processing. To address this problem, we have constructed FlaSh: a novel, genetically-encoded probe that can be used to measure trans-membrane voltage in single cells. We fused a modified green fluorescent protein (GFP) into a voltage-sensitive potassium channel so that voltage dependent rearrangements in the potassium channel induce changes in the fluorescence of GFP. A voltage sensor encoded into DNA has the advantage that it may be introduced into an organism non-invasively and targeted to specific developmental stages, brain regions, cell types, and sub-cellular compartments.

We also describe modifications to FlaSh that shift its color, kinetics, and dynamic range. We used multiple green fluorescent proteins to produce variants of the FlaSh sensor that generate ratiometric signal output via fluorescence resonance energy transfer (FRET). Finally, we describe initial work toward FlaSh variants that are sensitive to G-protein coupled receptor (GPCR) activation. These sensors can be used to design functional assays for receptor activation in living cells.

An experimental investigation of the heat transfer from a buoyant gas plume to a horizontal unobstructed ceiling

This thesis presents an experimental investigation of the axisymmetric heat transfer from a small scale fire and resulting buoyant plume to a horizontal, unobstructed ceiling during the initial stages of development. A propane-air burner yielding a heat source strength between 1.0 kW and 1.6 kW was used to simulate the fire, and measurements proved that this heat source did satisfactorily represent a source of buoyancy only. The ceiling consisted of a 1/16" steel plate of 0.91 m. diameter, insulated on the upper side. The ceiling height was adjustable between 0.5 m and 0.91 m. Temperature measurements were carried out in the plume, ceiling jet, and on the ceiling.

Heat transfer data were obtained by using the transient method and applying corrections for the radial conduction along the ceiling and losses through the insulation material. The ceiling heat transfer coefficient was based on the adiabatic ceiling jet temperature (recovery temperature) reached after a long time. A parameter involving the source strength Q and ceiling height H was found to correlate measurements of this temperature and its radial variation. A similar parameter for estimating the ceiling heat transfer coefficient was confirmed by the experimental results.

This investigation therefore provides reasonable estimates for the heat transfer from a buoyant gas plume to a ceiling in the axisymmetric case, for the stagnation region where such heat transfer is a maximum and for the ceiling jet region (r/H ≤ 0.7). A comparison with data from experiments which involved larger heat sources indicates that the predicted scaling of temperatures and heat transfer rates for larger scale fires is adequate.

I. Spectroscopic evidence for slow vibrational relaxation in excited electronic states of diatomics in rare gas solids. II. Static crystal field effects in the electronic spectra of isotopically mixed benzene crystals

Part I

Studies of vibrational relaxation in excited electronic states of simple diatomic molecules trapped in solid rare-gas matrices at low temperatures are reported. The relaxation is investigated by monitoring the emission intensity from vibrational levels of the excited electronic state to vibrational levels of the ground electronic state. The emission was in all cases excited by bombardment of the doped rare-gas solid with X-rays.

The diatomics studied and the band systems seen are: N₂, Vegard-Kaplan and Second Positive systems; O₂, Herzberg system; OH and OD, A ²Σ⁺ - X²II_i system. The latter has been investigated only in solid Ne, where both emission and absorption spectra were recorded; observed fine structure has been partly interpreted in terms of slightly perturbed rotational motion in the solid. For N₂, OH, and OD emission occurred from v' > 0, establishing a vibrational relaxation time in the excited electronic state of the order, of longer than, the electronic radiative lifetime. The relative emission intensity and decay times for different v' progressions in the Vegard-Kaplan system are found to depend on the rare-gas host and the N₂ concentration, but are independent of temperature in the range 1.7°K to 30°K.

Part II

Static crystal field effects on the absorption, fluorescence, and phosphorescence spectra of isotopically mixed benzene crystals were investigated. Evidence is presented which demonstrate that in the crystal the ground, lowest excited singlet, and lowest triplet states of the guest deviate from hexagonal symmetry. The deviation appears largest in the lowest triplet state and may be due to an intrinsic instability of the ³B_1u state. High resolution absorption and phospho- rescence spectra are reported and analyzed in terms of site-splitting of degenerate vibrations and orientational effects. The guest phosphorescence lifetime for various benzene isotopes in C₆D₆ and sym-C₆H₃D₃ hosts is presented and discussed.

Spectroscopic studies of gas-phase molecular clusters

Spectroscopic investigations of hydrogen-bonding and van der Waals' interactions m molecular clusters were studied by the techniques of infrared predissociation and resonance-enhanced multiphoton ionization spectroscopies (REMPI). Ab initio calculations were applied in conjunction for data interpretation.

The infrared predissociation spectroscopy of CN^-•(H_2O)_n (n = 2 - 6) clusters was reported in the region of 2950 - 3850 cm^(-1). The hydrogen bondings for the C-site and N-site binding, and among the water molecules were identified for n = 2 to 4. A spectral transition was observed for n = 5 and 6, implying that the anion was surface-bound onto the water aggregates in larger clusters.

The infrared predissociation spectroscopy of Br^-•(NH_3) and I^-•(NH_3)_n (n =1-3) clusters was reported in the region of 3050-3450 cm^(-1). For the Br^-•(NH_3) complex, a dominating ionic NH stretch appeared at 3175 cm^(-1), and the weaker free NH stretch appeared at 3348 cm^(-1). The observed spectrum was consistent to the structure in which there was one nearly linear hydrogen bond between Br^- and the NH_3 moiety. For the I^- •(NH_3) complex, five distinct IR absorption bands were observed in the spectrum. The spectrum was not consistent with basic frequency patterns of three geometries considered in the ab initio calculations - complex with one, two and three hydrogen bondings between I^- and the NH_3 moiety. Substantial inhomogenous broadening were displayed in the spectra for I^-•(NH_3)_n (n =2-3), suggesting the presence of multiple isomers.

The REMPI spectroscopy of the bound 4p ^2П 1/2 and ^2П 3/2 states, and the dissociative 3d ^2Σ^+ 1/2 state in the Al•Ar complex was reported. The dissociative spectrum at Al^+ channel suggested the coupling of the 4p ^2П 1/2,3/2 states to the repulsive 3d ^2Σ^+ 1/2 state. The spin-electronic coupling was further manifested in the dissociative Al^+ spectrum of the 3d ^2Σ^+ 1/2 state. Using the potential energy curves obtained from ab initio calculations, a bound → continuum Franck-Condon-intensity simulation was performed and compared with the one-photon 3d ^2Σ^+ 1/2 profile. The agreement provided evidence for the petturbation above the Al(3d)Ar dissociation limit, and the repulsive character of the 3d ^2Σ^+ 1/2 state.

New insights into the formation and modification of carbonate-bearing minerals and methane gas in geological systems using multiply substituted isotopologues

This thesis describes the use of multiply-substituted stable isotopologues of carbonate minerals and methane gas to better understand how these environmentally significant minerals and gases form and are modified throughout their geological histories. Stable isotopes have a long tradition in earth science as a tool for providing quantitative constraints on how molecules, in or on the earth, formed in both the present and past. Nearly all studies, until recently, have only measured the bulk concentrations of stable isotopes in a phase or species. However, the abundance of various isotopologues within a phase, for example the concentration of isotopologues with multiple rare isotopes (multiply substituted or 'clumped' isotopologues) also carries potentially useful information. Specifically, the abundances of clumped isotopologues in an equilibrated system are a function of temperature and thus knowledge of their abundances can be used to calculate a sample’s formation temperature. In this thesis, measurements of clumped isotopologues are made on both carbonate-bearing minerals and methane gas in order to better constrain the environmental and geological histories of various samples.

Clumped-isotope-based measurements of ancient carbonate-bearing minerals, including apatites, have opened up paleotemperature reconstructions to a variety of systems and time periods. However, a critical issue when using clumped-isotope based measurements to reconstruct ancient mineral formation temperatures is whether the samples being measured have faithfully recorded their original internal isotopic distributions. These original distributions can be altered, for example, by diffusion of atoms in the mineral lattice or through diagenetic reactions. Understanding these processes quantitatively is critical for the use of clumped isotopes to reconstruct past temperatures, quantify diagenesis, and calculate time-temperature burial histories of carbonate minerals. In order to help orient this part of the thesis, Chapter 2 provides a broad overview and history of clumped-isotope based measurements in carbonate minerals.

In Chapter 3, the effects of elevated temperatures on a sample’s clumped-isotope composition are probed in both natural and experimental apatites (which contain structural carbonate groups) and calcites. A quantitative model is created that is calibrated by the experiments and consistent with the natural samples. The model allows for calculations of the change in a sample’s clumped isotope abundances as a function of any time-temperature history.

In Chapter 4, the effects of diagenesis on the stable isotopic compositions of apatites are explored on samples from a variety of sedimentary phosphorite deposits. Clumped isotope temperatures and bulk isotopic measurements from carbonate and phosphate groups are compared for all samples. These results demonstrate that samples have experienced isotopic exchange of oxygen atoms in both the carbonate and phosphate groups. A kinetic model is developed that allows for the calculation of the amount of diagenesis each sample has experienced and yields insight into the physical and chemical processes of diagenesis.

The thesis then switches gear and turns its attention to clumped isotope measurements of methane. Methane is critical greenhouse gas, energy resource, and microbial metabolic product and substrate. Despite its importance both environmentally and economically, much about methane’s formational mechanisms and the relative sources of methane to various environments remains poorly constrained. In order to add new constraints to our understanding of the formation of methane in nature, I describe the development and application of methane clumped isotope measurements to environmental deposits of methane. To help orient the reader, a brief overview of the formation of methane in both high and low temperature settings is given in Chapter 5.

In Chapter 6, a method for the measurement of methane clumped isotopologues via mass spectrometry is described. This chapter demonstrates that the measurement is precise and accurate. Additionally, the measurement is calibrated experimentally such that measurements of methane clumped isotope abundances can be converted into equivalent formational temperatures. This study represents the first time that methane clumped isotope abundances have been measured at useful precisions.

In Chapter 7, the methane clumped isotope method is applied to natural samples from a variety of settings. These settings include thermogenic gases formed and reservoired in shales, migrated thermogenic gases, biogenic gases, mixed biogenic and thermogenic gas deposits, and experimentally generated gases. In all cases, calculated clumped isotope temperatures make geological sense as formation temperatures or mixtures of high and low temperature gases. Based on these observations, we propose that the clumped isotope temperature of an unmixed gas represents its formation temperature — this was neither an obvious nor expected result and has important implications for how methane forms in nature. Additionally, these results demonstrate that methane-clumped isotope compositions provided valuable additional constraints to studying natural methane deposits.