Estimation and inference for grasping and manipulation tasks using vision and kinesthetic sensors

This thesis presents a novel framework for state estimation in the context of robotic grasping and manipulation. The overall estimation approach is based on fusing various visual cues for manipulator tracking, namely appearance and feature-based, shape-based, and silhouette-based visual cues. Similarly, a framework is developed to fuse the above visual cues, but also kinesthetic cues such as force-torque and tactile measurements, for in-hand object pose estimation. The cues are extracted from multiple sensor modalities and are fused in a variety of Kalman filters.

A hybrid estimator is developed to estimate both a continuous state (robot and object states) and discrete states, called contact modes, which specify how each finger contacts a particular object surface. A static multiple model estimator is used to compute and maintain this mode probability. The thesis also develops an estimation framework for estimating model parameters associated with object grasping. Dual and joint state-parameter estimation is explored for parameter estimation of a grasped object's mass and center of mass. Experimental results demonstrate simultaneous object localization and center of mass estimation.

Dual-arm estimation is developed for two arm robotic manipulation tasks. Two types of filters are explored; the first is an augmented filter that contains both arms in the state vector while the second runs two filters in parallel, one for each arm. These two frameworks and their performance is compared in a dual-arm task of removing a wheel from a hub.

This thesis also presents a new method for action selection involving touch. This next best touch method selects an available action for interacting with an object that will gain the most information. The algorithm employs information theory to compute an information gain metric that is based on a probabilistic belief suitable for the task. An estimation framework is used to maintain this belief over time. Kinesthetic measurements such as contact and tactile measurements are used to update the state belief after every interactive action. Simulation and experimental results are demonstrated using next best touch for object localization, specifically a door handle on a door. The next best touch theory is extended for model parameter determination. Since many objects within a particular object category share the same rough shape, principle component analysis may be used to parametrize the object mesh models. These parameters can be estimated using the action selection technique that selects the touching action which best both localizes and estimates these parameters. Simulation results are then presented involving localizing and determining a parameter of a screwdriver.

Lastly, the next best touch theory is further extended to model classes. Instead of estimating parameters, object class determination is incorporated into the information gain metric calculation. The best touching action is selected in order to best discern between the possible model classes. Simulation results are presented to validate the theory.

Reaction of glucose catalyzed by framework and extraframework tin sites in zeolite beta

The isomerization of glucose into fructose is a large-scale reaction for the production of high-fructose corn syrup, and is now being considered as an intermediate step in the possible route of biomass conversion into fuels and chemicals. Recently, it has been shown that a hydrophobic, large pore, silica molecular sieve having the zeolite beta structure and containing framework Sn⁴⁺ (Sn-Beta) is able to isomerize glucose into fructose in aqueous media. Here, I have investigated how this catalyst converts glucose to fructose and show that it is analogous to that achieved with metalloenzymes. Specifically, glucose partitions into the molecular sieve in the pyranose form, ring opens to the acyclic form in the presence of the Lewis acid center (framework Sn⁴⁺), isomerizes into the acyclic form of fructose and finally ring closes to yield the furanose product. Akin to the metalloenzyme, the isomerization step proceeds by intramolecular hydride transfer from C2 to C1. Extraframework tin oxides located within hydrophobic channels of the molecular sieve that exclude liquid water can also isomerize glucose to fructose in aqueous media, but do so through a base-catalyzed proton abstraction mechanism. Extraframework tin oxide particles located at the external surface of the molecular sieve crystals or on amorphous silica supports are not active in aqueous media but are able to perform the isomerization in methanol by a base-catalyzed proton abstraction mechanism. Post-synthetic exchange of Na⁺ with Sn-Beta alters the glucose reaction pathway from the 1,2 intramolecular hydrogen shift (isomerization) to produce fructose towards the 1,2 intramolecular carbon shift (epimerization) that forms mannose. Na⁺ remains exchanged onto silanol groups during reaction in methanol solvent, leading to a near complete shift in selectivity towards glucose epimerization to mannose. In contrast, decationation occurs during reaction in aqueous solutions and gradually increases the reaction selectivity to isomerization at the expense of epimerization. Decationation and concomitant changes in selectivity can be eliminated by addition of NaCl to the aqueous reaction solution. Thus, framework tin sites with a proximal silanol group are the active sites for the 1, 2 intramolecular hydride shift in the isomerization of glucose to fructose, while these sites with Na-exchanged silanol group are the active sites for the 1, 2 intramolecular carbon shift in epimerization of glucose to mannose.

A retrofitting framework for pre-Northridge steel moment-frame buildings

In the 1994 M_w 6.7 Northridge and 1995 M_w 6.9 Kobe earthquakes, steel moment-frame buildings were exposed to an unexpected flaw. The commonly utilized welded unreinforced flange, bolted web connections were observed to experience brittle fractures in a number of buildings, even at low levels of seismic demand. A majority of these buildings have not been retrofitted and may be susceptible to structural collapse in a major earthquake.

This dissertation presents a case study of retrofitting a 20-story pre-Northridge steel moment-frame building. Twelve retrofit schemes are developed that present some range in degree of intervention. Three retrofitting techniques are considered: upgrading the brittle beam-to-column moment resisting connections, and implementing either conventional or buckling-restrained brace elements within the existing moment-frame bays. The retrofit schemes include some that are designed to the basic safety objective of ASCE-41 Seismic Rehabilitation of Existing Buildings.

Detailed finite element models of the base line building and the retrofit schemes are constructed. The models include considerations of brittle beam-to-column moment resisting connection fractures, column splice fractures, column baseplate fractures, accidental contributions from ``simple'' non-moment resisting beam-to-column connections to the lateral force-resisting system, and composite actions of beams with the overlying floor system. In addition, foundation interaction is included through nonlinear translational springs underneath basement columns.

To investigate the effectiveness of the retrofit schemes, the building models are analyzed under ground motions from three large magnitude simulated earthquakes that cause intense shaking in the greater Los Angeles metropolitan area, and under recorded ground motions from actual earthquakes. It is found that retrofit schemes that convert the existing moment-frames into braced-frames by implementing either conventional or buckling-restrained braces are effective in limiting structural damage and mitigating structural collapse. In the three simulated earthquakes, a 20% chance of simulated collapse is realized at PGV of around 0.6 m/s for the base line model, but at PGV of around 1.8 m/s for some of the retrofit schemes. However, conventional braces are observed to deteriorate rapidly. Hence, if a braced-frame that employs conventional braces survives a large earthquake, it is questionable how much service the braces provide in potential aftershocks.

A variational framework for spectral discretization of the density matrix in Kohn Sham density functional theory

Kohn-Sham density functional theory (KSDFT) is currently the main work-horse of quantum mechanical calculations in physics, chemistry, and materials science. From a mechanical engineering perspective, we are interested in studying the role of defects in the mechanical properties in materials. In real materials, defects are typically found at very small concentrations e.g., vacancies occur at parts per million, dislocation density in metals ranges from $10^{10} m^{-2}$ to $10^{15} m^{-2}$, and grain sizes vary from nanometers to micrometers in polycrystalline materials, etc. In order to model materials at realistic defect concentrations using DFT, we would need to work with system sizes beyond millions of atoms. Due to the cubic-scaling computational cost with respect to the number of atoms in conventional DFT implementations, such system sizes are unreachable. Since the early 1990s, there has been a huge interest in developing DFT implementations that have linear-scaling computational cost. A promising approach to achieving linear-scaling cost is to approximate the density matrix in KSDFT. The focus of this thesis is to provide a firm mathematical framework to study the convergence of these approximations. We reformulate the Kohn-Sham density functional theory as a nested variational problem in the density matrix, the electrostatic potential, and a field dual to the electron density. The corresponding functional is linear in the density matrix and thus amenable to spectral representation. Based on this reformulation, we introduce a new approximation scheme, called spectral binning, which does not require smoothing of the occupancy function and thus applies at arbitrarily low temperatures. We proof convergence of the approximate solutions with respect to spectral binning and with respect to an additional spatial discretization of the domain. For a standard one-dimensional benchmark problem, we present numerical experiments for which spectral binning exhibits excellent convergence characteristics and outperforms other linear-scaling methods.

A hybrid-parallel framework for the nonlinear seismic analysis of very tall buildings

FRAME3D, a program for the nonlinear seismic analysis of steel structures, has previously been used to study the collapse mechanisms of steel buildings up to 20 stories tall. The present thesis is inspired by the need to conduct similar analysis for much taller structures. It improves FRAME3D in two primary ways.

First, FRAME3D is revised to address specific nonlinear situations involving large displacement/rotation increments, the backup-subdivide algorithm, element failure, and extremely narrow joint hysteresis. The revisions result in superior convergence capabilities when modeling earthquake-induced collapse. The material model of a steel fiber is also modified to allow for post-rupture compressive strength.

Second, a parallel FRAME3D (PFRAME3D) is developed. The serial code is optimized and then parallelized. A distributed-memory divide-and-conquer approach is used for both the global direct solver and element-state updates. The result is an implicit finite-element hybrid-parallel program that takes advantage of the narrow-band nature of very tall buildings and uses nearest-neighbor-only communication patterns.

Using three structures of varied sized, PFRAME3D is shown to compute reproducible results that agree with that of the optimized 1-core version (displacement time-history response root-mean-squared errors are ~〖10〗^(-5) m) with much less wall time (e.g., a dynamic time-history collapse simulation of a 60-story building is computed in 5.69 hrs with 128 cores—a speedup of 14.7 vs. the optimized 1-core version). The maximum speedups attained are shown to increase with building height (as the total number of cores used also increases), and the parallel framework can be expected to be suitable for buildings taller than the ones presented here.

PFRAME3D is used to analyze a hypothetical 60-story steel moment-frame tube building (fundamental period of 6.16 sec) designed according to the 1994 Uniform Building Code. Dynamic pushover and time-history analyses are conducted. Multi-story shear-band collapse mechanisms are observed around mid-height of the building. The use of closely-spaced columns and deep beams is found to contribute to the building's “somewhat brittle” behavior (ductility ratio ~2.0). Overall building strength is observed to be sensitive to whether a model is fracture-capable.