Estimation and inference for grasping and manipulation tasks using vision and kinesthetic sensors

This thesis presents a novel framework for state estimation in the context of robotic grasping and manipulation. The overall estimation approach is based on fusing various visual cues for manipulator tracking, namely appearance and feature-based, shape-based, and silhouette-based visual cues. Similarly, a framework is developed to fuse the above visual cues, but also kinesthetic cues such as force-torque and tactile measurements, for in-hand object pose estimation. The cues are extracted from multiple sensor modalities and are fused in a variety of Kalman filters.

A hybrid estimator is developed to estimate both a continuous state (robot and object states) and discrete states, called contact modes, which specify how each finger contacts a particular object surface. A static multiple model estimator is used to compute and maintain this mode probability. The thesis also develops an estimation framework for estimating model parameters associated with object grasping. Dual and joint state-parameter estimation is explored for parameter estimation of a grasped object's mass and center of mass. Experimental results demonstrate simultaneous object localization and center of mass estimation.

Dual-arm estimation is developed for two arm robotic manipulation tasks. Two types of filters are explored; the first is an augmented filter that contains both arms in the state vector while the second runs two filters in parallel, one for each arm. These two frameworks and their performance is compared in a dual-arm task of removing a wheel from a hub.

This thesis also presents a new method for action selection involving touch. This next best touch method selects an available action for interacting with an object that will gain the most information. The algorithm employs information theory to compute an information gain metric that is based on a probabilistic belief suitable for the task. An estimation framework is used to maintain this belief over time. Kinesthetic measurements such as contact and tactile measurements are used to update the state belief after every interactive action. Simulation and experimental results are demonstrated using next best touch for object localization, specifically a door handle on a door. The next best touch theory is extended for model parameter determination. Since many objects within a particular object category share the same rough shape, principle component analysis may be used to parametrize the object mesh models. These parameters can be estimated using the action selection technique that selects the touching action which best both localizes and estimates these parameters. Simulation results are then presented involving localizing and determining a parameter of a screwdriver.

Lastly, the next best touch theory is further extended to model classes. Instead of estimating parameters, object class determination is incorporated into the information gain metric calculation. The best touching action is selected in order to best discern between the possible model classes. Simulation results are presented to validate the theory.

Geological evolution of two crustal scale shear zones. Part I. The Rand thrust complex, northwestern Mojave Desert, California. Part II. The Magdalena metamorphic core complex, north central Sonora, Mexico

The geology and structure of two crustal scale shear zones were studied to understand the partitioning of strain within intracontinental orogenic belts. Movement histories and regional tectonic implications are deduced from observational data. The two widely separated study areas bear the imprint of intense Late Mesozoic through Middle Cenozoic tectonic activity. A regional transition from Late Cretaceous-Early Tertiary plutonism, metamorphism, and shortening strain to Middle Tertiary extension and magmatism is preserved in each area, with contrasting environments and mechanisms. Compressional phases of this tectonic history are better displayed in the Rand Mountains, whereas younger extensional structures dominate rock fabrics in the Magdalena area.

In the northwestern Mojave desert, the Rand Thrust Complex reveals a stack of four distinctive tectonic plates offset along the Garlock Fault. The lowermost plate, Rand Schist, is composed of greenschist facies metagraywacke, metachert, and metabasalt. Rand Schist is structurally overlain by Johannesburg Gneiss (= garnet-amphibolite grade orthogneisses, marbles and quartzites), which in turn is overlain by a Late Cretaceous hornblende-biotite granodiorite. Biotite granite forms the fourth and highest plate. Initial assembly of the tectonic stack involved a Late Cretaceous? south or southwest vergent overthrusting event in which Johannesburg Gneiss was imbricated and attenuated between Rand Schist and hornblende-biotite granodiorite. Thrusting postdated metamorphism and deformation of the lower two plates in separate environments. A post-kinematic stock, the Late Cretaceous Randsburg Granodiorite, intrudes deep levels of the complex and contains xenoliths of both Rand Schist and mylonitized Johannesburg? gneiss. Minimum shortening implied by the map patterns is 20 kilometers.

Some low angle faults of the Rand Thrust Complex formed or were reactivated between Late Cretaceous and Early Miocene time. South-southwest directed mylonites derived from Johannesburg Gneiss are commonly overprinted by less penetrative north-northeast vergent structures. Available kinematic information at shallower structural levels indicates that late disturbance(s) culminated in northward transport of the uppermost plate. Persistence of brittle fabrics along certain structural horizons suggests a possible association of late movement(s) with regionally known detachment faults. The four plates were juxtaposed and significant intraplate movements had ceased prior to Early Miocene emplacement of rhyolite porphyry dikes.

In the Magdalena region of north central Sonora, components of a pre-Middle Cretaceous stratigraphy are used as strain markers in tracking the evolution of a long lived orogenic belt. Important elements of the tectonic history include: (1) Compression during the Late Cretaceous and Early Tertiary, accompanied by plutonism, metamorphism, and ductile strain at depth, and thrust driven? syntectonic sedimentation at the surface. (2) Middle Tertiary transition to crustal extension, initially recorded by intrusion of leucogranites, inflation of the previously shortened middle and upper crustal section, and surface volcanism. (3) Gravity induced development of a normal sense ductile shear zone at mid crustal levels, with eventual detachment and southwestward displacement of the upper crustal stratigraphy by Early Miocene time.

Elucidation of the metamorphic core complex evolution just described was facilitated by fortuitous preservation of a unique assemblage of rocks and structures. The "type" stratigraphy utilized for regional correlation and strain analysis includes a Jurassic volcanic arc assemblage overlain by an Upper Jurassic-Lower Cretaceous quartz pebble conglomerate, in turn overlain by marine strata with fossiliferous Aptian-Albian limestones. The Jurassic strata, comprised of (a) rhyolite porphyries interstratified with quartz arenites, (b) rhyolite cobble conglomerate, and (c) intrusive granite porphyries, are known to rest on Precambrian basement north and east of the study area. The quartz pebble conglomerate is correlated with the Glance Conglomerate of southeastern Arizona and northeastern Sonora. The marine sequence represents part of an isolated arm? of the Bisbee Basin.

Crosscutting structural relationships between the pre-Middle Cretaceous supracrustal section, younger plutons, and deformational fabrics allow the tectonic sequence to be determined. Earliest phases of a Late Cretaceous-Early Tertiary orogeny are marked by emplacement of the 78 ± 3 Ma Guacomea Granodiorite (U/Pb zircon, Anderson et al., 1980) as a sill into deep levels of the layered Jurassic series. Subsequent regional metamorphism and ductile strain is recorded by a penetrative schistosity and lineation, and east-west trending folds. These fabrics are intruded by post-kinematic Early Tertiary? two mica granites. At shallower crustal levels, the orogeny is represented by north directed thrust faulting, formation of a large intermontane basin, and development of a pronounced unconformity. A second important phase of ductile strain followed Middle Tertiary? emplacement of leucogranites as sills and northwest trending dikes into intermediate levels of the deformed section (surficial volcanism was also active during this transitional period to regional extension). Gravitational instabilities resulting from crustal swelling via intrusion and thermal expansion led to development of a ductile shear zone within the stratigraphic horizon occupied by a laterally extensive leucogranite sill. With continued extension, upper crustal brittle normal faults (detachment faults) enhanced the uplift and tectonic denudation of this mylonite zone, ultimately resulting in southwestward displacement of the upper crustal stratigraphy.

Strains associated with the two ductile deformation events have been successfully partitioned through a multifaceted analysis. R_f/Ø measurements on various markers from the "type" stratigraphy allow a gradient representing cumulative strain since Middle Cretaceous time to be determined. From this gradient, noncoaxial strains accrued since emplacement of the leucogranites may be removed. Irrotational components of the postleucogranite strain are measured from quartz grain shapes in deformed granites; rotational components (shear strains) are determined from S-C fabrics and from restoration of rotated dike and vein networks. Structural observations and strain data are compatable with a deformation path of: (1) coaxial strain (pure shear?), followed by (2) injection of leucogranites as dikes (perpendicular to the minimum principle stress) and sills (parallel to the minimum principle stress), then (3) southwest directed simple shear. Modeling the late strain gradient as a simple shear zone permits a minimum displacement of 10 kilometers on the Magdalena mylonite zone/detachment fault system. Removal of the Middle Tertiary noncoaxial strains yields a residual (or pre-existing) strain gradient representative of the Late Cretaceous-Early Tertiary deformation. Several partially destrained cross sections, restored to the time of leucogranite emplacement, illustrate the idea that the upper plate of the core complex bas been detached from a region of significant topographic relief. 50% to 100% bulk extension across a 50 kilometer wide corridor is demonstrated.

Late Cenozoic tectonics of the Magdalena region are dominated by Basin and Range style faulting. Northeast and north-northwest trending high angle normal faults have interacted to extend the crust in an east-west direction. Net extension for this period is minor (10% to 15%) in comparison to the Middle Tertiary detachment related extensional episode.

Structure-Guided Design and Biophysical Characterization of Novel Anti-HIV Reagents

Despite over 30 years of effort, an HIV-1 vaccine that elicits protective antibodies still does not exist. Recent clinical studies have identified that during natural infection about 20% of the population is capable of mounting a potent and protective antibody response. Closer inspection of these individuals reveal that a subset of these antibodies, recently termed potent VRC01-like (PVL), derive exclusively from a single human germline heavy chain gene. Induced clonal expansion of the B cell encoding this gene is the first step through which PVL antibodies may be elicited. Unfortunately, naturally occurring HIV gp120s fail to bind to this germline, and as a result cannot be used as the initial prime for a vaccine regimen. We have determined the crystal structure of an important germline antibody that is a promising target for vaccine design efforts, and have set out to engineer a more likely candidate using computationally-guided rational design.

In addition to prevention efforts on the side of vaccine design, recently characterized broadly neutralizing anti-HIV antibodies have excellent potential for use in gene therapy and passive immunotherapy. The separation distance between functional Fabs on an antibody is important due to the sparse distribution of envelop spikes on HIV compared to other viruses. We set out to build and characterize novel antibody architectures by incorporating structured linkers into the hinge region of an anti-HIV antibody b12. The goal was to observe whether these linkers increased the arm-span of the IgG dimer. When incorporated, flexible Gly4Ser repeats did not result in detectable extensions of the IgG antigen binding domains, by contrast to linkers including more rigid domains such as β2-microglobulin, Zn-α2-glycoprotein, and tetratricopeptide repeats (TPRs). This study adds an additional set of linkers with varying lengths and rigidities to the available linker repertoire, which may be useful for the modification and construction of antibodies and other fusion proteins.

Organization and function of the phage Lambda chromosome

The process of prophage integration by phage λ and the function and structure of the chromosomal elements required for λ integration have been studied with the use of λ deletion mutants. Since att^φ, the substrate of the integration enzymes, is not essential for λ growth, and since att^φ resides in a portion of the λ chromosome which is not necessary for vegetative growth, viable λ deletion mutants were isolated and examined to dissect the structure of att^φ.

Deletion mutants were selected from wild type populations by treating the phage under conditions where phage are inactivated at a rate dependent on the DNA content of the particles. A number of deletion mutants were obtained in this way, and many of these mutants proved to have defects in integration. These defects were defined by analyzing the properties of Int-promoted recombination in these att mutants.

The types of mutants found and their properties indicated that att^φ has three components: a cross-over point which is bordered on either side by recognition elements whose sequence is specifically required for normal integration. The interactions of the recognition elements in Int-promoted recombination between att mutants was examined and proved to be quite complex. In general, however, it appears that the λ integration system can function with a diverse array of mutant att sites.

The structure of att^φ was examined by comparing the genetic properties of various att mutants with their location in the λ chromosome. To map these mutants, the techniques of heteroduplex DNA formation and electron microscopy were employed. It was found that integration cross-overs occur at only one point in att^φ and that the recognition sequences that direct the integration enzymes to their site of action are quite small, less than 2000 nucleotides each. Furthermore, no base pair homology was detected between att^φ and its bacterial analog, att^B. This result clearly demonstrates that λ integration can occur between chromosomes which have little, if any, homology. In this respect, λ integration is unique as a system of recombination since most forms of generalized recombination require extensive base pair homology.

An additional study on the genetic and physical distances in the left arm of the λ genome was described. Here, a large number of conditional lethal nonsense mutants were isolated and mapped, and a genetic map of the entire left arm, comprising a total of 18 genes, was constructed. Four of these genes were discovered in this study. A series of λdg transducing phages was mapped by heteroduplex electron microscopy and the relationship between physical and genetic distances in the left arm was determined. The results indicate that recombination frequency in the left arm is an accurate reflection of physical distances, and moreover, there do not appear to be any undiscovered genes in this segment of the genome.

Deep near-infrared spectroscopy of high-redshift galaxies: the physical growth of passive systems

The assembly history of massive galaxies is one of the most important aspects of galaxy formation and evolution. Although we have a broad idea of what physical processes govern the early phases of galaxy evolution, there are still many open questions. In this thesis I demonstrate the crucial role that spectroscopy can play in a physical understanding of galaxy evolution. I present deep near-infrared spectroscopy for a sample of high-redshift galaxies, from which I derive important physical properties and their evolution with cosmic time. I take advantage of the recent arrival of efficient near-infrared detectors to target the rest-frame optical spectra of z > 1 galaxies, from which many physical quantities can be derived. After illustrating the applications of near-infrared deep spectroscopy with a study of star-forming galaxies, I focus on the evolution of massive quiescent systems.

Most of this thesis is based on two samples collected at the W. M. Keck Observatory that represent a significant step forward in the spectroscopic study of z > 1 quiescent galaxies. All previous spectroscopic samples at this redshift were either limited to a few objects, or much shallower in terms of depth. Our first sample is composed of 56 quiescent galaxies at 1 < z < 1.6 collected using the upgraded red arm of the Low Resolution Imaging Spectrometer (LRIS). The second consists of 24 deep spectra of 1.5 < z < 2.5 quiescent objects observed with the Multi-Object Spectrometer For Infra-Red Exploration (MOSFIRE). Together, these spectra span the critical epoch 1 < z < 2.5, where most of the red sequence is formed, and where the sizes of quiescent systems are observed to increase significantly.

We measure stellar velocity dispersions and dynamical masses for the largest number of z > 1 quiescent galaxies to date. By assuming that the velocity dispersion of a massive galaxy does not change throughout its lifetime, as suggested by theoretical studies, we match galaxies in the local universe with their high-redshift progenitors. This allows us to derive the physical growth in mass and size experienced by individual systems, which represents a substantial advance over photometric inferences based on the overall galaxy population. We find a significant physical growth among quiescent galaxies over 0 < z < 2.5 and, by comparing the slope of growth in the mass-size plane dlogR_e/dlogM_∗ with the results of numerical simulations, we can constrain the physical process responsible for the evolution. Our results show that the slope of growth becomes steeper at higher redshifts, yet is broadly consistent with minor mergers being the main process by which individual objects evolve in mass and size.

By fitting stellar population models to the observed spectroscopy and photometry we derive reliable ages and other stellar population properties. We show that the addition of the spectroscopic data helps break the degeneracy between age and dust extinction, and yields significantly more robust results compared to fitting models to the photometry alone. We detect a clear relation between size and age, where larger galaxies are younger. Therefore, over time the average size of the quiescent population will increase because of the contribution of large galaxies recently arrived to the red sequence. This effect, called progenitor bias, is different from the physical size growth discussed above, but represents another contribution to the observed difference between the typical sizes of low- and high-redshift quiescent galaxies. By reconstructing the evolution of the red sequence starting at z ∼ 1.25 and using our stellar population histories to infer the past behavior to z ∼ 2, we demonstrate that progenitor bias accounts for only half of the observed growth of the population. The remaining size evolution must be due to physical growth of individual systems, in agreement with our dynamical study.

Finally, we use the stellar population properties to explore the earliest periods which led to the formation of massive quiescent galaxies. We find tentative evidence for two channels of star formation quenching, which suggests the existence of two independent physical mechanisms. We also detect a mass downsizing, where more massive galaxies form at higher redshift, and then evolve passively. By analyzing in depth the star formation history of the brightest object at z > 2 in our sample, we are able to put constraints on the quenching timescale and on the properties of its progenitor.

A consistent picture emerges from our analyses: massive galaxies form at very early epochs, are quenched on short timescales, and then evolve passively. The evolution is passive in the sense that no new stars are formed, but significant mass and size growth is achieved by accreting smaller, gas-poor systems. At the same time the population of quiescent galaxies grows in number due to the quenching of larger star-forming galaxies. This picture is in agreement with other observational studies, such as measurements of the merger rate and analyses of galaxy evolution at fixed number density.