Algebraic Functions For Recognition

In the general case, a trilinear relationship between three perspective views is shown to exist. The trilinearity result is shown to be of much practical use in visual recognition by alignment --- yielding a direct method that cuts through the computations of camera transformation, scene structure and epipolar geometry. The proof of the central result may be of further interest as it demonstrates certain regularities across homographies of the plane and introduces new view invariants. Experiments on simulated and real image data were conducted, including a comparative analysis with epipolar intersection and the linear combination methods, with results indicating a greater degree of robustness in practice and a higher level of performance in re-projection tasks.

A Unified Statistical and Information Theoretic Framework for Multi-modal Image Registration

We formulate and interpret several multi-modal registration methods in the context of a unified statistical and information theoretic framework. A unified interpretation clarifies the implicit assumptions of each method yielding a better understanding of their relative strengths and weaknesses. Additionally, we discuss a generative statistical model from which we derive a novel analysis tool, the "auto-information function", as a means of assessing and exploiting the common spatial dependencies inherent in multi-modal imagery. We analytically derive useful properties of the "auto-information" as well as verify them empirically on multi-modal imagery. Among the useful aspects of the "auto-information function" is that it can be computed from imaging modalities independently and it allows one to decompose the search space of registration problems.

The Role of Fixation and Visual Attention in Object Recognition

This research project is a study of the role of fixation and visual attention in object recognition. In this project, we build an active vision system which can recognize a target object in a cluttered scene efficiently and reliably. Our system integrates visual cues like color and stereo to perform figure/ground separation, yielding candidate regions on which to focus attention. Within each image region, we use stereo to extract features that lie within a narrow disparity range about the fixation position. These selected features are then used as input to an alignment-style recognition system. We show that visual attention and fixation significantly reduce the complexity and the false identifications in model-based recognition using Alignment methods. We also demonstrate that stereo can be used effectively as a figure/ground separator without the need for accurate camera calibration.

Sequential Optimal Recovery: A Paradigm for Active Learning

In most classical frameworks for learning from examples, it is assumed that examples are randomly drawn and presented to the learner. In this paper, we consider the possibility of a more active learner who is allowed to choose his/her own examples. Our investigations are carried out in a function approximation setting. In particular, using arguments from optimal recovery (Micchelli and Rivlin, 1976), we develop an adaptive sampling strategy (equivalent to adaptive approximation) for arbitrary approximation schemes. We provide a general formulation of the problem and show how it can be regarded as sequential optimal recovery. We demonstrate the application of this general formulation to two special cases of functions on the real line 1) monotonically increasing functions and 2) functions with bounded derivative. An extensive investigation of the sample complexity of approximating these functions is conducted yielding both theoretical and empirical results on test functions. Our theoretical results (stated insPAC-style), along with the simulations demonstrate the superiority of our active scheme over both passive learning as well as classical optimal recovery. The analysis of active function approximation is conducted in a worst-case setting, in contrast with other Bayesian paradigms obtained from optimal design (Mackay, 1992).

Effects of Air Pollution Control on Climate

Urban air pollution and climate are closely connected due to shared generating processes (e.g., combustion) for emissions of the driving gases and aerosols. They are also connected because the atmospheric lifecycles of common air pollutants such as CO, NOx and VOCs, and of the climatically important methane gas (CH4) and sulfate aerosols, both involve the fast photochemistry of the hydroxyl free radical (OH). Thus policies designed to address air pollution may impact climate and vice versa. We present calculations using a model coupling economics, atmospheric chemistry, climate and ecosystems to illustrate some effects of air pollution policy alone on global warming. We consider caps on emissions of NOx, CO, volatile organic carbon, and SOx both individually and combined in two ways. These caps can lower ozone causing less warming, lower sulfate aerosols yielding more warming, lower OH and thus increase CH4 giving more warming, and finally, allow more carbon uptake by ecosystems leading to less warming. Overall, these effects significantly offset each other suggesting that air pollution policy has a relatively small net effect on the global mean surface temperature and sea level rise. However, our study does not account for the effects of air pollution policies on overall demand for fossil fuels and on the choice of fuels (coal, oil, gas), nor have we considered the effects of caps on black carbon or organic carbon aerosols on climate. These effects, if included, could lead to more substantial impacts of capping pollutant emissions on global temperature and sea level than concluded here. Caps on aerosols in general could also yield impacts on other important aspects of climate beyond those addressed here, such as the regional patterns of cloudiness and precipitation.