Regularizing a set of unstructured 3D points from a sequence of stereo images

[EN] In this paper we present a method for the regularization of a set of unstructured 3D points obtained from a sequence of stereo images. This method takes into account the information supplied by the disparity maps computed between pairs of images to constraint the regularization of the set of 3D points. We propose a model based on an energy which is composed of two terms: an attachment term that minimizes the distance from 3D points to the projective lines of camera points, and a second term that allows for the regularization of the set of 3D points by preserving discontinuities presented on the disparity maps. We embed this energy in a 2D finite element method. After minimizing, this method results in a large system of equations that can be optimized for fast computations. We derive an efficient implicit numerical scheme which reduces the number of calculations and memory allocations.

The STEREO/PLASTIC response to solar wind ions (Flight measurements and models)

The Plasma and Supra-Thermal Ion Composition (PLASTIC) instrument is one of four experiment packages on board of the two identical STEREO spacecraft A and B, which were successfully launched from Cape Canaveral on 26 October 2006. During the two years of the nominal STEREO mission, PLASTIC is providing us with the plasma characteristics of protons, alpha particles, and heavy ions. PLASTIC will also provide key diagnostic measurements in the form of the mass and charge state composition of heavy ions. Three measurements (E/qk, time of flight, ESSD) from the pulse height raw data are used to characterize the solar wind ions from the solar wind sector, and part of the suprathermal particles from the wide-angle partition with respect to mass, atomic number and charge state. In this paper, we present a new method for flight data analysis based on simulations of the PLASTIC response to solar wind ions. We present the response of the entrance system / energy analyzer in an analytical form. Based on stopping power theory, we use an analytical expression for the energy loss of the ions when they pass through a thin carbon foil. This allows us to model analytically the response of the time of flight mass spectrometer to solar wind ions. Thus we present a new version of the analytical response of the solid state detectors to solar wind ions. Various important parameters needed for our models were derived, based on calibration data and on the first flight measurements obtained from STEREO-A. We used information from each measured event that is registered in full resolution in the Pulse Height Analysis words and we derived a new algorithm for the analysis of both existing and future data sets of a similar nature which was tested and works well. This algorithm allows us to obtain, for each measured event, the mass, atomic number and charge state in the correct physical units. Finally, an important criterion was developed for filtering our Fe raw flight data set from the pulse height data without discriminating charge states.

Interactive Augmentation of Live Images using a HDR Stereo Camera

Adding virtual objects to real environments plays an important role in todays computer graphics: Typical examples are virtual furniture in a real room and virtual characters in real movies. For a believable appearance, consistent lighting of the virtual objects is required. We present an augmented reality system that displays virtual objects with consistent illumination and shadows in the image of a simple webcam. We use two high dynamic range video cameras with fisheye lenses permanently recording the environment illumination. A sampling algorithm selects a few bright parts in one of the wide angle images and the corresponding points in the second camera image. The 3D position can then be calculated using epipolar geometry. Finally, the selected point lights are used in a multi pass algorithm to draw the virtual object with shadows. To validate our approach, we compare the appearance and shadows of the synthetic objects with real objects.

High Resolution Image Correspondences for Video Post-Production

We present an algorithm for estimating dense image correspondences. Our versatile approach lends itself to various tasks typical for video post-processing, including image morphing, optical flow estimation, stereo rectification, disparity/depth reconstruction, and baseline adjustment. We incorporate recent advances in feature matching, energy minimization, stereo vision, and data clustering into our approach. At the core of our correspondence estimation we use Efficient Belief Propagation for energy minimization. While state-of-the-art algorithms only work on thumbnail-sized images, our novel feature downsampling scheme in combination with a simple, yet efficient data term compression, can cope with high-resolution data. The incorporation of SIFT (Scale-Invariant Feature Transform) features into data term computation further resolves matching ambiguities, making long-range correspondence estimation possible. We detect occluded areas by evaluating the correspondence symmetry, we further apply Geodesic matting to automatically determine plausible values in these regions.