Dense disparity map estimation respecting image discontinuities

[EN] We present an energy based approach to estimate a dense disparity map from a set of two weakly calibrated stereoscopic images while preserving its discontinuities resulting from image boundaries. We first derive a simplified expression for the disparity that allows us to estimate it from a stereo pair of images using an energy minimization approach. We assume that the epipolar geometry is known, and we include this information in the energy model. Discontinuities are preserved by means of a regularization term based on the Nagel-Enkelmann operator. We investigate the associated Euler-Lagrange equation of the energy functional, and we approach the solution of the underlying partial differential equation (PDE) using a gradient descent method The resulting parabolic problem has a unique solution. In order to reduce the risk to be trapped within some irrelevant local minima during the iterations, we use a focusing strategy based on a linear scalespace. Experimental results on both synthetic and real images arere presented to illustrate the capabilities of this PDE and scale-space based method.

Paralelización del código de desenredo y suavizado de mallas de tetraedros "S.U.S Code"

Máster Universitario en Sistemas Inteligentes y Aplicaciones Numéricas en Ingeniería (SIANI)

Historia de la morfogénesis granítica

[EN] From the moment a granitic magma begins to cool until it is solidified it is subjected to stress and strain, producing the various discontinuities that can be seen in the finally exposed rock. When as a result of the erosion of superincumbent rocks the granite is at or near the land surface these discontinuities are exploited by weathering. Such features, and particularly those related to fractures or diaclases, outline forms that are considered here as primary endogenous forms. Once the rock is in the earth surface, various external agencies first soil weathering and later others as gravity, rivers, waves, glaciers, frost, wind, attack the rock to produce new suites of forms that are considered here as primary exogenous either etched or subaerial features. Such primary forms, both endogenous and exogenous, can evolve morphologically further as a result of subaerial weathering and erosion, becoming secondary endogenous or secondary exogenous forms. Exceptionally, some primary, either exogenous or endogenous, features can survive to successive morphogenetic episodes either below sedimentary burial or just subaerially without appreciable modification by external agencies being considered as inherited forms. Only the discernment of all these types of landforms allows the complete understanding of the geomorphological history of the area in which they occur.

Estimación del movimiento de objetos en secuencias de imágenes de intensidad y profundidad

Máster Universitario en Sistemas Inteligentes y Aplicaciones Numéricas en Ingeniería (SIANI)

TV-L1 optical flow estimation

[EN] This article describes an implementation of the optical flow estimation method introduced by Zach, Pock and Bischof. This method is based on the minimization of a functional containing a data term using the L norm and a regularization term using the total variation of the flow. The main feature of this formulation is that it allows discontinuities in the flow field, while being more robust to noise than the classical approach. The algorithm is an efficient numerical scheme, which solves a relaxed version of the problem by alternate minimization.

A variational approach to 3D geometry reconstruction from two or multiple views

[EN] In the last years we have developed some methods for 3D reconstruction. First we began with the problem of reconstructing a 3D scene from a stereoscopic pair of images. We developed some methods based on energy functionals which produce dense disparity maps by preserving discontinuities from image boundaries. Then we passed to the problem of reconstructing a 3D scene from multiple views (more than 2). The method for multiple view reconstruction relies on the method for stereoscopic reconstruction. For every pair of consecutive images we estimate a disparity map and then we apply a robust method that searches for good correspondences through the sequence of images. Recently we have proposed several methods for 3D surface regularization. This is a postprocessing step necessary for smoothing the final surface, which could be afected by noise or mismatch correspondences. These regularization methods are interesting because they use the information from the reconstructing process and not only from the 3D surface. We have tackled all these problems from an energy minimization approach. We investigate the associated Euler-Lagrange equation of the energy functional, and we approach the solution of the underlying partial differential equation (PDE) using a gradient descent method.

A PDE model for computing the optical flow

[EN] In this paper we present a new model for optical flow calculation using a variational formulation which preserves discontinuities of the flow much better than classical methods. We study the Euler-Lagrange equations asociated to the variational problem. In the case of quadratic energy, we show the existence and uniqueness of the corresponding evolution problem. Since our method avoid linearization in the optical flow constraint, it can recover large displacement in the scene. We avoid convergence to irrelevant local minima by embedding our method into a linear scale-space framework and using a focusing strategy from coarse to fine scales.

Regularizing a set of unstructured 3D points from a sequence of stereo images

[EN] In this paper we present a method for the regularization of a set of unstructured 3D points obtained from a sequence of stereo images. This method takes into account the information supplied by the disparity maps computed between pairs of images to constraint the regularization of the set of 3D points. We propose a model based on an energy which is composed of two terms: an attachment term that minimizes the distance from 3D points to the projective lines of camera points, and a second term that allows for the regularization of the set of 3D points by preserving discontinuities presented on the disparity maps. We embed this energy in a 2D finite element method. After minimizing, this method results in a large system of equations that can be optimized for fast computations. We derive an efficient implicit numerical scheme which reduces the number of calculations and memory allocations.

Reconstrucción 3-D a partir de un par estéreo de imágenes en color utilizando ecuaciones en derivadas parciales

[ES] En este trabajo proponemos un nuevo modelo para el cálculo de la disparidad y la reconstrucción 3-D a partir de un sistema estéreo compuesto por 2 imágenes en color. Proponemos un nuevo modelo para el cálculo de la disparidad basado en un criterio de energía. Para calcular los mínimos de este funcional de energía utilizamos la ecuación en derivadas parciales de Euler-Langrage asociada. Este modelo es una extensión a imágenes color del modelo desarrollado en "L. Alvarez, R. Deriche, J. Sánchez and J. Weickert, Dense disparity map estimation respecting image discontinuities : A PDE and Scale-Space Based Approach. INRIA Rapport de Recherche Nº 3874, 2000". Con algunos cambios en la estrategia parav evitar caer en mínimos locales de la energía. Por último presentamos algunas experiencias numéricas de la reconstrucción 3-D obtenida con este método en algunos pares estéreos de imágenes reales.

Regularization strategies for discontinuity-preserving optical flow methods

[EN]The aim of this work is to study several strategies for the preservation of flow discontinuities in variational optical flow methods. We analyze the combination of robust functionals and diffusion tensors in the smoothness assumption. Our study includes the use of tensors based on decreasing functions, which has shown to provide good results. However, it presents several limitations and usually does not perform better than other basic approaches. It typically introduces instabilities in the computed motion fields in the form of independent \textit{blobs} of vectors with large magnitude...