Recovering Euclidean deformable models from stereo-motion

In this paper we present a novel structure from motion (SfM) approach able to infer 3D deformable models from uncalibrated stereo images. Using a stereo setup dramatically improves the 3D model estimation when the observed 3D shape is mostly deforming without undergoing strong rigid motion. Our approach first calibrates the stereo system automatically and then computes a single metric rigid structure for each frame. Afterwards, these 3D shapes are aligned to a reference view using a RANSAC method in order to compute the mean shape of the object and to select the subset of points on the object which have remained rigid throughout the sequence without deforming. The selected rigid points are then used to compute frame-wise shape registration and to extract the motion parameters robustly from frame to frame. Finally, all this information is used in a global optimization stage with bundle adjustment which allows to refine the frame-wise initial solution and also to recover the non-rigid 3D model. We show results on synthetic and real data that prove the performance of the proposed method even when there is no rigid motion in the original sequence

Online Robust 3D Mapping Using Structure from Motion Cues

This paper presents a complete solution for creating accurate 3D textured models from monocular video sequences. The methods are developed within the framework of sequential structure from motion, where a 3D model of the environment is maintained and updated as new visual information becomes available. The camera position is recovered by directly associating the 3D scene model with local image observations. Compared to standard structure from motion techniques, this approach decreases the error accumulation while increasing the robustness to scene occlusions and feature association failures. The obtained 3D information is used to generate high quality, composite visual maps of the scene (mosaics). The visual maps are used to create texture-mapped, realistic views of the scene

Overview of coded light projection techniques for automatic 3D profiling

Obtaining automatic 3D profile of objects is one of the most important issues in computer vision. With this information, a large number of applications become feasible: from visual inspection of industrial parts to 3D reconstruction of the environment for mobile robots. In order to achieve 3D data, range finders can be used. Coded structured light approach is one of the most widely used techniques to retrieve 3D information of an unknown surface. An overview of the existing techniques as well as a new classification of patterns for structured light sensors is presented. This kind of systems belong to the group of active triangulation method, which are based on projecting a light pattern and imaging the illuminated scene from one or more points of view. Since the patterns are coded, correspondences between points of the image(s) and points of the projected pattern can be easily found. Once correspondences are found, a classical triangulation strategy between camera(s) and projector device leads to the reconstruction of the surface. Advantages and constraints of the different patterns are discussed

An overview of the advantages and constraints of coded pattern projection techniques for autonomous navigation

The absolute necessity of obtaining 3D information of structured and unknown environments in autonomous navigation reduce considerably the set of sensors that can be used. The necessity to know, at each time, the position of the mobile robot with respect to the scene is indispensable. Furthermore, this information must be obtained in the least computing time. Stereo vision is an attractive and widely used method, but, it is rather limited to make fast 3D surface maps, due to the correspondence problem. The spatial and temporal correspondence among images can be alleviated using a method based on structured light. This relationship can be directly found codifying the projected light; then each imaged region of the projected pattern carries the needed information to solve the correspondence problem. We present the most significant techniques, used in recent years, concerning the coded structured light method

Modelatge procedural d’edificis

L’objectiu d’aquest PFC és el desenvolupament d’una eina pel modelatge procedural d’edificis i altres estructures arquitectòniques. El modelatge d’edificis és, per si sol, un bon tema on aplicar‐hi la programació procedural. Un edifici normal compte sempre amb elements que es repeteixen en altura i amplada. El fet de “repetir” una tasca suggereix sempre l’aplicació d’algun tipus de procediment per tal de simplificar i reduir la feina de l’usuari a l’hora de desenvolupar aquesta feina

Visualització de models fusionats

L’objectiu principal d’aquest projecte era implementar la visualització 3D demodels fusionats i aplicar totes les tècniques possibles per realitzar aquesta fusió. Aquestes tècniques s’integraran en la plataforma de visualització i processament de dades mèdiques STARVIEWER. Per assolir l’ objectiu principal s’ han definit els següents objectius específics:1- estudiar els algoritmes de visualització de models simples i analitzar els diferents paràmetres a tenir en compte. 2- ampliació de la tècnica de visualització bàsica seleccionada per tal de suportar els models fusionats. 3- avaluar i compar tots els mètodes implementats per poder determinar quin ofereix les millors visualitzacions

Segmentació de punts 3D rígids i no rígids obtinguts a partir d’un sistema estèreo

L’estudi consta de dues grans parts que serien la part de dissenyar, desenvolupar i implementar els mètodes de segmentació que ens serviran per separar els punts rígids dels punts no rígids/deformables. I l’altra part seria la d’obtenir reconstruccions 3D a partir d’un sistema estèreo, passant per la calibració de les càmeres del sistema, la realització de captures d’experiments reals, la generació de reconstruccions 3D per finalment posar a prova els mètodes desenvolupats en la part anterior

Desenvolupament d’un sistema de visió estereoscòpica per a la reconstrucció tridimensional d’objectes

El projecte consisteix en analitzar, dissenyar i desenvolupar un sistemaestèreo binocular (format per dues càmeres) sobre un suport que ofereixi la mobilitat iportabilitat necessària per utilitzar-lo de forma independent, és a dir, sense necessitat deconnexió a un ordinador, ja que normalment, els sistemes de visió per computador solenincorporar un ordinador amb un frame grabber (placa de captura d’imatges). Per a dur a terme elsistema estèreo més adient, s’analitzaran els requeriments necessaris, s’estudiaran diferentsalternatives, i finalment, es desenvoluparà i es demostrarà el funcionament del sistema en qüestió

Entorn de treball per a visualitzar escenes tridimensionals

Creació d'un entorn de treball per tal de visualitzar models tridimensionals en temps real amb dos objectius: proporcionar una interfície gràfica per poder visualitzar interactivament una escena, modificant-ne els seus elements i aconseguir un disseny que faci el projecte altament revisable i reutilitzable en elfutur, i serveixi per tant de plataforma per provar altres projectes

Navigator-gated coronary magnetic resonance angiography using steady-state-free-precession: comparison to standard T2-prepared gradient-echo and spiral imaging.

RATIONALE AND OBJECTIVES: Recent developments of magnetic resonance imaging enabled free-breathing coronary MRA (cMRA) using steady-state-free-precession (SSFP) for endogenous contrast. The purpose of this study was a systematic comparison of SSFP cMRA with standard T2-prepared gradient-echo and spiral cMRA. METHODS: Navigator-gated free-breathing T2-prepared SSFP-, T2-prepared gradient-echo- and T2-prepared spiral cMRA was performed in 18 healthy swine (45-68 kg body-weight). Image quality was investigated subjectively and signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR) and vessel sharpness were compared. RESULTS: SSFP cMRA allowed for high quality cMRA during free breathing with substantial improvements in SNR, CNR and vessel sharpness when compared with standard T2-prepared gradient-echo imaging. Spiral imaging demonstrated the highest SNR while image quality score and vessel definition was best for SSFP imaging. CONCLUSION: Navigator-gated free-breathing T2-prepared SSFP cMRA is a promising new imaging approach for high signal and high contrast imaging of the coronary arteries with improved vessel border definition.

Sistema d'estereovisió amb una càmera

Els sistemes de visió estèreo es basen en la reconstrucció per triangulació a partir de dues càmeres, permetent la representació d’objectes del món real en tres dimensions. L’objectiu d’aquest projecte consisteix a dissenyar i implementar un sistema estèreo amb una sola càmera amb dos petits vidres d’alta transmissivitat davant de la lent, utilitzant la teoria clàssica desenvolupada a partir de dues càmeres. D’aquesta forma obtindrem un sistema molt més compacte que en el cas de tenir dues càmeres, que serà apte per entorns molt reduïts i per escenes molt properes

Mapping complex tissue architecture with diffusion spectrum magnetic resonance imaging.

Methods are presented to map complex fiber architectures in tissues by imaging the 3D spectra of tissue water diffusion with MR. First, theoretical considerations show why and under what conditions diffusion contrast is positive. Using this result, spin displacement spectra that are conventionally phase-encoded can be accurately reconstructed by a Fourier transform of the measured signal's modulus. Second, studies of in vitro and in vivo samples demonstrate correspondence between the orientational maxima of the diffusion spectrum and those of the fiber orientation density at each location. In specimens with complex muscular tissue, such as the tongue, diffusion spectrum images show characteristic local heterogeneities of fiber architectures, including angular dispersion and intersection. Cerebral diffusion spectra acquired in normal human subjects resolve known white matter tracts and tract intersections. Finally, the relation between the presented model-free imaging technique and other available diffusion MRI schemes is discussed.

Practical signal-to-noise ratio quantification for sensitivity encoding: Application to coronary MR angiography.

Purpose: To develop and evaluate a practical method for the quantification of signal-to-noise ratio (SNR) on coronary MR angiograms (MRA) acquired with parallel imaging.Materials and Methods: To quantify the spatially varying noise due to parallel imaging reconstruction, a new method has been implemented incorporating image data acquisition followed by a fast noise scan during which radio-frequency pulses, cardiac triggering and navigator gating are disabled. The performance of this method was evaluated in a phantom study where SNR measurements were compared with those of a reference standard (multiple repetitions). Subsequently, SNR of myocardium and posterior skeletal muscle was determined on in vivo human coronary MRA.Results: In a phantom, the SNR measured using the proposed method deviated less than 10.1% from the reference method for small geometry factors (<= 2). In vivo, the noise scan for a 10 min coronary MRA acquisition was acquired in 30 s. Higher signal and lower SNR, due to spatially varying noise, were found in myocardium compared with posterior skeletal muscle.Conclusion: SNR quantification based on a fast noise scan is a validated and easy-to-use method when applied to three-dimensional coronary MRA obtained with parallel imaging as long as the geometry factor remains low.

Free-breathing renal magnetic resonance angiography with steady-state free-precession and slab-selective spin inversion combined with radial k-space sampling and water-selective excitation.

The impact of radial k-space sampling and water-selective excitation on a novel navigator-gated cardiac-triggered slab-selective inversion prepared 3D steady-state free-precession (SSFP) renal MR angiography (MRA) sequence was investigated. Renal MRA was performed on a 1.5-T MR system using three inversion prepared SSFP approaches: Cartesian (TR/TE: 5.7/2.8 ms, FA: 85 degrees), radial (TR/TE: 5.5/2.7 ms, FA: 85 degrees) SSFP, and radial SSFP combined with water-selective excitation (TR/TE: 9.9/4.9 ms, FA: 85 degrees). Radial data acquisition lead to significantly reduced motion artifacts (P < 0.05). SNR and CNR were best using Cartesian SSFP (P < 0.05). Vessel sharpness and vessel length were comparable in all sequences. The addition of a water-selective excitation could not improve image quality. In conclusion, radial k-space sampling reduces motion artifacts significantly in slab-selective inversion prepared renal MRA, while SNR and CNR are decreased. The addition of water-selective excitation could not improve the lower CNR in radial scanning.

Coronary MR imaging using free-breathing 3D steady-state free precession with radial k-space sampling.

PURPOSE: To investigate the potential of free-breathing 3D steady-state free precession (SSFP) imaging with radial k-space sampling for coronary MR-angiography (MRA), coronary projection MR-angiography and coronary vessel wall imaging. MATERIALS AND METHODS: A navigator-gated free-breathing T2-prepared 3D SSFP sequence (TR = 6.1 ms, TE = 3.0 ms, flip angle = 120 degrees, field-of-view = 360 mm(2)) with radial k-space sampling (384 radials) was implemented for coronary MRA. For projection coronary MRA, this sequence was combined with a 2D selective aortic spin tagging pulse. Coronary vessel wall imaging was performed using a high-resolution inversion-recovery black-blood 3D radial SSFP sequence (384 radials, TR = 5.3 ms, TE = 2.7 ms, flip angle = 55 degrees, reconstructed resolution 0.35 x 0.35 x 1.2 mm(3)) and a local re-inversion pulse. Six healthy volunteers (two for each sequence) were investigated. Motion artifact level was assessed by two radiologists. Results: In coronary MRA, the coronary lumen was displayed with a high signal and high contrast to the surrounding lumen. Projection coronary MRA demonstrated selective visualization of the coronary lumen while surrounding tissue was almost completely suppressed. In coronary vessel wall imaging, the vessel wall was displayed with a high signal when compared to the blood pool and the surrounding tissue. No visible motion artifacts were seen. Conclusion: 3D radial SSFP imaging enables coronary MRA, coronary projection MRA and coronary vessel wall imaging with a low motion artifact level.