Online Robust 3D Mapping Using Structure from Motion Cues

This paper presents a complete solution for creating accurate 3D textured models from monocular video sequences. The methods are developed within the framework of sequential structure from motion, where a 3D model of the environment is maintained and updated as new visual information becomes available. The camera position is recovered by directly associating the 3D scene model with local image observations. Compared to standard structure from motion techniques, this approach decreases the error accumulation while increasing the robustness to scene occlusions and feature association failures. The obtained 3D information is used to generate high quality, composite visual maps of the scene (mosaics). The visual maps are used to create texture-mapped, realistic views of the scene

Accuracy estimation of a new omnidirectional 3D vision sensor

We present a computer vision system that associates omnidirectional vision with structured light with the aim of obtaining depth information for a 360 degrees field of view. The approach proposed in this article combines an omnidirectional camera with a panoramic laser projector. The article shows how the sensor is modelled and its accuracy is proved by means of experimental results. The proposed sensor provides useful information for robot navigation applications, pipe inspection, 3D scene modelling etc

Overview of coded light projection techniques for automatic 3D profiling

Obtaining automatic 3D profile of objects is one of the most important issues in computer vision. With this information, a large number of applications become feasible: from visual inspection of industrial parts to 3D reconstruction of the environment for mobile robots. In order to achieve 3D data, range finders can be used. Coded structured light approach is one of the most widely used techniques to retrieve 3D information of an unknown surface. An overview of the existing techniques as well as a new classification of patterns for structured light sensors is presented. This kind of systems belong to the group of active triangulation method, which are based on projecting a light pattern and imaging the illuminated scene from one or more points of view. Since the patterns are coded, correspondences between points of the image(s) and points of the projected pattern can be easily found. Once correspondences are found, a classical triangulation strategy between camera(s) and projector device leads to the reconstruction of the surface. Advantages and constraints of the different patterns are discussed

Implementation of a robust coded structured light technique for dynamic 3D measurements

This paper presents the implementation details of a coded structured light system for rapid shape acquisition of unknown surfaces. Such techniques are based on the projection of patterns onto a measuring surface and grabbing images of every projection with a camera. Analyzing the pattern deformations that appear in the images, 3D information of the surface can be calculated. The implemented technique projects a unique pattern so that it can be used to measure moving surfaces. The structure of the pattern is a grid where the color of the slits are selected using a De Bruijn sequence. Moreover, since both axis of the pattern are coded, the cross points of the grid have two codewords (which permits to reconstruct them very precisely), while pixels belonging to horizontal and vertical slits have also a codeword. Different sets of colors are used for horizontal and vertical slits, so the resulting pattern is invariant to rotation. Therefore, the alignment constraint between camera and projector considered by a lot of authors is not necessary

Using 3D surface datasets to understand landslide evolution: From analogue models to real case study

Early detection of landslide surface deformation with 3D remote sensing techniques, as TLS, has become a great challenge during last decade. To improve our understanding of landslide deformation, a series of analogue simulation have been carried out on non-rigid bodies coupled with 3D digitizer. All these experiments have been carried out under controlled conditions, as water level and slope angle inclination. We were able to follow 3D surface deformation suffered by complex landslide bodies from precursory deformation still larger failures. These experiments were the basis for the development of a new algorithm for the quantification of surface deformation using automatic tracking method on discrete points of the slope surface. To validate the algorithm, comparisons were made between manually obtained results and algorithm surface displacement results. Outputs will help in understanding 3D deformation during pre-failure stages and failure mechanisms, which are fundamental aspects for future implementation of 3D remote sensing techniques in early warning systems.

Mòdul de visualització 3D d’ ajuda al diagnòstic de les neoplàsies rectals

El diagnòstic mitjançant la imatge mèdica s’ha convertit en una eina fonamental en la pràctica clínica, permet entre altres coses, reconstruir a partir d’un conjunt d’imatges 2D, obtingudes a partir d’aparells de captació, qualsevol part de l’organisme d’un pacient i representar-lo en un model 3D. Sobre aquest model 3D poden realitzar-se diferents operacions que faciliten el diagnòstic i la presa de decisions als especialistes. El projecte que es presenta forma part del desenvolupament de la plataforma informàtica de visualització i tractament de dades mèdiques, anomenada Starviewer, que desenvolupen conjuntament el laboratori de Gràfics i Imatge (GiLab) de la Universitat de Girona i l’ Institut de Diagnòstic per la Imatge (IDI) de l’Hospital Josep Trueta de Girona. En particular, en aquest projecte es centra en el diagnòstic del càncer colorectal i el desenvolupament de mètodes i tècniques de suport al seu diagnòstic. Els dos punts claus en el tractament d’aqueta patologia són: la detecció de les lesions I l’estudi de l’evolució d’aquestes lesions, una vegada s’ha iniciat el tractament tumoral. L’objectiu principal d’aquest projecte és implementar i integrar en la plataforma Starviewer les tècniques de visualització i processament de dades necessàries per donar suport als especialistes en el diagnòstic de les lesions del colon. Donada la dificultat en el processament de les dades reals del budell ens proposem: dissenyar i implementar un sistema per crear models sintètics del budell; estudiar, implementar i avaluar les tècniques de processament d’imatge que calen per segmentar lesions de budell; dissenyar i implementar un sistema d’exploració del budell iintegrar de tots els mòduls implementats en la plataforma starviewer

Segmentació de punts 3D rígids i no rígids obtinguts a partir d’un sistema estèreo

L’estudi consta de dues grans parts que serien la part de dissenyar, desenvolupar i implementar els mètodes de segmentació que ens serviran per separar els punts rígids dels punts no rígids/deformables. I l’altra part seria la d’obtenir reconstruccions 3D a partir d’un sistema estèreo, passant per la calibració de les càmeres del sistema, la realització de captures d’experiments reals, la generació de reconstruccions 3D per finalment posar a prova els mètodes desenvolupats en la part anterior

High throughput 3D super-resolution microscopy reveals Caulobacter crescentus in vivo Z-ring organization.

We created a high-throughput modality of photoactivated localization microscopy (PALM) that enables automated 3D PALM imaging of hundreds of synchronized bacteria during all stages of the cell cycle. We used high-throughput PALM to investigate the nanoscale organization of the bacterial cell division protein FtsZ in live Caulobacter crescentus. We observed that FtsZ predominantly localizes as a patchy midcell band, and only rarely as a continuous ring, supporting a model of "Z-ring" organization whereby FtsZ protofilaments are randomly distributed within the band and interact only weakly. We found evidence for a previously unidentified period of rapid ring contraction in the final stages of the cell cycle. We also found that DNA damage resulted in production of high-density continuous Z-rings, which may obstruct cytokinesis. Our results provide a detailed quantitative picture of in vivo Z-ring organization.

Disseny i construcció d'un motor 3D en temps real per la Gameboy Advance

El projecte desenvolupat ha tractat l’estudi i disseny d’un motor 3D interactiu a la consolaGame Boy Advance (GBA). La GBA disposa d’un processador ARM7TDMI a 16’78Mhz i no disposa de operacions 3D per-hardware, és una consola lenta en comparació lesque podem trobar al mercat d’avui en dia. Aquest treball, va partir de la construcció d’un prototipus ray-casting per-columna. Després,vàrem adaptar-lo a una estructura de portals i sectors. Més tard,es va introduir el mapeig de sostre/terra i de paisatges. Per últim,vàrem introduir efectes a la renderització per donar més realismeal recorregut del món, com il·luminació, objectes, etc.Tot i que es va estudiar l’arquitectura d’un motor eficient, no estenia prou per arribar a tenir un motor interactiu. Una de lestasques més difícils va ser la part de optimització. Peraconseguir-ho s’ha hagut de substituir operacions a temps realcostoses a temps de execució, replantejar parts de l’algorisme per fer-lo més eficient, entre altres

Influence of the ankle arthropathies on the 3D kinematics of the lower limbs during gait: analysis with an ambulatory system.

Introduction: Ankle arthropathy is associated with a decreased motion of the ankle-hindfoot during ambulation. Ankle arthrodesis was shown to result in degeneration of the neighbour joints of the foot. Inversely, total ankle arthroplasty conceptually preserves the adjacent joints because of the residual mobility of the ankle but this has not been demonstrated yet in vivo. It has also been reported that degenerative ankle diseases, and even arthrodesis, do not result in alteration of the knee and hip joints. We present the preliminary results of a new approach of this problem based on ambulatory gait analysis. Patients and Methods: Motion analysis of the lower limbs was performed using a Physilog® (BioAGM, CH) system consisting of three-dimensional (3D) accelerometer and gyroscope, coupled to a magnetic system (Liberty©, Polhemus, USA). Both systems have been validated. Three groups of two patients were included into this pilot study and compared to healthy subjects (controls) during level walking: patients with ankle osteoarthritis (group 1), patients treated by ankle arthrodesis (group 2), patients treated by total ankle prosthesis (group 3). Results: Motion patterns of all analyzed joints over more than 20 gait cycles in each subject were highly repeatable. Motion amplitude of the ankle-hindfoot in control patients was similar to recently reported results. Ankle arthrodesis limited the motion of the ankle-hindfoot in the sagittal and horizontal planes. The prosthetic ankle allowed a more physiologic movement in the sagittal plane only. Ankle arthritis and its treatments did not influence the range of motion of the knee and hip joint during stance phase, excepted for a slight decrease of the hip flexion in groups 1 and 2. Conclusion: The reliability of the system was shown by the repeatability of the consecutive measurements. The results of this preliminary study were similar to those obtained through laboratory gait analysis. However, our system has the advantage to allow ambulatory analysis of 3D kinematics of the lower limbs outside of a gait laboratory and in real life conditions. To our knowledge this is a new concept in the analysis of ankle arthropathy and its treatments. Therefore, there is a potential to address specific questions like the difficult comparison of the benefits of ankle arthroplasty versus arthrodesis. The encouraging results of this pilot study offer the perspective to analyze the consequences of ankle arthropathy and its treatments on the biomechanics of the lower limbs ambulatory, in vivo and in daily life conditions.

Trabecular bone score (TBS) the new parameter of 2D texture analysis for the evaluation of 3D bone micro architecture status

X-ray is a technology that is used for numerous applications in the medical field. The process of X-ray projection gives a 2-dimension (2D) grey-level texture from a 3- dimension (3D) object. Until now no clear demonstration or correlation has positioned the 2D texture analysis as a valid indirect evaluation of the 3D microarchitecture. TBS is a new texture parameter based on the measure of the experimental variogram. TBS evaluates the variation between 2D image grey-levels. The aim of this study was to evaluate existing correlations between 3D bone microarchitecture parameters - evaluated from μCT reconstructions - and the TBS value, calculated on 2D projected images. 30 dried human cadaveric vertebrae were acquired on a micro-scanner (eXplorer Locus, GE) at isotropic resolution of 93 μm. 3D vertebral body models were used. The following 3D microarchitecture parameters were used: Bone volume fraction (BV/TV), Trabecular thickness (TbTh), trabecular space (TbSp), trabecular number (TbN) and connectivity density (ConnD). 3D/2D projections has been done by taking into account the Beer-Lambert Law at X-ray energy of 50, 100, 150 KeV. TBS was assessed on 2D projected images. Correlations between TBS and the 3D microarchitecture parameters were evaluated using a linear regression analysis. Paired T-test is used to assess the X-ray energy effects on TBS. Multiple linear regressions (backward) were used to evaluate relationships between TBS and 3D microarchitecture parameters using a bootstrap process. BV/TV of the sample ranged from 18.5 to 37.6% with an average value at 28.8%. Correlations' analysis showedthat TBSwere strongly correlatedwith ConnD(0.856≤r≤0.862; p<0.001),with TbN (0.805≤r≤0.810; p<0.001) and negatively with TbSp (−0.714≤r≤−0.726; p<0.001), regardless X-ray energy. Results show that lower TBS values are related to "degraded" microarchitecture, with low ConnD, low TbN and a high TbSp. The opposite is also true. X-ray energy has no effect onTBS neither on the correlations betweenTBS and the 3Dmicroarchitecture parameters. In this study, we demonstrated that TBS was significantly correlated with 3D microarchitecture parameters ConnD and TbN, and negatively with TbSp, no matter what X-ray energy has been used. This article is part of a Special Issue entitled ECTS 2011. Disclosure of interest: None declared.

3D Automated Lung Nodule Segmentation in HRCT

A fully-automated 3D image analysis method is proposed to segment lung nodules in HRCT. A specific gray-level mathematical morphology operator, the SMDC-connection cost, acting in the 3D space of the thorax volume is defined in order to discriminate lung nodules from other dense (vascular) structures. Applied to clinical data concerning patients with pulmonary carcinoma, the proposed method detects isolated, juxtavascular and peripheral nodules with sizes ranging from 2 to 20 mm diameter. The segmentation accuracy was objectively evaluated on real and simulated nodules. The method showed a sensitivity and a specificity ranging from 85% to 97% and from 90% to 98%, respectively.

JULIDE: a software tool for 3D reconstruction and statistical analysis of autoradiographic mouse brain sections.

In this article we introduce JULIDE, a software toolkit developed to perform the 3D reconstruction, intensity normalization, volume standardization by 3D image registration and voxel-wise statistical analysis of autoradiographs of mouse brain sections. This software tool has been developed in the open-source ITK software framework and is freely available under a GPL license. The article presents the complete image processing chain from raw data acquisition to 3D statistical group analysis. Results of the group comparison in the context of a study on spatial learning are shown as an illustration of the data that can be obtained with this tool.

Coronary MR imaging using free-breathing 3D steady-state free precession with radial k-space sampling.

PURPOSE: To investigate the potential of free-breathing 3D steady-state free precession (SSFP) imaging with radial k-space sampling for coronary MR-angiography (MRA), coronary projection MR-angiography and coronary vessel wall imaging. MATERIALS AND METHODS: A navigator-gated free-breathing T2-prepared 3D SSFP sequence (TR = 6.1 ms, TE = 3.0 ms, flip angle = 120 degrees, field-of-view = 360 mm(2)) with radial k-space sampling (384 radials) was implemented for coronary MRA. For projection coronary MRA, this sequence was combined with a 2D selective aortic spin tagging pulse. Coronary vessel wall imaging was performed using a high-resolution inversion-recovery black-blood 3D radial SSFP sequence (384 radials, TR = 5.3 ms, TE = 2.7 ms, flip angle = 55 degrees, reconstructed resolution 0.35 x 0.35 x 1.2 mm(3)) and a local re-inversion pulse. Six healthy volunteers (two for each sequence) were investigated. Motion artifact level was assessed by two radiologists. Results: In coronary MRA, the coronary lumen was displayed with a high signal and high contrast to the surrounding lumen. Projection coronary MRA demonstrated selective visualization of the coronary lumen while surrounding tissue was almost completely suppressed. In coronary vessel wall imaging, the vessel wall was displayed with a high signal when compared to the blood pool and the surrounding tissue. No visible motion artifacts were seen. Conclusion: 3D radial SSFP imaging enables coronary MRA, coronary projection MRA and coronary vessel wall imaging with a low motion artifact level.