Overview of coded light projection techniques for automatic 3D profiling

Obtaining automatic 3D profile of objects is one of the most important issues in computer vision. With this information, a large number of applications become feasible: from visual inspection of industrial parts to 3D reconstruction of the environment for mobile robots. In order to achieve 3D data, range finders can be used. Coded structured light approach is one of the most widely used techniques to retrieve 3D information of an unknown surface. An overview of the existing techniques as well as a new classification of patterns for structured light sensors is presented. This kind of systems belong to the group of active triangulation method, which are based on projecting a light pattern and imaging the illuminated scene from one or more points of view. Since the patterns are coded, correspondences between points of the image(s) and points of the projected pattern can be easily found. Once correspondences are found, a classical triangulation strategy between camera(s) and projector device leads to the reconstruction of the surface. Advantages and constraints of the different patterns are discussed

Mòdul de visualització 3D d’ ajuda al diagnòstic de les neoplàsies rectals

El diagnòstic mitjançant la imatge mèdica s’ha convertit en una eina fonamental en la pràctica clínica, permet entre altres coses, reconstruir a partir d’un conjunt d’imatges 2D, obtingudes a partir d’aparells de captació, qualsevol part de l’organisme d’un pacient i representar-lo en un model 3D. Sobre aquest model 3D poden realitzar-se diferents operacions que faciliten el diagnòstic i la presa de decisions als especialistes. El projecte que es presenta forma part del desenvolupament de la plataforma informàtica de visualització i tractament de dades mèdiques, anomenada Starviewer, que desenvolupen conjuntament el laboratori de Gràfics i Imatge (GiLab) de la Universitat de Girona i l’ Institut de Diagnòstic per la Imatge (IDI) de l’Hospital Josep Trueta de Girona. En particular, en aquest projecte es centra en el diagnòstic del càncer colorectal i el desenvolupament de mètodes i tècniques de suport al seu diagnòstic. Els dos punts claus en el tractament d’aqueta patologia són: la detecció de les lesions I l’estudi de l’evolució d’aquestes lesions, una vegada s’ha iniciat el tractament tumoral. L’objectiu principal d’aquest projecte és implementar i integrar en la plataforma Starviewer les tècniques de visualització i processament de dades necessàries per donar suport als especialistes en el diagnòstic de les lesions del colon. Donada la dificultat en el processament de les dades reals del budell ens proposem: dissenyar i implementar un sistema per crear models sintètics del budell; estudiar, implementar i avaluar les tècniques de processament d’imatge que calen per segmentar lesions de budell; dissenyar i implementar un sistema d’exploració del budell iintegrar de tots els mòduls implementats en la plataforma starviewer

High throughput 3D super-resolution microscopy reveals Caulobacter crescentus in vivo Z-ring organization.

We created a high-throughput modality of photoactivated localization microscopy (PALM) that enables automated 3D PALM imaging of hundreds of synchronized bacteria during all stages of the cell cycle. We used high-throughput PALM to investigate the nanoscale organization of the bacterial cell division protein FtsZ in live Caulobacter crescentus. We observed that FtsZ predominantly localizes as a patchy midcell band, and only rarely as a continuous ring, supporting a model of "Z-ring" organization whereby FtsZ protofilaments are randomly distributed within the band and interact only weakly. We found evidence for a previously unidentified period of rapid ring contraction in the final stages of the cell cycle. We also found that DNA damage resulted in production of high-density continuous Z-rings, which may obstruct cytokinesis. Our results provide a detailed quantitative picture of in vivo Z-ring organization.

Mapping complex tissue architecture with diffusion spectrum magnetic resonance imaging.

Methods are presented to map complex fiber architectures in tissues by imaging the 3D spectra of tissue water diffusion with MR. First, theoretical considerations show why and under what conditions diffusion contrast is positive. Using this result, spin displacement spectra that are conventionally phase-encoded can be accurately reconstructed by a Fourier transform of the measured signal's modulus. Second, studies of in vitro and in vivo samples demonstrate correspondence between the orientational maxima of the diffusion spectrum and those of the fiber orientation density at each location. In specimens with complex muscular tissue, such as the tongue, diffusion spectrum images show characteristic local heterogeneities of fiber architectures, including angular dispersion and intersection. Cerebral diffusion spectra acquired in normal human subjects resolve known white matter tracts and tract intersections. Finally, the relation between the presented model-free imaging technique and other available diffusion MRI schemes is discussed.

Development of model observers applied to 3D breast tomosynthesis microcalcifications and masses

The development of model observers for mimicking human detection strategies has followed from symmetric signals in simple noise to increasingly complex backgrounds. In this study we implement different model observers for the complex task of detecting a signal in a 3D image stack. The backgrounds come from real breast tomosynthesis acquisitions and the signals were simulated and reconstructed within the volume. Two different tasks relevant to the early detection of breast cancer were considered: detecting an 8 mm mass and detecting a cluster of microcalcifications. The model observers were calculated using a channelized Hotelling observer (CHO) with dense difference-of-Gaussian channels, and a modified (Partial prewhitening [PPW]) observer which was adapted to realistic signals which are not circularly symmetric. The sustained temporal sensitivity function was used to filter the images before applying the spatial templates. For a frame rate of five frames per second, the only CHO that we calculated performed worse than the humans in a 4-AFC experiment. The other observers were variations of PPW and outperformed human observers in every single case. This initial frame rate was a rather low speed and the temporal filtering did not affect the results compared to a data set with no human temporal effects taken into account. We subsequently investigated two higher speeds at 5, 15 and 30 frames per second. We observed that for large masses, the two types of model observers investigated outperformed the human observers and would be suitable with the appropriate addition of internal noise. However, for microcalcifications both only the PPW observer consistently outperformed the humans. The study demonstrated the possibility of using a model observer which takes into account the temporal effects of scrolling through an image stack while being able to effectively detect a range of mass sizes and distributions.

Temporal SNR characteristics in segmented 3D-EPI at 7T.

Three-dimensional segmented echo planar imaging (3D-EPI) is a promising approach for high-resolution functional magnetic resonance imaging, as it provides an increased signal-to-noise ratio (SNR) at similar temporal resolution to traditional multislice 2D-EPI readouts. Recently, the 3D-EPI technique has become more frequently used and it is important to better understand its implications for fMRI. In this study, the temporal SNR characteristics of 3D-EPI with varying numbers of segments are studied. It is shown that, in humans, the temporal variance increases with the number of segments used to form the EPI acquisition and that for segmented acquisitions, the maximum available temporal SNR is reduced compared to single shot acquisitions. This reduction with increased segmentation is not found in phantom data and thus likely due to physiological processes. When operating in the thermal noise dominated regime, fMRI experiments with a motor task revealed that the 3D variant outperforms the 2D-EPI in terms of temporal SNR and sensitivity to detect activated brain regions. Thus, the theoretical SNR advantage of a segmented 3D-EPI sequence for fMRI only exists in a low SNR situation. However, other advantages of 3D-EPI, such as the application of parallel imaging techniques in two dimensions and the low specific absorption rate requirements, may encourage the use of the 3D-EPI sequence for fMRI in situations with higher SNR.

Patient-specific computational hemodynamics of intracranial aneurysms from 3D rotational angiography and CT angiography: an in vivo reproducibility study

Patient-specific simulations of the hemodynamics in intracranial aneurysms can be constructed by using image-based vascular models and CFD techniques. This work evaluates the impact of the choice of imaging technique on these simulations

Magnetization transfer-based 3D visualization of foot peripheral nerves.

PURPOSE: To investigate magnetization transfer (MT) effects as a new source of contrast for imaging and tracking of peripheral foot nerves. MATERIALS AND METHODS: Two sets of 3D spoiled gradient-echo images acquired with and without a saturation pulse were used to generate MT ratio (MTR) maps of 260 μm in-plane resolution for eight volunteers at 3T. Scan parameters were adjusted to minimize signal loss due to T2 dephasing, and a dedicated coil was used to improve the inherently low signal-to-noise ratio of small voxels. Resulting MTR values in foot nerves were compared with those in surrounding muscle tissue. RESULTS: Average MTR values for muscle (45.5 ± 1.4%) and nerve (21.4 ± 3.1%) were significantly different (P < 0.0001). In general, the difference in MTR values was sufficiently large to allow for intensity-based segmentation and tracking of foot nerves in individual subjects. This procedure was termed MT-based 3D visualization. CONCLUSION: The MTR serves as a new source of contrast for imaging of peripheral foot nerves and provides a means for high spatial resolution tracking of these structures. The proposed methodology is directly applicable on standard clinical MR scanners and could be applied to systemic pathologies, such as diabetes.

Is spinal stenosis assessment dependent on slice orientation? A magnetic resonance imaging study.

INTRODUCTION: Lumbar spinal stenosis (LSS) treatment is based primarily on the clinical criteria providing that imaging confirms radiological stenosis. The radiological measurement more commonly used is the dural sac cross-sectional area (DSCA). It has been recently shown that grading stenosis based on the morphology of the dural sac as seen on axial T2 MRI images, better reflects severity of stenosis than DSCA and is of prognostic value. This radiological prospective study investigates the variability of surface measurements and morphological grading of stenosis for varying degrees of angulation of the T2 axial images relative to the disc space as observed in clinical practice. MATERIALS AND METHODS: Lumbar spine TSE T2 three-dimensional (3D) MRI sequences were obtained from 32 consecutive patients presenting with either suspected spinal stenosis or low back pain. Axial reconstructions using the OsiriX software at 0°, 10°, 20° and 30° relative to the disc space orientation were obtained for a total of 97 levels. For each level, DSCA was digitally measured and stenosis was graded according to the 4-point (A-D) morphological grading by two observers. RESULTS: A good interobserver agreement was found in grade evaluation of stenosis (k = 0.71). DSCA varied significantly as the slice orientation increased from 0° to +10°, +20° and +30° at each level examined (P < 0.0001) (-15 to +32% at 10°, -24 to +143% at 20° and -29 to +231% at 30° of slice orientation). Stenosis definition based on the surface measurements changed in 39 out of the 97 levels studied, whereas the morphology grade was modified only in two levels (P < 0.01). DISCUSSION: The need to obtain continuous slices using the classical 2D MRI acquisition technique entails often at least a 10° slice inclination relative to one of the studied discs. Even at this low angulation, we found a significantly statistical difference between surface changes and morphological grading change. In clinical practice, given the above findings, it might therefore not be necessary to align the axial cuts to each individual disc level which could be more time-consuming than obtaining a single series of axial cuts perpendicular to the middle of the lumbar spine or to the most stenotic level. In conclusion, morphological grading seems to offer an alternative means of assessing severity of spinal stenosis that is little affected by image acquisition technique.

Comparison between standard radiography and spiral CT with 3D reconstruction in the evaluation, classification and management of tibial plateau fractures.

The aim of this study was to compare the diagnostic efficiency of plain film and spiral CT examinations with 3D reconstructions of 42 tibial plateau fractures and to assess the accuracy of these two techniques in the pre-operative surgical plan in 22 cases. Forty-two tibial plateau fractures were examined with plain film (anteroposterior, lateral, two obliques) and spiral CT with surface-shaded-display 3D reconstructions. The Swiss AO-ASIF classification system of bone fracture from Muller was used. In 22 cases the surgical plans and the sequence of reconstruction of the fragments were prospectively determined with both techniques, successively, and then correlated with the surgical reports and post-operative plain film. The fractures were underestimated with plain film in 18 of 42 cases (43%). Due to the spiral CT 3D reconstructions, and precise pre-operative information, the surgical plans based on plain film were modified and adjusted in 13 cases among 22 (59%). Spiral CT 3D reconstructions give a better and more accurate demonstration of the tibial plateau fracture and allows a more precise pre-operative surgical plan.

Parallel imaging with phase scrambling.

PURPOSE: Most existing methods for accelerated parallel imaging in MRI require additional data, which are used to derive information about the sensitivity profile of each radiofrequency (RF) channel. In this work, a method is presented to avoid the acquisition of separate coil calibration data for accelerated Cartesian trajectories. METHODS: Quadratic phase is imparted to the image to spread the signals in k-space (aka phase scrambling). By rewriting the Fourier transform as a convolution operation, a window can be introduced to the convolved chirp function, allowing a low-resolution image to be reconstructed from phase-scrambled data without prominent aliasing. This image (for each RF channel) can be used to derive coil sensitivities to drive existing parallel imaging techniques. As a proof of concept, the quadratic phase was applied by introducing an offset to the x(2) - y(2) shim and the data were reconstructed using adapted versions of the image space-based sensitivity encoding and GeneRalized Autocalibrating Partially Parallel Acquisitions algorithms. RESULTS: The method is demonstrated in a phantom (1 × 2, 1 × 3, and 2 × 2 acceleration) and in vivo (2 × 2 acceleration) using a 3D gradient echo acquisition. CONCLUSION: Phase scrambling can be used to perform parallel imaging acceleration without acquisition of separate coil calibration data, demonstrated here for a 3D-Cartesian trajectory. Further research is required to prove the applicability to other 2D and 3D sampling schemes. Magn Reson Med, 2014. © 2014 Wiley Periodicals, Inc.

Pre-procés i segmentació en imatges d’ultrasons 2D i 3D de la pròstata

Aquest projecte s'ha dut a terme amb el Grup de visió per computador del departamentd'Arquitectura i Tecnologia de Computadors (ATC) de la Universitat de Girona. Està enfocat a l'anàlisi d'imatges mèdiques, en concret s'analitzaran imatges de pròstata en relació a desenvolupaments que s'estan realitzant en el grup de visió esmentat. Els objectius fixats per aquest projecte són desenvolupar dos mòduls de processamentm d'imatges els quals afrontaran dos blocs important en el tractament d'imatges, aquests dos mòduls seran un pre-processat d'imatges, que constarà de tres filtres i un bloc de segmentació per tal de cercar la pròstata dintre de les imatges a tractar. En el projecte es treballarà amb el llenguatge de programació C++, concretament amb unes llibreries que es denominen ITK (Insight Toolkit ) i són open source enfocades al tractament d'imatges mèdiques. A part d'aquesta eina s'utilitzaran d'altres com les Qt que és una biblioteca d'eines per crear entorns gràfics

Impact of navigator timing on free-breathing submillimeter 3D coronary magnetic resonance angiography.

The purpose of this study was to investigate the impact of navigator timing on image quality in navigator-gated and real-time motion-corrected, free-breathing, three-dimensional (3D) coronary MR angiography (MRA) with submillimeter spatial image resolution. Both phantom and in vivo investigations were performed. 3D coronary MRA with real-time navigator technology was applied using variable navigator time delays (time delay between the navigator and imaging sequences) and varying spatial resolutions. Quantitative objective and subjective image quality parameters were assessed. For high-resolution imaging, reduced image quality was found as a function of increasing navigator time delay. Lower spatial resolution coronary MRA showed only minor sensitivity to navigator timing. These findings were consistent among volunteers and phantom experiments. In conclusion, for submillimeter navigator-gated and real-time motion-corrected 3D coronary MRA, shortening the time delay between the navigator and the imaging portion of the sequence becomes increasingly important for improved spatial resolution.

Artifact-free coronary magnetic resonance angiography and coronary vessel wall imaging in the presence of a new, metallic, coronary magnetic resonance imaging stent.

BACKGROUND: Coronary in-stent restenosis cannot be directly assessed by magnetic resonance angiography (MRA) because of the local signal void of currently used stainless steel stents. The aim of this study was to investigate the potential of a new, dedicated, coronary MR imaging (MRI) stent for artifact-free, coronary MRA and in-stent lumen and vessel wall visualization. METHODS AND RESULTS: Fifteen prototype stents were deployed in coronary arteries of 15 healthy swine and investigated with a double-oblique, navigator-gated, free-breathing, T2-prepared, 3D cartesian gradient-echo sequence; a T2-prepared, 3D spiral gradient-echo sequence; and a T2-prepared, 3D steady-state, free-precession coronary MRA sequence. Furthermore, black-blood vessel wall imaging by a dual-inversion-recovery, turbo spin-echo sequence was performed. Artifacts of the stented vessel segment and signal intensities of the coronary vessel lumen inside and outside the stent were assessed. With all investigated sequences, the vessel lumen and wall could be visualized without artifacts, including the stented vessel segment. No signal intensity alterations inside the stent when compared with the vessel lumen outside the stent were found. CONCLUSIONS: The new, coronary MRI stent allows for completely artifact-free coronary MRA and vessel wall imaging.

Imaging of the non-traumatic brachial plexus.

The first line imaging of the non-traumatic brachial plexus is by MRI. Knowledge of the anatomy and commonest variants is essential. Three Tesla imaging offers the possibility of 3D isotropic sequences with excellent spatial and contrast enhancement resolutions, which leads to time saving and quality boosting. The most commonly seen conditions are benign tumor lesions and radiation damage. Gadolinium is required to assess inflammatory or tumour plexopathy. MRI data should be correlated with FDG-PET if tumor recurrence is suspected.