Refined facial disparity maps for automatic creation of 3D avatars

We propose a new method to automatically refine a facial disparity map obtained with standard cameras and under conventional illumination conditions by using a smart combination of traditional computer vision and 3D graphics techniques. Our system inputs two stereo images acquired with standard (calibrated) cameras and uses dense disparity estimation strategies to obtain a coarse initial disparity map, and SIFT to detect and match several feature points in the subjects face. We then use these points as anchors to modify the disparity in the facial area by building a Delaunay triangulation of their convex hull and interpolating their disparity values inside each triangle. We thus obtain a refined disparity map providing a much more accurate representation of the the subjects facial features. This refined facial disparity map may be easily transformed, through the camera calibration parameters, into a depth map to be used, also automatically, to improve the facial mesh of a 3D avatar to match the subjects real human features.

RNA-controlled polymorphism in the in vivo assembly of 180-subunit and 120-subunit virions from a single capsid protein

Repeated, specific interactions between capsid protein (CP) subunits direct virus capsid assembly and exemplify regulated protein–protein interactions. The results presented here reveal a striking in vivo switch in CP assembly. Using cryoelectron microscopy, three-dimensional image reconstruction, and molecular modeling, we show that brome mosaic virus (BMV) CP can assemble in vivo two remarkably distinct capsids that selectively package BMV-derived RNAs in the absence of BMV RNA replication: a 180-subunit capsid indistinguishable from virions produced in natural infections and a previously unobserved BMV capsid type with 120 subunits arranged as 60 CP dimers. Each such dimer contains two CPs in distinct, nonequivalent environments, in contrast to the quasi-equivalent CP environments throughout the 180-subunit capsid. This 120-subunit capsid utilizes most of the CP interactions of the 180-subunit capsid plus nonequivalent CP–CP interactions. Thus, the CP of BMV, and perhaps other viruses, can encode CP–CP interactions that are not apparent from mature virions and may function in assembly or disassembly. Shared structural features suggest that the 120- and 180-subunit capsids share assembly steps and that a common pentamer of CP dimers may be an important assembly intermediate. The ability of a single CP to switch between distinct capsids by means of alternate interactions also implies reduced evolutionary barriers between different capsid structures. The in vivo switch between alternate BMV capsids is controlled by the RNA packaged: a natural BMV genomic RNA was packaged in 180-subunit capsids, whereas an engineered mRNA containing only the BMV CP gene was packaged in 120-subunit capsids. RNA features can thus direct the assembly of a ribonucleoprotein complex between alternate structural pathways.

Interaction of the poliovirus receptor with poliovirus

The structure of the extracellular, three-domain poliovirus receptor (CD155) complexed with poliovirus (serotype 1) has been determined to 22-Å resolution by means of cryo-electron microscopy and three-dimensional image-reconstruction techniques. Density corresponding to the receptor was isolated in a difference electron density map and fitted with known structures, homologous to those of the three individual CD155 Ig-like domains. The fit was confirmed by the location of carbohydrate moieties in the CD155 glycoprotein, the conserved properties of elbow angles in the structures of cell surface molecules with Ig-like folds, and the concordance with prior results of CD155 and poliovirus mutagenesis. CD155 binds in the poliovirus “canyon” and has a footprint similar to that of the intercellular adhesion molecule-1 receptor on human rhinoviruses. However, the orientation of the long, slender CD155 molecule relative to the poliovirus surface is quite different from the orientation of intercellular adhesion molecule-1 on rhinoviruses. In addition, the residues that provide specificity of recognition differ for the two receptors. The principal feature of receptor binding common to these two picornaviruses is the site in the canyon at which binding occurs. This site may be a trigger for initiation of the subsequent uncoating step required for viral infection.

Avaliação em 3D da cabeça da mandíbula em crianças portadoras de mordida cruzada posterior unilateral por meio de tomografia computadorizada de feixe cônico

Durante o desenvolvimento da oclusão, a instalação de maloclusões podem resultar em desarmonias dento faciais de natureza e severidade diversas, podendo provocar alterações no desenvolvimento crânio facial, dentre as estruturas envolvidas as Articulações Temporo Mandibulares (ATM), podem sofrer alguma influência, dessa forma a avaliação desta região, no aspecto morfológico e funcional, constituí tema de interesse, sempre que levados em conta os aspectos funcionais da oclusão. A relação entre a forma e a função, tanto das cabeças da mandíbula, bem como o contorno da fossa mandibular com as maloclusões ainda é controversa e não está compreendida por completo, porém a literatura sobre o assunto, demonstra correlação entre a instalação de maloclusões e modificações neste sistema, mesmo que algumas alterações não sejam de ordem estatística e em amostras de indivíduos em tenra idade, as mesmas podem comprometer o desenvolvimento adequado em indivíduos adultos ou mesmo adultos jovens. Tendo como propósito nesse estudo a avaliação das cabeças da mandíbula quanto ao volume e superficíe dos lados direito e esquerdo, cruzado e não cruzado, a amostra selecionada foi de 20 indivíduos com mordida cruzada posterior unilateral, com idades entre 06 e 09 anos de idade, utilizando imagens de tomografia computadorizada por feixe cônico, imagens obtidas por um equipamento modelo i- Cat, sendo utilizado na reformatação e manipulação das imagens o programa computacional - NemoCeph 3D® versão 11.5. Nas medições propostas para esse estudo, utilizou-se o teste t pareado de Student para amostras com distribuição normal. Na observação das tabelas e seus respectivos gráficos, podemos verificar que na comparação entre os lados direito e esquerdo, e cruzado e não cruzado das cabeças da mandíbula, com relação ao volume e superfície, existem diferenças numéricas entre elas, porém não pode ser observado diferenças estatísticas significantes, nessa amostra especifica com a metodologia empregada para esse estudo. Assim foi possível concluir que nas Mordidas Cruzadas Posteriores Unilaterais as cabeças da mandíbula tanto em seu volume como em sua superfície não apresentaram diferenças estatisticamente significantes na amostra estudada.

3-D magnetic resonance angiography versus conventional angiography in peripheral arterial disease: Pilot study

Angiography is usually performed as the preoperative road map for those requiring revascularization for lower extremity peripheral arterial disease (PAD). The alternative investigations are ultrasound, 3-D magnetic resonance angiography (3-D MRA) and computed tomography angiography. This pilot study aimed to assess whether 3-D MRA could replace the gold standard angiography in preoperative planning. Eight patients considered for aortoiliac or infrainguinal arterial bypass surgery were recruited. All underwent both imaging modalities within 7 days. A vascular surgeon and a radiologist each reported on the images from both the 3-D MRA and the angiography, with blinding to patient details and each others reports. Comparisons were made between the reports for the angiographic and the 3-D MRA images, and between the reports of the vascular surgeon and the radiologist. Compared to the gold standard angiogram, 3-D MRA had a sensitivity of 77% and specificity of 94% in detecting occlusion, and a sensitivity of 72% and specificity of 90% in differentiating high grade (> 50%) versus low grade (< 50%) stenoses. There was an overall concordance of 78% between the two investigations with a range of 62% in the peroneal artery to 94% in the aorta. 3-D MRA showed flow in 23% of cases where conventional angiography showed no flow. In the present pilot study, 3-D MRA had reasonable concordance with the gold standard angiography, depending on the level of the lesion. At times it showed vessel flow where occlusion was shown on conventional angiogram. 3-D MRA in peripheral vascular disease is challenging the gold standard, but is inconsistent at present.

Signal-to-noise ratio study of full-field Fourier-domain optical coherence tomography

We report a new approach in optical coherence tomography (OCT) called full-field Fourier-domain OCT (3F-OCT). A three-dimensional image of a sample is obtained by digital reconstruction of a three-dimensional data cube, acquired with a Fourier holography recording system, illuminated with a swept source. We present a theoretical and experimental study of the signal-to-noise ratio of the 3F-OCT approach versus serial image acquisition (flying-spot OCT) approach. (c) 2005 Optical Society of America.

3D reconstruction and quantification of macropores using X-ray computed tomography and image analysis

Axial X-ray Computed tomography (CT) scanning provides a convenient means of recording the three-dimensional form of soil structure. The technique has been used for nearly two decades, but initial development has concentrated on qualitative description of images. More recently, increasing effort has been put into quantifying the geometry and topology of macropores likely to contribute to preferential now in soils. Here we describe a novel technique for tracing connected macropores in the CT scans. After object extraction, three-dimensional mathematical morphological filters are applied to quantify the reconstructed structure. These filters consist of sequences of so-called erosions and/or dilations of a 32-face structuring element to describe object distances and volumes of influence. The tracing and quantification methodologies were tested on a set of undisturbed soil cores collected in a Swiss pre-alpine meadow, where a new earthworm species (Aporrectodea nocturna) was accidentally introduced. Given the reduced number of samples analysed in this study, the results presented only illustrate the potential of the method to reconstruct and quantify macropores. Our results suggest that the introduction of the new species induced very limited chance to the soil structured for example, no difference in total macropore length or mean diameter was observed. However. in the zone colonised by, the new species. individual macropores tended to have a longer average length. be more vertical and be further apart at some depth. Overall, the approach proved well suited to the analysis of the three-dimensional architecture of macropores. It provides a framework for the analysis of complex structures, which are less satisfactorily observed and described using 2D imaging. (C) 2002 Elsevier Science B.V. All rights reserved.

Towards Detecting Changes in Underwater Image Sequences

Detecting changes between images of the same scene taken at different times is of great interest for monitoring and understanding the environment. It is widely used for on-land application but suffers from different constraints. Unfortunately, Change detection algorithms require highly accurate geometric and photometric registration. This requirement has precluded their use in underwater imagery in the past. In this paper, the change detection techniques available nowadays for on-land application were analyzed and a method to automatically detect the changes in sequences of underwater images is proposed. Target application scenarios are habitat restoration sites, or area monitoring after sudden impacts from hurricanes or ship groundings. The method is based on the creation of a 3D terrain model from one image sequence over an area of interest. This model allows for synthesizing textured views that correspond to the same viewpoints of a second image sequence. The generated views are photometrically matched and corrected against the corresponding frames from the second sequence. Standard change detection techniques are then applied to find areas of difference. Additionally, the paper shows that it is possible to detect false positives, resulting from non-rigid objects, by applying the same change detection method to the first sequence exclusively. The developed method was able to correctly find the changes between two challenging sequences of images from a coral reef taken one year apart and acquired with two different cameras

Estimating the motion of an underwater robot from a monocular image sequence

When underwater vehicles perform navigation close to the ocean floor, computer vision techniques can be applied to obtain quite accurate motion estimates. The most crucial step in the vision-based estimation of the vehicle motion consists on detecting matchings between image pairs. Here we propose the extensive use of texture analysis as a tool to ameliorate the correspondence problem in underwater images. Once a robust set of correspondences has been found, the three-dimensional motion of the vehicle can be computed with respect to the bed of the sea. Finally, motion estimates allow the construction of a map that could aid to the navigation of the robot

Surface registration from range image fusion

The registration of full 3-D models is an important task in computer vision. Range finders only reconstruct a partial view of the object. Many authors have proposed several techniques to register 3D surfaces from multiple views in which there are basically two aspects to consider. First, poor registration in which some sort of correspondences are established. Second, accurate registration in order to obtain a better solution. A survey of the most common techniques is presented and includes experimental results of some of them

Omnidirectional Depth Computation from a Single Image

Omnidirectional cameras offer a much wider field of view than the perspective ones and alleviate the problems due to occlusions. However, both types of cameras suffer from the lack of depth perception. A practical method for obtaining depth in computer vision is to project a known structured light pattern on the scene avoiding the problems and costs involved by stereo vision. This paper is focused on the idea of combining omnidirectional vision and structured light with the aim to provide 3D information about the scene. The resulting sensor is formed by a single catadioptric camera and an omnidirectional light projector. It is also discussed how this sensor can be used in robot navigation applications

Medical image registration based on random line sampling

One of the key aspects in 3D-image registration is the computation of the joint intensity histogram. We propose a new approach to compute this histogram using uniformly distributed random lines to sample stochastically the overlapping volume between two 3D-images. The intensity values are captured from the lines at evenly spaced positions, taking an initial random offset different for each line. This method provides us with an accurate, robust and fast mutual information-based registration. The interpolation effects are drastically reduced, due to the stochastic nature of the line generation, and the alignment process is also accelerated. The results obtained show a better performance of the introduced method than the classic computation of the joint histogram

A multidimensional segmentation evaluation for medical image data.

Evaluation of segmentation methods is a crucial aspect in image processing, especially in the medical imaging field, where small differences between segmented regions in the anatomy can be of paramount importance. Usually, segmentation evaluation is based on a measure that depends on the number of segmented voxels inside and outside of some reference regions that are called gold standards. Although some other measures have been also used, in this work we propose a set of new similarity measures, based on different features, such as the location and intensity values of the misclassified voxels, and the connectivity and the boundaries of the segmented data. Using the multidimensional information provided by these measures, we propose a new evaluation method whose results are visualized applying a Principal Component Analysis of the data, obtaining a simplified graphical method to compare different segmentation results. We have carried out an intensive study using several classic segmentation methods applied to a set of MRI simulated data of the brain with several noise and RF inhomogeneity levels, and also to real data, showing that the new measures proposed here and the results that we have obtained from the multidimensional evaluation, improve the robustness of the evaluation and provides better understanding about the difference between segmentation methods.

Free-breathing 3D coronary MRA: the impact of "isotropic" image resolution.

During conventional x-ray coronary angiography, multiple projections of the coronary arteries are acquired to define coronary anatomy precisely. Due to time constraints, coronary magnetic resonance angiography (MRA) usually provides only one or two views of the major coronary vessels. A coronary MRA approach that allowed for reconstruction of arbitrary isotropic orientations might therefore be desirable. The purpose of the study was to develop a three-dimensional (3D) coronary MRA technique with isotropic image resolution in a relatively short scanning time that allows for reconstruction of arbitrary views of the coronary arteries without constraints given by anisotropic voxel size. Eight healthy adult subjects were examined using a real-time navigator-gated and corrected free-breathing interleaved echoplanar (TFE-EPI) 3D-MRA sequence. Two 3D datasets were acquired for the left and right coronary systems in each subject, one with anisotropic (1.0 x 1.5 x 3.0 mm, 10 slices) and one with "near" isotropic (1.0 x 1.5 x 1.0 mm, 30 slices) image resolution. All other imaging parameters were maintained. In all cases, the entire left main (LM) and extensive portions of the left anterior descending (LAD) and the right coronary artery (RCA) were visualized. Objective assessment of coronary vessel sharpness was similar (41% +/- 5% vs. 42% +/- 5%; P = NS) between in-plane and through-plane views with "isotropic" voxel size but differed (32% +/- 7% vs. 23% +/- 4%; P < 0.001) with nonisotropic voxel size. In reconstructed views oriented in the through-plane direction, the vessel border was 86% more defined (P < 0.01) for isotropic compared with anisotropic images. A smaller (30%; P < 0.001) improvement was seen for in-plane reconstructions. Vessel diameter measurements were view independent (2.81 +/- 0.45 mm vs. 2.66 +/- 0.52 mm; P = NS) for isotropic, but differed (2.71 +/- 0.51 mm vs. 3.30 +/- 0.38 mm; P < 0.001) between anisotropic views. Average scanning time was 2:31 +/- 0:57 minutes for anisotropic and 7:11 +/- 3:02 minutes for isotropic image resolution (P < 0.001). We present a new approach for "near" isotropic 3D coronary artery imaging, which allows for reconstruction of arbitrary views of the coronary arteries. The good delineation of the coronary arteries in all views suggests that isotropic 3D coronary MRA might be a preferred technique for the assessment of coronary disease, although at the expense of prolonged scan times. Comparative studies with conventional x-ray angiography are needed to investigate the clinical utility of the isotropic strategy.

Accuracy and predictability in use of AO three-dimensionally preformed titanium mesh plates for posttraumatic orbital reconstruction: a pilot study.

The aim of this study was to prospectively evaluate the accuracy and predictability of new three-dimensionally preformed AO titanium mesh plates for posttraumatic orbital wall reconstruction.We analyzed the preoperative and postoperative clinical and radiologic data of 10 patients with isolated blow-out orbital fractures. Fracture locations were as follows: floor (N = 7; 70%), medial wall (N = 1; 1%), and floor/medial wall (N = 2; 2%). The floor fractures were exposed by a standard transconjunctival approach, whereas a combined transcaruncular transconjunctival approach was used in patients with medial wall fractures. A three-dimensional preformed AO titanium mesh plate (0.4 mm in thickness) was selected according to the size of the defect previously measured on the preoperative computed tomographic (CT) scan examination and fixed at the inferior orbital rim with 1 or 2 screws. The accuracy of plate positioning of the reconstructed orbit was assessed on the postoperative CT scan. Coronal CT scan slices were used to measure bony orbital volume using OsiriX Medical Image software. Reconstructed versus uninjured orbital volume were statistically correlated.Nine patients (90%) had a successful treatment outcome without complications. One patient (10%) developed a mechanical limitation of upward gaze with a resulting handicapping diplopia requiring hardware removal. Postoperative orbital CT scan showed an anatomic three-dimensional placement of the orbital mesh plates in all of the patients. Volume data of the reconstructed orbit fitted that of the contralateral uninjured orbit with accuracy to within 2.5 cm(3). There was no significant difference in volume between the reconstructed and uninjured orbits.This preliminary study has demonstrated that three-dimensionally preformed AO titanium mesh plates for posttraumatic orbital wall reconstruction results in (1) a high rate of success with an acceptable rate of major clinical complications (10%) and (2) an anatomic restoration of the bony orbital contour and volume that closely approximates that of the contralateral uninjured orbit.