3D lung and rib cage reconstruction using low dose CT scans of adolescent idiopathic scoliosis pre and post anterior thoracoscopic correction

Adolescent Idiopathic Scoliosis (AIS) has been associated with reduced pulmonary function believed to be due to a restriction of lung volume by the deformed thoracic cavity. A recent study by our group examined the changes in lung volume pre and post anterior thoracoscopic scoliosis correction using pulmonary function testing (1), however the anatomical changes in ribcage shape and left/right lung volume after thoracoscopic surgery which govern overall respiratory capacity are unknown. The aim of this study was to use 3D rendering from CT scan data to compare lung and ribcage anatomical changes from pre to two years post thoracoscopic anterior scoliosis correction. The study concluded that 3D volumetric reconstruction from CT scans is a powerful means of evaluating changes in pulmonary and thoracic anatomy following surgical AIS correction. Most likely, lung volume changes following thoracoscopic scoliosis correction are multifactorial and affected by changes in height (due to residual growth), ribcage shape, diaphragm positioning, Cobb angle correction in the thoracic spine. Further analysis of the 3D reconstructions will be performed to assess how each of these factors affect lung volume in this patient cohort.

3D volumetric intensity reconsturction from 2D x-ray images using partial least squares regression

Reconstruction of shape and intensity from 2D x-ray images has drawn more and more attentions. Previously introduced work suffers from the long computing time due to its iterative optimization characteristics and the requirement of generating digitally reconstructed radiographs within each iteration. In this paper, we propose a novel method which uses a patient-specific 3D surface model reconstructed from 2D x-ray images as a surrogate to get a patient-specific volumetric intensity reconstruction via partial least squares regression. No DRR generation is needed. The method was validated on 20 cadaveric proximal femurs by performing a leave-one-out study. Qualitative and quantitative results demonstrated the efficacy of the present method. Compared to the existing work, the present method has the advantage of much shorter computing time and can be applied to both DXA images as well as conventional x-ray images, which may hold the potentials to be applied to clinical routine task such as total hip arthroplasty (THA).

3D Image Reconstruction From Truncated Helical Cone Beam Projection Data - A Linear Prediction Approach

With the introduction of 2D flat-panel X-ray detectors, 3D image reconstruction using helical cone-beam tomography is fast replacing the conventional 2D reconstruction techniques. In 3D image reconstruction, the source orbit or scanning geometry should satisfy the data sufficiency or completeness condition for exact reconstruction. The helical scan geometry satisfies this condition and hence can give exact reconstruction. The theoretically exact helical cone-beam reconstruction algorithm proposed by Katsevich is a breakthrough and has attracted interest in the 3D reconstruction using helical cone-beam Computed Tomography.In many practical situations, the available projection data is incomplete. One such case is where the detector plane does not completely cover the full extent of the object being imaged in lateral direction resulting in truncated projections. This result in artifacts that mask small features near to the periphery of the ROI when reconstructed using the convolution back projection (CBP) method assuming that the projection data is complete. A number of techniques exist which deal with completion of missing data followed by the CBP reconstruction. In 2D, linear prediction (LP)extrapolation has been shown to be efficient for data completion, involving minimal assumptions on the nature of the data, producing smooth extensions of the missing projection data.In this paper, we propose to extend the LP approach for extrapolating helical cone beam truncated data. The projection on the multi row flat panel detectors has missing columns towards either ends in the lateral direction in truncated data situation. The available data from each detector row is modeled using a linear predictor. The available data is extrapolated and this completed projection data is backprojected using the Katsevich algorithm. Simulation results show the efficacy of the proposed method.

A Profilometric Approach to 3D Face Reconstruction and Its Application to Face Recognition

3D Face Recognition is an active area of research for past several years. For a 3D face recognition system one would like to have an accurate as well as low cost setup for constructing 3D face model. In this paper, we use Profilometry approach to obtain a 3D face model.This method gives a low cost solution to the problem of acquiring 3D data and the 3D face models generated by this method are sufficiently accurate. We also develop an algorithm that can use the 3D face model generated by the above method for the recognition purpose.

Live 3D shape reconstruction, recognition and registration

We present a video-based system which interactively captures the geometry of a 3D object in the form of a point cloud, then recognizes and registers known objects in this point cloud in a matter of seconds (fig. 1). In order to achieve interactive speed, we exploit both efficient inference algorithms and parallel computation, often on a GPU. The system can be broken down into two distinct phases: geometry capture, and object inference. We now discuss these in further detail. © 2011 IEEE.

The heart of a dragon: 3D anatomical reconstruction of the 'scaly-foot gastropod' (Mollusca: Gastropoda: Neomphalina) reveals its extraordinary circulatory system

Introduction: The 'scaly-foot gastropod' (Chrysomallon squamiferum Chen et al., 2015) from deep-sea hydrothermal vent ecosystems of the Indian Ocean is an active mobile gastropod occurring in locally high densities, and it is distinctive for the dermal scales covering the exterior surface of its foot. These iron-sulfide coated sclerites, and its nutritional dependence on endosymbiotic bacteria, are both noted as adaptations to the extreme environment in the flow of hydrogen sulfide. We present evidence for other adaptations of the 'scaly-foot gastropod' to life in an extreme environment, investigated through dissection and 3D tomographic reconstruction of the internal anatomy.

Results: Our anatomical investigations of juvenile and adult specimens reveal a large unganglionated nervous system, a simple and reduced digestive system, and that the animal is a simultaneous hermaphrodite. We show that Chrysomallon squamiferum relies on endosymbiotic bacteria throughout post-larval life. Of particular interest is the circulatory system: Chrysomallon has a very large ctenidium supported by extensive blood sinuses filled with haemocoel. The ctenidium provides oxygen for the host but the circulatory system is enlarged beyond the scope of other similar vent gastropods. At the posterior of the ctenidium is a remarkably large and well-developed heart. Based on the volume of the auricle and ventricle, the heart complex represents approximately 4 % of the body volume. This proportionally giant heart primarily sucks blood through the ctenidium and supplies the highly vascularised oesophageal gland. Thus we infer the elaborate cardiovascular system most likely evolved to oxygenate the endosymbionts in an oxygen poor environment and/or to supply hydrogen sulfide to the endosymbionts.

Conclusions: This study exemplifies how understanding the autecology of an organism can be enhanced by detailed investigation of internal anatomy. This gastropod is a large and active species that is abundant in its hydrothermal vent field ecosystem. Yet all of its remarkable features-protective dermal sclerites, circulatory system, high fecundity-can be viewed as adaptations beneficial to its endosymbiont microbes. We interpret these results to show that, as a result of specialisation to resolve energetic needs in an extreme chemosynthetic environment, this dramatic dragon-like species has become a carrying vessel for its bacteria.

Optimal 3D surface reconstruction from multiview photographic images

This paper describes a new method for reconstructing 3D surface using a small number, e.g. 10, of 2D photographic images. The images are taken at different viewing directions by a perspective camera with full prior knowledge of the camera configurations. The reconstructed object's surface is represented a set of triangular facets. We empirically demonstrate that if the viewing directions are uniformly distributed around the object's viewing sphere, then the reconstructed 3D points optimally cluster closely on a highly curved part of the surface and are widely, spread on smooth or fat parts. The advantage of this property is that the reconstructed points along a surface or a contour generator are not undersampled or underrepresented because surfaces or contours should be sampled or represented with more densely points where their curvatures are high. The more complex the contour's shape, the greater is the number of points required, but the greater the number of points is automatically generated by the proposed method Given that the viewing directions are uniformly distributed, the number and distribution of the reconstructed points depend on the shape or the curvature of the surface regardless of the size of the surface or the size of the object.

Optimal 3D surface reconstruction from a small number of conventional 2D X-ray images

This paper describes a method for reconstructing 3D frontier points, contour generators and surfaces of anatomical objects or smooth surfaces from a small number, e. g. 10, of conventional 2D X-ray images. The X-ray images are taken at different viewing directions with full prior knowledge of the X-ray source and sensor configurations. Unlike previous works, we empirically demonstrate that if the viewing directions are uniformly distributed around the object's viewing sphere, then the reconstructed 3D points automatically cluster closely on a highly curved part of the surface and are widely spread on smooth or flat parts. The advantage of this property is that the reconstructed points along a surface or a contour generator are not under-sampled or under-represented because surfaces or contours should be sampled or represented with more densely points where their curvatures are high. The more complex the contour's shape, the greater is the number of points required, but the greater the number of points is automatically generated by the proposed method. Given that the number of viewing directions is fixed and the viewing directions are uniformly distributed, the number and distribution of the reconstructed points depend on the shape or the curvature of the surface regardless of the size of the surface or the size of the object. The technique may be used not only in medicine but also in industrial applications.

A variational approach to 3D geometry reconstruction from two or multiple views

[EN] In the last years we have developed some methods for 3D reconstruction. First we began with the problem of reconstructing a 3D scene from a stereoscopic pair of images. We developed some methods based on energy functionals which produce dense disparity maps by preserving discontinuities from image boundaries. Then we passed to the problem of reconstructing a 3D scene from multiple views (more than 2). The method for multiple view reconstruction relies on the method for stereoscopic reconstruction. For every pair of consecutive images we estimate a disparity map and then we apply a robust method that searches for good correspondences through the sequence of images. Recently we have proposed several methods for 3D surface regularization. This is a postprocessing step necessary for smoothing the final surface, which could be afected by noise or mismatch correspondences. These regularization methods are interesting because they use the information from the reconstructing process and not only from the 3D surface. We have tackled all these problems from an energy minimization approach. We investigate the associated Euler-Lagrange equation of the energy functional, and we approach the solution of the underlying partial differential equation (PDE) using a gradient descent method.

Development and implementation of a web-enabled 3D consultation tool for breast augmentation surgery based on 3D-image reconstruction of 2D pictures

Producing a rich, personalized Web-based consultation tool for plastic surgeons and patients is challenging.

Forensic veterinary radiology: ballistic-radiological 3D computertomographic reconstruction of an illegal lynx shooting in Switzerland

The lynx, which was reintroduced to Switzerland after being exterminated at the beginning of the 20th century, is protected by Swiss law. However, poaching occurs from time to time, which makes criminal investigations necessary. In the presented case, an illegally shot lynx was examined by conventional plane radiography and three-dimensional multislice computertomography (3D MSCT), of which the latter yielded superior results with respect to documentation and reconstruction of the inflicted gunshot wounds. We believe that 3D MSCT, already described in human forensic-pathological cases, is also a suitable and promising new technique for veterinary pathology.

3D Face Reconstruction from 2D Pictures: First Results of a Web-Based Computer Aided System for Aesthetic Procedures

The human face is a vital component of our identity and many people undergo medical aesthetics procedures in order to achieve an ideal or desired look. However, communication between physician and patient is fundamental to understand the patient’s wishes and to achieve the desired results. To date, most plastic surgeons rely on either “free hand” 2D drawings on picture printouts or computerized picture morphing. Alternatively, hardware dependent solutions allow facial shapes to be created and planned in 3D, but they are usually expensive or complex to handle. To offer a simple and hardware independent solution, we propose a web-based application that uses 3 standard 2D pictures to create a 3D representation of the patient’s face on which facial aesthetic procedures such as filling, skin clearing or rejuvenation, and rhinoplasty are planned in 3D. The proposed application couples a set of well-established methods together in a novel manner to optimize 3D reconstructions for clinical use. Face reconstructions performed with the application were evaluated by two plastic surgeons and also compared to ground truth data. Results showed the application can provide accurate 3D face representations to be used in clinics (within an average of 2 mm error) in less than 5 min.

A Novel Method for Radio Propagation Simulation Based on Automatic 3D Environment Reconstruction

In this paper, a novel method to simulate radio propagation is presented. The method consists of two steps: automatic 3D scenario reconstruction and propagation modeling. For 3D reconstruction, a machine learning algorithm is adopted and improved to automatically recognize objects in pictures taken from target regions, and 3D models are generated based on the recognized objects. The propagation model employs a ray tracing algorithm to compute signal strength for each point on the constructed 3D map. Our proposition reduces, or even eliminates, infrastructure cost and human efforts during the construction of realistic 3D scenes used in radio propagation modeling. In addition, the results obtained from our propagation model proves to be both accurate and efficient

A novel method for radio propagation simulation based on automatic 3D environment reconstruction

In this paper, a novel method to simulate radio propagation is presented. The method consists of two steps: automatic 3D scenario reconstruction and propagation modeling. For 3D reconstruction, a machine learning algorithm is adopted and improved to automatically recognize objects in pictures taken from target region, and 3D models are generated based on the recognized objects. The propagation model employs a ray tracing algorithm to compute signal strength for each point on the constructed 3D map. By comparing with other methods, the work presented in this paper makes contributions on reducing human efforts and cost in constructing 3D scene; moreover, the developed propagation model proves its potential in both accuracy and efficiency.