Personalized 3D reconstruction of the rib cage for clinical assessment of trunk deformities

Scoliosis is a 3D deformity of the spine and rib cage. Extensive validation of 3D reconstruction methods of the spine from biplanar radiography has already been published. In this article, we propose a novel method to reconstruct the rib cage, using the same biplanar views as for the 3D reconstruction of the spine, to allow clinical assessment of whole trunk deformities. This technique uses a semi-automatic segmentation of the ribs in the postero-anterior X-ray view and an interactive segmentation of partial rib edges in the lateral view. The rib midlines are automatically extracted in 2D and reconstructed in 3D using the epipolar geometry. For the ribs not visible in the lateral view, the method predicts their 3D shape. The accuracy of the proposed method has been assessed using data obtained from a synthetic bone model as a gold standard and has also been evaluated using data of real patients with scoliotic deformities. Results show that the reconstructed ribs enable a reliable evaluation of the rib axial rotation, which will allow a 3D clinical assessment of the spine and rib cage deformities.

Combining 3D and 2D for less constrained periocular recognition

Periocular recognition has recently become an active topic in biometrics. Typically it uses 2D image data of the periocular region. This paper is the first description of combining 3D shape structure with 2D texture. A simple and effective technique using iterative closest point (ICP) was applied for 3D periocular region matching. It proved its strength for relatively unconstrained eye region capture, and does not require any training. Local binary patterns (LBP) were applied for 2D image based periocular matching. The two modalities were combined at the score-level. This approach was evaluated using the Bosphorus 3D face database, which contains large variations in facial expressions, head poses and occlusions. The rank-1 accuracy achieved from the 3D data (80%) was better than that for 2D (58%), and the best accuracy (83%) was achieved by fusing the two types of data. This suggests that significant improvements to periocular recognition systems could be achieved using the 3D structure information that is now available from small and inexpensive sensors.

Reverse correlation reveals how observers sample visual information when estimating three-dimensional shape

Human observers exhibit large systematic distance-dependent biases when estimating the three-dimensional (3D) shape of objects defined by binocular image disparities. This has led some to question the utility of disparity as a cue to 3D shape and whether accurate estimation of 3D shape is at all possible. Others have argued that accurate perception is possible, but only with large continuous perspective transformations of an object. Using a stimulus that is known to elicit large distance-dependent perceptual bias (random dot stereograms of elliptical cylinders) we show that contrary to these findings the simple adoption of a more naturalistic viewing angle completely eliminates this bias. Using behavioural psychophysics, coupled with a novel surface-based reverse correlation methodology, we show that it is binocular edge and contour information that allows for accurate and precise perception and that observers actively exploit and sample this information when it is available.

Individuazione di punti salienti in dati 3D mediante rappresentazioni strutturate

Questa tesi si inserisce nel filone di ricerca dell'elaborazione di dati 3D, e in particolare nella 3D Object Recognition, e delinea in primo luogo una panoramica sulle principali rappresentazioni strutturate di dati 3D, le quali rappresentano una prerogativa necessaria per implementare in modo efficiente algoritmi di processing di dati 3D, per poi presentare un nuovo algoritmo di 3D Keypoint Detection che è stato sviluppato e proposto dal Computer Vision Laboratory dell'Università di Bologna presso il quale ho effettuato la mia attività di tesi.

Statistical shape analysis via principal factor analysis

Statistical shape analysis techniques commonly employed in the medical imaging community, such as active shape models or active appearance models, rely on principal component analysis (PCA) to decompose shape variability into a reduced set of interpretable components. In this paper we propose principal factor analysis (PFA) as an alternative and complementary tool to PCA providing a decomposition into modes of variation that can be more easily interpretable, while still being a linear efficient technique that performs dimensionality reduction (as opposed to independent component analysis, ICA). The key difference between PFA and PCA is that PFA models covariance between variables, rather than the total variance in the data. The added value of PFA is illustrated on 2D landmark data of corpora callosa outlines. Then, a study of the 3D shape variability of the human left femur is performed. Finally, we report results on vector-valued 3D deformation fields resulting from non-rigid registration of ventricles in MRI of the brain.

THE THREE DIMENSIONAL SHAPE AND ROUGHNESS OF MINERAL DUST

Mineral dust shape and roughness are important for a multitude of processes; it is known for aspherical shape but the true measurements in three dimensions are rare. Atomic Force Microscope was used for determine both 3D shape and roughness for two dust which are commonly used in laboratory experiments – Arizona Test Dust (ATD) and Kaolinite. We determined both of them are rather flat and round; an oblate spheroid would be a good model. Loess Filter was used to smooth the particles' surface and correlation analysis was used to examine the surfaces' properties of the dust; we found no features under 100nm scales. Also, our particles' surface area result is very similar to BET surface area.

Comparison of 3D kinetic and hydrodynamic models to ROSINA-COPS measurements of the neutral coma of 67P/Churyumov-Gerasimenko

67P/Churyumov-Gerasimenko (67P) is a Jupiter-family comet and the object of investigation of the European Space Agency mission Rosetta. This report presents the first full 3D simulation results of 67P’s neutral gas coma. In this study we include results from a direct simulation Monte Carlo method, a hydrodynamic code, and a purely geometric calculation which computes the total illuminated surface area on the nucleus. All models include the triangulated 3D shape model of 67P as well as realistic illumination and shadowing conditions. The basic concept is the assumption that these illumination conditions on the nucleus are the main driver for the gas activity of the comet. As a consequence, the total production rate of 67P varies as a function of solar insolation. The best agreement between the model and the data is achieved when gas fluxes on the night side are in the range of 7% to 10% of the maximum flux, accounting for contributions from the most volatile components. To validate the output of our numerical simulations we compare the results of all three models to in situ gas number density measurements from the ROSINA COPS instrument. We are able to reproduce the overall features of these local neutral number density measurements of ROSINA COPS for the time period between early August 2014 and January 1 2015 with all three models. Some details in the measurements are not reproduced and warrant further investigation and refinement of the models. However, the overall assumption that illumination conditions on the nucleus are at least an important driver of the gas activity is validated by the models. According to our simulation results we find the total production rate of 67P to be constant between August and November 2014 with a value of about 1 × 10²⁶ molecules s⁻¹.

PDB-Explorer: a web-based interactive map of the protein data bank in shape space

Background The RCSB Protein Data Bank (PDB) provides public access to experimentally determined 3D-structures of biological macromolecules (proteins, peptides and nucleic acids). While various tools are available to explore the PDB, options to access the global structural diversity of the entire PDB and to perceive relationships between PDB structures remain very limited. Methods A 136-dimensional atom pair 3D-fingerprint for proteins (3DP) counting categorized atom pairs at increasing through-space distances was designed to represent the molecular shape of PDB-entries. Nearest neighbor searches examples were reported exemplifying the ability of 3DP-similarity to identify closely related biomolecules from small peptides to enzyme and large multiprotein complexes such as virus particles. The principle component analysis was used to obtain the visualization of PDB in 3DP-space. Results The 3DP property space groups proteins and protein assemblies according to their 3D-shape similarity, yet shows exquisite ability to distinguish between closely related structures. An interactive website called PDB-Explorer is presented featuring a color-coded interactive map of PDB in 3DP-space. Each pixel of the map contains one or more PDB-entries which are directly visualized as ribbon diagrams when the pixel is selected. The PDB-Explorer website allows performing 3DP-nearest neighbor searches of any PDB-entry or of any structure uploaded as protein-type PDB file. All functionalities on the website are implemented in JavaScript in a platform-independent manner and draw data from a server that is updated daily with the latest PDB additions, ensuring complete and up-to-date coverage. The essentially instantaneous 3DP-similarity search with the PDB-Explorer provides results comparable to those of much slower 3D-alignment algorithms, and automatically clusters proteins from the same superfamilies in tight groups. Conclusion A chemical space classification of PDB based on molecular shape was obtained using a new atom-pair 3D-fingerprint for proteins and implemented in a web-based database exploration tool comprising an interactive color-coded map of the PDB chemical space and a nearest neighbor search tool. The PDB-Explorer website is freely available at www.​cheminfo.​org/​pdbexplorer and represents an unprecedented opportunity to interactively visualize and explore the structural diversity of the PDB.

Optimization of TRPV6 Calcium Channel Inhibitors Using a 3D Ligand-Based Virtual Screening Method

Herein, we report the discovery of the first potent and selective inhibitor of TRPV6, a calcium channel overexpressed in breast and prostate cancer, and its use to test the effect of blocking TRPV6-mediated Ca2+-influx on cell growth. The inhibitor was discovered through a computational method, xLOS, a 3D-shape and pharmacophore similarity algorithm, a type of ligand-based virtual screening (LBVS) method described briefly here. Starting with a single weakly active seed molecule, two successive rounds of LBVS followed by optimization by chemical synthesis led to a selective molecule with 0.3 μM inhibition of TRPV6. The ability of xLOS to identify different scaffolds early in LBVS was essential to success. The xLOS method may be generally useful to develop tool compounds for poorly characterized targets.

Shape from photographs:a multi-view stereo pipeline

Acquiring 3D shape from images is a classic problem in Computer Vision occupying researchers for at least 20 years. Only recently however have these ideas matured enough to provide highly accurate results. We present a complete algorithm to reconstruct 3D objects from images using the stereo correspondence cue. The technique can be described as a pipeline of four basic building blocks: camera calibration, image segmentation, photo-consistency estimation from images, and surface extraction from photo-consistency. In this Chapter we will put more emphasis on the latter two: namely how to extract geometric information from a set of photographs without explicit camera visibility, and how to combine different geometry estimates in an optimal way. © 2010 Springer-Verlag Berlin Heidelberg.

Understanding 3D structures from sketches

Sketches are a unique way to communicate: drawing a simple sketch does not require any training, sketches convey information that is hard to describe with words, they are powerful enough to represent almost any concept, and nowadays, it is possible to draw directly from mobile devices. Motivated from the unique characteristics of sketches and fascinated by the human ability to imagine 3D objects from drawings, this thesis focuses on automatically associating geometric information to sketches. The main research directions of the thesis can be summarized as obtaining geometric information from freehand scene sketches to improve 2D sketch-based tasks and investigating Vision-Language models to overcome 3D sketch-based tasks limitations. The first part of the thesis concerns geometric information prediction from scene sketches improving scene sketch to image generation and unlocking new creativity effects. The thesis proceeds showing a study conducted on the Vision-Language models embedding space considering sketches, line renderings and RGB renderings of 3D shape to overcome the use of supervised datasets for 3D sketch-based tasks, that are limited and hard to acquire. Following the obtained observations and results, Vision-Language models are applied to Sketch Based Shape Retrieval without the need of training on supervised datasets. We then analyze the use of Vision-Language models for sketch based 3D reconstruction in an unsupervised manner. In the final chapter we report the results obtained in an additional project carried during the PhD, which has lead to the development of a framework to learn an embedding space of neural networks that can be navigated to get ready-to-use models with desired characteristics.

Growth Factor Stimulation Improves The Structure And Properties Of Scaffold-free Engineered Auricular Cartilage Constructs.

The reconstruction of the external ear to correct congenital deformities or repair following trauma remains a significant challenge in reconstructive surgery. Previously, we have developed a novel approach to create scaffold-free, tissue engineering elastic cartilage constructs directly from a small population of donor cells. Although the developed constructs appeared to adopt the structural appearance of native auricular cartilage, the constructs displayed limited expression and poor localization of elastin. In the present study, the effect of growth factor supplementation (insulin, IGF-1, or TGF-β1) was investigated to stimulate elastogenesis as well as to improve overall tissue formation. Using rabbit auricular chondrocytes, bioreactor-cultivated constructs supplemented with either insulin or IGF-1 displayed increased deposition of cartilaginous ECM, improved mechanical properties, and thicknesses comparable to native auricular cartilage after 4 weeks of growth. Similarly, growth factor supplementation resulted in increased expression and improved localization of elastin, primarily restricted within the cartilaginous region of the tissue construct. Additional studies were conducted to determine whether scaffold-free engineered auricular cartilage constructs could be developed in the 3D shape of the external ear. Isolated auricular chondrocytes were grown in rapid-prototyped tissue culture molds with additional insulin or IGF-1 supplementation during bioreactor cultivation. Using this approach, the developed tissue constructs were flexible and had a 3D shape in very good agreement to the culture mold (average error <400 µm). While scaffold-free, engineered auricular cartilage constructs can be created with both the appropriate tissue structure and 3D shape of the external ear, future studies will be aimed assessing potential changes in construct shape and properties after subcutaneous implantation.

Encephalization And Diversification Of The Cranial Base In Platyrrhine Primates.

The cranial base, composed of the midline and lateral basicranium, is a structurally important region of the skull associated with several key traits, which has been extensively studied in anthropology and primatology. In particular, most studies have focused on the association between midline cranial base flexion and relative brain size, or encephalization. However, variation in lateral basicranial morphology has been studied less thoroughly. Platyrrhines are a group of primates that experienced a major evolutionary radiation accompanied by extensive morphological diversification in Central and South America over a large temporal scale. Previous studies have also suggested that they underwent several evolutionarily independent processes of encephalization. Given these characteristics, platyrrhines present an excellent opportunity to study, on a large phylogenetic scale, the morphological correlates of primate diversification in brain size. In this study we explore the pattern of variation in basicranial morphology and its relationship with phylogenetic branching and with encephalization in platyrrhines. We quantify variation in the 3D shape of the midline and lateral basicranium and endocranial volumes in a large sample of platyrrhine species, employing high-resolution CT-scans and geometric morphometric techniques. We investigate the relationship between basicranial shape and encephalization using phylogenetic regression methods and calculate a measure of phylogenetic signal in the datasets. The results showed that phylogenetic structure is the most important dimension for understanding platyrrhine cranial base diversification; only Aotus species do not show concordance with our molecular phylogeny. Encephalization was only correlated with midline basicranial flexion, and species that exhibit convergence in their relative brain size do not display convergence in lateral basicranial shape. The evolution of basicranial variation in primates is probably more complex than previously believed, and understanding it will require further studies exploring the complex interactions between encephalization, brain shape, cranial base morphology, and ecological dimensions acting along the species divergence process.

Recovering Euclidean deformable models from stereo-motion

In this paper we present a novel structure from motion (SfM) approach able to infer 3D deformable models from uncalibrated stereo images. Using a stereo setup dramatically improves the 3D model estimation when the observed 3D shape is mostly deforming without undergoing strong rigid motion. Our approach first calibrates the stereo system automatically and then computes a single metric rigid structure for each frame. Afterwards, these 3D shapes are aligned to a reference view using a RANSAC method in order to compute the mean shape of the object and to select the subset of points on the object which have remained rigid throughout the sequence without deforming. The selected rigid points are then used to compute frame-wise shape registration and to extract the motion parameters robustly from frame to frame. Finally, all this information is used in a global optimization stage with bundle adjustment which allows to refine the frame-wise initial solution and also to recover the non-rigid 3D model. We show results on synthetic and real data that prove the performance of the proposed method even when there is no rigid motion in the original sequence

Improvement of saliva production in ENT cancer patients treated by IMRT

Intensity modulated radiotherapy (IMRT) is a conformal radiotherapy that produces concave and irregular target volume dose distributions. IMRT has a potential to reduce the volume of healthy tissue irradiated to a high dose, but this often at the price of an increased volume of normal tissue irradiated to a low dose. Clinical benefits of IMRT are expected to be most pronounced at the body sites where sensitive normal tissues surround or are located next to a target with a complex 3D shape. The irradiation doses needed for tumor control are often markedly higher than the tolerance of the radiation sensitive structures such as the spinal cord, the optic nerves, the eyes, or the salivary glands in the treatment of head and neck cancer. Parotid gland salivary flow is markedly reduced following a cumulative dose of 30 50 Gy given with conventional fractionation and xerostomia may be prevented in most patients using a conformal parotid-sparing radiotherapy technique. However, in cohort studies where IMRT was compared with conventional and conformal radiotherapy techniques in the treatment of laryngeal or oropharyngeal carcinoma, the dosimetric advantage of IMRT translated into a reduction of late salivary toxicity with no apparent adverse impact on the tumor control. IMRT might reduce the radiation dose to the major salivary glands and the risk of permanent xerostomia without compromizing the likelihood for cure. Alternatively, IMRT might allow the target dose escalation at a given level of normal tissue damage. We describe here the clinical results on postirradiation salivary gland function in head and neck cancer patients treated with IMRT, and the technical aspects of IMRT applied. The results suggest that the major salivary gland function can be maintained with IMRT without a need to compromise the clinical target volume dose, or the locoregional control.