Automatic Segmentation of the Eye in 3D Magnetic Resonance Imaging: A novel Statistical Shape Model for treatment planning of Retinoblastoma

Purpose: Proper delineation of ocular anatomy in 3D imaging is a big challenge, particularly when developing treatment plans for ocular diseases. Magnetic Resonance Imaging (MRI) is nowadays utilized in clinical practice for the diagnosis confirmation and treatment planning of retinoblastoma in infants, where it serves as a source of information, complementary to the Fundus or Ultrasound imaging. Here we present a framework to fully automatically segment the eye anatomy in the MRI based on 3D Active Shape Models (ASM), we validate the results and present a proof of concept to automatically segment pathological eyes. Material and Methods: Manual and automatic segmentation were performed on 24 images of healthy children eyes (3.29±2.15 years). Imaging was performed using a 3T MRI scanner. The ASM comprises the lens, the vitreous humor, the sclera and the cornea. The model was fitted by first automatically detecting the position of the eye center, the lens and the optic nerve, then aligning the model and fitting it to the patient. We validated our segmentation method using a leave-one-out cross validation. The segmentation results were evaluated by measuring the overlap using the Dice Similarity Coefficient (DSC) and the mean distance error. Results: We obtained a DSC of 94.90±2.12% for the sclera and the cornea, 94.72±1.89% for the vitreous humor and 85.16±4.91% for the lens. The mean distance error was 0.26±0.09mm. The entire process took 14s on average per eye. Conclusion: We provide a reliable and accurate tool that enables clinicians to automatically segment the sclera, the cornea, the vitreous humor and the lens using MRI. We additionally present a proof of concept for fully automatically segmenting pathological eyes. This tool reduces the time needed for eye shape delineation and thus can help clinicians when planning eye treatment and confirming the extent of the tumor.

Articulated Statistical Shape Model-Based 2D-3D Reconstruction of a Hip Joint

In this paper, reconstruction of three-dimensional (3D) patient-specific models of a hip joint from two-dimensional (2D) calibrated X-ray images is addressed. Existing 2D-3D reconstruction techniques usually reconstruct a patient-specific model of a single anatomical structure without considering the relationship to its neighboring structures. Thus, when those techniques would be applied to reconstruction of patient-specific models of a hip joint, the reconstructed models may penetrate each other due to narrowness of the hip joint space and hence do not represent a true hip joint of the patient. To address this problem we propose a novel 2D-3D reconstruction framework using an articulated statistical shape model (aSSM). Different from previous work on constructing an aSSM, where the joint posture is modeled as articulation in a training set via statistical analysis, here it is modeled as a parametrized rotation of the femur around the joint center. The exact rotation of the hip joint as well as the patient-specific models of the joint structures, i.e., the proximal femur and the pelvis, are then estimated by optimally fitting the aSSM to a limited number of calibrated X-ray images. Taking models segmented from CT data as the ground truth, we conducted validation experiments on both plastic and cadaveric bones. Qualitatively, the experimental results demonstrated that the proposed 2D-3D reconstruction framework preserved the hip joint structure and no model penetration was found. Quantitatively, average reconstruction errors of 1.9 mm and 1.1 mm were found for the pelvis and the proximal femur, respectively.

Non-rigid Free-Form 2D-3D Registration Using Statistical Deformation Model

This paper presents a non-rigid free-from 2D-3D registration approach using statistical deformation model (SDM). In our approach the SDM is first constructed from a set of training data using a non-rigid registration algorithm based on b-spline free-form deformation to encode a priori information about the underlying anatomy. A novel intensity-based non-rigid 2D-3D registration algorithm is then presented to iteratively fit the 3D b-spline-based SDM to the 2D X-ray images of an unseen subject, which requires a computationally expensive inversion of the instantiated deformation in each iteration. In this paper, we propose to solve this challenge with a fast B-spline pseudo-inversion algorithm that is implemented on graphics processing unit (GPU). Experiments conducted on C-arm and X-ray images of cadaveric femurs demonstrate the efficacy of the present approach.

Accuracy of linear measurements using three imaging modalities: two lateral cephalograms and one 3D model from CBCT data

BACKGROUND The aim of this study was to evaluate the accuracy of linear measurements on three imaging modalities: lateral cephalograms from a cephalometric machine with a 3 m source-to-mid-sagittal-plane distance (SMD), from a machine with 1.5 m SMD and 3D models from cone-beam computed tomography (CBCT) data. METHODS Twenty-one dry human skulls were used. Lateral cephalograms were taken, using two cephalometric devices: one with a 3 m SMD and one with a 1.5 m SMD. CBCT scans were taken by 3D Accuitomo® 170, and 3D surface models were created in Maxilim® software. Thirteen linear measurements were completed twice by two observers with a 4 week interval. Direct physical measurements by a digital calliper were defined as the gold standard. Statistical analysis was performed. RESULTS Nasion-Point A was significantly different from the gold standard in all methods. More statistically significant differences were found on the measurements of the 3 m SMD cephalograms in comparison to the other methods. Intra- and inter-observer agreement based on 3D measurements was slightly better than others. LIMITATIONS Dry human skulls without soft tissues were used. Therefore, the results have to be interpreted with caution, as they do not fully represent clinical conditions. CONCLUSIONS 3D measurements resulted in a better observer agreement. The accuracy of the measurements based on CBCT and 1.5 m SMD cephalogram was better than a 3 m SMD cephalogram. These findings demonstrated the linear measurements accuracy and reliability of 3D measurements based on CBCT data when compared to 2D techniques. Future studies should focus on the implementation of 3D cephalometry in clinical practice.

Personalized X-Ray Reconstruction of the Proximal Femur via Intensity-Based Non-rigid 2D-3D Registration

This paper presents a new approach for reconstructing a patient-specific shape model and internal relative intensity distribution of the proximal femur from a limited number (e.g., 2) of calibrated C-arm images or X-ray radiographs. Our approach uses independent shape and appearance models that are learned from a set of training data to encode the a priori information about the proximal femur. An intensity-based non-rigid 2D-3D registration algorithm is then proposed to deformably fit the learned models to the input images. The fitting is conducted iteratively by minimizing the dissimilarity between the input images and the associated digitally reconstructed radiographs of the learned models together with regularization terms encoding the strain energy of the forward deformation and the smoothness of the inverse deformation. Comprehensive experiments conducted on images of cadaveric femurs and on clinical datasets demonstrate the efficacy of the present approach.

Investigating the interaction of cellulose nanofibers derived from cotton with a sophisticated 3D human lung cell coculture

Cellulose nanofibers are an attractive component of a broad range of nanomaterials. Their intriguing mechanical properties and low cost, as well as the renewable nature of cellulose make them an appealing alternative to carbon nanotubes (CNTs), which may pose a considerable health risk when inhaled. Little is known, however, concerning the potential toxicity of aerosolized cellulose nanofibers. Using a 3D in vitro triple cell coculture model of the human epithelial airway barrier, it was observed that cellulose nanofibers isolated from cotton (CCN) elicited a significantly (p < 0.05) lower cytotoxicity and (pro-)inflammatory response than multiwalled CNTs (MWCNTs) and crocidolite asbestos fibers (CAFs). Electron tomography analysis also revealed that the intracellular localization of CCNs is different from that of both MWCNTs and CAFs, indicating fundamental differences between each different nanofibre type in their interaction with the human lung cell coculture. Thus, the data shown in the present study highlights that not only the length and stiffness determine the potential detrimental (biological) effects of any nanofiber, but that the material used can significantly affect nanofiber-cell interactions.

Diagnostic microchip to assay 3D colony-growth potential of captured circulating tumor cells

Microfluidic technology has been successfully applied to isolate very rare tumor-derived epithelial cells (circulating tumor cells, CTCs) from blood with relatively high yield and purity, opening up exciting prospects for early detection of cancer. However, a major limitation of state-of-the-art CTC-chips is their inability to characterize the behavior and function of captured CTCs, for example to obtain information on proliferative and invasive properties or, ultimately, tumor re-initiating potential. Although CTCs can be efficiently immunostained with markers reporting phenotype or fate (e.g. apoptosis, proliferation), it has not yet been possible to reliably grow captured CTCs over long periods of time and at single cell level. It is challenging to remove CTCs from a microchip after capture, therefore such analyses should ideally be performed directly on-chip. To address this challenge, we merged CTC capture with three-dimensional (3D) tumor cell culture on the same microfluidic platform. PC3 prostate cancer cells were isolated from spiked blood on a transparent PDMS CTC-chip, encapsulated on-chip in a biomimetic hydrogel matrix (QGel™) that was formed in situ, and their clonal 3D spheroid growth potential was assessed by microscopy over one week in culture. The possibility to clonally expand a subset of captured CTCs in a near-physiological in vitro model adds an important element to the expanding CTC-chip toolbox that ultimately should improve prediction of treatment responses and disease progression.

Monte Carlo source model for photon beam radiotherapy: photon source characteristics

A major barrier to widespread clinical implementation of Monte Carlo dose calculation is the difficulty in characterizing the radiation source within a generalized source model. This work aims to develop a generalized three-component source model (target, primary collimator, flattening filter) for 6- and 18-MV photon beams that match full phase-space data (PSD). Subsource by subsource comparison of dose distributions, using either source PSD or the source model as input, allows accurate source characterization and has the potential to ease the commissioning procedure, since it is possible to obtain information about which subsource needs to be tuned. This source model is unique in that, compared to previous source models, it retains additional correlations among PS variables, which improves accuracy at nonstandard source-to-surface distances (SSDs). In our study, three-dimensional (3D) dose calculations were performed for SSDs ranging from 50 to 200 cm and for field sizes from 1 x 1 to 30 x 30 cm2 as well as a 10 x 10 cm2 field 5 cm off axis in each direction. The 3D dose distributions, using either full PSD or the source model as input, were compared in terms of dose-difference and distance-to-agreement. With this model, over 99% of the voxels agreed within +/-1% or 1 mm for the target, within 2% or 2 mm for the primary collimator, and within +/-2.5% or 2 mm for the flattening filter in all cases studied. For the dose distributions, 99% of the dose voxels agreed within 1% or 1 mm when the combined source model-including a charged particle source and the full PSD as input-was used. The accurate and general characterization of each photon source and knowledge of the subsource dose distributions should facilitate source model commissioning procedures by allowing scaling the histogram distributions representing the subsources to be tuned.

Hip2Norm: an object-oriented cross-platform program for 3D analysis of hip joint morphology using 2D pelvic radiographs

We developed an object-oriented cross-platform program to perform three-dimensional (3D) analysis of hip joint morphology using two-dimensional (2D) anteroposterior (AP) pelvic radiographs. Landmarks extracted from 2D AP pelvic radiographs and optionally an additional lateral pelvic X-ray were combined with a cone beam projection model to reconstruct 3D hip joints. Since individual pelvic orientation can vary considerably, a method for standardizing pelvic orientation was implemented to determine the absolute tilt/rotation. The evaluation of anatomically morphologic differences was achieved by reconstructing the projected acetabular rim and the measured hip parameters as if obtained in a standardized neutral orientation. The program had been successfully used to interactively objectify acetabular version in hips with femoro-acetabular impingement or developmental dysplasia. Hip(2)Norm is written in object-oriented programming language C++ using cross-platform software Qt (TrollTech, Oslo, Norway) for graphical user interface (GUI) and is transportable to any platform.

Development of the premature infant nose throat-model (PrINT-Model): an upper airway replica of a premature neonate for the study of aerosol delivery

Clinical efficacy of aerosol therapy in premature newborns depends on the efficiency of delivery of aerosolized drug to the bronchial tree. To study the influence of various anatomical, physical, and physiological factors on aerosol delivery in preterm newborns, it is crucial to have appropriate in vitro models, which are currently not available. We therefore constructed the premature infant nose throat-model (PrINT-Model), an upper airway model corresponding to a premature infant of 32-wk gestational age by three-dimensional (3D) reconstruction of a three-planar magnetic resonance imaging scan and subsequent 3D-printing. Validation was realized by visual comparison and comparison of total airway volume. To study the feasibility of measuring aerosol deposition, budesonide was aerosolized through the cast and lung dose was expressed as percentage of nominal dose. The airway volumes of the initial magnetic resonance imaging and validation computed tomography scan showed a relative deviation of 0.94%. Lung dose at low flow (1 L/min) was 61.84% and 9.00% at high flow (10 L/min), p < 0.0001. 3D-reconstruction provided an anatomically accurate surrogate of the upper airways of a 32-wk-old premature infant, making the model suitable for future in vitro testing.

Hierarchical Markov Random Fields Applied to Model Soft Tissue Deformations on Graphics Hardware

Many methodologies dealing with prediction or simulation of soft tissue deformations on medical image data require preprocessing of the data in order to produce a different shape representation that complies with standard methodologies, such as mass–spring networks, finite element method s (FEM). On the other hand, methodologies working directly on the image space normally do not take into account mechanical behavior of tissues and tend to lack physics foundations driving soft tissue deformations. This chapter presents a method to simulate soft tissue deformations based on coupled concepts from image analysis and mechanics theory. The proposed methodology is based on a robust stochastic approach that takes into account material properties retrieved directly from the image, concepts from continuum mechanics and FEM. The optimization framework is solved within a hierarchical Markov random field (HMRF) which is implemented on the graphics processor unit (GPU See Graphics processing unit ).

A system for 3-D reconstruction of a patient-specific surface model from calibrated X-ray images

This paper presents a system for 3-D reconstruction of a patient-specific surface model from calibrated X-ray images. Our system requires two X-ray images of a patient with one acquired from the anterior-posterior direction and the other from the axial direction. A custom-designed cage is utilized in our system to calibrate both images. Starting from bone contours that are interactively identified from the X-ray images, our system constructs a patient-specific surface model of the proximal femur based on a statistical model based 2D/3D reconstruction algorithm. In this paper, we present the design and validation of the system with 25 bones. An average reconstruction error of 0.95 mm was observed.

Nonviral Gene Delivery of Growth and Differentiation Factor 5 to Human Mesenchymal Stem Cells Injected into a 3D Bovine Intervertebral Disc Organ Culture System

Intervertebral disc (IVD) cell therapy with unconditioned 2D expanded mesenchymal stem cells (MSC) is a promising concept yet challenging to realize. Differentiation of MSCs by nonviral gene delivery of growth and differentiation factor 5 (GDF5) by electroporation mediated gene transfer could be an excellent source for cell transplantation. Human MSCs were harvested from bone marrow aspirate and GDF5 gene transfer was achieved by in vitro electroporation. Transfected cells were cultured as monolayers and as 3D cultures in 1.2% alginate bead culture. MSC expressed GDF5 efficiently for up to 21 days. The combination of GDF5 gene transfer and 3D culture in alginate showed an upregulation of aggrecan and SOX9, two markers for chondrogenesis, and KRT19 as a marker for discogenesis compared to untransfected cells. The cells encapsulated in alginate produced more proteoglycans expressed in GAG/DNA ratio. Furthermore, GDF5 transfected MCS injected into an IVD papain degeneration organ culture model showed a partial recovery of the GAG/DNA ratio after 7 days. In this study we demonstrate the potential of GDF5 transfected MSC as a promising approach for clinical translation for disc regeneration.