Automatic Segmentation of the Eye in 3D Magnetic Resonance Imaging: A novel Statistical Shape Model for treatment planning of Retinoblastoma

Purpose: Proper delineation of ocular anatomy in 3D imaging is a big challenge, particularly when developing treatment plans for ocular diseases. Magnetic Resonance Imaging (MRI) is nowadays utilized in clinical practice for the diagnosis confirmation and treatment planning of retinoblastoma in infants, where it serves as a source of information, complementary to the Fundus or Ultrasound imaging. Here we present a framework to fully automatically segment the eye anatomy in the MRI based on 3D Active Shape Models (ASM), we validate the results and present a proof of concept to automatically segment pathological eyes. Material and Methods: Manual and automatic segmentation were performed on 24 images of healthy children eyes (3.29±2.15 years). Imaging was performed using a 3T MRI scanner. The ASM comprises the lens, the vitreous humor, the sclera and the cornea. The model was fitted by first automatically detecting the position of the eye center, the lens and the optic nerve, then aligning the model and fitting it to the patient. We validated our segmentation method using a leave-one-out cross validation. The segmentation results were evaluated by measuring the overlap using the Dice Similarity Coefficient (DSC) and the mean distance error. Results: We obtained a DSC of 94.90±2.12% for the sclera and the cornea, 94.72±1.89% for the vitreous humor and 85.16±4.91% for the lens. The mean distance error was 0.26±0.09mm. The entire process took 14s on average per eye. Conclusion: We provide a reliable and accurate tool that enables clinicians to automatically segment the sclera, the cornea, the vitreous humor and the lens using MRI. We additionally present a proof of concept for fully automatically segmenting pathological eyes. This tool reduces the time needed for eye shape delineation and thus can help clinicians when planning eye treatment and confirming the extent of the tumor.

Articulated Statistical Shape Model-Based 2D-3D Reconstruction of a Hip Joint

In this paper, reconstruction of three-dimensional (3D) patient-specific models of a hip joint from two-dimensional (2D) calibrated X-ray images is addressed. Existing 2D-3D reconstruction techniques usually reconstruct a patient-specific model of a single anatomical structure without considering the relationship to its neighboring structures. Thus, when those techniques would be applied to reconstruction of patient-specific models of a hip joint, the reconstructed models may penetrate each other due to narrowness of the hip joint space and hence do not represent a true hip joint of the patient. To address this problem we propose a novel 2D-3D reconstruction framework using an articulated statistical shape model (aSSM). Different from previous work on constructing an aSSM, where the joint posture is modeled as articulation in a training set via statistical analysis, here it is modeled as a parametrized rotation of the femur around the joint center. The exact rotation of the hip joint as well as the patient-specific models of the joint structures, i.e., the proximal femur and the pelvis, are then estimated by optimally fitting the aSSM to a limited number of calibrated X-ray images. Taking models segmented from CT data as the ground truth, we conducted validation experiments on both plastic and cadaveric bones. Qualitatively, the experimental results demonstrated that the proposed 2D-3D reconstruction framework preserved the hip joint structure and no model penetration was found. Quantitatively, average reconstruction errors of 1.9 mm and 1.1 mm were found for the pelvis and the proximal femur, respectively.

Single fluoroscopic image based 2D/3D reconstruction of a scaled, patient-specific vertebral model

Purpose Accurate three-dimensional (3D) models of lumbar vertebrae can enable image-based 3D kinematic analysis. The common approach to derive 3D models is by direct segmentation of CT or MRI datasets. However, these have the disadvantages that they are expensive, timeconsuming and/or induce high-radiation doses to the patient. In this study, we present a technique to automatically reconstruct a scaled 3D lumbar vertebral model from a single two-dimensional (2D) lateral fluoroscopic image. Methods Our technique is based on a hybrid 2D/3D deformable registration strategy combining a landmark-to-ray registration with a statistical shape model-based 2D/3D reconstruction scheme. Fig. 1 shows different stages of the reconstruction process. Four cadaveric lumbar spine segments (total twelve lumbar vertebrae) were used to validate the technique. To evaluate the reconstruction accuracy, the surface models reconstructed from the lateral fluoroscopic images were compared to the associated ground truth data derived from a 3D CT-scan reconstruction technique. For each case, a surface-based matching was first used to recover the scale and the rigid transformation between the reconstructed surface model Results Our technique could successfully reconstruct 3D surface models of all twelve vertebrae. After recovering the scale and the rigid transformation between the reconstructed surface models and the ground truth models, the average error of the 2D/3D surface model reconstruction over the twelve lumbar vertebrae was found to be 1.0 mm. The errors of reconstructing surface models of all twelve vertebrae are shown in Fig. 2. It was found that the mean errors of the reconstructed surface models in comparison to their associated ground truths after iterative scaled rigid registrations ranged from 0.7 mm to 1.3 mm and the rootmean squared (RMS) errors ranged from 1.0 mm to 1.7 mm. The average mean reconstruction error was found to be 1.0 mm. Conclusion An accurate, scaled 3D reconstruction of the lumbar vertebra can be obtained from a single lateral fluoroscopic image using a statistical shape model based 2D/3D reconstruction technique. Future work will focus on applying the reconstructed model for 3D kinematic analysis of lumbar vertebrae, an extension of our previously-reported imagebased kinematic analysis. The developed method also has potential applications in surgical planning and navigation.

Automated detection of fiducial screws from CT/DVT volume data for image-guided ENT surgery

This paper presents an automated solution for precise detection of fiducial screws from three-dimensional (3D) Computerized Tomography (CT)/Digital Volume Tomography (DVT) data for image-guided ENT surgery. Unlike previously published solutions, we regard the detection of the fiducial screws from the CT/DVT volume data as a pose estimation problem. We thus developed a model-based solution. Starting from a user-supplied initialization, our solution detects the fiducial screws by iteratively matching a computer aided design (CAD) model of the fiducial screw to features extracted from the CT/DVT data. We validated our solution on one conventional CT dataset and on five DVT volume datasets, resulting in a total detection of 24 fiducial screws. Our experimental results indicate that the proposed solution achieves much higher reproducibility and precision than the manual detection. Further comparison shows that the proposed solution produces better results on the DVT dataset than on the conventional CT dataset.

Personalized X-Ray Reconstruction of the Proximal Femur via Intensity-Based Non-rigid 2D-3D Registration

This paper presents a new approach for reconstructing a patient-specific shape model and internal relative intensity distribution of the proximal femur from a limited number (e.g., 2) of calibrated C-arm images or X-ray radiographs. Our approach uses independent shape and appearance models that are learned from a set of training data to encode the a priori information about the proximal femur. An intensity-based non-rigid 2D-3D registration algorithm is then proposed to deformably fit the learned models to the input images. The fitting is conducted iteratively by minimizing the dissimilarity between the input images and the associated digitally reconstructed radiographs of the learned models together with regularization terms encoding the strain energy of the forward deformation and the smoothness of the inverse deformation. Comprehensive experiments conducted on images of cadaveric femurs and on clinical datasets demonstrate the efficacy of the present approach.

Diagnostic microchip to assay 3D colony-growth potential of captured circulating tumor cells

Microfluidic technology has been successfully applied to isolate very rare tumor-derived epithelial cells (circulating tumor cells, CTCs) from blood with relatively high yield and purity, opening up exciting prospects for early detection of cancer. However, a major limitation of state-of-the-art CTC-chips is their inability to characterize the behavior and function of captured CTCs, for example to obtain information on proliferative and invasive properties or, ultimately, tumor re-initiating potential. Although CTCs can be efficiently immunostained with markers reporting phenotype or fate (e.g. apoptosis, proliferation), it has not yet been possible to reliably grow captured CTCs over long periods of time and at single cell level. It is challenging to remove CTCs from a microchip after capture, therefore such analyses should ideally be performed directly on-chip. To address this challenge, we merged CTC capture with three-dimensional (3D) tumor cell culture on the same microfluidic platform. PC3 prostate cancer cells were isolated from spiked blood on a transparent PDMS CTC-chip, encapsulated on-chip in a biomimetic hydrogel matrix (QGel™) that was formed in situ, and their clonal 3D spheroid growth potential was assessed by microscopy over one week in culture. The possibility to clonally expand a subset of captured CTCs in a near-physiological in vitro model adds an important element to the expanding CTC-chip toolbox that ultimately should improve prediction of treatment responses and disease progression.

Reconstruction of patient-specific 3D bone surface from 2D calibrated fluoroscopic images and point distribution model

Reconstruction of patient-specific 3D bone surface from 2D calibrated fluoroscopic images and a point distribution model is discussed. We present a 2D/3D reconstruction scheme combining statistical extrapolation and regularized shape deformation with an iterative image-to-model correspondence establishing algorithm, and show its application to reconstruct the surface of proximal femur. The image-to-model correspondence is established using a non-rigid 2D point matching process, which iteratively uses a symmetric injective nearest-neighbor mapping operator and 2D thin-plate splines based deformation to find a fraction of best matched 2D point pairs between features detected from the fluoroscopic images and those extracted from the 3D model. The obtained 2D point pairs are then used to set up a set of 3D point pairs such that we turn a 2D/3D reconstruction problem to a 3D/3D one. We designed and conducted experiments on 11 cadaveric femurs to validate the present reconstruction scheme. An average mean reconstruction error of 1.2 mm was found when two fluoroscopic images were used for each bone. It decreased to 1.0 mm when three fluoroscopic images were used.

Prospective, intraindividual comparison of MRI versus MDCT for endoleak detection after endovascular repair of abdominal aortic aneurysms

This study compares MRI and MDCT for endoleak detection after endovascular repair of abdominal aortic aneurysms (EVAR). Forty-three patients with previous EVAR underwent both MRI (2D T1-FFE unenhanced and contrast-enhanced; 3D triphasic contrast-enhanced) and 16-slice MDCT (unenhanced and biphasic contrast-enhanced) within 1 week of each other for endoleak detection. MRI was performed by using a high-relaxivity contrast medium (gadobenate dimeglumine, MultiHance). Two blinded, independent observers evaluated MRI and MDCT separately. Consensus reading of MRI and MDCT studies was defined as reference standard. Sensitivity, specificity, and accuracy were calculated and Cohen's k statistics were used to estimate agreement between readers. Twenty endoleaks were detected in 18 patients at consensus reading (12 type II and 8 indeterminate endoleaks). Sensitivity, specificity, and accuracy for endoleak detection were 100%, 92%, and 96%, respectively, for reader 1 (95%, 81%, 87% for reader 2) for MRI and 55%, 100%, and 80% for reader 1 (60%, 100%, 82% for reader 2) for MDCT. Interobserver agreement was excellent for MDCT (k = 0.96) and good for MRI (k = 0.81). MRI with the use of a high-relaxivity contrast agent is significantly superior in the detection of endoleaks after EVAR compared with MDCT. MRI may therefore become the preferred technique for patient follow-up after EVAR.

The mean anatomical shape of the tibial plateau at the knee arthroplasty resection level: an investigation using MRI

Clinical assessments after Total Knee Arthroplasty (TKA) show persisting pain after implantation in over 20% of patients. Impingement of soft tissue around the knee, due to imprecise geometry of the tibial implant, can be one reason for persisting ailment. Two hundred and thirty seven MRI scans were evaluated using an active contour detection algorithm (snake) to obtain a high-resolution mean anatomical shape of the tibial plateau. Differences between female and male, older and younger (40) and left and right averaged shapes were determined. The shapes obtained were asymmetric throughout. Absolute differences between the subgroups fell short of inter-individual variations represented by calculated one-sigma confidence intervals. Our results indicate that a differentiation in TKA tibial plateau design by gender, age, or side is of minor relevance.

Multiscale methods for shape constraints in deconvolution: Confidence statements for qualitative features

We derive multiscale statistics for deconvolution in order to detect qualitative features of the unknown density. An important example covered within this framework is to test for local monotonicity on all scales simultaneously. We investigate the moderately ill-posed setting, where the Fourier transform of the error density in the deconvolution model is of polynomial decay. For multiscale testing, we consider a calibration, motivated by the modulus of continuity of Brownian motion. We investigate the performance of our results from both the theoretical and simulation based point of view. A major consequence of our work is that the detection of qualitative features of a density in a deconvolution problem is a doable task, although the minimax rates for pointwise estimation are very slow.

An integrated system for 3D hip joint reconstruction from 2D X-rays: a preliminary validation study

The acquisition of conventional X-ray radiographs remains the standard imaging procedure for the diagnosis of hip-related problems. However, recent studies demonstrated the benefit of using three-dimensional (3D) surface models in the clinical routine. 3D surface models of the hip joint are useful for assessing the dynamic range of motion in order to identify possible pathologies such as femoroacetabular impingement. In this paper, we present an integrated system which consists of X-ray radiograph calibration and subsequent 2D/3D hip joint reconstruction for diagnosis and planning of hip-related problems. A mobile phantom with two different sizes of fiducials was developed for X-ray radiograph calibration, which can be robustly detected within the images. On the basis of the calibrated X-ray images, a 3D reconstruction method of the acetabulum was developed and applied together with existing techniques to reconstruct a 3D surface model of the hip joint. X-ray radiographs of dry cadaveric hip bones and one cadaveric specimen with soft tissue were used to prove the robustness of the developed fiducial detection algorithm. Computed tomography scans of the cadaveric bones were used to validate the accuracy of the integrated system. The fiducial detection sensitivity was in the same range for both sizes of fiducials. While the detection sensitivity was 97.96% for the large fiducials, it was 97.62% for the small fiducials. The acetabulum and the proximal femur were reconstructed with a mean surface distance error of 1.06 and 1.01 mm, respectively. The results for fiducial detection sensitivity and 3D surface reconstruction demonstrated the capability of the integrated system for 3D hip joint reconstruction from 2D calibrated X-ray radiographs.

3D volumetric intensity reconsturction from 2D x-ray images using partial least squares regression

Reconstruction of shape and intensity from 2D x-ray images has drawn more and more attentions. Previously introduced work suffers from the long computing time due to its iterative optimization characteristics and the requirement of generating digitally reconstructed radiographs within each iteration. In this paper, we propose a novel method which uses a patient-specific 3D surface model reconstructed from 2D x-ray images as a surrogate to get a patient-specific volumetric intensity reconstruction via partial least squares regression. No DRR generation is needed. The method was validated on 20 cadaveric proximal femurs by performing a leave-one-out study. Qualitative and quantitative results demonstrated the efficacy of the present method. Compared to the existing work, the present method has the advantage of much shorter computing time and can be applied to both DXA images as well as conventional x-ray images, which may hold the potentials to be applied to clinical routine task such as total hip arthroplasty (THA).

IMILAST: A community effort to intercompare extratropical cyclone detection and tracking algorithms: assessing method-related uncertainties

The variability of results from different automated methods of detection and tracking of extratropical cyclones is assessed in order to identify uncertainties related to the choice of method. Fifteen international teams applied their own algorithms to the same dataset - the period 1989-2009 of interim European Centre for Medium-Range Weather Forecasts (ECMWF) Re-Analysis (ERAInterim) data. This experiment is part of the community project Intercomparison of Mid Latitude Storm Diagnostics (IMILAST; see www.proclim.ch/imilast/index.html). The spread of results for cyclone frequency, intensity, life cycle, and track location is presented to illustrate the impact of using different methods. Globally, methods agree well for geographical distribution in large oceanic regions, interannual variability of cyclone numbers, geographical patterns of strong trends, and distribution shape for many life cycle characteristics. In contrast, the largest disparities exist for the total numbers of cyclones, the detection of weak cyclones, and distribution in some densely populated regions. Consistency between methods is better for strong cyclones than for shallow ones. Two case studies of relatively large, intense cyclones reveal that the identification of the most intense part of the life cycle of these events is robust between methods, but considerable differences exist during the development and the dissolution phases.

Anti-PSMA antibody-coupled gold nanorods detection by optical and electron microscopies

While cancer is one of the greatest challenges to public health care, prostate cancer was chosen as cancer model to develop a more accurate imaging assessment than those currently available. Indeed, an efficient imaging technique which considerably improves the sensitivity and specificity of the diagnostic and predicting the cancer behavior would be extremely valuable. The concept of optoacoustic imaging using home-made functionalized gold nanoparticles coupled to an antibody targeting PSMA (prostate specific membrane antigen) was evaluated on different cancer cell lines to demonstrate the specificity of the designed platform. Two commonly used microscopy techniques (indirect fluorescence and scanning electron microscopy) showed their straightforwardness and versatility for the nanoparticle binding investigations regardless the composition of the investigated nanoobjects. Moreover most of the research laboratories and centers are equipped with fluorescence microscopes, so indirect fluorescence using Quantum dots can be used for any active targeting nanocarriers (polymers, ceramics, metals, etc.). The second technique based on backscattered electron is not only limited to gold nanoparticles but also suits for any study of metallic nanoparticles as the electronic density difference between the nanoparticles and binding surface stays high enough. Optoacoustic imaging was finally performed on a 3D cellular model to assess and prove the concept of the developed platform.

Mechanical constraints imposed by 3D cellular geometry and arrangement modulate growth patterns in the Arabidopsis embryo

Morphogenesis occurs in 3D space over time and is guided by coordinated gene expression programs. Here we use postembryonic development in Arabidopsis plants to investigate the genetic control of growth. We demonstrate that gene expression driving the production of the growth-stimulating hormone gibberellic acid and downstream growth factors is first induced within the radicle tip of the embryo. The center of cell expansion is, however, spatially displaced from the center of gene expression. Because the rapidly growing cells have very different geometry from that of those at the tip, we hypothesized that mechanical factors may contribute to this growth displacement. To this end we developed 3D finite-element method models of growing custom-designed digital embryos at cellular resolution. We used this framework to conceptualize how cell size, shape, and topology influence tissue growth and to explore the interplay of geometrical and genetic inputs into growth distribution. Our simulations showed that mechanical constraints are sufficient to explain the disconnect between the experimentally observed spatiotemporal patterns of gene expression and early postembryonic growth. The center of cell expansion is the position where genetic and mechanical facilitators of growth converge. We have thus uncovered a mechanism whereby 3D cellular geometry helps direct where genetically specified growth takes place.