Color Region Grouping and Shape Recognition with Deformable Models

A new deformable shape-based method for color region segmentation is described. The method includes two stages: over-segmentation using a traditional color region segmentation algorithm, followed by deformable model-based region merging via grouping and hypothesis selection. During the second stage, region merging and object identification are executed simultaneously. A statistical shape model is used to estimate the likelihood of region groupings and model hypotheses. The prior distribution on deformation parameters is precomputed using principal component analysis over a training set of region groupings. Once trained, the system autonomously segments deformed shapes from the background, while not merging them with similarly colored adjacent objects. Furthermore, the recovered parametric shape model can be used directly in object recognition and comparison. Experiments in segmentation and image retrieval are reported.

Retrieval by Shape Population: An Index Tree Approach

Based on our previous work in deformable shape model-based object detection, a new method is proposed that uses index trees for organizing shape features to support content-based retrieval applications. In the proposed strategy, different shape feature sets can be used in index trees constructed for object detection and shape similarity comparison respectively. There is a direct correspondence between the two shape feature sets. As a result, application-specific features can be obtained efficiently for shape-based retrieval after object detection. A novel approach is proposed that allows retrieval of images based on the population distribution of deformed shapes in each image. Experiments testing these new approaches have been conducted using an image database that contains blood cell micrographs. The precision vs. recall performance measure shows that our method is superior to previous methods.

Region Segmentation via Deformable Model-Guided Split and Merge

An improved method for deformable shape-based image segmentation is described. Image regions are merged together and/or split apart, based on their agreement with an a priori distribution on the global deformation parameters for a shape template. The quality of a candidate region merging is evaluated by a cost measure that includes: homogeneity of image properties within the combined region, degree of overlap with a deformed shape model, and a deformation likelihood term. Perceptually-motivated criteria are used to determine where/how to split regions, based on the local shape properties of the region group's bounding contour. A globally consistent interpretation is determined in part by the minimum description length principle. Experiments show that the model-based splitting strategy yields a significant improvement in segmention over a method that uses merging alone.

Intersubject Regularity in the Intrinsic Shape of Human V1

Previous studies have reported considerable intersubject variability in the three-dimensional geometry of the human primary visual cortex (V1). Here we demonstrate that much of this variability is due to extrinsic geometric features of the cortical folds, and that the intrinsic shape of V1 is similar across individuals. V1 was imaged in ten ex vivo human hemispheres using high-resolution (200 μm) structural magnetic resonance imaging at high field strength (7 T). Manual tracings of the stria of Gennari were used to construct a surface representation, which was computationally flattened into the plane with minimal metric distortion. The instrinsic shape of V1 was determined from the boundary of the planar representation of the stria. An ellipse provided a simple parametric shape model that was a good approximation to the boundary of flattened V1. The aspect ration of the best-fitting ellipse was found to be consistent across subject, with a mean of 1.85 and standard deviation of 0.12. Optimal rigid alignment of size-normalized V1 produced greater overlap than that achieved by previous studies using different registration methods. A shape analysis of published macaque data indicated that the intrinsic shape of macaque V1 is also stereotyped, and similar to the human V1 shape. Previoud measurements of the functional boundary of V1 in human and macaque are in close agreement with these results.

Shape and Rotation Modeling and Thermophysical Analysis of Near-Earth Asteroid (1917) Cuyo

We are conducting an ESO Large Program that includes optical photometry, thermal-IR observations, and optical-NIR spectroscopy of selected NEAs. Among the principal goals of the program are shape and spin-state modeling, and searching for YORP-induced changes in rotation periods. One of our targets is asteroid (1917) Cuyo, a near-Earth asteroid from the Amor group. We carried out an extensive observing campaign on Cuyo between April 2010 and April 2013, operating primarily at the ESO 3.6m NTT for optical photometry, and the 8.2m VLT at Paranal for thermal-IR imaging. Further optical observations were acquired at the ESO 2.2m telescope, the Palomar 200" Hale telescope (California), JPL’s Table Mountain Observatory (California) and the Faulkes Telescope South (Australia). We obtained optical imaging data for rotational lightcurves throughout this period, as the asteroid passed through a wide range of observational geometries, conducive to producing a good shape model and spin state solution. The preliminary shape and spin state model indicates a nearly spherical shape and a rotation pole at ecliptic longitude λ = 53° ± 20° and latitude β = -37° ± 10° (1-sigma error bars are approximate). The sidereal rotation period was measured to be 2.6899522 ± (3 × 10^-7) hours. Linkage with earlier lightcurve data shows possible evidence of a small change in rotation rate during the period 1989-2013. We applied the NEATM thermal model (Harris A., Icarus 131, 291, 1998) to our VLT thermal-IR measurements (8-19.6 μm), obtained in September and December 2011. The derived effective diameter ranges from 3.4 to 4.2 km, and the geometric albedo is 0.16 (+0.07, -0.04). Using the shape model and thermal fluxes we will perform a detailed thermophysical analysis using the new Advanced Thermophysical Model (Rozitis, B. & Green, S.F., MNRAS 415, 2042, 2011; Rozitis, B. & Green, S.F., MNRAS 423, 367, 2012). This work was performed in part at the Jet Propulsion Laboratory under a contract with NASA.

Single fluoroscopic image based 2D/3D reconstruction of a scaled, patient-specific vertebral model

Purpose Accurate three-dimensional (3D) models of lumbar vertebrae can enable image-based 3D kinematic analysis. The common approach to derive 3D models is by direct segmentation of CT or MRI datasets. However, these have the disadvantages that they are expensive, timeconsuming and/or induce high-radiation doses to the patient. In this study, we present a technique to automatically reconstruct a scaled 3D lumbar vertebral model from a single two-dimensional (2D) lateral fluoroscopic image. Methods Our technique is based on a hybrid 2D/3D deformable registration strategy combining a landmark-to-ray registration with a statistical shape model-based 2D/3D reconstruction scheme. Fig. 1 shows different stages of the reconstruction process. Four cadaveric lumbar spine segments (total twelve lumbar vertebrae) were used to validate the technique. To evaluate the reconstruction accuracy, the surface models reconstructed from the lateral fluoroscopic images were compared to the associated ground truth data derived from a 3D CT-scan reconstruction technique. For each case, a surface-based matching was first used to recover the scale and the rigid transformation between the reconstructed surface model Results Our technique could successfully reconstruct 3D surface models of all twelve vertebrae. After recovering the scale and the rigid transformation between the reconstructed surface models and the ground truth models, the average error of the 2D/3D surface model reconstruction over the twelve lumbar vertebrae was found to be 1.0 mm. The errors of reconstructing surface models of all twelve vertebrae are shown in Fig. 2. It was found that the mean errors of the reconstructed surface models in comparison to their associated ground truths after iterative scaled rigid registrations ranged from 0.7 mm to 1.3 mm and the rootmean squared (RMS) errors ranged from 1.0 mm to 1.7 mm. The average mean reconstruction error was found to be 1.0 mm. Conclusion An accurate, scaled 3D reconstruction of the lumbar vertebra can be obtained from a single lateral fluoroscopic image using a statistical shape model based 2D/3D reconstruction technique. Future work will focus on applying the reconstructed model for 3D kinematic analysis of lumbar vertebrae, an extension of our previously-reported imagebased kinematic analysis. The developed method also has potential applications in surgical planning and navigation.

Assessment Of Dynamic Properties Of A Crowd Model For Human-Structure Interaction Modeling

As lightweight and slender structural elements are more frequently used in the design, large scale structures become more flexible and susceptible to excessive vibrations. To ensure the functionality of the structure, dynamic properties of the occupied structure need to be estimated during the design phase. Traditional analysis method models occupants simply as an additional mass; however, research has shown that human occupants could be better modeled as an additional degree-of- freedom. In the United Kingdom, active and passive crowd models are proposed by the Joint Working Group as a result of a series of analytical and experimental research. It is expected that the crowd models would yield a more accurate estimation to the dynamic response of the occupied structure. However, experimental testing recently conducted through a graduate student project at Bucknell University indicated that the proposed passive crowd model might be inaccurate in representing the impact on the structure from the occupants. The objective of this study is to provide an assessment of the validity of the crowd models proposed by JWG through comparing the dynamic properties obtained from experimental testing data and analytical modeling results. The experimental data used in this study was collected by Firman in 2010. The analytical results were obtained by performing a time-history analysis on a finite element model of the occupied structure. The crowd models were created based on the recommendations from the JWG combined with the physical properties of the occupants during the experimental study. During this study, SAP2000 was used to create the finite element models and to implement the analysis; Matlab and ME¿scope were used to obtain the dynamic properties of the structure through processing the time-history analysis results from SAP2000. The result of this study indicates that the active crowd model could quite accurately represent the impact on the structure from occupants standing with bent knees while the passive crowd model could not properly simulate the dynamic response of the structure when occupants were standing straight or sitting on the structure. Future work related to this study involves improving the passive crowd model and evaluating the crowd models with full-scale structure models and operating data.

Statistical shape analysis via principal factor analysis

Statistical shape analysis techniques commonly employed in the medical imaging community, such as active shape models or active appearance models, rely on principal component analysis (PCA) to decompose shape variability into a reduced set of interpretable components. In this paper we propose principal factor analysis (PFA) as an alternative and complementary tool to PCA providing a decomposition into modes of variation that can be more easily interpretable, while still being a linear efficient technique that performs dimensionality reduction (as opposed to independent component analysis, ICA). The key difference between PFA and PCA is that PFA models covariance between variables, rather than the total variance in the data. The added value of PFA is illustrated on 2D landmark data of corpora callosa outlines. Then, a study of the 3D shape variability of the human left femur is performed. Finally, we report results on vector-valued 3D deformation fields resulting from non-rigid registration of ventricles in MRI of the brain.

Statistical model-based segmentation of the proximal femur in digital antero-posterior (AP) pelvic radiographs.

PURPOSE    Segmentation of the proximal femur in digital antero-posterior (AP) pelvic radiographs is required to create a three-dimensional model of the hip joint for use in planning and treatment. However, manually extracting the femoral contour is tedious and prone to subjective bias, while automatic segmentation must accommodate poor image quality, anatomical structure overlap, and femur deformity. A new method was developed for femur segmentation in AP pelvic radiographs. METHODS    Using manual annotations on 100 AP pelvic radiographs, a statistical shape model (SSM) and a statistical appearance model (SAM) of the femur contour were constructed. The SSM and SAM were used to segment new AP pelvic radiographs with a three-stage approach. At initialization, the mean SSM model is coarsely registered to the femur in the AP radiograph through a scaled rigid registration. Mahalanobis distance defined on the SAM is employed as the search criteria for each annotated suggested landmark location. Dynamic programming was used to eliminate ambiguities. After all landmarks are assigned, a regularized non-rigid registration method deforms the current mean shape of SSM to produce a new segmentation of proximal femur. The second and third stages are iteratively executed to convergence. RESULTS    A set of 100 clinical AP pelvic radiographs (not used for training) were evaluated. The mean segmentation error was [Formula: see text], requiring [Formula: see text] s per case when implemented with Matlab. The influence of the initialization on segmentation results was tested by six clinicians, demonstrating no significance difference. CONCLUSIONS    A fast, robust and accurate method for femur segmentation in digital AP pelvic radiographs was developed by combining SSM and SAM with dynamic programming. This method can be extended to segmentation of other bony structures such as the pelvis.

The spatial distribution of water in the inner coma of Comet 9P/Tempel 1: Comparison between models and observations

The near nucleus coma of Comet 9P/Tempel 1 has been simulated with the 3D Direct Simulation Monte Carlo (DSMC) code PDSC++ (Su, C.-C. [2013]. Parallel Direct Simulation Monte Carlo (DSMC) Methods for Modeling Rarefied Gas Dynamics. PhD Thesis, National Chiao Tung University, Taiwan) and the derived column densities have been compared to observations of the water vapour distribution found by using infrared imaging spectrometer on the Deep Impact spacecraft (Feaga, L.M., A’Hearn, M.F., Sunshine, J.M., Groussin, O., Farnham, T.L. [2007]. Icarus 191(2), 134–145. http://dx.doi.org/10.1016/j.icarus.2007.04.038). Modelled total production rates are also compared to various observations made at the time of the Deep Impact encounter. Three different models were tested. For all models, the shape model constructed from the Deep Impact observations by Thomas et al. (Thomas, P.C., Veverka, J., Belton, M.J.S., Hidy, A., A’Hearn, M.F., Farnham, T.L., et al. [2007]. Icarus, 187(1), 4–15. http://dx.doi.org/10.1016/j.icarus.2006.12.013) was used. Outgassing depending only on the cosine of the solar insolation angle on each shape model facet is shown to provide an unsatisfactory model. Models constructed on the basis of active areas suggested by Kossacki and Szutowicz (Kossacki, K., Szutowicz, S. [2008]. Icarus, 195(2), 705–724. http://dx.doi.org/10.1016/j.icarus.2007.12.014) are shown to be superior. The Kossacki and Szutowicz model, however, also shows deficits which we have sought to improve upon. For the best model we investigate the properties of the outflow.

Automatic X-ray landmark detection and shape segmentation via data-driven joint estimation of image displacements

In this paper, we propose a new method for fully-automatic landmark detection and shape segmentation in X-ray images. To detect landmarks, we estimate the displacements from some randomly sampled image patches to the (unknown) landmark positions, and then we integrate these predictions via a voting scheme. Our key contribution is a new algorithm for estimating these displacements. Different from other methods where each image patch independently predicts its displacement, we jointly estimate the displacements from all patches together in a data driven way, by considering not only the training data but also geometric constraints on the test image. The displacements estimation is formulated as a convex optimization problem that can be solved efficiently. Finally, we use the sparse shape composition model as the a priori information to regularize the landmark positions and thus generate the segmented shape contour. We validate our method on X-ray image datasets of three different anatomical structures: complete femur, proximal femur and pelvis. Experiments show that our method is accurate and robust in landmark detection, and, combined with the shape model, gives a better or comparable performance in shape segmentation compared to state-of-the art methods. Finally, a preliminary study using CT data shows the extensibility of our method to 3D data.

Fast Prediction of Femoral Biomechanics Using Supervised Machine Learning and Statistical Shape Modeling

Finite element (FE) analysis is an important computational tool in biomechanics. However, its adoption into clinical practice has been hampered by its computational complexity and required high technical competences for clinicians. In this paper we propose a supervised learning approach to predict the outcome of the FE analysis. We demonstrate our approach on clinical CT and X-ray femur images for FE predictions ( FEP), with features extracted, respectively, from a statistical shape model and from 2D-based morphometric and density information. Using leave-one-out experiments and sensitivity analysis, comprising a database of 89 clinical cases, our method is capable of predicting the distribution of stress values for a walking loading condition with an average correlation coefficient of 0.984 and 0.976, for CT and X-ray images, respectively. These findings suggest that supervised learning approaches have the potential to leverage the clinical integration of mechanical simulations for the treatment of musculoskeletal conditions.

Insolation, erosion, and morphology of comet 67P/Churyumov-Gerasimenko

Context. The complex shape of comet 67P and its oblique rotation axis cause pronounced seasonal effects. Irradiation and hence activity vary strongly. Aims. We investigate the insolation of the cometary surface in order to predict the sublimation of water ice. The strongly varying erosion levels are correlated with the topography and morphology of the present cometary surface and its evolution. Methods. The insolation as a function of heliocentric distance and diurnal (spin dependent) variation is calculated using >10(5) facets of a detailed digital terrain model. Shading, but also illumination and thermal radiation by facets in the field of view of a specific facet are iteratively taken into account. We use a two-layer model of a thin porous dust cover above an icy surface to calculate the water sublimation, presuming steady state and a uniform surface. Our second model, which includes the history of warming and cooling due to thermal inertia, is restricted to a much simpler shape model but allows us to test various distributions of active areas. Results. Sublimation from a dirty ice surface yields maximum erosion. A thin dust cover of 50 pm yields similar rates at perihelion. Only about 6% of the surface needs to be active to match the observed water production rates at perihelion. A dust layer of 1 mm thickness suppresses the activity by a factor of 4 to 5. Erosion on the south side can reach more than 10 m per orbit at active spots. The energy input to the concave neck area (Hapi) during northern summer is enhanced by about 50% owing to self-illumination. Here surface temperatures reach maximum values along the foot of the Hathor wall. Integrated over the whole orbit this area receives the least energy input. Based on the detailed shape model, the simulations identify "hot spots" in depressions and larger pits in good correlation with observed dust activity. Three-quarters of the total sublimation is produced while the sub-solar latitude is south, resulting in a distinct dichotomy in activity and morphology. Conclusions. The northern areas display a much rougher morphology than what is seen on Imhotep, an area at the equator that will be fully illuminated when 67P is closer to the Sun. Self-illumination in concave regions enhance the energy input and hence erosion. This explains the early activity observed at Hapi. Cliffs are more prone to erosion than horizontal, often dust covered, areas, which leads to surface planation. Local activity can only persist if the forming cliff walls are eroding. Comet 67P has two lobes and also two distinct sides. Transport of material from the south to the north is probable. The morphology of the Imhotep plain should be typical for the terrains of the yet unseen southern hemisphere.

A model for amplification of hair-bundle motion by cyclical binding of Ca2+ to mechanoelectrical-transduction channels

Amplification of auditory stimuli by hair cells augments the sensitivity of the vertebrate inner ear. Cell-body contractions of outer hair cells are thought to mediate amplification in the mammalian cochlea. In vertebrates that lack these cells, and perhaps in mammals as well, active movements of hair bundles may underlie amplification. We have evaluated a mathematical model in which amplification stems from the activity of mechanoelectrical-transduction channels. The intracellular binding of Ca2+ to channels is posited to promote their closure, which increases the tension in gating springs and exerts a negative force on the hair bundle. By enhancing bundle motion, this force partially compensates for viscous damping by cochlear fluids. Linear stability analysis of a six-state kinetic model reveals Hopf bifurcations for parameter values in the physiological range. These bifurcations signal conditions under which the system’s behavior changes from a damped oscillatory response to spontaneous limit-cycle oscillation. By varying the number of stereocilia in a bundle and the rate constant for Ca2+ binding, we calculate bifurcation frequencies spanning the observed range of auditory sensitivity for a representative receptor organ, the chicken’s cochlea. Simulations using prebifurcation parameter values demonstrate frequency-selective amplification with a striking compressive nonlinearity. Because transduction channels occur universally in hair cells, this active-channel model describes a mechanism of auditory amplification potentially applicable across species and hair-cell types.

Bone morphology of the femur and tibia captured by statistical shape modelling predicts rapid bone loss in acute spinal cord injury patients

We would like to thank the study participants and the clinical and research staff at the Queen Elizabeth National Spinal Injury Unit, as without them this study would not have been possible. We are grateful for the funding received from Glasgow Research Partnership in Engineering for the employment of SC during data collection for this study. We would like to thank the Royal Society of Edinburgh's Scottish Crucible scheme for providing the opportunity for this collaboration to occur. We are also indebted to Maria Dumitrascuta for her time and effort in producing inter-repeatability results for the shape models.