On Averaging Multiview Relations for 3D Scan Registration

In this paper, we present an extension of the iterative closest point (ICP) algorithm that simultaneously registers multiple 3D scans. While ICP fails to utilize the multiview constraints available, our method exploits the information redundancy in a set of 3D scans by using the averaging of relative motions. This averaging method utilizes the Lie group structure of motions, resulting in a 3D registration method that is both efficient and accurate. In addition, we present two variants of our approach, i.e., a method that solves for multiview 3D registration while obeying causality and a transitive correspondence variant that efficiently solves the correspondence problem across multiple scans. We present experimental results to characterize our method and explain its behavior as well as those of some other multiview registration methods in the literature. We establish the superior accuracy of our method in comparison to these multiview methods with registration results on a set of well-known real datasets of 3D scans.

Membrane-based deformable mirror: intrinsic aberrations and alignment issues

A deformable mirror (DM) is an important component of an adaptive optics system. It is known that an on-axis spherical/parabolic optical component, placed at an angle to the incident beam introduces defocus as well as astigmatism in the image plane. Although the former can be compensated by changing the focal plane position, the latter cannot be removed by mere optical realignment. Since the DM is to be used to compensate a turbulence-induced curvature term in addition to other aberrations, it is necessary to determine the aberrations induced by such (curved DM surface) an optical element when placed at an angle (other than 0 deg) of incidence in the optical path. To this effect, we estimate to a first order the aberrations introduced by a DM as a function of the incidence angle and deformation of the DM surface. We record images using a simple setup in which the incident beam is reflected by a 37 channel micro-machined membrane deformable mirror for various angles of incidence. It is observed that astigmatism is a dominant aberration, which was determined by measuring the difference between the tangential and sagittal focal planes. We justify our results on the basis of theoretical simulations and discuss the feasibility of using such a system for adaptive optics considering a trade-off between wavefront correction and astigmatism due to deformation. (C) 2015 Optical Society of America

Efficient registration of nonrigid 3-D bodies

We present a novel method to perform an accurate registration of 3-D nonrigid bodies by using phase-shift properties of the dual-tree complex wavelet transform (DT-CWT). Since the phases of DT-\BBCWT coefficients change approximately linearly with the amount of feature displacement in the spatial domain, motion can be estimated using the phase information from these coefficients. The motion estimation is performed iteratively: first by using coarser level complex coefficients to determine large motion components and then by employing finer level coefficients to refine the motion field. We use a parametric affine model to describe the motion, where the affine parameters are found locally by substituting into an optical flow model and by solving the resulting overdetermined set of equations. From the estimated affine parameters, the motion field between the sensed and the reference data sets can be generated, and the sensed data set then can be shifted and interpolated spatially to align with the reference data set. © 2011 IEEE.

Integrated Chest Image Analysis System "BU-MIA"

We introduce "BU-MIA," a Medical Image Analysis system that integrates various advanced chest image analysis methods for detection, estimation, segmentation, and registration. BU-MIA evaluates repeated computed tomography (CT) scans of the same patient to facilitate identification and evaluation of pulmonary nodules for interval growth. It provides a user-friendly graphical user interface with a number of interaction tools for development, evaluation, and validation of chest image analysis methods. The structures that BU-MIA processes include the thorax, lungs, and trachea, pulmonary structures, such as lobes, fissures, nodules, and vessels, and bones, such as sternum, vertebrae, and ribs.

Color Region Grouping and Shape Recognition with Deformable Models

A new deformable shape-based method for color region segmentation is described. The method includes two stages: over-segmentation using a traditional color region segmentation algorithm, followed by deformable model-based region merging via grouping and hypothesis selection. During the second stage, region merging and object identification are executed simultaneously. A statistical shape model is used to estimate the likelihood of region groupings and model hypotheses. The prior distribution on deformation parameters is precomputed using principal component analysis over a training set of region groupings. Once trained, the system autonomously segments deformed shapes from the background, while not merging them with similarly colored adjacent objects. Furthermore, the recovered parametric shape model can be used directly in object recognition and comparison. Experiments in segmentation and image retrieval are reported.

Deformable Shape Detection and Description via Model-Based Region Grouping

A method for deformable shape detection and recognition is described. Deformable shape templates are used to partition the image into a globally consistent interpretation, determined in part by the minimum description length principle. Statistical shape models enforce the prior probabilities on global, parametric deformations for each object class. Once trained, the system autonomously segments deformed shapes from the background, while not merging them with adjacent objects or shadows. The formulation can be used to group image regions based on any image homogeneity predicate; e.g., texture, color, or motion. The recovered shape models can be used directly in object recognition. Experiments with color imagery are reported.

Non-Rigid Shape from Image Streams

We present a framework for estimating 3D relative structure (shape) and motion given objects undergoing nonrigid deformation as observed from a fixed camera, under perspective projection. Deforming surfaces are approximated as piece-wise planar, and piece-wise rigid. Robust registration methods allow tracking of corresponding image patches from view to view and recovery of 3D shape despite occlusions, discontinuities, and varying illumination conditions. Many relatively small planar/rigid image patch trackers are scattered throughout the image; resulting estimates of structure and motion at each patch are combined over local neighborhoods via an oriented particle systems formulation. Preliminary experiments have been conducted on real image sequences of deforming objects and on synthetic sequences where ground truth is known.

Combinations of Deformable Shape Prototypes

We propose to investigate a model-based technique for encoding non-rigid object classes in terms of object prototypes. Objects from the same class can be parameterized by identifying shape and appearance invariants of the class to devise low-level representations. The approach presented here creates a flexible model for an object class from a set of prototypes. This model is then used to estimate the parameters of low-level representation of novel objects as combinations of the prototype parameters. Variations in the object shape are modeled as non-rigid deformations. Appearance variations are modeled as intensity variations. In the training phase, the system is presented with several example prototype images. These prototype images are registered to a reference image by a finite element-based technique called Active Blobs. The deformations of the finite element model to register a prototype image with the reference image provide the shape description or shape vector for the prototype. The shape vector for each prototype, is then used to warp the prototype image onto the reference image and obtain the corresponding texture vector. The prototype texture vectors, being warped onto the same reference image have a pixel by pixel correspondence with each other and hence are "shape normalized". Given sufficient number of prototypes that exhibit appropriate in-class variations, the shape and the texture vectors define a linear prototype subspace that spans the object class. Each prototype is a vector in this subspace. The matching phase involves the estimation of a set of combination parameters for synthesis of the novel object by combining the prototype shape and texture vectors. The strengths of this technique lie in the combined estimation of both shape and appearance parameters. This is in contrast with the previous approaches where shape and appearance parameters were estimated separately.

Index Trees for Efficient Deformable Shape-based Retrieval

An improved method for deformable shape-based image indexing and retrieval is described. A pre-computed index tree is used to improve the speed of our previously reported on-line model fitting method; simple shape features are used as keys in a pre-generated index tree of model instances. In addition, a coarse to fine indexing scheme is used at different levels of the tree to further improve speed while maintaining matching accuracy. Experimental results show that the speedup is significant, while accuracy of shape-based indexing is maintained. A method for shape population-based retrieval is also described. The method allows query formulation based on the population distributions of shapes in each image. Results of population-based image queries for a database of blood cell micrographs are shown.

Region Segmentation via Deformable Model-Guided Split and Merge

An improved method for deformable shape-based image segmentation is described. Image regions are merged together and/or split apart, based on their agreement with an a priori distribution on the global deformation parameters for a shape template. The quality of a candidate region merging is evaluated by a cost measure that includes: homogeneity of image properties within the combined region, degree of overlap with a deformed shape model, and a deformation likelihood term. Perceptually-motivated criteria are used to determine where/how to split regions, based on the local shape properties of the region group's bounding contour. A globally consistent interpretation is determined in part by the minimum description length principle. Experiments show that the model-based splitting strategy yields a significant improvement in segmention over a method that uses merging alone.

Measurement of intracellular strain on deformable substrates with texture correlation.

Mechanical stimuli are important factors that regulate cell proliferation, survival, metabolism and motility in a variety of cell types. The relationship between mechanical deformation of the extracellular matrix and intracellular deformation of cellular sub-regions and organelles has not been fully elucidated, but may provide new insight into the mechanisms involved in transducing mechanical stimuli to biological responses. In this study, a novel fluorescence microscopy and image analysis method was applied to examine the hypothesis that mechanical strains are fully transferred from a planar, deformable substrate to cytoplasmic and intranuclear regions within attached cells. Intracellular strains were measured in cells derived from the anulus fibrosus of the intervertebral disc when attached to an elastic silicone membrane that was subjected to tensile stretch. Measurements indicated cytoplasmic strains were similar to those of the underlying substrate, with a strain transfer ratio (STR) of 0.79. In contrast, nuclear strains were much smaller than those of the substrate, with an STR of 0.17. These findings are consistent with previous studies indicating nuclear stiffness is significantly greater than cytoplasmic stiffness, as measured using other methods. This study provides a novel method for the study of cellular mechanics, including a new technique for measuring intranuclear deformations, with evidence of differential magnitudes and patterns of strain transferred from the substrate to cell cytoplasm and nucleus.

Conventional 3D staging PET/CT in CT simulation for lung cancer: impact of rigid and deformable target volume alignments for radiotherapy treatment planning

Objective: Positron emission tomography (PET)/CT scans can improve target definition in radiotherapy for non-small cell lung cancer (NSCLC). As staging PET/CT scans are increasingly available, we evaluated different methods for co-registration of staging PET/CT data to radiotherapy simulation (RTP) scans.

Methods: 10 patients underwent staging PET/CT followed by RTP PET/CT. On both scans, gross tumour volumes (GTVs) were delineated using CT (GTVCT) and PET display settings. Four PET-based contours (manual delineation, two threshold methods and a source-to-background ratio method) were delineated. The CT component of the staging scan was co-registered using both rigid and deformable techniques to the CT component of RTP PET/CT. Subsequently rigid registration and deformation warps were used to transfer PET and CT contours from the staging scan to the RTP scan. Dice’s similarity coefficient (DSC) was used to assess the registration accuracy of staging-based GTVs following both registration methods with the GTVs delineated on the RTP PET/CT scan.

Results: When the GTVCT delineated on the staging scan after both rigid registration and deformation was compared with the GTVCT on the RTP scan, a significant improvement in overlap (registration) using deformation was observed (mean DSC 0.66 for rigid registration and 0.82 for deformable registration, p50.008). A similar comparison for PET contours revealed no significant improvement in overlap with the use of deformable registration.

Conclusions: No consistent improvements in similarity measures were observed when deformable registration was used for transferring PET-based contours from a staging PET/CT. This suggests that currently the use of rigid registration remains the most appropriate method for RTP in NSCLC.

On-line cone beam CT image guidance for vocal cord tumor targeting

Background and purpose: We are developing a technique for highly focused vocal cord irradiation in early glottic carcinoma to optimally treat a target volume confined to a single cord. This technique, in contrast with the conventional methods, aims at sparing the healthy vocal cord. As such a technique requires sub-mm daily targeting accuracy to be effective, we investigate the accuracy achievable with on-line kV-cone beam CT (CBCT) corrections. Materials and methods: CBCT scans were obtained in 10 early glottic cancer patients in each treatment fraction. The grey value registration available in X-ray volume imaging (XVI) software (Elekta, Synergy) was applied to a volume of interest encompassing the thyroid cartilage. After application of the thus derived corrections, residue displacements with respect to the planning CT scan were measured at clearly identifiable relevant landmarks. The intra- and inter-observer variations were also measured. Results: While before correction the systematic displacements of the vocal cords were as large as 2.4 ± 3.3 mm (cranial-caudal population mean ± SD Σ), daily CBCT registration and correction reduced these values to less than 0.2 ± 0.5 mm in all directions. Random positioning errors (SD σ) were reduced to less than 1 mm. Correcting only for translations and not for rotations did not appreciably affect this accuracy. The residue random displacements partly stem from intra-observer variations (SD = 0.2-0.6 mm). Conclusion: The use of CBCT for daily image guidance in combination with standard mask fixation reduced systematic and random set-up errors of the vocal cords to <1 mm prior to the delivery of each fraction dose. Thus, this facilitates the high targeting precision required for a single vocal cord irradiation. © 2009 Elsevier Ireland Ltd. All rights reserved.