Geometry-Aware Multiscale Image Registration via OBBTree-Based Polyaffine Log-Demons

Non-linear image registration is an important tool in many areas of image analysis. For instance, in morphometric studies of a population of brains, free-form deformations between images are analyzed to describe the structural anatomical variability. Such a simple deformation model is justified by the absence of an easy expressible prior about the shape changes. Applying the same algorithms used in brain imaging to orthopedic images might not be optimal due to the difference in the underlying prior on the inter-subject deformations. In particular, using an un-informed deformation prior often leads to local minima far from the expected solution. To improve robustness and promote anatomically meaningful deformations, we propose a locally affine and geometry-aware registration algorithm that automatically adapts to the data. We build upon the log-domain demons algorithm and introduce a new type of OBBTree-based regularization in the registration with a natural multiscale structure. The regularization model is composed of a hierarchy of locally affine transformations via their logarithms. Experiments on mandibles show improved accuracy and robustness when used to initialize the demons, and even similar performance by direct comparison to the demons, with a significantly lower degree of freedom. This closes the gap between polyaffine and non-rigid registration and opens new ways to statistically analyze the registration results.

Brain areas involved in medial temporal lobe seizures: a principal component analysis of ictal SPECT data

The study describes brain areas involved in medial temporal lobe (mTL) seizures of 12 patients. All patients showed so-called oro-alimentary behavior within the first 20 s of clinical seizure manifestation characteristic of mTL seizures. Single photon emission computed tomography (SPECT) images of regional cerebral blood flow (rCBF) were acquired from the patients in ictal and interictal phases and from normal volunteers. Image analysis employed categorical comparisons with statistical parametric mapping and principal component analysis (PCA) to assess functional connectivity. PCA supplemented the findings of the categorical analysis by decomposing the covariance matrix containing images of patients and healthy subjects into distinct component images of independent variance, including areas not identified by the categorical analysis. Two principal components (PCs) discriminated the subject groups: patients with right or left mTL seizures and normal volunteers, indicating distinct neuronal networks implicated by the seizure. Both PCs were correlated with seizure duration, one positively and the other negatively, confirming their physiological significance. The independence of the two PCs yielded a clear clustering of subject groups. The local pattern within the temporal lobe describes critical relay nodes which are the counterpart of oro-alimentary behavior: (1) right mesial temporal zone and ipsilateral anterior insula in right mTL seizures, and (2) temporal poles on both sides that are densely interconnected by the anterior commissure. Regions remote from the temporal lobe may be related to seizure propagation and include positively and negatively loaded areas. These patterns, the covarying areas of the temporal pole and occipito-basal visual association cortices, for example, are related to known anatomic paths.

Quantitative analysis of OCT characteristics in patients with achromatopsia and blue-cone monochromatism

PURPOSE: To quantify optical coherence tomography (OCT) images of the central retina in patients with blue-cone monochromatism (BCM) and achromatopsia (ACH) compared with healthy control individuals. METHODS: The study included 15 patients with ACH, 6 with BCM, and 20 control subjects. Diagnosis of BCM and ACH was established by visual acuity testing, morphologic examination, color vision testing, and Ganzfeld ERG recording. OCT images were acquired with the Stratus OCT 3 (Carl Zeiss Meditec AG, Oberkochen, Germany). Foveal OCT images were analyzed by calculating longitudinal reflectivity profiles (LRPs) from scan lines. Profiles were analyzed quantitatively to determine foveal thickness and distances between reflectivity layers. RESULTS: Patients with ACH and BCM had a mean visual acuity of 20/200 and 20/60, respectively. Color vision testing results were characteristic of the diseases. The LRPs of control subjects yielded four peaks (P1-P4), presumably representing the RPE (P1), the ovoid region of the photoreceptors (P2), the external limiting membrane (ELM) (P3), and the internal limiting membrane (P4). In patients with ACH, P2 was absent, but foveal thickness (P1-P4) did not differ significantly from that in the control subjects (187 +/- 20 vs. 192 +/- 14 microm, respectively). The distance from P1 to P3 did not differ significantly (78 +/- 10 vs. 82 +/- 5 microm) between ACH and controls subjects. In patients with BCM, P3 was lacking, and P2 advanced toward P1 compared with the control subjects (32 +/- 6 vs. 48 +/- 4 microm). Foveal thickness (153 +/- 16 microm) was significantly reduced compared with that in control subjects and patients with ACH. CONCLUSIONS: Quantitative OCT image analysis reveals distinct patterns for controls subjects and patients with ACH and BCM, respectively. Quantitative analysis of OCT imaging can be useful in differentiating retinal diseases affecting photoreceptors. Foveal thickness is similar in both normal subjects and patients with ACH but is decreased in patients with BCM.

Clinical validation of an automated vessel-segmentation software of the extracranial-carotid arteries based on 3D-MRA: A prospective study

OBJECTIVES: To determine the accuracy of automated vessel-segmentation software for vessel-diameter measurements based on three-dimensional contrast-enhanced magnetic resonance angiography (3D-MRA). METHOD: In 10 patients with high-grade carotid stenosis, automated measurements of both carotid arteries were obtained with 3D-MRA by two independent investigators and compared with manual measurements obtained by digital subtraction angiography (DSA) and 2D maximum-intensity projection (2D-MIP) based on MRA and duplex ultrasonography (US). In 42 patients undergoing carotid endarterectomy (CEA), intraoperative measurements (IOP) were compared with postoperative 3D-MRA and US. RESULTS: Mean interoperator variability was 8% for measurements by DSA and 11% by 2D-MIP, but there was no interoperator variability with the automated 3D-MRA analysis. Good correlations were found between DSA (standard of reference), manual 2D-MIP (rP=0.6) and automated 3D-MRA (rP=0.8). Excellent correlations were found between IOP, 3D-MRA (rP=0.93) and US (rP=0.83). CONCLUSION: Automated 3D-MRA-based vessel segmentation and quantification result in accurate measurements of extracerebral-vessel dimensions.

Novel autoantigens immunogenic in COPD patients

Background Chronic obstructive pulmonary disease (COPD) is a respiratory inflammatory condition with autoimmune features including IgG autoantibodies. In this study we analyze the complexity of the autoantibody response and reveal the nature of the antigens that are recognized by autoantibodies in COPD patients. Methods An array of 1827 gridded immunogenic peptide clones was established and screened with 17 sera of COPD patients and 60 healthy controls. Protein arrays were evaluated both by visual inspection and a recently developed computer aided image analysis technique. By this computer aided image analysis technique we computed the intensity values for each peptide clone and each serum and calculated the area under the receiver operator characteristics curve (AUC) for each clone and the separation COPD sera versus control sera. Results By visual evaluation we detected 381 peptide clones that reacted with autoantibodies of COPD patients including 17 clones that reacted with more than 60% of the COPD sera and seven clones that reacted with more than 90% of the COPD sera. The comparison of COPD sera and controls by the automated image analysis system identified 212 peptide clones with informative AUC values. By in silico sequence analysis we found an enrichment of sequence motives previously associated with immunogenicity. Conclusion The identification of a rather complex humoral immune response in COPD patients supports the idea of COPD as a disease with strong autoimmune features. The identification of novel immunogenic antigens is a first step towards a better understanding of the autoimmune component of COPD.

Tree phenology and carbon dioxide fluxes - use of digital photography for process-based interpretation at the ecosystem scale

Vegetation phenology is an important indicator of climate change and climate variability and it is strongly connected to biospheric–atmospheric gas exchange. We aimed to evaluate the applicability of phenological information derived from digital imagery for the interpretation of CO2 exchange measurements. For the years 2005–2007 we analyzed seasonal phenological development of 2 temperate mixed forests using tower-based imagery from standard RGB cameras. Phenological information was jointly analyzed with gross primary productivity (GPP) derived from net ecosystem exchange data. Automated image analysis provided reliable information on vegetation developmental stages of beech and ash trees covering all seasons. A phenological index derived from image color values was strongly correlated with GPP, with a significant mean time lag of several days for ash trees and several weeks for beech trees in early summer (May to mid-July). Leaf emergence dates for the dominant tree species partly explained temporal behaviour of spring GPP but were also masked by local meteorological conditions. We conclude that digital cameras at flux measurement sites not only provide an objective measure of the physiological state of a forest canopy at high temporal and spatial resolutions, but also complement CO2 and water exchange measurements, improving our knowledge of ecosystem processes.

Computer-aided diagnosis of carotid atherosclerosis based on ultrasound image statistics, laws' texture and neural networks

Quantitative characterisation of carotid atherosclerosis and classification into symptomatic or asymptomatic is crucial in planning optimal treatment of atheromatous plaque. The computer-aided diagnosis (CAD) system described in this paper can analyse ultrasound (US) images of carotid artery and classify them into symptomatic or asymptomatic based on their echogenicity characteristics. The CAD system consists of three modules: a) the feature extraction module, where first-order statistical (FOS) features and Laws' texture energy can be estimated, b) the dimensionality reduction module, where the number of features can be reduced using analysis of variance (ANOVA), and c) the classifier module consisting of a neural network (NN) trained by a novel hybrid method based on genetic algorithms (GAs) along with the back propagation algorithm. The hybrid method is able to select the most robust features, to adjust automatically the NN architecture and to optimise the classification performance. The performance is measured by the accuracy, sensitivity, specificity and the area under the receiver-operating characteristic (ROC) curve. The CAD design and development is based on images from 54 symptomatic and 54 asymptomatic plaques. This study demonstrates the ability of a CAD system based on US image analysis and a hybrid trained NN to identify atheromatous plaques at high risk of stroke.

Multi-modal glioblastoma segmentation: man versus machine

BACKGROUND AND PURPOSE Reproducible segmentation of brain tumors on magnetic resonance images is an important clinical need. This study was designed to evaluate the reliability of a novel fully automated segmentation tool for brain tumor image analysis in comparison to manually defined tumor segmentations. METHODS We prospectively evaluated preoperative MR Images from 25 glioblastoma patients. Two independent expert raters performed manual segmentations. Automatic segmentations were performed using the Brain Tumor Image Analysis software (BraTumIA). In order to study the different tumor compartments, the complete tumor volume TV (enhancing part plus non-enhancing part plus necrotic core of the tumor), the TV+ (TV plus edema) and the contrast enhancing tumor volume CETV were identified. We quantified the overlap between manual and automated segmentation by calculation of diameter measurements as well as the Dice coefficients, the positive predictive values, sensitivity, relative volume error and absolute volume error. RESULTS Comparison of automated versus manual extraction of 2-dimensional diameter measurements showed no significant difference (p = 0.29). Comparison of automated versus manual segmentation of volumetric segmentations showed significant differences for TV+ and TV (p<0.05) but no significant differences for CETV (p>0.05) with regard to the Dice overlap coefficients. Spearman's rank correlation coefficients (ρ) of TV+, TV and CETV showed highly significant correlations between automatic and manual segmentations. Tumor localization did not influence the accuracy of segmentation. CONCLUSIONS In summary, we demonstrated that BraTumIA supports radiologists and clinicians by providing accurate measures of cross-sectional diameter-based tumor extensions. The automated volume measurements were comparable to manual tumor delineation for CETV tumor volumes, and outperformed inter-rater variability for overlap and sensitivity.

Improved Localization of Implanted Subdural Electrode Contacts on MRI Using an Elastic Image Fusion Algorithm in Invasive EEG Recording

BACKGROUND: Accurate projection of implanted subdural electrode contacts in presurgical evaluation of pharmacoresistant epilepsy cases by invasive EEG is highly relevant. Linear fusion of CT and MRI images may display the contacts in the wrong position due to brain shift effects. OBJECTIVE: A retrospective study in five patients with pharmacoresistant epilepsy was performed to evaluate whether an elastic image fusion algorithm can provide a more accurate projection of the electrode contacts on the pre-implantation MRI as compared to linear fusion. METHODS: An automated elastic image fusion algorithm (AEF), a guided elastic image fusion algorithm (GEF), and a standard linear fusion algorithm (LF) were used on preoperative MRI and post-implantation CT scans. Vertical correction of virtual contact positions, total virtual contact shift, corrections of midline shift and brain shifts due to pneumencephalus were measured. RESULTS: Both AEF and GEF worked well with all 5 cases. An average midline shift of 1.7mm (SD 1.25) was corrected to 0.4mm (SD 0.8) after AEF and to 0.0mm (SD 0) after GEF. Median virtual distances between contacts and cortical surface were corrected by a significant amount, from 2.3mm after LF to 0.0mm after AEF and GEF (p<.001). Mean total relative corrections of 3.1 mm (SD 1.85) after AEF and 3.0mm (SD 1.77) after GEF were achieved. The tested version of GEF did not achieve a satisfying virtual correction of pneumencephalus. CONCLUSION: The technique provided a clear improvement in fusion of pre- and post-implantation scans, although the accuracy is difficult to evaluate.

Cilengitide treatment of newly diagnosed glioblastoma patients does not alter patterns of progression

The integrin antagonist cilengitide has been explored as an adjunct with anti-angiogenic properties to standard of care temozolomide chemoradiotherapy (TMZ/RT → TMZ) in newly diagnosed glioblastoma. Preclinical data as well as anecdotal clinical observations indicate that anti-angiogenic treatment may result in altered patterns of tumor progression. Using a standardized approach, we analyzed patterns of progression on MRI in 21 patients enrolled onto a phase 2 trial of cilengitide added to TMZ/RT → TMZ in newly diagnosed glioblastoma. Thirty patients from the experimental treatment arm of the EORTC/NCIC pivotal TMZ trial served as a reference. MRIcro software was used to map location and extent of initial preoperative and recurrent tumors on MRI of both groups into the same stereotaxic space which were then analyzed using an automated tool of image analysis. Clinical and outcome data of the cilengitide-treated patients were similar to those of the EORTC/NCIC trial except for a higher proportion of patients with a methylated O(6)-methylguanyl-DNA-methyltransferase gene promoter. Analysis of recurrence pattern revealed neither a difference in the size of the recurrent tumor nor in the distance of the recurrences from the preoperative tumor location between groups. Overall frequencies of distant recurrences were 20 % in the reference group and 19 % (4/21 patients) in the cilengitide group. Compared with TMZ/RT → TMZ alone, the addition of cilengitide does not alter patterns of progression. This analysis does not support concerns that integrin antagonism by cilengitide may induce a more aggressive phenotype at progression, but also provides no evidence for an anti-invasive activity of cilengitide in patients with newly diagnosed glioblastoma.

A computer-assisted microscopic analysis of bone tissue developed inside a polyactive plymer implanted into an equine articular surface

One of the most promising applications for the restoration of small or moderately sized focal articular lesions is mosaicplasty (MP). Although recurrent hemarthrosis is a rare complication after MP, recently, various strategies have been designed to find an effective filling material to prevent postoperative bleeding from the donor site. The porous biodegradable polymer Polyactive (PA; a polyethylene glycol terephthalate - polybutylene terephthalate copolymer) represents a promising solution in this respect. A histological evaluation of the longterm PA-filled donor sites obtained from 10 experimental horses was performed. In this study, attention was primarily focused on the bone tissue developed in the plug. A computer-assisted image analysis and quantitative polarized light microscopic measurements of decalcified, longitudinally sectioned, dimethylmethylene blue (DMMB)- and picrosirius red (PS) stained sections revealed that the coverage area of the bone trabecules in the PA-filled donor tunnels was substantially (25%) enlarged compared to the neighboring cancellous bone. For this quantification, identical ROIs (regions of interest) were used and compared. The birefringence retardation values were also measured with a polarized light microscope using monochromatic light. Identical retardation values could be recorded from the bone trabeculae developed in the PA and in the neighboring bone, which indicates that the collagen orientation pattern does not differ significantly among these bone trabecules. Based on our new data, we speculate that PA promotes bone formation, and some of the currently identified degradation products of PA may enhance osteo-conduction and osteoinduction inside the donor canal.

Reconstruction of 3D Vertebral Models from a Single 2D Lateral Fluoroscopic Image

Accurate three-dimensional (3D) models of lumbar vertebrae are required for image-based 3D kinematics analysis. MRI or CT datasets are frequently used to derive 3D models but have the disadvantages that they are expensive, time-consuming or involving ionizing radiation (e.g., CT acquisition). In this chapter, we present an alternative technique that can reconstruct a scaled 3D lumbar vertebral model from a single two-dimensional (2D) lateral fluoroscopic image and a statistical shape model. Cadaveric studies are conducted to verify the reconstruction accuracy by comparing the surface models reconstructed from a single lateral fluoroscopic image to the ground truth data from 3D CT segmentation. A mean reconstruction error between 0.7 and 1.4 mm was found.

Automatic X-ray landmark detection and shape segmentation via data-driven joint estimation of image displacements

In this paper, we propose a new method for fully-automatic landmark detection and shape segmentation in X-ray images. To detect landmarks, we estimate the displacements from some randomly sampled image patches to the (unknown) landmark positions, and then we integrate these predictions via a voting scheme. Our key contribution is a new algorithm for estimating these displacements. Different from other methods where each image patch independently predicts its displacement, we jointly estimate the displacements from all patches together in a data driven way, by considering not only the training data but also geometric constraints on the test image. The displacements estimation is formulated as a convex optimization problem that can be solved efficiently. Finally, we use the sparse shape composition model as the a priori information to regularize the landmark positions and thus generate the segmented shape contour. We validate our method on X-ray image datasets of three different anatomical structures: complete femur, proximal femur and pelvis. Experiments show that our method is accurate and robust in landmark detection, and, combined with the shape model, gives a better or comparable performance in shape segmentation compared to state-of-the art methods. Finally, a preliminary study using CT data shows the extensibility of our method to 3D data.