Hierarchical segmentation-assisted multimodal registration for MR brain images

Information theory-based metric such as mutual information (MI) is widely used as similarity measurement for multimodal registration. Nevertheless, this metric may lead to matching ambiguity for non-rigid registration. Moreover, maximization of MI alone does not necessarily produce an optimal solution. In this paper, we propose a segmentation-assisted similarity metric based on point-wise mutual information (PMI). This similarity metric, termed SPMI, enhances the registration accuracy by considering tissue classification probabilities as prior information, which is generated from an expectation maximization (EM) algorithm. Diffeomorphic demons is then adopted as the registration model and is optimized in a hierarchical framework (H-SPMI) based on different levels of anatomical structure as prior knowledge. The proposed method is evaluated using Brainweb synthetic data and clinical fMRI images. Both qualitative and quantitative assessment were performed as well as a sensitivity analysis to the segmentation error. Compared to the pure intensity-based approaches which only maximize mutual information, we show that the proposed algorithm provides significantly better accuracy on both synthetic and clinical data.

Integrated Segmentation of Brain Tumor Images for Radiotherapy and Neurosurgery

Image-based modeling of tumor growth combines methods from cancer simulation and medical imaging. In this context, we present a novel approach to adapt a healthy brain atlas to MR images of tumor patients. In order to establish correspondence between a healthy atlas and a pathologic patient image, tumor growth modeling in combination with registration algorithms is employed. In a first step, the tumor is grown in the atlas based on a new multi-scale, multi-physics model including growth simulation from the cellular level up to the biomechanical level, accounting for cell proliferation and tissue deformations. Large-scale deformations are handled with an Eulerian approach for finite element computations, which can operate directly on the image voxel mesh. Subsequently, dense correspondence between the modified atlas and patient image is established using nonrigid registration. The method offers opportunities in atlasbased segmentation of tumor-bearing brain images as well as for improved patient-specific simulation and prognosis of tumor progression.

Mapping material distribution in a heterogeneous sand tank by image analysis

Water flow and solute transport through soils are strongly influenced by the spatial arrangement of soil materials with different hydraulic and chemical properties. Knowing the specific or statistical arrangement of these materials is considered as a key toward improved predictions of solute transport. Our aim was to obtain two-dimensional material maps from photographs of exposed profiles. We developed a segmentation and classification procedure and applied it to the images of a very heterogeneous sand tank, which was used for a series of flow and transport experiments. The segmentation was based on thresholds of soil color, estimated from local median gray values, and of soil texture, estimated from local coefficients of variation of gray values. Important steps were the correction of inhomogeneous illumination and reflection, and the incorporation of prior knowledge in filters used to extract the image features and to smooth the results morphologically. We could check and confirm the success of our mapping by comparing the estimated with the designed sand distribution in the tank. The resulting material map was used later as input to model flow and transport through the sand tank. Similar segmentation procedures may be applied to any high-density raster data, including photographs or spectral scans of field profiles.

3D MPRAGE improves classification of cortical lesions in multiple sclerosis.

BACKGROUND: Gray matter lesions are known to be common in multiple sclerosis (MS) and are suspected to play an important role in disease progression and clinical disability. A combination of magnetic resonance imaging (MRI) techniques, double-inversion recovery (DIR), and phase-sensitive inversion recovery (PSIR), has been used for detection and classification of cortical lesions. This study shows that high-resolution three-dimensional (3D) magnetization-prepared rapid acquisition with gradient echo (MPRAGE) improves the classification of cortical lesions by allowing more accurate anatomic localization of lesion morphology. METHODS: 11 patients with MS with previously identified cortical lesions were scanned using DIR, PSIR, and 3D MPRAGE. Lesions were identified on DIR and PSIR and classified as purely intracortical or mixed. MPRAGE images were then examined, and lesions were re-classified based on the new information. RESULTS: The high signal-to-noise ratio, fine anatomic detail, and clear gray-white matter tissue contrast seen in the MPRAGE images provided superior delineation of lesion borders and surrounding gray-white matter junction, improving classification accuracy. 119 lesions were identified as either intracortical or mixed on DIR/PSIR. In 89 cases, MPRAGE confirmed the classification by DIR/PSIR. In 30 cases, MPRAGE overturned the original classification. CONCLUSION: Improved classification of cortical lesions was realized by inclusion of high-spatial resolution 3D MPRAGE. This sequence provides unique detail on lesion morphology that is necessary for accurate classification.

A Hybrid Model for Multimodal Brain Tumor Segmentation

We present a fully automatic segmentation method for multi-modal brain tumor segmentation. The proposed generative-discriminative hybrid model generates initial tissue probabilities, which are used subsequently for enhancing the classi�cation and spatial regularization. The model has been evaluated on the BRATS2013 training set, which includes multimodal MRI images from patients with high- and low-grade gliomas. Our method is capable of segmenting the image into healthy (GM, WM, CSF) and pathological tissue (necrotic, enhancing and non-enhancing tumor, edema). We achieved state-of-the-art performance (Dice mean values of 0.69 and 0.8 for tumor subcompartments and complete tumor respectively) within a reasonable timeframe (4 to 15 minutes).

Perfusion in rat brain at 7 T with arterial spin labeling using FAIR-TrueFISP and QUIPSS.

Measurement of perfusion in longitudinal studies allows for the assessment of tissue integrity and the detection of subtle pathologies. In this work, the feasibility of measuring brain perfusion in rats with high spatial resolution using arterial spin labeling is reported. A flow-sensitive alternating recovery sequence, coupled with a balanced gradient fast imaging with steady-state precession readout section was used to minimize ghosting and geometric distortions, while achieving high signal-to-noise ratio. The quantitative imaging of perfusion using a single subtraction method was implemented to address the effects of variable transit delays between the labeling of spins and their arrival at the imaging slice. Studies in six rats at 7 T showed good perfusion contrast with minimal geometric distortion. The measured blood flow values of 152.5+/-6.3 ml/100 g per minute in gray matter and 72.3+/-14.0 ml/100 g per minute in white matter are in good agreement with previously reported values based on autoradiography, considered to be the gold standard.

Quantification of the spatiotemporal microstructural organization of the human brain association, projection and commissural pathways across the lifespan using diffusion tensor tractography.

Using diffusion tensor tractography, we quantified the microstructural changes in the association, projection, and commissural compact white matter pathways of the human brain over the lifespan in a cohort of healthy right-handed children and adults aged 6-68 years. In both males and females, the diffusion tensor radial diffusivity of the bilateral arcuate fasciculus, inferior longitudinal fasciculus, inferior fronto-occipital fasciculus, uncinate fasciculus, corticospinal, somatosensory tracts, and the corpus callosum followed a U-curve with advancing age; fractional anisotropy in the same pathways followed an inverted U-curve. Our study provides useful baseline data for the interpretation of data collected from patients.

Clinical relevance of brain volume measures in multiple sclerosis.

Multiple sclerosis (MS) is a chronic disease with an inflammatory and neurodegenerative pathology. Axonal loss and neurodegeneration occurs early in the disease course and may lead to irreversible neurological impairment. Changes in brain volume, observed from the earliest stage of MS and proceeding throughout the disease course, may be an accurate measure of neurodegeneration and tissue damage. There are a number of magnetic resonance imaging-based methods for determining global or regional brain volume, including cross-sectional (e.g. brain parenchymal fraction) and longitudinal techniques (e.g. SIENA [Structural Image Evaluation using Normalization of Atrophy]). Although these methods are sensitive and reproducible, caution must be exercised when interpreting brain volume data, as numerous factors (e.g. pseudoatrophy) may have a confounding effect on measurements, especially in a disease with complex pathological substrates such as MS. Brain volume loss has been correlated with disability progression and cognitive impairment in MS, with the loss of grey matter volume more closely correlated with clinical measures than loss of white matter volume. Preventing brain volume loss may therefore have important clinical implications affecting treatment decisions, with several clinical trials now demonstrating an effect of disease-modifying treatments (DMTs) on reducing brain volume loss. In clinical practice, it may therefore be important to consider the potential impact of a therapy on reducing the rate of brain volume loss. This article reviews the measurement of brain volume in clinical trials and practice, the effect of DMTs on brain volume change across trials and the clinical relevance of brain volume loss in MS.

Atlas-based Segmentation of Tumor-bearing Brain Images

In diagnostic neuroradiology as well as in radiation oncology and neurosurgery, there is an increasing demand for accurate segmentation of tumor-bearing brain images. Atlas-based segmentation is an appealing automatic technique thanks to its robustness and versatility. However, atlas-based segmentation of tumor-bearing brain images is challenging due to the confounding effects of the tumor in the patient image. In this article, we provide a brief background on brain tumor imaging and introduce the clinical perspective, before we categorize and review the state of the art in the current literature on atlas-based segmentation for tumor-bearing brain images. We also present selected methods and results from our own research in more detail. Finally, we conclude with a short summary and look at new developments in the field, including requirements for future routine clinical use.

Improved Localization of Implanted Subdural Electrode Contacts on MRI Using an Elastic Image Fusion Algorithm in Invasive EEG Recording

BACKGROUND: Accurate projection of implanted subdural electrode contacts in presurgical evaluation of pharmacoresistant epilepsy cases by invasive EEG is highly relevant. Linear fusion of CT and MRI images may display the contacts in the wrong position due to brain shift effects. OBJECTIVE: A retrospective study in five patients with pharmacoresistant epilepsy was performed to evaluate whether an elastic image fusion algorithm can provide a more accurate projection of the electrode contacts on the pre-implantation MRI as compared to linear fusion. METHODS: An automated elastic image fusion algorithm (AEF), a guided elastic image fusion algorithm (GEF), and a standard linear fusion algorithm (LF) were used on preoperative MRI and post-implantation CT scans. Vertical correction of virtual contact positions, total virtual contact shift, corrections of midline shift and brain shifts due to pneumencephalus were measured. RESULTS: Both AEF and GEF worked well with all 5 cases. An average midline shift of 1.7mm (SD 1.25) was corrected to 0.4mm (SD 0.8) after AEF and to 0.0mm (SD 0) after GEF. Median virtual distances between contacts and cortical surface were corrected by a significant amount, from 2.3mm after LF to 0.0mm after AEF and GEF (p<.001). Mean total relative corrections of 3.1 mm (SD 1.85) after AEF and 3.0mm (SD 1.77) after GEF were achieved. The tested version of GEF did not achieve a satisfying virtual correction of pneumencephalus. CONCLUSION: The technique provided a clear improvement in fusion of pre- and post-implantation scans, although the accuracy is difficult to evaluate.

Interactive Segmentation of MR Images from Brain Tumor Patients

Medical doctors often do not trust the result of fully automatic segmentations because they have no possibility to make corrections if necessary. On the other hand, manual corrections can introduce a user bias. In this work, we propose to integrate the possibility for quick manual corrections into a fully automatic segmentation method for brain tumor images. This allows for necessary corrections while maintaining a high objectiveness. The underlying idea is similar to the well-known Grab-Cut algorithm, but here we combine decision forest classification with conditional random field regularization for interactive segmentation of 3D medical images. The approach has been evaluated by two different users on the BraTS2012 dataset. Accuracy and robustness improved compared to a fully automatic method and our interactive approach was ranked among the top performing methods. Time for computation including manual interaction was less than 10 minutes per patient, which makes it attractive for clinical use.

The Multimodal Brain TumorImage Segmentation Benchmark (BRATS)

In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients - manually annotated by up to four raters - and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all subregions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.

Classification of interstitial lung disease patterns using local DCT features and random forest.

Over the last decade, a plethora of computer-aided diagnosis (CAD) systems have been proposed aiming to improve the accuracy of the physicians in the diagnosis of interstitial lung diseases (ILD). In this study, we propose a scheme for the classification of HRCT image patches with ILD abnormalities as a basic component towards the quantification of the various ILD patterns in the lung. The feature extraction method relies on local spectral analysis using a DCT-based filter bank. After convolving the image with the filter bank, q-quantiles are computed for describing the distribution of local frequencies that characterize image texture. Then, the gray-level histogram values of the original image are added forming the final feature vector. The classification of the already described patches is done by a random forest (RF) classifier. The experimental results prove the superior performance and efficiency of the proposed approach compared against the state-of-the-art.