Integrated Segmentation of Brain Tumor Images for Radiotherapy and Neurosurgery

Image-based modeling of tumor growth combines methods from cancer simulation and medical imaging. In this context, we present a novel approach to adapt a healthy brain atlas to MR images of tumor patients. In order to establish correspondence between a healthy atlas and a pathologic patient image, tumor growth modeling in combination with registration algorithms is employed. In a first step, the tumor is grown in the atlas based on a new multi-scale, multi-physics model including growth simulation from the cellular level up to the biomechanical level, accounting for cell proliferation and tissue deformations. Large-scale deformations are handled with an Eulerian approach for finite element computations, which can operate directly on the image voxel mesh. Subsequently, dense correspondence between the modified atlas and patient image is established using nonrigid registration. The method offers opportunities in atlasbased segmentation of tumor-bearing brain images as well as for improved patient-specific simulation and prognosis of tumor progression.

Targeting the Blood-brain Barrier with a Non-canonical Iron-mimicry Mechanism

Treatment of central nervous system (CNS) diseases is limited by the blood-brain barrier (BBB), a selective vascular interface restricting passage of most molecules from blood into brain. Specific transport systems have evolved allowing circulating polar molecules to cross the BBB and gain access to the brain parenchyma. However, to date, few ligands exploiting such systems have proven clinically viable in the setting of CNS diseases. We reasoned that combinatorial phage-display screenings in vivo would yield peptides capable of crossing the BBB and allow for the development of ligand-directed targeting strategies of the brain. Here we show the identification of a peptide mediating systemic targeting to the normal brain and to an orthotopic human glioma model. We demonstrate that this peptide functionally mimics iron through an allosteric mechanism and that a non-canonical association of (i) transferrin, (ii) the iron-mimic ligand motif, and (iii) transferrin receptor mediates binding and transport of particles across the BBB. We also show that in orthotopic human glioma xenografts, a combination of transferrin receptor over-expression plus extended vascular permeability and ligand retention result in remarkable brain tumor targeting. Moreover, such tumor targeting attributes enables Herpes simplex virus thymidine kinase-mediated gene therapy of intracranial tumors for molecular genetic imaging and suicide gene delivery with ganciclovir. Finally, we expand our data by analyzing a large panel of primary CNS tumors through comprehensive tissue microarrays. Together, our approach and results provide a translational avenue for the detection and treatment of brain tumors.

Computer simulation of glioma growth and morphology.

Despite major advances in the study of glioma, the quantitative links between intra-tumor molecular/cellular properties, clinically observable properties such as morphology, and critical tumor behaviors such as growth and invasiveness remain unclear, hampering more effective coupling of tumor physical characteristics with implications for prognosis and therapy. Although molecular biology, histopathology, and radiological imaging are employed in this endeavor, studies are severely challenged by the multitude of different physical scales involved in tumor growth, i.e., from molecular nanoscale to cell microscale and finally to tissue centimeter scale. Consequently, it is often difficult to determine the underlying dynamics across dimensions. New techniques are needed to tackle these issues. Here, we address this multi-scalar problem by employing a novel predictive three-dimensional mathematical and computational model based on first-principle equations (conservation laws of physics) that describe mathematically the diffusion of cell substrates and other processes determining tumor mass growth and invasion. The model uses conserved variables to represent known determinants of glioma behavior, e.g., cell density and oxygen concentration, as well as biological functional relationships and parameters linking phenomena at different scales whose specific forms and values are hypothesized and calculated based on in vitro and in vivo experiments and from histopathology of tissue specimens from human gliomas. This model enables correlation of glioma morphology to tumor growth by quantifying interdependence of tumor mass on the microenvironment (e.g., hypoxia, tissue disruption) and on the cellular phenotypes (e.g., mitosis and apoptosis rates, cell adhesion strength). Once functional relationships between variables and associated parameter values have been informed, e.g., from histopathology or intra-operative analysis, this model can be used for disease diagnosis/prognosis, hypothesis testing, and to guide surgery and therapy. In particular, this tool identifies and quantifies the effects of vascularization and other cell-scale glioma morphological characteristics as predictors of tumor-scale growth and invasion.

Computer simulation of glioma growth and morphology.

Despite major advances in the study of glioma, the quantitative links between intra-tumor molecular/cellular properties, clinically observable properties such as morphology, and critical tumor behaviors such as growth and invasiveness remain unclear, hampering more effective coupling of tumor physical characteristics with implications for prognosis and therapy. Although molecular biology, histopathology, and radiological imaging are employed in this endeavor, studies are severely challenged by the multitude of different physical scales involved in tumor growth, i.e., from molecular nanoscale to cell microscale and finally to tissue centimeter scale. Consequently, it is often difficult to determine the underlying dynamics across dimensions. New techniques are needed to tackle these issues. Here, we address this multi-scalar problem by employing a novel predictive three-dimensional mathematical and computational model based on first-principle equations (conservation laws of physics) that describe mathematically the diffusion of cell substrates and other processes determining tumor mass growth and invasion. The model uses conserved variables to represent known determinants of glioma behavior, e.g., cell density and oxygen concentration, as well as biological functional relationships and parameters linking phenomena at different scales whose specific forms and values are hypothesized and calculated based on in vitro and in vivo experiments and from histopathology of tissue specimens from human gliomas. This model enables correlation of glioma morphology to tumor growth by quantifying interdependence of tumor mass on the microenvironment (e.g., hypoxia, tissue disruption) and on the cellular phenotypes (e.g., mitosis and apoptosis rates, cell adhesion strength). Once functional relationships between variables and associated parameter values have been informed, e.g., from histopathology or intra-operative analysis, this model can be used for disease diagnosis/prognosis, hypothesis testing, and to guide surgery and therapy. In particular, this tool identifies and quantifies the effects of vascularization and other cell-scale glioma morphological characteristics as predictors of tumor-scale growth and invasion.

Predictive oncology: a review of multidisciplinary, multiscale in silico modeling linking phenotype, morphology and growth.

Empirical evidence and theoretical studies suggest that the phenotype, i.e., cellular- and molecular-scale dynamics, including proliferation rate and adhesiveness due to microenvironmental factors and gene expression that govern tumor growth and invasiveness, also determine gross tumor-scale morphology. It has been difficult to quantify the relative effect of these links on disease progression and prognosis using conventional clinical and experimental methods and observables. As a result, successful individualized treatment of highly malignant and invasive cancers, such as glioblastoma, via surgical resection and chemotherapy cannot be offered and outcomes are generally poor. What is needed is a deterministic, quantifiable method to enable understanding of the connections between phenotype and tumor morphology. Here, we critically assess advantages and disadvantages of recent computational modeling efforts (e.g., continuum, discrete, and cellular automata models) that have pursued this understanding. Based on this assessment, we review a multiscale, i.e., from the molecular to the gross tumor scale, mathematical and computational "first-principle" approach based on mass conservation and other physical laws, such as employed in reaction-diffusion systems. Model variables describe known characteristics of tumor behavior, and parameters and functional relationships across scales are informed from in vitro, in vivo and ex vivo biology. We review the feasibility of this methodology that, once coupled to tumor imaging and tumor biopsy or cell culture data, should enable prediction of tumor growth and therapy outcome through quantification of the relation between the underlying dynamics and morphological characteristics. In particular, morphologic stability analysis of this mathematical model reveals that tumor cell patterning at the tumor-host interface is regulated by cell proliferation, adhesion and other phenotypic characteristics: histopathology information of tumor boundary can be inputted to the mathematical model and used as a phenotype-diagnostic tool to predict collective and individual tumor cell invasion of surrounding tissue. This approach further provides a means to deterministically test effects of novel and hypothetical therapy strategies on tumor behavior.

Improved cerebellar tissue classification on magnetic resonance images of brain.

PURPOSE: To develop and implement a method for improved cerebellar tissue classification on the MRI of brain by automatically isolating the cerebellum prior to segmentation. MATERIALS AND METHODS: Dual fast spin echo (FSE) and fluid attenuation inversion recovery (FLAIR) images were acquired on 18 normal volunteers on a 3 T Philips scanner. The cerebellum was isolated from the rest of the brain using a symmetric inverse consistent nonlinear registration of individual brain with the parcellated template. The cerebellum was then separated by masking the anatomical image with individual FLAIR images. Tissues in both the cerebellum and rest of the brain were separately classified using hidden Markov random field (HMRF), a parametric method, and then combined to obtain tissue classification of the whole brain. The proposed method for tissue classification on real MR brain images was evaluated subjectively by two experts. The segmentation results on Brainweb images with varying noise and intensity nonuniformity levels were quantitatively compared with the ground truth by computing the Dice similarity indices. RESULTS: The proposed method significantly improved the cerebellar tissue classification on all normal volunteers included in this study without compromising the classification in remaining part of the brain. The average similarity indices for gray matter (GM) and white matter (WM) in the cerebellum are 89.81 (+/-2.34) and 93.04 (+/-2.41), demonstrating excellent performance of the proposed methodology. CONCLUSION: The proposed method significantly improved tissue classification in the cerebellum. The GM was overestimated when segmentation was performed on the whole brain as a single object.

Perfusion in rat brain at 7 T with arterial spin labeling using FAIR-TrueFISP and QUIPSS.

Measurement of perfusion in longitudinal studies allows for the assessment of tissue integrity and the detection of subtle pathologies. In this work, the feasibility of measuring brain perfusion in rats with high spatial resolution using arterial spin labeling is reported. A flow-sensitive alternating recovery sequence, coupled with a balanced gradient fast imaging with steady-state precession readout section was used to minimize ghosting and geometric distortions, while achieving high signal-to-noise ratio. The quantitative imaging of perfusion using a single subtraction method was implemented to address the effects of variable transit delays between the labeling of spins and their arrival at the imaging slice. Studies in six rats at 7 T showed good perfusion contrast with minimal geometric distortion. The measured blood flow values of 152.5+/-6.3 ml/100 g per minute in gray matter and 72.3+/-14.0 ml/100 g per minute in white matter are in good agreement with previously reported values based on autoradiography, considered to be the gold standard.

Quantification of the spatiotemporal microstructural organization of the human brain association, projection and commissural pathways across the lifespan using diffusion tensor tractography.

Using diffusion tensor tractography, we quantified the microstructural changes in the association, projection, and commissural compact white matter pathways of the human brain over the lifespan in a cohort of healthy right-handed children and adults aged 6-68 years. In both males and females, the diffusion tensor radial diffusivity of the bilateral arcuate fasciculus, inferior longitudinal fasciculus, inferior fronto-occipital fasciculus, uncinate fasciculus, corticospinal, somatosensory tracts, and the corpus callosum followed a U-curve with advancing age; fractional anisotropy in the same pathways followed an inverted U-curve. Our study provides useful baseline data for the interpretation of data collected from patients.

Patient-Specific Semi-Supervised Learning for Postoperative Brain Tumor Segmentation

In contrast to preoperative brain tumor segmentation, the problem of postoperative brain tumor segmentation has been rarely approached so far. We present a fully-automatic segmentation method using multimodal magnetic resonance image data and patient-specific semi-supervised learning. The idea behind our semi-supervised approach is to effectively fuse information from both pre- and postoperative image data of the same patient to improve segmentation of the postoperative image. We pose image segmentation as a classification problem and solve it by adopting a semi-supervised decision forest. The method is evaluated on a cohort of 10 high-grade glioma patients, with segmentation performance and computation time comparable or superior to a state-of-the-art brain tumor segmentation method. Moreover, our results confirm that the inclusion of preoperative MR images lead to a better performance regarding postoperative brain tumor segmentation.

Interactive Segmentation of MR Images from Brain Tumor Patients

Medical doctors often do not trust the result of fully automatic segmentations because they have no possibility to make corrections if necessary. On the other hand, manual corrections can introduce a user bias. In this work, we propose to integrate the possibility for quick manual corrections into a fully automatic segmentation method for brain tumor images. This allows for necessary corrections while maintaining a high objectiveness. The underlying idea is similar to the well-known Grab-Cut algorithm, but here we combine decision forest classification with conditional random field regularization for interactive segmentation of 3D medical images. The approach has been evaluated by two different users on the BraTS2012 dataset. Accuracy and robustness improved compared to a fully automatic method and our interactive approach was ranked among the top performing methods. Time for computation including manual interaction was less than 10 minutes per patient, which makes it attractive for clinical use.

Establishing a fiber-optic-based optical neural interface.

Selective expression of opsins in genetically defined neurons makes it possible to control a subset of neurons without affecting nearby cells and processes in the intact brain, but light must still be delivered to the target brain structure. Light scattering limits the delivery of light from the surface of the brain. For this reason, we have developed a fiber-optic-based optical neural interface (ONI), which allows optical access to any brain structure in freely moving mammals. The ONI system is constructed by modifying the small animal cannula system from PlasticsOne. The system for bilateral stimulation consists of a bilateral cannula guide that has been stereotactically implanted over the target brain region, a screw cap for securing the optical fiber to the animal's head, a fiber guard modified from the internal cannula adapter, and a bare fiber whose length is customized based on the depth of the target region. For unilateral stimulation, a single-fiber system can be constructed using unilateral cannula parts from PlasticsOne. We describe here the preparation of the bilateral ONI system and its use in optical stimulation of the mouse or rat brain. Delivery of opsin-expressing virus and implantation of the ONI may be conducted in the same surgical session; alternatively, with a transgenic animal no opsin virus is delivered during the surgery. Similar procedures are useful for deep or superficial injections (even for neocortical targets, although in some cases surface light-emitting diodes or cortex-apposed fibers can be used for the most superficial cortical targets).

Are We Sims? How Computer Simulations Represent and What this Means for the Simulation Argument

N. Bostrom’s simulation argument and two additional assumptions imply that we are likely to live in a computer simulation. The argument is based upon the following assumption about the workings of realistic brain simulations: The hardware of a computer on which a brain simulation is run bears a close analogy to the brain itself. To inquire whether this is so, I analyze how computer simulations trace processes in their targets. I describe simulations as fictional, mathematical, pictorial, and material models. Even though the computer hardware does provide a material model of the target, this does not suffice to underwrite the simulation argument because the ways in which parts of the computer hardware interact during simulations do not resemble the ways in which neurons interact in the brain. Further, there are computer simulations of all kinds of systems, and it would be unreasonable to infer that some computers display consciousness just because they simulate brains rather than, say, galaxies.