A Hybrid Model for Multimodal Brain Tumor Segmentation

We present a fully automatic segmentation method for multi-modal brain tumor segmentation. The proposed generative-discriminative hybrid model generates initial tissue probabilities, which are used subsequently for enhancing the classi�cation and spatial regularization. The model has been evaluated on the BRATS2013 training set, which includes multimodal MRI images from patients with high- and low-grade gliomas. Our method is capable of segmenting the image into healthy (GM, WM, CSF) and pathological tissue (necrotic, enhancing and non-enhancing tumor, edema). We achieved state-of-the-art performance (Dice mean values of 0.69 and 0.8 for tumor subcompartments and complete tumor respectively) within a reasonable timeframe (4 to 15 minutes).

Volume and shape in feature space on adaptive FCM in MRI segmentation.

Intensity non-uniformity (bias field) correction, contextual constraints over spatial intensity distribution and non-spherical cluster's shape in the feature space are incorporated into the fuzzy c-means (FCM) for segmentation of three-dimensional multi-spectral MR images. The bias field is modeled by a linear combination of smooth polynomial basis functions for fast computation in the clustering iterations. Regularization terms for the neighborhood continuity of either intensity or membership are added into the FCM cost functions. Since the feature space is not isotropic, distance measures, other than the Euclidean distance, are used to account for the shape and volumetric effects of clusters in the feature space. The performance of segmentation is improved by combining the adaptive FCM scheme with the criteria used in Gustafson-Kessel (G-K) and Gath-Geva (G-G) algorithms through the inclusion of the cluster scatter measure. The performance of this integrated approach is quantitatively evaluated on normal MR brain images using the similarity measures. The improvement in the quality of segmentation obtained with our method is also demonstrated by comparing our results with those produced by FSL (FMRIB Software Library), a software package that is commonly used for tissue classification.

Molecular and biochemical analysis of the {\it Drosophila\/} segmentation gene {\it runt\/}

Genetic evidence has indicated that the segmentation gene runt plays a key role in regulating gene expression of the pair-rule genes hairy, even-skipped, and fushi tarazu. In contrast to other pair-rule genes, sequence data of the runt open reading frame did not reveal homologies to DNA-binding motifs of known transcriptional regulatory proteins. This thesis project examined several properties of the runt gene based on the sequence of the transcription unit, including the subcellular localization of the protein in vivo, its ability to bind DNA, and the functionality of a putative nucleotide binding domain.^ A runt-specific antibody was generated and used to demonstrate that runt is localized in the nucleus. Since the precise overlap of the pair-rule stripes is thought to be critical for the determination of cellular identity along the anterior-posterior axis, phasing of early runt expression in the blastoderm was examined with regard to the segmentation genes hairy, even-skipped, and fushi tarazu. runt was also expressed at later stages of embryogenesis, including expression in neuroblasts, and ganglion mother cells of the developing nervous system. Expression at this stage was required for the subsequent formation of specific neurons and runt was extensively expressed in the central and peripheral nervous systems.^ Several experiments were done to address the biochemical function of the runt protein. A direct interaction of runt with DNA was first examined. Although bacterial expressed runt was found to bind dsDNA-cellulose, subsequent experiments failed to detect sequence-specific interactions with DNA. Inter-species conservation of the putative nucleotide binding domain suggested that this region was functionally important, and runt protein bound a labeled ATP analog with high affinity in vitro. Finally, the effect of substitution of a critical residue of the nucleotide binding domain on runt activity was examined in vivo. Ectopic expression of the mutant protein indicated that this conserved substitution altered, but did not eliminate, runt activity as evaluated by segmentation phenotype and viability. ^

True four-dimensional analysis of thoracic aortic displacement and distension using model-based segmentation of computed tomography angiography.

Previous analyses of aortic displacement and distension using computed tomography angiography (CTA) were performed on double-oblique multi-planar reformations and did not consider through-plane motion. The aim of this study was to overcome this limitation by using a novel computational approach for the assessment of thoracic aortic displacement and distension in their true four-dimensional extent. Vessel segmentation with landmark tracking was executed on CTA of 24 patients without evidence of aortic disease. Distension magnitudes and maximum displacement vectors (MDV) including their direction were analyzed at 5 aortic locations: left coronary artery (COR), mid-ascending aorta (ASC), brachiocephalic trunk (BCT), left subclavian artery (LSA), descending aorta (DES). Distension was highest for COR (2.3 ± 1.2 mm) and BCT (1.7 ± 1.1 mm) compared with ASC, LSA, and DES (p < 0.005). MDV decreased from COR to LSA (p < 0.005) and was highest for COR (6.2 ± 2.0 mm) and ASC (3.8 ± 1.9 mm). Displacement was directed towards left and anterior at COR and ASC. Craniocaudal displacement at COR and ASC was 1.3 ± 0.8 and 0.3 ± 0.3 mm. At BCT, LSA, and DES no predominant displacement direction was observable. Vessel displacement and wall distension are highest in the ascending aorta, and ascending aortic displacement is primarily directed towards left and anterior. Craniocaudal displacement remains low even close to the left cardiac ventricle.

Segmentation and Recognition of Multi-Food Meal Images for Carbohydrate Counting

In this paper, we propose novel methodologies for the automatic segmentation and recognition of multi-food images. The proposed methods implement the first modules of a carbohydrate counting and insulin advisory system for type 1 diabetic patients. Initially the plate is segmented using pyramidal mean-shift filtering and a region growing algorithm. Then each of the resulted segments is described by both color and texture features and classified by a support vector machine into one of six different major food classes. Finally, a modified version of the Huang and Dom evaluation index was proposed, addressing the particular needs of the food segmentation problem. The experimental results prove the effectiveness of the proposed method achieving a segmentation accuracy of 88.5% and recognition rate equal to 87%

Interactive effects of mycorrhizae and a root hemiparasite on plant community productivity and diversity

Plant communities can be affected both by arbuscular mycorrhizal fungi (AMF) and hemiparasitic plants. However, little is known about the interactive effects of these two biotic factors on the productivity and diversity of plant communities. To address this question, we set up a greenhouse study in which different AMF inocula and a hemiparasitic plant (Rhinanthus minor) were added to experimental grassland communities in a fully factorial design. In addition, single plants of each species in the grassland community were grown with the same treatments to distinguish direct AMF effects from indirect effects via plant competition. We found that AMF changed plant community structure by influencing the plant species differently. At the community level, AMF decreased the productivity by 15-24%, depending on the particular AMF treatment, mainly because two dominant species, Holcus lanatus and Plantago lanceolata, showed a negative mycorrhizal dependency. Concomitantly, plant diversity increased due to AMF inoculation and was highest in the treatment with a combination of two commercial AM strains. AMF had a positive effect on growth of the hemiparasite, and thereby induced a negative impact of the hemiparasite on host plant biomass which was not found in non-inoculated communities. However, the hemiparasite did not increase plant diversity. Our results highlight the importance of interactions with soil microbes for plant community structure and that these indirect effects can vary among AMF treatments. We conclude that mutualistic interactions with AMF, but not antagonistic interactions with a root hemiparasite, promote plant diversity in this grassland community.

Multi-modal glioblastoma segmentation: man versus machine

BACKGROUND AND PURPOSE Reproducible segmentation of brain tumors on magnetic resonance images is an important clinical need. This study was designed to evaluate the reliability of a novel fully automated segmentation tool for brain tumor image analysis in comparison to manually defined tumor segmentations. METHODS We prospectively evaluated preoperative MR Images from 25 glioblastoma patients. Two independent expert raters performed manual segmentations. Automatic segmentations were performed using the Brain Tumor Image Analysis software (BraTumIA). In order to study the different tumor compartments, the complete tumor volume TV (enhancing part plus non-enhancing part plus necrotic core of the tumor), the TV+ (TV plus edema) and the contrast enhancing tumor volume CETV were identified. We quantified the overlap between manual and automated segmentation by calculation of diameter measurements as well as the Dice coefficients, the positive predictive values, sensitivity, relative volume error and absolute volume error. RESULTS Comparison of automated versus manual extraction of 2-dimensional diameter measurements showed no significant difference (p = 0.29). Comparison of automated versus manual segmentation of volumetric segmentations showed significant differences for TV+ and TV (p<0.05) but no significant differences for CETV (p>0.05) with regard to the Dice overlap coefficients. Spearman's rank correlation coefficients (ρ) of TV+, TV and CETV showed highly significant correlations between automatic and manual segmentations. Tumor localization did not influence the accuracy of segmentation. CONCLUSIONS In summary, we demonstrated that BraTumIA supports radiologists and clinicians by providing accurate measures of cross-sectional diameter-based tumor extensions. The automated volume measurements were comparable to manual tumor delineation for CETV tumor volumes, and outperformed inter-rater variability for overlap and sensitivity.

Atlas-based Segmentation of Tumor-bearing Brain Images

In diagnostic neuroradiology as well as in radiation oncology and neurosurgery, there is an increasing demand for accurate segmentation of tumor-bearing brain images. Atlas-based segmentation is an appealing automatic technique thanks to its robustness and versatility. However, atlas-based segmentation of tumor-bearing brain images is challenging due to the confounding effects of the tumor in the patient image. In this article, we provide a brief background on brain tumor imaging and introduce the clinical perspective, before we categorize and review the state of the art in the current literature on atlas-based segmentation for tumor-bearing brain images. We also present selected methods and results from our own research in more detail. Finally, we conclude with a short summary and look at new developments in the field, including requirements for future routine clinical use.

Interactive free viewpoint video streaming using prioritized network coding

In free viewpoint applications, the images are captured by an array of cameras that acquire a scene of interest from different perspectives. Any intermediate viewpoint not included in the camera array can be virtually synthesized by the decoder, at a quality that depends on the distance between the virtual view and the camera views available at decoder. Hence, it is beneficial for any user to receive camera views that are close to each other for synthesis. This is however not always feasible in bandwidth-limited overlay networks, where every node may ask for different camera views. In this work, we propose an optimized delivery strategy for free viewpoint streaming over overlay networks. We introduce the concept of layered quality-of-experience (QoE), which describes the level of interactivity offered to clients. Based on these levels of QoE, camera views are organized into layered subsets. These subsets are then delivered to clients through a prioritized network coding streaming scheme, which accommodates for the network and clients heterogeneity and effectively exploit the resources of the overlay network. Simulation results show that, in a scenario with limited bandwidth or channel reliability, the proposed method outperforms baseline network coding approaches, where the different levels of QoE are not taken into account in the delivery strategy optimization.

Combining Bottom-up and Top-down Generation of Interactive Knowledge Maps for Enterprise Search

Our research project develops an intranet search engine with concept- browsing functionality, where the user is able to navigate the conceptual level in an interactive, automatically generated knowledge map. This knowledge map visualizes tacit, implicit knowledge, extracted from the intranet, as a network of semantic concepts. Inductive and deductive methods are combined; a text ana- lytics engine extracts knowledge structures from data inductively, and the en- terprise ontology provides a backbone structure to the process deductively. In addition to performing conventional keyword search, the user can browse the semantic network of concepts and associations to find documents and data rec- ords. Also, the user can expand and edit the knowledge network directly. As a vision, we propose a knowledge-management system that provides concept- browsing, based on a knowledge warehouse layer on top of a heterogeneous knowledge base with various systems interfaces. Such a concept browser will empower knowledge workers to interact with knowledge structures.