The Multimodal Brain TumorImage Segmentation Benchmark (BRATS)

In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients - manually annotated by up to four raters - and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all subregions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.

Diagnosis of cardiac metastasis from cervical cancer in a 33-year-old patient using multimodal imaging studies: a case report and literature review.

We report a case of a 33-year-old woman with emergency admission due to dyspnoea and fever. History included squamous cell carcinoma of the cervix in complete remission. Contrast-enhanced computed tomography (CT) scanning of the chest, which was indicated to rule out pneumonia, revealed an infiltrative cardiac mass. Further assessment of the tumour by echocardiography and cardiac magnetic resonance imaging (MRI) showed transmural infiltration of the apical interventricular septum with a mass extending into the left and right ventricle cavities. The mass was highly suspicious for a cardiac metastasis. Cardiac metastases from cervical cancer are extremely rare. Recurrence of cervical carcinoma involving the heart should be considered even after a curative therapy approach. Non-invasive imaging plays a paramount role in investigating cardiac masses. Echocardiography, CT and MRI are complementary imaging modalities for complete work-up of intracardiac lesions.

Multimodal sequence learning

While sequence learning research models complex phenomena, previous studies have mostly focused on unimodal sequences. The goal of the current experiment is to put implicit sequence learning into a multimodal context: to test whether it can operate across different modalities. We used the Task Sequence Learning paradigm to test whether sequence learning varies across modalities, and whether participants are able to learn multimodal sequences. Our results show that implicit sequence learning is very similar regardless of the source modality. However, the presence of correlated task and response sequences was required for learning to take place. The experiment provides new evidence for implicit sequence learning of abstract conceptual representations. In general, the results suggest that correlated sequences are necessary for implicit sequence learning to occur. Moreover, they show that elements from different modalities can be automatically integrated into one unitary multimodal sequence.

Expanded Clinical Spectrum of Multiple Evanescent White Dot Syndrome with Multimodal Imaging

PURPOSE: To evaluate and characterize multiple evanescent white dot syndrome abnormalities with modern multimodal imaging modalities. METHODS: This retrospective cohort study evaluated fundus photography, fluorescein angiography, indocyanine green angiography, optical coherence tomography, enhanced depth imaging optical coherence tomography, short-wavelength autofluorescence, and near-infrared autofluorescence. RESULTS: Thirty-four multiple evanescent white dot syndrome patients with mean age of 28.7 years were studied (range, 14-49 years). Twenty-six patients were women, and eight were men. Initial mean visual acuity was 0.41 logMAR. Final mean visual acuity was 0.03 logMAR. Fluorescein angiography shows a variable number of mid retinal early fluorescent dots distributed in a wreathlike pattern, which correlate to fundus photography, fundus autofluorescence, and indocyanine green angiography. Indocyanine green angiography imaging shows the dots and also hypofluorescent, deeper, and larger spots, which are occasionally confluent, demonstrating a large plaque of deep retinal hypofluorescence. Optical coherence tomography imaging shows multifocal debris centered at and around the ellipsoid layer, corresponding to the location of spots seen with photography, indocyanine green angiography, and fluorescein angiography. Protrusions of the hyperreflectant material from the ellipsoid layer toward the outer nuclear layer correspond to the location of dots seen with photography, indocyanine green angiography, and fluorescein angiography. CONCLUSION: Multimodal imaging analysis of the retina in patients with multiple evanescent white dot syndrome shows additional features that may help in the diagnosis of the disease and in further understanding its etiology. Multiple evanescent white dot syndrome is predominantly a disease of the outer retina, centered at the ellipsoid zone, but also involving the interdigitation zone and the outer nuclear layer.

Biometrics, fatty acid composition and stable isotopic ratios of five seabird species from Kongsfjorden, Svalbard

Marine birds are important predators in the marine ecosystem, and dietary studies can give useful information about their feeding ecology, food webs and oceanographic variability. The aim of this study was to increase our understanding of the diet and trophic level of the seabirds breeding in Kongsfjorden, Svalbard. We have used fatty acids and stable isotopes, both of which integrate diet information over space and time, to determine trophic relationships in marine food webs. Fatty acid compositions of muscle from Little auk (Alle alle), Brünnich's guillemot (Uria lomvia), Black-legged kittiwake (Rissa tridactyla), Northern fulmar (Fulmarus glacialis) and Glaucous gull (Larus hyperboreus) were determined and compared with their prey species. Canonical analysis (CA) showed that fatty acid composition differed among the five seabird species. Little auk, Black-legged kittiwake and Northern fulmar had high levels of the Calanus markers 20:1n9 and 22:1, indicating that these seabirds are a part of the Calanus food chain. Brünnich's guillemot differed from the other species with much lower levels of 20:1n9 and 22:1. Brünnich's guillemot is a pursuit diver feeding on fish and amphipods deeper in the water column, below 30 m. Glaucous gull also differed from the other seabird species, with a larger variation in the fatty acid composition indicating a more diverse diet. Trophic level analysis placed Little auk at the lowest trophic level, Brünnich's guillemot and Black-legged kittiwake at intermediate levels and Glaucous gull and Northern fulmar at the highest trophic level.

Multimodal Imaging of Cotton Wool Spots in Branch Retinal Vein Occlusion.

PURPOSE: To describe and follow cotton wool spots (CWS) in branch retinal vein occlusion (BRVO) using multimodal imaging. METHODS: In this prospective cohort study including 24 patients with new-onset BRVO, CWS were described and analyzed in color fundus photography (CF), spectral domain optical coherence tomography (SD-OCT), infrared (IR) and fluorescein angiography (FA) every 3 months for 3 years. The CWS area on SD-OCT and CF was evaluated using OCT-Tool-Kit software: CWS were marked in each single OCT B-scan and the software calculated the area by interpolation. RESULTS: 29 central CWS lesions were found. 100% of these CWS were visible on SD-OCT, 100% on FA and 86.2% on IR imaging, but only 65.5% on CF imaging. CWS were visible for 12.4 ± 7.5 months on SD-OCT, for 4.4 ± 3 months and 4.3 ± 3.4 months on CF and on IR, respectively, and for 17.5 ± 7.1 months on FA. The evaluated CWS area on SD-OCT was larger than on CF (0.26 ± 0.17 mm(2) vs. 0.13 ± 0.1 mm(2), p < 0.0001). The CWS area on SD-OCT and surrounding pathology such as intraretinal cysts, avascular zones and intraretinal hemorrhage were predictive for how long CWS remained visible (r(2) = 0.497, p < 0.002). CONCLUSIONS: The lifetime and presentation of CWS in BRVO seem comparable to other diseases. SD-OCT shows a higher sensitivity for detecting CWS compared to CF. The duration of visibility of CWS varies among different image modalities and depends on the surrounding pathology and the CWS size.

A multimodal tablet-based interface for designing and reviewing 3D engineering models

The ability to view and interact with 3D models has been happening for a long time. However, vision-based 3D modeling has only seen limited success in applications, as it faces many technical challenges. Hand-held mobile devices have changed the way we interact with virtual reality environments. Their high mobility and technical features, such as inertial sensors, cameras and fast processors, are especially attractive for advancing the state of the art in virtual reality systems. Also, their ubiquity and fast Internet connection open a path to distributed and collaborative development. However, such path has not been fully explored in many domains. VR systems for real world engineering contexts are still difficult to use, especially when geographically dispersed engineering teams need to collaboratively visualize and review 3D CAD models. Another challenge is the ability to rendering these environments at the required interactive rates and with high fidelity. In this document it is presented a virtual reality system mobile for visualization, navigation and reviewing large scale 3D CAD models, held under the CEDAR (Collaborative Engineering Design and Review) project. It’s focused on interaction using different navigation modes. The system uses the mobile device's inertial sensors and camera to allow users to navigate through large scale models. IT professionals, architects, civil engineers and oil industry experts were involved in a qualitative assessment of the CEDAR system, in the form of direct user interaction with the prototypes and audio-recorded interviews about the prototypes. The lessons learned are valuable and are presented on this document. Subsequently it was prepared a quantitative study on the different navigation modes to analyze the best mode to use it in a given situation.

DAEDALUS at ImageCLEF Medical Retrieval 2011: Textual, Visual and Multimodal Experiments

This paper describes the participation of DAEDALUS at ImageCLEF 2011 Medical Retrieval task. We have focused on multimodal (or mixed) experiments that combine textual and visual retrieval. The main objective of our research has been to evaluate the effect on the medical retrieval process of the existence of an extended corpus that is annotated with the image type, associated to both the image itself and also to its textual description. For this purpose, an image classifier has been developed to tag each document with its class (1st level of the hierarchy: Radiology, Microscopy, Photograph, Graphic, Other) and subclass (2nd level: AN, CT, MR, etc.). For the textual-based experiments, several runs using different semantic expansion techniques have been performed. For the visual-based retrieval, different runs are defined by the corpus used in the retrieval process and the strategy for obtaining the class and/or subclass. The best results are achieved in runs that make use of the image subclass based on the classification of the sample images. Although different multimodal strategies have been submitted, none of them has shown to be able to provide results that are at least comparable to the ones achieved by the textual retrieval alone. We believe that we have been unable to find a metric for the assessment of the relevance of the results provided by the visual and textual processes

A visual object counter based on a multimodal data association for embedded systems with limited computational power

A low complex but highly-efficient object counter algorithm is presented that can be embedded in hardware with a low computational power. This is achieved by a novel soft-data association strategy that can handle multimodal distributions.