Multi-strand narrative structures: a filmic game of multiple players

Session 7: Playing with Roles, images and improvising New States of Awareness, 3rd Global Conference, 1st November – 3rd November, 2014, Prague, Czech Republic.

Fusion of Multi-Atlas Segmentations with Spatial Distribution Modeling

In recent years, multi-atlas fusion methods have gainedsignificant attention in medical image segmentation. Inthis paper, we propose a general Markov Random Field(MRF) based framework that can perform edge-preservingsmoothing of the labels at the time of fusing the labelsitself. More specifically, we formulate the label fusionproblem with MRF-based neighborhood priors, as an energyminimization problem containing a unary data term and apairwise smoothness term. We present how the existingfusion methods like majority voting, global weightedvoting and local weighted voting methods can be reframedto profit from the proposed framework, for generatingmore accurate segmentations as well as more contiguoussegmentations by getting rid of holes and islands. Theproposed framework is evaluated for segmenting lymphnodes in 3D head and neck CT images. A comparison ofvarious fusion algorithms is also presented.

Imputation in data fusion of heterogeneous data sets a model-based numerical experiment

Given the very large amount of data obtained everyday through population surveys, much of the new research again could use this information instead of collecting new samples. Unfortunately, relevant data are often disseminated into different files obtained through different sampling designs. Data fusion is a set of methods used to combine information from different sources into a single dataset. In this article, we are interested in a specific problem: the fusion of two data files, one of which being quite small. We propose a model-based procedure combining a logistic regression with an Expectation-Maximization algorithm. Results show that despite the lack of data, this procedure can perform better than standard matching procedures.

Landmark detection for fusion of fundus and MRI toward a patient-specific multimodal eye model.

Ophthalmologists typically acquire different image modalities to diagnose eye pathologies. They comprise, e.g., Fundus photography, optical coherence tomography, computed tomography, and magnetic resonance imaging (MRI). Yet, these images are often complementary and do express the same pathologies in a different way. Some pathologies are only visible in a particular modality. Thus, it is beneficial for the ophthalmologist to have these modalities fused into a single patient-specific model. The goal of this paper is a fusion of Fundus photography with segmented MRI volumes. This adds information to MRI that was not visible before like vessels and the macula. This paper contributions include automatic detection of the optic disc, the fovea, the optic axis, and an automatic segmentation of the vitreous humor of the eye.

Model-based Segmentation and Fusion of 3D Computed Tomography and 3D Ultrasound of the Eye for Radiotherapy Planning

Computed Tomography (CT) represents the standard imaging modality for tumor volume delineation for radiotherapy treatment planning of retinoblastoma despite some inherent limitations. CT scan is very useful in providing information on physical density for dose calculation and morphological volumetric information but presents a low sensitivity in assessing the tumor viability. On the other hand, 3D ultrasound (US) allows a highly accurate definition of the tumor volume thanks to its high spatial resolution but it is not currently integrated in the treatment planning but used only for diagnosis and follow-up. Our ultimate goal is an automatic segmentation of gross tumor volume (GTV) in the 3D US, the segmentation of the organs at risk (OAR) in the CT and the registration of both modalities. In this paper, we present some preliminary results in this direction. We present 3D active contour-based segmentation of the eye ball and the lens in CT images; the presented approach incorporates the prior knowledge of the anatomy by using a 3D geometrical eye model. The automated segmentation results are validated by comparing with manual segmentations. Then, we present two approaches for the fusion of 3D CT and US images: (i) landmark-based transformation, and (ii) object-based transformation that makes use of eye ball contour information on CT and US images.

Model-based Segmentation and Image Fusion of 3D Computed Tomography and 3D Ultrasound of the Eye for Radiotherapy Planning

For radiotherapy treatment planning of retinoblastoma inchildhood, Computed Tomography (CT) represents thestandard method for tumor volume delineation, despitesome inherent limitations. CT scan is very useful inproviding information on physical density for dosecalculation and morphological volumetric information butpresents a low sensitivity in assessing the tumorviability. On the other hand, 3D ultrasound (US) allows ahigh accurate definition of the tumor volume thanks toits high spatial resolution but it is not currentlyintegrated in the treatment planning but used only fordiagnosis and follow-up. Our ultimate goal is anautomatic segmentation of gross tumor volume (GTV) in the3D US, the segmentation of the organs at risk (OAR) inthe CT and the registration of both. In this paper, wepresent some preliminary results in this direction. Wepresent 3D active contour-based segmentation of the eyeball and the lens in CT images; the presented approachincorporates the prior knowledge of the anatomy by usinga 3D geometrical eye model. The automated segmentationresults are validated by comparing with manualsegmentations. Then, for the fusion of 3D CT and USimages, we present two approaches: (i) landmark-basedtransformation, and (ii) object-based transformation thatmakes use of eye ball contour information on CT and USimages.

Inversion of multiple intersecting high-resolution crosshole GPR profiles for hydrological characterization at the Boise Hydrogeophysical Research Site

The integration of geophysical data into the subsurface characterization problem has been shown in many cases to significantly improve hydrological knowledge by providing information at spatial scales and locations that is unattainable using conventional hydrological measurement techniques. In particular, crosshole ground-penetrating radar (GPR) tomography has shown much promise in hydrology because of its ability to provide highly detailed images of subsurface radar wave velocity, which is strongly linked to soil water content. Here, we develop and demonstrate a procedure for inverting together multiple crosshole GPR data sets in order to characterize the spatial distribution of radar wave velocity below the water table at the Boise Hydrogeophysical Research Site (BHRS) near Boise, Idaho, USA. Specifically, we jointly invert 31 intersecting crosshole GPR profiles to obtain a highly resolved and consistent radar velocity model along the various profile directions. The model is found to be strongly correlated with complementary neutron porosity-log data and is further corroborated by larger-scale structural information at the BHRS. This work is an important prerequisite to using crosshole GPR data together with existing hydrological measurements for improved groundwater flow and contaminant transport modeling.

Landmark detection for fusion of fundus and MRI toward a patient-specific multimodal eye model.

Ophthalmologists typically acquire different image modalities to diagnose eye pathologies. They comprise, e.g., Fundus photography, optical coherence tomography, computed tomography, and magnetic resonance imaging (MRI). Yet, these images are often complementary and do express the same pathologies in a different way. Some pathologies are only visible in a particular modality. Thus, it is beneficial for the ophthalmologist to have these modalities fused into a single patient-specific model. The goal of this paper is a fusion of Fundus photography with segmented MRI volumes. This adds information to MRI that was not visible before like vessels and the macula. This paper contributions include automatic detection of the optic disc, the fovea, the optic axis, and an automatic segmentation of the vitreous humor of the eye.

Automated segmentation of multiple red blood cells with digital holographic microscopy.

We present a method to automatically segment red blood cells (RBCs) visualized by digital holographic microscopy (DHM), which is based on the marker-controlled watershed algorithm. Quantitative phase images of RBCs can be obtained by using off-axis DHM along to provide some important information about each RBC, including size, shape, volume, hemoglobin content, etc. The most important process of segmentation based on marker-controlled watershed is to perform an accurate localization of internal and external markers. Here, we first obtain the binary image via Otsu algorithm. Then, we apply morphological operations to the binary image to get the internal markers. We then apply the distance transform algorithm combined with the watershed algorithm to generate external markers based on internal markers. Finally, combining the internal and external markers, we modify the original gradient image and apply the watershed algorithm. By appropriately identifying the internal and external markers, the problems of oversegmentation and undersegmentation are avoided. Furthermore, the internal and external parts of the RBCs phase image can also be segmented by using the marker-controlled watershed combined with our method, which can identify the internal and external markers appropriately. Our experimental results show that the proposed method achieves good performance in terms of segmenting RBCs and could thus be helpful when combined with an automated classification of RBCs.

Magnetic Resocance Imaging Methods in the Follow-up of Multiple Sclerosis and in Farby Disease

Multiple sclerosis (MS) is a chronic immune-mediated inflammatory disorder of the central nervous system. MS is the most common disabling central nervous system (CNS) disease of young adults in the Western world. In Finland, the prevalence of MS ranges between 1/1000 and 2/1000 in different areas. Fabry disease (FD) is a rare hereditary metabolic disease due to mutation in a single gene coding α-galactosidase A (alpha-gal A) enzyme. It leads to multi-organ pathology, including cerebrovascular disease. Currently there are 44 patients with diagnosed FD in Finland. Magnetic resonance imaging (MRI) is commonly used in the diagnostics and follow-up of these diseases. The disease activity can be demonstrated by occurrence of new or Gadolinium (Gd)-enhancing lesions in routine studies. Diffusion-weighted imaging (DWI) and diffusion tensor imaging (DTI) are advanced MR sequences which can reveal pathologies in brain regions which appear normal on conventional MR images in several CNS diseases. The main focus in this study was to reveal whether whole brain apparent diffusion coefficient (ADC) analysis can be used to demonstrate MS disease activity. MS patients were investigated before and after delivery and before and after initiation of diseasemodifying treatment (DMT). In FD, DTI was used to reveal possible microstructural alterations at early timepoints when excessive signs of cerebrovascular disease are not yet visible in conventional MR sequences. Our clinical and MRI findings at 1.5T indicated that post-partum activation of the disease is an early and common phenomenon amongst mothers with MS. MRI seems to be a more sensitive method for assessing MS disease activity than the recording of relapses. However, whole brain ADC histogram analysis is of limited value in the follow-up of inflammatory conditions in a pregnancy-related setting because the pregnancy-related physiological effects on ADC overwhelm the alterations in ADC associated with MS pathology in brain tissue areas which appear normal on conventional MRI sequences. DTI reveals signs of microstructural damage in brain white matter of FD patients before excessive white matter lesion load can be observed on conventional MR scans. DTI could offer a valuable tool for monitoring the possible effects of enzyme replacement therapy in FD.

SCaFoS: a tool for Selection, Concatenation and Fusion of Sequences for phylogenomics

Affiliation: Département de Biochimie, Université de Montréal

Multimodal image fusion of anatomical structures for diagnosis, therapy planning and assistance

This paper provides an overview of work done in recent years by our research group to fuse multimodal images of the trunk of patients with Adolescent Idiopathic Scoliosis (AIS) treated at Sainte-Justine University Hospital Center (CHU). We first describe our surface acquisition system and introduce a set of clinical measurements (indices) based on the trunk's external shape, to quantify its degree of asymmetry. We then describe our 3D reconstruction system of the spine and rib cage from biplanar radiographs and present our methodology for multimodal fusion of MRI, X-ray and external surface images of the trunk We finally present a physical model of the human trunk including bone and soft tissue for the simulation of the surgical outcome on the external trunk shape in AIS.

Sparse Representations of Multiple Signals

We discuss the problem of finding sparse representations of a class of signals. We formalize the problem and prove it is NP-complete both in the case of a single signal and that of multiple ones. Next we develop a simple approximation method to the problem and we show experimental results using artificially generated signals. Furthermore,we use our approximation method to find sparse representations of classes of real signals, specifically of images of pedestrians. We discuss the relation between our formulation of the sparsity problem and the problem of finding representations of objects that are compact and appropriate for detection and classification.

Cleidocranial dysplasia: importance of radiographic images in diagnosis of the condition.

Cleidocranial dysplasia (CCD) is a rare syndrome usually caused by an autosomal dominant gene, although 40% of cases of CCD appear spontaneously with no apparent genetic cause. This condition is characterized by several cranial malformations and underdevelopment, absence of the clavicles, and multiple supernumerary and impacted permanent teeth. The diagnosis of this condition is usually based on the presence of the main features (supernumerary teeth, partial or total absence of one or both the clavicles, and bony malformations) and on clinical and familial evidence. The bony and dental features of CCD may be visualized on radiographic images of the face and skull. Here, we present a familial case of CCD and discuss the importance of dental radiographs in diagnosis of the condition.

Fusion of fingerprint recognition methods for robust human identification

Biometrics is one of the biggest tendencies in human identification. The fingerprint is the most widely used biometric. However considering the automatic fingerprint recognition a completely solved problem is a common mistake. The most popular and extensively used methods, the minutiae-based, do not perform well on poor-quality images and when just a small area of overlap between the template and the query images exists. The use of multibiometrics is considered one of the keys to overcome the weakness and improve the accuracy of biometrics systems. This paper presents the fusion of a minutiae-based and a ridge-based fingerprint recognition method at rank, decision and score level. The fusion techniques implemented leaded to a reduction of the Equal Error Rate by 31.78% (from 4.09% to 2.79%) and a decreasing of 6 positions in the rank to reach a Correct Retrieval (from rank 8 to 2) when assessed in the FVC2002-DB1A database. © 2008 IEEE.