Model-based Segmentation and Image Fusion of 3D Computed Tomography and 3D Ultrasound of the Eye for Radiotherapy Planning

For radiotherapy treatment planning of retinoblastoma inchildhood, Computed Tomography (CT) represents thestandard method for tumor volume delineation, despitesome inherent limitations. CT scan is very useful inproviding information on physical density for dosecalculation and morphological volumetric information butpresents a low sensitivity in assessing the tumorviability. On the other hand, 3D ultrasound (US) allows ahigh accurate definition of the tumor volume thanks toits high spatial resolution but it is not currentlyintegrated in the treatment planning but used only fordiagnosis and follow-up. Our ultimate goal is anautomatic segmentation of gross tumor volume (GTV) in the3D US, the segmentation of the organs at risk (OAR) inthe CT and the registration of both. In this paper, wepresent some preliminary results in this direction. Wepresent 3D active contour-based segmentation of the eyeball and the lens in CT images; the presented approachincorporates the prior knowledge of the anatomy by usinga 3D geometrical eye model. The automated segmentationresults are validated by comparing with manualsegmentations. Then, for the fusion of 3D CT and USimages, we present two approaches: (i) landmark-basedtransformation, and (ii) object-based transformation thatmakes use of eye ball contour information on CT and USimages.

Model-based Segmentation and Fusion of 3D Computed Tomography and 3D Ultrasound of the Eye for Radiotherapy Planning

Computed Tomography (CT) represents the standard imaging modality for tumor volume delineation for radiotherapy treatment planning of retinoblastoma despite some inherent limitations. CT scan is very useful in providing information on physical density for dose calculation and morphological volumetric information but presents a low sensitivity in assessing the tumor viability. On the other hand, 3D ultrasound (US) allows a highly accurate definition of the tumor volume thanks to its high spatial resolution but it is not currently integrated in the treatment planning but used only for diagnosis and follow-up. Our ultimate goal is an automatic segmentation of gross tumor volume (GTV) in the 3D US, the segmentation of the organs at risk (OAR) in the CT and the registration of both modalities. In this paper, we present some preliminary results in this direction. We present 3D active contour-based segmentation of the eye ball and the lens in CT images; the presented approach incorporates the prior knowledge of the anatomy by using a 3D geometrical eye model. The automated segmentation results are validated by comparing with manual segmentations. Then, we present two approaches for the fusion of 3D CT and US images: (i) landmark-based transformation, and (ii) object-based transformation that makes use of eye ball contour information on CT and US images.

Evaluation of high frequency jet ventilation in patients undergoing percutaneous thermal ablation

Purpose: To evaluate the use of high frequency jet ventilation (HFJV) in patients undergoing percutanous thermal ablation procedures.Materials: From may to september 2011 patients with lung, liver or kidney tumors suitable for percutanous thermal ablation were prospectively enrolled to be treated under general anesthesia using HFJV instead of conventional positive pressure ventilation (PPV). Our primary endpoint was feasability of HFJV during percutanous ablation, our secondary endpoints were assessment of breathing related movements by image fusion (CT/US), precision and ease of needle placement by number of CT aquisition/needle reposition and procedure related complications.Results: Twenty-nine patients (21 males, 8 females mean age 66.2 years) with 30 liver tumors, 1 kidney tumors and 6 lung tumors were included. Tumor ablation was performed by radiofrequency (RFA) in 26 cases, microwaves ( MWA) in 2 and cryoablation (CRA) in 1. The ablation procedure could be completed under HFJV in 22 patients. In 2 patients HFVJ had to be stopped in favor of PPV because the tumor was better seen under PPV. HFJV was not performed in 5. Breathing related movements of the target lesion in the cranio-caudal direction as estimated by image fusion were always inferior to 5mm compared to 20mm when patients are under PPV. Needle placement was straightforward under CT as well as US. No patient needed needle repositionning before ablation. We did not observe any HFJV related complications.Conclusions: HFJV significantly reduces breathing movements of target lesion during percutaneous ablation procedures. It does not seem to cause any particular complication. However in some cases such as tumors located at the base of the lungs or in the dome of the liver, the target may be best seen under PPV.

Comparisons of preoperative three-dimensional planning and surgical reconstruction in primary cementless total hip arthroplasty.

Reconstruction of important parameters such as femoral offset and torsion is inaccurate, when templating is based on plain x-rays. We evaluate intraoperative reproducibility of pre-operative CT-based 3D-templating in a consecutive series of 50 patients undergoing primary cementless THA through an anterior approach. Pre-operative planning was compared to a postoperative CT scan by image fusion. The implant size was correctly predicted in 100% of the stems, 94% of the cups and 88% of the heads (length). The difference between the planned and the postoperative leg length was 0.3 + 2.3 mm. Values for overall offset, femoral anteversion, cup inclination and anteversion were 1.4 mm ± 3.1, 0.6° ± 3.3°, -0.4° ± 5° and 6.9° ± 11.4°, respectively. This planning allows accurate implant size prediction. Stem position and cup inclination are accurately reproducible.

Weighted Shape-based Averaging with Neighborhood Prior Model for Multiple Atlas Fusion-based Medical Image Segmentation

In medical imaging, merging automated segmentations obtained from multiple atlases has become a standard practice for improving the accuracy. In this letter, we propose two new fusion methods: "Global Weighted Shape-Based Averaging" (GWSBA) and "Local Weighted Shape-Based Averaging" (LWSBA). These methods extend the well known Shape-Based Averaging (SBA) by additionally incorporating the similarity information between the reference (i.e., atlas) images and the target image to be segmented. We also propose a new spatially-varying similarity-weighted neighborhood prior model, and an edge-preserving smoothness term that can be used with many of the existing fusion methods. We first present our new Markov Random Field (MRF) based fusion framework that models the above mentioned information. The proposed methods are evaluated in the context of segmentation of lymph nodes in the head and neck 3D CT images, and they resulted in more accurate segmentations compared to the existing SBA.

Fusion of Multi-Atlas Segmentations with Spatial Distribution Modeling

In recent years, multi-atlas fusion methods have gainedsignificant attention in medical image segmentation. Inthis paper, we propose a general Markov Random Field(MRF) based framework that can perform edge-preservingsmoothing of the labels at the time of fusing the labelsitself. More specifically, we formulate the label fusionproblem with MRF-based neighborhood priors, as an energyminimization problem containing a unary data term and apairwise smoothness term. We present how the existingfusion methods like majority voting, global weightedvoting and local weighted voting methods can be reframedto profit from the proposed framework, for generatingmore accurate segmentations as well as more contiguoussegmentations by getting rid of holes and islands. Theproposed framework is evaluated for segmenting lymphnodes in 3D head and neck CT images. A comparison ofvarious fusion algorithms is also presented.

Landmark detection for fusion of fundus and MRI toward a patient-specific multimodal eye model.

Ophthalmologists typically acquire different image modalities to diagnose eye pathologies. They comprise, e.g., Fundus photography, optical coherence tomography, computed tomography, and magnetic resonance imaging (MRI). Yet, these images are often complementary and do express the same pathologies in a different way. Some pathologies are only visible in a particular modality. Thus, it is beneficial for the ophthalmologist to have these modalities fused into a single patient-specific model. The goal of this paper is a fusion of Fundus photography with segmented MRI volumes. This adds information to MRI that was not visible before like vessels and the macula. This paper contributions include automatic detection of the optic disc, the fovea, the optic axis, and an automatic segmentation of the vitreous humor of the eye.

Recent advances in remote sensing image processing

Remote sensing image processing is nowadays a mature research area. The techniques developed in the field allow many real-life applications with great societal value. For instance, urban monitoring, fire detection or flood prediction can have a great impact on economical and environmental issues. To attain such objectives, the remote sensing community has turned into a multidisciplinary field of science that embraces physics, signal theory, computer science, electronics, and communications. From a machine learning and signal/image processing point of view, all the applications are tackled under specific formalisms, such as classification and clustering, regression and function approximation, image coding, restoration and enhancement, source unmixing, data fusion or feature selection and extraction. This paper serves as a survey of methods and applications, and reviews the last methodological advances in remote sensing image processing.

Landmark detection for fusion of fundus and MRI toward a patient-specific multimodal eye model.

Ophthalmologists typically acquire different image modalities to diagnose eye pathologies. They comprise, e.g., Fundus photography, optical coherence tomography, computed tomography, and magnetic resonance imaging (MRI). Yet, these images are often complementary and do express the same pathologies in a different way. Some pathologies are only visible in a particular modality. Thus, it is beneficial for the ophthalmologist to have these modalities fused into a single patient-specific model. The goal of this paper is a fusion of Fundus photography with segmented MRI volumes. This adds information to MRI that was not visible before like vessels and the macula. This paper contributions include automatic detection of the optic disc, the fovea, the optic axis, and an automatic segmentation of the vitreous humor of the eye.

Detection of Clinically Significant Prostate Cancer Using Magnetic Resonance Imaging-Ultrasound Fusion Targeted Biopsy: A Systematic Review.

CONTEXT: The current standard for diagnosing prostate cancer in men at risk relies on a transrectal ultrasound-guided biopsy test that is blind to the location of the cancer. To increase the accuracy of this diagnostic pathway, a software-based magnetic resonance imaging-ultrasound (MRI-US) fusion targeted biopsy approach has been proposed. OBJECTIVE: Our main objective was to compare the detection rate of clinically significant prostate cancer with software-based MRI-US fusion targeted biopsy against standard biopsy. The two strategies were also compared in terms of detection of all cancers, sampling utility and efficiency, and rate of serious adverse events. The outcomes of different targeted approaches were also compared. EVIDENCE ACQUISITION: We performed a systematic review of PubMed/Medline, Embase (via Ovid), and Cochrane Review databases in December 2013 following the Preferred Reported Items for Systematic reviews and Meta-analysis statement. The risk of bias was evaluated using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. EVIDENCE SYNTHESIS: Fourteen papers reporting the outcomes of 15 studies (n=2293; range: 13-582) were included. We found that MRI-US fusion targeted biopsies detect more clinically significant cancers (median: 33.3% vs 23.6%; range: 13.2-50% vs 4.8-52%) using fewer cores (median: 9.2 vs 37.1) compared with standard biopsy techniques, respectively. Some studies showed a lower detection rate of all cancer (median: 50.5% vs 43.4%; range: 23.7-82.1% vs 14.3-59%). MRI-US fusion targeted biopsy was able to detect some clinically significant cancers that would have been missed by using only standard biopsy (median: 9.1%; range: 5-16.2%). It was not possible to determine which of the two biopsy approaches led most to serious adverse events because standard and targeted biopsies were performed in the same session. Software-based MRI-US fusion targeted biopsy detected more clinically significant disease than visual targeted biopsy in the only study reporting on this outcome (20.3% vs 15.1%). CONCLUSIONS: Software-based MRI-US fusion targeted biopsy seems to detect more clinically significant cancers deploying fewer cores than standard biopsy. Because there was significant study heterogeneity in patient inclusion, definition of significant cancer, and the protocol used to conduct the standard biopsy, these findings need to be confirmed by further large multicentre validating studies. PATIENT SUMMARY: We compared the ability of standard biopsy to diagnose prostate cancer against a novel approach using software to overlay the images from magnetic resonance imaging and ultrasound to guide biopsies towards the suspicious areas of the prostate. We found consistent findings showing the superiority of this novel targeted approach, although further high-quality evidence is needed to change current practice.

Development of a bifunctional CD1d-anti-HER2 scFv fusion molecule to redirect the iNKT cell-mediated immune response to the tumor site

Abstract : Invariant natural killer T lymphocytes (iNKT) are a unique subpopulation of T lymphocytes recognizing glycolipid antigens in the context of the MHC class I-like molecule CD1d. Upon activation with the high affinity ligand α-galactosylceramide (αGalCer), iNKT cells rapidly produce large amounts of the pro-inflammatory cytokine interferon gamma (IFN-γ) and potently activate cells of the innate and adaptive immune response, such as dendritic cells (DCs), NK and T cells. In this context, iNKT cells have been shown to efficiently mediate antitumor activity, and recent research has focused on the manipulation of these cells for antitumor therapies. However, a major drawback of αGalCer as a free drug is that a single injection of this ligand leads to a short-lived iNKT cell activation followed by a long-term anergy, limiting its therapeutic use. In contrast, we demonstrate here that when αGalCer is loaded on a recombinant soluble CD1d molecule (αGalCer/sCD1d), repeated injections lead to a sustained iNKT and NK cell activation associated with IFN-γ secretion as well as with DC maturation. Most importantly, when the αGalCer/sCD1d is fused to an anti-HER2 scFv antibody fragment, potent inhibition of experimental lung metastasis and established subcutaneous tumors is obtained when systemic treatment is started two to seven days after the injection of HER2-expressing B16 melanoma cells, whereas at this time free αGalCer has no effect. The antitumor activity of the sCD1d-anti-HER2 fusion protein is associated with HER2-specific tumor localization and accumulation of iNKT, NK and T cells at the tumor site. Importantly, active T cell immunization combined with the sCD1d-anti-HER2 treatment leads to the accumulation of antigen-specific CD8 T cells exclusively in HER2-expressing tumors, resulting in potent tumor inhibition. In conclusion, sustained activation and tumor targeting of iNKT cells by recombinant αGalCer/sCD1d molecules thus may promote a combined innate and adaptive immune response at the tumor site that may prove to be effective in cancer immunotherapy. RESUME : Les lymphocytes «invariant Natural Killer T » (iNKT) forment une sous-population particulière de lymphocytes T reconnaissant des antigènes glycolipidiques présentés sur la molécule non-polymorphique CD1d, analogue aux protéines du complexe majeur d'histocompatibilité de classe I. Après activation avec le ligand de haute affinité α-galactosylceramide (αGalCer), les cellules iNKT produisent des grandes quantités de la cytokine pro-inflammatoire interferon gamma (IFN-γ) et activent les cellules du système immunitaire inné et acquis, telles que les cellules dendritiques (DC), NK et T. En conséquence, on a montré que les cellules iNKT exercent des activités anti-tumorales et la recherche s'est intéressée à la manipulation de ces cellules pour développer des thérapies anti-tumorales. Néanmoins, le désavantage majeur de l'αGalCer, injecté seul, est qu'une seule dose de ce ligand aboutit à une activation des cellules iNKT de courte durée suivie par un état anergique prolongé, limitant l'utilisation thérapeutique de ce glycolipide. En revanche, l'étude présentée ici démontre que, si l'αGalCer est chargé sur des molécules récombinantes soluble CD1d (αGalCer/sCDld), des injections répétées aboutissent à une activation prolongée des cellules iNKT et NK associée avec la sécrétion d'IFN-γ et la maturation des cellules DC. Plus important, si on fusionne la molécule αGalCer/sCD1d avec un fragment single-chain (scFv) de l'anticorps anti-HER2, on observe une importante inhibition de métastases expérimentales aux poumons et de tumeurs sous-cutanées même lorsque le traitement systémique est commencé 2 à 7 jours après la greffe des cellules de mélanome B16 transfectées avec l'antigène HER2. Dans les mêmes conditions le traitement avec l'αGalCer seul est inefficace. L'activité anti-tumorale de la protéine sCDld-anti-HER2 est associée à son accumulation spécifique dans des tumeurs exprimant le HER2 ainsi qu'avec une accumulation des cellules iNKT, NK et T à la tumeur. De plus, une immunisation active combinée avec le traitement sCD1d-anti-HER2 aboutit à une accumulation des lymphocytes T CD8 spécifiques de l'antigène d'immunisation, ceci exclusivement dans des tumeurs qui expriment l'antigène HER2. Cette combinaison résulte dans une activité anti-tumeur accrue. En conclusion, l'activation prolongée des cellules iNKT redirigées à la tumeur par des molécules recombinantes αGalCer/sCDld conduit à l'activation de la réponse innée et adaptative au site tumoral, offrant une nouvelle stratégie prometteuse d'immunothérapie contre le cancer. RESUME POUR UN LARGE PUBLIC : Le cancer est une cause majeure de décès dans le monde. Sur un total de 58 millions de décès enregistrés au niveau mondial en 2005, 7,6 millions (soit 13%) étaient dus au cancer. Les principaux traitements de nombreux cancers sont la chirurgie, en association avec la radiothérapie et la chimiothérapie. Néanmoins, ces traitements nuisent aussi aux cellules normales de notre corps et parfois, ils ne suffisent pas pour éliminer définitivement une tumeur. L'immunothérapie est l'une des nouvelles approches pour la lutte contre le cancer et elle vise à exploiter la spécificité du système immunitaire qui peut distinguer des cellules normales et tumorales. Une cellule exprimant un marqueur tumoral (antigène) peut être reconnue par le système immunitaire humoral (anticorps) et/ou cellulaire, induisant une réponse spécifique contre la tumeur. L'immunothérapie peut s'appuyer alors sur la perfusion d'anticorps monoclonaux dirigés contre des antigènes tumoraux, par exemple les anticorps dirigés contre les protéines oncogéniques Her-2/neu dans le cancer du sein. Ces anticorps ont le grand avantage de spécifiquement se localiser à la tumeur et d'induire la lyse ou d'inhiber la prolifération des cellules tumorales exprimant l'antigène. Aujourd'hui, six anticorps monoclonaux non-conjugés sont approuvés en clinique. Cependant l'efficacité de ces anticorps contre des tumeurs solides reste limitée et les traitements sont souvent combinés avec de la chimiothérapie. L'immunothérapie spécifique peut également être cellulaire et exploiter par immunisation active le développement de lymphocytes T cytotoxiques (CTL) capables de détruire spécifiquement les cellules malignes. De telles «vaccinations »sont actuellement testées en clinique, mais jusqu'à présent elles n'ont pas abouti aux résultats satisfaisants. Pour obtenir une réponse lymphocytaire T cytotoxique antitumorale, la cellule T doit reconnaître un antigène associé à la tumeur, présenté sous forme de peptide dans un complexe majeur d'histocompatibilité de classe I (CHM I). Cependant les cellules tumorales sont peu efficace dans la présentation d'antigène, car souvent elles se caractérisent par une diminution ou une absence d'expression des molécules d'histocompatibilité de classe I, et expriment peu ou pas de molécules d'adhésion et de cytokines costimulatrices. C'est en partie pourquoi, malgré l'induction de fortes réponses CTL spécifiquement dirigés contre des antigènes tumoraux, les régressions tumorales obtenus grâce à ces vaccinations sont relativement rares. Les lymphocytes «invariant Natural Killer T » (iNKT) forment une sous-population particulière de lymphocytes T reconnaissant des antigènes glycolipidiques présentés sur la molécule non-polymorphique CD1d, analogue aux protéines CMH I. Après activation avec le ligand de haute affinité α-galactosylceramide (αGalCer), les cellules iNKT produisent des grandes quantités de la cytokine pro-inflammatoire interferon gamma (IFN-γ) et activent les cellules du système immunitaire inné et acquis, telles que les cellules dendritiques (DC), NK et T. En conséquence, on a montré que les cellules iNKT exercent des activités anti-tumorales et la recherche s'est intéressée à la manipulation de ces cellules pour développer des thérapies anti-tumorales. Néanmoins, le désavantage majeur de l'αGalCer, injecté seul, est qu'une seule dose de ce ligand aboutit à une activation des cellules iNKT de courte durée suivie par un état anergique prolongé, limitant l'utilisation thérapeutique de ce glycolipide. Notre groupe de recherche a donc eu l'idée de développer une nouvelle approche thérapeutique où la réponse immunitaire des cellules iNKT serait prolongée et redirigée vers la tumeur par des anticorps monoclonaux. Concrètement, nous avons produit des molécules récombinantes soluble CD1d (sCD1d) qui, si elles sont chargés avec l'αGalCer (αGalCer/sCDld), aboutissent à une activation prolongée des cellules iNKT et NK associée avec la sécrétion d'IFN-γ et la maturation des cellules DC. Plus important, si la molécule αGalCer/sCD1d est fusionnée avec un fragment single-chain (scFv) de l'anticorps anti-HER2, la réponse immunitaire est redirigée à la tumeur pour autant que les cellules cancéreuses expriment l'antigène HER2. Les molécules αGalCer/sCDld ainsi présentées activent les lymphocytes iNKT. Avec cette stratégie, on observe une importante inhibition de métastases expérimentales aux poumons et de tumeurs sous-cutanées, même lorsque le traitement systémique est commencé 2 à 7 jours après la greffe des cellules de mélanome B16 transfectées avec l'antigène HER2. Dans les mêmes conditions le traitement avec l'αGalCer seul est inefficace. L'activité anti-tumorale de la protéine sCDld-anti-HER2 est associée à son accumulation spécifique dans des tumeurs exprimant le HER2 ainsi qu'avec une accumulation des cellules iNKT, NK et T à la tumeur. En conclusion, l'activation prolongée des cellules iNKT redirigées à la tumeur par des molécules récombinantes αGalCer/sCD1d conduit à l'activation de la réponse innée et adaptative au site tumoral, offrant une nouvelle stratégie prometteuse d'immunothérapie contre le cancer.