Development of a tool for the construction of "ground truth" for complex color images with text

Aquesta memoria resumeix el treball de final de carrera d’Enginyeria Superior d’Informàtica. Explicarà les principals raons que han motivat el projecte així com exemples que il·lustren l’aplicació resultant. En aquest cas el software intentarà resoldre la actual necessitat que hi ha de tenir dades de Ground Truth per als algoritmes de segmentació de text per imatges de color complexes. Tots els procesos seran explicats en els diferents capítols partint de la definició del problema, la planificació, els requeriments i el disseny fins a completar la il·lustració dels resultats del programa i les dades de Ground Truth resultants.

Détectabilité extra-fovéale sur des images anatomiques

Contexte¦- Les métastases hépatiques hypovasculaires sont parfois difficile à détecter car très polymorphiques et fréquemment irrégulières. Leurs contrastes sur CT scan hépatique sont souvent faibles.¦- Lors d'un diagnostic, le radiologue ne fixe pas sa vision fovéale sur chaque pixel de l'image. Les expériences de psychophysique avec eye-tracker montrent en effet que le radiologue se concentre sur quelques points spécifiques de l'image appelés fixations. Dans ce travail, nous nous intéresserons aux capacités de détection de l'oeil lorsque l'observateur effectue une saccade entre deux points de fixation. Plus particulièrement, nous nous intéresserons à caractériser les capacités de l'oeil à détecter les signaux se trouvant en dehors de sa vision fovéale, dans ce qu'on appelle, la vision périphérique.¦Objectifs¦- Caractériser l'effet de l'excentricité de la vision sur la détectabilité des contrastes dans le cas de métastases hépatiques hypovasculaires.¦- Récolter des données expérimentales en vue de créer un modèle mathématique qui permettra, à terme, de qualifier le système d'imagerie.¦- → objectifs du TM en soit :¦o prendre en main l'eyetracker¦o traduire une problématique médicale en une expérience scientifique reproductible, quantifiable et qualifiable.¦Méthode¦Nous effectuons une expérience 2AFC (2 Alternative Forced-Choice experiment) afin d'estimer la détectabilité du signal. Pour cela, nous forcerons l'observateur à maintenir son point de fixation à un endroit défini et vérifié par l'eye-tracker. La position del'excentricité du signal tumoral généré sur une coupe de CT hépatique sera le paramètre varié. L'observateur se verra présenté tour à tour deux coupes de CT hépatique, l'une comportant le signal tumoral standardisé et l'autre ne comportant pas le signal. L'observateur devra déterminer quelle image contient la pathologie avec la plus grande probabilité.¦- Cette expérience est un modèle simplifié de la réalité. En effet, le radiologue ne fixe pas un seul point lors de sa recherche mais effectue un "scanpath". Une seconde expérience, dite en free search sera effectuée dans la mesure du temps à disposition. Lors de cette expérience, le signal standardisé sera connu de l'observateur et il n'y aura plus de point de fixation forcée. L'eyetracker suivra le scanpath effectué par l'oeil de l'observateur lors de la recherche du signal sur une coupe de CT scan hépatique. L'intérêt de cette expérience réside dans l'observation de la corrélation entre les saccades et la découverte du signal. Elle permet aussi de vérifier les résultats obtenus lors de la première expérience.¦Résultats escomptés¦- Exp1 : Quantifier l'importance de l'excentricité en radiologie et aider à améliorer la performance de recherche.¦- Exp 2 : tester la validité des résultats obtenus par la première expérience.¦Plus value escomptée¦- Récolte de données pour créer un modèle mathématique capable de déterminer la qualité de l'image radiologique.¦- Possibilité d'extension à la recherche dans les trois dimensions du CT scan hépatique.

Estudi òptic dels minerals

El Grup Consolidat d’Innovació Docent de Mineralogia i òptica cristal·lina de la Universitat de Barcelona ha desenvolupat un CD interactiu que simula el funcionament d’un microscopi petrogràfic, per tal de facilitar a l’alumne un material d’autoaprenentatge, ha de servir per a reforçar els coneixements dels minerals formadors de roques en làmina prima. Aquest material te tres entrades diferents, en català, castellà i anglès. Cada mineral té una fitxa general amb les seves propietats òptiques i una complementaria amb les característiques cristal·logràfiques, camp d’estabilitat, diagrames de fases i característiques morfològiques del mineral a observar, les quals marquen els trets determinatius d’aquell mineral per tal de facilitar el seu reconeixement. Per tal de complementar les dades s’han introduït links directes amb la planes web: “webmineral” i “mindat” on hi ha les corresponents estructures i morfologies “interactives” de cadascun dels minerals que apareixen en el programa. En l’aplicació informàtica hi ha 169 filmacions corresponents a 43 dels principals minerals que formen les roques, una filmació correspon a la imatge només amb el polaritzador, i l'altre a la imatge amb el polaritzador més l'analitzador. Cadascuna d'aquestes imatges es presenta amb un gir de 360º; es pot aturar i després continuar girant, simulant el que veuríem al microscopi. D'aquesta manera es pot determinar el pleocroisme, la presència de macles, el color d'interferència i l'angle d'extinció.. S’ha intentat sempre que hi hagués diferents exemples d’un mateix mineral en diverses paragènesis. També s'incorpora una fitxa que l'usuari pot omplir amb les característiques texturals i òptiques del mineral agrupades segons les observacions que es fan, bé amb el polaritzador, amb el polaritzador i l'analitzador o bé amb les condicions específiques per veure la figura d'interferència i el signe òptic. Aquesta fitxa, un cop plena, es pot imprimir. En tot moment hi ha un menú d’ajuda on l’usuari pot remetre i fer la consulta adient per poder continuar.

Producció de material docent per a ciència de materials mitjançant microscòpia electrònica de rastreig i làser confocal

Aquest projecte s'ha realitzat al Servei de Microscòpia de la Universitat Autònoma de Barcelona, i ha tingut una durada de dos anys (2006-2008). La finalitat d’aquest projecte ha estat l’elaboració de material didàctic basat en la captació d’imatges i l’edició de recursos pedagògics de suport digital aplicats a la ciència de materials. Es pretén millorar així la qualitat docent de les pràctiques de diverses assignatures dels ensenyaments de Física i d’Enginyeria de Materials utilitzant tècniques d’anàlisi actuals com són la Microscòpia Electrònica de Rastreig (MER) i la Microscòpia Optica (MO). Amb aquest projecte es vol fomentar també el treball interdisciplinari en equip entre professionals (docents i tècnics superiors de recerca) i acostar la teoria de les assignatures a la realització pràctica, facilitant el suport digital necessari per aconseguir un màxim aprofitament a les aules. Les imatges de MER i MO ajudaran als alumnes a familiaritzar-se amb el món de la recerca i la indústria.

Three Generation Family With Pattern Dystrophy and a Successful Treatment of Subfoveal Cnv Related to Pattern Dystrophy With Anti-vegf Intravitreal Injections

Purpose: To phenotype a large 3 generation Swiss family with pattern dystrophy and to report a successful result of treatment with ranibizumab of a subfoveal choroidal neovascularisation (CNV) associated with pattern dystrophy in 1 patient Patients and methods: 4 affected and 3 unaffected patients (3 female 4 male, age range: 19 - 80 years) were assessed with a complete ophthalmologic examination. AF images were taken using Heidelberg Retina Angiograph and the digital color photos, fluorescein angiogragraphy (FFA) using the same TOPCON 501 camera. Electroretinogram (full-field and multifocal) was performed in 1 affected patient. One 48 years old patient developed a subfoveal CNV, which was treated with 2 injections of ranibizumab, at 3 months interval. Blood sample was taken for molecular analysis (screening of the gene RDS). Results: Two patients had a typical fundoscopic appearance of pattern dystrophy with butterfly shaped deposit at the fovea and some peripheral flecks, as shown with AF imaging.. Two others affected patients had a more unusual appearance with some macular atrophy in one or both eyes, surrounded by flecks. The visual acuity ranged from 1.0 to 0.1 according to Snellen EDTRS chart. The patient with subfoveal CNV presented a drop of vision form 1.0 to 0.6 within 10 days prior to the diagnosis and also reported some metamorphopsia. FFA and optical computerized tomography (OCT) confirmed a classic CNV. After the 1st injection her vision improved to 1.0 but persistent metamorphopsia and fluid on OCT motivated a second injection. One month after the second injection the OCT was flat and the patient had no symptoms. The results of RDS screening will be presented at the meeting. Conclusion: We present a family with pattern dystrophy, with some members having an unusual fundus appearance, which was mistaken for an early onset dry AMD. The AF imaging is a useful tool in diagnosing this condition. A CNV associated with pattern dystrophy a rare. This is the first report of a successful treatment of the CNV with anti-VEGF intravitreal injections.

Central and Cortical Gray Mater Segmentation of Magnetic Resonance Images of the Fetal Brain

Motivation. The study of human brain development in itsearly stage is today possible thanks to in vivo fetalmagnetic resonance imaging (MRI) techniques. Aquantitative analysis of fetal cortical surfacerepresents a new approach which can be used as a markerof the cerebral maturation (as gyration) and also forstudying central nervous system pathologies [1]. However,this quantitative approach is a major challenge forseveral reasons. First, movement of the fetus inside theamniotic cavity requires very fast MRI sequences tominimize motion artifacts, resulting in a poor spatialresolution and/or lower SNR. Second, due to the ongoingmyelination and cortical maturation, the appearance ofthe developing brain differs very much from thehomogenous tissue types found in adults. Third, due tolow resolution, fetal MR images considerably suffer ofpartial volume (PV) effect, sometimes in large areas.Today extensive efforts are made to deal with thereconstruction of high resolution 3D fetal volumes[2,3,4] to cope with intra-volume motion and low SNR.However, few studies exist related to the automatedsegmentation of MR fetal imaging. [5] and [6] work on thesegmentation of specific areas of the fetal brain such asposterior fossa, brainstem or germinal matrix. Firstattempt for automated brain tissue segmentation has beenpresented in [7] and in our previous work [8]. Bothmethods apply the Expectation-Maximization Markov RandomField (EM-MRF) framework but contrary to [7] we do notneed from any anatomical atlas prior. Data set &Methods. Prenatal MR imaging was performed with a 1-Tsystem (GE Medical Systems, Milwaukee) using single shotfast spin echo (ssFSE) sequences (TR 7000 ms, TE 180 ms,FOV 40 x 40 cm, slice thickness 5.4mm, in plane spatialresolution 1.09mm). Each fetus has 6 axial volumes(around 15 slices per volume), each of them acquired inabout 1 min. Each volume is shifted by 1 mm with respectto the previous one. Gestational age (GA) ranges from 29to 32 weeks. Mother is under sedation. Each volume ismanually segmented to extract fetal brain fromsurrounding maternal tissues. Then, in-homogeneityintensity correction is performed using [9] and linearintensity normalization is performed to have intensityvalues that range from 0 to 255. Note that due tointra-tissue variability of developing brain someintensity variability still remains. For each fetus, ahigh spatial resolution image of isotropic voxel size of1.09 mm is created applying [2] and using B-splines forthe scattered data interpolation [10] (see Fig. 1). Then,basal ganglia (BS) segmentation is performed on thissuper reconstructed volume. Active contour framework witha Level Set (LS) implementation is used. Our LS follows aslightly different formulation from well-known Chan-Vese[11] formulation. In our case, the LS evolves forcing themean of the inside of the curve to be the mean intensityof basal ganglia. Moreover, we add local spatial priorthrough a probabilistic map created by fitting anellipsoid onto the basal ganglia region. Some userinteraction is needed to set the mean intensity of BG(green dots in Fig. 2) and the initial fitting points forthe probabilistic prior map (blue points in Fig. 2). Oncebasal ganglia are removed from the image, brain tissuesegmentation is performed as described in [8]. Results.The case study presented here has 29 weeks of GA. Thehigh resolution reconstructed volume is presented in Fig.1. The steps of BG segmentation are shown in Fig. 2.Overlap in comparison with manual segmentation isquantified by the Dice similarity index (DSI) equal to0.829 (values above 0.7 are considered a very goodagreement). Such BG segmentation has been applied on 3other subjects ranging for 29 to 32 GA and the DSI hasbeen of 0.856, 0.794 and 0.785. Our segmentation of theinner (red and blue contours) and outer cortical surface(green contour) is presented in Fig. 3. Finally, torefine the results we include our WM segmentation in theFreesurfer software [12] and some manual corrections toobtain Fig.4. Discussion. Precise cortical surfaceextraction of fetal brain is needed for quantitativestudies of early human brain development. Our workcombines the well known statistical classificationframework with the active contour segmentation forcentral gray mater extraction. A main advantage of thepresented procedure for fetal brain surface extraction isthat we do not include any spatial prior coming fromanatomical atlases. The results presented here arepreliminary but promising. Our efforts are now in testingsuch approach on a wider range of gestational ages thatwe will include in the final version of this work andstudying as well its generalization to different scannersand different type of MRI sequences. References. [1]Guibaud, Prenatal Diagnosis 29(4) (2009). [2] Rousseau,Acad. Rad. 13(9), 2006, [3] Jiang, IEEE TMI 2007. [4]Warfield IADB, MICCAI 2009. [5] Claude, IEEE Trans. Bio.Eng. 51(4) (2004). [6] Habas, MICCAI (Pt. 1) 2008. [7]Bertelsen, ISMRM 2009 [8] Bach Cuadra, IADB, MICCAI 2009.[9] Styner, IEEE TMI 19(39 (2000). [10] Lee, IEEE Trans.Visual. And Comp. Graph. 3(3), 1997, [11] Chan, IEEETrans. Img. Proc, 10(2), 2001 [12] Freesurfer,http://surfer.nmr.mgh.harvard.edu.

Determination of chemical composition and its relationship with optical properties of Ti-N and Ti-V-N sputtered thin films

In the investigation of thin films of transition metal nitrides, an essential role is played by the accurate determination of their chemical composition. Actually the chemical composition depends on the deposition parameters and influences the optical properties. These relations are illustrated in thin films of TiNx and (Ti1-yVy)N-x deposited by reactive magnetron sputtering from composite targets of the elements. By variation of the nitrogen partial pressure and the target composition, different samples have been obtained. The chemical composition has been measured by electron probe microanalysis at low irradiation voltages. The optical properties are evaluated by ex-situ ellipsometry. Using the screened Drude model, they are correlated with the differences in composition. Adding vanadium or nitrogen in Ti-N is shown to have the same effect on the optical properties.

Line search multilevel optimization as computational methods for dense optical flow

We evaluate the performance of different optimization techniques developed in the context of optical flowcomputation with different variational models. In particular, based on truncated Newton methods (TN) that have been an effective approach for large-scale unconstrained optimization, we develop the use of efficient multilevel schemes for computing the optical flow. More precisely, we evaluate the performance of a standard unidirectional multilevel algorithm - called multiresolution optimization (MR/OPT), to a bidrectional multilevel algorithm - called full multigrid optimization (FMG/OPT). The FMG/OPT algorithm treats the coarse grid correction as an optimization search direction and eventually scales it using a line search. Experimental results on different image sequences using four models of optical flow computation show that the FMG/OPT algorithm outperforms both the TN and MR/OPT algorithms in terms of the computational work and the quality of the optical flow estimation.

Semi-supervised segmentation of ultrasound images based on patch representation and continuous min cut.

Ultrasound segmentation is a challenging problem due to the inherent speckle and some artifacts like shadows, attenuation and signal dropout. Existing methods need to include strong priors like shape priors or analytical intensity models to succeed in the segmentation. However, such priors tend to limit these methods to a specific target or imaging settings, and they are not always applicable to pathological cases. This work introduces a semi-supervised segmentation framework for ultrasound imaging that alleviates the limitation of fully automatic segmentation, that is, it is applicable to any kind of target and imaging settings. Our methodology uses a graph of image patches to represent the ultrasound image and user-assisted initialization with labels, which acts as soft priors. The segmentation problem is formulated as a continuous minimum cut problem and solved with an efficient optimization algorithm. We validate our segmentation framework on clinical ultrasound imaging (prostate, fetus, and tumors of the liver and eye). We obtain high similarity agreement with the ground truth provided by medical expert delineations in all applications (94% DICE values in average) and the proposed algorithm performs favorably with the literature.

Extent of Hypoattenuation On CT Angiography Source Images In Basilar Artery Occlusion: Prognostic Accuracy Of Posterior Circulation ASPECTS And The Pons-midbrain Score In The Basilar Artery International Cooperation Study

Background: The posterior circulation Acute Stroke Prognosis Early CT Score (pc-ASPECTS) and the combined Pons-midbrain score quantify the extent of early ischemic changes in the posterior circulation. We compared the prognostic accuracy of both scores if applied to CT angiography (CTA) source images (CTA-SI) of patients in the Basilar Artery International Cooperation Study (BASICS).Methods: BASICS was a prospective, observational, multi-centre, registry of consecutive patients who presented with acute symptomatic basilar artery occlusion (BAO). Functional outcome was assessed at 1 month. We applied pc-ASPECTS and the combined Pons-midbrain score to CTA-SI by 3-reader-consensus. Readers were blinded to clinical data. We performed multivariable logistic regression analysis, adjusting for thrombolysis, baseline NIHSS score and age, and used the output to derive ROC curves to compare the ability of both scores to discriminate patients with favourable (modified Rankin Scale [mRS] scores 0-3) from patients with unfavourable (mRS scores 4-6) functional outcome.Results: We reviewed CTAs of 158 patients (64% men, mean age 65 _ 15 years, median NIHSS score 25 [0-38], median GCS score 7 [3-15], median onset-to-CTA time 234 minutes [11-7380]). At 1 month, 40 (25%) patients had a favourable outcome, 49 (31%) had an unfavourable outcome (mRS score 4-5) and 69 (44%) were deceased. Both techniques of assessing CTA-SI hypoattenuation in the posterior circulation showed equally good discriminative value in predicting final outcome (C-statistics; area under ROC curve 0.74 versus 0.75, respectively; p_0.37). Pc-ASPECTS dichotomized at _6 versus _6 was an independent predictor of favourable functional outcome (RR _ 2.2; CI95 1.1-4.7; p _ 0.034).Conclusion: Compared to the combined Pons-midbrain score, the pc-ASPECTS score has similar prognostic accuracy to identify patients with a favourable functional outcome in BASICS. Dichotomized pc-ASPECTS (_6 versus _6) is an independent predictor of favourable functional outcome in this population. Author Disclosures: V. Puetz: None. A. Khomenko: None. M.D. Hill: None. I. Dzialowski: None. P. Michel: None. C. Weimar: None. C.A.C. Wijman: None. H. Mattle: None. K. Muir: None. T. Pfefferkorn: None. D. Tanne: None. S. Engelter: None. K. Szabo: None. A. Algra: None. A.M. Demchuk: None. W.J. Schonewille: None.

. Phenotype/genotype correlation associated with a novel nonsense Glu20stop mutation in the Rp2 gene in a three-generation family with x-linked retinitis pigmentosa

Purpose: To assess the phenotype of patients in a large 3 generation Swiss family with X-linked retinitis pigmentosa (XLRP) due to a novel nonsense mutation Glu20stop in RP2 gene and to correlate with the genotype. Methods: 6 affected patients (1 male, 5 females, age range: 23 - 73 years) were assessed with a complete ophthalmologic examination. All had fundus autofluorescence images, standardised electroretinography, Goldmann visual fields and Optical Coherence Tomography. In addition, medical records of 2 affected male patients were reviewed. Blood sample was taken for molecular analysis. Results: The male patients were severely affected at a young age with early macular involvement. The youngest 23 y old male had also high myopia and vision of less than 0.05 according to Snellen EDTRS chart bilaterally. All 5 female carriers had some degree of rod-cone dystrophy, but no macular involvement. The visual acuity was 1.0 in the younger carriers, while the 73 years old had VA of 0.5. Two females had mild myopia (range -0.75 to -2) and one had anisometropia of 3.5D, with the more severely affected eye being myopic. Three out of 5 female carriers had optic nerve drusen. Conclusions: We report a novel Glu20stop mutation in RP2 gene, which is a rare cause of XLRP. Our description of severe phenotype in male patients with high myopia and early macular atrophy confirms previous reports. Unlike previous reports, all our female carriers had RP, but not macular involvement or high myopia. The identifiable phenotype for RP2-XLRP aids in clinical diagnosis and targeted genetic screening.

Comparability of clinical wear measurements by optical 3D laser scanning in two different centers.

OBJECTIVE: The purpose of this study was to compare the use of different variables to measure the clinical wear of two denture tooth materials in two analysis centers. METHODS: Twelve edentulous patients were provided with full dentures. Two different denture tooth materials (experimental material and control) were placed randomly in accordance with the split-mouth design. For wear measurements, impressions were made after an adjustment phase of 1-2 weeks and after 6, 12, 18, and 24 months. The occlusal wear of the posterior denture teeth of 11 subjects was assessed in two study centers by use of plaster replicas and 3D laser-scanning methods. In both centers sequential scans of the occlusal surfaces were digitized and superimposed. Wear was described by use of four different variables. Statistical analysis was performed after log-transformation of the wear data by use of the Pearson and Lin correlation and by use of a mixed linear model. RESULTS: Mean occlusal vertical wear of the denture teeth after 24 months was between 120μm and 212μm, depending on wear variable and material. For three of the four variables, wear of the experimental material was statistically significantly less than that of the control. Comparison of the two study centers, however, revealed correlation of the wear variables was only moderate whereas strong correlation was observed among the different wear variables evaluated by each center. SIGNIFICANCE: Moderate correlation was observed for clinical wear measurements by optical 3D laser scanning in two different study centers. For the two denture tooth materials, wear measurements limited to the attrition zones led to the same qualitative assessment.