Visual analysis of image collections

Multidimensional Visualization techniques are invaluable tools for analysis of structured and unstructured data with variable dimensionality. This paper introduces PEx-Image-Projection Explorer for Images-a tool aimed at supporting analysis of image collections. The tool supports a methodology that employs interactive visualizations to aid user-driven feature detection and classification tasks, thus offering improved analysis and exploration capabilities. The visual mappings employ similarity-based multidimensional projections and point placement to layout the data on a plane for visual exploration. In addition to its application to image databases, we also illustrate how the proposed approach can be successfully employed in simultaneous analysis of different data types, such as text and images, offering a common visual representation for data expressed in different modalities.

3D Wavelet-based Fusion Techniques for Biomedical Imaging

Hoy en día las técnicas de adquisición de imágenes tridimensionales son comunes en diversas áreas, pero cabe destacar la relevancia que han adquirido en el ámbito de la imagen biomédica, dentro del cual encontramos una amplia gama de técnicas como la microscopía confocal, microscopía de dos fotones, microscopía de fluorescencia mediante lámina de luz, resonancia magnética nuclear, tomografía por emisión de positrones, tomografía de coherencia óptica, ecografía 3D y un largo etcétera. Un denominador común de todas esas aplicaciones es la constante necesidad por aumentar la resolución y la calidad de las imágenes adquiridas. En algunas de dichas técnicas de imagen tridimensional se da una interesante situación: aunque que cada volumen adquirido no contiene información suficiente para representar el objeto bajo estudio dentro de los parámetros de calidad requeridos por algunas aplicaciones finales, el esquema de adquisición permite la obtención de varios volúmenes que representan diferentes vistas de dicho objeto, de tal forma que cada una de las vistas proporciona información complementaria acerca del mismo. En este tipo de situación es posible, mediante la combinación de varias de esas vistas, obtener una mejor comprensión del objeto que a partir de cada una de ellas por separado. En el contexto de esta Tesis Doctoral se ha propuesto, desarrollado y validado una nueva metodología de proceso de imágenes basada en la transformada wavelet disc¬reta para la combinación, o fusión, de varias vistas con información complementaria de un mismo objeto. El método de fusión propuesto aprovecha la capacidad de descom¬posición en escalas y orientaciones de la transformada wavelet discreta para integrar en un solo volumen toda la información distribuida entre el conjunto de vistas adquiridas. El trabajo se centra en dos modalidades diferentes de imagen biomédica que per¬miten obtener tales adquisiciones multi-vista. La primera es una variante de la micro¬scopía de fluorescencia, la microscopía de fluorescencia mediante lámina de luz, que se utiliza para el estudio del desarrollo temprano de embriones vivos en diferentes modelos animales, como el pez cebra o el erizo de mar. La segunda modalidad es la resonancia magnética nuclear con realce tardío, que constituye una valiosa herramienta para evaluar la viabilidad del tejido miocárdico en pacientes con diversas miocardiopatías. Como parte de este trabajo, el método propuesto ha sido aplicado y validado en am¬bas modalidades de imagen. En el caso de la aplicación a microscopía de fluorescencia, los resultados de la fusión muestran un mejor contraste y nivel de detalle en comparación con cualquiera de las vistas individuales y el método no requiere de conocimiento previo acerca la función de dispersión puntual del sistema de imagen. Además, los resultados se han comparado con otros métodos existentes. Con respecto a la aplicación a imagen de resonancia magnética con realce tardío, los volúmenes fusionados resultantes pre-sentan una mejora cuantitativa en la nitidez de las estructuras relevantes y permiten una interpretación más sencilla y completa de la compleja estructura tridimensional del tejido miocárdico en pacientes con cardiopatía isquémica. Para ambas aplicaciones los resultados de esta tesis se encuentran actualmente en uso en los centros clínicos y de investigación con los que el autor ha colaborado durante este trabajo. Además se ha puesto a libre disposición de la comunidad científica la implementación del método de fusión propuesto. Por último, se ha tramitado también una solicitud de patente internacional que cubre el método de visualización desarrollado para la aplicación de Resonancia Magnética Nuclear. Abstract Nowadays three dimensional imaging techniques are common in several fields, but es-pecially in biomedical imaging, where we can find a wide range of techniques including: Laser Scanning Confocal Microscopy, Laser Scanning Two Photon Microscopy, Light Sheet Fluorescence Microscopy, Magnetic Resonance Imaging, Positron Emission To-mography, Optical Coherence Tomography, 3D Ultrasound Imaging, etc. A common denominator of all those applications being the constant need for further increasing resolution and quality of the acquired images. Interestingly, in some of the mentioned three-dimensional imaging techniques a remarkable situation arises: while a single volume does not contain enough information to represent the object being imaged within the quality parameters required by the final application, the acquisition scheme allows recording several volumes which represent different views of a given object, with each of the views providing complementary information. In this kind of situation one can get a better understanding of the object by combining several views instead of looking at each of them separately. Within such context, in this PhD Thesis we propose, develop and test new image processing methodologies based on the discrete wavelet transform for the combination, or fusion, of several views containing complementary information of a given object. The proposed fusion method exploits the scale and orientation decomposition capabil¬ities of the discrete wavelet transform to integrate in a single volume all the available information distributed among the set of acquired views. The work focuses in two different biomedical imaging modalities which provide such multi-view datasets. The first one is a particular fluorescence microscopy technique, Light-Sheet Fluorescence Microscopy, used for imaging and gaining understanding of the early development of live embryos from different animal models (like zebrafish or sea urchin). The second is Delayed Enhancement Magnetic Resonance Imaging, which is a valuable tool for assessing the viability of myocardial tissue on patients suffering from different cardiomyopathies. As part of this work, the proposed method was implemented and then validated on both imaging modalities. For the fluorescence microscopy application, the fusion results show improved contrast and detail discrimination when compared to any of the individual views and the method does not rely on prior knowledge of the system’s point spread function (PSF). Moreover, the results have shown improved performance with respect to previous PSF independent methods. With respect to its application to Delayed Enhancement Magnetic Resonance Imaging, the resulting fused volumes show a quantitative sharpness improvement and enable an easier and more complete interpretation of complex three-dimensional scar and heterogeneous tissue information in ischemic cardiomyopathy patients. In both applications, the results of this thesis are currently in use in the clinical and research centers with which the author collaborated during his work. An imple¬mentation of the fusion method has also been made freely available to the scientific community. Finally, an international patent application has been filed covering the visualization method developed for the Magnetic Resonance Imaging application.

Modeling and visualization of medical anesthesiology acts

Dissertação para obtenção do Grau de Mestre em Engenharia Informática

Ligamentous and tendinous anatomy of the intermetacarpal and common carpometacarpal joints: evaluation with MR imaging and MR arthrography.

PURPOSE: The purpose of this work was to demonstrate the normal ligamentous and tendinous anatomy of the intermetacarpal (IMC) and common carpometacarpal (CCMC) joints with MRI and MR arthrography. METHOD: MR images of 22 wrists derived from fresh human cadavers were obtained before and after arthrography. The MR imaging features of the ligaments and tendons about the CCMC and IMC joints and the joints themselves were analyzed in a randomized fashion and correlated with those seen on anatomic sections. RESULTS: Six CCMC ligaments were visualized. The dorsal and palmar CCMC ligaments and the pisometacarpal ligament were best visualized in the sagittal plane. The radial and ulnar CCMC collateral ligaments and the capito-third metacarpal ligament were best visualized in the coronal plane. Three main IMC ligaments were observed: a dorsal and a palmar ligament and an interosseous ligament complex. All three ligaments were best visualized in the axial plane. Four tendinous insertions to the metacarpal bases were evident. CONCLUSION: The anatomy of the ligaments and tendinous insertions about the second to fifth IMC and the CCMC joints is well demonstrated by MR imaging and MR arthrography. MR arthrography does not significantly improve the visualization of these complex structures.

Human red blood cells at work: identification and visualization of erythrocytic eNOS activity in health and disease

A nitric oxide synthase (NOS)-like activity has been demonstrated in human red blood cells (RBCs), but doubts about its functional significance, isoform identity and disease relevance remain. Using flow cytometry in combination with the NO-imaging probe DAF-FM we find that all blood cells form NO intracellularly, with a rank order of monocytes > neutrophils > lymphocytes > RBCs > platelets. The observation of a NO-related fluorescence within RBCs was unexpected given the abundance of the NO-scavenger oxyhemoglobin. Constitutive normoxic NO formation was abolished by NOS inhibition and intracellular NO scavenging, confirmed by laser-scanning microscopy and unequivocally validated by detection of the DAF-FM reaction product with NO using HPLC and LC-MS/MS. Employing immunoprecipitation, ESI-MS/MS-based peptide sequencing and enzymatic assay we further demonstrate that human RBCs contain an endothelial NOS (eNOS) that converts L-3H-Arginine to L-3H-Citrulline in a Ca2+/Calmodulin-dependent fashion. Moreover, in patients with coronary artery disease, red cell eNOS expression and activity are both lower than in age-matched healthy individuals and correlate with the degree of endothelial dysfunction. Thus, human RBCs constitutively produce NO under normoxic conditions via an active eNOS isoform the activity of which is compromised in patients with coronary artery disease.

Integration of merged delayed-enhanced magnetic resonance imaging and multidetector computed tomography for the guidance of ventricular tachycardia ablation: a pilot study

BACKGROUND Delayed enhancement (DE) MRI can assess the fibrotic substrate of scar-related VT. MDCT has the advantage of inframillimetric spatial resolution and better 3D reconstructions. We sought to evaluate the feasibility and usefulness of integrating merged MDCT/MRI data in 3D-mapping systems for structure-function assessment and multimodal guidance of VT mapping and ablation. METHODS Nine patients, including 3 ischemic cardiomyopathy (ICM), 3 nonischemic cardiomyopathy (NICM), 2 myocarditis, and 1 redo procedure for idiopathic VT, underwent MRI and MDCT before VT ablation. Merged MRI/MDCT data were integrated in 3D-mapping systems and registered to high-density endocardial and epicardial maps. Low-voltage areas (<1.5 mV) and local abnormal ventricular activities (LAVA) during sinus rhythm were correlated to DE at MRI, and wall-thinning (WT) at MDCT. RESULTS Endocardium and epicardium were mapped with 391 ± 388 and 1098 ± 734 points per map, respectively. Registration of MDCT allowed visualization of coronary arteries during epicardial mapping/ablation. In the idiopathic patient, integration of MRI data identified previously ablated regions. In ICM patients, both DE at MRI and WT at MDCT matched areas of low voltage (overlap 94 ± 6% and 79 ± 5%, respectively). In NICM patients, wall-thinning areas matched areas of low voltage (overlap 63 ± 21%). In patients with myocarditis, subepicardial DE matched areas of epicardial low voltage (overlap 92 ± 12%). A total number of 266 LAVA sites were found in 7/9 patients. All LAVA sites were associated to structural substrate at imaging (90% inside, 100% within 18 mm). CONCLUSION The integration of merged MDCT and DEMRI data is feasible and allows combining substrate assessment with high-spatial resolution to better define structure-function relationship in scar-related VT.

The imaging and dosimetric capabilities of a CT/MR-suitable, anatomically adaptive, shielded intracavitary brachytherapy applicator for the treatment of cervical cancer

Introduction. Investigations into the shortcomings of current intracavitary brachytherapy (ICBT) technology has lead us to design an Anatomically Adaptive Applicator (A3). The goal of this work was to design and characterize the imaging and dosimetric capabilities of this device. The A3 design incorporates a single shield that can both rotate and translate within the colpostat. We hypothesized that this feature, coupled with specific A3 component construction materials and imaging techniques, would facilitate artifact-free CT and MR image acquisition. In addition, by shaping the delivered dose distribution via the A3 movable shield, dose delivered to the rectum will be less compared to equivalent treatments utilizing current state-of-the-art ICBT applicators. ^ Method and materials. A method was developed to facilitate an artifact-free CT imaging protocol that used a "step-and-shoot" technique: pausing the scanner midway through the scan and moving the A 3 shield out of the path of the beam. The A3 CT imaging capabilities were demonstrated acquiring images of a phantom that positioned the A3 and FW applicators in a clinically-applicable geometry. Artifact-free MRI imaging was achieved by utilizing MRI-compatible ovoid components and pulse-sequences that minimize susceptibility artifacts. Artifacts were qualitatively compared, in a clinical setup. For the dosimetric study, Monte-Carlo (MC) models of the A3 and FW (shielded and unshielded) applicators were validated. These models were incorporated into a MC model of one cervical cancer patient ICBT insertion, using 192Ir (mHDR v2 source). The A3 shield's rotation and translation was adjusted for each dwell position to minimize dose to the rectum. Superposition of dose to rectum for all A3 dwell sources (4 per ovoid) was applied to obtain a comparison of equivalent FW treatments. Rectal dose-volume histograms (absolute and HDR/PDR biologically effective dose (BED)) and BED to 2 cc (BED2cc ) were determined for all applicators and compared. ^ Results. Using a "step-and-shoot" CT scanning method and MR compliant materials and optimized pulse-sequences, images of the A 3 were nearly artifact-free for both modalities. The A3 reduced BED2cc by 18.5% and 7.2% for a PDR treatment and 22.4% and 8.7% for a HDR treatment compared to treatments delivered using an uFW and sFW applicator, respectively. ^ Conclusions. The novel design of the A3 facilitated nearly artifact-free image quality for both CT and MR clinical imaging protocols. The design also facilitated a reduction in BED to the rectum compared to equivalent ICBT treatments delivered using current, state-of-the-art applicators. ^

Iis--integrated Interactome System: A Web-based Platform For The Annotation, Analysis And Visualization Of Protein-metabolite-gene-drug Interactions By Integrating A Variety Of Data Sources And Tools.

High-throughput screening of physical, genetic and chemical-genetic interactions brings important perspectives in the Systems Biology field, as the analysis of these interactions provides new insights into protein/gene function, cellular metabolic variations and the validation of therapeutic targets and drug design. However, such analysis depends on a pipeline connecting different tools that can automatically integrate data from diverse sources and result in a more comprehensive dataset that can be properly interpreted. We describe here the Integrated Interactome System (IIS), an integrative platform with a web-based interface for the annotation, analysis and visualization of the interaction profiles of proteins/genes, metabolites and drugs of interest. IIS works in four connected modules: (i) Submission module, which receives raw data derived from Sanger sequencing (e.g. two-hybrid system); (ii) Search module, which enables the user to search for the processed reads to be assembled into contigs/singlets, or for lists of proteins/genes, metabolites and drugs of interest, and add them to the project; (iii) Annotation module, which assigns annotations from several databases for the contigs/singlets or lists of proteins/genes, generating tables with automatic annotation that can be manually curated; and (iv) Interactome module, which maps the contigs/singlets or the uploaded lists to entries in our integrated database, building networks that gather novel identified interactions, protein and metabolite expression/concentration levels, subcellular localization and computed topological metrics, GO biological processes and KEGG pathways enrichment. This module generates a XGMML file that can be imported into Cytoscape or be visualized directly on the web. We have developed IIS by the integration of diverse databases following the need of appropriate tools for a systematic analysis of physical, genetic and chemical-genetic interactions. IIS was validated with yeast two-hybrid, proteomics and metabolomics datasets, but it is also extendable to other datasets. IIS is freely available online at: http://www.lge.ibi.unicamp.br/lnbio/IIS/.

Study Of The Homogeneity Of Drug Loaded In Polymeric Films Using Near-infrared Chemical Imaging And Split-plot Design.

Split-plot design (SPD) and near-infrared chemical imaging were used to study the homogeneity of the drug paracetamol loaded in films and prepared from mixtures of the biocompatible polymers hydroxypropyl methylcellulose, polyvinylpyrrolidone, and polyethyleneglycol. The study was split into two parts: a partial least-squares (PLS) model was developed for a pixel-to-pixel quantification of the drug loaded into films. Afterwards, a SPD was developed to study the influence of the polymeric composition of films and the two process conditions related to their preparation (percentage of the drug in the formulations and curing temperature) on the homogeneity of the drug dispersed in the polymeric matrix. Chemical images of each formulation of the SPD were obtained by pixel-to-pixel predictions of the drug using the PLS model of the first part, and macropixel analyses were performed for each image to obtain the y-responses (homogeneity parameter). The design was modeled using PLS regression, allowing only the most relevant factors to remain in the final model. The interpretation of the SPD was enhanced by utilizing the orthogonal PLS algorithm, where the y-orthogonal variations in the design were separated from the y-correlated variation.

Detection Of Explosives On The Surface Of Banknotes By Raman Hyperspectral Imaging And Independent Component Analysis.

The aim of this study was to develop a methodology using Raman hyperspectral imaging and chemometric methods for identification of pre- and post-blast explosive residues on banknote surfaces. The explosives studied were of military, commercial and propellant uses. After the acquisition of the hyperspectral imaging, independent component analysis (ICA) was applied to extract the pure spectra and the distribution of the corresponding image constituents. The performance of the methodology was evaluated by the explained variance and the lack of fit of the models, by comparing the ICA recovered spectra with the reference spectra using correlation coefficients and by the presence of rotational ambiguity in the ICA solutions. The methodology was applied to forensic samples to solve an automated teller machine explosion case. Independent component analysis proved to be a suitable method of resolving curves, achieving equivalent performance with the multivariate curve resolution with alternating least squares (MCR-ALS) method. At low concentrations, MCR-ALS presents some limitations, as it did not provide the correct solution. The detection limit of the methodology presented in this study was 50μgcm(-2).

Abnormally increased iron concentration in basal ganglia in Shy-Drager syndrome MR imaging and autonomic study: RM imagem e estudo autonômico

Report of an early case of Shy-Drager syndrome in a 67 year-old woman patient. Autonomic failure was diagnosed by functional evaluation as well as laboratory tests. MR imaging disclosed a prominent putamina hypodensity in T2-weighted images at high field strength due to iron increased depositing in this basal ganglia. MR imaging evidences confirm Shy-Drager syndrome diagnosis, and contributes for differential diagnosis of idiopathic hypotension (pure autonomic failure) in special in SDS early cases.

Integration and visualization of systems biology data in context of the genome

Background: High-density tiling arrays and new sequencing technologies are generating rapidly increasing volumes of transcriptome and protein-DNA interaction data. Visualization and exploration of this data is critical to understanding the regulatory logic encoded in the genome by which the cell dynamically affects its physiology and interacts with its environment. Results: The Gaggle Genome Browser is a cross-platform desktop program for interactively visualizing high-throughput data in the context of the genome. Important features include dynamic panning and zooming, keyword search and open interoperability through the Gaggle framework. Users may bookmark locations on the genome with descriptive annotations and share these bookmarks with other users. The program handles large sets of user-generated data using an in-process database and leverages the facilities of SQL and the R environment for importing and manipulating data. A key aspect of the Gaggle Genome Browser is interoperability. By connecting to the Gaggle framework, the genome browser joins a suite of interconnected bioinformatics tools for analysis and visualization with connectivity to major public repositories of sequences, interactions and pathways. To this flexible environment for exploring and combining data, the Gaggle Genome Browser adds the ability to visualize diverse types of data in relation to its coordinates on the genome. Conclusions: Genomic coordinates function as a common key by which disparate biological data types can be related to one another. In the Gaggle Genome Browser, heterogeneous data are joined by their location on the genome to create information-rich visualizations yielding insight into genome organization, transcription and its regulation and, ultimately, a better understanding of the mechanisms that enable the cell to dynamically respond to its environment.

Post-processing and visualization techniques in 2D boundary element analysis

Most post-processors for boundary element (BE) analysis use an auxiliary domain mesh to display domain results, working against the profitable modelling process of a pure boundary discretization. This paper introduces a novel visualization technique which preserves the basic properties of the boundary element methods. The proposed algorithm does not require any domain discretization and is based on the direct and automatic identification of isolines. Another critical aspect of the visualization of domain results in BE analysis is the effort required to evaluate results in interior points. In order to tackle this issue, the present article also provides a comparison between the performance of two different BE formulations (conventional and hybrid). In addition, this paper presents an overview of the most common post-processing and visualization techniques in BE analysis, such as the classical algorithms of scan line and the interpolation over a domain discretization. The results presented herein show that the proposed algorithm offers a very high performance compared with other visualization procedures.

Denisiuk-type reflection holography display with sillenite crystals for imaging and interferometry of small objects

A novel setup for imaging and interferometry through reflection holography with Bi12TiPO20(BTO) sillenite photorefractive crystals is proposed. A variation of the lensless Denisiuk arrangement was developed resulting in a compact, robust and simple interferometer. A red He-Ne laser was used as light source and the holographic recording occurred by diffusion with the grating vector parallel to the crystal [0 0 1]-axis. In order to enhance the holographic image quality and reduce noise a polarizing beam splitter (PBS) was positioned at the BTO input and the crystal was tilted around the [0 0 1]-axis. This enabled the orthogonally polarized transmission and diffracted beams to be separated by the PBS, providing the holographic image only. The possibility of performing deformation and strain analysis as well as vibration measurement of small objects was demonstrated. (C) 2007 Elsevier B.V. All rights reserved.