Visual analysis of image collections

Multidimensional Visualization techniques are invaluable tools for analysis of structured and unstructured data with variable dimensionality. This paper introduces PEx-Image-Projection Explorer for Images-a tool aimed at supporting analysis of image collections. The tool supports a methodology that employs interactive visualizations to aid user-driven feature detection and classification tasks, thus offering improved analysis and exploration capabilities. The visual mappings employ similarity-based multidimensional projections and point placement to layout the data on a plane for visual exploration. In addition to its application to image databases, we also illustrate how the proposed approach can be successfully employed in simultaneous analysis of different data types, such as text and images, offering a common visual representation for data expressed in different modalities.

The Queensland Cancer Physics Collaborative and the Quantitative Biomedical Imaging & Characterisation (Q-BIC) Research Group

a presentation about immersive visualised simulation systems, image analysis and GPGPU Techonology

3D Wavelet-based Fusion Techniques for Biomedical Imaging

Hoy en día las técnicas de adquisición de imágenes tridimensionales son comunes en diversas áreas, pero cabe destacar la relevancia que han adquirido en el ámbito de la imagen biomédica, dentro del cual encontramos una amplia gama de técnicas como la microscopía confocal, microscopía de dos fotones, microscopía de fluorescencia mediante lámina de luz, resonancia magnética nuclear, tomografía por emisión de positrones, tomografía de coherencia óptica, ecografía 3D y un largo etcétera. Un denominador común de todas esas aplicaciones es la constante necesidad por aumentar la resolución y la calidad de las imágenes adquiridas. En algunas de dichas técnicas de imagen tridimensional se da una interesante situación: aunque que cada volumen adquirido no contiene información suficiente para representar el objeto bajo estudio dentro de los parámetros de calidad requeridos por algunas aplicaciones finales, el esquema de adquisición permite la obtención de varios volúmenes que representan diferentes vistas de dicho objeto, de tal forma que cada una de las vistas proporciona información complementaria acerca del mismo. En este tipo de situación es posible, mediante la combinación de varias de esas vistas, obtener una mejor comprensión del objeto que a partir de cada una de ellas por separado. En el contexto de esta Tesis Doctoral se ha propuesto, desarrollado y validado una nueva metodología de proceso de imágenes basada en la transformada wavelet disc¬reta para la combinación, o fusión, de varias vistas con información complementaria de un mismo objeto. El método de fusión propuesto aprovecha la capacidad de descom¬posición en escalas y orientaciones de la transformada wavelet discreta para integrar en un solo volumen toda la información distribuida entre el conjunto de vistas adquiridas. El trabajo se centra en dos modalidades diferentes de imagen biomédica que per¬miten obtener tales adquisiciones multi-vista. La primera es una variante de la micro¬scopía de fluorescencia, la microscopía de fluorescencia mediante lámina de luz, que se utiliza para el estudio del desarrollo temprano de embriones vivos en diferentes modelos animales, como el pez cebra o el erizo de mar. La segunda modalidad es la resonancia magnética nuclear con realce tardío, que constituye una valiosa herramienta para evaluar la viabilidad del tejido miocárdico en pacientes con diversas miocardiopatías. Como parte de este trabajo, el método propuesto ha sido aplicado y validado en am¬bas modalidades de imagen. En el caso de la aplicación a microscopía de fluorescencia, los resultados de la fusión muestran un mejor contraste y nivel de detalle en comparación con cualquiera de las vistas individuales y el método no requiere de conocimiento previo acerca la función de dispersión puntual del sistema de imagen. Además, los resultados se han comparado con otros métodos existentes. Con respecto a la aplicación a imagen de resonancia magnética con realce tardío, los volúmenes fusionados resultantes pre-sentan una mejora cuantitativa en la nitidez de las estructuras relevantes y permiten una interpretación más sencilla y completa de la compleja estructura tridimensional del tejido miocárdico en pacientes con cardiopatía isquémica. Para ambas aplicaciones los resultados de esta tesis se encuentran actualmente en uso en los centros clínicos y de investigación con los que el autor ha colaborado durante este trabajo. Además se ha puesto a libre disposición de la comunidad científica la implementación del método de fusión propuesto. Por último, se ha tramitado también una solicitud de patente internacional que cubre el método de visualización desarrollado para la aplicación de Resonancia Magnética Nuclear. Abstract Nowadays three dimensional imaging techniques are common in several fields, but es-pecially in biomedical imaging, where we can find a wide range of techniques including: Laser Scanning Confocal Microscopy, Laser Scanning Two Photon Microscopy, Light Sheet Fluorescence Microscopy, Magnetic Resonance Imaging, Positron Emission To-mography, Optical Coherence Tomography, 3D Ultrasound Imaging, etc. A common denominator of all those applications being the constant need for further increasing resolution and quality of the acquired images. Interestingly, in some of the mentioned three-dimensional imaging techniques a remarkable situation arises: while a single volume does not contain enough information to represent the object being imaged within the quality parameters required by the final application, the acquisition scheme allows recording several volumes which represent different views of a given object, with each of the views providing complementary information. In this kind of situation one can get a better understanding of the object by combining several views instead of looking at each of them separately. Within such context, in this PhD Thesis we propose, develop and test new image processing methodologies based on the discrete wavelet transform for the combination, or fusion, of several views containing complementary information of a given object. The proposed fusion method exploits the scale and orientation decomposition capabil¬ities of the discrete wavelet transform to integrate in a single volume all the available information distributed among the set of acquired views. The work focuses in two different biomedical imaging modalities which provide such multi-view datasets. The first one is a particular fluorescence microscopy technique, Light-Sheet Fluorescence Microscopy, used for imaging and gaining understanding of the early development of live embryos from different animal models (like zebrafish or sea urchin). The second is Delayed Enhancement Magnetic Resonance Imaging, which is a valuable tool for assessing the viability of myocardial tissue on patients suffering from different cardiomyopathies. As part of this work, the proposed method was implemented and then validated on both imaging modalities. For the fluorescence microscopy application, the fusion results show improved contrast and detail discrimination when compared to any of the individual views and the method does not rely on prior knowledge of the system’s point spread function (PSF). Moreover, the results have shown improved performance with respect to previous PSF independent methods. With respect to its application to Delayed Enhancement Magnetic Resonance Imaging, the resulting fused volumes show a quantitative sharpness improvement and enable an easier and more complete interpretation of complex three-dimensional scar and heterogeneous tissue information in ischemic cardiomyopathy patients. In both applications, the results of this thesis are currently in use in the clinical and research centers with which the author collaborated during his work. An imple¬mentation of the fusion method has also been made freely available to the scientific community. Finally, an international patent application has been filed covering the visualization method developed for the Magnetic Resonance Imaging application.

Corneal topography with Scheimpflug imaging and videokeratography : comparative study of normal eyes

PURPOSE: To compare the repeatability within anterior corneal topography measurements and agreement between measurements with the Pentacam HR rotating Scheimpflug camera and with a previously validated Placido disk–based videokeratoscope (Medmont E300). ------ SETTING: Contact Lens and Visual Optics Laboratory, School of Optometry, Queensland University of Technology, Brisbane, Queensland, Australia. ----- METHODS: Normal eyes in 101 young adult subjects had corneal topography measured using the Scheimpflug camera (6 repeated measurements) and videokeratoscope (4 repeated measurements). The best-fitting axial power corneal spherocylinder was calculated and converted into power vectors. Corneal higher-order aberrations (HOAs) (up to the 8th Zernike order) were calculated using the corneal elevation data from each instrument. ----- RESULTS: Both instruments showed excellent repeatability for axial power spherocylinder measurements (repeatability coefficients <0.25 diopter; intraclass correlation coefficients >0.9) and good agreement for all power vectors. Agreement between the 2 instruments was closest when the mean of multiple measurements was used in analysis. For corneal HOAs, both instruments showed reasonable repeatability for most aberration terms and good correlation and agreement for many aberrations (eg, spherical aberration, coma, higher-order root mean square). For other aberrations (eg, trefoil and tetrafoil), the 2 instruments showed relatively poor agreement. ----- CONCLUSIONS: For normal corneas, the Scheimpflug system showed excellent repeatability and reasonable agreement with a previously validated videokeratoscope for the anterior corneal axial curvature best-fitting spherocylinder and several corneal HOAs. However, for certain aberrations with higher azimuthal frequencies, the Scheimpflug system had poor agreement with the videokeratoscope; thus, caution should be used when interpreting these corneal aberrations with the Scheimpflug system.

Simultaneous magnetic resonance imaging and consolidation measurement of articular cartilage

Magnetic resonance imaging (MRI) offers the opportunity to study biological tissues and processes in a non-disruptive manner. The technique shows promise for the study of the load-bearing performance (consolidation) of articular cartilage and changes in articular cartilage accompanying osteoarthritis. Consolidation of articular cartilage involves the recording of two transient characteristics: the change over time of strain and the hydrostatic excess pore pressure (HEPP). MRI study of cartilage consolidation under mechanical load is limited by difficulties in measuring the HEPP in the presence of the strong magnetic fields associated with the MRI technique. Here we describe the use of MRI to image and characterize bovine articular cartilage deforming under load in an MRI compatible consolidometer while monitoring pressure with a Fabry-Perot interferometer-based fiber-optic pressure transducer.

Magnetic resonance imaging: An accurate, radiation-free, alternative to computed tomography for the primary imaging and three-dimensional reconstruction of the bony orbit

Purpose: To determine the extent to which the accuracy of magnetic resonance imaging (MRI) based virtual 3-dimensional (3D) models of the intact orbit can approach that of the gold standard, computed tomography (CT) based models. The goal was to determine whether MRI is a viable alternative to CT scans in patients with isolated orbital fractures and penetrating eye injuries, pediatric patients, and patients requiring multiple scans in whom radiation exposure is ideally limited. Materials and Methods: Patients who presented with unilateral orbital fractures to the Royal Brisbane and Women’s Hospital from March 2011 to March 2012 were recruited to participate in this cross-sectional study. The primary predictor variable was the imaging technique (MRI vs CT). The outcome measurements were orbital volume (primary outcome) and geometric intraorbital surface deviations (secondary outcome)between the MRI- and CT-based 3D models. Results: Eleven subjects (9 male) were enrolled. The patients’ mean age was 30 years. On average, the MRI models underestimated the orbital volume of the CT models by 0.50 0.19 cm3 . The average intraorbital surface deviation between the MRI and CT models was 0.34 0.32 mm, with 78 2.7% of the surface within a tolerance of 0.5 mm. Conclusions: The volumetric differences of the MRI models are comparable to reported results from CT models. The intraorbital MRI surface deviations are smaller than the accepted tolerance for orbital surgical reconstructions. Therefore, the authors believe that MRI is an accurate radiation-free alternative to CT for the primary imaging and 3D reconstruction of the bony orbit. �

Medical imaging and Biomechanical analysis of scoliosis progression in the growing adolescent spine

Progression of spinal deformity in children was studied with Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) to identify how gravity affects the deformity and to determine the full three-dimensional character of the deformity. The CT study showed that gravity is significant in deformity progression in some patients which has implications for clinical patient management. The world first MRI study showed that the standard clinical measure used to define the extent of the deformity is inadequate and further use of three-dimensional MRI should be considered by spinal surgeons.

Diffusion indices on magnetic resonance imaging and neuropsychological performance in amnestic mild cognitive impairment

Background: Magnetic resonance diffusion tensor imaging (DTI) shows promise in the early detection of microstructural pathophysiological changes in the brain. Objectives: To measure microstructural differences in the brains of participants with amnestic mild cognitive impairment (MCI) compared with an age-matched control group using an optimised DTI technique with fully automated image analysis tools and to investigate the correlation between diffusivity measurements and neuropsychological performance scores across groups. Methods: 34 participants (17 participants with MCI, 17 healthy elderly adults) underwent magnetic resonance imaging (MRI)-based DTI. To control for the effects of anatomical variation, diffusion images of all participants were registered to standard anatomical space. Significant statistical differences in diffusivity measurements between the two groups were determined on a pixel-by-pixel basis using gaussian random field theory. Results: Significantly raised mean diffusivity measurements (p<0.001) were observed in the left and right entorhinal cortices (BA28), posterior occipital-parietal cortex (BA18 and BA19), right parietal supramarginal gyrus (BA40) and right frontal precentral gyri (BA4 and BA6) in participants with MCI. With respect to fractional anisotropy, participants with MCI had significantly reduced measurements (p<0.001) in the limbic parahippocampal subgyral white matter, right thalamus and left posterior cingulate. Pearson's correlation coefficients calculated across all participants showed significant correlations between neuropsychological assessment scores and regional measurements of mean diffusivity and fractional anisotropy. Conclusions: DTI-based diffusivity measures may offer a sensitive method of detecting subtle microstructural brain changes associated with preclinical Alzheimer's disease.

Lateralization of temporal lobe epilepsy based on resting-state functional magnetic resonance imaging and machine learning

Lateralization of temporal lobe epilepsy (TLE) is critical for successful outcome of surgery to relieve seizures. TLE affects brain regions beyond the temporal lobes and has been associated with aberrant brain networks, based on evidence from functional magnetic resonance imaging. We present here a machine learning-based method for determining the laterality of TLE, using features extracted from resting-state functional connectivity of the brain. A comprehensive feature space was constructed to include network properties within local brain regions, between brain regions, and across the whole network. Feature selection was performed based on random forest and a support vector machine was employed to train a linear model to predict the laterality of TLE on unseen patients. A leave-one-patient-out cross validation was carried out on 12 patients and a prediction accuracy of 83% was achieved. The importance of selected features was analyzed to demonstrate the contribution of resting-state connectivity attributes at voxel, region, and network levels to TLE lateralization.

In vivo velocity vector imaging and time-resolved strain rate measurements in the wall of blood vessels using MRI

In this paper, we present a new approach for velocity vector imaging and time-resolved measurements of strain rates in the wall of human arteries using MRI and we prove its feasibility on two examples: in vitro on a phantom and in vivo on the carotid artery of a human subject. Results point out the promising potential of this approach for investigating the mechanics of arterial tissues in vivo.

Correlation of carotid atheromatous plaque inflammation with biomechanical stress: Utility of USPIO enhanced MR imaging and finite element analysis

Objective: The aim of this study was to explore whether there is a relationship between the degree of MR-defined inflammation using ultra small super-paramagnetic iron oxide (USPIO) particles, and biomechanical stress using finite element analysis (FEA) techniques, in carotid atheromatous plaques. Methods and Results: 18 patients with angiographically proven carotid stenoses underwent multi-sequence MR imaging before and 36 h after USPIO infusion. T2 * weighted images were manually segmented into quadrants and the signal change in each quadrant normalised to adjacent muscle was calculated after USPIO administration. Plaque geometry was obtained from the rest of the multi-sequence dataset and used within a FEA model to predict maximal stress concentration within each slice. Subsequently, a new statistical model was developed to explicitly investigate the form of the relationship between biomechanical stress and signal change. The Spearman's rank correlation coefficient for USPIO enhanced signal change and maximal biomechanical stress was -0.60 (p = 0.009). Conclusions: There is an association between biomechanical stress and USPIO enhanced MR-defined inflammation within carotid atheroma, both known risk factors for plaque vulnerability. This underlines the complex interaction between physiological processes and biomechanical mechanisms in the development of carotid atheroma. However, this is preliminary data that will need validation in a larger cohort of patients.

Facile Synthesis and Visualization of Janus Double-Brush Copolymers

Well-defined double-brush copolymers with each graft site carrying a polystyrene (PSt) graft and a polylactide (PLA) graft were synthesized by simultaneous reversible addition fragmentation chain transfer (RAFT) and ring-opening polymerization (ROP) processes, followed by ring-opening metathesis polymerization (ROMP) "grafting through" of the resulting diblock macromonomer (MM). Their Janus-type 1 morphologies were detected by transmission electron microscopy (TEM) imaging after thermal annealing to facilitate the intramolecular self-assembly of PSt and PLA grafts. This finding provides critical evidence to verify double-brush copolymers as Janus nanomaterials.

Prostate cancer radiotherapy: potential applications of metal nanoparticles for imaging and therapy

Prostate cancer (CaP) is the most commonly diagnosed cancer in males. There have been dramatic technical advances in radiotherapy delivery, enabling higher doses of radiotherapy to primary cancer, involved lymph nodes and oligometastases with acceptable normal tissue toxicity. Despite this, many patients relapse following primary radical therapy, and novel treatment approaches are required. Metal nanoparticles are agents that promise to improve diagnostic imaging and image-guided radiotherapy and to selectively enhance radiotherapy effectiveness in CaP. We summarize current radiotherapy treatment approaches for CaP and consider pre-clinical and clinical evidence for metal nanoparticles in this condition.

Prostate cancer (CaP) is the most commonly diagnosed cancer in males and is responsible for more than 10,000 deaths each year in the UK.1 Technical advances in radiotherapy delivery, including image-guided intensity-modulated radiotherapy (IG-IMRT), have enabled the delivery of higher radiation dose to the prostate, which has led to improved biochemical control. Further improvements in cancer imaging during radiotherapy are being developed with the advent of MRI simulators and MRI linear accelerators.2–4

Nanotechnology promises to deliver significant advancements across numerous disciplines.5 The widest scope of applications are from the biomedical field including exogenous gene/drug delivery systems, advanced biosensors, targeted contrast agents for diagnostic applications and as direct therapeutic agents used in combination with existing treatment modalities.6–11 This diversity of application is especially evident within cancer research, with a myriad of experimental anticancer strategies currently under investigation.

This review will focus specifically on the potential of metal-based nanoparticles to augment the efficacy of radiotherapy in CaP, a disease where radiotherapy constitutes a major curative treatment modality.12 Furthermore, we will also address the clinical state of the art for CaP radiotherapy and consider how these treatments could be best combined with nanotherapeutics to improve cancer outcomes.

Human red blood cells at work: identification and visualization of erythrocytic eNOS activity in health and disease

A nitric oxide synthase (NOS)-like activity has been demonstrated in human red blood cells (RBCs), but doubts about its functional significance, isoform identity and disease relevance remain. Using flow cytometry in combination with the NO-imaging probe DAF-FM we find that all blood cells form NO intracellularly, with a rank order of monocytes > neutrophils > lymphocytes > RBCs > platelets. The observation of a NO-related fluorescence within RBCs was unexpected given the abundance of the NO-scavenger oxyhemoglobin. Constitutive normoxic NO formation was abolished by NOS inhibition and intracellular NO scavenging, confirmed by laser-scanning microscopy and unequivocally validated by detection of the DAF-FM reaction product with NO using HPLC and LC-MS/MS. Employing immunoprecipitation, ESI-MS/MS-based peptide sequencing and enzymatic assay we further demonstrate that human RBCs contain an endothelial NOS (eNOS) that converts L-3H-Arginine to L-3H-Citrulline in a Ca2+/Calmodulin-dependent fashion. Moreover, in patients with coronary artery disease, red cell eNOS expression and activity are both lower than in age-matched healthy individuals and correlate with the degree of endothelial dysfunction. Thus, human RBCs constitutively produce NO under normoxic conditions via an active eNOS isoform the activity of which is compromised in patients with coronary artery disease.