Hyperspectral Image Classification with Nonlinear Methods

This thesis introduces two related lines of study on classification of hyperspectral images with nonlinear methods. First, it describes a quantitative and systematic evaluation, by the author, of each major component in a pipeline for classifying hyperspectral images (HSI) developed earlier in a joint collaboration [23]. The pipeline, with novel use of nonlinear classification methods, has reached beyond the state of the art in classification accuracy on commonly used benchmarking HSI data [6], [13]. More importantly, it provides a clutter map, with respect to a predetermined set of classes, toward the real application situations where the image pixels not necessarily fall into a predetermined set of classes to be identified, detected or classified with.

The particular components evaluated are a) band selection with band-wise entropy spread, b) feature transformation with spatial filters and spectral expansion with derivatives c) graph spectral transformation via locally linear embedding for dimension reduction, and d) statistical ensemble for clutter detection. The quantitative evaluation of the pipeline verifies that these components are indispensable to high-accuracy classification.

Secondly, the work extends the HSI classification pipeline with a single HSI data cube to multiple HSI data cubes. Each cube, with feature variation, is to be classified of multiple classes. The main challenge is deriving the cube-wise classification from pixel-wise classification. The thesis presents the initial attempt to circumvent it, and discuss the potential for further improvement.

Excitation of highly conjugated (porphinato)palladium(II) and (porphinato)platinum(II) oligomers produces long-lived, triplet states at unit quantum yield that absorb strongly over broad spectral domains of the NIR.

Transient dynamical studies of bis[(5,5'-10,20-bis(2,6-bis(3,3-dimethylbutoxy)phenyl)porphinato)palladium(II)]ethyne (PPd(2)), 5,15-bis{[(5'-10,20-bis(2,6-bis(3,3-dimethylbutoxy)phenyl)porphinato)palladium(II)]ethynyl}(10,20-bis(2,6-bis(3,3-dimethylbutoxy)phenyl)porphinato)palladium(II) (PPd(3)), bis[(5,5'-10,20-bis(2,6-bis(3,3-dimethylbutoxy)phenyl)porphinato)platinum(II)]ethyne (PPt(2)), and 5,15-bis{[(5'-10,20-bis(2,6-bis(3,3-dimethylbutoxy)phenyl)porphinato)platinum(II)]ethynyl}(10,20-bis(2,6-bis(3,3-dimethylbutoxy)phenyl)porphinato)platinum(II) (PPt(3)) show that the electronically excited triplet states of these highly conjugated supermolecular chromophores can be produced at unit quantum yield via fast S(1) → T(1) intersystem crossing dynamics (τ(isc): 5.2-49.4 ps). These species manifest high oscillator strength T(1) → T(n) transitions over broad NIR spectral windows. The facts that (i) the electronically excited triplet lifetimes of these PPd(n) and PPt(n) chromophores are long, ranging from 5 to 50 μs, and (ii) the ground and electronically excited absorptive manifolds of these multipigment ensembles can be extensively modulated over broad spectral domains indicate that these structures define a new precedent for conjugated materials featuring low-lying π-π* electronically excited states for NIR optical limiting and related long-wavelength nonlinear optical (NLO) applications.

Identification of fluorescent beads using a coded aperture snapshot spectral imager.

We apply a coded aperture snapshot spectral imager (CASSI) to fluorescence microscopy. CASSI records a two-dimensional (2D) spectrally filtered projection of a three-dimensional (3D) spectral data cube. We minimize a convex quadratic function with total variation (TV) constraints for data cube estimation from the 2D snapshot. We adapt the TV minimization algorithm for direct fluorescent bead identification from CASSI measurements by combining a priori knowledge of the spectra associated with each bead type. Our proposed method creates a 2D bead identity image. Simulated fluorescence CASSI measurements are used to evaluate the behavior of the algorithm. We also record real CASSI measurements of a ten bead type fluorescence scene and create a 2D bead identity map. A baseline image from filtered-array imaging system verifies CASSI's 2D bead identity map.

Intraoperative spectral domain optical coherence tomography for vitreoretinal surgery.

We demonstrate in vivo human retinal imaging using an intraoperative microscope-mounted optical coherence tomography system (MMOCT). Our optomechanical design adapts an Oculus Binocular Indirect Ophthalmo Microscope (BIOM3), suspended from a Leica ophthalmic surgical microscope, with spectral domain optical coherence tomography (SD-OCT) scanning and relay optics. The MMOCT enables wide-field noncontact real-time cross-sectional imaging of retinal structure, allowing for SD-OCT augmented intrasurgical microscopy for intraocular visualization. We experimentally quantify the axial and lateral resolution of the MMOCT and demonstrate fundus imaging at a 20Hz frame rate.

Performance metrics of an optical spectral imaging system for intra-operative assessment of breast tumor margins.

As many as 20-70% of patients undergoing breast conserving surgery require repeat surgeries due to a close or positive surgical margin diagnosed post-operatively [1]. Currently there are no widely accepted tools for intra-operative margin assessment which is a significant unmet clinical need. Our group has developed a first-generation optical visible spectral imaging platform to image the molecular composition of breast tumor margins and has tested it clinically in 48 patients in a previously published study [2]. The goal of this paper is to report on the performance metrics of the system and compare it to clinical criteria for intra-operative tumor margin assessment. The system was found to have an average signal to noise ratio (SNR) >100 and <15% error in the extraction of optical properties indicating that there is sufficient SNR to leverage the differences in optical properties between negative and close/positive margins. The probe had a sensing depth of 0.5-2.2 mm over the wavelength range of 450-600 nm which is consistent with the pathologic criterion for clear margins of 0-2 mm. There was <1% cross-talk between adjacent channels of the multi-channel probe which shows that multiple sites can be measured simultaneously with negligible cross-talk between adjacent sites. Lastly, the system and measurement procedure were found to be reproducible when evaluated with repeated measures, with a low coefficient of variation (<0.11). The only aspect of the system not optimized for intra-operative use was the imaging time. The manuscript includes a discussion of how the speed of the system can be improved to work within the time constraints of an intra-operative setting.

A low-cost, portable, and quantitative spectral imaging system for application to biological tissues.

The ability of diffuse reflectance spectroscopy to extract quantitative biological composition of tissues has been used to discern tissue types in both pre-clinical and clinical cancer studies. Typically, diffuse reflectance spectroscopy systems are designed for single-point measurements. Clinically, an imaging system would provide valuable spatial information on tissue composition. While it is feasible to build a multiplexed fiber-optic probe based spectral imaging system, these systems suffer from drawbacks with respect to cost and size. To address these we developed a compact and low cost system using a broadband light source with an 8-slot filter wheel for illumination and silicon photodiodes for detection. The spectral imaging system was tested on a set of tissue mimicking liquid phantoms which yielded an optical property extraction accuracy of 6.40 +/- 7.78% for the absorption coefficient (micro(a)) and 11.37 +/- 19.62% for the wavelength-averaged reduced scattering coefficient (micro(s)').

3D refraction correction and extraction of clinical parameters from spectral domain optical coherence tomography of the cornea.

Capable of three-dimensional imaging of the cornea with micrometer-scale resolution, spectral domain-optical coherence tomography (SDOCT) offers potential advantages over Placido ring and Scheimpflug photography based systems for accurate extraction of quantitative keratometric parameters. In this work, an SDOCT scanning protocol and motion correction algorithm were implemented to minimize the effects of patient motion during data acquisition. Procedures are described for correction of image data artifacts resulting from 3D refraction of SDOCT light in the cornea and from non-idealities of the scanning system geometry performed as a pre-requisite for accurate parameter extraction. Zernike polynomial 3D reconstruction and a recursive half searching algorithm (RHSA) were implemented to extract clinical keratometric parameters including anterior and posterior radii of curvature, central cornea optical power, central corneal thickness, and thickness maps of the cornea. Accuracy and repeatability of the extracted parameters obtained using a commercial 859nm SDOCT retinal imaging system with a corneal adapter were assessed using a rigid gas permeable (RGP) contact lens as a phantom target. Extraction of these parameters was performed in vivo in 3 patients and compared to commercial Placido topography and Scheimpflug photography systems. The repeatability of SDOCT central corneal power measured in vivo was 0.18 Diopters, and the difference observed between the systems averaged 0.1 Diopters between SDOCT and Scheimpflug photography, and 0.6 Diopters between SDOCT and Placido topography.

Spectral structure of the pygmy dipole resonance.

High-sensitivity studies of E1 and M1 transitions observed in the reaction 138Ba(gamma,gamma{'}) at energies below the one-neutron separation energy have been performed using the nearly monoenergetic and 100% linearly polarized photon beams of the HIgammaS facility. The electric dipole character of the so-called "pygmy" dipole resonance was experimentally verified for excitations from 4.0 to 8.6 MeV. The fine structure of the M1 "spin-flip" mode was observed for the first time in N=82 nuclei.

Genetic Studies Identify Critical Biomarkers and Refine the Classification of Malignant Gliomas

Gliomagenesis is driven by a complex network of genetic alterations and while the glioma genome has been a focus of investigation for many years; critical gaps in our knowledge of this disease remain. The identification of novel molecular biomarkers remains a focus of the greater cancer community as a method to improve the consistency and accuracy of pathological diagnosis. In addition, novel molecular biomarkers are drastically needed for the identification of targets that may ultimately result in novel therapeutics aimed at improving glioma treatment. Through the identification of new biomarkers, laboratories will focus future studies on the molecular mechanisms that underlie glioma development. Here, we report a series of genomic analyses identifying novel molecular biomarkers in multiple histopathological subtypes of glioma and refine the classification of malignant gliomas. We have completed a large scale analysis of the WHO grade II-III astrocytoma exome and report frequent mutations in the chromatin modifier, alpha thalassemia mental retardation x-linked (ATRX), isocitrate dehydrogenase 1 and 2 (IDH1 and IDH2), and mutations in tumor protein 53 (TP53) as the most frequent genetic mutations in low grade astrocytomas. Furthermore, by analyzing the status of recurrently mutated genes in 363 brain tumors, we establish that highly recurrent gene mutational signatures are an effective tool in stratifying homogeneous patient populations into distinct groups with varying outcomes, thereby capable of predicting prognosis. Next, we have established mutations in the promoter of telomerase reverse transcriptase (TERT) as a frequent genetic event in gliomas and in tissues with low rates of self renewal. We identify TERT promoter mutations as the most frequently mutated gene in primary glioblastoma. Additionally, we show that TERT promoter mutations in combination with IDH1 and IDH2 mutations are able to delineate distinct clinical tumor cohorts and are capable of predicting median overall survival more effectively than standard histopathological diagnosis alone. Taken together, these data advance our understanding of the genetic alterations that underlie the transformation of glial cells into neoplasms and we provide novel genetic biomarkers and multi – gene mutational signatures that can be utilized to refine the classification of malignant gliomas and provide opportunity for improved diagnosis.