Detection and Classification of Whale Acoustic Signals

This dissertation focuses on two vital challenges in relation to whale acoustic signals: detection and classification.

In detection, we evaluated the influence of the uncertain ocean environment on the spectrogram-based detector, and derived the likelihood ratio of the proposed Short Time Fourier Transform detector. Experimental results showed that the proposed detector outperforms detectors based on the spectrogram. The proposed detector is more sensitive to environmental changes because it includes phase information.

In classification, our focus is on finding a robust and sparse representation of whale vocalizations. Because whale vocalizations can be modeled as polynomial phase signals, we can represent the whale calls by their polynomial phase coefficients. In this dissertation, we used the Weyl transform to capture chirp rate information, and used a two dimensional feature set to represent whale vocalizations globally. Experimental results showed that our Weyl feature set outperforms chirplet coefficients and MFCC (Mel Frequency Cepstral Coefficients) when applied to our collected data.

Since whale vocalizations can be represented by polynomial phase coefficients, it is plausible that the signals lie on a manifold parameterized by these coefficients. We also studied the intrinsic structure of high dimensional whale data by exploiting its geometry. Experimental results showed that nonlinear mappings such as Laplacian Eigenmap and ISOMAP outperform linear mappings such as PCA and MDS, suggesting that the whale acoustic data is nonlinear.

We also explored deep learning algorithms on whale acoustic data. We built each layer as convolutions with either a PCA filter bank (PCANet) or a DCT filter bank (DCTNet). With the DCT filter bank, each layer has different a time-frequency scale representation, and from this, one can extract different physical information. Experimental results showed that our PCANet and DCTNet achieve high classification rate on the whale vocalization data set. The word error rate of the DCTNet feature is similar to the MFSC in speech recognition tasks, suggesting that the convolutional network is able to reveal acoustic content of speech signals.

Data-Driven Motion Detection and Characterization in PET Brain Scans Using List Mode

Head motion during a Positron Emission Tomography (PET) brain scan can considerably degrade image quality. External motion-tracking devices have proven successful in minimizing this effect, but the associated time, maintenance, and workflow changes inhibit their widespread clinical use. List-mode PET acquisition allows for the retroactive analysis of coincidence events on any time scale throughout a scan, and therefore potentially offers a data-driven motion detection and characterization technique. An algorithm was developed to parse list-mode data, divide the full acquisition into short scan intervals, and calculate the line-of-response (LOR) midpoint average for each interval. These LOR midpoint averages, known as “radioactivity centroids,” were presumed to represent the center of the radioactivity distribution in the scanner, and it was thought that changes in this metric over time would correspond to intra-scan motion.

Several scans were taken of the 3D Hoffman brain phantom on a GE Discovery IQ PET/CT scanner to test the ability of the radioactivity to indicate intra-scan motion. Each scan incrementally surveyed motion in a different degree of freedom (2 translational and 2 rotational). The radioactivity centroids calculated from these scans correlated linearly to phantom positions/orientations. Centroid measurements over 1-second intervals performed on scans with ~1mCi of activity in the center of the field of view had standard deviations of 0.026 cm in the x- and y-dimensions and 0.020 cm in the z-dimension, which demonstrates high precision and repeatability in this metric. Radioactivity centroids are thus shown to successfully represent discrete motions on the submillimeter scale. It is also shown that while the radioactivity centroid can precisely indicate the amount of motion during an acquisition, it fails to distinguish what type of motion occurred.

Development of Plasmonic Nanoplatforms for Diagnostics, Therapy, and Sensing

Recent advances in nanotechnology have led to the application of nanoparticles in a wide variety of fields. In the field of nanomedicine, there is great emphasis on combining diagnostic and therapeutic modalities into a single nanoparticle construct (theranostics). In particular, anisotropic nanoparticles have shown great potential for surface-enhanced Raman scattering (SERS) detection due to their unique optical properties. Gold nanostars are a type of anisotropic nanoparticle with one of the highest SERS enhancement factors in a non-aggregated state. By utilizing the distinct characteristics of gold nanostars, new plasmonic materials for diagnostics, therapy, and sensing can be synthesized. The work described herein is divided into two main themes. The first half presents a novel, theranostic nanoplatform that can be used for both SERS detection and photodynamic therapy (PDT). The second half involves the rational design of silver-coated gold nanostars for increasing SERS signal intensity and improving reproducibility and quantification in SERS measurements.

The theranostic nanoplatforms consist of Raman-labeled gold nanostars coated with a silica shell. Photosensitizer molecules for PDT can be loaded into the silica matrix, while retaining the SERS signal of the gold nanostar core. SERS detection and PDT are performed at different wavelengths, so there is no interference between the diagnostic and therapeutic modalities. Singlet oxygen generation (a measure of PDT effectiveness) was demonstrated from the drug-loaded nanocomposites. In vitro testing with breast cancer cells showed that the nanoplatform could be successfully used for PDT. When further conjugating the nanoplatform with a cell-penetrating peptide (CPP), efficacy of both SERS detection and PDT is enhanced.

The rational design of plasmonic nanoparticles for SERS sensing involved the synthesis of silver-coated gold nanostars. Investigation of the silver coating process revealed that preservation of the gold nanostar tips was necessary to achieve the increased SERS intensity. At the optimal amount of silver coating, the SERS intensity is increased by over an order of magnitude. It was determined that a majority of the increased SERS signal can be attributed to reducing the inner filter effect, as the silver coating process moves the extinction of the particles far away from the laser excitation line. To improve reproducibility and quantitative SERS detection, an internal standard was incorporated into the particles. By embedding a small-molecule dye between the gold and silver surfaces, SERS signal was obtained both from the internal dye and external analyte on the particle surface. By normalizing the external analyte signal to the internal reference signal, reproducibility and quantitative analysis are improved in a variety of experimental conditions.