Efficient topology estimation for large scale optical mapping

Large scale image mosaicing methods are in great demand among scientists who study different aspects of the seabed, and have been fostered by impressive advances in the capabilities of underwater robots in gathering optical data from the seafloor. Cost and weight constraints mean that lowcost Remotely operated vehicles (ROVs) usually have a very limited number of sensors. When a low-cost robot carries out a seafloor survey using a down-looking camera, it usually follows a predetermined trajectory that provides several non time-consecutive overlapping image pairs. Finding these pairs (a process known as topology estimation) is indispensable to obtaining globally consistent mosaics and accurate trajectory estimates, which are necessary for a global view of the surveyed area, especially when optical sensors are the only data source. This thesis presents a set of consistent methods aimed at creating large area image mosaics from optical data obtained during surveys with low-cost underwater vehicles. First, a global alignment method developed within a Feature-based image mosaicing (FIM) framework, where nonlinear minimisation is substituted by two linear steps, is discussed. Then, a simple four-point mosaic rectifying method is proposed to reduce distortions that might occur due to lens distortions, error accumulation and the difficulties of optical imaging in an underwater medium. The topology estimation problem is addressed by means of an augmented state and extended Kalman filter combined framework, aimed at minimising the total number of matching attempts and simultaneously obtaining the best possible trajectory. Potential image pairs are predicted by taking into account the uncertainty in the trajectory. The contribution of matching an image pair is investigated using information theory principles. Lastly, a different solution to the topology estimation problem is proposed in a bundle adjustment framework. Innovative aspects include the use of fast image similarity criterion combined with a Minimum spanning tree (MST) solution, to obtain a tentative topology. This topology is improved by attempting image matching with the pairs for which there is the most overlap evidence. Unlike previous approaches for large-area mosaicing, our framework is able to deal naturally with cases where time-consecutive images cannot be matched successfully, such as completely unordered sets. Finally, the efficiency of the proposed methods is discussed and a comparison made with other state-of-the-art approaches, using a series of challenging datasets in underwater scenarios

Optical Design for Automatic Identification and Portable Systems

This thesis proposes design methods and test tools, for optical systems, which may be used in an industrial environment, where not only precision and reliability but also ease of use is important. The approach to the problem has been conceived to be as general as possible, although in the present work, the design of a portable device for automatic identification applications has been studied, because this doctorate has been funded by Datalogic Scanning Group s.r.l., a world-class producer of barcode readers. The main functional components of the complete device are: electro-optical imaging, illumination and pattern generator systems. For what concerns the electro-optical imaging system, a characterization tool and an analysis one has been developed to check if the desired performance of the system has been achieved. Moreover, two design tools for optimizing the imaging system have been implemented. The first optimizes just the core of the system, the optical part, improving its performance ignoring all other contributions and generating a good starting point for the optimization of the whole complex system. The second tool optimizes the system taking into account its behavior with a model as near as possible to reality including optics, electronics and detection. For what concerns the illumination and the pattern generator systems, two tools have been implemented. The first allows the design of free-form lenses described by an arbitrary analytical function exited by an incoherent source and is able to provide custom illumination conditions for all kind of applications. The second tool consists of a new method to design Diffractive Optical Elements excited by a coherent source for large pattern angles using the Iterative Fourier Transform Algorithm. Validation of the design tools has been obtained, whenever possible, comparing the performance of the designed systems with those of fabricated prototypes. In other cases simulations have been used.

OPTiSPIM: integrating optical projection tomography in light sheet microscopy extends specimen characterization to nonfluorescent contrasts.

Mesoscopic 3D imaging has become a widely used optical imaging technique to visualize intact biological specimens. Selective plane illumination microscopy (SPIM) visualizes samples up to a centimeter in size with micrometer resolution by 3D data stitching but is limited to fluorescent contrast. Optical projection tomography (OPT) works with fluorescent and nonfluorescent contrasts, but its resolution is limited in large samples. We present a hybrid setup (OPTiSPIM) combining the advantages of each technique. The combination of fluorescent and nonfluorescent high-resolution 3D data into integrated datasets enables a more extensive representation of mesoscopic biological samples. The modular concept of the OPTiSPIM facilitates incorporation of the transmission OPT modality into already established light sheet based imaging setups.

Annexin A5-Conjugated Polymeric Micelles For Dual SPECT and Optical Detection of Apoptosis

Apoptosis, a form of programmed cell death, is critical to homoeostasis, normal development, and physiology. Dysregulation of apoptosis can lead to the accumulation of unwanted cells, such as occurs in cancer, and the removal of needed cells or disorders of normal tissues, such as heart, neurodegenerative, and autoimmune diseases. Noninvasive detection of apoptosis may play an important role in the evaluation of disease states and response to therapeutic intervention for a variety of diseases. It is desirable to have an imaging method to accurately detect and monitor this process in patients. In this study, we developed annexin A5-conjugated polymeric micellar nanoparticles dual-labeled with a near-infrared fluorescence fluorophores (Cy7) and a radioisotope (111In), named as 111In-labeled annexin A5-CCPM. In vitro studies demonstrated that annexin A5-CCPM could strongly and specifically bind to apoptotic cells. In vivo studies showed that apoptotic tissues could be clearly visualized by both single photon emission computed tomography (SPECT) and fluorescence molecular tomography (FMT) after intravenous injection of 111In-labeled Annexin A5-CCPM in 6 different apoptosis models. In contrast, there was little signal in respective healthy tissues. All the biodistribution data confirmed imaging results. Moreover, histological analysis revealed that radioactivity count correlated with fluorescence signal from the nanoparticles, and both signals co-localized with the region of apoptosis. In sum, 111In-labeled annexin A5-CCPM allowed visualization of apoptosis by both nuclear and optical imaging techniques. The complementary information acquired with multiple imaging techniques should be advantageous in improving diagnostics and management of patients.

APPLICATIONS OF EPHB4 RECEPTOR SPECIFIC PEPTIDES IN TARGETED CANCER IMAGING AND THERAPY

EphB4 receptors, a member of the largest family of receptor tyrosine kinases, are found over-expressed in a variety of tumors cells including glioma cells as well as angiogenic blood vessels. Noninvasive imaging of EphB4 could potentially increase early detection rates, monitor response to therapy directed against EphB4, and improve patient outcomes. Targeted delivery of EphB4 receptor specific peptide conjugated hollow gold nanoshells (HAuNS) into tumors has great potential in cancer imaging and photothermal therapy. In this study, we developed an EphB4 specific peptide named TNYL-RAW and labeled with radioisotope 64Cu and Cy5.5 dye. We also conjugate this specific peptide with hollow gold nanoshells (HAuNS) to evaluate targeted photothermal therapy of cancers. In vitro, 64Cu-DOTA-TNYL- RAW specifically bind to CT26 and PC-3M cells but not to A549 cells. In vivo, Small-animal PET/CT clearly showed the significant uptake of 64Cu-DOTA-TNYL-RAW in CT26 and PC-3M tumors but not in A549 tumors. Furthermore, µPET/CT and near-infrared optical imaging clearly showed the uptake of the dual labeled TNYL-RAW peptide in both U251 and U87 tumors in the brains of nude mice. In U251 tumors, Cy5.5-labeled peptide can bind to EphB4-expressing tumor blood vessels and tumors cells. But in U87 models, dual labeled peptide only could bind to tumor associated blood vessels. Also, Irradiation of PC-3M and CT-26 cell treated with TNYL-PEG-HAuNS nanopatilces with near-infrared (NIR) laser resulted in selective destruction of these cells in vitro. EphB4 targeted TNYL-PEG-HAuNS showed more photothermal killing effect on CT26 tumor model than PEG-HAuNS did. In summary, tumors with overexpression of EphB4 receptors can be noninvasively visualized by micro PET/CT with 64Cu labeled or dual labeled TNYL-RAW peptide. Targeted delivery of TNYL-RAW conjugated HAuNS into tumors can greatly improve the treatment effect of photothermal therapy. The information acquired with this study should be advantageous in improving diagnostics and future applications in photothermal ablation therapy in clinical.

Noninvasive functional optical spectroscopy of human breast tissue

Near infrared diffuse optical spectroscopy and diffuse optical imaging are promising methods that eventually may enhance or replace existing technologies for breast cancer screening and diagnosis. These techniques are based on highly sensitive, quantitative measurements of optical and functional contrast between healthy and diseased tissue. In this study, we examine whether changes in breast physiology caused by exogenous hormones, aging, and fluctuations during the menstrual cycle result in significant alterations in breast tissue optical contrast. A noninvasive quantitative diffuse optical spectroscopy technique, frequency-domain photon migration, was used. Measurements were performed on 14 volunteer subjects by using a hand-held probe. Intrinsic tissue absorption and reduced scattering parameters were calculated from frequency-domain photon migration data. Wavelength-dependent absorption (at 674, 803, 849, and 956 nm) was used to determine tissue concentration of oxyhemoglobin, deoxyhemoglobin, total hemoglobin, tissue hemoglobin oxygen saturation, and bulk water content. Results show significant and dramatic differences in optical properties between menopausal states. Average premenopausal intrinsic tissue absorption and reduced scattering values at each wavelength are 2.5- to 3-fold higher and 16–28% greater, respectively, than absorption and scattering for postmenopausal subjects. Absorption and scattering properties for women using hormone replacement therapy are intermediate between premenopausal and postmenopausal populations. Physiological properties show differences in mean total hemoglobin (7.0 μM, 11.8 μM, and 19.2 μM) and water concentration relative to pure water (10.9%, 15.3%, and 27.3%) for postmenopausal, hormone replacement therapy, and premenopausal subjects, respectively. Because of their unique, quantitative information content, diffuse optical methods may play an important role in breast diagnostics and improving our understanding of breast disease.

Subthreshold facilitation and suppression in primary visual cortex revealed by intrinsic signal imaging.

Neurons in primary visual cortex (area 17) respond vigorously to oriented stimuli within their receptive fields; however, stimuli presented outside the suprathreshold receptive field can also influence their responses. Here we describe a fundamental feature of the spatial interaction between suprathreshold center and subthreshold surround. By optical imaging of intrinsic signals in area 17 in response to a stimulus border, we show that a given stimulus generates activity primarily in iso-orientation domains, which extend for several millimeters across the cortical surface in a manner consistent with the architecture of long-range horizontal connections in area 17. By mapping the receptive fields of single neurons and imaging responses from the same cortex to stimuli that include or exclude the aggregate suprathreshold receptive field, we show that intrinsic signals strongly reveal the subthreshold surround contribution. Optical imaging and single-unit recording both demonstrate that the relative contrast of center and surround stimuli regulates whether surround interactions are facilitative or suppressive: the same surround stimulus facilitates responses when center contrast is low, but suppresses responses when center contrast is high. Such spatial interactions in area 17 are ideally suited to contribute to phenomena commonly regarded as part of "higher-level" visual processing, such as perceptual "popout" and "filling-in."

Quantitative long-term imaging of the functional representation of a whisker in rat barrel cortex.

In this study, we implement chronic optical imaging of intrinsic signals in rat barrel cortex and repeatedly quantify the functional representation of a single whisker over time. The success of chronic imaging for more than 1 month enabled an evaluation of the normal dynamic range of this sensory representation. In individual animals for a period of several weeks, we found that: (i) the average spatial extent of the quantified functional representation of whisker C2 is surprisingly large--1.71 mm2 (area at half-height); (ii) the location of the functional representation is consistent; and (iii) there are ongoing but nonsystematic changes in spatiotemporal characteristics such as the size, shape, and response amplitude of the functional representation. These results support a modified description of the functional organization of barrel cortex, where although a precisely located module corresponds to a specific whisker, this module is dynamic, large, and overlaps considerably with the modules of many other whiskers.

Statistics of single-electron signals in electron-multiplying charge-coupled devices

Electron-multiplying charge coupled devices promise to revolutionize ultrasensitive optical imaging. The authors present a simple methodology allowing reliable measurement of camera characteristics and statistics of single-electron events, compare the measurements to a simple theoretical model, and report camera performance in a truly photon-counting regime that eliminates the excess noise related to fluctuations of the multiplication gain.

Development of tumour imaging and therapy strategies utilising unengineered bacteria

The ability of systemically administered bacteria to target and replicate to high numbers within solid tumours is well established. Tumour localising bacteria can be exploited as biological vehicles for the delivery of nucleic acid, protein or therapeutic payloads to tumour sites and present researchers with a highly targeted and safe vehicle for tumour imaging and cancer therapy. This work aimed to utilise bacteria to activate imaging probes or prodrugs specifically within target tissue in order to facilitate the development of novel imaging and therapeutic strategies. The vast majority of existing bacterial-mediated cancer therapy strategies rely on the use of bacteria that have been genetically modified (GM) to express genes of interest. While these approaches have been shown to be effective in a preclinical setting, GM presents extra regulatory hurdles in a clinical context. Also, many strains of bacteria are not genetically tractably and hence cannot currently be engineered to express genes of interest. For this reason, the development of imaging and therapeutic systems that utilise unengineered bacteria for the activation of probes or drugs represents a significant improvement on the current gold standard. Endogenously expressed bacterial enzymes that are not found in mammalian cells can be used for the targeted activation of imaging probes or prodrugs whose activation is only achieved in the presence of these enzymes. Exploitation of the intrinsic enzymatic activity of bacteria allows the use of a wider range of bacteria and presents a more clinically relevant system than those that are currently in use. The nitroreductase (NTR) enzymes, found only in bacteria, represent one such option. Chapter 2 introduces the novel concept of utilising native bacterial NTRs for the targeted activation of the fluorophore CytoCy5S. Bacterial-mediated probe activation allowed for non-invasive fluorescence imaging of in vivo bacteria in models of infection and cancer. Chapter 3 extends the concept of using native bacterial enzymes to activate a novel luminescent, NTR activated probe. The use of luminescence based imaging improved the sensitivity of the system and provides researchers with a more accessible modality for preclinical imaging. It also represents an improvement over existing caged luciferin probe systems described to date. Chapter 4 focuses on the employment of endogenous bacterial enzymes for use in a therapeutic setting. Native bacterial enzymatic activity (including NTR enzymes) was shown to be capable of activating multiple prodrugs, in isolation and in combination, and eliciting therapeutic responses in murine models of cancer. Overall, the data presented in this thesis advance the fields of bacterial therapy and imaging and introduce novel strategies for disease diagnosis and treatment. These preclinical studies demonstrate potential for clinical translation in multiple fields of research and medicine.

Optical Access Engine Setup and Validation

The optical access engine integrated with the diagnostic and optical measurement techniques is a great platform for engine research because it provides clear visual access to the combustion chamber inside the engines. An optical access engine customized based on a 4-cylinder spark ignited direct injection (SIDI) production engine is located in the Advanced Power Systems Laboratories (APS LABS) at Michigan Technological University. This optical access engine inside the test cell has been set up for different engine research. In this report, two SAE papers in engine research utilizing the optical access engine are reviewed to gain basic understanding of the methodology. Though the optical engine in APS LABS is a little bit different from the engines used in the literature, the methodology in the papers provides guidelines for engine research through optical access engines. In addition, the optical access engine instrumentation including the test cell setup and the optical engine setup is described in detail in the report providing a solid record for later troubleshooting and reference. Finally, the motoring tests, firing tests and optical imaging experiment on the optical engine have been performed to validate the instrumentation. This report only describes so far the instrumentation of the optical engine in the APS LABS by April 2015.

A search for thermally emitting isolated neutron stars in the 2XMMp catalogue

The relatively large number of nearby radio-quiet and thermally emitting isolated neutron stars (INSs) discovered in the ROSAT All-Sky Survey, dubbed the ""Magnificent Seven"", suggests that they belong to a formerly neglected major component of the overall INS population. So far, attempts to discover similar INSs beyond the solar vicinity failed to confirm any reliable candidate. The good positional accuracy and soft X-ray sensitivity of the EPIC cameras onboard the XMM-Newton satellite allow us to efficiently search for new thermally emitting INSs. We used the 2XMMp catalogue to select sources with no catalogued candidate counterparts and with X-ray spectra similar to those of the Magnificent Seven, but seen at greater distances and thus undergoing higher interstellar absorptions. Identifications in more than 170 astronomical catalogues and visual screening allowed us to select fewer than 30 good INS candidates. In order to rule out alternative identifications, we obtained deep ESO-VLT and SOAR optical imaging for the X-ray brightest candidates. We report here on the optical follow-up results of our search and discuss the possible nature of 8 of our candidates. A high X-ray-to-optical flux ratio together with a stable flux and soft X-ray spectrum make the brightest source of our sample, 2XMM J104608.7-594306, a newly discovered thermally emitting INS. The X-ray source 2XMM J010642.3+005032 has no evident optical counterpart and should be further investigated. The remaining X-ray sources are most probably identified with cataclysmic variables and active galactic nuclei, as inferred from the colours and flux ratios of their likely optical counterparts. Beyond the finding of new thermally emitting INSs, our study aims at constraining the space density of this Galactic population at great distances and at determining whether their apparently high density is a local anomaly or not.

Galaxy Disruption Caught in the Act

Direct evidence of stellar material from galaxy disruption in the intra-cluster medium (ICM) relies on challenging observations of individual stars, planetary nebulae and diffuse optical light. Here we show that the ultra-compact dwarf galaxies (UCDs) we have discovered in the Fornax Cluster are a new and easy-to-measure probe of disruption in the ICM. We present spectroscopic observations supporting the hypothesis that the UCDs are the remnant nuclei of tidally threshed dwarf galaxies. Deep optical imaging of the cluster has revealed a 43-kpc long arc of tidal debris, flanking a nucleated dwarf elliptical (dE,N) cluster member. We may be witnessing galaxy threshing in action.

Hyperglycemia-induced abnormalities in rat and human corneas: the potential of second harmonic generation microscopy.

BACKGROUND: Second Harmonic Generation (SHG) microscopy recently appeared as an efficient optical imaging technique to probe unstained collagen-rich tissues like cornea. Moreover, corneal remodeling occurs in many diseases and precise characterization requires overcoming the limitations of conventional techniques. In this work, we focus on diabetes, which affects hundreds of million people worldwide and most often leads to diabetic retinopathy, with no early diagnostic tool. This study then aims to establish the potential of SHG microscopy for in situ detection and characterization of hyperglycemia-induced abnormalities in the Descemet's membrane, in the posterior cornea. METHODOLOGY/PRINCIPAL FINDINGS: We studied corneas from age-matched control and Goto-Kakizaki rats, a spontaneous model of type 2 diabetes, and corneas from human donors with type 2 diabetes and without any diabetes. SHG imaging was compared to confocal microscopy, to histology characterization using conventional staining and transmitted light microscopy and to transmission electron microscopy. SHG imaging revealed collagen deposits in the Descemet's membrane of unstained corneas in a unique way compared to these gold standard techniques in ophthalmology. It provided background-free images of the three-dimensional interwoven distribution of the collagen deposits, with improved contrast compared to confocal microscopy. It also provided structural capability in intact corneas because of its high specificity to fibrillar collagen, with substantially larger field of view than transmission electron microscopy. Moreover, in vivo SHG imaging was demonstrated in Goto-Kakizaki rats. CONCLUSIONS/SIGNIFICANCE: Our study shows unambiguously the high potential of SHG microscopy for three-dimensional characterization of structural abnormalities in unstained corneas. Furthermore, our demonstration of in vivo SHG imaging opens the way to long-term dynamical studies. This method should be easily generalized to other structural remodeling of the cornea and SHG microscopy should prove to be invaluable for in vivo corneal pathological studies.