Bright-field and fluorescence chip-scale microscopy for biological imaging

Optical microscopy is an essential tool in biological science and one of the gold standards for medical examinations. Miniaturization of microscopes can be a crucial stepping stone towards realizing compact, cost-effective and portable platforms for biomedical research and healthcare. This thesis reports on implementations of bright-field and fluorescence chip-scale microscopes for a variety of biological imaging applications. The term “chip-scale microscopy” refers to lensless imaging techniques realized in the form of mass-producible semiconductor devices, which transforms the fundamental design of optical microscopes.

Our strategy for chip-scale microscopy involves utilization of low-cost Complementary metal Oxide Semiconductor (CMOS) image sensors, computational image processing and micro-fabricated structural components. First, the sub-pixel resolving optofluidic microscope (SROFM), will be presented, which combines microfluidics and pixel super-resolution image reconstruction to perform high-throughput imaging of fluidic samples, such as blood cells. We discuss design parameters and construction of the device, as well as the resulting images and the resolution of the device, which was 0.66 µm at the highest acuity. The potential applications of SROFM for clinical diagnosis of malaria in the resource-limited settings is discussed.

Next, the implementations of ePetri, a self-imaging Petri dish platform with microscopy resolution, are presented. Here, we simply place the sample of interest on the surface of the image sensor and capture the direct shadow images under the illumination. By taking advantage of the inherent motion of the microorganisms, we achieve high resolution (~1 µm) imaging and long term culture of motile microorganisms over ultra large field-of-view (5.7 mm × 4.4 mm) in a specialized ePetri platform. We apply the pixel super-resolution reconstruction to a set of low-resolution shadow images of the microorganisms as they move across the sensing area of an image sensor chip and render an improved resolution image. We perform longitudinal study of Euglena gracilis cultured in an ePetri platform and image based analysis on the motion and morphology of the cells. The ePetri device for imaging non-motile cells are also demonstrated, by using the sweeping illumination of a light emitting diode (LED) matrix for pixel super-resolution reconstruction of sub-pixel shifted shadow images. Using this prototype device, we demonstrate the detection of waterborne parasites for the effective diagnosis of enteric parasite infection in resource-limited settings.

Then, we demonstrate the adaptation of a smartphone’s camera to function as a compact lensless microscope, which uses ambient illumination as its light source and does not require the incorporation of a dedicated light source. The method is also based on the image reconstruction with sweeping illumination technique, where the sequence of images are captured while the user is manually tilting the device around any ambient light source, such as the sun or a lamp. Image acquisition and reconstruction is performed on the device using a custom-built android application, constructing a stand-alone imaging device for field applications. We discuss the construction of the device using a commercial smartphone and demonstrate the imaging capabilities of our system.

Finally, we report on the implementation of fluorescence chip-scale microscope, based on a silo-filter structure fabricated on the pixel array of a CMOS image sensor. The extruded pixel design with metal walls between neighboring pixels successfully guides fluorescence emission through the thick absorptive filter to the photodiode layer of a pixel. Our silo-filter CMOS image sensor prototype achieves 13-µm resolution for fluorescence imaging over a wide field-of-view (4.8 mm × 4.4 mm). Here, we demonstrate bright-field and fluorescence longitudinal imaging of living cells in a compact, low-cost configuration.

Multiwavelength observations of the black hole candidate 1E 1740.7-2942

Observations of the Galactic center region black hole candidate 1E 1740.7-2942 have been carried out using the Caltech Gamma-Ray Imaging Payload (GRIP), the Röntgensatellit (ROSAT) and the Very Large Array (VLA). These multiwavelength observations have helped to establish the association between a bright emitter of hard X-rays and soft γ-rays, the compact core of a double radio jet source, and the X-ray source, 1E 1740.7-2942. They have also provided information on the X-ray and hard X-ray spectrum.

The Galactic center region was observed by GRIP during balloon flights from Alice Springs, NT, Australia on 1988 April 12 and 1989 April 3. These observations revealed that 1E 1740.7-2942 was the strongest source of hard X-rays within ~10° of the Galactic center. The source spectrum from each flight is well fit by a single power law in the energy range 35-200 keV. The best-fit photon indices and 100 keV normalizations are: γ = (2.05 ± 0.15) and K_(100) = (8.5 ± 0.5) x 10^(-5) cm^(-2) s^(-1) keV^(-1) and γ = (2.2 ± 0.3) and K_(100) = (7.0 ± 0.7) x 10^(-5) cm^(-2) s^(-1) keV^(-1) for the 1988 and 1989 observations respectively. No flux above 200 keV was detected during either observation. These values are consistent with a constant spectrum and indicate that 1E 1740.7-2942 was in its normal hard X-ray emission state. A search on one hour time scales showed no evidence for variability.

The ROSAT HRI observed 1E 1740.7-2942 during the period 1991 March 20-24. An improved source location has been derived from this observation. The best fit coordinates (J2000) are: Right Ascension = 17^h43^m54^s.9, Declination = -29°44'45".3, with a 90% confidence error circle of radius 8".5. The PSPC observation was split between periods from 1992 September 28- October 4 and 1993 March 23-28. A thermal bremsstrahlung model fit to the data yields a column density of N_H = 1.12^(+1.51)_(0.18) x cm^(-2) , consistent with earlier X- ray measurements.

We observed the region of the Einstein IPC error circle for 1E 1740.7-2942 with the VLA at 1.5 and 4.9 GHz on 1989 March 2. The 4.9 GHz observation revealed two sources. Source 'A', which is the core of a double aligned radio jet source (Mirabel et al. 1992), lies within our ROSAT error circle, further strengthening its identification with 1E 1740.7-2942.

The relationship between the radio and gamma-ray emission of blazars

Blazars are active galaxies with a jet closely oriented to our line of sight. They are powerful, variable emitters from radio to gamma-ray wavelengths. Although the general picture of synchrotron emission at low energies and inverse Compton at high energies is well established, important aspects of blazars are not well understood. In particular, the location of the gamma-ray emission region is not clearly established, with some theories favoring a location close to the central engine, while others place it at parsec scales in the radio jet.

We developed a program to locate the gamma-ray emission site in blazars, through the study of correlated variations between their gamma-ray and radio-wave emission. Correlated variations are expected when there is a relation between emission processes at both bands, while delays tell us about the relative location of their energy generation zones. Monitoring at 15 GHz using the Owens Valley Radio Observatory 40 meter telescope started in mid-2007. The program monitors 1593 blazars twice per week, including all blazars detected by the Fermi Gamma-ray Space Telescope (Fermi) north of -20 degrees declination. This program complements the continuous monitoring of gamma-rays by Fermi.

Three year long gamma-ray light curves for bright Fermi blazars are cross-correlated with four years of radio monitoring. The significance of cross-correlation peaks is investigated using simulations that account for the uneven sampling and noise properties of the light curves, which are modeled as red-noise processes with a simple power-law power spectral density. We found that out of 86 sources with high quality data, only three show significant correlations (AO 0235+164, B2 2308+34 and PKS 1502+106). Additionally, we find a significant correlation for Mrk 421 when including the strong gamma-ray/radio flare of late 2012. In all four cases radio variations lag gamma-ray variations, suggesting that the gamma-ray emission originates upstream of the radio emission. For PKS 1502+106 we locate the gamma-ray emission site parsecs away from the central engine, thus disfavoring the model of Blandford and Levinson (1995), while other cases are inconclusive. These findings show that continuous monitoring over long time periods is required to understand the cross-correlation between gamma-ray and radio-wave variability in most blazars.

Diffraction-limited imaging on the 200-inch telescope

We have used the technique of non-redundant masking at the Palomar 200-inch telescope and radio VLBI imaging software to make optical aperture synthesis maps of two binary stars, β Corona Borealis and σ Herculis. The dynamic range of the map of β CrB, a binary star with a separation of 230 milliarcseconds is 50:1. For σ Her, we find a separation of 70 milliarcseconds and the dynamic range of our image is 30:1. These demonstrate the potential of the non-redundant masking technique for diffraction-limited imaging of astronomical objects with high dynamic range.

We find that the optimal integration time for measuring the closure phase is longer than that for measuring the fringe amplitude. There is not a close relationship between amplitude errors and phase errors, as is found in radio interferometry. Amplitude self calibration is less effective at optical wavelengths than at radio wavelengths. Primary beam sensitivity correction made in radio aperture synthesis is not necessary in optical aperture synthesis.

The effects of atmospheric disturbances on optical aperture synthesis have been studied by Monte Carlo simulations based on the Kolmogorov theory of refractive-index fluctuations. For the non-redundant masking with τ_c-sized apertures, the simulated fringe amplitude gives an upper bound of the observed fringe amplitude. A smooth transition is seen from the non-redundant masking regime to the speckle regime with increasing aperture size. The fractional reduction of the fringe amplitude according to the bandwidth is nearly independent of the aperture size. The limiting magnitude of optical aperture synthesis with τ_c-sized apertures and that with apertures larger than τ_c are derived.

Monte Carlo simulations are also made to study the sensitivity and resolution of the bispectral analysis of speckle interferometry. We present the bispectral modulation transfer function and its signal-to-noise ratio at high light levels. The results confirm the validity of the heuristic interferometric view of image-forming process in the mid-spatial-frequency range. The signal-to- noise ratio of the bispectrum at arbitrary light levels is derived in the mid-spatial-frequency range.

The non-redundant masking technique is suitable for imaging bright objects with high resolution and high dynamic range, while the faintest limit will be better pursued by speckle imaging.

Understanding planet formation through high precision photometry and spectroscopy

From studies of protoplanetary disks to extrasolar planets and planetary debris, we aim to understand the full evolution of a planetary system. Observational constraints from ground- and space-based instrumentation allows us to measure the properties of objects near and far and are central to developing this understanding. We present here three observational campaigns that, when combined with theoretical models, reveal characteristics of different stages and remnants of planet formation. The Kuiper Belt provides evidence of chemical and dynamical activity that reveals clues to its primordial environment and subsequent evolution. Large samples of this population can only be assembled at optical wavelengths, with thermal measurements at infrared and sub-mm wavelengths currently available for only the largest and closest bodies. We measure the size and shape of one particular object precisely here, in hopes of better understanding its unique dynamical history and layered composition.

Molecular organic chemistry is one of the most fundamental and widespread facets of the universe, and plays a key role in planet formation. A host of carbon-containing molecules vibrationally emit in the near-infrared when excited by warm gas, T~1000 K. The NIRSPEC instrument at the W.M. Keck Observatory is uniquely configured to study large ranges of this wavelength region at high spectral resolution. Using this facility we present studies of warm CO gas in protoplanetary disks, with a new code for precise excitation modeling. A parameterized suite of models demonstrates the abilities of the code and matches observational constraints such as line strength and shape. We use the models to probe various disk parameters as well, which are easily extensible to others with known disk emission spectra such as water, carbon dioxide, acetylene, and hydrogen cyanide.

Lastly, the existence of molecules in extrasolar planets can also be studied with NIRSPEC and reveals a great deal about the evolution of the protoplanetary gas. The species we observe in protoplanetary disks are also often present in exoplanet atmospheres, and are abundant in Earth's atmosphere as well. Thus, a sophisticated telluric removal code is necessary to analyze these high dynamic range, high-resolution spectra. We present observations of a hot Jupiter, revealing water in its atmosphere and demonstrating a new technique for exoplanet mass determination and atmospheric characterization. We will also be applying this atmospheric removal code to the aforementioned disk observations, to improve our data analysis and probe less abundant species. Guiding models using observations is the only way to develop an accurate understanding of the timescales and processes involved. The futures of the modeling and of the observations are bright, and the end goal of realizing a unified model of planet formation will require both theory and data, from a diverse collection of sources.

Computationally Guided Monomerization of Red Fluorescent Proteins of the Class Anthozoa

Red fluorescent proteins (RFPs) have attracted significant engineering focus because of the promise of near infrared fluorescent proteins, whose light penetrates biological tissue, and which would allow imaging inside of vertebrate animals. The RFP landscape, which numbers ~200 members, is mostly populated by engineered variants of four native RFPs, leaving the vast majority of native RFP biodiversity untouched. This is largely due to the fact that native RFPs are obligate tetramers, limiting their usefulness as fusion proteins. Monomerization has imposed critical costs on these evolved tetramers, however, as it has invariably led to loss of brightness, and often to many other adverse effects on the fluorescent properties of the derived monomeric variants. Here we have attempted to understand why monomerization has taken such a large toll on Anthozoa class RFPs, and to outline a clear strategy for their monomerization. We begin with a structural study of the far-red fluorescence of AQ143, one of the furthest red emitting RFPs. We then try to separate the problem of stable and bright fluorescence from the design of a soluble monomeric β-barrel surface by engineering a hybrid protein (DsRmCh) with an oligomeric parent that had been previously monomerized, DsRed, and a pre-stabilized monomeric core from mCherry. This allows us to use computational design to successfully design a stable, soluble, fluorescent monomer. Next we took HcRed, which is a previously unmonomerized RFP that has far-red fluorescence (λemission = 633 nm) and attempted to monomerize it making use of lessons learned from DsRmCh. We engineered two monomeric proteins by pre-stabilizing HcRed’s core, then monomerizing in stages, making use of computational design and directed evolution techniques such as error-prone mutagenesis and DNA shuffling. We call these proteins mGinger0.1 (λem = 637 nm / Φ = 0.02) and mGinger0.2 (λem = 631 nm Φ = 0.04). They are the furthest red first generation monomeric RFPs ever developed, are significantly thermostabilized, and add diversity to a small field of far-red monomeric FPs. We anticipate that the techniques we describe will be facilitate future RFP monomerization, and that further core optimization of the mGingers may allow significant improvements in brightness.

Wide Field-of-view Microscopes and Endoscopes for Time-lapse Imaging and High-throughput Screening

Wide field-of-view (FOV) microscopy is of high importance to biological research and clinical diagnosis where a high-throughput screening of samples is needed. This thesis presents the development of several novel wide FOV imaging technologies and demonstrates their capabilities in longitudinal imaging of living organisms, on the scale of viral plaques to live cells and tissues.

The ePetri Dish is a wide FOV on-chip bright-field microscope. Here we applied an ePetri platform for plaque analysis of murine norovirus 1 (MNV-1). The ePetri offers the ability to dynamically track plaques at the individual cell death event level over a wide FOV of 6 mm × 4 mm at 30 min intervals. A density-based clustering algorithm is used to analyze the spatial-temporal distribution of cell death events to identify plaques at their earliest stages. We also demonstrate the capabilities of the ePetri in viral titer count and dynamically monitoring plaque formation, growth, and the influence of antiviral drugs.

We developed another wide FOV imaging technique, the Talbot microscope, for the fluorescence imaging of live cells. The Talbot microscope takes advantage of the Talbot effect and can generate a focal spot array to scan the fluorescence samples directly on-chip. It has a resolution of 1.2 μm and a FOV of ~13 mm². We further upgraded the Talbot microscope for the long-term time-lapse fluorescence imaging of live cell cultures, and analyzed the cells’ dynamic response to an anticancer drug.

We present two wide FOV endoscopes for tissue imaging, named the AnCam and the PanCam. The AnCam is based on the contact image sensor (CIS) technology, and can scan the whole anal canal within 10 seconds with a resolution of 89 μm, a maximum FOV of 100 mm × 120 mm, and a depth-of-field (DOF) of 0.65 mm. We also demonstrate the performance of the AnCam in whole anal canal imaging in both animal models and real patients. In addition to this, the PanCam is based on a smartphone platform integrated with a panoramic annular lens (PAL), and can capture a FOV of 18 mm × 120 mm in a single shot with a resolution of 100─140 μm. In this work we demonstrate the PanCam’s performance in imaging a stained tissue sample.

Observations and Modeling of Tropical Planetary Atmospheres

This thesis is a comprised of three different projects within the topic of tropical atmospheric dynamics. First, I analyze observations of thermal radiation from Saturn’s atmosphere and from them, determine the latitudinal distribution of ammonia vapor near the 1.5-bar pressure level. The most prominent feature of the observations is the high brightness temperature of Saturn’s subtropical latitudes on either side of the equator. After comparing the observations to a microwave radiative transfer model, I find that these subtropical bands require very low ammonia relative humidity below the ammonia cloud layer in order to achieve the high brightness temperatures observed. We suggest that these bright subtropical bands represent dry zones created by a meridionally overturning circulation.

Second, I use a dry atmospheric general circulation model to study equatorial superrotation in terrestrial atmospheres. A wide range of atmospheres are simulated by varying three parameters: the pole-equator radiative equilibrium temperature contrast, the convective lapse rate, and the planetary rotation rate. A scaling theory is developed that establishes conditions under which superrotation occurs in terrestrial atmospheres. The scaling arguments show that superrotation is favored when the off-equatorial baroclinicity and planetary rotation rates are low. Similarly, superrotation is favored when the convective heating strengthens, which may account for the superrotation seen in extreme global-warming simulations.

Third, I use a moist slab-ocean general circulation model to study the impact of a zonally-symmetric continent on the distribution of monsoonal precipitation. I show that adding a hemispheric asymmetry in surface heat capacity is sufficient to cause symmetry breaking in both the spatial and temporal distribution of precipitation. This spatial symmetry breaking can be understood from a large-scale energetic perspective, while the temporal symmetry breaking requires consideration of the dynamical response to the heat capacity asymmetry and the seasonal cycle of insolation. Interestingly, the idealized monsoonal precipitation bears resemblance to precipitation in the Indian monsoon sector, suggesting that this work may provide insight into the causes of the temporally asymmetric distribution of precipitation over southeast Asia.

Computational microscopy: turning megapixels into gigapixels

The layout of a typical optical microscope has remained effectively unchanged over the past century. Besides the widespread adoption of digital focal plane arrays, relatively few innovations have helped improve standard imaging with bright-field microscopes. This thesis presents a new microscope imaging method, termed Fourier ptychography, which uses an LED to provide variable sample illumination and post-processing algorithms to recover useful sample information. Examples include increasing the resolution of megapixel-scale images to one gigapixel, measuring quantitative phase, achieving oil-immersion quality resolution without an immersion medium, and recovering complex three dimensional sample structure.