Understanding GPU programming for statistical computation: Studies in massively parallel massive mixtures

This article describes advances in statistical computation for large-scale data analysis in structured Bayesian mixture models via graphics processing unit (GPU) programming. The developments are partly motivated by computational challenges arising in fitting models of increasing heterogeneity to increasingly large datasets. An example context concerns common biological studies using high-throughput technologies generating many, very large datasets and requiring increasingly high-dimensional mixture models with large numbers of mixture components.We outline important strategies and processes for GPU computation in Bayesian simulation and optimization approaches, give examples of the benefits of GPU implementations in terms of processing speed and scale-up in ability to analyze large datasets, and provide a detailed, tutorial-style exposition that will benefit readers interested in developing GPU-based approaches in other statistical models. Novel, GPU-oriented approaches to modifying existing algorithms software design can lead to vast speed-up and, critically, enable statistical analyses that presently will not be performed due to compute time limitations in traditional computational environments. Supplementalmaterials are provided with all source code, example data, and details that will enable readers to implement and explore the GPU approach in this mixture modeling context. © 2010 American Statistical Association, Institute of Mathematical Statistics, and Interface Foundation of North America.

High-Resolution In Situ Oxygen-Argon Studies of Surface Biological and Physical Processes in the Polar Oceans

The Arctic Ocean and Western Antarctic Peninsula (WAP) are the fastest warming regions on the planet and are undergoing rapid climate and ecosystem changes. Until we can fully resolve the coupling between biological and physical processes we cannot predict how warming will influence carbon cycling and ecosystem function and structure in these sensitive and climactically important regions. My dissertation centers on the use of high-resolution measurements of surface dissolved gases, primarily O2 and Ar, as tracers or physical and biological functioning that we measure underway using an optode and Equilibrator Inlet Mass Spectrometry (EIMS). Total O2 measurements are common throughout the historical and autonomous record but are influenced by biological (net metabolic balance) and physical (temperature, salinity, pressure changes, ice melt/freeze, mixing, bubbles and diffusive gas exchange) processes. We use Ar, an inert gas with similar solubility properties to O2, to devolve distinct records of biological (O2/Ar) and physical (Ar) oxygen. These high-resolution measurements that expose intersystem coupling and submesoscale variability were central to studies in the Arctic Ocean, WAP and open Southern Ocean that make up this dissertation.

Key findings of this work include the documentation of under ice and ice-edge blooms and basin scale net sea ice freeze/melt processes in the Arctic Ocean. In the WAP O2 and pCO2 are both biologically driven and net community production (NCP) variability is controlled by Fe and light availability tied to glacial and sea ice meltwater input. Further, we present a feasibility study that shows the ability to use modeled Ar to derive NCP from total O2 records. This approach has the potential to unlock critical carbon flux estimates from historical and autonomous O2 measurements in the global oceans.

A low-cost, portable, and quantitative spectral imaging system for application to biological tissues.

The ability of diffuse reflectance spectroscopy to extract quantitative biological composition of tissues has been used to discern tissue types in both pre-clinical and clinical cancer studies. Typically, diffuse reflectance spectroscopy systems are designed for single-point measurements. Clinically, an imaging system would provide valuable spatial information on tissue composition. While it is feasible to build a multiplexed fiber-optic probe based spectral imaging system, these systems suffer from drawbacks with respect to cost and size. To address these we developed a compact and low cost system using a broadband light source with an 8-slot filter wheel for illumination and silicon photodiodes for detection. The spectral imaging system was tested on a set of tissue mimicking liquid phantoms which yielded an optical property extraction accuracy of 6.40 +/- 7.78% for the absorption coefficient (micro(a)) and 11.37 +/- 19.62% for the wavelength-averaged reduced scattering coefficient (micro(s)').

Assessment of LD matrix measures for the analysis of biological pathway association.

Complex diseases will have multiple functional sites, and it will be invaluable to understand the cross-locus interaction in terms of linkage disequilibrium (LD) between those sites (epistasis) in addition to the haplotype-LD effects. We investigated the statistical properties of a class of matrix-based statistics to assess this epistasis. These statistical methods include two LD contrast tests (Zaykin et al., 2006) and partial least squares regression (Wang et al., 2008). To estimate Type 1 error rates and power, we simulated multiple two-variant disease models using the SIMLA software package. SIMLA allows for the joint action of up to two disease genes in the simulated data with all possible multiplicative interaction effects between them. Our goal was to detect an interaction between multiple disease-causing variants by means of their linkage disequilibrium (LD) patterns with other markers. We measured the effects of marginal disease effect size, haplotype LD, disease prevalence and minor allele frequency have on cross-locus interaction (epistasis). In the setting of strong allele effects and strong interaction, the correlation between the two disease genes was weak (r=0.2). In a complex system with multiple correlations (both marginal and interaction), it was difficult to determine the source of a significant result. Despite these complications, the partial least squares and modified LD contrast methods maintained adequate power to detect the epistatic effects; however, for many of the analyses we often could not separate interaction from a strong marginal effect. While we did not exhaust the entire parameter space of possible models, we do provide guidance on the effects that population parameters have on cross-locus interaction.

Quantification of biological aging in young adults.

Antiaging therapies show promise in model organism research. Translation to humans is needed to address the challenges of an aging global population. Interventions to slow human aging will need to be applied to still-young individuals. However, most human aging research examines older adults, many with chronic disease. As a result, little is known about aging in young humans. We studied aging in 954 young humans, the Dunedin Study birth cohort, tracking multiple biomarkers across three time points spanning their third and fourth decades of life. We developed and validated two methods by which aging can be measured in young adults, one cross-sectional and one longitudinal. Our longitudinal measure allows quantification of the pace of coordinated physiological deterioration across multiple organ systems (e.g., pulmonary, periodontal, cardiovascular, renal, hepatic, and immune function). We applied these methods to assess biological aging in young humans who had not yet developed age-related diseases. Young individuals of the same chronological age varied in their "biological aging" (declining integrity of multiple organ systems). Already, before midlife, individuals who were aging more rapidly were less physically able, showed cognitive decline and brain aging, self-reported worse health, and looked older. Measured biological aging in young adults can be used to identify causes of aging and evaluate rejuvenation therapies.

Biological and physical interactions on a tropical island coral reef: Transport and retention processes on moorea, French Polynesia

The Moorea Coral Reef Long Term Ecological Research project funded by the US National Science Foundation includes multidisciplinary studies of physical processes driving ecological dynamics across the fringing reef, back reef, and fore reef habitats of Moorea, French Polynesia. A network of oceanographic moorings and a variety of other approaches have been used to investigate the biological and biogeochemical aspects of water transport and retention processes in this system. There is evidence to support the hypothesis that a low-frequency counterclockwise flow around the island is superimposed on the relatively strong alongshore currents on each side of the island. Despite the rapid flow and flushing of the back reef, waters over the reef display chemical and biological characteristics distinct from those offshore. The patterns include higher nutrient and lower dissolved organic carbon concentrations, distinct microbial community compositions among habitats, and reef assemblages of zooplankton that exhibit migration behavior, suggesting multigenerational residence on the reef. Zooplankton consumption by planktivorous fish on the reef reflects both retention of reef-associated taxa and capture by the reef community of resources originating offshore. Coral recruitment and population genetics of reef fishes point to retention of larvae within the system and high recruitment levels from local adult populations. The combined results suggest that a broad suite of physical and biological processes contribute to high retention of externally derived and locally produced organic materials within this island coral reef system. © 2013 by The Oceanography Society. All rights reserved.

Functional Evaluation of Causal Mutations Identified in Human Genetic Studies

Human genetics has been experiencing a wave of genetic discoveries thanks to the development of several technologies, such as genome-wide association studies (GWAS), whole-exome sequencing, and whole genome sequencing. Despite the massive genetic discoveries of new variants associated with human diseases, several key challenges emerge following the genetic discovery. GWAS is known to be good at identifying the locus associated with the patient phenotype. However, the actually causal variants responsible for the phenotype are often elusive. Another challenge in human genetics is that even the causal mutations are already known, the underlying biological effect might remain largely ambiguous. Functional evaluation plays a key role to solve these key challenges in human genetics both to identify causal variants responsible for the phenotype, and to further develop the biological insights from the disease-causing mutations.

We adopted various methods to characterize the effects of variants identified in human genetic studies, including patient genetic and phenotypic data, RNA chemistry, molecular biology, virology, and multi-electrode array and primary neuronal culture systems. Chapter 1 is a broader introduction for the motivation and challenges for functional evaluation in human genetic studies, and the background of several genetics discoveries, such as hepatitis C treatment response, in which we performed functional characterization.

Chapter 2 focuses on the characterization of causal variants following the GWAS study for hepatitis C treatment response. We characterized a non-coding SNP (rs4803217) of IL28B (IFNL3) in high linkage disequilibrium (LD) with the discovery SNP identified in the GWAS. In this chapter, we used inter-disciplinary approaches to characterize rs4803217 on RNA structure, disease association, and protein translation.

Chapter 3 describes another avenue of functional characterization following GWAS focusing on the novel transcripts and proteins identified near the IL28B (IFNL3) locus. It has been recently speculated that this novel protein, which was named IFNL4, may affect the HCV treatment response and clearance. In this chapter, we used molecular biology, virology, and patient genetic and phenotypic data to further characterize and understand the biology of IFNL4. The efforts in chapter 2 and 3 provided new insights to the candidate causal variant(s) responsible for the GWAS for HCV treatment response, however, more evidence is still required to make claims for the exact causal roles of these variants for the GWAS association.

Chapter 4 aims to characterize a mutation already known to cause a disease (seizure) in a mouse model. We demonstrate the potential use of multi-electrode array (MEA) system for the functional characterization and drug testing on mutations found in neurological diseases, such as seizure. Functional characterization in neurological diseases is relatively challenging and available systematic tools are relatively limited. This chapter shows an exploratory research and example to establish a system for the broader use for functional characterization and translational opportunities for mutations found in neurological diseases.

Overall, this dissertation spans a range of challenges of functional evaluations in human genetics. It is expected that the functional characterization to understand human mutations will become more central in human genetics, because there are still many biological questions remaining to be answered after the explosion of human genetic discoveries. The recent advance in several technologies, including genome editing and pluripotent stem cells, is also expected to make new tools available for functional studies in human diseases.

Design, Synthesis, and Biological Characterization of Largazole Analogues

Histone deacetylases (HDACs) have been shown to play key roles in tumorigenesis, and

have been validated as effective enzyme target for cancer treatment. Largazole, a marine natural

product isolated from the cyanobacterium Symploca, is an extremely potent HDAC inhibitor that

has been shown to possess high differential cytotoxicity towards cancer cells along with excellent

HDAC class-selectivity. However, improvements can be made in the isoform-selectivity and

pharmacokinetic properties of largazole.

In attempts to make these improvements and furnish a more efficient biochemical probe

as well as a potential therapeutic, several largazole analogues have been designed, synthesized,

and tested for their biological activity. Three different types of analogues were prepared. First,

different chemical functionalities were introduced at the C2 position to probe the class Iselectivity profile of largazole. Additionally, docking studies led to the design of a potential

HDAC8-selective analogue. Secondly, the thiol moiety in largazole was replaced with a wide

variety of othe zinc-binding group in order to probe the effect of Zn2+ affinity on HDAC

inhibition. Lastly, three disulfide analogues of largazole were prepared in order to utilize a

different prodrug strategy to modulate the pharmacokinetic properties of largazole.

Through these analogues it was shown that C2 position can be modified significantly

without a major loss in activity while also eliciting minimal changes in isoform-selectivity. While

the Zn2+-binding group plays a major role in HDAC inhibition, it was also shown that the thiol

can be replaced by other functionalities while still retaining inhibitory activity. Lastly, the use of

a disulfide prodrug strategy was shown to affect pharmacokinetic properties resulting in varying

functional responses in vitro and in vivo.

v

Largazole is already an impressive HDAC inhibitor that shows incredible promise.

However, in order to further develop this natural product into an anti-cancer therapeutic as well as

a chemical probe, improvements in the areas of pharmacokinetics as well as isoform-selectivity

are required. Through these studies we plan on building upon existing structure–activity

relationships to further our understanding of largazole’s mechanism of inhibition so that we may

improve these properties and ultimately develop largazole into an efficient HDAC inhibitor that

may be used as an anti-cancer therapeutic as well as a chemical probe for the studying of

biochemical systems.

Biological and Physical Factors Affecting the Natural History and Evolution of Encapsulated Development

The evolution of reproductive strategies involves a complex calculus of costs and benefits to both parents and offspring. Many marine animals produce embryos packaged in tough egg capsules or gelatinous egg masses attached to benthic surfaces. While these egg structures can protect against environmental stresses, the packaging is energetically costly for parents to produce. In this series of studies, I examined a variety of ecological factors affecting the evolution of benthic development as a life history strategy. I used marine gastropods as my model system because they are incredibly diverse and abundant worldwide, and they exhibit a variety of reproductive and developmental strategies.

The first study examines predation on benthic egg masses. I investigated: 1) behavioral mechanisms of predation when embryos are targeted (rather than the whole egg mass); 2) the specific role of gelatinous matrix in predation. I hypothesized that gelatinous matrix does not facilitate predation. One study system was the sea slug Olea hansineensis, an obligate egg mass predator, feeding on the sea slug Haminoea vesicula. Olea fed intensely and efficiently on individual Haminoea embryos inside egg masses but showed no response to live embryos removed from gel, suggesting that gelatinous matrix enables predation. This may be due to mechanical support of the feeding predator by the matrix. However, Haminoea egg masses outnumber Olea by two orders of magnitude in the field, and each egg mass can contain many tens of thousands of embryos, so predation pressure on individuals is likely not strong. The second system involved the snail Nassarius vibex, a non-obligate egg mass predator, feeding on the polychaete worm Clymenella mucosa. Gel neither inhibits nor promotes embryo predation for Nassarius, but because it cannot target individual embryos inside an egg mass, its feeding is slow and inefficient, and feeding rates in the field are quite low. However, snails that compete with Nassarius for scavenged food have not been seen to eat egg masses in the field, leaving Nassarius free to exploit the resource. Overall, egg mass predation in these two systems likely benefits the predators much more than it negatively affects the prey. Thus, selection for environmentally protective aspects of egg mass production may be much stronger than selection for defense against predation.

In the second study, I examined desiccation resistance in intertidal egg masses made by Haminoea vesicula, which preferentially attaches its flat, ribbon-shaped egg masses to submerged substrata. Egg masses occasionally detach and become stranded on exposed sand at low tide. Unlike adults, the encased embryos cannot avoid desiccation by selectively moving about the habitat, and the egg mass shape has high surface-area-to-volume ratio that should make it prone to drying out. Thus, I hypothesized that the embryos would not survive stranding. I tested this by deploying individual egg masses of two age classes on exposed sand bars for the duration of low tide. After rehydration, embryos midway through development showed higher rates of survival than newly-laid embryos, though for both stages survival rates over 25% were frequently observed. Laboratory desiccation trials showed that >75% survival is possible in an egg mass that has lost 65% of its water weight, and some survival (<25%) was observed even after 83% water weight lost. Although many surviving embryos in both experiments showed damage, these data demonstrate that egg mass stranding is not necessarily fatal to embryos. They may be able to survive a far greater range of conditions than they normally encounter, compensating for their lack of ability to move. Also, desiccation tolerance of embryos may reduce pressure on parents to find optimal laying substrata.

The third study takes a big-picture approach to investigating the evolution of different developmental strategies in cone snails, the largest genus of marine invertebrates. Cone snail species hatch out of their capsules as either swimming larvae or non-dispersing forms, and their developmental mode has direct consequences for biogeographic patterns. Variability in life history strategies among taxa may be influenced by biological, environmental, or phylogenetic factors, or a combination of these. While most prior research has examined these factors singularly, my aim was to investigate the effects of a host of intrinsic, extrinsic, and historical factors on two fundamental aspects of life history: egg size and egg number. I used phylogenetic generalized least-squares regression models to examine relationships between these two egg traits and a variety of hypothesized intrinsic and extrinsic variables. Adult shell morphology and spatial variability in productivity and salinity across a species geographic range had the strongest effects on egg diameter and number of eggs per capsule. Phylogeny had no significant influence. Developmental mode in Conus appears to be influenced mostly by species-level adaptations and niche specificity rather than phylogenetic conservatism. Patterns of egg size and egg number appear to reflect energetic tradeoffs with body size and specific morphologies as well as adaptations to variable environments. Overall, this series of studies highlights the importance of organism-scale biotic and abiotic interactions in evolutionary patterns.