Latent variable models for neural data analysis

The brain is perhaps the most complex system to have ever been subjected to rigorous scientific investigation. The scale is staggering: over 10^11 neurons, each making an average of 10^3 synapses, with computation occurring on scales ranging from a single dendritic spine, to an entire cortical area. Slowly, we are beginning to acquire experimental tools that can gather the massive amounts of data needed to characterize this system. However, to understand and interpret these data will also require substantial strides in inferential and statistical techniques. This dissertation attempts to meet this need, extending and applying the modern tools of latent variable modeling to problems in neural data analysis.

It is divided into two parts. The first begins with an exposition of the general techniques of latent variable modeling. A new, extremely general, optimization algorithm is proposed - called Relaxation Expectation Maximization (REM) - that may be used to learn the optimal parameter values of arbitrary latent variable models. This algorithm appears to alleviate the common problem of convergence to local, sub-optimal, likelihood maxima. REM leads to a natural framework for model size selection; in combination with standard model selection techniques the quality of fits may be further improved, while the appropriate model size is automatically and efficiently determined. Next, a new latent variable model, the mixture of sparse hidden Markov models, is introduced, and approximate inference and learning algorithms are derived for it. This model is applied in the second part of the thesis.

The second part brings the technology of part I to bear on two important problems in experimental neuroscience. The first is known as spike sorting; this is the problem of separating the spikes from different neurons embedded within an extracellular recording. The dissertation offers the first thorough statistical analysis of this problem, which then yields the first powerful probabilistic solution. The second problem addressed is that of characterizing the distribution of spike trains recorded from the same neuron under identical experimental conditions. A latent variable model is proposed. Inference and learning in this model leads to new principled algorithms for smoothing and clustering of spike data.

Part I: Latent heat of vaporization of n-decane. Part II: Heat and mass transfer from a cylinder placed in a turbulent air stream - Sherwood and Frössling numbers as a function of free stream turbulence level and Reynolds number

Part I

The latent heat of vaporization of n-decane is measured calorimetrically at temperatures between 160° and 340°F. The internal energy change upon vaporization, and the specific volume of the vapor at its dew point are calculated from these data and are included in this work. The measurements are in excellent agreement with available data at 77° and also at 345°F, and are presented in graphical and tabular form.

Part II

Simultaneous material and energy transport from a one-inch adiabatic porous cylinder is studied as a function of free stream Reynolds Number and turbulence level. Experimental data is presented for Reynolds Numbers between 1600 and 15,000 based on the cylinder diameter, and for apparent turbulence levels between 1.3 and 25.0 per cent. n-heptane and n-octane are the evaporating fluids used in this investigation.

Gross Sherwood Numbers are calculated from the data and are in substantial agreement with existing correlations of the results of other workers. The Sherwood Numbers, characterizing mass transfer rates, increase approximately as the 0.55 power of the Reynolds Number. At a free stream Reynolds Number of 3700 the Sherwood Number showed a 40% increase as the apparent turbulence level of the free stream was raised from 1.3 to 25 per cent.

Within the uncertainties involved in the diffusion coefficients used for n-heptane and n-octane, the Sherwood Numbers are comparable for both materials. A dimensionless Frössling Number is computed which characterizes either heat or mass transfer rates for cylinders on a comparable basis. The calculated Frössling Numbers based on mass transfer measurements are in substantial agreement with Frössling Numbers calculated from the data of other workers in heat transfer.

Site-Specific Isotopes in Small Organic Molecules

Stable isotope geochemistry is a valuable toolkit for addressing a broad range of problems in the geosciences. Recent technical advances provide information that was previously unattainable or provide unprecedented precision and accuracy. Two such techniques are site-specific stable isotope mass spectrometry and clumped isotope thermometry. In this thesis, I use site-specific isotope and clumped isotope data to explore natural gas development and carbonate reaction kinetics. In the first chapter, I develop an equilibrium thermodynamics model to calculate equilibrium constants for isotope exchange reactions in small organic molecules. This equilibrium data provides a framework for interpreting the more complex data in the later chapters. In the second chapter, I demonstrate a method for measuring site-specific carbon isotopes in propane using high-resolution gas source mass spectrometry. This method relies on the characteristic fragments created during electron ionization, in which I measure the relative isotopic enrichment of separate parts of the molecule. My technique will be applied to a range of organic compounds in the future. For the third chapter, I use this technique to explore diffusion, mixing, and other natural processes in natural gas basins. As time progresses and the mixture matures, different components like kerogen and oil contribute to the propane in a natural gas sample. Each component imparts a distinct fingerprint on the site-specific isotope distribution within propane that I can observe to understand the source composition and maturation of the basin. Finally, in Chapter Four, I study the reaction kinetics of clumped isotopes in aragonite. Despite its frequent use as a clumped isotope thermometer, the aragonite blocking temperature is not known. Using laboratory heating experiments, I determine that the aragonite clumped isotope thermometer has a blocking temperature of 50-100°C. I compare this result to natural samples from the San Juan Islands that exhibit a maximum clumped isotope temperature that matches this blocking temperature. This thesis presents a framework for measuring site-specific carbon isotopes in organic molecules and new constraints on aragonite reaction kinetics. This study represents the foundation of a future generation of geochemical tools for the study of complex geologic systems.

Phase transitions from the solid state of monatomic elements

The principle aims of this thesis include the development of models of sublimation and melting from first principles and the application of these models to the rare gases.

A simple physical model is constructed to represent the sublimation of monatomic elements. According to this model, the solid and gas phases are two states of a single physical system. The nature of the phase transition is clearly revealed, and the relations between the vapor pressure, the latent heat, and the transition temperature are derived. The resulting theory is applied to argon, krypton, and xenon, and good agreement with experiment is found.

For the melting transition, the solid is represented by an anharmonic model and the liquid is described by the Percus-Yevick approximation. The behavior of the liquid at high densities is studied on the isotherms kT/∈ = 1.3, 1.8, and 2.0, where k is Boltzmann's constant, T is the temperature, and e is the well depth of the Lennard-Jones 12-6 pair potential. No solutions of the PercusYevick equation were found for ρσ³ above 1.3, where ρ is the particle density and σ is the radial parameter of the Lennard-Jones potential. The liquid structure is found to be very different from the solid structure near the melting line. The liquid pressures are about 50 percent low for experimental melting densities of argon. This discrepancy gives rise to melting pressures up to twice the experimental values.

Simulations and mechanisms of subtropical low-cloud response to climate change

This thesis focuses on improving the simulation skills and the theoretical understanding of the subtropical low cloud response to climate change.

First, an energetically consistent forcing framework is designed and implemented for the large eddy simulation (LES) of the low-cloud response to climate change. The three representative current-day subtropical low cloud regimes of cumulus (Cu), cumulus-over-stratocumulus, and stratocumulus (Sc) are all well simulated with this framework, and results are comparable to the conventional fixed-SST approach. However, the cumulus response to climate warming subject to energetic constraints differs significantly from the conventional approach with fixed SST. Under the energetic constraint, the subtropics warm less than the tropics, since longwave (LW) cooling is more efficient with the drier subtropical free troposphere. The surface latent heat flux (LHF) also increases only weakly subject to the surface energetic constraint. Both factors contribute to an increased estimated inversion strength (EIS), and decreased inversion height. The decreased Cu-depth contributes to a decrease of liquid water path (LWP) and weak positive cloud feedback. The conventional fixed-SST approach instead simulates a strong increase in LHF and deepening of the Cu layer, leading to a weakly negative cloud feedback. This illustrates the importance of energetic constraints to the simulation and understanding of the sign and magnitude of low-cloud feedback.

Second, an extended eddy-diffusivity mass-flux (EDMF) closure for the unified representation of sub-grid scale (SGS) turbulence and convection processes in general circulation models (GCM) is presented. The inclusion of prognostic terms and the elimination of the infinitesimal updraft fraction assumption makes it more flexible for implementation in models across different scales. This framework can be consistently extended to formulate multiple updrafts and downdrafts, as well as variances and covariances. It has been verified with LES in different boundary layer regimes in the current climate, and further development and implementation of this closure may help to improve our simulation skills and understanding of low-cloud feedback through GCMs.

I. The attenuation and dispersion of sound in a condensing medium. II. The flow of a gas-particle mixture downstream of a normal shock in a nozzle

I. The attenuation of sound due to particles suspended in a gas was first calculated by Sewell and later by Epstein in their classical works on the propagation of sound in a two-phase medium. In their work, and in more recent works which include calculations of sound dispersion, the calculations were made for systems in which there was no mass transfer between the two phases. In the present work, mass transfer between phases is included in the calculations.

The attenuation and dispersion of sound in a two-phase condensing medium are calculated as functions of frequency. The medium in which the sound propagates consists of a gaseous phase, a mixture of inert gas and condensable vapor, which contains condensable liquid droplets. The droplets, which interact with the gaseous phase through the interchange of momentum, energy, and mass (through evaporation and condensation), are treated from the continuum viewpoint. Limiting cases, for flow either frozen or in equilibrium with respect to the various exchange processes, help demonstrate the effects of mass transfer between phases. Included in the calculation is the effect of thermal relaxation within droplets. Pressure relaxation between the two phases is examined, but is not included as a contributing factor because it is of interest only at much higher frequencies than the other relaxation processes. The results for a system typical of sodium droplets in sodium vapor are compared to calculations in which there is no mass exchange between phases. It is found that the maximum attenuation is about 25 per cent greater and occurs at about one-half the frequency for the case which includes mass transfer, and that the dispersion at low frequencies is about 35 per cent greater. Results for different values of latent heat are compared.

II. In the flow of a gas-particle mixture through a nozzle, a normal shock may exist in the diverging section of the nozzle. In Marble’s calculation for a shock in a constant area duct, the shock was described as a usual gas-dynamic shock followed by a relaxation zone in which the gas and particles return to equilibrium. The thickness of this zone, which is the total shock thickness in the gas-particle mixture, is of the order of the relaxation distance for a particle in the gas. In a nozzle, the area may change significantly over this relaxation zone so that the solution for a constant area duct is no longer adequate to describe the flow. In the present work, an asymptotic solution, which accounts for the area change, is obtained for the flow of a gas-particle mixture downstream of the shock in a nozzle, under the assumption of small slip between the particles and gas. This amounts to the assumption that the shock thickness is small compared with the length of the nozzle. The shock solution, valid in the region near the shock, is matched to the well known small-slip solution, which is valid in the flow downstream of the shock, to obtain a composite solution valid for the entire flow region. The solution is applied to a conical nozzle. A discussion of methods of finding the location of a shock in a nozzle is included.

Particle fluid mechanics in shear flows, acoustic waves, and shock waves

Three different categories of flow problems of a fluid containing small particles are being considered here. They are: (i) a fluid containing small, non-reacting particles (Parts I and II); (ii) a fluid containing reacting particles (Parts III and IV); and (iii) a fluid containing particles of two distinct sizes with collisions between two groups of particles (Part V).

Part I

A numerical solution is obtained for a fluid containing small particles flowing over an infinite disc rotating at a constant angular velocity. It is a boundary layer type flow, and the boundary layer thickness for the mixture is estimated. For large Reynolds number, the solution suggests the boundary layer approximation of a fluid-particle mixture by assuming W = W_p. The error introduced is consistent with the Prandtl’s boundary layer approximation. Outside the boundary layer, the flow field has to satisfy the “inviscid equation” in which the viscous stress terms are absent while the drag force between the particle cloud and the fluid is still important. Increase of particle concentration reduces the boundary layer thickness and the amount of mixture being transported outwardly is reduced. A new parameter, β = 1/Ω τ_v, is introduced which is also proportional to μ. The secondary flow of the particle cloud depends very much on β. For small values of β, the particle cloud velocity attains its maximum value on the surface of the disc, and for infinitely large values of β, both the radial and axial particle velocity components vanish on the surface of the disc.

Part II

The “inviscid” equation for a gas-particle mixture is linearized to describe the flow over a wavy wall. Corresponding to the Prandtl-Glauert equation for pure gas, a fourth order partial differential equation in terms of the velocity potential ϕ is obtained for the mixture. The solution is obtained for the flow over a periodic wavy wall. For equilibrium flows where λ_v and λ_T approach zero and frozen flows in which λ_v and λ_T become infinitely large, the flow problem is basically similar to that obtained by Ackeret for a pure gas. For finite values of λ_v and λ_T, all quantities except v are not in phase with the wavy wall. Thus the drag coefficient C_D is present even in the subsonic case, and similarly, all quantities decay exponentially for supersonic flows. The phase shift and the attenuation factor increase for increasing particle concentration.

Part III

Using the boundary layer approximation, the initial development of the combustion zone between the laminar mixing of two parallel streams of oxidizing agent and small, solid, combustible particles suspended in an inert gas is investigated. For the special case when the two streams are moving at the same speed, a Green’s function exists for the differential equations describing first order gas temperature and oxidizer concentration. Solutions in terms of error functions and exponential integrals are obtained. Reactions occur within a relatively thin region of the order of λ_D. Thus, it seems advantageous in the general study of two-dimensional laminar flame problems to introduce a chemical boundary layer of thickness λ_D within which reactions take place. Outside this chemical boundary layer, the flow field corresponds to the ordinary fluid dynamics without chemical reaction.

Part IV

The shock wave structure in a condensing medium of small liquid droplets suspended in a homogeneous gas-vapor mixture consists of the conventional compressive wave followed by a relaxation region in which the particle cloud and gas mixture attain momentum and thermal equilibrium. Immediately following the compressive wave, the partial pressure corresponding to the vapor concentration in the gas mixture is higher than the vapor pressure of the liquid droplets and condensation sets in. Farther downstream of the shock, evaporation appears when the particle temperature is raised by the hot surrounding gas mixture. The thickness of the condensation region depends very much on the latent heat. For relatively high latent heat, the condensation zone is small compared with Ʌ_D.

For solid particles suspended initially in an inert gas, the relaxation zone immediately following the compression wave consists of a region where the particle temperature is first being raised to its melting point. When the particles are totally melted as the particle temperature is further increased, evaporation of the particles also plays a role.

The equilibrium condition downstream of the shock can be calculated and is independent of the model of the particle-gas mixture interaction.

Part V

For a gas containing particles of two distinct sizes and satisfying certain conditions, momentum transfer due to collisions between the two groups of particles can be taken into consideration using the classical elastic spherical ball model. Both in the relatively simple problem of normal shock wave and the perturbation solutions for the nozzle flow, the transfer of momentum due to collisions which decreases the velocity difference between the two groups of particles is clearly demonstrated. The difference in temperature as compared with the collisionless case is quite negligible.

Stationary Eddies and Zonal Variations of the Global Hydrological Cycle in a Changing Climate

This thesis advances our physical understanding of the sensitivity of the hydrological cycle to global warming. Specifically, it focuses on changes in the longitudinal (zonal) variation of precipitation minus evaporation (P - E), which is predominantly controlled by planetary-scale stationary eddies. By studying idealized general circulation model (GCM) experiments with zonally varying boundary conditions, this thesis examines the mechanisms controlling the strength of stationary-eddy circulations and their role in the hydrological cycle. The overarching goal of this research is to understand the cause of changes in regional P - E with global warming. An understanding of such changes can be useful for impact studies focusing on water availability, ecosystem management, and flood risk.

Based on a moisture-budget analysis of ERA-Interim data, we establish an approximation for zonally anomalous P - E in terms of surface moisture content and stationary-eddy vertical motion in the lower troposphere. Part of the success of this approximation comes from our finding that transient-eddy moisture fluxes partially cancel the effect of stationary-eddy moisture advection, allowing divergent circulations to dominate the moisture budget. The lower-tropospheric vertical motion is related to horizontal motion in stationary eddies by Sverdrup and Ekman balance. These moisture- and vorticity-budget balances also hold in idealized and comprehensive GCM simulations across a range of climates.

By examining climate changes in the idealized and comprehensive GCM simulations, we are able to show the utility of the vertical motion P - E approximation for splitting changes in zonally anomalous P - E into thermodynamic and dynamic components. Shifts in divergent stationary-eddy circulations dominate changes in zonally anomalous P - E. This limits the local utility of the "wet gets wetter, dry gets drier” idea, where existing P - E patterns are amplified with warming by the increase in atmospheric moisture content, with atmospheric circulations held fixed. The increase in atmospheric moisture content manifests instead in an increase in the amplitude of the zonally anomalous hydrological cycle as measured by the zonal variance of P - E. However, dynamic changes, particularly the slowdown of divergent stationary-eddy circulations, limit the strengthening of the zonally anomalous hydrological cycle. In certain idealized cases, dynamic changes are even strong enough to reverse the tendency towards "wet gets wetter, dry gets drier” with warming.

Motivated by the importance of stationary-eddy vertical velocities in the moisture budget analysis, we examine controls on the amplitude of stationary eddies across a wide range of climates in an idealized GCM with simple topographic and ocean-heating zonal asymmetries. An analysis of the thermodynamic equation in the vicinity of topographic forcing reveals the importance of on-slope surface winds, the midlatitude isentropic slope, and latent heating in setting the amplitude of stationary waves. The response of stationary eddies to climate change is determined primarily by the strength of zonal surface winds hitting the mountain. The sensitivity of stationary-eddies to this surface forcing increases with climate change as the slope of midlatitude isentropes decreases. However, latent heating also plays an important role in damping the stationary-eddy response, and this damping becomes stronger with warming as the atmospheric moisture content increases. We find that the response of tropical overturning circulations forced by ocean heat-flux convergence is described by changes in the vertical structure of moist static energy and deep convection. This is used to derive simple scalings for the Walker circulation strength that capture the monotonic decrease with warming found in our idealized simulations.

Through the work of this thesis, the advances made in understanding the amplitude of stationary-waves in a changing climate can be directly applied to better understand and predict changes in the zonally anomalous hydrological cycle.

Isolation and characteristics of a bacteriophage for bacillus stearothermophilus

A bacteriophage (TØ3) which infects the thermophilic bacterium Bacillus stearothermophilus ATCC 8005 was isolated and characterized. Infection of the bacterium by the bacteriophage was carried out at 60°C, the optimum growth temperature of the host. At 60°C the phage has a latent period of 18 minutes and a burst size of about 200. The phage is comparatively thermostable in broth. The half life of the phage is 400 minutes at 60°C, 120 minutes at 65°C, 40 minutes at 70°C and 12 minutes at 75°C. The activation energy for the heat inactivation of TØ3 is 56,000 cal. The buoyant density of TØ3 in a cesium chloride density gradient is 1.526.

Electron micrographs of TØ3 indicate that the phage has a regular hexagonal shaped head 57 mμ long. The morphology of the head is compatible with icosahedral symmetry. Each edge of the head is 29 mμ long, and there are 6 or 7 subunits along each edge. The tail of TØ3 is 125 mμ long and 10 mμ wide. There are about 30 cross striations that are spaced at 3.9 mμ intervals along the tail.

The DNA of phage TØ3 has a melting temperature of 88.5°C. Heat denatured TØ3 DNA can be extensively annealed in a high ionic strength environment. The buoyant density of TØ3 DNA in a cesium chloride density gradient is 1.695. TØ3 DNA contains: 42.7% guanine plus cytosine, as determined from the melting temperature; 43% guanine plus cytosine, as determined from the buoyant density; and 40.2% guanine plus cytosine, as determined by chromatographic separation and spectrophotometric estimation of the bases. The molecular weight of TØ3 DNA is 16.7 X 10⁶ as determined from the band width of the TØ3 DNA concentration distribution in a cesium chloride density gradient. Electron microscopy of TØ3 DNA revealed a single linear molecule that is 11.7 μ long. This corresponds to a molecular weight of 22.5 X 10⁶.

Heat denatured TØ3 DNA forms two bands in a cesium chloride density gradient, one at a density of 1.707 and the other at a density of 1.715. After the separated bands are mixed and annealed in the centrifuge cell, the renatured TØ3 DNA forms a single band at a density of 1.699. These results indicate that the two complementary strands of TØ3 DNA have different buoyant densities in cesium chloride, presumably because they have different base compositions.

The characteristics of TØ3 are compared with those of other phages. A hypothesis is presented for a relationship between the base composition of one strand of TØ3 DNA and the amino acid composition of the proteins of TØ3.

Alkylation of ketones with 3-bromomethyl-1,2-benzisothiazoles

The synthesis of 3-bromomethyl-1,2-benzisothiazole and its 5- and 7-methoxy derivatives has been accomplished. In alkylation reactions, these bromides were found to behave much like benzylic bromides; and in this respect they have been used successfully to alkylate strongly basic enolates, thus introducing a latent β-phenylethyl moiety in situations where β-phenylethyl bromide and phenacyl bromide give at best poor yields of alkylated product. In several cases, degradative procedures have been devised to remove the heteroatoms from the benzisothiazoyl system to provide the actual β-phenylethyl fragment; however, no generally applicable degradative method has yet been developed.

I. Studies on the activation of Drosophila phenol oxidase. II. Studies on serum insulin in normal subjects and diabetics

Part I

Phenol oxidase is the enzyme responsible for hardening and pigmentation of the insect cuticle. In Drosophila, phenol oxidase is a latent enzyme. Enzyme activity is produced by the interaction of a number of protein components. A minimal activation scheme consisting of six protein components, designated Pre S, S activator, S, P. P' and Ʌ₁ is described. Quantitative assays have been developed for the S activator, S, P and P' proteins and these components have been partially purified. Experiments describing the interactions of the six components have been conducted and a model for the activation of phenol oxidase in a minimal system is proposed. Possible mechanisms of the reactions between the constituents of the activating system and potential regulatory mechanisms involved in phenol oxidase production and function are discussed.

Part II

A method has been developed for the partial purification of insulin from human serum. A procedure for the determination of the electrophoretic mobility of serum insulin on polyacrylamide gels is described. An electrophoretic analysis of insulin isolated from a normal subject is reported and in addition to a major band, the existence of a number of minor bands of immunoreactive insulin is described. A comparison of the electrophoretic patterns of insulin isolated from normal and diabetic subjects was carried out and indications that differences between them may occur are reported.