Latent variable models for neural data analysis

The brain is perhaps the most complex system to have ever been subjected to rigorous scientific investigation. The scale is staggering: over 10^11 neurons, each making an average of 10^3 synapses, with computation occurring on scales ranging from a single dendritic spine, to an entire cortical area. Slowly, we are beginning to acquire experimental tools that can gather the massive amounts of data needed to characterize this system. However, to understand and interpret these data will also require substantial strides in inferential and statistical techniques. This dissertation attempts to meet this need, extending and applying the modern tools of latent variable modeling to problems in neural data analysis.

It is divided into two parts. The first begins with an exposition of the general techniques of latent variable modeling. A new, extremely general, optimization algorithm is proposed - called Relaxation Expectation Maximization (REM) - that may be used to learn the optimal parameter values of arbitrary latent variable models. This algorithm appears to alleviate the common problem of convergence to local, sub-optimal, likelihood maxima. REM leads to a natural framework for model size selection; in combination with standard model selection techniques the quality of fits may be further improved, while the appropriate model size is automatically and efficiently determined. Next, a new latent variable model, the mixture of sparse hidden Markov models, is introduced, and approximate inference and learning algorithms are derived for it. This model is applied in the second part of the thesis.

The second part brings the technology of part I to bear on two important problems in experimental neuroscience. The first is known as spike sorting; this is the problem of separating the spikes from different neurons embedded within an extracellular recording. The dissertation offers the first thorough statistical analysis of this problem, which then yields the first powerful probabilistic solution. The second problem addressed is that of characterizing the distribution of spike trains recorded from the same neuron under identical experimental conditions. A latent variable model is proposed. Inference and learning in this model leads to new principled algorithms for smoothing and clustering of spike data.

Electron transfer in cytochrome c oxidase : the rate of electron equillibration between cytochrome a and copper A

Intramolecular electron transfer in partially reduced cytochrome c oxidase has been studied by means of perturbed equilibrium techniques. We have prepared a three electron reduced, CO inhibited form of the enzyme in which cytochrome a and copper A are partially reduced an in intramolecular redox equilibrium. When these samples were photolyzed using a nitrogen laser (0.6 µs, 1.0 mJ pulses) changes in absorbance at 598 nm and 830 nm were observed which are consistent with a fast electron from cytochrome a to copper A. The absorbance changes at 598 nm have an apparent rate of 17,200 ± 1,700 s^(-1) (1σ), at pH 7.0 and 25.5 °C. These changes were not observed in either the CO mixed valence or CO inhibited fully reduced forms of the enzyme. The rate is fastest at about pH 8.0, and falls off in either direction, and there is a small, but clear temperature dependence. The process was also observed in the cytochrome c -- cytochrome c oxidase high affinity complex.

This rate is far faster than any rate measured or inferred previously for the cytochrome a -- copper A electron equilibration, but the interpretation of these results is hampered by the fact that the relaxation could only be followed during the time before CO became rebound to the oxygen binding site. The meaning of our our measured rate is discussed, along with other reported rates for this process. In addition, a temperature-jump experiment on the same system is discussed.

We have also prepared a partially reduced, cyanide inhibited form of the enzyme in which cytochrome a, copper A and copper B are partially reduced and in redox equilibrium. Warming these samples produced absorbance changes at 605 nm which indicate that cytochrome a was becoming more oxidized, but there were no parallel changes in absorbance at 830 nm as would be expected if copper A was becoming reduced. We concluded that electrons were being redistributed from cytochrome a to copper B. The kinetics of the absorbance changes at 605 nm were investigated by temperature-jump methods. Although a rate could not be resolved, we concluded that the process must occur with an (apparent) rate larger than 10,000 s^(-1).

During the course of the temperature-jump experiments, we also found that non-redox related, temperature dependent absorbance changes in fully reduced CO inhibited cytochrome c oxidase, and in the cyanide mixed valence enzyme, took place with an (apparent) rate faster that 30,000 s^(-1).

Variable-angle electron spectroscopic studies of various polyatomic molecular systems

The complementary techniques of low-energy, variable-angle electron-impact spectroscopy and ultraviolet variable-angle photoelectron spectroscopy have been used to study the electronic spectroscopy and structure of several series of molecules. Electron-impact studies were performed at incident beam energies between 25 eV and 100 eV and at scattering angles ranging from 0° to 90°. The energy-loss regions from 0 eV to greater than 15 eV were studied. Photoelectron spectroscopic studies were conducted using a HeI radiation source and spectra were measured at scattering angles from 45° to 90°. The molecules studied were chosen because of their spectroscopic, chemical, and structural interest. The operation of a new electron-impact spectrometer with multiple-mode target source capability is described. This spectrometer has been used to investigate the spin-forbidden transitions in a number of molecular systems.

The electron-impact spectroscopy of the six chloro-substituted ethylenes has been studied over the energy-loss region from 0-15 eV. Spin-forbidden excitations corresponding to the π → π*, N → T transition have been observed at excitation energies ranging from 4.13 eV in vinyl chloride to 3.54 eV in tetrachloroethylene. Symmetry-forbidden transitions of the type π → np have been oberved in trans-dichloroethyene and tetrachlor oethylene. In addition, transitions to many states lying above the first ionization potential were observed for the first time. Many of these bands have been assigned to Rydberg series converging to higher ionization potentials. The trends observed in the measured transition energies for the π → π*, N → T, and N → V as well as the π → 3s excitation are discussed and compared to those observed in the methyl- and fluoro- substituted ethylenes.

The electron energy-loss spectra of the group VIb transition metal hexacarbonyls have been studied in the 0 eV to 15 eV region. The differential cross sections were obtained for several features in the 3-7 eV energy-loss region. The symmetry-forbidden nature of the ¹A_1g → ¹A_1g, 2t_2g(π) → 3t_2g(π*) transition in these compounds was confirmed by the high-energy, low-angle behavior of their relative intensities. Several low lying transitions have been assigned to ligand field transitions on the basis of the energy and angular behavior of the differential cross sections for these transitions. No transitions which could clearly be assigned to singlet → triplet excitations involving metal orbitals were located. A number of states lying above the first ionization potential have been observed for the first time. A number of features in the 6-14 eV energy-loss region of the spectra of these compounds correspond quite well to those observed in free CO.

A number of exploratory studies have been performed. The π → π*, N → T, singlet → triplet excitation has been located in vinyl bromide at 4.05 eV. We have also observed this transition at approximately 3.8 eV in a cis-/trans- mixture of the 1,2-dibromoethylenes. The low-angle spectrum of iron pentacarbonyl was measured over the energy-loss region extending from 2-12 eV. A number of transitions of 8 eV or greater excitation energy were observed for the first time. Cyclopropane was also studied at both high and low angles but no clear evidence for any spin- forbidden transitions was found. The electron-impact spectrum of the methyl radical resulting from the pyrolysis of tetramethyl tin was obtained at 100 eV incident energy and at 0° scattering angle. Transitions observed at 5.70 eV and 8.30 eV agree well with the previous optical results. In addition, a number of bands were observed in the 8-14 eV region which are most likely due to Rydberg transitions converging to the higher ionization potentials of this molecule. This is the first reported electron-impact spectrum of a polyatomic free radical.

Variable-angle photoelectron spectroscopic studies were performed on a series of three-membered-ring heterocyclic compounds. These compounds are of great interest due to their highly unusual structure. Photoelectron angular distributions using HeI radiation have been measured for the first time for ethylene oxide and ethyleneimine. The measured anisotropy parameters, β, along with those measured for cyclopropane were used to confirm the orbital correlations and photoelectron band assignments. No high values of β similar to those expected for alkene π orbitals were observed for the Walsh or Forster-Coulson-Moffit type orbitals.

Electron flow through cytochrome P450

The cytochromes P450 (P450s) are a remarkable class of heme enzymes that catalyze the metabolism of xenobiotics and the biosynthesis of signaling molecules. Controlled electron flow into the thiolate-ligated heme active site allows P450s to activate molecular oxygen and hydroxylate aliphatic C–H bonds via the formation of high-valent metal-oxo intermediates (compounds I and II). Due to the reactive nature and short lifetimes of these intermediates, many of the fundamental steps in catalysis have not been observed directly. The Gray group and others have developed photochemical methods, known as “flash-quench,” for triggering electron transfer (ET) and generating redox intermediates in proteins in the absence of native ET partners. Photo-triggering affords a high degree of temporal precision for the gating of an ET event; the initial ET and subsequent reactions can be monitored on the nanosecond-to-second timescale using transient absorption (TA) spectroscopies. Chapter 1 catalogues critical aspects of P450 structure and mechanism, including the native pathway for formation of compound I, and outlines the development of photochemical processes that can be used to artificially trigger ET in proteins. Chapters 2 and 3 describe the development of these photochemical methods to establish electronic communication between a photosensitizer and the buried P450 heme. Chapter 2 describes the design and characterization of a Ru-P450-BM3 conjugate containing a ruthenium photosensitizer covalently tethered to the P450 surface, and nanosecond-to-second kinetics of the photo-triggered ET event are presented. By analyzing data at multiple wavelengths, we have identified the formation of multiple ET intermediates, including the catalytically relevant compound II; this intermediate is generated by oxidation of a bound water molecule in the ferric resting state enzyme. The work in Chapter 3 probes the role of a tryptophan residue situated between the photosensitizer and heme in the aforementioned Ru-P450 BM3 conjugate. Replacement of this tryptophan with histidine does not perturb the P450 structure, yet it completely eliminates the ET reactivity described in Chapter 2. The presence of an analogous tryptophan in Ru-P450 CYP119 conjugates also is necessary for observing oxidative ET, but the yield of heme oxidation is lower. Chapter 4 offers a basic description of the theoretical underpinnings required to analyze ET. Single-step ET theory is first presented, followed by extensions to multistep ET: electron “hopping.” The generation of “hopping maps” and use of a hopping map program to analyze the rate advantage of hopping over single-step ET is described, beginning with an established rhenium-tryptophan-azurin hopping system. This ET analysis is then applied to the Ru-tryptophan-P450 systems described in Chapter 2; this strongly supports the presence of hopping in Ru-P450 conjugates. Chapter 5 explores the implementation of flash-quench and other phototriggered methods to examine the native reductive ET and gas binding events that activate molecular oxygen. In particular, TA kinetics that demonstrate heme reduction on the microsecond timescale for four Ru-P450 conjugates are presented. In addition, we implement laser flash-photolysis of P450 ferrous–CO to study the rates of CO rebinding in the thermophilic P450 CYP119 at variable temperature. Chapter 6 describes the development and implementation of air-sensitive potentiometric redox titrations to determine the solution reduction potentials of a series of P450 BM3 mutants, which were designed for non-native cyclopropanation of styrene in vivo. An important conclusion from this work is that substitution of the axial cysteine for serine shifts the wild type reduction potential positive by 130 mV, facilitating reduction by biological redox cofactors in the presence of poorly-bound substrates. While this mutation abolishes oxygenation activity, these mutants are capable of catalyzing the cyclopropanation of styrene, even within the confines of an E. coli cell. Four appendices are also provided, including photochemical heme oxidation in ruthenium-modified nitric oxide synthase (Appendix A), general protocols (Appendix B), Chapter-specific notes (Appendix C) and Matlab scripts used for data analysis (Appendix D).

Towards understanding the mixing characteristics of turbulent buoyant flows

This work proposes a new simulation methodology in which variable density turbulent flows can be studied in the context of a mixing layer with or without the presence of gravity. Specifically, this methodology is developed to probe the nature of non-buoyantly-driven (i.e. isotropically-driven) or buoyantly-driven mixing deep inside a mixing layer. Numerical forcing methods are incorporated into both the velocity and scalar fields, which extends the length of time over which mixing physics can be studied. The simulation framework is designed to allow for independent variation of four non-dimensional parameters, including the Reynolds, Richardson, Atwood, and Schmidt numbers. Additionally, the governing equations are integrated in such a way to allow for the relative magnitude of buoyant energy production and non-buoyant energy production to be varied.

The computational requirements needed to implement the proposed configuration are presented. They are justified in terms of grid resolution, order of accuracy, and transport scheme. Canonical features of turbulent buoyant flows are reproduced as validation of the proposed methodology. These features include the recovery of isotropic Kolmogorov scales under buoyant and non-buoyant conditions, the recovery of anisotropic one-dimensional energy spectra under buoyant conditions, and the preservation of known statistical distributions in the scalar field, as found in other DNS studies.

This simulation methodology is used to perform a parametric study of turbulent buoyant flows to discern the effects of varying the Reynolds, Richardson, and Atwood numbers on the resulting state of mixing. The effects of the Reynolds and Atwood numbers are isolated by looking at two energy dissipation rate conditions under non-buoyant (variable density) and constant density conditions. The effects of Richardson number are isolated by varying the ratio of buoyant energy production to total energy production from zero (non-buoyant) to one (entirely buoyant) under constant Atwood number, Schmidt number, and energy dissipation rate conditions. It is found that the major differences between non-buoyant and buoyant turbulent flows are contained in the transfer spectrum and longitudinal structure functions, while all other metrics are largely similar (e.g. energy spectra, alignment characteristics of the strain-rate tensor). Also, despite the differences noted between fully buoyant and non-buoyant turbulent fields, the scalar field, in all cases, is unchanged by these. The mixing dynamics in the scalar field are found to be insensitive to the source of turbulent kinetic energy production (non-buoyant vs. buoyant).

Part I. Kinetics of coarsening of the gamma-prime precipitate in nickel-silicon alloys. Part II. Rate of crystallization of an amorphous Fe-P-C alloy

The coarsening kinetics of Ni₃ Si(γ') precipitate in a binary Ni-Si alloy containing 6.5 wt. % silicon was studied by magnetic techniques and transmission electronmicroscopy. A calibration curve was established to determine the concentration of silicon in the matrix. The variation of the Si content of the Ni-rich matrix as a function of time follows Lifshitz and Wagner theory for diffusion controlled coarsening phenomena. The estimated values of equilibrium solubility of silicon in the matrix represent the true coherent equilibrium solubilities.

The experimental particle-size distributions and average particle size were determined from dark field electron micrographs. The average particle size varies linearly with t^-1/3 as suggested by Lifshitz and Wagner. The experimental distributions of particle sizes differ slightly from the theoretical curve at the early stages of aging, but the agreement is satisfactory at the later stages. The values of diffusion coefficient of silicon, interfacial free energy and activation energy were calculated from the results of coarsening kinetics. The experimental value of effective diffusion coefficient is in satisfactory agreement with the value predicted by the application of irreversible the rmodynamics to the process of volume constrained growth of coherent precipitate during coarsening. The coherent γ' particles in Ni-Sialloy unlike those in Ni-Al and Ni-Ti seem to lose coherency at high temperature. A mechanism for the formation of semi-coherent precipitate is suggested.

Rate and Microstructure Effects on the Dynamics of Carbon Nanotube Foams

Soft hierarchical materials often present unique functional properties that are sensitive to the geometry and organization of their micro- and nano-structural features across different lengthscales. Carbon Nanotube (CNT) foams are hierarchical materials with fibrous morphology that are known for their remarkable physical, chemical and electrical properties. Their complex microstructure has led them to exhibit intriguing mechanical responses at different length-scales and in different loading regimes. Even though these materials have been studied for mechanical behavior over the past few years, their response at high-rate finite deformations and the influence of their microstructure on bulk mechanical behavior and energy dissipative characteristics remain elusive.

In this dissertation, we study the response of aligned CNT foams at the high strain-rate regime of 10² - 10⁴ s^-1. We investigate their bulk dynamic response and the fundamental deformation mechanisms at different lengthscales, and correlate them to the microstructural characteristics of the foams. We develop an experimental platform, with which to study the mechanics of CNT foams in high-rate deformations, that includes direct measurements of the strain and transmitted forces, and allows for a full field visualization of the sample’s deformation through high-speed microscopy.

We synthesize various CNT foams (e.g., vertically aligned CNT (VACNT) foams, helical CNT foams, micro-architectured VACNT foams and VACNT foams with microscale heterogeneities) and show that the bulk functional properties of these materials are highly tunable either by tailoring their microstructure during synthesis or by designing micro-architectures that exploit the principles of structural mechanics. We also develop numerical models to describe the bulk dynamic response using multiscale mass-spring models and identify the mechanical properties at length scales that are smaller than the sample height.

The ability to control the geometry of microstructural features, and their local interactions, allows the creation of novel hierarchical materials with desired functional properties. The fundamental understanding provided by this work on the key structure-function relations that govern the bulk response of CNT foams can be extended to other fibrous, soft and hierarchical materials. The findings can be used to design materials with tailored properties for different engineering applications, like vibration damping, impact mitigation and packaging.

Characterization and modeling of premixed turbulent n-heptane flames in the thin reaction zone regime

n-heptane/air premixed turbulent flames in the high-Karlovitz portion of the thin reaction zone regime are characterized and modeled in this thesis using Direct Numerical Simulations (DNS) with detailed chemistry. In order to perform these simulations, a time-integration scheme that can efficiently handle the stiffness of the equations solved is developed first. A first simulation with unity Lewis number is considered in order to assess the effect of turbulence on the flame in the absence of differential diffusion. A second simulation with non-unity Lewis numbers is considered to study how turbulence affects differential diffusion. In the absence of differential diffusion, minimal departure from the 1D unstretched flame structure (species vs. temperature profiles) is observed. In the non-unity Lewis number case, the flame structure lies between that of 1D unstretched flames with "laminar" non-unity Lewis numbers and unity Lewis number. This is attributed to effective Lewis numbers resulting from intense turbulent mixing and a first model is proposed. The reaction zone is shown to be thin for both flames, yet large chemical source term fluctuations are observed. The fuel consumption rate is found to be only weakly correlated with stretch, although local extinctions in the non-unity Lewis number case are well correlated with high curvature. These results explain the apparent turbulent flame speeds. Other variables that better correlate with this fuel burning rate are identified through a coordinate transformation. It is shown that the unity Lewis number turbulent flames can be accurately described by a set of 1D (in progress variable space) flamelet equations parameterized by the dissipation rate of the progress variable. In the non-unity Lewis number flames, the flamelet equations suggest a dependence on a second parameter, the diffusion of the progress variable. A new tabulation approach is proposed for the simulation of such flames with these dimensionally-reduced manifolds.

I. The rate and mechanism of the vapor-phase reaction between water and parts-per-million concentrations of nitrogen dioxide. II. The rate and mechanism of the air oxidation of parts-per-million concentrations of nitric oxide in the presence of water vapor.

Part I

A study of the thermal reaction of water vapor and parts-per-million concentrations of nitrogen dioxide was carried out at ambient temperature and at atmospheric pressure. Nitric oxide and nitric acid vapor were the principal products. The initial rate of disappearance of nitrogen dioxide was first order with respect to water vapor and second order with respect to nitrogen dioxide. An initial third-order rate constant of 5.5 (± 0.29) x 10⁴ liter² mole^-2 sec^-1 was found at 25˚C. The rate of reaction decreased with increasing temperature. In the temperature range of 25˚C to 50˚C, an activation energy of -978 (± 20) calories was found.

The reaction did not go to completion. From measurements as the reaction approached equilibrium, the free energy of nitric acid vapor was calculated. This value was -18.58 (± 0.04) kilocalories at 25˚C.

The initial rate of reaction was unaffected by the presence of oxygen and was retarded by the presence of nitric oxide. There were no appreciable effects due to the surface of the reactor. Nitric oxide and nitrogen dioxide were monitored by gas chromatography during the reaction.

Part II

The air oxidation of nitric oxide, and the oxidation of nitric oxide in the presence of water vapor, were studied in a glass reactor at ambient temperatures and at atmospheric pressure. The concentration of nitric oxide was less than 100 parts-per-million. The concentration of nitrogen dioxide was monitored by gas chromatography during the reaction.

For the dry oxidation, the third-order rate constant was 1.46 (± 0.03) x 10⁴ liter² mole^-2 sec^-1 at 25˚C. The activation energy, obtained from measurements between 25˚C and 50˚C, was -1.197 (±0.02) kilocalories.

The presence of water vapor during the oxidation caused the formation of nitrous acid vapor when nitric oxide, nitrogen dioxide and water vapor combined. By measuring the difference between the concentrations of nitrogen dioxide during the wet and dry oxidations, the rate of formation of nitrous acid vapor was found. The third-order rate constant for the formation of nitrous acid vapor was equal to 1.5 (± 0.5) x 10⁵ liter² mole^-2 sec^-1 at 40˚C. The reaction rate did not change measurably when the temperature was increased to 50˚C. The formation of nitric acid vapor was prevented by keeping the concentration of nitrogen dioxide low.

Surface effects were appreciable for the wet tests. Below 35˚C, the rate of appearance of nitrogen dioxide increased with increasing surface. Above 40˚C, the effect of surface was small.

Firing Patterns of Cerebellar Purkinje Cells During Locomotion and Sleep

The cerebellum is a major supraspinal center involved in the coordination of movement. The principal neurons of the cerebellar cortex, Purkinje cells, receive excitatory synaptic input from two sources: the parallel and climbing fibers. These pathways have markedly different effects: the parallel fibers control the rate of simple sodium spikes, while the climbing fibers induce characteristic complex spike bursts, which are accompanied by dendritic calcium transients and play a key role in regulating synaptic plasticity. While many studies using a variety of species, behaviors, and cerebellar regions have documented modulation in Purkinje cell activity during movement, few have attempted to record from these neurons in unrestrained rodents. In this dissertation, we use chronic, multi-tetrode recording in freely-behaving rats to study simple and complex spike firing patterns during locomotion and sleep. Purkinje cells discharge rhythmically during stepping, but this activity is highly variable across steps. We show that behavioral variables systematically influence the step-locked firing rate in a step-phase-dependent way, revealing a functional clustering of Purkinje cells. Furthermore, we find a pronounced disassociation between patterns of variability driven by the parallel and climbing fibers, as well as functional differences between cerebellar lobules. These results suggest that Purkinje cell activity not only represents step phase within each cycle, but is also shaped by behavior across steps, facilitating control of movement under dynamic conditions. During sleep, we observe an attenuation of both simple and complex spiking, relative to awake behavior. Although firing rates during slow wave sleep (SWS) and rapid eye movement sleep (REM) are similar, simple spike activity is highly regular in SWS, while REM is characterized by phasic increases and pauses in simple spiking. This phasic activity in REM is associated with pontine waves, which propagate into the cerebellar cortex and modulate both simple and complex spiking. Such a temporal coincidence between parallel and climbing fiber activity is known to drive plasticity at parallel fiber synapses; consequently, pontocerebellar waves may provide a mechanism for tuning synaptic weights in the cerebellum during active sleep.

The rate and mechanism of the partial oxidation of acetaldehyde by PPM concentrations of nitrogen dioxide

The thermal reaction between nitrogen dioxide and acetaldehyde in the gas phase was investigated at room temperature and atmospheric pressure. The initial rate of disappearance of nitrogen dioxide was 1.00 ± 0.03 order with respect to nitrogen dioxide and 1.00 ± 0.07 order with respect to acetaldehyde. An initial second order rate constant of (8.596 ± 0.189) x 10^-3 1.mole^-1 sec^-1 was obtained at 22.0 ± 0.1 °C and a total pressure of one atmosphere. The activation energy of the reaction was 12,900 cal/mole in the temperature range between 22°C and 122°C.

The products of the reaction were nitric oxide, carbon dioxide, methyl nitrite, nitromethane and a trace amount of trans-dimeric nitrosomethane. The addition of nitric oxide increased the rate of formation of nitromethane and decreased the rate of formation of methyl nitrite. There were no measurable surface effects due to the addition of glass wool or glass beads to the reactor.

Reactants and products were analyzed by gas chromatography. A mechanism was proposed incorporating the principal features of the reaction.