Latent variable models for neural data analysis

The brain is perhaps the most complex system to have ever been subjected to rigorous scientific investigation. The scale is staggering: over 10^11 neurons, each making an average of 10^3 synapses, with computation occurring on scales ranging from a single dendritic spine, to an entire cortical area. Slowly, we are beginning to acquire experimental tools that can gather the massive amounts of data needed to characterize this system. However, to understand and interpret these data will also require substantial strides in inferential and statistical techniques. This dissertation attempts to meet this need, extending and applying the modern tools of latent variable modeling to problems in neural data analysis.

It is divided into two parts. The first begins with an exposition of the general techniques of latent variable modeling. A new, extremely general, optimization algorithm is proposed - called Relaxation Expectation Maximization (REM) - that may be used to learn the optimal parameter values of arbitrary latent variable models. This algorithm appears to alleviate the common problem of convergence to local, sub-optimal, likelihood maxima. REM leads to a natural framework for model size selection; in combination with standard model selection techniques the quality of fits may be further improved, while the appropriate model size is automatically and efficiently determined. Next, a new latent variable model, the mixture of sparse hidden Markov models, is introduced, and approximate inference and learning algorithms are derived for it. This model is applied in the second part of the thesis.

The second part brings the technology of part I to bear on two important problems in experimental neuroscience. The first is known as spike sorting; this is the problem of separating the spikes from different neurons embedded within an extracellular recording. The dissertation offers the first thorough statistical analysis of this problem, which then yields the first powerful probabilistic solution. The second problem addressed is that of characterizing the distribution of spike trains recorded from the same neuron under identical experimental conditions. A latent variable model is proposed. Inference and learning in this model leads to new principled algorithms for smoothing and clustering of spike data.

Molecular mechanism of sulfated carbohydrate recognition: structural and biochemical studies of the cysteine-rich domain of mannose receptor

Mannose receptor (MR) is widely expressed on macrophages, immature dendritic cells, and a variety of epithelial and endothelial cells. It is a 180 kD type I transmembrane receptor whose extracellular region consists of three parts: the amino-terminal cysteine-rich domain (Cys-MR); a fibronectin type II-like domain; and a series of eight tandem C-type lectin carbohydrate recognition domains (CRDs). Two portions of MR have distinct carbohydrate recognition properties: Cys-MR recognizes sulfated carbohydrates and the tandem CRD region binds terminal mannose, fucose, and N-acetyl-glucosamine (GlcNAc). The dual carbohydrate binding specificity allows MR to interact with sulfated and nonsulfated polysaccharide chains, and thereby facilitating the involvement of MR in immunological and physiological processes. The immunological functions of MR include antigen capturing (through binding non-sulfated carbohydrates) and antigen targeting (through binding sulfated carbohydrates), and the physiological roles include rapid clearance of circulatory luteinizing hormone (LH), which bears polysaccharide chains terminating with sulfated and non-sulfated carbohydrates.

We have crystallized and determined the X-ray structures of unliganded Cys-MR (2.0 Å) and Cys-MR complexed with different ligands, including Hepes (1.7 Å), 4SO_4-N-Acetylgalactosamine (4SO_4-GalNAc; 2.2 Å), 3SO_4-Lewis^x (2.2 Å), 3S04-Lewis^a (1.9 Å), and 6SO_4-GalNAc (2.5 Å). The overall structure of Cys-MR consists of 12 anti-parallel β-strands arranged in three lobes with approximate three fold internal symmetry. The structure contains three disulfide bonds, formed by the six cysteines in the Cys-MR sequence. The ligand-binding site is located in a neutral pocket within the third lobe, in which the sulfate group of ligand is buried. Our results show that optimal binding is achieved by a carbohydrate ligand with a sulfate group that anchors the ligand by forming numerous hydrogen bonds and a sugar ring that makes ring-stacking interactions with Trpll7 of CysMR. Using a fluorescence-based assay, we characterized the binding affinities between CysMR and its ligands, and rationalized the derived affinities based upon the crystal structures. These studies reveal the mechanism of sulfated carbohydrate recognition by Cys-MR and facilitate our understanding of the role of Cys-MR in MR recognition of its ligands.

Biophysical and network mechanisms of high frequency extracellular potentials in the rat hippocampus

A fundamental question in neuroscience is how distributed networks of neurons communicate and coordinate dynamically and specifically. Several models propose that oscillating local networks can transiently couple to each other through phase-locked firing. Coherent local field potentials (LFP) between synaptically connected regions is often presented as evidence for such coupling. The physiological correlates of LFP signals depend on many anatomical and physiological factors, however, and how the underlying neural processes collectively generate features of different spatiotemporal scales is poorly understood. High frequency oscillations in the hippocampus, including gamma rhythms (30-100 Hz) that are organized by the theta oscillations (5-10 Hz) during active exploration and REM sleep, as well as sharp wave-ripples (SWRs, 140-200 Hz) during immobility or slow wave sleep, have each been associated with various aspects of learning and memory. Deciphering their physiology and functional consequences is crucial to understanding the operation of the hippocampal network.

We investigated the origins and coordination of high frequency LFPs in the hippocampo-entorhinal network using both biophysical models and analyses of large-scale recordings in behaving and sleeping rats. We found that the synchronization of pyramidal cell spikes substantially shapes, or even dominates, the electrical signature of SWRs in area CA1 of the hippocampus. The precise mechanisms coordinating this synchrony are still unresolved, but they appear to also affect CA1 activity during theta oscillations. The input to CA1, which often arrives in the form of gamma-frequency waves of activity from area CA3 and layer 3 of entorhinal cortex (EC3), did not strongly influence the timing of CA1 pyramidal cells. Rather, our data are more consistent with local network interactions governing pyramidal cells' spike timing during the integration of their inputs. Furthermore, the relative timing of input from EC3 and CA3 during the theta cycle matched that found in previous work to engage mechanisms for synapse modification and active dendritic processes. Our work demonstrates how local networks interact with upstream inputs to generate a coordinated hippocampal output during behavior and sleep, in the form of theta-gamma coupling and SWRs.

Contribution of the temporoammonic pathway to hippocampal processing

The temporoammonic (TA) pathway is the direct, monosynaptic projection from layer III of entorhinal cortex to the distal dendritic region of area CA1 of the hippo­ campus. Although this pathway has been implicated in various functions, such as memory encoding and retrieval, spatial navigation, generation of oscillatory activity, and control of hippocampal excitability, the details of its physiology are not well understood. In this thesis, I examine the contribution of the TA pathway to hippocampal processing. I find that, as has been previously reported, the TA pathway includes both excitatory, glutamatergic components and inhibitory, GABAergic components. Several new discoveries are reported in this thesis. I show that the TA pathway is subject to forms of short-term activity-dependent regulation, including paired-pulse and frequency­ dependent plasticity, similar to other hippocampal pathways such as the Schaffer collateral (SC) input from CA3 to CA1. The TA pathway provides a strongly excitatory input to stratum radiatum giant cells of CA1. The excitatory component of the TA pathway undergoes a long-lasting decrease in synaptic strength following low-frequency stimulation in a manner partially dependent on the activation of NMDA receptors. High­ frequency activation of the TA pathway recruits a feedforward inhibition that can prevent CA1 pyramidal cells from spiking in response to SC input; this spike-blocking effect shows that the TA pathway can act to regulate information flow through the hippocampal trisynaptic pathway.

Firing Patterns of Cerebellar Purkinje Cells During Locomotion and Sleep

The cerebellum is a major supraspinal center involved in the coordination of movement. The principal neurons of the cerebellar cortex, Purkinje cells, receive excitatory synaptic input from two sources: the parallel and climbing fibers. These pathways have markedly different effects: the parallel fibers control the rate of simple sodium spikes, while the climbing fibers induce characteristic complex spike bursts, which are accompanied by dendritic calcium transients and play a key role in regulating synaptic plasticity. While many studies using a variety of species, behaviors, and cerebellar regions have documented modulation in Purkinje cell activity during movement, few have attempted to record from these neurons in unrestrained rodents. In this dissertation, we use chronic, multi-tetrode recording in freely-behaving rats to study simple and complex spike firing patterns during locomotion and sleep. Purkinje cells discharge rhythmically during stepping, but this activity is highly variable across steps. We show that behavioral variables systematically influence the step-locked firing rate in a step-phase-dependent way, revealing a functional clustering of Purkinje cells. Furthermore, we find a pronounced disassociation between patterns of variability driven by the parallel and climbing fibers, as well as functional differences between cerebellar lobules. These results suggest that Purkinje cell activity not only represents step phase within each cycle, but is also shaped by behavior across steps, facilitating control of movement under dynamic conditions. During sleep, we observe an attenuation of both simple and complex spiking, relative to awake behavior. Although firing rates during slow wave sleep (SWS) and rapid eye movement sleep (REM) are similar, simple spike activity is highly regular in SWS, while REM is characterized by phasic increases and pauses in simple spiking. This phasic activity in REM is associated with pontine waves, which propagate into the cerebellar cortex and modulate both simple and complex spiking. Such a temporal coincidence between parallel and climbing fiber activity is known to drive plasticity at parallel fiber synapses; consequently, pontocerebellar waves may provide a mechanism for tuning synaptic weights in the cerebellum during active sleep.

The Physiology and Computation of Pyramidal Neurons

A variety of neural signals have been measured as correlates to consciousness. In particular, late current sinks in layer 1, distributed activity across the cortex, and feedback processing have all been implicated. What are the physiological underpinnings of these signals? What computational role do they play in the brain? Why do they correlate to consciousness? This thesis begins to answer these questions by focusing on the pyramidal neuron. As the primary communicator of long-range feedforward and feedback signals in the cortex, the pyramidal neuron is set up to play an important role in establishing distributed representations. Additionally, the dendritic extent, reaching layer 1, is well situated to receive feedback inputs and contribute to current sinks in the upper layers. An investigation of pyramidal neuron physiology is therefore necessary to understand how the brain creates, and potentially uses, the neural correlates of consciousness. An important part of this thesis will be in establishing the computational role that dendritic physiology plays. In order to do this, a combined experimental and modeling approach is used.

This thesis beings with single-cell experiments in layer 5 and layer 2/3 pyramidal neurons. In both cases, dendritic nonlinearities are characterized and found to be integral regulators of neural output. Particular attention is paid to calcium spikes and NMDA spikes, which both exist in the apical dendrites, considerable distances from the spike initiation zone. These experiments are then used to create detailed multicompartmental models. These models are used to test hypothesis regarding spatial distribution of membrane channels, to quantify the effects of certain experimental manipulations, and to establish the computational properties of the single cell. We find that the pyramidal neuron physiology can carry out a coincidence detection mechanism. Further abstraction of these models reveals potential mechanisms for spike time control, frequency modulation, and tuning. Finally, a set of experiments are carried out to establish the effect of long-range feedback inputs onto the pyramidal neuron. A final discussion then explores a potential way in which the physiology of pyramidal neurons can establish distributed representations, and contribute to consciousness.