Latent variable models for neural data analysis

The brain is perhaps the most complex system to have ever been subjected to rigorous scientific investigation. The scale is staggering: over 10^11 neurons, each making an average of 10^3 synapses, with computation occurring on scales ranging from a single dendritic spine, to an entire cortical area. Slowly, we are beginning to acquire experimental tools that can gather the massive amounts of data needed to characterize this system. However, to understand and interpret these data will also require substantial strides in inferential and statistical techniques. This dissertation attempts to meet this need, extending and applying the modern tools of latent variable modeling to problems in neural data analysis.

It is divided into two parts. The first begins with an exposition of the general techniques of latent variable modeling. A new, extremely general, optimization algorithm is proposed - called Relaxation Expectation Maximization (REM) - that may be used to learn the optimal parameter values of arbitrary latent variable models. This algorithm appears to alleviate the common problem of convergence to local, sub-optimal, likelihood maxima. REM leads to a natural framework for model size selection; in combination with standard model selection techniques the quality of fits may be further improved, while the appropriate model size is automatically and efficiently determined. Next, a new latent variable model, the mixture of sparse hidden Markov models, is introduced, and approximate inference and learning algorithms are derived for it. This model is applied in the second part of the thesis.

The second part brings the technology of part I to bear on two important problems in experimental neuroscience. The first is known as spike sorting; this is the problem of separating the spikes from different neurons embedded within an extracellular recording. The dissertation offers the first thorough statistical analysis of this problem, which then yields the first powerful probabilistic solution. The second problem addressed is that of characterizing the distribution of spike trains recorded from the same neuron under identical experimental conditions. A latent variable model is proposed. Inference and learning in this model leads to new principled algorithms for smoothing and clustering of spike data.

Imaging and tracking single fluorescent nanobeads in solution

In single-particle tracking (SPT), fluorescence video microscopy is used to record the motion images of single particle or single molecule. Here, by using a total-internal-reflection microscope equipped with an argon ion laser and a charge-coupled device (CCD) camera with high-speed and high-sensitivity, video images of single nanobeads in solutions were obtained. From the trajectories, the diffusion coefficient of individual nanobead was determined by the mean square displacements as a function of time. The sizes of nanobeads were calculated by Stokes-Einstein equation, and the results were compared with the actual values.

Phase transitions from the solid state of monatomic elements

The principle aims of this thesis include the development of models of sublimation and melting from first principles and the application of these models to the rare gases.

A simple physical model is constructed to represent the sublimation of monatomic elements. According to this model, the solid and gas phases are two states of a single physical system. The nature of the phase transition is clearly revealed, and the relations between the vapor pressure, the latent heat, and the transition temperature are derived. The resulting theory is applied to argon, krypton, and xenon, and good agreement with experiment is found.

For the melting transition, the solid is represented by an anharmonic model and the liquid is described by the Percus-Yevick approximation. The behavior of the liquid at high densities is studied on the isotherms kT/∈ = 1.3, 1.8, and 2.0, where k is Boltzmann's constant, T is the temperature, and e is the well depth of the Lennard-Jones 12-6 pair potential. No solutions of the PercusYevick equation were found for ρσ³ above 1.3, where ρ is the particle density and σ is the radial parameter of the Lennard-Jones potential. The liquid structure is found to be very different from the solid structure near the melting line. The liquid pressures are about 50 percent low for experimental melting densities of argon. This discrepancy gives rise to melting pressures up to twice the experimental values.

Technology for Single Cell Protein Analysis in Immunology and Cancer Prognostics

The first chapter of this thesis deals with automating data gathering for single cell microfluidic tests. The programs developed saved significant amounts of time with no loss in accuracy. The technology from this chapter was applied to experiments in both Chapters 4 and 5.

The second chapter describes the use of statistical learning to prognose if an anti-angiogenic drug (Bevacizumab) would successfully treat a glioblastoma multiforme tumor. This was conducted by first measuring protein levels from 92 blood samples using the DNA-encoded antibody library platform. This allowed the measure of 35 different proteins per sample, with comparable sensitivity to ELISA. Two statistical learning models were developed in order to predict whether the treatment would succeed. The first, logistic regression, predicted with 85% accuracy and an AUC of 0.901 using a five protein panel. These five proteins were statistically significant predictors and gave insight into the mechanism behind anti-angiogenic success/failure. The second model, an ensemble model of logistic regression, kNN, and random forest, predicted with a slightly higher accuracy of 87%.

The third chapter details the development of a photocleavable conjugate that multiplexed cell surface detection in microfluidic devices. The method successfully detected streptavidin on coated beads with 92% positive predictive rate. Furthermore, chambers with 0, 1, 2, and 3+ beads were statistically distinguishable. The method was then used to detect CD3 on Jurkat T cells, yielding a positive predictive rate of 49% and false positive rate of 0%.

The fourth chapter talks about the use of measuring T cell polyfunctionality in order to predict whether a patient will succeed an adoptive T cells transfer therapy. In 15 patients, we measured 10 proteins from individual T cells (~300 cells per patient). The polyfunctional strength index was calculated, which was then correlated with the patient's progress free survival (PFS) time. 52 other parameters measured in the single cell test were correlated with the PFS. No statistical correlator has been determined, however, and more data is necessary to reach a conclusion.

Finally, the fifth chapter talks about the interactions between T cells and how that affects their protein secretion. It was observed that T cells in direct contact selectively enhance their protein secretion, in some cases by over 5 fold. This occurred for Granzyme B, Perforin, CCL4, TNFa, and IFNg. IL- 10 was shown to decrease slightly upon contact. This phenomenon held true for T cells from all patients tested (n=8). Using single cell data, the theoretical protein secretion frequency was calculated for two cells and then compared to the observed rate of secretion for both two cells not in contact, and two cells in contact. In over 90% of cases, the theoretical protein secretion rate matched that of two cells not in contact.

I. Quantum mechanics of one-dimensional two-particle models. II. A quantum mechanical treatment of inelastic collisions

Part I

Solutions of Schrödinger’s equation for system of two particles bound in various stationary one-dimensional potential wells and repelling each other with a Coulomb force are obtained by the method of finite differences. The general properties of such systems are worked out in detail for the case of two electrons in an infinite square well. For small well widths (1-10 a.u.) the energy levels lie above those of the noninteresting particle model by as much as a factor of 4, although excitation energies are only half again as great. The analytical form of the solutions is obtained and it is shown that every eigenstate is doubly degenerate due to the “pathological” nature of the one-dimensional Coulomb potential. This degeneracy is verified numerically by the finite-difference method. The properties of the square-well system are compared with those of the free-electron and hard-sphere models; perturbation and variational treatments are also carried out using the hard-sphere Hamiltonian as a zeroth-order approximation. The lowest several finite-difference eigenvalues converge from below with decreasing mesh size to energies below those of the “best” linear variational function consisting of hard-sphere eigenfunctions. The finite-difference solutions in general yield expectation values and matrix elements as accurate as those obtained using the “best” variational function.

The system of two electrons in a parabolic well is also treated by finite differences. In this system it is possible to separate the center-of-mass motion and hence to effect a considerable numerical simplification. It is shown that the pathological one-dimensional Coulomb potential gives rise to doubly degenerate eigenstates for the parabolic well in exactly the same manner as for the infinite square well.

Part II

A general method of treating inelastic collisions quantum mechanically is developed and applied to several one-dimensional models. The formalism is first developed for nonreactive “vibrational” excitations of a bound system by an incident free particle. It is then extended to treat simple exchange reactions of the form A + BC →AB + C. The method consists essentially of finding a set of linearly independent solutions of the Schrödinger equation such that each solution of the set satisfies a distinct, yet arbitrary boundary condition specified in the asymptotic region. These linearly independent solutions are then combined to form a total scattering wavefunction having the correct asymptotic form. The method of finite differences is used to determine the linearly independent functions.

The theory is applied to the impulsive collision of a free particle with a particle bound in (1) an infinite square well and (2) a parabolic well. Calculated transition probabilities agree well with previously obtained values.

Several models for the exchange reaction involving three identical particles are also treated: (1) infinite-square-well potential surface, in which all three particles interact as hard spheres and each two-particle subsystem (i.e. BC and AB) is bound by an attractive infinite-square-well potential; (2) truncated parabolic potential surface, in which the two-particle subsystems are bound by a harmonic oscillator potential which becomes infinite for interparticle separations greater than a certain value; (3) parabolic (untruncated) surface. Although there are no published values with which to compare our reaction probabilities, several independent checks on internal consistency indicate that the results are reliable.

The predicting power of models for eutrophication

Restoration of water-bodies from eutrophication has proved to be extremely difficult. Mathematical models have been used extensively to provide guidance for management decisions. The aim of this paper is to elucidate important problems of using models for predicting environmental changes. First, the necessity for a proper uncertainty assessment of the model, upon calibration, has not been widely recognized. Predictions must not be a single time trajectory; they should be a band, expressing system uncertainty and natural variability. Availability of this information may alter the decision to be taken. Second, even with well-calibrated models, there is no guarantee they will give correct projections in situations where the model is used to predict the effects of measures designed to bring the system into an entirely different ”operating point”, as is typically the case in eutrophication abatement. The concept of educated speculation is introduced to partially overcome this difficulty. Lake Veluwe is used as a case to illustrate the point. Third, as questions become more detailed, such as ”what about expected algal composition”, there is a greater probability of running into fundamental problems that are associated with predicting the behaviour of complex non-linear systems. Some of these systems show extreme initial condition sensitivity and even, perhaps, chaotic behaviour, and are therefore fundamentally unpredictable.

The connection between single species and ecosystems

Ecosystem level models are motivated by some combination of scientific and practical concerns. Those models motivated by practical concerns are likely to bear little historical relation to previous models. Mechanisms of interaction between particular species and their ecosystems vary enormously. Some species literally construct their own ecosystems. Others have more or less complex and important interactions with other species so that their presence or absence may alter the ecosystem. Prior information about the natural history of particular species can make ecosystem investigations quicker, cheaper, and more effective. The optimal resource for preparing to deal with the unlimited diversity of questions asked of ecologists would be a large' computerized databank of natural history observations for as many species as possible.

Digital Quantum Rabi and Dicke Models in Superconducting Circuits

We propose the analog-digital quantum simulation of the quantum Rabi and Dicke models using circuit quantum electrodynamics (QED). We find that all physical regimes, in particular those which are impossible to realize in typical cavity QED setups, can be simulated via unitary decomposition into digital steps. Furthermore, we show the emergence of the Dirac equation dynamics from the quantum Rabi model when the mode frequency vanishes. Finally, we analyze the feasibility of this proposal under realistic superconducting circuit scenarios.

Embedding quantum simulators

79 p.

Usage of substances and their dosage regimes in pharmacological animal models of schizophrenia

Background: Contrary to what is generally thought schizophrenia is a very common mental health issue. For this, several animal models are used to assess the illness in order to develop a definitive. The most widely spread paradigm is the use of pharmacological models. Aim: The aim of this review is to display which are the most used insults for the assessment of social behaviour related negative symptoms in animal models as well as to ascertain which is the most adequate regime. Design: Literature review. Methods: PubMed database was used for this article by the search of the indexed “schizophrenia”, “animal models”, “social behaviour” and “negative symptoms” descriptors. With the exception of a single article due to it value this review is based on articles from 10 years onwards. Besides, only clinical trials and reviews written in English or Spanish and that had laboratory rodents as target population were accepted. Results: The studies assessed agree that pharmacological models (specially those regarding the NMDA receptor antagonists) are a valuable means for the experimental investigation of negative symptoms in schizophrenia with the necessity to emphasise that only some negative symptoms (anhedonia and social interaction, mainly) can be experimentally assessed. Conclusions: There is not enough evidence regarding the fours aspects of this review. PCP, Ketamine or MK-801 in sub-acute dosage regimes are currently the most indicated insults to mimic schizophrenic symptoms in rodents, although further research in needed, albeit other substances are valuable as well. (In English language exclusively)

Learning the Structure of Deep Sparse Graphical Models

Deep belief networks are a powerful way to model complex probability distributions. However, learning the structure of a belief network, particularly one with hidden units, is difficult. The Indian buffet process has been used as a nonparametric Bayesian prior on the directed structure of a belief network with a single infinitely wide hidden layer. In this paper, we introduce the cascading Indian buffet process (CIBP), which provides a nonparametric prior on the structure of a layered, directed belief network that is unbounded in both depth and width, yet allows tractable inference. We use the CIBP prior with the nonlinear Gaussian belief network so each unit can additionally vary its behavior between discrete and continuous representations. We provide Markov chain Monte Carlo algorithms for inference in these belief networks and explore the structures learned on several image data sets.

APPLICATION OF CENTRIFUGE MODELS IN THE STUDY OF AN INTERACTION PROBLEM.

Rigid retaining walls are considered. Both the backfill and the soil supporting the foundation of the model wall have been made of a single dry granular soil. Attention is limited to one grain.

Reconstruction of surfaces of revolution from single uncalibrated views

This paper addresses the problem of recovering the 3D shape of a surface of revolution from a single uncalibrated perspective view. The algorithm introduced here makes use of the invariant properties of a surface of revolution and its silhouette to locate the image of the revolution axis, and to calibrate the focal length of the camera. The image is then normalized and rectified such that the resulting silhouette exhibits bilateral symmetry. Such a rectification leads to a simpler differential analysis of the silhouette, and yields a simple equation for depth recovery. It is shown that under a general camera configuration, there will be a 2-parameter family of solutions for the reconstruction. The first parameter corresponds to an unknown scale, whereas the second one corresponds to an unknown attitude of the object. By identifying the image of a latitude circle, the ambiguity due to the unknown attitude can be resolved. Experimental results on real images are presented, which demonstrate the quality of the reconstruction. © 2004 Elsevier B.V. All rights reserved.

Learning shape priors for single view reconstruction

In this paper, we aim to reconstruct free-from 3D models from a single view by learning the prior knowledge of a specific class of objects. Instead of heuristically proposing specific regularities and defining parametric models as previous research, our shape prior is learned directly from existing 3D models under a framework based on the Gaussian Process Latent Variable Model (GPLVM). The major contributions of the paper include: 1) a probabilistic framework for prior-based reconstruction we propose, which requires no heuristic of the object, and can be easily generalized to handle various categories of 3D objects, and 2) an attempt at automatic reconstruction of more complex 3D shapes, like human bodies, from 2D silhouettes only. Qualitative and quantitative experimental results on both synthetic and real data demonstrate the efficacy of our new approach. ©2009 IEEE.

Voltage programmable dual-band bandpass/bandstop filter response in a single micro-electro-mechanical device

This paper reports on a switchable multi-band filter response achieved within a single micro-electro-mechanical device. A prototype device fabricated in a SOI process demonstrates a voltage programmable and tunable, dual-band, band-pass/band-stop response. Both analytical and finite element models are introduced in this paper to elucidate the operating principle of the filter and to guide filter design. Voltage programmability of the filter characteristic is demonstrated with the ability to independently tune the centre frequency and bandwidth for each band. A representative measurement shows that the minimum 3 dB-bandwidth (BW) is 155 Hz, 140Hz, and 20 dB-BW is 216 Hz, 203Hz for the upper-band and lower-band center frequencies located at 131.5 kHz and 130.7 kHz, respectively. © 2011 IEEE.