Graph-based Semi-Supervised Learning in Acoustic Modeling for Automatic Speech Recognition

Thesis (Ph.D.)--University of Washington, 2016-06

A geometric approach to quantum circuit lower bounds

What is the minimal size quantum circuit required to exactly implement a specified n-qubit unitary operation, U, without the use of ancilla qubits? We show that a lower bound on the minimal size is provided by the length of the minimal geodesic between U and the identity, I, where length is defined by a suitable Finsler metric on the manifold SU(2(n)). The geodesic curves on these manifolds have the striking property that once an initial position and velocity are set, the remainder of the geodesic is completely determined by a second order differential equation known as the geodesic equation. This is in contrast with the usual case in circuit design, either classical or quantum, where being given part of an optimal circuit does not obviously assist in the design of the rest of the circuit. Geodesic analysis thus offers a potentially powerful approach to the problem of proving quantum circuit lower bounds. In this paper we construct several Finsler metrics whose minimal length geodesics provide lower bounds on quantum circuit size. For each Finsler metric we give a procedure to compute the corresponding geodesic equation. We also construct a large class of solutions to the geodesic equation, which we call Pauli geodesics, since they arise from isometries generated by the Pauli group. For any unitary U diagonal in the computational basis, we show that: (a) provided the minimal length geodesic is unique, it must be a Pauli geodesic; (b) finding the length of the minimal Pauli geodesic passing from I to U is equivalent to solving an exponential size instance of the closest vector in a lattice problem (CVP); and (c) all but a doubly exponentially small fraction of such unitaries have minimal Pauli geodesics of exponential length.

Fate of hairpin transcript components during RNA silencing and its suppression in transgenic virus-resistant tobacco

Transgenic tobacco plants, carrying a Potato virus Y (PVY)-NIa hairpin sequence separated by a unique unrelated spacer sequence were specifically silenced and highly resistant to PVY infection. In such plants neither PVY-NIa nor spacer transgene transcripts were detectable by specific quantitative real time reverse transcriptase PCR (RT-qPCR) assays of similar relative efficiencies developed for direct comparative analysis. However, small interfering RNAs (siRNAs) specific for the PVY sequence of the transgene and none specific for the LNYV spacer sequence were detected. Following infection with Cucumber mosaic virus (CMV), which suppresses dsRNA-induced RNA silencing, transcript levels of PVY-NIa as well as spacer sequence increased manifold with the same time course. The cellular abundance of the single-stranded (ss) spacer sequence was consistently higher than that of PVY dsRNA in all cases. The results show that during RNA silencing and its suppression of a hairpin transcript in transgenic tobacco, the ssRNA spacer sequence is affected differently than the dsRNA. In PVY-silenced plants. the spacer is efficiently degraded by a mechanism not involving the accumulation of siRNAs, while following suppression of RNA silencing by CMV, the spacer appears protected from degradation. Crown Copyright (c) 2006 Published by Elsevier B.V. All rights reserved.

Optimal control, geometry, and quantum computing

We prove upper and lower bounds relating the quantum gate complexity of a unitary operation, U, to the optimal control cost associated to the synthesis of U. These bounds apply for any optimal control problem, and can be used to show that the quantum gate complexity is essentially equivalent to the optimal control cost for a wide range of problems, including time-optimal control and finding minimal distances on certain Riemannian, sub-Riemannian, and Finslerian manifolds. These results generalize the results of [Nielsen, Dowling, Gu, and Doherty, Science 311, 1133 (2006)], which showed that the gate complexity can be related to distances on a Riemannian manifold.

Positive solutions of a Neumann problem with competing critical nonlinearities

We present existence results for a Neumann problem involving critical Sobolev nonlinearities both on the right hand side of the equation and at the boundary condition.. Positive solutions are obtained through constrained minimization on the Nehari manifold. Our approach is based on the concentration 'compactness principle of P. L. Lions and M. Struwe.

A Bethe ansatz solvable model for superpositions of Cooper pairs and condensed molecular bosons

We introduce a general Hamiltonian describing coherent superpositions of Cooper pairs and condensed molecular bosons. For particular choices of the coupling parameters, the model is integrable. One integrable manifold, as well as the Bethe ansatz solution, was found by Dukelsky et al. [J. Dukelsky, G.G. Dussel, C. Esebbag, S. Pittel, Phys. Rev. Lett. 93 (2004) 050403]. Here we show that there is a second integrable manifold, established using the boundary quantum inverse scattering method. In this manner we obtain the exact solution by means of the algebraic Bethe ansatz. In the case where the Cooper pair energies are degenerate we examine the relationship between the spectrum of these integrable Hamiltonians and the quasi-exactly solvable spectrum of particular Schrodinger operators. For the solution we derive here the potential of the Schrodinger operator is given in terms of hyperbolic functions. For the solution derived by Dukelsky et al., loc. cit. the potential is sextic and the wavefunctions obey PT-symmetric boundary conditions. This latter case provides a novel example of an integrable Hermitian Hamiltonian acting on a Fock space whose states map into a Hilbert space of PE-symmetric wavefunctions defined on a contour in the complex plane. (c) 2006 Elsevier B.V. All rights reserved.

Lifetime suicide risk in major depression: sex and age determinants

Background: Recent work has demonstrated that the lifetime suicide risk for patients with DSM IV Major Depression cannot mathematically approximate the accepted figure of 15%. Gender and age significantly affect both the prevalence of major depression and suicide risk, Methods: Gender and age stratified calculations were made on the entire population of the USA in 1994 using a mathematical algorithm. Sex specific corrections for under-reporting were incorporated into the design. Results: The lifetime suicide risks for men and women were 7% and 1%, respectively. The combined risk was 3.4%. The male:female ratio for suicide risk in major depression was 10:1 for youths under 25, and 5.6:1 for adults. Conclusions: Suicide in major depression is predominantly a male problem, although complacency towards female sufferers is to be avoided. Diagnosis of major depression is of limited help in predicting suicide risk compared to case specific factors. The male experience of depression that leads to suicide is often not identified as a legitimate medical complaint by either sufferers or professionals. Increasing help-accessing by males is a priority. Clinical implications: Patients with a history of hospitalisation; comorbidity, especially for substance abuse; and who are male, require greater vigilance for suicide risk. It may be that for males che threshold for diagnosing and treating major depression needs to be lowered. Limitations: This research is based on a mathematical algorithm to approximate a life-long longitudinal study that identifies community cases of depression. Our findings therefore rely on the validity of the statistics used. Extrapolation is limited to populations with an actual suicide rate of 17/100,000 or less and a lifetime prevalence of major depression of 17% or more. (C) 1999 Elsevier Science B.V. All rights reserved.

Towards a framework for combining stochastic and deterministic descriptions of nonstationary financial time series

We present in this paper ideas to tackle the problem of analysing and forecasting nonstationary time series within the financial domain. Accepting the stochastic nature of the underlying data generator we assume that the evolution of the generator's parameters is restricted on a deterministic manifold. Therefore we propose methods for determining the characteristics of the time-localised distribution. Starting with the assumption of a static normal distribution we refine this hypothesis according to the empirical results obtained with the methods anc conclude with the indication of a dynamic non-Gaussian behaviour with varying dependency for the time series under consideration.

Hierarchical GTM: Constructing localized non-linear projection manifolds in a principled way

It has been argued that a single two-dimensional visualization plot may not be sufficient to capture all of the interesting aspects of complex data sets, and therefore a hierarchical visualization system is desirable. In this paper we extend an existing locally linear hierarchical visualization system PhiVis ¸iteBishop98a in several directions: bf(1) We allow for em non-linear projection manifolds. The basic building block is the Generative Topographic Mapping. bf(2) We introduce a general formulation of hierarchical probabilistic models consisting of local probabilistic models organized in a hierarchical tree. General training equations are derived, regardless of the position of the model in the tree. bf(3) Using tools from differential geometry we derive expressions for local directional curvatures of the projection manifold. Like PhiVis, our system is statistically principled and is built interactively in a top-down fashion using the EM algorithm. It enables the user to interactively highlight those data in the parent visualization plot which are captured by a child model. We also incorporate into our system a hierarchical, locally selective representation of magnification factors and directional curvatures of the projection manifolds. Such information is important for further refinement of the hierarchical visualization plot, as well as for controlling the amount of regularization imposed on the local models. We demonstrate the principle of the approach on a toy data set and apply our system to two more complex 12- and 19-dimensional data sets.

Using directional curvatures to visualize folding patterns of the GTM projection manifolds

In data visualization, characterizing local geometric properties of non-linear projection manifolds provides the user with valuable additional information that can influence further steps in the data analysis. We take advantage of the smooth character of GTM projection manifold and analytically calculate its local directional curvatures. Curvature plots are useful for detecting regions where geometry is distorted, for changing the amount of regularization in non-linear projection manifolds, and for choosing regions of interest when constructing detailed lower-level visualization plots.

Hierarchical GTM: constructing localized non-linear projection manifolds in a principled way

It has been argued that a single two-dimensional visualization plot may not be sufficient to capture all of the interesting aspects of complex data sets, and therefore a hierarchical visualization system is desirable. In this paper we extend an existing locally linear hierarchical visualization system PhiVis ¸iteBishop98a in several directions: bf(1) We allow for em non-linear projection manifolds. The basic building block is the Generative Topographic Mapping (GTM). bf(2) We introduce a general formulation of hierarchical probabilistic models consisting of local probabilistic models organized in a hierarchical tree. General training equations are derived, regardless of the position of the model in the tree. bf(3) Using tools from differential geometry we derive expressions for local directional curvatures of the projection manifold. Like PhiVis, our system is statistically principled and is built interactively in a top-down fashion using the EM algorithm. It enables the user to interactively highlight those data in the ancestor visualization plots which are captured by a child model. We also incorporate into our system a hierarchical, locally selective representation of magnification factors and directional curvatures of the projection manifolds. Such information is important for further refinement of the hierarchical visualization plot, as well as for controlling the amount of regularization imposed on the local models. We demonstrate the principle of the approach on a toy data set and apply our system to two more complex 12- and 18-dimensional data sets.

A principled approach to interactive hierarchical non-linear visualization of high-dimensional data

Hierarchical visualization systems are desirable because a single two-dimensional visualization plot may not be sufficient to capture all of the interesting aspects of complex high-dimensional data sets. We extend an existing locally linear hierarchical visualization system PhiVis [1] in several directions: bf(1) we allow for em non-linear projection manifolds (the basic building block is the Generative Topographic Mapping -- GTM), bf(2) we introduce a general formulation of hierarchical probabilistic models consisting of local probabilistic models organized in a hierarchical tree, bf(3) we describe folding patterns of low-dimensional projection manifold in high-dimensional data space by computing and visualizing the manifold's local directional curvatures. Quantities such as magnification factors [3] and directional curvatures are helpful for understanding the layout of the nonlinear projection manifold in the data space and for further refinement of the hierarchical visualization plot. Like PhiVis, our system is statistically principled and is built interactively in a top-down fashion using the EM algorithm. We demonstrate the visualization system principle of the approach on a complex 12-dimensional data set and mention possible applications in the pharmaceutical industry.

Constructing localized non-linear projection manifolds in a principled way:hierarchical generative topographic mapping

It has been argued that a single two-dimensional visualization plot may not be sufficient to capture all of the interesting aspects of complex data sets, and therefore a hierarchical visualization system is desirable. In this paper we extend an existing locally linear hierarchical visualization system PhiVis (Bishop98a) in several directions: 1. We allow for em non-linear projection manifolds. The basic building block is the Generative Topographic Mapping. 2. We introduce a general formulation of hierarchical probabilistic models consisting of local probabilistic models organized in a hierarchical tree. General training equations are derived, regardless of the position of the model in the tree. 3. Using tools from differential geometry we derive expressions for local directionalcurvatures of the projection manifold. Like PhiVis, our system is statistically principled and is built interactively in a top-down fashion using the EM algorithm. It enables the user to interactively highlight those data in the parent visualization plot which are captured by a child model.We also incorporate into our system a hierarchical, locally selective representation of magnification factors and directional curvatures of the projection manifolds. Such information is important for further refinement of the hierarchical visualization plot, as well as for controlling the amount of regularization imposed on the local models. We demonstrate the principle of the approach on a toy data set andapply our system to two more complex 12- and 19-dimensional data sets.