Using sub-word-level information for confidence estimation with conditional random field models

The task of word-level confidence estimation (CE) for automatic speech recognition (ASR) systems stands to benefit from the combination of suitably defined input features from multiple information sources. However, the information sources of interest may not necessarily operate at the same level of granularity as the underlying ASR system. The research described here builds on previous work on confidence estimation for ASR systems using features extracted from word-level recognition lattices, by incorporating information at the sub-word level. Furthermore, the use of Conditional Random Fields (CRFs) with hidden states is investigated as a technique to combine information for word-level CE. Performance improvements are shown using the sub-word-level information in linear-chain CRFs with appropriately engineered feature functions, as well as when applying the hidden-state CRF model at the word level.

Computations of turbulent lean premixed combustion using conditional moment closure

Conditional Moment Closure (CMC) is a suitable method for predicting scalars such as carbon monoxide with slow chemical time scales in turbulent combustion. Although this method has been successfully applied to non-premixed combustion, its application to lean premixed combustion is rare. In this study the CMC method is used to compute piloted lean premixed combustion in a distributed combustion regime. The conditional scalar dissipation rate of the conditioning scalar, the progress variable, is closed using an algebraic model and turbulence is modelled using the standard k-e{open} model. The conditional mean reaction rate is closed using a first order CMC closure with the GRI-3.0 chemical mechanism to represent the chemical kinetics of methane oxidation. The PDF of the progress variable is obtained using a presumed shape with the Beta function. The computed results are compared with the experimental measurements and earlier computations using the transported PDF approach. The results show reasonable agreement with the experimental measurements and are consistent with the transported PDF computations. When the compounded effects of shear-turbulence and flame are strong, second order closures may be required for the CMC. © 2013 Copyright Taylor and Francis Group, LLC.

Reversible jump sampler for autoregressive time series

We use reversible jump Markov chain Monte Carlo (MCMC) methods to address the problem of model order uncertainty in autoregressive (AR) time series within a Bayesian framework. Efficient model jumping is achieved by proposing model space moves from the full conditional density for the AR parameters, which is obtained analytically. This is compared with an alternative method, for which the moves are cheaper to compute, in which proposals are made only for new parameters in each move. Results are presented for both synthetic and audio time series.

Bayesian separation and recovery of convolutively mixed autoregressive sources

In this paper we address the problem of the separation and recovery of convolutively mixed autoregressive processes in a Bayesian framework. Solving this problem requires the ability to solve integration and/or optimization problems of complicated posterior distributions. We thus propose efficient stochastic algorithms based on Markov chain Monte Carlo (MCMC) methods. We present three algorithms. The first one is a classical Gibbs sampler that generates samples from the posterior distribution. The two other algorithms are stochastic optimization algorithms that allow to optimize either the marginal distribution of the sources, or the marginal distribution of the parameters of the sources and mixing filters, conditional upon the observation. Simulations are presented.

Comment and reply on the 'assessment of combustion and submodels for turbulent nonpremixed hydrocarbon flames'

In deriving the flamelet model for nonpremixed combustion certain terms, but not the unsteady term, are assumed to be negligible. This results in a relation between all reacting scalars and the mixture fraction as independent variable. An ideal test of the flamelet assumption can be based on direct numerical simulation (DNS) data, if all reacting scalars are conditioned on mixture fraction and conditional moments are evaluated. The fundamental assumption of the flamelet model are unwillingly justified. The unsteady and steady formulations of the same equations are compared and found that unsteadiness is important in an unsteady simulation.

Three-dimensional direct numerical simulations of autoignition in turbulent non-premixed flows with simple and complex chemistry

3D Direct Numerical Simulations (DNS) of autoignition in turbulent non-premixed flows between fuel and hotter air have been carried out using both 1-step and complex chemistry consisting of a 22 species n-heptane mechanism to investigate spontaneous ignition timing and location. The simple chemistry results showed that the previous findings from 2D DNS that ignition occurred at the most reactive mixture fraction (ξMR) and at small values of the conditional scalar dissipation rate (N|ξMR) are valid also for 3D turbulent mixing fields. Performing the same simulation many times with different realizations of the initial velocity field resulted in a very narrow statistical distribution of ignition delay time, consistent with a previous conjecture that the first appearance of ignition is correlated with the low-N content of the conditional probability density function of N. The simulations with complex chemistry for conditions outside the Negative Temperature Coefficient (NTC) regime show behaviour similar to the single-step chemistry simulations. However, in the NTC regime, the most reactive mixture fraction is very rich and ignition seems to occur at high values of scalar dissipation. Copyright © 2006 by ASME.

Structured discriminative models for noise robust continuous speech recognition

Recently there has been interest in structured discriminative models for speech recognition. In these models sentence posteriors are directly modelled, given a set of features extracted from the observation sequence, and hypothesised word sequence. In previous work these discriminative models have been combined with features derived from generative models for noise-robust speech recognition for continuous digits. This paper extends this work to medium to large vocabulary tasks. The form of the score-space extracted using the generative models, and parameter tying of the discriminative model, are both discussed. Update formulae for both conditional maximum likelihood and minimum Bayes' risk training are described. Experimental results are presented on small and medium to large vocabulary noise-corrupted speech recognition tasks: AURORA 2 and 4. © 2011 IEEE.

Derivative Kernels for Noise Robust ASR

Recently there has been interest in combined gen- erative/discriminative classifiers. In these classifiers features for the discriminative models are derived from generative kernels. One advantage of using generative kernels is that systematic approaches exist how to introduce complex dependencies beyond conditional independence assumptions. Furthermore, by using generative kernels model-based compensation/adaptation tech- niques can be applied to make discriminative models robust to noise/speaker conditions. This paper extends previous work with combined generative/discriminative classifiers in several directions. First, it introduces derivative kernels based on context- dependent generative models. Second, it describes how derivative kernels can be incorporated in continuous discriminative models. Third, it addresses the issues associated with large number of classes and parameters when context-dependent models and high- dimensional features of derivative kernels are used. The approach is evaluated on two noise-corrupted tasks: small vocabulary AURORA 2 and medium-to-large vocabulary AURORA 4 task.

Effects of flow geometry and Damkohler number on turbulent premixed flame

DNS of planar turbulent flame and turbulent V-flame has been conducted to investigate turbulence-scalar interaction in relatively practical turbulent combustion. Several turbulence quantities are examined for the understandings of fundamental characteristics of flow field in V-flame. Due to the additional turbulence production by the hot-rod, turbulence does not simply decay in V-flame. Turbulence-scalar interaction, scalar alignments with the principal strain rate in other words, is then clarified. The competition of turbulence and dilatation can be found in the conditional PDF of flame normal alignment. The results suggests that the alignment characteristics in high Da flames are applicable to low Da flames in the region of intense heat release.

Response probability distribution of built-up vibro-acoustic systems

The vibro-acoustic response of built-up structures, consisting of stiff components with low modal density and flexible components with high modal density, is sensitive to small imperfections in the flexible components. In this paper, the uncertainty of the response is considered by modeling the low modal density master system as deterministic and the high modal density subsystems in a nonparametric stochastic way, i.e., carrying a diffuse wave field, and by subsequently computing the response probability density function. The master system's mean squared response amplitude follows a singular noncentral complex Wishart distribution conditional on the subsystem energies. For a single degree of freedom, this is equivalent to a chi-square or an exponential distribution, depending on the loading conditions. The subsystem energies follow approximately a chi-square distribution when their relative variance is smaller than unity. The results are validated by application to plate structures, and good agreement with Monte Carlo simulations is found. © 2012 Acoustical Society of America.

Construction of nonparametric Bayesian models from parametric Bayes equations

We consider the general problem of constructing nonparametric Bayesian models on infinite-dimensional random objects, such as functions, infinite graphs or infinite permutations. The problem has generated much interest in machine learning, where it is treated heuristically, but has not been studied in full generality in non-parametric Bayesian statistics, which tends to focus on models over probability distributions. Our approach applies a standard tool of stochastic process theory, the construction of stochastic processes from their finite-dimensional marginal distributions. The main contribution of the paper is a generalization of the classic Kolmogorov extension theorem to conditional probabilities. This extension allows a rigorous construction of nonparametric Bayesian models from systems of finite-dimensional, parametric Bayes equations. Using this approach, we show (i) how existence of a conjugate posterior for the nonparametric model can be guaranteed by choosing conjugate finite-dimensional models in the construction, (ii) how the mapping to the posterior parameters of the nonparametric model can be explicitly determined, and (iii) that the construction of conjugate models in essence requires the finite-dimensional models to be in the exponential family. As an application of our constructive framework, we derive a model on infinite permutations, the nonparametric Bayesian analogue of a model recently proposed for the analysis of rank data.

Effects of preferential transport in turbulent bluff-body-stabilized lean premixed CH 4/air flames

Preferential species diffusion is known to have important effects on local flame structure in turbulent premixed flames, and differential diffusion of heat and mass can have significant effects on both local flame structure and global flame parameters, such as turbulent flame speed. However, models for turbulent premixed combustion normally assume that atomic mass fractions are conserved from reactants to fully burnt products. Experiments reported here indicate that this basic assumption may be incorrect for an important class of turbulent flames. Measurements of major species and temperature in the near field of turbulent, bluff-body stabilized, lean premixed methane-air flames (Le=0.98) reveal significant departures from expected conditional mean compositional structure in the combustion products as well as within the flame. Net increases exceeding 10% in the equivalence ratio and the carbon-to-hydrogen atom ratio are observed across the turbulent flame brush. Corresponding measurements across an unstrained laminar flame at similar equivalence ratio are in close agreement with calculations performed using Chemkin with the GRI 3.0 mechanism and multi-component transport, confirming accuracy of experimental techniques. Results suggest that the large effects observed in the turbulent bluff-body burner are cause by preferential transport of H 2 and H 2O through the preheat zone ahead of CO 2 and CO, followed by convective transport downstream and away from the local flame brush. This preferential transport effect increases with increasing velocity of reactants past the bluff body and is apparently amplified by the presence of a strong recirculation zone where excess CO 2 is accumulated. © 2011 The Combustion Institute.