Bayesian signal processing

The application of Bayes' Theorem to signal processing provides a consistent framework for proceeding from prior knowledge to a posterior inference conditioned on both the prior knowledge and the observed signal data. The first part of the lecture will illustrate how the Bayesian methodology can be applied to a variety of signal processing problems. The second part of the lecture will introduce the concept of Markov Chain Monte-Carlo (MCMC) methods which is an effective approach to overcoming many of the analytical and computational problems inherent in statistical inference. Such techniques are at the centre of the rapidly developing area of Bayesian signal processing which, with the continual increase in available computational power, is likely to provide the underlying framework for most signal processing applications.

Finite volume distance field solution applied to medial axis transform

Accurate and efficient computation of the nearest wall distance d (or level set) is important for many areas of computational science/engineering. Differential equation-based distance/ level set algorithms, such as the hyperbolic-natured Eikonal equation, have demonstrated valuable computational efficiency. Here, in the context, as an 'auxiliary' equation to the main flow equations, the Eikonal equation is solved efficiently with two different finite volume approaches (the cell vertex and cell-centered). Application of the distance solution is studied for various geometries. Moreover, a procedure using the differential field to obtain the medial axis transform (MAT) for different geometries is presented. The latter provides a skeleton representation of geometric models that has many useful analysis properties. As an alternative approach to the pure geometric methods (e.g. the Voronoi approach), the current d-MAT procedure bypasses many difficulties that are usually encountered by pure geometric methods, especially in three dimensional space. It is also shown that the d-MAT approach provides the potential to sculpt/control the MAT form for specialized solution purposes. Copyright © 2010 by the American Institute of Aeronautics and Astronautics, Inc.

Structured discriminative models for noise robust continuous speech recognition

Recently there has been interest in structured discriminative models for speech recognition. In these models sentence posteriors are directly modelled, given a set of features extracted from the observation sequence, and hypothesised word sequence. In previous work these discriminative models have been combined with features derived from generative models for noise-robust speech recognition for continuous digits. This paper extends this work to medium to large vocabulary tasks. The form of the score-space extracted using the generative models, and parameter tying of the discriminative model, are both discussed. Update formulae for both conditional maximum likelihood and minimum Bayes' risk training are described. Experimental results are presented on small and medium to large vocabulary noise-corrupted speech recognition tasks: AURORA 2 and 4. © 2011 IEEE.

Phase noise analysis of a mechanical autonomous impact oscillator with a MEMS resonator

In this paper, phase noise analysis of a mechanical autonomous impact oscillator with a MEMS resonator is performed. Since the circuit considered belongs to the class of hybrid systems, methods based on the variational model for the evaluation of either phase noise or steady state solutions cannot be directly applied. As a matter of fact, the monodromy matrix is not defined at impact events in these systems. By introducing saltation matrices, this limit is overcome and the aforementioned methods are extended. In particular, the unified theory developed by Demir is used to analyze the phase noise after evaluating the asymptotically stable periodic solution of the system by resorting to the shooting method. Numerical results are presented to show how noise sources affect the phase noise performances. © 2011 IEEE.

On the stability of a rod adhering to a rigid surface: Shear-induced stable adhesion and the instability of peeling

Using variational methods, we establish conditions for the nonlinear stability of adhesive states between an elastica and a rigid halfspace. The treatment produces coupled criteria for adhesion and buckling instabilities by exploiting classical techniques from Legendre and Jacobi. Three examples that arise in a broad range of engineered systems, from microelectronics to biologically inspired fiber array adhesion, are used to illuminate the stability criteria. The first example illustrates buckling instabilities in adhered rods, while the second shows the instability of a peeling process and the third illustrates the stability of a shear-induced adhesion. The latter examples can also be used to explain how microfiber array adhesives can be activated by shearing and deactivated by peeling. The nonlinear stability criteria developed in this paper are also compared to other treatments. © 2012 Elsevier Ltd. All rights reserved.

A unifying resolution-independent formulation for early vision

We present a model for early vision tasks such as denoising, super-resolution, deblurring, and demosaicing. The model provides a resolution-independent representation of discrete images which admits a truly rotationally invariant prior. The model generalizes several existing approaches: variational methods, finite element methods, and discrete random fields. The primary contribution is a novel energy functional which has not previously been written down, which combines the discrete measurements from pixels with a continuous-domain world viewed through continous-domain point-spread functions. The value of the functional is that simple priors (such as total variation and generalizations) on the continous-domain world become realistic priors on the sampled images. We show that despite its apparent complexity, optimization of this model depends on just a few computational primitives, which although tedious to derive, can now be reused in many domains. We define a set of optimization algorithms which greatly overcome the apparent complexity of this model, and make possible its practical application. New experimental results include infinite-resolution upsampling, and a method for obtaining subpixel superpixels. © 2012 IEEE.

Use of contexts in language model interpolation and adaptation

Language models (LMs) are often constructed by building multiple individual component models that are combined using context independent interpolation weights. By tuning these weights, using either perplexity or discriminative approaches, it is possible to adapt LMs to a particular task. This paper investigates the use of context dependent weighting in both interpolation and test-time adaptation of language models. Depending on the previous word contexts, a discrete history weighting function is used to adjust the contribution from each component model. As this dramatically increases the number of parameters to estimate, robust weight estimation schemes are required. Several approaches are described in this paper. The first approach is based on MAP estimation where interpolation weights of lower order contexts are used as smoothing priors. The second approach uses training data to ensure robust estimation of LM interpolation weights. This can also serve as a smoothing prior for MAP adaptation. A normalized perplexity metric is proposed to handle the bias of the standard perplexity criterion to corpus size. A range of schemes to combine weight information obtained from training data and test data hypotheses are also proposed to improve robustness during context dependent LM adaptation. In addition, a minimum Bayes' risk (MBR) based discriminative training scheme is also proposed. An efficient weighted finite state transducer (WFST) decoding algorithm for context dependent interpolation is also presented. The proposed technique was evaluated using a state-of-the-art Mandarin Chinese broadcast speech transcription task. Character error rate (CER) reductions up to 7.3 relative were obtained as well as consistent perplexity improvements. © 2012 Elsevier Ltd. All rights reserved.

Structural and thermodynamic properties of different phases of supercooled liquid water.

Computer simulation results are reported for a realistic polarizable potential model of water in the supercooled region. Three states, corresponding to the low density amorphous ice, high density amorphous ice, and very high density amorphous ice phases are chosen for the analyses. These states are located close to the liquid-liquid coexistence lines already shown to exist for the considered model. Thermodynamic and structural quantities are calculated, in order to characterize the properties of the three phases. The results point out the increasing relevance of the interstitial neighbors, which clearly appear in going from the low to the very high density amorphous phases. The interstitial neighbors are found to be, at the same time, also distant neighbors along the hydrogen bonded network of the molecules. The role of these interstitial neighbors has been discussed in connection with the interpretation of recent neutron scattering measurements. The structural properties of the systems are characterized by looking at the angular distribution of neighboring molecules, volume and face area distribution of the Voronoi polyhedra, and order parameters. The cumulative analysis of all the corresponding results confirms the assumption that a close similarity between the structural arrangement of molecules in the three explored amorphous phases and that of the ice polymorphs I(h), III, and VI exists.

Kernel conditional quantile estimation via reduction revisited

Quantile regression refers to the process of estimating the quantiles of a conditional distribution and has many important applications within econometrics and data mining, among other domains. In this paper, we show how to estimate these conditional quantile functions within a Bayes risk minimization framework using a Gaussian process prior. The resulting non-parametric probabilistic model is easy to implement and allows non-crossing quantile functions to be enforced. Moreover, it can directly be used in combination with tools and extensions of standard Gaussian Processes such as principled hyperparameter estimation, sparsification, and quantile regression with input-dependent noise rates. No existing approach enjoys all of these desirable properties. Experiments on benchmark datasets show that our method is competitive with state-of-the-art approaches. © 2009 IEEE.

Modelling the vibration of tyre sidewalls

The dynamical behaviour of the sidewall has an important influence on tyre vibration characteristics. Nonetheless, it remains crudely represented in many existing models. The current work considers a geometrically accurate, two-dimensional, sidewall description, with a view to identifying potential shortcomings in the approximate formulations and identifying the physical characteristics that must be accounted for. First, the mean stress state under pressurisation and centrifugal loading is investigated. Finite-Element calculations show that, while the loaded sidewall shape remains close to a toroid, its in-plane tensions differ appreciably from the associated analytical solution. This is largely due to the inability of the anisotropic sidewall material to sustain significant azimuthal stress. An approximate analysis, based on the meridional tension alone, is therefore developed, and shown to yield accurate predictions. In conjunction with a set of formulae for the 'engineering constants' of the sidewall material, the approximate solutions provide a straightforward and efficient means of determining the base state for the vibration analysis. The latter is implemented via a 'waveguide' discretisation of a variational formulation. Its results show that, while the full geometrical description is necessary for a complete and reliable characterisation of the sidewall's vibrational properties, a one-dimensional approximation will often be satisfactory in practice. Meridional thickness variations only become important at higher frequencies (above 500 Hz for the example considered here), and rotational inertia effects appear to be minor at practical vehicle speeds. © 2013 Elsevier Ltd. All rights reserved.

Computational analysis of liquid crystalline elastomer membranes: Changing Gaussian curvature without stretch energy

Liquid crystalline elastomers (LCEs) can undergo extremely large reversible shape changes when exposed to external stimuli, such as mechanical deformations, heating or illumination. The deformation of LCEs result from a combination of directional reorientation of the nematic director and entropic elasticity. In this paper, we study the energetics of initially flat, thin LCE membranes by stress driven reorientation of the nematic director. The energy functional used in the variational formulation includes contributions depending on the deformation gradient and the second gradient of the deformation. The deformation gradient models the in-plane stretching of the membrane. The second gradient regularises the non-convex membrane energy functional so that infinitely fine in-plane microstructures and infinitely fine out-of-plane membrane wrinkling are penalised. For a specific example, our computational results show that a non-developable surface can be generated from an initially flat sheet at cost of only energy terms resulting from the second gradients. That is, Gaussian curvature can be generated in LCE membranes without the cost of stretch energy in contrast to conventional materials. © 2013 Elsevier Ltd. All rights reserved.

Molecular evidence for diphyly of the Asian catfish family Amblycipitidae (Teleostei: Siluriformes) and exclusion of the South American Aspredinidae from Sisoroidea

Amblycipitidae Day, 1873 is an Asian family of catfishes (Siluriformes) usually considered to contain 28 species placed in three genera: Amblyceps (14 spp.), Liobagrus (12 spp.) and Xiurenbagrus (2 spp.). Morphology-based systematics has supported the monophyly of this family, with some authors placing Amblycipitidae within a larger group including Akysidae, Sisoridae and Aspredinidae, termed the Sisoroidea. Here we investigate the phylogenetic relationships among four species of Amblyceps, six species of Liobagrus and the two species of Xiurenbagrus with respect to other sisoroid taxa as well as other catfish groups using 6100 aligned base pairs of DNA sequence data from the rag1 and rag2 genes of the nuclear genome and from three regions (cyt b, COL ND4 plus tRNA-His and tRNA-Ser) of the mitochondrial genome. Parsimony and Bayesian analyses of the data indicate strong support for a diphyletic Amblycipitidae in which the genus Amblyceps is the sister group to the Sisoridae and a clade formed by genera Liobagrus and Xiurenbagrus is the sister group to Akysidae. These taxa together form a well supported monophyletic group that assembles all Asian sisoroid taxa, but excludes the South American Aspredinidae. Results for aspredinids are consistent with previous molecular studies that indicate these catfishes are not sisoroids, but the sister group to the South American doradoid catfishes (Auchenipteridae + Doradidae). The redefined sisoroid clade plus Bagridae, Horabagridae and (Ailia + Laides) make up a larger monophyletic group informally termed "Big Asia." Likelihood-based SH tests and Bayes Factor comparisons of the rag and the mitochondrial data partitions considered separately and combined reject both the hypothesis of amblycipitid monophyly and the hypothesis of aspredinid inclusion within Sisoroidea. This result for amblycipitids conflicts with a number of well documented morphological synapomorphies that we briefly review. Possible nomenclatural changes for amblycipitid taxa are noted.

Unified form language: A domain-specific language for weak formulations of partial differential equations

We present the Unified Form Language (UFL), which is a domain-specific language for representing weak formulations of partial differential equations with a view to numerical approximation. Features of UFL include support for variational forms and functionals, automatic differentiation of forms and expressions, arbitrary function space hierarchies formultifield problems, general differential operators and flexible tensor algebra. With these features, UFL has been used to effortlessly express finite element methods for complex systems of partial differential equations in near-mathematical notation, resulting in compact, intuitive and readable programs. We present in this work the language and its construction. An implementation of UFL is freely available as an open-source software library. The library generates abstract syntax tree representations of variational problems, which are used by other software libraries to generate concrete low-level implementations. Some application examples are presented and libraries that support UFL are highlighted. © 2014 ACM.

"Plateau"-related summary statistics are uninformative for comparing working memory models.

Performance on visual working memory tasks decreases as more items need to be remembered. Over the past decade, a debate has unfolded between proponents of slot models and slotless models of this phenomenon (Ma, Husain, Bays (Nature Neuroscience 17, 347-356, 2014). Zhang and Luck (Nature 453, (7192), 233-235, 2008) and Anderson, Vogel, and Awh (Attention, Perception, Psychophys 74, (5), 891-910, 2011) noticed that as more items need to be remembered, "memory noise" seems to first increase and then reach a "stable plateau." They argued that three summary statistics characterizing this plateau are consistent with slot models, but not with slotless models. Here, we assess the validity of their methods. We generated synthetic data both from a leading slot model and from a recent slotless model and quantified model evidence using log Bayes factors. We found that the summary statistics provided at most 0.15 % of the expected model evidence in the raw data. In a model recovery analysis, a total of more than a million trials were required to achieve 99 % correct recovery when models were compared on the basis of summary statistics, whereas fewer than 1,000 trials were sufficient when raw data were used. Therefore, at realistic numbers of trials, plateau-related summary statistics are highly unreliable for model comparison. Applying the same analyses to subject data from Anderson et al. (Attention, Perception, Psychophys 74, (5), 891-910, 2011), we found that the evidence in the summary statistics was at most 0.12 % of the evidence in the raw data and far too weak to warrant any conclusions. The evidence in the raw data, in fact, strongly favored the slotless model. These findings call into question claims about working memory that are based on summary statistics.

MoT - Mixture of trees probabilistic graphical model for video segmentation

We present a novel mixture of trees (MoT) graphical model for video segmentation. Each component in this mixture represents a tree structured temporal linkage between super-pixels from the first to the last frame of a video sequence. Our time-series model explicitly captures the uncertainty in temporal linkage between adjacent frames which improves segmentation accuracy. We provide a variational inference scheme for this model to estimate super-pixel labels and their confidences in nearly realtime. The efficacy of our approach is demonstrated via quantitative comparisons on the challenging SegTrack joint segmentation and tracking dataset [23].