Intonation modelling and adaptation for emotional prosody generation

This paper proposes an HMM-based approach to generating emotional intonation patterns. A set of models were built to represent syllable-length intonation units. In a classification framework, the models were able to detect a sequence of intonation units from raw fundamental frequency values. Using the models in a generative framework, we were able to synthesize smooth and natural sounding pitch contours. As a case study for emotional intonation generation, Maximum Likelihood Linear Regression (MLLR) adaptation was used to transform the neutral model parameters with a small amount of happy and sad speech data. Perceptual tests showed that listeners could identify the speech with the sad intonation 80% of the time. On the other hand, listeners formed a bimodal distribution in their ability to detect the system generated happy intontation and on average listeners were able to detect happy intonation only 46% of the time. © Springer-Verlag Berlin Heidelberg 2005.

Pitman-Yor Diffusion Trees

We introduce the Pitman Yor Diffusion Tree (PYDT) for hierarchical clustering, a generalization of the Dirichlet Diffusion Tree (Neal, 2001) which removes the restriction to binary branching structure. The generative process is described and shown to result in an exchangeable distribution over data points. We prove some theoretical properties of the model and then present two inference methods: a collapsed MCMC sampler which allows us to model uncertainty over tree structures, and a computationally efficient greedy Bayesian EM search algorithm. Both algorithms use message passing on the tree structure. The utility of the model and algorithms is demonstrated on synthetic and real world data, both continuous and binary.

Theoretical performance of a coiled coil piezoelectric bimorph

The electromechanical coupling behaviour of a novel, highly coiled piezoelectric strip structure is developed in full, in order to expound its performance and efficiency. The strip is doubly coiled for compactness and, compared to a standard straight actuator of the same cross-section, it is shown that the actuator here offers better generative forces and energy conversion, and substantial actuated displacements, however, at the expense of a much lower stiffness. The device is therefore proposed for high-displacement, quasi-static applications. © 2006 Elsevier B.V. All rights reserved.

Structured discriminative models for noise robust continuous speech recognition

Recently there has been interest in structured discriminative models for speech recognition. In these models sentence posteriors are directly modelled, given a set of features extracted from the observation sequence, and hypothesised word sequence. In previous work these discriminative models have been combined with features derived from generative models for noise-robust speech recognition for continuous digits. This paper extends this work to medium to large vocabulary tasks. The form of the score-space extracted using the generative models, and parameter tying of the discriminative model, are both discussed. Update formulae for both conditional maximum likelihood and minimum Bayes' risk training are described. Experimental results are presented on small and medium to large vocabulary noise-corrupted speech recognition tasks: AURORA 2 and 4. © 2011 IEEE.

A controller for a miniature intra-aortic ventricular assist device.

Two control algorithms have been developed for a minimally invasive axial-flow ventricular assist device (VAD) for placement in the descending aorta. The purpose of the device is to offload the left ventricle and to augment lower body perfusion in patients with moderate congestive heart failure. The VAD consists of an intra-aortic impeller with a built-in permanent magnet rotor and an extra-aortic stator. The control algorithms, which use pressure readings upstream and downstream of the VAD to determine the pump status, have been tested in a mock circulatory system under two conditions, namely with or without afterload sensitivity. The results give an insight into controller design for an intra-aortic blood pump working in series with the heart.

Derivative Kernels for Noise Robust ASR

Recently there has been interest in combined gen- erative/discriminative classifiers. In these classifiers features for the discriminative models are derived from generative kernels. One advantage of using generative kernels is that systematic approaches exist how to introduce complex dependencies beyond conditional independence assumptions. Furthermore, by using generative kernels model-based compensation/adaptation tech- niques can be applied to make discriminative models robust to noise/speaker conditions. This paper extends previous work with combined generative/discriminative classifiers in several directions. First, it introduces derivative kernels based on context- dependent generative models. Second, it describes how derivative kernels can be incorporated in continuous discriminative models. Third, it addresses the issues associated with large number of classes and parameters when context-dependent models and high- dimensional features of derivative kernels are used. The approach is evaluated on two noise-corrupted tasks: small vocabulary AURORA 2 and medium-to-large vocabulary AURORA 4 task.

The Gaussian process density sampler

We present the Gaussian Process Density Sampler (GPDS), an exchangeable generative model for use in nonparametric Bayesian density estimation. Samples drawn from the GPDS are consistent with exact, independent samples from a fixed density function that is a transformation of a function drawn from a Gaussian process prior. Our formulation allows us to infer an unknown density from data using Markov chain Monte Carlo, which gives samples from the posterior distribution over density functions and from the predictive distribution on data space. We can also infer the hyperparameters of the Gaussian process. We compare this density modeling technique to several existing techniques on a toy problem and a skullreconstruction task.

Derivative kernels for noise robust ASR

Recently there has been interest in combining generative and discriminative classifiers. In these classifiers features for the discriminative models are derived from the generative kernels. One advantage of using generative kernels is that systematic approaches exist to introduce complex dependencies into the feature-space. Furthermore, as the features are based on generative models standard model-based compensation and adaptation techniques can be applied to make discriminative models robust to noise and speaker conditions. This paper extends previous work in this framework in several directions. First, it introduces derivative kernels based on context-dependent generative models. Second, it describes how derivative kernels can be incorporated in structured discriminative models. Third, it addresses the issues associated with large number of classes and parameters when context-dependent models and high-dimensional feature-spaces of derivative kernels are used. The approach is evaluated on two noise-corrupted tasks: small vocabulary AURORA 2 and medium-to-large vocabulary AURORA 4 task. © 2011 IEEE.

Silhouette-based object phenotype recognition using 3D shape priors

This paper tackles the novel challenging problem of 3D object phenotype recognition from a single 2D silhouette. To bridge the large pose (articulation or deformation) and camera viewpoint changes between the gallery images and query image, we propose a novel probabilistic inference algorithm based on 3D shape priors. Our approach combines both generative and discriminative learning. We use latent probabilistic generative models to capture 3D shape and pose variations from a set of 3D mesh models. Based on these 3D shape priors, we generate a large number of projections for different phenotype classes, poses, and camera viewpoints, and implement Random Forests to efficiently solve the shape and pose inference problems. By model selection in terms of the silhouette coherency between the query and the projections of 3D shapes synthesized using the galleries, we achieve the phenotype recognition result as well as a fast approximate 3D reconstruction of the query. To verify the efficacy of the proposed approach, we present new datasets which contain over 500 images of various human and shark phenotypes and motions. The experimental results clearly show the benefits of using the 3D priors in the proposed method over previous 2D-based methods. © 2011 IEEE.

Growth and shape control of disks by bending and extension

Differential growth of thin elastic bodies furnishes a surprisingly simple explanation of the complex and intriguing shapes of many biological systems, such as plant leaves and organs. Similarly, inelastic strains induced by thermal effects or active materials in layered plates are extensively used to control the curvature of thin engineering structures. Such behaviour inspires us to distinguish and to compare two possible modes of differential growth not normally compared to each other, in order to reveal the full range of out-of-plane shapes of an initially flat disk. The first growth mode, frequently employed by engineers, is characterised by direct bending strains through the thickness, and the second mode, mainly apparent in biological systems, is driven by extensional strains of the middle surface. When each mode is considered separately, it is shown that buckling is common to both modes, leading to bistable shapes: growth from bending strains results in a double-curvature limit at buckling, followed by almost developable deformation in which the Gaussian curvature at buckling is conserved; during extensional growth, out-of-plane distortions occur only when the buckling condition is reached, and the Gaussian curvature continues to increase. When both growth modes are present, it is shown that, generally, larger displacements are obtained under in-plane growth when the disk is relatively thick and growth strains are small, and vice versa. It is also shown that shapes can be mono-, bi-, tri- or neutrally stable, depending on the growth strain levels and the material properties: furthermore, it is shown that certain combinations of growth modes result in a free, or natural, response in which the doubly curved shape of disk exactly matches the imposed strains. Such diverse behaviour, in general, may help to realise more effective actuation schemes for engineering structures. © 2012 Elsevier Ltd. All rights reserved.

Attenuated Salmonella Typhimurium lacking the pathogenicity island-2 type 3 secretion system grow to high bacterial numbers inside phagocytes in mice.

Intracellular replication within specialized vacuoles and cell-to-cell spread in the tissue are essential for the virulence of Salmonella enterica. By observing infection dynamics at the single-cell level in vivo, we have discovered that the Salmonella pathogenicity island 2 (SPI-2) type 3 secretory system (T3SS) is dispensable for growth to high intracellular densities. This challenges the concept that intracellular replication absolutely requires proteins delivered by SPI-2 T3SS, which has been derived largely by inference from in vitro cell experiments and from unrefined measurement of net growth in mouse organs. Furthermore, we infer from our data that the SPI-2 T3SS mediates exit from infected cells, with consequent formation of new infection foci resulting in bacterial spread in the tissues. This suggests a new role for SPI-2 in vivo as a mediator of bacterial spread in the body. In addition, we demonstrate that very similar net growth rates of attenuated salmonellae in organs can be derived from very different underlying intracellular growth dynamics.

A Structured Model of Video Reproduces Primary Visual Cortical Organisation

The visual system must learn to infer the presence of objects and features in the world from the images it encounters, and as such it must, either implicitly or explicitly, model the way these elements interact to create the image. Do the response properties of cells in the mammalian visual system reflect this constraint? To address this question, we constructed a probabilistic model in which the identity and attributes of simple visual elements were represented explicitly and learnt the parameters of this model from unparsed, natural video sequences. After learning, the behaviour and grouping of variables in the probabilistic model corresponded closely to functional and anatomical properties of simple and complex cells in the primary visual cortex (V1). In particular, feature identity variables were activated in a way that resembled the activity of complex cells, while feature attribute variables responded much like simple cells. Furthermore, the grouping of the attributes within the model closely parallelled the reported anatomical grouping of simple cells in cat V1. Thus, this generative model makes explicit an interpretation of complex and simple cells as elements in the segmentation of a visual scene into basic independent features, along with a parametrisation of their moment-by-moment appearances. We speculate that such a segmentation may form the initial stage of a hierarchical system that progressively separates the identity and appearance of more articulated visual elements, culminating in view-invariant object recognition.