Numerical methods for second-order stochastic differential equations

We seek numerical methods for second‐order stochastic differential equations that reproduce the stationary density accurately for all values of damping. A complete analysis is possible for scalar linear second‐order equations (damped harmonic oscillators with additive noise), where the statistics are Gaussian and can be calculated exactly in the continuous‐time and discrete‐time cases. A matrix equation is given for the stationary variances and correlation for methods using one Gaussian random variable per timestep. The only Runge–Kutta method with a nonsingular tableau matrix that gives the exact steady state density for all values of damping is the implicit midpoint rule. Numerical experiments, comparing the implicit midpoint rule with Heun and leapfrog methods on nonlinear equations with additive or multiplicative noise, produce behavior similar to the linear case.

Application of higher order spectra to identify epileptic EEG

Epilepsy is characterized by the spontaneous and seemingly unforeseeable occurrence of seizures, during which the perception or behavior of patients is disturbed. An automatic system that detects seizure onsets would allow patients or the people near them to take appropriate precautions, and could provide more insight into this phenomenon. Various methods have been proposed to predict the onset of seizures based on EEG recordings. The use of nonlinear features motivated by the higher order spectra (HOS) has been reported to be a promising approach to differentiate between normal, background (pre-ictal) and epileptic EEG signals. In this work, we made a comparative study of the performance of Gaussian mixture model (GMM) and Support Vector Machine (SVM) classifiers using the features derived from HOS and from the power spectrum. Results show that the selected HOS based features achieve 93.11% classification accuracy compared to 88.78% with features derived from the power spectrum for a GMM classifier. The SVM classifier achieves an improvement from 86.89% with features based on the power spectrum to 92.56% with features based on the bispectrum.

Shape discrimination using invariants defined from higher-order spectra

An approach to pattern recognition using invariant parameters based on higher-order spectra is presented. In particular, bispectral invariants are used to classify one-dimensional shapes. The bispectrum, which is translation invariant, is integrated along straight lines passing through the origin in bifrequency space. The phase of the integrated bispectrum is shown to be scale- and amplification-invariant. A minimal set of these invariants is selected as the feature vector for pattern classification. Pattern recognition using higher-order spectral invariants is fast, suited for parallel implementation, and works for signals corrupted by Gaussian noise. The classification technique is shown to distinguish two similar but different bolts given their one-dimensional profiles

An approach to statistical lip modelling for speaker identification via chromatic feature extraction

This paper presents a novel technique for the tracking of moving lips for the purpose of speaker identification. In our system, a model of the lip contour is formed directly from chromatic information in the lip region. Iterative refinement of contour point estimates is not required. Colour features are extracted from the lips via concatenated profiles taken around the lip contour. Reduction of order in lip features is obtained via principal component analysis (PCA) followed by linear discriminant analysis (LDA). Statistical speaker models are built from the lip features based on the Gaussian mixture model (GMM). Identification experiments performed on the M2VTS¹ database, show encouraging results

Stochastic modelling of T cell homeostasis for two competing clonotypes via the master equation

Stochastic models for competing clonotypes of T cells by multivariate, continuous-time, discrete state, Markov processes have been proposed in the literature by Stirk, Molina-París and van den Berg (2008). A stochastic modelling framework is important because of rare events associated with small populations of some critical cell types. Usually, computational methods for these problems employ a trajectory-based approach, based on Monte Carlo simulation. This is partly because the complementary, probability density function (PDF) approaches can be expensive but here we describe some efficient PDF approaches by directly solving the governing equations, known as the Master Equation. These computations are made very efficient through an approximation of the state space by the Finite State Projection and through the use of Krylov subspace methods when evolving the matrix exponential. These computational methods allow us to explore the evolution of the PDFs associated with these stochastic models, and bimodal distributions arise in some parameter regimes. Time-dependent propensities naturally arise in immunological processes due to, for example, age-dependent effects. Incorporating time-dependent propensities into the framework of the Master Equation significantly complicates the corresponding computational methods but here we describe an efficient approach via Magnus formulas. Although this contribution focuses on the example of competing clonotypes, the general principles are relevant to multivariate Markov processes and provide fundamental techniques for computational immunology.

Scene invariant crowd counting

This paper describes a scene invariant crowd counting algorithm that uses local features to monitor crowd size. Unlike previous algorithms that require each camera to be trained separately, the proposed method uses camera calibration to scale between viewpoints, allowing a system to be trained and tested on different scenes. A pre-trained system could therefore be used as a turn-key solution for crowd counting across a wide range of environments. The use of local features allows the proposed algorithm to calculate local occupancy statistics, and Gaussian process regression is used to scale to conditions which are unseen in the training data, also providing confidence intervals for the crowd size estimate. A new crowd counting database is introduced to the computer vision community to enable a wider evaluation over multiple scenes, and the proposed algorithm is tested on seven datasets to demonstrate scene invariance and high accuracy. To the authors' knowledge this is the first system of its kind due to its ability to scale between different scenes and viewpoints.

New variational Bayesian approaches for statistical data mining : with applications to profiling and differentiating habitual consumption behaviour of customers in the wireless telecommunication industry

This thesis investigates profiling and differentiating customers through the use of statistical data mining techniques. The business application of our work centres on examining individuals’ seldomly studied yet critical consumption behaviour over an extensive time period within the context of the wireless telecommunication industry; consumption behaviour (as oppose to purchasing behaviour) is behaviour that has been performed so frequently that it become habitual and involves minimal intentions or decision making. Key variables investigated are the activity initialised timestamp and cell tower location as well as the activity type and usage quantity (e.g., voice call with duration in seconds); and the research focuses are on customers’ spatial and temporal usage behaviour. The main methodological emphasis is on the development of clustering models based on Gaussian mixture models (GMMs) which are fitted with the use of the recently developed variational Bayesian (VB) method. VB is an efficient deterministic alternative to the popular but computationally demandingMarkov chainMonte Carlo (MCMC) methods. The standard VBGMMalgorithm is extended by allowing component splitting such that it is robust to initial parameter choices and can automatically and efficiently determine the number of components. The new algorithm we propose allows more effective modelling of individuals’ highly heterogeneous and spiky spatial usage behaviour, or more generally human mobility patterns; the term spiky describes data patterns with large areas of low probability mixed with small areas of high probability. Customers are then characterised and segmented based on the fitted GMM which corresponds to how each of them uses the products/services spatially in their daily lives; this is essentially their likely lifestyle and occupational traits. Other significant research contributions include fitting GMMs using VB to circular data i.e., the temporal usage behaviour, and developing clustering algorithms suitable for high dimensional data based on the use of VB-GMM.

Knowledge and attitudes of paediatric nurses related to breastfeeding

Introduction: Almost 90% of Australian mothers are exclusively breastfeeding when they discharge from maternity hospitals but by six months of age breastfeeding infants have reduced to 32% nationally and 19% in Queensland, far below the national target of 80%. Many factors influence the choice to breastfeed, including health care provision, therefore the knowledge and attitudes of paediatric nurses have the potential to affect breastfeeding duration. Aims: To assess current breastfeeding knowledge and attitudes of paediatric nurses in metropolitan and regional Queensland settings. Method: The study used a cross-sectional survey design. The tool was developed from several documented health professional questionnaires about breastfeeding, with permission from authors. Survey items relating breastfeeding physiology, factors relating to breastfeeding success, and local, national and international policies were also included. Ethics approval was granted from the appropriate Ethics Committees to conduct the survey through tertiary metropolitan and regional hospital settings. Results: A total of 241 surveys were returned, achieving a response rate of 53%. Nurses acknowledged breastmilk as the best source of nutrition for infants (99%, n=238) and that mothers should be encouraged to breastfeed (92%, n=221). However, many respondents considered infant formula a nutritional equivalent (44%, n=105) and (47%, n=113) were unaware that supplemental formulas interfered with successful breastfeeding. Most nurses recognised that stress (e.g. infant hospitalisation) impacts on the success of breastfeeding (90%, n=216). Knowledge of breastfeeding anatomy and physiology was poor and a substantial number of nurses did not identify correct attachment in response to two diagrammatic representations (76%, n=183 and 45%, n=109). Survey results demonstrated deficiencies in knowledge that would impact on support provided to breastfeeding mothers. Knowledge deficits were also identified relating to local, national and international policies and protocols concerning breastfeeding and breastmilk substitutes. Conclusion: Breastfeeding knowledge and attitudes were exceptional in areas related to general breastfeeding knowledge. However, in areas directly related to nursing practice, considerable deficits in paediatric nurses' knowledge and attitudes were identified. Lack of appropriate skills, knowledge and varying attitudes amongst paediatric nurses has the potential to negatively impact on the education, advice and support provided to breastfeeding mothers and their families whilst their infant is in hospital. These study findings will guide future research and strategies to improve knowledge and policy statements to assist paediatric nurses in fulfilling their role.

Cross likelihood ratio based speaker clustering using eigenvoice models

This paper proposes the use of eigenvoice modeling techniques with the Cross Likelihood Ratio (CLR) as a criterion for speaker clustering within a speaker diarization system. The CLR has previously been shown to be a robust decision criterion for speaker clustering using Gaussian Mixture Models. Recently, eigenvoice modeling techniques have become increasingly popular, due to its ability to adequately represent a speaker based on sparse training data, as well as an improved capture of differences in speaker characteristics. This paper hence proposes that it would be beneficial to capitalize on the advantages of eigenvoice modeling in a CLR framework. Results obtained on the 2002 Rich Transcription (RT-02) Evaluation dataset show an improved clustering performance, resulting in a 35.1% relative improvement in the overall Diarization Error Rate (DER) compared to the baseline system.

i-vector based speaker recognition on short utterances

Robust speaker verification on short utterances remains a key consideration when deploying automatic speaker recognition, as many real world applications often have access to only limited duration speech data. This paper explores how the recent technologies focused around total variability modeling behave when training and testing utterance lengths are reduced. Results are presented which provide a comparison of Joint Factor Analysis (JFA) and i-vector based systems including various compensation techniques; Within-Class Covariance Normalization (WCCN), LDA, Scatter Difference Nuisance Attribute Projection (SDNAP) and Gaussian Probabilistic Linear Discriminant Analysis (GPLDA). Speaker verification performance for utterances with as little as 2 sec of data taken from the NIST Speaker Recognition Evaluations are presented to provide a clearer picture of the current performance characteristics of these techniques in short utterance conditions.

Pattern recognition using invariants defined from higher order spectra - one-dimensional inputs

A new approach to pattern recognition using invariant parameters based on higher order spectra is presented. In particular, invariant parameters derived from the bispectrum are used to classify one-dimensional shapes. The bispectrum, which is translation invariant, is integrated along straight lines passing through the origin in bifrequency space. The phase of the integrated bispectrum is shown to be scale and amplification invariant, as well. A minimal set of these invariants is selected as the feature vector for pattern classification, and a minimum distance classifier using a statistical distance measure is used to classify test patterns. The classification technique is shown to distinguish two similar, but different bolts given their one-dimensional profiles. Pattern recognition using higher order spectral invariants is fast, suited for parallel implementation, and has high immunity to additive Gaussian noise. Simulation results show very high classification accuracy, even for low signal-to-noise ratios.

On the behaviour of higher-order spectral features for object recognition in the presence of various types of noise

This paper presents results on the robustness of higher-order spectral features to Gaussian, Rayleigh, and uniform distributed noise. Based on cluster plots and accuracy results for various signal to noise conditions, the higher-order spectral features are shown to be better than moment invariant features.

Robust multidisciplinary UAS design optimisation

There are many applications in aeronautical/aerospace engineering where some values of the design parameters states cannot be provided or determined accurately. These values can be related to the geometry(wingspan, length, angles) and or to operational flight conditions that vary due to the presence of uncertainty parameters (Mach, angle of attack, air density and temperature, etc.). These uncertainty design parameters cannot be ignored in engineering design and must be taken into the optimisation task to produce more realistic and reliable solutions. In this paper, a robust/uncertainty design method with statistical constraints is introduced to produce a set of reliable solutions which have high performance and low sensitivity. Robust design concept coupled with Multi Objective Evolutionary Algorithms (MOEAs) is defined by applying two statistical sampling formulas; mean and variance/standard deviation associated with the optimisation fitness/objective functions. The methodology is based on a canonical evolution strategy and incorporates the concepts of hierarchical topology, parallel computing and asynchronous evaluation. It is implemented for two practical Unmanned Aerial System (UAS) design problems; the flrst case considers robust multi-objective (single disciplinary: aerodynamics) design optimisation and the second considers a robust multidisciplinary (aero structures) design optimisation. Numerical results show that the solutions obtained by the robust design method with statistical constraints have a more reliable performance and sensitivity in both aerodynamics and structures when compared to the baseline design.

Visual voice activity detection using frontal versus profile views

Visual activity detection of lip movements can be used to overcome the poor performance of voice activity detection based solely in the audio domain, particularly in noisy acoustic conditions. However, most of the research conducted in visual voice activity detection (VVAD) has neglected addressing variabilities in the visual domain such as viewpoint variation. In this paper we investigate the effectiveness of the visual information from the speaker’s frontal and profile views (i.e left and right side views) for the task of VVAD. As far as we are aware, our work constitutes the first real attempt to study this problem. We describe our visual front end approach and the Gaussian mixture model (GMM) based VVAD framework, and report the experimental results using the freely available CUAVE database. The experimental results show that VVAD is indeed possible from profile views and we give a quantitative comparison of VVAD based on frontal and profile views The results presented are useful in the development of multi-modal Human Machine Interaction (HMI) using a single camera, where the speaker’s face may not always be frontal.

Neuropsychological development in children with early and continuously treated phenylketonuria : association with biochemical markers

PKU is a genetically inherited inborn error of metabolism caused by a deficiency of the enzyme phenylalanine hydroxylase. The failure of this enzyme causes incomplete metabolism of protein ingested in the diet, specifically the conversion of one amino acid, phenylalanine, to tyrosine, which is a precursor to the neurotransmitter dopamine. Rising levels of phenylalanine is toxic to the developing brain, disrupting the formation of white matter tracts. The impact of tyrosine deficiency is not as well understood, but is hypothesized to lead to a low dopamine environment for the developing brain. Detection in the newborn period and continuous treatment (a low protein phe-restricted diet supplemented with phenylalanine-free protein formulas) has resulted in children with early and continuously treated PKU now developing normal I.Q. However, deficits in executive function (EF) are common, leading to a rate of Attention Deficit Hyperactivity Disorder (ADHD) up to five times the norm. EF worsens with exposure to higher phenylalanine levels, however recent research has demonstrated that a high phenylalanine to tyrosine ratio (phenylalanine:tyrosine ratio), which is hypothesised to lead to poorer dopamine function, has a more negative impact on EF than phenylalanine levels alone. Research and treatment of PKU is currently phenylalanine-focused, with little investigation of the impact of tyrosine on neuropsychological development. There is no current consensus as to the veracity of tyrosine monitoring or treatment in this population. Further, the research agenda in this population has demonstrated a primary focus on EF impairment alone, even though there may be additional neuropsychological skills compromised (e.g., mood, visuospatial deficits). The aim of this PhD research was to identify residual neuropsychological deficits in a cohort of children with early and continuously treated phenylketonuria, at two time points in development (early childhood and early adolescence), separated by eight years. In addition, this research sought to determine which biochemical markers were associated with neuropsychological impairments. A clinical practice survey was also undertaken to ascertain the current level of monitoring/treatment of tyrosine in this population. Thirteen children with early and continuously treated PKU were tested at mean age 5.9 years and again at mean age 13.95 years on several neuropsychological measures. Four children with hyperphenylalaninemia (a milder version of PKU) were also tested at both time points and provide a comparison group in analyses. Associations between neuropsychological function and biochemical markers were analysed. A between groups analysis in adolescence was also conducted (children with PKU compared to their siblings) on parent report measures of EF and mood. Minor EF impairments were evident in the PKU group by age 6 years and these persisted into adolescence. Life-long exposure to high phenylalanine:tyrosine ratio and/or low tyrosine independent of phenylalanine were significantly associated with EF impairments at both time points. Over half the children with PKU showed severe impairment on a visuospatial task, and this was associated only with concurrent levels of tyrosine in adolescence. Children with PKU also showed a statistically significant decline in a language comprehension task from 6 years to adolescence (going from normal to subnormal), this deficit was associated with lifetime levels of phenylalanine. In comparison, the four children with hyperphenylalaninemia demonstrated normal function at both time points, across all measures. No statistically significant differences were detected between children with PKU and their siblings on the parent report of EF and mood. However, depressive symptoms were significantly correlated with: EF; long term high phe:tyr exposure; and low tyrosine levels independent of phenylalanine. The practice survey of metabolic clinics from 12 countries indicated a high level of variability in terms of monitoring/treatment of tyrosine in this population. Whilst over 80% of clinics surveyed routinely monitored tyrosine levels in their child patients, 25% reported treatment strategies to increase tyrosine (and thereby lower the phenylalanine:tyrosine ratio) under a variety of patient presentation conditions. Overall, these studies have shown that EF impairments associated with PKU provide support for the dopamine-deficiency model. A language comprehension task showed a different trajectory, serving a timely reminder that non-EF functions also remain vulnerable in this population; and that normal function in childhood does not guarantee normal function by adolescence. Mood impairments were associated with EF impairments as well as long term measures of phenylalanine:tyrosine and/or tyrosine. The implications of this research for enhanced clinical guidelines are discussed given varied current practice.