Model choice problems using approximate Bayesian computation with applications to pathogen transmission data sets

Analytically or computationally intractable likelihood functions can arise in complex statistical inferential problems making them inaccessible to standard Bayesian inferential methods. Approximate Bayesian computation (ABC) methods address such inferential problems by replacing direct likelihood evaluations with repeated sampling from the model. ABC methods have been predominantly applied to parameter estimation problems and less to model choice problems due to the added difficulty of handling multiple model spaces. The ABC algorithm proposed here addresses model choice problems by extending Fearnhead and Prangle (2012, Journal of the Royal Statistical Society, Series B 74, 1–28) where the posterior mean of the model parameters estimated through regression formed the summary statistics used in the discrepancy measure. An additional stepwise multinomial logistic regression is performed on the model indicator variable in the regression step and the estimated model probabilities are incorporated into the set of summary statistics for model choice purposes. A reversible jump Markov chain Monte Carlo step is also included in the algorithm to increase model diversity for thorough exploration of the model space. This algorithm was applied to a validating example to demonstrate the robustness of the algorithm across a wide range of true model probabilities. Its subsequent use in three pathogen transmission examples of varying complexity illustrates the utility of the algorithm in inferring preference of particular transmission models for the pathogens.

Online estimation of Allan variance parameters

A new online method is presented for estimation of the angular randomwalk and rate randomwalk coefficients of inertial measurement unit gyros and accelerometers. In the online method, a state-space model is proposed, and recursive parameter estimators are proposed for quantities previously measured from offline data techniques such as the Allan variance method. The Allan variance method has large offline computational effort and data storage requirements. The technique proposed here requires no data storage and computational effort of approximately 100 calculations per data sample.

Reduced complexity on-line estimation of hidden Markov model parameters

In this paper we propose and study low complexity algorithms for on-line estimation of hidden Markov model (HMM) parameters. The estimates approach the true model parameters as the measurement noise approaches zero, but otherwise give improved estimates, albeit with bias. On a nite data set in the high noise case, the bias may not be signi cantly more severe than for a higher complexity asymptotically optimal scheme. Our algorithms require O(N3) calculations per time instant, where N is the number of states. Previous algorithms based on earlier hidden Markov model signal processing methods, including the expectation-maximumisation (EM) algorithm require O(N4) calculations per time instant.

On-line estimation of Allan variance parameters

A new online method is presented for estimation of the angular random walk and rate random walk coefficients of IMU (inertial measurement unit) gyros and accelerometers. The online method proposes a state space model and proposes parameter estimators for quantities previously measured from off-line data techniques such as the Allan variance graph. Allan variance graphs have large off-line computational effort and data storage requirements. The technique proposed here requires no data storage and computational effort of O(100) calculations per data sample.

Computation of Mathematical Models for Complex Industrial Processes

Designed for undergraduate and postgraduate students, academic researchers and industrial practitioners, this book provides comprehensive case studies on numerical computing of industrial processes and step-by-step procedures for conducting industrial computing. It assumes minimal knowledge in numerical computing and computer programming, making it easy to read, understand and follow. Topics discussed include fundamentals of industrial computing, finite difference methods, the Wavelet-Collocation Method, the Wavelet-Galerkin Method, High Resolution Methods, and comparative studies of various methods. These are discussed using examples of carefully selected models from real processes of industrial significance. The step-by-step procedures in all these case studies can be easily applied to other industrial processes without a need for major changes and thus provide readers with useful frameworks for the applications of engineering computing in fundamental research problems and practical development scenarios.

Novel solutions for a model of wound healing angiogenesis

We prove the existence of novel, shock-fronted travelling wave solutions to a model of wound healing angiogenesis studied in Pettet et al (2000 IMA J. Math. App. Med. 17 395–413) assuming two conjectures hold. In the previous work, the authors showed that for certain parameter values, a heteroclinic orbit in the phase plane representing a smooth travelling wave solution exists. However, upon varying one of the parameters, the heteroclinic orbit was destroyed, or rather cut-off, by a wall of singularities in the phase plane. As a result, they concluded that under this parameter regime no travelling wave solutions existed. Using techniques from geometric singular perturbation theory and canard theory, we show that a travelling wave solution actually still exists for this parameter regime. We construct a heteroclinic orbit passing through the wall of singularities via a folded saddle canard point onto a repelling slow manifold. The orbit leaves this manifold via the fast dynamics and lands on the attracting slow manifold, finally connecting to its end state. This new travelling wave is no longer smooth but exhibits a sharp front or shock. Finally, we identify regions in parameter space where we expect that similar solutions exist. Moreover, we discuss the possibility of more exotic solutions.

Understanding Uncertainties in Non-Linear Population Trajectories: A Bayesian Semi-Parametric Hierarchical Approach to Large-Scale Surveys of Coral Cover

Recently, attempts to improve decision making in species management have focussed on uncertainties associated with modelling temporal fluctuations in populations. Reducing model uncertainty is challenging; while larger samples improve estimation of species trajectories and reduce statistical errors, they typically amplify variability in observed trajectories. In particular, traditional modelling approaches aimed at estimating population trajectories usually do not account well for nonlinearities and uncertainties associated with multi-scale observations characteristic of large spatio-temporal surveys. We present a Bayesian semi-parametric hierarchical model for simultaneously quantifying uncertainties associated with model structure and parameters, and scale-specific variability over time. We estimate uncertainty across a four-tiered spatial hierarchy of coral cover from the Great Barrier Reef. Coral variability is well described; however, our results show that, in the absence of additional model specifications, conclusions regarding coral trajectories become highly uncertain when considering multiple reefs, suggesting that management should focus more at the scale of individual reefs. The approach presented facilitates the description and estimation of population trajectories and associated uncertainties when variability cannot be attributed to specific causes and origins. We argue that our model can unlock value contained in large-scale datasets, provide guidance for understanding sources of uncertainty, and support better informed decision making

Mathematical modelling of intramembranous bone formation during fracture healing

During fracture healing, many complex and cryptic interactions occur between cells and bio-chemical molecules to bring about repair of damaged bone. In this thesis two mathematical models were developed, concerning the cellular differentiation of osteoblasts (bone forming cells) and the mineralisation of new bone tissue, allowing new insights into these processes. These models were mathematically analysed and simulated numerically, yielding results consistent with experimental data and highlighting the underlying pattern formation structure in these aspects of fracture healing.

Choosing an appropriate modelling framework for analysing multispecies co-culture cell biology experiments

In vitro cell biology assays play a crucial role in informing our understanding of the migratory, proliferative and invasive properties of many cell types in different biological contexts. While mono-culture assays involve the study of a population of cells composed of a single cell type, co-culture assays study a population of cells composed of multiple cell types (or subpopulations of cells). Such co-culture assays can provide more realistic insights into many biological processes including tissue repair, tissue regeneration and malignant spreading. Typically, system parameters, such as motility and proliferation rates, are estimated by calibrating a mathematical or computational model to the observed experimental data. However, parameter estimates can be highly sensitive to the choice of model and modelling framework. This observation motivates us to consider the fundamental question of how we can best choose a model to facilitate accurate parameter estimation for a particular assay. In this work we describe three mathematical models of mono-culture and co-culture assays that include different levels of spatial detail. We study various spatial summary statistics to explore if they can be used to distinguish between the suitability of each model over a range of parameter space. Our results for mono-culture experiments are promising, in that we suggest two spatial statistics that can be used to direct model choice. However, co-culture experiments are far more challenging: we show that these same spatial statistics which provide useful insight into mono-culture systems are insuffcient for co-culture systems. Therefore, we conclude that great care ought to be exercised when estimating the parameters of co-culture assays.

Pre-processing for approximate Bayesian computation in image analysis

Most of the existing algorithms for approximate Bayesian computation (ABC) assume that it is feasible to simulate pseudo-data from the model at each iteration. However, the computational cost of these simulations can be prohibitive for high dimensional data. An important example is the Potts model, which is commonly used in image analysis. Images encountered in real world applications can have millions of pixels, therefore scalability is a major concern. We apply ABC with a synthetic likelihood to the hidden Potts model with additive Gaussian noise. Using a pre-processing step, we fit a binding function to model the relationship between the model parameters and the synthetic likelihood parameters. Our numerical experiments demonstrate that the precomputed binding function dramatically improves the scalability of ABC, reducing the average runtime required for model fitting from 71 hours to only 7 minutes. We also illustrate the method by estimating the smoothing parameter for remotely sensed satellite imagery. Without precomputation, Bayesian inference is impractical for datasets of that scale.

Process considerations related to the microencapsulation of plasmid DNA via ultrasonic atomization

An effective means of facilitating DNA vaccine delivery to antigen presenting cells is through biodegradable microspheres. Microspheres offer distinct advantages over other delivery technologies by providing release of DNA vaccine in its bioactive form in a controlled fashion. In this study, biodegradable poly(D,L-lactide-coglycolide) (PLGA) microspheres containing polyethylenimine (PEI) condensed plasmid DNA (pDNA) were prepared using a 40 kHz ultrasonic atomization system. Process synthesis parameters, which are important to the scale-up of microspheres that are suitable for nasal delivery (i.e., less than 20 μm), were studied. These parameters include polymer concentration; feed flowrate; volumetric ratio of polymer and pDNA-PEI (plasmid DNA-polyethylenimine) complexes; and nitrogen to phosphorous (N/P) ratio. PDNA encapsulation efficiencies were predominantly in the range 82-96%, and the mean sizes of the particle were between 6 and 15 μm. The ultrasonic synthesis method was shown to have excellent reproducibility. PEI affected morphology of the microspheres, as it induced the formation of porous particles that accelerate the release rate of pDNA. The PLGA microspheres displayed an in vitro release of pDNA of 95-99% within 30 days and demonstrated zero order release kinetics without an initial spike of pDNA. Agarose electrophoresis confirmed conservation of the supercoiled form of pDNA throughout the synthesis and in vitro release stages. It was concluded that ultrasonic atomization is an efficient technique to overcome the key obstacles in scaling-up the manufacture of encapsulated vaccine for clinical trials and ultimately, commercial applications.