Implicit stochastic Runge-Kutta methods for stochastic differential equations

In this paper we construct implicit stochastic Runge-Kutta (SRK) methods for solving stochastic differential equations of Stratonovich type. Instead of using the increment of a Wiener process, modified random variables are used. We give convergence conditions of the SRK methods with these modified random variables. In particular, the truncated random variable is used. We present a two-stage stiffly accurate diagonal implicit SRK (SADISRK2) method with strong order 1.0 which has better numerical behaviour than extant methods. We also construct a five-stage diagonal implicit SRK method and a six-stage stiffly accurate diagonal implicit SRK method with strong order 1.5. The mean-square and asymptotic stability properties of the trapezoidal method and the SADISRK2 method are analysed and compared with an explicit method and a semi-implicit method. Numerical results are reported for confirming convergence properties and for comparing the numerical behaviour of these methods.

Adaptive stepsize based on control theory for stochastic differential equations

The numerical solution of stochastic differential equations (SDEs) has been focussed recently on the development of numerical methods with good stability and order properties. These numerical implementations have been made with fixed stepsize, but there are many situations when a fixed stepsize is not appropriate. In the numerical solution of ordinary differential equations, much work has been carried out on developing robust implementation techniques using variable stepsize. It has been necessary, in the deterministic case, to consider the best choice for an initial stepsize, as well as developing effective strategies for stepsize control-the same, of course, must be carried out in the stochastic case. In this paper, proportional integral (PI) control is applied to a variable stepsize implementation of an embedded pair of stochastic Runge-Kutta methods used to obtain numerical solutions of nonstiff SDEs. For stiff SDEs, the embedded pair of the balanced Milstein and balanced implicit method is implemented in variable stepsize mode using a predictive controller for the stepsize change. The extension of these stepsize controllers from a digital filter theory point of view via PI with derivative (PID) control will also be implemented. The implementations show the improvement in efficiency that can be attained when using these control theory approaches compared with the regular stepsize change strategy. (C) 2004 Elsevier B.V. All rights reserved.

Numerical methods for strong solutions of stochastic differential equations: an overview

This paper gives a review of recent progress in the design of numerical methods for computing the trajectories (sample paths) of solutions to stochastic differential equations. We give a brief survey of the area focusing on a number of application areas where approximations to strong solutions are important, with a particular focus on computational biology applications, and give the necessary analytical tools for understanding some of the important concepts associated with stochastic processes. We present the stochastic Taylor series expansion as the fundamental mechanism for constructing effective numerical methods, give general results that relate local and global order of convergence and mention the Magnus expansion as a mechanism for designing methods that preserve the underlying structure of the problem. We also present various classes of explicit and implicit methods for strong solutions, based on the underlying structure of the problem. Finally, we discuss implementation issues relating to maintaining the Brownian path, efficient simulation of stochastic integrals and variable-step-size implementations based on various types of control.

Stochastic dynamic programming for election timing: A game theory approach

In this paper, we consider dynamic programming for the election timing in the majoritarian parliamentary system such as in Australia, where the government has a constitutional right to call an early election. This right can give the government an advantage to remain in power for as long as possible by calling an election, when its popularity is high. On the other hand, the opposition's natural objective is to gain power, and it will apply controls termed as "boosts" to reduce the chance of the government being re-elected by introducing policy and economic responses. In this paper, we explore equilibrium solutions to the government, and the opposition strategies in a political game using stochastic dynamic programming. Results are given in terms of the expected remaining life in power, call and boost probabilities at each time at any level of popularity.

Optimal strategies in political elections

In the Majoritarian Parliamentary System, the government has a constitutional right to call an early election. This right provides the government a control to achieve its objective to remain in power for as long as possible. We model the early election problem mathematically using opinion polls data as a stochastic process to proxy the government's probability of re-election. These data measure the difference in popularity between the government and the opposition. We fit a mean reverting Stochastic Differential Equation to describe the behaviour of the process and consider the possibility for the government to use other control tools, which are termed 'boosts' to induce shocks to the opinion polls by making timely policy announcements or economic actions. These actions improve the government's popularity and have some impact upon the early-election exercise boundary. © Austral. Mathematical Soc. 2005.

Stochastic models for regulatory networks of the genetic toggle switch

Bistability arises within a wide range of biological systems from the A phage switch in bacteria to cellular signal transduction pathways in mammalian cells. Changes in regulatory mechanisms may result in genetic switching in a bistable system. Recently, more and more experimental evidence in the form of bimodal population distributions indicates that noise plays a very important role in the switching of bistable systems. Although deterministic models have been used for studying the existence of bistability properties under various system conditions, these models cannot realize cell-to-cell fluctuations in genetic switching. However, there is a lag in the development of stochastic models for studying the impact of noise in bistable systems because of the lack of detailed knowledge of biochemical reactions, kinetic rates, and molecular numbers. in this work, we develop a previously undescribed general technique for developing quantitative stochastic models for large-scale genetic regulatory networks by introducing Poisson random variables into deterministic models described by ordinary differential equations. Two stochastic models have been proposed for the genetic toggle switch interfaced with either the SOS signaling pathway or a quorum-sensing signaling pathway, and we have successfully realized experimental results showing bimodal population distributions. Because the introduced stochastic models are based on widely used ordinary differential equation models, the success of this work suggests that this approach is a very promising one for studying noise in large-scale genetic regulatory networks.

Stochastic modelling and simulations for solute transport in porous media

A stochastic model for solute transport in aquifers is studied based on the concepts of stochastic velocity and stochastic diffusivity. By applying finite difference techniques to the spatial variables of the stochastic governing equation, a system of stiff stochastic ordinary differential equations is obtained. Both the semi-implicit Euler method and the balanced implicit method are used for solving this stochastic system. Based on the Karhunen-Loeve expansion, stochastic processes in time and space are calculated by means of a spatial correlation matrix. Four types of spatial correlation matrices are presented based on the hydraulic properties of physical parameters. Simulations with two types of correlation matrices are presented.

Quantum nondemolition measurement of Fock states of mesoscopic mechanical oscillators

We investigate a scheme that makes a quantum nondemolition (QND) measurement of the excitation level of a mesoscopic mechanical oscillator by utilizing the anharmonic coupling between two beam bending modes. The nonlinear coupling between the two modes shifts the resonant frequency of the readout oscillator in proportion to the excitation level of the system oscillator. This frequency shift may be detected as a phase shift of the readout oscillation when driven on resonance. We derive an equation for the reduced density matrix of the system oscillator, and use this to study the conditions under which discrete jumps in the excitation level occur. The appearance of jumps in the actual quantity measured is also studied using the method of quantum trajectories. We consider the feasibility of the scheme for experimentally accessible parameters.

Gauge Poisson representations for birth/death master equations

Poisson representation techniques provide a powerful method for mapping master equations for birth/death processes -- found in many fields of physics, chemistry and biology -- into more tractable stochastic differential equations. However, the usual expansion is not exact in the presence of boundary terms, which commonly occur when the differential equations are nonlinear. In this paper, a gauge Poisson technique is introduced that eliminates boundary terms, to give an exact representation as a weighted rate equation with stochastic terms. These methods provide novel techniques for calculating and understanding the effects of number correlations in systems that have a master equation description. As examples, correlations induced by strong mutations in genetics, and the astrophysical problem of molecule formation on microscopic grain surfaces are analyzed. Exact analytic results are obtained that can be compared with numerical simulations, demonstrating that stochastic gauge techniques can give exact results where standard Poisson expansions are not able to.

First-principles quantum dynamics in interacting Bose gases II: stochastic gauges

First principles simulations of the quantum dynamics of interacting Bose gases using the stochastic gauge representation are analysed. In a companion paper, we showed how the positive-P representation can be applied to these problems using stochastic differential equations. That method, however, is limited by increased sampling error as time evolves. Here, we show how the sampling error can be greatly reduced and the simulation time significantly extended using stochastic gauges. In particular, local stochastic gauges (a subset) are investigated. Improvements are confirmed in numerical calculations of single-, double- and multi-mode systems in the weak-mode coupling regime. Convergence issues are investigated, including the recognition of two modes by which stochastic equations produced by phase-space methods in general can diverge: movable singularities and a noise-weight relationship. The example calculated here displays wave-like behaviour in spatial correlation functions propagating in a uniform 1D gas after a sudden change in the coupling constant. This could in principle be tested experimentally using Feshbach resonance methods.

Accelerated leap methods for simulating discrete stochastic chemical kinetics

Biologists are increasingly conscious of the critical role that noise plays in cellular functions such as genetic regulation, often in connection with fluctuations in small numbers of key regulatory molecules. This has inspired the development of models that capture this fundamentally discrete and stochastic nature of cellular biology - most notably the Gillespie stochastic simulation algorithm (SSA). The SSA simulates a temporally homogeneous, discrete-state, continuous-time Markov process, and of course the corresponding probabilities and numbers of each molecular species must all remain positive. While accurately serving this purpose, the SSA can be computationally inefficient due to very small time stepping so faster approximations such as the Poisson and Binomial τ-leap methods have been suggested. This work places these leap methods in the context of numerical methods for the solution of stochastic differential equations (SDEs) driven by Poisson noise. This allows analogues of Euler-Maruyuma, Milstein and even higher order methods to be developed through the Itô-Taylor expansions as well as similar derivative-free Runge-Kutta approaches. Numerical results demonstrate that these novel methods compare favourably with existing techniques for simulating biochemical reactions by more accurately capturing crucial properties such as the mean and variance than existing methods.