Gaussian process approximations of stochastic differential equations

Stochastic differential equations arise naturally in a range of contexts, from financial to environmental modeling. Current solution methods are limited in their representation of the posterior process in the presence of data. In this work, we present a novel Gaussian process approximation to the posterior measure over paths for a general class of stochastic differential equations in the presence of observations. The method is applied to two simple problems: the Ornstein-Uhlenbeck process, of which the exact solution is known and can be compared to, and the double-well system, for which standard approaches such as the ensemble Kalman smoother fail to provide a satisfactory result. Experiments show that our variational approximation is viable and that the results are very promising as the variational approximate solution outperforms standard Gaussian process regression for non-Gaussian Markov processes.

Quasi-separation of the biharmonic partial differential equation

In this paper, we consider analytical and numerical solutions to the Dirichlet boundary-value problem for the biharmonic partial differential equation on a disc of finite radius in the plane. The physical interpretation of these solutions is that of the harmonic oscillations of a thin, clamped plate. For the linear, fourth-order, biharmonic partial differential equation in the plane, it is well known that the solution method of separation in polar coordinates is not possible, in general. However, in this paper, for circular domains in the plane, it is shown that a method, here called quasi-separation of variables, does lead to solutions of the partial differential equation. These solutions are products of solutions of two ordinary linear differential equations: a fourth-order radial equation and a second-order angular differential equation. To be expected, without complete separation of the polar variables, there is some restriction on the range of these solutions in comparison with the corresponding separated solutions of the second-order harmonic differential equation in the plane. Notwithstanding these restrictions, the quasi-separation method leads to solutions of the Dirichlet boundary-value problem on a disc with centre at the origin, with boundary conditions determined by the solution and its inward drawn normal taking the value 0 on the edge of the disc. One significant feature for these biharmonic boundary-value problems, in general, follows from the form of the biharmonic differential expression when represented in polar coordinates. In this form, the differential expression has a singularity at the origin, in the radial variable. This singularity translates to a singularity at the origin of the fourth-order radial separated equation; this singularity necessitates the application of a third boundary condition in order to determine a self-adjoint solution to the Dirichlet boundary-value problem. The penultimate section of the paper reports on numerical solutions to the Dirichlet boundary-value problem; these results are also presented graphically. Two specific cases are studied in detail and numerical values of the eigenvalues are compared with the results obtained in earlier studies.

Variational mean-field algorithm for efficient inference in large systems of stochastic differential equations

This work introduces a Gaussian variational mean-field approximation for inference in dynamical systems which can be modeled by ordinary stochastic differential equations. This new approach allows one to express the variational free energy as a functional of the marginal moments of the approximating Gaussian process. A restriction of the moment equations to piecewise polynomial functions, over time, dramatically reduces the complexity of approximate inference for stochastic differential equation models and makes it comparable to that of discrete time hidden Markov models. The algorithm is demonstrated on state and parameter estimation for nonlinear problems with up to 1000 dimensional state vectors and compares the results empirically with various well-known inference methodologies.

A Computer Algebra Application to Determination of Lie Symmetries of Partial Differential Equations

The paper has been presented at the 12th International Conference on Applications of Computer Algebra, Varna, Bulgaria, June, 2006

Differential Equations in Abstract Cones

We extend the method of quasilinearization to differential equations in abstract normal cones. Under some assumptions, corresponding monotone iterations converge to the unique solution of our problem and this convergence is superlinear or semi–superlinear

Boundary-Value Problems for almost Nonlinear Singularly Perturbed Systems of Ordinary Differential Equations

A boundary-value problems for almost nonlinear singularly perturbed systems of ordinary differential equations are considered. An asymptotic solution is constructed under some assumption and using boundary functions and generalized inverse matrix and projectors.

Integral Manifolds and Bounded Solutions of Singularly Perturbed Systems of Impulsive Differential Equations

Sufficient conditions for the existence of bounded solutions of singularly perturbed impulsive differential equations are obtained. For this purpose integral manifolds are used.

Oscillation Theorems for Perturbed Second Order Nonlinear Differential Equations with Damping

Some oscillation criteria for solutions of a general perturbed second order ordinary differential equation with damping (r(t)x′ (t))′ + h(t)f (x)x′ (t) + ψ(t, x) = H(t, x(t), x′ (t)) with alternating coefficients are given. The results obtained improve and extend some existing results in the literature.

Extremal Solutions for a Class of Functional Differential Equations

We study, in Carathéodory assumptions, existence, continuation and continuous dependence of extremal solutions for an abstract and rather general class of hereditary differential equations. By some examples we prove that, unlike the nonfunctional case, solved Cauchy problems for hereditary differential equations may not have local extremal solutions.

Oscillation Theorems for Second Order Sublinear Ordinary Differential Equations

Oscillation criteria are given for the second order sublinear non-autonomous differential equation. (r(t) (x)x′(t))′ + q(t)g(x(t)) = (t). These criteria extends and improves earlier oscillation criteria of Kamenev, Kura, Philos and Wong. Oscillation criteria are also given for second order sublinear damped non-autonomous differential equations.

Application of Lyapunov's Direct Method to the Existence of Integral Manifolds of Impulsive Differential Equations

The present paper investigates the existence of integral manifolds for impulsive differential equations with variable perturbations. By means of piecewise continuous functions which are generalizations of the classical Lyapunov’s functions, sufficient conditions for the existence of integral manifolds of such equations are found.