Discrete-time mean variance optimal control of linear systems with Markovian jumps and multiplicative noise

In this article, we consider the stochastic optimal control problem of discrete-time linear systems subject to Markov jumps and multiplicative noise under three kinds of performance criterions related to the final value of the expectation and variance of the output. In the first problem it is desired to minimise the final variance of the output subject to a restriction on its final expectation, in the second one it is desired to maximise the final expectation of the output subject to a restriction on its final variance, and in the third one it is considered a performance criterion composed by a linear combination of the final variance and expectation of the output of the system. We present explicit sufficient conditions for the existence of an optimal control strategy for these problems, generalising previous results in the literature. We conclude this article presenting a numerical example of an asset liabilities management model for pension funds with regime switching.

Generalized Coupled Algebraic Riccati Equations for Discrete-time Markov Jump with Multiplicative Noise Systems

In this paper we consider the existence of the maximal and mean square stabilizing solutions for a set of generalized coupled algebraic Riccati equations (GCARE for short) associated to the infinite-horizon stochastic optimal control problem of discrete-time Markov jump with multiplicative noise linear systems. The weighting matrices of the state and control for the quadratic part are allowed to be indefinite. We present a sufficient condition, based only on some positive semi-definite and kernel restrictions on some matrices, under which there exists the maximal solution and a necessary and sufficient condition under which there exists the mean square stabilizing solution fir the GCARE. We also present a solution for the discounted and long run average cost problems when the performance criterion is assumed be composed by a linear combination of an indefinite quadratic part and a linear part in the state and control variables. The paper is concluded with a numerical example for pension fund with regime switching.

Fluctuations in domain growth: Ginzburg-Landau equations with multiplicative noise

Ginzburg-Landau equations with multiplicative noise are considered, to study the effects of fluctuations in domain growth. The equations are derived from a coarse-grained methodology and expressions for the resulting concentration-dependent diffusion coefficients are proposed. The multiplicative noise gives contributions to the Cahn-Hilliard linear-stability analysis. In particular, it introduces a delay in the domain-growth dynamics.

Numerical algorithm for Ginzburg-Landau equations with multiplicative noise: Application to domain growth

We consider stochastic partial differential equations with multiplicative noise. We derive an algorithm for the computer simulation of these equations. The algorithm is applied to study domain growth of a model with a conserved order parameter. The numerical results corroborate previous analytical predictions obtained by linear analysis.

Decay of an unstable state in the presence of multiplicative noise

The phenomenon of anomalous fluctuations associated with the decay of an unstable state is analyzed in the presence of multiplicative noise. A theory is presented and compared with a numerical simulation. Our results allow us to distinguish the roles of additive and multiplicative noise in the nonlinear relaxation process. We suggest the use of experiments on transient dynamics to understand the effect of these two sources of noise in problems in which parametric noise is thought to be important, such as dye lasers.

Relaxation time of processes driven by multiplicative noise

We consider systems described by nonlinear stochastic differential equations with multiplicative noise. We study the relaxation time of the steady-state correlation function as a function of noise parameters. We consider the white- and nonwhite-noise case for a prototype model for which numerical data are available. We discuss the validity of analytical approximation schemes. For the white-noise case we discuss the results of a projector-operator technique. This discussion allows us to give a generalization of the method to the non-white-noise case. Within this generalization, we account for the growth of the relaxation time as a function of the correlation time of the noise. This behavior is traced back to the existence of a non-Markovian term in the equation for the correlation function.

Kinematic reduction of reaction-diffusion fronts with multiplicative noise. Derivation of stochastic sharp-interface equations

We study the dynamics of generic reaction-diffusion fronts, including pulses and chemical waves, in the presence of multiplicative noise. We discuss the connection between the reaction-diffusion Langevin-like field equations and the kinematic (eikonal) description in terms of a stochastic moving-boundary or sharp-interface approximation. We find that the effective noise is additive and we relate its strength to the noise parameters in the original field equations, to first order in noise strength, but including a partial resummation to all orders which captures the singular dependence on the microscopic cutoff associated with the spatial correlation of the noise. This dependence is essential for a quantitative and qualitative understanding of fluctuating fronts, affecting both scaling properties and nonuniversal quantities. Our results predict phenomena such as the shift of the transition point between the pushed and pulled regimes of front propagation, in terms of the noise parameters, and the corresponding transition to a non-Kardar-Parisi-Zhang universality class. We assess the quantitative validity of the results in several examples including equilibrium fluctuations and kinetic roughening. We also predict and observe a noise-induced pushed-pulled transition. The analytical predictions are successfully tested against rigorous results and show excellent agreement with numerical simulations of reaction-diffusion field equations with multiplicative noise.

Mean field model for spatially extended systems in the presence of multiplicative noise

We present a mean field model that describes the effect of multiplicative noise in spatially extended systems. The model can be solved analytically. For the case of the phi4 potential it predicts that the phase transition is shifted. This conclusion is supported by numerical simulations of this model in two dimensions.

Ballistic and diffusive corrections to front propagation in the presence of multiplicative noise

We study the dynamics of reaction-diffusion fronts under the influence of multiplicative noise. An approximate theoretical scheme is introduced to compute the velocity of the front and its diffusive wandering due to the presence of noise. The theoretical approach is based on a multiple scale analysis rather than on a small noise expansion and is confirmed with numerical simulations for a wide range of the noise intensity. We report on the possibility of noise sustained solutions with a continuum of possible velocities, in situations where only a single velocity is allowed without noise.

Nonequilibrium transitions induced by multiplicative noise

A simple model exhibiting a noise-induced ordering transition (NIOT) and a noise-induced disordering transition (NIDT), in which the noise is purely multiplicative, is presented. Both transitions are found in two dimensions as well as in one dimension. We show analytically and numerically that the critical behavior of these two transitions is described by the so called multiplicative noise (MN) universality class. A computation of the set of critical exponents is presented in both d=1 and d=2.

Multiplicative noise effects on relaxations from marginal states

Relaxational processes in bistable potentials close to marginal conditions are studied under the combined effect of additive and multiplicative fluctuations. Characteristic time scales associated with the first-passage-time-distribution are analytically obtained. Multiplicative noise introduces large effects on the characteristic decay times, which is particularly significant when relaxations are mediated by fluctuations, i.e., below marginality and for small noise intensity. The relevance of our approach with respect to realistic chemical bistable systems experimentally operated under external noise influences is mentioned.

Langevin equations with multiplicative noise: Application to domain growth

Langevin Equations of Ginzburg-Landau form, with multiplicative noise, are proposed to study the effects of fluctuations in domain growth. These equations are derived from a coarse-grained methodology. The Cahn-Hiliard-Cook linear stability analysis predicts some effects in the transitory regime. We also derive numerical algorithms for the computer simulation of these equations. The numerical results corroborate the analytical predictions of the linear analysis. We also present simulation results for spinodal decomposition at large times.

Correlation times in stochastic equations with delayed feedback and multiplicative noise

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Linear minimum mean square filter for discrete-time linear systems with Markov jumps and multiplicative noises

In this paper we obtain the linear minimum mean square estimator (LMMSE) for discrete-time linear systems subject to state and measurement multiplicative noises and Markov jumps on the parameters. It is assumed that the Markov chain is not available. By using geometric arguments we obtain a Kalman type filter conveniently implementable in a recurrence form. The stationary case is also studied and a proof for the convergence of the error covariance matrix of the LMMSE to a stationary value under the assumption of mean square stability of the system and ergodicity of the associated Markov chain is obtained. It is shown that there exists a unique positive semi-definite solution for the stationary Riccati-like filter equation and, moreover, this solution is the limit of the error covariance matrix of the LMMSE. The advantage of this scheme is that it is very easy to implement and all calculations can be performed offline. (c) 2011 Elsevier Ltd. All rights reserved.

Effects of external noise on the Swift-Hohenberg Equation

The Swift-Hohenberg equation is studied in the presence of a multiplicative noise. This stochastic equation could describe a situation in which a noise has been superimposed on the temperature gradient between the two plates of a Rayleigh-Bnard cell. A linear stability analysis and numerical simulations show that, in constrast to the additive-noise case, convective structures appear in a regime in which a deterministic analysis predicts a homogeneous solution.