A stochastic approximation algorithm with Markov chain Monte-Carlo method for incomplete data estimation problems

We propose a general procedure for solving incomplete data estimation problems. The procedure can be used to find the maximum likelihood estimate or to solve estimating equations in difficult cases such as estimation with the censored or truncated regression model, the nonlinear structural measurement error model, and the random effects model. The procedure is based on the general principle of stochastic approximation and the Markov chain Monte-Carlo method. Applying the theory on adaptive algorithms, we derive conditions under which the proposed procedure converges. Simulation studies also indicate that the proposed procedure consistently converges to the maximum likelihood estimate for the structural measurement error logistic regression model.

Models for stochastic climate prediction

There has been a recent burst of activity in the atmosphere/ocean sciences community in utilizing stable linear Langevin stochastic models for the unresolved degree of freedom in stochastic climate prediction. Here several idealized models for stochastic climate modeling are introduced and analyzed through unambiguous mathematical theory. This analysis demonstrates the potential need for more sophisticated models beyond stable linear Langevin equations. The new phenomena include the emergence of both unstable linear Langevin stochastic models for the climate mean and the need to incorporate both suitable nonlinear effects and multiplicative noise in stochastic models under appropriate circumstances. The strategy for stochastic climate modeling that emerges from this analysis is illustrated on an idealized example involving truncated barotropic flow on a beta-plane with topography and a mean flow. In this example, the effect of the original 57 degrees of freedom is well represented by a theoretically predicted stochastic model with only 3 degrees of freedom.