Stochastic control strategies and adaptive critic methods

Adaptive critic methods have common roots as generalizations of dynamic programming for neural reinforcement learning approaches. Since they approximate the dynamic programming solutions, they are potentially suitable for learning in noisy, nonlinear and nonstationary environments. In this study, a novel probabilistic dual heuristic programming (DHP) based adaptive critic controller is proposed. Distinct to current approaches, the proposed probabilistic (DHP) adaptive critic method takes uncertainties of forward model and inverse controller into consideration. Therefore, it is suitable for deterministic and stochastic control problems characterized by functional uncertainty. Theoretical development of the proposed method is validated by analytically evaluating the correct value of the cost function which satisfies the Bellman equation in a linear quadratic control problem. The target value of the critic network is then calculated and shown to be equal to the analytically derived correct value.

Stochastic Arithmetic Theory and Experiments

Stochastic arithmetic has been developed as a model for exact computing with imprecise data. Stochastic arithmetic provides confidence intervals for the numerical results and can be implemented in any existing numerical software by redefining types of the variables and overloading the operators on them. Here some properties of stochastic arithmetic are further investigated and applied to the computation of inner products and the solution to linear systems. Several numerical experiments are performed showing the efficiency of the proposed approach.

Fractional Fokker-Planck-Kolmogorov type Equations and their Associated Stochastic Differential Equations

MSC 2010: 26A33, 35R11, 35R60, 35Q84, 60H10 Dedicated to 80-th anniversary of Professor Rudolf Gorenflo

Generalised Riccati solution and pinning control of complex stochastic networks

This paper considers the global synchronisation of a stochastic version of coupled map lattices networks through an innovative stochastic adaptive linear quadratic pinning control methodology. In a stochastic network, each state receives only noisy measurement of its neighbours' states. For such networks we derive a generalised Riccati solution that quantifies and incorporates uncertainty of the forward dynamics and inverse controller in the derivation of the stochastic optimal control law. The generalised Riccati solution is derived using the Lyapunov approach. A probabilistic approximation type algorithm is employed to estimate the conditional distributions of the state and inverse controller from historical data and quantifying model uncertainties. The theoretical derivation is complemented by its validation on a set of representative examples.

Branching Stochastic Processes: History, Theory, Applications

Косто В. Митов - Разклоняващите се стохастични процеси са модели на популационната динамика на обекти, които имат случайно време на живот и произвеждат потомци в съответствие с дадени вероятностни закони. Типични примери са ядрените реакции, клетъчната пролиферация, биологичното размножаване, някои химични реакции, икономически и финансови явления. В този обзор сме се опитали да представим съвсем накратко някои от най-важните моменти и факти от историята, теорията и приложенията на разклоняващите се процеси.

Efficient Control in Multistage Stochastic Optimization Problem

AMS subject classification: 90C31, 90A09, 49K15, 49L20.

A Stochastic Approach for Investigation Ultrafast Phenomena in Semiconductors

2002 Mathematics Subject Classification: 65C05

Detecting Precipitation Climate Changes: An Approach Based on a Stochastic Daily Precipitation Model

2002 Mathematics Subject Classification: 62M10.

Branching Stochastic Processes: Regulation, Regeneration, Estimation, Applications

2000 Mathematics Subject Classification: 60J80.

A Stochastic Control Approach to a Parabolic Equation, Reciprocal Processes

2000 Mathematics Subject Classi cation: 49L60, 60J60, 93E20.

Stochastic Optimization in Robust Statistic

2000 Mathematics Subject Classification: 62J05, 62G35

On a Stochastic Partial Differential Equation with a Noisy Term

2000 Mathematics Subject Classification: 60H15, 60H40

A Stochastic Approach for Finding of Semantically Related Words

2000 Mathematics Subject Classification: 62P99, 68T50

A Generalized Quasi-Likelihood Estimator for Nonstationary Stochastic Processes−Asymptotic Properties and Examples

2010 Mathematics Subject Classification: 62F12, 62M05, 62M09, 62M10, 60G42.

State-owned enterprises, exporting and productivity in China:a stochastic dominance approach

A popular explanation for China's rapid economic growth in recent years has been the dramatic increase in the number of private domestic- and foreign-owned firms and a decline in the state-owned sector. However, recent evidence suggests that China's state-owned enterprises (SOEs) are in fact stronger than ever. In this paper, we examine over 78,000 manufacturing firms between 2002 and 2006 to investigate the relationship between ownership structure and the degree of firm-level exposure to export markets and firm-level productivity. Using a conditional stochastic dominance approach, we reveal that although our results largely adhere to prior expectations, the performance of SOEs differs markedly between those that export and those that supply the domestic market only. It appears that China's internationally focused SOEs have become formidable global competitors. © 2013 John Wiley & Sons Ltd.