Creep behaviour of nimonic and R.R. 59 alloys

The Ramberg-Osgood relation which adequately describes the stress-strain curve of a strain-hardening material is extended to formulate the constitutive laws for creep. The constitutive laws which describe primary creep adequately are extended to secondary creep. The results are verified for the case of R.R. 59 at 200°C, Nimonic 80A and Nimonic 90 alloys at 750°C.

An actor-critic algorithm with function approximation for discounted cost constrained Markov decision processes

We develop in this article the first actor-critic reinforcement learning algorithm with function approximation for a problem of control under multiple inequality constraints. We consider the infinite horizon discounted cost framework in which both the objective and the constraint functions are suitable expected policy-dependent discounted sums of certain sample path functions. We apply the Lagrange multiplier method to handle the inequality constraints. Our algorithm makes use of multi-timescale stochastic approximation and incorporates a temporal difference (TD) critic and an actor that makes a gradient search in the space of policy parameters using efficient simultaneous perturbation stochastic approximation (SPSA) gradient estimates. We prove the asymptotic almost sure convergence of our algorithm to a locally optimal policy. (C) 2010 Elsevier B.V. All rights reserved.