Optimality conditions for infinite horizon control problems with state constraints

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

On the value function for nonautonomous optimal control problems with infinite horizon

In this paper we consider nonautonomous optimal control problems of infinite horizon type, whose control actions are given by L-1-functions. We verify that the value function is locally Lipschitz. The equivalence between dynamic programming inequalities and Hamilton-Jacobi-Bellman (HJB) inequalities for proximal sub (super) gradients is proven. Using this result we show that the value function is a Dini solution of the HJB equation. We obtain a verification result for the class of Dini sub-solutions of the HJB equation and also prove a minimax property of the value function with respect to the sets of Dini semi-solutions of the HJB equation. We introduce the concept of viscosity solutions of the HJB equation in infinite horizon and prove the equivalence between this and the concept of Dini solutions. In the Appendix we provide an existence theorem. (c) 2006 Elsevier B.V. All rights reserved.

Necessary conditions of optimality for state constrained infinite horizon differential inclusions

This article presents and discusses necessary conditions of optimality for infinite horizon dynamic optimization problems with inequality state constraints and set inclusion constraints at both endpoints of the trajectory. The cost functional depends on the state variable at the final time, and the dynamics are given by a differential inclusion. Moreover, the optimization is carried out over asymptotically convergent state trajectories. The novelty of the proposed optimality conditions for this class of problems is that the boundary condition of the adjoint variable is given as a weak directional inclusion at infinity. This improves on the currently available necessary conditions of optimality for infinite horizon problems. © 2011 IEEE.

A maximum principle for constrained infinite horizon dynamic control systems

This article presents and discusses a maximum principle for infinite horizon constrained optimal control problems with a cost functional depending on the state at the final time. The main feature of these optimality conditions is that, under reasonably weak assumptions, the multiplier is shown to satisfy a novel transversality condition at infinite time. It is also shown that these conditions can also be obtained for impulsive control problems whose dynamics are given by measure driven differential equations. © 2011 IFAC.

A maximum principle for infinite time asymptotically stable impulsive dynamic control systems

We consider an infinite horizon optimal impulsive control problems for which a given cost function is minimized by choosing control strategies driving the state to a point in a given closed set C ∞. We present necessary conditions of optimality in the form of a maximum principle for which the boundary condition of the adjoint variable is such that non-degeneracy due to the fact that the time horizon is infinite is ensured. These conditions are given for conventional systems in a first instance and then for impulsive control problems. They are proved by considering a family of approximating auxiliary interval conventional (without impulses) optimal control problems defined on an increasing sequence of finite time intervals. As far as we know, results of this kind have not been derived previously. © 2010 IFAC.

Stochastic stability for Markovian jump linear systems associated with a finite number of jump times

This paper deals with a stochastic stability concept for discrete-time Markovian jump linear systems. The random jump parameter is associated to changes between the system operation modes due to failures or repairs, which can be well described by an underlying finite-state Markov chain. In the model studied, a fixed number of failures or repairs is allowed, after which, the system is brought to a halt for maintenance or for replacement. The usual concepts of stochastic stability are related to pure infinite horizon problems, and are not appropriate in this scenario. A new stability concept is introduced, named stochastic tau-stability that is tailored to the present setting. Necessary and sufficient conditions to ensure the stochastic tau-stability are provided, and the almost sure stability concept associated with this class of processes is also addressed. The paper also develops equivalences among second order concepts that parallels the results for infinite horizon problems. (C) 2003 Elsevier B.V. All rights reserved.

On an optimal control design for Rossler system

In this Letter, an optimal control strategy that directs the chaotic motion of the Rossler system to any desired fixed point is proposed. The chaos control problem is then formulated as being an infinite horizon optimal control nonlinear problem that was reduced to a solution of the associated Hamilton-Jacobi-Bellman equation. We obtained its solution among the correspondent Lyapunov functions of the considered dynamical system. (C) 2004 Elsevier B.V All rights reserved.

Stochastic Stability for Markovian Jump Linear Systems Subject to a Crucial Failure Event

This paper is concerned with the stability of discrete-time linear systems subject to random jumps in the parameters, described by an underlying finite-state Markov chain. In the model studied, a stopping time τ Δ is associated with the occurrence of a crucial failure after which the system is brought to a halt for maintenance. The usual stochastic stability concepts and associated results are not indicated, since they are tailored to pure infinite horizon problems. Using the concept named stochastic τ-stability, equivalent conditions to ensure the stochastic stability of the system until the occurrence of τ Δ is obtained. In addition, an intermediary and mixed case for which τ represents the minimum between the occurrence of a fix number N of failures and the occurrence of a crucial failure τ Δ is also considered. Necessary and sufficient conditions to ensure the stochastic τ-stability are provided in this setting that are auxiliary to the main result.

Periodic compression of an adiabatic gas: Intermittency-enhanced Fermi acceleration

A gas of non-interacting particles diffuses in a lattice of pulsating scatterers. In the finite-horizon case with bounded distance between collisions and strongly chaotic dynamics, the velocity growth (Fermi acceleration) is well described by a master equation, leading to an asymptotic universal non-Maxwellian velocity distribution scaling as v∼t. The infinite-horizon case has intermittent dynamics which enhances the acceleration, leading to v∼t ln t and a non-universal distribution. © Copyright EPLA, 2013.

An Optimal Control Framework for Resources Management in Agriculture

An optimal control framework to support the management and control of resources in a wide range of problems arising in agriculture is discussed. Lessons extracted from past research on the weed control problem and a survey of a vast body of pertinent literature led to the specification of key requirements to be met by a suitable optimization framework. The proposed layered control structure—including planning, coordination, and execution layers—relies on a set of nested optimization processes of which an “infinite horizon” Model Predictive Control scheme plays a key role in planning and coordination. Some challenges and recent results on the Pontryagin Maximum Principle for infinite horizon optimal control are also discussed.

PERIODIC PERTURBATION of QUADRATIC SYSTEMS WITH TWO INFINITE HETEROCLINIC CYCLES

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Schwarzschild generalized black hole horizon and the embedding space

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Kinematics of a spacetime with an infinite cosmological constant

A solution of the sourceless Einstein's equation with an infinite value for the cosmological constant L is discussed by using Inonu-Wigner contractions of the de Sitter groups and spaces. When Lambda --> infinity, spacetime becomes a four-dimensional cone, dual to Minkowski space by a spacetime inversion. This inversion relates the four-cone vertex to the infinity of Minkowski space, and the four-cone infinity to the Minkowski light-cone. The non-relativistic limit c --> infinity. is further considered, the kinematical group in this case being a modified Galilei group in which the space and time translations are replaced by the non-relativistic limits of the corresponding proper conformal transformations. This group presents the same abstract Lie algebra as the Galilei group and can be named the conformal Galilei group. The results may be of interest to the early Universe Cosmology.

Infinite symmetries in the Skyrme model

We show that the Skyrme theory possesses a submodel with an infinite number of local conserved currents. The constraints leading to the submodel explore a decomposition of SU(2) with a complex field parametrizing the symmetric space SU(2)/U(1) and a real field in the direction of U(1). We demonstrate that the Skyrmions of topological charges ii belong to such integrable sector of the theory. Our results open ways to the development of exact methods, compensating for the non-existence of a BPS type sector in the Skyrme theory. (C) 2001 Published by Elsevier B.V. B.V.

Interaction of Hawking radiation with static sources in de Sitter and Schwarzschild-de Sitter spacetimes

We study and look for similarities between the response rates R-dS(a(0),Lambda) and R-SdS(a(0),Lambda,M) of a static scalar source with constant proper acceleration a(0) interacting with a massless, conformally coupled Klein-Gordon field (i) in de Sitter spacetime, in the Euclidean vacuum, which describes a thermal flux of radiation emanating from the de Sitter cosmological horizon and (ii) in Schwarzschild-de Sitter spacetime, in the Gibbons-Hawking vacuum, which describes thermal fluxes of radiation emanating from both the hole and the cosmological horizons, respectively, where Lambda is the cosmological constant and M is the black hole mass. After performing the field quantization in each of the above spacetimes, we obtain the response rates at the tree level in terms of an infinite sum of zero-energy field modes possessing all possible angular momentum quantum numbers. In the case of de Sitter spacetime, this formula is worked out and a closed, analytical form is obtained. In the case of Schwarzschild-de Sitter spacetime such a closed formula could not be obtained, and a numerical analysis is performed. We conclude, in particular, that R-dS(a(0),Lambda) and R-SdS(a(0),Lambda,M) do not coincide in general, but tend to each other when Lambda-->0 or a(0)-->infinity. Our results are also contrasted and shown to agree (in the proper limits) with related ones in the literature.