Average control of Markov decision processes with Feller transition probabilities and general action spaces

This paper studies the average control problem of discrete-time Markov Decision Processes (MDPs for short) with general state space, Feller transition probabilities, and possibly non-compact control constraint sets A(x). Two hypotheses are considered: either the cost function c is strictly unbounded or the multifunctions A(r)(x) = {a is an element of A(x) : c(x, a) <= r} are upper-semicontinuous and compact-valued for each real r. For these two cases we provide new results for the existence of a solution to the average-cost optimality equality and inequality using the vanishing discount approach. We also study the convergence of the policy iteration approach under these conditions. It should be pointed out that we do not make any assumptions regarding the convergence and the continuity of the limit function generated by the sequence of relative difference of the alpha-discounted value functions and the Poisson equations as often encountered in the literature. (C) 2012 Elsevier Inc. All rights reserved.

The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.

The JNR Property and the Borel Structure of a Banach Space

Research partially supported by a grant of Caja de Ahorros del Mediterraneo.

Radon Measures on Banach Spaces with their Weak Topologies

The main concern of this paper is to present some improvements to results on the existence or non-existence of countably additive Borel measures that are not Radon measures on Banach spaces taken with their weak topologies, on the standard axioms (ZFC) of set-theory. However, to put the results in perspective we shall need to say something about consistency results concerning measurable cardinals.

AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This paper deals with the long run average continuous control problem of piecewise deterministic Markov processes (PDMPs) taking values in a general Borel space and with compact action space depending on the state variable. The control variable acts on the jump rate and transition measure of the PDMP, and the running and boundary costs are assumed to be positive but not necessarily bounded. Our first main result is to obtain an optimality equation for the long run average cost in terms of a discrete-time optimality equation related to the embedded Markov chain given by the postjump location of the PDMP. Our second main result guarantees the existence of a feedback measurable selector for the discrete-time optimality equation by establishing a connection between this equation and an integro-differential equation. Our final main result is to obtain some sufficient conditions for the existence of a solution for a discrete-time optimality inequality and an ordinary optimal feedback control for the long run average cost using the so-called vanishing discount approach. Two examples are presented illustrating the possible applications of the results developed in the paper.

Comparative Study of the Changes in Partial Pressure of Plasma Carbon Dioxide During Carbon Dioxide Insufflation into the Intraperitoneal and Preperitoneal Spaces

Background: We aimed to compare plasma concentrations of carbon dioxide (CO(2)) in dogs that underwent intra- and preperitoneal CO(2) insufflation. Materials and Methods: Thirty dogs were studied. Ten formed a control group, 10 underwent intraperitoneal CO(2) insufflation, and 10 underwent preperitoneal CO(2) insufflation. General anesthesia with controlled ventilation was standardized for all dogs. After stabilizing the anesthesia, blood samples were collected at predetermined times and were sent for immediate gasometric analysis. Analysis of variance was used for comparing variables. Results: The plasma CO(2) concentration in the intraperitoneal insufflation group increased significantly more than in the preperitoneal insufflation group and was significantly greater than in the control group (P < 0.05). The pH values in the intraperitoneal group were lower than in the preperitoneal group (P < 0.05). Conclusion: The data from this study suggest that a greater plasma concentration of CO(2) is achieved by insufflation at constant pressure into the intraperitoneal space than into the preperitoneal space.

Quantum fields with noncommutative target spaces

Quantum field theories (QFT's) on noncommutative spacetimes are currently under intensive study. Usually such theories have world sheet noncommutativity. In the present work, instead, we study QFT's with commutative world sheet and noncommutative target space. Such noncommutativity can be interpreted in terms of twisted statistics and is related to earlier work of Oeckl [R. Oeckl, Commun. Math. Phys. 217, 451 (2001)], and others [A. P. Balachandran, G. Mangano, A. Pinzul, and S. Vaidya, Int. J. Mod. Phys. A 21, 3111 (2006); A. P. Balachandran, A. Pinzul, and B. A. Qureshi, Phys. Lett. B 634,434 (2006); A.P. Balachandran, A. Pinzul, B.A. Qureshi, and S. Vaidya, arXiv:hep-th/0608138; A.P. Balachandran, T. R. Govindarajan, G. Mangano, A. Pinzul, B.A. Qureshi, and S. Vaidya, Phys. Rev. D 75, 045009 (2007); A. Pinzul, Int. J. Mod. Phys. A 20, 6268 (2005); G. Fiore and J. Wess, Phys. Rev. D 75, 105022 (2007); Y. Sasai and N. Sasakura, Prog. Theor. Phys. 118, 785 (2007)]. The twisted spectra of their free Hamiltonians has been found earlier by Carmona et al. [J. M. Carmona, J. L. Cortes, J. Gamboa, and F. Mendez, Phys. Lett. B 565, 222 (2003); J. M. Carmona, J. L. Cortes, J. Gamboa, and F. Mendez, J. High Energy Phys. 03 (2003) 058]. We review their derivation and then compute the partition function of one such typical theory. It leads to a deformed blackbody spectrum, which is analyzed in detail. The difference between the usual and the deformed blackbody spectrum appears in the region of high frequencies. Therefore we expect that the deformed blackbody radiation may potentially be used to compute a Greisen-Zatsepin-Kuzmin cutoff which will depend on the noncommutative parameter theta.

COMPLETE ISOMORPHIC CLASSIFICATIONS OF SOME SPACES OF COMPACT OPERATORS

This paper is a continuation and a complement of our previous work on isomorphic classification of some spaces of compact operators. We improve the main result concerning extensions of the classical isomorphic classification of the Banach spaces of continuous functions on ordinals. As an application, fixing an ordinal a and denoting by X(xi), omega(alpha) <= xi < omega(alpha+1), the Banach space of all X-valued continuous functions defined in the interval of ordinals [0,xi] and equipped with the supremum, we provide complete isomorphic classifications of some Banach spaces K(X(xi),Y(eta)) of compact operators from X(xi) to Y(eta), eta >= omega. It is relatively consistent with ZFC (Zermelo-Fraenkel set theory with the axiom of choice) that these results include the following cases: 1.X* contains no copy of c(0) and has the Mazur property, and Y = c(0)(J) for every set J. 2. X = c(0)(I) and Y = l(q)(J) for any infinite sets I and J and 1 <= q < infinity. 3. X = l(p)(I) and Y = l(q)(J) for any infinite sets I and J and 1 <= q < p < infinity.

ON ISOMORPHIC CLASSIFICATIONS OF SPACES OF COMPACT OPERATORS

We prove an extension of the classical isomorphic classification of Banach spaces of continuous functions on ordinals. As a consequence, we give complete isomorphic classifications of some Banach spaces K(X,Y(n)), eta >= omega, of compact operators from X to Y(eta), the space of all continuous Y-valued functions defined in the interval of ordinals [1, eta] and equipped with the supremum norm. In particular, under the Continuum Hypothesis, we extend a recent result of C. Samuel by classifying, up to isomorphism, the spaces K(X(xi), c(0)(Gamma)(eta)), where omega <= xi < omega(1,) eta >= omega, Gamma is a countable set, X contains no complemented copy of l(1), X* has the Mazur property and the density character of X** is less than or equal to N(1).

Induced Modules for Affine Lie Algebras

We study induced modules of nonzero central charge with arbitrary multiplicities over affine Lie algebras. For a given pseudo parabolic subalgebra P of an affine Lie algebra G, our main result establishes the equivalence between a certain category of P-induced G-modules and the category of weight P-modules with injective action of the central element of G. In particular, the induction functor preserves irreducible modules. If P is a parabolic subalgebra with a finite-dimensional Levi factor then it defines a unique pseudo parabolic subalgebra P(ps), P subset of P(ps). The structure of P-induced modules in this case is fully determined by the structure of P(ps)-induced modules. These results generalize similar reductions in particular cases previously considered by V. Futorny, S. Konig, V. Mazorchuk [Forum Math. 13 (2001), 641-661], B. Cox [Pacific J. Math. 165 (1994), 269-294] and I. Dimitrov, V. Futorny, I. Penkov [Comm. Math. Phys. 250 (2004), 47-63].

ON SPACES OF COMPACT OPERATORS ON C(K, X) SPACES

This paper concerns the spaces of compact operators kappa(E,F), where E and F are Banach spaces C([1, xi], X) of all continuous X-valued functions defined on the interval of ordinals [1, xi] and equipped with the supremun norm. We provide sufficient conditions on X, Y, alpha, beta, xi and eta, with omega <= alpha <= beta < omega 1 for the following equivalence: (a) kappa(C([1, xi], X), C([1, alpha], Y)) is isomorphic to kappa(C([1,eta], X), C([1, beta], Y)), (b) beta < alpha(omega). In this way, we unify and extend results due to Bessaga and Pelczynski (1960) and C. Samuel (2009). Our result covers the case of the classical spaces X = l(p) and Y = l(q) with 1 < p, q < infinity.

COUNTABLE GROUPS OF ISOMETRIES ON BANACH SPACES

A group G is representable in a Banach space X if G is isomorphic to the group of isometrics on X in some equivalent norm. We prove that a countable group G is representable in a separable real Banach space X in several general cases, including when G similar or equal to {-1,1} x H, H finite and dim X >= vertical bar H vertical bar or when G contains a normal subgroup with two elements and X is of the form c(0)(Y) or l(p)(Y), 1 <= p < +infinity. This is a consequence of a result inspired by methods of S. Bellenot (1986) and stating that under rather general conditions on a separable real Banach space X and a countable bounded group G of isomorphisms on X containing -Id, there exists an equivalent norm on X for which G is equal to the group of isometrics on X. We also extend methods of K. Jarosz (1988) to prove that any complex Banach space of dimension at least 2 may be renormed with an equivalent complex norm to admit only trivial real isometries, and that any complexification of a Banach space may be renormed with an equivalent complex norm to admit only trivial and conjugation real isometrics. It follows that every real Banach space of dimension at least 4 and with a complex structure may be renormed to admit exactly two complex structures up to isometry, and that every real Cartesian square may be renormed to admit a unique complex structure up to isometry.

POLAR ACTIONS ON CERTAIN PRINCIPAL BUNDLES OVER SYMMETRIC SPACES OF COMPACT TYPE

We study polar actions with horizontal sections on the total space of certain principal bundles G/K -> G/H with base a symmetric space of compact type. We classify such actions up to orbit equivalence in many cases. In particular, we exhibit examples of hyperpolar actions with cohomogeneity greater than one on locally irreducible homogeneous spaces with nonnegative curvature which are not homeomorphic to symmetric spaces.

Extremal problems on sum-free sets and coverings in tridimensional spaces

Given a prime power q, define c (q) as the minimum cardinality of a subset H of F 3 q which satisfies the following property: every vector in this space di ff ers in at most 1 coordinate from a multiple of a vector in H. In this work, we introduce two extremal problems in combinatorial number theory aiming to discuss a known connection between the corresponding coverings and sum-free sets. Also, we provide several bounds on these maps which yield new classes of coverings, improving the previous upper bound on c (q)

Hamiltonian mappings and circle packing phase spaces.

We introduce three area preserving maps with phase space structures which resemble circle packings. Each mapping is derived from a kicked Hamiltonian system with one of the three different phase space geometries (planar, hyperbolic or spherical) and exhibits an infinite number of coexisting stable periodic orbits which appear to ‘pack’ the phase space with circular resonances.