Average control of Markov decision processes with Feller transition probabilities and general action spaces

This paper studies the average control problem of discrete-time Markov Decision Processes (MDPs for short) with general state space, Feller transition probabilities, and possibly non-compact control constraint sets A(x). Two hypotheses are considered: either the cost function c is strictly unbounded or the multifunctions A(r)(x) = {a is an element of A(x) : c(x, a) <= r} are upper-semicontinuous and compact-valued for each real r. For these two cases we provide new results for the existence of a solution to the average-cost optimality equality and inequality using the vanishing discount approach. We also study the convergence of the policy iteration approach under these conditions. It should be pointed out that we do not make any assumptions regarding the convergence and the continuity of the limit function generated by the sequence of relative difference of the alpha-discounted value functions and the Poisson equations as often encountered in the literature. (C) 2012 Elsevier Inc. All rights reserved.

Ranking Configurations of Shading Devices by Its Thermal and Luminous Performance

This paper evaluates the thermal and luminous performance of different louver configurations on an office room model located in Maceió-AL (Brazil), ranking the alternatives in a way that leads to choices for alternatives with potential balanced performance. Parametric analyses were done, based on computer simulations on software Troplux 5 and DesignBuilder 2. The variables examined were number of slats, slat slope and slat reflectance, considering the window facing North, South, East and West and a fixed shading mask for each orientation. Results refer to internal average illuminance and solar heat gains through windows. It was observed that configurations of shading devices with the same shading mask may have different luminous and thermal performance. The alternatives were ranked, so the information here produced has the potential to support decisions on designing shading devices in practice.