SINGULARLY PERTURBED DISCOUNTED MARKOV CONTROL PROCESSES IN A GENERAL STATE SPACE

This paper studies the asymptotic optimality of discrete-time Markov decision processes (MDPs) with general state space and action space and having weak and strong interactions. By using a similar approach as developed by Liu, Zhang, and Yin [Appl. Math. Optim., 44 (2001), pp. 105-129], the idea in this paper is to consider an MDP with general state and action spaces and to reduce the dimension of the state space by considering an averaged model. This formulation is often described by introducing a small parameter epsilon > 0 in the definition of the transition kernel, leading to a singularly perturbed Markov model with two time scales. Our objective is twofold. First it is shown that the value function of the control problem for the perturbed system converges to the value function of a limit averaged control problem as epsilon goes to zero. In the second part of the paper, it is proved that a feedback control policy for the original control problem defined by using an optimal feedback policy for the limit problem is asymptotically optimal. Our work extends existing results of the literature in the following two directions: the underlying MDP is defined on general state and action spaces and we do not impose strong conditions on the recurrence structure of the MDP such as Doeblin's condition.

Identifying regulational alterations in gene regulatory networks by state space representation of vector autoregressive models and variational annealing

Background: In the analysis of effects by cell treatment such as drug dosing, identifying changes on gene network structures between normal and treated cells is a key task. A possible way for identifying the changes is to compare structures of networks estimated from data on normal and treated cells separately. However, this approach usually fails to estimate accurate gene networks due to the limited length of time series data and measurement noise. Thus, approaches that identify changes on regulations by using time series data on both conditions in an efficient manner are demanded. Methods: We propose a new statistical approach that is based on the state space representation of the vector autoregressive model and estimates gene networks on two different conditions in order to identify changes on regulations between the conditions. In the mathematical model of our approach, hidden binary variables are newly introduced to indicate the presence of regulations on each condition. The use of the hidden binary variables enables an efficient data usage; data on both conditions are used for commonly existing regulations, while for condition specific regulations corresponding data are only applied. Also, the similarity of networks on two conditions is automatically considered from the design of the potential function for the hidden binary variables. For the estimation of the hidden binary variables, we derive a new variational annealing method that searches the configuration of the binary variables maximizing the marginal likelihood. Results: For the performance evaluation, we use time series data from two topologically similar synthetic networks, and confirm that our proposed approach estimates commonly existing regulations as well as changes on regulations with higher coverage and precision than other existing approaches in almost all the experimental settings. For a real data application, our proposed approach is applied to time series data from normal Human lung cells and Human lung cells treated by stimulating EGF-receptors and dosing an anticancer drug termed Gefitinib. In the treated lung cells, a cancer cell condition is simulated by the stimulation of EGF-receptors, but the effect would be counteracted due to the selective inhibition of EGF-receptors by Gefitinib. However, gene expression profiles are actually different between the conditions, and the genes related to the identified changes are considered as possible off-targets of Gefitinib. Conclusions: From the synthetically generated time series data, our proposed approach can identify changes on regulations more accurately than existing methods. By applying the proposed approach to the time series data on normal and treated Human lung cells, candidates of off-target genes of Gefitinib are found. According to the published clinical information, one of the genes can be related to a factor of interstitial pneumonia, which is known as a side effect of Gefitinib.

Average control of Markov decision processes with Feller transition probabilities and general action spaces

This paper studies the average control problem of discrete-time Markov Decision Processes (MDPs for short) with general state space, Feller transition probabilities, and possibly non-compact control constraint sets A(x). Two hypotheses are considered: either the cost function c is strictly unbounded or the multifunctions A(r)(x) = {a is an element of A(x) : c(x, a) <= r} are upper-semicontinuous and compact-valued for each real r. For these two cases we provide new results for the existence of a solution to the average-cost optimality equality and inequality using the vanishing discount approach. We also study the convergence of the policy iteration approach under these conditions. It should be pointed out that we do not make any assumptions regarding the convergence and the continuity of the limit function generated by the sequence of relative difference of the alpha-discounted value functions and the Poisson equations as often encountered in the literature. (C) 2012 Elsevier Inc. All rights reserved.

Efficient Kernel Computation for Volterra Filter Structure Evaluation

Despite their generality, conventional Volterra filters are inadequate for some applications, due to the huge number of parameters that may be needed for accurate modelling. When a state-space model of the target system is known, this can be assessed by computing its kernels, which also provides valuable information for choosing an adequate alternate Volterra filter structure, if necessary, and is useful for validating parameter estimation procedures. In this letter, we derive expressions for the kernels by using the Carleman bilinearization method, for which an efficient algorithm is given. Simulation results are presented, which confirm the usefulness of the proposed approach.

Arbitrage-Free Conditions and Hedging Strategies for Markets with Penalty Costs on Short Positions

We consider a discrete-time financial model in a general sample space with penalty costs on short positions. We consider a friction market closely related to the standard one except that withdrawals from the portfolio value proportional to short positions are made. We provide necessary and sufficient conditions for the nonexistence of arbitrages in this situation and for a self-financing strategy to replicate a contingent claim. For the finite-sample space case, this result leads to an explicit and constructive procedure for obtaining perfect hedging strategies.

An estimate on the fractal dimension of attractors of gradient-like dynamical systems

This paper is dedicated to estimate the fractal dimension of exponential global attractors of some generalized gradient-like semigroups in a general Banach space in terms of the maximum of the dimension of the local unstable manifolds of the isolated invariant sets, Lipschitz properties of the semigroup and the rate of exponential attraction. We also generalize this result for some special evolution processes, introducing a concept of Morse decomposition with pullback attractivity. Under suitable assumptions, if (A, A*) is an attractor-repeller pair for the attractor A of a semigroup {T(t) : t >= 0}, then the fractal dimension of A can be estimated in terms of the fractal dimension of the local unstable manifold of A*, the fractal dimension of A, the Lipschitz properties of the semigroup and the rate of the exponential attraction. The ingredients of the proof are the notion of generalized gradient-like semigroups and their regular attractors, Morse decomposition and a fine analysis of the structure of the attractors. As we said previously, we generalize this result for some evolution processes using the same basic ideas. (C) 2012 Elsevier Ltd. All rights reserved.

Closed-loop stable model predictive control of integrating systems with dead time

Model predictive control (MPC) applications in the process industry usually deal with process systems that show time delays (dead times) between the system inputs and outputs. Also, in many industrial applications of MPC, integrating outputs resulting from liquid level control or recycle streams need to be considered as controlled outputs. Conventional MPC packages can be applied to time-delay systems but stability of the closed loop system will depend on the tuning parameters of the controller and cannot be guaranteed even in the nominal case. In this work, a state space model based on the analytical step response model is extended to the case of integrating time systems with time delays. This model is applied to the development of two versions of a nominally stable MPC, which is designed to the practical scenario in which one has targets for some of the inputs and/or outputs that may be unreachable and zone control (or interval tracking) for the remaining outputs. The controller is tested through simulation of a multivariable industrial reactor system. (C) 2012 Elsevier Ltd. All rights reserved.

A new approach for modeling and control of nonlinear systems via norm-bounded linear differential inclusions

A systematic approach to model nonlinear systems using norm-bounded linear differential inclusions (NLDIs) is proposed in this paper. The resulting NLDI model is suitable for the application of linear control design techniques and, therefore, it is possible to fulfill certain specifications for the underlying nonlinear system, within an operating region of interest in the state-space, using a linear controller designed for this NLDI model. Hence, a procedure to design a dynamic output feedback controller for the NLDI model is also proposed in this paper. One of the main contributions of the proposed modeling and control approach is the use of the mean-value theorem to represent the nonlinear system by a linear parameter-varying model, which is then mapped into a polytopic linear differential inclusion (PLDI) within the region of interest. To avoid the combinatorial problem that is inherent of polytopic models for medium- and large-sized systems, the PLDI is transformed into an NLDI, and the whole process is carried out ensuring that all trajectories of the underlying nonlinear system are also trajectories of the resulting NLDI within the operating region of interest. Furthermore, it is also possible to choose a particular structure for the NLDI parameters to reduce the conservatism in the representation of the nonlinear system by the NLDI model, and this feature is also one important contribution of this paper. Once the NLDI representation of the nonlinear system is obtained, the paper proposes the application of a linear control design method to this representation. The design is based on quadratic Lyapunov functions and formulated as search problem over a set of bilinear matrix inequalities (BMIs), which is solved using a two-step separation procedure that maps the BMIs into a set of corresponding linear matrix inequalities. Two numerical examples are given to demonstrate the effectiveness of the proposed approach.

Constraining H-0 in general dark energy models from Sunyaev-Zeldovich/X-ray technique and complementary probes

In accelerating dark energy models, the estimates of the Hubble constant, Ho, from Sunyaev-Zerdovich effect (SZE) and X-ray surface brightness of galaxy clusters may depend on the matter content (Omega(M)), the curvature (Omega(K)) and the equation of state parameter GO. In this article, by using a sample of 25 angular diameter distances of galaxy clusters described by the elliptical beta model obtained through the SZE/X-ray technique, we constrain Ho in the framework of a general ACDM model (arbitrary curvature) and a flat XCDM model with a constant equation of state parameter omega = p(x)/rho(x). In order to avoid the use of priors in the cosmological parameters, we apply a joint analysis involving the baryon acoustic oscillations (BA()) and the (MB Shift Parameter signature. By taking into account the statistical and systematic errors of the SZE/X-ray technique we obtain for nonflat ACDM model H-0 = 74(-4.0)(+5.0) km s(-1) Mpc(-1) (1 sigma) whereas for a fiat universe with constant equation of state parameter we find H-0 = 72(-4.0)(+5.5) km s(-1) Mpc(-1)(1 sigma). By assuming that galaxy clusters are described by a spherical beta model these results change to H-0 = 6(-7.0)(+8.0) and H-0 = 59(-6.0)(+9.0) km s(-1) Mpc(-1)(1 sigma), respectively. The results from elliptical description are in good agreement with independent studies from the Hubble Space Telescope key project and recent estimates based on the Wilkinson Microwave Anisotropy Probe, thereby suggesting that the combination of these three independent phenomena provides an interesting method to constrain the Bubble constant. As an extra bonus, the adoption of the elliptical description is revealed to be a quite realistic assumption. Finally, by comparing these results with a recent determination for a, flat ACDM model using only the SZE/X-ray technique and BAO, we see that the geometry has a very weak influence on H-0 estimates for this combination of data.

The IDEOLOGY SPACE BRAZILIAN NATIONAL STATE OF CONSTITUTIVE

In the debate over the construction of the Brazilian national state, we assume that this process has established itself at the heart of a fragmentary appreciation of their aesthetic variants, forming a controversial ideology spatial sense of identity to the nation. progress, modernization and territorial integration emerge as slogans on the link between the imagined nation, Brazil Imperial, and the nation as concretized throughout the twentieth century, despite the discourse and actions in the rescue culture synthesis Brazilianness. It is evident, that scope, a tendency to think the nation more as a product of a cultural elite (fragments of baroque and colonial cities consecrated) than through symbols forming territories hybrids representatives of all of their constructors: the antagonistic protagonists.

GROUND STATE AND NON-GROUND STATE SOLUTIONS OF SOME STRONGLY COUPLED ELLIPTIC SYSTEMS

We study an elliptic system of the form Lu = vertical bar v vertical bar(p-1) v and Lv = vertical bar u vertical bar(q-1) u in Omega with homogeneous Dirichlet boundary condition, where Lu := -Delta u in the case of a bounded domain and Lu := -Delta u + u in the cases of an exterior domain or the whole space R-N. We analyze the existence, uniqueness, sign and radial symmetry of ground state solutions and also look for sign changing solutions of the system. More general non-linearities are also considered.

The dynamical state of galaxy groups and their luminosity content

We analyse the dependence of the luminosity function (LF) of galaxies in groups on group dynamical state. We use the Gaussianity of the velocity distribution of galaxy members as a measurement of the dynamical equilibrium of groups identified in the Sloan Digital Sky Survey Data Release 7 by Zandivarez & Martinez. We apply the Anderson-Darling goodness-of-fit test to distinguish between groups according to whether they have Gaussian or non-Gaussian velocity distributions, i.e. whether they are relaxed or not. For these two subsamples, we compute the (0.1)r-band LF as a function of group virial mass and group total luminosity. For massive groups, , we find statistically significant differences between the LF of the two subsamples: the LFs of groups that have Gaussian velocity distributions have a brighter characteristic absolute magnitude (similar to 0.3 mag) and a steeper faint-end slope (similar to 0.25). We detect a similar effect when comparing the LF of bright [M-0.1r(group) - 5log(h) < -23.5] Gaussian and non-Gaussian groups. Our results indicate that, for massive/luminous groups, the dynamical state of the system is directly related to the luminosity of its galaxy members.

Space-time cluster analysis of American visceral leishmaniasis in Bauru, Sao Paulo State, Brazil

A space-time analysis of American visceral leishmaniasis (AVL) in humans in the city of Bauru, Sao Paulo State, Brazil was carried out based on 239 cases diagnosed between June 2003 and October 2008. Spatial analysis of the disease showed that cases occurred especially in the city's urban areas. AVL annual incidence rates were calculated, demonstrating that the highest rate occurred in 2006 (19.55/100,000 inhabitants). This finding was confirmed by the time series analysis, which also showed a positive tendency over the period analyzed. The present study allows us to conclude that the disease was clustered in the Southwest side of the city in 2006, suggesting that this area may require special attention with regard to control and prevention measures.

Space and Motion Perception and Discomfort in Air Travel

RAMOS RT, MATTOS DA, REBOUCAS ITS, RANVAUD RD. Space and motion perception and discomfort in air travel. Aviat Space Environ Med 2012; 83:1162-6. Introduction: The perception of comfort during air trips is determined by several factors. External factors like cabin design and environmental parameters (temperature, humidity, air pressure, noise, and vibration) interact with individual characteristics (anxiety traits, fear of flying, and personality) from arrival at the airport to landing at the destination. In this study, we investigated the influence of space and motion discomfort (SMD), fear of heights, and anxiety on comfort perception during all phases of air travel. Methods: We evaluated 51 frequent air travelers through a modified version of the Flight Anxiety Situations Questionnaire (FAS), in which new items were added and where the subjects were asked to report their level of discomfort or anxiety (not fear) for each phase of air travel (Chronbach's alpha = 0.974). Correlations were investigated among these scales: State-Trait Anxiety Inventory (STAB, Cohen's Acrophobia Questionnaire, and the Situational Characteristics Questionnaire (SitQ, designed to estimate SMD levels). Results: Scores of SitQ correlated with discomfort in situations involving space and movement perception (Pearson's rho = 0.311), while discomfort was associated with cognitive mechanisms related to scores in the anxiety scales (Pearson's rho = 0.375). Anxiety traits were important determinants of comfort perception before and after flight, while the influence of SMD was more significant during the time spent in the aircraft cabin. Discussion: SMD seems to be an important modulator of comfort perception in air travel. Its influence on physical well being and probably on cognitive performance, with possible effects on flight safety, deserves further investigation.

Space-time cluster analysis of American visceral leishmaniasis in Bauru, São Paulo State, Brazil

A space-time analysis of American visceral leishmaniasis (AVL) in humans in the city of Bauru, São Paulo State, Brazil was carried out based on 239 cases diagnosed between June 2003 and October 2008. Spatial analysis of the disease showed that cases occurred especially in the city's urban areas. AVL annual incidence rates were calculated, demonstrating that the highest rate occurred in 2006 (19.55/100,000 inhabitants). This finding was confirmed by the time series analysis, which also showed a positive tendency over the period analyzed. The present study allows us to conclude that the disease was clustered in the Southwest side of the city in 2006, suggesting that this area may require special attention with regard to control and prevention measures.