SINGULARLY PERTURBED DISCOUNTED MARKOV CONTROL PROCESSES IN A GENERAL STATE SPACE

This paper studies the asymptotic optimality of discrete-time Markov decision processes (MDPs) with general state space and action space and having weak and strong interactions. By using a similar approach as developed by Liu, Zhang, and Yin [Appl. Math. Optim., 44 (2001), pp. 105-129], the idea in this paper is to consider an MDP with general state and action spaces and to reduce the dimension of the state space by considering an averaged model. This formulation is often described by introducing a small parameter epsilon > 0 in the definition of the transition kernel, leading to a singularly perturbed Markov model with two time scales. Our objective is twofold. First it is shown that the value function of the control problem for the perturbed system converges to the value function of a limit averaged control problem as epsilon goes to zero. In the second part of the paper, it is proved that a feedback control policy for the original control problem defined by using an optimal feedback policy for the limit problem is asymptotically optimal. Our work extends existing results of the literature in the following two directions: the underlying MDP is defined on general state and action spaces and we do not impose strong conditions on the recurrence structure of the MDP such as Doeblin's condition.

A new approach for modeling and control of nonlinear systems via norm-bounded linear differential inclusions

A systematic approach to model nonlinear systems using norm-bounded linear differential inclusions (NLDIs) is proposed in this paper. The resulting NLDI model is suitable for the application of linear control design techniques and, therefore, it is possible to fulfill certain specifications for the underlying nonlinear system, within an operating region of interest in the state-space, using a linear controller designed for this NLDI model. Hence, a procedure to design a dynamic output feedback controller for the NLDI model is also proposed in this paper. One of the main contributions of the proposed modeling and control approach is the use of the mean-value theorem to represent the nonlinear system by a linear parameter-varying model, which is then mapped into a polytopic linear differential inclusion (PLDI) within the region of interest. To avoid the combinatorial problem that is inherent of polytopic models for medium- and large-sized systems, the PLDI is transformed into an NLDI, and the whole process is carried out ensuring that all trajectories of the underlying nonlinear system are also trajectories of the resulting NLDI within the operating region of interest. Furthermore, it is also possible to choose a particular structure for the NLDI parameters to reduce the conservatism in the representation of the nonlinear system by the NLDI model, and this feature is also one important contribution of this paper. Once the NLDI representation of the nonlinear system is obtained, the paper proposes the application of a linear control design method to this representation. The design is based on quadratic Lyapunov functions and formulated as search problem over a set of bilinear matrix inequalities (BMIs), which is solved using a two-step separation procedure that maps the BMIs into a set of corresponding linear matrix inequalities. Two numerical examples are given to demonstrate the effectiveness of the proposed approach.

Improved low-voltage-ride-through capability of fixed-speed wind turbines using decentralised control of STATCOM with energy storage system

The design and implementation of a new control scheme for reactive power compensation, voltage regulation and transient stability enhancement for wind turbines equipped with fixed-speed induction generators (IGs) in large interconnected power systems is presented in this study. The low-voltage-ride-through (LVRT) capability is provided by extending the range of the operation of the controlled system to include typical post-fault conditions. A systematic procedure is proposed to design decentralised multi-variable controllers for large interconnected power systems using the linear quadratic (LQ) output-feedback control design method and the controller design procedure is formulated as an optimisation problem involving rank-constrained linear matrix inequality (LMI). In this study, it is shown that a static synchronous compensator (STATCOM) with energy storage system (ESS), controlled via robust control technique, is an effective device for improving the LVRT capability of fixed-speed wind turbines.

Multiple independent origins of mitochondrial control region duplications in the order Psittaciformes

mitochondrial genomes are generally thought to be under selection for compactness, due to their small size, consistent gene content, and a lack of introns or intergenic spacers. As more animal mitochondrial genomes are fully sequenced, rearrangements and partial duplications are being identified with increasing frequency, particularly in birds (Class Ayes). In this study, we investigate the evolutionary history of mitochondrial control region states within the avian order Psittaciformes (parrots and cockatoos). To this aim, we reconstructed a comprehensive multi-locus phylogeny of parrots, used PCR of three diagnostic fragments to classify the mitochondrial control region state as single or duplicated, and mapped these states onto the phylogeny. We further sequenced 44 selected species to validate these inferences of control region state. Ancestral state reconstruction using a range of weighting schemes identified six independent origins of mitochondrial control region duplications within Psittaciformes. Analysis of sequence data showed that varying levels of mitochondrial gene and tRNA homology and degradation were present within a given clade exhibiting duplications. Levels of divergence between control regions within an individual varied from 0-10.9% with the differences occurring mainly between 51 and 225 nucleotides 3' of the goose hairpin in domain I. Further investigations into the fates of duplicated mitochondrial genes, the potential costs and benefits of having a second control region, and the complex relationship between evolutionary rates, selection, and time since duplication are needed to fully explain these patterns in the mitochondrial genome. (C) 2012 Elsevier Inc. All rights reserved.

Clusters of leprosy transmission and of late diagnosis in a highly endemic area in Brazil: focus on different spatial analysis approaches

Objective The Brazilian National Hansens Disease Control Program recently identified clusters with high disease transmission. Herein, we present different spatial analytical approaches to define highly vulnerable areas in one of these clusters. Method The study area included 373 municipalities in the four Brazilian states Maranha o, Para ', Tocantins and Piaui '. Spatial analysis was based on municipalities as the observation unit, considering the following disease indicators: (i) rate of new cases / 100 000 population, (ii) rate of cases < 15 years / 100 000 population, (iii) new cases with grade-2 disability / 100 000 population and (iv) proportion of new cases with grade-2 disabilities. We performed descriptive spatial analysis, local empirical Bayesian analysis and spatial scan statistic. Results A total of 254 (68.0%) municipalities were classified as hyperendemic (mean annual detection rates > 40 cases / 100 000 inhabitants). There was a concentration of municipalities with higher detection rates in Para ' and in the center of Maranha o. Spatial scan statistic identified 23 likely clusters of new leprosy case detection rates, most of them localized in these two states. These clusters included only 32% of the total population, but 55.4% of new leprosy cases. We also identified 16 significant clusters for the detection rate < 15 years and 11 likely clusters of new cases with grade-2. Several clusters of new cases with grade-2 / population overlap with those of new cases detection and detection of children < 15 years of age. The proportion of new cases with grade-2 did not reveal any significant clusters. Conclusions Several municipality clusters for high leprosy transmission and late diagnosis were identified in an endemic area using different statistical approaches. Spatial scan statistic is adequate to validate and confirm high-risk leprosy areas for transmission and late diagnosis, identified using descriptive spatial analysis and using local empirical Bayesian method. National and State leprosy control programs urgently need to intensify control actions in these highly vulnerable municipalities.

Relating network rigidity, time scale hierarchies, and expression noise in gene networks

Fluctuation-dissipation theorems can be used to predict characteristics of noise from characteristics of the macroscopic response of a system. In the case of gene networks, feedback control determines the "network rigidity," defined as resistance to slow external changes. We propose an effective Fokker-Planck equation that relates gene expression noise to topology and to time scales of the gene network. We distinguish between two situations referred to as normal and inverted time hierarchies. The noise can be buffered by network feedback in the first situation, whereas it can be topology independent in the latter.

Factors associated with preterm birth in Campina Grande, Paraiba State, Brazil: a case-control study

A case-control study (2008-2009) analyzed risk factors for preterm birth in the city of Campina Grande, Paraiba State, Brazil. A total of 341 preterm births and 424 controls were included. A multiple logistic regression model was used. Risk factors for preterm birth were: previous history of preterm birth (OR = 2.32; 95% CI: 1.25-4.29), maternal age (OR = 2.00; 95% CI: 1.00-4.03), inadequate prenatal care (OR = 2.15; 95% CI: 1.40-3.27), inadequate maternal weight gain (OR = 2.33; 95% CI: 1.45-3.75), maternal physical injury (OR = 2.10; 95% CI: 1.22-3.60), hypertension with eclampsia (OR = 17.08; 95% CI: 3.67-79.43) and without eclampsia (OR = 6.42; 95% CI: 3.50-11.76), hospitalization (OR = 5.64; 95% CI: 3.47-9.15), altered amniotic fluid volume (OR = 2.28; 95% CI: 1.32-3.95), vaginal bleeding (OR = 1.54; 95% CI: 1.01-2.34), and multiple gestation (OR = 22.65; 95% CI: 6.22-82.46). High and homogeneous prevalence of poverty and low maternal schooling among both cases and controls may have contributed to the fact that socioeconomic variables did not remain significantly associated with preterm birth.

CASE-CONTROL STUDY OF AN OUTBREAK OF ACUTE TOXOPLASMOSIS IN AN INDUSTRIAL PLANT IN THE STATE OF SÃO PAULO, BRAZIL

Foodborne diseases represent operational risks in industrial restaurants. We described an outbreak of nine clustered cases of acute illness resembling acute toxoplasmosis in an industrial plant with 2300 employees. These patients and another 36 similar asymptomatic employees were diagnosed with anti-T. gondii IgG titer and avidity by ELISA. We excluded 14 patients based on high IgG avidity and chronic toxoplasmosis: 13 from controls and one from acute disease other than T. gondii infection. We also identified another three asymptomatic employees with T.gondii acute infection and also anti-T. gondii IgM positive as remaining acute cases. Case control study was conducted by interview in 11 acute infections and 20 negative controls. The ingestion of green vegetables, but not meat or water, was observed to be associated with the incidence of acute disease. These data reinforce the importance of sanitation control in industrial restaurants and also demonstrate the need for improvement in quality control regarding vegetables at risk for T. gondii oocyst contamination. We emphasized the accurate diagnosis of indexed cases and the detection of asymptomatic infections to determine the extent of the toxoplasmosis outbreak.

Case-control study of an outbreak of acute toxoplasmosis in an industrial plant in the state of São Paulo, Brazil

Foodborne diseases represent operational risks in industrial restaurants. We described an outbreak of nine clustered cases of acute illness resembling acute toxoplasmosis in an industrial plant with 2300 employees. These patients and another 36 similar asymptomatic employees were diagnosed with anti-T. gondii IgG titer and avidity by ELISA. We excluded 14 patients based on high IgG avidity and chronic toxoplasmosis: 13 from controls and one from acute disease other than T. gondii infection. We also identified another three asymptomatic employees with T.gondii acute infection and also anti-T. gondii IgM positive as remaining acute cases. Case control study was conducted by interview in 11 acute infections and 20 negative controls. The ingestion of green vegetables, but not meat or water, was observed to be associated with the incidence of acute disease. These data reinforce the importance of sanitation control in industrial restaurants and also demonstrate the need for improvement in quality control regarding vegetables at risk for T. gondii oocyst contamination. We emphasized the accurate diagnosis of indexed cases and the detection of asymptomatic infections to determine the extent of the toxoplasmosis outbreak.