The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.

THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

On the Filtering Problem for Continuous-Time Markov Jump Linear Systems with no Observation of the Markov Chain

We consider in this paper the optimal stationary dynamic linear filtering problem for continuous-time linear systems subject to Markovian jumps in the parameters (LSMJP) and additive noise (Wiener process). It is assumed that only an output of the system is available and therefore the values of the jump parameter are not accessible. It is a well known fact that in this setting the optimal nonlinear filter is infinite dimensional, which makes the linear filtering a natural numerically, treatable choice. The goal is to design a dynamic linear filter such that the closed loop system is mean square stable and minimizes the stationary expected value of the mean square estimation error. It is shown that an explicit analytical solution to this optimal filtering problem is obtained from the stationary solution associated to a certain Riccati equation. It is also shown that the problem can be formulated using a linear matrix inequalities (LMI) approach, which can be extended to consider convex polytopic uncertainties on the parameters of the possible modes of operation of the system and on the transition rate matrix of the Markov process. As far as the authors are aware of this is the first time that this stationary filtering problem (exact and robust versions) for LSMJP with no knowledge of the Markov jump parameters is considered in the literature. Finally, we illustrate the results with an example.

Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.

FtsH2 and FtsH5: two homologous subunits use different integration mechanisms leading to the same thylakoid multimeric complex

P>The Arabidopsis thylakoid FtsH protease complex is composed of FtsH1/FtsH5 (type A) and FtsH2/FtsH8 (type B) subunits. Type A and type B subunits display a high degree of sequence identity throughout their mature domains, but no similarity in their amino-terminal targeting peptide regions. In chloroplast import assays, FtsH2 and FtsH5 were imported and subsequently integrated into thylakoids by a two-step processing mechanism that resulted in an amino-proximal lumenal domain, a single transmembrane anchor, and a carboxyl proximal stromal domain. FtsH2 integration into washed thylakoids was entirely dependent on the proton gradient, whereas FtsH5 integration was dependent on NTPs, suggesting their integration by Tat and Sec pathways, respectively. This finding was corroborated by in organello competition and by antibody inhibition experiments. A series of constructs were made in order to understand the molecular basis for different integration pathways. The amino proximal domains through the transmembrane anchors were sufficient for proper integration as demonstrated with carboxyl-truncated versions of FtsH2 and FtsH5. The mature FtsH2 protein was found to be incompatible with the Sec machinery as determined with targeting peptide-swapping experiments. Incompatibility does not appear to be determined by any specific element in the FtsH2 domain as no single domain was incompatible with Sec transport. This suggests an incompatible structure that requires the intact FtsH2. That the highly homologous type A and type B subunits of the same multimeric complex use different integration pathways is a striking example of the notion that membrane insertion pathways have evolved to accommodate structural features of their respective substrates.

Biochemistry of the Envenomation Response-a Generator Theme for Interdisciplinary Integration

The understanding of complex physiological processes requires information from many different areas of knowledge. To meet this interdisciplinary scenario, the ability of integrating and articulating information is demanded. The difficulty of such approach arises because, more often than not, information is fragmented through under graduation education in Health Sciences. Shifting from a fragmentary and deep view of many topics to joining them horizontally in a global view is not a trivial task for teachers to implement. To attain that objective we proposed a course herein described Biochemistry of the envenomation response aimed at integrating previous contents of Health Sciences courses, following international recommendations of interdisciplinary model. The contents were organized by modules with increasing topic complexity. The full understanding of the envenoming pathophysiology of each module would be attained by the integration of knowledge from different disciplines. Active-learning strategy was employed focusing concept map drawing. Evaluation was obtained by a 30-item Likert-type survey answered by ninety students; 84% of the students considered that the number of relations that they were able to establish as seen by concept maps increased throughout the course. Similarly, 98% considered that both the theme and the strategy adopted in the course contributed to develop an interdisciplinary view.

CO(2) from Alcoholic Fermentation for Continuous Cultivation of Arthrospira (Spirulina) platensis in Tubular Photobioreactor Using Urea as Nitrogen Source

Carbon dioxide released from alcoholic fermentation accounts for 33% of the whole CO(2) involved in the use of ethanol as fuel derived from glucose. As Arthrospira platensis can uptake this greenhouse gas, this study evaluates the use of the CO(2) released from alcoholic fermentation for the production of Arthrospira platensis. For this purpose, this cyanobacterium was cultivated in continuous process using urea as nitrogen source, either using CO(2) from alcoholic fermentation, without any treatment, or using pure CO(2) from cylinder. The experiments were carried out at 120 mu mol photons m(-2) s(-1) in tubular photobioreactor at different dilution rates (0.2 <= D <= 0.8 d(-1)). Using CO(2) from alcoholic fermentation, maximum steady-state cell concentration (2661 +/- 71 mg L(-1)) was achieved at D 0.2 d(-1), whereas higher dilution rate (0.6 d(-1)) was needed to maximize cell productivity (839 mg L(-1) d(-1)). This value was 10% lower than the one obtained with pure CO(2), and there was no significant difference in the biomass protein content. With D 0.8 d(-1), it was possible to obtain 56% +/- 1.5% and 50% +/- 1.2% of protein in the dry biomass, using pure CO(2) and CO(2) from alcoholic fermentation, respectively. These results demonstrate that the use of such cost free CO(2) from alcoholic fermentation as carbon source, associated with low cost nitrogen source, may be a promising way to reduce costs of continuous cultivation of photosynthetic microorganisms, contributing at the same time to mitigate the greenhouse effect. (C) 2011 American Institute of Chemical Engineers Biotechnol. Prog., 27: 650-656, 2011

Extraction of Ascorbate Oxidase from Cucurbita maxima by Continuous Process in Perforated Rotating Disc Contactor Using Aqueous Two-Phase Systems

The ascorbate oxidase is the enzyme used to determine the content of ascorbic acid in the pharmaceutical and food industries and clinics analyses. The techniques currently used for the purification of this enzyme raise its production cost. Thus, the development of alternative processes and with the potential to reduce costs is interesting. The application of aqueous two-phase system is proposed as an alternative to purification because it enables good separation of biomolecules. The objective of this study was to determine the conditions to continuously pre-purify the enzyme ascorbate oxidase by an aqueous two-phase system (PEG/citrate) using rotating column provided with perforated discs. Under the best conditions (20,000 g/mol PEG molar mass, 10% PEG concentration, and 25% citrate concentration), the system showed satisfactory results (partition coefficient, 3.35; separation efficiency, 54.98%; and purification factor, 1.46) and proved suitable for the pre-purification of ascorbate oxidase in continuous process.

Continuous extraction of alpha-toxin from a fermented broth of Clostridium perfringens Type A in perforated rotating disc contactor using aqueous two-phase PEG-phosphate system

A 2(3-1) factorial experimental design was used to evaluate the performance of a perforated rotating disc contactor to extract alpha-toxin from the fermented broth of Clostridium perfringens Type A by aqueous two-phase system of polyethylene glycol-phosphate salts. The influence of three independent variables, specifically the dispersed phase flowrate, the continuous phase flowrate and the disc rotational speed, was investigated on the hold up, the mass transfer coefficient, the separation efficiency and the purification factor, taken as the response variables. The optimum dispersed phase flowrate was 3.0 mL/min for all these responses. Besides, maximum values of hold up (0.80), separation efficiency (0. 10) and purification factor (2.4) were obtained at this flowrate using the lowest disc rotational speed (35 rpm), while the optimum mass transfer coefficient (0. 165 h(-1)) was achieved at the highest agitation level (140 rpm). The results of this study demonstrated that the dispersed phase flowrate strongly influenced the performance of PRDC, in that both the mass transfer coefficient and hold up increased with this parameter. (c) 2007 Elsevier B. V. All rights reserved.

Evaluating the efficiency of fractional integration parameter estimators

This article deals with the efficiency of fractional integration parameter estimators. This study was based on Monte Carlo experiments involving simulated stochastic processes with integration orders in the range]-1,1[. The evaluated estimation methods were classified into two groups: heuristics and semiparametric/maximum likelihood (ML). The study revealed that the comparative efficiency of the estimators, measured by the lesser mean squared error, depends on the stationary/non-stationary and persistency/anti-persistency conditions of the series. The ML estimator was shown to be superior for stationary persistent processes; the wavelet spectrum-based estimators were better for non-stationary mean reversible and invertible anti-persistent processes; the weighted periodogram-based estimator was shown to be superior for non-invertible anti-persistent processes.

Continuous reproduction and recruitment in the narrowback mud crab Panopeus americanus (Brachyura, Panopeidae) in a remnant human-impacted mangrove area

The population structure, reproductive period, and juvenile recruitment of Panopeus americanus were studied in order to enhance knowledge of its life cycle and reproductive strategy and promote the maintenance of its natural stocks in an impacted region. Specimens were collected in the remnant human-impacted mangrove at Araca, state of Sao Paulo, Brazil, at two-month intervals from January to November 2005, at low tide, with a capture effort by three people. The crabs were measured (carapace width, CW) and sexed. The total catch was 275 animals, including 132 males (48.0%); 127 females (46.2%), of which 39 were ovigerous (14.2% of total catch); and 16 individuals whose sex could not be identified (5.8%). No correlation was observed between water temperature and the number of collected individuals; however, there was a significant, positive correlation with salinity. Males were significantly larger than females. The size-frequency distribution was bimodal, reflecting the occurrende of more than one recruitment pulse and the differential abundance of adults during the period of study. The overall sex ratio was 1:0.97 favoring males, and was not significantly different from the expected value, i.e., this population fits the anomalous pattern of sex occurrence in size classes. Ovigerous females were captured in all sampled months, which explain the continuous recruitment observed. Expected low levels of individuals of different size classes in the population were not confirmed. All population aspects found here allowed us to infer that this population of P. americanus is well established in the impacted mangrove by virtue of its reproductive strategy.

Bleeding patterns and menstrual-related symptoms with the continuous use of a contraceptive combination of ethinylestradiol and drospirenone: a randomized study

Background: The objective of this study was to compare bleeding patterns of women using a contraceptive combination of 30 mcg ethinylestradiol (EE) and 3 mg drospirenone (DRSP) continuously or cyclically. Menstrual-related symptoms were also evaluated. Study Design: This open, prospective, randomized study evaluated 78 women using the EE/DRSP combination continuously for 168 days or for six 28-day cycles, each followed by a 7-day hormone-free interval. A diary with pre-established scales was used to assess the frequency and intensity of bleeding and menstrual-related symptoms. Results: Amenorrhea increased with continuous use; 62.2% of women with continuous use were amenorrheic at the end of treatment (95% CI: 46.6-77.8%). Dysmenorrhea, headache, acne, nausea, edema and increased appetite improved significantly in the continuous-use group, and mastalgia and edema in the cyclic-use group (p<.05). Six subjects in the continuous-use group (15.4%) and three in the cyclic-use group (7.7%) discontinued due to adverse events. Conclusions: Continuous use was associated with amenorrhea and fewer menstrual-related symptoms compared to cyclic use. (C) 2010 Elsevier Inc. All rights reserved.

Effect of a continuous regimen of contraceptive combination of ethinylestradiol and drospirenone on lipid, carbohydrate and coagulation profiles

Background: The objective of this study was to evaluate the effects of a contraceptive pill containing ethinylestradiol (30 mcg) and drospirenone (3 mg) in a continuous regimen on lipid, carbohydrate and coagulation parameters. Study Design: This open, prospective, randomized study included 78 participants (mean age 27.8 years) who were randomized into two groups to use the pill continuously for 168 days or for six 28-day cycles with a 7-day hormone-free interval between cycles. Markers of lipid, carbohydrate and coagulation profiles were measured prior to initiation and after the 6 months of pill use. Results: No statistically significant differences were found between the two contraceptive regimens with respect to carbohydrate or lipid profiles or in the parameters related to coagulation. Conclusions: The contraceptive combination of ethinylestradiol and drospirenone used in a continuous regimen was associated with metabolic alterations similar to those found during the traditional cyclic regimen of oral contraceptive use. (C) 2010 Elsevier Inc. All rights reserved.

Effects of Nasal Continuous Positive Airway Pressure Treatment on Oxidative Stress and Adiponectin Levels in Obese Patients with Obstructive Sleep Apnea

Background: Obesity and obstructive sleep apnea (OSA) are both associated with the prevalence of major cardiovascular illnesses and certain common factors they are considered responsible for, such as stress oxidative increase, sympathetic tonus and resistance to insulin. Objective: The aim of the present study was to compare the effect of continuous positive airway pressure (CPAP) on oxidative stress and adiponectin levels in obese patients with and without OSA. Methods: Twenty-nine obese patients were categorized into 3 groups: group 1: 10 individuals without OSA (apnea-hypopnea index, AHI <= 5) who did not have OSA diagnosed at polysomnography; group 2: 10 patients with moderate to severe OSA (AHI >= 20) who did not use CPAP; group 3: 9 patients with moderate to severe OSA (AHI >= 20) who used CPAP. Results: Group 3 showed significant differences before and after the use of CPAP, in the variables of diminished production of superoxide, and increased nitrite and nitrate synthesis and adiponectin levels. Positive correlations were seen between the AHI and the superoxide production, between the nitrite and nitrate levels and the adiponectin levels, between superoxide production and the HOMA-IR, and between AHI and the HOMA-IR. Negative correlations were found between AHI and the nitrite and nitrate levels, between the superoxide production and that of nitric oxide, between the superoxide production and the adiponectin levels, between AHI and the adiponectin levels, and between the nitrite and nitrate levels and the HOMA-IR. Conclusions: This study demonstrates that the use of CPAP can reverse the increased superoxide production, the diminished serum nitrite, nitrate and plasma adiponectin levels, and the metabolic changes existing in obese patients with OSA. Copyright (C) 2009 S. Karger AG, Basel

Discontinuation of continuous renal replacement therapy: A post hoc analysis of a prospective multicenter observational study

Objectives: To describe current practice for the discontinuation of continuous renal replacement therapy in a multinational setting and to identify variables associated with successful discontinuation. The approach to discontinue continuous renal replacement therapy may affect patient outcomes. However, there is lack of information on how and under what conditions continuous renal replacement therapy is discontinued. Design: Post hoc analysis of a prospective observational study. Setting. Fifty-four intensive care units in 23 countries. Patients: Five hundred twenty-nine patients (52.6%) who survived initial therapy among 1006 patients treated with continuous renal replacement therapy. Interventions: None. Measurements and Main Results., Three hundred thirteen patients were removed successfully from continuous renal replacement therapy and did not require any renal replacement therapy for at least 7 days and were classified as the ""success"" group and the rest (216 patients) were classified as the ""repeat-RRT"" (renal replacement therapy) group. Patients in the ""success"" group had lower hospital mortality (28.5% vs. 42.7%, p < .0001) compared with patients in the ""repeat-RRT"" group. They also had lower creatinine and urea concentrations and a higher urine output at the time of stopping continuous renal replacement therapy. Multivariate logistic regression analysis for successful discontinuation of continuous renal replacement therapy identified urine output (during the 24 hrs before stopping continuous renal replacement therapy: odds ratio, 1.078 per 100 mL/day increase) and creatinine (odds ratio, 0.996 per mu mol/L increase) as significant predictors of successful cessation. The area under the receiver operating characteristic curve to predict successful discontinuation of continuous renal replacement therapy was 0.808 for urine output and 0.635 for creatinine. The predictive ability of urine output was negatively affected by the use of diuretics (area under the receiver operating characteristic curve, 0.671 with diuretics and 0.845 without diuretics). Conclusions. We report on the current practice of discontinuing continuous renal replacement therapy in a multinational setting. Urine output at the time of initial cessation (if continuous renal replacement therapy was the most important predictor of successful discontinuation, especially if occurring without the administration of diuretics. (Crit Care Med 2009; 37:2576-2582)