THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

On the Filtering Problem for Continuous-Time Markov Jump Linear Systems with no Observation of the Markov Chain

We consider in this paper the optimal stationary dynamic linear filtering problem for continuous-time linear systems subject to Markovian jumps in the parameters (LSMJP) and additive noise (Wiener process). It is assumed that only an output of the system is available and therefore the values of the jump parameter are not accessible. It is a well known fact that in this setting the optimal nonlinear filter is infinite dimensional, which makes the linear filtering a natural numerically, treatable choice. The goal is to design a dynamic linear filter such that the closed loop system is mean square stable and minimizes the stationary expected value of the mean square estimation error. It is shown that an explicit analytical solution to this optimal filtering problem is obtained from the stationary solution associated to a certain Riccati equation. It is also shown that the problem can be formulated using a linear matrix inequalities (LMI) approach, which can be extended to consider convex polytopic uncertainties on the parameters of the possible modes of operation of the system and on the transition rate matrix of the Markov process. As far as the authors are aware of this is the first time that this stationary filtering problem (exact and robust versions) for LSMJP with no knowledge of the Markov jump parameters is considered in the literature. Finally, we illustrate the results with an example.

Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.

Effects of oral supplementation with glutamine and alanyl-glutamine on glutamine, glutamate, and glutathione status in trained rats and subjected to long-duration exercise

Objective: We investigated the effect of supplementation with the dipeptide L-alanyl-L-glutamine (DIP) and a solution containing L-glutamine and L-alanine, both in the free form, on the plasma and tissue concentrations of glutamine, glutamate, and glutathione (GSH) in rats subjected to long-duration exercise. Methods: Rats were subjected to sessions of swim training. Twenty-one days before sacrifice, the animals were supplemented with DIP (1.5 g/kg, n = 6), a solution of free L-glutamine (1 g/kg) and free L-alanine (0.61 g/kg; GLN + ALA, n = 6), or water (CON, n = 6). Animals were sacrificed before (TR, n = 6) or after (LD, n = 6) long-duration exercise. Plasma concentrations of glutamine, glutamate, glucose, and ammonia and liver and muscle concentrations of glutamine, glutamate, and reduced and oxidized (GSSG) GSH were measured. Results: Higher concentrations of plasma glutamine were found in the DIP-TR and GLN + ALA-TR groups. The CON-LD group showed hyperammonemia, whereas the DIP-LD and GLN + ALA-LD groups exhibited lower concentrations of ammonia. Higher concentrations of glutamine, glutamate, and GSH/GSSG in the soleus muscle and GSH and GSH/GSSG in the liver were observed in the DIP-TR and GLN + ALA-TR groups. The DIP-LD and GLN + ALA-LD groups exhibited higher concentrations of GSH and GSH/GSSG in the soleus muscle and liver compared with the CON-LD group. Conclusion: Chronic oral administration of DIP and free GLN + ALA before long-duration exercise represents an effective source of glutamine and glutamate, which may increase muscle and liver stores of GSH and improve the redox state of the cell. (C) 2009 Published by Elsevier Inc.

CO(2) from Alcoholic Fermentation for Continuous Cultivation of Arthrospira (Spirulina) platensis in Tubular Photobioreactor Using Urea as Nitrogen Source

Carbon dioxide released from alcoholic fermentation accounts for 33% of the whole CO(2) involved in the use of ethanol as fuel derived from glucose. As Arthrospira platensis can uptake this greenhouse gas, this study evaluates the use of the CO(2) released from alcoholic fermentation for the production of Arthrospira platensis. For this purpose, this cyanobacterium was cultivated in continuous process using urea as nitrogen source, either using CO(2) from alcoholic fermentation, without any treatment, or using pure CO(2) from cylinder. The experiments were carried out at 120 mu mol photons m(-2) s(-1) in tubular photobioreactor at different dilution rates (0.2 <= D <= 0.8 d(-1)). Using CO(2) from alcoholic fermentation, maximum steady-state cell concentration (2661 +/- 71 mg L(-1)) was achieved at D 0.2 d(-1), whereas higher dilution rate (0.6 d(-1)) was needed to maximize cell productivity (839 mg L(-1) d(-1)). This value was 10% lower than the one obtained with pure CO(2), and there was no significant difference in the biomass protein content. With D 0.8 d(-1), it was possible to obtain 56% +/- 1.5% and 50% +/- 1.2% of protein in the dry biomass, using pure CO(2) and CO(2) from alcoholic fermentation, respectively. These results demonstrate that the use of such cost free CO(2) from alcoholic fermentation as carbon source, associated with low cost nitrogen source, may be a promising way to reduce costs of continuous cultivation of photosynthetic microorganisms, contributing at the same time to mitigate the greenhouse effect. (C) 2011 American Institute of Chemical Engineers Biotechnol. Prog., 27: 650-656, 2011

Extraction of Ascorbate Oxidase from Cucurbita maxima by Continuous Process in Perforated Rotating Disc Contactor Using Aqueous Two-Phase Systems

The ascorbate oxidase is the enzyme used to determine the content of ascorbic acid in the pharmaceutical and food industries and clinics analyses. The techniques currently used for the purification of this enzyme raise its production cost. Thus, the development of alternative processes and with the potential to reduce costs is interesting. The application of aqueous two-phase system is proposed as an alternative to purification because it enables good separation of biomolecules. The objective of this study was to determine the conditions to continuously pre-purify the enzyme ascorbate oxidase by an aqueous two-phase system (PEG/citrate) using rotating column provided with perforated discs. Under the best conditions (20,000 g/mol PEG molar mass, 10% PEG concentration, and 25% citrate concentration), the system showed satisfactory results (partition coefficient, 3.35; separation efficiency, 54.98%; and purification factor, 1.46) and proved suitable for the pre-purification of ascorbate oxidase in continuous process.

Continuous extraction of alpha-toxin from a fermented broth of Clostridium perfringens Type A in perforated rotating disc contactor using aqueous two-phase PEG-phosphate system

A 2(3-1) factorial experimental design was used to evaluate the performance of a perforated rotating disc contactor to extract alpha-toxin from the fermented broth of Clostridium perfringens Type A by aqueous two-phase system of polyethylene glycol-phosphate salts. The influence of three independent variables, specifically the dispersed phase flowrate, the continuous phase flowrate and the disc rotational speed, was investigated on the hold up, the mass transfer coefficient, the separation efficiency and the purification factor, taken as the response variables. The optimum dispersed phase flowrate was 3.0 mL/min for all these responses. Besides, maximum values of hold up (0.80), separation efficiency (0. 10) and purification factor (2.4) were obtained at this flowrate using the lowest disc rotational speed (35 rpm), while the optimum mass transfer coefficient (0. 165 h(-1)) was achieved at the highest agitation level (140 rpm). The results of this study demonstrated that the dispersed phase flowrate strongly influenced the performance of PRDC, in that both the mass transfer coefficient and hold up increased with this parameter. (c) 2007 Elsevier B. V. All rights reserved.

Continuous reproduction and recruitment in the narrowback mud crab Panopeus americanus (Brachyura, Panopeidae) in a remnant human-impacted mangrove area

The population structure, reproductive period, and juvenile recruitment of Panopeus americanus were studied in order to enhance knowledge of its life cycle and reproductive strategy and promote the maintenance of its natural stocks in an impacted region. Specimens were collected in the remnant human-impacted mangrove at Araca, state of Sao Paulo, Brazil, at two-month intervals from January to November 2005, at low tide, with a capture effort by three people. The crabs were measured (carapace width, CW) and sexed. The total catch was 275 animals, including 132 males (48.0%); 127 females (46.2%), of which 39 were ovigerous (14.2% of total catch); and 16 individuals whose sex could not be identified (5.8%). No correlation was observed between water temperature and the number of collected individuals; however, there was a significant, positive correlation with salinity. Males were significantly larger than females. The size-frequency distribution was bimodal, reflecting the occurrende of more than one recruitment pulse and the differential abundance of adults during the period of study. The overall sex ratio was 1:0.97 favoring males, and was not significantly different from the expected value, i.e., this population fits the anomalous pattern of sex occurrence in size classes. Ovigerous females were captured in all sampled months, which explain the continuous recruitment observed. Expected low levels of individuals of different size classes in the population were not confirmed. All population aspects found here allowed us to infer that this population of P. americanus is well established in the impacted mangrove by virtue of its reproductive strategy.

Bleeding patterns and menstrual-related symptoms with the continuous use of a contraceptive combination of ethinylestradiol and drospirenone: a randomized study

Background: The objective of this study was to compare bleeding patterns of women using a contraceptive combination of 30 mcg ethinylestradiol (EE) and 3 mg drospirenone (DRSP) continuously or cyclically. Menstrual-related symptoms were also evaluated. Study Design: This open, prospective, randomized study evaluated 78 women using the EE/DRSP combination continuously for 168 days or for six 28-day cycles, each followed by a 7-day hormone-free interval. A diary with pre-established scales was used to assess the frequency and intensity of bleeding and menstrual-related symptoms. Results: Amenorrhea increased with continuous use; 62.2% of women with continuous use were amenorrheic at the end of treatment (95% CI: 46.6-77.8%). Dysmenorrhea, headache, acne, nausea, edema and increased appetite improved significantly in the continuous-use group, and mastalgia and edema in the cyclic-use group (p<.05). Six subjects in the continuous-use group (15.4%) and three in the cyclic-use group (7.7%) discontinued due to adverse events. Conclusions: Continuous use was associated with amenorrhea and fewer menstrual-related symptoms compared to cyclic use. (C) 2010 Elsevier Inc. All rights reserved.

Effect of a continuous regimen of contraceptive combination of ethinylestradiol and drospirenone on lipid, carbohydrate and coagulation profiles

Background: The objective of this study was to evaluate the effects of a contraceptive pill containing ethinylestradiol (30 mcg) and drospirenone (3 mg) in a continuous regimen on lipid, carbohydrate and coagulation parameters. Study Design: This open, prospective, randomized study included 78 participants (mean age 27.8 years) who were randomized into two groups to use the pill continuously for 168 days or for six 28-day cycles with a 7-day hormone-free interval between cycles. Markers of lipid, carbohydrate and coagulation profiles were measured prior to initiation and after the 6 months of pill use. Results: No statistically significant differences were found between the two contraceptive regimens with respect to carbohydrate or lipid profiles or in the parameters related to coagulation. Conclusions: The contraceptive combination of ethinylestradiol and drospirenone used in a continuous regimen was associated with metabolic alterations similar to those found during the traditional cyclic regimen of oral contraceptive use. (C) 2010 Elsevier Inc. All rights reserved.

Effects of Nasal Continuous Positive Airway Pressure Treatment on Oxidative Stress and Adiponectin Levels in Obese Patients with Obstructive Sleep Apnea

Background: Obesity and obstructive sleep apnea (OSA) are both associated with the prevalence of major cardiovascular illnesses and certain common factors they are considered responsible for, such as stress oxidative increase, sympathetic tonus and resistance to insulin. Objective: The aim of the present study was to compare the effect of continuous positive airway pressure (CPAP) on oxidative stress and adiponectin levels in obese patients with and without OSA. Methods: Twenty-nine obese patients were categorized into 3 groups: group 1: 10 individuals without OSA (apnea-hypopnea index, AHI <= 5) who did not have OSA diagnosed at polysomnography; group 2: 10 patients with moderate to severe OSA (AHI >= 20) who did not use CPAP; group 3: 9 patients with moderate to severe OSA (AHI >= 20) who used CPAP. Results: Group 3 showed significant differences before and after the use of CPAP, in the variables of diminished production of superoxide, and increased nitrite and nitrate synthesis and adiponectin levels. Positive correlations were seen between the AHI and the superoxide production, between the nitrite and nitrate levels and the adiponectin levels, between superoxide production and the HOMA-IR, and between AHI and the HOMA-IR. Negative correlations were found between AHI and the nitrite and nitrate levels, between the superoxide production and that of nitric oxide, between the superoxide production and the adiponectin levels, between AHI and the adiponectin levels, and between the nitrite and nitrate levels and the HOMA-IR. Conclusions: This study demonstrates that the use of CPAP can reverse the increased superoxide production, the diminished serum nitrite, nitrate and plasma adiponectin levels, and the metabolic changes existing in obese patients with OSA. Copyright (C) 2009 S. Karger AG, Basel

Discontinuation of continuous renal replacement therapy: A post hoc analysis of a prospective multicenter observational study

Objectives: To describe current practice for the discontinuation of continuous renal replacement therapy in a multinational setting and to identify variables associated with successful discontinuation. The approach to discontinue continuous renal replacement therapy may affect patient outcomes. However, there is lack of information on how and under what conditions continuous renal replacement therapy is discontinued. Design: Post hoc analysis of a prospective observational study. Setting. Fifty-four intensive care units in 23 countries. Patients: Five hundred twenty-nine patients (52.6%) who survived initial therapy among 1006 patients treated with continuous renal replacement therapy. Interventions: None. Measurements and Main Results., Three hundred thirteen patients were removed successfully from continuous renal replacement therapy and did not require any renal replacement therapy for at least 7 days and were classified as the ""success"" group and the rest (216 patients) were classified as the ""repeat-RRT"" (renal replacement therapy) group. Patients in the ""success"" group had lower hospital mortality (28.5% vs. 42.7%, p < .0001) compared with patients in the ""repeat-RRT"" group. They also had lower creatinine and urea concentrations and a higher urine output at the time of stopping continuous renal replacement therapy. Multivariate logistic regression analysis for successful discontinuation of continuous renal replacement therapy identified urine output (during the 24 hrs before stopping continuous renal replacement therapy: odds ratio, 1.078 per 100 mL/day increase) and creatinine (odds ratio, 0.996 per mu mol/L increase) as significant predictors of successful cessation. The area under the receiver operating characteristic curve to predict successful discontinuation of continuous renal replacement therapy was 0.808 for urine output and 0.635 for creatinine. The predictive ability of urine output was negatively affected by the use of diuretics (area under the receiver operating characteristic curve, 0.671 with diuretics and 0.845 without diuretics). Conclusions. We report on the current practice of discontinuing continuous renal replacement therapy in a multinational setting. Urine output at the time of initial cessation (if continuous renal replacement therapy was the most important predictor of successful discontinuation, especially if occurring without the administration of diuretics. (Crit Care Med 2009; 37:2576-2582)

The possible role of physical exercise on the treatment of idiopathic inflammatory myopathies

Idiopathic inflammatory myopathies (IIM) are a heterogeneous group of diseases that share some symptoms such as muscular weakness and inflammation of skeletal muscle. Complete recovery of muscle function with pharmacological treatment does not always occur, suggesting that physical inability is a great concern for these patients. In this context, it has been speculated that physical exercise could result in functional benefits to patients with IIM, leading to an improvement in quality of life. In fact, recent studies of polymyositis (PM) and dermatomyositis (DM) support the notion that exercise training improves or at least stabilizes muscle strength and functional ability without inducing disease flares. Importantly, these benefits were observed not only during the chronic phase, but also in the course of active disease. This positive effect was found to be long term, as demonstrated by a six-month significant improvement in exercise capacity and strength. Together, these findings indicate that a well controlled exercise program can be recommended for patients with DM and PM. The optimal exercise modality training and the underlying mechanism for this encouraging response remain to be determined in future studies. (C) 2008 Elsevier B.V. All rights reserved.

Aerobic Exercise Improves Reverse Cholesterol Transport in Cholesteryl Ester Transfer Protein Transgenic Mice

We analyzed the effect of a 6-week aerobic exercise training program on the in vivo macrophage reverse cholesterol transport (RCT) in human cholesteryl ester transfer protein (CETP) transgenic (CETP-tg) mice. Male CETP-tg mice were randomly assigned to a sedentary group or a carefully supervised exercise training group (treadmill 15 m/min, 30 min sessions, five sessions per week). The levels of plasma lipids were determined by enzymatic methods, and the lipoprotein profile was determined by fast protein liquid chromatography (FPLC). CETP activity was determined by measuring the transfer rate of (14)C-cholesterol from HDL to apo-B containing lipoproteins, using plasma from CETP-tg mice as a source of CETP. The reverse cholesterol transport was determined in vivo by measuring the [(3)H]-cholesterol recovery in plasma and feces (24 and 48 h) and in the liver (48 h) following a peritoneal injection of [(3)H]-cholesterol labeled J774-macrophages into both sedentary and exercise trained mice. The protein levels of liver receptors were determined by immunoblot, and the mRNA levels for liver enzymes were measured using RT-PCR. Exercise training did not significantly affect the levels of plasma lipids or CETP activity. The HDL fraction assessed by FPLC was higher in exercise-trained compared to sedentary mice. In comparison to the sedentary group, a greater recovery of [(3)H]-cholesterol from the injected macrophages was found in the plasma, liver and feces of exercise-trained animals. The latter occurred even with a reduction in the liver CYP7A1 mRNA level in exercised trained animals. Exercise training increased the liver LDL receptor and ABCA-1 protein levels, although the SR-BI protein content was unchanged. The RCT benefit in CETP-tg mice elicited by exercise training helps to elucidate the role of exercise in the prevention of atherosclerosis in humans.

Cardiovascular, metabolic and hormonal responses to the progressive exercise performed to exhaustion in patients with type 2 diabetes treated with metformin or glyburide

Objectives: To evaluate the effects of Metformin and Glyburide on cardiovascular, metabolic and hormonal parameters during progressive exercise performed to exhaustion in the post-prandial state in women with type 2 diabetes (T2DM). Design and Methods: Ten T2DM patients treated with Metformin (M group), 10 with Glyburide (G group) and 10 age-paired healthy subjects exercised on a bicycle ergometer up to exercise peak. Cardiovascular and blood metabolic and hormonal parameters were measured at times -60 min, 0 min, exercise end, and at 10 and 20 minutes of recovery phase. Thirty minutes before the exercise, a standard breakfast was provided to all participants. The diabetic patients took Metformin or Glyburide before or with meal. Results: Peak oxygen uptake (VO2) was lower in patients with diabetes. Plasma glucose levels remained unchanged, but were higher in both diabetic groups. Patients with diabetes also presented lower insulin levels after meals and higher glucagon levels at exercise peak than C group. Serum cortisol levels were higher in G than M group at exercise end and recovery phase. Lactate levels were higher in M than G group at fasting and in C group at exercise peak. Nor epinephrine, GH and FFA responses were similar in all 3 groups. Conclusion: Progressive exercise performed to exhaustion, in the post-prandial state did not worsen glucose control during and after exercise. The administration of the usual dose of Glyburide or Metformin to T2DM patients did not influence the cardiovascular, metabolic and hormonal response to exercise.