The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.

THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

On the Filtering Problem for Continuous-Time Markov Jump Linear Systems with no Observation of the Markov Chain

We consider in this paper the optimal stationary dynamic linear filtering problem for continuous-time linear systems subject to Markovian jumps in the parameters (LSMJP) and additive noise (Wiener process). It is assumed that only an output of the system is available and therefore the values of the jump parameter are not accessible. It is a well known fact that in this setting the optimal nonlinear filter is infinite dimensional, which makes the linear filtering a natural numerically, treatable choice. The goal is to design a dynamic linear filter such that the closed loop system is mean square stable and minimizes the stationary expected value of the mean square estimation error. It is shown that an explicit analytical solution to this optimal filtering problem is obtained from the stationary solution associated to a certain Riccati equation. It is also shown that the problem can be formulated using a linear matrix inequalities (LMI) approach, which can be extended to consider convex polytopic uncertainties on the parameters of the possible modes of operation of the system and on the transition rate matrix of the Markov process. As far as the authors are aware of this is the first time that this stationary filtering problem (exact and robust versions) for LSMJP with no knowledge of the Markov jump parameters is considered in the literature. Finally, we illustrate the results with an example.

Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.

Isolation and analysis of bioactive isoflavonoids and chalcone from a new type of Brazilian propolis

Activity-directed fractionation and purification processes were employed to identify isoflavonoids with antioxidant and antimicrobial activities from Brazilian red propolis. Crude propolis was extracted with ethanol (80%. v/v) and fractioned by liquid-liquid extraction technique using hexane and chloroform. Since chloroform fraction showed strong antioxidant and antimicrobial activities it was purified and isolated using various chromatographic techniques. Comparing our spectral data (UV, NMR, and mass spectrometry) with values found in the literature, we identified two bioactive isoflavonoids (vestitol and neovestitol), together with one chalcone (isoliquiritigenin). Vestitol presented higher antioxidant activity against beta-carotene consumption than neovestitol. The antimicrobial activity of these three compounds against Staphylococcus aureus, Streptococcus mutans, and Actinomyces naeslundii was evaluated and we concluded that isoliquiritigenin was the most active one with lower MIC, ranging from 15.6 to 62.5 mu g/mL. Our results showed that Brazilian red propolis has biologically active isoflavonoids that may be used as a mild antioxidant and antimicrobial for food preservation. (C) 2010 Elsevier B.V. All rights reserved.

Gas Chromatographic Analysis of Dimethyltryptamine and beta-Carboline Alkaloids in Ayahuasca, an Amazonian Psychoactive Plant Beverage

Introduction - Ayahuasca is obtained by infusing the pounded stems of Banisteriopsis caapi in combination with the leaves of Psychotria viridis. P. viridis is rich in the psychedelic indole N,N-dimethyltryptamine, whereas B. caapi contains substantial amounts of beta-carboline alkaloids, mainly harmine, harmaline and tetrahydroharmine, which are monoamine-oxidase inhibitors. Because of differences in composition in ayahuasca preparations, a method to measure their main active constituents is needed. Objective - To develop a gas chromatographic method for the simultaneous determination of dimethyltryptamine and the main beta-carbolines found in ayahuasca preparations. Methodology - The alkaloids were extracted by means of solid phase extraction (C(18)) and detected by gas chromatography with nitrogen/phosphorous detector. Results - The lower limit of quantification (LLOQ) was 0.02 mg/mL for all analytes. The calibration curves were linear over a concentration range of 0.02-4.0 mg/mL (r(2) > 0.99). The method was also precise (RSD < 10%). Conclusion - A simple gas chromatographic method to determine the main alkaloids found in ayahuasca was developed and validated. The method can be useful to estimate administered doses in animals and humans for further pharmacological and toxicological investigations of ayahuasca. Copyright (C) 2009 John Wiley & Sons, Ltd.

CO(2) from Alcoholic Fermentation for Continuous Cultivation of Arthrospira (Spirulina) platensis in Tubular Photobioreactor Using Urea as Nitrogen Source

Carbon dioxide released from alcoholic fermentation accounts for 33% of the whole CO(2) involved in the use of ethanol as fuel derived from glucose. As Arthrospira platensis can uptake this greenhouse gas, this study evaluates the use of the CO(2) released from alcoholic fermentation for the production of Arthrospira platensis. For this purpose, this cyanobacterium was cultivated in continuous process using urea as nitrogen source, either using CO(2) from alcoholic fermentation, without any treatment, or using pure CO(2) from cylinder. The experiments were carried out at 120 mu mol photons m(-2) s(-1) in tubular photobioreactor at different dilution rates (0.2 <= D <= 0.8 d(-1)). Using CO(2) from alcoholic fermentation, maximum steady-state cell concentration (2661 +/- 71 mg L(-1)) was achieved at D 0.2 d(-1), whereas higher dilution rate (0.6 d(-1)) was needed to maximize cell productivity (839 mg L(-1) d(-1)). This value was 10% lower than the one obtained with pure CO(2), and there was no significant difference in the biomass protein content. With D 0.8 d(-1), it was possible to obtain 56% +/- 1.5% and 50% +/- 1.2% of protein in the dry biomass, using pure CO(2) and CO(2) from alcoholic fermentation, respectively. These results demonstrate that the use of such cost free CO(2) from alcoholic fermentation as carbon source, associated with low cost nitrogen source, may be a promising way to reduce costs of continuous cultivation of photosynthetic microorganisms, contributing at the same time to mitigate the greenhouse effect. (C) 2011 American Institute of Chemical Engineers Biotechnol. Prog., 27: 650-656, 2011

Extraction of Ascorbate Oxidase from Cucurbita maxima by Continuous Process in Perforated Rotating Disc Contactor Using Aqueous Two-Phase Systems

The ascorbate oxidase is the enzyme used to determine the content of ascorbic acid in the pharmaceutical and food industries and clinics analyses. The techniques currently used for the purification of this enzyme raise its production cost. Thus, the development of alternative processes and with the potential to reduce costs is interesting. The application of aqueous two-phase system is proposed as an alternative to purification because it enables good separation of biomolecules. The objective of this study was to determine the conditions to continuously pre-purify the enzyme ascorbate oxidase by an aqueous two-phase system (PEG/citrate) using rotating column provided with perforated discs. Under the best conditions (20,000 g/mol PEG molar mass, 10% PEG concentration, and 25% citrate concentration), the system showed satisfactory results (partition coefficient, 3.35; separation efficiency, 54.98%; and purification factor, 1.46) and proved suitable for the pre-purification of ascorbate oxidase in continuous process.

Continuous extraction of alpha-toxin from a fermented broth of Clostridium perfringens Type A in perforated rotating disc contactor using aqueous two-phase PEG-phosphate system

A 2(3-1) factorial experimental design was used to evaluate the performance of a perforated rotating disc contactor to extract alpha-toxin from the fermented broth of Clostridium perfringens Type A by aqueous two-phase system of polyethylene glycol-phosphate salts. The influence of three independent variables, specifically the dispersed phase flowrate, the continuous phase flowrate and the disc rotational speed, was investigated on the hold up, the mass transfer coefficient, the separation efficiency and the purification factor, taken as the response variables. The optimum dispersed phase flowrate was 3.0 mL/min for all these responses. Besides, maximum values of hold up (0.80), separation efficiency (0. 10) and purification factor (2.4) were obtained at this flowrate using the lowest disc rotational speed (35 rpm), while the optimum mass transfer coefficient (0. 165 h(-1)) was achieved at the highest agitation level (140 rpm). The results of this study demonstrated that the dispersed phase flowrate strongly influenced the performance of PRDC, in that both the mass transfer coefficient and hold up increased with this parameter. (c) 2007 Elsevier B. V. All rights reserved.

New Rapid Derivative Spectrophotometric and Chromatographic Methods for Assay of Loratadine in Tablets and Syrups

New rapid first-derivative spectrophotometric (UVDS) and a stability-indicating high performance liquid chromatographic (HPLC) methods were developed, validated and successfully applied in the analysis of loratadine (LT) in tablets and syrups. In the UVDS method, 0.1 M HCl was used as solvent. The measurements were made at 312.4 nm in the first order derivative spectra. The HPLC method was carried out on a RP-18 column with a mobile phase composed of methanol-water-tetrahydrofuran (50:30:20, v/v/v). UV detection was made at 247 nm. For HPLC methods the total analysis time was <3min, adequate for routine quality control of tablets and syrups containing loratadine.

UV-Derivative Spectrophotometric and Stability-Indicating High-Performance Liquid Chromatographic Methods for Determination of Simvastatin in Tablets

A stability-indicating high-performance liquid chromatographic (HPLC) and a second-order derivative spectrophotometric (UVDS) analytical methods were validated and compared for determination of simvastatin in tablets. The HPLC method was performed with isocratic elution using a C18 column and a mobile phase composed of methanol:acetonitrile:water (60:20:20, v/v/v) at a flow rate of 1.0 ml/min. The detection was made at 239 nm. In UVDS method, methanol and water were used in first dilution and distilled water was used in consecutive dilutions and as background. The second-order derivative signal measurement was taken at 255 nm. Analytical curves showed correlation coefficients > 0.999 for both methods. The quantitation limits (QL) were 2.41 mu g/ml for HPLC and 0.45 mu g/ml for UVDS, respectively. Intra and inter-day relative standard deviations were < 2.0 %. Statistical analysis with t- and F-tests are not exceeding their critical values demonstrating that there is no significant difference between the two methods at 95 % confidence level.

Development and validation of high performance liquid chromatographic and UV-derivative spectrophotometric methods for the determination of sotalol hydrochloride in tablets

High performance liquid chromatographic (HPLC) and UV derivative spectrophotometric (UVDS) methods were developed and validated for the quantitative determination of sotalol hydrochloride in tablets. The HPLC method was performed on a C18 column with fluorescence detection. The excitation and emission wavelengths were 235 and 310nm, respectively. The mobile phase was composed of acetonitrile-water containing 0.1% trietylamine (7:93v/v) and pH adjusted to 4.6 with formic acid. The UVDS method was performed taking a signal at 239.1nm in the first derivative. The correlation coefficients (r) obtained were 0.9998 and 0.9997 for HPLC and UVDS methods, respectively. The proposed methods are simple and adaptable to routine analysis.

Determination of beta-artemether and its main metabolite dihydroartemisinin in plasma employing liquid-phase microextraction prior to liquid chromatographic-tandem mass spectrometric analysis

A method for the determination of artemether (ART) and its main metabolite dihydroartemisinin (DHA) in plasma employing liquid-phase microextraction (LPME) for sample preparation prior to liquid chromatography-tandem mass spectrometry (LC-MS-MS) was developed. The analytes were extracted from 1 nil, of plasma utilizing a two-phase LPME procedure with artemisinin as internal standard. Using the optimized LPME conditions, mean absolute recovery rates of 25 and 32% for DHA and ART, respectively, were achieved using toluene-n-octanol (1:1, viv) as organic phase with an extraction time of 30 min. After extraction, the analytes were resolved within 5 min using a mobile phase consisting of methanol-ammonium acetate (10 mmol L(-1) pH 5.0, 80:20. v/v) on a laboratory-made column based on poly(methyltetradecylsiloxane) attached to a zirconized-silica support. MS-MS detection was employed using an electrospray interface in the positive ion mode. The method developed was linear over the range of 5-1000 ng mL(-1) for both analytes. Precision and accuracy were within acceptable levels of confidence (<15%). The assay was applied to the determination of these analytes in plasma from rats treated with ART. The two-phase LPME procedure is affordable and the solvent consumption was very low compared to the traditional methods of sample preparation. (C) 2010 Elsevier B.V. All rights reserved.

Validation of a gas chromatographic method to quantify sesquiterpenes in copaiba oils

Copaifera species (Leguminoseae) are popularly known as ""copaiba"" or ""copaiva"". The oleoresins obtained from the trunk of these species have been extensively used in folk medicine and are commercialized in Brazil as crude oil and in several pharmaceutical and cosmetic products. This work reports a complete validated method for the quantification of beta-caryophyllene, alpha-copaene, and alpha-humulene in distinct copaiba oleoresins available commercially. Thus, essential oil samples (100 mu L) were dissolved in 20 mL of hexanes containing internal standard (1,2,4,5-tetramethylbenzene, 3.0 mM) in a 25 mL glass flask. A 1 mu L aliquot was injected into the GC-FID system. A fused-silica capillary column HP-5, coated with 5% phenylmethylsiloxane was used for this study. The developed method gave a good detection response with linearity in the range of 0.10-18.74 mM. Limits of detection and quantitation variety ranged between 0.003 and 0.091 mM. beta-Caryophyllene, alpha-copaene, and alpha-humulene were recovered in a range from 74.71% to 88.31%, displaying RSD lower than 10% and relative errors between -11.69% and -25.30%. Therefore, this method could be considered as an analytical tool for the quality control of different Copaifera oil samples and its products in both cosmetic and pharmaceutical companies. (C) 2010 Elsevier B.V. All rights reserved.

Partial characterization of proteins from baru (Dipteryx alata Vog) seeds

BACKGROUND: Baru (Dipteryx alata Vog.) is a fruit distributed throughout the Brazilian savanna and contains a seed with a high protein content, whose properties have been rarely explored. The purpose of this study was to characterize this protein, especially by isolation and quantifying its fractions and measuring some of its molecular properties. RESULTS: Baru seeds contain 244 g kg(-1) protein on a dry weight basis. Solubility profiles showed a preponderance of globulins. This fraction dominated the seed composition, with 61.7 wt% of the total soluble proteins. Albumins and glutelins accounted for 14 and 3.3 wt%, respectively. SDS-PAGE resolution of albumin and globulin showed main bands with molecular weights of 84 kDa and 64,66 and 73 kDa, respectively. The total protein of the flour and the globulin showed values of in vitro digestibility of 85.59% and 90.54%, relative to casein. Total globulin produced only one chromatographic peak, both on Sepharose CL-6B gel filtration and on DEAE-cellulose ion-exchange columns, eluted at a concentration of 0.12 mol L(-1) NaCl. CONCLUSION: The baru seed had high protein content with large quantities of storage proteins. The chromatographic and solubility profiles indicate the predominance of a fraction with characteristics of a legumin-type protein. (C) 2011 Society of Chemical Industry