The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.

THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

On the Filtering Problem for Continuous-Time Markov Jump Linear Systems with no Observation of the Markov Chain

We consider in this paper the optimal stationary dynamic linear filtering problem for continuous-time linear systems subject to Markovian jumps in the parameters (LSMJP) and additive noise (Wiener process). It is assumed that only an output of the system is available and therefore the values of the jump parameter are not accessible. It is a well known fact that in this setting the optimal nonlinear filter is infinite dimensional, which makes the linear filtering a natural numerically, treatable choice. The goal is to design a dynamic linear filter such that the closed loop system is mean square stable and minimizes the stationary expected value of the mean square estimation error. It is shown that an explicit analytical solution to this optimal filtering problem is obtained from the stationary solution associated to a certain Riccati equation. It is also shown that the problem can be formulated using a linear matrix inequalities (LMI) approach, which can be extended to consider convex polytopic uncertainties on the parameters of the possible modes of operation of the system and on the transition rate matrix of the Markov process. As far as the authors are aware of this is the first time that this stationary filtering problem (exact and robust versions) for LSMJP with no knowledge of the Markov jump parameters is considered in the literature. Finally, we illustrate the results with an example.

Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.

Characterization of electrical penetration graphs of Bucephalogonia xanthophis, a vector of Xylella fastidiosa in citrus

The sharpshooter Bucephalogonia xanthophis (Berg) (Homoptera: Cicadellidae) is a vector of the xylem-limited bacterium, Xylella fastidiosa (Wells, Raju, Hung, Weisburg, Mandelco-Paul, and Brenner), which causes citrus variegated chlorosis. Despite the importance of citrus variegated chlorosis, the probing behavior of vectors on citrus and its implications for transmission of X. fastidiosa have not been studied. Here we studied electrical penetration graph (EPG-DC system) waveforms produced by B. xanthophis on Citrus sinensis (L.) Osbeck (Rutaceae), and their relationships with stylet activities and xylem ingestion. Electrical penetration graph waveforms were described based on amplitude, frequency, voltage level, and electrical origin of the observed traces during stylet penetration on plant tissues. The main waveforms were correlated with histological observations of salivary sheaths in plant tissues and excretion analysis, in order to determine stylet activities and their precise position. Six waveforms and associated activities are described: (S) secretion of salivary sheath and intracellular stylet pathway, (R) resting during stylet pathway, (Xc) contact of stylets with xylem vessels, (Xi) active xylem ingestion, (N) interruption within the xylem phase (during Xc or Xi), and (W) withdrawal of stylet from the plant. The sharpshooter spent 91.8% of its probing time with its stylet in the xylem, where the main activity was ingestion (Xi: 97.5%). During a probe, the most likely sequence of events is secretion of salivary sheath and pathway (S) through epidermal and parenchyma cells (all individuals), followed by contact with xylem (Xc) (67.6% of all individuals) and ingestion (Xi) (88.3% of those that exhibit waveform Xc). The mean time to contact the xylem (Xc) and initiate ingestion (Xi) after onset of the first probe was 27.8 and 34.2 min, respectively. However, sustained xylem ingestion (Xi > 5 min) was established after 39.8 min, on average. This information is basic for future studies on the transmission mechanisms of X. fastidiosa and in order to establish control strategies aimed at interfering with this process.

Vector within-host feeding preference mediates transmission of a heterogeneously distributed pathogen

2. We documented the within-host distribution of two vector species that differ in transmission efficiency, the leafhoppers Draeculacephala minerva and Graphocephala atropunctata, and which are free to move throughout entirely caged alfalfa plants. The more efficient vector D. minerva fed preferentially at the base of the plant near the soil surface, whereas the less efficient G. atropunctata preferred overwhelming the top of the plant. 3. Next we documented X. fastidiosa heterogeneity in mechanically inoculated plants. Infection rates were up to 50% higher and mean bacterial population densities were 100-fold higher near the plant base than at the top or in the taproot. 4. Finally, we estimated transmission efficiency of the two leafhoppers when they were confined at either the base or top of inoculated alfalfa plants. Both vectors were inefficient when confined at the top of infected plants and were 20-60% more efficient when confined at the plant base. 5. These results show that vector transmission efficiency is determined by the interaction between leafhopper within-plant feeding behaviour and pathogen within-plant distribution. Fine-scale vector and pathogen overlap is likely to be a requirement generally for efficient transmission of vector-borne pathogens.

Endophytic population of Pantoea agglomerans in citrus plants and development of a cloning vector for endophytes

Harmless bacteria inhabiting inner plant tissues are termed endophytes. Population fluctuations in the endophytic bacterium Pantoea agglomerans associated with two species of field cultured citrus plants were monitored over a two-year period. The results demonstrated that populations of P. agglomerans fluctuated in Citrus reticulata but not C. sinensis. A cryptic plasmid pPA3.0 (2.9 kb) was identified in 35 out of 44 endophytic isolates of P. agglomerans and was subsequently sequenced. The origins of replication were identified and nine out of 18 open reading frames (ORFs) revealed homology with described proteins. Notably, two ORFs were related to cellular transport systems and plasmid maintenance. Plasmid pPA3.0 was cloned and the gfp gene inserted to generate the pPAGFP vector. The vector was introduced into P. agglomerans isolates and revealed stability was dependent on the isolate genotype, ninety-percent stability values were reached after 60 hours of bacterial cultivation in most evaluated isolates. In order to definitively establish P. agglomerans as an endophyte, the non-transformed bacterium was reintroduced into in vitro cultivated seedlings and the density of inner tissue colonization in inoculated plants was estimated by bacterium re-isolation, while the tissue niches preferred by the bacterium were investigated by scanning electronic microscopy (SEM). Cells from P. agglomerans (strain ARB18) at similar densities were re-isolated from roots, stems and leaves and colonization of parenchyma and xylem tissues were observed. Data suggested that P. agglomerans is a ubiquitous citrus endophyte harboring cryptic plasmids. These characteristics suggest the potential to use the bacterium as a vehicle to introduce new genes in host plants via endophytic bacterial transformation.

CO(2) from Alcoholic Fermentation for Continuous Cultivation of Arthrospira (Spirulina) platensis in Tubular Photobioreactor Using Urea as Nitrogen Source

Carbon dioxide released from alcoholic fermentation accounts for 33% of the whole CO(2) involved in the use of ethanol as fuel derived from glucose. As Arthrospira platensis can uptake this greenhouse gas, this study evaluates the use of the CO(2) released from alcoholic fermentation for the production of Arthrospira platensis. For this purpose, this cyanobacterium was cultivated in continuous process using urea as nitrogen source, either using CO(2) from alcoholic fermentation, without any treatment, or using pure CO(2) from cylinder. The experiments were carried out at 120 mu mol photons m(-2) s(-1) in tubular photobioreactor at different dilution rates (0.2 <= D <= 0.8 d(-1)). Using CO(2) from alcoholic fermentation, maximum steady-state cell concentration (2661 +/- 71 mg L(-1)) was achieved at D 0.2 d(-1), whereas higher dilution rate (0.6 d(-1)) was needed to maximize cell productivity (839 mg L(-1) d(-1)). This value was 10% lower than the one obtained with pure CO(2), and there was no significant difference in the biomass protein content. With D 0.8 d(-1), it was possible to obtain 56% +/- 1.5% and 50% +/- 1.2% of protein in the dry biomass, using pure CO(2) and CO(2) from alcoholic fermentation, respectively. These results demonstrate that the use of such cost free CO(2) from alcoholic fermentation as carbon source, associated with low cost nitrogen source, may be a promising way to reduce costs of continuous cultivation of photosynthetic microorganisms, contributing at the same time to mitigate the greenhouse effect. (C) 2011 American Institute of Chemical Engineers Biotechnol. Prog., 27: 650-656, 2011

Extraction of Ascorbate Oxidase from Cucurbita maxima by Continuous Process in Perforated Rotating Disc Contactor Using Aqueous Two-Phase Systems

The ascorbate oxidase is the enzyme used to determine the content of ascorbic acid in the pharmaceutical and food industries and clinics analyses. The techniques currently used for the purification of this enzyme raise its production cost. Thus, the development of alternative processes and with the potential to reduce costs is interesting. The application of aqueous two-phase system is proposed as an alternative to purification because it enables good separation of biomolecules. The objective of this study was to determine the conditions to continuously pre-purify the enzyme ascorbate oxidase by an aqueous two-phase system (PEG/citrate) using rotating column provided with perforated discs. Under the best conditions (20,000 g/mol PEG molar mass, 10% PEG concentration, and 25% citrate concentration), the system showed satisfactory results (partition coefficient, 3.35; separation efficiency, 54.98%; and purification factor, 1.46) and proved suitable for the pre-purification of ascorbate oxidase in continuous process.

Continuous extraction of alpha-toxin from a fermented broth of Clostridium perfringens Type A in perforated rotating disc contactor using aqueous two-phase PEG-phosphate system

A 2(3-1) factorial experimental design was used to evaluate the performance of a perforated rotating disc contactor to extract alpha-toxin from the fermented broth of Clostridium perfringens Type A by aqueous two-phase system of polyethylene glycol-phosphate salts. The influence of three independent variables, specifically the dispersed phase flowrate, the continuous phase flowrate and the disc rotational speed, was investigated on the hold up, the mass transfer coefficient, the separation efficiency and the purification factor, taken as the response variables. The optimum dispersed phase flowrate was 3.0 mL/min for all these responses. Besides, maximum values of hold up (0.80), separation efficiency (0. 10) and purification factor (2.4) were obtained at this flowrate using the lowest disc rotational speed (35 rpm), while the optimum mass transfer coefficient (0. 165 h(-1)) was achieved at the highest agitation level (140 rpm). The results of this study demonstrated that the dispersed phase flowrate strongly influenced the performance of PRDC, in that both the mass transfer coefficient and hold up increased with this parameter. (c) 2007 Elsevier B. V. All rights reserved.

Use of virtual screening, flexible docking, and molecular interaction fields to design novel HMG-CoA reductase inhibitors for the treatment of hypercholesterolemia

Dietary changes associated with drug therapy can reduce high serum cholesterol levels and dramatically decrease the risk of coronary artery disease, stroke, and overall mortality. Statins are hypolipemic drugs that are effective in the reduction of cholesterol serum levels, attenuating cholesterol synthesis in liver by competitive inhibition regarding the substrate or molecular target HMG-CoA reductase. We have herewith used computer-aided molecular design tools, i.e., flexible docking, virtual screening in large data bases, molecular interaction fields to propose novel potential HMG-CoA reductase inhibitors that are promising for the treatment of hypercholesterolemia.

Simulations of Bose fields at finite temperature

We introduce a time-dependent projected Gross-Pitaevskii equation to describe a partially condensed homogeneous Bose gas, and find that this equation will evolve randomized initial wave functions to equilibrium. We compare our numerical data to the predictions of a gapless, second order theory of Bose-Einstein condensation [S. A. Morgan, J. Phys. B 33, 3847 (2000)], and find that we can determine a temperature when the theory is valid. As the Gross-Pitaevskii equation is nonperturbative, we expect that it can describe the correct thermal behavior of a Bose gas as long as all relevant modes are highly occupied. Our method could be applied to other boson fields.

Modifying insect population age structure to control vector-borne disease

Age is a critical determinant of the ability of most arthropod vectors to transmit a range of human pathogens. This is due to the fact that most pathogens require a period of extrinsic incubation in the arthropod host before pathogen transmission can occur. This developmental period for the pathogen often comprises a significant proportion of the expected lifespan of the vector. As such, only a small proportion of the population that is oldest contributes to pathogen transmission. Given this, strategies that target vector age would be expected to obtain the most significant reductions in the capacity of a vector population to transmit disease. The recent identification of biological agents that shorten vector lifespan, such as Wolbachia, entomopathogenic fungi and densoviruses, offer new tools for the control of vector-borne diseases. Evaluation of the efficacy of these strategies under field conditions will be possible due to recent advances in insect age-grading techniques. Implementation of all of these strategies will require extensive field evaluation and consideration of the selective pressures that reductions in vector longevity may induce on both vector and pathogen.

Evidence of a spotted fever-like rickettsia and a potential new vector from northeastern Australia

A spotted fever-like rickettsia was identified in a Hemaphysalis tick by polymerase chain reaction (PCR) amplification and sequencing of the 16S rDNA, ompA, and ompB genes. A comparison of these nucleotide sequences with those of other spotted fever group (SFG) rickettsiae revealed that the Hemaphysalis tick rickettsia was distinct from other previously reported strains. Phylogenetic analysis based on both ompA and ompB also indicates that the strain’s closest relatives are the agents of Thai tick typhus (Rickettsia honei strain TT-118) and Flinders Island spotted fever (R. honei). This study represents the first report of an R. honei-like agent from a Hemaphysalis tick in Australia and of a spotted fever group rickettsia from Cape York Peninsula, Queensland.

Field prevalence of Wolbachia in the mosquito vector Aedes albopictus

The endosymbiotic bacteria in the genus Wolbachia have been proposed as a potential candidate to deliver pathogen-blocking genes into natural populations of medically important insects. The successful application of Wolbachia in insect vector control depends on the ability of the agent to successfully invade and maintain itself at high frequency under field conditions. Here, we evaluated the prevalence of Wolbachia infections in a field population of the Wolbachia-superinfected mosquito Aedes albopictus. A field prevalence of 100% (n = 1,016) was found in a single population in eastern Thailand via polymerase chain reaction (PCR) testing of Wolbachia both from individual parent females and their corresponding F1 offspring. This is the first report of accurate Wolbachia prevalence in a field population of an insect disease vector. The prevalence of superinfection was estimated to be 99.41%. All single-infected individual mosquitoes (n = 6) were found to harbor group A Wolbachia. For this particular population, none was found to be single-infected with group B Wolbachia. Our results also show that PCR testing of field materials alone without checking F1 offspring overestimated the natural prevalence of single infection. Thus, the confirmation of infection status by means of F1 offspring was critical to the accurate estimates of Wolbachia prevalence under field conditions.