The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.

THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.

Hardware/firmware implementation of a soft sensor using an improved version of a fuzzy identification algorithm

This paper presents the design and implementation of an embedded soft sensor, i. e., a generic and autonomous hardware module, which can be applied to many complex plants, wherein a certain variable cannot be directly measured. It is implemented based on a fuzzy identification algorithm called ""Limited Rules"", employed to model continuous nonlinear processes. The fuzzy model has a Takagi-Sugeno-Kang structure and the premise parameters are defined based on the Fuzzy C-Means (FCM) clustering algorithm. The firmware contains the soft sensor and it runs online, estimating the target variable from other available variables. Tests have been performed using a simulated pH neutralization plant. The results of the embedded soft sensor have been considered satisfactory. A complete embedded inferential control system is also presented, including a soft sensor and a PID controller. (c) 2007, ISA. Published by Elsevier Ltd. All rights reserved.

Comparing lock-in ranges and transient responses of second- and third-order phase-locked loops in master-slave clock distribution networks

The distribution of clock signals throughout the nodes of a network is essential for several applications. in control and communication with the phase-locked loop (PLL) being the component for electronic synchronization process. In systems with master-slave (MS) strategies, the PLLs are the slave nodes responsible for providing reliable clocks in all nodes of the network. As PLLs have nonlinear phase detection, double-frequency terms appear and filtering becomes necessary. Imperfections in filtering process cause oscillations around the synchronous state worsening the performance of the clock distribution process. The behavior of one-way master-slave (OWMS) clock distribution networks is studied and performances of first- and second-order filter processes are compared, concerning lock-in ranges and responses to perturbations of the synchronous state. (c) 2007 Elsevier GmbH. All rights reserved.

A calibration approach based on Takagi-Sugeno fuzzy inference system for digital electronic compasses

Recently, the development of industrial processes brought on the outbreak of technologically complex systems. This development generated the necessity of research relative to the mathematical techniques that have the capacity to deal with project complexities and validation. Fuzzy models have been receiving particular attention in the area of nonlinear systems identification and analysis due to it is capacity to approximate nonlinear behavior and deal with uncertainty. A fuzzy rule-based model suitable for the approximation of many systems and functions is the Takagi-Sugeno (TS) fuzzy model. IS fuzzy models are nonlinear systems described by a set of if then rules which gives local linear representations of an underlying system. Such models can approximate a wide class of nonlinear systems. In this paper a performance analysis of a system based on IS fuzzy inference system for the calibration of electronic compass devices is considered. The contribution of the evaluated IS fuzzy inference system is to reduce the error obtained in data acquisition from a digital electronic compass. For the reliable operation of the TS fuzzy inference system, adequate error measurements must be taken. The error noise must be filtered before the application of the IS fuzzy inference system. The proposed method demonstrated an effectiveness of 57% at reducing the total error based on considered tests. (C) 2011 Elsevier Ltd. All rights reserved.

A new approach to heart valve tissue engineering: mimicking the heart ventricle with a ventricular assist device in a novel bioreactor

The `biomimetic` approach to tissue engineering usually involves the use of a bioreactor mimicking physiological parameters whilst supplying nutrients to the developing tissue. Here we present a new heart valve bioreactor, having as its centrepiece a ventricular assist device (VAD), which exposes the cell-scaffold constructs to a wider array of mechanical forces. The pump of the VAD has two chambers: a blood and a pneumatic chamber, separated by an elastic membrane. Pulsatile air-pressure is generated by a piston-type actuator and delivered to the pneumatic chamber, ejecting the fluid in the blood chamber. Subsequently, applied vacuum to the pneumatic chamber causes the blood chamber to fill. A mechanical heart valve was placed in the VAD`s inflow position. The tissue engineered (TE) valve was placed in the outflow position. The VAD was coupled in series with a Windkessel compliance chamber, variable throttle and reservoir, connected by silicone tubings. The reservoir sat on an elevated platform, allowing adjustment of ventricular preload between 0 and 11 mmHg. To allow for sterile gaseous exchange between the circuit interior and exterior, a 0.2 mu m filter was placed at the reservoir. Pressure and flow were registered downstream of the TE valve. The circuit was filled with culture medium and fitted in a standard 5% CO(2) incubator set at 37 degrees C. Pressure and flow waveforms were similar to those obtained under physiological conditions for the pulmonary circulation. The `cardiomimetic` approach presented here represents a new perspective to conventional biomimetic approaches in TE, with potential advantages. Copyright (C) 2010 John Wiley & Sons, Ltd.

Isolation and analysis of bioactive isoflavonoids and chalcone from a new type of Brazilian propolis

Activity-directed fractionation and purification processes were employed to identify isoflavonoids with antioxidant and antimicrobial activities from Brazilian red propolis. Crude propolis was extracted with ethanol (80%. v/v) and fractioned by liquid-liquid extraction technique using hexane and chloroform. Since chloroform fraction showed strong antioxidant and antimicrobial activities it was purified and isolated using various chromatographic techniques. Comparing our spectral data (UV, NMR, and mass spectrometry) with values found in the literature, we identified two bioactive isoflavonoids (vestitol and neovestitol), together with one chalcone (isoliquiritigenin). Vestitol presented higher antioxidant activity against beta-carotene consumption than neovestitol. The antimicrobial activity of these three compounds against Staphylococcus aureus, Streptococcus mutans, and Actinomyces naeslundii was evaluated and we concluded that isoliquiritigenin was the most active one with lower MIC, ranging from 15.6 to 62.5 mu g/mL. Our results showed that Brazilian red propolis has biologically active isoflavonoids that may be used as a mild antioxidant and antimicrobial for food preservation. (C) 2010 Elsevier B.V. All rights reserved.

SELF-SIMILARITY AND LAMPERTI CONVERGENCE FOR FAMILIES OF STOCHASTIC PROCESSES

We define a new type of self-similarity for one-parameter families of stochastic processes, which applies to certain important families of processes that are not self-similar in the conventional sense. This includes Hougaard Levy processes such as the Poisson processes, Brownian motions with drift and the inverse Gaussian processes, and some new fractional Hougaard motions defined as moving averages of Hougaard Levy process. Such families have many properties in common with ordinary self-similar processes, including the form of their covariance functions, and the fact that they appear as limits in a Lamperti-type limit theorem for families of stochastic processes.

Alterations in energy properties of eucalyptus wood and bark subjected to torrefaction: The potential of mass loss as a synthetic indicator

Torrefaction is a mild pyrolysis process (usually up to 300 degrees C) that changes the chemical and physical properties of biomass. This process is a possible pre-treatment prior to further processes (transport, grinding, combustion, gasification, etc) to generate energy or biofuels. In this study, three eucalyptus wood species and bark were subjected to different torrefaction conditions to determine the alterations in their structural and energy properties. The most severe treatment (280 degrees C, 5 h) causes mass losses of more than 35%, with severe damage to anatomical structure, and an increase of about 27% in the specific energy content. Bark is more sensitive to heat than wood. Energy yields are always higher than mass yields, thereby demonstrating the benefits of torrefaction in concentrating biomass energy. The overall mass loss is proposed as a relevant parameter to synthesize the effect of torrefaction conditions (temperature and duration). Accordingly, all results are summarised by analytical expressions able to predict the energy properties as a function of the overall mass loss. These expressions are intended to be used in any optimization procedure, from production in the field to the final use. (c) 2010 Elsevier Ltd. All rights reserved.

Deciphering the weathering processes using environmental mineralogy and geochemistry: Towards an integrated model of laterite and podzol genesis in the Upper Amazon Basin

This article reports major results from collaborative research between France and Brazil on soil and water systems, carried out in the Upper Amazon Basin. It reveals the weathering processes acting in the partly inundated, low elevation plateaus of the Basin, mostly covered by evergreen forest. Our findings are based on geochemical data and mineral spectroscopy that probe the crystal chemistry of Fe and Al in mineral phases (mainly kaolinite, Al- and Fe-(hydr)oxides) of tropical soils (laterites). These techniques reveal crystal alterations in mineral populations of different ages and changes of metal speciation associated with mineral or organic phases. These results provide an integrated model of soil formation and changes (from laterites to podzols) in distinct hydrological compartments of the Amazon landscapes and under altered water regimes. (C) 2010 Academie des sciences. Published by Elsevier Masson SAS. All rights reserved.

A Validated Reverse-phase HPLC Analytical Method for the Quantification of Phenolic Compounds in Baccharis dracunculifolia

Introduction - Baccharis dracunculifolia, which has great potential for the development of new phytotherapeutic medicines, is the most important botanical source of the southeastern Brazilian propolis, known as green propolis on account of its color. Objective - To develop a reliable reverse-phase HPLC chromatographic method for the analysis of phenolic compounds in both B. dracunculifolia raw material and its hydroalcoholic extracts. Methodology - The method utilised a C(18) CLC-ODS (M) (4.6 x 250 mm) column with nonlinear gradient elution and UV detection at 280 nm. A procedure for the extraction of phenolic compounds using aqueous ethanol 90%, with the addition of veratraldehyde as the internal standard, was developed allowing the quantification of 10 compounds: caffeic acid, coumaric acid, ferulic acid, cinnamic acid, aromadendrin-4`-methyl ether, isosakuranetin, drupanin, artepillin C, baccharin and 2,2-dimethyl-6-carboxyethenyl-2H-1-benzopyran acid. Results - The developed method gave a good detection response with linearity in the range 20.83-800 mu g/mL and recovery in the range 81.25-93.20%, allowing the quantification of the analysed standards. Conclusion - The method presented good results for the following parameters: selectivity, linearity, accuracy, precision, robustness, as well as limit of detection and limit of quantitation. Therefore, this method could be considered as an analytical tool for the quality control of B. dracunculifolia raw material and its products in both cosmetic and pharmaceutical companies. Copyright (C) 2008 John Wiley & Sons, Ltd.

A new approach to the granulation of beta-cyclodextrin inclusion complexes

Cyclodextrins (CDs) are annular oligosaccharides containing 6-12 glucose unities joined together by alpha-1,4 bonds. They have a conical-truncated shape with a lipophilic cavity in which different molecules can be included resulting in a stable inclusion complex. The cyclodextrins have been widely applied in pharmaceutical technology with the objective of increasing the solubility, stability and bioavailability of drugs in different pharmaceutical dosage forms, such as tablets. In order to obtain beta-CD tablets, liquid dispersions of drug/beta-CD are usually submitted to different drying processes, like spray-drying, freeze-drying or slow evaporation, being this dry material added to a number of excipients. However, such drying processes can generate particulate materials showing problems of flow and compressibility, needing their conversion into granulates by means of wetting with granulation liquid followed by additional drying. In this work, the main objective was to evaluate the preparation of tablets without the need of this additional drying step. For this purpose an aqueous dispersion containing acetaminophen/beta-CD complex and cornstarch was dried using a spouted bed and the obtained granules were compressed in tablets. Acetaminophen was used as model drug due to its low water solubility and the inexpensive and widely available cornstarch was chosen as excipient. Acetaminophen powder was added into a beta-cyclodextrin solution prepared in distilled water at 70 degrees C. Stirring was kept until this dispersion cooled to room temperature. Then cornstarch was added and the resulting dispersion was dried in spouted bed equipment. This material was compressed into tablets using an Erweka Korsh EKO tablet machine. This innovative approach allowed the tablets preparation process to be carried out with fewer steps and represents a technological reliable strategy to produce beta-cyclodextrin inclusion complexes tablets. (C) 2010 Elsevier By. All rights reserved.

Nuclear Quadrupole Resonance: A Technique to Control Hydration Processes in the Pharmaceutical Industry

Pharmaceuticals can exist in many solid forms, which can have different physical and chemical properties. These solid forms include polymorphs, solvates, amorphous, and hydrates. Particularly, hydration process can be quite common since pharmaceutical solids can be in contact with water during manufacturing process and can also be exposed to water during storage. In the present work, it is proved that NQR technique is capable of detecting different hydrated forms not only in the pure raw material but also in the final product (tablets), being in this way a useful technique for quality control. This technique was also used to study the dehydration process from pentahydrate to trihydrate.

Using multidimensional projection techniques for reaching a high distinguishing ability in biosensing

Recent advances in the control of molecular engineering architectures have allowed unprecedented ability of molecular recognition in biosensing, with a promising impact for clinical diagnosis and environment control. The availability of large amounts of data from electrical, optical, or electrochemical measurements requires, however, sophisticated data treatment in order to optimize sensing performance. In this study, we show how an information visualization system based on projections, referred to as Projection Explorer (PEx), can be used to achieve high performance for biosensors made with nanostructured films containing immobilized antigens. As a proof of concept, various visualizations were obtained with impedance spectroscopy data from an array of sensors whose electrical response could be specific toward a given antibody (analyte) owing to molecular recognition processes. In addition to discussing the distinct methods for projection and normalization of the data, we demonstrate that an excellent distinction can be made between real samples tested positive for Chagas disease and Leishmaniasis, which could not be achieved with conventional statistical methods. Such high performance probably arose from the possibility of treating the data in the whole frequency range. Through a systematic analysis, it was inferred that Sammon`s mapping with standardization to normalize the data gives the best results, where distinction could be made of blood serum samples containing 10(-7) mg/mL of the antibody. The method inherent in PEx and the procedures for analyzing the impedance data are entirely generic and can be extended to optimize any type of sensor or biosensor.