The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.

THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

On the Filtering Problem for Continuous-Time Markov Jump Linear Systems with no Observation of the Markov Chain

We consider in this paper the optimal stationary dynamic linear filtering problem for continuous-time linear systems subject to Markovian jumps in the parameters (LSMJP) and additive noise (Wiener process). It is assumed that only an output of the system is available and therefore the values of the jump parameter are not accessible. It is a well known fact that in this setting the optimal nonlinear filter is infinite dimensional, which makes the linear filtering a natural numerically, treatable choice. The goal is to design a dynamic linear filter such that the closed loop system is mean square stable and minimizes the stationary expected value of the mean square estimation error. It is shown that an explicit analytical solution to this optimal filtering problem is obtained from the stationary solution associated to a certain Riccati equation. It is also shown that the problem can be formulated using a linear matrix inequalities (LMI) approach, which can be extended to consider convex polytopic uncertainties on the parameters of the possible modes of operation of the system and on the transition rate matrix of the Markov process. As far as the authors are aware of this is the first time that this stationary filtering problem (exact and robust versions) for LSMJP with no knowledge of the Markov jump parameters is considered in the literature. Finally, we illustrate the results with an example.

Postural control during kneeling

Postural control was studied when the subject was kneeling with erect trunk in a quiet posture and compared to that obtained during quiet standing. The analysis was based on the center of pressure motion in the sagittal plane (CPx), both in the time and in the frequency domains. One could assume that postural control during kneeling would be poorer than in standing because it is a less natural posture. This could cause a higher CPx variability. The power spectral density (PSD) of the CPx obtained from the experimental data in the kneeling position (KN) showed a significant decrease at frequencies below 0.3 Hz compared to upright (UP) (P < 0.01), which indicates less sway in KN. Conversely, there was an increase in fast postural oscillations (above 0.7 Hz) during KN compared to UP (P < 0.05). The root mean square (RMS) of the CPx was higher for UP (P < 0.01) while the mean velocity (MV) was higher during KN (P < 0.05). Lack of vision had a significant effect on the PSD and the parameters estimated from the CPx in both positions. We also sought to verify whether the changes in the PSD of the CPx found between the UP and KN positions were exclusively due to biomechanical factors (e.g., lowered center of gravity), or also reflected changes in the neural processes involved in the control of balance. To reach this goal, besides the experimental approach, a simple feedback model (a PID neural system, with added neural noise and controlling an inverted pendulum) was used to simulate postural sway in both conditions (in KN the pendulum was shortened, the mass and the moment of inertia were decreased). A parameter optimization method was used to fit the CPx power spectrum given by the model to that obtained experimentally. The results indicated that the changed anthropometric parameters in KN would indeed cause a large decrease in the power spectrum at low frequencies. However, the model fitting also showed that there were considerable changes also in the neural subsystem when the subject went from standing to kneeling. There was a lowering of the proportional and derivative gains and an increase in the neural noise power. Additional increases in the neural noise power were found also when the subject closed his eyes.

Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.

Characterisation of electric arc furnace dust generated during plain carbon steel production

Electric arc furnace (EAF) dust is a waste generated in the EAF during the steel production process. Among different wastes, EAF dust represents one of the most hazardous, since it contains heavy metals such as Zn, Fe, Cr, Cd and Pb. The goal of the present work is to characterise the waste through chemical analysis, particle size distribution, X-ray diffraction (XRD), scanning electron microscopy coupled with energy dispersive spectroscopy detection and thermal analysis. The waste sample is composed essentially of spherical particles and has a very small particle size and the majority of the identified elements were Fe, Zn, Ca, Cr, Mn, K and Si. The XRD has presented compounds such as ZnO, ZnFe2O4, Fe2O3, MnO, SiO2, FeFe2O4 and MnAl2O4. According to the thermal analysis results, up to 1000 degrees C the total weight loss was similar to 5%. The results of waste characterisation are very important to these further investigations.

A new technique to control brushless motor for blood pump application

This article presents a back-electromotive force (BEMF)-based technique of detection for sensorless brushless direct current motor (BLDCM) drivers. The BLDCM has been chosen as the energy converter in rotary or pulsatile blood pumps that use electrical motors for pumping. However, in order to operate properly, the BLDCM driver needs to know the shaft position. Usually, that information is obtained through a set of Hall sensors assembled close to the rotor and connected to the electronic controller by wires. Sometimes, a large distance between the motor and controller makes the system susceptible to interference on the sensor signal because of winding current switching. Thus, the goal of the sensorless technique presented in this study is to avoid this problem. First, the operation of BLDCM was evaluated on the electronic simulator PSpice. Then, a BEMF detector circuitry was assembled in our laboratories. For the tests, a sensor-dependent system was assembled where the direct comparison between the Hall sensors signals and the detected signals was performed. The obtained results showed that the output sensorless detector signals are very similar to the Hall signals at speeds of more than 2500 rpm. Therefore, the sensorless technique is recommended as a responsible or redundant system to be used in rotary blood pumps.

Optimized harvest scheduling in eucalyptus plantations under operational, spatial and climatic constraints

The representation of sustainability concerns in industrial forests management plans, in relation to environmental, social and economic aspects, involve a great amount of details when analyzing and understanding the interaction among these aspects to reduce possible future impacts. At the tactical and operational planning levels, methods based on generic assumptions usually provide non-realistic solutions, impairing the decision making process. This study is aimed at improving current operational harvesting planning techniques, through the development of a mixed integer goal programming model. This allows the evaluation of different scenarios, subject to environmental and supply constraints, increase of operational capacity, and the spatial consequences of dispatching harvest crews to certain distances over the evaluation period. As a result, a set of performance indicators was selected to evaluate all optimal solutions provided to different possible scenarios and combinations of these scenarios, and to compare these outcomes with the real results observed by the mill in the study case area. Results showed that it is possible to elaborate a linear programming model that adequately represents harvesting limitations, production aspects and environmental and supply constraints. The comparison involving the evaluated scenarios and the real observed results showed the advantage of using more holistic approaches and that it is possible to improve the quality of the planning recommendations using linear programming techniques.

Effectiveness of two systems for the spraying of pesticides in citrus trees

Citriculture normally uses high application volumes in pesticide solutions (of 2.000 to 5.000 L ha(-1)) to control pests and diseases that affect the crop, which generates an increase in operational costs. For this reason, diverse systems of application are being developed to reduce application volumes and improve the uniformity of pesticide deposition. The goal of this work was to evaluate the efficiency of two application systems of pesticides in citrus trees. One system used a prototype for terrestrial application with rotary disc atomizers that are widely used in agricultural aviation, and the other system used hollow cone tip hydraulics. For the treatment of the trees the insecticide Metidation was used at the dose of 180 gr per hectare. To study the droplet spectrum, water-sensitive papers were installed at different positions in the trees canopy, and for the study of insecticide deposition leaves of the treated plants were collected. The water-sensitive papers were collected and analyzed using a computerized image analysis system (e-Sprinkle, EMBRAPA, Sao Paulo, Brazil), and the leaves analyzed by the technique of gas chromatography. Pesticide deposition was similar in both application system, although the solution volume used by the application system equipped with rotary disc atomizers was one quarter of the volume used by the application system equipped with hydraulic tips, reducing considerably the cost of the phytosanitary treatments.

The impact of El Nino Southern Oscillation phases on off-season maize yield for a subtropical region of Brazil

In recent years, maize has become one of the main alternative crops for the autumn winter growing season in the central-western and southeastern regions of Brazil. However, water deficits, sub-optimal temperatures and low solar radiation levels are common problems that are experienced during this growing season by local farmers. One methodology to assess the impact of variable weather conditions on crop production is the use of crop simulation models. The goal of this study was to evaluate the effect of climate variability on maize yield for a subtropical region of Brazil. Specific objectives for this study were (1) to analyse the effect of El Nino Southern Oscillation (ENSO) on precipitation and air temperature for four locations in the state of Sao Paulo and (2) to analyse the impact of ENSO on maize grown off-season for the same four locations using a crop simulation model. For each site, historical weather data were categorised as belonging to one of three phases of ENSO: El Nino (warm sea surface temperature anomalies in the Pacific), La Nina (cool sea surface temperature anomalies) or neutral, based on an index derived from observed sea surface temperature anomalies. During El Nino, there is a tendency for an increase in the rainfall amount during May for the four selected locations, and also during April, mainly in three of the locations, resulting in an increase in simulated maize yield planted between February 15 and March 15. In general, there was a decrease in the simulated yield for maize grown off-season during neutral years. This study showed how a crop model can be used to assess the impact of climate variability on the yield of maize grown off-season in a subtropical region of Brazil. The outcomes of this study can be very useful for both policy makers and local farmers for agricultural planning and decision making. Copyright (C) 2009 Royal Meteorological Society

Inheritance of resistance to Puccinia psidii G. Winter in a eucalyptus interspecific hybrid progeny evaluated under conditions of natural infection

Inheritance of resistance to Puccinia psidii G. Winter in a eucalyptus interspecific hybrid progeny evaluated under conditions of natural infection Rust caused by the fungus Puccinia psidii is currently the most important disease of eucalyptus. It is widely disseminated in Brazil, and causes serious damage in nurseries and plantation areas. The identification of resistant germplasm along with knowledge of the genetic basis of resistance heredity are the first requirements for the success of breeding programs aiming to develop resistant varieties. Earlier studies carried out under controlled conditions suggested a monogenic control as well as the participation of at least two genes promoting resistance to rust. The goal of this study was to evaluate the resistance to P. psidii under field conditions in fourteen progenies from controlled crosses and self-crosses among four hybrid clones of Eucalyptus grandis Hill ex Maiden x Eucalyptus urophylla ST Blake that contrast for resistance to the fungus. Results indicated that resistance could be explained by one locus with main effects and at least three different alleles. However, loci with minor effects may influence the resistance, since variation on severity classes was observed. Differences in segregation of resistance between reciprocal crosses were not observed, indicating absence of cytoplasmic effects.

Histological, physiological and molecular investigations of Fagus sylvatica seedlings infected with Phytophthora citricola

P>The aim of the work was to shed light into histological, physiological and molecular changes of Fagus sylvatica seedlings infected with the root pathogen Phytophthora citricola with the final goal to distinguish between local and systemic responses. Real-time quantitative PCR analysis proved that P. citricola was able to grow from infected roots into hypocotyl and epicotyl tissue of F. sylvatica seedlings. Light microscopy showed many collapsed parenchyma cells of the cortex without being penetrated by the pathogen. Hyphae were mainly growing intracellular in parenchyma and xylem tissue. Transmission electron microscopy displayed disintegration of xylem vessels and of parenchyma cells. Inhibition of water uptake of infected beech seedlings was positively correlated with the concentration of zoospores used in the experiment. In addition, a split root experiment indicated that invertases were possibly involved locally and systemically in the conversion of sucrose of P. citricola infected roots. During the growth of the pathogen in roots, a transient expression of the 1-aminocyclopropane-1-carboxylic acid (ACC)-oxidase gene was quantified in leaves which was detected in parallel with the first peak of a biphasic ethylene outburst. Additionally a systemic upregulation of aquaporin transcripts was mainly detected in leaves of beech seedlings infected with P. citricola.

Evaluation of citrus somatic hybrids for tolerance to Phytophthora nicotianae and citrus tristeza virus

Somatic hybridization is a biotechnology tool that can be used in citrus breeding programs to produce somatic hybrids with the complete genetic combination of both parents. The goal of this work was to test the reaction of citrus somatic hybrids that may be useful as rootstocks to trunk and root infections caused by Phytophthora nicotianae van Breda de Haan (P parasitica Dastur) and to citrus tristeza virus (CTV). The somatic hybrids evaluated were `Caipira` sweet orange (Citrus sinensis L. Osbeck) + `Rangpur` lime (C. limonia Osbeck), `Caipira` sweet orange + `Cleopatra` mandarin (C. reshni hort. ex Tanaka), `Caipira` sweet orange + `Volkamer` lemon (C. volkameriana V Ten. & Pasq.), `Caipira` sweet orange + rough lemon (C. jambhiri Lush.), `Cleopatra` mandarin + `Volkamer` lemon, `Cleopatra` mandarin + sour orange (C. aurantium L.), `Rangpur` lime + `Sunki` mandarin (C. sunki (Hayata) hort. ex Tanaka), `Ruby Blood` sweet orange (C. sinensis L. Osbeck) + `Volkamer` lemon, `Rohde Red` sweet orange (C. sinensis L. Osbeck) + `Volkamer` lemon, and `Valencia` sweet orange + Fortunella obovata hort. ex Tanaka. For P. nicotianae trunk and root infection assays, plants of the somatic hybrids, obtained from 9-month semi-hardwood cuttings, were evaluated and compared with diploid citrus rootstock cultivars after mycelia inoculation in the trunk or spore infestation in the substrate, respectively. `Cleopatra` mandarin + sour orange, `Rangpur` lime + `Sunki` mandarin, `Cleopatra` mandarin + `Volkamer` lemon, `Ruby Blood` sweet orange + `Volkamer` lemon, `Rohde Red` sweet orange + `Volkamer` lemon, and `Caipira` sweet orange + `Volkamer` lemon had less trunk rot occurrence, whereas the somatic hybrids `Cleopatra` mandarin + `Volkamer` lemon, `Cleopatra` mandarin + sour orange, `Caipira` sweet orange + `Volkamer` lemon, and `Caipira` sweet orange + `Rangpur` lime were tolerant to root rot. For CTV assays, plants of the somatic hybrids along with tolerant and intolerant rootstocks were budded with a mild strain CTV-infected or healthy `Valencia` sweet orange budwood. Differences in average scion shoot length indicated that the hybrids `Cleopatra` mandarin + sour orange and `Valencia` sweet orange + Fortunella obovata were intolerant to CTV (c) 2007 Elsevier B.V. All rights reserved.

Digestibility of plant protein-based diets by largemouth bass Micropterus salmoides

Commercial farming of carnivorous fish demands the reduction of environmental impact of feeds; that requires minimal use of dietary animal protein. This study investigated the digestibility of diets formulated exclusively out of plant protein, added feed attractants, by the carnivore largemouth bass, Micropterus salmoides. Juvenile largemouth bass (14.0 +/- 1.0 cm) conditioned to accept artificial, dry feed were confined in polypropylene cages and fed ad libitum in three daily meals, seven experimental diets containing varying levels of vegetable and animal protein sources, added of different feed stimulants. After last daily meal, cages were transferred to cylindrical-conical-bottomed, 200-L aquaria, where faeces were collected by sedimentation into refrigerated containers, preserved and later analysed for chemical composition. Soybean meal can be used as partial substitute of animal protein in diets for largemouth bass; the poultry by-product meal shows as a good option as animal protein source in these rations. Control treatment - 50PP : 50AP - yielded best performances; the need for the use of fish meal in the formulation for carnivorous diets is, at least, questionable. Results of the digestibility trials demonstrated the importance of determining the diet digestibility, if precision in the formulation of least-cost feeds for carnivorous fish is the ultimate goal.

Production of finger millet (Eleusine coracana (L.) Gaertn.) dry matter under anticipated fertilization of soybeans

Due to the lack of information about the effects of soybean fertilization anticipation and the use of Eleusine coracana (L.) Gaerm. (ANSB Pe-de-galinha 5352) as cover culture, and the need for new techniques for the management of the agro-ecosystem in a more conservationist, sustainable and functional manner the goal of this research was to study the effects of anticipated fertilization on the production of dry matter in E. coracana. The experiments were carried out in an Oxisol, during the growing seasons of 200112002, 200212003 and 200312004, in Piracicaba, SP Brazil (22`50`25""S and 48`01`65""W). The experimental design was of totally randomized blocks and twelve treatments (lev- els of anticipated fertilization) were used with three repetitions. The base fertilization of soybean culture was partially anticipated, in the sowing for the finger-millet crop. Approximately 70 days after sowing, samples of the finger millet plants were collected in order to evaluate the dry matter production and to desiccate them thereafter It is concluded that the anticipation of phosphorus and potassium fertilization of soybean increases the dry matter production of E. coracana; in addition, E. coracana holds a great potential for the production of plant residues and it can be used in culture rotation or in no-tillage production systems.