244 resultados para Optimal Stochastic Control
Resumo:
Several MPC applications implement a control strategy in which some of the system outputs are controlled within specified ranges or zones, rather than at fixed set points [J.M. Maciejowski, Predictive Control with Constraints, Prentice Hall, New Jersey, 2002]. This means that these outputs will be treated as controlled variables only when the predicted future values lie outside the boundary of their corresponding zones. The zone control is usually implemented by selecting an appropriate weighting matrix for the output error in the control cost function. When an output prediction is inside its zone, the corresponding weight is zeroed, so that the controller ignores this output. When the output prediction lies outside the zone, the error weight is made equal to a specified value and the distance between the output prediction and the boundary of the zone is minimized. The main problem of this approach, as long as stability of the closed loop is concerned, is that each time an output is switched from the status of non-controlled to the status of controlled, or vice versa, a different linear controller is activated. Thus, throughout the continuous operation of the process, the control system keeps switching from one controller to another. Even if a stabilizing control law is developed for each of the control configurations, switching among stable controllers not necessarily produces a stable closed loop system. Here, a stable M PC is developed for the zone control of open-loop stable systems. Focusing on the practical application of the proposed controller, it is assumed that in the control structure of the process system there is an upper optimization layer that defines optimal targets to the system inputs. The performance of the proposed strategy is illustrated by simulation of a subsystem of an industrial FCC system. (C) 2008 Elsevier Ltd. All rights reserved.
Resumo:
The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.
Resumo:
In this technical note we consider the mean-variance hedging problem of a jump diffusion continuous state space financial model with the re-balancing strategies for the hedging portfolio taken at discrete times, a situation that more closely reflects real market conditions. A direct expression based on some change of measures, not depending on any recursions, is derived for the optimal hedging strategy as well as for the ""fair hedging price"" considering any given payoff. For the case of a European call option these expressions can be evaluated in a closed form.
Resumo:
This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.
Resumo:
This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.
Resumo:
In this paper, we deal with a generalized multi-period mean-variance portfolio selection problem with market parameters Subject to Markov random regime switchings. Problems of this kind have been recently considered in the literature for control over bankruptcy, for cases in which there are no jumps in market parameters (see [Zhu, S. S., Li, D., & Wang, S. Y. (2004). Risk control over bankruptcy in dynamic portfolio selection: A generalized mean variance formulation. IEEE Transactions on Automatic Control, 49, 447-457]). We present necessary and Sufficient conditions for obtaining an optimal control policy for this Markovian generalized multi-period meal-variance problem, based on a set of interconnected Riccati difference equations, and oil a set of other recursive equations. Some closed formulas are also derived for two special cases, extending some previous results in the literature. We apply the results to a numerical example with real data for Fisk control over bankruptcy Ill a dynamic portfolio selection problem with Markov jumps selection problem. (C) 2008 Elsevier Ltd. All rights reserved.
Resumo:
Most models currently used to determine optimal foreign reserve holdings take the level of international debt as given. However, given the sovereign`s willingness-to-pay incentive problems, reserve accumulation may reduce sustainable debt levels. In addition, assuming constant debt levels does not allow addressing one of the puzzles behind using reserves as a means to avoid the negative effects of crisis: why do not sovereign countries reduce their sovereign debt instead? To study the joint decision of holding sovereign debt and reserves, we construct a stochastic dynamic equilibrium model calibrated to a sample of emerging markets. We obtain that the reserve accumulation does not play a quantitatively important role in this model. In fact, we find the optimal policy is not to hold reserves at all. This finding is robust to considering interest rate shocks, sudden stops, contingent reserves and reserve dependent output costs. (c) 2008 Elsevier B.V. All rights reserved.
Resumo:
Neonatal calf diarrhea is a multi-etiology syndrome of cattle and direct detection of the two major agents of the syndrome, group A rotavirus and Bovine coronavirus (BCoV) is hampered by their fastidious growth in cell culture. This study aimed at developing a multiplex semi-nested RT-PCR for simultaneous detection of BCoV (N gene) and group A rotavirus (VP1 gene) with the addition of an internal control (mRNA ND5). The assay was tested in 75 bovine feces samples tested previously for rotavirus using PAGE and for BCoV using nested RT-PCR targeted to RdRp gene. Agreement with reference tests was optimal for BCoV (kappa = 0.833) and substantial for rotavirus detection (kappa = 0.648). the internal control, ND5 mRNA, was detected successfully in all reactions. Results demonstrated that this multiplex semi-nested RT-PCR was effective in the detection of BCoV and rotavirus, with high sensitivity and specificity for simultaneous detection of both viruses at a lower cost, providing an important tool for studies on the etiology of diarrhea in cattle. (C) 2010 Elsevier B.V. All rights reserved.
Resumo:
This paper addresses the one-dimensional cutting stock problem when demand is a random variable. The problem is formulated as a two-stage stochastic nonlinear program with recourse. The first stage decision variables are the number of objects to be cut according to a cutting pattern. The second stage decision variables are the number of holding or backordering items due to the decisions made in the first stage. The problem`s objective is to minimize the total expected cost incurred in both stages, due to waste and holding or backordering penalties. A Simplex-based method with column generation is proposed for solving a linear relaxation of the resulting optimization problem. The proposed method is evaluated by using two well-known measures of uncertainty effects in stochastic programming: the value of stochastic solution-VSS-and the expected value of perfect information-EVPI. The optimal two-stage solution is shown to be more effective than the alternative wait-and-see and expected value approaches, even under small variations in the parameters of the problem.
Resumo:
Dental erosion is a type of wear caused by non bacterial acids or chelation. There is evidence of a significant increase in the prevalence of dental wear in the deciduous and permanent teeth as a consequence of the frequent intake of acidic foods and drinks, or due to gastric acid which may reach the oral cavity following reflux or vomiting episodes. The presence of acids is a prerequisite for dental erosion, but the erosive wear is complex and depends on the interaction of biological, chemical and behavioral factors. Even though erosion may be defined or described as an isolated process, in clinical situations other wear phenomena are expected to occur concomitantly, such as abrasive wear (which occurs, e.g, due to tooth brushing or mastication). In order to control dental loss due to erosive wear it is crucial to take into account its multifactorial nature, which predisposes some individuals to the condition.
Resumo:
The mechanical control of supragingival biofilm is accepted as one of the most important measures to treat and prevent dental caries and periodontal diseases. Nevertheless, maintaining dental surfaces biofilm-free is not an easy task. In this regard, chemical agents, mainly in the form of mouthwashes, have been studied to help overcome the difficulties involved in the mechanical control of biofilm. The aim of this paper was to discuss proposals for the teaching of supragingival chemical control (SCC) in order to improve dentists' knowledge regarding this clinical issue. Firstly, the literature regarding the efficacy of antiseptics is presented, clearly showing that chemical agents are clinically effective in the reduction of biofilm and gingival inflammation when used as adjuvant agents to mechanical control. Thus, it is suggested that the content related to SCC be included in the curricular grid of dental schools. Secondly, some essential topics are recommended to be included in the teaching of SCC as follows: skills and competencies expected of a graduate dentist regarding SCC; how to include this content in the curricular grid; teaching-learning tools and techniques to be employed; and program content.
Resumo:
Este artigo discute um modelo de previsão combinada para a realização de prognósticos climáticos na escala sazonal. Nele, previsões pontuais de modelos estocásticos são agregadas para obter as melhores projeções no tempo. Utilizam-se modelos estocásticos autoregressivos integrados a médias móveis, de suavização exponencial e previsões por análise de correlações canônicas. O controle de qualidade das previsões é feito através da análise dos resíduos e da avaliação do percentual de redução da variância não-explicada da modelagem combinada em relação às previsões dos modelos individuais. Exemplos da aplicação desses conceitos em modelos desenvolvidos no Instituto Nacional de Meteorologia (INMET) mostram bons resultados e ilustram que as previsões do modelo combinado, superam na maior parte dos casos a de cada modelo componente, quando comparadas aos dados observados.
Resumo:
The arterial partial pressure (P CO2) of carbon dioxide is virtually constant because of the close match between the metabolic production of this gas and its excretion via breathing. Blood gas homeostasis does not rely solely on changes in lung ventilation, but also to a considerable extent on circulatory adjustments that regulate the transport of CO2 from its sites of production to the lungs. The neural mechanisms that coordinate circulatory and ventilatory changes to achieve blood gas homeostasis are the subject of this review. Emphasis will be placed on the control of sympathetic outflow by central chemoreceptors. High levels of CO2 exert an excitatory effect on sympathetic outflow that is mediated by specialized chemoreceptors such as the neurons located in the retrotrapezoid region. In addition, high CO2 causes an aversive awareness in conscious animals, activating wake-promoting pathways such as the noradrenergic neurons. These neuronal groups, which may also be directly activated by brain acidification, have projections that contribute to the CO2-induced rise in breathing and sympathetic outflow. However, since the level of activity of the retrotrapezoid nucleus is regulated by converging inputs from wake-promoting systems, behavior-specific inputs from higher centers and by chemical drive, the main focus of the present manuscript is to review the contribution of central chemoreceptors to the control of autonomic and respiratory mechanisms.
Resumo:
OBJECTIVE: Despite the relevance of irritability emotions to the treatment, prognosis and classification of psychiatric disorders, the neurobiological basis of this emotional state has been rarely investigated to date. We assessed the brain circuitry underlying personal script-driven irritability in healthy subjects (n = 11) using functional magnetic resonance imaging. METHOD: Blood oxygen level-dependent signal changes were recorded during auditory presentation of personal scripts of irritability in contrast to scripts of happiness or neutral emotional content. Self-rated emotional measurements and skin conductance recordings were also obtained. Images were acquired using a 1,5T magnetic resonance scanner. Brain activation maps were constructed from individual images, and between-condition differences in the mean power of experimental response were identified by using cluster-wise nonparametric tests. RESULTS: Compared to neutral scripts, increased blood oxygen level-dependent signal during irritability scripts was detected in the left subgenual anterior cingulate cortex, and in the left medial, anterolateral and posterolateral dorsal prefrontal cortex (cluster-wise p-value < 0.05). While the involvement of the subgenual cingulate and dorsal anterolateral prefrontal cortices was unique to the irritability state, increased blood oxygen level-dependent signal in dorsomedial and dorsal posterolateral prefrontal regions were also present during happiness induction. CONCLUSION: Irritability induction is associated with functional changes in a limited set of brain regions previously implicated in the mediation of emotional states. Changes in prefrontal and cingulate areas may be related to effortful cognitive control aspects that gain salience during the emergence of irritability.
Resumo:
Vacuolar H+-ATPase is a large multi-subunit protein that mediates ATP-driven vectorial H+ transport across the membranes. It is widely distributed and present in virtually all eukaryotic cells in intracellular membranes or in the plasma membrane of specialized cells. In subcellular organelles, ATPase is responsible for the acidification of the vesicular interior, which requires an intraorganellar acidic pH to maintain optimal enzyme activity. Control of vacuolar H+-ATPase depends on the potential difference across the membrane in which the proton ATPase is inserted. Since the transport performed by H+-ATPase is electrogenic, translocation of H+-ions across the membranes by the pump creates a lumen-positive voltage in the absence of a neutralizing current, generating an electrochemical potential gradient that limits the activity of H+-ATPase. In many intracellular organelles and cell plasma membranes, this potential difference established by the ATPase gradient is normally dissipated by a parallel and passive Cl- movement, which provides an electric shunt compensating for the positive charge transferred by the pump. The underlying mechanisms for the differences in the requirement for chloride by different tissues have not yet been adequately identified, and there is still some controversy as to the molecular identity of the associated Cl--conducting proteins. Several candidates have been identified: the ClC family members, which may or may not mediate nCl-/H+ exchange, and the cystic fibrosis transmembrane conductance regulator. In this review, we discuss some tissues where the association between H+-ATPase and chloride channels has been demonstrated and plays a relevant physiologic role.