942 resultados para MARKOV DECISION-PROCESSES
Resumo:
This paper analyzes the convergence of the constant modulus algorithm (CMA) in a decision feedback equalizer using only a feedback filter. Several works had already observed that the CMA presented a better performance than decision directed algorithm in the adaptation of the decision feedback equalizer, but theoretical analysis always showed to be difficult specially due to the analytical difficulties presented by the constant modulus criterion. In this paper, we surmount such obstacle by using a recent result concerning the CM analysis, first obtained in a linear finite impulse response context with the objective of comparing its solutions to the ones obtained through the Wiener criterion. The theoretical analysis presented here confirms the robustness of the CMA when applied to the adaptation of the decision feedback equalizer and also defines a class of channels for which the algorithm will suffer from ill-convergence when initialized at the origin.
Resumo:
We consider in this paper the optimal stationary dynamic linear filtering problem for continuous-time linear systems subject to Markovian jumps in the parameters (LSMJP) and additive noise (Wiener process). It is assumed that only an output of the system is available and therefore the values of the jump parameter are not accessible. It is a well known fact that in this setting the optimal nonlinear filter is infinite dimensional, which makes the linear filtering a natural numerically, treatable choice. The goal is to design a dynamic linear filter such that the closed loop system is mean square stable and minimizes the stationary expected value of the mean square estimation error. It is shown that an explicit analytical solution to this optimal filtering problem is obtained from the stationary solution associated to a certain Riccati equation. It is also shown that the problem can be formulated using a linear matrix inequalities (LMI) approach, which can be extended to consider convex polytopic uncertainties on the parameters of the possible modes of operation of the system and on the transition rate matrix of the Markov process. As far as the authors are aware of this is the first time that this stationary filtering problem (exact and robust versions) for LSMJP with no knowledge of the Markov jump parameters is considered in the literature. Finally, we illustrate the results with an example.
Resumo:
In this paper we consider the existence of the maximal and mean square stabilizing solutions for a set of generalized coupled algebraic Riccati equations (GCARE for short) associated to the infinite-horizon stochastic optimal control problem of discrete-time Markov jump with multiplicative noise linear systems. The weighting matrices of the state and control for the quadratic part are allowed to be indefinite. We present a sufficient condition, based only on some positive semi-definite and kernel restrictions on some matrices, under which there exists the maximal solution and a necessary and sufficient condition under which there exists the mean square stabilizing solution fir the GCARE. We also present a solution for the discounted and long run average cost problems when the performance criterion is assumed be composed by a linear combination of an indefinite quadratic part and a linear part in the state and control variables. The paper is concluded with a numerical example for pension fund with regime switching.
Resumo:
In this paper we obtain the linear minimum mean square estimator (LMMSE) for discrete-time linear systems subject to state and measurement multiplicative noises and Markov jumps on the parameters. It is assumed that the Markov chain is not available. By using geometric arguments we obtain a Kalman type filter conveniently implementable in a recurrence form. The stationary case is also studied and a proof for the convergence of the error covariance matrix of the LMMSE to a stationary value under the assumption of mean square stability of the system and ergodicity of the associated Markov chain is obtained. It is shown that there exists a unique positive semi-definite solution for the stationary Riccati-like filter equation and, moreover, this solution is the limit of the error covariance matrix of the LMMSE. The advantage of this scheme is that it is very easy to implement and all calculations can be performed offline. (c) 2011 Elsevier Ltd. All rights reserved.
Resumo:
This work deals with a procedure for model re-identification of a process in closed loop with ail already existing commercial MPC. The controller considered here has a two-layer structure where the upper layer performs a target calculation based on a simplified steady-state optimization of the process. Here, it is proposed a methodology where a test signal is introduced in a tuning parameter of the target calculation layer. When the outputs are controlled by zones instead of at fixed set points, the approach allows the continuous operation of the process without an excessive disruption of the operating objectives as process constraints and product specifications remain satisfied during the identification test. The application of the method is illustrated through the simulation of two processes of the oil refining industry. (c) 2008 Elsevier Ltd. All rights reserved.
Resumo:
In this paper, we deal with a generalized multi-period mean-variance portfolio selection problem with market parameters Subject to Markov random regime switchings. Problems of this kind have been recently considered in the literature for control over bankruptcy, for cases in which there are no jumps in market parameters (see [Zhu, S. S., Li, D., & Wang, S. Y. (2004). Risk control over bankruptcy in dynamic portfolio selection: A generalized mean variance formulation. IEEE Transactions on Automatic Control, 49, 447-457]). We present necessary and Sufficient conditions for obtaining an optimal control policy for this Markovian generalized multi-period meal-variance problem, based on a set of interconnected Riccati difference equations, and oil a set of other recursive equations. Some closed formulas are also derived for two special cases, extending some previous results in the literature. We apply the results to a numerical example with real data for Fisk control over bankruptcy Ill a dynamic portfolio selection problem with Markov jumps selection problem. (C) 2008 Elsevier Ltd. All rights reserved.
Resumo:
We define a new type of self-similarity for one-parameter families of stochastic processes, which applies to certain important families of processes that are not self-similar in the conventional sense. This includes Hougaard Levy processes such as the Poisson processes, Brownian motions with drift and the inverse Gaussian processes, and some new fractional Hougaard motions defined as moving averages of Hougaard Levy process. Such families have many properties in common with ordinary self-similar processes, including the form of their covariance functions, and the fact that they appear as limits in a Lamperti-type limit theorem for families of stochastic processes.
Resumo:
This article reports major results from collaborative research between France and Brazil on soil and water systems, carried out in the Upper Amazon Basin. It reveals the weathering processes acting in the partly inundated, low elevation plateaus of the Basin, mostly covered by evergreen forest. Our findings are based on geochemical data and mineral spectroscopy that probe the crystal chemistry of Fe and Al in mineral phases (mainly kaolinite, Al- and Fe-(hydr)oxides) of tropical soils (laterites). These techniques reveal crystal alterations in mineral populations of different ages and changes of metal speciation associated with mineral or organic phases. These results provide an integrated model of soil formation and changes (from laterites to podzols) in distinct hydrological compartments of the Amazon landscapes and under altered water regimes. (C) 2010 Academie des sciences. Published by Elsevier Masson SAS. All rights reserved.
Resumo:
The aim of this study was the design of a set of benzofuroxan derivatives as antimicrobial agents exploring the physicochemical properties of the related substituents. Topliss` decision tree approach was applied to select the substituent groups. Hierarchical cluster analysis was also performed to emphasize natural clusters and patterns. The compounds were obtained using two synthetic approaches for reducing the synthetic steps as well as improving the yield. The minimal inhibitory concentration method was employed to evaluate the activity against multidrug-resistant Staphylococcus aureus strains. The most active compound was 4-nitro-3-(trifluoromethyl)[N`-(benzofuroxan-5-yl) methylene] benzhydrazide (MIC range 12.7-11.4 mu g/mL), pointing out that the antimicrobial activity was indeed influenced by the hydrophobic and electron-withdrawing property of the substituent groups 3-CF(3) and 4-NO(2), respectively. (C) 2011 Elsevier Ltd. All rights reserved.
Resumo:
Pharmaceuticals can exist in many solid forms, which can have different physical and chemical properties. These solid forms include polymorphs, solvates, amorphous, and hydrates. Particularly, hydration process can be quite common since pharmaceutical solids can be in contact with water during manufacturing process and can also be exposed to water during storage. In the present work, it is proved that NQR technique is capable of detecting different hydrated forms not only in the pure raw material but also in the final product (tablets), being in this way a useful technique for quality control. This technique was also used to study the dehydration process from pentahydrate to trihydrate.
Resumo:
Weakly branched silica films formed by the two-step sol-gel process allow for the formation of high selectivity membranes for gas separation. 29Si NMR and gas permeation showed that reduced crosslinking leads to He/CH4 selectivity improvement from 300 to 1000. Applied in membrane reactor for cyclohexane conversion to benzene, conversions were achieved at 14 fold higher than a conventional reactor at 250°C. Hydrothermal stability studies showed that carbon templating of silica is required for hydrothermally stable membranes. From our work it was shown that with correct application of chemistry, practical membrane systems can be built to suit gas separation (e. g. hydrogen fuel) and reactor systems.
Resumo:
Rectangular dropshafts, commonly used in sewers and storm water systems, are characterised by significant flow aeration. New detailed air-water flow measurements were conducted in a near-full-scale dropshaft at large discharges. In the shaft pool and outflow channel, the results demonstrated the complexity of different competitive air entrainment mechanisms. Bubble size measurements showed a broad range of entrained bubble sizes. Analysis of streamwise distributions of bubbles suggested further some clustering process in the bubbly flow although, in the outflow channel, bubble chords were in average smaller than in the shaft pool. A robust hydrophone was tested to measure bubble acoustic spectra and to assess its field application potential. The acoustic results characterised accurately the order of magnitude of entrained bubble sizes, but the transformation from acoustic frequencies to bubble radii did not predict correctly the probability distribution functions of bubble sizes.
Resumo:
This is a draft for a chapter of the book version of my Ph.D thesis. The chapter addresses the following question: Are the creative processes of musical composers and academic economists essentially the same, or are there significant differences? The paper finds that there are deep similarities between the creative processes of theoretical economists and the creative processes of artists. The chapter builds a process oriented lifecycle account of creative activity, drawing on testimonial material from the arts and the sciences, and relates the model to the creative work of economists developing economic theory.
Resumo:
Dwarf galaxies have attracted increased attention in recent years, because of their susceptibility to galaxy transformation processes within rich galaxy clusters. Direct evidence for these processes, however, has been difficult to obtain, with a small number of diffuse light trails and intra-cluster stars, being the only signs of galaxy disruption. Furthermore, our current knowledge of dwarf galaxy populations may be very incomplete, because traditional galaxy surveys are insensitive to extremely diffuse or compact galaxies. Aware of these concerns, we recently undertook an all-object survey of the Fornax galaxy cluster. This revealed a new population of compact members, overlooked in previous conventional surveys. Here we demonstrate that these 'ultra-compact' dwarf galaxies are structurally and dynamically distinct from both globular star clusters and known types of dwarf galaxy, and thus represent a new class of dwarf galaxy. Our data are consistent with the interpretation that these are the remnant nuclei of disrupted dwarf galaxies, making them an easily observed tracer of galaxy disruption.
Resumo:
Faced with today’s ill-structured business environment of fast-paced change and rising uncertainty, organizations have been searching for management tools that will perform satisfactorily under such ambiguous conditions. In the arena of managerial decision making, one of the approaches being assessed is the use of intuition. Based on our definition of intuition as a non-sequential information-processing mode, which comprises both cognitive and affective elements and results in direct knowing without any use of conscious reasoning, we develop a testable model of integrated analytical and intuitive decision making and propose ways to measure the use of intuition.