77 resultados para Markov decision processes


Relevância:

20.00% 20.00%

Publicador:

Resumo:

In this paper we obtain the linear minimum mean square estimator (LMMSE) for discrete-time linear systems subject to state and measurement multiplicative noises and Markov jumps on the parameters. It is assumed that the Markov chain is not available. By using geometric arguments we obtain a Kalman type filter conveniently implementable in a recurrence form. The stationary case is also studied and a proof for the convergence of the error covariance matrix of the LMMSE to a stationary value under the assumption of mean square stability of the system and ergodicity of the associated Markov chain is obtained. It is shown that there exists a unique positive semi-definite solution for the stationary Riccati-like filter equation and, moreover, this solution is the limit of the error covariance matrix of the LMMSE. The advantage of this scheme is that it is very easy to implement and all calculations can be performed offline. (c) 2011 Elsevier Ltd. All rights reserved.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

This work deals with a procedure for model re-identification of a process in closed loop with ail already existing commercial MPC. The controller considered here has a two-layer structure where the upper layer performs a target calculation based on a simplified steady-state optimization of the process. Here, it is proposed a methodology where a test signal is introduced in a tuning parameter of the target calculation layer. When the outputs are controlled by zones instead of at fixed set points, the approach allows the continuous operation of the process without an excessive disruption of the operating objectives as process constraints and product specifications remain satisfied during the identification test. The application of the method is illustrated through the simulation of two processes of the oil refining industry. (c) 2008 Elsevier Ltd. All rights reserved.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

In this paper, we deal with a generalized multi-period mean-variance portfolio selection problem with market parameters Subject to Markov random regime switchings. Problems of this kind have been recently considered in the literature for control over bankruptcy, for cases in which there are no jumps in market parameters (see [Zhu, S. S., Li, D., & Wang, S. Y. (2004). Risk control over bankruptcy in dynamic portfolio selection: A generalized mean variance formulation. IEEE Transactions on Automatic Control, 49, 447-457]). We present necessary and Sufficient conditions for obtaining an optimal control policy for this Markovian generalized multi-period meal-variance problem, based on a set of interconnected Riccati difference equations, and oil a set of other recursive equations. Some closed formulas are also derived for two special cases, extending some previous results in the literature. We apply the results to a numerical example with real data for Fisk control over bankruptcy Ill a dynamic portfolio selection problem with Markov jumps selection problem. (C) 2008 Elsevier Ltd. All rights reserved.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

We define a new type of self-similarity for one-parameter families of stochastic processes, which applies to certain important families of processes that are not self-similar in the conventional sense. This includes Hougaard Levy processes such as the Poisson processes, Brownian motions with drift and the inverse Gaussian processes, and some new fractional Hougaard motions defined as moving averages of Hougaard Levy process. Such families have many properties in common with ordinary self-similar processes, including the form of their covariance functions, and the fact that they appear as limits in a Lamperti-type limit theorem for families of stochastic processes.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

This article reports major results from collaborative research between France and Brazil on soil and water systems, carried out in the Upper Amazon Basin. It reveals the weathering processes acting in the partly inundated, low elevation plateaus of the Basin, mostly covered by evergreen forest. Our findings are based on geochemical data and mineral spectroscopy that probe the crystal chemistry of Fe and Al in mineral phases (mainly kaolinite, Al- and Fe-(hydr)oxides) of tropical soils (laterites). These techniques reveal crystal alterations in mineral populations of different ages and changes of metal speciation associated with mineral or organic phases. These results provide an integrated model of soil formation and changes (from laterites to podzols) in distinct hydrological compartments of the Amazon landscapes and under altered water regimes. (C) 2010 Academie des sciences. Published by Elsevier Masson SAS. All rights reserved.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

The aim of this study was the design of a set of benzofuroxan derivatives as antimicrobial agents exploring the physicochemical properties of the related substituents. Topliss` decision tree approach was applied to select the substituent groups. Hierarchical cluster analysis was also performed to emphasize natural clusters and patterns. The compounds were obtained using two synthetic approaches for reducing the synthetic steps as well as improving the yield. The minimal inhibitory concentration method was employed to evaluate the activity against multidrug-resistant Staphylococcus aureus strains. The most active compound was 4-nitro-3-(trifluoromethyl)[N`-(benzofuroxan-5-yl) methylene] benzhydrazide (MIC range 12.7-11.4 mu g/mL), pointing out that the antimicrobial activity was indeed influenced by the hydrophobic and electron-withdrawing property of the substituent groups 3-CF(3) and 4-NO(2), respectively. (C) 2011 Elsevier Ltd. All rights reserved.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

Pharmaceuticals can exist in many solid forms, which can have different physical and chemical properties. These solid forms include polymorphs, solvates, amorphous, and hydrates. Particularly, hydration process can be quite common since pharmaceutical solids can be in contact with water during manufacturing process and can also be exposed to water during storage. In the present work, it is proved that NQR technique is capable of detecting different hydrated forms not only in the pure raw material but also in the final product (tablets), being in this way a useful technique for quality control. This technique was also used to study the dehydration process from pentahydrate to trihydrate.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

This paper analyzes the geography of regional competitiveness in manufacturing in Brazil. The authors estimate stochastic frontiers to calculate regional efficiency of representative firms in 137 regions in the period 2000-2006, in four sectors defined by technological intensity. The efficiency results are analyzed using Markov Spatial Transition Matrices to provide insights into the transition of regions between efficiency levels, considering their local spatial context. The results indicate that geography plays an important role in manufacturing competitiveness. In particular, regions with more competitive neighbors are more likely to improve their relative efficiency (pull effect) over time, and regions with less competitive neighbors are more likely to lose relative efficiency (drag effect). The authors find that the pull effect is stronger than the drag effect.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

Most regional programs focus on the supply side of regions, emphasizing the attraction conditions offered, such as infrastructure, labor skills, tax incentives, etc. This study analyzes one aspect of the demand side, that is, how investment decisions of private firms are made by asking the question: ""Do corporations decide the same way on investments in different parts of the territory?"" The paper analyzes the investments of 373 large Brazilian firms during 1996-2004. Based on the investment decisions of these firms, the role of sales, cash-flow, external financing, and working capital is investigated through regression analysis. The regional influence is captured by explanatory variables representing regional and firm characteristics, and by interaction dummies between the region and the main investment determinants. The results indicate significant differences across regions in the importance of investment determinants. This information is important for regional development policy, because different mechanisms should be used in different regions to foster private investments.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

The capacity to distinguish colony members from strangers is a key component in social life. In social insects, this extends to the brood and involves discrimination of queen eggs. Chemical substances communicate colony affiliation for both adults and brood; thus, in theory, all colony members should be able to recognize fellow nestmates. In this study, we investigate the ability of Dinoponera quadriceps workers to discriminate nestmate and non-nestmate eggs based on cuticular hydrocarbon composition. We analyzed whether cuticular hydrocarbons present on the eggs provide cues of discrimination. The results show that egg recognition in D. quadriceps is related to both age and the functional role of workers. Brood care workers were able to distinguish nestmate from non-nestmate eggs, while callow and forager workers were unable to do so.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

The elevated plus-maze is an animal model of anxiety used to study the effect of different drugs on the behavior of the animal It consists of a plus-shaped maze with two open and two closed arms elevated 50 cm from the floor The standard measures used to characterize exploratory behavior in the elevated plus-maze are the time spent and the number of entries in the open arms In this work we use Markov chains to characterize the exploratory behavior of the rat in the elevated plus-maze under three different conditions normal and under the effects of anxiogenic and anxiolytic drugs The spatial structure of the elevated plus-maze is divided into squares which are associated with states of a Markov chain By counting the frequencies of transitions between states during 5-min sessions in the elevated plus-maze we constructed stochastic matrices for the three conditions studied The stochastic matrices show specific patterns which correspond to the observed behaviors of the rat under the three different conditions For the control group the stochastic matrix shows a clear preference for places in the closed arms This preference is enhanced for the anxiogenic group For the anxiolytic group the stochastic matrix shows a pattern similar to a random walk Our results suggest that Markov chains can be used together with the standard measures to characterize the rat behavior in the elevated plus-maze (C) 2010 Elsevier B V All rights reserved

Relevância:

20.00% 20.00%

Publicador:

Resumo:

OBJECTIVE. MRI and combined ankle and posterior subtalar MR arthrography in cadavers were used to evaluate the ligaments of the posterior and lateral talar processes. Subsequent anatomic and histologic correlation was performed. MATERIALS AND METHODS. Ten cadaveric ankles were used. Routine radiography and MRI were initially performed. Ankle and posterior subtalar MR arthrography, followed by anatomic and histologic analysis, was then performed to allow better assessment of the ligaments of the lateral and posterior talar process. RESULTS. In all subjects, MR arthrography provided superior delineation of the articular and periarticular structures, as well as the ligaments. The lateral talocalcaneal and medial talocalcaneal ligaments were best seen in the axial and coronal planes, respectively. The axial plane was best for visualizing the fibulotalocalcaneal ligament, and the sagittal plane was best for evaluating the posterior talocalcaneal ligament. The anterior and posterior talofibular ligaments and the posterior tibiotalar ligament (superficial and deep portions) were best seen in the axial plane. Histologic analysis was correlated to anatomic sectioning and showed the attachment sites of these ligaments. CONCLUSION. Combined ankle and posterior subtalar MR arthrography enhances visualization of the ligaments attaching to the posterior and lateral talar processes, including the posterior, lateral, and medial talocalcaneal and fibulotalocalcaneal ligaments.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

Crack cocaine-dependent individuals (CCDI) present abnormalities in both social adjustment and decision making, but few studies have examined this association. This study investigated cognitive and social performance of 30 subjects (CCDI x controls); CCDI were abstinent for 2 weeks. We used the Social Adjustment Scale (SAS), Wisconsin Card Sorting Test (WCST), and Iowa Gambling Task (IGT). Disadvantageous choices on the IGT were associated with higher levels of social dysfunction in CCDI, suggesting the ecological validity of the IGT. Social dysfunction and decision making may be linked to the same underlying prefrontal dysfunction, but the nature of this association should be further investigated. (Am J Addict 2010;00: 1-9).

Relevância:

20.00% 20.00%

Publicador:

Resumo:

Aims: To compare septal and vascular matrix remodelling, vascular occlusion, Pulmonary function tests and survival between two groups: one with idiopathic non-specific interstitial pneumonia (NSIP) and one with NSIP associated with systemic sclerosis (SSc). Methods and results: Pulmonary biopsy specimens were examined from 40 patients, 22 with NSIP and 18 with NSIP associated with SSc. The content of septal collagen and elastic fibres, as well as the elastic fibres in the vascular interstitium, were higher in the SSc group (P = 0.01, P = 0.001 and P < 0.0001, respectively). Among pulmonary function tests. the diffusing capacity for carbon monoxide/alveolar volume was affected to a greater extent in the SSc group (59%) of the predicted value in SSc and 97% in the idiopathic group). There were no differences in collagen content of the vascular interstitium, arterial occlusion, or survival between the two groups. Conclusions: Although the fibrotic process is more intense in the SSc group. it, does not affect the prognosis of these patients. Because the elastotic process is higher in the SSc group, this might suggest that autoimmune inflammatory mechanisms affecting the elastic fibre system play a greater role in the pathogenesis and pulmonary remodelling process of SSc NSIP than in idiopathic NSIP.

Relevância:

20.00% 20.00%

Publicador:

Resumo:

Introduction Different modalities of palliation for obstructive symptoms in patients with unresectable esophageal cancer (EC) exist. However, these therapeutic alternatives have significant differences in costs and effectiveness. Methods A Markov model was designed to compare the cost-effectiveness (CE) of self-expandable stent (SES), brachytherapy and laser in the palliation of unresectable EC. Patients were assigned to one of the strategies, and the improvement in swallowing function was compared given the treatment efficacy, probability of survival, and risks of complications associated to each strategy. Probabilities and parameters for distribution were based on a 9-month time frame. Results Under the base-case scenario, laser has the lowest CE ratio, followed by brachytherapy at an incremental cost-effectiveness ratio (ICER) of $4,400.00, and SES is a dominated strategy. In the probabilistic analysis, laser is the strategy with the highest probability of cost-effectiveness for willingness to pay (WTP) values lower than $3,201 and brachytherapy for all WTP yielding a positive net health benefit (NHB) (threshold $4,440). The highest probability of cost-effectiveness for brachytherapy is 96%, and consequently, selection of suboptimal strategies can lead to opportunity losses for the US health system, ranging from US$ 4.32 to US$ 38.09 million dollars over the next 5-20 years. Conclusion Conditional to the WTP and current US Medicare costs, palliation of unresectable esophageal cancers with brachytherapy provides the largest amount of NHB and is the strategy with the highest probability of CE. However, some level of uncertainly remains, and wrong decisions will be made until further knowledge is acquired.