149 resultados para Markov decision processes


Relevância:

30.00% 30.00%

Publicador:

Resumo:

Coastal wetlands are dynamic and include the freshwater-intertidal interface. In many parts of the world such wetlands are under pressure from increasing human populations and from predicted sea-level rise. Their complexity and the limited knowledge of processes operating in these systems combine to make them a management challenge.Adaptive management is advocated for complex ecosystem management (Hackney 2000; Meretsky et al. 2000; Thom 2000;National Research Council 2003).Adaptive management identifies management aims,makes an inventory/environmental assessment,plans management actions, implements these, assesses outcomes, and provides feedback to iterate the process (Holling 1978;Walters and Holling 1990). This allows for a dynamic management system that is responsive to change. In the area of wetland management recent adaptive approaches are exemplified by Natuhara et al. (2004) for wild bird management, Bunch and Dudycha (2004) for a river system, Thom (2000) for restoration, and Quinn and Hanna (2003) for seasonal wetlands in California. There are many wetland habitats for which we currently have only rudimentary knowledge (Hackney 2000), emphasizing the need for good information as a prerequisite for effective management. The management framework must also provide a way to incorporate the best available science into management decisions and to use management outcomes as opportunities to improve scientific understanding and provide feedback to the decision system. Figure 9.1 shows a model developed by Anorov (2004) based on the process-response model of Maltby et al. (1994) that forms a framework for the science that underlies an adaptive management system in the wetland context.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

enin et al. (2000) recently introduced the idea of similarity in the context of birth-death processes. This paper examines the extent to which their results can be extended to arbitrary Markov chains. It is proved that, under a variety of conditions, similar chains are strongly similar in a sense which is described, and it is shown that minimal chains are strongly similar if and only if the corresponding transition-rate matrices are strongly similar. A general framework is given for constructing families of strongly similar chains; it permits the construction of all such chains in the irreducible case.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

Recent semantic priming investigations in Parkinsons disease (PD) employed variants of Neelys (1977) lexical decision paradigm to dissociate the automatic and attentional aspects of semantic activation (McDonald, Brown, Gorell, 1996; Spicer, Brown, Gorell, 1994). In our earlier review, we claimed that the results of Spicer, McDonald and colleagues normal control participants violated the two-process model of information processing (Posner Snyder, 1975) upon which their experimental paradigm had been based (Arnott Chenery, 1999). We argued that, even at the shortest SOA employed, key design modifications to Neelys original experiments biased the tasks employed by Spicer et al. and McDonald et al. towards being assessments of attention-dependent processes. Accordingly, we contended that experimental procedures did not speak to issues of automaticity and, therefore, Spicer, McDonald and colleagues claims of robust automatic semantic activation in PD must be treated with caution.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

The nature of the semantic memory deficit in dementia of the Alzheimer's type (DAT) was investigated in a semantic priming task which was designed to assess both automatic and attention-induced priming effects. Ten DAT patients and 10 age-matched control subjects completed a word naming semantic priming task in which both relatedness proportion (RP) and stimulus-onset asynchrony (SOA) were varied. A clear dissociation between automatic and attentional priming effects in both groups was demonstrated; however, the DAT subjects pattern of priming deviated significantly from that of the normal controls. The DAT patients failed to produce any priming under conditions which encouraged automatic semantic processing and produced facilitation only when the RP was high. In addition, the DAT group produced hyperpriming, with significantly larger facilitation effects than the control group. These results suggest an impairment of automatic spreading activation in DAT and have implications for theories of semantic memory impairment in DAT as well as models of normal priming. (C) 2001 Academic Press.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

This note presents a method of evaluating the distribution of a path integral for Markov chains on a countable state space.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

This paper presents a method of evaluating the expected value of a path integral for a general Markov chain on a countable state space. We illustrate the method with reference to several models, including birth-death processes and the birth, death and catastrophe process. (C) 2002 Elsevier Science Inc. All rights reserved.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

For Markov processes on the positive integers with the origin as an absorbing state, Ferrari, Kesten, Martinez and Picco studied the existence of quasi-stationary and limiting conditional distributions by characterizing quasi-stationary distributions as fixed points of a transformation Phi on the space of probability distributions on {1, 2,.. }. In the case of a birth-death process, the components of Phi(nu) can be written down explicitly for any given distribution nu. Using this explicit representation, we will show that Phi preserves likelihood ratio ordering between distributions. A conjecture of Kryscio and Lefevre concerning the quasi-stationary distribution of the SIS logistic epidemic follows as a corollary.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

Let Q be a stable and conservative Q-matrix over a countable state space S consisting of an irreducible class C and a single absorbing state 0 that is accessible from C. Suppose that Q admits a finite mu-subinvariant measure in on C. We derive necessary and sufficient conditions for there to exist a Q-process for which m is mu-invariant on C, as well as a necessary condition for the uniqueness of such a process.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

The study aimed to examine the factors influencing referral to rehabilitation following traumatic brain injury (TBI) by using social problems theory as a conceptual model to focus on practitioners and the process of decision-making in two Australian hospitals. The research design involved semi-structured interviews with 18 practitioners and observations of 10 team meetings, and was part of a larger study on factors influencing referral to rehabilitation in the same settings. Analysis revealed that referral decisions were influenced primarily by practitioners' selection and their interpretation of clinical and non-clinical patient factors. Further, practitioners generally considered patient factors concurrently during an ongoing process of decision-making, with the combinations and interactions of these factors forming the basis for interpretations of problems and referral justifications. Key patient factors considered in referral decisions included functional and tracheostomy status, time since injury, age, family, place of residence and Indigenous status. However, rate and extent of progress, recovery potential, safety and burden of care, potential for independence and capacity to cope were five interpretative themes, which emerged as the justifications for referral decisions. The subsequent negotiation of referral based on patient factors was in turn shaped by the involvement of practitioners. While multi-disciplinary processes of decision-making were the norm, allied health professionals occupied a central role in referral to rehabilitation, and involvement of medical, nursing and allied health practitioners varied. Finally, the organizational pressures and resource constraints, combined with practitioners' assimilation of the broader efficiency agenda were central factors shaping referral. (C) 2004 Elsevier Ltd. All rights reserved.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

Let (Phi(t))(t is an element of R+) be a Harris ergodic continuous-time Markov process on a general state space, with invariant probability measure pi. We investigate the rates of convergence of the transition function P-t(x, (.)) to pi; specifically, we find conditions under which r(t) vertical bar vertical bar P-t (x, (.)) - pi vertical bar vertical bar -> 0 as t -> infinity, for suitable subgeometric rate functions r(t), where vertical bar vertical bar - vertical bar vertical bar denotes the usual total variation norm for a signed measure. We derive sufficient conditions for the convergence to hold, in terms of the existence of suitable points on which the first hitting time moments are bounded. In particular, for stochastically ordered Markov processes, explicit bounds on subgeometric rates of convergence are obtained. These results are illustrated in several examples.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

We derive necessary and sufficient conditions for the existence of bounded or summable solutions to systems of linear equations associated with Markov chains. This substantially extends a famous result of G. E. H. Reuter, which provides a convenient means of checking various uniqueness criteria for birth-death processes. Our result allows chains with much more general transition structures to be accommodated. One application is to give a new proof of an important result of M. F. Chen concerning upwardly skip-free processes. We then use our generalization of Reuter's lemma to prove new results for downwardly skip-free chains, such as the Markov branching process and several of its many generalizations. This permits us to establish uniqueness criteria for several models, including the general birth, death, and catastrophe process, extended branching processes, and asymptotic birth-death processes, the latter being neither upwardly skip-free nor downwardly skip-free.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

Let S be a countable set and let Q = (q(ij), i, j is an element of S) be a conservative q-matrix over S with a single instantaneous state b. Suppose that we are given a real number mu >= 0 and a strictly positive probability measure m = (m(j), j is an element of S) such that Sigma(i is an element of S) m(i)q(ij) = -mu m(j), j 0 b. We prove that there exists a Q-process P(t) = (p(ij) (t), i, j E S) for which m is a mu-invariant measure, that is Sigma(i is an element of s) m(i)p(ij)(t) = e(-mu t)m(j), j is an element of S. We illustrate our results with reference to the Kolmogorov 'K 1' chain and a birth-death process with catastrophes and instantaneous resurrection.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

Two studies in the context of English-French relations in Québec suggest that individuals who strongly identify with a group derive the individual-level costs and benefits that drive expectancy-value processes (rational decision-making) from group-level costs and benefits. In Study 1, high identifiers linked group- and individual-level outcomes of conflict choices whereas low identifiers did not. Group-level expectancy-value processes, in Study 2, mediated the relationship between social identity and perceptions that collective action benefits the individual actor and between social identity and intentions to act. These findings suggest the rational underpinnings of identity-driven political behavior, a relationship sometimes obscured in intergroup theory that focuses on cognitive processes of self-stereotyping. But the results also challenge the view that individuals' cost-benefit analyses are independent of identity processes. The findings suggest the importance of modeling the relationship of group and individual levels of expectancy-value processes as both hierarchical and contingent on social identity processes

Relevância:

30.00% 30.00%

Publicador:

Resumo:

Process optimisation and optimal control of batch and continuous drum granulation processes are studied in this paper. The main focus of the current research has been: (i) construction of optimisation and control relevant, population balance models through the incorporation of moisture content, drum rotation rate and bed depth into the coalescence kernels; (ii) investigation of optimal operational conditions using constrained optimisation techniques; (iii) development of optimal control algorithms based on discretized population balance equations; and (iv) comprehensive simulation studies on optimal control of both batch and continuous granulation processes. The objective of steady state optimisation is to minimise the recycle rate with minimum cost for continuous processes. It has been identified that the drum rotation-rate, bed depth (material charge), and moisture content of solids are practical decision (design) parameters for system optimisation. The objective for the optimal control of batch granulation processes is to maximize the mass of product-sized particles with minimum time and binder consumption. The objective for the optimal control of the continuous process is to drive the process from one steady state to another in a minimum time with minimum binder consumption, which is also known as the state-driving problem. It has been known for some time that the binder spray-rate is the most effective control (manipulative) variable. Although other possible manipulative variables, such as feed flow-rate and additional powder flow-rate have been investigated in the complete research project, only the single input problem with the binder spray rate as the manipulative variable is addressed in the paper to demonstrate the methodology. It can be shown from simulation results that the proposed models are suitable for control and optimisation studies, and the optimisation algorithms connected with either steady state or dynamic models are successful for the determination of optimal operational conditions and dynamic trajectories with good convergence properties. (c) 2005 Elsevier Ltd. All rights reserved.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

Three experiments are reported that examined the process by which trainees learn decision-making skills during a critical incident training program. Formal theories of category learning were used to identify two processes that may be responsible for the acquisition of decision-making skills: rule learning and exemplar learning. Experiments I and 2 used the process dissociation procedure (L. L. Jacoby, 1998) to evaluate the contribution of these processes to performance. The results suggest that trainees used a mixture of rule and exemplar learning. Furthermore, these learning processes were influenced by different aspects of training structure and design. The goal of Experiment 3 was to develop training techniques that enable trainees to use a rule adaptively. Trainees were tested on cases that represented exceptions to the rule. Unexpectedly, the results suggest that providing general instruction regarding the kinds of conditions in which a decision rule does not apply caused them to fixate on the specific conditions mentioned and impaired their ability to identify other conditions in which the rule might not apply. The theoretical, methodological, and practical implications of the results are discussed.