932 resultados para Markov Decision Process


Relevância:

90.00% 90.00%

Publicador:

Resumo:

We derive necessary and sufficient conditions for the existence of bounded or summable solutions to systems of linear equations associated with Markov chains. This substantially extends a famous result of G. E. H. Reuter, which provides a convenient means of checking various uniqueness criteria for birth-death processes. Our result allows chains with much more general transition structures to be accommodated. One application is to give a new proof of an important result of M. F. Chen concerning upwardly skip-free processes. We then use our generalization of Reuter's lemma to prove new results for downwardly skip-free chains, such as the Markov branching process and several of its many generalizations. This permits us to establish uniqueness criteria for several models, including the general birth, death, and catastrophe process, extended branching processes, and asymptotic birth-death processes, the latter being neither upwardly skip-free nor downwardly skip-free.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

We extend the Harris regularity condition for ordinary Markov branching process to a more general case of non-linear Markov branching process. A regularity criterion which is very easy to check is obtained. In particular, we prove that a super-linear Markov branching process is regular if and only if the per capita offspring mean is less than or equal to I while a sub-linear Markov branching process is regular if the per capita offspring mean is finite. The Harris regularity condition then becomes a special case of our criterion.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

This note provides a new probabilistic approach in discussing the weighted Markov branching process (WMBP) which is a natural generalisation of the ordinary Markov branching process. Using this approach, some important characteristics regarding the hitting times of such processes can be easily obtained. In particular, the closed forms for the mean extinction time and conditional mean extinction time are presented. The explosion behaviour of the process is investigated and the mean explosion time is derived. The mean global holding time and the mean total survival time are also obtained. The close link between these newly developed processes and the well-known compound Poisson processes is investigated. It is revealed that any weighted Markov branching process (WMBP) is a random time change of a compound Poisson process.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

This article reports results of an experiment designed to analyze the link between risky decisions made by couples and risky decisions made separately by each spouse. We estimate both the spouses and the couples' degrees of risk aversion, we assess how the risk preferences of the two spouses aggregate when they make risky decisions, and we shed light on the dynamics of the decision process that takes place when couples make risky decisions. We find that, far from being fixed, the balance of power within the household is malleable. In most couples, men have, initially, more decision-making power than women but women who ultimately implement the joint decisions gain more and more power over the course of decision making.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

La tâche de kinématogramme de points aléatoires est utilisée avec le paradigme de choix forcé entre deux alternatives pour étudier les prises de décisions perceptuelles. Les modèles décisionnels supposent que les indices de mouvement pour les deux alternatives sont encodés dans le cerveau. Ainsi, la différence entre ces deux signaux est accumulée jusqu’à un seuil décisionnel. Cependant, aucune étude à ce jour n’a testé cette hypothèse avec des stimuli contenant des mouvements opposés. Ce mémoire présente les résultats de deux expériences utilisant deux nouveaux stimuli avec des indices de mouvement concurrentiels. Parmi une variété de combinaisons d’indices concurrentiels, la performance des sujets dépend de la différence nette entre les deux signaux opposés. De plus, les sujets obtiennent une performance similaire avec les deux types de stimuli. Ces résultats supportent un modèle décisionnel basé sur l’accumulation des indices de mouvement net et suggèrent que le processus décisionnel peut intégrer les signaux de mouvement à partir d’une grande gamme de directions pour obtenir un percept global de mouvement.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

This paper describes a new statistical, model-based approach to building a contact state observer. The observer uses measurements of the contact force and position, and prior information about the task encoded in a graph, to determine the current location of the robot in the task configuration space. Each node represents what the measurements will look like in a small region of configuration space by storing a predictive, statistical, measurement model. This approach assumes that the measurements are statistically block independent conditioned on knowledge of the model, which is a fairly good model of the actual process. Arcs in the graph represent possible transitions between models. Beam Viterbi search is used to match measurement history against possible paths through the model graph in order to estimate the most likely path for the robot. The resulting approach provides a new decision process that can be use as an observer for event driven manipulation programming. The decision procedure is significantly more robust than simple threshold decisions because the measurement history is used to make decisions. The approach can be used to enhance the capabilities of autonomous assembly machines and in quality control applications.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

In recent years there has been a significantly rising trend amongst consumers for health and environmental issues, which has resulted in greater attention for and sales of organic food. Organic food production strives to use natural resources, such as land, energy and water in a sustainable way and the products does not contain artificial fertilizers or chemical pesticides. However, organic food products are also often more expensive and less available in comparison to conventional food products. Despite this, interest for and sales of organic food products have increased around the globe, and in Sweden particularly, the increase in sales has grown largely from an international perspective. This thesis is of qualitative character and is focused on studying some consumers from the Swedish market of organic food. The purpose of this thesis is to contribute with a better understanding on the buying decision process regarding organic food purchase. To achieve this, the authors have studied some consumers that purchase organic food and have searched for patterns that could be identified in the decision process. The consumer buying decision process model has been used for portrayal of the chosen consumers’ decision to purchase organic food products. Interviews with six Swedish consumers were conducted, whereas each respondent continuously purchase organic food products. Results show that the purchase of organic food products begins with discovering an unsatisfied need state, which the consumers of this study desired to change with the purchase of organic food products. This study show how six consumers reason when passing through the stages of the buying decision process, in order to satisfy their desired need state. The authors found that the respondents feel satisfied with purchasing organic food products, which lead them in to continuously buying these products. Altogether, the findings contribute with knowledge that can come to be helpful when wanting to understand more about the consumer decision to purchase organic food.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

The increasingly complex organisational environment has made certainty in decision-making difficult. Sometimes careful consideration comes before decisions, but sometimes rushed decisions are made. Successful outcomes can often follow from either process, but exactly why each approach works needs to be examined. A return to the epistemological bases of common sense and intuition can help to clarify the decision process for managers in the current environment. The paper starts with perspectives on the similarities and differences between common sense and intuition, drills down to the rational and empirical foundations of each, and then introduces a decision-making matrix that portrays the conceptual basis of intuition and common sense in the actions and reactions of the decision-makers. Primarily, this is a theoretical paper incorporating literature review and authors’ analysis of the interaction of common sense and intuition when making decisions. We conclude that it is pertinent to accept intuition as a valuable complement to common sense, and it is anticipated that the different perspective can facilitate the merging of critical countervailing concepts in the management decision-making process.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

Realizing value from IT investments continues to be a challenge for most healthcare organizations. IT governance (ITG) is envisaged to solve many of these challenges. ITG is the practice that establishes accountability framework for IT investments by allocating decision rights among major participants involved in IT decision processes. As ITG is relatively new in healthcare industry, it is expected that knowledge about how healthcare organizations govern their IT decisions is limited. This research aims to extend this knowledge and to assist both researchers and professionals by providing insights on how IT decisions are made and governed in healthcare organizations (HOs). This research adopts case-study methodology to investigate IT governance in two distinctly different HOs. The research findings indicate that HOs implement ITG to achieve alignment between business objectives and IT. Both HOs set up a five-stage IT decision process to identify, evaluate and prioritize IT investment ideas. They also established generic committee-structures that clearly defined roles and decision authorities to govern such process. It is suggested here that ITG in HOs is heavily influenced by strategic priorities, organizational structure, governance experience and governmental initiatives. Effective ITG in HOs is challenged by IT alignment, policy government, involvement of healthcare executives, and lack of business metrics to justify and evaluate decisions. The research proposes recommendations to address these challenges.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

Thousands of the world's offshore oil and gas structures are approaching obsolescence and will require decommissioning within the next decade. Many nations have blanket regulations requiring obsolete structures to be removed, yet this option is unlikely to yield optimal environmental, societal and economic outcomes in all situations. We propose that nations adopt a flexible approach that allows decommissioning options to be selected from the full range of alternatives (including 'rigs-to-reefs' options) on a case-by-case basis. We outline a method of multi-criteria decision analysis (Multi-criteria Approval, MA) for evaluating and comparing alternative decommissioning options across key selection criteria, including environmental, financial, socioeconomic, and health and safety considerations. The MA approach structures the decision problem, forces explicit consideration of trade-offs and directly involves stakeholder groups in the decision process. We identify major decommissioning options and provide a generic list of selection criteria for inclusion in the MA decision process. To deal with knowledge gaps concerning environmental impacts of decommissioning, we suggest that expert opinion feed into the MA approach until sufficient data become available. We conducted a limited trial of the MA decision approach to demonstrate its application to a complex and controversial decommissioning scenario; Platform Grace in southern California. The approach indicated, for this example, that the option 'leave in place intact' would likely provide best environmental outcomes in the event of future decommissioning. In summary, the MA approach will allow the environmental, social, and economic impacts of decommissioning decisions to be assessed simultaneously in a transparent manner. © 2013 Elsevier Ltd.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

Crowdfunding é um método recente e emergente de captar dinheiro para desenvolvimento de projetos (tanto orientados a lucro ou não) sem a intermediação tradicional de instituições financeiras, liberando empreendedores de custos, regulações e burocracia associada a essa prática. Além disso, também é um método de pré-testar novos produtos com um público selecionado e entusiasmado. O objetivo dessa dissertação é entender que fatores estão influenciando a decisão do consumidor de investir em projetos. A literatura contribui com: (1) fatores intrínsecos, como desejo de patronagem; (2) fatores extrínsecos, como a apresentação do projeto; e (3) pressão social. Há ainda fatores associados com o nível atual de captação e número de investidores, assim como tipo de projeto envolvido, sendo ele de caridade ou não. Além disso, atitudes também possuem um papel em afetar a decisão de compra. Para responder a pergunta de pesquisa, uma metodologia de duas fases foi usada: uma entrevista de profundidade para capturar intenção de investir e motivação, de forma a construir um processo de decisão que englobasse todas as possibilidades descritas pela literatura. Após essa pesquisa qualitativa, uma pesquisa quantitativa foi feita para validar as informações coletadas pela fase anterior e coletar dados adicionais para gerar uma associação entre intenção de investir e comportamento. Dentre as informações geradas pela fase qualitativa, temos o fato que a maioria dos investidores tiveram como principal motivação a compra do produto sendo oferecido como se eles estivessem participando de uma pré-venda. Entretanto, essa não foi a principal razão para o investidor de caridade. Além disso, os respondentes que pré-compraram os produtos o fizeram para única razão que esses produtos satisfizeram desejos que tinham. Esses desejos variavam, sendo desde saudade de jogos antigos como resolver um problema de organização da carteira. Outra característica da pré-compra foi que eles não investiam valores simbólicos, pela razão que se o fizessem não receberiam o produto em troca. Recompensas tiveram um grande papel em atrair os respondentes para investimento em valores maiores que consideravam anteriormente. Também é verdade para o investidor em caridade, que também doou mais. A fase quantitativa confirmou as informações acima e gerou informação extra sobre as categorias de produto. Projetos de caridade e arte concentraram a maioria dos respondentes que disseram que a principal razão para investir foi basicamente ajudar a desenvolver o projeto sem demandar um produto em retorno. Entretanto, outros projetos como Música também apresentaram altos números de comportamento caridoso, possivelmente por causa do envolvimento emocional com o artista. Outras categorias apresentaram um mix de razões para investir ou enviesado a comprar o produto apenas, o que pode ser explicado pelo efeito de recompensas e pelo fato que essas categorias estão simplesmente pré-vendendo produtos. Essa pesquisa também confirmou as principais fontes usadas para conhecer mais sobre os projetos: recomendação pessoal e blogs e fóruns. Outro resultado dessa fase foi o desenvolvimento de fatores a partir de frases atitudinais que puderam explicar intenção de investir. Seis fatores foram criados: Entusiasmo (por crowdfunding), Exclusividade (compra de recompensas), Caridade (doações pequenas para ajudar o desenvolvimento do projeto), Cautela (similar à difusão de responsabilidade, isto é, espera por mais investidores para dar o primeiro passo), Intimidade (projeto foi recomendado ou há ligação emocional com o criador) e Compartilhamento (compartilhar para ajudar a trazer mais investidores para o projeto). Categorias com alto envolvimento emocional apresentaram associação com Intimidade, como música, filme e tecnologia. Dado o fato que a amostra não continha muitos entusiastas por crowdfunding, esse fator não apresentou qualquer associação com as categorias. Categorias que não entregam produtos em troca, como comida e fotografia, apresentaram altos níveis de associação com o fator caridade. Compartilhamento é altamente associado com tecnologia, dado o fato que essa categoria concentra os respondentes que são mais orientados à inovação e entusiastas sobre o produto, então precisam compartilhar e gerar boca-a-boca para ajudar a atingir a meta de investimento.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

This paper studies the asymptotic optimality of discrete-time Markov decision processes (MDPs) with general state space and action space and having weak and strong interactions. By using a similar approach as developed by Liu, Zhang, and Yin [Appl. Math. Optim., 44 (2001), pp. 105-129], the idea in this paper is to consider an MDP with general state and action spaces and to reduce the dimension of the state space by considering an averaged model. This formulation is often described by introducing a small parameter epsilon > 0 in the definition of the transition kernel, leading to a singularly perturbed Markov model with two time scales. Our objective is twofold. First it is shown that the value function of the control problem for the perturbed system converges to the value function of a limit averaged control problem as epsilon goes to zero. In the second part of the paper, it is proved that a feedback control policy for the original control problem defined by using an optimal feedback policy for the limit problem is asymptotically optimal. Our work extends existing results of the literature in the following two directions: the underlying MDP is defined on general state and action spaces and we do not impose strong conditions on the recurrence structure of the MDP such as Doeblin's condition.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

We study the decision process in a group dictator game in which three subjects can distribute an initial endowment between themselves and a group of recipients. The experiment consists of two stages; first, individuals play a standard dictator game. Second, individuals are randomly matched into groups of three and communicate via instant messaging regarding the decision in the group dictator game. In contrast to former studies our results show that group decisions do not differ from individual decisions in the dictator game. Furthermore, the analysis of the chat history reveals that players make proposals according to their preferences as revealed in the single dictator game and that these proposals in groups drive the final allocation.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

Decision strategies aim at enabling reasonable decisions in cases of uncertain policy decision problems which do not meet the conditions for applying standard decision theory. This paper focuses on decision strategies that account for uncertainties by deciding whether a proposed list of policy options should be accepted or revised (scope strategies) and whether to decide now or later (timing strategies). They can be used in participatory approaches to structure the decision process. As a basis, we propose to classify the broad range of uncertainties affecting policy decision problems along two dimensions, source of uncertainty (incomplete information, inherent indeterminacy and unreliable information) and location of uncertainty (information about policy options, outcomes and values). Decision strategies encompass multiple and vague criteria to be deliberated in application. As an example, we discuss which decision strategies may account for the uncertainties related to nutritive technologies that aim at reducing methane (CH4) emissions from ruminants as a means of mitigating climate change, limiting our discussion to published scientific information. These considerations not only speak in favour of revising rather than accepting the discussed list of options, but also in favour of active postponement or semi-closure of decision-making rather than closure or passive postponement.

Relevância:

90.00% 90.00%

Publicador:

Resumo:

PURPOSE The decision-making process plays a key role in organizations. Every decision-making process produces a final choice that may or may not prompt action. Recurrently, decision makers find themselves in the dichotomous question of following a traditional sequence decision-making process where the output of a decision is used as the input of the next stage of the decision, or following a joint decision-making approach where several decisions are taken simultaneously. The implication of the decision-making process will impact different players of the organization. The choice of the decision- making approach becomes difficult to find, even with the current literature and practitioners’ knowledge. The pursuit of better ways for making decisions has been a common goal for academics and practitioners. Management scientists use different techniques and approaches to improve different types of decisions. The purpose of this decision is to use the available resources as well as possible (data and techniques) to achieve the objectives of the organization. The developing and applying of models and concepts may be helpful to solve managerial problems faced every day in different companies. As a result of this research different decision models are presented to contribute to the body of knowledge of management science. The first models are focused on the manufacturing industry and the second part of the models on the health care industry. Despite these models being case specific, they serve the purpose of exemplifying that different approaches to the problems and could provide interesting results. Unfortunately, there is no universal recipe that could be applied to all the problems. Furthermore, the same model could deliver good results with certain data and bad results for other data. A framework to analyse the data before selecting the model to be used is presented and tested in the models developed to exemplify the ideas. METHODOLOGY As the first step of the research a systematic literature review on the joint decision is presented, as are the different opinions and suggestions of different scholars. For the next stage of the thesis, the decision-making process of more than 50 companies was analysed in companies from different sectors in the production planning area at the Job Shop level. The data was obtained using surveys and face-to-face interviews. The following part of the research into the decision-making process was held in two application fields that are highly relevant for our society; manufacturing and health care. The first step was to study the interactions and develop a mathematical model for the replenishment of the car assembly where the problem of “Vehicle routing problem and Inventory” were combined. The next step was to add the scheduling or car production (car sequencing) decision and use some metaheuristics such as ant colony and genetic algorithms to measure if the behaviour is kept up with different case size problems. A similar approach is presented in a production of semiconductors and aviation parts, where a hoist has to change from one station to another to deal with the work, and a jobs schedule has to be done. However, for this problem simulation was used for experimentation. In parallel, the scheduling of operating rooms was studied. Surgeries were allocated to surgeons and the scheduling of operating rooms was analysed. The first part of the research was done in a Teaching hospital, and for the second part the interaction of uncertainty was added. Once the previous problem had been analysed a general framework to characterize the instance was built. In the final chapter a general conclusion is presented. FINDINGS AND PRACTICAL IMPLICATIONS The first part of the contributions is an update of the decision-making literature review. Also an analysis of the possible savings resulting from a change in the decision process is made. Then, the results of the survey, which present a lack of consistency between what the managers believe and the reality of the integration of their decisions. In the next stage of the thesis, a contribution to the body of knowledge of the operation research, with the joint solution of the replenishment, sequencing and inventory problem in the assembly line is made, together with a parallel work with the operating rooms scheduling where different solutions approaches are presented. In addition to the contribution of the solving methods, with the use of different techniques, the main contribution is the framework that is proposed to pre-evaluate the problem before thinking of the techniques to solve it. However, there is no straightforward answer as to whether it is better to have joint or sequential solutions. Following the proposed framework with the evaluation of factors such as the flexibility of the answer, the number of actors, and the tightness of the data, give us important hints as to the most suitable direction to take to tackle the problem. RESEARCH LIMITATIONS AND AVENUES FOR FUTURE RESEARCH In the first part of the work it was really complicated to calculate the possible savings of different projects, since in many papers these quantities are not reported or the impact is based on non-quantifiable benefits. The other issue is the confidentiality of many projects where the data cannot be presented. For the car assembly line problem more computational power would allow us to solve bigger instances. For the operation research problem there was a lack of historical data to perform a parallel analysis in the teaching hospital. In order to keep testing the decision framework it is necessary to keep applying more case studies in order to generalize the results and make them more evident and less ambiguous. The health care field offers great opportunities since despite the recent awareness of the need to improve the decision-making process there are many opportunities to improve. Another big difference with the automotive industry is that the last improvements are not spread among all the actors. Therefore, in the future this research will focus more on the collaboration between academia and the health care sector.