12 resultados para MARKOV DECISION-PROCESSES

em Universidade Federal do Rio Grande do Norte(UFRN)


Relevância:

80.00% 80.00%

Publicador:

Resumo:

PEDRO, Edilson da Silva. Estratégias para a organização da pesquisa em cana-de-açúcar: uma análise de governança em sistemas de inovação. 2008. 226f. Tese (Doutorado em Política Científica e Tecnológica) - Universidade Estadual de Campinas, Campinas, 2008.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

Techniques of optimization known as metaheuristics have achieved success in the resolution of many problems classified as NP-Hard. These methods use non deterministic approaches that reach very good solutions which, however, don t guarantee the determination of the global optimum. Beyond the inherent difficulties related to the complexity that characterizes the optimization problems, the metaheuristics still face the dilemma of xploration/exploitation, which consists of choosing between a greedy search and a wider exploration of the solution space. A way to guide such algorithms during the searching of better solutions is supplying them with more knowledge of the problem through the use of a intelligent agent, able to recognize promising regions and also identify when they should diversify the direction of the search. This way, this work proposes the use of Reinforcement Learning technique - Q-learning Algorithm - as exploration/exploitation strategy for the metaheuristics GRASP (Greedy Randomized Adaptive Search Procedure) and Genetic Algorithm. The GRASP metaheuristic uses Q-learning instead of the traditional greedy-random algorithm in the construction phase. This replacement has the purpose of improving the quality of the initial solutions that are used in the local search phase of the GRASP, and also provides for the metaheuristic an adaptive memory mechanism that allows the reuse of good previous decisions and also avoids the repetition of bad decisions. In the Genetic Algorithm, the Q-learning algorithm was used to generate an initial population of high fitness, and after a determined number of generations, where the rate of diversity of the population is less than a certain limit L, it also was applied to supply one of the parents to be used in the genetic crossover operator. Another significant change in the hybrid genetic algorithm is the proposal of a mutually interactive cooperation process between the genetic operators and the Q-learning algorithm. In this interactive/cooperative process, the Q-learning algorithm receives an additional update in the matrix of Q-values based on the current best solution of the Genetic Algorithm. The computational experiments presented in this thesis compares the results obtained with the implementation of traditional versions of GRASP metaheuristic and Genetic Algorithm, with those obtained using the proposed hybrid methods. Both algorithms had been applied successfully to the symmetrical Traveling Salesman Problem, which was modeled as a Markov decision process

Relevância:

80.00% 80.00%

Publicador:

Resumo:

Large efforts have been maden by the scientific community on tasks involving locomotion of mobile robots. To execute this kind of task, we must develop to the robot the ability of navigation through the environment in a safe way, that is, without collisions with the objects. In order to perform this, it is necessary to implement strategies that makes possible to detect obstacles. In this work, we deal with this problem by proposing a system that is able to collect sensory information and to estimate the possibility for obstacles to occur in the mobile robot path. Stereo cameras positioned in parallel to each other in a structure coupled to the robot are employed as the main sensory device, making possible the generation of a disparity map. Code optimizations and a strategy for data reduction and abstraction are applied to the images, resulting in a substantial gain in the execution time. This makes possible to the high level decision processes to execute obstacle deviation in real time. This system can be employed in situations where the robot is remotely operated, as well as in situations where it depends only on itself to generate trajectories (the autonomous case)

Relevância:

80.00% 80.00%

Publicador:

Resumo:

In contemporaneousness watches in Brazil the emergence of a "new" relationship between State and society based on partnership, which will allow the growing playacting organizations "non-profit" and "public interest" in the management of social public policies. In that sense, as part of a logic of global restructuring of the Capital, under the aegis of the neoliberal project, starting from the years of 1990, an administration model is had in favor of the market that looks for to minimize the actions of the State, reinforcing the outsourcing of the social public politics, and consequently, debilitating rights legally conquered. In that way, with this study it was pursued as general objective to apprehend the actions developed by Non-governmental Organizations NGOs in the child's area and of the adolescent in Natal / RN, verifying in that measured, these contribute to the warranty of rights or they reproduce practices of welfare work, and as specific objectives: to identify the group of the actions developed by NGOs in the child's area and of the adolescent in Natal / RN; to analyze the practice of NGOs of the point of view of the human resources, of the administration, of the financing, of the user's participation in the decision processes, as well as the quality of the services and the continuity of the actions of these organizations; and to apprehend the relationship between the researched organizations and users in the process of implantation of the actions, in order to identify the perspective that guide the practice of NGOs is going in the direction of contributing in the warranty of rights or in the reinforcement to the welfare work. In summary the results showed two trends in the actions of the NGOs, in the direction of the provision of services, which still unfurls in two perspectives of handouts. The other trend will give priority to the defense of rights of children and adolescents, with actions of political impact strengthen the promotion of public policies state, thus contributing to guarantee rights

Relevância:

80.00% 80.00%

Publicador:

Resumo:

This study analysed the creation of businesses by entrepreneur women in the Currais Novos city, looking for verifying if they used making decision processes aligned to the Effectuation logic throughout the creation of their companies. To this, was accomplished a multiple cases and exploratory study, whit a qualitative approach of analyse, using the thematic life history technique that match accounts and semi-structured interview route, being accomplished like a long interview, where the researcher interact with the informer continuously. The semi-structured interview route was created by the adaptation of the interview route used by Tasic (2007). The present study appealed to a intentional selection of individuals in function of their importance in relation to the boarded theme. This means that the individuals were chosen in function of their social and theoretical representatively inside the considered situation. The participant individuals of this research were five entrepreneur women that act in the Currais Novos city, owners of five different companies. To the data treatment and analyse, was chosen the content analyse technique. This study worked with a priori theoretical categories. The categories of analyse in this study was obtained with base in the Effectuation approach (SARASVATHY, 2001a, 2001b, 2008), that is an alternative model of making decision to the classic model based in the causality principle. These categories are Clarity of Initial Aims , Tolerance to the Lost and Initials Investments , Control of Resources ( who I am , what I know and who I know ) and Promoting Over Contingencies . As result, the entrepreneur women researched, in a general way, hadn t clear initial aims at the companies creation moment, hadn t aversion to the risk to lose the time and the money that they were investing in the company in formation, they highlighted the products and services identity that offered with a strong link with Seridó region, they had experience in the field of activity in which they decided to open their companies, had the commitment of partners in the beginning of the business and they knew to transform the initial difficulties in opportunities. By the end, this study conclude that the entrepreneur women studied used, in a big part, making decision processes aligned to the Effectuation logic throughout the creation of their companies

Relevância:

80.00% 80.00%

Publicador:

Resumo:

This research focuses on raise the discussion of existance tourism policies in Rio Grande do Norte and its contributions to the integration of local communities in the coastal tourist activity. Guided by the background of the neoliberalism and its influence on the model of tourism development adopted in Rio Grande do Norte. For that, were surveyed the concrete realities of coastal localities of the municipalities of Ceará-Mirim, Extremoz, Parnamirim and Nísia Floresta covered by Prodetur-RN I and II, by being part of the tourist portion of the state that have received domestic and international investment and, because are located in the geographical area of the Potiguar capital, Natal. We interviewed the municipal managers and the residents of local communities who live in municipalities more than ten years. Also, was raised a discussion on the role of the state as the main agent of public policies and hegemonic facilitator in the attraction of domestic and foreign investments, with the main scenario the neoliberal model of economic development. Here discuss ways and strategies of socio-political organization of local communities, with regard to the inclusion in the tourist and, pointing to the critical development model in question and signaling other concepts of development model, such as local basis, for example. By the ending of the research, was concluded that the model of development of the tourism in the Rio Grande do Norte is reflected of the way of life of the society, that the communities live in precarious conditions and that the way of inclusion in the tourism is almost incipient. Also, it was possible to detect the inexistence of public politics of tourism that promoted the planning of the tourist activity, as well as, the inclusion of the communities in the decision processes and that, searched the development on the basis of the principles of sustainable and local autonomy

Relevância:

80.00% 80.00%

Publicador:

Resumo:

PEDRO, Edilson da Silva. Estratégias para a organização da pesquisa em cana-de-açúcar: uma análise de governança em sistemas de inovação. 2008. 226f. Tese (Doutorado em Política Científica e Tecnológica) - Universidade Estadual de Campinas, Campinas, 2008.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

The processing of spatial and mnemonic information is believed to depend on hippocampal theta oscillations (5–12 Hz). However, in rats both the power and the frequency of the theta rhythm are modulated by locomotor activity, which is a major confounding factor when estimating its cognitive correlates. Previous studies have suggested that hippocampal theta oscillations support decision-making processes. In this study, we investigated to what extent spatial decision making modulates hippocampal theta oscillations when controlling for variations in locomotion speed. We recorded local field potentials from the CA1 region of rats while animals had to choose one arm to enter for reward (goal) in a four-arm radial maze. We observed prominent theta oscillations during the decision-making period of the task, which occurred in the center of the maze before animals deliberately ran through an arm toward goal location. In speed-controlled analyses, theta power and frequency were higher during the decision period when compared to either an intertrial delay period (also at the maze center), or to the period of running toward goal location. In addition, theta activity was higher during decision periods preceding correct choices than during decision periods preceding incorrect choices. Altogether, our data support a cognitive function for the hippocampal theta rhythm in spatial decision making

Relevância:

30.00% 30.00%

Publicador:

Resumo:

The power-law size distributions obtained experimentally for neuronal avalanches are an important evidence of criticality in the brain. This evidence is supported by the fact that a critical branching process exhibits the same exponent t~3=2. Models at criticality have been employed to mimic avalanche propagation and explain the statistics observed experimentally. However, a crucial aspect of neuronal recordings has been almost completely neglected in the models: undersampling. While in a typical multielectrode array hundreds of neurons are recorded, in the same area of neuronal tissue tens of thousands of neurons can be found. Here we investigate the consequences of undersampling in models with three different topologies (two-dimensional, small-world and random network) and three different dynamical regimes (subcritical, critical and supercritical). We found that undersampling modifies avalanche size distributions, extinguishing the power laws observed in critical systems. Distributions from subcritical systems are also modified, but the shape of the undersampled distributions is more similar to that of a fully sampled system. Undersampled supercritical systems can recover the general characteristics of the fully sampled version, provided that enough neurons are measured. Undersampling in two-dimensional and small-world networks leads to similar effects, while the random network is insensitive to sampling density due to the lack of a well-defined neighborhood. We conjecture that neuronal avalanches recorded from local field potentials avoid undersampling effects due to the nature of this signal, but the same does not hold for spike avalanches. We conclude that undersampled branching-process-like models in these topologies fail to reproduce the statistics of spike avalanches.

Relevância:

30.00% 30.00%

Publicador:

Resumo:

In this work, we present our understanding about the article of Aksoy [1], which uses Markov chains to model the flow of intermittent rivers. Then, we executed an application of his model in order to generate data for intermittent streamflows, based on a data set of Brazilian streams. After that, we build a hidden Markov model as a proposed new approach to the problem of simulation of such flows. We used the Gamma distribution to simulate the increases and decreases in river flows, along with a two-state Markov chain. The motivation for us to use a hidden Markov model comes from the possibility of obtaining the same information that the Aksoy’s model provides, but using a single tool capable of treating the problem as a whole, and not through multiple independent processes

Relevância:

30.00% 30.00%

Publicador:

Resumo:

The processing of spatial and mnemonic information is believed to depend on hippocampal theta oscillations (5–12 Hz). However, in rats both the power and the frequency of the theta rhythm are modulated by locomotor activity, which is a major confounding factor when estimating its cognitive correlates. Previous studies have suggested that hippocampal theta oscillations support decision-making processes. In this study, we investigated to what extent spatial decision making modulates hippocampal theta oscillations when controlling for variations in locomotion speed. We recorded local field potentials from the CA1 region of rats while animals had to choose one arm to enter for reward (goal) in a four-arm radial maze. We observed prominent theta oscillations during the decision-making period of the task, which occurred in the center of the maze before animals deliberately ran through an arm toward goal location. In speed-controlled analyses, theta power and frequency were higher during the decision period when compared to either an intertrial delay period (also at the maze center), or to the period of running toward goal location. In addition, theta activity was higher during decision periods preceding correct choices than during decision periods preceding incorrect choices. Altogether, our data support a cognitive function for the hippocampal theta rhythm in spatial decision making

Relevância:

30.00% 30.00%

Publicador:

Resumo:

The power-law size distributions obtained experimentally for neuronal avalanches are an important evidence of criticality in the brain. This evidence is supported by the fact that a critical branching process exhibits the same exponent t~3=2. Models at criticality have been employed to mimic avalanche propagation and explain the statistics observed experimentally. However, a crucial aspect of neuronal recordings has been almost completely neglected in the models: undersampling. While in a typical multielectrode array hundreds of neurons are recorded, in the same area of neuronal tissue tens of thousands of neurons can be found. Here we investigate the consequences of undersampling in models with three different topologies (two-dimensional, small-world and random network) and three different dynamical regimes (subcritical, critical and supercritical). We found that undersampling modifies avalanche size distributions, extinguishing the power laws observed in critical systems. Distributions from subcritical systems are also modified, but the shape of the undersampled distributions is more similar to that of a fully sampled system. Undersampled supercritical systems can recover the general characteristics of the fully sampled version, provided that enough neurons are measured. Undersampling in two-dimensional and small-world networks leads to similar effects, while the random network is insensitive to sampling density due to the lack of a well-defined neighborhood. We conjecture that neuronal avalanches recorded from local field potentials avoid undersampling effects due to the nature of this signal, but the same does not hold for spike avalanches. We conclude that undersampled branching-process-like models in these topologies fail to reproduce the statistics of spike avalanches.