Algoritmo Q-learning como estratégia de exploração e/ou explotação para metaheurísticas GRASP e algoritmo genético

Techniques of optimization known as metaheuristics have achieved success in the resolution of many problems classified as NP-Hard. These methods use non deterministic approaches that reach very good solutions which, however, don t guarantee the determination of the global optimum. Beyond the inherent difficulties related to the complexity that characterizes the optimization problems, the metaheuristics still face the dilemma of xploration/exploitation, which consists of choosing between a greedy search and a wider exploration of the solution space. A way to guide such algorithms during the searching of better solutions is supplying them with more knowledge of the problem through the use of a intelligent agent, able to recognize promising regions and also identify when they should diversify the direction of the search. This way, this work proposes the use of Reinforcement Learning technique - Q-learning Algorithm - as exploration/exploitation strategy for the metaheuristics GRASP (Greedy Randomized Adaptive Search Procedure) and Genetic Algorithm. The GRASP metaheuristic uses Q-learning instead of the traditional greedy-random algorithm in the construction phase. This replacement has the purpose of improving the quality of the initial solutions that are used in the local search phase of the GRASP, and also provides for the metaheuristic an adaptive memory mechanism that allows the reuse of good previous decisions and also avoids the repetition of bad decisions. In the Genetic Algorithm, the Q-learning algorithm was used to generate an initial population of high fitness, and after a determined number of generations, where the rate of diversity of the population is less than a certain limit L, it also was applied to supply one of the parents to be used in the genetic crossover operator. Another significant change in the hybrid genetic algorithm is the proposal of a mutually interactive cooperation process between the genetic operators and the Q-learning algorithm. In this interactive/cooperative process, the Q-learning algorithm receives an additional update in the matrix of Q-values based on the current best solution of the Genetic Algorithm. The computational experiments presented in this thesis compares the results obtained with the implementation of traditional versions of GRASP metaheuristic and Genetic Algorithm, with those obtained using the proposed hybrid methods. Both algorithms had been applied successfully to the symmetrical Traveling Salesman Problem, which was modeled as a Markov decision process

Influência dos intermediários de distribuição de produtos turísticos no processo de decisão do meio de hospedagem pelo consumidor

This study examines the complex hotel buyer decision process in front of the tourism distribution channels. Its objective is to describe the influence level of the tourism marketing intermediaries, mainly the travel agents and tour operators, over the hotel decision process by the buyer-tourist. The data collection process was done trough a survey with three hundred brazilian tourists hosted in nineteen hotels of Natal, capital of Rio Grande do Norte, Brazil. The data analysis was done using some multivariate statistic techniques as correlation analysis, multiple regression analysis, factor analysis and multiple discriminant analysis. The research characterizes the hotel services consumers profile and his trip, and identifying the distribution channels used by them. Furthermore, the research verifies the intermediaries influence exercised over hotel buyer decision process, looking for identify causality relations between the influence level and the buyer profile. Verifies that information about hotels available on internet reduces the probability that this influence can be practiced; however it was possible identifying those consumers considers this information complementary and non-substitutes than the information from intermediaries. The characteristics of the data do not allow indentifying the factors that constraint the intermediaries influence neither identifying discriminant functions of the specific distribution channel choice by consumers. The study concludes that consumers don t agree in have been influenced by intermediaries or don t know if they have, still considering important to consult them and internet doesn t substitute their function as information source

Modelagem da decisão por pacotes de viagem: um estudo usando processo de hierarquia analítica AHP

The objective of this dissertation is to propose a Multi Criteria Decision Aid Model to be used by the costumers of the travel agencies and help them to choose the best package travel. The main objective is to contribute for the simplification of the travel package decision choice from the identification of the models of values and preference of the customers and applying them to the existing package. It is used the Analytic Hierarchy Process (AHP) method to structuralize a decision hierarchic model composed by six criteria (package cost, hotel category, security of the city, travel time, direct flight and position in ranking of the 10 most visited destination) and five real alternatives of packages for a holiday of three days created from travel agency data. The decision analysis was realized for the choice of a travel package by a group composed by two couples that regularly travels together, to which was asked to do a pairwise judgment of the criteria and the alternatives. The mains results show that, although been a group that travels together, there are different models of values in the weights of the criteria and a certain convergence in the scales of preferences of the alternatives in the criteria. It was not pointed a dominant alternative for all the members of the group separately, but an analysis of a total utility of the group shows a classification and an order of the travel packages and an alternative clearly in front of the others. The sensitivity analysis revels that there are changes in the ranking, but the two alternatives best classified in the normal analysis are the same ones in the sensitivity analysis, although with the positions changed. The analysis also led to a simplification of the process with the exclusion of alternatives dominated for the others ones. As main conclusion, it is evaluated that the model and method suggested allow a simplification of the decision process in the choice of travel packages

Modelagem de decisão na seleção de equipamento: um estudo usando o processo analítico hierárquico na contratação de sondas de perfuração de poços de petróleo

The main goal of this dissertation is to develop a Multi Criteria Decision Aid Model to be used in Oils and Gas perforation rigs contracts choices. The developed model should permit the utilization of multiples criterions, covering problems that exist with models that mainly use the price of the contracts as its decision criterion. The AHP has been chosen because its large utilization, not only academic, but in many other areas, its simplicity of use and flexibility, and also fill all the requirements necessary to complete the task. The development of the model was conducted by interviews and surveys with one specialist in this specific area, who also acts as the main actor on the decision process. The final model consists in six criterions: Costs, mobility, automation, technical support, how fast the service could be concluded and availability to start the operations. Three rigs were chosen as possible solutions for the problem. The results reached by the utilizations of the model suggests that the utilization of AHP as a decision support system in this kind of situation is possible, allowing a simplifications of the problem, and also it s a useful tool to improve every one involved on the process s knowledge about the problem subject, and its possible solutions

Análise da integração dos stakeholders na adoção de estratégias de marketing verde: um estudo em empresa moveleira

This master's thesis aims to ascertain how the Stakeholders interactions influence the adoption of green marketing strategies from the perspective of the Alpha Company, a furniture industry located in Rio Grande do Norte, Brazil. The methodology has a qualitative approach and uses the exploratorydescriptive case study method as model of formal and systematic study. Following the theoretical and conceptual propositions of Polonsky (1995), Michell, Angle and Wood (1997) and Frooman (1999) as a reference base. This study identifies and assesses the importance degree of the relevant stakeholders, shows their expectations and needs and describes the tactics used by the company for the implementation of green marketing strategies. The study describes the reality of a furniture industry in Rio Grande do Norte, and shows his philosophy and background; identifies present stakeholders that influence the decision process of the company and also, analyzes the degree of importance of each group showing their needs and expectations and, finally, it states the changes in the organization with the implementation of green marketing strategies. The results it s concluded that stakeholders are taken into consideration in the adoption of green marketing strategies, even without a proper strategic perception from the company, an imperative to advance towards the adoption of the green marketing philosophy. This case study explores knowledge that may be used and suited to small companies that act in the strategic segment-trend of green marketing

Terceirização em tecnologia da informação sob os aspectos de estratégia, tomada de decisão e análise de investimentos :estudo de múltiplos casos em três organizações franqueadas da Coca-Cola do Brasil

Desde a criação da tecnologia e do seu uso pelas empresas, a relação custo e benefício nem sempre foi bem elucidada tanto para os responsáveis pela área de tecnologia quanto para a alta direção. Mas, apesar disto, cada vez mais as organizações investem maciçamente em tecnologia, esperando que esta seja a solução para diversos problemas. Por isto, esta questão tem se tornado crucial para o processo de tomada de decisões, visto que investimentos nesta área costumam ser dispendiosos e, na atual conjuntura, estas análises precisam ser extremamente criteriosas para que se miniminizem as possibilidades de insucesso dos projetos, principalmente numa economia estabilizada e de concorrência acirrada. Uma das alternativas que as empresas têm buscado para atingir o sucesso e correr menos riscos é a terceirização da área de TI. Partindo desta visão, a presente dissertação tem por objetivo realizar uma investigação sobre a terceirização dos serviços de TI em todos os seus aspectos, isto é, desde a sua motivação, serviços efetivamente terceirizados, vantagens, desvantagens e possíveis obstáculos, a visão do alinhamento estratégico da TI, os processos de gestão de contratos e formas de controle e, por fim, tendências futuras. Trata-se de uma pesquisa de múltiplos casos, envolvendo franquias do Sistema Coca-Cola no Brasil. O estudo apresenta uma pesquisa bibliográfica sobre o processo de tomada de decisão empresarial, a análise de investimentos, a gestão e a terceirização da TI, o que permitem definir as dimensões de análise da pesquisa. Na pesquisa de campo foram entrevistados os gerentes da área de TI, nas cidades de Brasília-DF, Goiânia-GO e Ribeirão Preto-SP. A pesquisa de campo permitiu identificar como as mesmas avaliam seus investimentos em TI, como esta área é gerenciada, o que as levou a optar pela terceirização e como os processos terceirizados afetam a organização. Por se tratar de uma pesquisa qualitativa, optou-se por analisar comparativamente as três organizações. Com a realização deste estudo, obtiveram-se, como principais resultados, que as organizações estão utilizando a terceirização em TI para focar no negócio principal e, mesmo encontrando diversas desvantagens, inclusive com relação a custos, acreditam que os benefícios justificam. Ainda identificaram-se alguns obstáculos internos para a terceirização, principalmente quanto ao receio de se perder a inteligência do negócio. O acompanhamento dessas atividades terceirizadas é realizado pela equipe interna e por critérios estruturados, onde se verificam os níveis de serviço

Agentes Inteligentes com Foco de Atenção Afetivo em Simulações Baseadas em Agentes

Simulations based on cognitively rich agents can become a very intensive computing task, especially when the simulated environment represents a complex system. This situation becomes worse when time constraints are present. This kind of simulations would benefit from a mechanism that improves the way agents perceive and react to changes in these types of environments. In other worlds, an approach to improve the efficiency (performance and accuracy) in the decision process of autonomous agents in a simulation would be useful. In complex environments, and full of variables, it is possible that not every information available to the agent is necessary for its decision-making process, depending indeed, on the task being performed. Then, the agent would need to filter the coming perceptions in the same as we do with our attentions focus. By using a focus of attention, only the information that really matters to the agent running context are perceived (cognitively processed), which can improve the decision making process. The architecture proposed herein presents a structure for cognitive agents divided into two parts: 1) the main part contains the reasoning / planning process, knowledge and affective state of the agent, and 2) a set of behaviors that are triggered by planning in order to achieve the agent s goals. Each of these behaviors has a runtime dynamically adjustable focus of attention, adjusted according to the variation of the agent s affective state. The focus of each behavior is divided into a qualitative focus, which is responsible for the quality of the perceived data, and a quantitative focus, which is responsible for the quantity of the perceived data. Thus, the behavior will be able to filter the information sent by the agent sensors, and build a list of perceived elements containing only the information necessary to the agent, according to the context of the behavior that is currently running. Based on the human attention focus, the agent is also dotted of a affective state. The agent s affective state is based on theories of human emotion, mood and personality. This model serves as a basis for the mechanism of continuous adjustment of the agent s attention focus, both the qualitative and the quantative focus. With this mechanism, the agent can adjust its focus of attention during the execution of the behavior, in order to become more efficient in the face of environmental changes. The proposed architecture can be used in a very flexibly way. The focus of attention can work in a fixed way (neither the qualitative focus nor the quantitaive focus one changes), as well as using different combinations for the qualitative and quantitative foci variation. The architecture was built on a platform for BDI agents, but its design allows it to be used in any other type of agents, since the implementation is made only in the perception level layer of the agent. In order to evaluate the contribution proposed in this work, an extensive series of experiments were conducted on an agent-based simulation over a fire-growing scenario. In the simulations, the agents using the architecture proposed in this work are compared with similar agents (with the same reasoning model), but able to process all the information sent by the environment. Intuitively, it is expected that the omniscient agent would be more efficient, since they can handle all the possible option before taking a decision. However, the experiments showed that attention-focus based agents can be as efficient as the omniscient ones, with the advantage of being able to solve the same problems in a significantly reduced time. Thus, the experiments indicate the efficiency of the proposed architecture

Aplicação de ontologias para métodos de negociação de um sistema multiagente para o reconhecimento de padrões

The use of intelligent agents in multi-classifier systems appeared in order to making the centralized decision process of a multi-classifier system into a distributed, flexible and incremental one. Based on this, the NeurAge (Neural Agents) system (Abreu et al 2004) was proposed. This system has a superior performance to some combination-centered methods (Abreu, Canuto, and Santana 2005). The negotiation is important to the multiagent system performance, but most of negotiations are defined informaly. A way to formalize the negotiation process is using an ontology. In the context of classification tasks, the ontology provides an approach to formalize the concepts and rules that manage the relations between these concepts. This work aims at using ontologies to make a formal description of the negotiation methods of a multi-agent system for classification tasks, more specifically the NeurAge system. Through ontologies, we intend to make the NeurAge system more formal and open, allowing that new agents can be part of such system during the negotiation. In this sense, the NeurAge System will be studied on the basis of its functioning and reaching, mainly, the negotiation methods used by the same ones. After that, some negotiation ontologies found in literature will be studied, and then those that were chosen for this work will be adapted to the negotiation methods used in the NeurAge.

Serviço de nuvem pública e sua relação com os arranjos de governança de TI e o alinhamento estratégico

Increasingly, the Information Technology (IT) has been used to sustain the business strategies, causing increased its relevance. Therefore IT governance is seen as one of the priorities of organizations at the time. The search for strategic alignment between business and IT is debated as a factor for business success, but even with that importance, usually the main business managers are reluctant to take responsibility for decisions involving IT, mainly due to the complexity of your infrastructure. Since cloud computing is being seen as an element capable of assisting in the implementation of organizational strategies, because their characteristics enable greater efficiency and agility in IT, and is considered as a new computing paradigm. The main objective of the analyze the relationship between IT governance arrangements and strategic alignment with the infrastructure as a service (IaaS) of public cloud computing. Therefore, an exploratory, descriptive and inferential was developed, with approach to the problem of quantitatively research, with descriptive survey method and cross section. An electronic questionnaire that was applied to the ISACA chapters Associates of São Paulo and the Distrito Federal, totaling 164 respondents was used. The instrument used based on the theories of Weill and Ross (2006) for array of IT governance arrangement; Henderson and Venkatraman (1993) and Luftman (2000), for maturity of the strategic alignment model; and NIST (2011 b), ITGI (2007) and CSA (2010) for infrastructure maturity as a service (IaaS) public in its essential characteristics. As regards the main results, this research proved that with public IaaS decision-making structures have changed, with a greater participation of senior executives in all five key IT decisions (IT governance arrangement array) including more technical decisions as architecture and IT infrastructure. With increased participation of senior executives the decrease was also observed in the share of IT specialists, characterizing the decision process with the duopoly archetype (shared decision). With regard to strategic alignment, it was observed that it changes with cloud computing, and organizations with public IaaS, a maturity of strategic alignment with statistically significant and greater difference when compared to organizations without IaaS. The maturity of public IaaS is at the intermediate level (level 3 - "defined process"), with the elasticity and measurement achieved level 4 - "managed and measurable" It was also possible to infer in organizations with public IaaS, there are positive correlations between the key decisions and the maturity of IaaS, especially at the beginning, architecture and infrastructure, and the archetypes involving senior executives and IT specialists. In the correlation between the maturity and mature strategic alignment of public IaaS therefore the higher the strategic alignment, the greater the maturity of the public IaaS and vice versa.

Influência dos intermediários de distribuição de produtos turísticos no processo de decisão do meio de hospedagem pelo consumidor

This study examines the complex hotel buyer decision process in front of the tourism distribution channels. Its objective is to describe the influence level of the tourism marketing intermediaries, mainly the travel agents and tour operators, over the hotel decision process by the buyer-tourist. The data collection process was done trough a survey with three hundred brazilian tourists hosted in nineteen hotels of Natal, capital of Rio Grande do Norte, Brazil. The data analysis was done using some multivariate statistic techniques as correlation analysis, multiple regression analysis, factor analysis and multiple discriminant analysis. The research characterizes the hotel services consumers profile and his trip, and identifying the distribution channels used by them. Furthermore, the research verifies the intermediaries influence exercised over hotel buyer decision process, looking for identify causality relations between the influence level and the buyer profile. Verifies that information about hotels available on internet reduces the probability that this influence can be practiced; however it was possible identifying those consumers considers this information complementary and non-substitutes than the information from intermediaries. The characteristics of the data do not allow indentifying the factors that constraint the intermediaries influence neither identifying discriminant functions of the specific distribution channel choice by consumers. The study concludes that consumers don t agree in have been influenced by intermediaries or don t know if they have, still considering important to consult them and internet doesn t substitute their function as information source

Modelagem de usinas eólicas através de um processo de Markov e técnicas de confiabilidade para a estimativa anual da energia produzida

This study aims to use a computational model that considers the statistical characteristics of the wind and the reliability characteristics of a wind turbine, such as failure rates and repair, representing the wind farm by a Markov process to determine the estimated annual energy generated, and compare it with a real case. This model can also be used in reliability studies, and provides some performance indicators that will help in analyzing the feasibility of setting up a wind farm, once the power curve is known and the availability of wind speed measurements. To validate this model, simulations were done using the database of the wind farm of Macau PETROBRAS. The results were very close to the real, thereby confirming that the model successfully reproduced the behavior of all components involved. Finally, a comparison was made of the results presented by this model, with the result of estimated annual energy considering the modeling of the distribution wind by a statistical distribution of Weibull

Predição de promotores de Bacillus subtilis usando técnicas de aprendizado de máquina

One of the most important goals of bioinformatics is the ability to identify genes in uncharacterized DNA sequences on world wide database. Gene expression on prokaryotes initiates when the RNA-polymerase enzyme interacts with DNA regions called promoters. In these regions are located the main regulatory elements of the transcription process. Despite the improvement of in vitro techniques for molecular biology analysis, characterizing and identifying a great number of promoters on a genome is a complex task. Nevertheless, the main drawback is the absence of a large set of promoters to identify conserved patterns among the species. Hence, a in silico method to predict them on any species is a challenge. Improved promoter prediction methods can be one step towards developing more reliable ab initio gene prediction methods. In this work, we present an empirical comparison of Machine Learning (ML) techniques such as Na¨ýve Bayes, Decision Trees, Support Vector Machines and Neural Networks, Voted Perceptron, PART, k-NN and and ensemble approaches (Bagging and Boosting) to the task of predicting Bacillus subtilis. In order to do so, we first built two data set of promoter and nonpromoter sequences for B. subtilis and a hybrid one. In order to evaluate of ML methods a cross-validation procedure is applied. Good results were obtained with methods of ML like SVM and Naïve Bayes using B. subtilis. However, we have not reached good results on hybrid database

Integrating strategic and sustainable design approach for innovation process: a cement case study

Global society and technology have changed the relationships of the market. Quality and cost are not the main aspects of any industrial product. On the other hand, design, innovation and sustainability became significant requirements to company’s competitiveness. In this context, the design approach has shown evolutions, integrating social and environmental aspects beside traditional aspects such as technical and economic. Still, design has been becoming a strategic opportunity for companies, improving their competitiveness and increasing their market share. Thus, this research has analyzed the integration of both the Sustainable Design and Strategic Design Coaching (SDC) method in the making decision activities of companies. A cement company (BQMIL) was assigned as case study, in which the previous results have pointed out the significant hole of those concepts to generate Eco-innovation and Eco-Brand to increase its market share, corroborating the expectative of the design team

Estimação paramétrica e não-paramétrica em modelos de markov ocultos

In this work we study the Hidden Markov Models with finite as well as general state space. In the finite case, the forward and backward algorithms are considered and the probability of a given observed sequence is computed. Next, we use the EM algorithm to estimate the model parameters. In the general case, the kernel estimators are used and to built a sequence of estimators that converge in L1-norm to the density function of the observable process

Ajuste preventivo versus ajuste corretivo no controle on-line de processo do número de não-conformidades num item inspecionado

In production lines, the entire process is bound to unexpected happenings which may cost losing the production quality. Thus, it means losses to the manufacturer. Identify such causes and remove them is the task of the processing management. The on-line control system consists of periodic inspection of every month produced item. Once any of those items is quali ed as not t, it is admitted that a change in the fraction of the items occurred, and then the process is stopped for adjustments. This work is an extension of Quinino & Ho (2010) and has as objective main to make the monitoramento in a process through the control on-line of quality for the number of non-conformities about the inspected item. The strategy of decision to verify if the process is under control, is directly associated to the limits of the graphic control of non-conformities of the process. A policy of preventive adjustments is incorporated in order to enlarge the conforming fraction of the process. With the help of the R software, a sensibility analysis of the proposed model is done showing in which situations it is most interesting to execute the preventive adjustment