Aprendizado por Reforço com Valores deInfluência em Sistemas Multi-Agente

We propose a new paradigm for collective learning in multi-agent systems (MAS) as a solution to the problem in which several agents acting over the same environment must learn how to perform tasks, simultaneously, based on feedbacks given by each one of the other agents. We introduce the proposed paradigm in the form of a reinforcement learning algorithm, nominating it as reinforcement learning with influence values. While learning by rewards, each agent evaluates the relation between the current state and/or action executed at this state (actual believe) together with the reward obtained after all agents that are interacting perform their actions. The reward is a result of the interference of others. The agent considers the opinions of all its colleagues in order to attempt to change the values of its states and/or actions. The idea is that the system, as a whole, must reach an equilibrium, where all agents get satisfied with the obtained results. This means that the values of the state/actions pairs match the reward obtained by each agent. This dynamical way of setting the values for states and/or actions makes this new reinforcement learning paradigm the first to include, naturally, the fact that the presence of other agents in the environment turns it a dynamical model. As a direct result, we implicitly include the internal state, the actions and the rewards obtained by all the other agents in the internal state of each agent. This makes our proposal the first complete solution to the conceptual problem that rises when applying reinforcement learning in multi-agent systems, which is caused by the difference existent between the environment and agent models. With basis on the proposed model, we create the IVQ-learning algorithm that is exhaustive tested in repetitive games with two, three and four agents and in stochastic games that need cooperation and in games that need collaboration. This algorithm shows to be a good option for obtaining solutions that guarantee convergence to the Nash optimum equilibrium in cooperative problems. Experiments performed clear shows that the proposed paradigm is theoretical and experimentally superior to the traditional approaches. Yet, with the creation of this new paradigm the set of reinforcement learning applications in MAS grows up. That is, besides the possibility of applying the algorithm in traditional learning problems in MAS, as for example coordination of tasks in multi-robot systems, it is possible to apply reinforcement learning in problems that are essentially collaborative

Não-extensividade em percolação por ligações de longo - alcance

A linear chain do not present phase transition at any finite temperature in a one dimensional system considering only first neighbors interaction. An example is the Ising ferromagnet in which his critical temperature lies at zero degree. Analogously, in percolation like disordered geometrical systems, the critical point is given by the critical probability equals to one. However, this situation can be drastically changed if we consider long-range bonds, replacing the probability distribution by a function like . In this kind of distribution the limit α → ∞ corresponds to the usual first neighbor bond case. In the other hand α = 0 corresponds to the well know "molecular field" situation. In this thesis we studied the behavior of Pc as a function of a to the bond percolation specially in d = 1. Our goal was to check a conjecture proposed by Tsallis in the context of his Generalized Statistics (a generalization to the Boltzmann-Gibbs statistics). By this conjecture, the scaling laws that depend with the size of the system N, vary in fact with the quantitie

Estrutura genética de populações de Amphobotrys ricini, agente causal do mofo cinzento da mamoneira

The gray mold, causal organism Amphobotrys ricini, is one of the major diseases of castor bean. Difficulties in managing plant disease arises form the limited understanding of the genetic structure of A. ricini, their complexity and variability make it difficult to control. Genetic structure can be used to infer the relative impact of different forces that influence the evolution of pathogen populations, that allow to predict the potencial for pathogen populations to envolve in agricultural ecosystems. Growers protect their crop by applying fungicides, but there aren t fungicides to provide significant control of gray mold of castor bean. The objectives of this work were use RAPD to determine the genetic structure of A. ricini subpopulations in Paraíba and assay the sensitivity of A. ricini isolates to azoxystrobin and carbendazim. To determine the genetic structure of A. ricini subpopulations in Paraíba, 23 isolates were colleted from two different geographic location (subpopulation). These isolates were analysed by RAPD using 22 random decamer primers, purchased from OPERON, produced a total of 80 markers polimorphics. The resulting matrixes were analysed using PopGene version 1.32. Sensitivity to azoxystrobin and carbendazim of 30 isolates, colleted form Paraíba and Alagoas, was estimated based on spore germination and colony growth inhibition. The stock solutions were added toV8 medium after sterilization to produce final concentrations of 0, 0.01, 0.1, 1, 10, and 100 µg/ml of carbendazim and 0, 0.001, 0.01, 0.1, 1, and 10 µg/ml of azoxystrobin. All statistical analyses were performed using SAS to estimate the dose that inhibited fungal growth by 50% (ED50 values). The genetic diversity within subpopulations (Hs=0,271) accounted for 92% of the total genetic diversity (Ht=0,293), while genetic diversity between subpopulations (Gst = 0,075) represented only 7,5%. The estimated number of migrants per generation (NM ) was 6,15. Nei s average gene identity across 80 RAPD loci was 0,9468. Individual ED50 values, for the 30 isolates screened for their sensitivity to azoxystrobin, ranged From a maximum of 0,168 µg/ml to a minimum of 0,0036 µg/ml. The ED50 values for carbendazim varied within the range of 0,026 to 0,316 µg/ml

A percepção da fiscalização dos contratos de mão de obra terceirizada pelos agentes envolvidos nesse processo no âmbito da Universidade Federal do Rio Grande do Norte: uma análise sob o modelo do principal-agente

Outsourcing has emerged as one of the new ways of guiding the work. For its advantages and be consistent with the paradigms of managerial reform, outsourcing also started to be used in the Public Administration. However, taking into account the particularities of the latter, some issues are relevant when outsourcing concluded with the State. Gains notoriety, for example, the step of monitoring these contracts, to the extent that, from this activity, we can avoid the negative effects of outsourcing like the fact that the state will pay for labor and wage liens that are obligation of the company providing the services. This study aims to understand the perception that this process is under the Federal University of Rio Grande do Norte, from the point of view of different stakeholders, also explaining the motivations that these agents have to perform the supervisory process. As a theoretical basis was used the Agency Theory, which reinforces the supervisory activities as a necessary means to minimize moral hazard and adverse selection, seeking to understand not only the different motivations tax contracts to properly perform their duties, but also analyze other phenomena arising from this contractual relationship. To achieve the proposed objectives, were taken a literature review and a presentation of how to organize the management and oversight of contracts in UFRN. The methodological procedures included questionnaires and interviews with those involved in the process. After analyzing the results obtained in the survey instruments , and also based on the laws, regulations and instructions governing the procurement process within the UFRN, it was concluded that the process of overseeing the outsourcing of labor contracts in UFRN is not fully institutionalized, some points should be strengthened in order to have the consolidation of this process, highlighting the need for training of UFRN servers that act as tax, the knowledge that the contractual penalties are applied effectively, the need that there is a supervisor of tax of contractors and also the realization of the rotation system of outsourced employees

Agente penitenciário: trabalho no cárcere

Behind the high walls of a prison, there is suffering! Suffering from those who atone to their punishment, from those who work on behalf of an alleged regeneration, suffering that has remained for over two centuries. For those who had their conducts characterized as a crime, many studies have been developed. On the other hand, little is known about the prison servants. This research focused mainly on the identification, from the perspective of the correctional officers from two prisons in different states of Brazil, of the negative influence that their jobs have on them, on the factors that serve as protection, as well as the ones that offer them risk. It was observed that hygiene and security conditions are precarious in both prisons. From the reports, scabies, tuberculosis, hepatitis, H1N1, constant violence, politicization of the working environment, doubled working hours, lack of career planning and salaries emerge as evidence of the place where the bodies who work there are subdued, not taking the differences into account. From the above, and as of the many things that still need to be said about this category, it is reiterated the importance in developing studies about the conditions and the work organization and its implications on the mental health of those workers, who lack of public policies committed to their working realities

Problemas de aprendizagem sobre ligações químicas para estudantes de graduação

This research aims at identifying the learning problems in newly undergraduate students at university, interpreting the nature and causes of these problems, offering subsidies to overcome these difficulties and enabling a meaningful learning through which students give meaning to their learning. As an object for this work was chosen the theme Chemical Bonds - where were studied the forces between atoms to form molecules, compound ions and ionic crystalline structures - and is characterized as one of the most important subjects of Chemistry. In research, it was used a questionnaire with five open questions, answered by 147 students from the early periods of degrees in Chemistry at Universidade Federal do f Rio Grande do Norte. The answers revealed uncertainty on the part of students, both conceptual and representation, with superficial justifications, always using the octet rule to describe models of chemical bonds. Results suggest that these students had inadequate training in high school and that the examinations for entrance into the ranks were made according to flexible criteria less demanding in terms of knowledge. These observations have led to the conclusion that for future changes, it is necessary for high schools and in the early periods in universities favoring the adoption of pedagogical approaches in context and applying strategies to overcome the teaching of superficial memorization on Chemical Bonds, which probably have applied to the teaching of other subjects of chemistry

Síntese de zeólitas tipo ton utilizando um sal de imidazólio como agente direcionador de estrutura

This work reports the synthesis of zeolites with different compositions (pure silica, Si/Ti and Si/Al), via hydroxide and fluoride medium using the cation 1-butyl-3- methylimidazolium as structure directing agent. Initially, the cation was synthesized in chloride form and used for the synthesis in hydroxide medium. An anion-exchange (Cl- for OH-) was required for the synthesis in fluoride medium. Different reactants were used for the formation of gels synthesis, resulting in the crystallization of MFI and TON phases, the latter predominant in many compositions. The cation and synthesized zeolites obtained were characterized by different techniques such as NMR, TG/DTG, XRD, SEM, N2 adsorption and desorption, DRS and EPMA. Besides characterizing the cation and zeolites, the mother liquor of hydroxide synthesis was characterized and it was possible to observe a modification of the cation in the synthesis conditions employed. The materials synthesized in this work can be applied in catalytic reactions and adsorption

Programa Agente jovem em Arez/RN: juventude e violação de direitos

This paper proposes discusses the theme of the youth and of the violation of rights in the context of the Young Agent Program developed in the local authority of Arez/RN, sugar cane region of the Brazilian northeast. We take like empirical reference, the young people in the age group from 15 to 17 years old that were participating of the activities of the Program, in the period of April to July of 2008. Objectives of this study were constituted, economical-partner apprehended the conditions and cultural of the young participants of the Young Agent Program, in the context of violations of rights; as well as the analysis of the limits and means, of the bases theoretician-politician, methodological and of the activities developed in the Program. In the persecution of the objectives we use like methodological instrumental the observation, activities in group with the focal group technique and the application of semi-structured interviews. As result, we notice that the violation of rights of the young persons inserted in the Young Agent Program of Arez sets itself up as reflex of the multiple determinations of the social question, inherent in the capitalist society, specified in the context of the poverty and of the social unequality that they acquire visibility in the hunger, in the unemployment / menial job, in the precarious dwelling, in the low schooling, for lack of leisure, in the violence between others. The approximations systematized in this healthy work relevant for the Unveiling of the reality of the Brazilian youth, specifically of Arez young people, in such a way that they come to subsidize future inquiries, are eaten by me also it promotes the discussion around the way like the Social Politics Programs they are implemented and driven in the capitalist society, in its neoliberal format, where the focusing and the selectivity is put on top to the detriment of the universal access of the democratic rights. So, the great challenge that is put for the XXI century is to cause to the voices from these which they do and this which build this country, in the continuous and tireless search of the rights realization in the struggle against the barbarism installed in the capitalist societycapitalista

O agente comunitário de saúde frente ao processo de trabalho em equipe: facilidades e dificuldades

O estudo propõe-se a analisar as dificuldades e facilidades dos Agentes Comunitários de Saúde (ACS) frente ao trabalho em equipe. A análise pautou-se na perspectiva hermenêutica-dialética, tendo como referência os princípios do método de interpretação dos sentidos. As dificuldades e facilidades apontadas por eles revelam que trabalhar em equipe demanda relações efetivas, com ênfase na comunicação, respeito e cooperação, sendo as reuniões de equipe estratégia importante para isso. Depreende-se a necessidade de constantes investimentos nas relações entre os membros da equipe.

Avaliação cardiocirculatória do sevofluorano como agente de manutenção anestésica em cães, em diferentes concentrações de oxigênio e óxido nitroso

Com o objetivo de avaliar as alterações cardiocirculatórias resultantes da manutenção anestésica com sevofluorano, três grupos de 10 cães cada foram anestesiados por 60 minutos com fluxo diluente de 100% de oxigênio (grupo 1), de 50% de oxigênio e de óxido nitroso (grupo 2) ou 27% de oxigênio e 63% de óxido nitroso (grupo 3). A tranqüilização foi realizada com levomepromazina (0,5 mg/kg) e a indução com tiopental (12,5 mg/kg). A freqüência cardíaca apresentou elevação significativa após a indução (P<0,05), mantendo-se mais alta que a basal, em todos os grupos, durante toda a anestesia. As variações das pressões arteriais sistólica, média e diastólica foram pouco significativas e mantiveram-se em todos os grupos dentro de valores aceitáveis para a espécie e a utilização do óxido nitroso não interferiu nessa variação. O sevofluorano demonstrou ser um bom agente de manutenção anestésica em cães, e a adição de 63% de óxido nitroso ao fluxo diluente de oxigênio reduziu a necessidade anestésica de maneira significativa.

Agente comunitário de saúde: perfil adequado a realidade do Programa Saúde da Família?

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Ação de produtos químicos in vitro e in vivo sobre Clavibacter michiganensis subsp. michiganensis, agente causal do cancro bacteriano do tomateiro

O presente trabalho teve como objetivo avaliar a sensibilidade in vitro e in vivo de um isolado de Clavibacter michiganensis subsp. michiganensis (Cmm) aos produtos cloridrato de kasugamicina, fulusulfamide e oxitetraciclina. Para o teste in vitro, foram avaliados os halos de inibição formados ao redor de discos de papel de filtro umedecidos com os produtos, nas concentrações de 0, 1, 10, 100 e 1000 mig mL-1, 24 h após a instalação do ensaio. Quanto à avaliação dos produtos in vivo, dois ensaios foram instalados sob condições de casa-de-vegetação, com plantas de tomateiro cultivar Ângela Hiper, através da inoculação das plantas por dois métodos: pulverização foliar e ferimento no caule. Nos dois ensaios, as plantas foram pulverizadas com os produtos cloridrato de kasugamicina a 0,06 mL L-1, fulusulfamide a 0,025, 0,05 e 0,075 mL L-1 e oxitetraciclina a 0,40 g L-1, duas vezes antes e duas vezes após a inoculação, em intervalos médios de 5-7 dias. Foram avaliados a incidência de folíolos doentes (inoculação foliar) e a severidade dos sintomas nas plantas inoculadas por ferimento no caule. Verificou-se que o isolado de Cmm foi sensível in vitro ao cloridrato de kasugamicina, ao fulusulfamide e à oxitetraciclina, respectivamente a partir das concentrações de 1000, 100 e 10 mig mL-1. Com relação aos ensaios in vivo, apenas oxitetraciclina propiciou menor incidência de folíolos doentes nas plantas inoculadas através de pulverização foliar; nenhum produto teve êxito em controlar a doença nas plantas inoculadas por ferimento no caule. O fulusulfamide, em todas as concentrações, foi fitotóxico aos folíolos das plantas de tomateiro.

Ácido glicólico: Agente despigmentante e rejuvenescedor

The skin pigmentation caused by ultraviolet light irradiation as a defense against the carcinogenic action of solar light may lead to early skin aging and to hyperchromia, which treatment requires the use of photo-protective, depigmenting and rejuvenating agents. Recently, there have been used many substances for the prevention and/or treatment of skin aging as well as to lowering the skin pigmentation. Glycolic acid is the alpha-hydroxy acid most commonly used in cosmetic and dermatological prepatations. This use is due to its depigmentating and rejuvenating properties and its efficacy at different concentrations, when incorporated to different kind of excipients.

Emprego do reagente de fenton como agente coagulante na remoção de substâncias húmicas de água por meio da flotação por ar dissolvido e filtração

Fenton 's reagent was used as coagulant agent to treat water with high true color (100 ± 5 HU) caused by the introduction of humic substances extracted from peat, using dissolved air flotation. The pair value of coagulant dosage x coagulation pH was optimized to posterior construction of coagulation diagrams, reaching apparent color removal efficiency slightly superior to 60%. It was tried to simulate a treatment with complete cycle, carrying out an experiment with sand filtration after flotation, obtaining an effluent with excellent quality, presenting remnant apparent color, turbidity and absorbance of 253.7 nm less or equal to 2 HU, 0.40 TU and 0.009 cm -1, respectively, and residual total iron < 0.005 mg/L and DOC < 0.001 mg/L.