Aprendizado por Reforço com Valores deInfluência em Sistemas Multi-Agente

We propose a new paradigm for collective learning in multi-agent systems (MAS) as a solution to the problem in which several agents acting over the same environment must learn how to perform tasks, simultaneously, based on feedbacks given by each one of the other agents. We introduce the proposed paradigm in the form of a reinforcement learning algorithm, nominating it as reinforcement learning with influence values. While learning by rewards, each agent evaluates the relation between the current state and/or action executed at this state (actual believe) together with the reward obtained after all agents that are interacting perform their actions. The reward is a result of the interference of others. The agent considers the opinions of all its colleagues in order to attempt to change the values of its states and/or actions. The idea is that the system, as a whole, must reach an equilibrium, where all agents get satisfied with the obtained results. This means that the values of the state/actions pairs match the reward obtained by each agent. This dynamical way of setting the values for states and/or actions makes this new reinforcement learning paradigm the first to include, naturally, the fact that the presence of other agents in the environment turns it a dynamical model. As a direct result, we implicitly include the internal state, the actions and the rewards obtained by all the other agents in the internal state of each agent. This makes our proposal the first complete solution to the conceptual problem that rises when applying reinforcement learning in multi-agent systems, which is caused by the difference existent between the environment and agent models. With basis on the proposed model, we create the IVQ-learning algorithm that is exhaustive tested in repetitive games with two, three and four agents and in stochastic games that need cooperation and in games that need collaboration. This algorithm shows to be a good option for obtaining solutions that guarantee convergence to the Nash optimum equilibrium in cooperative problems. Experiments performed clear shows that the proposed paradigm is theoretical and experimentally superior to the traditional approaches. Yet, with the creation of this new paradigm the set of reinforcement learning applications in MAS grows up. That is, besides the possibility of applying the algorithm in traditional learning problems in MAS, as for example coordination of tasks in multi-robot systems, it is possible to apply reinforcement learning in problems that are essentially collaborative

Estratégias baseadas em aprendizado para coordenação de uma frota de robôs em tarefas cooperativas

In multi-robot systems, both control architecture and work strategy represent a challenge for researchers. It is important to have a robust architecture that can be easily adapted to requirement changes. It is also important that work strategy allows robots to complete tasks efficiently, considering that robots interact directly in environments with humans. In this context, this work explores two approaches for robot soccer team coordination for cooperative tasks development. Both approaches are based on a combination of imitation learning and reinforcement learning. Thus, in the first approach was developed a control architecture, a fuzzy inference engine for recognizing situations in robot soccer games, a software for narration of robot soccer games based on the inference engine and the implementation of learning by imitation from observation and analysis of others robotic teams. Moreover, state abstraction was efficiently implemented in reinforcement learning applied to the robot soccer standard problem. Finally, reinforcement learning was implemented in a form where actions are explored only in some states (for example, states where an specialist robot system used them) differently to the traditional form, where actions have to be tested in all states. In the second approach reinforcement learning was implemented with function approximation, for which an algorithm called RBF-Sarsa($lambda$) was created. In both approaches batch reinforcement learning algorithms were implemented and imitation learning was used as a seed for reinforcement learning. Moreover, learning from robotic teams controlled by humans was explored. The proposal in this work had revealed efficient in the robot soccer standard problem and, when implemented in other robotics systems, they will allow that these robotics systems can efficiently and effectively develop assigned tasks. These approaches will give high adaptation capabilities to requirements and environment changes.

Abordagem de temas em saúde pública por meio de atividades lúdicas com professoras da educação infantil

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior

Uma proposta de ensino para o nível fundamental a partir das concepções sobre insetos

O presente trabalho consiste em uma investigação acerca das concepções de estudantes sobre o que é um inseto. Partiu-se do pressuposto de que os alunos expressam concepções errôneas no momento de identificar os representantes do táxon Insecta e que isso é consequência das experiências do cotidiano e de erros conceituais oriundos da formação escolar incorreta. Os objetivos deste trabalho foram investigar sobre concepções alternativas acerca dos insetos com alunos do ensino fundamental II e propor situações para promoção de uma aprendizagem mais ativa. Os dados para analise foram coletados em três turmas de escolas diferentes: uma escola em Nova Parnamirim, da rede privada, e duas da rede pública municipal de ensino: uma do município de Natal/RN e a outra do município de Parnamirim/RN. Utilizou-se como instrumento um questionário aplicado em duas fases. Na primeira etapa foram feitas três questões abertas e duas fechadas. Na segunda, aplicaram-se mais três questões. Nesta oportunidade foram apresentados aos alunos uma lista com imagens de insetos e animais considerados não insetos. Os resultados dos questionários mostraram que os alunos apresentaram na sua maioria, 62%, sentimentos negativos sobre os insetos, expressos por palavras depreciativas, entre elas: nojentos, feios, asquerosos, perigosos, sendo estes mais da metade dos alunos da amostra. Sentimentos positivos representaram 20%: fazem bem ao homem, Deus criou, são bons, são bonitos, e 18% apresentaram neutralidade nessas categorias. Outro resultado apresentado foi que 82% generalizaram os animais artrópodes como sendo insetos. Como forma de resolver problemas relacionados as concepções uma unidade didática foi aplicada em uma das escolas envolvidas na pesquisa, validando assim um instrumento pedagógico que incluiu atividade lúdica constituída de um jogo de tabuleiro proporcionador de uma vivência de aprendizagem focada em conceitos científicos sobre os insetos fáceis de serem apreendidos

Geometria e arirmética numa visão multicultural: uma experiência pedagógica

This paper aims to build a notebook of activities that can help the teacher of elementary school mathematics. Topics covered are arithmetic and geometry and the activities proposed here were developed aiming print them a multicultural character. We take as a base line developed by Claudia Zaslavsky multiculturalism and reflected in his books "Games and activities worldwide" and "More games and activities worldwide." We structure our work around four themes: the symbol of the Olympic Games, the pyramids of Egypt, the Russian abacus abacus and Chinese. The first two themes allow you to explore basic concepts of geometry while the latter two themes allow us to explore numerical notation and arithmetic operations

O devir Clarice e o animal- escrita na literatura infantil

La escritura de Clarice Lispector fue consagrada por la academia a través de sus libros direccionados al público adulto . Este trabajo pretende entre sus objetivos compartir sus obras infantiles con el medio académico y desvincular, desde la escritura clariciana, el ámbito de una menoridad literaria de la literatura infantil. Repensar la infancia y problematizar sus lugares de escrita. De ese modo, el corpus teórico de las obras de Deleuze y Guattari nos conducirá en la desconstrucción de tales territorios hacia un desterritorializar y al reterritorializar de la literatura infantil a través de un reinvento narrativo clariciano, lo cual llamamos de Fábula de la Modernidad

O ser elástico, mola, agulha, trepidação: expressões do homoerotismo em Fernando Pessoa

This Masters thesis investigates and analyzes the homoerotic expressions in Fernando Pessoa s poetry and in his heteronyms : Álvaro de Campos, Alberto Caeiro and Ricardo Reis. Through the elaboration of deceptive strategies as a way to escape from the insults and the constraints, the poet by means of creative runaway lines builds up a homoerotic poetry that differ from the established patterns and representational models of the literature. We can find, bearing in mind a problematic sexuality which overflows in the various I s, of the sinuous identities and the movable boundaries, and intense mask games. They become real in poems, especially by means of sensations, yielding the possibility of a queer discourse and generating a homoerotic poetry. Pessoa s homoerotism is, thus, presented amid friendly relationships, smooth spaces, of heterotrophy of the city, or others space and the closet s aesthetics. Based on this, it is noted the articulations of a performance gender as body scripture and inscription, thus establishing a physical-writing which reveals a transgressive sexuality, with multiple entrances and exits, affirmations and denials that originate paradoxes. In this matter, we develop links between Foucault conceptions (2010a, 2010b, 2011) towards the history of sexuality, friendship and the power-knowledge relations with traces of significance and subjectivity, in processes of faciality and BwO (Body-without-Organs) in Deleuze and Guattari (1996). We still consider the ontological questionings towards the Gay dimension in Eribon (2008) and we raise aspects concerning the construction of the idea of masculinity in Bourdieu (2010). Finally, we base ourselves on Sedgwick s 1993 closet epistemological approach, as well as on Butler s 2012 gender and performance theory, also going through a few Bataille 1987 passages about erotism, that redimension the homoaffective images of the Portuguese poet

A criança e o brinquedo-TV: análise sobre o discurso publicitário direcionado para a infância na Rede Globo de Televisão

Esta investigación es un análisis del contexto actual que rodea a la publicidad brasileña, más concretamente, la publicidad discurso televisivo dirigido a los niños en Brasil. Análisis de los documentos se basa en la revisión retórica (Leach, 2004) (SODRE, 2006) A partir de la primera supuesta inadecuación de algunos de sus contenidos al público para que se comunican. También investiga las posibilidades de regulación y la educación del consumidor y el papel de los medios de comunicación en la sociedad mediante la movilización exigiendo el cumplimiento y la mejora de la legislación vigente, evitando los posibles abusos y distorsiones de las secciones generales de la ley. Hemos llevado a cabo por separado se analiza en los niños y sus conceptualizaciones y la función social, abordando también el juguete y el acto de jugar hoy y su sede histórica en un intento de crear una fundación que apoya el análisis de la relación entre la infancia y la publicidad y el consumo, basado en obras de Roger Silverstone, Kapferer, Leontiev y Walter Benjamin. También se hicieron inferencias basadas en estudios de Pablo Del Río, sobre las posibles consecuencias psicológicas del consumo de medios por los niños, sin embargo, en arvorarmos llevar a cabo investigaciones en el estudio de la recepción. Se enfrentarán, tanto en acciones a favor de la aprobación de la Ley 5.921/2001 N º Suplente sugiere que la prohibición de la publicidad infantil en todo el país, los enfoques ampliamente "integrado" y por lo tanto, favorables a la continuidad de la actividad publicitaria en el país bajo la acción de la CONAR de autorregulación, lo que demuestra sin embargo, la viabilidad de ambas propuestas. Tambien relativa a el CONAR se llevó a cabo un estudio sobre su Consejo Asesor, dando a entender su composición y características. Por último, se estudian las posibilidades y el concepto de la educación para el consumo de los medios de comunicación, a partir de la utilización de los recursos de los propios medios de comunicación, como una propuesta para un cambio de paradigma en el mercado de la publicidad en Brasil. En conclusión, vemos que a partir del análisis de la publicidad comercial de los niños atendidos por la Red Globo de Televisión, en una muestra de 170 inserciones, todavía existen graves lagunas, pero que los desequilibrios se pueden resolver con medidas relativamente sencillas que incluyan campañas de educación y la exigencia de adecuación de los pocos grandes anunciantes que violan la ley. Afortunadamente, una nueva entrega de los anunciantes mostró la responsabilidad social en sus acciones