Experience generalization for multi-agent reinforcement learning

On-line learning methods have been applied successfully in multi-agent systems to achieve coordination among agents. Learning in multi-agent systems implies in a non-stationary scenario perceived by the agents, since the behavior of other agents may change as they simultaneously learn how to improve their actions. Non-stationary scenarios can be modeled as Markov Games, which can be solved using the Minimax-Q algorithm a combination of Q-learning (a Reinforcement Learning (RL) algorithm which directly learns an optimal control policy) and the Minimax algorithm. However, finding optimal control policies using any RL algorithm (Q-learning and Minimax-Q included) can be very time consuming. Trying to improve the learning time of Q-learning, we considered the QS-algorithm. in which a single experience can update more than a single action value by using a spreading function. In this paper, we contribute a Minimax-QS algorithm which combines the Minimax-Q algorithm and the QS-algorithm. We conduct a series of empirical evaluation of the algorithm in a simplified simulator of the soccer domain. We show that even using a very simple domain-dependent spreading function, the performance of the learning algorithm can be improved.

A energia e suas implicações no ensino-aprendizagem da química

The area of Education in Chemistry in Brazil has appeared over 30 years and its growth has been accelerated by the need of comprehension of the processes of teaching and learning in chemistry. Many researches, in this area, has among its investigation objects the teaching tools like teaching materials and the learning processes of students in high school and basic education, but when dealing with higher levels of education, they are seldom portrayed. This study aimed to investigate the General Chemistry textbooks with respect to approach the concept of energy; know the main ideas of graduate students in Chemistry on the relation of the concept of energy and chemical transformations; finally, developing a cicle of studies with the proposition of an approach wich inter-relate the concept of energy and its implications in the teaching-learning process of a chemical transformation. To do so, we used as instruments a questionnaire, press conference, conceptual map and experimental activities. All activities of the study cicle were videotaped and recorded, transcribed and the results organized in tables. For the activities of the study cicle texts that have been developed and inter-relating concepts of chemistry and energy, which in turn gave theoretical support to the activities in the cycle. In the analysis it was used as a theoretical content the analysis of Laurence Bardin. The results revealed that the analysis of the book might be perceived that not always the concept of energy is used in order to generate the abstract thought of chemical transformations, but that the main macroscopic thermodynamic variables are present in the explanation of these transformations. During the study cicle, were studied two chemical reactions: the first one, made possible to approach the macroscopic dimension to quantify the concept of energy and the second one, made possible to demonstrate the macro and microscopic dimension of the concept of energy during a chemical transformation. In all reactions proposed, students used, in most of the times, as explanations, only macroscopic observations of the reactions under study and failed to realize that the concept of energy can be used to explain macro and microscopic chemical transformation. As a final action of the study cicle, students requested further discussion, to clarify the link between the concept of energy and the meanings constructed in the process of studying the reactions. This is done through an oral explanation, during the cycle, and registered in this thesis and attempts to show the interrelationship existing conceptual

Action mechanisms of petroleum hydrocarbons present in waters impacted by an oil spill on the genetic material of Allium cepa root cells

Chromosomal aberration (CA) assays have been widely used, not only to assess the genotoxic effects of chemical agents, but also to evaluate their action mechanisms on the genetic material of exposed organisms. This is of particular interest, since such analyses provide a better knowledge related to the action of these agents on DNA. Among test organisms, Allium cepa is an outstanding species due to its sensitivity and suitable chromosomal features, which are essential for studies on chromosomal damage or disturbances in cell cycle. The goal of the present study was to analyze the action mechanisms of chemical agents present in petroleum polluted waters. Therefore, CA assay was carried out in A. cepa meristematic cells exposed to the Guaeca river waters, located in the city of Sao Sebastiao, SP, Brazil, which had its waters impacted by an oil pipeline leak. Analyses of the aberration types showed clastogenic and aneugenic effects for the roots exposed to the polluted waters from Guaeca river, besides the induction of cell death. Probably all the observed effects were induced by the petroleum hydrocarbons derived from the oil leakage. (C) 2008 Elsevier B.V. All rights reserved.

Hormonal Oscillations During the Estrous Cycle Influence the Morphophysiology of the Gerbil (Meriones unguiculatus) Female Prostate (Skene Paraurethral Glands)

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Influence of gender and estrous cycle in the forced swim test in rats

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Origin of nuclear and chromosomal alterations derived from the action of an aneugenic agent-Trifluralin herbicide

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Interaction of equatorial waves through resonance with the diurnal cycle of tropical heating

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

The effect of chilling on the photosynthetic activity in coffee (Coffea arabica L.) seedlings. The protective action of chloroplastid pigments

Coffea arabica is considered to be sensitive to low temperatures, being affected throughout its entire life cycle. Injury caused by chilling (low temperatures above zero degree centigrade) is characterized primarily by inhibition of the photosynthetic process. The objective of this work was to evaluate the role of photosynthetic pigments in the tolerance of coffee (C. arabica L.) seedlings to chilling. The evaluation the photosynthetic activity was made by emission of Chl a fluorescence at room temperature (25°C) in vivo and in situ, using a portable fluorometer. The pigment content was obtained by extraction with 80% acetone, while estimation of membrane lipid peroxidation was determined by measuring the MDA content in leaf tissue extracts. The results indicated a generalized reduction in the quantum yield of PSII when the seedlings were maintained in the dark. The reduction occurred in the seedlings submitted to chilling treatment as well as in the control ones. This demonstrates that not only chilling acts to cause an alteration in PSII. It is possible that the tissue storage reserves had been totally exhausted, with the respiratory rate exceeding the photosynthetic rate; the later was nil, since the seedlings were kept in the dark. The efficiency in the capture, transfer and utilization of light energy in PS11 photochemical reactions requires a sequence of photochemical, biochemical and biophysical events which depend on the structural integrity of the photosynthetic apparatus. However, this efficiency was found to be related to the protective action of chloroplastid pigments, rather than to the concentration of these pigments.

Biomolecular information, brain activity and cognitive functions

Molecular neurobiology has provided an explanation of mechanisms supporting mental functions as learning, memory, emotion and consciousness. However, an explanatory gap remains between two levels of description: molecular mechanisms determining cellular and tissue functions, and cognitive functions. In this paper we review molecular and cellular mechanisms that determine brain activity, and then hypothetize about their relation with cognition and consciousness. The brain is conceived of as a dynamic system that exchanges information with the whole body and the environment. Three explanatory hypotheses are presented, stating that: a) brain tissue function is coordinated by macromolecules controlling ion movements, b) structured (amplitude, frequency and phase-modulated) local field potentials generated by organized ionic movement embody cognitive information patterns, and c) conscious episodes are constructed by a large-scale mechanism that uses oscillatory synchrony to integrate local field patterns. © by São Paulo State University.

Action of the insect growth regulator fluazuron, the active ingredient of the acaricide Acatak®, in Rhipicephalus sanguineus nymphs (Latreille, 1806) (Acari: Ixodidae)

The present study evaluated the efficacy of fluazuron (active ingredient of the acaricide Acatak®) and its effects on Rhipicephalus sanguineus nymphs fed on rabbits exposed to different doses of this insect growth regulator. Three different doses of fluazuron (20 mg/kg, 40 mg/kg, and 80 mg/kg) were applied on the back of hosts (via pour on), while distilled water was applied to the Control group. On the first day of treatment with fluazuron (24 h), hosts were artificially infested with R. sanguineus nymphs. Once fully engorged, nymphs were removed and placed in identified Petri dishes in Biochemical Oxygen Demand (BOD) incubator for 7 days. After this period, engorged nymphs were processed for ultramorphological analysis. The results revealed alterations in the ultramorphology of many chitinous structures (smaller hypostome and chelicerae, less sclerotized scutum, fewer sensilla, fewer pores, absence of grooves, marginal and cervical strips and festoons in the body, even the anal plaque was damaged) that play essential roles for the survivor of ticks and that can compromise the total or partial development of nymphs and emergence of adults after periodic molting. Our findings confirm the efficacy of fluazuron, a more specific and less aggressive chemical to the environment and human health, and that does not induce resistance, in nymphs of the tick R. sanguineus in artificially infested rabbits treated with this arthropod growth regulator (AGR), indicating that it could be used in the control of this stage of the biological cycle of the tick R. sanguineus. © 2013 Wiley Periodicals, Inc.

A temática ambiental no currículo do Ensino fundamental do Estado de São Paulo a partir de 2008

Pós-graduação em Educação - IBRC

A implementação do Projeto Intensivo no Ciclo (PIC) em Pompeia (SP): (re)construindo o processo formativo dos professores que ensinam Matemática

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

A formação de educadores em serviço no contexto escolar: mídias digitais e projetos de trabalho

Pós-graduação em Educação - FCT

Adaptation to climate change in megacities of Latin America: Regional Learning Network of the research project ClimateAdaptationSantiago (CAS)

The main objective of this publication is to document the current state of urban climate change adaptation practice in Latin America. It is a summary of the three workshops of the Regional Learning Network that was set up under the ClimateAdaptationSantiago project (CAS), encompassing six large Latin American cities (Bogotá, Buenos Aires, Lima, Mexico City, São Paulo and Santiago). It aims to synthesize information on the manifestations and impacts of climate change in those Latin American cities that participated in the network, and above all, governance in the form of concrete actions. The publication is based on information obtained from the participants in the three workshops, but also includes additional scientific input and reflections by the editors. All of this information makes a major contribution to highlighting the different paths these six cities are pursuing in response to climate change. To that end, the publication discusses the various courses of action on climate change adaptation, with the aim of learning from these cases and highlighting practical examples.

Panorama da educação fundamental e média no Brasil: o modelo da aprendizagem baseada em problemas como experiência na prática docente

O presente documento atualiza os dados que revelam o perfil atual do ensino fundamental e médio no Brasil, re-visitando os bancos de dados de instituições oficiais (INEP e IBGE). Nós encontramos coincidências suspeitas que relacionam concentração de renda e abstinência educacional, como combustíveis que realimentam o ciclo da miséria em nosso país. Aspectos qualitativos da escola brasileira também foram levantados para que pudéssemos compreender as dificuldades do fazer educacional no Brasil e acenar com possibilidades concretas de mudança. Nós também investigamos, através da metodologia de estudo de caso, dois cursos de férias para implementar e avaliar a Aprendizagem Baseada em Problemas (ABP). As aulas foram direcionadas a professores e alunos do Ensino Médio. Através da observação direta e de inferências obtidas a partir de questionários aplicados a alunos e professores, antes e depois de cada um dos cursos (em 2004 e 2005), mediu-se o impacto da ABP sobre alunos e professores. Os resultados revelaram várias dificuldades e perplexidades demonstradas por professores e alunos, tais como a dificuldade em relacionar experimentos e conteúdos dos livros didáticos, a abstinência quase completa em experimentação e sua relação com o Método Científico, dificuldades de discernir entre hipótese e fato, etc. A Aprendizagem Baseada em Problemas foi aceita por todos (estudantes e professores) como uma possível maneira de mudar as aulas de Ciências e a Biologia. Contudo, sua ampla disseminação vai exigir capacitação em larga escala, gestão e liderança para iniciar o processo de mudança, aumentos de salários, e melhor infra-estrutura das escolas para experimentação. Utilizando metodologias semelhantes à ABP, como alternativa para capacitação, as universidades que desenvolvem atividades de pesquisa precisam ser diretamente envolvidas no processo através de fomento dirigido para a renovação. Um pacto educacional precisa ser construído para reformar o fazer educacional, e essa ação deve incluir Administradores e Professores das escolas de ensino fundamental e médio, Secretários de Educação (do Estado e do Município), Governos de Estado e do Município, Ministérios da Educação e da Ciência e Tecnologia, Universidades e Agências de Fomento para que o esforço possa ganhar dimensões nacionais.