Aprendizado por Reforço com Valores deInfluência em Sistemas Multi-Agente

We propose a new paradigm for collective learning in multi-agent systems (MAS) as a solution to the problem in which several agents acting over the same environment must learn how to perform tasks, simultaneously, based on feedbacks given by each one of the other agents. We introduce the proposed paradigm in the form of a reinforcement learning algorithm, nominating it as reinforcement learning with influence values. While learning by rewards, each agent evaluates the relation between the current state and/or action executed at this state (actual believe) together with the reward obtained after all agents that are interacting perform their actions. The reward is a result of the interference of others. The agent considers the opinions of all its colleagues in order to attempt to change the values of its states and/or actions. The idea is that the system, as a whole, must reach an equilibrium, where all agents get satisfied with the obtained results. This means that the values of the state/actions pairs match the reward obtained by each agent. This dynamical way of setting the values for states and/or actions makes this new reinforcement learning paradigm the first to include, naturally, the fact that the presence of other agents in the environment turns it a dynamical model. As a direct result, we implicitly include the internal state, the actions and the rewards obtained by all the other agents in the internal state of each agent. This makes our proposal the first complete solution to the conceptual problem that rises when applying reinforcement learning in multi-agent systems, which is caused by the difference existent between the environment and agent models. With basis on the proposed model, we create the IVQ-learning algorithm that is exhaustive tested in repetitive games with two, three and four agents and in stochastic games that need cooperation and in games that need collaboration. This algorithm shows to be a good option for obtaining solutions that guarantee convergence to the Nash optimum equilibrium in cooperative problems. Experiments performed clear shows that the proposed paradigm is theoretical and experimentally superior to the traditional approaches. Yet, with the creation of this new paradigm the set of reinforcement learning applications in MAS grows up. That is, besides the possibility of applying the algorithm in traditional learning problems in MAS, as for example coordination of tasks in multi-robot systems, it is possible to apply reinforcement learning in problems that are essentially collaborative

Sistema de agentes poligínicos para esteganálise de imagens digitais

In this work, we propose a multi agent system for digital image steganalysis, based on the poliginic bees model. Such approach aims to solve the problem of automatic steganalysis for digital media, with a case study on digital images. The system architecture was designed not only to detect if a file is suspicious of covering a hidden message, as well to extract the hidden message or information regarding it. Several experiments were performed whose results confirm a substantial enhancement (from 67% to 82% success rate) by using the multi-agent approach, fact not observed in traditional systems. An ongoing application using the technique is the detection of anomalies in digital data produced by sensors that capture brain emissions in little animals. The detection of such anomalies can be used to prove theories and evidences of imagery completion during sleep provided by the brain in visual cortex areas

Utilizando Pesos estáticos e dinâmicos em sistemas multi-classificadores com diferentes níveis de diversidade

Although some individual techniques of supervised Machine Learning (ML), also known as classifiers, or algorithms of classification, to supply solutions that, most of the time, are considered efficient, have experimental results gotten with the use of large sets of pattern and/or that they have a expressive amount of irrelevant data or incomplete characteristic, that show a decrease in the efficiency of the precision of these techniques. In other words, such techniques can t do an recognition of patterns of an efficient form in complex problems. With the intention to get better performance and efficiency of these ML techniques, were thought about the idea to using some types of LM algorithms work jointly, thus origin to the term Multi-Classifier System (MCS). The MCS s presents, as component, different of LM algorithms, called of base classifiers, and realized a combination of results gotten for these algorithms to reach the final result. So that the MCS has a better performance that the base classifiers, the results gotten for each base classifier must present an certain diversity, in other words, a difference between the results gotten for each classifier that compose the system. It can be said that it does not make signification to have MCS s whose base classifiers have identical answers to the sames patterns. Although the MCS s present better results that the individually systems, has always the search to improve the results gotten for this type of system. Aim at this improvement and a better consistency in the results, as well as a larger diversity of the classifiers of a MCS, comes being recently searched methodologies that present as characteristic the use of weights, or confidence values. These weights can describe the importance that certain classifier supplied when associating with each pattern to a determined class. These weights still are used, in associate with the exits of the classifiers, during the process of recognition (use) of the MCS s. Exist different ways of calculating these weights and can be divided in two categories: the static weights and the dynamic weights. The first category of weights is characterizes for not having the modification of its values during the classification process, different it occurs with the second category, where the values suffers modifications during the classification process. In this work an analysis will be made to verify if the use of the weights, statics as much as dynamics, they can increase the perfomance of the MCS s in comparison with the individually systems. Moreover, will be made an analysis in the diversity gotten for the MCS s, for this mode verify if it has some relation between the use of the weights in the MCS s with different levels of diversity

Ação de polissacarídeos sulfatados de Fucus Vesiculosus na Hemostasia e no sistema complemento

Fucans are a family of sulfated homo and teropolysaccharides respectively, composed mainly of a- (1®2) and a- (1®3) linked by L-fucose residues. Properties such as the ability to act as an anti-contraceptive, to reduce cholesterol levels, and to act as an anti-tumor agent are much related. We have focused our attention on the anticoagulant properties, platelet aggregation, hemorrhagic activity and complement system in vitro of commercial fucoidan (F) and their purified fractions (F1, F2 and F3) from Fucus vesiculosus obtained from fractionation of the fucoidan with different concentrations of acetone 1, 2 and 3v. These compounds were chemically characterized and the fucoidan (F) was modified by desulfation. The anticoagulant activity of the compounds was assessment by activated partial thromboplastin time (APTT) and prothrombine time assay (PT) using citrated normal human plasma. The results of APPT test showed that F, F1 and F2 have high anticoagulants activities 240.0 s (5 µg). The F3 showed 73.7 s in the same concentrations. The results obtained with PT test to F, F1, F2 and F3 were 81.5 s, 120.0 s, 57.1 and 32.5 s respectively with 50 µg. The dessulfated polymer showed a decrease in the anticoagulant activity in these two tests. Platelet aggregation assay was measured turbidimetrically with platelet aggregometer by method of Born. The aggregation platelet with F and fractions F1, F2 and F3 exhibited a two-phase answer in the concentration of 5 mg/mL with maximum aggregation of 76.36 ± 10.3% ; 69.54 ± 9.40%; 75.94 ± 9.01%; 51.13 ± 9.59% respectively. However, was observed a hipoaggregate profile F (15.17 ± 5.2%), F1 (7.40 ± 3.04 %), F2 (19.1 ± 5.41%) and F3 (5.09 ± 3.02%) at 0.1 mg/mL. The hemorrhagic activity assay was carried in Wistar rats and showed that these compounds have low hemorrhagic effect when compared to heparin. The complement system ( alternative pathway was made using non-sensibilized rabbit red blood cells The results of complement system essay showed that F , F2 and F3 have action inhibitory in relation to the group control 0.544, 0.697, 0.622 and 0.958 respectively The results showed that these compounds have action on this system. Interaction of the polisaccharides with proteins C3 and C4 showed that the fraction F1 stimulated the activity assay hemolytic using red blood cells

Desenvolvimento de um sistema de indicadores de desempenho para empreendimentos em construção civil, utilizando a abordagem macroergonômica

This paper presents the validation of the Performance Indicator System for Projects under Construction - SIDECC. The goal was to develop a system of performance indicators from the macroergonômica approach, considering criteria of usefulness, practicality and applicability and the concept of continuous improvement in the construction industry. The validation process SIDECC consisted of three distinct models. Modeling I corresponded to the theoretical development and validation of a system of indicators. Modeling II concerns the development and validation of multi- indicator system. For this modeling, we used the Mother of Use and Importance and Multivariate Analysis. Modeling III corresponded to the validation situated, which consisted of a case study of a work of construction of buildings, which were applied and analyzed the results of modeling II. This work resulted in the development of an applied and tested for the construction of an integrated system of performance indicators methodology, involving aspects of production, quality, environmental, health and safety. It is inferred that the SIDECC can be applied, in full or in part, the construction companies as a whole, as well as in other economic sectors

Desenvolvimento de um ressoador retangular de fenda com múltiplas camadas de substrato e com utilização de material PBG para sistema de comunicação sem fio

In the globalized world modern telecommunications have assumed key role within the company, causing a large increase in demand for the wireless technology of communication, which has been happening in recent years have greatly increased the number of applications using this technology. Due to this demand, new materials are developed to enable new control mechanisms and propagation of electromagnetic waves. The research to develop new technologies for wireless communication presents a multidisciplinary study that covers from the new geometries for passive antennas, active up to the development of materials for devices that improve the performance at the frequency range of operation. Recently, planar antennas have attracted interest due to their characteristics and advantages when compared with other types of antennas. In the area of mobile communications the need for antennas of this type has become increasingly used, due to intensive development, which needs to operate in multifrequency antennas and broadband. The microstrip antennas have narrow bandwidth due to the dielectric losses generated by irradiation. Another limitation is the degradation of the radiation pattern due to the generation of surface waves in the substrate. Some techniques have been developed to minimize this limitation of bandwidth, such as the study of type materials PBG - Photonic Band Gap, to form the dielectric material. This work has as main objective the development project of a slot resonator with multiple layers and use the type PBG substrate, which carried out the optimization from the numerical analysis and then designed the device initially proposed for the band electromagnetic spectrum between 3-9 GHz, which basically includes the band S to X. Was used as the dielectric material RT/Duroid 5870 and RT/Duroid 6010.LM where both are laminated ceramic-filled PTFE dielectric constants 2.33 and 10.2, respectively. Through an experimental investigation was conducted an analysis of the simulated versus measured by observing the behavior of the radiation characteristics from the height variation of the dielectric multilayer substrates. We also used the LTT method resonators structures rectangular slot with multiple layers of material photonic PBG in order to obtain the resonance frequency and the entire theory involving the electromagnetic parameters of the structure under consideration. xviii The analysis developed in this work was performed using the method LTT - Transverse Transmission Line, in the field of Fourier transform that uses a component propagating in the y direction (transverse to the real direction of propagation z), thus treating the general equations of the fields electric and magnetic and function. The PBG theory is applied to obtain the relative permittivity of the polarizations for the sep photonic composite substrates material. The results are obtained with the commercial software Ansoft HFSS, used for accurate analysis of the electromagnetic behavior of the planar device under study through the Finite Element Method (FEM). Numerical computational results are presented in graphical form in two and three dimensions, playing in the parameters of return loss, frequency of radiation and radiation diagram, radiation efficiency and surface current for the device under study, and have as substrates, photonic materials and had been simulated in an appropriate computational tool. With respect to the planar device design study are presented in the simulated and measured results that show good agreement with measurements made. These results are mainly in the identification of resonance modes and determining the characteristics of the designed device, such as resonant frequency, return loss and radiation pattern

Controlador preditivo generalizado multi-modelo aplicado ao controle de pressão arterial

Postsurgical complication of hypertension may occur in cardiac patients. To decrease the chances of complication it is necessary to reduce elevated blood pressure as soon as possible. Continuous infusion of vasodilator drugs, such as sodium nitroprusside (Nipride), would quickly lower the blood pressure in most patients. However, each patient has a different sensitivity to infusion of Nipride. The parameters and the time delays of the system are initially unknown. Moreover, the parameters of the transfer function associated with a particular patient are time varying. the objective of the study is to develop a procedure for blood pressure control i the presence of uncertainty of parameters and considerable time delays. So, a methodology was developed multi-model, and for each such model a Preditive Controller can be a priori designed. An adaptive mechanism is then needed for deciding which controller should be dominant for a given plant

A percepção da fiscalização dos contratos de mão de obra terceirizada pelos agentes envolvidos nesse processo no âmbito da Universidade Federal do Rio Grande do Norte: uma análise sob o modelo do principal-agente

Outsourcing has emerged as one of the new ways of guiding the work. For its advantages and be consistent with the paradigms of managerial reform, outsourcing also started to be used in the Public Administration. However, taking into account the particularities of the latter, some issues are relevant when outsourcing concluded with the State. Gains notoriety, for example, the step of monitoring these contracts, to the extent that, from this activity, we can avoid the negative effects of outsourcing like the fact that the state will pay for labor and wage liens that are obligation of the company providing the services. This study aims to understand the perception that this process is under the Federal University of Rio Grande do Norte, from the point of view of different stakeholders, also explaining the motivations that these agents have to perform the supervisory process. As a theoretical basis was used the Agency Theory, which reinforces the supervisory activities as a necessary means to minimize moral hazard and adverse selection, seeking to understand not only the different motivations tax contracts to properly perform their duties, but also analyze other phenomena arising from this contractual relationship. To achieve the proposed objectives, were taken a literature review and a presentation of how to organize the management and oversight of contracts in UFRN. The methodological procedures included questionnaires and interviews with those involved in the process. After analyzing the results obtained in the survey instruments , and also based on the laws, regulations and instructions governing the procurement process within the UFRN, it was concluded that the process of overseeing the outsourcing of labor contracts in UFRN is not fully institutionalized, some points should be strengthened in order to have the consolidation of this process, highlighting the need for training of UFRN servers that act as tax, the knowledge that the contractual penalties are applied effectively, the need that there is a supervisor of tax of contractors and also the realization of the rotation system of outsourced employees

Aplicação de ontologias para métodos de negociação de um sistema multiagente para o reconhecimento de padrões

The use of intelligent agents in multi-classifier systems appeared in order to making the centralized decision process of a multi-classifier system into a distributed, flexible and incremental one. Based on this, the NeurAge (Neural Agents) system (Abreu et al 2004) was proposed. This system has a superior performance to some combination-centered methods (Abreu, Canuto, and Santana 2005). The negotiation is important to the multiagent system performance, but most of negotiations are defined informaly. A way to formalize the negotiation process is using an ontology. In the context of classification tasks, the ontology provides an approach to formalize the concepts and rules that manage the relations between these concepts. This work aims at using ontologies to make a formal description of the negotiation methods of a multi-agent system for classification tasks, more specifically the NeurAge system. Through ontologies, we intend to make the NeurAge system more formal and open, allowing that new agents can be part of such system during the negotiation. In this sense, the NeurAge System will be studied on the basis of its functioning and reaching, mainly, the negotiation methods used by the same ones. After that, some negotiation ontologies found in literature will be studied, and then those that were chosen for this work will be adapted to the negotiation methods used in the NeurAge.

MoSAC: um módulo para seleção de configurações arquiteturais baseado em critérios de QoS no contexto de sistema distribuídos autoadaptativos

The process for choosing the best components to build systems has become increasingly complex. It becomes more critical if it was need to consider many combinations of components in the context of an architectural configuration. These circumstances occur, mainly, when we have to deal with systems involving critical requirements, such as the timing constraints in distributed multimedia systems, the network bandwidth in mobile applications or even the reliability in real-time systems. This work proposes a process of dynamic selection of architectural configurations based on non-functional requirements criteria of the system, which can be used during a dynamic adaptation. This proposal uses the MAUT theory (Multi-Attribute Utility Theory) for decision making from a finite set of possibilities, which involve multiple criteria to be analyzed. Additionally, it was proposed a metamodel which can be used to describe the application s requirements in terms of the non-functional requirements criteria and their expected values, to express them in order to make the selection of the desired configuration. As a proof of concept, it was implemented a module that performs the dynamic choice of configurations, the MoSAC. This module was implemented using a component-based development approach (CBD), performing a selection of architectural configurations based on the proposed selection process involving multiple criteria. This work also presents a case study where an application was developed in the context of Digital TV to evaluate the time spent on the module to return a valid configuration to be used in a middleware with autoadaptative features, the middleware AdaptTV

Sistema operacional e biblioteca de funções para plataformas MPSOC: um estudo de caso para simuladores de reservatórios

The increasingly request for processing power during last years has pushed integrated circuit industry to look for ways of providing even more processing power with less heat dissipation, power consumption, and chip area. This goal has been achieved increasing the circuit clock, but since there are physical limits of this approach a new solution emerged as the multiprocessor system on chip (MPSoC). This approach demands new tools and basic software infrastructure to take advantage of the inherent parallelism of these architectures. The oil exploration industry has one of its firsts activities the project decision on exploring oil fields, those decisions are aided by reservoir simulations demanding high processing power, the MPSoC may offer greater performance if its parallelism can be well used. This work presents a proposal of a micro-kernel operating system and auxiliary libraries aimed to the STORM MPSoC platform analyzing its influence on the problem of reservoir simulation

Analisando o desempenho do ClassAge: um sistema multiagentes para classificação de padrões

The use of multi-agent systems for classification tasks has been proposed in order to overcome some drawbacks of multi-classifier systems and, as a consequence, to improve performance of such systems. As a result, the NeurAge system was proposed. This system is composed by several neural agents which communicate and negotiate a common result for the testing patterns. In the NeurAge system, a negotiation method is very important to the overall performance of the system since the agents need to reach and agreement about a problem when there is a conflict among the agents. This thesis presents an extensive analysis of the NeurAge System where it is used all kind of classifiers. This systems is now named ClassAge System. It is aimed to analyze the reaction of this system to some modifications in its topology and configuration

Sistemas orbitais e aéreos aplicados à análise multi-escala da tectônica rúptil atuante na borda sudeste da Bacia do Parnaíba

The tectonics activity on the southern border of Parnaíba Basin resulted in a wide range of brittle structures that affect siliciclastic sedimentary rocks. This tectonic activity and related faults, joints, and folds are poorly known. The main aims of this study were (1) to identify lineaments using several remotesensing systems, (2) to check how the interpretation based on these systems at several scales influence the identification of lineaments, and (3) to contribute to the knowledge of brittle tectonics in the southern border of the Parnaíba Basin. The integration of orbital and aerial systems allowed a multi-scale identification, classification, and quantification of lineaments. Maps of lineaments were elaborated in the following scales: 1:200,000 (SRTM Shuttle Radar Topographic Mission), 1:50,000 (Landsat 7 ETM+ satellite), 1:10,000 (aerial photographs) and 1:5,000 (Quickbird satellite). The classification of the features with structural significance allowed the determination of four structural sets: NW, NS, NE, and EW. They were usually identified in all remote-sensing systems. The NE-trending set was not easily identified in aerial photographs but was better visualized on images of medium-resolution systems (SRTM and Landsat 7 ETM+). The same behavior characterizes the NW-trending. The NS-and EW-trending sets were better identified on images from high-resolution systems (aerial photographs and Quickbird). The structural meaning of the lineaments was established after field work. The NEtrending set is associated with normal and strike-slip faults, including deformation bands. These are the oldest structures identified in the region and are related to the reactivation of Precambrian basement structures from the Transbrazilian Lineament. The NW-trending set represents strike-slip and subordinated normal faults. The high dispersion of this set suggests a more recent origin than the previous structures. The NW-trending set may be related to the Picos-Santa Inês Lineament. The NS-and EW-trending sets correspond to large joints (100 m 5 km long). The truncation relationships between these joint sets indicate that the EW-is older than the NS-trending set. The methodology developed by the present work is an excellent tool for the understanding of the regional and local tectonic structures in the Parnaíba basin. It helps the choice of the best remote-sensing system to identify brittle features in a poorly known sedimentary basin

Desenvolvimento de um sistema de indicadores de desempenho para empreendimentos em construção civil, utilizando a abordagem macroergonômica

This paper prese nts the validation of the Performance Indicator System for Projects under Construction - SIDECC. The goal was to develop a system of performance indicators from the macroergonômica approach, con sidering criteria of usefulness , practicality and applicabilit y and the concept of continuous improveme nt in the construction industry . The validation process SIDECC consisted of three disti nct models . Modeling I corresponded to the theoretical development and valid ation of a system of indicators . Modeling II concern s the development and valida tion of multi - indicator system . For this modeling, we used the Mother of Use and Importance and Multivariate Analysis . Modeling III correspo nded to the validation situated , which consisted of a case study of a wo rk of construct ion of buildings , which were applied and anal yzed the results of modeling II . This work resulted in the development of an applied and tested for the construction of an integrated system of per formance indicators methodology , involving aspects of production , quality , e nvironmental, health and safety . It is inferred that the SIDECC can be applied, in full or in part , the construction companies as a whole, as we ll as in other economic sectors .

A conduta judicial ética teórica e aplicada contida em princípios e regras deontológicos abrangidos pelo sistema constitucional

Research on Legal Deontology dedicated to theoretical and applied ethics on judicial conduct grounded in legal principles and rules set out in the Constitution of the Federative Republic of Brazil and the Organic Law of the National Judiciary, also contemplating propositional instruments covered by the constitutional system, which conveys behavioural paradigms inserted in the Bangalore Principles of Judicial Conduct, in the Universal Statute of the Judge and in the Latin-American Code of Judicial Ethics, as well as highlight the influence of those instruments in the Brazilian Ethical Code of the Magistrates and in the official complementary training of judges in charge of Judiciary Schools. The study provides the theoretical influxes of moral norm, passing by behavioural social norm to consolidate the ideal standards of judicial conduct into legal standards and related instruments. The Legal Deontology directed to the ethical judicial conduct is confronted with the stereotype that society expressed in relation to the judge's person, who is the political agent that interprets the law for making decisions which directly influences the realization of access to justice, that is constitutionally guaranteed to all. Core values inserted in the constitutional system intended to discipline the judicial conduct are presented and analysed under a critical view, since they are enclosed in prescriptive language that conveys behavioural aspects open to interpretation and which compliance is revealed as a proposition focused on promoting a better solution of interest’s conflicts under the responsibility of those who constitute the distinctive corporation of the Judiciary. The theme’s contextualization also focuses on applied ethics, based on the approach of normative and propositional instruments of deontological content, still focusing on the study of real cases examined by the Brazilian National Council of Justice, as part of its correctional goals.