Case-based reasoning for meta-heuristics self-parameterization in a multi-agent scheduling system

A novel agent-based approach to Meta-Heuristics self-configuration is proposed in this work. Meta-heuristics are examples of algorithms where parameters need to be set up as efficient as possible in order to unsure its performance. This paper presents a learning module for self-parameterization of Meta-heuristics (MHs) in a Multi-Agent System (MAS) for resolution of scheduling problems. The learning is based on Case-based Reasoning (CBR) and two different integration approaches are proposed. A computational study is made for comparing the two CBR integration perspectives. In the end, some conclusions are reached and future work outlined.

Cooperation mechanism for team-work based multi-agent system in dynamic scheduling through meta-heuristics

This paper describes a Multi-agent Scheduling System that assumes the existence of several Machines Agents (which are decision-making entities) distributed inside the Manufacturing System that interact and cooperate with other agents in order to obtain optimal or near-optimal global performances. Agents have to manage their internal behaviors and their relationships with other agents via cooperative negotiation in accordance with business policies defined by the user manager. Some Multi Agent Systems (MAS) organizational aspects are considered. An original Cooperation Mechanism for a Team-work based Architecture is proposed to address dynamic scheduling using Meta-Heuristics.

ABS4GD: a multi-agent system that simulates group decision processes considering emotional and argumentative aspects

Emotion although being an important factor in our every day life it is many times forgotten in the development of systems to be used by persons. In this work we present an architecture for a ubiquitous group decision support system able to support persons in group decision processes. The system considers the emotional factors of the intervenient participants, as well as the argumentation between them. Particular attention will be taken to one of components of this system: the multi-agent simulator, modeling the human participants, considering emotional characteristics, and allowing the exchanges of hypothetic arguments among the participants.

ISEM: a multi-agent system that simulates competitive electronic marketplaces

With the increasing importance of large commerce across the Internet it is becoming increasingly evident that in a few years the Iternet will host a large number of interacting software agents. a vast number of them will be economically motivated, and will negociate a variety of goods and services. It is therefore important to consider the economic incentives and behaviours of economic software agents, and to use all available means to anticipate their collective interactions. This papers addresses this concern by presenting a multi-agent market simulator designed for analysing agent market strategies based on a complete understanding of buyer and seller behaviours, preference models and pricing algorithms, consideting risk preferences. The system includes agents that are capable of increasing their performance with their own experience, by adapting to the market conditions. The results of the negotiations between agents are analysed by data minig algorithms in order to extract rules that give agents feedback to imprive their strategies.

Multi-agent Simulation of Bilateral Contracting in Competitive Electricity Markets

Traditional vertically integrated power utilities around the world have evolved from monopoly structures to open markets that promote competition among suppliers and provide consumers with a choice of services. Market forces drive the price of electricity and reduce the net cost through increased competition. Electricity can be traded in both organized markets or using forward bilateral contracts. This article focuses on bilateral contracts and describes some important features of an agent-based system for bilateral trading in competitive markets. Special attention is devoted to the negotiation process, demand response in bilateral contracting, and risk management. The article also presents a case study on forward bilateral contracting: a retailer agent and a customer agent negotiate a 24h-rate tariff. © 2014 IEEE.

Multi-agent simulation of bilateral contracting in competitive electricity markets

Traditional vertically integrated power utilities around the world have evolved from monopoly structures to open markets that promote competition among suppliers and provide consumers with a choice of services. Market forces drive the price of electricity and reduce the net cost through increased competition. Electricity can be traded in both organized markets or using forward bilateral contracts. This article focuses on bilateral contracts and describes some important features of an agent-based system for bilateral trading in competitive markets. Special attention is devoted to the negotiation process, demand response in bilateral contracting, and risk management. The article also presents a case study on forward bilateral contracting: a retailer agent and a customer agent negotiate a 24h-rate tariff. © 2014 IEEE.

Meta-heuristics self-parameterization in a multi-agent scheduling system using case-based reasoning

This paper proposes a novel agent-based approach to Meta-Heuristics self-configuration. Meta-heuristics are algorithms with parameters which need to be set up as efficient as possible in order to unsure its performance. A learning module for self-parameterization of Meta-heuristics (MH) in a Multi-Agent System (MAS) for resolution of scheduling problems is proposed in this work. The learning module is based on Case-based Reasoning (CBR) and two different integration approaches are proposed. A computational study is made for comparing the two CBR integration perspectives. Finally, some conclusions are reached and future work outlined.

Multi-agent system for personalization of location-based services

The current ubiquitous network access and increase in network bandwidth are driving the sales of mobile location-aware user devices and, consequently, the development of context-aware applications, namely location-based services. The goal of this project is to provide consumers of location-based services with a richer end-user experience by means of service composition, personalization, device adaptation and continuity of service. Our approach relies on a multi-agent system composed of proxy agents that act as mediators and providers of personalization meta-services, device adaptation and continuity of service for consumers of pre-existing location-based services. These proxy agents, which have Web services interfaces to ensure a high level of interoperability, perform service composition and take in consideration the preferences of the users, the limitations of the user devices, making the usage of different types of devices seamless for the end-user. To validate and evaluate the performance of this approach, use cases were defined, tests were conducted and results gathered which demonstrated that the initial goals were successfully fulfilled.

Environmental Decision Support: a Multi-Agent Approach

The environmental management domain is vast and encompasses many identifiable activities: impact assessment, planning, project evaluation, etc. In particular, this paper focusses on the modelling of the project evaluation activity. The environmental decision support system under development aims to provide assistance to project developers in the selection of adequate locations, guaranteeing the compliance with the applicable regulations and the existing development plans as well as satisfying the specified project requirements. The inherent multidisciplinarity features of this activity lead to the adoption of the Multi-Agent paradigm, and, in particular, to the modelling of the involved agencies as a community of cooperative autonomous agents, where each agency contributes with its share of problem solving to the final system’s recommendation. To achieve this behaviour the many conclusions of the individual agencies have to be justifiably accommodated: not only they may differ, but can be interdependent, complementary, irreconcilable, or simply, independent. We propose different solutions (involving both local and global consistency) to support the adequate merge of the distinct perspectives that inevitably arise during this type of decision making.

Consistency and Context Management in a Multi Agent Belief Revision Testbed

Multi-agent architectures are well suited for complex inherently distributed problem solving domains. From the many challenging aspects that arise within this framework, a crucial one emerges: how to incorporate dynamic and conflicting agent beliefs? While the belief revision activity in a single agent scenario is concentrated on incorporating new information while preserving consistency, in a multi-agent system it also has to deal with possible conflicts between the agents perspectives. To provide an adequate framework, each agent, built as a combination of an assumption based belief revision system and a cooperation layer, was enriched with additional features: a distributed search control mechanism allowing dynamic context management, and a set of different distributed consistency methodologies. As a result, a Distributed Belief Revision Testbed (DiBeRT) was developed. This paper is a preliminary report presenting some of DiBeRT contributions: a concise representation of external beliefs; a simple and innovative methodology to achieve distributed context management; and a reduced inter-agent data exchange format.

Beliefs and Conflicts in a Real World Multi-Agent System

In a real world multiagent system, where the agents are faced with partial, incomplete and intrinsically dynamic knowledge, conflicts are inevitable. Frequently, different agents have goals or beliefs that cannot hold simultaneously. Conflict resolution methodologies have to be adopted to overcome such undesirable occurrences. In this paper we investigate the application of distributed belief revision techniques as the support for conflict resolution in the analysis of the validity of the candidate beams to be produced in the CERN particle accelerators. This CERN multiagent system contains a higher hierarchy agent, the Specialist agent, which makes use of meta-knowledge (on how the con- flicting beliefs have been produced by the other agents) in order to detect which beliefs should be abandoned. Upon solving a conflict, the Specialist instructs the involved agents to revise their beliefs accordingly. Conflicts in the problem domain are mapped into conflicting beliefs of the distributed belief revision system, where they can be handled by proven formal methods. This technique builds on well established concepts and combines them in a new way to solve important problems. We find this approach generally applicable in several domains.

Multi-agent system for distributed manufacturing scheduling with genetic algorithms and tabu search

Computerized scheduling methods and computerized scheduling systems according to exemplary embodiments. A computerized scheduling method may be stored in a memory and executed on one or more processors. The method may include defining a main multi-machine scheduling problem as a plurality of single machine scheduling problems; independently solving the plurality of single machine scheduling problems thereby calculating a plurality of near optimal single machine scheduling problem solutions; integrating the plurality of near optimal single machine scheduling problem solutions into a main multi-machine scheduling problem solution; and outputting the main multi-machine scheduling problem solution.

Immune reconstitution after autologous hematopoietic stem cell transplantation

Abstract The investigation of the web of relationships between the different elements of the immune system has proven instrumental to better understand this complex biological system. This is particularly true in the case of the interactions between B and T lymphocytes, both during cellular development and at the stage of cellular effectors functions. The understanding of the B–T cells interdependency and the possibility to manipulate this relationship may be directly applicable to situations where immunity is deficient, as is the case of cancer or immune suppression after radio and chemotherapy. The work presented here started with the development of a novel and accurate tool to directly assess the diversity of the cellular repertoire (Chapter III). Contractions of T cell receptor diversity have been related with a deficient immune status. This method uses gene chips platforms where nucleic acids coding for lymphocyte receptors are hybridized and is based on the fact that the frequency of hybridization of nucleic acids to the oligonucleotides on a gene chip varies in direct proportion to diversity. Subsequently, and using this new method and other techniques of cell quantification I examined, in an animal model, the role that polyclonal B cells and immunoglobulin exert upon T cell development in the thymus, specifically on the acquisition of a broader repertoire diversity by the T cell receptors (Chapter IV and V). The hypothesis tested was if the presence of more diverse peptides in the thymus, namely polyclonal immunoglobulin, would induce the generation of more diverse T cells precursors. The results obtained demonstrated that the diversity of the T cell compartment is increased by the presence of polyclonal immunoglobulin. Polyclonal immunoglobulin, and particularly the Fab fragments of the molecule, represent the most diverse self-molecules in the body and its peptides are presented by antigen presenting cells to precursor T cells in the thymus during its development. This probably contributes significantly to the generation of receptor diversity. Furthermore, we also demonstrated that a more diverse repertoire of T lymphocytes is associated with a more effective and robust T cell immune function in vivo, as mice with a more diverse T cell receptors reject minor histocompatiblility discordant skin grafts faster than mice with a shrunken T cell receptor repertoire (Chapter V). We believe that a broader T cell receptor diversity allows a more efficient recognition and rejection of a higher range of external and internal aggressions. In this work it is demonstrated that a reduction of TCR diversity by thymectomy in wild type mice significantly increased survival of H-Y incompatible skin grafts, indicating decrease on T cell function. In addiction reconstitution of T-cell diversity in mice with a decreased T cell repertoire diversity with immunoglobulin Fab fragments, lead to a increase on TCR diversity and to a significantly decreased survival of the skin grafts (Chapter V). These results strongly suggest that increases on T cell repertoire diversity contribute to improvement of T cell function. Our results may have important implications on therapy and immune reconstitution in the context of AIDS, cancer, autoimmunity and post myeloablative treatments. Based on the previous results, we tested the clinical hypothesis that patients with haematological malignancies subjected to stem cell transplantation who recovered a robust immune system would have a better survival compared to patients who did not recover such a robust immune system. This study was undertaken by the examination of the progression and overall survival of 42 patients with mantle cell non-Hodgkin lymphoma receiving autologous hematopoietic stem cell transplantation (Chapter VI). The results obtained show that patients who recovered higher numbers of lymphocytes soon after autologous transplantation had a statistically significantly longer progression free and overall survivals. These results demonstrate the positive impact that a more robust immune system reconstitution after stem cell transplantation may have upon the survival of patients with haematological malignancies. In a similar clinical research framework, this dissertation also includes the study of the impact of recovering normal serum levels of polyclonal immunoglobulin on the survival of patients with another B cell haematological malignancy, multiple myeloma, after autologous stem cell transplantation (Chapter VII). The relapse free survival of the 110 patients with multiple myeloma analysed was associated with their ability to recover normal serum levels of the polyclonal compartment of immunoglobulin. These results suggest again the important effect of polyclonal immunoglobulin for the (re)generation of the immune competence. We also studied the impact of a robust immunity for the response to treatment with the antibody anti CD20, rituximab, in patients with non- Hodgkin’s lymphoma (NHL) (Chapter VIII). Patients with higher absolute counts of CD4+ T lymphocytes respond better (in terms of longer progression free survival) to rituximab compared to patients with lower number of CD4+ T lymphocytes. These observations highlight again the fact that a competent immune system is required for the clinical benefit of rituximab therapy in NHL patients. In conclusion, the work presented in this dissertation demonstrates, for the first time, that diverse B cells and polyclonal immunoglobulin promote T cell diversification in the thymus and improve T lymphocyte function. Also, it shows that in the setting of immune reconstitution, as after autologous stem cell transplantation for mantle cell lymphoma and in the setting of immune therapy for NHL, the absolute lymphocyte counts are an independent factor predicting progression free and overall survival. These results can have an important application in the clinical practice since the majority of the current treatments for cancer are immunosuppressive and implicate a subsequent immune recovery. Also, the effects of a number of antineoplastic treatments, including biological agents, depend on the immune system activity. In this way, studies similar to the ones presented here, where methods to improve the immune reconstitution are examined, may prove to be instrumental for a better understanding of the immune system and to guide more efficient treatment options and the design of future clinical trials. Resumo O estudo da rede de inter-relações entre os diversos elementos do sistema immune tem-se mostrado um instrumento essencial para uma melhor compreensão deste complexo sistema biológico. Tal é particularmente verdade no caso das interacções entre os linfócitos B e T, quer durante o desenvolvimento celular, quer ao nível das funções celulares efectoras. A compreensão da interdependência entre linfócitos B e T e a possibilidade de manipular esta relação pode ser directamente aplicável a situações em que a imunidade está deficiente, como é o caso das doenças neoplásicas ou da imunossupressão após radio ou quimioterapia. O trabalho apresentado nesta dissertação iniciou-se com o desenvolvimento de um novo método laboratorial para medir directamente a diversidade do reportório celular (Capítulo III). Reduções da diversidade do reportório dos receptores de células T têm sido relacionadas com um estado de imunodeficiência. O método desenvolvido utiliza “gene chips”, aos quais hibridizam os ácidos nucleicos codificantes das cadeias proteicas dos receptores linfocitários. A diversidade é calculada com base na frequência de hibridização do ácido nucleico da amostra aos oligonucleótidos presentes no “gene chip”. De seguida, e utilizando este novo método e outras técnicas de quantificação celular examinei, num modelo animal, o papel que as células policlonais B e a imunoglobulina exercem sobre o desenvolvimento linfocitário T no timo, especificamente na aquisição de um reportório diverso de receptores T (Capítulos IV e V). Testei, então, a hipótese de que a presença no timo de péptidos mais diversos, como a imunoglobulna policlonal, induzisse a génese de precursores T mais diversos. Demonstrámos que a diversidade do compartimento T é aumentado pela presença de imunoglobulina policlonal. A imunoglobulina policlonal, e particularmente os fragmentos Fab desta molécula, representam as moléculas autólogas mais diversas presentes nos organismos vertebrados. Estes péptidos são apresentados por células apresentadoras de antigénio às células precursoras T no timo, durante o desenvolvimento celular T. Tal, provavelmente, contribui para a génese da diversidade dos receptores. Também demonstrámos que a presença de um reportório mais diverso de linfócitos T se associa a um incremento da função imunológica T in vivo. Uma diversidade de receptores T mais extensa parece permitir um reconhecimento e rejeição mais eficientes de um maior número de agressores internos e externos. Demonstrámos que ratinhos com receptores de células T (RCT) com maior diversidade rejeitam transplantes cutâneos discordantes para antigénios minor de histocompatibilidade mais rapidamente do que ratinhos com um menor reportório T (Capítulo V). Por outro lado, uma redução da diversidade do RCT, causada por timectomia de ratinhos de estirpes selvagens, mostrou aumentar significativamente a sobrevivência de transplantes cutâneos incompatíveis para o antigénio H-Y (antigénio minor de histocompatibilidade), indicando uma diminuição da função linfocitária T. Além disso, a reconstituição da diversidade dos linfócitos T em ratinhos com uma diversidade de reportório T diminuída, induzida pela administração de fragmentos Fab de imunoglobulina, conduz a um aumento da diversidade dos RCT e a uma diminuição significativa da sobrevivência dos enxertos cutâneos (Capítulo V). Estes resultados sugerem que o aumento do reportório de células T contribui para uma melhoria das funções celulares T e poderão ter implicações importantes na terapêutica e reconstitutição imunológica em contexto de SIDA, neoplasias, autoimunidade e após tratamentos mieloablativos. Baseado nos resultados anteriores, decidimos testar a hipótese clínica de que doentes com neoplasias hematológicas sujeitos a transplantação de precursores hematopoiéticos e com recuperação imunológica precoce após transplante teriam uma sobrevivência mais longa do que doentes que não recuperassem tão bem a sua imunidade. Analisámos a sobrevivência global e sobrevivência sem doença de 42 doentes com linfoma não Hodgkin de células do manto sujeitos a transplante autólogo de precursores hematopoiéticos (Capítulo VI). Os resultados obtidos mostraram que os doentes que recuperaram contagens mais elevadas de linfócitos imediatamente após o transplante autólogo, apresentaram uma sobrevivência global e sem progressão mais longa do que doentes que não recuperaram contagens linfocitárias tão precocemente. Estes resultados demonstram o efeito positivo de uma reconstitutição imunológica robusta após transplante de presursores hematopoiéticos, sobre a sobrevivência de doentes com neoplasias hematológicas. Do mesmo modo, estudámos o efeito que a recuperação de níveis séricos normais de imunoglobulina policlonal tem na sobrevivência de doentes com outras neoplasias hematológicas de linfócitos B, como o mieloma múltiplo,após transplante autólogo de precursos hematopoiéticos (Capítulo VII). A sobrevivência livre de doença dos 110 doentes com mieloma múltiplo analizados está associada com a sua capacidade de recuperar níveis séricos normais do compartmento policlonal de imunoglobulina. Estes resultados pioneiros indicam a importância da imunoglobulina policlonal para a génese de competência imunológica. Também estudámos o impacto de um sistema imunitário eficiente sobre a resposta ao tratamento com o anticorpo anti CD20, ituximab, em doentes com linfoma não Hodgkin (LNH) (Capítulo VIII). Os resultados mostram que doentes com valores mais elevados de linfócitos T CD4+ respondem melhor (em termos de maior sobrevida livre de doença) ao rituximab, do que doentes com valores mais baixos. Estas observações ilustram a necessidade de um sistema imunitário competente para o benefício clínico da terapêutica com rituximab em doentes com LNH. Em conclusão, o trabalho apresentado nesta dissertação demonstra que as células B e a imunoglobulina policlonal promovem a diversidade das células T no timo e melhoram a função linfocitária T periférica. Concomitantemente, também demonstrámos que, no contexto de reconstituição imune, por exemplo, após transplante autólogo de precursores hematopoiéticos em doentes com linfomas de células do manto, o número absoluto de linfócitos é uma factor independente da sobrevivência. Os resultados demonstram, também, a importância dos valores de linfocitos T na resposta ao tratamento com rituximab no caso de doentes com LNH. O mesmo princípio se prova pelo facto de que doentes com mieloma múltiplo sujeitos a transplante autólogo de precursores hematopoiéticos que recuperam valores normais séricos de imunoglobulinas policlonais, terem melhores taxas de resposta em comparação com doentes que não recuperam valores normais de imunoglobulinas policlonais. Estes resultados podem ter importantes aplicações na prática clínica dado que a maioria dos tratamentos de doenças neoplásicas implica imunossupressão e, subsequente, recuperação imunológica. Estes estudos podem ser um instrumento fundamental para uma melhor compreensão do sistema imune e guiar uma escolha mais eficiente de opções terapêuticas bem como contribuir para a concepção de futuros estudos clínicos.

Multi-Agent Based Smart Grid Management and Simulation: Situation Awareness and Learning in a Test Bed with Simulated and Real Installations and Players

The rising usage of distributed energy resources has been creating several problems in power systems operation. Virtual Power Players arise as a solution for the management of such resources. Additionally, approaching the main network as a series of subsystems gives birth to the concepts of smart grid and micro grid. Simulation, particularly based on multi-agent technology is suitable to model all these new and evolving concepts. MASGriP (Multi-Agent Smart Grid simulation Platform) is a system that was developed to allow deep studies of the mentioned concepts. This paper focuses on a laboratorial test bed which represents a house managed by a MASGriP player. This player is able to control a real installation, responding to requests sent by the system operators and reacting to observed events depending on the context.

Automatic Electricity Markets Data Extraction for Realistic Multi-agent Simulations

Electricity markets worldwide suffered profound transformations. The privatization of previously nationally owned systems; the deregulation of privately owned systems that were regulated; and the strong interconnection of national systems, are some examples of such transformations [1, 2]. In general, competitive environments, as is the case of electricity markets, require good decision-support tools to assist players in their decisions. Relevant research is being undertaken in this field, namely concerning player modeling and simulation, strategic bidding and decision-support.