Multi-Agent Based Smart Grid Management and Simulation: Situation Awareness and Learning in a Test Bed with Simulated and Real Installations and Players

The rising usage of distributed energy resources has been creating several problems in power systems operation. Virtual Power Players arise as a solution for the management of such resources. Additionally, approaching the main network as a series of subsystems gives birth to the concepts of smart grid and micro grid. Simulation, particularly based on multi-agent technology is suitable to model all these new and evolving concepts. MASGriP (Multi-Agent Smart Grid simulation Platform) is a system that was developed to allow deep studies of the mentioned concepts. This paper focuses on a laboratorial test bed which represents a house managed by a MASGriP player. This player is able to control a real installation, responding to requests sent by the system operators and reacting to observed events depending on the context.

Upper Ontology for Multi-Agent Energy Systems’ Applications

Energy systems worldwide are complex and challenging environments. Multi-agent based simulation platforms are increasing at a high rate, as they show to be a good option to study many issues related to these systems, as well as the involved players at act in this domain. In this scope the authors research group has developed three multi-agent systems: MASCEM, which simulates the electricity markets; ALBidS that works as a decision support system for market players; and MASGriP, which simulates the internal operations of smart grids. To take better advantage of these systems, their integration is mandatory. For this reason, is proposed the development of an upper-ontology which allows an easier cooperation and adequate communication between them. Additionally, the concepts and rules defined by this ontology can be expanded and complemented by the needs of other simulation and real systems in the same areas as the mentioned systems. Each system’s particular ontology must be extended from this top-level ontology.

Demonstration of the Multi-Agent Simulator of Competitive Electricity Markets

Electricity markets are complex environments with very particular characteristics. A critical issue concerns the constant changes they are subject to. This is a result of the electricity markets’ restructuring, performed so that the competitiveness could be increased, but with exponential implications in the increase of the complexity and unpredictability in those markets’ scope. The constant growth in markets unpredictability resulted in an amplified need for market intervenient entities in foreseeing market behavior. The need for understanding the market mechanisms and how the involved players’ interaction affects the outcomes of the markets, contributed to the growth of usage of simulation tools. Multi-agent based software is particularly well fitted to analyze dynamic and adaptive systems with complex interactions among its constituents, such as electricity markets. This paper presents the Multi-Agent System for Competitive Electricity Markets (MASCEM) – a simulator based on multi-agent technology that provides a realistic platform to simulate electricity markets, the numerous negotiation opportunities and the participating entities.

Automatic Electricity Markets Data Extraction for Realistic Multi-agent Simulations

Electricity markets worldwide suffered profound transformations. The privatization of previously nationally owned systems; the deregulation of privately owned systems that were regulated; and the strong interconnection of national systems, are some examples of such transformations [1, 2]. In general, competitive environments, as is the case of electricity markets, require good decision-support tools to assist players in their decisions. Relevant research is being undertaken in this field, namely concerning player modeling and simulation, strategic bidding and decision-support.

Load Control Timescales Simulation in a Multi-Agent Smart Grid Platform

Environmental concerns and the shortage in the fossil fuel reserves have been potentiating the growth and globalization of distributed generation. Another resource that has been increasing its importance is the demand response, which is used to change consumers’ consumption profile, helping to reduce peak demand. Aiming to support small players’ participation in demand response events, the Curtailment Service Provider emerged. This player works as an aggregator for demand response events. The control of small and medium players which act in smart grid and micro grid environments is enhanced with a multi-agent system with artificial intelligence techniques – the MASGriP (Multi-Agent Smart Grid Platform). Using strategic behaviours in each player, this system simulates the profile of real players by using software agents. This paper shows the importance of modeling these behaviours for studying this type of scenarios. A case study with three examples shows the differences between each player and the best behaviour in order to achieve the higher profit in each situation.

Biomarkers in Solea Senegalensis Kaup, 1858 exposed to contaminated estuarine sediments: a multi-level approach

Thesis submitted to the Universidade Nova de Lisboa, Faculdade de Ciências e Tecnologia for the degree of Doctor of Philosophy in Environmental Sciences

Multi-scale vegetation classification using earth observation data of the Sundarban mangrove forest, Bangladesh.

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial Technologies.

Multi-agent Simulation of Bilateral Contracting in Competitive Electricity Markets

Traditional vertically integrated power utilities around the world have evolved from monopoly structures to open markets that promote competition among suppliers and provide consumers with a choice of services. Market forces drive the price of electricity and reduce the net cost through increased competition. Electricity can be traded in both organized markets or using forward bilateral contracts. This article focuses on bilateral contracts and describes some important features of an agent-based system for bilateral trading in competitive markets. Special attention is devoted to the negotiation process, demand response in bilateral contracting, and risk management. The article also presents a case study on forward bilateral contracting: a retailer agent and a customer agent negotiate a 24h-rate tariff.

Realistic Multi-Agent Simulation of Competitive Electricity Markets

The dynamism and ongoing changes that the electricity markets sector is constantly suffering, enhanced by the huge increase in competitiveness, create the need of using simulation platforms to support operators, regulators, and the involved players in understanding and dealing with this complex environment. This paper presents an enhanced electricity market simulator, based on multi-agent technology, which provides an advanced simulation framework for the study of real electricity markets operation, and the interactions between the involved players. MASCEM (Multi-Agent Simulator of Competitive Electricity Markets) uses real data for the creation of realistic simulation scenarios, which allow the study of the impacts and implications that electricity markets transformations bring to different countries. Also, the development of an upper-ontology to support the communication between participating agents, provides the means for the integration of this simulator with other frameworks, such as MAN-REM (Multi-Agent Negotiation and Risk Management in Electricity Markets). A case study using the enhanced simulation platform that results from the integration of several systems and different tools is presented, with a scenario based on real data, simulating the MIBEL electricity market environment, and comparing the simulation performance with the real electricity market results.

Data Mining Approach to support the Generation of Realistic Scenarios for Multi-Agent simulation of Electricity Markets

This paper presents the Realistic Scenarios Generator (RealScen), a tool that processes data from real electricity markets to generate realistic scenarios that enable the modeling of electricity market players’ characteristics and strategic behavior. The proposed tool provides significant advantages to the decision making process in an electricity market environment, especially when coupled with a multi-agent electricity markets simulator. The generation of realistic scenarios is performed using mechanisms for intelligent data analysis, which are based on artificial intelligence and data mining algorithms. These techniques allow the study of realistic scenarios, adapted to the existing markets, and improve the representation of market entities as software agents, enabling a detailed modeling of their profiles and strategies. This work contributes significantly to the understanding of the interactions between the entities acting in electricity markets by increasing the capability and realism of market simulations.

Distributed Intelligent Management of Microgrids using a Multi-Agent Simulation Platform

Multi-agent approaches have been widely used to model complex systems of distributed nature with a large amount of interactions between the involved entities. Power systems are a reference case, mainly due to the increasing use of distributed energy sources, largely based on renewable sources, which have potentiated huge changes in the power systems’ sector. Dealing with such a large scale integration of intermittent generation sources led to the emergence of several new players, as well as the development of new paradigms, such as the microgrid concept, and the evolution of demand response programs, which potentiate the active participation of consumers. This paper presents a multi-agent based simulation platform which models a microgrid environment, considering several different types of simulated players. These players interact with real physical installations, creating a realistic simulation environment with results that can be observed directly in the reality. A case study is presented considering players’ responses to a demand response event, resulting in an intelligent increase of consumption in order to face the wind generation surplus.

The role of complex chromosome translocations in leukemia

Resumo A tumorigénese é um processo de transformação celular que se desenrola tipicamente em várias etapas. Os diferentes níveis de evolução tumoral resultam da acumulação sucessiva de mutações genéticas numa célula normal que lhe conferem uma vantagem selectiva no respectivo meio tecidular. As mutações podem manifestar-se sob a forma de alterações nucleotídicas pontuais ao nível da sequência de DNA, levando a uma desregulação da função proteíca ou à formação de proteínas não-funcionais, ou através de alterações cromossómicas numéricas ou estruturais. Na leucemia, por exemplo, os genes híbridos que resultam de translocações cromossómicas desempenham um importante papel no processo tumorigénico. Estes genes são transcritos sob a forma de um RNA mensageiro de fusão, o qual é traduzido numa proteína híbrida com função oncogénica. Frequentemente, os subtipos de doença leucémica estão associados com translocações cromossómicas que envolvem 2 pontos de quebra recorrentes e específicos. É disto exemplo a leucemia mielóide crónica, em que uma translocação recíproca entre os cromossomas 9 e 22 conduz à formação de um gene de fusão BCR-ABL1. Em diferentes subtipos de doença, existe também uma pequena proporção de casos que apresenta translocações cromossómicas complexas, que envolvem um ou mais pontos de quebra adicionais em outras localizações genómicas além das que estão implicadas na formação dos genes de fusão. Por vezes, os pontos de quebra estão também associados a delecções extensas de material genético que se pensa terem uma função importante na tumorigénese. No entanto, o papel destas regiões genómicas no desenvolvimento tumoral não tem sido um motivo recorrente de estudo. Neste contexto, o objectivo desta dissertação foi o de determinar o potencial papel tumorigénico de alterações génicas adicionais ocorridas nos pontos de quebra de translocações cromossómicas complexas. Para a prossecução do objectivo proposto, foram estudados 5 rearranjos cromossómicos distintos associados com diferentes tipos de doença hematológica maligna, nomeadamente a leucemia linfoblástica aguda de células B (2 casos), leucemia mielóide aguda, neoplasma mieloproliferativo e síndrome mielodisplásico/neoplasma ieloproliferativo, não classificável. O mapeamento dos pontos de quebra foi efectuado utilizando a hibridação fluorescente in situ e diferentes metodologias de biologia molecular, tendo como base a informação inicial da análise citogenética. Em casos seleccionados, o papel dos novos genes candidatos foi avaliado in vitro utilizando modelos de linhas celulares, nomeadamente no que respeita às funções de controlo da proliferação celular e de regulação transcricional. De entre os 5 casos estudados, quatro deles evidenciaram translocações complexas envolvendo 3 cromossomas, nomeadamente t(12;21;5)(p13;q22;q13), t(12;6;15)(p13;p24~25;q22), t(9;11;19)(p22;q23;p13) e t(X;20;16)(p11;q13;q23). No caso remanescente, foi observada uma translocação dicêntrica dic(9;12)(p11;p11) acompanhada de delecções extensas em ambos os pontos de quebra. Nos casos com t(12;21;5) e t(9;11;19) as translocações estavam associadas com a presença de genes de fusão recorrentes, nomeadamente TV6(12p13)-RUNX1(21q22) e TLL(11q23)-MLLT3(9p22), indicando que se tratavam de rearranjos complexos das translocações t(12;21) e t(9;11) associadas com a leucemia linfoblástica aguda de células B e a leucemia mielóide aguda, respectivamente. O papel dos pontos de quebra adicionais foi estudado em detalhe no caso com t(9;11;19). Através da metodologia de long distance inverse-polymerase chain reaction, foram identificados os pontos de quebra na sequência de DNA dos 3 cromossomas envolvidos na translocação. Além dos pontos de quebra nos genes MLL e MLLT3, foi observado que o local de quebra no cromossoma 19 interrompeu a sequência de um novo gene, designado CCDC94,conduzindo à sua haplo-insuficiência nas células com t(9;11;19). Através de ensaios de reverse transcription-polymerase chain reaction verificámos que o gene CCDC94 é expresso ubiquitariamente em tecidos humanos normais. A análise informática da sequência prevista da proteína CCDC94 indicou uma elevada identidade de aminoácidos com a proteína cwf16, envolvida na regulação do ciclo celular da levedura Schizosaccharomyces pombe. Através da clonagem do DNA complementar de CCDC94 em vectores de expressão, e após a transfecção destes em culturas de linhas celulares in vitro, observámos que este gene codifica uma proteína de localização exclusivamente nuclear. A expressão ectópica da proteína CCDC94 diminuiu a progressão do ciclo celular e a proliferação das células em cultura. Inversamente, a supressão do transcrito do gene CCDC94 através de interferência de RNA conduziu a um aumento significativo da proliferação celular, confirmando que CCDC94 regula negativamente a proliferação e a progressão do ciclo celular. Estes resultados mostram que os pontos de quebra adicionais, presentes em translocações cromossómicas complexas em leucemia, podem resultar na haplo-insuficiência de genes controladores dos mecanismos proliferativos, cooperando desta forma com a acção das proteínas de fusão para proporcionar ao clone leucémico uma proliferação celular descontrolada. Nos restantes 3 casos estudados não foram identificados genes de fusão. Ao invés, todos aqueles apresentaram delecções de extensão variável associadas com os pontos de quebra cromossómicos. No caso com t(12;6;15), identificámos uma delecção de 1.2 megabases de DNA na banda 12p13 que resultou na eliminação de 9 genes incluindo ETV6 e CDKN1B. O gene ETV6 codifica um factor de transcrição que é essencial para a formação das diferentes linhagens hematopoiéticas na medula óssea, enquanto CDKN1B é traduzido numa proteína responsável por bloquear a entrada das células na fase G1 do ciclo celular e,consequentemente, por travar a proliferação celular. Neste contexto, os resultados obtidos indicam que a perda simultânea de ETV6 e de CDKN1B, através de uma translocação cromossómica complexa, constituiu uma acção cooperativa na leucemogénese. A mesma noção pode aplicar-se ao caso com dic(9;12), no qual pelo menos 2 genes que codificam para factores de transcrição importantes na linhagem hematopoiética, PAX5 no cromossoma 9 e ETV6 no cromossoma 12, estavam deleccionados como resultado do rearranjo cromossómico. Dado que o factor de transcrição PAX5 regula negativamente a expressão do gene FLT3, que desempenha uma função pró-proliferativa, é expectável que a haplo-insuficiência de PAX5 no caso com dic(9;12) terá tido como consequência uma elevação dos níveis de expressão de FLT3, contribuindo deste modo para uma proliferação celular aumentada. A t(X;20;16) foi identificada num doente com trombocitémia essencial (TE), uma doença que está intimamente relacionada com alterações de vias intracelulares reguladas por citocinas. Neste caso, através da utilização de um array genómico, identificámos a presença de pequenas delecções associadas com os pontos de quebra nos cromossomas 16 e 20. No cromossoma 16 apenas um gene, MAF, estava deleccionado, enquanto no cromossoma 20 a delecção tinha abrangido 3 genes. Dos genes deleccionados, dois deles, NFATC2 (20q13) e MAF (16q23), codificam proteínas que operam como reguladores transcricionais de citocinas hematopoiéticas. Dado que NFATC2 se localiza numa região que constitui um alvo frequente de delecções em neoplasmas ieloproliferativos, incluindo a trombocitémia essencial,efectuámos um estudo detalhado do papel deste gene na proliferação megacariocítica e na regulação da expressão de uma citocina hematopoiética (GM-CSF), implicada na maturação das diferentes linhagens mielóides. Utilizando um modelo de linha celular de trombocitémia essencial, verificámos que a supressão do transcrito do gene NFATC2 in vitro, por interferência de RNA, estava associada com um aumento da proliferação celular. Em concordância, o bloqueio da activação da proteína NFATC2 através de um inibidor específico da sua interacção com a calcineurina, conduziu a um aumento da proliferação celular in vitro. Utilizando a PCR quantitativa em tempo real, detectou-se um aumento da produção do RNA de GM-CSF em ambos os ensaios celulares, indicando que o factor de transcrição NFATC2 pode regular negativamente a expressão de GM-CSF em células de trombocitémia essencial. No geral, estes resultados mostram que a redução dos níveis fisiológicos do transcrito NFATC2, ou a redução da respectiva actividade proteica, estão relacionados com a proliferação de megacariocitos através do aumento da produção de GM-CSF. De acordo com estes resultados, verificámos que as células dos doentes com TE apresentam níveis mais baixos do transcrito NFATC2 do que a população normal. Dado que o factor de transcrição MAF desempenha igualmente um papel como regular transcricional de citocinas, é plausível que a haplo-insuficiência dos genes NFATC2 e MAF, resultante do rearranjo cromossómico complexo t(X;20;16), teve um efeito cooperativo importante na patogénese da trombocitémia essencial através da alteração do padrão normal de expressão das citocinas hematopoiéticas. Em síntese, efectuámos nesta dissertação um estudo citogenético de 4 translocações cromossómicas complexas incluindo t(12;21;5), t(12;6;15), t(9;11;19) e t(X;20;16), e de uma translocação dicêntrica dic(9;12), associadas com diferentes neoplasmas hematológicos. Em casos seleccionados efectuámos também um estudo molecular detalhado das regiões dos pontos de quebra. Esta análise permitiu-nos identificar 2 genes, CCDC94 no cromossoma 19 e NFATC2 no cromossoma 20, cuja haplo-insuficiência pode promover o aumento da proliferação celular das células leucémicas. A partir destes estudos podem ser retiradas 2 noções principais: (i) Os pontos de quebra adicionais, que ocorrem em translocações complexas associadas com a formação de genes de fusão, podem ter como consequência a desregulação de genes controladores da proliferação celular (e.g., CCDC94); (ii) As translocações complexas caracterizadas pela ausência de genes de fusão recorrentes poderão estar preferencialmente associadas com a presença de delecções, envolvendo um ou mais genes, nos pontos de quebra; nestas situações, serão necessários pelo menos 2 genes com funções celulares semelhantes (e.g., NFATC2 e MAF) ou complementares (e.g., ETV6 e CDKN1B) para, quando deleccionados, promoverem de forma cooperativa a leucemogénese. Nestes termos, o modelo de alterações genéticas sequenciais que caracteriza o desenvolvimento do cancro pode ser substituído por um modelo em que vários genes-alvo são simultaneamente desregulados pela formação de uma translocação cromossómica complexa, evitando deste modo a necessidade de ocorrência de alterações genéticas subsequentes.----------------------ABSTRACT: Tumourigenesis is a multistep process which results from the accumulation of successive genetic mutations in a normal cell. In leukemia for instance, recurrent translocations play a part in this process by generating fusion genes which lead to the production of hybrid proteins with an oncogenic role. However, a minor subset of chromosomal translocations referred to as complex or variant involves extra breakpoints at variable genome locations in addition to those implicated in the formation of fusion genes. We aimed to describe in this work the role, if any, of genes located at extra breakpoint locations or which are affected by breakpoint-adjacent deletions through the study of 5 leukemia patients.Two of the patients presented with TV6(12p13)-RUNX1(21q22) and MLL(11q23)- MLLT3(9p22) fusion genes as a result of a t(12;21;5) and a t(9;11;19), respectively. Detailed molecular characterization of the extra breakpoint at chromosome 19 in the latter case revealed that a novel ubiquitously expressed gene, CCDC94, with a potential role in cell cycle regulation, was disrupted by the breakpoint. We demonstrated using in vitro cellular assays that this gene codifies for a nuclear protein which negatively regulates cell cycle progression. These data shows that extra breakpoint locations of complex translocations may result in haplo-insufficiency of critical proliferation genes, thereby cooperating with the generation of hybrid proteins to provide unrestrained cell proliferation. In the other 3 patients there were reakpoint-associated deletions which precluded the formation of putative fusion genes. In a case with a t(12;6;15) we characterized a deletion at 12p13 which eliminated ETV6 and 8 other genes including CDKN1B. These findings indicate that concomitant loss of ETV6 and CDKN1B, which encodes a cyclin-dependent kinase inhibitor responsible for blocking entry of cells into the G1 phase of the cell cycle, acted cooperatively to promote leukemogenic proliferation. The same notion applied to a case with a dic(9;12) in which 2 genes encoding hematopoietic transcription factors - ETV6 and PAX5 (9p13)- were deleted as a result of breakpoint-adjacent deletions. Similarly, we found that 2 transcription factor genes involved in the regulation of cytokine expression, NFATC2 (20q13) and MAF (16q23), were involved in deletions contiguous to the breakpoints in a patient with a t(X;20;16). In vitro suppression of NFATC2 mRNA or inhibiton of NFATC2 protein activity enhanced cell proliferation as a result of an increase in the production of a myeloid-lineage stimulating hematopoietic cytokine, GM-CSF. These results suggest that haplo-insufficiency of NFATC2 and MAF genes had a cooperative effect in inducing cell proliferation as a result of a disregulation of cytokine production. Two main conclusions may be drawn from our studies: (i) In complex translocations associated with the production of fusion genes, additional breakpoints may cooperate in tumourigenesis by targeting genes that control cell proliferation; (ii) In complex translocations associated with small breakpoint-adjacent deletions, at least 2 genes with similar or complementary functions need to be deregulated to promote tumourigenesis.

A framework for memory contention analysis in multi-core platforms

The last decade has witnessed a major shift towards the deployment of embedded applications on multi-core platforms. However, real-time applications have not been able to fully benefit from this transition, as the computational gains offered by multi-cores are often offset by performance degradation due to shared resources, such as main memory. To efficiently use multi-core platforms for real-time systems, it is hence essential to tightly bound the interference when accessing shared resources. Although there has been much recent work in this area, a remaining key problem is to address the diversity of memory arbiters in the analysis to make it applicable to a wide range of systems. This work handles diverse arbiters by proposing a general framework to compute the maximum interference caused by the shared memory bus and its impact on the execution time of the tasks running on the cores, considering different bus arbiters. Our novel approach clearly demarcates the arbiter-dependent and independent stages in the analysis of these upper bounds. The arbiter-dependent phase takes the arbiter and the task memory-traffic pattern as inputs and produces a model of the availability of the bus to a given task. Then, based on the availability of the bus, the arbiter-independent phase determines the worst-case request-release scenario that maximizes the interference experienced by the tasks due to the contention for the bus. We show that the framework addresses the diversity problem by applying it to a memory bus shared by a fixed-priority arbiter, a time-division multiplexing (TDM) arbiter, and an unspecified work-conserving arbiter using applications from the MediaBench test suite. We also experimentally evaluate the quality of the analysis by comparison with a state-of-the-art TDM analysis approach and consistently showing a considerable reduction in maximum interference.

Trade-Off Performance Regions of Slotted ALOHA Protocol using Multi-Objective Optimization

10th Conference on Telecommunications (Conftele 2015), Aveiro, Portugal.