Adaptive Learning in Games: Defining Profiles of Competitor Players

Artificial Intelligence has been applied to dynamic games for many years. The ultimate goal is creating responses in virtual entities that display human-like reasoning in the definition of their behaviors. However, virtual entities that can be mistaken for real persons are yet very far from being fully achieved. This paper presents an adaptive learning based methodology for the definition of players’ profiles, with the purpose of supporting decisions of virtual entities. The proposed methodology is based on reinforcement learning algorithms, which are responsible for choosing, along the time, with the gathering of experience, the most appropriate from a set of different learning approaches. These learning approaches have very distinct natures, from mathematical to artificial intelligence and data analysis methodologies, so that the methodology is prepared for very distinct situations. This way it is equipped with a variety of tools that individually can be useful for each encountered situation. The proposed methodology is tested firstly on two simpler computer versus human player games: the rock-paper-scissors game, and a penalty-shootout simulation. Finally, the methodology is applied to the definition of action profiles of electricity market players; players that compete in a dynamic game-wise environment, in which the main goal is the achievement of the highest possible profits in the market.

Short-term Wind Forecasting to Support Virtual Power Player Operation

This paper proposes a wind speed forecasting model that contributes to the development and implementation of adequate methodologies for Energy Resource Man-agement in a distribution power network, with intensive use of wind based power generation. The proposed fore-casting methodology aims to support the operation in the scope of the intraday resources scheduling model, name-ly with a time horizon of 10 minutes. A case study using a real database from the meteoro-logical station installed in the GECAD renewable energy lab was used. A new wind speed forecasting model has been implemented and it estimated accuracy was evalu-ated and compared with a previous developed forecast-ing model. Using as input attributes the information of the wind speed concerning the previous 3 hours enables to obtain results with high accuracy for the wind short-term forecasting.

Determination of electricity consumers’ load profiles via weighted evidence accumulation clustering using subsampling

With the electricity market liberalization, the distribution and retail companies are looking for better market strategies based on adequate information upon the consumption patterns of its electricity consumers. A fair insight on the consumers’ behavior will permit the definition of specific contract aspects based on the different consumption patterns. In order to form the different consumers’ classes, and find a set of representative consumption patterns we use electricity consumption data from a utility client’s database and two approaches: Two-step clustering algorithm and the WEACS approach based on evidence accumulation (EAC) for combining partitions in a clustering ensemble. While EAC uses a voting mechanism to produce a co-association matrix based on the pairwise associations obtained from N partitions and where each partition has equal weight in the combination process, the WEACS approach uses subsampling and weights differently the partitions. As a complementary step to the WEACS approach, we combine the partitions obtained in the WEACS approach with the ALL clustering ensemble construction method and we use the Ward Link algorithm to obtain the final data partition. The characterization of the obtained consumers’ clusters was performed using the C5.0 classification algorithm. Experiment results showed that the WEACS approach leads to better results than many other clustering approaches.

Typical load profiles in the smart grid context – a clustering methods comparison

The present research paper presents five different clustering methods to identify typical load profiles of medium voltage (MV) electricity consumers. These methods are intended to be used in a smart grid environment to extract useful knowledge about customer’s behaviour. The obtained knowledge can be used to support a decision tool, not only for utilities but also for consumers. Load profiles can be used by the utilities to identify the aspects that cause system load peaks and enable the development of specific contracts with their customers. The framework presented throughout the paper consists in several steps, namely the pre-processing data phase, clustering algorithms application and the evaluation of the quality of the partition, which is supported by cluster validity indices. The process ends with the analysis of the discovered knowledge. To validate the proposed framework, a case study with a real database of 208 MV consumers is used.

Intelligent energy resource management considering vehicle-to-grid: A simulated annealing approach

This paper proposes a simulated annealing (SA) approach to address energy resources management from the point of view of a virtual power player (VPP) operating in a smart grid. Distributed generation, demand response, and gridable vehicles are intelligently managed on a multiperiod basis according to V2G user´s profiles and requirements. Apart from using the aggregated resources, the VPP can also purchase additional energy from a set of external suppliers. The paper includes a case study for a 33 bus distribution network with 66 generators, 32 loads, and 1000 gridable vehicles. The results of the SA approach are compared with a methodology based on mixed-integer nonlinear programming. A variation of this method, using ac load flow, is also used and the results are compared with the SA solution using network simulation. The proposed SA approach proved to be able to obtain good solutions in low execution times, providing VPPs with suitable decision support for the management of a large number of distributed resources.

Intelligent multi-player smart grid management considering distributed energy resources and demand response

The smart grid concept is rapidly evolving in the direction of practical implementations able to bring smart grid advantages into practice. Evolution in legacy equipment and infrastructures is not sufficient to accomplish the smart grid goals as it does not consider the needs of the players operating in a complex environment which is dynamic and competitive in nature. Artificial intelligence based applications can provide solutions to these problems, supporting decentralized intelligence and decision-making. A case study illustrates the importance of Virtual Power Players (VPP) and multi-player negotiation in the context of smart grids. This case study is based on real data and aims at optimizing energy resource management, considering generation, storage and demand response.

Adaptive learning in agents behaviour: a framework for electricity markets simulation

Electricity markets are complex environments with very particular characteristics. A critical issue regarding these specific characteristics concerns the constant changes they are subject to. This is a result of the electricity markets’ restructuring, which was performed so that the competitiveness could be increased, but it also had exponential implications in the increase of the complexity and unpredictability in those markets scope. The constant growth in markets unpredictability resulted in an amplified need for market intervenient entities in foreseeing market behaviour. The need for understanding the market mechanisms and how the involved players’ interaction affects the outcomes of the markets, contributed to the growth of usage of simulation tools. Multi-agent based software is particularly well fitted to analyze dynamic and adaptive systems with complex interactions among its constituents, such as electricity markets. This dissertation presents ALBidS – Adaptive Learning strategic Bidding System, a multiagent system created to provide decision support to market negotiating players. This system is integrated with the MASCEM electricity market simulator, so that its advantage in supporting a market player can be tested using cases based on real markets’ data. ALBidS considers several different methodologies based on very distinct approaches, to provide alternative suggestions of which are the best actions for the supported player to perform. The approach chosen as the players’ actual action is selected by the employment of reinforcement learning algorithms, which for each different situation, simulation circumstances and context, decides which proposed action is the one with higher possibility of achieving the most success. Some of the considered approaches are supported by a mechanism that creates profiles of competitor players. These profiles are built accordingly to their observed past actions and reactions when faced with specific situations, such as success and failure. The system’s context awareness and simulation circumstances analysis, both in terms of results performance and execution time adaptation, are complementary mechanisms, which endow ALBidS with further adaptation and learning capabilities.

Characterizations of power indices based on null player free winning coalitions

In this paper, we characterize two power indices introduced in [1] using two different modifications of the monotonicity property first stated by [2]. The sets of properties are easily comparable among them and with previous characterizations of other power indices.

Inventories and concentration profiles of 137Cs in undisturbed soils in the northeast of Buenos Aires Province, Argentina

Inventories and vertical distribution of (137)Cs were determined in La Plata region undisturbed soils, Argentina. A mean inventory value of 891 ± 220 Bq/m(2) was established, which is compatible with the values expected from atmospheric weapon tests fallout. The study was complemented with pH, organic carbon fraction, texture and mineralogical soil analyses. Putting together Southern Hemisphere (137)Cs inventory data, it is possible to correlate these data with the mean annual precipitations. The large differences in (137)Cs concentration profiles were attributed to soil properties, especially the clay content and the pH values. A convection-dispersion model with irreversible retention was used to fit the activity concentration profiles. The obtained effective diffusion coefficient and effective convection velocity parameters values were in the range from 0.2 cm(2)/y to 0.4 cm(2)/y and from 0.23 cm/y to 0.43 cm/y, respectively. These data are in agreement with values reported in literature. In general, with the growth of clay content in the soil, there was an increase in the transfer rate from free to bound state. Finally, the highest transfer rate from free to bound state was obtained for soil pH value equal to 8.

Development of a new pultrusion equipment to manufacture thermoplastic matrix composite profiles

This paper describes the design and manufacture of a low-cost full scale pultrusion prototype equipment and discusses the production and obtained mechanical properties of polypropylene/glass (GF/PP) reinforced composite ba rs fabricated by using the prototype equipment. Three different GF/PP pre-impregnated ra w-materials, a commercial GF/PP comingled system from Vetrotex, a GF/PP powder coat ed towpreg [1-3] and, a GF/PP pre- consolidated tape (PCT) produced in our laboratorie s, were used in the production of composite bars that were subsequently submitted to mechanical testing in order to determine the relevant mechanical properties and quantify the consolidation quality. Samples of the different composite profiles were also observed und er SEM microscopy.

Distributed Generation and Demand Response Dispatch for a Virtual Power Player Energy and Reserve Provision

Recent changes in the operation and planning of power systems have been motivated by the introduction of Distributed Generation (DG) and Demand Response (DR) in the competitive electricity markets' environment, with deep concerns at the efficiency level. In this context, grid operators, market operators, utilities and consumers must adopt strategies and methods to take full advantage of demand response and distributed generation. This requires that all the involved players consider all the market opportunities, as the case of energy and reserve components of electricity markets. The present paper proposes a methodology which considers the joint dispatch of demand response and distributed generation in the context of a distribution network operated by a virtual power player. The resources' participation can be performed in both energy and reserve contexts. This methodology contemplates the probability of actually using the reserve and the distribution network constraints. Its application is illustrated in this paper using a 32-bus distribution network with 66 DG units and 218 consumers classified into 6 types of consumers.

Assessment of nutritional and metabolic profiles of pea shoots: The new ready-to-eat baby-leaf vegetable

Pea-shoots are a new option as ready-to-eat baby-leaf vegetable. However, data about the nutritional composition and the shelf-life stability of these leaves, especially their phytonutrient composition is scarce. In this work, the macronutrient, micronutrient and phytonutrients profile of minimally processed pea shoots were evaluated at the beginning and at the end of a 10-day storage period. Several physicochemical characteristics (color, pH, total soluble solids, and total titratable acidity) were also monitored. Standard AOAC methods were applied in the nutritional value evaluation, while chromatographic methods with UV–vis and mass detection were used to analyze free forms of vitamins (HPLC-DAD-ESI-MS/MS), carotenoids (HPLC-DAD-APCI-MSn) and flavonoid compounds (HPLC-DAD-ESI-MSn). Atomic absorption spectrometry (HR-CS-AAS) was employed to characterize the mineral content of the leaves. As expected, pea leaves had a high water (91.5%) and low fat (0.3%) and carbohydrate (1.9%) contents, being a good source of dietary fiber (2.1%). Pea shoots showed a high content of vitamins C, E and A, potassium and phosphorous compared to other ready-to-eat green leafy vegetables. The carotenoid profile revealed a high content of β-carotene and lutein, typical from green leafy vegetables. The leaves had a mean flavonoid content of 329 mg/100 g of fresh product, mainly composed by glycosylated quercetin and kaempferol derivatives. Pea shoots kept their fresh appearance during the storage being color maintained throughout the shelf-life. The nutritional composition was in general stable during storage, showing some significant (p < 0.05) variation in certain water-soluble vitamins.

Virtual Power Player Using Demand Response to Deal with Unexpected Low Wind Power Generation

Demand response is assumed as an essential resource to fully achieve the smart grids operating benefits, namely in the context of competitive markets and of the increasing use of renewable-based energy sources. Some advantages of Demand Response (DR) programs and of smart grids can only be achieved through the implementation of Real Time Pricing (RTP). The integration of the expected increasing amounts of distributed energy resources, as well as new players, requires new approaches for the changing operation of power systems. The methodology proposed in this paper aims the minimization of the operation costs in a distribution network operated by a virtual power player that manages the available energy resources focusing on hour ahead re-scheduling. When facing lower wind power generation than expected from day ahead forecast, demand response is used in order to minimize the impacts of such wind availability change. In this way, consumers actively participate in regulation up and spinning reserve ancillary services through demand response programs. Real time pricing is also applied. The proposed model is especially useful when actual and day ahead wind forecast differ significantly. Its application is illustrated in this paper implementing the characteristics of a real resources conditions scenario in a 33 bus distribution network with 32 consumers and 66 distributed generators.

Defining Electricity Tariffs Using the Knowledge About the Consumers Profiles in ELECON Project

The increasing importance of the integration of distributed generation and demand response in the power systems operation and planning, namely at lower voltage levels of distribution networks and in the competitive environment of electricity markets, leads us to the concept of smart grids. In both traditional and smart grid operation, non-technical losses are a great economic concern, which can be addressed. In this context, the ELECON project addresses the use of demand response contributions to the identification of non-technical losses. The present paper proposes a methodology to be used by Virtual Power Players (VPPs), which are entities able to aggregate distributed small-size resources, aiming to define the best electricity tariffs for several, clusters of consumers. A case study based on real consumption data demonstrates the application of the proposed methodology.

Using Typical Consumption Profiles to Stablish the Consumption Level for Short Time Periods

The current practices in the consumption metering by electricity utilities is currently largely based on monthly consumption reading. The consumption metering device is always calculating the cumulative consumption. Then, it is possible to calculate the difference between the actual and the previous consumption evaluation in order to estimate the monthly consumption. The power systems planning needs in many aspects to handle consumption data obtained for shorter periods, namely in the Demand Response programs planning. The work presented in this paper is based on the application of typical consumption profiles that are previously defined for a certain power system area. Such profiles are then used in order to estimate the 15 minutes consumption for a certain consumer or consumer type.