Adaptive Learning in Games: Defining Profiles of Competitor Players

Artificial Intelligence has been applied to dynamic games for many years. The ultimate goal is creating responses in virtual entities that display human-like reasoning in the definition of their behaviors. However, virtual entities that can be mistaken for real persons are yet very far from being fully achieved. This paper presents an adaptive learning based methodology for the definition of players’ profiles, with the purpose of supporting decisions of virtual entities. The proposed methodology is based on reinforcement learning algorithms, which are responsible for choosing, along the time, with the gathering of experience, the most appropriate from a set of different learning approaches. These learning approaches have very distinct natures, from mathematical to artificial intelligence and data analysis methodologies, so that the methodology is prepared for very distinct situations. This way it is equipped with a variety of tools that individually can be useful for each encountered situation. The proposed methodology is tested firstly on two simpler computer versus human player games: the rock-paper-scissors game, and a penalty-shootout simulation. Finally, the methodology is applied to the definition of action profiles of electricity market players; players that compete in a dynamic game-wise environment, in which the main goal is the achievement of the highest possible profits in the market.

Decision Support for Energy Contracts Negotiation with Game Theory and Adaptive Learning

This paper presents a decision support methodology for electricity market players’ bilateral contract negotiations. The proposed model is based on the application of game theory, using artificial intelligence to enhance decision support method’s adaptive features. This model is integrated in AiD-EM (Adaptive Decision Support for Electricity Markets Negotiations), a multi-agent system that provides electricity market players with strategic behavior capabilities to improve their outcomes from energy contracts’ negotiations. Although a diversity of tools that enable the study and simulation of electricity markets has emerged during the past few years, these are mostly directed to the analysis of market models and power systems’ technical constraints, making them suitable tools to support decisions of market operators and regulators. However, the equally important support of market negotiating players’ decisions is being highly neglected. The proposed model contributes to overcome the existing gap concerning effective and realistic decision support for electricity market negotiating entities. The proposed method is validated by realistic electricity market simulations using real data from the Iberian market operator—MIBEL. Results show that the proposed adaptive decision support features enable electricity market players to improve their outcomes from bilateral contracts’ negotiations.

Learning new tricks: Corticostriatal dynamics during novel skill learning

Learning novel actions and skills is a prevalent ability across multiple species and a critical feature for survival and competence in a constantly changing world. Novel actions are generated and learned through a process of trial and error, where an animal explores the environment around itself, generates multiple patterns of behavior and selects the ones that increase the likelihood of positive outcomes. Proper adaptation and execution of the selected behavior requires the coordination of several biomechanical features by the animal. Cortico-basal ganglia circuits and loops are critically involved in the acquisition, learning and consolidation of motor skills.(...)

Modeling U.S. Inflation Dynamics: A Bayesian Nonparametric Approach

This paper uses an infinite hidden Markov model (IIHMM) to analyze U.S. inflation dynamics with a particular focus on the persistence of inflation. The IHMM is a Bayesian nonparametric approach to modeling structural breaks. It allows for an unknown number of breakpoints and is a flexible and attractive alternative to existing methods. We found a clear structural break during the recent financial crisis. Prior to that, inflation persistence was high and fairly constant.

Notes on Agents’ Behavioral Rules Under Adaptive Learning and Studies of Monetary Policy

These notes try to clarify some discussions on the formulation of individual intertemporal behavior under adaptive learning in representative agent models. First, we discuss two suggested approaches and related issues in the context of a simple consumption-saving model. Second, we show that the analysis of learning in the NewKeynesian monetary policy model based on “Euler equations” provides a consistent and valid approach.

A fractionally integrated approach to monetary policy and inflation dynamics

This paper relaxes the standard I(0) and I(1) assumptions typically stated in the monetary VAR literature by considering a richer framework that encompasses the previous two processes as well as other fractionally integrated possibilities. First, a timevarying multivariate spectrum is estimated for post WWII US data. Then, a structural fractionally integrated VAR (VARFIMA) is fitted to each of the resulting time dependent spectra. In this way, both the coefficients of the VAR and the innovation variances are allowed to evolve freely. The model is employed to analyze inflation persistence and to evaluate the stance of US monetary policy. Our findings indicate a strong decline in the innovation variances during the great disinflation, consistent with the view that the good performance of the economy during the 80’s and 90’s is in part a tale of good luck. However, we also find evidence of a decline in inflation persistence together with a stronger monetary response to inflation during the same period. This last result suggests that the Fed may still play a role in accounting for the observed differences in the US inflation history. Finally, we conclude that previous evidence against drifting coefficients could be an artifact of parameter restriction towards the stationary region. Keywords: monetary policy, inflation persistence, fractional integration, timevarying coefficients, VARFIMA. JEL Classification: E52, C32

Inflation dynamics and the New Keynesian Phillips Curve: an identification robust econometric analysis

In this paper, we use identification-robust methods to assess the empirical adequacy of a New Keynesian Phillips Curve (NKPC) equation. We focus on the Gali and Gertler’s (1999) specification, on both U.S. and Canadian data. Two variants of the model are studied: one based on a rationalexpectations assumption, and a modification to the latter which consists in using survey data on inflation expectations. The results based on these two specifications exhibit sharp differences concerning: (i) identification difficulties, (ii) backward-looking behavior, and (ii) the frequency of price adjustments. Overall, we find that there is some support for the hybrid NKPC for the U.S., whereas the model is not suited to Canada. Our findings underscore the need for employing identificationrobust inference methods in the estimation of expectations-based dynamic macroeconomic relations.

Short-Term Load Forecast Of A Low Loadfactor Power System For Optimization Of Merit Order Dispatch Using Adaptive Learning Algorithm

Short term load forecasting is one of the key inputs to optimize the management of power system. Almost 60-65% of revenue expenditure of a distribution company is against power purchase. Cost of power depends on source of power. Hence any optimization strategy involves optimization in scheduling power from various sources. As the scheduling involves many technical and commercial considerations and constraints, the efficiency in scheduling depends on the accuracy of load forecast. Load forecasting is a topic much visited in research world and a number of papers using different techniques are already presented. The accuracy of forecast for the purpose of merit order dispatch decisions depends on the extent of the permissible variation in generation limits. For a system with low load factor, the peak and the off peak trough are prominent and the forecast should be able to identify these points to more accuracy rather than minimizing the error in the energy content. In this paper an attempt is made to apply Artificial Neural Network (ANN) with supervised learning based approach to make short term load forecasting for a power system with comparatively low load factor. Such power systems are usual in tropical areas with concentrated rainy season for a considerable period of the year

The small open-economy New Keynesian Phillips Curve: empirical evidence and implied inflation dynamics

In this paper we apply GMM estimation to assess the relevance of domestic versus external determinants of CPI inflation dynamics in a sample of OECD countries typically classified as open economies. The analysis is based on a variant of the small open-economy New Keynesian Phillips Curve derived in Galí and Monacelli (Rev Econ Stud 72:707–734, 2005), where the novel feature is that expectations about fluctuations in the terms of trade enter explicitly. For most countries in our sample the expected relative change in the terms of trade emerges as the more relevant inflation driver than the contemporaneous domestic output gap.

Inflation dynamics in the new EU member states: how relevant are external factors?

In this paper we evaluate the relative influence of external versus domestic inflation drivers in the 12 new European Union (EU) member countries. Our empirical analysis is based on the New Keynesian Phillips Curve (NKPC) derived in Galí and Monacelli (2005) for small open economies (SOE). Employing the generalized method of moments (GMM), we find that the SOE NKPC is well supported in the new EU member states. We also find that the inflation process is dominated by domestic variables in the larger countries of our sample, whereas external variables are mostly relevant in the smaller countries.