Adaptive Learning in Games: Defining Profiles of Competitor Players

Artificial Intelligence has been applied to dynamic games for many years. The ultimate goal is creating responses in virtual entities that display human-like reasoning in the definition of their behaviors. However, virtual entities that can be mistaken for real persons are yet very far from being fully achieved. This paper presents an adaptive learning based methodology for the definition of players’ profiles, with the purpose of supporting decisions of virtual entities. The proposed methodology is based on reinforcement learning algorithms, which are responsible for choosing, along the time, with the gathering of experience, the most appropriate from a set of different learning approaches. These learning approaches have very distinct natures, from mathematical to artificial intelligence and data analysis methodologies, so that the methodology is prepared for very distinct situations. This way it is equipped with a variety of tools that individually can be useful for each encountered situation. The proposed methodology is tested firstly on two simpler computer versus human player games: the rock-paper-scissors game, and a penalty-shootout simulation. Finally, the methodology is applied to the definition of action profiles of electricity market players; players that compete in a dynamic game-wise environment, in which the main goal is the achievement of the highest possible profits in the market.

Reinforcement Learning Based on the Bayesian Theorem for Electricity Markets Decision Support

This paper presents the applicability of a reinforcement learning algorithm based on the application of the Bayesian theorem of probability. The proposed reinforcement learning algorithm is an advantageous and indispensable tool for ALBidS (Adaptive Learning strategic Bidding System), a multi-agent system that has the purpose of providing decision support to electricity market negotiating players. ALBidS uses a set of different strategies for providing decision support to market players. These strategies are used accordingly to their probability of success for each different context. The approach proposed in this paper uses a Bayesian network for deciding the most probably successful action at each time, depending on past events. The performance of the proposed methodology is tested using electricity market simulations in MASCEM (Multi-Agent Simulator of Competitive Electricity Markets). MASCEM provides the means for simulating a real electricity market environment, based on real data from real electricity market operators.

Learning sustainability by developing a solar dryer for microalgae retrieval

The development of nations depends on energy consumption, which is generally based on fossil fuels. This dependency produces irreversible and dramatic effects on the environment, e.g. large greenhouse gas emissions, which in turn cause global warming and climate changes, responsible for the rise of the sea level, floods, and other extreme weather events. Transportation is one of the main uses of energy, and its excessive fossil fuel dependency is driving the search for alternative and sustainable sources of energy such as microalgae, from which biodiesel, among other useful compounds, can be obtained. The process includes harvesting and drying, two energy consuming steps, which are, therefore, expensive and unsustainable. The goal of this EPS@ISEP Spring 2013 project was to develop a solar microalgae dryer for the microalgae laboratory of ISEP. A multinational team of five students from distinct fields of study was responsible for designing and building the solar microalgae dryer prototype. The prototype includes a control system to ensure that the microalgae are not destroyed during the drying process. The solar microalgae dryer works as a distiller, extracting the excess water from the microalgae suspension. This paper details the design steps, the building technologies, the ethical and sustainable concerns and compares the prototype with existing solutions. The proposed sustainable microalgae drying process is competitive as far as energy usage is concerned. Finally, the project contributed to increase the deontological ethics, social compromise skills and sustainable development awareness of the students.