Optimising market share and profit margin:SMDP-based tariff pricing under the smart grid paradigm

Smart grid technologies have given rise to a liberalised and decentralised electricity market, enabling energy providers and retailers to have a better understanding of the demand side and its response to pricing signals. This paper puts forward a reinforcement-learning-powered tool aiding an electricity retailer to define the tariff prices it offers, in a bid to optimise its retail strategy. In a competitive market, an energy retailer aims to simultaneously increase the number of contracted customers and its profit margin. We have abstracted the problem of deciding on a tariff price as faced by a retailer, as a semi-Markov decision problem (SMDP). A hierarchical reinforcement learning approach, MaxQ value function decomposition, is applied to solve the SMDP through interactions with the market. To evaluate our trading strategy, we developed a retailer agent (termed AstonTAC) that uses the proposed SMDP framework to act in an open multi-agent simulation environment, the Power Trading Agent Competition (Power TAC). An evaluation and analysis of the 2013 Power TAC finals show that AstonTAC successfully selects sell prices that attract as many customers as necessary to maximise the profit margin. Moreover, during the competition, AstonTAC was the only retailer agent performing well across all retail market settings.

Analysis and improvement of performance in LCL filter-based PWM rectifier/inverter application using hybrid damping approach

A hybrid passive-active damping solution with improved system stability margin and enhanced dynamic performance is proposed for high power grid interactive converters. In grid connected active rectifier/inverter application, line side LCL filter improves the high frequency attenuation and makes the converter compatible with the stringent grid power quality regulations. Passive damping though offers a simple and reliable solution but it reduces overall converter efficiency. Active damping solutions do not increase the system losses but can guarantee the stable operation up to a certain speed of dynamic response which is limited by the maximum bandwidth of the current controller. This paper examines this limit and introduces a concept of hybrid passive-active damping solution with improved stability margin and high dynamic performance for line side LCL filter based active rectifier/inverter applications. A detailed design, analysis of the hybrid approach and trade-off between system losses and dynamic performance in grid connected applications are reported. Simulation and experimental results from a 10 kVA prototype demonstrate the effectiveness of the proposed solution. An analytical study on system stability and dynamic response with the variations of various controller and passive filter parameters is presented.