Reliability estimation of second life battery system power electronic topologies for grid frequency response applications

This paper is part of a project which aims to research the opportunities for the re-use of batteries after their primary use in low and ultra low carbon vehicles on the electricity grid system. One potential revenue stream is to provide primary/secondary/high frequency response to National Grid through market mechanisms via DNO's or Energy service providers. Some commercial battery energy storage systems (BESS) already exist on the grid system, but these tend to use costly new or high performance batteries. Second life batteries should be available at lower cost than new batteries but reliability becomes an important issue as individual batteries may suffer from degraded performance or failure. Therefore converter topology design could be used to influence the overall system reliability. A detailed reliability calculation of different single phase battery-to-grid converter interfacing schemes is presented. A suitable converter topology for robust and reliable BESS is recommended.

Optimising market share and profit margin:SMDP-based tariff pricing under the smart grid paradigm

Smart grid technologies have given rise to a liberalised and decentralised electricity market, enabling energy providers and retailers to have a better understanding of the demand side and its response to pricing signals. This paper puts forward a reinforcement-learning-powered tool aiding an electricity retailer to define the tariff prices it offers, in a bid to optimise its retail strategy. In a competitive market, an energy retailer aims to simultaneously increase the number of contracted customers and its profit margin. We have abstracted the problem of deciding on a tariff price as faced by a retailer, as a semi-Markov decision problem (SMDP). A hierarchical reinforcement learning approach, MaxQ value function decomposition, is applied to solve the SMDP through interactions with the market. To evaluate our trading strategy, we developed a retailer agent (termed AstonTAC) that uses the proposed SMDP framework to act in an open multi-agent simulation environment, the Power Trading Agent Competition (Power TAC). An evaluation and analysis of the 2013 Power TAC finals show that AstonTAC successfully selects sell prices that attract as many customers as necessary to maximise the profit margin. Moreover, during the competition, AstonTAC was the only retailer agent performing well across all retail market settings.