EconPapers    
Economics at your fingertips  
 

Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning

Daniel J.B. Harrold, Jun Cao and Zhong Fan

Energy, 2022, vol. 238, issue PC

Abstract: As the world seeks to become more sustainable, intelligent solutions are needed to increase the penetration of renewable energy. In this paper, the model-free deep reinforcement learning algorithm Rainbow Deep Q-Networks is used to control a battery in a microgrid to perform energy arbitrage and more efficiently utilise solar and wind energy sources. The grid operates with its own demand and renewable generation, as well as dynamic energy pricing from a real wholesale energy market. Four scenarios are tested including using demand and price forecasting produced with local weather data. The algorithm and its subcomponents are evaluated against an actor-critic method and a linear programming model with Rainbow able to outperform all other methods. This research shows the importance of using the distributional approach for reinforcement learning for complex environments, as well as how it can visualise and contextualise the agents’ behaviour for real-world applications.

Keywords: Actor-critic methods; Deep Q-Networks; Demand response; Microgrids; Renewable energy (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (10)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544221022064
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:238:y:2022:i:pc:s0360544221022064

DOI: 10.1016/j.energy.2021.121958

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().

 
Page updated 2025-03-19
Handle: RePEc:eee:energy:v:238:y:2022:i:pc:s0360544221022064