Surrogate model enabled deep reinforcement learning for hybrid energy community operation

Xiaodi Wang, Youbo Liu, Junbo Zhao, Chang Liu, Junyong Liu and Jinyue Yan

Applied Energy, 2021, vol. 289, issue C, No S0306261921002403

Abstract: Local peer-to-peer (P2P) transactions in a community are becoming a trend for energy integration and management. The introduction of P2P trading scheme requires comprehensive consideration on various aspects, such as peer privacy, computational efficiency, network security and operational economics. This paper provides a novel hybrid community P2P market framework for multi-energy systems, where a data-driven market surrogate model-enabled deep reinforcement learning (DRL) method is proposed to facilitate P2P transaction within technical constraints of the community delivery networks. Specifically, to achieve privacy protection, a market surrogate model based on deep belief network (DBN) is developed to characterize P2P transaction behaviors of peers in the community without disclosing their private data. Since the energy inputs and outputs of peers are highly correlated with real time signals of retail energy prices, the data-driven market surrogate model is further integrated into the DRL-enabled optimization model of a community agent (CA) for on-line retail energy price generation. Particularly, by integrating network constraints into DRL reward function, the P2P transaction scheme among community peers under specific retail energy price is guaranteed to proceed within a feasible region of community networks. Numerical results indicate that the proposed market framework can achieve 7.6% energy cost saving for community peers over none P2P transaction scheme while increase 284.4$ economic benefits for CA in one day over other comparison algorithms. This study provides an effective prototype to supplement existing P2P markets.

Keywords: P2P transaction; Community market; Deep reinforcement learning; Optimization; Transactive control (search for similar items in EconPapers)
Date: 2021
References: Add references at CitEc
Citations: View citations in EconPapers (12)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261921002403
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:289:y:2021:i:c:s0306261921002403

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2021.116722

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().