Agent-Based Energy Sharing Mechanism Using Deep Deterministic Policy Gradient Algorithm

Yi Kuang, Xiuli Wang, Hongyang Zhao, Yijun Huang, Xianlong Chen and Xifan Wang
Additional contact information
Yi Kuang: School of Electric Engineering, Xi’an Jiaotong University, Xi’an 710000, China
Xiuli Wang: School of Electric Engineering, Xi’an Jiaotong University, Xi’an 710000, China
Hongyang Zhao: School of Electric Engineering, Xi’an Jiaotong University, Xi’an 710000, China
Yijun Huang: State Grid Shanghai Municipal Electric Power Company, Shanghai 200122, China
Xianlong Chen: School of Electric Engineering, Xi’an Jiaotong University, Xi’an 710000, China
Xifan Wang: School of Electric Engineering, Xi’an Jiaotong University, Xi’an 710000, China

Energies, 2020, vol. 13, issue 19, 1-20

Abstract: Balancing energy generation and consumption is essential for smoothing the power grids. The mismatch between energy supply and demand would not only increase the cost on both sides, but also has a great impact on the stability of the system. This paper proposes a novel energy sharing mechanism (ESM) to facilitate the consumption of local energy. With the help of the ESM, multiple prosumers have an opportunity to share surplus energy with neighboring prosumers. The problem is formulated as a leader–follower framework based on the Stackelberg game theory. To address the aforementioned problems, a deep deterministic policy gradient (DDPG) is applied to solve the Nash equilibrium (NE). The numerical results demonstrate that the proposed method is more stable than the conventional reinforcement learning (RL) algorithm. Moreover, the proposed method can converge to NE and find a relatively good energy sharing (ES) pricing strategy without knowing the specific system information. In short, it is notable that the proposed ESM can be seen as a win–win strategy for both prosumers and the power system.

Keywords: energy sharing; Nash equilibrium; deep reinforcement learning; deep deterministic policy gradient (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/1996-1073/13/19/5027/pdf (application/pdf)
https://www.mdpi.com/1996-1073/13/19/5027/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:13:y:2020:i:19:p:5027-:d:418674

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().