Multi-agent deep reinforcement learning-based autonomous decision-making framework for community virtual power plants

Xiangyu Li, Fengji Luo and Chaojie Li

Applied Energy, 2024, vol. 360, issue C, No S030626192400196X

Abstract: Modern grids are facing a reduction of system inertia and primary frequency regulation capability due to the high penetration of distributed energy resources. In this paper, a decision-making framework is proposed to facilitate community-based virtual power plants (cVPPs) to promptly provide ancillary services to the grid. A non-convex cVPP decision-making model is established to optimize the operational plans of a cVPP’s internal energy resources and the bids it puts in a local energy market to minimize the cVPP’s operation cost. Bidding and management strategies will be automatically executed by solving each participating cVPP’s decision-making problem. Due to its nature of high complexity and intractability, the problem is transformed into a partially observable Markov game model and solved by a multi-agent actor transformer-based critic method. A shared transformer encoder is used in the critic network to extract more robust features from the cVPPs’ observations and actions. Numerical simulation demonstrates that the proposed method can effectively support cVPPs to autonomously generate energy bidding and management strategies without acquiring other cVPPs’ private information.

Keywords: Community microgrid; Load balancing; Virtual power plant; Multi-agent reinforcement learning; Privacy-preserving (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S030626192400196X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:360:y:2024:i:c:s030626192400196x

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2024.122813

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().