Optimal bidding strategy for the price-maker virtual power plant in the day-ahead market based on multi-agent twin delayed deep deterministic policy gradient algorithm

Yuzheng Jiang, Jun Dong and Hexiang Huang

Energy, 2024, vol. 306, issue C

Abstract: In recent years, distributed energy resources (DERs) have developed greatly, and the total capacity of resources aggregated by virtual power plants (VPPs) has increased. The role VPP plays in the market is changing. It is necessary to explore VPP's bidding strategy in the electricity market based on the impact of VPP on the clearing price. At the same time, the strategy game of different market players will also impact VPP's strategy. The multi-agent twin delayed deep deterministic policy gradient (MATD3) algorithm is used to solve the problem of price-maker VPP participation in the day-ahead (DA) market. VPP is required to submit the power and prices of electricity in multi-segments at different times. In the market bidding process, the main market participants are considered as agents. Iterative refinement of each player's strategy is achieved through multi-agent reinforcement learning, with the primary aim of maximizing revenue. For the VPP, the MATD3 algorithm improved the reward by approximately 65 % and increased the convergence speed by 17 % compared to the multi-agent deep deterministic policy gradient and multi-agent proximal policy optimization algorithms. The effects of different influences on VPP's bidding strategy are analyzed, which can provide a decision-making reference for market participants.

Keywords: Virtual power plant; Electricity market; Bidding strategy; Multi-agent reinforcement learning; Twin delayed deep deterministic policy gradient (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0360544224021625
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:306:y:2024:i:c:s0360544224021625

DOI: 10.1016/j.energy.2024.132388

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().