A distributed dynamic multi-agent reinforcement learning based cooperative game framework for multi-sectoral transaction in electricity markets considering dynamic revenue allocation optimisation and Renewable Energy Certificate trading

Jinjia Cao, Xu Xu, Weitao Yao, Fei Xue and Chao Long

Energy, 2025, vol. 335, issue C

Abstract: This study proposes an innovative framework for constructing a tripartite cooperative game model in the electricity market, aiming to harmonise the power dispatch and the trading of Renewable Energy Certificates (RECs) among multiple customers within the same region. In this framework, industrial, commercial, and residential customers engage in energy trading and RECs trading to comprehensively optimise carbon emissions and revenues for industrial self-power plants (SPPs). Given the complexity of the proposed model, the tripartite cooperative game model is formulated as a Markov Decision Process (MDP), which can be solved by the proposed distributed dynamic multi-agent deep reinforcement learning algorithm. The proposed solution algorithm adopts the distributed training distributed execution (DTDE) architecture to enhance training efficiency and incorporates benefit-sharing mechanisms grounded in cooperative contributions. Furthermore, a dynamic reward module is introduced and integrated into the deep reinforcement learning training process to encourage trading agents to explore a broader operational state space. The results show that (1) The renewable energy utilisation increases by 21.14% under the tripartite cooperative game compared to the no-cooperation case; (2) The total electricity cost is reduced by about 26.62% under the proposed tripartite cooperative game model; (3) The proposed algorithm significantly improves training efficiency compared to traditional reinforcement learning methods, achieving up to a 37.32% increase in reward performance. These findings demonstrate the effectiveness of the proposed model in improving market efficiency, reducing costs, and promoting renewable energy utilisation.

Keywords: Tripartite cooperative game; Renewable Energy Certificates; Deep reinforcement learning; Distributed training distributed execution; Benefit-sharing mechanisms (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S036054422503765X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:energy:v:335:y:2025:i:c:s036054422503765x

DOI: 10.1016/j.energy.2025.138123

Access Statistics for this article

Energy is currently edited by Henrik Lund and Mark J. Kaiser

More articles in Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().