Federated deep reinforcement learning for varying-scale multi-energy microgrids energy management considering comprehensive security

Yiwen Zhang, Yifan Ren, Ziyun Liu, Haoqin Li, Huaiguang Jiang, Ying Xue, Junhui Ou, Renzong Hu, Jun Zhang and David Wenzhong Gao

Applied Energy, 2025, vol. 380, issue C, No S0306261924024565

Abstract: The penetration of abundant renewable resources and the integration of distributed energy coupling equipment prompt the development of multi-energy microgrids (MEMGs). However, the uncertainties from the generation and demand sides render the energy management problem of MEMGs a non-trivial task. Centralized and decentralized methods require massive local records containing user information or an accurate system model to derive an optimal solution, which is hard to obtain in practice and the transmission of local data may impose privacy concerns and extra communication burdens. To solve these, a novel physical perception federated learning algorithm is proposed to optimize the scheduling process in MEMGs with different load levels. Considering the model leakage risk during the model transmission procedure, a data encryption process is further introduced to prevent malicious attackers from inferring valid information from the model parameters. A Lagrangian-based deep reinforcement learning method is proposed to ensure safe operation under physical constraints. Therefore, a comprehensive secure energy management paradigm, which considers the security of decision-making, privacy, and data transmission, is constructed in our paper. Extensive experiments based on real-world datasets are conducted to illustrate the effectiveness of our proposed algorithm in terms of cost efficiency, safety, and carbon reduction.

Keywords: Multi-energy microgrids; Energy management; Federated learning; Safe reinforcement learning; Peer-to-peer energy trading; Data security (search for similar items in EconPapers)
Date: 2025
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261924024565
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:380:y:2025:i:c:s0306261924024565

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2024.125072

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().