Hybrid multi-agent emotional deep Q network for generation control of multi-area integrated energy systems

Linfei Yin and Yu Li

Applied Energy, 2022, vol. 324, issue C, No S0306261922010741

Abstract: With the integration of renewable energy, pumped storage, and new energy storage into multi-area integrated energy systems, the generation control of multi-area integrated energy systems is facing serious challenges. A differential evolution variable parameter vector multi-agent emotional deep Q network is proposed to increase the frequency regulation accuracy and convergence speed of multi-area integrated energy systems. The proposed control framework enhances the performance of artificial emotion by differential evolution and adaptive to the environment; the learning rates and action values of two deep Q networks are emotionalized separately by adaptive artificial emotion based on differential evolution; the action values of two deep Q networks are employed to generate commands for smart generation control through vector control. The proposed control framework is calculated in two-area and four-area integrated energy systems with China Southern Power Grid as the background. The numerical calculation results verify the best control performance and fastest convergence speed of the proposed control framework. The frequency deviations of the two cases are reduced by at least 7.44 % and 8.37 %, respectively; the convergence speed of the control framework in the two cases is increased by at least 2.70 % and 0.84 %, respectively; the power generation costs of the two cases are reduced by at least 305,370.9 $ and 460,186.6 $, respectively; the carbon emissions of the two cases are reduced by at least 10,940 kg and 11,610 kg, respectively.

Keywords: Differential evolution; Variable parameter; Multi-agent emotional deep Q network; Multi-area integrated energy system; Multi-area smart generation control (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (8)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261922010741
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:324:y:2022:i:c:s0306261922010741

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2022.119797

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().