Flexible Transmission Network Expansion Planning Based on DQN Algorithm

Yuhong Wang, Lei Chen, Hong Zhou, Xu Zhou, Zongsheng Zheng, Qi Zeng, Li Jiang and Liang Lu
Additional contact information
Yuhong Wang: College of Electrical Engineering, Sichuan University, Chengdu 610065, China
Lei Chen: College of Electrical Engineering, Sichuan University, Chengdu 610065, China
Hong Zhou: State Grid Southwest China Branch, Chengdu 610041, China
Xu Zhou: College of Electrical Engineering, Sichuan University, Chengdu 610065, China
Zongsheng Zheng: College of Electrical Engineering, Sichuan University, Chengdu 610065, China
Qi Zeng: College of Electrical Engineering, Sichuan University, Chengdu 610065, China
Li Jiang: State Grid Southwest China Branch, Chengdu 610041, China
Liang Lu: State Grid Southwest China Branch, Chengdu 610041, China

Energies, 2021, vol. 14, issue 7, 1-21

Abstract: Compared with static transmission network expansion planning (TNEP), multi-stage TNEP is more in line with the actual situation, but the modeling is also more complicated. This paper proposes a new multi-stage TNEP method based on the deep Q -network (DQN) algorithm, which can solve the multi-stage TNEP problem based on a static TNEP model. The main purpose of this research is to provide grid planners with a simple and effective multi-stage TNEP method, which is able to flexibly adjust the network expansion scheme without replanning. The proposed method takes into account the construction sequence of lines in the planning and completes the adaptive planning of lines by utilizing the interactive learning characteristics of the DQN algorithm. In order to speed up the learning efficiency of the algorithm and enable the agent to have a better judgment on the reward of the line-building action, the prioritized experience replay (PER) strategy is added to the DQN algorithm. In addition, the economy, reliability, and flexibility of the expansion scheme are considered in order to evaluate the scheme more comprehensively. The fault severity of equipment is considered on the basis of the Monte Carlo method to obtain a more comprehensive system state simulation. Finally, extensive studies are conducted with IEEE 24-bus reliability test system, and the computational results demonstrate the effectiveness and adaptability of the proposed flexible TNEP method.

Keywords: flexible transmission network expansion planning; deep Q-network; prioritized experience replay strategy; construction sequence (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.mdpi.com/1996-1073/14/7/1944/pdf (application/pdf)
https://www.mdpi.com/1996-1073/14/7/1944/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:14:y:2021:i:7:p:1944-:d:528316

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().