Out-of-Step Prediction Using DQN-Based Disturbance Observer and Its RTDS Verification

Sun Jick Yang, Nebiyeleul Daniel Amare, Jun Woo Kim and Young Ik Son
Additional contact information
Sun Jick Yang: Department of Electrical Engineering, Myongji University, Yongin 17058, Korea
Nebiyeleul Daniel Amare: Department of Electrical Engineering, Myongji University, Yongin 17058, Korea
Jun Woo Kim: Department of Electrical Engineering, Myongji University, Yongin 17058, Korea
Young Ik Son: Department of Electrical Engineering, Myongji University, Yongin 17058, Korea

Energies, 2022, vol. 15, issue 7, 1-21

Abstract: Despite having extensive research dedicated towards designing methodologies for synchronous out-of-step detection, the risk posed by a large-scale power blackout still makes power system protection an active research area. In recent decades, multiple out-of-step detection techniques such as impedance-based relays and equal-area criterion-analysis-based methods have been widely adopted. However, these conventional techniques have been known to suffer from drawbacks that may be attributed to the inherent assumptions of their foundational design principles. Therefore, to alleviate some of the problems faced in the currently adopted techniques, researchers have been studying the implementation of estimation algorithms for synchronous out-of-step detection. Aiming to contribute to this research area, this paper proposes a synchronous out-of-step detection algorithm that uses a deep Q-network-based disturbance observer, robust to measurement noise. Using the disturbance estimation provided by the observer and a separately gathered critical clearing time data of the power grid, a neural network is trained to relate the magnitude of the estimation with the critical clearing time. The trained neural network is then used to provide an estimation of the critical clearing time for the algorithm, which uses the information to predict whether a fault will result in a stable power swing or a synchronous out-of-step detection. The performance of the proposed algorithm is verified through a real-time digital-simulator-based hardware-in-the-loop simulation. The results show that the proposed algorithm can detect synchronous out-of-step prediction by estimating the disturbance resulting from line fault within two cycles and predicting the critical clearing time at sample fault locations within a 3 % margin of error.

Keywords: synchronous out-of-step detection; reinforcement learning; internal model-based disturbance observer; single machine infinite bus system; real-time digital simulator; power system protection (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1996-1073/15/7/2652/pdf (application/pdf)
https://www.mdpi.com/1996-1073/15/7/2652/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:15:y:2022:i:7:p:2652-:d:787064

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().