Deep Reinforcement Learning-Based Approach for Autonomous Power Flow Control Using Only Topology Changes

Ivana Damjanović (), Ivica Pavić, Mate Puljiz and Mario Brcic
Additional contact information
Ivana Damjanović: Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia
Ivica Pavić: Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia
Mate Puljiz: Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia
Mario Brcic: Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia

Energies, 2022, vol. 15, issue 19, 1-16

Abstract: With the increasing complexity of power system structures and the increasing penetration of renewable energy, driven primarily by the need for decarbonization, power system operation and control become challenging. Changes are resulting in an enormous increase in system complexity, wherein the number of active control points in the grid is too high to be managed manually and provide an opportunity for the application of artificial intelligence technology in the power system. For power flow control, many studies have focused on using generation redispatching, load shedding, or demand side management flexibilities. This paper presents a novel reinforcement learning (RL)-based approach for the secure operation of power system via autonomous topology changes considering various constraints. The proposed agent learns from scratch to master power flow control purely from data. It can make autonomous topology changes according to current system conditions to support grid operators in making effective preventive control actions. The state-of-the-art RL algorithm—namely, dueling double deep Q-network with prioritized replay—is adopted to train effective agent for achieving the desired performance. The IEEE 14-bus system is selected to demonstrate the effectiveness and promising performance of the proposed agent controlling power network for up to a month with only nine actions affecting substation configuration.

Keywords: power system control; autonomous topology control; artificial intelligence; deep reinforcement learning (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.mdpi.com/1996-1073/15/19/6920/pdf (application/pdf)
https://www.mdpi.com/1996-1073/15/19/6920/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:15:y:2022:i:19:p:6920-:d:921288

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().