Transfer-Reinforcement-Learning-Based rescheduling of differential power grids considering security constraints

Tianjing Wang and Yong Tang

Applied Energy, 2022, vol. 306, issue PB, No S0306261921014008

Abstract: The power system rescheduling based on model-free methods has obvious defects in practical application, such as poor scenario transferability, long data training time, and waste of domain knowledge. To overcome the above defects, a transfer-reinforcement-learning-based rescheduling method of differential power grids considering security constraints is proposed. When constructing the Markov decision-making process of security-constrained rescheduling, both the off-limits of line power and node voltage are considered in the reward. The action space of deep reinforcement learning is narrowed by calculating the sensitivities of devices and mapped to control the active and reactive power regulating devices to reschedule active and reactive power simultaneously. According to the change degree of transfer object, the applications of transfer learning are divided into two scenarios. For the security-constrained rescheduling transfer scenario of different structures of the same power grid, a domain-adaption transfer learning method is formed, realizing good data adaptability after structure changes with the original model. Moreover, a policy-based transfer learning method is constructed for the security-constrained rescheduling transfer scenario of different power grids, enhancing the training speed and training effect of target power grid. Two standard systems and two actual power grids are utilized to verify the effectiveness of the method. For the actual power grids, the effects of the two scenarios are improved by 5.8% and 3.9% with transfer learning. Compared with other methods, this method not only has obvious advantages in transferability, but also has a shorter learning process and lower control cost.

Keywords: Rescheduling; Security; Differential power grids; Transfer; Deep reinforcement learning (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261921014008
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:306:y:2022:i:pb:s0306261921014008

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2021.118121

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().