Deep Reinforcement Learning-Based Voltage Control to Deal with Model Uncertainties in Distribution Networks

Jean-François Toubeau, Bashir Bakhshideh Zad, Martin Hupez, Zacharie De Grève and François Vallée
Additional contact information
Jean-François Toubeau: Power Systems and Markets Research Group, University of Mons, 7000 Mons, Belgium
Bashir Bakhshideh Zad: Power Systems and Markets Research Group, University of Mons, 7000 Mons, Belgium
Martin Hupez: Power Systems and Markets Research Group, University of Mons, 7000 Mons, Belgium
Zacharie De Grève: Power Systems and Markets Research Group, University of Mons, 7000 Mons, Belgium
François Vallée: Power Systems and Markets Research Group, University of Mons, 7000 Mons, Belgium

Energies, 2020, vol. 13, issue 15, 1-15

Abstract: This paper addresses the voltage control problem in medium-voltage distribution networks. The objective is to cost-efficiently maintain the voltage profile within a safe range, in presence of uncertainties in both the future working conditions, as well as the physical parameters of the system. Indeed, the voltage profile depends not only on the fluctuating renewable-based power generation and load demand, but also on the physical parameters of the system components. In reality, the characteristics of loads, lines and transformers are subject to complex and dynamic dependencies, which are difficult to model. In such a context, the quality of the control strategy depends on the accuracy of the power flow representation, which requires to capture the non-linear behavior of the power network. Relying on the detailed analytical models (which are still subject to uncertainties) introduces a high computational power that does not comply with the real-time constraint of the voltage control task. To address this issue, while avoiding arbitrary modeling approximations, we leverage a deep reinforcement learning model to ensure an autonomous grid operational control. Outcomes show that the proposed model-free approach offers a promising alternative to find a compromise between calculation time, conservativeness and economic performance.

Keywords: voltage control; deep deterministic policy gradient; deep reinforcement learning; model uncertainties (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
https://www.mdpi.com/1996-1073/13/15/3928/pdf (application/pdf)
https://www.mdpi.com/1996-1073/13/15/3928/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:13:y:2020:i:15:p:3928-:d:393060

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().