Planning Under Uncertainty Applications in Power Plants Using Factored Markov Decision Processes

Alberto Reyes, L. Enrique Sucar, Pablo H. Ibargüengoytia and Eduardo F. Morales
Additional contact information
Alberto Reyes: Instituto Nacional de Electricidad y Energías Limpias (INEEL), Cuernavaca 62490, Mexico
L. Enrique Sucar: Instituto Nacional de Astrofísica, Óptica y Electrónica (INAOE), San Andrés Cholula 72840, Mexico
Pablo H. Ibargüengoytia: Instituto Nacional de Electricidad y Energías Limpias (INEEL), Cuernavaca 62490, Mexico
Eduardo F. Morales: Instituto Nacional de Astrofísica, Óptica y Electrónica (INAOE), San Andrés Cholula 72840, Mexico

Energies, 2020, vol. 13, issue 9, 1-17

Abstract: Due to its ability to deal with non-determinism and partial observability, represent goals as an immediate reward function and find optimal solutions, planning under uncertainty using factored Markov Decision Processes (FMDPs) has increased its importance and usage in power plants and power systems. In this paper, three different applications using this approach are described: (i) optimal dam management in hydroelectric power plants, (ii) inspection and surveillance in electric substations, and (iii) optimization of steam generation in a combined cycle power plant. For each case, the technique has demonstrated to find optimal action policies in uncertain settings, present good response and compilation times, deal with stochastic variables and be a good alternative to traditional control systems. The main contributions of this work are as follows, a methodology to approximate a decision model using machine learning techniques, and examples of how to specify and solve problems in the electric power domain in terms of a FMDP.

Keywords: power plants; planning under uncertainty; Markov decision processes (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/1996-1073/13/9/2302/pdf (application/pdf)
https://www.mdpi.com/1996-1073/13/9/2302/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:13:y:2020:i:9:p:2302-:d:354451

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().