Planning Under Uncertainty Applications in Power Plants Using Factored Markov Decision Processes
1
Instituto Nacional de Electricidad y Energías Limpias (INEEL), Cuernavaca 62490, Mexico
2
Instituto Nacional de Astrofísica, Óptica y Electrónica (INAOE), San Andrés Cholula 72840, Mexico
3
Centro de Investigación en Matemáticas (CIMAT), Guanajuato 36023, Mexico
*
Author to whom correspondence should be addressed.
Energies 2020, 13(9), 2302; https://doi.org/10.3390/en13092302
Received: 13 March 2020 / Revised: 2 April 2020 / Accepted: 8 April 2020 / Published: 6 May 2020
(This article belongs to the Special Issue Planning and Economics of Electric Energy Systems)
Due to its ability to deal with non-determinism and partial observability, represent goals as an immediate reward function and find optimal solutions, planning under uncertainty using factored Markov Decision Processes (FMDPs) has increased its importance and usage in power plants and power systems. In this paper, three different applications using this approach are described: (i) optimal dam management in hydroelectric power plants, (ii) inspection and surveillance in electric substations, and (iii) optimization of steam generation in a combined cycle power plant. For each case, the technique has demonstrated to find optimal action policies in uncertain settings, present good response and compilation times, deal with stochastic variables and be a good alternative to traditional control systems. The main contributions of this work are as follows, a methodology to approximate a decision model using machine learning techniques, and examples of how to specify and solve problems in the electric power domain in terms of a FMDP.
View Full-Text
▼
Show Figures
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited
MDPI and ACS Style
Reyes, A.; Sucar, L.E.; Ibargüengoytia, P.H.; Morales, E.F. Planning Under Uncertainty Applications in Power Plants Using Factored Markov Decision Processes. Energies 2020, 13, 2302. https://doi.org/10.3390/en13092302
AMA Style
Reyes A, Sucar LE, Ibargüengoytia PH, Morales EF. Planning Under Uncertainty Applications in Power Plants Using Factored Markov Decision Processes. Energies. 2020; 13(9):2302. https://doi.org/10.3390/en13092302
Chicago/Turabian StyleReyes, Alberto; Sucar, L. E.; Ibargüengoytia, Pablo H.; Morales, Eduardo F. 2020. "Planning Under Uncertainty Applications in Power Plants Using Factored Markov Decision Processes" Energies 13, no. 9: 2302. https://doi.org/10.3390/en13092302
Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.
Search more from Scilit