High Accuracy Modeling for Solar PV Power Generation Using Noble BD-LSTM-Based Neural Networks with EMA
Abstract
:1. Introduction
2. Review of Recent Works for SPVG Forecasting
3. Methodology Description
3.1. Exponential Moving Average
3.2. Long Short-Term Modeling
3.2.1. Structure of the LSTM
3.2.2. Operation of LSTM
4. Proposed SolPVELA
4.1. Data Processing (Training and Testing Procedures)
4.2. LSTM Deep Learning Algorithm of the SolPVELA
4.3. ANN Estimation with Target Selection
5. Case Study and Discussion
5.1. Data Description
5.2. Performance Metrics in Terms of the Evaluation Index
5.3. Performance Analysis
6. Conclusions
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
References
- IEA. Renewables 2018: Analysis and Forecasts to 2023. October 2018. Available online: https://www.iea.org/reports/renewables-2018 (accessed on 2 December 2019).
- Mordor Intelligence, South Korea Solar Photovoltaic (PV) Market Outlook to 2022. 2019. Available online: https://www.mordorintelligence.com/industry-reports/south-korea-solar-power-market-industry (accessed on 8 January 2020).
- South Korean Ministry of Trade, Industry, and Energy, Press Releases, Ministry Announces 7th Basic Plan for Electricity Supply and Demand, 14 December 2017. Available online: https://www.kpx.or.kr/eng/selectBbsNttView.do?key=328&bbsNo=199&nttNo=14547& (accessed on 8 January 2020).
- Da Silva, A.P.C.; Renga, D.; Meo, M.; Marsan, M.A. The impact of quantization on the design of solar power systems for cellular base stations. IEEE Trans. Green Commun. Netw. 2017, 2, 260–274. [Google Scholar] [CrossRef]
- IRENA. Future of Solar Photovoltaic: Deployment, Investment, Technology, Grid Integration and Socio-Economic Aspects (A Global Energy Transformation: Paper); International Renewable Energy Agency: Abu Dhabi, UAE, 2019; Available online: https://www.irena.org/-/media/Files/IRENA/Agency/Publication/2019/Nov/IRENA_Future_of_Solar_PV_2019.pdf (accessed on 8 January 2020).
- Zhou, H.; Zhang, Y.; Yang, L.; Liu, Q.; Yan, K.; Du, Y. Short-term photovoltaic power forecasting based on long short-term memory neural network and attention mechanism. IEEE Access 2019, 7, 78063–78074. [Google Scholar] [CrossRef]
- Das, U.K.; Tey, K.S.; Seyedmahmoudian, M.; Mekhilef, S.; Idris, M.Y.I.; van Deventer, W.; Horan, B.; Stojcevski, A. Forecasting of photovoltaic power generation and model optimization: A review. Renew. Sustain. Energy Rev. 2018, 81, 912–928. [Google Scholar] [CrossRef]
- Wan, C.; Zhao, J.; Song, Y.; Xu, Z.; Lin, J.; Hu, Z. Photovoltaic and solar power forecasting for smart grid energy management. CSEE J. Power Energy Syst. 2015, 1, 38–46. [Google Scholar] [CrossRef]
- Chai, M.; Xia, F.; Hao, S.; Peng, D.; Cui, C.; Liu, W. PV power prediction based on LSTM with adaptive hyperparameter adjustment. IEEE Access 2019, 7, 115473–115486. [Google Scholar] [CrossRef]
- Liu, J.; Fang, W.; Zhang, X.; Yang, C. An improved photovoltaic power forecasting model with the assistance of aerosol index data. IEEE Trans. Sustain. Energy 2015, 6, 434–442. [Google Scholar] [CrossRef]
- Gao, M.; Li, J.; Hong, F.; Long, D. Day-ahead power forecasting in a large-scale photovoltaic plant based on weather classification using LSTM. Energy 2019, 187, 115838. [Google Scholar] [CrossRef]
- Huang, C.; Kuo, P. Multiple-input deep convolutional neural network model for short-term photovoltaic power forecasting. IEEE Access 2019, 7, 74822–74834. [Google Scholar] [CrossRef]
- Wang, K.; Qi, X.; Liu, H. Photovoltaic power forecasting based LSTM convolutional network. Energy 2019, 189, 116225. [Google Scholar] [CrossRef]
- Lopes, F.; Silva, H.; Salgado, R.; Cavaco, A.; Canhoto, P.; Collares-Pereira, M. Short-term forecasts of GHI and DNI for solar energy systems operation: Assessment of the ECMWF integrated forecasting system in southern Portugal. Sol. Energy 2018, 170, 14–30. [Google Scholar] [CrossRef]
- Miller, S.D.; Rogers, M.A.; Haynes, J.M. Short-term solar irradiance forecasting via satellite/model coupling. Sol. Energy 2017, 168, 102–117. [Google Scholar] [CrossRef]
- Li, G.; Wang, H.; Zhang, S.; Xin, J.; Liu, H. Recurrent neural networks based photovoltaic power forecasting approach. Energies 2019, 12, 2538. [Google Scholar] [CrossRef]
- Inman, R.H.; Pedro, H.T.; Coimbra, C.F. Solar forecasting methods for renewable energy integration. Prog. Energy Combust. Sci. 2013, 39, 535–576. [Google Scholar] [CrossRef]
- Li, Y.; Niu, J. Forecast of power generation for grid-connected photovoltaic system based on Markov chain. In Proceedings of the 2009 Asia-Pacific Power and Energy Engineering Conference (APPEEC’09), Wuhan, China, 27–31 March 2009; pp. 1–4. [Google Scholar]
- Jang, H.S.; Bae, K.Y.; Park, H.; Sung, D.K. Solar power prediction based on satellite images and support vector machine. IEEE Trans. Sustain. Energy 2016, 7, 1255–1263. [Google Scholar] [CrossRef]
- Song, J.; Krishnamurthy, V.; Kwasinski, A.; Sharma, R. Development of a Markov-chain-based energy storage model for power supply availability assessment of photovoltaic generation plants. IEEE Trans. Sustain. Energy 2013, 4, 491–500. [Google Scholar]
- Miao, S.; Ning, G.; Gu, Y.; Yan, J.; Ma, B. Markov chain model for solar farm generation and its application to generation performance evaluation. J. Clean. Prod. 2018, 186, 905–917. [Google Scholar] [CrossRef]
- Elminir, H.K.; Azzam, Y.A.; Younes, F.I. Prediction of hourly and daily diffuse fraction using neural network, as compared to linear regression models. Energy 2017, 32, 1513–1523. [Google Scholar] [CrossRef]
- Sulaiman, S.I.; Rahman, T.K.A.; Musirin, I.; Shaari, S. Artificial neural network versus linear regression for predicting grid-connected photovoltaic system output. In Proceedings of the 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), Bangkok, Thailand, 27–31 May 2012; pp. 170–174. [Google Scholar]
- Poolla, C.; Ishihara, A.K. Localized solar power prediction based on weather data from local history and global forecasts. In Proceedings of the 2018 IEEE 7th World Conference Photovoltaic Energy Conversion (WCPEC) (Joint Conference 45th IEEE PVSC, 28th PVSEC & 34th EU PVSEC), Waikoloa Village, HI, USA, 10–15 June 2018; pp. 2341–2345. [Google Scholar]
- Saghafian, B.; Anvari, S.; Morid, S. Effect of southern oscillation index and spatially distributed climate data on improving the accuracy of artificial neural network, adaptive neuro–fuzzy inference system and K-nearest neighbor streamflow forecasting models. Expert Syst. 2013, 30, 367–380. [Google Scholar] [CrossRef]
- Lee, W.; Kim, K.; Park, J.; Kim, J.; Kim, Y. Forecasting solar power using long-short term memory and convolutional neural networks. IEEE Access 2018, 6, 73068–73080. [Google Scholar] [CrossRef]
- Wang, Y.; Liao, W.; Chang, Y. Gated recurrent unit network-based short-term photovoltaic forecasting. Energies 2018, 11, 2163. [Google Scholar] [CrossRef]
- Sheng, H.; Xiao, J.; Cheng, Y.; Ni, Q.; Wang, S. Short-term solar power forecasting based on weighted Gaussian process regression. IEEE Trans. Ind. Electron. 2018, 65, 300–308. [Google Scholar] [CrossRef]
- Du, P. Ensemble machine learning-based wind forecasting to combine NWP output with data from weather Station. IEEE Trans. Sustain. Energy 2019, 10, 2133–2141. [Google Scholar] [CrossRef]
- Liu, Z.; Zhang, Z. Solar forecasting by K-nearest neighbors method with weather classification and physical model. In Proceedings of the 2016 North American Power Symposium (NAPS), Denver, CO, USA, 18–20 September 2016; pp. 1–6. [Google Scholar]
- Abuella, M.; Chowdhury, B. Solar power probabilistic forecasting by using multiple linear regression analysis. In Proceedings of the SoutheastCon 2015, Fort Lauderdale, FL, USA, 9–12 April 2015; pp. 1–5. [Google Scholar]
- Gensler, A.; Henze, J.; Sick, B.; Raabe, N. Deep learning for solar power forecasting—An approach using AutoEncoder and LSTM neural networks. In Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary, 9–12 October 2016; pp. 002858–002865. [Google Scholar]
- Zeng, J.; Qiao, W. Short-term solar power prediction using a support vector machine. Renew. Energy 2013, 52, 118–127. [Google Scholar] [CrossRef]
- Li, R.; Wang, H.N.; He, H.; Cui, Y.M.; Du, Z.L. Support vector machine combined with k-nearest neighbors for solar flare forecasting. Chin. J. Astron. Astrophys. 2007, 7, 441. [Google Scholar] [CrossRef]
- Qiu, X.; Zhang, L.; Ren, Y.; Suganthan, P.N.; Amaratunga, G. Ensemble deep learning for regression and time series forecasting. In Proceedings of the 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL), Orlando, FL, USA, 9–12 December 2014; pp. 1–6. [Google Scholar]
- Muzumdar, A.; Modi, C.N.; Madhu, G.M.; Vyjayanthi, C. Analyzing the feasibility of different machine learning techniques for energy imbalance classification in smart grid. In Proceedings of the2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kanpur, India, 6–8 July 2019; pp. 1–6. [Google Scholar]
- Wang, J.; Li, P.; Ran, R.; Che, Y.; Zhou, Y. A short-term photovoltaic power prediction model based on the gradient boost decision tree. Appl. Sci. 2018, 8, 689. [Google Scholar] [CrossRef]
- Chaturvedi, D.K.; Isha, I. Solar power forecasting: A review. Int. J. Comput. Appl. 2016, 145, 28–50. [Google Scholar]
- Zhu, H.; Li, X.; Sun, Q.; Nie, L.; Yao, J.; Zhao, G. A power prediction method for photovoltaic power plant based on wavelet decomposition and artificial neural networks. Energies 2015, 9, 11. [Google Scholar] [CrossRef]
- Al-Dahidi, S.; Ayadi, O.; Alrbai, M.; Adeeb, J. Ensemble approach of optimized artificial neural networks for solar photovoltaic power prediction. IEEE Access 2019, 7, 81741–81758. [Google Scholar] [CrossRef]
- Sun, Y.; Venugopal, V.; Brandt, A.R. Convolutional Neural Network for Short-term Solar Panel Output Prediction. In Proceedings of the 2018 IEEE 7th World Conference on Photovoltaic Energy Conversion (WCPEC) (A Joint Conference of 45th IEEE PVSC, 28th PVSEC & 34th EU PVSEC), Waikoloa Village, HI, USA, 10–15 June 2018; pp. 2357–2361. [Google Scholar]
- Kim, D.; Hwang, S.; Kim, J. Very Short-Term Photovoltaic Power Generation Forecasting with Convolutional Neural Networks. In Proceedings of the 2018 International Conference on Information and Communication Technology Convergence (ICTC), Jeju, Korea, 19 November 2018; pp. 1310–1312. [Google Scholar]
- Sodsong, N.; Yu, K.M.; Ouyang, W. Short-Term Solar PV Forecasting Using Gated Recurrent Unit with a Cascade Model. In Proceedings of the 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Okinawa, Japan, 11–13 February 2019; pp. 292–297. [Google Scholar]
- Neo, Y.Q.; Teo, T.T.; Woo, W.L.; Logenthiran, T.; Sharma, A. Forecasting of photovoltaic power using deep belief network. In Proceedings of the TENCON 2017—2017 IEEE Region 10 Conference, Penang, Malaysia, 5–8 November 2017; pp. 1189–1194. [Google Scholar]
- Brockwell, P.J.; Davis, R.A. Introduction to Time Series and Forecasting, 3rd ed.; Springer: Berlin, Germany, 2016. [Google Scholar]
- Hunter, J.S. The exponentially weighted moving average. Qual. Technol. 1986, 18, 203–207. [Google Scholar] [CrossRef]
- Zaouali, K.; Rekik, R.; Bouallegue, R. Deep Learning Forecasting Based on Auto-LSTM Model for Home Solar Power Systems. In Proceedings of the 2018 IEEE 20th International Conference on High Performance Computing and Communications, Exeter, UK, 28–30 June 2018. [Google Scholar]
- Lai, G.; Chang, W.C.; Yang, Y.; Liu, H. Modeling long- and short-term temporal patterns with deep neural networks. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, Ann Arbor, MI, USA, 8–12 June 2018; pp. 95–104. [Google Scholar]
- Cui, Z.; Ke, R.; Wang, Y. Deep Stacked Bidirectional and Unidirectional LSTM Recurrent Neural Network for Network-wide Traffic Speed Prediction. In Proceedings of the 6th International Workshop on Urban Computing (UrbComp 2017), Halifax, NS, Canada, 14 August 2017. [Google Scholar]
- Wiener, N. Extrapolation, Interpolation, and Smoothing of Stationary Time Series: With Engineering Applications; MIT Press: Cambridge, MA, USA, 1964; p. 163. [Google Scholar]
- Zhong, J.; Liu, L.; Sun, Q.; Wang, X. Prediction of photovoltaic power generation based on general regression and back propagation neural network. Energy Procedia 2018, 152, 1224–1229. [Google Scholar]
Author | Year | Forecast Horizon | Error Evaluation Method | Model/Model Type | Description |
---|---|---|---|---|---|
Liu et al. | 2015 | 24 h ahead | MAPE, MALPE | ANN + Aerosol Index/preprocessing | Liu et al. [10] studied ANNs with the Aerosol Index, which is a measure of how much the wavelength depends on backscattered ultraviolet radiation from the atmosphere because solar PV generation has a strong relationship with the status of solar irradiation from the atmosphere. |
Zhu et al. | 2016 | 5 days ahead | RMSE, MAE, MAPE | ANN + wavelet decomposition/preprocessing | Zhu et al. [39] addressed the nonlinear characteristics of ANNs due to nonstationary characteristics of solar PV generation using wavelet decomposition, which separates useful information from a disturbance. |
Al-Dahidi et al. | 2019 | 24 h ahead | RMSE, MAE, WMAE | Ensemble | Al-Dahidi et al. [40] proposed an ensemble approach based on the ANN model with an optimization technique to quantize the uncertainty range of the hidden layer of an ANN prediction. |
Sun et al. | 2018 | 15 min ahead | MSE/RMSE | CNN | Sun et al. [41] developed the input parameter and several filters of the SUNSET model, which benefits the correlation between SPVG and the contemporaneous images. |
Huang et al. | 2019 | 24 h ahead | MAE/RMSE | CNN | Huang et al. [12] introduced PVPNet, which is used for a one-dimensional convolutional layer with anStochastic Gradient Descent (SGD) parameter optimizer for more accurate performance of the short-term solar PV power forecasting approach. |
Dohyun et al. | 2018 | 24 h ahead | MSE | CNN + prepredicted value | Dohyun [42] used a convolutional neural network to overcome the limits of the proposed ensemble LSTM/RNN method by removing the long-term dependency of PV data, which applies to predicted weather values. |
Li et al. | 2019 | 30 min ahead | MAE, RMSE, MAPE | RNN | In [16], the RNN revealed higher accuracy for short-term solar PV power forecasting compared to traditional machine learning techniques such as SVM, RBF, BPNN, and LSTM. |
Wang et al. | 2019 | One week ahead | MAE, RMSE, MAPE, SDE, PSDE, PRMSE | Hybrid CNN + LSTM | Wang et al. [13] studied the hybrid LSTM–convolutional network, which was evaluated by the technique that considers temporal–spatial feature extraction in two steps. The LSTM model is used to extract the temporal feature information of the historical data, whereas the convolutional neural network extracts the spatial feature information of the historical data. |
Chai et al. | 2019 | A year ahead | MAPE, QRPE, MBE, RMSE, MSE | LSTM + adaptive hyperparameter adjustment | Chai et al. [9] proposed an ultra-short-term PV power forecasting, which reduces the problem of hyperparameters in LSTM using the adaptive hyperparameter adjustment–LSTM model framework. |
Zhou et al. | 2019 | 7.5, 15, 30, and 60 min ahead | RMSE/MAE | LSTM + attention mechanism | Zhou et al. [6] employed two LSTM network layers for temperature and solar PV power, which comprise an ensemble deep learning network, adopting an attention mechanism. |
Gao et al. | 2019 | 24 h ahead | RMSE/MAD | LSTM + NWP | Gao et al. [11] studied an LSTM for the large-scale solar PV forecasting technique, which preprocesses classifications between ideal weather data and nonideal weather data based on a discrete gray model. |
Wang et al. | 2018 | 24 h ahead | MAE/RMSE | Gated recurrent unit (GRU) + K means cluster + Pearson coefficient | Wang et al. [27] proposed two preprocessing methods based on GRU modeling: the Pearson coefficient extracts the main features that affect solar PV power and then examines the relationship between the input data and future PV power output. Then, the K-means method is used as a cluster analysis, which divides each group based on a similar pattern of input data. |
Sodsong et al. | 2019 | 24 h ahead | NRMSE | Multiple GRU frames | Sodsong et al. [43] introduced multiple GRU frameworks, which consist of three networks with a single GRU in each network. By splitting the data into multiple smaller networks compared to the normal GRU, this results in shorter training time. |
Neo et al. | 2017 | Two days ahead | MSE | Deep belief network | Neo et al. [44] introduced a deep belief network training algorithm to determine the optimum number of input variables for two-day solar PV forecasting. |
Type | R2 | RMSE | MAE |
---|---|---|---|
ELA | 0.96 | 83.26 | 45.24 |
EL | 0.80 | 176.43 | 110.04 |
LSTM | 0.87 | 142.41 | 85.04 |
CNN | 0.80 | 185.07 | 105.97 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Kim, Y.; Seo, K.; Harrington, R.J.; Lee, Y.; Kim, H.; Kim, S. High Accuracy Modeling for Solar PV Power Generation Using Noble BD-LSTM-Based Neural Networks with EMA. Appl. Sci. 2020, 10, 7339. https://doi.org/10.3390/app10207339
Kim Y, Seo K, Harrington RJ, Lee Y, Kim H, Kim S. High Accuracy Modeling for Solar PV Power Generation Using Noble BD-LSTM-Based Neural Networks with EMA. Applied Sciences. 2020; 10(20):7339. https://doi.org/10.3390/app10207339
Chicago/Turabian StyleKim, Youngil, Keunjoo Seo, Robert J. Harrington, Yongju Lee, Hyeok Kim, and Sungjin Kim. 2020. "High Accuracy Modeling for Solar PV Power Generation Using Noble BD-LSTM-Based Neural Networks with EMA" Applied Sciences 10, no. 20: 7339. https://doi.org/10.3390/app10207339
APA StyleKim, Y., Seo, K., Harrington, R. J., Lee, Y., Kim, H., & Kim, S. (2020). High Accuracy Modeling for Solar PV Power Generation Using Noble BD-LSTM-Based Neural Networks with EMA. Applied Sciences, 10(20), 7339. https://doi.org/10.3390/app10207339