Prophet–CEEMDAN–ARBiLSTM-Based Model for Short-Term Load Forecasting
Abstract
:1. Introduction
- The paper proposes the forecasting model based on Prophet-CEEMDAN-ARBiLSTM. The model can decompose the original electricity load series into different components without considering the external factors affecting the change in the load data. Then, these components are used as inputs of the ARBiLSTM block to generate the final output.
- The paper proposes an advanced residual BiLSTM (ARBiLSTM) block achieved by restructuring the BiLSTM layer into a dense connected structure. The ARBiLSTM block effectively enhances the forecasting ability of the method and relieves the gradient vanishing.
- The effectiveness of the proposed method is verified using real data, and the experiments show that the Prophet-CEEMDAN-ARBiLSTM yields higher accuracy than existing models.
2. Method
2.1. Proposed Ensemble Model
2.2. Prophet
2.3. CEEMDAN
- Incorporate the finite number of the adaptive Gaussian white noise to improve the original sequence , and it is expressed as:
- Perform EMD decomposition on with mean values for the first Intrinsic Mode Function (IMF) component , and it is expressed as:
- 3.
- Continue the EMD decomposition for to obtain the second IMF component, and it is expressed as:
- 4.
- Iterate the following steps to acquire the remaining IMF components, as follows:
2.4. Advanced Residual BiLSTM Block
3. Experiment Results and Analysis
3.1. Data
3.1.1. Data Collection
3.1.2. Data Decomposition
3.1.3. Input Matrix
3.1.4. Model Settings
3.1.5. Model Settings
- (1)
- Prophet-GRU [32]: The model first employs the Prophet approach to decompose the input series, yielding the trend components, periodic components, and residual terms. Then, GRU is used to learn the temporal information of the above components to obtain the final output. The unit size of GRU is 32. The dropout rate is set as 0.1, and the learning rate is 0.001 in this paper.
- (2)
- Prophet-LSTM [33]: Different from the Prophet-GRU, LSTM is used to capture the long- and short-term dependencies from input data. The unit size of LSTM is 32 in this paper. For dropout, the dropout rate is set as 0.1. The learning rate is 0.001.
- (3)
- Prophet-EEMD-LSTM [33]: Different from above method, the Prophet-EEMD-LSTM adopts the EEMD to decompose the residual data, producing the multiple Intrinsic Mode Functions (IMFs) and the final residue. Then, the above components are used as the input of the LSTM to produce the final output. The unit size of LSTM is 16. For dropout, the dropout rate is set as 0.1. The learning rate is 0.001.
- (4)
- Prophet-CEEMDAN-ARBiLSTM: Different from the Prophet-EEMD-LSTM, the CEEMDAN method promotes the performance of the model to recognize the complex signals, thereby improving the sensitivity to the intricate information. In addition, the designed ARBiLSTM can help the model learn the temporal features influencing the variation in the load sequence and produce more accurate forecasting results. The unit size of BiLSTM in the ARBiLSTM block is 16. For dropout, the dropout rate is set as 0.1. The learning rate is 0.001.
3.2. Effectiveness Evaluation of Proposed Method
3.3. Comparison with Other Existing Models
4. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Guo, Y.; Li, Y.; Qiao, X.; Zhang, Z.; Zhou, W.; Mei, Y.; Lin, J.; Zhou, Y.; Nakanishi, Y. BiLSTM Multitask Learning-Based Combined Load Forecasting Considering the Loads Coupling Relationship for Multienergy System. IEEE Trans. Smart Grid. 2022, 13, 3481–3492. [Google Scholar] [CrossRef]
- Sharma, A.; Sachin, K.J. A Novel Two-Stage Framework for Mid-Term Electric Load Forecasting. IEEE Trans. Ind. Informat. 2024, 20, 247–255. [Google Scholar] [CrossRef]
- Dong, J.; Luo, L.; Lu, Y.; Zhang, Q. A Parallel Short-Term Power Load Forecasting Method Considering High-Level Elastic Loads. IEEE Trans. Instrum. Meas. 2023, 72, 1–10. [Google Scholar] [CrossRef]
- Wang, C.; Zhou, Y.; Wen, Q.; Wan, Y. Improving Load Forecasting Performance via Sample Reweighting. IEEE Trans. Smart Grid. 2023, 14, 3317–3320. [Google Scholar] [CrossRef]
- Zhao, P.; Cao, D.; Wang, Y.; Chen, Z.; Hu, W. Gaussian Process-Aided Transfer Learning for Probabilistic Load Forecasting Against Anomalous Events. IEEE Trans. Power Syst. 2023, 38, 2962–2965. [Google Scholar] [CrossRef]
- Xiao, J.W.; Liu, P.; Fang, H.; Liu, X.K.; Wang, Y.W. Short-Term Residential Load Forecasting with Baseline-Refinement Profiles and Bi-Attention Mechanism. IEEE Trans. Smart Grid. 2024, 15, 1052–1062. [Google Scholar] [CrossRef]
- Conejo, A.; Plazas, M.; Espinola, R.; Molina, A. Day-ahead electricity price forecasting using the wavelet transform and ARIMA models. IEEE Trans. Power Syst. 2005, 20, 1035–1042. [Google Scholar] [CrossRef]
- Mariana, R.M.; Laurențiu, D.M.; Ștefanesc, V. Studies on energy consumption using methods of exponential smoothing. In Proceedings of the International Symposium on Advanced Topics in Electrical Engineering (ATEE), Bucharest, Romania, 28–30 March 2019; pp. 1–4. [Google Scholar]
- Elsaraiti, M.; Ali, G.; Musbah, H.; Merabet, A.; Little, T. Time series analysis of electricity consumption forecasting using ARIMA model. In Proceedings of the 2021 IEEE Green Technologies Conference (GreenTech), Denver, CO, USA, 7–9 April 2021; pp. 259–262. [Google Scholar]
- Dittmer, C.; Lemmer, A. Power demand forecasting for demand-driven energy production with biogas plants. Renew. Energy 2021, 163, 1871–1877. [Google Scholar] [CrossRef]
- Goudarzi, S.; Anisi, M.H.; Kama, N. Predictive modelling of building energy consumption based on a hybrid nature-inspired optimization algorithm. Energy Build. 2019, 196, 83–93. [Google Scholar] [CrossRef]
- Jagait, R.K.; Fekri, M.N.; Grolinger, K.; Mir, S. Load Forecasting Under Concept Drift: Online Ensemble Learning with Recurrent Neural Network and ARIMA. IEEE Access. 2021, 9, 98992–99008. [Google Scholar] [CrossRef]
- Wang, R.; Zhang, W.; Deng, W.; Zhang, R.; Zhang, X. Study on prediction of energy conservation and carbon reduction in universities based on exponential smoothing. Sustainability 2022, 14, 11903. [Google Scholar] [CrossRef]
- Wu, Z.; Zhao, X.; Ma, Y.; Zhao, X. A hybrid model based on modified multi-objective cuckoo search algorithm for short-term load forecasting. Appl. Energy 2019, 237, 896–909. [Google Scholar] [CrossRef]
- Wu, D.; Wang, B.; Precup, D.; Boulet, B. Multiple kernel learning based transfer regression for electric load forecasting. IEEE Trans. Smart Grid. 2020, 11, 1183–1192. [Google Scholar] [CrossRef]
- Cordeiro, C.M.; Villanueva, D.; Eguía, O.P.; Martínez, C.M.; Ramos, S. Load Forecasting with Machine Learning and Deep Learning Methods. Appl. Sci. 2023, 13, 7933. [Google Scholar] [CrossRef]
- Zhang, Z.; Dong, Y.; Hong, W.C. Long Short-Term Memory-Based Twin Support Vector Regression for Probabilistic Load Forecasting. IEEE Trans. Neural Netw. Learn. Syst. 2023, 1–15. [Google Scholar] [CrossRef] [PubMed]
- Li, Y.; Zhu, N.; Hou, Y. A novel hybrid model for building heat load forecasting based on multivariate Empirical modal decomposition. Build. Environ. 2023, 237, 110317. [Google Scholar] [CrossRef]
- Sayed, H.A.; William, A.; Said, A.M. Smart Electricity Meter Load Prediction in Dubai Using MLR, ANN, RF, and ARIMA. Electronics 2023, 12, 389. [Google Scholar] [CrossRef]
- Jiang, H.; Zhang, Y.; Muljadi, E.; Zhang, J.J.; Gao, D.W. A Short-Term and High-Resolution Distribution System Load Forecasting Approach Using Support Vector Regression with Hybrid Parameters Optimization. IEEE Trans. Smart Grid. 2018, 9, 3341–3350. [Google Scholar] [CrossRef]
- Chen, Y.; Xu, P.; Chu, Y.; Li, W.; Wu, Y.; Ni, L.; Bao, Y.; Wang, K. Short-Term Electrical Load Forecasting Using the Support Vector Regression (SVR) Model to Calculate the Demand Response Baseline for Office Buildings. Appl. Energy 2017, 195, 659–670. [Google Scholar] [CrossRef]
- Jian, L.; Daiyu, D.; Junbo, Z.; Dong, C.; Wei, H. A Novel Hybrid Short-Term Load Forecasting Method of Smart Grid Using MLR and LSTM Neural Network. IEEE Trans. Ind. Inform. 2021, 17, 2443–2452. [Google Scholar]
- Lu, H.; Cheng, F.; Ma, X. Short-term prediction of building energy consumption employing an improved extreme gradient boosting model: A case study of an intake tower. Energy 2020, 203, 117756. [Google Scholar] [CrossRef]
- Liu, Z.; Yu, J.; Feng, C.; Su, Y.; Dai, J.; Chen, Y. A hybrid forecasting method for cooling load in large public buildings based on improved long short-term memory. J. Build. Eng. 2023, 76, 107238. [Google Scholar] [CrossRef]
- Rubasinghe, O.; Zhang, X.; Chau, T.K.; Chow, Y.H.; Fernando, T. A Novel Sequence to Sequence Data Modelling Based CNN-LSTM Algorithm for Three Years Ahead Monthly Peak Load Forecasting. IEEE Trans. Power Syst. 2020, 39, 1932–1947. [Google Scholar] [CrossRef]
- Chaojie, L.; Zhao, D.; Lan, D.; Henry, P.; Zihang, Q.; Guo, C.; Deo, P. Interpretable Memristive LSTM Network Design for Probabilistic Residential Load Forecasting. IEEE Trans. Circuits Syst. I Regul. Pap. 2022, 69, 2297–2310. [Google Scholar]
- Muzumdar, A.A.; Modi, C.N.; Vyjayanthi, C. Designing a Robust and Accurate Model for Consumer-Centric Short-Term Load Forecasting in Microgrid Environment. IEEE Syst. J. 2022, 16, 2448–2459. [Google Scholar] [CrossRef]
- Liu, Y.; Liang, Z.; Li, X. Enhancing Short-Term Power Load Forecasting for Industrial and Commercial Buildings: A Hybrid Approach Using TimeGAN, CNN, and LSTM. IEEE Open J. Ind. Electron. Soc. 2023, 4, 451–462. [Google Scholar] [CrossRef]
- Ijaz, K.; Hussain, Z.; Ahmad, J.; Ali, S.F.; Adnan, M.; Khosa, I. A Novel Temporal Feature Selection Based LSTM Model for Electrical Short-Term Load Forecasting. IEEE Access. 2022, 10, 82596–82613. [Google Scholar] [CrossRef]
- Shakeel, A.; Chong, D.; Wang, J. District heating load forecasting with a hybrid model based on LightGBM and FB-prophet. J. Clean. Prod. 2023, 409, 137130. [Google Scholar] [CrossRef]
- Kim, T.Y.; Cho, S.B. Research on Peak Load Prediction of Distribution Network Lines Based on Prophet-LSTM Model. Sustainability 2023, 15, 11667. [Google Scholar] [CrossRef]
- Son, N.; Shin, Y. Short-and Medium-Term Electricity Consumption Forecasting Using Prophet and GRU. Sustainability 2023, 15, 15860. [Google Scholar] [CrossRef]
- Lu, Y.; Sheng, B.; Fu, G.; Luo, R.; Chen, G.; Huang, Y. Prophet-EEMD-LSTM based method for predicting energy consumption in the paint workshop. Appl. Soft Comput. 2023, 143, 110447. [Google Scholar] [CrossRef]
- Ko, M.S.; Lee, K.; Kim, J.K.; Hong, C.W.; Dong, Z.Y.; Hur, K. Deep Concatenated Residual Network with Bidirectional LSTM for One-Hour-Ahead Wind Power Forecasting. IEEE Trans. Sustain. Energy 2021, 12, 1321–1335. [Google Scholar] [CrossRef]
- Li, K.; Huang, W.; Hu, G. Ultra-short term power load forecasting based on CEEMDAN-SE and LSTM neural network. Energy Build. 2023, 279, 112666. [Google Scholar] [CrossRef]
Method | MAPE (%) | MAE (Mwh) | RMSE (Mwh) |
---|---|---|---|
Prophet-CEEMDAN-Dense | 5.49 | 812.68 | 1091.77 |
Prophet-ARBiLSTM | 3.00 | 450.85 | 655.88 |
CEEMDAN-ARBiLSTM | 2.37 | 346.92 | 474.52 |
Prophet-CEEMDAN-ARBiLSTM | 1.66 | 234.57 | 330.95 |
Method | MAPE (%) | MAE (Mwh) | RMSE (Mwh) |
---|---|---|---|
ARIMA | 7.73 | 1138.59 | 1364.69 |
ETS | 5.47 | 814.56 | 1095.98 |
Prophet-LSTM | 3.27 | 493.02 | 706.53 |
Prophet-GRU | 3.23 | 488.8 | 701.55 |
Prophet-EEMD-LSTM | 1.92 | 283.51 | 410.71 |
Prophet-CEEMDAN-ARBiLSTM | 1.66 | 234.57 | 330.95 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Yang, J.; Zhang, X.; Chen, W.; Rong, F. Prophet–CEEMDAN–ARBiLSTM-Based Model for Short-Term Load Forecasting. Future Internet 2024, 16, 192. https://doi.org/10.3390/fi16060192
Yang J, Zhang X, Chen W, Rong F. Prophet–CEEMDAN–ARBiLSTM-Based Model for Short-Term Load Forecasting. Future Internet. 2024; 16(6):192. https://doi.org/10.3390/fi16060192
Chicago/Turabian StyleYang, Jindong, Xiran Zhang, Wenhao Chen, and Fei Rong. 2024. "Prophet–CEEMDAN–ARBiLSTM-Based Model for Short-Term Load Forecasting" Future Internet 16, no. 6: 192. https://doi.org/10.3390/fi16060192
APA StyleYang, J., Zhang, X., Chen, W., & Rong, F. (2024). Prophet–CEEMDAN–ARBiLSTM-Based Model for Short-Term Load Forecasting. Future Internet, 16(6), 192. https://doi.org/10.3390/fi16060192