A Wind and Solar Power Prediction Method Based on Temporal Convolutional Network–Attention–Long Short-Term Memory Transfer Learning and Sensitive Meteorological Features
Abstract
:1. Introduction
2. Overall Framework of the Model
3. Features Selection and TCN-ATT-LSTM Transfer Learning
3.1. Selection Method for Sensitive Meteorological Features
3.2. Feature Extraction TCN-ATT-LSTM Pretrained Network
3.2.1. TCN-ATT-LSTM Network
3.2.2. Optimization Objective for the Combined Network
3.3. Knowledge Transfer via Network Parameter FT
4. Case Study and Analysis
4.1. Results of the Sensitive Meteorological Feature Selection Strategy
4.2. Analysis of TCN-ATT-LSTM Network Transfer Learning Prediction Results
4.3. Comparison of Transfer Learning Method with Other Methods
- (1)
- Under conditions of limited historical data, the prediction performance of traditional deep learning models decreases significantly. Both the RNN and LSTM models show negative R2 values for the wind and solar power test sets, indicating underfitting. In contrast, models using transfer learning exhibit significantly lower errors when generating wind and solar power curves, without signs of underfitting. This demonstrates the effectiveness of the transfer learning approach.
- (2)
- Compared to the pre-trained method, the proposed model reduces the MAE of wind and solar power curves by an average of 21.19% and 42.5%, respectively, while reducing RMSE by 24.11% and 37.25%. The R2 values increase by 12.5% and 4.97%. This analysis shows that, while the pre-trained network effectively captures the complex spatiotemporal mapping relationships between meteorological data and renewable energy output characteristics in the source domain, it is still unable to achieve efficient prediction when directly applied to the target domain. Target domain-specific feature data adjustments are required.
- (3)
- Compared to the LSTM model after transfer learning, the proposed method reduces the MAE by an average of 32.81% for wind power and 34.75% for solar power, while RMSE decreases by 31.45% and 28.89%. The R2 values increase by 16.47% and 25.82%. This analysis indicates that the LSTM method cannot fully extract and process all the features from the source domain. However, by incorporating the TCN-ATT module, the model’s prediction performance is significantly enhanced.
5. Conclusions
- The model improves transfer learning efficiency by performing NWP feature selection prior to transfer, selecting meteorological features with a cumulative contribution of over 85% as input, enhancing the efficiency compared to single evaluation methods;
- The TCN-ATT-LSTM model accurately predicts wind and solar power output in both overall trends and most specific time points, effectively addressing the issue of limited historical data for power forecasting. Compared to traditional deep learning models without transfer learning, pre-trained TCN-ATT-LSTM, and transfer learning with LSTM, this method demonstrates superior performance with significantly higher accuracy in real-world cases;
- As new wind and solar power stations collect more operational data, the target domain dataset for transfer learning will expand, enhancing forecasting accuracy. With improved data completeness, the proportion of target domain samples in the training set will increase, gradually transitioning the approach to deep learning methods.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Lin, W.-H.; Wang, P.; Chao, K.-M.; Lin, H.-C.; Yang, Z.-Y.; Lai, Y.-H. Wind Power Forecasting with Deep Learning Networks: Time-Series Forecasting. Appl. Sci. 2021, 11, 10335. [Google Scholar] [CrossRef]
- Yin, D.; Zhao, L.; Zhai, K.; Zheng, J. Short-Term Wind Power Prediction Based on Feature-Weighted and Combined Models. Appl. Sci. 2024, 14, 7698. [Google Scholar] [CrossRef]
- Xing, F.; Gao, Y.; Kang, L.; Zhang, M.; Qin, C. KAN-Transformer Model for UltraShort-Term Wind Power Prediction Based on EWMA Data Processing. Appl. Sci. 2024, 14, 9630. [Google Scholar] [CrossRef]
- Yang, T.; Yang, Z.; Li, F.; Wang, H. A short-term wind power forecasting method based on multivariate signal decomposition and variable selection. Appl. Energy 2024, 360, 122759. [Google Scholar] [CrossRef]
- Sun, Y.; Li, Z.; Yu, X.; Li, B.; Yang, M. Research on ultra-short-term wind power prediction considering source relevance. IEEE Access 2020, 8, 147703–147710. [Google Scholar] [CrossRef]
- Yang, M.; Dong, H. Short-term wind power interval prediction based on wind speed of numerical weather prediction and monte Carlo method. Autom. Electr. Power Syst. 2021, 45, 79–85. [Google Scholar] [CrossRef]
- Ye, W.; Yang, D.; Tang, C.; Wang, W.; Liu, G. Combined prediction of wind power in extreme weather based on time series adversarial generation networks. IEEE Access 2024, 12, 102660–102669. [Google Scholar] [CrossRef]
- Chang, Y.; Yang, H.; Chen, Y.; Zhou, M.; Yang, H.; Wang, Y. A hybrid model for long-term wind power forecasting utilizing NWP subsequence correction and multi-scale deep learning regression methods. IEEE Trans. Sustain. Energy 2024, 15, 263–275. [Google Scholar] [CrossRef]
- Lu, P.; Ye, L.; Zhao, Y.-G. Review of meta-heuristic algorithms for wind power prediction: Methodologies, applications and challenges. Appl. Energy 2021, 301, 117446. [Google Scholar] [CrossRef]
- Zheng, H.; Wu, Y. A XGBoost Model with Weather Similarity Analysis and Feature Engineering for Short-Term Wind Power Forecasting. Appl. Sci. 2019, 9, 3019. [Google Scholar] [CrossRef]
- Camacho, M.; Maldonado-Correa, J.; Torres-Cabrera, J.; Martín-Martínez, S.; Gómez-Lázaro, E. Short-Medium-Term Solar Irradiance Forecasting with a CEEMDAN-CNN-ATT-LSTM Hybrid Model Using Meteorological Data. Appl. Sci. 2025, 15, 1275. [Google Scholar] [CrossRef]
- Wu, C.; Zhu, G.-P.; Qian, M.-H. Impact of historical data selection on accuracy of ultra-short-term wind power prediction based on prediction information entropy. Power Syst. Technol. 2021, 45, 1767–1772. [Google Scholar] [CrossRef]
- Nuño, E.; Maule, P.; Hahmann, A.; Cutululis, N.; Sørensen, P.; Karagali, I. Simulation of transcontinental wind and solar PV generation time series. Renew. Energy 2018, 118, 425–436. [Google Scholar] [CrossRef]
- Zhao, M.; Zhou, X. Multi-Step short-term wind power prediction model based on CEEMD and improved snake optimization algorithm. IEEE Access 2024, 12, 50755–50778. [Google Scholar] [CrossRef]
- Yang, Z.; Peng, X.; Song, J.; Duan, R.; Jiang, Y.; Liu, S. Short-term wind power prediction based on multi-parameters similarity wind process matching and weighed-voting-based deep learning model selection. IEEE Trans. Power Syst. 2024, 39, 2129–2142. [Google Scholar] [CrossRef]
- Yin, H.; Ou, Z.; Fu, J.; Cai, Y.; Chen, S.; Meng, A. A novel transfer learning approach for wind power prediction based on a serio-parallel deep learning architecture. Energy 2021, 234, 121271. [Google Scholar] [CrossRef]
- Zhang, T.-Y.; Liao, Q.-F.; Tang, F. Wide-area distributed photovoltaic power forecast method based on meteorological resource interpolation and transfer learning. Proc. CSEE 2023, 43, 7929–7940. [Google Scholar]
- Ma, Z.-Y.; Wang, B.; Yang, M. Two-stage transfer learning short-term wind power prediction based on two-dimensional wind speed correction and multiple integration. High Volt. Eng. 2024, 9, 3934–3943. [Google Scholar] [CrossRef]
- Yang, M.; Huang, X. Ultra-short-term prediction of photovoltaic power based on periodic extraction of PV energy and LSH algorithm. IEEE Access 2018, 6, 51200–51205. [Google Scholar] [CrossRef]
- Xu, W.-F.; Liu, P.; Cheng, L. Multistep wind speed prediction by combining a WRF simulation and an error correction strategy. Renew. Energy 2021, 163, 772–782. [Google Scholar] [CrossRef]
- Zhang, Y.; Zhang, L.; Sun, D.; Jin, K.; Gu, Y. Short-Term Wind Power Forecasting Based on VMD and a Hybrid SSA-TCN-BiGRU Network. Appl. Sci. 2023, 13, 9888. [Google Scholar] [CrossRef]
- Liu, Y.; Guan, L.; Hou, C.; Han, H.; Liu, Z.; Sun, Y.; Zheng, M. Wind Power Short-Term Prediction Based on LSTM and Discrete Wavelet Transform. Appl. Sci. 2019, 9, 1108. [Google Scholar] [CrossRef]
- Tang, Y.; Zhang, S.; Zhang, Z. A privacy-preserving framework integrating federated learning and transfer learning for wind power forecasting. Energy 2024, 286, 129639. [Google Scholar] [CrossRef]
Structure | Layer | Input | Kernel Size | Stride | Dilation | Output |
---|---|---|---|---|---|---|
TCN block #1 | Dilated Causal Conv-1 | 4 × 24 | 3 | 1 | 1 | 16 × 24 |
Dilated Causal Conv-2 | 16 × 24 | 3 | 1 | 1 | 16 × 24 | |
TCN block #2 | Dilated Causal Conv-1 | 16 × 24 | 3 | 1 | 2 | 16 × 24 |
Dilated Causal Conv-2 | 16 × 24 | 3 | 1 | 2 | 16 × 24 | |
TCN block #3 | Dilated Causal Conv-1 | 16 × 24 | 3 | 1 | 4 | 16 × 24 |
Dilated Causal Conv-2 | 16 × 24 | 3 | 1 | 4 | 16 × 24 | |
TCN block #4 | Dilated Causal Conv-1 | 16 × 24 | 3 | 1 | 8 | 16 × 24 |
Dilated Causal Conv-2 | 16 × 24 | 3 | 1 | 8 | 16 × 24 | |
LSTM | LSTM layer | 16 × 24 | - | - | - | 1 × 16 |
Fully connected | 1 × 16 | - | - | - | 1 × 1 |
Selection Results of Wind Power Meteorological Characteristics | ||||
---|---|---|---|---|
Meteorological Characteristics | Pearson Correlation Index | Mutual Information Entropy Value | Spearman Correlation Index | Contribution Rate After Dual Optimization Combination |
Wind speed at 100 m height | 0.80719 | 0.902547 | 0.807 | 0.278669 |
Wind speed at 70 m height | 0.841589 | 0.925733 | 0.8415 | 0.284937 |
Wind speed at 30 m height | 0.830482 | 0.848707 | 0.8199 | 0.247796 |
Wind speed at 10 m height | 0.778506 | 0.667219 | 0.7608 | 0.16816 |
Wind direction at 100 m height | 0.01 | 0.987157 | 0.01 | 0.0000788 |
Wind direction at 70 m height | 0.01 | 1.019574 | 0.01 | 0.0000809 |
Wind direction at 30 m height | 0.01 | 1.023214 | 0.01 | 0.0000816 |
Wind direction at 10 m height | 0.01 | 1.050781 | 0.01 | 0.0000831 |
Cloud cover | 0.174265 | 0.811323 | 0.2063 | 0.014064 |
Radiation flux | 0.095408 | 0.771664 | 0.0917 | 0.005246 |
Large-scale precipitation | 0.099563 | 0.02651 | 0.2149 | 0.000279 |
Selection Results of PV Meteorological Characteristics | ||||
Sunshine intensity | 0.828158 | 0.911613 | 0.8525 | 0.225 |
PV panel temperature detection | 0.81939 | 0.89268 | 0.8390 | 0.216 |
Global horizontal irradiance | 0.866445 | 0.913612 | 0.8633 | 0.235 |
UV index | 0.825131 | 0.766496 | 0.8326 | 0.183 |
Atmospheric temperature | 0.50876 | 0.5556 | 0.5375 | 0.0701 |
Mean wind speed | 0.352289 | 0.442447 | 0.2515 | 0.038 |
Maximum wind speed | 0.287183 | 0.952151 | 0.2557 | 0.032 |
Humidity | 0.161997 | 0.024704 | 0.3528 | 0.0005 |
Air pressure | 0.058114 | 0.026726 | 0.3339 | 0.0000179 |
Model | Evaluating Indicator | WT | PV |
---|---|---|---|
RNN | MAE | 0.2153 | 0.1314 |
RMSE | 0.2524 | 0.1506 | |
R2 | −0.1455 | −0.0611 | |
LSTM | MAE | 0.2054 | 0.1289 |
RMSE | 0.2323 | 0.1509 | |
R2 | −0.0294 | −0.2460 | |
Pre-Trained TCN-ATT-LSTM | MAE | 0.1029 | 0.032 |
RMSE | 0.1468 | 0.0604 | |
R2 | 0.7907 | 0.9308 | |
Transfer Learning LSTM | MAE | 0.1207 | 0.0282 |
RMSE | 0.1625 | 0.0533 | |
R2 | 0.7637 | 0.9524 | |
Transfer Learning TCN-ATT-LSTM | MAE | 0.0811 | 0.0184 |
RMSE | 0.1114 | 0.0379 | |
R2 | 0.8895 | 0.9771 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Wang, Y.; Bi, Y.; Guo, Y.; Liu, X.; Sun, W.; Yu, Y.; Yang, J. A Wind and Solar Power Prediction Method Based on Temporal Convolutional Network–Attention–Long Short-Term Memory Transfer Learning and Sensitive Meteorological Features. Appl. Sci. 2025, 15, 1636. https://doi.org/10.3390/app15031636
Wang Y, Bi Y, Guo Y, Liu X, Sun W, Yu Y, Yang J. A Wind and Solar Power Prediction Method Based on Temporal Convolutional Network–Attention–Long Short-Term Memory Transfer Learning and Sensitive Meteorological Features. Applied Sciences. 2025; 15(3):1636. https://doi.org/10.3390/app15031636
Chicago/Turabian StyleWang, Yuan, Yue Bi, Yu Guo, Xianglong Liu, Weiqiang Sun, Yuan Yu, and Jiaqiang Yang. 2025. "A Wind and Solar Power Prediction Method Based on Temporal Convolutional Network–Attention–Long Short-Term Memory Transfer Learning and Sensitive Meteorological Features" Applied Sciences 15, no. 3: 1636. https://doi.org/10.3390/app15031636
APA StyleWang, Y., Bi, Y., Guo, Y., Liu, X., Sun, W., Yu, Y., & Yang, J. (2025). A Wind and Solar Power Prediction Method Based on Temporal Convolutional Network–Attention–Long Short-Term Memory Transfer Learning and Sensitive Meteorological Features. Applied Sciences, 15(3), 1636. https://doi.org/10.3390/app15031636