An Integrated SSA-LSTM-Transformer Model for Identifying and Predicting Driving Factors of Provincial Carbon Emissions in China
Abstract
1. Introduction
2. Model Framework and Methodology
2.1. Data Sources
2.2. LSTM–SHAP Approach
2.3. LSTM–Transformer Model
2.3.1. Input and Output Definition
2.3.2. LSTM Module
2.3.3. Transformer Module
- 1.
- Self-attention: scaled dot-product attention
- 2.
- Convolutional feed-forward block
2.3.4. Dual-Branch Fusion
2.4. SSA-Based Optimization
3. Carbon Emission Driving Factors Identification Results
3.1. SHAP-Based Driver Importance Results
3.2. Heterogeneity Analysis
3.2.1. Rules for Regional Division
- (1)
- Developed Provinces: regions with advanced economic development and a clear shift from heavy industry toward high tech and services. These provinces typically exhibit higher energy efficiency and stronger innovation capacity, with emissions often stabilizing or trending downward.
- (2)
- Rapidly Developing Provinces: regions in the middle-to-late stage of industrialization, with strong growth momentum and fast urbanization. They usually have a large manufacturing base and high energy demand, making them central to balancing growth and emission pressure in the near term.
- (3)
- Developing Provinces: regions with later economic take-off, still driven by resources or in an accelerated industrialization phase. They tend to rely on conventional energy supply or energy-intensive industries. Current emissions may be lower, but the growth potential is substantial as infrastructure investment and industrial relocation continue.
3.2.2. Heterogeneity Test Results
3.2.3. Statistical Test of Heterogeneity
3.3. Comparison with Existing Studies
4. SSA–LSTM–Transformer Forecasting Results
4.1. Model Evaluation
4.1.1. Iterative Curve of the SSA Model
4.1.2. Ablation Study
4.1.3. Benchmark Comparison
4.2. Forecast Results
4.3. Kernel Density Analysis of Forecasts
5. Recommendation and Conclusions
5.1. Recommendations
5.2. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A
| Model | Parameter (Optimization Value) |
|---|---|
| LSTM | EmbDim = 122; Heads = 2; TransLayers = 2; LSTM Hidden = 51; LSTM Layers = 1; Dropout = 0.1375; LR = 0.006785; Batch = 11 |
| Transformer | PosEnc Params = 12,200; InputProj = 1832 (12->122); Encoder Params = 305,592 (2 layers); Attention Params = 7565 |
| LSTM | Proj = 663 (12->51); Layer Params = 21,216 (1 layer); Norm Params = 102 |
| BP | InputDim = 40; Hidden = [128,64,32]; LR = 0.001; Dropout = 0.2; L2 = 0.0001 |
| ANN | InputDim = 40; Total Params = 54,721 |
| MLP | InputDim = 40 |
| GBDT | InputDim = 40 |
| XGBoost | Trees = 100; MaxDepth = 6; LR = 0.1 |
| LightGBM | Trees = 100; MaxDepth = 6; LR = 0.1; RandomState = 42 |
| SVM | Kernel = rbf; C = 1; Epsilon = 0.1 |
| RF | Trees = 100; MaxDepth = 10 |
| SSA | Population size N = 50; Max iterations T = 100; Fitness = validation NRMSE; Search space = {EmbDim, Heads, TransLayers, LSTM Hidden, LSTM Layers, Dropout, LR, Batch} |
References
- Zhao, J.; Kou, L.; Wang, H.; He, X.; Xiong, Z.; Liu, C.; Cui, H. Carbon emission prediction model and analysis in the Yellow River basin based on a machine learning method. Sustainability 2022, 14, 6153. [Google Scholar] [CrossRef] [Scilit]
- Gu, H.; Wu, L. Pulse fractional grey model application in forecasting global carbon emission. Appl. Energy 2024, 358, 122638. [Google Scholar] [CrossRef] [Scilit]
- Yang, Y.; Yuan, Y.; Han, Z.; Liu, G. Interpretability analysis for thermal sensation machine learning models: An exploration based on the SHAP approach. Indoor Air 2022, 32, e12984. [Google Scholar] [CrossRef] [Scilit]
- Xia, X.; Liu, B.; Wang, Q.; Luo, T.; Zhu, W.; Pan, K.; Zhou, Z. Analysis of carbon peak achievement at the provincial level in China: Construction of ensemble prediction models and Monte Carlo simulation. Sustain. Prod. Consum. 2024, 44, 445–461. [Google Scholar] [CrossRef] [Scilit]
- Feng, X.-D.; Wang, X.-L.; Wen, L.; Yuan, Y.; Zhang, Y.-Q. Research and Prediction Analysis of Key Factors Influencing the Carbon Dioxide Emissions of Countries Along the “Belt and Road” Based on Panel Regression and the AAE Coupling Model. Sustainability 2024, 16, 11014. [Google Scholar] [CrossRef] [Scilit]
- Feng, D.; Xu, W.; Gao, X.; Yang, Y.; Feng, S.; Yang, X.; Li, H. Carbon emission prediction and the reduction pathway in industrial parks: A scenario analysis based on the integration of the LEAP model with LMDI decomposition. Energies 2023, 16, 7356. [Google Scholar] [CrossRef] [Scilit]
- Sharma, S.; Mittal, A.; Bansal, M.; Joshi, B.P.; Rayal, A. Forecasting of carbon emissions in India using ARIMA time series predicting approach. In International Conference on Renewable Power; Springer Nature: Singapore, 2023; pp. 799–811. [Google Scholar] [CrossRef] [Scilit]
- Li, Y.; Chen, Y.; Wang, Y. Grey forecasting the impact of population and GDP on carbon emissions in a Chinese region. J. Clean. Prod. 2023, 425, 139025. [Google Scholar] [CrossRef] [Scilit]
- Lu, J.; Chen, H.; Cai, X. From global to national scenarios: Exploring carbon emissions to 2050. Energy Strategy Rev. 2022, 41, 100860. [Google Scholar] [CrossRef] [Scilit]
- Zhao, X.; Du, D. Forecasting carbon dioxide emissions. J. Environ. Manag. 2015, 160, 39–44. [Google Scholar] [CrossRef] [Scilit]
- Breiman, L. Random forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Scilit]
- Cortes, C.; Vapnik, V. Support-vector networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef] [Scilit]
- Chen, T.; Guestrin, C. XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 785–794. [Google Scholar] [CrossRef] [Scilit]
- Wang, H.; Wei, Z.; Fang, T.; Xie, Q.; Li, R.; Fang, D. Carbon emissions prediction based on the GIOWA combination forecasting model: A case study of China. J. Clean. Prod. 2024, 445, 141340. [Google Scholar] [CrossRef] [Scilit]
- Bhatt, H.; Davawala, M.; Joshi, T.; Shah, M.; Unnarkat, A. Forecasting and mitigation of global environmental carbon dioxide emission using machine learning techniques. Clean. Chem. Eng. 2023, 5, 100095. [Google Scholar] [CrossRef] [Scilit]
- Han, Z.; Cui, B.; Xu, L.; Wang, J.; Guo, Z. Coupling LSTM and CNN neural networks for accurate carbon emission prediction in 30 Chinese provinces. Sustainability 2023, 15, 13934. [Google Scholar] [CrossRef] [Scilit]
- Wang, T.; Fu, Z.; Zhang, S.; Li, Z. Water erosion risk assessment and predictive modelling for cultural heritage under climate change: A case study of the Great Wall in the Yellow River Basin, China. J. Clean. Prod. 2025, 510, 145645. [Google Scholar] [CrossRef] [Scilit]
- Fu, Z.; Yang, X.; Ma, Y.; Sun, Y.; Wang, T. Integrating explainable AI and causal inference to unveil regional air quality drivers in China. J. Environ. Manag. 2025, 390, 126270. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Sun, Q.; Chen, H.; Long, R.; Zhang, J.; Yang, M.; Huang, H.; Ma, W.; Wang, Y. Can Chinese cities reach their carbon peaks on time? Scenario analysis based on machine learning and LMDI decomposition. Appl. Energy 2023, 340, 121427. [Google Scholar] [CrossRef] [Scilit]
- Zhao, X.; Long, L.; Yin, S.; Zhou, Y. How technological innovation influences carbon emission efficiency for sustainable development? Evidence from China. Resour. Environ. Sustain. 2023, 14, 100135. [Google Scholar] [CrossRef] [Scilit]
- Wang, Z.; Shao, H. Spatiotemporal interactions and influencing factors for carbon emission efficiency of cities in the Yangtze River Economic Belt, China. Sustain. Cities Soc. 2024, 103, 105248. [Google Scholar] [CrossRef] [Scilit]
- Ma, D.; Deng, P.; Yan, Y.; Zhang, J.; Guo, Z.; Hu, C.; Li, K. How does carbon emission efficiency vary in Chinese cities? Taking 108 cities along the Yangtze River Economic Belt as an example. Renew. Energy 2026, 256, 124208. [Google Scholar] [CrossRef] [Scilit]
- Xu, P.; Zhou, G.; Zhao, Q.; Lu, Y.; Chen, J. Spatiotemporal dynamics and influencing factors of city-level carbon emissions in mainland China. Ecol. Indic. 2024, 167, 112672. [Google Scholar] [CrossRef] [Scilit]
- Pan, X.; Guo, S. Decomposition analysis of regional differences in China’s carbon emissions based on socioeconomic factors. Energy 2024, 303, 131932. [Google Scholar] [CrossRef] [Scilit]
- Zhou, Y.; Song, M.; Xu, W.; Ouyang, W. Empowering carbon neutrality: Impact of the technology factor market on China’s carbon emission intensity. J. Environ. Manag. 2025, 391, 126568. [Google Scholar] [CrossRef] [Scilit]
- Cheng, H.; Wu, B.; Jiang, X. Spatial network structure of energy carbon emission efficiency and its driving factors in Chinese cities. Appl. Energy 2024, 371, 123689. [Google Scholar] [CrossRef] [Scilit]
- Xin, L.; Li, S.; Rene, E.R.; Lun, X.; Zhang, P.; Ma, W. Prediction of carbon emissions peak and carbon neutrality based on life cycle CO2 emissions in megacity building sector: Dynamic scenario simulations of Beijing. Environ. Res. 2023, 238, 117160. [Google Scholar] [CrossRef] [Scilit]
- Huo, T.; Xu, L.; Feng, W.; Cai, W.; Liu, B. Dynamic scenario simulations of carbon emission peak in China’s city-scale urban residential building sector through 2050. Energy Policy 2021, 159, 112612. [Google Scholar] [CrossRef] [Scilit]
- Li, W.; Wen, H.; Nie, P. Prediction of China’s industrial carbon peak: Based on GDIM-MC model and LSTM-NN model. Energy Strategy Rev. 2023, 50, 101240. [Google Scholar] [CrossRef] [Scilit]
- Alabi, R.O.; Elmusrati, M.; Leivo, I.; Almangush, A.; Mäkitie, A.A. Machine learning explainability in nasopharyngeal cancer survival using LIME and SHAP. Sci. Rep. 2023, 13, 8984. [Google Scholar] [CrossRef] [Scilit]
- Hochreiter, S.; Schmidhuber, J. Long short-term memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Guo, Y.; Mao, Z. Long-term prediction model for NOx emission based on LSTM–Transformer. Electronics 2023, 12, 3929. [Google Scholar] [CrossRef] [Scilit]
- Si, Q.; Li, Y.; Sun, J.; Yu, X.; Li, J.; Wang, J.; Dong, X.; Guo, K. New energy vehicle forecasting based on grey forecasting and random forest. In Smart Applications and Sustainability in the AIoT Era; Al-Turjman, F., Ed.; Springer: Cham, Switzerland, 2024. [Google Scholar] [CrossRef] [Scilit]
- Qiu, C.; Li, Q.; Jing, J.; Tan, N.; Wu, J.; Wang, M.; Li, Q. Transforming prediction into decision: Leveraging Transformer-long short-term memory networks and automatic control for enhanced water treatment efficiency and sustainability. Sensors 2025, 25, 1652. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Li, Y.; Wang, Z.; Yang, A.; Yu, X. Integrating evolutionary algorithms and enhanced-YOLOv8+ for comprehensive apple ripeness prediction. Sci. Rep. 2025, 15, 7307. [Google Scholar] [CrossRef] [Scilit]
- Chen, X.; Liu, X.; Luo, Y.; Zeng, X. Exploring time-series deep learning models for ship fuel consumption prediction. J. Mar. Sci. Eng. 2025, 13, 2102. [Google Scholar] [CrossRef] [Scilit]
- Li, Y.; Song, Z.; Xia, L.; Sun, J.; Wang, Z. Application of the adaptive sparrow search algorithm in medical supply engineering. Sci. Rep. 2025, 15, 35775. [Google Scholar] [CrossRef] [Scilit]
- Lee, K.; Ko, J.; Jung, S. Quantifying uncertainty in carbon emission estimation: Metrics and methodologies. J. Clean. Prod. 2024, 451, 142141. [Google Scholar] [CrossRef] [Scilit]
- Akrami, M.; Porter, M.D.; Colosi, L.M. Addressing uncertainty in machine learning-integrated life cycle assessment. J. Environ. Manag. 2025, 375, 126225. [Google Scholar] [CrossRef] [Scilit]
- Xu, H.; Pan, X.; Guo, S.; Lu, Y. Forecasting Chinese CO2 emissions using a nonlinear multi-agent intertemporal optimization model and scenario analysis. Energy 2021, 229, 120514. [Google Scholar] [CrossRef] [Scilit]
- Yu, W.; Xia, L.; Cao, Q.; Ni, J. A machine learning algorithm to explore the drivers of carbon emissions in Chinese cities. Sci. Rep. 2024, 14, 13490. [Google Scholar] [CrossRef] [Scilit]
- Ke, Z.; Cao, Y.; Chen, Z.; Yin, Y.; He, S.; Cheng, Y. Early warning of cryptocurrency reversal risks via multi-source data. Financ. Res. Lett. 2025, 85, 107890. [Google Scholar] [CrossRef] [Scilit]
- Zong, K.; Shen, J.; Zhao, X.; Fu, X.; Wang, Y.; Li, Z.; Liu, L.; Mu, H. A stable technical feature with GRU-CNN-GA fusion. Appl. Soft Comput. 2026, 187, 114302. [Google Scholar] [CrossRef] [Scilit]










| Indicator Factor | Abbreviation | Classify | Range | References |
|---|---|---|---|---|
| Regional comprehensive economic strength | EDL | Scale and Growth-Driven | [−3.78, 9.50] | [19,20] |
| Innovation input, R&D vitality, and sustainability potential | TIM | Structure Optimization and Efficiency Enhancement | [−5.98, 3.60] | [21,22] |
| Energy efficiency and green development level | EES | Structure Optimization and Efficiency Enhancement | [−4.28, 3.98] | [23] |
| Urban concentration and social modernization | UL | Spatial and System Characteristics | [−2.94, 4.33] | [24] |
| Demographic foundation and resource analysis | PSS | Scale and Growth-Driven | [−1.59, 3.04] | [25,26] |
| Digital infrastructure penetration and intelligent modernization | DNE | Spatial and System Characteristics | [−3.00, 1.65] | [27] |
| Industrial sophistication and economic transformation quality | IS | Structure Optimization and Efficiency Enhancement | [−1.64, 4.41] | [28] |
| Comprehensive and balanced regional coordination | CD | Spatial and System Characteristics | [−1.63, 1.76] | [29] |
| Classification | Provincial-Level Region |
|---|---|
| Developed Provinces | Beijing (BJ), Shanghai (SH), Tianjin (TJ), Jiangsu (JS), Zhejiang (ZJ), Guangdong (GD), Fujian (FJ) |
| Rapidly Developing Provinces | Shandong (SD), Hebei (HEB), Hubei (HB), Hunan (HN), Henan (HEN), Sichuan (SC), Anhui (AH), Jiangxi (JX), Shaanxi (SAX), Liaoning (LN), Jilin (JL), Heilongjiang (HL) |
| Developing Provinces | Chongqing (CQ), Hainan (HAN), Shanxi (SX), Inner Mongolia (NAM), Guangxi (GX), Guizhou (GZ), Yunnan (YN), Gansu (GS), Qinghai (QH), Ningxia (NX), Xinjiang (XJ) |
| Models | NRMSE | R2 | NMAE | sMAPE | CVRMSE |
|---|---|---|---|---|---|
| Our Work | 0.0192 | 0.9911 | 0.0127 | 0.0492 | 0.0611 |
| Grid Search | 0.0375 | 0.9663 | 0.0212 | 0.1563 | 0.0763 |
| Random Search | 0.0451 | 0.9532 | 0.0351 | 0.2365 | 0.0845 |
| Metrics | Our Work | T + S | L + S | L + T | T | L |
|---|---|---|---|---|---|---|
| NRMSE | 0.0192 | 0.0401 | 0.0392 | 0.0344 | 0.0503 | 0.0289 |
| Rank | 1 | 5 | 4 | 3 | 6 | 2 |
| R2 | 0.9911 | 0.9599 | 0.9618 | 0.9662 | 0.9636 | 0.9813 |
| Rank | 1 | 6 | 5 | 3 | 4 | 2 |
| NMAE | 0.0127 | 0.0227 | 0.0224 | 0.0219 | 0.0288 | 0.0222 |
| Rank | 1 | 5 | 4 | 2 | 6 | 3 |
| sMAPE | 0.0492 | 0.269 | 0.0846 | 0.1046 | 0.1007 | 0.9390 |
| Rank | 1 | 5 | 2 | 4 | 3 | 6 |
| CVRMSE | 0.0611 | 0.0813 | 0.1363 | 0.1321 | 0.1479 | 0.9190 |
| Rank | 1 | 2 | 4 | 3 | 5 | 6 |
| Total | 5 | 23 | 19 | 15 | 24 | 19 |
| Metrics | Our Work | BP | ANN | MLP | GBDT | XGBoost | LightGBM | SVM | RF |
|---|---|---|---|---|---|---|---|---|---|
| NRMSE | 0.0192 | 0.1062 | 0.0453 | 0.0574 | 0.1119 | 0.1217 | 0.1165 | 0.1340 | 0.1242 |
| Rank | 1 | 4 | 2 | 3 | 5 | 7 | 6 | 9 | 8 |
| R2 | 0.9911 | 0.8008 | 0.9638 | 0.9417 | 0.7788 | 0.7295 | 0.7521 | 0.6725 | 0.7185 |
| Rank | 1 | 4 | 2 | 3 | 5 | 7 | 6 | 9 | 8 |
| NMAE | 0.0127 | 0.0866 | 0.0316 | 0.0463 | 0.0797 | 0.0802 | 0.0814 | 0.0948 | 0.0843 |
| Rank | 1 | 8 | 2 | 3 | 4 | 5 | 6 | 9 | 7 |
| sMAPE | 0.0492 | 0.3871 | 0.1186 | 0.1808 | 0.2641 | 0.2464 | 0.2572 | 0.3039 | 0.2679 |
| Rank | 1 | 9 | 2 | 3 | 6 | 4 | 5 | 8 | 7 |
| CVRMSE | 0.0611 | 0.3123 | 0.1331 | 0.1690 | 0.3291 | 0.3605 | 0.3452 | 0.3967 | 0.3678 |
| Rank | 1 | 4 | 2 | 3 | 5 | 7 | 6 | 9 | 8 |
| Total | 5 | 29 | 10 | 15 | 25 | 30 | 29 | 44 | 38 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Chen, G.; Zhang, Y. An Integrated SSA-LSTM-Transformer Model for Identifying and Predicting Driving Factors of Provincial Carbon Emissions in China. Sustainability 2026, 18, 2893. https://doi.org/10.3390/su18062893
Chen G, Zhang Y. An Integrated SSA-LSTM-Transformer Model for Identifying and Predicting Driving Factors of Provincial Carbon Emissions in China. Sustainability. 2026; 18(6):2893. https://doi.org/10.3390/su18062893
Chicago/Turabian StyleChen, Guanwen, and Yulin Zhang. 2026. "An Integrated SSA-LSTM-Transformer Model for Identifying and Predicting Driving Factors of Provincial Carbon Emissions in China" Sustainability 18, no. 6: 2893. https://doi.org/10.3390/su18062893
APA StyleChen, G., & Zhang, Y. (2026). An Integrated SSA-LSTM-Transformer Model for Identifying and Predicting Driving Factors of Provincial Carbon Emissions in China. Sustainability, 18(6), 2893. https://doi.org/10.3390/su18062893

