Logistics Transportation Vehicle Supply Forecasting Based on Improved Informer Modeling
Abstract
:1. Introduction
- Multidimensional feature engineering based on historical data has been established. This is used to extract and select features closely related to the model’s prediction task, enhance the interpretability of label data, and improve the model’s generalization ability and predictive performance.
- A new method for forecasting logistic transportation supply has been introduced. It is based on the enhanced Informer model. The original Informer model did not account for sequential spatial features, so a spatiotemporal convolutional network has been developed to address this. Additionally, an LSTM model has been incorporated to capture the long- and short-term dependencies in the temporal data.
- In-depth experimental evaluations demonstrate that this method is suitable for long-sequence time series forecasting, exhibiting high predictive accuracy. It shows better capture capabilities for local changes and fluctuations, resulting in overall improved predictive performance.
2. Related Work
2.1. Logistics and Transportation Supply Forecasting Model
2.2. Informer Model
3. Problem Description and Model Design
3.1. Problem Description
3.2. Principles of Informer Model Timing Prediction Algorithm
- Multi-Head Sparse Attention Mechanism
- Self-Attentive Distillation Mechanism
- Generative Decoder
3.3. Improved Informer Modeling
3.3.1. Multidimensional Feature Engineering Construction for Supply Data
3.3.2. Spatiotemporal Convolutional Network to Extract Spatiotemporal Features
3.3.3. LSTM Module Extracts Temporal Long- and Short-Term Memory
3.3.4. Improving Supply Forecasting with the Informer Model
4. Experiment and Analysis
4.1. Experimental Environment and Data
4.2. Parameterization and Evaluation Indicators
4.3. Experiments and Analysis of Results
4.3.1. Multidimensional Feature Engineering of Data
4.3.2. Comparative Experiments on Single-Predictive Models
4.3.3. Comparative Experiments on Integrated Predictive Models
4.3.4. Comparative Experiments on Open-Source Datasets
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Xu, Z.; Wen, J.; Wang, X.; Liu, N. Optimization study of low-carbon vehicle paths for cold T. chain logistics with improved refrigeration cost—Based on ALNS genetic algorithm. Soft Sci. 2024, 38, 92–100. [Google Scholar]
- Wang, C.; Yang, X.; Shi, L. Research on the impact of Chengdu-Chongqing supply chain hub on regional economic development based on system dynamics perspective. Railw. Trans. Econ. 2023, 45, 131–139. [Google Scholar]
- Tang, H. Do a good job of logistics management, digging deep into the enterprise’s third profit source. Taxation 2018, 13, 130. [Google Scholar]
- Pan, Y. Application of information technology in the development of agricultural logistics. Guangdong Seric. 2020, 54, 81–82. [Google Scholar]
- Zhang, L. Research on the coupling and interaction mechanism of agricultural logistics capacity and agricultural economic development. Agric. Econ. 2019, 4, 141–142. [Google Scholar]
- Li, D.; Yang, H. Analysis of research progress and development trend of agricultural internet of things technology. Agric. Mach. 2018, 49, 1–20. [Google Scholar]
- Zhang, Y.; Liu, J.; Chen, C. Design of Traceability System for Agricultural Products by Applying Hyperledger Fabric and IoT Technology. J. Shanxi Agric. Univ. 2022, 42, 12–23. [Google Scholar]
- Mirabelli, G.; Solina, V. Blockchain and agricultural supply chains traceability: Research trends and future challenges. Procedia Manuf. 2020, 42, 414–421. [Google Scholar] [CrossRef]
- Pincheira, M.; Ali, M.; Vecchio, M.; Giaffreda, R. Blockchain-based traceability in Agri-Food supply chain management: A practical implementation. In Proceedings of the 2018 IoT Vertical and Topical Summit on Agriculture-Tuscany (IOT Tuscany), Tuscany, Italy, 8–9 May 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 1–4. [Google Scholar]
- Misra, N.N.; Dixit, Y.; Al Mallahi, A.; Bhullar, M.; Upadhyay, R.; Martynenko, A. IoT, big data and artificial intelligence in agriculture and food industry. IEEE Internet Things J. 2020, 9, 6305–6324. [Google Scholar] [CrossRef]
- Lokers, R.; Knapen, R.; Janssen, S.; van Randen, Y.; Jansen, J. Analysis of big data technologies for use in agro-environmental science. Environ. Model. Softw. 2016, 84, 494–504. [Google Scholar] [CrossRef]
- Jahani, R.; Jain, R.; Ivanov, D. Data science and big data analytics: A systematic review of methodologies used in the supply chain and logistics research. Ann. Oper. Res. 2023, 7, 11. [Google Scholar] [CrossRef]
- He, M.; An, Y.; Pu, J. Dynamic Modeling and Optimization of Modern Agricultural Logistics System in Jiangsu Province. J. Jiangsu Univ. 2021, 42, 562–568. [Google Scholar]
- Li, X.; Wang, Y.; Wang, F. Research on the application mode and implementation path of block chain technology in cross border logistics. Contemp. Econ. Manag. 2020, 42, 32–39. [Google Scholar]
- Lu, M.; Jiang, X.; Liu, S.; Lin, Q. Research on blocking database of power material supply chain based on system dynamics. J. Xi’an Univ. Technol. 2021, 37, 580–587. [Google Scholar]
- Liu, Y.; Tian, Q.; Lu, D. Research on interactive development of agriculture and logistics industry based on system dynamics. Chin. J. Agric. Mech. Chem. 2019, 40, 222–228. [Google Scholar]
- Solak, A. Squatter housing transformations in Turkey after 2002: Public choice perspective. Int. J. Hous. Policy 2021, 21, 612–625. [Google Scholar] [CrossRef]
- Gruzauskas, V.; Gimzauskiene, E.; Navickas, V. Forecasting accuracy influence on logistics clusters activities: The case of the food industry. J. Clean. Prod. 2019, 240, 118225.1–118225.13. [Google Scholar] [CrossRef]
- Mi, J.; Luo, Q.; Gao, M.; Zhang, H. Research on the medium- and long-term supply and demand balance of potato. China Agric. Resour. Zoning 2015, 36, 27–34. [Google Scholar]
- Ilaeva, Z.; Alikhadzhieva, D.; Pashaev, M. Transport Logistics as a Tool of Interaction Between Transport Streams. SHS Web Conf. 2023, 172, 02034. [Google Scholar] [CrossRef]
- Wen, J.; Wang, M.; Liu, J. Multi-step prediction algorithm for time series based on time series decomposition and random forest. J. East China Univ. Sci. Technol. 2023, 49, 873–881. [Google Scholar]
- Nishino, T.; Hokugo, A. A stochastic model for time series prediction of the number of post-earthquake fire ignitions in buildings based on the ignition record for the 2011 Tohoku Earthquake. Earthq. Spectra 2020, 36, 232–249. [Google Scholar] [CrossRef]
- Huang, H.; Tian, Y.; Tao, Z. Multi-rule combination prediction of compositional data time series based on multivariate fuzzy time series model and its application. Expert Syst. Appl. 2024, 238, 121966. [Google Scholar] [CrossRef]
- Wen, X.; Li, W. Time Series Prediction Based on LSTM-Attention-LSTM Model. IEEE Access. 2023, 11, 48322–48331. [Google Scholar] [CrossRef]
- Sun, J.; Guo, W. Time Series Prediction Based on Time Attention Mechanism and LSTM Neural Network. In Proceedings of the 2023 IEEE International Conference on Integrated Circuits and Communication Systems (ICICACS), Raichur, India, 24–25 February 2023; IEEE: Piscataway, NJ, USA, 2023. [Google Scholar]
- Wang, S.; Chang, L.; Liu, H.; Chang, Y.; Xue, Q. Short-term prediction of wind power based on temporal convolutional network and the informer model. IET Gener. Transm. Distrib. 2023, 18, 941–951. [Google Scholar] [CrossRef]
- Gong, M.; Yan, C.; Xu, W.; Zhao, Z.; Li, W. Short-term wind power forecasting model based on temporal convolutional network and Informer. Energy 2023, 283, 129171. [Google Scholar] [CrossRef]
- Wang, H.; Li, D.; Chen, F.; Du, J.; Song, K. GCNInformer: A combined Deep learning model based on GCN and Informer for wind power forecasting. Energy Sci. Eng. 2023, 11, 3836–3854. [Google Scholar] [CrossRef]
- Yin, Z.; Gong, M.; Sun, J.; Han, C.; Jing, L. A new hybrid optimization prediction strategy based on SH-Informer for district heating system. Energy 2023, 282, 129010. [Google Scholar]
- Peng, T.; Fu, Y.; Wang, Y.; Xiong, J.; Suo, L. An intelligent hybrid approach for photovoltaic power forecasting using enhanced chaos game optimization algorithm and Locality sensitive hashing based Informer model. J. Build. Eng. 2023, 78, 107635. [Google Scholar] [CrossRef]
- Li, F.; Wan, Z.; Thomas, K.; Zan, G.; Li, M. Improving the accuracy of multi-step prediction of building energy consumption based on EEMD-PSO-Informer and long-time series. Comput. Electr. Eng. 2023, 110, 108845. [Google Scholar] [CrossRef]
- Yang, K.; Shi, F. Medium- and Long-Term Load Forecasting for Power Plants Based on Causal Inference and Informer. Appl. Sci. 2023, 13, 13. [Google Scholar] [CrossRef]
- Xu, H.; Peng, Q.; Wang, Y.; Zhan, Z. Power-Load Forecasting Model Based on Informer and Its Application. Energies 2023, 16, 7. [Google Scholar] [CrossRef]
- Ma, J.; Dan, J. Long-Term Structural State Trend Forecasting Based on an FFT–Informer Model. Appl. Sci. 2023, 13, 2553. [Google Scholar] [CrossRef]
- Li, H.; Liu, C.; Yang, F.; Ma, X.; Guo, N. Dynamic Temperature Prediction on High-Speed Angular Contact Ball Bearings of Machine Tool Spindles Based on CNN and Informer. Lubricants 2023, 11, 343. [Google Scholar] [CrossRef]
- Xie, X.; Huang, M.; Liu, Y.; An, Q. Intelligent Tool-Wear Prediction Based on Informer Encoder and Bi-Directional Long Short-Term Memory. Machines 2023, 11, 94. [Google Scholar] [CrossRef]
- Gao, Y.; Liu, G.; Luo, D.; Bavirisetti, D.P.; Xiao, G. Multi-timescale photovoltaic power forecasting using an improved Stacking ensemble algorithm based LSTM-Informer model. Energy 2023, 283, 128669. [Google Scholar]
- Jiang, Y.; Fu, K.; Huang, W.; Zhang, J.; Li, X. Ultra-short-term PV power prediction based on Informer with multi-head probability sparse self-attentiveness mechanism. Front. Energy Res. 2023, 11, 1301828. [Google Scholar] [CrossRef]
- Zhuang, W.; Li, Z.; Wang, Y.; Xi, Q.; Xia, M. GCN–Informer: A Novel Framework for Mid-Term Photovoltaic Power Forecasting. Appl. Sci. 2024, 14, 2181. [Google Scholar] [CrossRef]
- Zhao, M.; Peng, H.; Li, P.; Ren, Y. Graph Attention Network and Informer for Multivariate Time Series Anomaly Detection. Sensors 2024, 24, 5. [Google Scholar] [CrossRef]
- Shi, Z.; Li, J.; Jiang, Z.; Li, H.; Yu, C. WGformer: A Weibull-Gaussian Informer based model for wind speed prediction. Eng. Appl. Artif. Intell. 2024, 131, 107891. [Google Scholar] [CrossRef]
- Vaswani, A.; Shazeer, N.; Parmar, N. Attention is all you need. Adv. Neural Inf. Process. Syst. 2017, 30, 5999–6009. [Google Scholar]
- Hu, F.; Sha, Z.; Wei, P. Deep learning for GNSS zenith tropospheric delay forecasting based on the informer model using 11-year ERA5 reanalysis data. GPS Solut. 2024, 182, 28. [Google Scholar] [CrossRef]
- Zhou, H.; Zhang, S.; Peng, J. Informer: Beyond efficient transformer for long sequence time-series forecasting. Proc. AAAI Conf. Artif. Intell. 2021, 35, 11106–11115. [Google Scholar] [CrossRef]
- Tan, Y.; Huang, Y.; Liu, J.; Yang, R. Multi-time series forecasting of power system diverse loads based on the MMoE-CNN-informer model. J. Electr. Eng. 2024, 29, 1–11. [Google Scholar]
- Imane, J.; Fatima-Zahra, B.; Issam, M.K.; Amine, T. Prediction of solar energy guided by pearson correlation using machine learning. Energy 2021, 224, 120109. [Google Scholar]
- Federico, L.; Lorenzo, B.; Marcella, C.; Rita, C. Working Memory Connections for LSTM. Neural Netw. 2021, 144, 334–341. [Google Scholar]
- Zhang, X.; Yang, C.; Ding, H. Displacement prediction of the Jina Ancient Landslide in Zhaotong, Yunnan, based on time-series InSAR and GRU-ARIMA. Geod. Geodyn. 2024, 29, 1–14. [Google Scholar]
Feature Category | Feature | Characterization |
---|---|---|
Economic characteristic | Order_num | Quantity demanded |
Cost | Freight | |
Date characteristics | Weekends | Weekend, 0 weekend, 1 weekday |
Quarter | Quarterly, four quarters, [1, 4] | |
Day_of_year | Mid-year day, [1, 365] | |
Month | Month, December, 1–12 |
Form | Extremely Low Correlation | Low Correlation | Moderately Relevant | Strong Correlation | Highly Relevant |
---|---|---|---|---|---|
[0, 0.2) | [0.2, 0.4) | [0.4, 0.6) | [0.6, 0.8) | [0.8, 1.0] |
Parameters | Descriptive | Value |
---|---|---|
seq_len | Sequence length | 160 |
label_len | Label length | 64 |
pred_len | Predicted length | 64 |
freq | Frequency | d |
enc_in | Encoder input size | 7 |
dec_in | Decoder input size | 7 |
c_out | Output | 7 |
d_model | Model size | 512 |
n_heads | Attention span | 8 |
e_layers | Encoder layers | 2 |
d_layers | Decoder layers | 1 |
s_layers | Stack encoder layers | [3, 2, 1] |
d_ff | Fcn dimension | 2048 |
factor | Prob atten factor | 5 |
distill | Distillate | True |
attn | Attention | prob |
embed | Embedding | timeF |
train_epochs | Number of trainings | 100 |
batch_size | Batch size | 32 |
learning_rate | Learning rate | 0.0001 |
Date | Weekends | Quarter | Year | Month | Cost | Order-Num | Car-Num |
---|---|---|---|---|---|---|---|
2018/1/1 | 1 | 1 | 1 | 1 | 9235 | 45 | 1 |
2018/1/2 | 1 | 1 | 2 | 1 | 15,205 | 112 | 1 |
2018/1/3 | 1 | 1 | 3 | 1 | 11,350 | 91 | 1 |
… | … | … | … | … | … | … | … |
2023/5/12 | 1 | 2 | 132 | 5 | 118,018 | 1053 | 20 |
2023/5/13 | 0 | 2 | 133 | 5 | 103,078 | 889 | 25 |
2023/5/14 | 0 | 2 | 134 | 5 | 102,251 | 875 | 47 |
Model | Target | Car-num | Etth1 |
Improved Informer Model | MSE | 2.79 | 1.39 |
MAE | 1.30 | 0.60 | |
ARIMA Model | MSE | 10.65 | 10.11 |
MAE | 2.71 | 2.98 | |
SVR Model | MSE | 13.52 | 1.18 |
MAE | 3.21 | 0.94 | |
LSTM Model | MSE | 15.71 | 0.21 |
MAE | 3.28 | 0.35 | |
GRU Model | MSE | 13.03 | 0.20 |
MAE | 3.06 | 0.34 | |
BPNN Model | MSE | 12.14 | 0.22 |
MAE | 2.82 | 0.36 | |
Informer Model | MSE | 6.06 | 0.90 |
MAE | 1.89 | 0.82 | |
InformerStack Model | MSE | 4.68 | 0.96 |
MAE | 2.05 | 0.96 |
Model | Target | Car-num | Etth1 |
---|---|---|---|
Informer Model | MSE | 2.79 | 1.39 |
MAE | 1.30 | 0.60 | |
ARIMA + BPNN Model | MSE | 11.11 | 2.90 |
MAE | 2.67 | 1.61 | |
ARIMA + GRU Model | MSE | 9.81 | 3.04 |
MAE | 2.60 | 1.64 | |
ARIMA + LSTM Model | MSE | 10.76 | 2.90 |
MAE | 2.71 | 1.61 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Guo, D.; Jiang, P.; Qin, Y.; Zhang, X.; Zhang, J. Logistics Transportation Vehicle Supply Forecasting Based on Improved Informer Modeling. Appl. Sci. 2024, 14, 8162. https://doi.org/10.3390/app14188162
Guo D, Jiang P, Qin Y, Zhang X, Zhang J. Logistics Transportation Vehicle Supply Forecasting Based on Improved Informer Modeling. Applied Sciences. 2024; 14(18):8162. https://doi.org/10.3390/app14188162
Chicago/Turabian StyleGuo, Dudu, Peifan Jiang, Yin Qin, Xue Zhang, and Jinquan Zhang. 2024. "Logistics Transportation Vehicle Supply Forecasting Based on Improved Informer Modeling" Applied Sciences 14, no. 18: 8162. https://doi.org/10.3390/app14188162
APA StyleGuo, D., Jiang, P., Qin, Y., Zhang, X., & Zhang, J. (2024). Logistics Transportation Vehicle Supply Forecasting Based on Improved Informer Modeling. Applied Sciences, 14(18), 8162. https://doi.org/10.3390/app14188162