A New Accurate Aircraft Trajectory Prediction in Terminal Airspace Based on Spatio-Temporal Attention Mechanism
Abstract
:1. Introduction
- Based on aircraft trajectory data and air traffic control spacing regulations, an aircraft spatial structure graph is constructed. A vectorized representation method is defined for spatial interaction information between aircraft to characterize the close-range spatial positional relationship between them;
- To delve deeply into the multi-faceted trajectory characteristics, time series features and spatial position features of aircraft are targeted separately. Based on the attention mechanism, a temporal attention module and a spatial attention module are constructed to achieve an in-depth exploration of trajectory features from various aspects;
- Considering the terminal airspace aircraft operation scenario, a Spatio-Temporal Transformer (ST-Transformer) model is constructed by stacking temporal attention and spatial attention modules. This achieves high-precision short-term trajectory prediction with spatiotemporal feature coupling.
2. Literature Review
2.1. Aircraft Trajectory Prediction Method
2.1.1. Non-Data-Driven Method
2.1.2. Deep Learning Method
2.2. Trajectory Prediction Model Considering Spatiotemporal Feature Coupling
2.3. Summary
3. Methodologies
3.1. Problem Setup
3.2. The Structure of ST-Transformer
3.2.1. Temporal Attention Module
- (1)
- Temporal feature dataset
- (2)
- Temporal attention mechanism
3.2.2. Spatial Attention Module
- (1)
- Spatial feature dataset
- (2)
- Node feature update rule
3.2.3. ST-Transformer
4. Experiments
4.1. Datasets
4.2. Evaluation Metrics
4.3. Model Training
- (1)
- The dataset is split into training and testing sets in a 7:3 ratio;
- (2)
- Structural parameters of the network are defined, including the number of encoding layers, the number of heads in the multi-head attention mechanism, and the number of training epochs;
- (3)
- Hyperparameters used during training are set, including the network learning rate and dropout rate in hidden layers. The Adam optimization strategy is employed, using Mean Squared Error (MSE) between predicted and historical trajectories as the loss function. Training begins with one epoch to minimize the loss function and obtain optimal network weight parameters;
- (4)
- The training process in (3) is repeated until the maximum specified number of training epochs is reached. The trained model is then saved for potential finetuning in subsequent stages.
4.4. Experimental Analysis
- (1)
- Back Propagation (BP) Neural Network: A multilayer feedforward neural network trained using the error backpropagation algorithm, it is one of the most classic and widely used models in neural networks;
- (2)
- Recurrent Neural Network (RNN): A type of neural network model used for processing sequential data. It captures temporal dependencies in sequences through its recurrent structure and shared parameters;
- (3)
- Long Short-Term Memory (LSTM): A special type of RNN that effectively captures long-term dependencies by introducing gating mechanisms;
- (4)
- State Refined LSTM (SR-LSTM): SR-LSTM is based on the research results by Zhang et al. in pedestrian trajectory prediction [54]. The model introduces a state refinement module to model the interaction behaviors between pedestrians;
- (5)
- S-Transformer: S-Transformer model does not include the spatial attention module and is a vanilla Transformer model with individual trajectory data as the input unit [47].
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- European Aviation in 2040—Challenges of Growth 2018. Available online: https://www.eurocontrol.int/publication/challenges-growth-2018 (accessed on 2 October 2018).
- Jiang, C. Recent advances for smart air traffic management: An overview. In Proceedings of the International Conference on Artificial Intelligence in China, Zhuhai, China, 11–13 December 2020; Springer: Singapore, 2020. [Google Scholar] [CrossRef]
- Global Air Navigation Plan Strategy. Available online: https://www4.icao.int/ganpportal/ganpdocument#/ (accessed on 1 October 2018).
- Joint Planning and Development Office. Concept of Operations for the Next Generation Air Transportation System; Joint Planning and Development Office: Washington, DC, USA, 2007. [Google Scholar]
- European ATM Master Plan 2020. Available online: https://www.sesarju.eu/masterplan2020 (accessed on 17 December 2019).
- Mondoloni, S.; Rozen, N. Aircraft Trajectory Prediction and Synchronization for Air Traffic Management Applications. Prog. Aerosp. Sci. 2020, 119, 100640. [Google Scholar] [CrossRef]
- EUROCONTROL Specification for Trajectory Prediction. Available online: https://www.eurocontrol.int/publication/eurocontrol-specification-trajectory-prediction (accessed on 3 March 2017).
- Schuster, W.; Ochieng, W. Performance Requirements of Future Trajectory Prediction and Conflict Detection and Resolution Tools within SESAR and NextGen: Framework for the Derivation and Discussion. J. Air Transp. Manag. 2014, 35, 92–101. [Google Scholar] [CrossRef]
- Trajectory Based Operations (TBO). Available online: https://www.faa.gov/air_traffic/technology/tbo#:~:text=Aircraft%20trajectory%20is%20the%20core%20tenant%20of%20TBO.,when%20-%20at%20key%20points%20along%20its%20route (accessed on 9 February 2022).
- Song, Y.; Cheng, P.; Mu, C. An Improved Trajectory Prediction Algorithm Based on Trajectory Data Mining for Air Traffic Management. In Proceedings of the 2012 IEEE International Conference on Information and Automation, Shenyang, China, 6–8 June 2012. [Google Scholar] [CrossRef]
- Zeng, W.; Chu, X.; Xu, Z.; Liu, Y.; Quan, Z. Aircraft 4D Trajectory Prediction in Civil Aviation: A Review. Aerospace 2022, 9, 91. [Google Scholar] [CrossRef]
- Niu, Z.; Zhong, G.; Yu, H. A Review on the Attention Mechanism of Deep Learning. Neurocomputing 2021, 452, 48–62. [Google Scholar] [CrossRef]
- Liu, W.; Hwang, I. Probabilistic Trajectory Prediction and Conflict Detection for Air Traffic Control. J. Guid. Control Dyn. 2011, 34, 1779–1789. [Google Scholar] [CrossRef]
- Wang, Z.; Liang, M.; Delahaye, D. A Hybrid Machine Learning Model for Short-Term Estimated Time of Arrival Prediction in Terminal Manoeuvring Area. Transp. Res. Part C Emerg. Technol. 2018, 95, 280–294. [Google Scholar] [CrossRef]
- Dong, X.; Tian, Y.; Niu, K.; Sun, M.; Li, J. Research on Flight Trajectory Prediction Method Based on Transformer. In Proceedings of the International Conference on Smart Transportation and City Engineering (STCE 2023), Chongqing, China, 16–18 December 2023. [Google Scholar] [CrossRef]
- FAA/EUROCONTROL. Common TP Structure and Terminology in Support of SESAR & NextGen; Techincal Report FAA/EUROCONTROL: Brussels, Belgium, 2010. [Google Scholar]
- Sturdy, J.; Andrews, J.; Welch, J. Aircraft Trajectory Prediction for Terminal Automation. In Proceedings of the Guidance, Navigation and Control Conference, Boston, MA, USA, 14–16 August 1989. [Google Scholar] [CrossRef]
- Lymperopoulos, I.; Lygeros, J.; Lecchini, A. Model Based Aircraft Trajectory Prediction During Takeoff. In Proceedings of the AIAA Guidance, Navigation, and Control Conference and Exhibit, Keystone, CO, USA, 21–24 August 2006. [Google Scholar] [CrossRef]
- Thipphavong, D.P.; Schultz, C.A.; Lee, A.G.; Chan, S.H. Adaptive Algorithm to Improve Trajectory Prediction Accuracy of Climbing Aircraft. J. Guid. Control Dyn. 2013, 36, 15–24. [Google Scholar] [CrossRef]
- Zhang, J.; Liu, J.; Hu, R.; Zhu, H. Online Four Dimensional Trajectory Prediction Method Based on Aircraft Intent Updating. Aerosp. Sci. Technol. 2018, 77, 774–787. [Google Scholar] [CrossRef]
- Alligier, R.; Hamed, M.G.; Gianazza, D.; Serrurier, M. Ground-Based Prediction of Aircraft Climb: Point-Mass Model vs. Regression Methods. In Proceedings of the 1st Annual Complex World Conference, Seville, Spain, 11–15 July 2011. [Google Scholar]
- Chatterji, G. Short-Term Trajectory Prediction Methods. In Proceedings of the Guidance, Navigation, and Control Conference and Exhibit, Portland, OR, USA, 9–11 August 1999. [Google Scholar] [CrossRef]
- Zhang, J.; Wang, G.; Xiao, G. Dynamic Trajectory Prediction for Continuous Descend Operations Based on Unscented Kalman Filter. In Proceedings of the 2020 Chinese Intelligent Systems Conference, Shenzheng, China, 24–25 October 2020. [Google Scholar] [CrossRef]
- Ayhan, S.; Samet, H. Aircraft Trajectory Prediction Made Easy with Predictive Analytics. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, 13–17 August 2016. [Google Scholar] [CrossRef]
- Lin, Y.; Yang, B.; Zhang, J.; Liu, H. Approach for 4-d trajectory management based on HMM and trajectory similarity. J. Mar. Sci. Technol. 2019, 27, 7. [Google Scholar] [CrossRef]
- Baek, K.Y.; Bang, H.C. ADS-B Based Trajectory Prediction and Conflict Detection for Air Traffic Management. Int. J. Aeronaut. Space Sci. 2012, 13, 377–385. [Google Scholar] [CrossRef]
- Zhang, J.; Wu, X.; Wang, F. Aircraft Trajectory Prediction Based on Modified Interacting Multiple Model Algorithm. J. Donghua Univ. (Engl. Ed.) 2015, 32, 180–184. [Google Scholar] [CrossRef]
- Alligier, R.; Gianazza, D.; Durand, N. Learning the Aircraft Mass and Thrust to Improve the Ground-Based Trajectory Prediction of Climbing Flights. Transp. Res. Part C Emerg. Technol. 2013, 36, 45–60. [Google Scholar] [CrossRef]
- De Leege, A.; Van Paassen, M.; Mulder, M. A Machine Learning Approach to Trajectory Prediction. In Proceedings of the AIAA Guidance, Navigation, and Control (GNC) Conference, Boston, MA, USA, 19–22 August 2013. [Google Scholar] [CrossRef]
- Hashemi, S.M.; Botez, R.M.; Grigorie, T.L. New Reliability Studies of Data-Driven Aircraft Trajectory Prediction. Aerospace 2020, 7, 145. [Google Scholar] [CrossRef]
- Shi, Z.; Xu, M.; Pan, Q.; Yan, B.; Zhang, H. LSTM-Based Flight Trajectory Prediction. In Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil, 8–13 July 2018. [Google Scholar] [CrossRef]
- Pang, Y.; Yao, H.; Hu, J.; Liu, Y. A Recurrent Neural Network Approach for Aircraft Trajectory Prediction with Weather Features from Sherlock. In Proceedings of the AIAA Aviation 2019 Forum, Dallas, TX, USA, 17–21 June 2019. [Google Scholar] [CrossRef]
- Han, P.; Wang, W.; Shi, Q.; Yang, J. Real-Time Short- Term Trajectory Prediction Based on GRU Neural Network. In Proceedings of the 2019 IEEE/AIAA 38th Digital Avionics Systems Conference (DASC), San Diego, CA, USA, 8–12 September 2019. [Google Scholar] [CrossRef]
- Wu, Z.-J.; Tian, S.; Ma, L. A 4D Trajectory Prediction Model Based on the BP Neural Network. J. Intell. Syst. 2020, 29, 1545–1557. [Google Scholar] [CrossRef]
- Ma, L.; Tian, S. A Hybrid CNN-LSTM Model for Aircraft 4D Trajectory Prediction. IEEE Access 2020, 8, 134668–134680. [Google Scholar] [CrossRef]
- Zeng, W.; Quan, Z.; Zhao, Z.; Xie, C.; Lu, X. A Deep Learning Approach for Aircraft Trajectory Prediction in Terminal Airspace. IEEE Access 2020, 8, 151250–151266. [Google Scholar] [CrossRef]
- Cheng, C.; Guo, L.; Wu, T.; Sun, J.; Gui, G.; Adebisi, B.; Gacanin, H.; Sari, H. Machine-Learning-Aided Trajectory Prediction and Conflict Detection for Internet of Aerial Vehicles. IEEE Internet Things J. 2022, 9, 5882–5894. [Google Scholar] [CrossRef]
- Shi, Z.; Xu, M.; Pan, Q. 4-D Flight Trajectory Prediction with Constrained LSTM Network. IEEE Trans. Intell. Transp. Syst. 2021, 22, 7242–7255. [Google Scholar] [CrossRef]
- Tran, P.N.; Nguyen, H.Q.V.; Pham, D.-T.; Alam, S. Aircraft Trajectory Prediction with Enriched Intent Using Encoder-Decoder Architecture. IEEE Access 2022, 10, 17881–17896. [Google Scholar] [CrossRef]
- Wu, X.; Yang, H.; Chen, H.; Hu, Q.; Hu, H. Long-Term 4D Trajectory Prediction Using Generative Adversarial Networks. Transp. Res. Part C Emerg. Technol. 2022, 136, 103554. [Google Scholar] [CrossRef]
- Guo, M.H.; Xu, T.X.; Liu, J.J.; Liu, Z.N.; Jiang, P.T.; Mu, T.J.; Zhang, S.H.; Martin, R.R.; Cheng, M.M.; Hu, S.M. Attention Mechanisms in Computer Vision: A Survey. Comp. Vis. Media 2022, 8, 331–368. [Google Scholar] [CrossRef]
- Luong, M.T.; Pham, H.; Manning, C.D. Effective Approaches to Attention-Based Neural Machine Translation. arXiv 2015, arXiv:1508.04025. [Google Scholar]
- Schimpf, N.; Knoblock, E.J.; Wang, Z.; Apaza, R.D.; Li, H. Flight Trajectory Prediction Based on Hybrid- Recurrent Networks. In Proceedings of the 2021 IEEE Cognitive Communications for Aerospace Applications Workshop (CCAAW), Cleveland, OH, USA, 21–23 June 2021. [Google Scholar] [CrossRef]
- Wu, Y.; Yu, H.; Du, J.; Liu, B.; Yu, W. An Aircraft Trajectory Prediction Method Based on Trajectory Clustering and a Spatiotemporal Feature Network. Electronics 2022, 11, 3453. [Google Scholar] [CrossRef]
- Jia, P.; Chen, H.; Zhang, L.; Han, D. Attention-LSTM Based Prediction Model for Aircraft 4-D Trajectory. Sci. Rep. 2022, 12, 15533. [Google Scholar] [CrossRef] [PubMed]
- Ding, W.; Huang, J.; Shang, G.; Wang, X.; Li, B.; Li, Y.; Liu, H. Short-Term Trajectory Prediction Based on Hyperparametric Optimisation and a Dual Attention Mechanism. Aerospace 2022, 9, 464. [Google Scholar] [CrossRef]
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention Is All You Need. In Proceedings of the 31st Conference on Neural Information Processing Systems, Long Beach, CA, USA, 4–9 December 2017. [Google Scholar]
- Guo, D.; Wu, E.Q.; Wu, Y.; Zhang, J.; Law, R.; Lin, Y. FlightBERT: Binary Encoding Representation for Flight Trajectory Prediction. IEEE Trans. Intell. Transp. Syst. 2023, 24, 1828–1842. [Google Scholar] [CrossRef]
- Guo, D.; Zhang, Z.; Yan, Z.; Zhang, J.; Lin, Y. FlightBERT++: A Non-Autoregressive Multi-Horizon Flight Trajectory Prediction Framework. In Proceedings of the 38th AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada, 20–27 February 2024. [Google Scholar] [CrossRef]
- Tong, Q.; Hu, J.; Chen, Y.; Guo, D.; Liu, X. Long-Term Trajectory Prediction Model Based on Transformer. IEEE Access 2023, 11, 143695–143703. [Google Scholar] [CrossRef]
- Dong, Z.; Fan, B.; Li, F.; Xu, X.; Sun, H.; Cao, W. TCN-Informer-Based Flight Trajectory Prediction for Aircraft in the Approach Phase. Sustainability 2023, 15, 16344. [Google Scholar] [CrossRef]
- Alahi, A.; Goel, K.; Ramanathan, V.; Robicquet, A.; Fei-Fei, L.; Savarese, S. Social LSTM: Human Trajectory Prediction in Crowded Spaces. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 26 June–1 July 2016. [Google Scholar]
- Gupta, A.; Johnson, J.; Fei-Fei, L.; Savarese, S.; Alahi, A. Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 18–22 June 2018. [Google Scholar]
- Zhang, P.; Ouyang, W.; Zhang, P.; Xue, J.; Zheng, N. SR-LSTM: State Refinement for LSTM Towards Pedestrian Trajectory Prediction. In Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 16–20 June 2019. [Google Scholar] [CrossRef]
- Liu, Q.; Shi, X.; Jiang, R.; Zhang, H.; Lu, L.; Shibasaki, R. Modeling Interpretable Social Interactions for Pedestrian Trajectory. Transp. Res. Part C Emerg. Technol. 2024, 162, 104617. [Google Scholar] [CrossRef]
- Xu, Z.; Zeng, W.; Chu, X.; Cao, P. Multi-Aircraft Trajectory Collaborative Prediction Based on Social Long Short-Term Memory Network. Aerospace 2021, 8, 115. [Google Scholar] [CrossRef]
- Shafienya, H.; Regan, A.C. 4D Flight Trajectory Prediction Using a Hybrid Deep Learning Prediction Method Based on ADS-B Technology: A Case Study of Hartsfield–Jackson Atlanta International Airport (ATL). Transp. Res. Part C Emerg. Technol. 2022, 144, 103878. [Google Scholar] [CrossRef]
- Xu, Z.; Liu, Y.; Chu, X.; Tan, X.; Zeng, W. Aircraft Trajectory Prediction for Terminal Airspace Employing Social Spatiotemporal Graph Convolutional Network. J. Aerosp. Inf. Syst. 2023, 20, 319–333. [Google Scholar] [CrossRef]
- Sudarsanan, V.S.; Kostiuk, P.F. Deep-Learning Framework for Terminal Airspace Trajectory Prediction and In-Time Prognostics. J. Aerosp. Inf. Syst. 2024, 21, 1–13. [Google Scholar] [CrossRef]
Parameter | Parameter Value |
---|---|
Number of heads | 8 |
Number of encoder layers | 2 |
Dimension of model | 32 |
Dropout | 0.05 |
Learning rate | 0.0015 |
Train epoch | 100 |
Number of aircraft stored as one batch | 128 |
Method | MADE | MADHE | MADVE | MAPE | R2 |
---|---|---|---|---|---|
ST-Transformer | 1365.27 | 1353.54 | 100.53 | 12.69% | 0.6992 |
S-Transformer | 2277.53 | 2274.46 | 104.17 | 15.34% | 0.6933 |
SR-LSTM | 2608.83 | 2583.24 | 233.36 | 36.05% | 0.4765 |
LSTM | 2616.54 | 2593.01 | 237.53 | 36.69% | 0.3195 |
RNN | 3060.21 | 3041.44 | 243.91 | 57.17% | 0.1161 |
BP | 4762.07 | 4752.28 | 248.29 | 62.31% | 0.1096 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Dong, X.; Tian, Y.; Dai, L.; Li, J.; Wan, L. A New Accurate Aircraft Trajectory Prediction in Terminal Airspace Based on Spatio-Temporal Attention Mechanism. Aerospace 2024, 11, 718. https://doi.org/10.3390/aerospace11090718
Dong X, Tian Y, Dai L, Li J, Wan L. A New Accurate Aircraft Trajectory Prediction in Terminal Airspace Based on Spatio-Temporal Attention Mechanism. Aerospace. 2024; 11(9):718. https://doi.org/10.3390/aerospace11090718
Chicago/Turabian StyleDong, Xingchen, Yong Tian, Linyanran Dai, Jiangchen Li, and Lili Wan. 2024. "A New Accurate Aircraft Trajectory Prediction in Terminal Airspace Based on Spatio-Temporal Attention Mechanism" Aerospace 11, no. 9: 718. https://doi.org/10.3390/aerospace11090718
APA StyleDong, X., Tian, Y., Dai, L., Li, J., & Wan, L. (2024). A New Accurate Aircraft Trajectory Prediction in Terminal Airspace Based on Spatio-Temporal Attention Mechanism. Aerospace, 11(9), 718. https://doi.org/10.3390/aerospace11090718