Collision Risk Assessment of Lane-Changing Vehicles Based on Spatio-Temporal Feature Fusion Trajectory Prediction
Abstract
1. Introduction
- The STGAT-EDGRU trajectory prediction model is constructed, which uses Transformer to extract the vehicle motion temporal features, the improved GAT structure to extract the spatial interaction features, and achieves the effective fusion of the temporal and spatial features through the gated multimodal unit (GMU), and the decoding end adopts a two-layer GRU network in order to generate the future location of 2D Gaussian distribution. Comparison experiments on the HighD dataset verify the significant advantage of this method in long-time prediction accuracy;
- Based on the predicted trajectories of the main vehicle and the surrounding vehicle, combining the collision probability and the collision intensity, a collision risk index (CRI) is designed to weigh the likelihood and severity of the risk in the predicted time domain. It is verified that the CRI can warn of potential risk about 0.4 s earlier than the traditional collision risk index in a typical high-risk lane-changing scenario, and maintains the stable risk tracking ability during this critical time. It also has risk tracking ability;
- This paper proposes a collision risk assessment framework based on multi-vehicle trajectory prediction, which is capable of portraying the uncertainty in the process of multi-vehicle interaction and risk evolution in complex road scenarios. Compared with existing driving risk assessment models, the model achieves the deep coupling of trajectory prediction and collision risk assessment, providing more prospective risk warning support for autonomous driving systems.
2. Literature Review
2.1. Trajectory Prediction
2.2. Risk Assessment Methods
3. Vehicle Trajectory Prediction Model
3.1. Problem Description
3.2. Model Architecture
3.2.1. Trajectory Feature Encoding Module
3.2.2. Improved GAT Interactive Feature Extraction Module
3.2.3. Spatio-Temporal Feature Fusion Module
Algorithm 1: Spatio-temporal fusion algorithm |
Input: temporal feature s; spatial feature r |
Output: fused spatio-temporal feature f |
1. = tanh(s) |
2. = tanh(r) |
3. = sigmoid(add(, )) |
4. = add(multiply(, 1-z), multiply(, z)) |
3.2.4. Decoding and Prediction Module
4. Collision Risk Assessment Model
4.1. Two-Vehicle Collision Risk Assessment
4.2. Multi-Vehicle Collision Risk Assessment
4.3. Predictive Time-Domain Collision Risk Fusion
5. Model Experiment and Analysis
5.1. Data Processing
5.2. Analysis of Experimental Results for Trajectory Prediction Models
5.2.1. Model Parameter Settings
5.2.2. Model Performance Analysis
- (1)
- S-LSTM [45]: An LSTM Encoder-decoder structure that uses a fully connected social pooling layer to model vehicle-to-vehicle interactions.
- (2)
- CS-LSTM [18]: An LSTM Encoder-decoder structure that uses a convolutional social pooling layer to model vehicle-to-vehicle interactions.
- (3)
- Attention-LSTM [17]: An LSTM Encoder-decoder structure with a simple attention mechanism embedded.
- (4)
- GAT-LSTM [21]: An LSTM Encoder-decoder structure that uses a GAT network to model vehicle-to-space interactions.
- (5)
- GAT-Transformer [46]: A Transformer Encoder-decoder structure that uses a GAT network to model vehicle-space interactions.
5.2.3. Ablation Experiment
5.2.4. Analysis of Multi-Objective Trajectory Prediction Results
5.3. Collision Risk Assessment Model Case Analysis
5.3.1. Scene Design
5.3.2. Result Analysis
6. Conclusions
6.1. Contributions
6.2. Applications
6.3. Limitations and Future Work
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
STGAT-EDGRU | Spatio-Temporal Graph Attention Transformer with Enhanced Gated Recurrent Unit |
GAT | Graph Attention Network |
RMSE | Root Mean Square Error |
CRI | Collision Risk Index |
CAVs | Connected Autonomous vehicles |
TTC | Time to Collision |
RSS | Responsibility-Sensitive Safety |
GMM | Gaussian Mixture Model |
GACNet | Graph Attention Cooperative Network |
RI-DiT | Risk-Informed Diffusion Transformer |
GAN | Generative Adversarial Network |
LSTM | Long Short-Term Memory |
CSP | Common Spatial Pattern |
MDM | Minimum Distance Boundary |
GMU | Gated Multimodal Unit |
CV | Constant Velocity |
CA | Constant Acceleration |
CTRA | Constant Turn Rate and Acceleration |
HME | Hierarchical Mixture of Experts |
RNNs | Recurrent Neural Networks |
GCN | Graph Convolutional Network |
TTB | Time to Brake |
PET | Post-Encroachment Time |
DRAC | Deceleration Rate to Avoid Crash |
THW | Time Headway |
LK | Lane Keeping |
LCL | Left Lane Change |
LCR | Right Lane Change |
LCI | Lane Change Intention generation phase |
LCE | Lane Change Execution phase |
ITTC | Inverse Time to Collision |
LCTTC | Lane-Change Time to Collision |
References
- Katrakazas, C.; Quddus, M.; Chen, W.H. A new integrated collision risk assessment methodology for autonomous vehicles. Accid. Anal. Prev. 2019, 127, 61–79. [Google Scholar] [CrossRef]
- Li, Y.; Wu, D.; Lee, J.; Yang, M.; Shi, Y. Analysis of the transition condition of rear-end collisions using time-to-collision index and vehicle trajectory data. Accid. Anal. Prev. 2020, 144, 105676. [Google Scholar] [CrossRef]
- Li, Y.; Wu, D.; Chen, Q.; Lee, J.; Long, K. Exploring transition durations of rear-end collisions based on vehicle trajectory data: A survival modeling approach. Accid. Anal. Prev. 2021, 159, 106271. [Google Scholar] [CrossRef]
- Liu, S.; Wang, X.; Hassanin, O.; Xu, X.; Yang, M.; Hurwitz, D.; Wu, X. Calibration and evaluation of responsibility-sensitive safety (RSS) in automated vehicle performance during cut-in scenarios. Transp. Res. Part C Emerg. Technol. 2021, 125, 103037. [Google Scholar] [CrossRef]
- Chen, J.; Wang, K.; Xiong, Z. Collision probability prediction algorithm for cooperative overtaking based on TTC and conflict probability estimation method. Int. J. Veh. Des. 2018, 77, 195. [Google Scholar] [CrossRef]
- Shangguan, A.; Xie, G.; Wang, D.; Fei, R.; Hei, X.; Ji, W. Analyzing the collision probability of autonomous vehicles at crossroads. In Proceedings of the 2020 IEEE 9th Data Driven Control and Learning Systems Conference (DDCLS), Liuzhou, China, 19–21 June 2020; IEEE: New York, NY, USA, 2020; pp. 30–35. [Google Scholar]
- Xie, G.; Zhang, X.; Gao, H.; Qian, L.; Wang, J.; Ozguner, U. Situational assessments based on uncertainty-risk awareness in complex traffic scenarios. Sustainability 2017, 9, 1582. [Google Scholar] [CrossRef]
- Huang, C.; Hang, P.; Hu, Z.; Lv, C. Collision-probability-aware human-machine cooperative planning for safe automated driving. IEEE Trans. Veh. Technol. 2021, 70, 9752–9763. [Google Scholar] [CrossRef]
- Anik, B.M.T.; Islam, Z.; Abdel-Aty, M. inTformer: A Time-Embedded Attention-Based Transformer for Crash Likelihood Prediction at Intersections Using Connected Vehicle Data. arXiv 2023. [Google Scholar] [CrossRef]
- Chen, J.; Liu, P.; Zhang, Z.; Zhao, H.; Ji, Y.; Pu, Z. Risk-Informed Diffusion Transformer for Long-Tail Trajectory Prediction in the Crash Scenario. arXiv 2024, arXiv:2401.08581. [Google Scholar]
- Chai, J.; Liu, J.; Huang, J.; Huang, C. GACNet: Interactive Prediction of Surrounding Vehicle Behavior under High Collision Risk. Artif. Intell. Sci. Eng. 2025, 7, 2401040. [Google Scholar] [CrossRef]
- Meng, D.; Xiao, W.; Zhang, L.; Zhang, Z.; Liu, Z. Vehicle Trajectory Prediction-Based Predictive Collision Risk Assessment for Autonomous Driving in Highway Scenarios. IEEE Trans. Intell. Transp. Syst. 2023, arXiv:2304.05610. [Google Scholar] [CrossRef]
- Lefèvre, S.; Vasquez, D.; Laugier, C. A Survey on Motion Prediction and Risk Assessment for Intelligent Vehicles. Robomech J. 2014, 1, 1. [Google Scholar] [CrossRef]
- Gao, J.; Mao, Y.C.; Li, Z.T. Trajectory prediction based on Gauss mixture time series model. Comput. Appl. 2019, 39, 2261–2270. [Google Scholar]
- Joseph, J.M.; Doshi-Velez, F.; Roy, N. A Bayesian Nonparametric Approach to Modeling Mobility Patterns. In Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence (AAAI), Atlanta, GA, USA, 11–15 July 2010; AAAI Press: Washington, DC, USA, 2010; pp. 1587–1593. [Google Scholar]
- Ji, X.; Fei, C.; He, X.; Liu, Y. Driving intention recognition and vehicle trajectory prediction based on LSTM network. J. China Highw. Transp. 2019, 32, 34–42. [Google Scholar]
- Yang, S.; Chen, Y.; Cao, Y.; Wang, R.; Shi, R.; Lu, J. Lane change trajectory prediction based on spatio-temporal attention mechanism. In Proceedings of the 2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC), Macau, China, 8–12 October 2022; IEEE: New York, NY, USA, 2022; pp. 2366–2371. [Google Scholar]
- Deo, N.; Trivedi, M.M. Convolutional Social Pooling for Vehicle Trajectory Prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA, 18–22 June 2018; IEEE: New York, NY, USA, 2018; pp. 1468–1476. [Google Scholar]
- Wang, M.; Cai, Y.; Wang, H.; Rao, Z.; Chen, L.; Li, Y. Vehicle trajectory prediction method based on graph convolution interaction network. Automot. Eng. 2024, 46, 1863–1872. [Google Scholar]
- Chen, S.; Piao, L.; Zang, X.; Luo, Q.; Li, J.; Yang, J.; Rong, J. Analyzing differences of highway lane-changing behavior using vehicle trajectory data. Phys. A Stat. Mech. Its Appl. 2023, 624, 128980. [Google Scholar] [CrossRef]
- Wen, H.; Zhang, X.; Huang, J.; Xu, P. Prediction of Intelligent Vehicle Trajectories Considering Dynamic Interactions. J. Transp. Syst. Eng. Inf. 2024, 24, 60–68. [Google Scholar]
- Chen, X.; Wu, S.; Shi, C.; Huang, Y.; Yang, Y.; Ke, R. Sensing Data Supported Traffic Flow Prediction via Denoising Schemes ANN: A Comparison. IEEE Sens. J. 2020, 20, 14317–14328. [Google Scholar] [CrossRef]
- Xiong, L.; Wu, J.; Xing, X.; Chen, J. A review of autonomous vehicle driving risk assessment methods. J. Automot. Eng. 2024, 14, 745–759. [Google Scholar]
- Noh, S.; An, K. Decision-making framework for automated driving in highway environments. IEEE Trans. Intell. Transp. Syst. 2017, 19, 58–71. [Google Scholar] [CrossRef]
- Chu, K.; Lee, M.; Sunwoo, M. Local path planning for off-road autonomous driving with avoidance of static obstacles. IEEE Trans. Intell. Transp. Syst. 2012, 13, 1599–1616. [Google Scholar] [CrossRef]
- Kaempchen, N.; Schiele, B.; Dietmayer, K. Situation assessment of an autonomous emergency brake for arbitrary vehicle-to-vehicle collision scenarios. IEEE Trans. Intell. Transp. Syst. 2009, 10, 678–687. [Google Scholar] [CrossRef]
- Ferguson, D.; Darms, M.; Urmson, C.; Kolski, S. Detection, prediction, and avoidance of dynamic obstacles in urban environments. In Proceedings of the 2008 IEEE Intelligent Vehicles Symposium, Eindhoven, The Netherlands, 4–6 June 2008; IEEE: New York, NY, USA, 2008; pp. 1149–1154. [Google Scholar]
- Yang, Z.; Shi, C.; Zheng, Y.; Gu, S.; Chen, F. A study on a vehicle semi-active suspension control system based on road elevation identification. PLoS ONE 2022, 17, e0269406. [Google Scholar] [CrossRef] [PubMed]
- Tan, H.S.; Huang, J. DGPS-based vehicle-to-vehicle cooperative collision warning: Engineering feasibility viewpoints. IEEE Trans. Intell. Transp. Syst. 2006, 7, 415–428. [Google Scholar] [CrossRef]
- Hillenbrand, J.; Spieker, A.M.; Kroschel, K. A multilevel collision mitigation approach—Its situation assessment, decision making, and performance tradeoffs. IEEE Trans. Intell. Transp. Syst. 2006, 7, 528–540. [Google Scholar] [CrossRef]
- Noh, S. Decision-making framework for autonomous driving at road intersections: Safeguarding against collision, overly conservative behavior, and violation vehicles. IEEE Trans. Ind. Electron. 2018, 66, 3275–3286. [Google Scholar] [CrossRef]
- Li, G.; Yang, Y.; Zhang, T.; Qu, X.; Cao, D.; Cheng, B.; Li, K. Risk assessment-based collision avoidance decision-making for autonomous vehicles in multi-scenarios. Transp. Res. Part C Emerg. Technol. 2021, 122, 102820. [Google Scholar] [CrossRef]
- Vogel, K. A Comparison of Headway and Time to Collision as Safety Indicators. Accid. Anal. Prev. 2003, 35, 427–433. [Google Scholar] [CrossRef]
- Kim, J.; Kum, D. Collision risk assessment algorithm via lane-based probabilistic motion prediction of surrounding vehicles. IEEE Trans. Intell. Transp. Syst. 2017, 19, 2965–2976. [Google Scholar] [CrossRef]
- de Campos, G.R.; Runarsson, A.H.; Granum, F.; Falcone, P.; Alenljung, K. Collision avoidance at intersections: A probabilistic threat-assessment and decision-making system for safety interventions. In Proceedings of the 17th International IEEE Conference on Intelligent Transportation Systems (ITSC), Qingdao, China, 8–11 October 2014; IEEE: New York, NY, USA, 2014; pp. 649–654. [Google Scholar]
- Wang, J.; Wu, J.; Zheng, X.; Ni, D.; Li, K. Driving safety field theory modeling and its application in pre-collision warning system. Transp. Res. Part C Emerg. Technol. 2016, 72, 306–324. [Google Scholar] [CrossRef]
- Tian, Y.; Pei, H.; Yan, S.; Zhang, Y. Extended driving risk field model for i-VICS and its application. J. Tsinghua Univ. (Sci. Technol.) 2022, 62, 447–457. [Google Scholar]
- Lambert, A.; Gruyer, D.; Saint Pierre, G. A fast Monte Carlo algorithm for collision probability estimation. In Proceedings of the 2008 10th International Conference on Control, Automation, Robotics and Vision, Hanoi, Vietnam, 17–20 December 2008; IEEE: New York, NY, USA, 2008; pp. 406–411. [Google Scholar]
- Ammoun, S.; Nashashibi, F. Real-time trajectory prediction for collision risk estimation between vehicles. In Proceedings of the 2009 IEEE 5th International Conference on Intelligent Computer Communication and Processing, Cluj-Napoca, Romania, 27–29 August 2009; IEEE: New York, NY, USA, 2009; pp. 417–422. [Google Scholar]
- Houénou, A.; Bonnifait, P.; Cherfaoui, V. Risk assessment for collision avoidance systems. In Proceedings of the 17th International IEEE Conference on Intelligent Transportation Systems (ITSC), Qingdao, China, 8–11 October 2014; IEEE: New York, NY, USA, 2014; pp. 386–391. [Google Scholar]
- Lee, K.; Peng, H. Evaluation of automotive forward collision warning and collision avoidance algorithms. Veh. Syst. Dyn. 2005, 43, 735–751. [Google Scholar] [CrossRef]
- Arevalo, J.; Solorio, T.; Manuel, M.; González, F.A. Gated multimodal networks. Neural Comput. Appl. 2020, 32, 10209–10228. [Google Scholar] [CrossRef]
- Jia, S.; Xu, J.; Wang, S.; Liu, X.; Li, G. Connected multi-vehicle crash risk assessment considering probability and intensity. PLoS ONE 2025, 20, e0313317. [Google Scholar] [CrossRef] [PubMed]
- Yang, L.; Zhang, J.; Lyu, N.; Zhao, Q. Predicting lane change maneuver and associated collision risks based on multi-task learning. Accid. Anal. Prev. 2024, 209, 107830. [Google Scholar] [CrossRef] [PubMed]
- Alahi, A.; Goel, K.; Ramanathan, V.; Robicquet, A.; Fei-Fei, L.; Savarese, S. Social LSTM: Human trajectory prediction in crowded spaces. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27–30 June 2016; IEEE: New York, NY, USA, 2016; pp. 961–971. [Google Scholar]
- Chen, W.; Zhang, Y.; Han, X. Vehicle Trajectory Prediction Model Based on Transformer and Graph Attention Network. J. Jilin Univ. (Eng. Ed.), 2025; Online ahead of print. [Google Scholar] [CrossRef]
- Laureshyn, A.; Svensson, Å.; Hydén, C. Evaluation of traffic safety, based on micro-level behavioural data: Theoretical framework and first implementation. Accid. Anal. Prev. 2010, 42, 1637–1646. [Google Scholar] [CrossRef]
- Rajaram, V.; Subramanian, S.C. Heavy vehicle collision avoidance control in heterogeneous traffic using varying time headway. Mechatronics 2018, 50, 328–340. [Google Scholar] [CrossRef]
- Xie, J.; Xia, Y.; Qian, Z.; Liu, B.; Qin, Y. Lane change risk warning for interweaving zones considering intelligent connected vehicle neighbor information. J. Transp. Eng. 2023, 23, 287–300. [Google Scholar]
Reference | Trajectory Prediction | Collision Probability | Collision Intensity | Fusing Spatio-Temporal Features | Multi-Vehicle Interaction Modeling | Method Overview |
---|---|---|---|---|---|---|
[2,3] | TTC countdown risk function | |||||
[4] | RSS rule model | |||||
[5] | √ | TTC mapping to collision probability | ||||
[6] | √ | √ | LSTM trajectory prediction Monte Carlo simulation | |||
[8] | √ | √ | GMM trajectory prediction fuzzy logic | |||
[7] | √ | √ | √ | √ | Multimodal trajectory generation network | |
[9] | √ | √ | √ | Transformer trajectory prediction collision probability | ||
[10] | √ | √ | √ | RI-DiT trajectory prediction TTC risk characteristics | ||
[11] | √ | √ | √ | √ | GAN + GAT trajectory prediction Conflict analysis module | |
[12] | √ | √ | √ | √ | √ | LSTM + CSP + GAT trajectory prediction TTC + MDM continuous risk function |
This study | √ | √ | √ | √ | √ | Transformer + GAT trajectory prediction CRI Collision Risk Index |
Model | RMSE(/m) | ||||
---|---|---|---|---|---|
1 s | 2 s | 3 s | 4 s | 5 s | |
S-LSTM | 0.31 | 0.70 | 1.29 | 2.31 | 3.47 |
CS-LSTM | 0.27 | 0.61 | 1.24 | 2.19 | 3.30 |
Attention-LSTM | 0.24 | 0.52 | 1.05 | 1.76 | 2.63 |
GAT-LSTM | 0.19 | 0.37 | 0.51 | 1.04 | 1.87 |
GAT-Transformer | 0.12 | 0.20 | 0.35 | 0.73 | 1.38 |
STGAT-EDGRU | 0.14 | 0.21 | 0.33 | 0.61 | 1.12 |
Model | RMSE(/m) | ||||
---|---|---|---|---|---|
1 s | 2 s | 3 s | 4 s | 5 s | |
STGAT-EDGRU | 0.14 | 0.21 | 0.33 | 0.61 | 1.12 |
M1 | 0.22 | 0.36 | 0.49 | 0.83 | 1.65 |
M2 | 0.31 | 0.62 | 1.27 | 2.30 | 3.51 |
M3 | 0.20 | 0.35 | 0.64 | 1.08 | 1.99 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Su, H.; Wang, N.; Wang, X. Collision Risk Assessment of Lane-Changing Vehicles Based on Spatio-Temporal Feature Fusion Trajectory Prediction. Electronics 2025, 14, 3388. https://doi.org/10.3390/electronics14173388
Su H, Wang N, Wang X. Collision Risk Assessment of Lane-Changing Vehicles Based on Spatio-Temporal Feature Fusion Trajectory Prediction. Electronics. 2025; 14(17):3388. https://doi.org/10.3390/electronics14173388
Chicago/Turabian StyleSu, Hongtao, Ning Wang, and Xiangmin Wang. 2025. "Collision Risk Assessment of Lane-Changing Vehicles Based on Spatio-Temporal Feature Fusion Trajectory Prediction" Electronics 14, no. 17: 3388. https://doi.org/10.3390/electronics14173388
APA StyleSu, H., Wang, N., & Wang, X. (2025). Collision Risk Assessment of Lane-Changing Vehicles Based on Spatio-Temporal Feature Fusion Trajectory Prediction. Electronics, 14(17), 3388. https://doi.org/10.3390/electronics14173388