Next Article in Journal
Identification of Pathologies in Pavements by Unmanned Aerial Vehicle (UAV): A Systematic Literature Review
Previous Article in Journal
Aerial Drone Magnetometry for the Detection of Subsurface Unexploded Ordnance (UXO) in the San Gregorio Experimental Site (Zaragoza, Spain)
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Fusing Deep Learning and Predictive Control for Safe Operation of Manned–Unmanned Aircraft Systems

1
Research Institute, Integrated Research and Development Platform of Unmanned Aerial Vehicle, National Key Laboratory of Unmanned Aerial Vehicle Technology, Northwestern Polytechnical University, Xi’an 710072, China
2
China Flight Test Establishment, Xi’an 710089, China
3
China Aerospace Science and Technology System and Innovation Research Institute, Beijing 100048, China
*
Author to whom correspondence should be addressed.
Drones 2026, 10(2), 89; https://doi.org/10.3390/drones10020089
Submission received: 18 November 2025 / Revised: 9 January 2026 / Accepted: 22 January 2026 / Published: 28 January 2026

Highlights

What are the main findings?
  • An EKF–LSTM fusion model for manned–unmanned collaborative flight trajectory prediction reduces ADE, FDE, and RMSE by 21.2%, 50.7%, and 24.9% compared with an LSTM baseline, and remains accurate under typical and nonlinear flight states.
  • A trajectory dispersion cone (TDC) with Monte Carlo sampling uses EKF-LSTM prediction errors to estimate collision probability, while the VO-MPC strategy increases minimum separation, raises avoidance success from 91.2% to 99.8%, and lowers mean collision probability by 66.7% in low noise, with further reductions to 27.7% and 34.2% of MPC in medium- and high-noise cases.
What are the implications of the main findings?
  • Integrating EKF-LSTM prediction, TDC-based uncertainty quantification, and VO-MPC forms a unified safety assurance framework that addresses safety challenges in manned–unmanned collaborative flight.
  • The framework shows high feasibility and practical value in civil aviation and can be extended to more complex multi-aircraft cooperative scenarios.

Abstract

With the rapid development of the low-altitude economy, the deployment of unmanned aircraft vehicles (UAVs) in many fields is increasing continuously, and the demand for collaborative flights is also growing. However, the issue of flight safety in complex airspace remains a pressing concern. Precise flight path prediction, collision detection, and avoidance are paramount for secure collaborative operations. This study proposes an integrated framework that combines an EKF-LSTM model for trajectory prediction, a Trajectory Dispersion Cone (TDC) method for probabilistic collision risk assessment, and a Velocity Obstacle-Model Predictive Control (VO-MPC) strategy for dynamic collision avoidance. Experimental results demonstrate the advantages of our approach: the EKF-LSTM model reduces prediction errors in complex flight states. Furthermore, the VO-MPC method achieves a 99.8% collision avoidance success rate under low-noise conditions—an 8.6% improvement over traditional MPC—while reducing the average collision probability by 66.7%. It also maintains stable performance under medium- and high-noise conditions, reducing the collision probability to only 27.7% and 34.2% of that of conventional MPC, respectively. The proposed framework offers a solution for safe manned–unmanned collaboration in complex environments. Future work will extend these methods to multi-aircraft cooperative scenarios.

1. Introduction

In recent years, UAVs have been playing an increasingly important role in various fields such as agricultural plant protection, disaster response, and environmental monitoring [1,2]. However, the intelligent autonomy of UAVs remains limited by constraints on algorithmic maturity, computational resources, and payload capacity. These limitations often necessitate human intervention, reducing their adaptability to dynamic environments [3].
To address this challenge, Manned–Unmanned Aircraft System (M-UAS) collaborative flight modes have been proposed as a promising solution. In M-UAS frameworks, manned aircraft assume command and decision-making roles, while UAVs perform high-risk missions. This synergy leverages their complementary strengths to enhance operational efficiency and resource utilization in complex scenarios [4]. The architecture of a typical M-UAS collaborative flight system (shown in Figure 1) comprises a ground mission control center, which connects multiple command aircraft-equipped mission planning systems. Each system deploys several manned/unmanned collaborative groups, supporting multi-formation M-UAS mission operations.
Although manned–unmanned collaborative flight has demonstrated potential, collision avoidance in complex operational environments remains a critical challenge and a core bottleneck limiting further deployment [5]. Recent work on prediction-informed autonomous trajectory planning in crowded and unknown dynamic environments also emphasizes collision avoidance as a central requirement for safe UAV operations [6]. Moreover, a comprehensive survey on multi-UAV collision avoidance summarizes existing solution families and highlights collision avoidance as a persistent challenge for multi-agent airspace operations [7]. To improve safety assurance, existing research has explored mission-driven autonomous perception and information fusion for enhanced situational awareness [8], as well as swarm-level collision-avoidance control and optimization strategies [9]. Meanwhile, progress in intent-aware and data-driven motion prediction has provided stronger prerequisites for downstream avoidance, including multi-agent intention-guided prediction [10], vision-based planning with dynamic obstacle trajectory prediction [11], and UAV-based moving-target trajectory prediction in cluttered environments [12]. Recent studies have further explored integrating predicted/estimated intentions into receding-horizon optimization frameworks (e.g., prediction-driven MPC) to support safe UAV navigation in dynamic environments [13]. These studies collectively indicate that trajectory prediction and collision/conflict detection are not only the technical foundations of collision avoidance algorithms, but also key enablers for ensuring overall flight safety of collaborative systems.
Aircraft trajectory prediction serves as the cornerstone for ensuring safe coordination between manned and unmanned aircraft, as it directly underpins the reliability of collision detection and safety assessments. Existing prediction methodologies can be broadly categorized into three groups: dynamics-based methods (relying on aerodynamics and aircraft performance models), state estimation methods, and machine learning techniques [14].
Dynamics-based methods rely on dynamic and kinematic equations to simulate aircraft parameters for trajectory prediction. Kang et al. [15] proposed a path prediction method based on attitude estimation of fixed-wing aircraft, and the results show that the performance of the proposed algorithm is superior to that of the prediction method based only on position data. Sahbon et al. [16] compared two aerodynamic models in trajectory simulations, highlighting the impact of model selection on prediction precision. Although dynamics-based methods analyze aircraft from the perspective of force interactions, most studies are conducted under idealized assumptions to simplify the model. Due to insufficient consideration of real-world constraints, the actual prediction results fail to meet practical requirements.
State estimation methods use statistical analysis of historical trajectory data to construct probabilistic distribution models, making them suitable for processing uncertain data in dynamic environments [17]. Hematulin et al. [18] proposed a multi-UAV trajectory planning and hierarchical collision avoidance approach based on nonlinear Kalman filtering, achieving real-time trajectory prediction through sensor data fusion, ideal for multi-target tracking scenarios. Li et al. [19] used dynamic models for coupled motion and leveraging Kalman filtering to fuse scene context information, this approach achieves accurate and feasible multi-step multimodal trajectory prediction by combining the advantages of learning-based and physics-based models. Despite their advantage in uncertainty handling, these methods fail to capture complex nonlinear and time-varying trajectory characteristics, leading to decreased accuracy in highly dynamic scenarios.
Machine learning-based methods, particularly neural networks, have been widely applied in trajectory prediction due to their strong temporal modeling capabilities. Yoon et al. [20] introduced a deep learning framework employing gated recurrent units (GRUs) for real-time, precise, and scalable UAV trajectory prediction, showcasing its effectiveness in managing temporal data. Li et al. [21] proposed the MFAN model, which integrates mixed feature attention mechanisms to enhance trajectory prediction performance and improve the accuracy of motion forecasting. Shi et al. [22] developed a UAV trajectory prediction system that integrates multiple flight modes, leveraging diverse flight states to improve prediction accuracy. Machine learning methods exhibit exceptional nonlinear modeling capabilities and do not rely on physical models, thereby eliminating the need for certain unavailable aircraft performance parameters, data, and unrealistic assumptions. However, they struggle to quantify uncertainty and suffer from black-box characteristics. Thus, this study integrates state estimation with machine learning methods. The integrated model can not only analyze long-term trends and high-level intentions to provide global observational predictions but also perform local optimization and correction based on accurate physical models, ensuring trajectory smoothness and physical rationality. This makes the model an intelligent predictor that understands both physics and intentions.
Beyond trajectory prediction, collision detection is another core technology ensuring safe M-UAS collaboration, as it directly determines the effectiveness of subsequent collision avoidance strategies [23]. Roberto et al. [24] proposed a vision -based method for obstacle detection, tracking and conflict detection, enabling small UAS to achieve non-cooperative sense-and-avoid capabilities. Zou et al. [25] developed a small UAV collision probability approach integrating navigation errors; they further proposed a rapid algorithm [26] with an average computation time of <0.001 s for real-time performance. Although these methods are effective in specific scenarios, they generally rely on high-quality perceptual data or precise knowledge of system errors. In dynamic and uncertain mixed M-UAS airspace, their resilience faces challenges. To address the above challenges, this paper introduces the Trajectory Dispersion Cone (TDC) method. By constructing a probabilistic safety space that accommodates uncertainties, this method breaks away from the reliance on continuous high-quality external observations and provides a more fundamental solution for the safe operation of manned–unmanned collaborative flight in complex environments.
Collision detection is a prerequisite for identifying risks in Manned–Unmanned Aerial Collaborative Flight, while collision avoidance serves as the core guarantee to fundamentally mitigate such risks and ensure operational safety. These techniques are primarily categorized into tactical and strategic approaches.
Tactical methods respond rapidly to collision threats by analyzing the relative geometry and dynamic characteristics between aircraft in real time [27]. Wakabayashi et al. [28] developed a Chance Constrained Model Predictive Control (CCMPC) method that provides more robust collision avoidance against changes in obstacle speed. Zhang et al. [29] proposed a velocity obstacle-based method for multi-agent systems, constructing RHC chance constraints to plan at velocity level for collision-free trajectories.
Strategic methods prioritize global path planning to minimize collision risks throughout the flight. Wang et al. [30] proposed a D3QN path planning algorithm customized for UAVs—with novel designs of state space, action space and reward mechanism to reflect objectives and constraints—achieving low collision rates and high adaptability in tests. Wei et al. [31] modeled aircraft collision avoidance as a POMDP and solved it via MCTS, with the algorithm showing good performance in effectiveness, robustness, convergence and constraint handling.
In summary, while strategic methods provide globally optimized solutions for complex mission profiles, real-time safety in dynamic M-UAV shared airspace hinges on robust tactical-layer solutions. To address the critical need for both instantaneous reactivity and predictive foresight, this study focuses on the tactical layer, proposing a novel collision avoidance method by seamlessly merging the Velocity Obstacle (VO) approach with Model Predictive Control (MPC).
Building upon existing literature, this study proposes an integrated framework for manned–unmanned collaborative flight. The main contributions are threefold: (1) developing an EKF-LSTM hybrid model that combines the strengths of machine learning for nonlinear sequence modeling and Kalman filtering for state estimation, to reduce trajectory prediction errors during complex flight maneuvers; (2) constructing a trajectory uncertainty and collision risk assessment method based on Monte Carlo sampling for probabilistic collision detection in 3D airspace; and (3) designing a VO-MPC strategy to improve collision avoidance performance under varying noise conditions. The novelty lies in integrating EKF-LSTM’s predictive accuracy, TDC’s uncertainty quantification, and VO-MPC’s reliable collision avoidance performance under noisy conditions into a unified safety assurance system for manned–unmanned collaborative flight.
The remainder of this paper is organized as follows. Section 2 presents the proposed framework, including the EKF-LSTM trajectory prediction model, the TDC-based probabilistic collision risk assessment method, and the VO-MPCVO-MPCVO-MPC collision avoidance strategy. Section 3 reports the experimental setup and results, and analyzes the performance of the proposed approach under different flight scenarios and noise conditions. Finally, Section 4 concludes the paper and outlines directions for future work.

2. Materials and Methods

2.1. EKF-LSTM Fusion Prediction Model for Trajectory Prediction

2.1.1. Model Basics

The Kalman Filter (KF) is a recursive state estimation algorithm that integrates system dynamics models with observational data to achieve optimal state estimation in environments with Gaussian noise. It is particularly effective for linear systems where the noise is Gaussian. However, the KF’s assumption of linearity limits its applicability in nonlinear maneuvering scenarios, which are common in UAV operations. To address this, the Extended Kalman Filter (EKF) extends the KF framework to nonlinear systems by linearizing the nonlinear functions using a first-order Taylor expansion. This makes the EKF a widely used method for aircraft trajectory prediction. Nevertheless, in scenarios with strong nonlinearities or high dynamics, the linear approximation can lead to significant errors due to model mismatch.
Long Short-Term Memory (LSTM) networks, an advanced form of recurrent neural networks (RNNs), are designed to capture long-term dependencies in sequential data through gating mechanisms. LSTMs excel at learning nonlinear dynamic features from historical trajectory data, making them a powerful tool for trajectory prediction. However, their purely data-driven nature means they lack the constraints of physical models, which can lead to predictions that deviate from actual dynamic characteristics, especially when data is scarce or when there are abrupt changes in the environment.

2.1.2. Model Architecture and Fusion Mechanism

The EKF-LSTM fusion prediction model integrates the Extended Kalman Filter’s (EKF) capability to model physical systems with the Long Short-Term Memory (LSTM) network’s strength in capturing temporal features. The LSTM analyzes time series data to extract long-term dependencies from flight trajectories, providing its output as observational input to the EKF algorithm. Leveraging a model of aircraft dynamics, the EKF extracts local characteristics from flight data and refines the LSTM’s predictions. This combined approach enhances the accuracy of flight trajectory predictions. Figure 2 presents the principle block diagram of this method.
At time t , the LSTM leverages historical trajectory information to produce a one-step-ahead prior state estimate x ^ t t 1 . Specifically, { X 1 , X 2 , , X t } denotes the ordered trajectory input sequence up to time t , where each X i represents the trajectory feature vector at time step i (i.e., the measured kinematic quantities used as the LSTM input; the sequence is fed in chronological order). The LSTM output x ^ t t 1 is then used as the observation-related input for the EKF, which performs iterative “prediction–update” refinement. The EKF first propagates the prior uncertainty through the state transition model and the error covariance update, and then incorporates observation information via the Kalman gain to correct the state estimate. Sequential rolling prediction generates a complete flight trajectory. The specific equations governing this process are detailed below:
{ x ^ t | t 1 = L S T M ( X 1 , X 2 , , X t ) P t | t 1 = F t P t 1 | t 1 F t T + Q t
In Equation (1), x ^ t t 1 is the predicted (prior) state estimate at time tobtained from the LSTM based on the historical sequence { X 1 , , X t } . P t t 1 is the prior error covariance matrix, which quantifies the uncertainty associated with the prior estimate. The term F t P t 1 t 1 F t T describes how the previous posterior uncertainty P t 1 t 1 is propagated through the state transition at time t , where F t is the state transition matrix (capturing the local mapping of state perturbations across time). Q t is the process noise covariance matrix, which models uncertainty introduced by unmodeled dynamics, disturbances, and maneuvering effects. Therefore, Equation (1) corresponds to the EKF prediction (time-update) stage, where uncertainty is propagated forward before incorporating the current observation.
In the update step, the observed data is used to correct the predicted results, and the Kalman gain K t is used to calculate the corrected state estimate. The update equation is:
{ K t = P t | t 1 H t T ( H t P t | t 1 H t T + R t ) 1 x ^ t = x ^ t | t 1 + K t ( z t h ( x ^ t | t 1 ) )     P t = ( I K t H t ) P t | t 1
In Equation (2), z t denotes the observation at time t , and h ( ) is the measurement function that maps a state estimate to the predicted observation. Accordingly, H t is the measurement matrix that maps state-space uncertainty into the observation space (or equivalently the local linearization of h ( ) ). The innovation term z t h ( x ^ t t 1 ) represents the residual between the actual observation and the predicted observation implied by the prior estimate. The Kalman gain K t weights this residual to fuse observation information with the prior prediction in an uncertainty-aware manner: R t characterizes the observation noise level (measurement reliability), while P t t 1 reflects the prior uncertainty. The updated state estimate x ^ t is the posterior result after correction, and P t is the corresponding posterior error covariance reflecting the updated uncertainty. Overall, Equation (2) corresponds to the EKF update (measurement-correction) stage.

2.1.3. Implementation Details and Reproducibility

To improve reproducibility, Table 1 summarizes the key implementation parameters of the LSTM predictor and the EKF fusion filter.
The LSTM is trained with one-step supervision using MSE loss and the Adam optimizer (lr = 10−4) for 100 epochs with batch size 32. Training data are shuffled each epoch, and the checkpoint with the lowest validation loss is selected. All experiments use a fixed random seed for determinism.

2.2. Trajectory Dispersion Cone (TDC) for Collision Detection

2.2.1. Theoretical Foundation

In complex three-dimensional airspace, aircraft trajectories are subject to significant uncertainty due to measurement errors, environmental disturbances, and other factors [32]. To address this, this study proposes a collision detection method based on the Trajectory Dispersion Cone (TDC), which integrates trajectory prediction with the geometric properties of a conical region and employs Monte Carlo sampling to assess collision risks between aircraft.
The TDC constructs a conical spatial region defined by the aircraft’s predicted trajectory, heading, and root mean square error (RMSE), which quantifies trajectory deviation and maps uncertainty to a three-dimensional cone for quantitative risk assessment.
This conical region encapsulates the range of possible aircraft movements within a predicted time frame, enabling the evaluation of intersections with obstacles or other aircraft. The TDC approach effectively manages movement uncertainty and offers distinct advantages in multi-target or dynamic obstacle environments by not only predicting future positions but also quantifying uncertainty through a rigorous geometric model.

2.2.2. Construction of the Trajectory Dispersion Cone Model

Let the starting point of the aircraft’s predicted trajectory be ( x 0 , y 0 , z 0 ) , and the trajectory over the next Tc time steps be:
P ( t ) = { ( x t , y t , z t ) | t = 1,2 , , T c }
The cone has its vertex at the predicted starting point ( x 0 , y 0 , z 0 ) , the cone axis direction is the unit vector d = d T c d T c pointing from the starting point to the predicted endpoint ( x T , y T , z T ) , where d T c = ( x T c x 0 , y T c y 0 , z T c z 0 ) , and the cone axis length is the total length of the future trajectory L = d T c . The cone radius function is denoted as r = t T c R M S E ( t ) , which varies with time t and is related to the prediction uncertainty (i.e., the RMSE value), reflecting the range of prediction uncertainty. As RMSE increases, the radius of the cone base increases, indicating increased prediction uncertainty; conversely, a decrease in RMSE means more precise predictions, with the cone base radius correspondingly decreasing. The distance between the base circles of the two aircraft’s TDCs dynamically changes with time t. Through the three-dimensional cone model, the predicted trajectory can be visually displayed and uncertainty quantified.

2.2.3. Collision Detection Model Construction

Cone Point Set Distribution: In order to reflect the uncertainty of the aircraft trajectory, the point set distribution inside the cone must be defined. The position of any point inside the cone can be expressed as:
q ( t , u , v ) = v 0 + t d + u R ( e 1 ) + v R ( e 2 )
where t [ 0 , L ] is the distance along the cone axis; u , v R satisfy u 2 + v 2 r 2 ( t ) ; e 1 , e 2 are the transformed bases of the standard orthogonal basis under the action of the rotation matrix R , which describe the two orthogonal directions of the cone base, respectively.
Monte Carlo sampling: At each time step, we generate a finite set of sample points inside the trajectory dispersion cone using an axially stratified sampling procedure. Specifically, we first discretize the axial coordinate t [ 0 , L ] into N uniformly spaced levels { t i } i = 1 N as in Equation (5). This step ensures that the samples cover the cone consistently along its full axial extent (i.e., the entire look-ahead length). Conditioned on each axial level t i , we then draw a random point ( u i , v i ) uniformly within the cross-sectional circular disk u 2 + v 2 r 2 ( t i ) using two independent random variables ξ 1 , ξ 2 U ( 0 , 1 ) , as given in Equation (6) and (7). Therefore, “uniform along the cone axis” refers to the uniform spacing of the axial levels { t i } , while the randomness is introduced through the in-disk sampling at each axial level. Repeating the above process for the cones of the two aircraft yields the corresponding point sets used for collision checking and probability estimation.
Distribute sampling points uniformly along the cone axis:
t i = i N L , i = 1,2 , , N
Among them, L is the axial length of the cone.
For each axial sampling point t i , sampling points are uniformly distributed on the circular disk with radius r ( t i ) corresponding to the cone. The sampling points u i , v i satisfy:
u i = r ( t i ) ξ 1 cos ( 2 π ξ 2 )
v i = r ( t i ) ξ 1 sin ( 2 π ξ 2 )
Among them, ξ 1 , ξ 2 U ( 0,1 ) .
Perform the above sampling process on the cones of the two aircraft to obtain the point sets:
Q A ( t ) = { q A , i ( t ) } i = 1 N
Q B ( t ) = { q B , j ( t ) } j = 1 N
Collision conditions and probability estimation: For any pair of sampling points ( q A , i , q B , j ) , in three-dimensional space, calculate their Euclidean distance:
d i j ( t ) = q A , i ( t ) q B , j ( t )  
Set the system safety threshold D s = 40   m , which is selected as a moderate tactical separation within the commonly reported baseline separation range (typically 30–80 m) in low-altitude UAV conflict management studies, and lies between representative fixed baselines (e.g., 30 m and 50 m) frequently used in simulations to balance safety margin and operational burden [33]. The system collision risk conditions is as follows:
i , j   d i j ( t ) < D s  
That is, when the distance between any two sampling points is less than D s , a potential collision risk is deemed to exist. At each time step, 1000 independent Monte Carlo trials are conducted to estimate the collision probability for that time step:
P c ( t ) = N u m b e r   o f   c o l l i s i o n s   d e t e c t e d 1000
In order to make the detection results more accurate, multi-time step joint detection is used to combine the collision probabilities of the next k time steps:
P c total ( t ) = 1 t = 1 k ( 1 P c ( t ) )
Set the threshold P t = 0.1 . Here, P t is an alerting (decision) threshold for triggering collision warning and avoidance rather than a regulatory target probability; in detect-and-avoid practice, such thresholds are chosen by trading off missed detections and nuisance alerts (often characterized via SOC-type analyses relating alert rate to residual risk). In addition, since P c total ( t ) aggregates risk over the next k steps in Equation (13), P t = 0.1   corresponds to a smaller per-step risk level, and together with 1000 Monte Carlo trials per step it provides a more stable online trigger under finite-sample estimation noise. If P c total ( t ) > 0.1 , determine that the system is at risk of collision, trigger a collision warning, and execute obstacle avoidance.
Existing collision detection models can be broadly grouped into (i) deterministic separation or geometry-based checks that assess conflicts on nominal predicted trajectories, (ii) velocity-space/geometric formulations (e.g., VO-type methods) that characterize conflicts efficiently in the velocity domain, and (iii) probabilistic risk models that typically assume an explicit sensing/navigation error model or bounded error sets. Deterministic/geometric checks are computationally efficient but can underestimate risk when prediction uncertainty is significant unless conservative buffers are introduced. Probabilistic models provide risk quantification but often depend on how uncertainty is parameterized. In contrast, the proposed TDC explicitly converts trajectory prediction residual statistics into a 3D uncertainty envelope and estimates conflict risk via Monte Carlo sampling inside the dispersion cones, producing a collision-probability output that aligns with the warning/decision threshold used by the downstream avoidance module. Therefore, TDC can be viewed as a lightweight probabilistic layer bridging trajectory prediction uncertainty and tactical-level collision warning, and it is complementary to the geometric constraints used later in the VO-MPC controller.

2.3. Collision Avoidance Method Based on Velocity Obstacle-Model Predictive Control (VO-MPC)

2.3.1. Theoretical Basis and Problem Modeling

To ensure safe collaborative flight between manned aircraft and UAVs in complex airspace, this study proposes a collision avoidance method integrating the velocity obstacle (VO) approach with model predictive control (MPC), termed VO-MPC. The VO technique identifies potential collision zones, while MPC optimizes control inputs, making this method highly effective for dynamic environments. Figure 3 illustrates the implementation process of this approach.

2.3.2. UAV Dynamics Model

The state of a UAV consists of its position and velocity. The dynamics model is represented by a nonlinear discrete-time system:
x A k + 1 = g A ( x A k , u A k ) + ω A k
Among these, x A = [ p A T , v A T ] T denotes the state vector composed of position and velocity, and u A is the control input vector. k denotes the k th time step of the UAV, and g A is the nonlinear discrete-time dynamic model of the UAV.
Considering the Gaussian process noise of velocity ω A N ( 0 , W i ) , where the covariance matrix W i is a diagonal matrix.

2.3.3. Velocity Obstacle Model Construction

The VO method is a mature collision detection technique that identifies potential collision risks by calculating the projection area of obstacles in the velocity space [34]. Suppose that UAV A is located at p A , with a velocity of v A   and a radius of r A ; manned aircraft B is located at p B , with a velocity of v B and a radius of r B . The Minkowski sum of the two aircraft is defined as:
O A O B = { m A + m B | m A O A , m B O B }  
Among them, O A = { p A + μ r A | μ 2 1 } , O B = { p B + μ r B | μ 2 1 } . The relative velocity v A B = v A v B , and the collision cone C A B is expressed as:
C A B = { v A B | ( O A O B ) λ ( v A B ) }
Among them, λ ( v A B ) = { p A + λ v A B | λ 0 } . The velocity obstacle V A B is:
V A B = { v A | ( v A v B ) C A B } = v B + C A B
For object A, any velocity v A V A B will result in a collision, so the composite obstacle velocity and collision cone are:
V A = B A V A B
C A = B A C A B

2.3.4. VO-MPC Optimization Framework

VO-MPC generates collision avoidance trajectories by solving optimization problems. The objective function comprehensively considers trajectory tracking error and control input penalties:
J = k = 0 N 1   [ p k p r , k Q 2 + ν k ν r , k Q 2 + u A k R 2 ]     = k = 0 N 1   [ x A k x r , A k Q 2 + u A k R 2 ]
Among them, x A k = [ p A k T ν A k T ] T denotes the state vector of agent A at time k, where p A k and ν A k are the actual position and velocity of agent A at time k, respectively; x r , A k = [ p r , A k T ν r , A k T ] T represents the reference state vector for agent A at time k, where p r , A k and ν r , A k are the target position and velocity of the reference trajectory for agent A at time k, respectively. Q and R are weighting matrices that adjust the weights of state error (position and velocity) and control input, respectively; N is the prediction time domain length. The constraints include:
Dynamic constraints:
x A k + 1 = g ( x A k , u A k )
x ̱ A k + 1 x A k + 1 x ̱ A k + 1
Among them, x ̱ A , x ̱ A are the lower and upper limits of the state variables.
Collision probability constraints:
Considering noise   v A k N ( v ^ A k , W i ) , the chance constraint is:
Pr ( v A B k + 1 C A k + 1 ) 1 δ A
Lemma 1
(Deterministic reformulation of a Gaussian chance constraint). Let X ( t ) N ( μ ( t ) , Σ ( t ) ) be a multivariate Gaussian random variable. For any vector  A  and scalar  b , the chance constraint
P r ( A T X ( t ) < b ) φ
is equivalent to the deterministic linear constraint
A T μ ( t ) b η
where
η = 2   A T Σ ( t ) A     e r f 1 ( 1 2 φ )
and  e r f ( x ) = 2 π 0 x e x p ( s 2 )   d s .
By using Lemma 1, the probability constraint is transformed into a deterministic linear constraint:
N A B , 1 k T v ^ A k N A B , 1 k T v B k κ A B , 1
N A B , 2 k T v ^ A k N A B , 2 k T v B k κ A B , 2
where κ A B , 1 = 2 N A B , 1 k T W i N A B , 1 k e r f 1 ( 1 2 δ A B , 1 ) , κ A B , 2 = 2 N A B , 2 k T W i N A B , 2 k e r f 1 ( 1 2 δ A B , 2 ) .
Position distance constraint:
Ensure that the minimum distance over the next N time steps is greater than the safety threshold d min :
p A p B k 2 d { 1,2 , , N } m i n  
Control input and boundary constraints:
u ̱ A u A u ̱ A , p min p ( t ) p max , v min v ( t ) v max
For reproducibility, we report the VO-MPC implementation settings as follows. The MPC state is x = [px, py, pz, vx, vy, vz]ᵀ and the control is u = [ax, ay, az]ᵀ. We use Δt = 0.1 s and horizon N = 20 (2.0 s). The weighting matrices are Qmpc = diag (1000, 1000, 1000, 100, 100, 100) and Rmpc = 10−6 I3, with an additional vertical penalty wz = 100. Control bounds are u ∈ [−100, 100] per axis. The VO activation range is 75 m and the risk threshold is δ = 0.1. The resulting nonlinear program is solved using CasADi + IPOPT (maxiter = 1000, tol = 10−8, objtol = 10−6).

2.3.5. Deterministic VO-MPC Formulation and Solution

At each time step t, VO-MPC solves the following optimization problem to obtain the control input:
m i n x A 1 : N , u A 0 : N 1 k = 0 N 1 x A k x r e f , A k Q + u A k R
Subject to the above constraints, the optimal control sequence u A * = [ ( u A * 0 ) T ( u A * 1 ) T ( u A * ( N 1 ) ) T ] T is generated, and the first control input u A * 0 is executed. By this method, the probabilistic constraints can be converted into deterministic linear constraints, which facilitates the solution.

2.4. Fusion Logic Between EKF-LSTM Prediction and VO-Based Avoidance

The proposed safety-assurance pipeline couples trajectory prediction, probabilistic risk assessment, and tactical-level avoidance in a closed loop. While Section 2.1, Section 2.2 and Section 2.3 introduce the EKF-LSTM predictor, the TDC-based collision risk assessment, and the VO-MPC controller, the information flow between these modules was not explicitly described. This section therefore summarizes how EKF-LSTM prediction is fused with VO-based avoidance during online operation.
At each time step t , the onboard navigation system provides measurements of each aircraft state (position and velocity). The EKF-LSTM module uses a window of historical trajectory states to generate a one-step-ahead state prediction x ^ t t 1 and then produce the updated (filtered) state estimate after correction. The resulting predicted trajectory over the next few steps constitutes the nominal future motion used by the downstream collision-risk evaluation. Meanwhile, EKF-LSTM prediction residuals provide an empirical description of forecast uncertainty, which is later leveraged by the risk assessment module.
Based on the predicted nominal trajectories, the TDC method constructs a three-dimensional uncertainty envelope for each aircraft and performs Monte Carlo sampling inside the dispersion cones to estimate the collision probability over a finite look-ahead window. The resulting risk value is compared with the alerting threshold δ ; when the estimated collision probability exceeds δ , a potential conflict is declared and the avoidance controller is triggered. In this way, the EKF-LSTM predictor does not directly command avoidance actions; instead, it provides both the nominal motion forecast and the uncertainty evidence that enable risk-aware decision triggering.
Once activated, the VO-MPC controller uses the latest filtered state estimate as the initial condition for optimization, improving resilience against measurement noise. The other aircraft is treated as a moving obstacle, and the relative position and velocity derived from the most recent state estimates are used to construct the corresponding velocity obstacle region in the velocity space. The MPC optimization then searches for a control sequence that maintains trajectory tracking while enforcing VO-based collision-free constraints together with the vehicle dynamics and the probabilistic/deterministic constraints defined in Section 2.3. The first control input of the optimal sequence is applied, and the overall procedure repeats at the next time step, forming an iterative loop.

3. Results

3.1. Flight Trajectory Prediction Results

3.1.1. Dataset and Preprocessing

The dataset utilized in this study for trajectory prediction in manned–unmanned aircraft collaboration was constructed from actual flight data of a specific manned aircraft model and simulation data from a six-degree-of-freedom aircraft model. The dataset covers five representative maneuver types—S-shaped maneuver, dive, roll, circling, and level flight—with 500 complete trajectories for each maneuver. Each training sample is generated using a sliding window with an input history length of 10 time steps. Using this process, a total of 285,396 samples were obtained. Data preprocessing involved cleaning and Min–Max normalization (scaling to [0, 1]) to eliminate dimensional differences. Following model prediction, denormalization was applied to restore the predicted values to their original scale. To ensure the model’s generalization capability, the dataset was split into training, validation, and test sets, comprising 70%, 15%, and 15% of the samples, respectively. This split follows common practice in supervised learning for trajectory prediction, aiming to balance sufficient training data for learning representative maneuver patterns, an independent validation subset for model selection and hyper-parameter tuning, and a sufficiently large held-out test subset for stable and unbiased performance reporting. If other reasonable splits are adopted, the main effect is a trade-off between the amount of training data and the statistical stability of validation/test evaluation: allocating more data to training may slightly improve fitted accuracy but reduces validation/test reliability, whereas allocating more data to testing strengthens evaluation reliability but may marginally reduce training performance due to fewer training samples.

3.1.2. Introduction to Evaluation Metrics

Evaluation metrics are critical for assessing the performance of prediction models, facilitating the comparison and selection of the optimal model, detecting overfitting and underfitting, and guiding optimization strategies. They ensure consistency and comparability in evaluations while supporting decision-making in practical applications, such as UAV navigation and control. In this study, Root Mean Squared Error (RMSE), Average Displacement Error (ADE), and Final Displacement Error (FDE) are adopted as evaluation metrics for the model.
RMSE quantifies the square root of the mean of squared prediction errors, thereby imposing a greater penalty on larger deviations. This metric is particularly well-suited for tasks demanding high precision, such as trajectory prediction in aerial systems. A lower RMSE value signifies reduced prediction errors and, consequently, enhanced model performance. The mathematical expression for RMSE is:
RMSE   =   1 N i = 1 N ( x ^ i x i ) 2
ADE assesses the overall deviation between the predicted and actual trajectories by calculating the average Euclidean distance across all time steps in the prediction horizon. This metric comprehensively reflects the model’s prediction accuracy over the entire trajectory. Its mathematical expression is:
ADE = 1 N i = 1 N x ^ i x i
FDE measures the Euclidean distance between the predicted and actual positions at the final time step, serving as an indicator of the model’s accuracy at the trajectory’s endpoint. Its mathematical expression is:
FDE = x ^ N x N

3.1.3. Comparison and Analysis of Experimental Results

The experimental setup included various flight scenarios (such as level flight, S-shaped maneuver flight, etc.). The prediction task used a window of 10 time steps, and the evaluation metrics included RMSE, ADE, FDE. The results are shown in Table 2:
The experimental results demonstrate that the EKF-LSTM fusion model outperforms standalone methods across all evaluated metrics, achieving reductions of approximately 21.2%, 50.7%, and 24.9% in ADE, FDE, and RMSE, respectively, compared to the LSTM alone. To more intuitively verify the prediction performance of the EKF-LSTM model, we plot the three-dimensional diagrams of the predicted trajectories and actual trajectories of the four models under various typical flight states. Under approximately linear and stable horizontal flight (Figure 4), all models yield marginally differing predictions. However, notable X-direction errors emerge for CNN and EKF, stemming from their inherent limitations: CNN lacks long-term temporal modeling capacity, while EKF is constrained by linearization assumptions.
As illustrated in Figure 5, Figure 6, Figure 7 and Figure 8, significant disparities in predictive performance are evident across different model types for complex flight states, including circling flight (Figure 5), S-shaped maneuvering flight (Figure 6), dive flight (Figure 7), and roll flight (Figure 8). These maneuvers are characterized by stronger nonlinearity and higher dynamics than level flight, which places greater demands on both temporal modeling and state estimation.
In circling flight (Figure 5), the aircraft follows a continuously curved path. The CNN model shows a large deviation from the actual trajectory due to its insufficient ability to model long-term temporal dependence. The LSTM model follows the turning trend better and captures the curved pattern, but it still exhibits a certain degree of mismatch over the horizon. The EKF model performs well in maintaining the overall turning shape; however, constrained by the linearization assumption, it may present a noticeable lag/offset along the trajectory. In contrast, the EKF-LSTM model yields the closest trajectory to the ground truth throughout the turn.
For the S-shaped maneuver (Figure 6), the trajectory contains successive turns with an evident direction switch. The LSTM model captures the overall “S” trend, yet local deviations can be observed near the turning points. Compared with LSTM, EKF-LSTM further reduces these deviations, producing a trajectory that aligns more consistently with the ground truth across both turns and the transition region. Meanwhile, CNN shows the largest mismatch around the direction-change segments, and EKF may exhibit lag/offset when the trajectory changes direction rapidly.
During dive flight (Figure 7), the motion involves a pronounced altitude change and strong 3D coupling. The LSTM model provides a reasonable partial fit of the dive trend, but it may deviate in the steep descent segment due to the lack of real-time correction. The EKF-LSTM model remains the closest to the actual trajectory throughout the entire dive process, demonstrating the best overall performance in nonlinear scenarios. CNN shows significant deviation under this maneuver, while EKF also exhibit mismatch around the transition segment under rapidly changing dynamics.
In roll flight (Figure 8), the trajectory contains a short transition segment, where prediction errors are most noticeable. The EKF prediction is consistent with the overall trend and aligns closely with the ground-truth trajectory, although a visible deviation can be observed around the transition segment. The CNN prediction exhibits the largest error, producing an evident detour and failing to remain on the true 3D path. The LSTM prediction generally follows the overall trajectory but shows a local mismatch near the transition. In contrast, the EKF-LSTM prediction almost overlaps with the ground truth throughout the entire roll maneuver and further reduces the transition deviation, demonstrating the most stable and accurate performance in this highly dynamic scenario.
Comparative analysis reveals that the EKF-LSTM model exhibits superior accuracy across diverse dynamic scenarios, particularly in complex flight phases such as dives and rolls. In contrast, standalone methods struggle in these phases due to their limited ability to capture long-term temporal dependencies or manage significant prediction biases during dynamic maneuvers. By integrating the LSTM’s capability to model nonlinear sequences with the EKF’s resilience, the proposed model delivers stable, accurate, and interpretable predictions, making it well-suited for trajectory forecasting in challenging aerial environments.

3.2. Collision Detection and Avoidance Results

3.2.1. Collision Detection Based on Trajectory Dispersion Cones

In this section, we evaluate a representative two-aircraft manned–unmanned collaborative flight scenario to validate the complete pipeline The trajectories of UAV A and manned aircraft B during the potential collision phase are selected as the objects of study. First, the root mean square error (RMSE) is calculated for each time step based on the predicted three-dimensional trajectory, and a three-dimensional trajectory dispersion cone model is constructed using the RMSE, as shown in Figure 9. The trajectory dispersion cone model fully considers the uncertainty of the prediction and can clearly describe the movement range of the aircraft and their deviation distribution.
Building on the trajectory dispersion cone model, collision detection and risk assessment were conducted by calculating the Euclidean distance between points within the dispersion cones of UAV A and manned aircraft B. In a three-dimensional flight scenario, UAV A maintained a level flight phase while manned aircraft B performed an S-shaped maneuver, introducing a potential collision risk. The predicted three-dimensional flight trajectories, generated using the EKF-LSTM fusion method, are presented in Figure 10.
In the simulation, a collision probability threshold of 0.1 was established. This value indicates that if the collision probability exceeds 0.1 at any time step, a potential collision risk is detected, triggering a collision warning. The threshold was chosen to reflect the aircraft’s operational environment—such as altitude, speed, and surrounding traffic—ensuring sensitive detection of collision risks while minimizing false alarms that might arise from an overly conservative threshold. This approach enhances safety without sacrificing system stability. Figure 11 illustrates the trend of collision probability across time steps, highlighting the threshold’s effectiveness in identifying critical risk moments.
Collision probability fluctuations are directly driven by the spatial relationship between aircraft, specifically their separation distance and the overlap of trajectory dispersion cones. From the 2nd to 3rd time steps, the UAV’s high-speed flight expands its trajectory cone, increasing overlap with the manned aircraft’s cone and elevating collision risk. As the aircraft subsequently move apart, reduced overlap lowers collision probability accordingly. Between the 22th and 25th time steps, their re-approach causes maximum cone overlap and a renewed risk increase. Outside these intervals, collision probability remains low (mostly near zero), indicating sustained safe separation with no significant convergence trend. Flight conflict experiments show close alignment between model predictions and actual outcomes, validating the trajectory dispersion cone-based collision detection model’s effectiveness in accurately identifying potential risks. This method demonstrates resilience in complex environments, providing a reliable basis for collision avoidance decision-making.

3.2.2. Collision Avoidance Based on VO-MPC

To comprehensively evaluate the performance of the VO-MPC method proposed in this paper, its performance is compared with that of the traditional MPC method under different noise levels. The core performance metrics of the two methods are compared under low-noise (σ = 0.5 m), medium-noise (σ = 1.0 m), and high-noise (σ = 2.0 m) conditions. Here, the noise level σ   denotes the standard deviation of additive Gaussian position measurement noise used to emulate imperfect sensing/communication. Specifically, the position observation is generated as z ( t ) = p ( t ) + v ( t ) , where v ( t ) N ( 0 , σ 2 I 3 ) . The noisy observations are fed to the prediction/risk module at the measurement-update instants (with Δ t = 0.1     s in our simulations). The primary metrics include minimum distance (the shortest horizontal distance between aircraft), collision avoidance success rate (the proportion of aircraft that safely pass each other), and average collision probability (a measure of collision risk probability). These metrics evaluate the model’s overall success rate from different perspectives. The experimental results are shown in Figure 12.
The simulation results presented in Table 3 illustrate that the VO-MPC method introduced in this study outperforms traditional Model Predictive Control (MPC) methods in complex airspace environments, particularly in enhancing safety across varying noise levels. Under low-noise conditions, VO-MPC achieves a minimum separation distance of 15.6 m, marking a 27% improvement over traditional MPC. The collision avoidance success rate reaches 99.8%, an 8.6% increase, while the average collision probability drops to 0.04%, reflecting a 66.7% reduction. In medium-noise scenarios, VO-MPC sustains stable performance with a minimum distance of 14.7 m and a collision avoidance success rate of 96.5%, reducing the average collision probability to 27.7% of that observed with traditional MPC. Similarly, under high-noise conditions, the method maintains a minimum distance of 12.4 m and a success rate of 89.7%, with the collision probability reduced to 34.2% of the traditional MPC value. This approach excels in capturing dynamic interactions between aircraft and environmental shifts, demonstrating exceptional adaptability in high-density airspace and intricate obstacle settings. Notably, VO-MPC’s ability to mitigate collision risks and enhance flight path safety margins, even in challenging high-noise contexts, highlights its potential to substantially elevate flight safety standards in operational environments.

4. Conclusions

This paper presented a unified safety-assurance framework for manned–unmanned collaborative flight by integrating (i) an EKF-LSTM predictor for intent-aware yet physically consistent trajectory forecasting, (ii) a trajectory dispersion cone (TDC) model for probabilistic conflict assessment, and (iii) a VO-MPC controller for collision avoidance under uncertainty. The proposed pipeline explicitly connects prediction, risk quantification, and control, enabling the downstream avoidance module to react not only to nominal future states but also to the estimated uncertainty envelope inferred from prediction residuals.
From the trajectory forecasting experiments under representative maneuvers, the EKF-LSTM fusion consistently outperformed standalone predictors and achieved notable reductions in ADE, FDE, and RMSE compared with the LSTM baseline.
These improvements indicate that combining data-driven temporal modeling with model-based filtering can better accommodate nonlinear flight dynamics while maintaining physically plausible state evolution. Building upon these predictions, the TDC-based Monte Carlo risk evaluation provided a direct mechanism to translate prediction errors into probabilistic collision estimates, which supports the timely triggering of avoidance actions and avoids relying solely on deterministic separation checks.
For collision avoidance, the VO-MPC strategy increased safety margins and remained effective across different noise levels. In the reported experiments, VO-MPC improved minimum separation and raised the avoidance success rate from 91.2% to 99.8% in low-noise settings, while reducing the mean collision probability by 66.7%; it also maintained lower collision risk than conventional MPC in medium- and high-noise cases.
These results suggest that incorporating velocity-obstacle constraints into the MPC formulation can provide more reliable tactical-level avoidance decisions in uncertain and dynamically changing airspace.
Despite these encouraging results, the current study focuses on pairwise encounter scenarios and is evaluated primarily in simulation. Future work will extend the proposed pipeline to multi-aircraft cooperative settings by developing scalable conflict-detection and resolution mechanisms (e.g., coordination and prioritization among multiple agents) while preserving real-time feasibility. We will also investigate more realistic uncertainty representations and perform sensitivity analyses with respect to key safety parameters. In addition, we plan hardware-in-the-loop and flight-test validation, together with computational profiling on representative onboard hardware, to quantify real-time performance and deployment readiness.

Author Contributions

Conceptualization, X.C. and X.P.; methodology, X.C. and X.P.; software, Y.Z.; validation, X.X. and Y.Z.; formal analysis, Y.Z.; investigation, X.P.; resources, X.C.; writing—original draft preparation, X.P. and Y.Z.; writing—review and editing, X.C. and J.Y.; visualization, Y.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Data can be requested from the corresponding author with a reasonable request.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
EKFExtended Kalman Filter
LSTMLong Short-Term Memory
TDCTrajectory Dispersion Cone
VO-MPCVelocity Obstacle-Model Predictive Control
RMSERoot Mean Squared Error
ADEAverage Displacement Error
FDEFinal Displacement Error
UAVUnmanned aircraft Vehicle
CNNConvolutional Neural Network
KFKalman Filter
VOVelocity Obstacle

References

  1. Javed, S.; Hassan, A.; Ahmad, R.; Ahmed, W.; Ahmed, R.; Saadat, A. State-of-the-Art and Future Research Challenges in UAV Swarms. IEEE Internet Things J. 2024, 11, 19023–19045. [Google Scholar] [CrossRef]
  2. Xu, Y.; Xue, X.; Sun, Z.; Gu, W.; Cui, L.; Jin, Y.; Lan, Y. Joint path planning and scheduling for vehicle-assisted multiple Unmanned Aerial Systems plant protection operation. Comput. Electron. Agric. 2022, 200, 107221. [Google Scholar] [CrossRef]
  3. Sarkar, N.I.; Gul, S. Artificial Intelligence-Based Autonomous UAV Networks: A Survey. Drones 2023, 7, 322. [Google Scholar] [CrossRef]
  4. Delgado-Aguilera Jurado, R.; Vera Reina, B.J.; Zamarreño Suárez, M.; Pérez Moreno, F.; Gómez Arnaldo, C.; Arnaldo Valdés, R.M. AI-Driven Real-Time Interference Detection in Manned-Unmanned Aircraft Communications: Concept of Operations and Integration. Aerosp. Sci. Technol. 2026, 168, 110722. [Google Scholar] [CrossRef]
  5. Guan, X.M.; Lyu, R.L.; Shi, H.X.; Chen, J. A survey of safety separation management and collision avoidance approaches of civil UAS operating in integration national airspace system. Chin. J. Aeronaut. 2020, 33, 2851–2863. [Google Scholar] [CrossRef]
  6. Tang, J.; Yang, S.; Chen, S.; Li, Q.; Yin, Q.; Zhou, S. Research on UAV Autonomous Trajectory Planning Based on Prediction Information in Crowded Unknown Dynamic Environment. Sensors 2025, 25, 7343. [Google Scholar] [CrossRef]
  7. Huang, S.; Teo, R.S.H.; Tan, K.K. Collision Avoidance of Multi Unmanned Aerial Vehicles: A Review. Annu. Rev. Control 2019, 48, 147–164. [Google Scholar] [CrossRef]
  8. He, Y. Mission-driven autonomous perception and fusion based on UAV swarm. Chin. J. Aeronaut. 2020, 33, 2831–2834. [Google Scholar] [CrossRef]
  9. Luo, L.B.; Wang, X.Y.; Ma, J.F.; Ong, Y.S. GrpAvoid: Multigroup collision-avoidance control and optimization for UAV swarm. IEEE Trans. Cybern. 2023, 53, 1776–1789. [Google Scholar] [CrossRef]
  10. Shi, S.S.; Jiang, L.; Dai, D.X.; Schiele, B. MTR++: Multi-agent motion prediction with symmetric scene modeling and guided intention querying. IEEE Trans. Pattern Anal. Mach. Intell. 2024, 46, 3955–3971. [Google Scholar] [CrossRef]
  11. Zhong, J.; Li, M.; Chen, Y.; Wei, Z.; Yang, F.; Shen, H. A safer vision-based autonomous planning system for quadrotor UAVs with dynamic obstacle trajectory prediction and its application with LLMs. In Proceedings of the 2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW), Waikoloa, HI, USA, 1–6 January 2024; pp. 920–929. [Google Scholar] [CrossRef]
  12. Zhou, Y.; Tang, D.; Zhou, H.; Xiang, X. Moving target geolocation and trajectory prediction using a fixed-wing UAV in cluttered environments. Remote Sens. 2025, 17, 969. [Google Scholar] [CrossRef]
  13. Xu, Z.; Jin, H.; Han, X.; Shen, H.; Shimada, K. Intent Prediction-Driven Model Predictive Control for UAV Planning and Navigation in Dynamic Environments. IEEE Robot. Autom. Lett. 2025, 10, 4946–4953. [Google Scholar] [CrossRef]
  14. Shukla, P.; Shukla, S.; Singh, A.K. Trajectory-prediction techniques for unmanned aerial vehicles (UAVs): A comprehensive survey. IEEE Commun. Surv. Tutor. 2025, 27, 1867–1910. [Google Scholar] [CrossRef]
  15. Kang, C.; Woolsey, C.A. Model-based path prediction for fixed-wing unmanned aircraft using pose estimates. Aerosp. Sci. Technol. 2020, 105, 106030. [Google Scholar] [CrossRef]
  16. Sahbon, N.; Welcer, M. Comparison of Two Aerodynamic Models for Projectile Trajectory Simulation. Aerospace 2024, 11, 189. [Google Scholar] [CrossRef]
  17. Ma, M.; Fu, L.; Zhai, Z.; Sun, R.B. Transformer Based Kalman Filter with EM Algorithm for Time Series Prediction and Anomaly Detection of Complex Systems. Measurement 2024, 229, 114378. [Google Scholar] [CrossRef]
  18. Hematulin, W.; Kamsing, P.; Torteeka, P.; Somjit, T.; Phisannupawong, T.; Jarawan, T. Trajectory Planning for Multiple UAVs and Hierarchical Collision Avoidance Based on Nonlinear Kalman Filters. Drones 2023, 7, 142. [Google Scholar] [CrossRef]
  19. Li, Z.; Sun, H.; Xiao, D.; Xie, H. Hybrid Kalman recurrent neural network for vehicle trajectory prediction. IEEE Trans. Instrum. Meas. 2024, 73, 2519814. [Google Scholar] [CrossRef]
  20. Yoon, S.; Jang, D.; Yoon, H.; Park, T.; Lee, K. GRU-Based Deep Learning Framework for Real-Time, Accurate, and Scalable UAV Trajectory Prediction. Drones 2025, 9, 142. [Google Scholar] [CrossRef]
  21. Li, J.; Yang, L.; Chen, Y.; Jin, Y. MFAN: Mixing Feature Attention Network for trajectory prediction. Pattern Recogn. 2024, 146, 109997. [Google Scholar] [CrossRef]
  22. Shi, Z.; Zhang, J.; Shi, G.; Ji, L.; Wang, D.; Wu, Y. Design of a UAV Trajectory Prediction System Based on Multi-Flight Modes. Drones 2024, 8, 255. [Google Scholar] [CrossRef]
  23. Hamissi, A.; Dhraief, A.; Sliman, L. A Comprehensive Survey on Conflict Detection and Resolution in Unmanned Aircraft System Traffic Management. IEEE Trans. Intell. Transp. Syst. 2025, 26, 1395–1418. [Google Scholar] [CrossRef]
  24. Opromolla, R.; Fasano, G. Visual-based obstacle detection and tracking, and conflict detection for small UAS sense and avoid. Aerosp. Sci. Technol. 2021, 119, 107167. [Google Scholar] [CrossRef]
  25. Zou, Y.; Zhang, H.; Zhong, G.; Liu, H.; Feng, D. Collision Probability Estimation for Small Unmanned Aircraft Systems. Reliab. Eng. Syst. Saf. 2021, 213, 107619. [Google Scholar] [CrossRef]
  26. Zou, Y.; Zhang, H.; Feng, D.; Liu, H.; Zhong, G. Fast Collision Detection for Small Unmanned Aircraft Systems in Urban Airspace. IEEE Access 2021, 9, 16630–16641. [Google Scholar] [CrossRef]
  27. Tang, J.; Lao, S.; Wan, Y. Systematic Review of Collision-Avoidance Approaches for Unmanned Aerial Vehicles. IEEE Syst. J. 2022, 16, 4356–4367. [Google Scholar] [CrossRef]
  28. Wakabayashi, T.; Nunoya, Y.; Suzuki, S. Dynamic obstacle avoidance of multi-rotor UAV using chance constrained MPC. In Proceedings of the 21st International Conference on Control, Automation and Systems (ICCAS), Jeju, Republic of Korea, 12–15 October 2021; pp. 412–417. [Google Scholar] [CrossRef]
  29. Zhang, X.; Ma, J.; Cheng, Z.; Huang, S.; Lee, T.H. Receding Horizon Motion Planning for Multi-Agent Systems: A Velocity Obstacle Based Probabilistic Method. arXiv 2021, arXiv:2103.12968. [Google Scholar] [CrossRef]
  30. Wang, X.; Gursoy, M.C.; Erpek, T.; Sagduyu, Y.E. Learning-Based UAV Path Planning for Data Collection With Integrated Collision Avoidance. IEEE Internet Things J. 2022, 9, 16663–16676. [Google Scholar] [CrossRef]
  31. Jiang, W.; Lyu, Y.X.; Li, Y.F.; Guo, Y.C.; Zhang, W.G. UAV Path Planning and Collision Avoidance in 3D Environments Based on POMDP and Improved Grey Wolf Optimizer. Aerosp. Sci. Technol. 2022, 121, 107314. [Google Scholar] [CrossRef]
  32. Chen, S.F.; Chen, B.H.; Shu, P.; Wang, Z.S.; Chen, C.B. Real-Time Unmanned Aerial Vehicle Flight Path Prediction Using a Bi-Directional Long Short-Term Memory Network with Error Compensation. J. Comput. Des. Eng. 2023, 10, 16–35. [Google Scholar] [CrossRef]
  33. Cao, Y.; Zhao, G.; Wu, Y.; Wang, H.; Sun, J.; Zhang, L. Dynamic Separation Standards for Multi-Category UAV Operations. Aerospace 2025, 12, 1064. [Google Scholar] [CrossRef]
  34. Cheng, Z.X.; Chen, P.F.; Mou, J.M.; Chen, L.Y. Novel Collision Risk Measurement Method for Multi-Ship Encounters via Velocity Obstacles and Temporal Proximity. Ocean Eng. 2024, 302, 117585. [Google Scholar] [CrossRef]
Figure 1. Architecture of Manned–Unmanned Aircraft collaborative flight system based on ground command center.
Figure 1. Architecture of Manned–Unmanned Aircraft collaborative flight system based on ground command center.
Drones 10 00089 g001
Figure 2. Principle diagram of EKF-LSTM fusion method.
Figure 2. Principle diagram of EKF-LSTM fusion method.
Drones 10 00089 g002
Figure 3. VO-MPC collision avoidance process diagram.
Figure 3. VO-MPC collision avoidance process diagram.
Drones 10 00089 g003
Figure 4. (ad) show the trajectory prediction results of the EKF, CNN, LSTM, and EKF-LSTM models, respectively, compared with the actual trajectory during level flight, which features approximately steady motion with mild acceleration.
Figure 4. (ad) show the trajectory prediction results of the EKF, CNN, LSTM, and EKF-LSTM models, respectively, compared with the actual trajectory during level flight, which features approximately steady motion with mild acceleration.
Drones 10 00089 g004
Figure 5. (ad) show the trajectory prediction results of the EKF, CNN, LSTM, and EKF-LSTM models, respectively, compared with the actual trajectory during circling flight, which features sustained curvature and lateral acceleration.
Figure 5. (ad) show the trajectory prediction results of the EKF, CNN, LSTM, and EKF-LSTM models, respectively, compared with the actual trajectory during circling flight, which features sustained curvature and lateral acceleration.
Drones 10 00089 g005
Figure 6. (ad) show the trajectory prediction results of the EKF, CNN, LSTM, and EKF-LSTM models, respectively, compared with the actual trajectory during S-shaped maneuver flight, which features alternating turns with curvature reversal at turning points.
Figure 6. (ad) show the trajectory prediction results of the EKF, CNN, LSTM, and EKF-LSTM models, respectively, compared with the actual trajectory during S-shaped maneuver flight, which features alternating turns with curvature reversal at turning points.
Drones 10 00089 g006
Figure 7. (ad) show the trajectory prediction results of the EKF, CNN, LSTM, and EKF-LSTM models, respectively, compared with the actual trajectory during the dive flight, which features pronounced vertical-rate change and strong 3D coupling.
Figure 7. (ad) show the trajectory prediction results of the EKF, CNN, LSTM, and EKF-LSTM models, respectively, compared with the actual trajectory during the dive flight, which features pronounced vertical-rate change and strong 3D coupling.
Drones 10 00089 g007
Figure 8. (ad) show the trajectory prediction results of the EKF, CNN, LSTM, and EKF-LSTM models, respectively, compared with the actual trajectory during roll flight, which features rapid dynamic variation.
Figure 8. (ad) show the trajectory prediction results of the EKF, CNN, LSTM, and EKF-LSTM models, respectively, compared with the actual trajectory during roll flight, which features rapid dynamic variation.
Drones 10 00089 g008
Figure 9. Three-dimensional TDC model of Manned Aircraft and Unmanned Aircraft. Light red indicates the trajectory dispersion cone of the manned aircraft, and light blue indicates that of the unmanned aircraft.
Figure 9. Three-dimensional TDC model of Manned Aircraft and Unmanned Aircraft. Light red indicates the trajectory dispersion cone of the manned aircraft, and light blue indicates that of the unmanned aircraft.
Drones 10 00089 g009
Figure 10. Predicted flight trajectories of Manned Aircraft and Unmanned Aircraft.
Figure 10. Predicted flight trajectories of Manned Aircraft and Unmanned Aircraft.
Drones 10 00089 g010
Figure 11. Distribution of collision probability over time steps. Red dots highlight the time steps when collision probability exceeds the threshold.
Figure 11. Distribution of collision probability over time steps. Red dots highlight the time steps when collision probability exceeds the threshold.
Drones 10 00089 g011
Figure 12. Unmanned Aircraft collision avoidance trajectory based on VO-MPC.
Figure 12. Unmanned Aircraft collision avoidance trajectory based on VO-MPC.
Drones 10 00089 g012
Table 1. LSTM predictor and EKF fusion filter settings used in this work.
Table 1. LSTM predictor and EKF fusion filter settings used in this work.
ModuleParameter NameSymbol/NotationSetting
LSTMInput3D position [x, y, z]
Look-back windowL10 steps
Layers2
Hidden units1000
EKFState[x, y, z, vx, vy, vz, ax, ay, az]ᵀ
Measurement matrixH[I3×3, 03×6]
Initial covarianceP0diag ([1, 1, 1, 400, 400, 400, 1, 1, 1])
Process noiseQekfdiag ([10, …, 10])
Initial measurement noiseRekf,0120 I3
Table 2. Prediction error results for EKF, CNN, LSTM, and EKF-LSTM methods.
Table 2. Prediction error results for EKF, CNN, LSTM, and EKF-LSTM methods.
Flight StatesMetricLSTMCNNEKFLSTM-EKF
S-shaped Maneuver FlightADE (m)145.79236.14249.57122.67
FDE (m)342.39773.98249.84221.28
RMSE (m)116.99180.90145.0495.75
Dive FlightADE (m)69.69295.95277.4965.06
FDE (m)80.06269.51312.1115.14
RMSE (m)57.09225.66161.9342.89
Circling FlightADE (m)59.12528.60267.3153.09
FDE (m)40.09808.91289.3330.77
RMSE (m)46.35387.17154.7539.40
Roll FlightADE (m)168.21793.43224.34113.36
FDE (m)86.10362.34223.338.24
RMSE (m)175.471251.41129.53115.06
Level FlightADE (m)45.03420.22339.8130.07
FDE (m)99.15304.55339.8144.16
RMSE (m)34.51369.51196.1930.04
AverageADE (m)97.57454.87271.7176.85
FDE (m)129.56503.86282.8863.92
RMSE (m)86.08486.93157.4964.63
Table 3. Comparison of safety performance indicators between MPC and VO-MPC under different noise conditions.
Table 3. Comparison of safety performance indicators between MPC and VO-MPC under different noise conditions.
Noise LevelMethodMinimum Distance (m)Collision Avoidance Success Rate (%)Average Collision Probability (%)
0.5 mMPC12.391.20.12
VO-MPC15.699.80.04
1.0 mMPC10.288.50.65
VO-MPC14.796.50.18
2.0 mMPC7.875.32.4
VO-MPC12.489.70.82
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Pan, X.; Chang, X.; Zhou, Y.; Xu, X.; Yan, J. Fusing Deep Learning and Predictive Control for Safe Operation of Manned–Unmanned Aircraft Systems. Drones 2026, 10, 89. https://doi.org/10.3390/drones10020089

AMA Style

Pan X, Chang X, Zhou Y, Xu X, Yan J. Fusing Deep Learning and Predictive Control for Safe Operation of Manned–Unmanned Aircraft Systems. Drones. 2026; 10(2):89. https://doi.org/10.3390/drones10020089

Chicago/Turabian Style

Pan, Xiangyu, Xiaofei Chang, Yixuan Zhou, Xinkai Xu, and Jie Yan. 2026. "Fusing Deep Learning and Predictive Control for Safe Operation of Manned–Unmanned Aircraft Systems" Drones 10, no. 2: 89. https://doi.org/10.3390/drones10020089

APA Style

Pan, X., Chang, X., Zhou, Y., Xu, X., & Yan, J. (2026). Fusing Deep Learning and Predictive Control for Safe Operation of Manned–Unmanned Aircraft Systems. Drones, 10(2), 89. https://doi.org/10.3390/drones10020089

Article Metrics

Back to TopTop