Abstract
In pursuit–evasion scenarios, the pursuer typically possesses a lethal zone. If the evader effectively utilizes perceptual information, they can narrowly escape the lethal zone while minimizing energy consumption, thereby avoiding excessive and unnecessary maneuvers. Based on optimal control theory, we propose a guidance law for achieving critical safe miss distance evasion under bounded control. First, we establish the zero-effort miss (ZEM) state equation for the evader, while approximating disturbances from the pursuer. Next, we formulate an optimal control problem with energy consumption as the objective function and the ZEM at the terminal time as the terminal constraint. Subsequently, we design an iterative algorithm that combines the homotopy method and Newton’s iteration to solve the optimal control problem, applying Pontryagin’s Maximum Principle. The simulation results indicate that the designed iterative method converges effectively; through online updates, the proposed guidance law can successfully achieve critical safe miss distance evasion. Compared to programmatic maneuvering and norm differential game guidance law, this approach not only stabilizes the evader’s evasion capabilities but also significantly reduces energy consumption.
1. Introduction
In certain evasive situations, a larger miss distance is not always preferable. An excessive miss distance may result in unnecessary energy waste and hinder course recovery. For instance, when an unmanned aerial vehicle (UAV) primarily tasked with engaging a target is evading an interceptor, completing the evasion with a large miss distance may result in insufficient energy to engage the subsequent target. Critical safe miss distance evasion refers to evasive action that ensures the miss distance exceeds a critical safe value while minimizing energy consumption. Consequently, critical safe miss distance evasion represents a more efficient maneuvering strategy [1].
Traditional maneuver evasion techniques primarily consist of programmatic maneuvers such as sinusoidal maneuvers [2] and spiral maneuvers [3], which exhibit relatively low levels of proactivity. With the advancements in optimal control theory, methods utilizing detected pursuer information for active evasion have become mainstream. These methods involve the application of Pontryagin’s Maximum Principle and differential game theory to derive analytical solutions for optimal guidance laws [4,5,6]. Recently, scholars have expanded and refined research on optimal maneuver evasion strategies by incorporating high-order complex models, conditions of incomplete information, and multi-agent cooperative evasion strategies. For instance, reference [7] investigated optimal maneuver evasion strategies by establishing a high-order guidance system state-space model for interceptors under proportional guidance control, and utilizing a formula for miss distance series. Reference [8] combined guidance laws derived from complete and incomplete information models using mixed-strategy game theory to propose a new adaptive weighted differential game guidance law. Reference [9] integrated the covariance matrix analysis of Kalman filtering into differential game theory to propose an orientation-driven guidance law. Additionally, references [10,11,12] developed maneuver evasion guidance laws for evaders in active defense scenarios using differential game theory. In the study of the one-evader two-pursuer game problem, the work in reference [13] is based on ideal dynamic characteristics, whereas reference [14] adopted first-order dynamic assumptions and bounded control. Furthermore, with the development of machine learning, intelligent evasion methods have been proposed, such as acquiring evasion guidance law through deep reinforcement learning [15] and employing machine learning to identify saddle-point solutions in nonlinear optimal control problems [16,17].
The aforementioned methods provide robust guidance laws for evasion in various scenarios. However, the objective function, which aims to maximize the miss distance, often results in excessive energy consumption and over-maneuvering issues. To address this, traditional solutions propose treating the control variables as process costs, which are subsequently weighted with terminal costs to form a quadratic differential game [18]. Nevertheless, quadratic differential games yield suboptimal solutions, as they do not consider the boundaries of control variables when solving for co-state variables, and the weighting parameters for the objective function necessitate manual tuning. Consequently, building on previous optimal control theories, several studies have explored optimal guidance laws under critical safe miss distance constraints. Reference [19] derived a solution for the critical safe miss distance evasion problem in a two-dimensional plane under bounded control. However, the miss distance constraint remains a soft constraint weighted within the objective function. Reference [1] employed a similar objective function to investigate three-dimensional critical safe miss distance guidance laws and optimized the selection of the miss distance setting in the objective function using a neural network surrogate model. Reference [20] simplified the evasion maneuver problem to the timing of maneuver selection and utilized LSTM networks to predict the intercept miss distance in real-time during flight, thereby determining the optimal timing for evasion. However, this method does not analyze its optimality.
As discussed above, the current research on critical safe miss distance evasion remains incomplete, particularly regarding the optimality of energy consumption. To address this gap, this study focuses on the maneuvering evasion problem in three-dimensional space, formulating a guidance law for critical safe miss distance evasion grounded in optimal control theory. Initially, the state equation for the zero-effort miss (ZEM) in three-dimensional space is established by treating the pursuer’s maneuvers as disturbances and estimating their values. Subsequently, an optimal control problem is formulated with the control cost defined as the objective function and the ZEM at the terminal time specified as the terminal constraint. The problem is subsequently solved using Pontryagin’s Maximum Principle and iterative algorithms. Finally, the effectiveness of the proposed method is validated through comparative simulations.
This paper presents three substantial and innovative contributions. First, the consideration of bounded control enhances the realism of the modeling process. The introduction of bounded control also complicates the optimal control problem, necessitating an iterative solution approach. Second, it introduces a maneuver estimation method for the pursuer, effectively transforming the game problem into a unilateral optimal control problem, thereby significantly simplifying the derivation of the optimal solution. Third, the miss distance constraint is no longer weighted within the objective function, filling a gap in the research on critical safe miss distance evasion regarding terminal constraints. The terminal constraints are more aligned with the actual requirements of critical miss distance. This research can enrich the evasion strategies and provide valuable insights for optimal maneuvering strategies under other complex model constraints.
2. Optimal Control Problem of Critical Safe Miss Distance Evasion
2.1. Dynamics of Pursuer and Evader
In this paper, both the pursuer and the evader are modeled with constant-speed, three-degree-of-freedom vehicle dynamics. As illustrated in Figure 1, the evader’s initial position is defined as the origin O, and the OX axis is oriented along the evader’s target direction within the horizontal plane. The OY axis is vertical and points upward, and the OZ axis completes the right-handed coordinate system. Thus, we have the following:
where the subscripts denote the evader and pursuer, respectively; represents the position; is the speed; is the trajectory inclination angle; is the trajectory deflection angle; and is the gravitational acceleration. and are the normal control accelerations that are perpendicular to the velocity vector, with lying in the plane containing the velocity vector and lying in the horizontal plane. Let , and the upper limit of control is . Equation (1) is based on the aircraft dynamic model presented in reference [1], with the gravitational acceleration and control acceleration separated to emphasize their independent effects on the dynamics.
Figure 1.
Relative motion diagram of the pursuer and evader.
In Figure 1, and are the line-of-sight angles in the pitch and yaw directions of the evader, respectively. In the figure, the directions of , , , and are positive, while the directions of and are negative. In this study, the following assumptions are established:
Assumption 1.
The initial relative motion between the pursuer and evader is characterized by a head-on interception, with the line-of-sight angle exhibiting minimal variation throughout most of the engagement process.
Assumption 2.
There is no control delay for either the pursuer or the evader, and both have ideal dynamic characteristics.
Assumption 3.
The evader is aware of the pursuer’s maximum control input and can obtain real-time information on both parties’ velocities and positions.
The head-on interception refers to the pursuer approaching the evader along the direction opposite to the velocity vector of the evader. This interception method facilitates the stable tracking of the evader by the pursuer and enables the interception of a higher-speed evader. Assumptions 1 and 2 simplify the analytical process of the model, ensuring that it can be effectively solved within the constraints of limited derivations and computational methods. Assumption 3 posits that, in engagement scenarios, both parties’ aircrafts are equipped with radar, a velocity detection system, and other relevant equipment.
2.2. State Equation for Zero-Effort Miss
As shown in Figure 2, the normal control acceleration is projected onto the initial line-of-sight coordinate system , resulting in . Let denote the distance between the two entities, and represent the distance vector. Let and denote the components of the distance vector along the and axes, respectively. Then, we have the following:
Figure 2.
Projection of control acceleration in initial line-of-sight coordinate system.
In calculating the time-to-go, it is assumed that the impact of the second derivative of distance on the result is relatively small, and the following typical approach is adopted for the estimation [10]:
In the direction, with as the state variable, the state equation is established as follows:
At time , the zero-input state transition matrix is introduced:
Thus, the zero-effort miss in the direction at time is obtained as follows:
Similarly, the zero-effort miss in the direction is as follows:
Taking the derivatives of and , and combining the result with Equation (2), we obtain the following:
According to the transformation relationship between the coordinate systems and , we have the following:
where the transformation matrix function is given by the following:
Substituting the above expression into Equation (8), we obtain the following:
where the coefficients of the state equation are as follows:
Thus, we have obtained the state equation for the zero-effort miss.
2.3. Objective Function and Constraints
To transform the critical safe miss distance evasion problem into a unilateral optimal control problem, the ZEM caused by the maneuvers of the pursuer and evader is addressed separately. By integrating Equation (11), the miss distance at time is obtained:
The integral terms of the pursuer are considered as disturbances and are approximated using the following method. At , the pursuer’s strategy is assumed to minimize the absolute value of the initial ZEM by the terminal time. When , if and , according to Equation (13), it can be ensured that and , meaning that the pursuer can successfully eliminate the initial ZEM at the terminal time. When , the pursuer is unable to fully eliminate the initial ZEM. In this case, the maximum control is distributed proportionally between the two directions, i.e., setting and . Based on the above approximation method, the disturbance terms are calculated as follows:
where the saturation function sat is given by the following:
The basis for the above approximation is that, at , the pursuer’s strategy is assumed to minimize the absolute value of the initial ZEM by the terminal time. This approximation considers, on one hand, the limitations of the pursuer’s control and, on the other hand, the trend of the disturbance. Additionally, the approximation can be updated in real time during the guidance process.
Let the ZEM caused by the evader be treated as the new state variables in the optimal control problem, and the new state equation is as follows:
To minimize energy consumption in control, the objective function is defined as follows:
The energy is expressed using the energy concept commonly employed in optimal control theory [12], which is the integral of the square of the control acceleration with respect to time. Therefore, the unit of energy in this paper is .
By decoupling the constraints on the terminal ZEM in two directions, the evader’s requirements for the magnitudes of the terminal ZEM in both directions are established to be no less than . Consequently, the constraints are defined as follows:
In the aforementioned approximate model, the constraints on and utilize absolute values. However, in practical applications, to increase the energy consumption of the pursuer, it is necessary for the signs of and to match those of and at the initial time, respectively. Then, we have the following:
It is evident that when the initial zero-effort miss is zero, the sign function should not equal zero. Therefore, the sign function is defined as follows:
Moreover, the control is bounded, with the constraints given by the following:
The preceding discussion outlines the optimal control problem concerning critical safe miss distance evasion, where the constraint on the miss distance is not incorporated into the objective function but is instead treated as a hard constraint. The distinction between the maneuver for a critical safe miss and the traditional maneuver aimed at maximizing the miss distance is illustrated in Figure 3, where represents the maximized miss distance and denotes the critical safe miss distance.
Figure 3.
Schematic diagram of critical safe miss distance evasion.
3. Solution Method of the Optimal Guidance Law
3.1. Optimal Guidance Law
The aforementioned optimal control problem is solved using the Pontryagin’s Maximum Principle. The Hamiltonian is as follows:
where and are co-state variables. According to the Maximum Principle, the adjoint equations are as follows:
where and are Lagrange multipliers. The transversality condition is as follows:
The extremum condition states that for any permissible and , the following is held:
By combining the quadratic form in Equation (23) with the control boundary constraint in Equation (22), the optimal control is derived as follows:
Consequently, once the co-state variables are determined, the optimal control can be obtained, which necessitates jointly solving Equations (23)–(28).
3.2. Method for Solving Co-State Variables
As the co-state variables do not possess an analytical solution, a numerical solution method has been designed, consisting of the following steps.
Step 1: Assume and determine whether Equation (26) is satisfied.
According to Equation (25), , and the Hamiltonian is as follows:
Furthermore, according to Equation (28), ; then, the following is obtained:
Given that , the assumption holds true only if the following is true:
Then, the co-states are obtained as .
Step 2: If the assumption in Step 1 is not satisfied, we can further assume that , and determine whether Equation (26) is satisfied.
Based on the assumption, it follows that , . The first task is to determine whether is valid. If this condition is satisfied, then , and the assumption is not valid. Otherwise, the following equality constraint must be met:
For convenience in subsequent use, the expression above can be rewritten as follows:
After solving for from Equation (33), substitute and the solution into the inequality:
If inequality (34) is satisfied, then the assumption is validated, resulting in the co-states .
Step 3: If the assumption in Step 2 is not satisfied, we can further assume that , and determine whether Equation (26) is satisfied.
Similarly, based on the assumption, it follows that , . The first task is to determine whether is valid. If this condition is met, then , and the assumption is not valid. Otherwise, the following equality constraint must be satisfied:
After solving for from Equation (35), substitute and the solution into the inequality:
If inequality (36) is satisfied, then the assumption is validated, resulting in the co-states .
Step 4: If the assumption in Step 3 is not valid, then , . According to Equation (26), the following equality constraint must be satisfied:
Values of and can be derived from Equation (37).
The steps outlined above detail the process for solving the co-state variables, as illustrated in Figure 4.
Figure 4.
Process for solving co-state variables.
3.3. Iteration Method for Solving Nonlinear Equations
Equations (33), (35), and (37) are all nonlinear equations that necessitate iterative solutions. According to Equation (28), exhibits two types of variation curves, with in Figure 5 representing the inflection point of the control variable.
Figure 5.
Two variation curves of .
When solving Equation (33), the assumptions and are made. By combining Equations (13) and (28), the variation of corresponds to Case 1 when the following is obtained:
At this point, does not require iterative solving and is expressed as follows:
For Case 2, the nonlinear equation required for the iteration process in Equation (33) is given by the following:
where is defined as follows:
and can be calculated by the following:
Similarly, for Equation (35), the variation of corresponds to Case 1 when the following is obtained:
At this point, does not require iterative solving, leading to the following:
For Case 2, the nonlinear equation required for the iteration process in Equation (35) is given by the following:
Combining with Equation (28), the system of nonlinear equations required for the iteration process in Equation (37) is given by:
where
For Case 1, when , the following is obtained:
In Case 1, Equation (46) is a linear equation in terms of , and it can be solved analytically to yield the following:
For Case 2, when , the following is obtained:
where
Equations (40) and (45) each possess a single independent variable and are relatively straightforward in form, facilitating the identification of appropriate initial values. Consequently, the Newton iteration method is employed as follows:
where denotes the upper limit of the Newton iteration. Let the error tolerance be , and the convergence criterion for iteration process is as follows:
To ensure a suitable initial value for the Newton iteration, we assume that and differ only slightly. Consequently, and are small quantities that can be disregarded, enabling an analytical approximation of :
represent the initial value for the iteration of Equation (52).
To solve Equation (46), a preliminary value is initially calculated based on Equation (49). If the preliminary value satisfies the inequality for Case 1, then . If the preliminary value does not satisfy Case 1, the iteration solution is required. Due to the coupling between and , the nonlinear equations become more complex, necessitating the adoption of the Newton–homotopy iteration method [21] for the solution:
where is the number of homotopy iterations and is the upper limit for the Newton iteration. The homotopy iteration method demonstrates strong adaptability to initial values, so the purpose of iterations is to obtain a suitable initial value for the subsequent Newton iteration. The computed serves as the initial value for homotopy iteration, and the convergence criterion for Newton iteration is given by the following:
In summary, once the solution for is complete, the optimal evasion guidance law can be derived from Equation (28).
4. Simulation and Analysis
4.1. Simulation Setup
Continuous updates to the guidance law during flight are essential due to the simplifications and assumptions inherent in the ZEM model. Given that the simulation time step is frequently shorter than the duration required for an iterative solution, the evader continues to employ the previous guidance law until the updates are finalized. Furthermore, as the distance diminishes, the angle between the evader’s velocity vector and the line-of-sight increases, leading to a heightened linearization error. Consequently, it is mandated that updates to the guidance law and control commands cease when the distance falls below . When is too large, it may cause the guidance law to stop updating prematurely. Conversely, if is too small, significant linearization errors may lead to an inaccurate guidance law. According to simulation results, a value of provides stable guidance and control performance for the evader.
The iteration initial values for the first computation of the guidance law are derived from Section 3.3, whereas the initial values for each subsequent update adopt the calculated result of the preceding update. A concise overview of the simulation process is illustrated in Figure 6, and the general parameters are detailed in Table 1. As indicated in Section 2.3, the critical safe miss distance synthesized in two directions is denoted as . The computer hardware configuration comprises an Intel Core i7-13620H processor operating at 4.90 GHz. All results in this study are based on computational simulations and do not include experimental data.
Figure 6.
Simulation flow chart.
Table 1.
General parameters used in simulation.
In the simulation, the pursuer’s guidance law employs proportional navigation with bounded control:
where is the effective navigation ratio.
4.2. Simulation of Critical Safe Miss Distance Evasion
First, simulations were conducted under two typical operating conditions, shown in Table 2, with the effective navigation ratio of the pursuer set to 3. The simulation results are illustrated in Figure 7, Figure 8, Figure 9 and Figure 10. In Figure 7 and Figure 9, points and denote the initial positions of the evader and the pursuer, respectively. The miss distances for two conditions were 70.68 m and 71.37 m, with errors of −0.04% and 0.93% relative to the critical value, respectively. The energy consumption of the evader under two conditions is and , respectively.
Table 2.
Initial states under typical conditions.
Figure 7.
Trajectory and co-state variables in Condition 1. (a) The trajectory; (b) the co-state variables.
Figure 8.
Evasion and pursuit control commands in Condition 1. (a) ay; (b) az.
Figure 9.
Trajectory and co-state variables in Condition 2. (a) The trajectory; (b) the co-state variables.
Figure 10.
Evasion and pursuit control commands in Condition 2. (a) ay; (b) az.
Under both conditions, the miss distances are near the critical safe value, with Condition 2 demonstrating a greater miss distance and reduced energy consumption. This phenomenon is attributed to the initial ZEM of zero in Condition 1, while Condition 2 features a significant initial ZEM of 70.80 m. The absolute values of the evasion control for both conditions display a trend of initially increasing and subsequently decreasing. In Condition 1, when the pursuer’s maximum control commands are insufficient to reduce the ZEM to the critical safe value, the evasion control command becomes zero. In Condition 2, as the time-to-go decreases, the co-state variable in the pitch direction does not converge to zero, leading to a non-zero evasion control command. When the distance between the two parties is below the established threshold of 500 m, the control command remains constant. The average duration for the guidance law updates in two conditions is , with a maximum duration of 0.0096 s, which satisfies the requirement for rapid updates.
Monte Carlo simulations were conducted. The initial states were generated uniformly at random within the range specified in Table 3. The random variables for the initial states include the relative positions of two parties and the direction of the evader’s velocity. The evader’s initial position was always located at the origin of the coordinate system, while the direction of pursuer’s initial velocity was oriented toward the evader, aligning with the initial line of sight. To evaluate the adaptability of the guidance law to different effective navigation ratios of pursuer, simulations were conducted 500 times for and , respectively. The simulation trajectories and statistical results are presented in Figure 11. Due to the influence of gravity, the average positions at the interception moment for both parties are significantly lower than the origin. The statistics on the miss distance indicate that the average miss distances for and are 136.51 m and 116.37 m, respectively, with 12.4% and 32.0% of them falling below the critical value. The minimum miss distances are 70.45 m and 70.37 m, with relative errors to the critical value of −0.37% and −0.48%, respectively. The average energy consumption for the evader is 9.847 × 102 m2·s−3 and 2244 × 103 m2·s−3, while for the pursuer, it is and , respectively. In 1000 simulations, the average update time for the guidance law is 1.17 × 10−5 s, with a maximum update time of 0.0088 s, which meets the requirements for rapid updates.
Table 3.
Range of initial states distributions in Monte Carlo simulations.
Figure 11.
Trajectories and statistical results of guidance law with critical safe miss distance. (a) The trajectories; (b) the statistical results.
It can be observed that under random initial states, the average miss distance is greater when compared to . The average energy consumption for the evader is higher at ; however, the energy consumption for the pursuer is also greater. When , Case 1 of occurs more frequently, leading to more instances in which no iteration is required, resulting in a shorter average update time. Due to simplifications in the optimal control model, the proportion of miss distances below the critical safe value is relatively high. Nevertheless, for both effective navigation ratios, the relative errors of the minimum miss distances compared to the critical safe value are less than 1%, indicating that the guidance law for critical safe miss distance evasion is effective.
4.3. Comparison with Other Methods
To illustrate the effectiveness of the guidance law for critical safe miss distance evasion in reducing energy consumption, comparisons were made with the sinusoidal maneuver, spiral maneuver, and norm differential game maneuver [22]. The sinusoidal and differential game maneuvers are applied in the yaw plane, with the control commands for the three methods detailed in Table 4. Considering that some of the miss distances in Section 4.2 fall below the critical value while the relative error does not exceed 1%, this section modifies the original in the guidance law to . Initial states were uniformly and randomly generated within the range specified in Table 3, and 500 simulations were conducted for each of the four methods with .
Table 4.
Control commands for three methods.
The simulation results are presented in Table 5 and Figure 12. In Figure 12, the results of the critical safe miss distance maneuver exhibit a significant difference compared to other maneuvering methods. The primary reason for this difference is that the proposed guidance law has an objective function specifically aimed at achieving the critical safe miss distance. In contrast, the programmatic oscillatory maneuvers lack the objective functions, while the norm differential game maneuver is designed to maximize the miss distance. Table 5 provides the statistics of the miss distances and energy consumption, including the mean value, relative standard deviation (RSD), and other relevant statistical metrics. In the context of anti-interception operations, evasion is deemed unsuccessful when the miss distance is less than the critical safe miss distance. In the results of the critical safe miss distance evasion, occurrences of miss distance below the critical value are no longer observed, indicating that the 1% adjustment to is effective. Comparatively, among the four evaluated methods, the critical safe miss distance evasion exhibits the smallest average miss distance. Moreover, the critical safe miss distance evasion has no instances of failure, which is comparable to the differential game maneuver. The energy consumption of the critical safe miss distance evasion is also lower and significantly less than that of the other methods. Although the average miss distances for the sinusoidal and spiral maneuvers are larger, they exhibit relatively high RSDs and greater proportions of failure. This indicates that the miss distances for the programmatic maneuvers are more dependent on initial state values, exhibiting lower proactivity. When flight times are similar, the energy consumption of sinusoidal and spiral maneuvers shows a small variation after fixing the frequency and phase, resulting in lower RSDs in energy consumption. Since the control magnitude of the differential game maneuver is set at , the differences in flight times are also minimal, leading to a lower RSD for energy consumption.
Table 5.
Statistics of miss distance and energy consumption for different methods.
Figure 12.
Statistics of miss distances and energy consumption for different methods. (a) The miss distances; (b) the energy consumption.
In summary, the proposed guidance law exhibits a greater probability of successful evasion compared to programmatic oscillatory maneuvers while incurring lower energy costs. Furthermore, in comparison to the norm differential game maneuver, it additionally achieves a reduction in energy consumption and effectively satisfies the requirements for critical safe miss distance evasion.
4.4. Evaluation of the Adaptability to Unpowered Aerial Vehicle
To reduce the mathematical and computational complexity, the proposed guidance law is formulated for the constant-speed vehicle. However, when the engagement time is short and the vehicle’s speed variation is relatively small, the guidance law could be adapted for the unpowered aerial vehicle. The aerodynamic characteristics and mass data for the CAV-H model are provided in reference [23]. In the subsequent simulation, we consider a scenario in which both the pursuer and evader are CAV-H models, aiming to evaluate the adaptability of the guidance law to the more complex model. The specific procedure for applying the guidance law under the CAV-H model is outlined as follows:
Step 1: Determine the maximum control and based on the current speeds, maximum attack angles, and aerodynamic characteristics of the evader and pursuer.
Step 2: If the guidance law needs to be updated, substitute the current speeds of the evader and pursuer into and , respectively, and compute the required acceleration command for the evader.
Step 3: Based on the aerodynamic characteristics of CAV-H, calculate the attack angle and the bank angle from the acceleration command. Substitute the attack angle and bank angle into the CAV-H dynamic model and perform the simulation through numerical integration.
The effective navigation ratio of the pursuer is set to 4, and the initial altitude of the evader is set to 25 km. Under Condition 1 and Condition 2 provided in Table 2, the four guidance laws in Section 4.3 are applied in the simulations. The resulting flight trajectories and speed curves are shown in Figure 13 and Figure 14, while the miss distances and the evader’s terminal speeds are presented in Table 6. For the unpowered vehicle, a larger acceleration in the objective function leads to a larger attack angle, which results in greater speed loss. Therefore, in this section, energy consumption is represented by the evader’s speed loss, defined as the difference between the initial and the terminal speeds. Under both conditions, the miss distance of the critical safe miss distance maneuver exceeds the critical value. The speed curves for the spiral maneuver and the differential game maneuver are similar, as both use maximum overload, resulting in a comparable aerodynamic drag. In Condition 1, the speed loss of the critical safe miss distance maneuver is only slightly lower than that of the sinusoidal maneuver. However, the miss distance of the sinusoidal maneuver is smaller than , whereas the critical safe miss distance maneuver ensures safe evasion. In Condition 2, all the guidance laws achieve safe evasion, with the critical safe miss distance maneuver resulting in the smallest speed loss.
Figure 13.
Simulation results of the CAV-H model under Condition 1. (a) The trajectories; (b) the speed curves.
Figure 14.
Simulation results of the CAV-H model under Condition 2. (a) The trajectories; (b) the speed curves.
Table 6.
Simulation results based on the CAV-H model.
The results indicate that the critical safe miss distance maneuver can be effectively applied to the CAV-H model. In comparison with the programmatic maneuver and the differential game maneuver, the critical safe miss distance guidance law achieves a safe evasion with smaller speed losses in head-on intercepts.
5. Conclusions
This paper addresses the pursuit–evasion problem for constant-speed vehicles in three-dimensional space and proposes a guidance law for critical safe miss distance evasion. Simulation results validate the effectiveness of the guidance law. The main conclusions are as follows:
Through the state equation of the ZEM and the approximation of the disturbances experienced by the pursuer, an optimal control problem for critical safe miss distance evasion was established. Using the Maximum Principle, the optimal guidance law under bounded control and terminal constraints was derived. Furthermore, an iterative method was designed for solving co-state variables with the homotopy method and Newton iteration.
The simulation results demonstrate that, within a certain range of initial conditions, the proposed iterative method meets real-time requirements. Under head-on intercept conditions, the guidance law effectively achieves critical safe miss distance evasion and adapts to different effective navigation ratios of the pursuer. Compared to other methods, the critical safe miss distance evasion results in a lower probability of the miss distance being below the critical value and incurs a smaller energy cost. In head-on intercept scenarios, the proposed guidance law is applicable to unpowered vehicle models.
Future research will focus on comparing various guidance methods across a broader range of engagement configurations, such as non-head-on intercepts, and improving the feasibility of the proposed guidance law in practical engineering applications.
Author Contributions
Conceptualization, C.W., J.Y. and R.L.; methodology, C.W., J.Y. and R.L.; software, C.W.; validation, C.W. and J.Y.; formal analysis, C.W. and R.L.; investigation, R.L.; resources, J.Y.; data curation, Z.L.; writing—original draft preparation, C.W.; writing—review and editing, Y.C.; visualization, Y.C.; supervision, Z.L.; project administration, Z.L. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Data Availability Statement
The original contributions presented in the study are included in the article. Further inquiries can be directed to the corresponding author.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Yu, X.; Wang, X.; Lin, H. Optimal penetration guidance law with controllable missile escape distance. J. Astronaut. 2023, 44, 1053–1063. [Google Scholar]
- Zarchan, P. Proportional Navigation and Weaving Targets. J. Guid. Control Dyn. 1995, 18, 969–974. [Google Scholar] [CrossRef]
- Luo, W.; Lei, G.; Lai, C.; Wang, H. Research of Integrated Spiral Maneuvering and Guidance Based on Virtual Target. J. Eng. Res. 2024. Advanced online publication. [Google Scholar] [CrossRef]
- Shinar, J.; Rotsztein, Y.; Bezner, E. Analysis of Three-Dimensional Optimal Evasion with Linearized Kinematics. J. Guid. Control 1979, 2, 353–360. [Google Scholar] [CrossRef]
- Gutman, S.; Esh, M.; Gefen, M. Simple Linear Pursuit-Evasion Games. Comput. Math. Appl. 1987, 13, 83–95. [Google Scholar] [CrossRef]
- Anderson, G.M. Comparison of Optimal Control and Differential Game Intercept Missile Guidance Laws. J. Guid. Control 1981, 4, 109–115. [Google Scholar] [CrossRef]
- Wang, Y.; Zhou, T.; Chen, W.; He, T. Optimal maneuver penetration strategy based on power series solution of miss distance. J. Beijing Univ. Aeronaut. Astronaut. 2020, 46, 159–169. [Google Scholar]
- Zhang, P.; Fang, Y.; Zhang, F.; Xiao, B.; Hu, S.; Zong, S. An Adaptive Weighted Differential Game Guidance Law. Chin. J. Aeronaut. 2012, 25, 739–746. [Google Scholar] [CrossRef]
- Battistini, S.; Shima, T. Differential Games Missile Guidance with Bearings-Only Measurements. IEEE Trans. Aerosp. Electron. Syst. 2014, 50, 2906–2915. [Google Scholar] [CrossRef]
- Sun, Q.; Zhang, C.; Liu, N.; Zhou, W.; Qi, N. Guidance Laws for Attacking Defended Target. Chin. J. Aeronaut. 2019, 32, 2337–2353. [Google Scholar] [CrossRef]
- Liu, F.; Dong, X.; Li, Q.; Ren, Z. Cooperative Differential Games Guidance Laws for Multiple Attackers against an Active Defense Target. Chin. J. Aeronaut. 2022, 35, 374–389. [Google Scholar] [CrossRef]
- Liang, H.; Li, Z.; Wu, J.; Zheng, Y.; Chu, H.; Wang, J. Optimal Guidance Laws for a Hypersonic Multiplayer Pursuit-Evasion Game Based on a Differential Game Strategy. Aerospace 2022, 9, 97. [Google Scholar] [CrossRef]
- Zhao, S.; Zhang, H.; Lyu, R.; Yang, J.; Xue, C. Optimal avoidance strategy based on nonlinear approximate analytic solution of non-cooperative differential game. Aeronaut. J. 2024, 128, 2906–2923. [Google Scholar] [CrossRef]
- Hayoun, S.Y.; Shima, T. A Two-on-One Linear Pursuit–Evasion Game with Bounded Controls. J. Optim. Theory Appl. 2017, 174, 837–857. [Google Scholar] [CrossRef]
- Gao, M.; Yan, T.; Li, Q.; Fu, W.; Zhang, J. Intelligent Pursuit–Evasion Game Based on Deep Reinforcement Learning for Hypersonic Vehicles. Aerospace 2023, 10, 86. [Google Scholar] [CrossRef]
- Peng, C.; Ma, J.; Liu, X. An Online Data Driven Actor-Critic-Disturbance Guidance Law for Missile-Target Interception with Input Constraints. Chin. J. Aeronaut. 2022, 35, 144–156. [Google Scholar] [CrossRef]
- Kartal, Y.; Subbarao, K.; Dogan, A.; Lewis, F. Optimal Game Theoretic Solution of the Pursuit-evasion Intercept Problem Using On-policy Reinforcement Learning. Int. J. Robust Nonlinear Control 2021, 31, 7886–7903. [Google Scholar] [CrossRef]
- Turetsky, V.; Shinar, J. Missile Guidance Laws Based on Pursuit–Evasion Game Formulations. Automatica 2003, 39, 607–618. [Google Scholar] [CrossRef]
- Yan, T.; Cai, Y.; Xu, B. Evasion Guidance Algorithms for Air-Breathing Hypersonic Vehicles in Three-Player Pursuit-Evasion Games. Chin. J. Aeronaut. 2020, 33, 3423–3436. [Google Scholar] [CrossRef]
- Chen, S.; Yan, J.; Pu, K. Anti-intercept maneuver method of vehicle based on prediction of miss distance. Syst. Eng. Electron. 2023, 45, 2922–2930. [Google Scholar]
- Deuflhard, P. Newton Methods for Nonlinear Problems; Spinger: Berlin/Heidelberg, Germany, 2011. [Google Scholar]
- Gutman, S. On Optimal Guidance for Homing Missiles. J. Guid. Control 1979, 2, 296–300. [Google Scholar] [CrossRef]
- Richie, G. The Common Aero Vehicle–Space delivery system of the future. In Proceedings of the Space Technology Conference and Exposition, Albuquerque, NM, USA, 28–30 September 1999. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).