1. Introduction
Trajectory planning for agile unmanned aerial vehicles (UAVs) operating in cluttered environments is commonly formulated as a constrained optimal control problem. Such missions require the simultaneous satisfaction of nonlinear system dynamics, actuator limitations, and collision avoidance constraints imposed by environmental obstacles. These requirements often lead to highly non-convex feasible regions, making the reliable computation of safe and feasible trajectories a challenging task, particularly in aggressive flight scenarios. Accordingly, a wide range of optimal control-based approaches have been investigated to address UAV trajectory planning under geometric and dynamical constraints [
1,
2,
3,
4,
5,
6,
7,
8].
Existing UAV trajectory planning methods can be broadly categorized into three approaches: convex relaxation-based optimization, learning-based planning, and nonlinear trajectory optimization methods. Convex relaxation techniques, such as half-space approximations, transform non-convex obstacle avoidance constraints into convex constraints, enabling efficient optimization. However, these methods often introduce conservatism, particularly in cluttered environments where narrow feasible corridors exist between obstacles. In parallel, recent studies have explored data-driven approaches using deep Reinforcement Learning (RL) and large Artificial Intelligence (AI) models for UAV path planning. These learning-based methods can learn navigation policies in complex environments through large-scale training data. Nevertheless, their performance often depends on the availability of representative training environments and may require additional mechanisms to ensure strict constraint satisfaction. In contrast, nonlinear trajectory optimization methods directly solve the optimal control problem while considering system dynamics and constraints. These methods can generate high-precision trajectories but may suffer from infeasible local minima in highly constrained environments.
In practical implementations, to enable real-time computation, UAV dynamics is often simplified and modeled as a point mass [
9,
10,
11]. Subsequently, for path tracking, nonlinear control methods such as Incremental Nonlinear Dynamic Inversion (INDI) are commonly employed [
12,
13]; however, these methods do not guarantee optimality of minimum-time or minimum-energy planning. Consequently, a path planning approach that accounts for system dynamics more accurately is desirable. Although popular path planning methods exist, including Rapidly exploring Random Trees (RRT) [
14,
15] and Probabilistic Roadmaps (PRM) [
16], explicitly incorporating system dynamics is essential for achieving agile control in complex missions. In addition, large AI models and deep RL have recently gained popularity for aerial navigation [
17,
18]. AI and RL are, however, not considered in our work because our study focuses on improving the feasibility of local solutions in optimization solvers and is motivated by the fact that these learning-based methods often struggle to generalize scenarios outside their training data and to bridge the sim-to-real gap [
19,
20,
21]. In contrast, model-based approaches [
9,
22] can robustly compute feasible solutions in unknown environments by explicitly leveraging the system model and current-time state information.
A notable study addressing coupled translational and rotational motion is reported in [
23]. This study introduced a unified system model that incorporates both translational dynamics and rotational kinematics, enabling simultaneous feedback control of position and attitude. By applying a state-dependent linear quadratic regulator to track target states, the approach in [
23] achieves highly agile control performance. In our previous work [
24], the model based on [
23] was extended and adapted for trajectory optimization rather than feedback control. Specifically, simple rotational dynamics and thrust-related states were explicitly incorporated into the optimization model, allowing the generation of dynamically feasible and collision-free trajectories under geometric constraints. To solve the resulting constrained nonlinear optimal control problem, the Augmented Lagrangian iterative Linear Quadratic Regulator (AL-iLQR), implemented in ALTRO [
25], was employed as the numerical solver. This choice was motivated by the computational efficiency of iLQR for nonlinear systems and the ability of the Augmented Lagrangian Method (ALM) [
26] to handle geometric constraints with high accuracy. Since the introduction of iLQR [
27], the effectiveness of iLQR-based methods for real-time applications has been demonstrated in numerous studies [
28,
29]. In particular, ALM plays a critical role in collision avoidance problems, where optimal solutions often lie on or near constraint boundaries.
Despite the success of optimization solvers based on Sequential Quadratic Programming (SQP) [
30] and interior point methods (IPM), inequality constraints associated with collision avoidance are known to be computationally challenging [
31,
32,
33]. Similar difficulties arise in practical optimal control solvers such as ALTRO [
25], Crocoddyl [
34], FATROP [
35] and Acados [
36], which are specifically designed for trajectory optimization problems, including UAV trajectory planning.
Numerous studies have investigated methods for handling both convex and non-convex constraints [
37,
38]. While projection methods (PMs) are well suited to convex geometric constraints, addressing complex non-convex constraints—such as those arising from the presence of numerous obstacles in UAV missions—remains challenging. In addition, the Alternating Direction Method of Multipliers (ADMM), which can be viewed as an extension of the Augmented Lagrangian Method (ALM), has been applied to constrained trajectory optimization in several studies [
39,
40]. However, although ADMM is well suited for distributed control problems, it often exhibits slow convergence due to problem splitting, particularly in environments containing a large number of uncontrollable obstacles.
Some works reformulate the problem into a half-space convex relaxation [
41,
42,
43], thereby utilizing fast convex optimization solvers. While half-space convex relaxation is a powerful method because of benefit from general fast convex solvers, it relies on the separating hyperplane theorem, which tends to generate overly conservative trajectories, particularly in densely cluttered environments.
In complex constrained trajectory optimization problems, these solvers frequently fail to find feasible solutions due to conflicting interactions among constraint gradients. Such failures are particularly critical in UAV trajectory optimization, where safety and reliability are paramount. Moreover, when these solvers fail to identify feasible solutions, a guidance mechanism is required; however, identifying a partially feasible region that contains the global optimum is itself challenging in complex scenarios. To address these problems, several hybrid approaches that combine sampling-based methods with existing local solvers have been proposed [
44,
45,
46,
47]. However, the learning costs associated with complex problems remain high in [
44,
45,
46]. Specifically, Ref. [
45] identifies feasible solutions using Bayesian optimization (BO) during the Interior Point OPTimizers (IPOPT) [
48] iterations but does not prioritize real-time capability. In Ref. [
46], BO is employed to learn complex constraints, after which optimal solutions are identified using iLQR within the resulting feasible regions. In Ref. [
47], circular safety zones are generated around obstacles, enabling trajectory optimization within these predefined safe regions. While Model Predictive Path Integral (MPPI) control [
49] demonstrates excellent real-time performance, its integration with IPDDP [
50] may suffer from degraded numerical accuracy near constraint boundaries due to the inherent characteristics of interior point methods.
From the above discussion, despite the growing demand for agile control based on advanced dynamic models such as [
23] and for robust optimization of UAV trajectories, path planning—particularly trajectory optimization—often fails to identify feasible solutions under non-convex constraints. Furthermore, existing approaches that explicitly ensure feasibility are generally unsuitable for real-time UAV trajectory optimization in environments containing obstacles. Therefore, real-time UAV trajectory optimization requires a modified optimization framework that effectively leverages advanced UAV dynamics, the characteristics of collision avoidance constraints, and the computational efficiency of established high-accuracy solvers. This observation motivates the development of the approach proposed in this paper.
This study proposes a plugin-style method that is integrated into the AL-iLQR iteration process. The proposed approach explores feasible regions by employing Model Predictive Path Integral (MPPI) control as a fast, supplementary guidance mechanism, without requiring fundamental modifications to the underlying solver algorithm. Namely, the proposed approach first estimates a coarse, low-precision optimal solution and then performs high-precision local refinement around the solution. This allows our method to effectively exploit narrow passages between obstacles rather than being restricted to conservative regions. Notably, the method exploits failure behaviors in optimization that are specific to geometric constraints and effectively guides infeasible trajectories toward feasible regions. The main contributions of this study are summarized as follows:
Integration of active guidance as an additional constraint within the iteration process of an established optimal control solver;
Trajectory optimization that leverages advanced UAV dynamics in the presence of static and dynamic obstacles;
Improved robustness and solution quality through an MPPI-based guidance mechanism.
2. System Model
In this work, the system dynamics describes a quadrotor model that accounts for first-order rotor dynamics and thrust limitations. The state value is defined as
, where
denotes the position,
the velocity,
the orientation with a quaternion,
the angular velocity, and
the thrust generated by each rotor along the body-frame
-axis. The control input is defined as the commanded rotor speeds,
. The rotor dynamics is modeled as a first-order lag system with time constant
. The rotational speed
of the
-th rotor evolves according to
Using the relationship between thrust and rotor speed,
, with coefficient
, the system dynamics can be written as
The direction cosine matrix
and the quaternion multiplication matrix
are defined in Equations (3) and (4), respectively. The thrust allocation matrix
and the aerodynamic damping matrix
are given in Equations (5) and (6). The quaternion is constrained to satisfy
Here, the thrust satisfies , , where is the vehicle mass, is the gravitational acceleration, denotes the inertia matrix, the arm length, the rotor torque coefficient, and the aerodynamic drag coefficient. , and denotes the Hadamard product.
Quadrotor control systems are commonly designed using separate subsystems for position and attitude control to avoid singularities and simplify controller design. However, for trajectory optimization problems such as minimum-time or minimum-energy planning, it is necessary to employ a unified control formulation that simultaneously considers translational and rotational dynamics. In Ref. [
23], a subsystem combining translational dynamics and attitude kinematics was proposed, while neglecting rotational dynamics. In this study, that subsystem is modified and extended for trajectory optimization. The subsystem used for path planning is defined as
For practical implementation, both the rotational dynamics and thrust acceleration are modeled as first-order lag systems. The optimal state trajectories
and
obtained from path planning are treated as reference trajectories and constraints in the path tracking stage. The path tracking model is defined as
Figure 1 illustrates the overall framework of the path planning and path tracking system. Here,
,
,
,
, and
denote the target states. In the path tracking stage, appropriate weighting of
and
is required when applying AL-iLQR.
4. Our Proposed Method for Feasibility
This section presents the proposed guidance mechanism designed to steer the AL-iLQR algorithm away from infeasible local minima and to improve convergence toward feasible solutions.
Figure 2 illustrates the overall quadrotor system architecture, encompassing the complete pipeline from trajectory planning to trajectory tracking while incorporating the associated constraints. The constraints are visually categorized in the diagram: the left block represents general system constraints; the central block corresponds to position constraints relevant to the path planning stage; and the right block describes constraints imposed during path tracking. When trajectory optimization fails to identify a feasible solution, the proposed method dynamically modifies the geometric constraints. This modification acts as a corrective mechanism by transmitting a guidance signal from the path planning module to the constraint formulation. Note that the left block also includes constraints related to system dynamics.
4.1. What Is Feasibility for Collision Avoidance?
General-purpose optimization solvers, such as SQP and IPOPT, often struggle to robustly converge to feasible regions under complex constraints. This difficulty also arises in AL-iLQR, which is employed in this study. The problem is particularly pronounced in collision avoidance problems, which impose the following position constraint.
where
denotes the position of the
-th obstacle,
is the discrete time index, and the collision radii define spherical approximations of the obstacle and the vehicle geometry. While such algorithms can reliably find feasible trajectories in simple scenarios (e.g., a single obstacle), they often converge to infeasible local minima in complex environments with multiple obstacles. This behavior is a direct consequence of their gradient-based nature.
Figure 3a illustrates this failure mode using a two-dimensional example. The color-graded curve extending toward the target represents the predictive trajectory generated by AL-iLQR. The red crosses (×) denote infeasible states that violate the position constraints. This result indicates convergence to an infeasible local minimum.
In AL-iLQR, constraint multipliers are initialized with small values and gradually increased. Consequently, the algorithm initially solves a relaxed problem in which constraint violations have only a weak influence on the cost function. As a result, even when starting from a feasible initial guess, early iterations tend to prioritize minimizing the primary cost over satisfying constraints. Once the trajectory converges to an infeasible region, such as that shown in
Figure 3a, subsequent increases in the multipliers are often insufficient to escape the infeasible solution.
Therefore, the solution we propose is to actively guide the predictive trajectory into the feasible region during the iterative optimization process. Our guidance mechanism is represented by the region
in
Figure 3b.
constitutes the set of discrete time indices of constraint violations that are highly unlikely to be resolved by further AL-iLQR iterations.
To address this problem, we propose actively guiding the predictive trajectory into a feasible region during the iterative optimization process. This guidance mechanism is illustrated by the region
in
Figure 3b. The set
consists of discrete time indices at which constraint violations are unlikely to be resolved by further AL-iLQR iterations alone.
To identify such indices, we first define the set of active constraints at each time step.
where
Here,
denotes the number of obstacles. If
, the trajectory is feasible at time
; if
, feasibility can often be recovered through iterative optimization. On the other hand, when only one geometric constraint is active, AL-iLQR can successfully find a solution by continuously deforming the trajectory using gradient information, assuming spherical obstacles. In contrast, when two or more constraints are active, the spatial arrangement of the obstacles can cause the gradient vectors to cancel each other out in the augmented Lagrangian method. Consequently, there is no guarantee that the gradient direction calculated by AL-iLQR will coincide with the correct direction toward the feasible region. Accordingly, the index set
is defined as
4.2. How to Find
The challenge of determining extends beyond identifying any feasible solution; it lies in simultaneously satisfying constraints while optimizing the mission cost. The objective is not to compute a single optimal trajectory, but rather to estimate a region in which optimal solutions are likely to be distributed. To this end, we employ a sampling-based solver, Model Predictive Path Integral control (MPPI), which is well suited for rapidly approximating the distribution of optimal solutions.
The MPPI cost function is defined as
Here,
is a constant penalty parameter. MPPI enforces input constraints by clamping sampled inputs that fall outside the admissible range. Assuming the sampled input
follows a multivariate Gaussian distribution centered at the mean input
with covariance
, the sampling distribution is given by
The optimal control sequence is obtained by solving
where
is the distribution that is described by
. According to the variational inference theory, minimizing KL-divergence yields the optimal solution. Under the Law of Large Numbers, the sample-based approximation used in MPPI converges to the true expected value as the number of samples increases. Note, the law does not guarantee convergence to the global optimum. Algorithm 3 shows the MPPI algorithm [
49].
The optimal state sequence
is then obtained from
, and the guidance region
is determined such that it contains
.
| Algorithm 3: Model Predictive Path Integration (MPPI) |
| | Inputs: |
| | |
| | |
| | Outputs: |
| | |
| | Procedure: |
| 1: | // Sampling number |
| 2: |
|
| 3: |
|
| 4: |
|
| 5: |
|
| 6: |
|
| 7: |
|
| 8: |
|
| 9: |
|
| 10: |
end for |
| 11: |
|
| 12: |
end for |
| 13: |
|
| 14: |
|
| 15: |
|
| 16: |
|
| 17: |
|
| 18: |
|
| 19: |
end for |
| 20: |
|
4.3. Integration of into AL-iLQR
Based on the sampled inputs generated by MPPI, we obtain an estimate of the optimal distribution
. The guidance region
is then integrated into the AL-iLQR framework. The key observation is that AL-iLQR converges efficiently to an optimal solution as long as the trajectory remains within the feasible region. Therefore, it is sufficient to guide the trajectory toward feasibility rather than explicitly solving the global constrained problem. The guidance region is defined as
where
Here, corresponds to the MPPI-derived reference position . The guidance radius , selected to be smaller than the obstacle geometry, is set equal to the collision radius of the controlled vehicle.
Since
may vary significantly between AL-iLQR iterations—especially in multimodal solution spaces—reusing multipliers from previous iterations can hinder convergence. Therefore, we redefine the augmented Lagrangian as
The penalty parameter
is updated according to
where
is chosen such that
. Satisfying the guidance constraint in Equation (62) becomes equivalent to satisfying the original collision constraint in Equation (52) in later iterations, once the AL-iLQR multipliers have sufficiently increased. If
, the guidance constraint is omitted.
When GCO is activated, the guidance constraint is penalized more aggressively than the original constraints, thereby prioritizing feasibility restoration. If the solution later drifts back into infeasible regions, the guidance mechanism is reactivated. Once convergence within the feasible domain is imminent, the guidance constraint is permanently deactivated.
Unlike standard augmented Lagrangian (AL) constraints, the proposed guidance constraint is incorporated directly into the cost function as a penalty term rather than through Lagrange multipliers. From a numerical standpoint, it is treated as an inequality constraint whose associated multiplier is intentionally fixed to zero.
In the proposed scheme, the guidance mechanism is integrated into the AL-iLQR optimizer. While the original collision avoidance constraints in Equation (52) are handled using the full AL formulation with Lagrange multipliers , the guidance constraint in Equation (62) is excluded from the AL framework and instead added directly to the AL-iLQR cost function as a simple penalty term. The guidance constraint is introduced as a temporary penalty term to assist the optimization process when the solver encounters a solution that may yield an infeasible local minima during the AL-iLQR iterations. Importantly, the guidance constraint is designed to remain inactive in the vicinity of feasible solutions. Since the optimal trajectory must satisfy the original geometric constraints, the guidance constraint naturally becomes inactive near the final solution. Therefore, the final solution satisfies the Karush–Kuhn–Tucker (KKT) conditions associated with the original optimization problem. In addition, the margin parameter ensures that the feasible region around the optimal trajectory remains inside the region where the guidance constraint is inactive.
The proposed framework involves several parameters, such as the guidance margin
, the sampling distribution parameters in MPPI, and the penalty weights used in the augmented Lagrangian formulation. The guidance margin mainly determines the activation region of the guidance mechanism, while the AL-iLQR refinement step ensures that the final trajectory satisfies the original geometric constraints. As a result, the final solution is not highly sensitive to the exact value of this parameter. Similarly, the MPPI sampling parameters primarily influence the exploration behavior during the guidance phase, but once a feasible trajectory is identified, the optimization process proceeds using the standard AL-iLQR framework. The overall guidance algorithm is summarized in Algorithms 4 and 5.
| Algorithm 4: Modified AL-iLQR (Our proposed method) |
| | Inputs: |
| | |
| | |
| | Outputs: |
| | |
| | Procedure: |
| 1: |
|
| 2: |
|
| 3: |
|
| 4: |
|
| 5: |
while |
| 6: | using iLQR |
| 7: | if the convergence conditions are satisfied |
| 8: |
Break |
| 9: |
end if |
| 10: |
|
| 11: | using Equations (21), (22) and (66) |
| 12: | corresponds to Equation (62) |
| 13: |
end while |
| 14: |
|
| Algorithm 5: Constraint Parameters Update for Feasibility (CPUF) |
| | Inputs: |
| | |
| | Outputs: |
| | |
| | Procedure: |
| 1: |
|
| 2: |
|
| 3: |
|
| 4: |
|
| 5: |
|
| 6: |
|
| 7: |
|
| 8: |
|
| 9: |
|
| 10: |
end if |
| 11: |
end for |
| 12: |
|
| 13: |
end if |
| 14: |
|