1. Introduction
Multiple robot systems have become widespread, as they can perform hard and possibly dangerous tasks for humans while improving efficiency and productivity. Among the plethora of applications, there are industry, agriculture, construction, and emergency rescue [
1].
Among the different kinds of collaboration, hybrid teams can tackle more complex tasks requiring different capabilities, notably air–ground cooperation. On the one hand, Unmanned Aerial Vehicles (UAVs) have long-range sensors on board, making them suitable for monitoring from the sky. On the other side, Unmanned Ground Vehicles (UGVs) have short-range sensors and high load and computational capacities. The main issues are motion control, formation control, and collision avoidance. Vinicius et al. [
2] proposed a light path following a virtual structure-based controller for package delivery. As the UAV flies over it, the UGV has to follow a desired trajectory while avoiding obstacles.
A PI optimal control theory is presented in [
3], and results show that the proposed scheme can overcome input and model disturbances and linearization biases. Again considering air–ground cooperation, ref. [
4] presents a leader–follower architecture, where the quadcopter has to reach the desired waypoints and send its position to the unicycle, which uses these data as the desired position. In addition, the ground agent should avoid obstacles around it.
Classical control methods assume complete knowledge of the system state without data loss. When agents are not tracked, the control action cannot be computed, and the robots must halt. Nonlinear Model Predictive Control (NMPC) provides a solution to this issue. In the absence of measurements, NMPC can apply the optimal control trajectory computed in the previous step until updated data become available. The key idea is to use an internal nonlinear model to predict the system’s future response. Due to its simplicity, MPC has been widely used in various applications, with numerous studies experimentally validating its superiority over classical linear controllers. In [
5], the authors compared the performance of PID, LQR and MPC in controlling a drone. Both simulations and real experiments with a Parrot mini-drone were carried out. It turns out that MPC outperforms other methods, ensuring robustness, stability, and small errors in terms of maximum pitch deviation. Al-Saoudi et al. [
6] carried out a similar study comparing model-based controllers such as PID, fuzzy logic, and MPC with an ANFIS-based controller. From the MATLAB/SIMULINK R2022a tests, it is shown that the MPC is superior, as it can handle input constraints and has lower overshoot and response time compared to other techniques. Taking into account a separation clutch system in the slipping state, ref. [
7] compares PI-PD and LQR methods with a scheme composed of multiple MPCs but again this last turns out to be the best in terms of performance. Always in the field of autonomous driving, the paper [
8] studies and evaluates in terms of tracking error different methods (Pure Pursuite, Stanley, LQR and MPC) for the trajectory tracking mission of a steering car. In both tests, MPC provides better accuracy both for the eight shape and the circle path. While NMPC has been consolidated over the years for controlling UGVs, leading to embedded implementations [
9,
10], it has been applied to UAVs only recently. Indeed, with the advent of more powerful microprocessors and efficient nonlinear solvers, a real-time application of NMPC for small drones is now possible [
11].
However, one of the primary limitations of NMPC is the assumption that the complete state is measurable. To overcome this, NMPC is often paired with nonlinear estimators, such as the Nonlinear Moving Horizon Estimator (NMHE) [
12]. NMHE addresses the dual problem of NMPC by providing state estimates that incorporate constraints and nonlinearities without assuming a specific error distribution. This pairing allows NMPC to function effectively even when full state information is not directly measurable. These two complementary state-of-the-art tools, when combined, can accurately control and estimate complex underactuated systems. In [
13], the authors propose an NMHE-NMPC scheme to address the path-following problem of generalized N-vehicles under noisy measurements and disturbances. To evaluate its performance, simulations and real-world experiments have been performed to show its accuracy and applicability to real-time scenarios. A combination of both techniques is presented in [
14] to control a selective catalytic reduction process for reducing engine emissions. In the context of UAVs, ref. [
15] proposes a new NMPC method for UAV navigation that can deal with dynamic obstacles by predicting their movement and using a fast solver to find safe trajectories in real time, while [
16] presents a nonlinear fault-tolerant control system for a quadcopter. This approach combines NMPC and NMHE to maintain trajectory control even in the presence of rotor failures. In the worst-case scenario where all motors are damaged, the NMHE estimates allow the NMPC to effectively stabilize and accurately follow the reference trajectory.
This work addresses the UAV-UGV formation and path-tracking problem. In particular, a distributed leader–follower NMPC-NMHE scheme is defined. The main novelties and contributions of this paper are the following:
- (a)
Although promising results have been obtained in various applications, NMPC and NMHE have not been used together for air–ground cooperation.
- (b)
To the best of the authors’ knowledge, these two receiving horizon techniques have not been used to control a heterogeneous fleet consisting of a steering car and a quadcopter. In fact, most current work considers unicycles as ground vehicles.
- (c)
It is worth noting that the proposed solution deals with partially noisy state measurements and is, in principle, robust to information loss.
The paper unfolds in three key sections.
Section 2 outlines the methods and definitions devised to tackle the focal problem under examination. Moving forward,
Section 3 consolidates the numerical simulation results. Ultimately,
Section 4 encapsulates the conclusions, emphasizing future avenues for development.
3. Results
To validate the proposed solution, various simulations were conducted in MATLAB/Simulink, altering the reference trajectories, the number of obstacles, and their positions. In particular, to implement MHE and the switching NMPC of the UGV, the CasADi framework is used as in [
10,
20]. CasADi [
21] is an open-source tool that provides different facilities useful in academic and industrial applications, notably the Internal Point Optimizer to solve nonlinear programming problems efficiently.
The robots parameters are set to
and
in accordance with the values of the JetRacer race car and the Parrot Bebop 2.0 drone. It is assumed that the agent can detect barriers up to
, in line with the datasheet of the RPLIDAR A1 included with the JetRacer ROS Kit. The safety distance for the UGV is set to
and
. At the beginning of the simulations, the states of both robots are
Concerning the structural boundaries of the quadcopter, the maximum tilt angle, vertical speed, and rotational speed around
are
On the other hand, for the steering car’s state, only the forward velocity is bounded
while for its control inputs
Regarding the NMPC parameters,
is set for both
and
, while for the weights
Concerning the estimators,
,
is chosen, and
as defined in the Optitrack’s specification.
For all the cases studies, the quantitative analysis is split considering the robots separately, as, indeed, the controller is distributed. Let us focus first on the UGV. To investigate the NMPC performance, the Root Mean Square Error (RMSE) is considered for the tracking:
and for the one-step prediction
Regarding the MHE, the estimation’s RMSE is considered as
Regarding the quadcopter tracking, it is important to distinguish the deviation from the reference used by the NMPC objective, where zeros corresponding to nontracked quantities are not considered:
and the actual one
Depending on whether Equation (
43) or Equation (
44) is chosen, two tracking errors can be defined:
where
is the subset of the tracked drone’s state’s components, i.e.,
Finally, to evaluate the MHE performance, the metric below is considered
3.1. Circle with One Obstacle
The first scenario lasts
and considers a circular trajectory centered in the origin with radius of
, described by the following equations:
A static obstacle is placed along the reference trajectory in
. While the UGV should track the reference, the drone should follow the leader, keeping an altitude defined as
The aim is to demonstrate that even if the drone must increase its altitude to avoid an
obstacle, the controller effectively manages this change in trajectory. It should be noted that
the UAV NMPC formulation currently does not include constraints such as Equation (31).
Figure 4 shows the trajectories of the two agents.
The UGV moves in a circle as long as it maintains a safe distance from the obstacle. When the car approaches the obstacle, it turns away to avoid it and then realigns with the reference trajectory as illustrated in
Figure 5. Meanwhile, the UAV keeps the formation with the leader and increases its height when required.
Table 1 summarizes all the indexes. The small errors in estimating and predicting the vehicle’s state allow to track the reference with deviations of a few centimeters and radiant.
As summed up in
Table 2, resorting to the one-step prediction ensures the tracking of the desired attitude. Naturally, Equation (45) is smaller in magnitude than Equation (46), as in the NMPC formulation there appears
and not
. Still, the variations from the actual reference are quite satisfactory.
Table 3 reports for each quadcopter’s state’s components the negligible estimation error.
3.2. Circle with Two Obstacles
The second case study maintains the circular trajectory previously described but considers two obstacles, placed in
and
. The aircraft should adhere to a specified take-off reference trajectory as delineated below:
The simulation time is also reduced to one minute.
Figure 6 and
Figure 7 demonstrate
that both the leader and the follower qualitatively follow the reference without collisions.
Table 4,
Table 5 and
Table 6 show the performance indices for both agents. In order to avoid the two obstacles,
the ground robot has to deviate its trajectory, which leads to an increase in its
of
Equation (40). The drone accurately follows the one-step prediction of the car. However, the
increase in the leader’s tracking error caused by the obstacles is reflected in the follower’s
performance.
3.3. Lemniscate of Bernoulli with One Obstacle
For the third simulation, Bernoulli’s lemniscate is chosen as the desired trajectory, described by the following equations:
with
and the only obstacle is in the origin. The reference altitude of the UAV is kept constant at
.
The trajectories of the two agents are depicted in
Figure 8 and
Figure 9. The UGV initially follows the lemniscate path until it approaches too close to the origin. At that point, it navigates around the obstacle, resulting in a decrease in tracking accuracy as shown in
Table 7. Due to the control constraints, the agent gradually returns to the reference path without sudden movements. When the steering car returns to its starting point, it must pass the origin again, thereby repeating the same behavior. Regarding the quadcopter, except for the initial moments of the simulation due to the initial conditions, it maintains the desired height while following the leader from above. For a quantitative analysis, see
Table 8 and
Table 9.
3.4. Lemniscate of Bernoulli with Two Obstacles
The last case study is similar to the previous one, but a second obstacle is added. Both are in the reference positions that the robot should ideally pass at
and
. To complicate the test, the constant height is replaced by a decreasing trajectory:
The resulting performance indices are presented in
Table 10,
Table 11 and
Table 12. As can be seen from
Figure 10 and
Figure 11, considerations similar to those for the single barrier case can be drawn.
Note that the
RSMEx and
RMSEy of the tracking error Equation (40) are smaller compared
to the values in the first row of
Table 10, which remain the worst values among all the
simulations. Nevertheless, in none of the case studies did the errors diverge and the ground
vehicle entered the unsafe region.