This section describes the modeling process of the multi-UAV cooperative search from three aspects: simplified UAV model, target motion model, and environmental information model. It also defines the search problem.
2.1. Scenario Description of Multi-UAV Cooperative Search
This paper addresses the problem of cooperative multi-UAV target search in complex environments.
Figure 1 shows a typical cooperative target search scenario using multiple UAVs. Specifically,
denotes a set of
homogeneous UAVs in the search area and
denotes the
i-th UAV.
denotes a set of
targets in the search area and
denotes the
j-th target. Similar to [
18], we consider the scenario that the UAV cluster flies at the same altitude, and the flying altitude is high enough so that local terrain fluctuations do not significantly affect the perception range. The proposed algorithm in this paper focuses on a two-dimensional planar task, where
represents the position of
projected onto the 2D plane at time
. Constrained by communication constraints, the multi-UAV system performs information exchange via local perception. The primary objective is to optimize UAV flight trajectories for efficient capture of dynamic evasive targets with minimal resource consumption. To strike a balance between model fidelity and computational efficiency, this work focuses on the horizontal coordination of UAVs, assuming that targets move on a 2D plane and UAVs maintain a constant operating altitude. Accordingly, the Z-coordinate is neglected in the graph modeling framework, so as to prioritize real-time trajectory optimization and multi-agent task allocation. Furthermore, as illustrated in
Figure 1, the target
perceives the sensing intensity from
and
. Individual repulsion vectors
and
are generated in the opposite directions of the UAVs. The final evasion vector
is defined as the normalized resultant vector, which directs the target toward the safest region with the lowest sensing gradient. A detailed description is provided in
Section 2.3 to clarify the physical interpretation of this vector.
2.3. Target Motion Model
In this paper, the structure and motion attitude of the target is considered to be a prime, disregarding UAV movement along the
Z-axis. The target’s position at time
is
. We assume the target moves along its planned route when unaware of UAV presence and changes heading to evade upon detection. This approximates an intelligent evasion scenario. Then, the motion model for
is expressed as follows:
where
is the position of
at time
, and
is the position of
at the next time
.
is the movement direction of
.
is the heading angle of
.
is the velocity of
at time
.
is the current direction of the target’s motion in unit vector.
For dynamic targets with reconnaissance-avoidance characteristics, the actual target is assumed to possess anti-reconnaissance capabilities, enabling it to sense the presence of nearby UAVs. When the UAV enters its sensing range,
, the target
initiates evasive maneuvers, where
denotes the perception range of UAV
,
denotes the perception range of target
. Upon sensing the UAV, the target adjusts its movement direction away from the UAV’s path. The target’s position is updated along the evasive path, and the new equation of motion is as follows:
where
is the unit vector of the evasion direction relative to multiple UAVs. In this paper, the evasion direction is determined based on the relative position between
and
with
. In order to move away from the UAV, the target will move in the opposite direction of the position.
is the unit vector of the avoidance direction relative to a single
:
Assume the presence of multiple UAVs, where the target executes combined avoidance maneuvers based on the positions of all UAVs. The positional influences of all UAVs are averaged using
, where
is the set of all UAVs within the sensing range of
. The avoidance strength
is defined by
, with strength increasing as the UAV approaches the avoidance direction. The evasion direction is shown below:
It is crucial to emphasize that this motion model merely defines the ground-truth adversarial environment. From the UAVs’ perspective, they possess no prior knowledge of the targets’ exact coordinates, movement rules, or specific evasion policies, and must rely on an environmental information map to infer their whereabouts under strictly asymmetric information.
2.4. Environmental Information Map Modeling
In this paper, the rectangular task area of is rasterized and divided into discrete raster cells of , task area . To facilitate vectorized matrix operations in the subsequent graph-based algorithms, the 2D spatial grid is mathematically flattened into a 1D array with cell indices . The translation between the 2D grid coordinates and the 1D index is defined using standard row-major ordering as . The center point of the -th grid cell is used to represent its continuous physical location, denoted by the 2D coordinate vector . Based on the discrete grid indices and the cell resolutions , , the physical center coordinates are mapped as and Here, , denote the total number of grids along the horizontal and vertical axes, respectively.
2.4.1. Initialization of Target Prior Probability Map
The target probability distribution graph
indicates the target existence probability estimate of grid
by UAV
at time
k. Through fully utilizing detected environmental information to update the probability map, target distribution can be better predicted, enabling more effective target search in time-varying environments. In practical applications, the initial probability distribution of the target
can be constructed based on the availability of prior information from satellite data, sensor networks, historical records, or intelligence sources. When there is no prior information about the target location, the search area is typically discretized into a grid and assigned a uniform probability distribution. If positional prior information is available, the distribution is instead represented using a Gaussian model centered on the estimated location. Furthermore, when motion-related priors such as the target’s velocity and heading are known, the initial distribution
will be further refined as a Gaussian distribution with the target’s estimated position
and the uncertainty in the target’s position
[
19].
2.4.2. Sensor Observation Update
After obtaining the initial probability distribution , the UAV system performs two-dimensional probability evolution at moment as the search mission progresses: target dynamic state transition and sensor observation update.
For the target dynamic state transition process, this paper will detail in
Section 3.2 to obtain the prior probability of the prediction
output of the graph-enhanced probability diffusion module. For the sensor observation update process, it is assumed that the UAV reaches a predefined grid node
at moment
and performs detection, with its sensor detection probability
and its sensor false alarm probability
. Combined with the actual detection result
, the UAV uses the Bayesian criterion [
33] to correct the prior prediction probability
for observation, thereby obtaining the final posterior probability
of target existence at time
. The specific description is as follows:
where
indicates that the target is detected by
at time
k in grid
, and
indicates that the target is not detected. The updated probability map is
.
2.4.3. Environment Uncertainty Map Update
In this paper, uncertainty
is employed to characterize the UAV
’s perception of the environmental grid
at time
k. At the outset, the environmental uncertainty is quantified as the information entropy associated with the initial target existence probabilities across the search grid.
Here, each grid cell is assumed to have an identical likelihood of containing the target at the initial stage
. As multiple UAVs collaboratively explore the area, their accumulated observations progressively enhance knowledge of the environment, leading to a continuous reduction in uncertainty [
12].
where the uncertainty
of a grid cell decreases sharply when it is within the sensor coverage
, while it maintains a marginal reduction when outside
, reflecting the variation in environmental uncertainty as the search proceeds in greater depth.
is the decay factor of information uncertainty in the environment. This paper sets
.
2.5. Problem Formulation
When multiple UAVs perform search tasks, their motion states can be uniformly represented in a common state space, allowing the multiple UAVs participating in the task to be regarded as a multi-input, multi-output cooperative control system. At the time , the state of the system is recorded as , and the corresponding control input is . The state transition equation of the system can be described as , where is the state transition function. According to (1), the state of the UAV at time k is , with control input . is selected as the optimization decision variable. To evaluate the overall effectiveness of multi-UAV cooperative search, we introduced the UAV search effectiveness function . The search effectiveness function is a multi-objective function that comprehensively considers the benefits and costs of multiple UAVs in the search process, as follows:
- (1)
Regional Target Discovery Benefits: It is expressed as the cumulative sum of the target existence probability within , the union of all grid cells covered by the UAV . is defined as follows:
where
represents whether a target is confirmed to exist in grid
. If
,
; otherwise,
.
is the predefined existence probability threshold; this paper sets
. Once
reaches
, the discovery benefit for this grid drops to zero, incentivizing the UAV to search elsewhere.
- (2)
Multi-UAV Expected Detection Benefits: forces the UAVs to prioritize exploring highly probable but currently highly uncertain regions. is defined as follows:
- (3)
Implementation Costs: To minimize UAV turns and flight distances during the search process, the UAV is guided to complete the task with the lowest execution cost, which is expressed here by the change of UAV yaw angle. N is the control time domain of DMPC. The cost of implementation of the task at time k is defined as:
- (4)
Collision Avoidance Costs: To avoid the collision between UAVs in the process of coordinated search, virtual repulsion is introduced to construct the UAV inter-copter collision prevention mechanism, and is repelled by the repulsive force generated by other UAVs at time k as:
where
denotes the repulsive force exerted by
on
.
is visualized as the arrow pointing away from
toward
in
Figure 2.
denotes the repulsive force coefficient,
denotes the repulsive force factor,
denotes the value of the distance between the UAVs, and
denotes the safe distance between UAVs.
denotes the unit vector from
to
.
denotes the angle between and , and denotes the maximum heading angle generated by repulsion. denotes the angle between the UAV’s position and the repulsive force .
As illustrated in
Figure 2, the dashed lines with arrows represent the heading direction of each UAV (denoted by
for
), while
is the angle between the heading direction of
and the unit vector
, and
is the maximum allowable angle for repulsive force activation.
denotes the angle between the position vector of
at time
,
, and the total repulsive force
. A dynamic repulsive force is generated only when a neighboring UAV falls within the detection sector defined by
and
. For instance,
generates a repulsive force
on
because it is within the sector. Conversely,
is ignored as it exceeds
, and
is ignored as its relative angle exceeds
. The maximum repulsion angle
simulates the limited Field of View (FOV) of directional airborne sensors. From a kinematic perspective, excluding UAVs behind the current UAV prevents unnatural forward acceleration from rear-approaching agents and follows the principle that trailing UAVs are primarily responsible for collision avoidance.
- (5)
Obstacle Avoidance Costs: Each prohibited area is modelled as a hemispherical no-fly zone with centre and radius . The cost of obstacle avoidance is defined as follows:
where
is the shortest Euclidean distance from
to the path
,
is the foot of the perpendicular from
to the path.
Here
penalizes large heading changes, while
and
act as soft constraints, penalizing small inter-UAV distances and proximity to no-fly zones, respectively. In summary, the overall search performance of the multi-UAV system after the control input
is adopted in the state
is defined as:
where
are weight coefficients.
The search performance of the multi-UAV system after
N-step prediction is modeled as follows:
and
are the predictions of the system state and control input at time
k + q, respectively. The optimization model for solving the optimal task decision of the system at time
k can be described as
. Under the DMPC architecture [
6], the overall behavior of the system is determined by each subsystem [
34,
35]. For a decoupled dynamic system, since its state equations are independent of each other, the state equation of the overall system can be expressed as:
, where
denotes the state equation of
. Furthermore, the overall system performance function can be decomposed as:
where
and
are the
N-step predicted state and predicted control input of the
, respectively;
is the set of
N-step predicted states of other UAVs;
is the set of
N-step predicted control inputs of other UAVs. Then, the local optimization control model for the subsystem of
can be formulated as:
where
is the optimal control sequence of
.