Skip to Content
BiomimeticsBiomimetics
  • Article
  • Open Access

21 July 2026

26 Pages

Wolf-Pack-Inspired Distributed Encirclement for UAV–USV Systems via Visual Connectivity Preservation

,
,
,
,
and
1
School of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, China
2
The State Key Laboratory for Turbulence and Complex Systems, School of Advanced Manufacturing and Robotics, Peking University, Beijing 100871, China
3
National Engineering Research Center for Software Engineering, Peking University, Beijing 100871, China
4
SPIC Nuclear Energy Co., Ltd., Yantai 100088, China

Abstract

This paper presents a wolf-pack-inspired distributed encirclement framework for heterogeneous unmanned aerial vehicle–unmanned surface vehicle (UAV–USV) teams operating with limited communication and intermittent visual sensing. The proposed growth-based visual connectivity encirclement (GB-VCE) method separates high-level role evolution from low-level motion execution. Each agent accumulates local evidence from target observation, visual connectivity contribution, motion stability, and platform characteristics, enabling smooth transitions among leader, relay, searcher, and encircler roles. Visual links and relay relations are treated as coordination resources rather than auxiliary sensing constraints, allowing target-related information to propagate through the team without centralized fusion or persistent all-to-all communication. Simulations with paired random seeds show that GB-VCE improves encirclement accuracy, target-information coverage, convergence consistency, and heterogeneous role complementarity compared with fixed-role, static-leader, UAV-only, and USV-only baselines. The results indicate that biomimetic role growth and visual connectivity preservation provide an interpretable and robust coordination principle for air–sea cooperative encirclement.

1. Introduction

Encirclement is a demanding cooperative behavior in which multiple agents must maintain target observability, safe spacing, angular distribution, and robustness to target motion. The problem is particularly challenging for heterogeneous UAV–USV teams: UAVs provide fast repositioning and wide-area visual relay, whereas USVs offer persistent surface-level monitoring but slower dynamics. In maritime missions, continuous communication and global state fusion are often unavailable because of occlusion, bandwidth limits, platform motion, and environmental disturbance. Thus, the central question is how to generate distributed encirclement from local perception while preserving the flow of target-related information.
Table 1 lists the comparison of representative methods for cooperative encirclement and heterogeneous coordination. Existing approaches include geometric enclosing control, optimization and learning-based coordination, and connectivity-aware multi-robot control. Chen et al. [1] developed a monocular vision-based target-enclosing method for USVs under field-of-view constraints and uncertain dynamics. Chen et al. [2] further investigated bearing-only cooperative enclosing for multiple USVs with unknown dynamics and sideslip. Mnih et al. [3] established a deep reinforcement learning framework, while Van Hasselt et al. [4] improved value-estimation stability through double Q-learning. Orr and Dutta [5] reviewed the application of multi-agent deep reinforcement learning to multi-robot systems. Busoniu et al. [6] summarized the principles and challenges of multi-agent reinforcement learning. Lowe et al. [7] proposed a multi-agent actor–critic framework for mixed cooperative–competitive environments. Rashid et al. [8] introduced monotonic value-function factorization for cooperative multi-agent learning, whereas Foerster et al. [9] developed counterfactual policy gradients for multi-agent credit assignment. Although these learning-based approaches improve adaptability, their functional roles are generally implicit. Müller and Hutter [10] studied cooperative vision-based navigation for heterogeneous robot teams. Pesce and Montana [11] investigated connectivity-driven communication for multi-agent coordination, while Shetty et al. [12] proposed decentralized connectivity maintenance under motion and sensing uncertainties. However, these methods rarely combine visual connectivity with an explicit and biologically interpretable role-evolution mechanism for heterogeneous encirclement.
Table 1. Comparison of representative methods for cooperative encirclement and heterogeneous coordination.
Biological collective hunting offers a useful design principle. Wolf-pack and mixed-species hunting studies show that leadership and contribution are not fixed attributes; rather, they emerge from local observation, spatial position, prey response, and the changing contribution of individuals [15]. Goeckner et al. [16] demonstrated that graph-based learning can improve resilient distributed coordination in multi-robot systems. Ning and Xie [13] reviewed adaptive decision-making mechanisms in multi-agent reinforcement learning, while Wang et al. [14] investigated deep-reinforcement-learning-based multi-robot coordination in complex environments. These studies suggest that UAV–USV roles should evolve from accumulated evidence rather than be determined only by instantaneous conditions. In this paper, visual connectivity is therefore treated as a coordination primitive: agents that maintain target-information paths can become relay agents, agents with strong observation and stability can become leaders, and agents with poor information access can search or recover connectivity.
Unlike conventional role-allocation methods based on fixed roles or instantaneous conditions, the proposed mechanism uses accumulated observation, connectivity, stability, and platform information to achieve continuous role evolution. Moreover, visual connectivity is directly incorporated into relay selection and target-information propagation rather than being treated only as a connectivity constraint.
Figure 1 summarizes the biological abstraction used in this work. Cai et al. [17] showed that a biologically inspired gene-regulation network can generate emergent UAV-swarm behaviors from local interactions. Shi et al. [18] investigated communication-connectivity restoration in multi-robot systems. Inspired by these studies, the proposed two-layer framework separates role growth and task-state selection from executable motion control, allowing target search, relay maintenance, tracking, and encirclement behaviors to emerge within the same distributed framework.
Figure 1. Biologically inspired encirclement mechanism.
Compared with representative cooperative encirclement approaches, the principal advantage of GB-VCE lies in extending encirclement from geometric formation regulation to adaptive functional organization. Conventional geometric methods primarily regulate inter-agent distance, bearing, or angular distribution, whereas GB-VCE additionally determines which agents should undertake target guidance, visual relay, search recovery, and geometric enclosure according to their locally evaluated contributions. Unlike fixed-role and static-leader strategies, these functions are not permanently assigned but are reorganized as target observability, visual topology, motion stability, and platform suitability vary. Moreover, the growth-based accumulation of role evidence provides temporal continuity, reducing the sensitivity of instantaneous role-selection schemes to transient sensing and topology fluctuations. In contrast to learning-based coordination, the resulting functional differentiation remains explicit and physically interpretable. Finally, visual connectivity is not treated merely as a feasibility constraint; its contribution is incorporated into role evaluation, so that agents preserving critical target-information paths are actively assigned relay functions. This enables heterogeneous UAVs and USVs to establish complementary roles while maintaining distributed encirclement under constrained communication.
The innovations of this paper are as follows:
  • A wolf-pack-inspired distributed encirclement framework is proposed for heterogeneous UAV–USV teams under communication-constrained visual sensing, enabling cooperative target acquisition, relay maintenance, and encirclement without centralized fusion.
  • A growth-based role-evolution mechanism is developed, in which leader, relay, searcher, and encircler roles emerge from accumulated observation quality, visual connectivity contribution, motion stability, and platform bias.
  • A visual-connectivity-preserving motion-control strategy is designed and validated through multi-seed simulations, showing improved encirclement accuracy, target-information coverage, role stability, and heterogeneous complementarity over baseline methods.

2. Related Work

2.1. Biomimetic Encirclement and Collective Hunting

Biomimetic coordination seeks transferable principles from biological systems rather than literal imitation. For encirclement, the relevant principles are local perception, progressive spatial closure, role differentiation, and resilient information sharing. Xie et al. [19] reviewed the development and future directions of flocking-control models for multi-agent systems. Yan and Su [20] analyzed the role of alignment interactions in the collective behavior of self-propelled particles. Gable et al. [15] showed that the contribution of individual wolves changes with prey size, prey abundance, and provisioning conditions. Sampaio et al. [21] further demonstrated that leadership and collective success in mixed-species hunting groups depend on social influence and group composition. Oh et al. [22] systematically reviewed multi-agent formation-control methods. Cao et al. [23] summarized the theoretical foundations of distributed multi-agent coordination. Ge et al. [24] reviewed distributed coordination under intermittent sampling and communication. Feng et al. [25] discussed resilient cooperative control and optimization, while Wang et al. [26] investigated resilient consensus control under disturbances and failures. These studies motivate an encirclement mechanism that integrates geometric enclosure, visual connectivity preservation, and temporally continuous role growth. These results motivate an encirclement mechanism that combines geometric enclosure, visual connectivity preservation, and temporally continuous role growth.

2.2. Target Enclosing Control and Learning-Based Coordination

Target enclosing has been addressed through bearing control, circular formation control, collision avoidance, and learning-based planning. Chen et al. [1] considered field-of-view constraints and uncertain dynamics in monocular vision-based USV target enclosing. Chen et al. [2] addressed cooperative enclosing using bearing-only measurements under unknown USV dynamics and sideslip. Ma et al. [27] applied deep reinforcement learning to multi-robot target encirclement with collision avoidance. Zhang et al. [28] extended this approach to multi-target encirclement. Lowe et al. [7] developed a multi-agent actor–critic framework for decentralized policy learning. Rashid et al. [8] proposed value-function factorization for cooperative decision making, whereas Foerster et al. [9] introduced counterfactual policy gradients for multi-agent credit assignment. However, the functional division learned by these approaches is generally implicit. Chung et al. [29] reviewed aerial swarm robotics and emphasized the importance of distributed sensing and coordination. Qu et al. [30] applied multi-agent reinforcement learning to cooperative encirclement by autonomous surface vehicles. These studies indicate that sensing and interaction topology are as important as encirclement geometry in air–sea cooperative tasks. The proposed GB-VCE differs by making roles explicit, interpretable, and driven by local visual connectivity evidence.

3. Architecture and Mathematical Model

3.1. Overall Architecture of the Biological Distributed Encirclement Framework

The proposed GB-VCE framework shown in Figure 2 realizes cooperative encirclement of a maneuvering surface target by a heterogeneous UAV–USV team. The architecture contains three coupled modules: visual perception and connectivity evaluation, growth-based role evolution, and role-dependent motion execution. UAVs contribute fast relocation and wide-area visual relay, whereas USVs provide persistent surface-level encirclement. Instead of assigning a permanent leader, the system lets leadership and relay functions emerge from accumulated observation quality, connectivity contribution, and motion stability.
Figure 2. Overall architecture of the proposed UAV–USV biological distributed encirclement framework.
The framework follows a two-layer decision structure shown in Figure 3. The upper layer evaluates biological growth state and role potential, while the lower layer transforms the selected role into executable acceleration and heading commands. This separation keeps the method interpretable: the leader guides target-related encirclement, relay agents preserve visual information propagation, searchers recover target or teammate visibility, and encirclers regulate their angular distribution around the target.
Figure 3. Two-layer distributed decision structure.
At each sampling instant, local measurements update the target observation quality O i ( t ) , the visual graph G v ( t ) , and the connectivity contribution C i ( t ) . These variables drive the growth state z i ( t ) and leadership potential P i ( t ) , after which the role variable is selected as
r i ( t ) ∈ { L , R , S , E } ,
where L, R, S, and E denote leader, relay, searcher, and encircler. The resulting closed loop is summarized by
{ O i ( t ) , G v ( t ) , C i ( t ) } → { g i ( t ) , z i ( t ) , P i ( t ) } → r i ( t ) → ( a i c ( t ) , α i c ( t ) ) → x i ( t + Δ t ) .
where g i ( t ) , z i ( t ) , and  P i ( t ) denote the growth drive, accumulated growth state, and leadership potential, respectively. This loop links perception, role evolution, and motion execution without centralized state fusion.

3.2. Heterogeneous Agent, Target, and Visual Connectivity Model

Let the heterogeneous team be
A = A UAV ∪ A USV , N = | A | .
For agent i, the planar state is denoted by x i = [ p i ⊤ , ψ i , v i , ω i ] ⊤ , where p i ∈ R 2 is position, ψ i is heading, and  v i and ω i are linear and angular velocities. The target state is x T = [ p T ⊤ , v T ⊤ ] ⊤ . Heterogeneity is represented by platform-dependent limits on sensing range, field of view, speed, acceleration, and turning rate.
A visual link from agent i to object j is valid only when range and bearing constraints are both satisfied. With relative vector d i j = p j − p i , the distance condition is ∥ d i j ∥   ≤ R i , and the field-of-view condition is
wrap atan 2 ( d i j , y , d i j , x ) − ψ i ≤ Φ i 2 .
Here, wrap ( · ) maps an angle to the interval ( − π , π ] . The visual accessibility indicator is therefore
δ i j ( t ) = I ∥ d i j ∥   ≤ R i , | β i j ( t ) |   ≤ Φ i / 2 ,
and the visual graph is G v ( t ) = ( A , E v ( t ) ) , where ( i , j ) ∈ E v ( t ) if a bidirectional or task-valid visual relation exists. Target observation quality is normalized as
O i ( t ) = δ i T ( t ) exp − ∥ p i − p T ∥ 2 σ R 2 cos + β i T ( t ) ,
where cos + ( x ) = max ( 0 , cos x ) . Since all factors in Equation (6) are bounded, the resulting observation-quality index satisfies 0 ≤ O i ( t ) ≤ 1 . This normalization provides a dimensionless and comparable measure across heterogeneous UAV and USV sensing conditions, facilitates its integration with the other role-evaluation terms, and supports consistent threshold selection in the subsequent role-evolution process. Connectivity contribution C i ( t ) is computed from the visual graph by combining local degree, bridge contribution, and accessibility to target-observing agents. This term rewards agents that preserve the visual information path rather than merely approaching the target.

3.3. Growth-Based Role Evolution Model

The biomimetic role mechanism treats leadership as a growth process. The instantaneous growth drive of agent i is
g i ( t ) = w O O i ( t ) + w C C i ( t ) + w S S i ( t ) + w H H i ,
where O i ( t ) , C i ( t ) , S i ( t ) , and  H i denote target observation quality, connectivity contribution, motion stability, and heterogeneous platform bias, respectively; w O , w C , w S , and  w H are the corresponding nonnegative weights.
z i ( t + Δ t ) = ( 1 − λ g ) z i ( t ) + Δ t g i ( t ) ,
where λ g is the decay coefficient. This accumulation prevents role changes caused by short visual fluctuations.
Motivated by the observation that leadership and individual contribution in collective hunting vary with local perception, spatial position, and task-dependent contribution [15], and by adaptive role-decision principles in multi-agent systems [13], we define a composite leadership-potential function in this study as
P i ( t ) = η z z i ( t ) + η O O i ( t ) + η C C i ( t ) − η D D i ( t ) ,
where η z , η O , η C , and  η D are weighting coefficients for growth state, observation quality, connectivity contribution, and penalty term, respectively. D i ( t ) penalizes excessive distance or unstable motion. The leader is selected by hysteretic maximization
L ( t ) = arg max i ∈ A P i ( t ) , P L ( t ) ( t ) > P L ( t − ) ( t ) + h L ,
where h L is a switching margin. Relay agents are selected from nodes with high C i ( t ) , searchers are assigned when both observation and connectivity are weak, and the remaining agents are encirclers. This creates explicit and temporally smooth roles, consistent with adaptive biological hunting rather than instantaneous thresholding [13].

3.4. Distributed Encirclement Control Model

For an encircler, the desired position is defined as a point on a circle centered at the estimated target position, so that different encirclers occupy different angular slots around the target:
p i d ( t ) = p ^ T ( t ) + R E cos θ i d ( t ) sin θ i d ( t ) ,
where R E is the desired encirclement radius and θ i d is generated from the angular distribution of active encirclers. Leader and relay agents use the same target reference but add stronger observation and connectivity terms. Search agents move toward the predicted target region or toward positions that increase visual coverage.
The commanded planar acceleration is written as
u i ( t ) = u i role ( t ) + u i conn ( t ) + u i align ( t ) + u i safe ( t ) ,
where the four terms correspond to role objective tracking, visual connectivity maintenance, direction alignment, and collision avoidance. The command is then mapped to the heterogeneous execution model subject to platform limits
a i c = sat a i u i ⊤ e ψ i , α i c = sat α i k ψ wrap ( ψ i d − ψ i ) − k ω ω i .
The feasibility of encirclement is evaluated by success rate, radius error, stable encirclement time, target-information coverage, role switching frequency, and control smoothness. These metrics jointly assess spatial enclosure, visual information preservation, and biological role stability.

4. Methods

GB-VCE comprises three complementary modules for distributed heterogeneous encirclement. The connectivity-aware task-state switching module regulates the transition among target acquisition, connectivity recovery, and cooperative encirclement according to target-information availability, thereby avoiding premature coordination based on incomplete observations. The growth-based role-evolution module adaptively organizes agents into leader, relay, searcher, and encircler roles using accumulated local evidence, providing greater adaptability than fixed role assignment and greater temporal stability than instantaneous selection. The role-dependent control module maps these functional roles to platform-specific motion objectives, enabling UAVs and USVs to exploit their complementary sensing and mobility capabilities more effectively than a unified control strategy. Together, these modules improve information consistency, role reconfiguration, and heterogeneous coordination compared with simpler methods that rely on direct encirclement, static roles, or identical agent behaviors.

4.1. Target Acquisition and Connectivity-Aware Task-State Switching

In heterogeneous pursuit–encirclement missions, target visibility and information accessibility may be intermittent. Therefore, GB-VCE first uses a connectivity-aware task-state switch to distinguish target acquisition, connectivity recovery, and cooperative encirclement. Full encirclement is activated only when at least one valid target observation exists and target-related information is accessible to a sufficient portion of the swarm.
The three task states are defined as follows: target acquisition when no agent observes the target, connectivity recovery when the target is observed but visual information has not propagated sufficiently, and cooperative encirclement when observation and accessibility conditions are both satisfied.
Let A = { 1 , 2 , … , N } denote the heterogeneous team. An observation by agent i is effective when O i ( t ) > ϵ O , yielding
S T ( t ) = i ∈ A ∣ O i ( t ) > ϵ O
A binary target-availability variable is then introduced as
ζ T ( t ) = 1 , S T ( t ) ≠ ⌀ , 0 , S T ( t ) = ⌀ .
Here, ζ T ( t ) indicates whether valid target information is currently available.
A single isolated observation is insufficient for collective encirclement; therefore, target-information accessibility is evaluated on the visual graph. Let A vis ( t ) denote the visual connectivity adjacency matrix. For agent i, the accessibility indicator ξ i ( t ) is defined as
ξ i ( t ) = 1 , agent i is connected to at least one agent in S T ( t ) through A vis ( t ) , 0 , otherwise .
Based on ξ i ( t ) , the target-information coverage ratio of the swarm is defined as
Γ T ( t ) = 1 N ∑ i = 1 N ξ i ( t )
Γ T ( t ) measures the fraction of agents with direct or relayed access to target information.
The control layer uses an estimated target reference. When the target is visible, the estimate is updated as
p ^ T ( t ) = p T ( t ) , v ^ T ( t ) = v T ( t ) , if ζ T ( t ) = 1
and the latest observation time is recorded as t last = t . When the target is temporarily lost but has been observed previously, a constant-velocity prediction model is used
p ^ T ( t ) = p ^ T ( t − Δ t ) + Δ t v ^ T ( t − Δ t ) , if ζ T ( t ) = 0 , t − t last ≤ T lost
where Δ t is the sampling interval and T lost is the maximum allowable duration for short-term target-state prediction. This treatment allows the agents to continue searching around the most probable target region after a temporary loss of visual contact.
If the target has never been observed, or if the target has been lost for longer than T lost , the extrapolated target estimate is no longer regarded as reliable. In this case, the target reference is reset to the global search center p c , and the estimated velocity is set to zero
p ^ T ( t ) = p c , v ^ T ( t ) = 0 , if ζ T ( t ) = 0 , t − t last > T lost
This reset prevents pursuit of unreliable extrapolations and reorganizes the team around a distributed search pattern.
Each agent uses an information-consistent target reference:
p T , i c ( t ) = p T ( t ) , ξ i ( t ) = 1 , p ^ T ( t ) , ξ i ( t ) = 0 ,
and
v T , i c ( t ) = v T ( t ) , ξ i ( t ) = 1 , v ^ T ( t ) , ξ i ( t ) = 0 .
Thus, disconnected agents use predicted references instead of unavailable true target states. The task state is jointly determined by ζ T ( t ) and Γ T ( t ) . If  ζ T ( t ) = 0 , leader election is suspended and all agents search.
The threshold Γ th determines whether dissemination is sufficient. If  ζ T ( t ) = 1 but Γ T ( t ) < Γ th , the team enters connectivity recovery and selects the strongest observer
i L ( t ) = arg max i ∈ S T ( t ) O i ( t )
The observing leader maintains target contact, while other agents execute relay or search motions until visual information becomes sufficiently accessible.
If ζ T ( t ) = 1 and Γ T ( t ) ≥ Γ th , the cooperative-encirclement state activates the growth-based role assignment.
The complete target acquisition and connectivity-aware task-state switching procedure is summarized in Algorithm 1.
Algorithm 1 Connectivity-aware target acquisition and task-state switching.
Require: 
A , { O i ( t ) } i = 1 N , ϵ O , A vis ( t ) , Γ th , ( p ^ T , v ^ T ) , t last , T lost , p c
Ensure: 
M ( t ) , { ( p T , i c , v T , i c ) } i = 1 N , { r i ( t ) } i = 1 N , leader candidate i L ( t )
  1:
S T ( t ) ← { i ∈ A ∣ O i ( t ) > ϵ O }
  2:
Compute ξ i ( t ) from A vis ( t ) and S T ( t ) ; set Γ T ( t ) ← N − 1 ∑ i = 1 N ξ i ( t )
  3:
if  S T ( t ) = ⌀  then
  4:
     ζ T ( t ) ← 0 , M ( t ) ← target acquisition state
  5:
    Suspend leader election; assign r i ( t ) ← R S , ∀ i ∈ A
  6:
    if target has been observed before and t − t last ≤ T lost  then
  7:
         p ^ T ( t ) ← p ^ T ( t − Δ t ) + Δ t v ^ T ( t − Δ t )
  8:
    else
  9:
         p ^ T ( t ) ← p c , v ^ T ( t ) ← 0
10:
    end if
11:
    Set ( p T , i c ( t ) , v T , i c ( t ) ) ← ( p ^ T ( t ) , v ^ T ( t ) ) , ∀ i ∈ A
12:
else
13:
     ζ T ( t ) ← 1
14:
     p ^ T ( t ) ← p T ( t ) , v ^ T ( t ) ← v T ( t ) , t last ← t
15:
    Set ( p T , i c ( t ) , v T , i c ( t ) ) ← ( p T ( t ) , v T ( t ) ) for agents with ξ i ( t ) = 1 , and  ( p ^ T ( t ) , v ^ T ( t ) ) for agents with ξ i ( t ) = 0
16:
     i L ( t ) ← arg max i ∈ S T ( t ) O i ( t )
17:
    if  Γ T ( t ) < Γ th  then
18:
         M ( t ) ← connectivity-recovery state
19:
        Assign r i L ( t ) ← R L ; assign non-leader agents to relay-oriented or search-oriented recovery
20:
    else
21:
         M ( t ) ← cooperative-encirclement state
22:
        Activate growth-based adaptive role assignment
23:
    end if
24:
end if
25:
return  M ( t ) , { ( p T , i c ( t ) , v T , i c ( t ) ) } i = 1 N , { r i ( t ) } i = 1 N , i L ( t )

4.2. Growth-Based Adaptive Role Assignment

Once cooperative encirclement is active, agents are assigned to functional roles according to accumulated growth evidence rather than fixed labels.
The growth state integrates observation quality, connectivity contribution, stability, and platform bias, thereby filtering transient sensing errors and topology fluctuations.
Leader selection uses accumulated leadership potential with switching margin and holding-time constraints. Relay agents preserve visual information paths, searchers recover weak observation/connectivity, and the remaining agents form the encirclement ring.
In Algorithm 2, the auxiliary variable g ˜ i ( t ) denotes the instantaneous growth drive before temporal smoothing. The relay score Ψ i Re ( t ) evaluates whether agent i is suitable for maintaining visual information paths. Here, d i L ( t ) = ∥ p i ( t ) − p i L ( t ) ∥ and d i T ( t ) = ∥ p i ( t ) − p T , i c ( t ) ∥ denote the distances from agent i to the current leader and to its target reference, respectively. N Re is the prescribed number of relay agents selected from the remaining agents according to the relay score. The variables τ i S ( t ) and σ i S ( t ) denote the duration of poor observation/connectivity and the binary searcher-state flag, respectively. The thresholds O low , O rec , C low T , and  C rec T define the entry and recovery conditions for the searcher role, where C i T ( t ) measures the local accessibility of target-related information. The sets A rem , A Re , A res , A S , and  A E denote the remaining agents after leader selection, selected relay agents, residual agents after relay selection, searchers, and encirclers, respectively.
Algorithm 2 Growth-based adaptive role assignment.
Require: 
M ( t ) , A , i L ( t − Δ t ) , { r i ( t − Δ t ) } i = 1 N , { g i ( t − Δ t ) } i = 1 N , { P i ( t − Δ t ) } i = 1 N
Ensure: 
{ r i ( t ) } i = 1 N , i L ( t )
  1:
if  M ( t ) ≠ M CE  then
  2:
     { r i ( t ) } i = 1 N ← { r i ( t − Δ t ) } i = 1 N ,     i L ( t ) ← i L ( t − Δ t )
  3:
    return  { r i ( t ) } i = 1 N , i L ( t )
  4:
end if
  5:
for  i = 1 to N do
  6:
     g ˜ i ( t ) ← f g O i ( t ) , C i ( t ) , S i ( t ) , H i
  7:
     g i ( t ) ← λ g g i ( t − Δ t ) + ( 1 − λ g ) g ˜ i ( t )
  8:
     P i ( t ) ← f L g i ( t ) , O i ( t ) , C i ( t ) , S i ( t ) , H i
  9:
end for
10:
i L cand ← arg max i ∈ A P i ( t ) ,     Δ P L ← P i L cand ( t ) − P i L ( t − Δ t ) ( t )
11:
i L ( t ) ← i L cand , Δ P L ≥ Δ P th and T L ( t ) ≥ T L min , i L ( t − Δ t ) , otherwise .
12:
r i L ( t ) ( t ) ← R L ,     A rem ← A ∖ { i L ( t ) }
13:
for  i ∈ A rem  do
14:
    Ψ i Re ( t ) ← f Re C i ( t ) , d i L ( t ) , d i T ( t ) , O i ( t )
15:
end for
16:
A Re ← TopK i ∈ A rem Ψ i Re ( t ) , N Re
17:
A res ← A rem ∖ A Re
18:
for  i ∈ A res  do
19:
     τ i S ( t ) ← τ i S ( t − Δ t ) + Δ t , O i ( t ) < O low and C i T ( t ) < C low T , 0 , otherwise .
20:
     σ i S ( t ) ← 1 , τ i S ( t ) ≥ T S in , 0 , O i ( t ) ≥ O rec or C i T ( t ) ≥ C rec T , σ i S ( t − Δ t ) , otherwise .
21:
end for
22:
A S ← { i ∈ A res ∣ σ i S ( t ) = 1 } ,     A E ← A res ∖ A S
23:
r i ( t ) ← R Re , ∀ i ∈ A Re ;     r i ( t ) ← R S , ∀ i ∈ A S ;     r i ( t ) ← R E , ∀ i ∈ A E
24:
return  { r i ( t ) } i = 1 N , i L ( t )
The output of this module is not a direct motion command, but a role label for each agent. These role labels are passed to the role-dependent motion-control module in Section 4.3, where they are converted into executable motion objectives. The complete procedure is summarized in Algorithm 2.

4.3. Role-Dependent Motion Control

The role-dependent motion-control module converts the task state and adaptive role assignment into physically feasible motion commands for the heterogeneous UAV–USV swarm. In contrast to a fixed formation controller, the proposed controller does not impose an identical motion objective on all agents. Instead, each agent generates its motion command according to its current biological role, locally accessible target reference, visual-neighbor topology, and platform-dependent dynamic constraints. This design allows target guidance, information relay, search recovery, and encirclement formation to be executed within a unified distributed control process.
At each control step, the current role selects a role-specific virtual velocity: target guidance for the leader, information-path maintenance for relays, exploration for searchers, and ring tracking for encirclers. Agent-wise target references ensure distributed information consistency.
For agent i, the heading-alignment term is obtained by averaging the unit heading vectors of its currently visible neighbors:
v ¯ i ( t ) = 1 | N i v ( t ) | ∑ j ∈ N i v ( t ) cos ψ j ( t ) sin ψ j ( t ) ,
where N i v ( t ) denotes the visual-neighbor set of agent i. If no visual neighbor is available, v ¯ i ( t ) is set to zero. The term k align v ¯ i ( t ) is added to the role-dependent desired velocity to improve local directional consistency without overriding the primary role objective.
Connectivity-maintenance and heading-alignment corrections are then added before bounded acceleration commands are generated under UAV/USV-specific limits.
Algorithm 3 summarizes the role-dependent controller.
Algorithm 3 Role-dependent motion control.
Require: 
Agent states { p i , ψ i , v i , ω i } i = 1 N , roles { r i } i = 1 N , target references { ( p T , i c , v T , i c ) } i = 1 N , visual graph A vis , leader i L , platform limits
Ensure: 
Control inputs { a i c , α i c } i = 1 N and updated states
  1:
for  i = 1  to N do
  2:
    Compute r i T ← p i − p T , i c , d i T ← ∥ r i T ∥ , e r , i ← r i T / ( d i T + ε ) , e t , i ← [ − e r , i y , e r , i x ] ⊤
  3:
    if  r i = R L  then
  4:
         p L d ← p T , i c + γ L R E [ − v T , i c , y , v T , i c , x ] ⊤ / ( ∥ v T , i c ∥ + ε )
  5:
         v i , role ref ← k L ( p L d − p i ) + k L T v T , i c + k L o e t , i
  6:
    else if  r i = R Re  then
  7:
         p mid ← λ L p i L + ( 1 − λ L ) p T , i c
  8:
         v i , role ref ← k R e ( p mid − p i ) + k conn v i conn + k R T v T , i c
  9:
    else if  r i = R S  then
10:
         θ i S ← ω S t + ϕ i , p i S ← p T , i c + r S [ cos θ i S , sin θ i S ] ⊤
11:
         v i , role ref ← k S 1 ( p i S − p i ) + k S 2 ( p T , i c − p i )
12:
    else
13:
         φ i d ← 2 π k i / N E , p i E ← p T , i c + R E [ cos φ i d , sin φ i d ] ⊤
14:
         v i , role ref ← k E ( p i E − p i ) + k o e t , i + k E T v T , i c
15:
    end if
16:
     N i v ← { j ∈ A ∖ { i } ∣ A vis , i j = 1 }
17:
    Compute v i cm from pairwise visual-neighbor distance regulation, and compute v ¯ i from average neighbor heading alignment
18:
     v i des ← v i , role ref + k cm v i cm + k align v ¯ i
19:
     s i ← ∥ v i des ∥ , ψ i ref ← atan 2 ( v i , y des , v i , x des ) , e ψ , i ← wrap ( ψ i ref − ψ i )
20:
     v i ref ← min ( v χ i max , s i ) max ( η min , cos e ψ , i )
21:
     ω i ref ← sat ( k ψ ref e ψ , i , − ω χ i max , ω χ i max )
22:
     a i c ← sat ( k v ( v i ref − v i ) , a χ i min , a χ i max )
23:
     α i c ← sat ( k ω ( ω i ref − ω i ) , − α χ i max , α χ i max )
24:
    Apply velocity-boundary protection to a i c and α i c
25:
    Update x i , y i , ψ i , v i , and  ω i using the discrete-time second-order motion model
26:
end for
27:
return  { a i c , α i c } i = 1 N and updated states

5. Experimental Setup

5.1. Simulation Environment

All simulations were implemented in MATLAB 2023a on a local workstation equipped with an Intel R12 12700H CPU, 16 GB of RAM, and an NVIDIA RTX 3070 GPU. Table 2 lists the environment and platform parameters.
Table 2. Simulation environment parameters.

5.2. Algorithm Parameters

The key motion-control and role-evolution parameters are listed in Table 3 and Table 4. To improve reproducibility, the evaluated ranges and selection rationale are provided for the parameters that most directly affect convergence, visual connectivity preservation, and role stability.
Table 3. Key motion-control hyperparameters.
Table 4. Key role-evolution hyperparameters.
The experimental tuning was performed in a staged manner. The motion-control gains were tuned while keeping the role-evolution parameters fixed. The objective of this stage was to ensure that agents could follow their role-dependent reference motions without obvious oscillation or excessive control effort. The role-evolution parameters were tuned while using the selected motion-control gains. This stage focused on reducing transient role switching and maintaining sufficient target-information coverage. The combined parameter set was checked through preliminary paired-seed simulations under the same randomized initial perturbations used in the main experiments.
The final parameters were selected according to four criteria: stable encirclement success, radius error, target-information coverage, and role switching stability. Parameter settings that improved one metric but caused severe degradation in another metric were not used. For example, excessively large tracking gains accelerated convergence but increased oscillatory motion, while overly small leader-switching margins improved responsiveness but caused frequent leader changes.
In general, larger tracking gains accelerate convergence but may increase control effort and oscillatory motion. Smaller tracking gains improve smoothness but delay stable encirclement. A larger growth decay coefficient, switching margin, or holding time reduces frequent role changes, but may slow adaptation to visual-topology changes. The observation and connectivity weights determine the balance between target tracking and information preservation: excessive observation weighting tends to favor target-facing agents, whereas excessive connectivity weighting may delay spatial encirclement by overemphasizing relay behavior. Therefore, the selected values represent a trade-off among convergence speed, radius accuracy, visual connectivity preservation, and role stability.

5.3. Evaluation Metrics

We evaluate the performance of each method using the following metrics:
  • Final success metric: The composite encirclement score at the final simulation step.
  • Mean success score in the last 20 steps: The average composite score during the final stage of each run.
  • Post-stabilization mean score: The average composite score after stable encirclement is first reached.
  • Radius error: The deviation between the achieved encirclement radius and the desired radius.
  • Stable encirclement time: The time required for the team to first reach stable encirclement.
  • Stable reached rate: The proportion of runs in which stable encirclement is successfully achieved.
  • Coverage ratio: The fraction of agents with direct or relayed access to target information.
  • Visual connectivity: The average strength of valid visual links in the team.
  • Geometric score: A normalized score measuring radius accuracy and angular distribution.
  • Information score: A normalized score measuring target-information availability within the team.
  • Role switches: The total number of role changes during one run.
  • Leader switches: The number of leader changes during one run.
  • Control effort: The accumulated motion-control cost during the simulation.
  • Composite value index: An overall normalized index combining convergence, radius accuracy, information availability, visual connectivity, and control effort.
  • Mean rank and best count: Ranking-based indicators used to compare UAV-only, USV-only, and UAV–USV configurations across multiple metrics.

5.4. Statistical Significance Analysis

To verify whether the observed performance gains were statistically reliable, a paired Wilcoxon signed-rank test was conducted. Since all compared methods were evaluated under identical random seeds and perturbed initial conditions, the results form paired samples. The significance level was set to p < 0.05 .
The test focuses on the comparison between GB-VCE and the static-leader baseline, because static-leader is the stronger baseline and reaches stable encirclement in most runs, whereas fixed-role fails to reach stable encirclement in all 100 runs. The tested metrics include final success metric, stable encirclement time, final radius error, post-stabilization target-information coverage, and mean information score.

6. Results and Performance Analysis

6.1. Computational-Time Analysis

The computational cost of the proposed GB-VCE framework was evaluated in terms of wall-clock simulation time. All simulations were executed on the workstation described above, and the reported values were obtained from 100 independent runs under identical experimental settings. In the strategy-comparison study, the average computational times of the fixed-role, static-leader, and GB-VCE models were 1.1371 ± 0.1591   s , 2.0811 ± 0.3374   s , and 1.5198 ± 0.2040   s per 200 s simulated mission, respectively. The corresponding average computation time of GB-VCE was approximately 1.518   ms per control step. In the heterogeneous-value study, the UAV-only, USV-only, and heterogeneous UAV–USV configurations required 1.9405 ± 0.3426   s , 1.4383 ± 0.2609   s , and 1.3390 ± 0.1754   s per run, respectively. In all evaluated cases, the average computation time per control step remained substantially below the adopted sampling interval of 0.2   s . These results indicate that the computational burden of GB-VCE is compatible with online execution under the tested simulation settings.
Table 5 summarizes the computational time of the evaluated simulation studies over 100 independent runs.
Table 5. Computational time of the evaluated simulation studies over 100 independent runs.

6.2. Encirclement Performance Comparison

The proposed GB-VCE method was evaluated against fixed-role and static-leader baselines using 100 independent paired-seed runs. The use of 100 runs reduces the influence of random initial positions and target-motion perturbations and provides a sufficiently large sample for reliable statistical comparison. For each seed, all compared methods were evaluated under the same perturbed initial conditions, so the observed differences mainly reflect the coordination strategy rather than random variation.
Table 6 shows that GB-VCE achieves the strongest spatial encirclement performance. It obtains the highest final success metric ( 0.644 ± 0.060 ), the highest post-stabilization score ( 0.640 ± 0.009 ), and the lowest final radius error ( 1.040 ± 1.034   m ). Compared with the static-leader baseline, GB-VCE reduces stable encirclement time from 68.29 ± 41.15   s to 40.65 ± 11.25   s and reaches stability in all 100 runs, indicating faster and more consistent convergence.
Table 6. Statistical comparison of encirclement performance over 100 independent paired-seed runs.
Table 7 further explains the source of this improvement. GB-VCE achieves the highest final coverage ratio ( 0.726 ± 0.066 ) and post-stabilization coverage ( 0.692 ± 0.018 ), and substantially improves the mean information score in the last 20 steps from 0.490 ± 0.044 for static-leader to 0.716 ± 0.016 . Although its role switches are higher than in fixed-role, fixed-role never reaches stable encirclement; compared with static-leader, GB-VCE reduces role switches from 273.96 ± 54.53 to 130.27 ± 27.71 .
Table 7. Statistical comparison of information coverage, visual connectivity, role adaptation, and control smoothness over 100 independent paired-seed runs.
Table 8 reports the paired Wilcoxon signed-rank test results between GB-VCE and the static-leader baseline. The results show that GB-VCE achieves statistically significant improvements in the main performance dimensions. Specifically, GB-VCE improves the final success metric from 0.5978 to 0.6435 ( p = 6.81 × 10 − 3 ), reduces the stable encirclement time from 68.29   s to 40.85   s ( p = 1.22 × 10 − 13 ), and decreases the final radius error from 2.8505   m to 1.0397   m ( p = 1.45 × 10 − 12 ). In addition, GB-VCE significantly improves post-stabilization target-information coverage and mean information score. These results confirm that the observed performance gains are statistically supported rather than caused by random variations.
Table 8. Statistical significance test between GB-VCE and the static-leader baseline.

Representative Dynamics and Statistical Dispersion

Figure 4, Figure 5, Figure 6, Figure 7 and Figure 8 visualize the same trend from time-series, distributional, and snapshot perspectives.
Figure 4. Temporal evolution of representative encirclement-performance metrics for the fixed-role, static-leader, and proposed GB-VCE methods over paired-seed simulations.
Figure 5. Box-scatter distributions of final success score, stable encirclement time, radius error, information coverage, visual connectivity, and control-related metrics for the compared methods.
Figure 6. Representative encirclement snapshots of fixed-role (a–d), static-leader (e–h), and GB-VCE (i–l) methods at different mission stages.
Figure 7. Normalized radar comparison of the fixed-role, static-leader, and proposed GB-VCE methods across success score, radius accuracy, information coverage, role stability, visual connectivity, and control smoothness.
Figure 8. Recovery-to-encirclement snapshots showing visual relay formation and target-information propagation. UAV-only (a–d), USV-only (e–h) and UAV-USV (i–l).
The performance curves in Figure 4 show that GB-VCE rises faster and stabilizes at a higher score than the baselines. The fixed-role method remains limited by its inability to redistribute sensing and relay functions, whereas the static-leader method improves convergence but is more sensitive to initial visibility and leader placement.
The box-scatter results in Figure 5 indicate that GB-VCE has both higher median performance and smaller dispersion, especially for final success and radius-error metrics. This supports the conclusion that growth-based role evolution improves not only average performance but also run-to-run reliability.
Figure 6 qualitatively shows the formation process, while the quantitative results in Table 6 and Table 7 confirm the smaller final radius error, higher geometric score, and better information coverage of GB-VCE. GB-VCE forms a tighter and more symmetric encirclement ring around the target than the fixed-role and static-leader baselines.
The normalized radar comparison in Figure 7 illustrates the trade-off among success score, radius accuracy, information coverage, role stability, and control smoothness. GB-VCE provides the most balanced profile, which is important for heterogeneous UAV–USV deployment where a single metric cannot capture mission quality.

6.3. Heterogeneous Value Verification

To isolate the value of platform heterogeneity, the proposed role-evolution mechanism was also tested with UAV-only, USV-only, and UAV–USV teams under the same number of agents and paired seeds.
Figure 8 compares the recovery-to-encirclement process for UAV-only, USV-only, and heterogeneous UAV–USV teams. UAV-only teams are fast and agile, bridging information gaps quickly but with less stable coverage. USV-only teams maintain stable encirclement but converge slowly. The heterogeneous UAV–USV team combines both strengths: UAVs act as fast information relays, while USVs provide a stable encirclement backbone, achieving both rapid convergence and robust, complete coverage.
Figure 9 compares the average performance of UAV-only, USV-only, and UAV–USV teams in terms of convergence time, post-stabilization score, radius error, information coverage, visual connectivity, control effort, and composite value. The dynamic curves in in Figure 9 show that the UAV-only team converges quickly but with higher control activity, while the USV-only team is smoother but slower. The heterogeneous UAV–USV team achieves the most favorable balance between convergence, radius accuracy, and stable behavior.
Figure 9. Temporal performance comparison of UAV-only, USV-only, and heterogeneous UAV–USV teams.
The bar comparison in in Figure 10 confirms that heterogeneity is most beneficial for task-critical encirclement accuracy and composite value rather than for every individual metric. This is consistent with the biological interpretation: mixed functional capabilities improve group-level performance through complementarity.
Figure 10. Statistical comparison of homogeneous and heterogeneous platform configurations over multi-seed simulations.
Table 9 quantifies this effect. UAV–USV obtains the highest post-stabilization score and the lowest stable radius error among the three platform configurations. Although UAV-only reaches stable encirclement faster and USV-only yields lower control effort, the heterogeneous team provides the best overall trade-off.
Table 9. Multi-seed statistical comparison of different platform configurations.
The gain is calculated relative to the best homogeneous baseline under the same random seed, providing a conservative comparison of heterogeneous complementarity. Figure 11 shows that the UAV–USV team consistently improves the most task-critical metric, radius error, relative to homogeneous baselines. The conservative per-seed best-baseline comparison should therefore be interpreted as a strict test: even under this reference, the heterogeneous system retains a clear advantage in encirclement accuracy.
Figure 11. Performance gain of the heterogeneous UAV–USV team over homogeneous baselines.

Role Complementarity in the Heterogeneous Team

Figure 12 reveals a clear emergent division of labor. UAVs spend most of the stable phase as relay agents, using their mobility and observation flexibility to maintain visual information paths. USVs spend most of the stable phase as encircling agents, exploiting their smoother motion to maintain the surrounding ring. This role complementarity explains why the heterogeneous team obtains the lowest radius error and highest composite value: UAVs support information flow and fast adjustment, while USVs provide persistent geometric enclosure.
Figure 12. Stable-phase role allocation shares of UAVs and USVs in the heterogeneous team.
Overall, the experiments verify that GB-VCE improves encirclement by coupling biomimetic role growth with visual connectivity preservation. The method achieves better spatial accuracy, more reliable target-information propagation, smoother role differentiation, and stronger heterogeneous complementarity than the evaluated baselines. The organization and definitions of the simulation data supporting the reported statistical results are provided in Appendix A.

7. Conclusions and Future Work

This paper proposed GB-VCE, a wolf-pack-inspired distributed encirclement framework for heterogeneous UAV–USV teams operating under visual connectivity constraints. The method translates biological role differentiation into a two-layer robotic coordination architecture: the upper layer accumulates local growth evidence to select leader, relay, searcher, and encircler roles, while the lower layer converts the selected role into bounded motion commands for heterogeneous platforms. By using visual links and relay relations as coordination resources, GB-VCE avoids dependence on centralized fusion or persistent all-to-all communication.
Simulation results over 100 paired-seed runs demonstrate that GB-VCE improves both convergence and stable encirclement quality. Compared with fixed-role and static-leader baselines, the proposed method achieves the highest final success metric, the lowest final radius error, faster stable encirclement, and higher target-information coverage. The heterogeneous verification further shows that UAV–USV cooperation provides a better balance than UAV-only or USV-only teams: UAVs mainly emerge as relay agents that maintain information flow, while USVs mainly serve as encircling agents that stabilize the surrounding geometry. These results confirm that biomimetic role growth can transform platform heterogeneity into measurable cooperative performance gains.
The current study still has several limitations. The validation is simulation-based, and the target dynamics, sensing uncertainty, communication delay, localization error, environmental disturbances, and aerodynamic and hydrodynamic effects are simplified. In addition, the current framework considers planar motion and single-target encirclement. Future work will introduce a high-fidelity air–sea simulation environment, hardware-in-the-loop validation, and physical UAV–USV experiments. Three-dimensional UAV motion, multi-target encirclement, and more realistic sensing, communication, and environmental models will also be investigated.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/biomimetics11070513/s1. Table S1: Strategy Comparison All Seed Metrics. Table S2: Strategy Comparison Significance Tests. Table S3: Strategy Comparison Metric Definitions. Table S4: Heterogeneous Study All Trials. Table S5: Heterogeneous Gain All Seeds. Table S6: Heterogeneous Role Complementarity.

Author Contributions

Conceptualization, J.X. and S.K.; methodology, J.X.; software, J.X.; validation, S.K., J.X. and J.Y.; formal analysis, J.X. and S.K.; investigation, F.W., Y.L. and J.S.; resources, J.Y.; data curation, F.W. and J.S.; writing—original draft preparation, J.X. and S.K.; writing—review and editing, S.K.; visualization, S.K.; supervision, J.S.; project administration, J.Y.; funding acquisition, J.Y. and S.K. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported in part by the National Natural Science Foundation of China under Grant 62573007, Grant 62433021, Grant 62533001, and 62533014, in part by the Beijing Natural Science Foundation under Grant 4242038.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

The simulation data supporting the findings of this study are described in Appendix A and provided in the accompanying Supplementary Materials. The Supplementary Files include per-seed results for the strategy-comparison and heterogeneous-value studies, statistical-test outputs, metric definitions, heterogeneous-gain and role-complementarity data, and computational-time records. Additional information is available from the corresponding authors upon reasonable request.

Conflicts of Interest

Yingnan Li and Fang Wu were employed by the company SPIC Nuclear Energy Co. Ltd. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Dual-Use Research of Concern Statement

Current research is limited to cooperative robots, which is beneficial for swarm intelligence researches and does not pose a threat to public health or national security. Authors acknowledge the dual use potential of the research involving autonomous robot control technologies and confirm that all necessary precautions have been taken to prevent potential misuse. As an ethical responsibility, authors strictly adhere to relevant national and international laws regarding DURC. Authors advocate for responsible deployment, ethical considerations, regulatory compliance, and transparent reporting to mitigate misuse risks and foster beneficial outcomes.

Appendix A. Simulation Data Supporting the Statistical Analysis

The simulation data were generated from 100 paired random seeds for each evaluated method or platform configuration. Each run represented a 200 s simulated mission with a sampling interval of 0.2 s, corresponding to 1001 simulation steps. Under the same random seed, the compared methods or platform configurations were evaluated using matched initial-condition and target-motion perturbations.
Two groups of simulation data were generated. The strategy-comparison dataset contains the results of the fixed-role, static-leader, and proposed GB-VCE methods. The heterogeneous-value dataset contains the results of the UAV-only, USV-only, and heterogeneous UAV–USV configurations. The recorded variables include encirclement performance, convergence time, radius error, target-information coverage, visual connectivity, role transitions, control effort, heterogeneous gain, and computational time.
The Supplementary Data files and their correspondence to the results reported in the main text are summarized in Table A1.
The complete per-seed data are provided in machine-readable CSV format. The strategy-comparison dataset contains 300 records, corresponding to 100 seeds and three methods. The heterogeneous-value dataset also contains 300 records, corresponding to 100 seeds and three platform configurations. Summary statistics, confidence intervals, significance-test results, and heterogeneous-gain measures reported in the main text were calculated from these per-seed records.
Table A1. Supplementary Data files supporting the reported simulation results.
Table A2. Principal data fields used in the statistical analyses.

References

  1. Chen, Z.; Chen, X.; Liu, Z.; Huang, F. Monocular vision-based target enclosing control for USVs with FOV constraint and uncertain dynamics. IEEE Trans. Ind. Inform. 2026, 22, 4681–4692. [Google Scholar] [CrossRef] [Scilit]
  2. Chen, X.; Huang, F.; Pan, Y.-J.; Chen, Z. Bearing-only-based cooperative target enclosing control for multiple uncrewed surface vehicles with unknown dynamics and sideslip. IEEE J. Ocean. Eng. 2025, 50, 1015–1029. [Google Scholar]
  3. Mnih, V.; Kavukcuoglu, K.; Silver, D.; Rusu, A.A.; Veness, J.; Bellemare, M.G.; Graves, A.; Riedmiller, M.; Fidjeland, A.K.; Ostrovski, G. Human-level control through deep reinforcement learning. Nature 2015, 518, 529–533. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  4. Van Hasselt, H.; Guez, A.; Silver, D. Deep reinforcement learning with double Q-learning. In Proceedings of the 30th AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA, 12–17 February 2016; Volume 30, pp. 2094–2100. [Google Scholar]
  5. Orr, J.; Dutta, A. Multi-agent deep reinforcement learning for multi-robot applications: A Survey. Sensors 2023, 23, 3625. [Google Scholar] [PubMed]
  6. Busoniu, L.; Babuska, R.; De Schutter, B. Multi-agent reinforcement learning: An overview. Innov. Multi-Agent Syst. Appl. 2010, 310, 183–221. [Google Scholar] [CrossRef] [Scilit]
  7. Lowe, R.; Wu, Y.; Tamar, A.; Harb, J.; Abbeel, P.; Mordatch, I. Multi-agent actor-critic for mixed cooperative-competitive environments. Adv. Neural Inf. Process. Syst. 2017, 30, 6379–6390. [Google Scholar]
  8. Rashid, T.; Samvelyan, M.; De Witt, C.S.; Farquhar, G.; Foerster, J.; Whiteson, S. QMIX: Monotonic value function factorization for deep multi-agent reinforcement learning. In Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden, 10–15 July 2018; Volume 80, pp. 4295–4304. [Google Scholar]
  9. Foerster, J.; Farquhar, G.; Afouras, T.; Nardelli, N.; Whiteson, S. Counterfactual multi-agent policy gradients. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence, New Orleans, LA, USA, 2–7 February 2018; Volume 32, pp. 2974–2982. [Google Scholar]
  10. Müller, M.; Hutter, M. Cooperative vision-based navigation for heterogeneous robot teams. Rob. Auton. Syst. 2019, 117, 233–245. [Google Scholar]
  11. Pesce, E.; Montana, G. Learning multi-agent coordination through connectivity-driven communication. Mach. Learn. 2023, 112, 483–514. [Google Scholar]
  12. Shetty, A.; Hussain, T.; Gao, G.X. Decentralized connectivity maintenance for multi-robot systems under motion and sensing uncertainties. Navigation 2023, 70, 552. [Google Scholar] [CrossRef] [Scilit]
  13. Ning, Z.; Xie, L. A survey on multi-agent reinforcement learning and its application. J. Autom. Intell. 2024, 3, 73–91. [Google Scholar] [CrossRef] [Scilit]
  14. Wang, D.; Deng, H.; Pan, Z. Multirobot coordination with deep reinforcement learning in complex environments. Expert Syst. Appl. 2021, 180, 115128. [Google Scholar] [CrossRef] [Scilit]
  15. Gable, T.D.; Johnson-Bice, S.M.; Homkes, A.T.; Windels, S.K.; Bump, J.K. Differential provisioning roles, prey size, and prey abundance shape the dynamic feeding behavior of gray wolves. Commun. Biol. 2023, 6, 1045. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  16. Goeckner, A.; Sui, Y.; Martinet, N.; Li, X.; Zhu, Q. Graph neural network-based multi-agent reinforcement learning for resilient distributed coordination of multi-robot systems. In Proceedings of the 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Abu Dhabi, United Arab Emirates, 14–18 October 2024; pp. 5732–5739. [Google Scholar]
  17. Cai, Y.; Li, H.; Hong, J.; Xu, P.; Cheng, H.; Zhu, X.; Hu, B.; Hao, Z.; Fan, Z. VG-Swarm: A vision-based gene regulation network for UAVs swarm behavior emergence. IEEE Robot. Autom. Lett. 2023, 8, 1175–1182. [Google Scholar]
  18. Shi, G.; Ishat-E-Rabban, M.; Bonner, G.; Tokekar, P. Fast k-connectivity restoration in multi-robot systems for robust communication maintenance: Algorithmic and learning-based solutions. Auton. Robot. 2025, 49, 34. [Google Scholar] [CrossRef] [Scilit]
  19. Xie, J.; Zhong, Y.; Cui, Y. Advances and future directions in flocking control models for multi-agent systems. In Proceedings of the 2025 5th International Conference on Automation Control, Nanjing, China, 6–8 June 2025; pp. 477–482. [Google Scholar]
  20. Yan, R.; Su, J. Mechanism of the nonequilibrium phase transition in self-propelled particles with alignment. Phys. Rev. Res. 2025, 7, 33082. [Google Scholar] [CrossRef] [Scilit]
  21. Sampaio, E.; Sridhar, V.H.; Francisco, F.A.; Weitekamp, C.A.; Romanczuk, P.; Gingins, S.; Thünken, T.; Bshary, R. Multidimensional social influence drives leadership and composition-dependent success in octopus–fish hunting groups. Nat. Ecol. Evol. 2024, 8, 2072–2084. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  22. Oh, K.-K.; Park, M.-C.; Ahn, H.-S. A survey of multi-agent formation control. Automatica 2015, 53, 424–440. [Google Scholar] [CrossRef] [Scilit]
  23. Cao, Y.; Yu, W.; Ren, W.; Chen, G. An overview of recent progress in the study of distributed multi-agent coordination. IEEE Trans. Ind. Inform. 2013, 9, 427–438. [Google Scholar] [CrossRef] [Scilit]
  24. Ge, X.; Han, Q.-L.; Zhang, X.-M.; Ding, D. Distributed coordination control of multi-agent systems under intermittent sampling and communication: A comprehensive survey. Sci. China Inf. Sci. 2025, 68, 151201. [Google Scholar] [CrossRef] [Scilit]
  25. Feng, Z.; Dong, X.; Hu, G.; Lyu, J. Resilient Cooperative Control and Optimization of Multi-Agent Systems; Academic Press: Cambridge, MA, USA, 2025. [Google Scholar]
  26. Wang, J.; Deng, X.; Guo, J.; Zeng, Z. Resilient consensus control for multi-agent systems. Sensors 2023, 23, 2904. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  27. Ma, J.; Lu, H.; Xiao, J.; Zeng, Z.; Zheng, Z. Multi-robot target encirclement control with collision avoidance via deep reinforcement learning. J. Intell. Robot. Syst. 2020, 99, 371–386. [Google Scholar]
  28. Zhang, T.; Li, Q.; Zhang, C.-S.; Liang, H.-W.; Li, P.; Wang, T.M.; Li, S.; Zhu, Y.-L.; Wu, C. Multi-target encirclement with collision avoidance via deep reinforcement learning. In Proceedings of the 2022 International Conference on Robotics and Automation (ICRA); IEEE: Piscataway, NJ, USA, 2022; pp. 6900–6906. [Google Scholar]
  29. Chung, S.-J.; Paranjape, A.A.; Dames, P.; Shen, S.; Kumar, V. A survey on aerial swarm robotics. IEEE Trans. Robot. 2018, 34, 837–855. [Google Scholar] [CrossRef] [Scilit]
  30. Qu, X.; Li, C.; Jiang, S.; Liu, G.; Zhang, R. Multi-agent reinforcement learning-based cooperative encirclement control of autonomous surface vehicles against multiple targets. J. Mar. Sci. Eng. 2025, 13, 1558. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.