Next Article in Journal
AIFloodSense: A Global Aerial Imagery Dataset for Semantic Segmentation and Understanding of Flooded Environments
Next Article in Special Issue
A Small Object Detection Transformer for UAV Remote Sensing Imagery via Multi-Scale Perception and Cross-Spatial-Frequency Domain Fusion
Previous Article in Journal
Hierarchical Extraction and Multi-Feature Optimization of Complex Crop Planting Structures in the Hetao Irrigation District Based on Multi-Source Remote Sensing Data
Previous Article in Special Issue
SRTSOD-YOLO: Stronger Real-Time Small Object Detection Algorithm Based on Improved YOLO11 for UAV Imageries
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Edge-Graph Enhanced Network for Multi-Object Tracking in UAV Videos

Xi’an Key Laboratory of Intelligent Spectrum Sensing and Information Fusion, Xidian University, Xi’an 710071, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2026, 18(6), 936; https://doi.org/10.3390/rs18060936
Submission received: 12 February 2026 / Revised: 11 March 2026 / Accepted: 18 March 2026 / Published: 19 March 2026

Highlights

What are the main findings?
  • An Edge-Graph Enhanced Network (EGEN) is proposed for robust multi-object tracking in UAV aerial videos, effectively addressing the challenges of small object scale, weak appearance cues, and complex background interference through edge-aware detection enhancement and graph-guided identity modeling.
  • Two dedicated modules are designed: the Edge-Guided Gaussian Enhancement Module (EGGEM) for small object detection and the Graph-Guided Embedding Enhancement Module (GGEEM) for identity-discriminative embedding learning, together with a hierarchical two-stage data association strategy to ensure stable and accurate tracking.
What are the implications of the main findings?
  • The Edge-Guided Gaussian Enhancement Module (EGGEM) explicitly models global edge relationships between objects and background, guiding selective feature enhancement to strengthen key structural characteristics of small objects while suppressing background interference. This addresses the limitations of conventional implicit saliency-driven attention, effectively enhancing detection discriminability in complex UAV scenarios.
  • The Graph-Guided Embedding Enhancement Module (GGEEM) overcomes the implicit nature of conventional context modeling by explicitly representing re-identification (ReID) embeddings as a graph. By explicitly representing and propagating relational information between objects, it effectively propagates identity information across objects, thereby enhancing tracking robustness.

Abstract

Multi-Object Tracking (MOT) is a fundamental research topic in the field of computer vision, with broad application potential in unmanned aerial vehicle (UAV) videos. However, existing methods still face significant challenges in detection discriminability and identity association stability due to the small scale and weak appearance of objects under aerial viewpoints, as well as complex background interference. To address these issues, we propose an Edge-Graph Enhanced Network (EGEN) for UAV aerial MOT, aiming to improve the performance of small object detection (SOD) and tracking in complex scenes. The framework follows a one-step tracking paradigm and consists of three main components: object detection, embedding feature extraction, and data association. In the detection stage, we design an Edge-Guided Gaussian Enhancement Module (EGGEM), which models edge relationships between objects and backgrounds from a global perspective and selectively enhances Gaussian features guided by edge information, thereby strengthening key structural features of small objects while suppressing background interference. In the embedding feature extraction stage, we develop a Graph-Guided Embedding Enhancement Module (GGEEM), which explicitly represents re-identification (ReID) embeddings as a graph structure and jointly models nodes and their neighborhood relationships to fully capture inter-object associations and enhance embedding discriminability. In the data association stage, we introduce a hierarchical two-stage association strategy to match objects with different confidence levels separately, improving tracking stability and robustness. Extensive experiments on the VisDrone, UAVDT, and self-constructed WildDrone datasets demonstrate that the proposed method significantly outperforms state-of-the-art approaches in both SOD and MOT, demonstrating strong generalization and practical applicability.

1. Introduction

Multi-object tracking (MOT) is one of the core problems in computer vision, aiming to localize and recognize multiple categories of objects in continuous video sequences while maintaining identity consistency over time. In recent years, driven by advances in sensor miniaturization, efficient energy systems, autonomous trajectory planning, and visual perception technologies, unmanned aerial vehicles (UAVs) have demonstrated broad application potential in areas such as geographic surveying [1], logistics delivery [2], urban inspection [3], emergency response [4], and agricultural monitoring [5]. Owing to their controllable deployment cost, flexible coverage, and high operational mobility, UAVs offer irreplaceable advantages in reducing labor dependence, shortening operational cycles, and enhancing operational safety. Despite the substantial progress achieved by deep learning based tracking frameworks, applying MOT techniques to UAV aerial videos remains highly challenging [6,7]. Compared with ground-view scenes, UAV imagery typically contains extremely small objects due to the long shooting distance and wide field of view. These objects often occupy only a few pixels and lack clear structural details, making it difficult for generic detection models to learn discriminative representations [8]. In addition, UAV platforms frequently undergo viewpoint changes and capture large-scale scenes with complex terrain structures. The resulting imagery is often affected by motion blur, scale variation, illumination fluctuation, and cluttered backgrounds, which can easily confuse the model’s decision-making process and degrade both detection accuracy and identity consistency [9]. These characteristics jointly make robust small-object detection (SOD) and reliable identity association particularly difficult in UAV-based MOT scenarios.
To alleviate the challenges brought by small objects, a large body of research has focused on feature enhancement strategies for small object detection. Attention mechanisms have become a widely adopted solution to improve detection and tracking performance by emphasizing informative spatial regions or feature channels [10,11]. However, most attention-based approaches learn attention weights mainly according to feature response magnitudes or statistical correlations among feature vectors [12,13,14]. Such mechanisms are essentially saliency-driven and rely on implicit feature correlations, making it difficult to explicitly capture the structural relationships between small objects and complex backgrounds. In UAV aerial scenes, where objects are extremely small and background structures are highly complex, weak object responses can be easily overwhelmed by surrounding textures, resulting in insufficient feature discriminability. To address these limitations, we propose an Edge-Guided Gaussian Enhancement Module (EGGEM), which models edge relationships from a global perspective and generates a global edge vector to guide the selective enhancement of Gaussian features. Through this design, it overcomes the limitations of conventional attention mechanisms that rely on implicit feature correlations and effectively strengthens the key edges and salient features of small objects in complex UAV aerial scenes.
As a core component of one-step trackers, the re-identification (ReID) branch is responsible for extracting embedding representations for identity association [15,16]. Existing studies often introduce context modeling to enhance embedding learning for small objects [17]. These approaches typically focus on capturing the relationship between an object and its surrounding environment, which can provide auxiliary semantic cues. However, most context modeling strategies are implicitly constructed and primarily describe object–background interactions [18], while overlooking the structural relationships among different objects. In complex UAV tracking scenarios where multiple small objects frequently appear with similar appearances and dynamic motion patterns, the lack of explicit modeling of inter-object relationships restricts the propagation of contextual identity information across objects, thereby limiting the discriminability and robustness of embedding representations. To address these limitations, we propose a Graph-Guided Embedding Enhancement Module (GGEEM), which explicitly models ReID embeddings as a graph structure composed of nodes and edges. By jointly modeling and updating nodes and their neighborhood relationships, inter-object association information is effectively encoded into the embedding representations. In challenging UAV tracking scenarios, such as occlusions, appearance similarity, and dynamic motion patterns, GGEEM fully exploits identity cues of small objects, thereby ensuring tracking accuracy and robustness.
To achieve accurate and robust MOT in complex UAV tracking scenarios, we propose an Edge-Graph Enhanced Network (EGEN). The framework consists of three components: object detection, embedding feature extraction, and data association. First, in the object detection component, an EGGEM is designed. This module models the edge relationships between objects and background from a global perspective and leverages edge information to guide the selective enhancement of Gaussian features. As a result, key structural characteristics of small objects are effectively strengthened while background interference is suppressed, thereby improving the detection discriminability of small objects in complex backgrounds. Second, in the embedding feature extraction component, a GGEEM is proposed. By explicitly representing ReID embeddings as a graph composed of nodes and edges, and jointly modeling and iteratively updating nodes and their neighborhood relationships, inter-object association information is effectively encoded into the embedding space. This design significantly enhances the identity discriminability of the embeddings. Finally, a two-stage data association strategy is introduced. In the first stage, high confidence objects are jointly matched by integrating positional consistency and appearance similarity. In the second stage, low confidence objects are associated in a complementary manner based on positional constraints. Through this hierarchical association strategy, objects with different confidence levels are stably maintained, further improving the accuracy and robustness of MOT in complex UAV scenarios.
We conduct a systematic evaluation of the proposed method on three datasets, namely VisDrone [19], UAVDT [20], and self-constructed WildDrone. Experimental results demonstrate that EGEN significantly outperforms existing mainstream methods in both SOD and MOT performance. The main contributions of this work are summarized as follows:
  • An Edge-Graph Enhanced Network (EGEN) is proposed to address the two core challenges in UAV-based MOT: insufficient discriminability in SOD and unstable identity association. This framework integrates edge-guided feature enhancement and graph-based embedding modeling to systematically tackle these challenges.
  • An Edge-Guided Gaussian Enhancement Module (EGGEM) is designed. By modeling the edge relationships between objects and background from a global perspective and leveraging edge information to guide feature enhancement, EGGEM effectively strengthens the structural characteristics of small objects, improving their discriminability in complex UAV scenes.
  • A Graph-Guided Embedding Enhancement Module (GGEEM) is proposed. This module explicitly represents ReID embeddings as a graph structure and jointly models nodes and their neighborhood relationships, fully exploiting inter-object associations to enhance the identity discriminability of embeddings and the reliability of data association.
  • To improve the generality and practicality of MOT methods in complex UAV visual scenarios, a UAV-based small-object tracking dataset, termed WildDrone, is constructed. The dataset focuses on diverse and unstructured wild environments, providing a challenging benchmark for related research.

2. Related Work

2.1. Multi-Object Tracking

2.1.1. Separate Detection and Embedding

Separate Detection and Embedding (SDE) adopts a “tracking-by-detection” strategy, where objects in each frame are first detected and then associated across frames based on their appearance features and motion information. SORT [21] employs a deep learning detector to identify potential objects in each frame, followed by Kalman filtering for state prediction and update, and finally assigns trajectories using the Hungarian algorithm. Although SORT demonstrates excellent computational efficiency and processing speed, its performance degrades in crowded scenes or under occlusion, leading to frequent ID switches. To address this issue, DeepSORT [22] introduces a ReID module to extract object appearance features, effectively reducing ID switches, while a cascade matching strategy further improves tracking accuracy. BoTSORT [23] enhances robustness in complex scenarios by integrating both motion and appearance information of objects and incorporating a camera motion compensation module. The Motion-Aware Tracker [24] prioritizes object motion modeling and employs motion localization along with a dynamic reconnection context mechanism to handle challenges caused by camera movement, non-rigid objects, and occlusion or motion blur. StrongSORT [25] strengthens trajectory continuity by introducing an appearance-free linking model and a Gaussian smoothing interpolation algorithm while maintaining trajectory authenticity. ByteTrack [26] incorporates low-confidence detection boxes into the association process, which significantly improves data association completeness and accuracy compared with approaches that rely solely on high-confidence detections. Overall, these methods can fully leverage the representational power of detection networks, providing reliable cues for cross-frame association under occlusion, small objects, or blurred images. However, due to the sequential “detect-then-track” workflow, these methods heavily depend on the detector’s performance.

2.1.2. Joint Detection and Embedding

Joint Detection and Embedding (JDE) integrates object detection and feature embedding within a single model, enabling the simultaneous execution of detection and embedding feature extraction [15]. The advantage of this approach lies in balancing tracking speed and accuracy, allowing detection boxes and embedding features to be output synchronously. FairMOT [16] combines the detection network with the ReID network. It employs the anchor-free CenterNet [27] as the detector, representing each object as a center point and predicting object size and offset through center point regression, effectively mitigating the center bias issue associated with traditional anchor-based methods. Building on JDE, CSTrack [28] introduces a cross-correlation network to alleviate competitive conflicts between the detection and ReID branches, while attention mechanisms enhance feature interaction between the two. Li et al. proposed SMFMOT [29], which employs a set-membership filter to model object states as bounded sets and combines it with a cascade strategy based on appearance matching, significantly improving the tracking stability of non-uniformly moving objects in UAV videos. UTM [30] leverages identity-aware information to enhance detection and embedding, thereby achieving the collaborative optimization of object detection, feature embedding, and identity association. In UAV-based small object tracking scenarios, the JDE framework demonstrates notable advantages: by performing end-to-end joint learning of detection and embedding within a single model, and leveraging shared feature representations along with multi-branch interaction mechanisms, small objects can achieve stable feature representations while maintaining real-time tracking performance.

2.1.3. Joint Detection and Tracking

Joint Detection and Tracking (JDT) integrates object detection and data association, achieving a unified design. CenterTrack [31], based on CenterNet, formulates tracking as a combination of object center detection and inter-frame displacement prediction, enabling cross-frame tracking through offset estimation between consecutive frames. Pavel Tokmakov et al. [32] further introduced a spatio-temporal recurrent memory module into CenterTrack, allowing the model to leverage historical frame information to infer object positions in the current frame, thereby maintaining stable tracking under occlusion. In recent years, Transformer architectures have shown remarkable potential in MOT. TransTrack [33] represents the first attempt to apply Transformers to MOT, employing a dual-path mechanism with object queries and track queries. By sharing detection and tracking features and utilizing multi-head attention layers for cross-frame feature matching, it achieves high-precision tracking. However, TransTrack does not feed object queries and track queries into the same decoder simultaneously, limiting the ability to update trajectories for newly appearing objects. TrackFormer [34] partially addresses this issue, but its modeling is restricted to short-term dependencies between adjacent frames, leaving room for performance improvement. Building on Deformable DETR [10], Zeng et al. extended it to MOT tasks, using track queries and Tracklet-Aware Label Assignment (TALA) to achieve implicit data association and iteratively update predicted trajectories. MeMOT [35] emphasizes temporal information, encoding object embeddings from the previous frame via a memory aggregation module to enable long-term cross-frame association using attention mechanisms. While these methods perform well in specific scenarios, they still struggle to surpass state-of-the-art SDE algorithms on conventional pedestrian tracking datasets. Moreover, in UAV tracking scenarios, particularly in traffic or densely crowded environments, small objects are easily affected by background clutter and neighboring objects, which leads to attention drift and trajectory confusion. Additionally, small objects occupy few pixels in the image and exhibit sparse features, making Transformer-based methods prone to mismatches or missed detections. Combined with the high computational cost of these approaches, high-resolution videos and scenes with numerous small objects increase latency and memory usage, thereby limiting their real-time tracking performance.

2.2. Small Object Detection

2.2.1. Multi-Scale Feature Fusion-Based Methods

Multi-scale representation strategies enable models to capture visual information at different spatial granularities, thereby supporting feature expression across multiple resolutions. In a hierarchical feature structure, deep-layer features, although of lower spatial resolution, contain more abstract and discriminative semantic information, which aids in the classification of small objects. In contrast, shallow-layer features retain richer local structures and spatial details, providing crucial support for precise object localization. Lin et al. proposed the Feature Pyramid Network (FPN) [36], which constructs a top-down information pathway to progressively fuse high-level semantic features into lower-level ones, effectively mitigating the challenges of feature extraction across scales. However, the multi-scale features generated by FPN may not always be optimally aligned or sufficiently detailed to fully capture the extreme scale variations in small objects. Building on this framework, Min et al. introduced multiple attention mechanisms, including dynamic texture attention, foreground-aware co-attention, and detail context attention, resulting in the Attentional FPN (AFPN) [13] that significantly improves small-object representation. Subsequently, Ge et al. proposed the Adaptive Reparameterized Generalized FPN (Adaptive-RepGFPN) [37], which incorporates an adaptive weighting strategy during feature recombination and concatenation, further strengthening features relevant to small-scale objects. Furthermore, Kiobya et al. proposed the Multi-Scale Semantic Enhanced FPN (MSSEFPN) [38], which extracts discriminative semantic information from high-level prediction branches and adaptively injects it into lower-level features, significantly improving semantic descriptions of small objects.
Despite these advances, multi-scale fusion strategies mainly rely on hierarchical feature aggregation and are still limited when dealing with UAV aerial imagery. In UAV scenarios, objects often occupy only a few pixels due to long shooting distances and wide field-of-view cameras. In addition, UAV platforms frequently experience viewpoint variations, motion blur, and illumination fluctuations. Under such conditions, the semantic information propagated from high-level features may become insufficient to compensate for the missing structural details of extremely small objects, while shallow features are easily overwhelmed by complex background textures. Consequently, conventional multi-scale fusion mechanisms still struggle to maintain robust feature representations for extremely small objects in UAV imagery.

2.2.2. Context Modeling-Based Methods

Context modeling methods exploit the relationships between scene-level and local regions to provide additional discriminative cues for small objects, compensating for their limited appearance information. FSSSD [39] explicitly incorporate spatial context modeling, embedding the relative positional relationships among objects into the ReID branch, which effectively enhances feature extraction stability from UAV perspectives. CABNet [40] leverages dilated convolutions to aggregate multi-level contextual information, generating high-resolution features with richer semantics and improving the responsiveness of small objects. ACmix [41] unifies attention mechanisms and convolution operations within a single computational framework, constructing more discriminative feature representations while capturing both global dependencies and local structures. Shi et al. [42] integrate semantic information with contextual relationships into a multi-scale feature space, enabling more reliable object localization and recognition in remote sensing scenarios. Li et al. proposed YOLO-DCTI [43], which collaboratively fuses global residual information with local feature representations to achieve deep coupling of spatial dependencies and channel attributes, thereby enhancing small-object representation. Chen et al. designed a Hybrid Receptive Field Network (HRFN) [44] that expands shallow feature coverage with diverse receptive fields while simultaneously modeling cross-layer contextual dependencies, significantly improving small-object perception. Yang et al. introduced PConv [45] tailored to the spatial distribution characteristics of infrared small objects, which enlarges the effective receptive field while controlling parameter size and refines contextual modeling to strengthen small-object feature representation.
Nevertheless, most context modeling approaches rely on predefined receptive fields or implicit attention mechanisms to capture contextual cues. In UAV aerial scenes, object distributions, motion patterns, and background structures vary significantly due to dynamic viewpoints and large-scale environments. Fixed receptive field configurations may fail to adapt to such spatial variability, and the contextual cues extracted from surrounding regions can become unreliable when background clutter, motion blur, or low illumination conditions are present. As a result, contextual information may not consistently provide reliable auxiliary cues for extremely small objects, limiting the robustness of context-based detection methods in UAV scenarios.

2.2.3. Super-Resolution-Based Methods

Super-resolution (SR)-based methods enhance small-object details by finely reconstructing low-resolution images or candidate regions, enabling models to capture clearer and more discriminative information, thereby compensating for the limitations of original imaging conditions. Previous studies have shown that upscaling the input resolution combined with bilinear interpolation helps improve the spatial localization accuracy of small objects [46]. However, applying SR directly to the entire image is often inefficient, as a large number of background regions unrelated to detection are also processed, resulting in significant computational overhead. To address this limitation, SOD-MTGAN [47] employs a high-recall detector to select potential object regions and performs SR only on these regions of interest, thereby significantly improving computational efficiency while maintaining performance. Building on this, Li et al. [48] elevate small-object feature maps to the SR level, reducing the feature disparity between small and large objects and further enhancing small-object representation. Bashir et al. [49] introduced a detection approach that employs residual feature aggregation (RFA)–driven SR, combining generative adversarial networks (GANs) with RFA to better capture small objects in satellite and remote sensing imagery. Zhang et al. [50] designed an auxiliary SR learning branch, enabling the model to retain strong SOD capabilities even under low-resolution input. Liu et al. [51] jointly optimize SR reconstruction and object detection tasks to guide the backbone in learning more discriminative small-object features.
Although SR methods can enhance fine-grained visual details, they may also introduce unrealistic structures or reconstruction artifacts. In UAV aerial imagery, where small objects often contain only a few pixels and lack clear structural boundaries, such artifacts can be easily amplified during the reconstruction process. This may lead to distorted edge patterns or artificial textures that deviate from the true scene distribution, which can confuse the detector and increase the risk of false positives. Therefore, directly applying SR techniques to UAV-based SOD may not always yield reliable improvements.

2.3. UAV-Based Object Detection

Recent studies have explored UAV-based detection frameworks to address the challenges of low-resolution aerial imagery in agricultural monitoring. Li et al. [52] proposed Succulent-YOLO, which integrates SR reconstruction with UAV-based object detection to enhance low-resolution imagery and improve the accuracy of large-scale succulent farmland monitoring. Zhao et al. [53] developed a rose monitoring framework that combines the MambaIR SR reconstruction model with the ROSE-YOLO detector, enabling accurate rose identification from low-resolution UAV images while achieving performance comparable to high-resolution inputs. Beyond crop-specific monitoring tasks, several general UAV-based SOD methods have been proposed to improve feature representation in aerial imagery. High-Resolution FPN (HR-FPN) [54] utilizes progressive alignment and high-resolution feature fusion to enhance small-object representations for UAV-based detection while maintaining model efficiency. Xu et al. [8] proposed a Contextual-Semantic Interactive Perception Network (CSIPN) that enhances UAV-based detection performance by capturing contextual interactions and dynamic semantic relationships in aerial scenes. Detailed Feature Pyramid Network (D-FPN) [55] enhances UAV-based SOD by strengthening high-resolution and fine-grained feature representations. Xu et al. [9] introduced a Dual-Domain Perception Network (DDPNet), which improves small-object representation by jointly modeling spatial and frequency-domain features. These studies demonstrate that integrating advanced feature representation strategies and SR techniques can significantly improve UAV-based detection performance. However, effectively modeling structural relationships between small objects and complex backgrounds and selectively enhancing informative edge cues while suppressing background interference remain challenging in UAV-based SOD.

3. Methods

3.1. Overview of EGEN

The proposed EGEN follows a one-step tracking paradigm that aims to determine the categories and locations of all objects of interest in video streams and assign consistent identities to them over time. As illustrated in Figure 1, the current frame image I t is first fed into backbone to obtain multi-level feature representations X i R C i × H i × W i , i { 1 , 2 , 3 , 4 } , where C i , H i , and W i denote the channel number, height, and width of the i-th feature map, respectively. X i is then input into EGGEM, where global edge relationships are extracted and used to guide selective Gaussian feature enhancement, thereby strengthening the key edge and saliency features of small objects while suppressing irrelevant background responses, resulting in the enhanced feature representation Y i R C i × H i × W i , i { 1 , 2 , 3 , 4 } . Then, Y i is processed by a detection branch with two 1 × 1 convolutional layers to generate the object detection results, and by an embedding branch composed of a 3 × 3 convolution and a 1 × 1 convolution to obtain the initial embeddings Z i R C e × H i × W i , i { 1 , 2 , 3 , 4 } . Subsequently, Z i is input into the GGEEM, where graph modeling and aggregation of nodes and their neighboring edges are performed to enhance the discriminability and associativity of the embeddings, yielding more discriminative embeddings O i R C e × H i × W i , i { 1 , 2 , 3 , 4 } .
Finally, data association is performed by constructing a matching cost matrix between the detection results and historical trajectories, jointly considering spatial cues and the discriminative embedding features. The data association strategy adopts a two-stage scheme, where the first stage handles high-confidence objects and the second stage focuses on low-confidence objects. In these two stages, the construction of the cost matrices and the handling of unmatched detections and tracklets differ accordingly. Through this strategy, accurate matching of both high- and low-confidence objects is achieved, ensuring robust and stable tracking performance.

3.2. Edge-Guided Gaussian Enhancement Module

Most existing small-object feature enhancement methods typically rely on local convolutions or attention mechanisms to improve representation capability. However, these approaches often neglect the edge interaction between small objects and their surrounding environment, making small-object features susceptible to background interference or attenuation, which in turn limits further improvements in detection accuracy. To address this issue, we propose an EGGEM, as shown in Figure 2. Specifically, the proposed module first extracts edge relationships from a global perspective to generate a global edge vector, which is then used to guide the selective enhancement of Gaussian features. Through this mechanism, the key edge and salient features of small objects are effectively strengthened, while irrelevant background responses are suppressed, thereby significantly improving the discriminability of small objects in complex backgrounds.
First, global relationship extraction is performed on X i . Specifically, X i is sequentially processed by convolution, tensor transformation, and Softmax function to obtain the global relation feature G i R R 1 × H i W i × 1 :
G i R = softmax T C 1 × 1 X i
where C n × n denotes a convolution with kernel size n × n , which is consistently followed by a SiLU activation function; softmax ( · ) represents the Softmax function; and T ( · ) denotes tensor transformation.
Meanwhile, a Sobel filter is employed to extract robust edge information from X i . The horizontal and vertical Sobel kernels are defined as
K x = 1 0 1 2 0 2 1 0 1 , K y = 1 2 1 0 0 0 1 2 1
These kernels are fixed in two 3 × 3 convolution layers C 3 × 3 K x and C 3 × 3 K y , respectively. The resulting outputs are then combined using the L1 norm to obtain the edge feature E i R C i × H i × W i :
E i = C 3 × 3 K x X i + C 3 × 3 K y X i
Subsequently, a residual structure is introduced to ensure training stability, followed by 1 × 1 convolution and tensor transformation to extract edge relationships, yielding the edge relation feature E i R R 1 × C i × H i W i :
E i R = T C 1 × 1 E i + X i
Next, E i R and G i R are combined via matrix multiplication and reshaped to construct the global edge vector G i E R C i × 1 × 1 , which is used to describe the global edge relationship between foreground small objects and their surrounding environment:
G i E = T E i R G i R
where ⊗ denotes matrix multiplication.
To more effectively capture small-object features, a Gaussian convolution kernel based on a Gaussian spatial prior is introduced to enhance salient responses while suppressing irrelevant background. Specifically, a depth-wise separable convolution configured with a 5 × 5 Gaussian kernel is applied to the feature map to perform Gaussian saliency modeling, thereby emphasizing key information and producing the Gaussian-modulated feature F i R C i × H i × W i :
F i = C G 5 × 5 1.0 X i
where C G 5 × 5 1.0 denotes a depth-wise separable convolution with a two-dimensional Gaussian kernel of size 5 × 5 and a standard deviation of 1. The two-dimensional Gaussian kernel function is defined as
G k × k σ ( x , y ) = 1 2 π σ 2 exp x 2 + y 2 2 σ 2
where σ denotes the standard deviation, k denotes the Gaussian kernel size, and x , y { k / 2 , , k / 2 } . By discretely sampling and normalizing the above continuous Gaussian function, a discrete Gaussian kernel is obtained for the depth-wise separable convolution. Subsequently, the Gaussian-enhanced feature F i G R C i × H i × W i is obtained through a residual structure and a 1 × 1 convolution:
F i G = C 1 × 1 F i + X i
To further enhance the saliency and discriminability of small objects under the guidance of the global edge vector G i E , the Gaussian-enhanced feature F i G is weighted by G i E in a broadcast element-wise manner, and a residual structure is introduced to ensure training stability, resulting in the final output Y i R C i × H i × W i :
Y i = X i + F i G G i E
where ⊙ denotes broadcast element-wise multiplication.

3.3. Graph-Guided Embedding Enhancement Module

Existing ReID methods are typically built upon the assumption that object appearance information is sufficiently discriminative, and they enhance feature representations through single-object feature learning or local region modeling. However, for small objects under UAV viewpoints, appearance cues are often incomplete and easily affected by complex background interference, making it difficult to achieve stable and reliable data association by relying solely on object-specific features, which in turn limits further improvements in tracking performance. To address this challenge, we propose a GGEEM. This module explicitly models ReID embeddings as a graph composed of nodes and edges, and jointly models and updates nodes and their neighborhood relationships through a generator and an aggregator, enabling the ReID branch to learn more discriminative embedding representations that support effective object matching. Through this mechanism, graph-structured modeling adaptively strengthens node and edge features associated with regions of interest and fully exploits inter-object relational information, significantly improving the discriminability of different small objects in UAV tracking scenarios.
As illustrated in Figure 3, GGEEM is composed of a generator and an aggregator. The generator takes the initial embeddings output by ReID branch as input and aims to construct them into a graph consisting of nodes and edges. Specifically, the input Z i is treated as nodes, and the node set V i R C e × H i × W i is defined as
V i = Z i
The generator constructs edges based on each node and its four nearest neighboring nodes, and the edge set L i R 4 × C e × H i × W i is expressed as
L i = stack V i shift up ( V i ) , V i shift down ( V i ) , V i shift left ( V i ) , V i shift right ( V i )
where shift up ( · ) denotes the operation that shifts the feature map downward by one row while replicating the top row, thereby aligning each pixel with its upper neighbor and ensuring that the spatial dimensions of the feature map remain unchanged. Similarly, shift down ( · ) , shift left ( · ) , and shift right ( · ) denote operations that align each pixel with its lower, left, and right neighbors, respectively. stack ( , ) denotes the stacking operation.
The aggregator is designed to aggregate neighborhood information and update both nodes and edges. First, L i is passed through tensor transformation and linear transformation to obtain L i T R C e × H i × W i :
L i T = T L T L i
where L ( · ) denotes a linear transformation implemented by a fully connected layer. Subsequently, V i and L i T are concatenated along the channel dimension to obtain the aggregated feature A i R 2 C e × H i × W i :
A i = V i ; L i T
where [ ; ] denotes the concatenation operation.
During the node and edge update process, in order to assign higher activation values to nodes and edges associated with regions of interest, a joint weight is introduced. Specifically, A i is first passed through a 1 × 1 convolution to reduce the number of channels from C e to C e / 2 , followed by global average pooling, one-dimensional convolution, tensor transformation, and Sigmoid function to generate the joint weight W i R C e / 2 × H i × W i :
W i = S T conv1d T GAP C 1 × 1 A i
where GAP ( · ) denotes global average pooling, conv1d ( · ) denotes a one-dimensional convolution with a kernel size of 5, and S ( · ) denotes the Sigmoid activation function.
For node updating, A i is first processed by tensor transformation and linear transformation, and then weighted by the joint weight W i to obtain the updated nodes V i U R C e / 2 × H i × W i :
V i U = T L T V i W i
For edge updating, the nodes are stacked and concatenated with the edges, followed by tensor transformation and linear transformation. The resulting features are then weighted by the joint weight W i to obtain the updated edges L i U R C e / 2 × H i × W i :
L i U = T L T stack V i ; V i ; V i ; V i ; L i W i
Finally, V i U and L i U are fused through concatenation and 1 × 1 convolution, and the input Z i is modulated based on the fused features. In this way, graph-structured information is effectively injected into the embedding features, making small-object representations more discriminative. The final output O i R C e × H i × W i is expressed as
O i = C 1 × 1 V i U ; L i U Z i

3.4. Data Association Strategy

Our method adopts a two-stage data association strategy to handle high-confidence and low-confidence objects separately. In these two stages, the calculation of the cost matrix and the handling of unmatched detections and tracklets differ.
In the first stage, for high-confidence objects, we construct the cost matrix by jointly considering the Intersection over Union (IoU) and ReID similarity. First, the Kalman filter is used to predict the position of each track, and the IoU between predictions and detections are computed as the position matching criterion. Then, we compute the similarity between objects using their ReID embeddings for appearance matching. Finally, the IoU and ReID similarity metrics are fused with pre-defined weights (ReID weight: 1.0, IoU weight: 0.55) to form the final cost matrix. The matching process is carried out using the Hungarian algorithm, and the computed cost matrix is used to determine the optimal match between tracks and detections. For unmatched detections and tracklets in the first stage, the following strategies are applied: unmatched high-confidence detections are initialized as new tracklets and added to the tracking list; existing tracklets that fail to match any detection in the current frame are marked as unconfirmed and await association in subsequent frames.
In the second stage, for low-confidence objects, the calculation of the cost matrix relies on IoU. Since the appearance information of low-confidence objects is relatively unstable, ReID similarity is not considered in this stage. The matching of low-confidence objects is still performed using the Hungarian algorithm. For unmatched detections and tracklets in the second stage, the following strategies are applied: unmatched low-confidence detections are initialized as new tracklets; unmatched tracklets are retained for up to 30 frames to handle potential occlusions, after which they are removed.
The above two-stage data association strategy enables precise matching of high-confidence and low-confidence objects, ensuring the robustness and stability of MOT.

3.5. Loss Function

The overall loss function of the proposed method consists of a classification loss, a bounding box loss, and an embedding loss, defined as
L total = λ 1 L cls + λ 2 L box + λ 3 L embed
where L cls denotes the classification loss, L box denotes the bounding box loss, L embed denotes the embedding loss, and λ 1 , λ 2 , and λ 3 are the weighting coefficients for the corresponding loss terms.
The bounding box loss is defined as
L box = 1 S i = 1 N w i 1 CIoU b i , b ^ i
where w i denotes the sum of soft-label confidence scores for the i-th positive sample, S denotes the sum of w i over all positive samples, b i represents the predicted bounding box of the i-th object, b ^ i represents the corresponding ground-truth bounding box, and CIoU ( · ) denotes the Complete-IoU (CIoU) loss, whose details can be found in [56].
The classification loss is defined as
L cls = 1 S i = 1 N c = 1 C p i c ^ log p i c + 1 p i c ^ log 1 p i c
where p i c denotes the predicted probability of the i-th object for class c, p ^ i c denotes the corresponding ground-truth of the i-th object for class c, C denotes the total number of classes, and N denotes the number of positive samples.
The embedding loss aims to make embeddings of objects with the same identity more similar while pushing embeddings of different identities further apart. It is defined as
L embed = j = 1 T max d a j , e j d a j , n j + m , 0
where a j denotes the embedding of the j-th anchor sample, e j denotes the embedding of a hard positive sample sharing the same identity as a j , n j denotes the embedding of a semi-hard negative sample with a different identity from a j , d ( · , · ) denotes the Euclidean distance between embeddings, and m is a predefined margin that controls the minimum separation between positive and negative samples.

4. Results

4.1. Datasets

To validate the effectiveness of the proposed method in UAV aerial scenarios, we conducted comprehensive experiments on three UAV-based datasets: VisDrone, UAVDT and WildDrone. Table 1 provides an overview of the datasets used in our experiments, listing task type, the number of sequences, the number of images or frames, and the number of total annotated instances.

4.1.1. VisDrone

The dataset is collected by multiple UAV platforms in real-world environments, covering a wide range of application scenarios, as well as diverse weather conditions and illumination variations, thereby providing strong support for research on object detection and MOT from the UAV perspective. In terms of category definition, the dataset includes 12 object classes: ignored regions, pedestrian, people, bicycle, car, van, truck, tricycle, awning-tricycle, bus, motor, and others. The VisDrone-MOT subset is specifically constructed for MOT tasks and is organized into training, validation, and test sets, containing 56, 7, and 33 video sequences, respectively. During the annotation process, each object is assigned a unique tracking ID, along with corresponding category labels and high-precision bounding box annotations. Under the MOT evaluation setting, this study strictly follows the official evaluation protocol and focuses on five key object categories, namely pedestrian, car, van, bus, and truck. In addition, the dataset incorporates numerous complex and representative scenarios, such as viewpoint changes caused by UAV motion, pronounced motion blur, dense object distributions, and frequent occlusions, making it a reliable testbed for validating the performance of UAV-based MOT methods.

4.1.2. UAVDT

The dataset is constructed from the UAV observation perspective and is primarily designed to support research on vehicle detection and tracking, while covering three key visual tasks: object detection, single-object tracking, and MOT. In terms of object definition, the dataset focuses exclusively on vehicles and further categorizes them into cars, trucks, and buses; in this work, all categories are unified into a single “vehicle” class. For the MOT setting, the UAVDT dataset provides 30 video sequences for training and 20 video sequences for performance evaluation. All sequences are captured at a frame rate of 30 FPS with a consistent resolution of 1080 × 540 . In addition, the data collection spans a variety of typical and complex scenarios, including urban squares, major roads, toll stations, highway segments, and different types of intersections, thereby reflecting the visual challenges encountered by UAV platforms in practical application environments.

4.1.3. WildDrone

At present, most UAV aerial datasets cover relatively limited application scenarios, primarily focusing on urban environments, where small objects are typically surrounded by simple backgrounds such as roads and squares. This lack of background diversity significantly constrains the robustness and generalization capability of deep learning-based detection and tracking methods when deployed in UAV aerial scenarios characterized by complex and highly variable backgrounds, thereby restricting their practical applicability to a certain extent. To address this limitation, we constructs a UAV-view dataset for SOD and tracking in complex outdoor environments, named WildDrone. The dataset spans a wide range of natural terrains, including forests, plains, mountainous regions, canyons, marine areas, and snow-covered landscapes. In these scenes, small objects are often sparsely distributed or heavily camouflaged within cluttered backgrounds, which substantially increases the difficulty of both detection and tracking tasks.
All image and video materials in the WildDrone dataset are collected and curated from publicly available Internet resources containing real-world UAV aerial scenes. These materials are carefully screened to ensure scene diversity and data quality, and are subsequently annotated to support both detection and tracking tasks. Specifically, WildDrone-DET is designed for SOD and consists of 1950 images, with 1260 images used for training and 690 images used for testing, containing 23,567 annotated object instances in total. In contrast, WildDrone-MOT focuses on MOT and includes 22 UAV video sequences with 7820 frames. The video frames are divided into training and testing sets at a ratio of 7:3, with a total of 14,794 annotated instances. Regarding annotation categories, all objects in the WildDrone dataset are uniformly classified into two classes: person and vehicle. Representative samples of WildDrone-DET and WildDrone-MOT are shown in Figure 4 and Figure 5, respectively, illustrating both the diversity of environments and the difficulty of the tasks involved.
To facilitate further research, a representative subset of the WildDrone dataset together with the corresponding data processing algorithms has been publicly released. The code and partial dataset are available at https://github.com/mubiaogenzong2019/WildDrone (accessed on 9 March 2026). Due to usage and redistribution restrictions of some original online materials, the complete dataset cannot be fully released at the current stage.

4.2. Implementation Details

All models are trained and evaluated on a machine equipped with a 24-core CPU, 64 GB of RAM, and an RTX 4090 GPU. The proposed EGEN adopts YOLO11 [57] as the baseline object detector and uses its first 19 layers as the backbone of the model. The data augmentation strategies used during training are kept consistent with those of the baseline. Training is conducted using the SGD optimizer with a batch size of 4. The initial learning rate is set to 0.01 and decayed according to a cosine scheduling strategy. Before being fed into the network, all images are uniformly resized to a resolution of 512 × 512 pixels. The weighting coefficients of the loss terms, λ 1 , λ 2 , and λ 3 , are set to 7.5, 0.5, and 0.5, respectively. During inference, the thresholds for high- and low-confidence detections are set to 0.7 and 0.3, respectively. In the object association stage, disappeared tracks are allowed to be reactivated and recovered within a maximum of 30 frames.

4.3. Evaluation Metrics

To systematically evaluate detection performance, average precision (AP) and mean average precision (mAP) are adopted as the primary evaluation metrics. For datasets involving a single object category, performance is measured using AP, whereas mAP is employed as the evaluation criterion for multi-class datasets. The conventional MS COCO [58] evaluation protocol characterizes SOD performance using APs for objects with areas smaller than 32 2 . However, in UAV aerial scenarios where a large proportion of objects are extremely small, this metric is insufficient to fully capture performance differences among competing methods. To address this limitation, a finer-grained evaluation scheme is introduced, in which small objects are further divided into multiple scale intervals, including mAPs1 ( a r e a < 20 2 ), mAPs2 ( 20 2 a r e a < 24 2 ), mAPs3 ( 24 2 a r e a < 28 2 ), and mAPs4 ( 28 2 a r e a < 32 2 ). In addition, the overall small-object metric mAPs ( a r e a < 32 2 ) and the AP over all objects are also reported. In the experiments, mAP is computed with a fixed IoU threshold of 0.5.
In addition to evaluating SOD performance, a comprehensive analysis of the tracking capability of the proposed method is conducted by following the standardized evaluation protocol for MOT tasks. Multiple performance metrics are adopted to provide a holistic assessment, including MOT Accuracy (MOTA), MOT Precision (MOTP), High-Order Tracking Accuracy (HOTA), Detection Accuracy (DetA), Association Accuracy (AssA), Identity F1 Score (IDF1), and frames per second (FPS).
Among these metrics, MOTA reflects the combined impact of false positives (FP), false negatives (FN), and identity switches (IDSW) on overall tracking performance, calculated as
MOTA = 1 t ( F N t + F P t + I D S W t ) t G T t
where G T t is the number of ground-truth objects at frame t.
MOTP measures the alignment accuracy between predicted and ground-truth object positions:
MOTP = i , t d i , t t c t
where d i , t is the bounding box IoU of the i-th matched pair in frame t, and c t is the number of matches in frame t.
HOTA balances detection and association quality, defined as
HOTA = DetA · AssA
with DetA and AssA computed as
DetA = T P T P + F P + F N , AssA = T P T P + I D S W
where T P denotes true positives.
IDF1 quantifies the proportion of correctly matched identities:
IDF 1 = 2 · I D T P 2 · I D T P + I D F P + I D F N
where I D T P , I D F P , and I D F N are identity true positives, false positives, and false negatives, respectively.
In addition, the computational efficiency of the model is analyzed using the number of parameters (Params) and floating-point operations (GFLOPs), which reflect the model complexity and computation cost in practical application scenarios.
Among these metrics, MOTA reflects the combined impact of detection errors, missed detections, and identity switches on overall tracking performance, with an emphasis on the joint accuracy of detection and association stages. HOTA measures the balance between detection quality and association quality, thereby characterizing the overall effectiveness of the tracker from a holistic perspective. IDF1 quantifies the proportion of correctly matched identities and evaluates the model’s ability to maintain identity consistency over long-term sequences. In addition, the runtime efficiency of the tracker is analyzed using FPS, which represents the overall processing speed of the system in practical application scenarios.

4.4. Ablation Studies

To evaluate the effectiveness of the two primary modules (EGGEM and GGEEM) within the overall tracking system, ablation experiments are conducted. Specifically, EGGEM is designed to enhance SOD capability, while GGEEM focuses on improving the association accuracy of multiple objects. The experimental results are summarized in Table 2 and Table 3.

4.4.1. Effectiveness of EGGEM

From the first two rows of Table 2, it is evident that introducing the EGGEM into the baseline leads to improvements of 8.4%, 0.6%, and 1.9% in MOTA, MOTP, and HOTA, respectively, indicating that the proposed EGGEM can effectively enhance the overall performance of a MOT system. Notably, the DetA metric shows a significant increase, rising from 33.9% to 36.7%, which demonstrates that EGGEM, through its edge-guided feature enhancement mechanism, can substantially strengthen the discriminability and localization precision of small objects in UAV aerial scenes, thereby effectively improving detection quality. In addition, both AssA and IDF1 exhibit moderate improvements, indicating that while EGGEM enhances detection performance, it does not disrupt the temporal association structure of the objects and also contributes to maintaining identity consistency and stability during the data association process.
To further demonstrate the unique advantages of EGGEM in SOD, ablation experiments are conducted on the VisDrone-DET test set. As shown in Table 3, with the assistance of EGGEM, the baseline achieves improvements of 5.4%, 6.8%, 6.3%, 5.1%, and 5.4% on mAPs1, mAPs2, mAPs3, mAPs4, and mAPs, respectively, indicating that EGGEM provides significant performance gains in SOD tasks. Notably, the improvement on mAPs1, which corresponds to the smallest object scale, demonstrates that EGGEM is particularly effective for extremely small objects. This can be attributed to the edge-guided enhancement mechanism, which explicitly strengthens structural edge cues and suppresses background interference. Such enhancement helps preserve the limited visual information of tiny objects in UAV imagery, making them more distinguishable from complex backgrounds. Moreover, the overall AP increases by 4.5%, further validating its effectiveness in UAV aerial scenarios with complex backgrounds. These results demonstrate that EGGEM can effectively enhance the critical structures and discriminative features of small objects, thereby significantly improving detection accuracy in UAV-based SOD tasks.
To analyze the contributions of the two core components of EGGEM, ablation experiments are conducted on global edge relationship extraction (GERE) and Gaussian-based feature enhancement (GFE) separately. As shown in Table 3, introducing GERE alone increases mAPs from 17.5% to 20.8%, indicating that modeling global edge relationships effectively captures structural cues of small objects and enhances their discriminability in complex backgrounds. When only GFE is applied, the mAPs rises to 19.2%, demonstrating that Gaussian-based feature enhancement emphasizes salient local responses while suppressing irrelevant background noise. Compared with the individual components, the complete EGGEM further improves mAPs to 22.9%, verifying that GERE and GFE work cooperatively rather than independently. This confirms that the edge-guided enhancement mechanism not only strengthens structural edges but also effectively integrates local saliency information, thereby enhancing the detection performance of small objects in UAV imagery.
In addition, to intuitively demonstrate the mechanism of EGGEM, we visualize the intermediate feature responses of the network, as shown in the Figure 6. From the feature responses of baseline, it can be observed that the attention distribution is relatively scattered, with a large amount of activation concentrated in complex background regions, while the responses in the object regions are relatively weak. This indicates that in UAV aerial scenes, the features of small objects can be easily overwhelmed by complex background textures, resulting in insufficient discriminability in the object regions. After introducing GERE, the feature responses become more concentrated on the boundary regions of small objects where clear structural variations exist. This indicates that GERE can model edge relationship information from a global perspective and enhance the network’s perception of structural features. However, since this process mainly focuses on edge relationships, some background structural regions still produce certain responses. After incorporating GFE, the feature responses are observed to concentrate more clearly toward the central regions of the small objects, indicating that the Gaussian feature enhancement mechanism can effectively strengthen the feature representation of object regions, making the responses of small objects more concentrated in the feature map. When the complete EGGEM integrates both GERE and GFE, the feature responses are primarily concentrated at the true object locations, while the interference from background regions is significantly reduced. Compared with other results, EGGEM can highlight small object regions more accurately while suppressing noise interference caused by complex backgrounds. This demonstrates that the Gaussian feature enhancement guided by global edge relationships enables the network to more effectively strengthen the key structural and salient features of small objects.

4.4.2. Effectiveness of GGEEM

As shown in the first and third rows of Table 2, introducing GGEEM into the baseline increases IDF1 from 56.8% to 59.2% and AssA from 58.4% to 60.0%, indicating that GGEEM can effectively improve object identity association, reduce identity switches, and thereby enhance overall tracking stability. This result validates the effectiveness of explicitly modeling inter-object relationships for improving the discriminative capability of embeddings.
Furthermore, combining EGGEM with GGEEM provides complementary enhancements at both the detection and association levels. As shown in the fourth row of Table 2, the complete model achieves 46.6%, 80.3%, and 47.8% on MOTA, MOTP, and HOTA, respectively, representing further improvements compared with configurations using only a single module. This demonstrates that the high-quality detection results provided by EGGEM and the identity association enhancement of GGEEM can act synergistically, significantly boosting MOT performance.

4.5. Hyperparameter Sensitivity Analysis

4.5.1. Effect of ReID and IoU Weights

To evaluate the influence of key hyperparameters in the association stage, we conduct a sensitivity analysis on the weights of ReID similarity and IoU similarity.
Specifically, the ReID weight and IoU weight are varied while keeping other parameters unchanged. The results are reported in Table 4. When the IoU weight is fixed at 0.55, increasing the ReID weight from 0.5 to 1.0 consistently improves the tracking performance. Specifically, MOTA increases from 44.8% to 51.7%, HOTA rises from 49.2% to 55.5%, and IDF1 improves from 66.3% to 68.8%. This indicates that appearance similarity plays a crucial role in maintaining identity consistency in UAV aerial scenes. However, further increasing the ReID weight to 1.2 leads to a slight performance drop (MOTA decreases to 50.6%), suggesting that excessively emphasizing appearance information may weaken the contribution of spatial cues.
We further analyze the effect of the IoU weight while fixing the ReID weight at 1.0. As shown in Table 4, setting the IoU weight to 0.55 achieves the best overall performance. Reducing the IoU weight to 0.50 decreases MOTA, HOTA, and IDF1 to 49.8%, 53.6%, and 68.1%, respectively, while increasing it to 0.60 results in slightly lower performance (MOTA = 51.1%, HOTA = 54.9%, IDF1 = 68.5%). These results indicate that an appropriate balance between appearance similarity and spatial overlap is essential for robust data association. Overall, the results demonstrate that the proposed tracking framework remains stable under moderate variations in these hyperparameters, and the empirical setting of ReID weight = 1.0 and IoU weight = 0.55 achieves the best trade-off among the evaluated metrics.

4.5.2. Effect of Confidence Thresholds

To investigate the influence of the high and low confidence thresholds in the association stage, we conduct a sensitivity analysis on the WildDrone-MOT dataset. Table 5 reports the MOT performance under different combinations of high and low confidence thresholds.
From the results, we observe that the overall performance in terms of MOTA, HOTA, and IDF1 varies slightly with different threshold settings. The highest performance is achieved when the high and low thresholds are set to 0.7 and 0.35, respectively (MOTA = 52.6%, HOTA = 55.9%, IDF1 = 70.0%). Our chosen thresholds (0.7 for high and 0.3 for low) yield MOTA = 51.7%, HOTA = 55.5%, and IDF1 = 68.8%, which is not the absolute optimum but aligns with the baseline configuration. This choice ensures a fair comparison with other methods while keeping the experimental setup consistent. Although the impact of confidence thresholds on the overall performance is minor compared to the substantial improvements brought by our method, we acknowledge its potential influence. In future work, more extensive experiments will be conducted to explore and select more optimal hyperparameters for further performance gains.

4.6. Small Object Detection Experiments

4.6.1. Quantitative Experiments

Table 6 provides a systematic comparison of the detection performance of our EGEN’s detector against several representative mainstream methods on the WildDrone-DET test set. Owing to the inclusion of more complex and diverse natural backgrounds, along with a substantially higher proportion of small objects, this dataset poses greater detection difficulty than conventional UAV benchmarks and places higher demands on the SOD capability of detection models. Under this more challenging evaluation setting, our method demonstrates consistent superiority across all evaluation metrics, outperforming other state-of-the-art approaches. In particular, with respect to SOD metrics, our method surpasses the second-best method PConv by 2.3%, 2.7%, 2.4%, 2.4%, and 2.6% on mAPs1, mAPs2, mAPs3, mAPs4, and mAPs, respectively, clearly highlighting its effectiveness in SOD. From an overall performance perspective, our method achieves an mAP of 60.1%, ranking second among all compared methods. Notably, this improvement in SOD is achieved without compromising overall detection accuracy. These results collectively indicate that EGEN’s detector is capable of substantially enhancing SOD in complex UAV scenarios while maintaining competitive overall detection performance.
In addition to its detection performance, EGEN’s detector maintains a moderate model complexity, with only 18.8 M parameters, and requires 31.8 GFLOPs for inference. Considering all 22 compared methods, the parameters and computational cost of EGEN’s detector both rank within the top 20%, significantly lower than those of most high-performance methods, thereby achieving efficient computation while maintaining high SOD accuracy.

4.6.2. Qualitative Experiments

We further conduct qualitative comparative experiments on the WildDrone-DET test set, where several representative methods are selected for comparison, including the strong single-stage small-object detector FFCA-YOLO and the recently proposed PConv designed specifically for SOD. The qualitative results are shown in Figure 7.
In region #1, the baseline, FFCA-YOLO, and PConv suffer from severe missed detections of weakly salient small objects in complex backgrounds, whereas our method accurately detects these objects, demonstrating a clear performance advantage over other advanced detectors. In Region #2, the baseline, FFCA-YOLO, and PConv show limited performance in densely distributed small-object scenarios, where object adhesion and missing detections frequently occur. In contrast, our method adapts well to crowded scenes, owing to the EGGEM, which strengthens the boundary structures between adjacent small objects through global edge relationship modeling, thereby enhancing object discriminability. In region #3, even under poor illumination conditions and low object contrast, our method still achieves superior detection performance compared with other methods. This benefit mainly stems from the EGGEM, which captures stable global edge priors and performs edge-guided selective enhancement of Gaussian features, effectively highlighting the key structural information of small objects while suppressing background noise responses. Overall, the results in regions #1, #2, and #3 demonstrate that the proposed method exhibits strong adaptability to complex backgrounds and high-density object scenarios, effectively alleviating the severe missed-detection problem of small objects.

4.7. Multi-Object Tracking Experiments

4.7.1. Quantitative Experiments

To facilitate a comprehensive comparison, we conduct a series of experiments on the VisDrone-MOT and WildDrone-MOT datasets and compare the results with those of other state-of-the-art methods. The detailed experimental results are reported in Table 7 and Table 8. As shown in Table 7, our EGEN exhibits superior performance across multiple evaluation metrics. Specifically, EGEN achieves a MOTA of 29.3%, ranking first among all compared methods, which demonstrates its significant advantage in overall MOT accuracy. Meanwhile, MOTP reaches 78.5%, further validating the reliability of the proposed method in terms of object localization precision. With respect to the HOTA metric, which jointly evaluates detection and association performance, EGEN attains a score of 38.7%, markedly outperforming existing mainstream approaches, indicating a more balanced and effective synergy between detection quality and trajectory association. In addition, EGEN also achieves leading performance on the DetA (27.3%) and AssA (56.0%) sub-metrics, suggesting that the proposed method not only improves detection quality but also enhances the stability and consistency of cross-frame object association. Furthermore, the IDF1 score is improved to 45.2%, providing further evidence of EGEN’s superiority in identity preservation and trajectory integrity. This improvement also implies a reduction in identity switches, as the proposed GGEEM explicitly models ReID embeddings as a graph structure and captures neighborhood relationships between objects, thereby enhancing identity discriminability and maintaining more stable identity associations across frames. Notably, EGEN also demonstrates excellent real-time performance, achieving a processing speed of 75.5 FPS, which is higher than the median of the compared methods. Overall, these results clearly indicate that EGEN can maintain both high detection accuracy and robust association performance in complex UAV scenarios, while also providing efficient computation suitable for real-time UAV applications.
The WildDrone-MOT dataset covers a wide range of highly challenging UAV aerial scenarios, placing stringent demands on both the detection and association capabilities of MOT algorithms. The experimental results in Table 8 show that our EGEN achieves the best overall performance among all compared approaches. Specifically, it attains a MOTA of 51.7%, a HOTA of 55.5%, and an IDF1 of 68.8%, indicating improved overall tracking accuracy and stronger identity preservation ability. Compared with mainstream online tracking methods, the advantages of our approach are clearly observed. For example, EGEN improves MOTA by 10.9% and 10.1% over ByteTrack and JDE, respectively, while achieving corresponding IDF1 gains of 10.3% and 10.7%. These improvements suggest that the proposed method more effectively mitigates identity drift and maintains stable object association in complex UAV scenarios. BoTSORT, which has been widely adopted in recent years, exhibits stable performance on the HOTA and AssA metrics, whereas its HOTA score remains lower than the 55.5% achieved by our method. In addition, compared with UAVMoT, which is specifically designed for UAV-based tracking, our EGEN achieves substantial improvements on both HOTA and IDF1, increasing them from 43.2% and 49.8% to 55.5% and 68.8%, respectively. This further validates the effectiveness of the proposed method in enhancing detection reliability and cross-frame association consistency under UAV viewpoints. Overall, while maintaining high detection accuracy, our EGEN significantly improves the stability of object identity association, leading to superior overall performance in complex UAV-based MOT tasks. In addition, EGEN achieves a processing speed of 74.6 FPS on the WildDrone-MOT dataset, ranking above the majority of the compared methods, which demonstrates that it provides high-quality tracking results while maintaining efficient real-time computation.

4.7.2. Qualitative Experiments

Figure 8 illustrates qualitative comparisons between EGEN and the baseline on the WildDrone-MOT dataset. As indicated by the yellow dashed boxes, at frame 3, when the small object is not occluded by background clutter, both methods deliver reliable detection and tracking performance. However, as scene complexity increases, at frame 16, the small object becomes partially occluded and gradually blends into the surrounding tree background. Under this condition, the baseline, which mainly relies on local appearance features, exhibits pronounced vulnerability when key information is missing and fails to maintain consistent identification and tracking of the object. In contrast, at frame 30, when the small object reappears after complete occlusion, EGEN is still able to successfully re-establish identity association and maintain continuous tracking, whereas the baseline fails to recover effective associations, ultimately leading to tracking failure. This phenomenon indicates that the local appearance features exploited by the baseline are insufficient to sustain stable identity discrimination under occlusion or information loss. By comparison, the proposed method jointly models and dynamically updates object neighborhood relationships through the GGEEM, enabling effective utilization of topological structural information to preserve coherent identity representations during occlusion. As a result, stable and continuous tracking is achieved, and object identity consistency is maintained throughout the entire sequence.
Figure 9 presents qualitative results demonstrating EGEN’s robustness in three representative challenging UAV scenarios. In scenario (a), under conditions of highly dense small-object distributions, EGEN is able to effectively distinguish adjacent objects without noticeable identity confusion. In scenario (b), under low-light nighttime conditions where object appearance information is severely degraded, EGEN consistently maintains identity consistency and achieves reliable MOT. In scenario (c), where small objects with highly similar features intersect, EGEN correctly preserves identity associations during object overlap and separation. These results demonstrate that EGEN exhibits strong robustness and stability across a variety of complex and extreme conditions, highlighting its ability to handle diverse and challenging UAV tracking scenarios.

5. Discussion

SOD and MOT in UAV aerial imagery face numerous challenges, including complex backgrounds, weak object features, densely distributed small objects, illumination variation, and occlusions. The proposed EGEN addresses these challenges through edge-guided feature enhancement and graph-based embedding modeling. In this section, we analyze the advantages and underlying mechanisms of EGEN under different challenging UAV scenarios based on the experimental results.

5.1. Complex Background Interference and Weak Object Features

In UAV aerial scenes, small objects are often embedded within complex natural or urban backgrounds, making them difficult to detect due to limited appearance cues. The proposed EGGEM explicitly enhances object features by modeling global edge relationships and guiding selective Gaussian feature enhancement. Quantitative results on the VisDrone-DET and WildDrone-DET test sets show that EGGEM significantly improves detection performance, especially for extremely small objects. Feature visualization (Figure 6) further demonstrates that EGGEM concentrates responses on the small object regions while suppressing interference from complex background textures. This confirms that EGEN can effectively preserve the limited visual information of small UAV objects and improve their discriminability in cluttered scenes.

5.2. Densely Distributed Small Objects and Scene Diversity

In UAV aerial scenes, small objects are often densely distributed and captured under diverse environmental conditions, including complex backgrounds and unstable illumination. Due to the limited number of pixels occupied by each object, standard detectors frequently suffer from missed detections, object adhesion, or degraded feature representations. The proposed EGGEM alleviates these challenges by leveraging global edge relationships to enhance structural boundaries between adjacent objects, while the Gaussian enhancement emphasizes salient object regions. This design allows the network to better distinguish closely positioned small objects and maintain stable feature responses even under difficult imaging conditions. Both quantitative (Table 3 and Table 6) and qualitative results (Figure 7, Regions #2 and #3) demonstrate that EGEN effectively handles densely distributed small objects and maintains robust detection performance under diverse lighting conditions. This capability is particularly important for UAV scenarios, where objects are often observed at long distances with extremely limited visual information.

5.3. Identity Association and Occlusion Handling

For reliable MOT, maintaining identity consistency is essential, particularly in complex UAV scenarios with occlusions or highly similar object appearances. The GGEEM explicitly models ReID embeddings as a graph structure, capturing inter-object neighborhood relationships and propagating contextual identity information across frames. Ablation studies indicate that GGEEM improves IDF1 by 2.4% and AssA by 1.6%, reducing identity switches and enhancing tracking stability (Table 2). Qualitative results (Figure 8) further show that EGEN successfully re-establishes object identities after occlusion and maintains continuous tracking under dense and overlapping object scenarios. These findings confirm that graph-guided embedding enhancement is effective for improving cross-frame association reliability in UAV-based MOT tasks.

6. Conclusions

This paper presents an EGEN for MOT in complex UAV aerial scenarios, addressing challenges such as the limited appearance information of small objects and background interference. The network incorporates an EGGEM and a GGEEM, combined with a hierarchical two-stage data association strategy, to achieve accurate and robust MOT. EGGEM explicitly models object–background edge relationships, effectively strengthening the structural features of small objects while suppressing background interference, thereby enhancing detection discriminability. GGEEM explicitly represents inter-object relationships as a graph, enabling identity information to propagate across objects and thereby improving MOT robustness. Experimental results on VisDrone, UAVDT, and self-constructed WildDrone datasets demonstrate that EGEN significantly outperforms existing state-of-the-art methods in SOD and MOT performance. Overall, EGEN provides a systematic solution that integrates edge information with graph-based relational modeling, offering new theoretical and practical insights for UAV-based SOD and MOT. Future work may focus on real-time optimization in multi-UAV scenarios, cross-scene generalization, and multimodal integration to further advance intelligent UAV perception in complex environments.

Author Contributions

Conceptualization, Y.X. and H.J.; methodology, Y.X. and Y.Z.; software, Y.X.; validation, Y.X. and Y.Z.; formal analysis, H.J. and Y.Z.; investigation, H.J. and Y.Z.; data curation, Y.X.; writing—original draft preparation, Y.X.; writing—review and editing, Y.X.; visualization, Y.X. and Y.Z.; supervision, H.J. and Y.Z.; funding acquisition, H.J. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China, grant number 62276204.

Data Availability Statement

The original contributions presented in the study are included in the article; further inquiries can be directed to the corresponding author.

Acknowledgments

We thank the editors and reviewers for their hard work and valuable advice.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Doughty, C.L.; Cavanaugh, K.C. Mapping coastal wetland biomass from high resolution unmanned aerial vehicle (UAV) Imagery. Remote Sens. 2019, 11, 540. [Google Scholar] [CrossRef]
  2. Dissanayaka, D.; Wanasinghe, T.R.; De Silva, O.; Jayasiri, A.; Mann, G.K.I. Review of navigation methods for UAV-based parcel delivery. IEEE Trans. Autom. Sci. Eng. 2024, 21, 1068–1082. [Google Scholar] [CrossRef]
  3. Feroz, S.; Abu Dabous, S. UAV-based remote sensing applications for bridge condition assessment. Remote Sens. 2021, 13, 1809. [Google Scholar] [CrossRef]
  4. Liu, J.; Liao, X.; Ye, H.; Yue, H.; Wang, Y.; Tan, X.; Wang, D. UAV swarm scheduling method for remote sensing observations during emergency scenarios. Remote Sens. 2022, 14, 1406. [Google Scholar] [CrossRef]
  5. Liu, L.; Wang, A.; Sun, G.; Li, J.; Pan, H.; Quek, T.Q.S. Multi-objective optimization for data collection in UAV-assisted agricultural IoT. IEEE Trans. Veh. Technol. 2025, 74, 6488–6503. [Google Scholar] [CrossRef]
  6. Zhang, P.; Sun, L.; Li, C.; Wang, Q.; Hao, Q.; Lu, J.; Zuo, L.; Ma, X. HA-tracker: A hybrid architecture tracker with spatiotemporal Mamba motion model for UAV-based video multi-object tracking. Remote Sens. 2026, 18, 133. [Google Scholar] [CrossRef]
  7. Liu, S.; Shen, X.; Xiao, S.; Li, H.; Tao, H. A multi-scale feature-fusion multi-object tracking algorithm for scale-variant vehicle tracking in UAV videos. Remote Sens. 2025, 17, 1014. [Google Scholar] [CrossRef]
  8. Xu, Y.; Ji, H. Contextual-semantic interactive perception network for small object detection in UAV aerial images. Remote Sens. 2025, 17, 3581. [Google Scholar] [CrossRef]
  9. Xu, Y.; Ji, H.; Zhang, Y.; Chen, Z. Dual-domain perception network for small object detection in UAV aerial images. Chin. J. Aeronaut. 2025, 103961. [Google Scholar] [CrossRef]
  10. Zhu, X.; Su, W.; Lu, L.; Li, B.; Wang, X.; Dai, J. Deformable DETR: Deformable transformers for end-to-end object detection. arXiv 2020, arXiv:2010.04159. [Google Scholar]
  11. Zhao, Y.; Lv, W.; Xu, S.; Wei, J.; Wang, G.; Dang, Q.; Liu, Y.; Chen, J. Dab-DETR: Dynamic anchor boxes are better queries for DETR. arXiv 2022, arXiv:2201.12329. [Google Scholar] [CrossRef]
  12. Zhang, H.; Li, F.; Liu, S.; Zhang, L.; Su, H.; Zhu, J.; Ni, L.M.; Shum, H.-Y. Dino: Detr with improved denoising anchor boxes for end-to-end object detection. arXiv 2022, arXiv:2203.03605. [Google Scholar]
  13. Min, K.; Lee, G.-H.; Lee, S.-W. Attentional feature pyramid network for small object detection. Neural Netw. 2022, 155, 439–450. [Google Scholar] [CrossRef] [PubMed]
  14. Zhao, Y.; Lv, W.; Xu, S.; Wei, J.; Wang, G.; Dang, Q.; Liu, Y.; Chen, J. DETRs beat YOLOs on Real-Time Object Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 14–19 June 2024; pp. 16965–16974. [Google Scholar]
  15. Wang, Z.; Zheng, L.; Liu, Y.; Li, Y.; Wang, S. Towards Real-Time Multi-Object Tracking. In Proceedings of the European Conference on Computer Vision (ECCV), Glasgow, UK, 23–28 August 2020; pp. 107–122. [Google Scholar]
  16. Zhang, Y.; Wang, C.; Wang, X.; Zeng, W.; Liu, W. FairMOT: On the fairness of detection and re-identification in multiple object tracking. Int. J. Comput. Vis. 2021, 129, 3069–3087. [Google Scholar] [CrossRef]
  17. Ma, J.; Wu, F.; Li, C.; Tang, C.; Zhang, J.; Xu, Z.; Li, M.; Liu, D. G2EMOT: Guided embedding enhancement for multiple object tracking in complex scenes. IEEE Trans. Instrum. Meas. 2024, 73, 1–14. [Google Scholar] [CrossRef]
  18. Wang, G.; Song, M.; Hwang, J.N. Recent advances in embedding methods for multi-object tracking: A survey. arXiv 2022, arXiv:2205.10766. [Google Scholar]
  19. Du, D.; Zhu, P.; Wen, L.; Bian, X.; Lin, H.; Hu, Q.; Peng, T.; Zheng, J.; Wang, X.; Zhang, Y.; et al. VisDrone-DET2019: The Vision Meets Drone Object Detection in Image Challenge Results. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, Seoul, Republic of Korea, 27 October–2 November 2019. [Google Scholar]
  20. Du, D.; Qi, Y.; Yu, H.; Yang, Y.; Duan, K.; Li, G.; Zhang, W.; Huang, Q.; Tian, Q. The Unmanned Aerial Vehicle Benchmark: Object detection and tracking. In Proceedings of the European Conference on Computer Vision (ECCV); Springer: Cham, Switzerland, 2018; pp. 370–386. [Google Scholar]
  21. Bewley, A.; Ge, Z.; Ott, L.; Ramos, F.; Upcroft, B. Simple Online and Realtime Tracking. In 2016 IEEE International Conference on Image Processing (ICIP); IEEE: Piscataway, NJ, USA, 2016; pp. 3464–3468. [Google Scholar]
  22. Wojke, N.; Bewley, A.; Paulus, D. Simple Online and Realtime Tracking with a Deep Association Metric. In 2017 IEEE International Conference on Image Processing (ICIP); IEEE: Piscataway, NJ, USA, 2017; pp. 3645–3649. [Google Scholar]
  23. Aharon, N.; Orfaig, R.; Bobrovsky, B.Z. BoT-SORT: Robust associations multi-pedestrian tracking. arXiv 2022, arXiv:2206.14651. [Google Scholar]
  24. Han, S.; Huang, P.; Wang, H.; Yu, E.; Liu, D.; Pan, X. MAT: Motion-aware multi-object tracking. Neurocomputing 2022, 476, 75–86. [Google Scholar] [CrossRef]
  25. Du, Y.; Zhao, Z.; Song, Y.; Zhao, Y.; Su, F.; Gong, T.; Meng, H. StrongSORT: Make DeepSORT great again. IEEE Trans. Multimedia 2023, 25, 8725–8737. [Google Scholar] [CrossRef]
  26. Zhang, Y.; Ma, X.; Li, J.; Li, S.; Song, M.; Wang, C.; Li, Q.; Yan, J. ByteTrack: Multi-Object Tracking by Associating Every Detection Box. In Proceedings of the Computer Vision—ECCV 2022, Cham, Switzerland, 23–27 October 2022; pp. 3–19. [Google Scholar]
  27. Zhou, X.; Wang, D.; Krähenbühl, P. Objects as points. arXiv 2019, arXiv:1904.07850. [Google Scholar]
  28. Liang, C.; Zhang, Z.; Zhou, X.; Li, B.; Zhu, S.; Hu, W. Rethinking the competition between detection and ReID in multiobject tracking. IEEE Trans. Image Process. 2022, 31, 3182–3196. [Google Scholar] [CrossRef]
  29. Li, X.; Zhu, R.; Yu, X.; Wang, X. High-performance detection-based tracker for multiple object tracking in UAVs. Drones 2023, 7, 681. [Google Scholar] [CrossRef]
  30. You, S.; Yao, H.; Bao, B.-K.; Xu, C. UTM: A Unified Multiple Object Tracking Model with Identity-Aware Feature Enhancement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2023; IEEE: Piscataway, NJ, USA, 2023; pp. 21876–21886. [Google Scholar]
  31. Zhou, X.; Koltun, V.; Krähenbühl, P. Tracking Objects as Points. In Proceedings of the Computer Vision—ECCV 2020, Cham, Switzerland, 23–28 August 2020; Lecture Notes in Computer Science. Volume 12349. [Google Scholar]
  32. Tokmakov, P.; Li, J.; Burgard, W.; Gaidon, A. Learning to track with object permanence. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV); IEEE: Piscataway, NJ, USA, 2021; pp. 10860–10869. [Google Scholar]
  33. Sun, P.; Cao, J.; Jiang, Y.; Zhang, R.; Xie, E.; Yuan, Z.; Wang, C.; Luo, P. TransTrack: Multiple object tracking with transformer. arXiv 2020, arXiv:2012.15460. [Google Scholar]
  34. Meinhardt, T.; Kirillov, A.; Leal-Taixé, L.; Feichtenhofer, C. TrackFormer: Multi-Object Tracking with Transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 19–24 June 2022; pp. 8844–8854. [Google Scholar]
  35. Cai, J.; Xu, M.; Li, W.; Xiong, Y.; Xia, W.; Tu, Z.; Soatto, S. MeMOT: Multi-Object Tracking with Memory. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 19–24 June 2022; pp. 8090–8100. [Google Scholar]
  36. Lin, T.-Y.; Dollár, P.; Girshick, R.; He, K.; Hariharan, B.; Belongie, S. Feature Pyramid Networks for Object Detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 2117–2125. [Google Scholar]
  37. Ge, Q.; Da, W.; Wang, M. MARFPNet: Multiattention and Adaptive Reparameterized Feature Pyramid Network for small Target Detection on Water Surfaces. IEEE Trans. Instrum. Meas. 2024, 73, 1–17. [Google Scholar] [CrossRef]
  38. Kiobya, T.; Zhou, J.; Maiseli, B. A Multi-Scale Semantically Enriched Feature Pyramid Network with Enhanced Focal Loss for Small Object Detection. Knowl.Based Syst. 2025, 310, 113003. [Google Scholar] [CrossRef]
  39. Liang, X.; Zhang, J.; Zhuo, L.; Li, Y.; Tian, Q. Small object detection in unmanned aerial vehicle images using feature fusion and scaling-based single shot detector with spatial context analysis. IEEE Trans. Circuits Syst. Video Technol. 2020, 30, 1758–1770. [Google Scholar] [CrossRef]
  40. Cui, L.; Lv, P.; Jiang, X.; Gao, Z.; Zhou, B.; Zhang, L.; Shao, L.; Xu, M. Context-aware block net for small object detection. IEEE Trans. Cybern. 2022, 52, 2300–2313. [Google Scholar] [CrossRef] [PubMed]
  41. Pan, X.; Ge, C.; Lu, R.; Song, S.; Chen, G.; Huang, Z.; Huang, G. On the Integration of Self-Attention and Convolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 19–24 June 2022; pp. 815–825. [Google Scholar]
  42. Shi, T.; Gong, J.; Hu, J.; Zhi, X.; Zhu, G.; Yuan, B.; Sun, Y.; Zhang, W. Adaptive feature fusion with attention-guided small target detection in remote sensing images. IEEE Trans. Geosci. Remote Sens. 2023, 61, 1–16. [Google Scholar] [CrossRef]
  43. Li, Z.; Wang, Y.; Zhang, Y.; Gao, Y.; Zhao, Z.; Feng, H.; Zhao, T. Context feature integration and balanced sampling strategy for small weak object detection in remote sensing imagery. IEEE Geosci. Remote Sens. Lett. 2024, 21, 1–5. [Google Scholar] [CrossRef]
  44. Chen, Z.; Ji, H.; Zhang, Y.; Liu, W.; Zhu, Z. Hybrid receptive field network for small object detection on drone view. Chin. J. Aeronaut. 2025, 38, 103127. [Google Scholar] [CrossRef]
  45. Yang, J.; Liu, S.; Wu, J.; Su, X.; Hai, N.; Huang, X. Pinwheel-Shaped Convolution and Scale-Based Dynamic Loss for Infrared Small Target Detection. In Proceedings of the AAAI Conference on Artificial Intelligence, Philadelphia, PA, USA, 25 February–4 March 2025; pp. 9202–9210. [Google Scholar]
  46. Hu, P.; Ramanan, D. Finding tiny faces. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 951–959. [Google Scholar]
  47. Bai, Y.; Zhang, Y.; Ding, M.; Ghanem, B. SOD-MTGAN: Small Object Detection via Multi-Task Generative Adversarial Network. In Proceedings of the European Conference on Computer Vision, Munich, Germany, 8–14 September 2018; pp. 206–221. [Google Scholar]
  48. Li, J.; Liang, X.; Wei, Y.; Xu, T.; Feng, J.; Yan, S. Perceptual Generative Adversarial Networks for Small Object Detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017. [Google Scholar]
  49. Bashir, S.M.A.; Wang, Y. Small object detection in remote sensing images with residual feature aggregation-based super-resolution and object detector network. Remote Sens. 2021, 13, 1854. [Google Scholar] [CrossRef]
  50. Zhang, J.; Lei, J.; Xie, W.; Fang, Z.; Li, Y.; Du, Q. SuperYOLO: Super resolution assisted object detection in multimodal remote sensing imagery. IEEE Trans. Geosci. Remote Sens. 2023, 61, 1–15. [Google Scholar] [CrossRef]
  51. Liu, J.; Zhang, J.; Ni, Y.; Chi, W.; Qi, Z. small object detection in remote sensing images with super-resolution perception. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2024, 17, 15721–15734. [Google Scholar] [CrossRef]
  52. Li, H.; Zhao, F.; Xue, F.; Wang, J.; Liu, Y.; Chen, Y.; Wu, Q.; Tao, J.; Zhang, G.; Xi, D.; et al. Succulent-YOLO: Smart UAV-assisted succulent farmland monitoring with CLIP-based YOLOv10 and Mamba computer vision. Remote Sens. 2025, 17, 2219. [Google Scholar] [CrossRef]
  53. Zhao, F.; Ren, Z.; Wang, J.; Wu, Q.; Xi, D.; Shao, X.; Liu, Y.; Chen, Y.; Mizuno, K. Smart UAV-assisted rose growth monitoring with improved YOLOv10 and Mamba restoration techniques. Smart Agric. Technol. 2025, 10, 100730. [Google Scholar] [CrossRef]
  54. Chen, Z.; Ji, H.; Zhang, Y.; Zhu, Z.; Li, Y. High-resolution feature pyramid network for small object detection on drone view. IEEE Trans. Circuits Syst. Video Technol. 2024, 34, 475–489. [Google Scholar] [CrossRef]
  55. Xu, Y.; Ji, H.; Zhang, Y.; Zhang, W.; Wang, P.; Chen, Z. Detail Feature Pyramid Network for Small Object Detection in Aerial Images. In Proceedings of the International Conference on Computer Application and Information Security (ICCAIS 2023); SPIE: Wuhan, China, 2023; Volume 13090, pp. 905–910. [Google Scholar]
  56. Zheng, Z.; Wang, P.; Liu, W.; Li, J.; Ye, R.; Ren, D. Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression. In Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA, 7–12 February 2020; pp. 12993–13000. [Google Scholar]
  57. Jocher, G. Ultralytics YOLO11. Available online: https://github.com/ultralytics/ultralytics (accessed on 2 March 2025).
  58. Lin, T.-Y.; Maire, M.; Belongie, S.; Hays, J.; Perona, P.; Ramanan, D.; Dollár, P.; Zitnick, C.L. Microsoft Coco: Common Objects in Context. In Proceedings of the European Conference on Computer Vision, Zurich, Switzerland, 6–12 September 2014; pp. 740–755. [Google Scholar]
  59. Tian, Z.; Shen, C.; Chen, H.; He, T. FCOS: Fully Convolutional One-Stage Object Detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea, 27 October–2 November 2019; pp. 9627–9636. [Google Scholar]
  60. Li, X.; Wang, W.; Wu, L.; Chen, S.; Hu, X.; Li, J.; Tang, J.; Yang, J. Generalized focal loss: Learning qualified and distributed bounding boxes for dense object detection. Adv. Neural Inf. Process. Syst. 2020, 33, 21002–21012. [Google Scholar]
  61. Zhang, S.; Chi, C.; Yao, Y.; Lei, Z.; Li, S.Z. Bridging the Gap Between Anchor-Based and Anchor-Free Detection Via Adaptive Training Sample Selection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 13–19 June 2020; pp. 9759–9768. [Google Scholar]
  62. Chen, Z.; Yang, C.; Li, Q.; Zhao, F.; Zha, Z.-J.; Wu, F. Disentangle Your Dense Object Detector. In Proceedings of the 29th ACM International Conference on Multimedia, Chengdu, China, 20–24 October 2021; pp. 4939–4948. [Google Scholar]
  63. Rossi, L.; Karimi, A.; Prati, A. A novel region of interest extraction layer for instance segmentation. In Proceedings of the 2020 25th International Conference on Pattern Recognition, Milan, Italy, 10–15 January 2021; pp. 2203–2209. [Google Scholar]
  64. Wu, Y.; Chen, Y.; Yuan, L.; Liu, Z.; Wang, L.; Li, H.; Fu, Y. Rethinking Classification and Localization for Object Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 13–19 June 2020; pp. 10186–10195. [Google Scholar]
  65. Cao, Y.; Chen, K.; Loy, C.C.; Lin, D. Prime Sample Attention in Object Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 13–19 June 2020; pp. 11583–11591. [Google Scholar]
  66. Ren, S.; He, K.; Girshick, R.; Sun, J. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 1137–1149. [Google Scholar] [CrossRef]
  67. Cai, Z.; Vasconcelos, N. Cascade R-CNN: High quality object detection and instance segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2021, 43, 1483–1498. [Google Scholar] [CrossRef]
  68. Zhang, H.; Wang, Y.; Dayoub, F.; Sunderhauf, N. Varifocalnet: An IoU-Aware Dense Object Detector. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 20–25 June 2021; pp. 8514–8523. [Google Scholar]
  69. Xiao, Y.; Xu, T.; Yu, X.; Fang, Y.; Li, J. A lightweight fusion strategy with enhanced interlayer feature correlation for small object detection. IEEE Trans. Geosci. Remote Sens. 2024, 62, 1–11. [Google Scholar] [CrossRef]
  70. Wang, A.; Chen, H.; Liu, L.; Chen, K.; Lin, Z.; Han, J.; Ding, G. Yolov10: Real-time end-to-end object detection. Adv. Neural Inf. Process. Syst. 2024, 37, 107984–108011. [Google Scholar]
  71. Wang, C.-Y.; Yeh, I.-H.; Mark Liao, H.-Y. Yolov9: Learning What You Want to Learn Using Programmable Gradient Information. In Proceedings of the European Conference on Computer Vision, Graz, Austria, 27–31 October 2024; pp. 1–21. [Google Scholar]
  72. Xie, X.; Cheng, G.; Wang, J.; Yao, X.; Han, J. Oriented R-CNN for Object Detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada, 11–17 October 2021; pp. 3520–3529. [Google Scholar]
  73. Lu, W.; Chen, S.B.; Li, H.D.; Shu, Q.-L.; Ding, C.H.Q.; Tang, J.; Luo, B. LegNet: Lightweight edge-Gaussian driven network for low-quality remote sensing image object detection. arXiv 2025, arXiv:2503.14012. [Google Scholar]
  74. Zhang, Y.; Ye, M.; Zhu, G.; Liu, Y.; Guo, P.; Yan, J. FFCA-YOLO for small object detection in remote sensing images. IEEE Trans. Geosci. Remote Sens. 2024, 62, 1432. [Google Scholar] [CrossRef]
  75. Dong, Z.; Li, G.; Liao, Y.; Wang, F.; Ren, P.; Qian, C. Centripetalnet: Pursuing High-Quality Keypoint Pairs for Object Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 14–19 June 2020; pp. 10519–10528. [Google Scholar]
  76. Stanojević, V.D.; Todorović, B.T. BoostTrack: Boosting the similarity measure and detection confidence for improved multiple object tracking. Mach. Vis. Appl. 2024, 35, 53. [Google Scholar] [CrossRef]
  77. Wang, Y.-H.; Hsieh, J.-W.; Chen, P.-Y.; Chang, M.-C.; So, H.-H.; Li, X. SMILEtrack: Similarity Learning for Occlusion-Aware Multiple Object Tracking. In Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA, 28 February–6 March 2024; pp. 5740–5748. [Google Scholar]
  78. Liu, S.; Li, X.; Lu, H.; He, Y. Multi-Object Tracking Meets Moving UAV. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 19–24 June 2022; pp. 8876–8885. [Google Scholar]
  79. Xu, Y.; Osep, A.; Ban, Y.; Horaud, R.; Leal-Taixé, L.; Alameda-Pineda, X. How to Train Your Deep Multi-Object Tracker. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 13–19 June 2020. [Google Scholar]
Figure 1. Overall framework of EGEN.
Figure 1. Overall framework of EGEN.
Remotesensing 18 00936 g001
Figure 2. Structure of the EGGEM.
Figure 2. Structure of the EGGEM.
Remotesensing 18 00936 g002
Figure 3. Structure of GGEEM.
Figure 3. Structure of GGEEM.
Remotesensing 18 00936 g003
Figure 4. Visualization of diverse scenarios in WildDrone-DET. Orange bounding boxes indicate small person objects.
Figure 4. Visualization of diverse scenarios in WildDrone-DET. Orange bounding boxes indicate small person objects.
Remotesensing 18 00936 g004
Figure 5. Visualization of diverse scenarios in WildDrone-MOT. Different colored bounding boxes indicate objects with different identities.
Figure 5. Visualization of diverse scenarios in WildDrone-MOT. Different colored bounding boxes indicate objects with different identities.
Remotesensing 18 00936 g005
Figure 6. Visualization of feature responses for the proposed EGGEM. Orange bounding boxes indicate small person objects.
Figure 6. Visualization of feature responses for the proposed EGGEM. Orange bounding boxes indicate small person objects.
Remotesensing 18 00936 g006
Figure 7. Qualitative comparison of our EGEN and some state-of-the-art methods on the WildDrone-DET test set. Different colored bounding boxes indicate objects of different categories.
Figure 7. Qualitative comparison of our EGEN and some state-of-the-art methods on the WildDrone-DET test set. Different colored bounding boxes indicate objects of different categories.
Remotesensing 18 00936 g007
Figure 8. Qualitative comparison of baseline and our EGEN on the WildDrone-MOT test set. Different colored bounding boxes indicate objects with different identities.
Figure 8. Qualitative comparison of baseline and our EGEN on the WildDrone-MOT test set. Different colored bounding boxes indicate objects with different identities.
Remotesensing 18 00936 g008
Figure 9. Visualization of EGEN’s robustness in challenging UAV scenarios: (a) dense small-object distributions; (b) low-light nighttime conditions; (c) intersections of small objects with highly similar appearances. Different colored bounding boxes indicate objects with different identities.
Figure 9. Visualization of EGEN’s robustness in challenging UAV scenarios: (a) dense small-object distributions; (b) low-light nighttime conditions; (c) intersections of small objects with highly similar appearances. Different colored bounding boxes indicate objects with different identities.
Remotesensing 18 00936 g009
Table 1. Overview of UAV-based datasets in our experiments.
Table 1. Overview of UAV-based datasets in our experiments.
DatasetTaskSequencesImages/FramesInstances
VisDrone-DETDetection10,209~540 k
WildDrone-DETDetection195023,567
VisDrone-MOTTracking7933,366~1621 k
WildDrone-MOTTracking22782014,794
UAVDTTracking100~80 k~842 k
Table 2. Results of the ablation studies on the UAVDT test set. Bold font indicates the best result for each metric.
Table 2. Results of the ablation studies on the UAVDT test set. Bold font indicates the best result for each metric.
MethodMOTAMOTPHOTADetAAssAIDF1
Baseline36.179.544.633.958.456.8
+EGGEM44.580.146.536.758.957.9
+GGEEM37.879.845.234.560.059.2
+EGGEM + GGEEM46.680.347.837.560.560.1
Table 3. Results of the ablation studies on the VisDrone-DET test set. Bold font indicates the best result for each metric.
Table 3. Results of the ablation studies on the VisDrone-DET test set. Bold font indicates the best result for each metric.
MethodmAPs1mAPs2mAPs3mAPs4mAPsmAP
Baseline10.725.131.334.217.531.2
+GERE13.628.434.236.720.833.6
+GFE12.827.133.035.819.232.7
+EGGEM16.131.937.639.322.935.7
Table 4. Hyperparameter sensitivity analysis of ReID and IoU weights on the WildDrone-MOT dataset. Bold font indicates the best result of each metric.
Table 4. Hyperparameter sensitivity analysis of ReID and IoU weights on the WildDrone-MOT dataset. Bold font indicates the best result of each metric.
ReID WeightIoU WeightMOTAHOTAIDF1
0.50.5544.849.266.3
0.80.5548.953.167.9
1.00.5551.755.568.8
1.20.5550.654.468.3
1.00.5049.853.668.1
1.00.6051.154.968.5
Table 5. Hyperparameter sensitivity analysis of high and low confidence thresholds on the WildDrone-MOT dataset. Bold font indicates the best result for each metric.
Table 5. Hyperparameter sensitivity analysis of high and low confidence thresholds on the WildDrone-MOT dataset. Bold font indicates the best result for each metric.
High ThresholdLow ThresholdMOTAHOTAIDF1
0.60.352.155.869.5
0.650.351.655.568.9
0.70.351.755.568.8
0.750.351.755.568.8
0.70.2551.855.669.1
0.70.3552.655.970.0
Table 6. Comparison results of detection accuracy between different methods on the WildDrone-DET test set. Bold font indicates the best result for one metric.
Table 6. Comparison results of detection accuracy between different methods on the WildDrone-DET test set. Bold font indicates the best result for one metric.
MethodBackbonemAPs1mAPs2mAPs3mAPs4mAPsmAPParamsGFLOPs
DAB-DETR [11]ResNet-504.812.021.031.613.429.743.7 M25.4
FCOS [59]HRNetV2p-W326.415.327.839.119.435.437.1 M74.1
Deformable-DETR [10]ResNet-509.217.132.641.920.837.340.8 M50.7
GFL [60]ResNeXt-1018.017.431.841.621.141.250.9 M73.3
ATSS [61]ResNet-1018.419.332.245.221.842.751.1 M72.6
DDOD [62]ResNet-5010.420.737.545.524.344.932.2 M45.8
GRoIE [63]ResNet-5010.521.243.150.325.747.243.3 M160.2
Double Heads [64]ResNet-5010.920.942.350.225.947.947.3 M142.9
PISA [65]ResNeXt-1019.722.841.255.426.355.860.0 M80.5
RT-DETR [14]ResNet-10110.721.941.954.827.344.161.8 M62.1
Faster R-CNN [66]HRNetV2p-W4011.124.045.956.129.150.763.2 M94.6
Cascade R-CNN [67]HRNetV2p-W3210.725.446.255.130.151.474.7 M83.7
VarifocalNet [68]ResNet-10112.723.342.553.430.550.951.7 M88.4
EFC [69]ResNet-1813.025.945.257.631.653.440.0 M116.8
YOLOv10-M [70]C2fNet12.324.146.957.132.154.416.5 M57.2
YOLOv9-C [71]GELAN14.126.848.960.133.556.451.0 M79.5
Oriented-RCNN [72]LEGNet-S [73]14.827.549.258.533.860.329.8 M47.9
DINO [12]Swin-L15.529.049.959.135.758.2218.6 M
FFCA-YOLO [74]C3Net15.426.650.058.435.958.97.2 M17.3
CentripetalNet [75]HourglassNet-10416.626.647.657.936.355.4206.0 M817.6
PConv [45]C2fNet16.930.152.962.137.259.63.0 M7.4
EGEN’s detectorC3Net19.232.855.364.539.860.118.8 M31.8
Table 7. Comparison results of MOT performance between different methods on the VisDrone-MOT test set. Bold font indicates the best result for one metric.
Table 7. Comparison results of MOT performance between different methods on the VisDrone-MOT test set. Bold font indicates the best result for one metric.
MethodMOTAMOTPHOTADetAAssAIDF1FPS
BoTSORT [23]27.877.837.125.454.944.174.6
BoostTrack [76]28.177.336.826.052.743.963.3
JDE [15]24.277.829.722.340.232.165.2
ByteTrack [26]26.376.833.124.146.038.587.0
SMILEtrack [77]24.378.129.822.140.932.581.3
UAVMoT [78]25.276.531.722.944.636.883.4
DeepMOT [79]19.476.925.320.332.825.453.8
EGEN29.378.538.727.356.045.275.5
Table 8. Comparison results of MOT performance between different methods on the WildDrone-MOT test set. Bold font indicates the best result for one metric.
Table 8. Comparison results of MOT performance between different methods on the WildDrone-MOT test set. Bold font indicates the best result for one metric.
MethodMOTAMOTPHOTADetAAssAIDF1FPS
BoTSORT [23]39.983.545.035.257.756.773.7
BoostTrack [76]38.781.241.132.452.353.361.9
JDE [15]41.682.145.337.355.458.164.5
ByteTrack [26]40.882.045.136.955.558.586.3
SMILEtrack [77]40.082.543.935.654.656.579.4
UAVMoT [78]43.181.743.236.249.649.882.8
DeepMOT [79]33.582.136.532.140.438.452.5
EGEN51.783.755.548.664.468.874.6
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Xu, Y.; Ji, H.; Zhang, Y. Edge-Graph Enhanced Network for Multi-Object Tracking in UAV Videos. Remote Sens. 2026, 18, 936. https://doi.org/10.3390/rs18060936

AMA Style

Xu Y, Ji H, Zhang Y. Edge-Graph Enhanced Network for Multi-Object Tracking in UAV Videos. Remote Sensing. 2026; 18(6):936. https://doi.org/10.3390/rs18060936

Chicago/Turabian Style

Xu, Yiming, Hongbing Ji, and Yongquan Zhang. 2026. "Edge-Graph Enhanced Network for Multi-Object Tracking in UAV Videos" Remote Sensing 18, no. 6: 936. https://doi.org/10.3390/rs18060936

APA Style

Xu, Y., Ji, H., & Zhang, Y. (2026). Edge-Graph Enhanced Network for Multi-Object Tracking in UAV Videos. Remote Sensing, 18(6), 936. https://doi.org/10.3390/rs18060936

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop