1. Introduction
Object detection, a cornerstone of computer vision, focuses on the automatic identification and localization of objects in images. This technology has been successfully utilized in a range of domains, such as automated quality control [
1], UAV piloting [
2], and secure transaction authentication [
3]. Progress in this field is vital for the successful real-world deployment of AI applications. The advent of large-scale AI models in recent years has led to significant improvements in both the accuracy and generalization performance of object detectors. Consequently, researchers have begun exploring the integration of object detection with large AI models [
4,
5] and augmented reality (AR) technologies, forming a multi-level technical synergy. Within this integrated framework, object detection ensures data verification, large AI models facilitate data processing, and AR systems provide an interface for virtual–real fusion and real-time interaction, thereby establishing a closed perception–decision–interaction loop. Thus, advancing research in object detection holds substantial significance.
Considerable research efforts have been devoted to the development of object detection methodologies. The landscape of contemporary object detection is primarily composed of three methodological streams: traditional techniques, methods founded on deep learning, and specialized algorithms designed for detecting small objects. Traditional approaches primarily rely on handcrafted feature extractors and machine learning techniques, with representative methods including HOG [
6], HAAR [
7], DPM [
8], SURF [
9], and SIFT [
10]. In contrast, deep learning-based object detection algorithms are typically divided into two-stage and one-stage paradigms based on their architectural design. Two-stage detectors first generate a set of candidate object proposals and subsequently classify these proposals using convolutional neural networks (CNNs). Prominent examples in this category include RCNN [
11], Fast R-CNN [
12], Faster R-CNN [
13], and FPN [
14]. One-stage detectors, by contrast, bypass the proposal generation step and directly formulate object localization as a regression problem. Well-known one-stage algorithms include the YOLO series [
15,
16], SSD [
17], and RetinaNet [
18]. This fundamental architectural distinction leads to inherent performance trade-offs: two-stage methods typically excel in detection accuracy and localization precision, whereas one-stage methods offer superior inference speed.
Small-object detection, a specialized branch within the broader field, faces enduring difficulties. These stem from the low spatial resolution and the paucity of distinctive features characteristic of small objects, both of which hinder reliable identification and localization. Consequently, a diverse array of methodological innovations has emerged in recent years to tackle these problems.
The BRA-YOLOv10 model, presented by Zhang et al. (2025) [
19] for drone-based object detection, features a Bi-Level Routing Attention mechanism and a high-resolution small-object detection layer, which enabled it to reach 96.5% mAP@0.5 on drone image datasets. In a similar vein, Zhang et al. (2023) [
20] developed Drone-YOLO, which combines multi-scale feature fusion with the RepVGG module, resulting in a 17.4% improvement in mAP@0.5 on the VisDrone2019 dataset. Bai (2025) [
21] proposed the SFFEF-YOLO model, which incorporates a fine-grained feature extraction module (FIEM) and an SPD-Conv module, yielding a 9.9% increase in mAP on the VisDrone2019 dataset. Zhang (2025) [
22] developed MASNet, which integrates spatial depth convolution (SPDConv) with a global–local spatial attention mechanism (GLSA), achieving an mAP of 52.2% in drone object detection tasks. Li et al. (2025) [
23] constructed CSFCANet, employing a channel-spatial fusion cross-attention mechanism to enhance scale sequence fusion and local–global feature modeling, leading to a 7% mAP improvement across multiple datasets, including VisDrone, UAVDT, and PIDrone. Wang et al. (2023) [
24] introduced a small target detection component (STC) and a global attention mechanism (GAM) based on improvements to YOLOv8, elevating small-object detection accuracy in drone images to an mAP of 39.3%, which represents a 4.4% increase over the baseline. Finally, Zhao et al. (2023) [
25] combined a Transformer encoder, GAM, and coordinate attention mechanism (CA) to develop TGC-YOLOv5, enhancing the average precision (AP) to 0.848 on the SUAV-DATA dataset, with a 2.5% improvement.
In the field of industrial defect detection, Hu et al. (2024) [
26] introduced deformable convolution and the WIoU loss function into the YOLOv8 framework for insulator defect detection tasks, achieving a 5.5% improvement in mAP. Xiao (2023) [
27] proposed GRA-Net, which integrates the global perception capabilities of both CNNs and Transformers, resulting in a 4–7% increase in mIoU for defect detection tasks. Qu (2023) [
28] optimized the YOLOv5 architecture for aero-engine defect detection by incorporating a dual-path attention mechanism and the CARAFE upsampling module, reducing the number of parameters by 11.7% while simultaneously increasing mAP by 10.6%. Jiang (2023) [
29] developed the RAR-SSD model, which combines the RFB module with attention mechanisms for PCB defect detection, achieving a 4.85% improvement in the F1 score. Huang et al. (2023) [
30] constructed the TBi-YOLOv5 model for crane wire rope defect detection, enhancing multi-scale feature extraction capabilities by introducing the Bottleneck Transformer (BOT) and bidirectional feature pyramid network (BiFPN), resulting in a 4% increase in mAP. Furthermore, Zhang et al. (2025) [
31] developed the YOLO-BS model for traffic sign detection, incorporating a small-object detection layer and BiFPN, achieving an mAP@0.5 of 90.1% and 78 FPS on the TT100K dataset, effectively balancing detection accuracy with real-time performance.
In the field of agricultural disease detection, Bai et al. (2024) [
32] proposed an enhanced YOLOv7 model by integrating a Swin Transformer prediction head and a GS-ELAN optimization module, achieving an mAP of 92.1% for detecting strawberry seedling flowers and fruits. Lv and Su (2024) [
33] further advanced YOLOv5 by incorporating CBAM and Transformer modules for apple leaf disease detection, achieving an mAP@0.5 of 73.4%. Notably, their model demonstrated significant improvement in distinguishing visually similar diseases.
While a multitude of strategies has been developed to improve small-object detection, a common issue among high-performance models like RT-DETR [
34] is their reliance on considerable computational resources, resulting in increased inference latency. This creates a clear conflict with the stringent real-time requirements of practical applications.
While a 30 FPS refresh rate proves satisfactory for real-time needs in low-dynamic settings (e.g., video analytics, surveillance, industrial inspection), far more stringent requirements exist for high-dynamic/high-speed applications. These include autonomous driving, real-time industrial monitoring, UAV obstacle avoidance, live video analysis, high-speed tracking, robotic surgery, and VR, where maintaining at least 60 FPS is essential for ensuring operational fluency and response accuracy. Achieving high-accuracy small-object detection under such high-frame-rate (≥60 FPS) constraints thus represents a significant and pressing technical hurdle.
In response to the aforementioned difficulties, we develop a new object detection framework in this work. The core contribution of this work lies not in designing a novel infrastructure from scratch, but rather in the targeted enhancement and novel synthesis of established, high-performance modules, tailored specifically for small-object detection. This approach seeks to strike an improved trade-off between detection accuracy and inference speed. Our primary innovations are threefold:
- (1)
RCSOSA Module (Reduced Channel Spatial Object Attention): Designed to augment the model’s spatial attentiveness, this module compresses the channel dimension of feature maps while preserving essential spatial representations. By refining the feature extraction process, RCSOSA markedly elevates accuracy in detecting small objects and concurrently alleviates computational load, rendering it appropriate for applications demanding real-time performance.
- (2)
HFPN Module (Hierarchical Feature Pyramid Network): We introduce a three-branch architecture for multi-scale feature fusion, which amalgamates the proficiency of Convolutional Neural Networks (CNNs) in capturing local patterns with the aptitude of Transformers in comprehending global context. This integrated approach facilitates a comprehensive representation encompassing fine-grained local details and high-level semantic information, thereby bolstering the model’s adaptability in identifying objects across different sizes, especially those that are small.
- (3)
Fused Loss Function Design: Our approach integrates the Normalized Wasserstein Distance (NWD) loss—noted for its heightened sensitivity to small objects—with a dynamically adjusted weighting scheme throughout the training phase, forming a composite loss function. This formulation promotes alignment in both the statistical distribution and the spatial geometry of predicted bounding boxes. Moreover, the adaptive weighting mechanism improves training stability for multi-scale objects, diminishes the need for extensive hyperparameter search, and contributes to more efficient training and better model generalization.
3. Results
3.1. Experiment Introduction
To comprehensively evaluate the performance and generalization capability of the proposed algorithm, we conduct experiments on three widely used public benchmark datasets: MS COCO, VisDrone2019, and PASCAL VOC 2012. Their key characteristics and roles in our evaluation are summarized below.
MS COCO (Common Objects in Context): This is the primary dataset for training and evaluating our model, as it is one of the most authoritative benchmarks in object detection. The COCO dataset encompasses 80 object categories across diverse real-world scenes. Crucially for our study, it explicitly defines objects with an area less than 32 × 32 pixels as small objects, which constitute approximately 31.62% of all instances in the dataset. This substantial proportion of small targets makes COCO exceptionally suitable for developing and validating small-object detection algorithms. We use the standard train2017set (≈118 K images) for training and the val2017set (≈5 K images) for testing and ablation studies.
VisDrone2019: To assess the model’s robustness in complex, dense small-object scenarios, we employ the VisDrone2019 dataset. Collected from a drone’s perspective, it contains numerous small and densely packed objects (e.g., pedestrians, vehicles) under various lighting and weather conditions, posing significant challenges for detection. We use its training set (6471 images) for fine-tuning (when applicable) and its validation set (548 images) for testing, strictly following the official split to evaluate cross-domain generalization.
PASCAL VOC 2012: We utilize this dataset to supplement the evaluation of the model’s performance on medium-sized objects and to further verify its generalization across different data distributions. We train on the combined trainvalset and report results on the testset.
To ensure the fairness and reproducibility of the comparison, all the models evaluated in this study were trained and tested under the same experimental conditions:
- (1)
Hardware and software: All experiments were conducted on an specified identical platform (as shown in
Table 2).
- (2)
Data Splits and Preprocessing: We rigorously adhered to the official training, validation, and testing splits for the MS COCO, VisDrone, and PASCAL VOC datasets to prevent any data leakage. All input images were resized to a fixed resolution of 640 × 640 pixels and normalized using the identical procedure (i.e., pixel values scaled to [0, 1]).
- (3)
Training Hyperparameters: All models, including the baseline and our proposed model, were trained from scratch (without using any pre-trained weights) using the exact same set of hyperparameters. These are comprehensively listed in
Table 3, encompassing the optimizer, initial/final learning rates, batch size, number of epochs, momentum, and weight decay.
- (4)
Post-processing: During evaluation, the same non-maximum suppression (NMS) parameters were applied across all models, with an IoU threshold of 0.45 and a confidence threshold of 0.25.
- (5)
Dataset and evaluation: All models were trained and evaluated on the same partitions of the MS COCO, VisDrone, and PASCAL VOC datasets as described in
Section 3.1. The evaluation metrics were calculated using the same script and protocol. This strict setup ensures that the performance differences reported in the following sections are caused by the model architecture itself, rather than differences in training configurations or initialization methods.
To comprehensively evaluate the model’s effectiveness and practicality, this paper selects four types of metrics for performance assessment. The mean Average Precision (mAP) and F1 score are used to measure the precision and accuracy of detection, with higher values indicating better detection performance. The number of parameters (Params) and FLOPs (Floating Point Operations) are used to measure the model’s complexity and inference efficiency, with smaller values indicating a lighter model and higher computational efficiency. Before that, let us first introduce the meanings of the following four evaluation indicators. Among them, TP represents the number of positive samples that are correctly detected, FP represents the number of negative samples that are wrongly identified as positive, and FN represents the number of positive samples that are wrongly recognized as negative.
The specific definitions of the metrics are as follows:
Precision refers to the proportion of positive samples in all samples predicted by the model. Among them, high accuracy means the positive prediction of the model, and the proportion of true positive samples is higher.
Recall rate refers to the proportion of the number of samples correctly identified as positive by the model among all real positive samples, which is a measure of the ability of the model to identify positive samples. A high recall rate means that the model can more easily find all real positive samples.
The F1 score takes into account the accuracy and recall ability of the model. The value range is 0 to 1, and the closer the F1 value is to 1, the better the performance of the model.
(4) mAP.
mAP takes into account the accuracy and recall of the model, which is an important index to evaluate the performance of the target detection model. The formula of AP is shown in Formula (25). Specifically, firstly, the detection results of the model are sorted according to the confidence level, and then the precision rate and recall rate of each detection result are calculated according to the sorting results. Finally, the PR curve is drawn, and the area under the PR curve is AP. For the multi-classification problem, the average value is calculated after calculating the AP of each classification, and finally mAP is obtained. The calculation formula of mAP is shown in Formula (26).
mAP is the most commonly used evaluation index in multi-class object detection tasks, which combines different types of accuracy and recall. The higher the mAP, the better the detection performance of the model. In this paper, the average accuracy means (mAP@0.5–0.95) when the threshold IoU is 0.5 and 0.5: 0.95 is taken as the evaluation index.
3.2. Comparison Experiments
To verify the effectiveness of the proposed model in the task of small-object detection, this paper compares it with the current mainstream object detection algorithms, including YOLOv5, YOLOv8, YOLOv10, YOLOv11, YOLOv12, Faster R-CNN and RT-DETR. Due to the limited computing power, we only conducted experiments on the minimum versions of these models. This excluded the improvement in accuracy caused by the increase in model capacity. To evaluate the statistical reliability and significance of the results, we conducted three repeated experiments on the yolov11 model and our model and report the average values and standard deviations of the performance indicators. All models were evaluated under the same experimental conditions and training strategies, and the experimental results are summarized in
Table 4. The small standard deviations observed (e.g., ±0.001 for YOLOv11n and ±0.002 for our model in mAP@0.5) indicate that the training process is stable and the results are reproducible. The performance gain of our model over the baseline (e.g., an improvement of 0.040 in mAP@0.5) is substantially larger than the inherent experimental variability reflected by these standard deviations, which underscores that the improvement is consistent and statistically robust.
Given that this paper focuses on applications with high real-time requirements, with a specific constraint that the detection speed must reach FPS ≥ 60, the RT-DETR model, despite having higher accuracy, is excluded from the candidate models due to its frame rate of only 22, which is significantly below the real-time detection requirement. As shown in
Table 4, the early YOLOv5 model, due to its relatively simple network structure and fewer convolutional layers, has limited detection accuracy, achieving only mAP@0.5 = 0.424. With the iteration of model versions, YOLOv8 to YOLOv12 show improvements in accuracy, with average detection accuracies of 0.433, 0.435, 0.435, and 0.441, respectively. However, the improvements are limited, and model optimization gradually reaches a bottleneck. In contrast, the new model proposed in this paper achieves a detection accuracy of mAP@0.5 = 0.475, which represents an improvement of about 3.4% over the best benchmark model (YOLOv12), marking a significant advancement within the YOLO series. Moreover, the fluctuations in the multiple experimental results are very small, and the mean of our model consistently exceeds that of the baseline models, indicating that the observed performance improvement is stable and reliable.
Similarly, the three average precisions based on the COCO standard are shown in
Table 4. Specifically, for small targets (APS), the model has improved from 0.322 of the baseline YOLOv11n to 0.365, an absolute increase of 4.3%. This directly verifies the effectiveness of the RCSOSA, HFPN module, and NWD-CIoU loss function in detecting small targets. At the same time, the model’s detection accuracy for medium targets (APm) and large targets (APl) has also increased by 1.7% and 5.8%, respectively. This indicates that our improvements enhance the overall feature representation and multi-scale fusion capabilities of the model, rather than optimizing small targets at the expense of large targets, effectively avoiding detection deviations.
Although the introduction of new structures (such as RCSOSA and HFPN) increases the number of parameters from 2.62 M to 4.57 M, and FLOPs increase moderately, the overall inference speed is still maintained at FPS = 81, far exceeding the real-time detection standard, demonstrating a good balance between performance and complexity. Compared to the RT-DETR model, although it has slightly higher accuracy (mAP@0.5 = 0.494), its FLOPs are as high as 108.3 G, approximately 10 times that of the YOLO series models, and its FPS is only 22, making it unsuitable for practical low-latency scenarios. In contrast, the model proposed in this paper achieves comparable or even better accuracy while maintaining a lightweight design, showing stronger potential for practical deployment.
Figure 7 shows a radar chart comparing the new model with various mainstream models across multiple key performance indicators (mAP, FLOPs, number of parameters, FPS, F1 score), clearly illustrating the new model’s comprehensive advantages in multiple dimensions.
Figure 8 presents the relationship curve between mAP@0.5 and FPS for each algorithm, with algorithms closer to the top-right corner representing better performance. It can be seen that the proposed model achieves the highest detection accuracy while maintaining a high frame rate, validating its practicality in real-world scenarios. Additionally,
Figure 9 and
Figure 10 show the F1 score curves and PR curves for each model, respectively. As shown, except for the RT-DETR model, which has a low FPS, the model proposed in this paper performs the best in detection accuracy. A larger area under the PR curve indicates stronger detection performance, and a higher F1 score means the model is more stable and reliable in object recognition and localization. Notably, within a wide confidence threshold range, the proposed model maintains a high F1 score, indicating better robustness to threshold variations.
Based on the above comparison results, the new model proposed in this paper achieves higher detection accuracy for small objects while ensuring real-time performance (FPS > 60), demonstrating good scalability and engineering application value.
3.3. Model Effectiveness Analysis
To further validate the generalization ability of the proposed model across different datasets, this paper conducts experimental evaluations on two representative datasets: PASCAL VOC and VisDrone2019. The detection results of various mainstream object detection models on these two datasets are listed in
Table 5 and
Table 6.
From
Table 5 and
Figure 11, it can be seen that the proposed model achieves mAP@0.5 = 0.630 and mAP@0.5:0.95 = 0.453 on the PASCAL VOC dataset, representing improvements of 2.7% and 0.8%, respectively, over the best baseline model. Meanwhile, the inference speed reaches FPS = 100.1, maintaining excellent running efficiency while improving accuracy. This demonstrates that the new model outperforms mainstream YOLO series algorithms in terms of overall performance on the PASCAL VOC dataset.
The experimental results on the VisDrone2019 dataset are shown in
Table 6 and in
Figure 12. This dataset is primarily used to evaluate the performance of dense small-object detection scenes and is more challenging. The results indicate that the proposed model achieves an average detection accuracy of 0.348 on this dataset, which is a 2.9% improvement over the baseline model, further validating its ability to detect small objects in complex scenarios.
In summary, the proposed new model achieves significant improvements in detection accuracy on both the PASCAL VOC and VisDrone datasets, while maintaining real-time inference performance (FPS > 60), fully demonstrating the model’s excellent generalization ability and practicality in cross-scenario and small-object detection tasks.
3.4. Ablation Study
To assess the actual contribution of each module in the overall model, this paper designs an ablation study, gradually introducing the three key components of the proposed model: the RCSOSA module, the HFPN module, and the NWD-CIoU loss function. The experimental results are shown in
Table 7, where “✓” indicates that the module has been enabled.
As seen in the table, each module has a positive impact on detection performance. After introducing the RCSOSA module, the model’s mAP@0.5 and mAP@0.5:0.95 improve to 0.451 and 0.312, respectively, showing increases of 1.6% and 1.4% over the baseline model, with the number of parameters increasing to 3.46 M. This indicates that the RCSOSA module contributes the most to the accuracy improvement. When the HFPN module is introduced, mAP@0.5 increases to 0.449, and mAP@0.5:0.95 increases to 0.309, with improvements of 1.4% and 1.1%, and the model parameters grow to 3.03 M, highlighting its significant effect in enhancing feature fusion. After introducing the NWD-CIoU loss function, mAP@0.5 and mAP@0.5:0.95 increase to 0.441 and 0.301, respectively. Although the improvements are relatively small (0.6% and 0.3%), the NWD-CIoU loss function plays a positive role in fine-tuning object localization accuracy, with only a slight increase in parameters, reaching 2.63 M.
Furthermore, the ablation study reveals positive synergistic effects between the proposed modules. The combination of RCSOSA and HFPN yields a greater performance gain (mAP@0.5: 0.469) than the sum of their individual improvements. This suggests that the RCSOSA module’s enhanced feature extraction in the backbone provides more discriminative inputs for the HFPN module’s hierarchical fusion, enabling more effective integration of local and global contexts. Similarly, integrating the NWD-CIoU loss with either RCSOSA or HFPN (Rows 6 and 7) shows complementary benefits, as the dynamic loss provides better gradient guidance for training the enhanced architecture. The full model integrating all three components achieves the best performance, demonstrating that the contributions of the RCSOSA module (primarily for feature enhancement), the HFPN module (for multi-scale fusion), and the NWD-CIoU loss (for optimized regression) are complementary and mutually reinforcing.
3.5. Visual Results Analyses
To more intuitively demonstrate the advantages of the proposed model in small-object detection tasks, this paper compares and visualizes the detection results of the new model and the baseline model YOLOv11 on the MS COCO validation set. Representative images selected from numerous samples are shown in
Figure 13 and
Figure 14. As illustrated in
Figure 13, when detecting the “person” class, a typical small object, YOLOv11 exhibits a clear failure to detect, identifying only one target. In contrast, the proposed new model successfully detects nine targets in the same image, significantly improving the recall rate for small-object detection. This result further validates that the new model outperforms the baseline model in detecting small-scale targets, demonstrating stronger feature representation and localization capabilities, making it especially suitable for dense small-object detection tasks in complex scenes.
3.6. Model Deployment on Mobile Devices
To prove the feasibility of deploying the new model on the Android system, we trained the new model based on the MS COCO dataset and then deployed it to the Android side to achieve offline, low-latency image detection and real-time monitoring. This demonstrates that the model can maintain an acceptable operational delay outside of the high-performance simulation environment and is suitable for resource-constrained real-time applications. To meet the lightweight requirements of the mobile end and the need for efficient inference, we adopted NCNN as the end-side inference framework. The new files after training were exported as NCNN models, obtaining the network structure and network weights. The Android side adopted a three-layer architecture of “Kotlin + JNI + NCNN(C++)”. The application layer (Kotlin) is responsible for interface interaction, camera acquisition, image selection, and result visualization; the interface layer (JNI) is responsible for parameter passing and memory object bridging; the inference layer (C++/NCNN) is responsible for model loading, preprocessing, forward inference, post-processing (NMS), and result output.
The final application can run stably on Android devices, supporting the dual mode of “image detection + real-time detection”, and can perform end-side recognition and visual output.
Figure 15 shows the real-time monitoring effect of the mobile APP. From the figure, it can be seen that this APP can detect the number of bromine ions and the inference time. After testing, the inference time of this APP during real-time monitoring is greater than 60 ms, meeting the real-time requirements, which also proves that our model still has an acceptable operation delay on the mobile end.
4. Discussion
This study evaluates the proposed model through comprehensive experiments on three benchmark datasets: MS COCO, VisDrone2019, and PASCAL VOC 2012, demonstrating improved detection performance. Nevertheless, certain limitations persist in this work. The following sections discuss these shortcomings and outline potential avenues for future research.
- (1)
Practical Deployment Gap: Current validation relies predominantly on software simulation, creating a gap to real-world deployment. Future efforts will focus on porting the model to hardware platforms and iterative optimization in practical settings. Techniques such as model quantization, pruning, and compression will be explored to enhance operational efficiency on resource-constrained embedded or edge devices.
- (2)
Hyperparameter Optimization Space: Despite achieving high accuracy, the model’s hyperparameters present an opportunity for further tuning. In future work, we plan to employ advanced meta-heuristic optimization algorithms to systematically search for more optimal parameter configurations.
Computational Cost and Generalization: Compared to the baseline, the proposed model entails higher computational demands. To address this, model compression techniques like pruning, quantization, and knowledge distillation could be applied. Additionally, enhancing model generalization and mitigating overfitting through advanced data augmentation and regularization schemes remain important areas for future work.
In conclusion, this work demonstrates the effectiveness of the RCS-HFPN-YOLOv11 framework for small-object detection. The results should be interpreted considering the ongoing challenge of balancing accuracy and speed in this domain, as highlighted in related studies. The findings—notably the gains in mAP, especially for small objects (APS)—validate the working hypotheses behind the RCSOSA, HFPN, and dynamic loss design. The broader implications include a viable architectural strategy for real-time, accurate small-object detection in applications like drone imagery and automated inspection. Future research directions, beyond addressing the aforementioned limitations, could include exploring the integration of larger vision–language models for enhanced contextual understanding and testing the framework on a wider array of specialized small object datasets.