Next Article in Journal
A Techno-Economic Analysis of a Direct Vapour Generation Solar Cascade Organic Rankine Cycle for Efficient Cogeneration
Previous Article in Journal
Data Symmetry Enhancement-Based Abnormal State Detection of High-End Hydrogen Compressors Under No-Fault Samples
Previous Article in Special Issue
Automated Synthesis of Hierarchical Deep Learning Cascades for Identifying Visually Similar Objects in UAV Imagery
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Multi-Generational YOLO Ensemble with Weighted Boxes Fusion for Robust Rescue-Oriented Object Detection in Chaotic Disaster Scenes

1
Department of Medical Informatics, Chung Shan Medical University, Taichung 402, Taiwan
2
Information Technology Office, Chung Shan Medical University Hospital, Taichung 402, Taiwan
*
Author to whom correspondence should be addressed.
Technologies 2026, 14(9), 530; https://doi.org/10.3390/technologies14090530
Submission received: 15 April 2026 / Revised: 25 June 2026 / Accepted: 29 June 2026 / Published: 28 August 2026
(This article belongs to the Special Issue Advanced Technologies in Computer Vision and Applications)

Abstract

Accurate and robust object detection in complex disaster scenes is essential for effective emergency response; however, severe occlusion, dense overlap, and cluttered backgrounds pose significant challenges to conventional single-model detectors. To address these limitations, this study proposes a novel rescue-oriented detection framework that integrates a fine-grained disaster dataset, a cross-generational YOLO ensemble, and a consensus-based fusion strategy using Weighted Boxes Fusion (WBF). A dataset of 2323 images was constructed by re-annotating CDNIC19k with instance-level labels for four rescue-critical roles, enabling more precise evaluation in real-world scenarios. Heterogeneous YOLO models spanning multiple architectural generations were jointly exploited within a unified ensemble framework to leverage complementary representations. Meanwhile, a consensus-driven fusion strategy based on WBF was adopted to improve prediction aggregation in dense and occluded scenes. Experimental results showed that the proposed method outperformed single-model baselines and NMS-based approaches, improving mAP@0.5 from 0.696 to 0.756 (+8.6%) while maintaining strong recall and robustness. Analysis of the YOLOv12 family reveals an accuracy–efficiency trade-off, where lightweight models enable real-time inference while high-capacity models provide more reliable detection. Overall, these findings demonstrate that cross-generational architectural diversity combined with consensus-based fusion constitutes a generalizable and effective paradigm for high-precision disaster scene understanding under diverse deployment constraints.

1. Introduction

In disaster scenarios, effective emergency response and resource allocation rely heavily on the timely and accurate interpretation of visual information. With the increasing availability of visual data from drones, surveillance systems, and mobile devices, analyzing disaster scenes has become an urgent and important task [1,2]. However, translating raw visual input into actionable insights remains challenging, particularly due to the complex and densely overlapping nature of disaster environments. Ensuring both detection accuracy and real-time performance is therefore critical for improving decision-making efficiency in emergency response.
Object detection is one of the most representative approaches for analyzing disaster images and has been widely validated in various computer vision tasks [3,4,5]. Nevertheless, most object detection models have been developed and evaluated on general-purpose datasets with relatively structured scenes and well-defined object categories [6,7], which limits their effectiveness when directly applied to chaotic disaster environments characterized by severe occlusion and ambiguous visual cues.
Recent studies have explored domain-specific detection for rescue scenarios. For instance, prior work investigated personnel detection in flood environments [8] and object detection in aerial imagery under adverse conditions [9]. While these studies demonstrate the feasibility of applying deep learning to emergency response, they are typically constrained to specific disaster types, limited object categories, or narrow operational contexts. Comprehensive detection of multiple rescue-related roles across diverse disaster situations remains insufficient.
Meanwhile, the You Only Look Once (YOLO) family [10,11] has significantly advanced real-time object detection through successive architectural improvements in feature representation, multi-scale learning, and computational efficiency [10,12,13,14,15]. More recent versions have incorporated attention mechanisms to enhance contextual understanding in complex scenes [16]. Despite these advances, YOLO-based approaches in disaster scenarios are predominantly applied as single-model detectors and are rarely optimized for fine-grained rescue-oriented semantics or densely overlapping entities. In addition, many existing disaster datasets focus primarily on scene-level annotations or coarse human detection [17,18], providing limited support for distinguishing between different rescue roles at the instance level. However, existing approaches have largely overlooked cross-generational complementarity in ensemble design, limiting their ability to exploit diverse feature representations across different model architectures.
To address these limitations, this study proposes a multi-generational YOLO ensemble framework for high-precision disaster scene analysis. The proposed approach integrates a curated rescue-oriented dataset derived from disaster news imagery with an ensemble of YOLO models from different architectural generations. By leveraging cross-generational diversity and adopting Weighted Boxes Fusion (WBF) [19] as an inference-time fusion operator, the framework enhances detection robustness and localization accuracy in chaotic, densely populated disaster scenes. This design provides a reliable foundation for real-time emergency response and automated disaster reporting.
Unlike conventional ensemble strategies that combine closely related model variants, this study explicitly treats cross-generational architectural diversity as a core design principle. Different YOLO generations introduce distinct inductive biases in feature extraction, localization, and contextual reasoning. By integrating these heterogeneous characteristics through consensus-based fusion, the proposed framework achieves more robust rescue-oriented detection than homogeneous or single-model approaches.
The contributions of this work are summarized as follows:
(1) We propose a multi-generational YOLO ensemble framework that systematically integrates detectors across architectural generations, explicitly leveraging cross-generational diversity to improve robustness in complex, densely occluded disaster scenes.
(2) We incorporate Weighted Boxes Fusion (WBF) as an inference-time consensus mechanism, combined with a frozen backbone strategy, enabling effective aggregation of heterogeneous predictions without modifying model architectures.
(3) We construct a fine-grained, rescue-oriented dataset derived from CDNIC19k [20] with four mission-critical roles and conduct comprehensive experiments to evaluate robustness under varying thresholds and ensemble configurations.
(4) We provide a systematic analysis of accuracy–efficiency trade-offs across model scales and ensemble configurations, providing practical insights into the balance between detection performance and computational cost.

2. Related Works

This section reviews representative studies in disaster-oriented object detection, domain-specific rescue applications, and YOLO-based real-time detection and ensemble strategies. By summarizing their key characteristics and limitations, the research gap addressed by this study is identified.

2.1. Object Detection in Disaster and Emergency Scenes

Object detection has been widely applied to disaster scene analysis due to its ability to provide actionable spatial information. Early studies primarily focused on scene-level tasks, such as damage assessment, classification, or coarse human detection, which provide global situational awareness but offer limited support for fine-grained localization of critical entities.
Recent efforts have explored the application of deep learning–based detection models in disaster response. For example, Bahmanyar et al. [1] applied YOLOv3 for human detection using drones, while Paik et al. [4] integrated detection with multi-object tracking in UAV-based systems. Gomez et al. [21] further developed a YOLOv8-based detection system to improve search-and-rescue efficiency. Although these approaches demonstrate the feasibility of deploying object detection in disaster scenarios, they generally lack the ability to provide fine-grained, role-aware instance-level detection, which is essential for distinguishing between responders, victims, and other critical entities.

2.2. Rescue-Oriented Object Detection and Domain-Specific Studies

To address the limitations of general-purpose models, recent studies have investigated domain-specific detection methods for rescue scenarios. Nehete et al. [8] focused on human detection under flood conditions, demonstrating the effectiveness of tailored detection pipelines in visually challenging environments. Similarly, Tian et al. [9] explored victim detection from UAV imagery under adverse conditions, while Hao et al. [22] proposed YOLO-MSFR to improve multi-scale detection of victims. In addition, Ciccone et al. [23] developed lightweight AI systems for UAV-based rescue operations.
Despite these advances, existing approaches are typically restricted to narrow operational settings, focusing on specific disaster types or limited detection targets. Furthermore, many existing datasets, including RescueNet [17], SARD [18], and EmergencyNet [24], emphasize scene understanding or damage assessment rather than instance-level role annotation. Although Zhou et al. [25] provides rich semantic descriptions of disaster events, its lack of spatial annotations limits its direct applicability to object detection tasks.
More importantly, current studies often treat all human subjects as a single category and rarely address fine-grained role differentiation (e.g., rescue personnel, medical staff, injured individuals). In addition, most approaches rely on single-model detection frameworks, which may be insufficient for handling dense object overlaps and complex interactions in disaster scenarios. These limitations highlight the need for detection frameworks that jointly consider semantic granularity and architectural robustness.

2.3. Real-Time Object Detection with YOLO-Based Architectures

The YOLO family has become one of the most widely adopted frameworks for real-time object detection due to its efficiency and end-to-end design [10,12]. Successive developments have improved feature representation, multi-scale learning, and computational efficiency [13,14,15], while recent variants incorporate mechanisms such as attention to enhance contextual modeling [16].
Despite these advancements, YOLO-based detectors are commonly deployed as single-model systems in disaster applications, which can lead to unstable localization and reduced robustness under complex conditions. Additionally, traditional post-processing methods such as non-maximum suppression (NMS) [26] rely on suppression mechanisms that may discard valid detections in densely populated scenes.
To improve detection performance, ensemble-based approaches have been explored. Among them, Weighted Boxes Fusion (WBF) [19] provides a confidence-driven fusion strategy that combines overlapping predictions from multiple models rather than suppressing them, allowing more accurate localization in dense scenarios. This approach has been widely adopted in object detection ensembles [27].
However, existing ensemble strategies are typically constructed from closely related model variants and do not fully exploit the architectural diversity across different YOLO generations. Given that different generations exhibit distinct inductive biases in feature extraction, localization, and contextual reasoning, cross-generational complementarity remains largely underexplored.
This limitation highlights a critical research gap and motivates the development of a multi-generational YOLO ensemble framework with consensus-based fusion to improve detection robustness and role-aware localization in complex disaster environments. To the best of our knowledge, no prior work has systematically investigated cross-generational YOLO ensembles for fine-grained disaster scene understanding.

3. Materials and Methods

This section describes the rescue-oriented dataset, the proposed multi-generational YOLO ensemble framework, the training strategy, the evaluation metrics, and the experimental setup.

3.1. Rescue-Oriented Dataset

3.1.1. Data Collection

To support rescue-oriented disaster scene analysis, this study constructed a domain-specific object detection dataset by re-annotating a subset of the publicly available CDNIC19k dataset, which contains more than 19,000 real-world disaster news images across 15 disaster types. Although CDNIC19k provides rich disaster-related visual content, it was originally developed for image captioning and does not include instance-level spatial annotations required for object detection.
The keyword-based filtering process initially retrieved approximately 4318 images. These images were subsequently subjected to manual inspection and excluded if they met any of the following criteria: (1) irrelevance to rescue scenarios, (2) insufficient visual clarity, or (3) duplicate or near-duplicate content. After this screening process, a total of 2323 images were retained.
These 2323 images were then fully re-annotated. The selection was guided by a keyword matching strategy derived from a manual examination of the CDNIC19k caption vocabulary. Rescue-related Chinese terms were grouped into four predefined categories: rescue personnel, firefighters, medical staff, and injured individuals.
Images were included if their original captions contained manually identified category-specific keywords (including synonyms and related expressions). After filtering, all selected images were re-annotated with bounding boxes, resulting in 3211 labeled instances across the four categories.
Table 1 compares the class distribution between the original CDNIC19k captions and the proposed rescue-oriented dataset. The CDNIC19k counts reflect caption-level semantic references, whereas the proposed dataset provides instance-level bounding-box annotations. Although modest in scale compared with generic object detection benchmarks, this dataset reflects the practical constraints of rescue-oriented annotation and provides fine-grained role-aware labels rarely available in disaster imagery.

3.1.2. Annotation Procedure

Object annotation followed a two-stage expert-involved verification procedure to improve labeling accuracy and semantic consistency. In the first stage, all bounding boxes were manually annotated by a trained research assistant according to unified annotation guidelines. In the second stage, the annotations were independently reviewed and verified by a senior researcher with experience in computer vision–based object detection.
Discrepancies identified during review were resolved through direct expert inspection and correction rather than statistical averaging, to preserve precise localization in visually complex rescue scenes. Although this expert-driven process improves annotation reliability, the current dataset does not include formal quantitative inter-annotator agreement metrics or a fully standardized multi-expert consensus protocol. This limitation reflects the exploratory nature of the present study and practical constraints in rescue-oriented data collection. Future work will incorporate systematic multi-expert validation workflows and quantitative agreement analysis.

3.2. Detection Framework and Ensemble Strategy

This study proposes a multi-model ensemble detection framework that integrates heterogeneous YOLO variants and fuses their predictions using Weighted Boxes Fusion (WBF). The overall pipeline consists of three main stages: (1) input preprocessing, (2) model inference with frozen backbone fine-tuning, and (3) prediction fusion.

3.2.1. Input Preprocessing

Given an input batch, images are represented as a tensor
I R B × 3 × H × W
where B denotes the batch size, and H and W represent the spatial dimensions.
The preprocessing follows the default Ultralytics YOLO pipeline. Specifically, images are converted to RGB format and pixel values are normalized to the range [0, 1]. During batch processing, a minimum rectangle padding (minimal letterboxing) strategy is applied. Images are proportionally resized and padded only to the minimum size required to ensure consistent spatial dimensions within each batch, rather than being uniformly resized to a fixed 640 × 640 resolution.
This approach preserves aspect ratios while maintaining computational efficiency and compatibility with batch inference.

3.2.2. Model Configuration and Fine-Tuning Strategy

We employ multiple YOLO variants spanning different architectural generations to enhance detection diversity. For each model, we adopt a frozen-backbone fine-tuning strategy, where only the detection head layers are updated while the backbone feature extractor remains fixed.
The definition of backbone and detection head modules follows the official Ultralytics YOLO configuration files. Accordingly, the backbone corresponds to the feature extraction layers, while the detection head comprises the prediction layers responsible for bounding box regression, objectness estimation, and class probability outputs.
The number of frozen backbone layers varies across model variants according to their configurations: YOLOv5x (10 layers), YOLOv8x (10 layers), YOLOv9e (30 layers), YOLOv10x (11 layers), YOLOv11x (11 layers), YOLOv12n/x (9 layers), and YOLOv26x (11 layers).
This strategy ensures consistent adaptation to the target dataset while preserving the general feature representations learned from large-scale pretraining.

3.2.3. Prediction Fusion via Weighted Boxes Fusion

For each input image, multiple YOLO models produce a set of predictions, which can be expressed as:
P = { ( B k , i , C k , i , l k , i ) k = 1 , , 8 ;   i = 1 , , 4 }
where B k , i denotes the bounding box coordinates, C k , i represents the confidence score, and l k , i is the predicted class label from the k -th model.
Before fusion, predictions are processed through a series of steps: confidence-based filtering to remove low-confidence detections, class-wise grouping to ensure independent processing of each category, and IoU-based clustering to group overlapping bounding boxes.
The WBF algorithm then fuses overlapping boxes by computing a confidence-weighted average of their coordinates, optionally incorporating model-specific weights. The confidence score C k , i is defined as the product of objectness and class probability, following the standard YOLO formulation.
After fusion, a final confidence threshold is applied to remove low-confidence predictions. No additional post-processing step is introduced beyond this filtering stage, and the resulting outputs are directly treated as the final detection results Y d e t .

3.2.4. Design Rationale

As illustrated in Figure 1, the proposed framework is designed to exploit architectural complementarity across different YOLO generations. By combining diverse detection behaviors and aggregating them through WBF, the model achieves improved robustness and accuracy compared to individual detectors.
Meanwhile, the overall pipeline remains computationally streamlined, because final predictions are derived directly from WBF outputs without introducing additional post-processing complexity.

3.3. Selection and Diversity of Multi-Generational YOLO Models

The proposed ensemble includes eight YOLO variants selected to represent different stages of architectural development. Earlier models, such as YOLOv5 and YOLOv8, emphasize hierarchical convolutional feature extraction and efficient multi-scale fusion, whereas newer versions, such as YOLOv12 and YOLOv26, incorporate more advanced designs, including attention-related mechanisms and improved contextual modeling.
These architectural differences introduce complementary inductive biases in feature extraction, localization, and contextual reasoning. By combining models from different generations, the framework aims to capture a broader range of detection behaviors than single-model or same-generation ensembles. This design is particularly relevant for disaster scenes, where dense overlap, scale variation, and ambiguous visual cues can challenge individual detectors.

3.4. Training Strategy

The training strategy consists of two stages: independent model specialization and inference-time fusion.

3.4.1. Stage 1 Training: Frozen Backbone and Head Fine-Tuning

Each YOLO model is trained independently on the curated rescue-oriented dataset. To improve stability under limited domain-specific data and reduce overfitting, only the detection heads are fine-tuned, while the backbone parameters remain fixed. The effectiveness of this design is empirically examined in Section 4.1.
All backbones are initialized with weights pre-trained on the Microsoft COCO dataset [28], providing transferable low- and mid-level visual representations for the target task. The detection heads are then adapted to the four rescue-oriented categories.
Bounding-box regression followed the standard YOLO formulation. For localization, this study adopted the Complete Intersection over Union (CIoU) loss [29], an extension of Intersection over Union (IoU) [30] that incorporates the overlap area, center-point distance, and aspect-ratio consistency for more comprehensive bounding-box regression. Compared with other IoU-based variants, such as Generalized IoU (GIoU) [31] and Distance IoU (DIoU), CIoU provides more stable localization and faster convergence, particularly in dense scenes.
The optimization objective is defined by a multi-component loss function:
  • CIoU loss for bounding-box regression;
  • Binary cross-entropy loss for object score;
  • Categorical cross-entropy loss for the four target classes.

3.4.2. Stage 2 Strategy: Fusion During Inference

The second stage does not involve additional training. Instead, the predictions from all independently fine-tuned YOLO models are directly aggregated and fused during inference using Weighted Boundary Fusion (WBF).
Unlike suppression-based methods such as non-maximum suppression (NMS), WBF combines overlapping predictions by computing confidence-weighted spatial averages, thereby preserving valid detections contributed by multiple models. Because all detectors share a unified YOLO-style output format, their predictions can be fused directly without modifying the underlying architecture.
Performing fusion directly during inference helps maintain training stability while improving localization robustness in complex disaster scenarios.

3.5. Evaluation Metrics

Detection performance is evaluated using standard object detection metrics, including precision, recall, F1 score, mAP50, and mAP50–95.
Precision and recall are defined as:
P r e c i s i o n = T P T P + F P
R e c a l l = T P T P + F N
where T P , F P and F N denote true positives, false positives and false negatives, respectively.
The F1 score is defined as the harmonic mean of precision and recall:
F 1 = 2 × P r e c i s i o n × R e c a l l P r e c i s i o n + R e c a l l
The primary metric is mean Average Precision (mAP). This study reports the following:
  • mAP50: mAP at IoU = 0.5;
  • mAP50–95: mAP averaged over IoU thresholds from 0.50 to 0.95 in intervals of 0.05.
Formally,
m A P 50 95 = 1 N i = 1 N A P ( I o U = 0.50 + 0.05 × ( i 1 ) )
where N = 10 .
These metrics jointly evaluate classification confidence, localization precision, and detection completeness.

3.6. Experiment Setup

All experiments were conducted under the same data split, training configuration, and implementation environment to ensure fair comparison across single-model and ensemble settings.

3.6.1. Dataset Split and Preparation

The curated rescue-oriented dataset consists of 2323 images with four annotated categories: rescue personnel, firefighters, medical staff, and injured individuals. In the main experiments, the dataset was divided into 80% training and 20% testing, using a fixed hold-out split.
Given the relatively limited dataset size, introducing an additional validation split could increase evaluation variance. Therefore, the original experiments adopted an 80/20 hold-out protocol to balance training sufficiency and evaluation reliability. To further assess generalization and address potential overfitting concerns, the study additionally includes a 5-fold cross-validation (CV) evaluation, the results of which are compared with the hold-out results in Section 4.
All models were trained under the same data split and frozen backbone setting, and ensemble fusion was applied only at inference time.

3.6.2. Experimental Design

Three groups of experiments were designed to evaluate the proposed framework:
  • Detection framework comparison
    Single-model baselines;
    Ensemble with NMS;
    Ensemble with WBF.
  • Sensitivity analysis of post-processing parameters
    Confidence threshold variation;
    IoU threshold variation;
    Comparison between NMS- and WBF-based ensembles.
  • Ablation of ensemble composition
    Early-generation ensemble;
    Recent-generation ensemble;
    Full multi-generational ensemble.
Unless otherwise specified, the default inference settings are confidence = 0.25 and IoU = 0.7. Peak results are reported using threshold settings identified through sensitivity analysis.

3.6.3. Training Configuration

All experiments were implemented in PyTorch 2.3.1 with cu121 on a system with an NVIDIA RTX 3090 Ti (24 GB VRAM), an Intel Core i9-12900K CPU, 64 GB RAM (Micro-Star INT’L CO., LTD., Zhonghe, New Taipei, Taiwan), and Windows 11. The Python version was 3.11.12. For YOLOv12 experiments, FlashAttention 2.5.9.post2 was used to support attention operations.
All models were trained using the Ultralytics YOLO training pipeline with identical hyperparameters:
  • Optimizer: auto;
  • Learning rate (lr0/lrf): 1 × 10−2;
  • Momentum: 0.937;
  • Batch size: 12;
  • Epochs: 100.
For inference, all models used the same default settings:
  • IoU threshold: 0.7;
  • Confidence threshold: 0.25.
No automated hyperparameter optimization (e.g., grid search, Bayesian optimization, or genetic algorithms) was performed in this study. Instead, to maintain a consistent and unbiased training protocol across heterogeneous YOLO architectures, all models were trained using the same set of hyperparameters, including optimizer type, learning rate schedule, momentum, batch size, and number of epochs. This design choice allows the performance differences to be attributed primarily to architectural diversity and ensemble fusion rather than to model-specific tuning.
To mitigate class imbalance among the four annotated categories, we adopted a data-level balancing strategy. Rotation-based augmentations (90°, 180°, and 270°) were selectively applied only to minority classes (“Medical staff” and “Injured Individuals”), increasing effective sample diversity without introducing unrealistic visual distortions. The resulting class distributions before and after augmentation are summarized in Table 2.
To enhance generalization to chaotic disaster scenes, additional image-level augmentations were applied during training. Brightness adjustments were used to simulate varying illumination conditions, while minor affine transformations accounted for mild viewpoint and geometric variations frequently observed in disaster news imagery. No augmentation was applied during validation or testing to ensure unbiased evaluation.
Class-weighted losses were not employed in this study to preserve a consistent training configuration across heterogeneous YOLO architectures and to isolate the impact of ensemble diversity and weighted box fusion. The evaluation of alternative reweighting strategies is left for future work.

4. Results

Quantitative evaluation results are first reported to compare detection accuracy among baseline models and the proposed ensemble approach. This is followed by a discussion of the observed performance gains, robustness improvements, and the inherent trade-offs between accuracy and computational efficiency.

4.1. Comparison of Frozen vs. Trainable Backbone Networks

This experiment examines the effect of training backbone networks. As shown in Table 3, backbone fine-tuning does not provide consistent mAP50 improvements for either single models or ensembles. Only one model shows marginal improvement, while most configurations degrade after fine-tuning. The same trend is observed for ensemble methods, where both NMS and WBF exhibit reduced performance under trainable backbone settings (Table 3). These results suggest that full fine-tuning offers no consistent benefit and may negatively affect ensemble stability. Therefore, frozen backbones are adopted in all subsequent experiments, as they provide more stable detection performance under limited-data conditions.

4.2. Detection Framework Comparison

When integrating multiple YOLO variants, ensemble frameworks significantly improve recall but exhibit substantially lower precision compared to single models. As shown in Table 4, the WBF-based ensemble achieves the highest recall and mAP, indicating the effectiveness of cross-generational prediction fusion.
The NMS-based ensemble also achieves high recall but with similarly low precision (Table 4), while its mAP remains comparable to strong single-model baselines. These results reveal a clear precision–recall trade-off, where improved detection coverage is achieved at the expense of increased false positives, particularly under ensemble aggregation. In rescue-oriented scenarios, recall is often more critical than precision, as missed detections may compromise situational awareness. Therefore, maintaining high recall and stable localization is essential for effective disaster response.

4.3. Sensitivity to Post-Processing Parameters

The parameter sensitivity analysis in Figure 2 shows that the NMS-based ensemble is sensitive to threshold selection, with performance degrading rapidly as confidence or IoU values deviate from a narrow optimal range. In contrast, the WBF-based ensemble demonstrates more stable performance across a wider range of settings.
As summarized in Table 5, even under their respective optimal thresholds, WBF consistently outperforms NMS. This comparison is conducted under identical confidence and IoU settings (Table 5), confirming that the performance gain of WBF is not due to parameter tuning.
These observations are further supported by Figure 3 and Figure 4, which illustrate the behavior of both ensembles across different operating points. Both methods operate in a high-recall regime, while WBF achieves its optimal mAP50 with relatively higher precision, indicating a more balanced precision–recall trade-off. In addition, WBF consistently maintains higher mAP50 across varying confidence and IoU thresholds, while NMS exhibits a narrower optimal region and rapid performance degradation outside it.

4.4. Ensemble Composition Ablation

To analyze the impact of ensemble composition, ablation experiments are conducted using subsets of YOLO generations. As shown in Table 6, ensembles constructed from similar generations (Early-YOLO and Recent-YOLO) provide only marginal improvement over their corresponding single-model baselines.
In contrast, the multi-generational ensemble achieves the highest mAP50, significantly outperforming both single models and same-generation ensembles. This result indicates that combining models from different YOLO generations provides stronger complementarity.
Overall, these findings highlight that performance gains are primarily driven by cross-generational diversity rather than simply increasing the number of models.

4.5. Quantitative Analysis of Accuracy–Efficiency Trade-Offs

The trade-off between accuracy and efficiency is quantitatively analyzed from two complementary perspectives: (i) intra-family comparison within the YOLOv12 series (Table 7), and (ii) cross-model and ensemble evaluation (Table 8).
As shown in Table 7, the YOLOv12 family exhibits a clear accuracy–efficiency trade-off. Lightweight models such as YOLOv12n provide high throughput but limited accuracy, whereas larger models improve accuracy at the cost of speed. Among single models, YOLOv12x offers the best balance when accuracy is prioritized, achieving higher mAP50 than YOLOv12l with only a moderate reduction in FPS.
This trend is further extended in Table 8, which compares heterogeneous single models and ensemble configurations. Relative to the best single model (YOLOv12x), the full ensemble improves mAP50 from 0.696 to 0.756 but at substantially higher computational cost, including increased parameters, GFLOPs, latency, and reduced throughput.
Smaller ensembles provide a more practical balance. For example, the two-model ensemble improves mAP50 to 0.707 while maintaining near real-time performance, whereas the four-model ensemble further improves accuracy to 0.746 but reduces FPS to 12.53. In addition, WBF consistently outperforms NMS across all ensemble settings (e.g., 0.756 vs. 0.715 for the full ensemble), indicating that preserving complementary predictions is beneficial in dense disaster scenes.
Overall, Table 7 and Table 8 reveal a controllable accuracy–efficiency trade-off. Lightweight models are suitable for latency-sensitive deployment, whereas YOLOv12x is a stronger single-model choice when accuracy is crucial. Ensemble methods provide the highest reliability when computational resources permit. Because the proposed framework operates only at inference time and requires no retraining, model combinations can be flexibly adjusted according to deployment constraints. This two-level analysis implicitly defines a Pareto frontier between accuracy and efficiency across both model scaling and ensemble design.

4.6. Cross-Validation Analysis

The effectiveness and generalization capability of the proposed multi-generational ensemble framework were further evaluated using a 5-fold cross-validation (CV) scheme and compared with the original hold-out evaluation. As summarized in Table 9, the average 5-fold CV results are highly consistent with the hold-out performance across all metrics evaluated.
Specifically, mAP50, mAP50–95, precision, and recall obtained from 5-fold CV align closely with those reported under the hold-out setting, with relatively small standard deviations across folds. This consistency indicates that the observed performance improvements are not sensitive to a specific data split and are not attributable to overfitting. Overall, these results demonstrate the stability and generalizability of the proposed ensemble approach across different data partitions.

4.7. Interpretation of Quantitative Differences Between NMS and WBF

To complement the quantitative evaluation presented in Table 4, Table 5 and Table 8, an interpretation of the observed quantitative results is provided to examine the behavioral characteristics of Non-Maximum Suppression (NMS) and Weighted Box Fusion (WBF) under challenging emergency-response scenarios. Although both methods operate as post-processing strategies for object detection, they exhibit distinct trade-offs between recall and precision.
The quantitative results suggest that NMS tends to preserve a larger number of candidate detections. This characteristic improves the likelihood of retaining partially occluded or low-visibility targets, thereby contributing to higher recall. However, the increased sensitivity also leads to a higher occurrence of false positives and redundant detections, particularly in crowded environments where multiple objects overlap spatially. In such situations, visually similar regions may be incorrectly interpreted as separate targets, resulting in duplicated bounding boxes or erroneous object assignments.
In contrast, the quantitative performance differences observed in Table 4, Table 5 and Table 8 suggest that WBF provides a stronger capability for consolidating overlapping predictions generated by the ensemble models. By aggregating spatially consistent bounding boxes, WBF produces cleaner detection outputs with fewer duplicate detections and reduced false-positive rates. These characteristics contribute to improved localization stability and higher overall detection accuracy, consistent with the superior mAP and F1-score results reported in Table 4 and Table 5. These observations are further supported by the results in Table 8, where WBF-based ensembles consistently outperform their NMS counterparts across different ensemble configurations.
The comparison further indicates that the advantages of WBF may become more evident in complex scenes containing multiple interacting subjects. In these scenarios, WBF effectively suppresses redundant predictions while preserving primary targets, leading to more coherent detection results. Nevertheless, the fusion mechanism may also suppress detections associated with weak confidence scores. Consequently, highly occluded, distant, or visually degraded targets may occasionally be omitted during fusion despite the overall competitive recall performance of WBF. Another notable observation is that both methods exhibit similar limitations in fine-grained role recognition. Confusions between visually similar categories persist regardless of the post-processing strategy employed. This suggests that classification ambiguities primarily originate from feature representation and model discrimination capability rather than from the post-processing stage itself. Therefore, improvements in feature learning, class-specific representation, or attention mechanisms may be necessary to further enhance category discrimination.
Overall, the foregoing interpretation is consistent with the quantitative results reported in Table 4 and Table 5. NMS favors sensitivity by preserving more candidate detections and achieving stronger recall performance, whereas WBF prioritizes detection reliability by reducing redundant predictions and false positives. As a result, WBF achieves superior overall detection performance, while NMS remains advantageous when detecting heavily occluded or low-confidence targets is critical. These findings suggest that future research may benefit from adaptive or hybrid post-processing mechanisms that dynamically balance recall and precision according to scene complexity and target visibility conditions.

5. Discussion

This study demonstrates that leveraging cross-generational architectural diversity with a consensus-based fusion strategy significantly improves rescue-oriented object detection in complex disaster scenes. The proposed multi-generational YOLO ensemble consistently outperforms single-model baselines and conventional NMS-based approaches, achieving a notable increase in mAP50 (0.696 → 0.756) along with improved recall and F1-scores. Sensitivity analysis further shows stable performance across a wide range of confidence and IoU thresholds, indicating strong robustness under variable conditions.
These findings extend prior work on YOLO-based disaster detection and ensemble learning. Unlike existing approaches that rely on single architectures or homogeneous ensembles, this study systematically leverages cross-generational complementarity, combining convolution- and attention-enhanced YOLO variants. The results confirm the advantage of WBF over suppression-based methods in crowded scenarios and demonstrate that its effectiveness is further amplified when paired with heterogeneous model ensembles. In addition, the curated rescue-oriented dataset enables fine-grained, role-aware detection, addressing a key limitation in existing datasets that focus primarily on generic human detection.
From an academic perspective, this work contributes a principled multi-generational ensemble framework that treats architectural diversity as a core design strategy. It further provides empirical evidence that inference-time fusion via WBF improves localization robustness without additional training cost, making it suitable for time-critical applications. The proposed dataset also establishes a benchmark for role-aware disaster detection.
Despite these contributions, several limitations remain. The dataset is limited in scale and diversity, as it is largely derived from disaster news imagery, and the current framework does not exploit temporal information from video data. Additionally, evaluation is not explicitly stratified by visibility conditions (e.g., smoke or severe weather), which may affect performance in extreme environments.
Future work will focus on expanding the dataset to include multi-source and multi-modal data, incorporating temporal fusion for video-based analysis, and exploring adaptive ensemble weighting to better balance accuracy and efficiency. Extending the framework to integrate Transformer-based detectors (such as RT-DETR [32]) and additional modalities (e.g., thermal imaging) also represents a promising direction, particularly for low-visibility scenarios. In general, the proposed ensemble design for inference-only remains flexible and scalable, allowing practical deployment in diverse disaster response settings.

6. Conclusions

This study presents a multi-generational YOLO ensemble with a WBF framework for rescue-oriented object detection in chaotic and densely populated disaster scenes. By explicitly leveraging cross-generational architectural complementarity and integrating model predictions through confidence-weighted fusion, the proposed approach achieves robust and reliable detection performance beyond that of individual detectors.
Experimental results demonstrated that ensemble-based detection substantially enhances localization accuracy and detection completeness compared to single-model baselines. In particular, the proposed framework demonstrated strong robustness to variations in confidence and IoU thresholds, highlighting its suitability for real-world disaster response scenarios where operating conditions may be difficult to tune in advance.
Although lightweight YOLO variants are attractive for resource-constrained deployment, Table 7 shows that YOLOv12n/s/m exhibits noticeable performance degradation in complex disaster environments due to limited feature representation. In contrast, YOLOv12x offers superior accuracy and more stable localization under challenging conditions, making it a more reliable choice for safety-critical rescue tasks where missed detections must be minimized. Accordingly, this study prioritizes robustness by incorporating YOLOv12x as a core component of the proposed multi-generational ensemble framework. Importantly, the framework remains model-agnostic and supports resource-aware configurations, allowing lightweight variants to be included when computational constraints are critical, albeit with reduced detection accuracy. This design enables flexible adaptation across diverse deployment scenarios.
Ablation studies further confirm that architectural diversity across multiple generations of YOLO plays a critical role in improving detection performance, whereas ensembles constructed from limited or closely related variants provide only marginal gains. In general, these findings demonstrate that the complementarity of cross-generational models, combined with inference-time consensus, offers a practical and effective solution for accurate and robust object detection in complex disaster environments. More importantly, this study reframes ensemble object detection by treating cross-generational architectural diversity as a core design principle enabled by consensus-based fusion to achieve enhanced robustness in complex scenes.

Author Contributions

M.-H.T. designed the study. Y.-W.H. trained the models. M.-H.T. and Y.-W.H. collected the data. All authors analyzed and interpreted the data. All authors prepared the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Science and Technology Council, Taiwan, grant number NSTC 114-2121-M-040-001.

Data Availability Statement

Data supporting the findings of this study are available from [News image caption dataset (CDNIC19k)] at https://github.com/fi94/News_Dataset, reference number [20].

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Bahmanyar, R.; Merkle, N. Saving lives from above: Person detection in disaster response using deep neural networks. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2023, 10, 343–350. [Google Scholar] [CrossRef] [Scilit]
  2. Daud, S.M.S.M.; Yusof, M.Y.P.M.; Heo, C.C.; Khoo, L.S.; Singh, M.K.C.; Mahmood, M.S.; Nawawi, H. Applications of drone in disaster management: A scoping review. Sci. Justice 2022, 62, 30–42. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  3. Wang, D.; Ma, G.; Wang, X.; Yang, R.; Zhang, Y. Few-Shot change detection in optical and SAR remote sensing images for disaster response. Int. J. Appl. Earth Obs. Geoinf. 2026, 146, 105100. [Google Scholar] [CrossRef] [Scilit]
  4. Paik, C.; Kim, H.J. Improving object detection, multi-object tracking, and re-identification for disaster response drones. arXiv 2022, arXiv:2201.01494. [Google Scholar]
  5. Li, Z.; Wang, Y.; Zhang, N.; Zhang, Y.; Zhao, Z.; Xu, D.; Ben, G.; Gao, Y. Deep learning-based object detection techniques for remote sensing images: A survey. Remote Sens. 2022, 14, 2385. [Google Scholar] [CrossRef] [Scilit]
  6. Tang, G.; Ni, J.; Zhao, Y.; Gu, Y.; Cao, W. A survey of object detection for UAVs based on deep learning. Remote Sens. 2023, 16, 149. [Google Scholar] [CrossRef] [Scilit]
  7. Gui, S.; Song, S.; Qin, R.; Tang, Y. Remote sensing object detection in the deep learning era—A review. Remote Sens. 2024, 16, 327. [Google Scholar] [CrossRef] [Scilit]
  8. Nehete, P.U.; Dharrao, D.S.; Pise, P.; Bongale, A. Object Detection and Classification in Human Rescue Operations: Deep Learning Strategies for Flooded Environments. Int. J. Saf. Secur. Eng. 2024, 14, 599–611. [Google Scholar] [CrossRef] [Scilit]
  9. Tian, X.; Zheng, Y.; Huang, L.; Bi, R.; Chen, Y.; Wang, S.; Su, W. LightSeek-YOLO: A Lightweight Architecture for Real-Time Trapped Victim Detection in Disaster Scenarios. Mathematics 2025, 13, 3231. [Google Scholar] [CrossRef] [Scilit]
  10. Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You only look once: Unified, real-time object detection. Presented at the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June, 2016; pp. 779–788. [Google Scholar]
  11. Sapkota, R.; Cheppally, R.H.; Sharda, A.; Karkee, M. YOLO26: Key architectural enhancements and performance benchmarking for real-time object detection. arXiv 2025, arXiv:2509.25164. [Google Scholar]
  12. Zhao, Z.-Q.; Zheng, P.; Xu, S.-T.; Wu, X. Object detection with deep learning: A review. IEEE Trans. Neural Netw. Learn. Syst. 2019, 30, 3212–3232. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  13. Wang, C.-Y.; Liao, H.-Y.M. YOLOv1 to YOLOv10: The fastest and most accurate real-time object detection systems. APSIPA Trans. Signal Inf. Process. 2024, 13, e29. [Google Scholar] [CrossRef] [Scilit]
  14. Ali, M.L.; Zhang, Z. The YOLO framework: A comprehensive review of evolution, applications, and benchmarks in object detection. Computers 2024, 13, 336. [Google Scholar] [CrossRef] [Scilit]
  15. Hussain, M. Yolov5, yolov8 and yolov10: The go-to detectors for real-time vision. arXiv 2024, arXiv:2407.02988. [Google Scholar]
  16. Tian, Y.; Ye, Q.; Doermann, D. Yolov12: Attention-centric real-time object detectors. arXiv 2025, arXiv:2502.12524. [Google Scholar]
  17. Rahnemoonfar, M.; Chowdhury, T.; Murphy, R. RescueNet: A high resolution UAV semantic segmentation dataset for natural disaster damage assessment. Sci. Data 2023, 10, 913. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  18. Sambolek, S.; Ivasic-Kos, M. Automatic person detection in search and rescue operations using deep CNN detectors. IEEE Access 2021, 9, 37905–37922. [Google Scholar] [CrossRef] [Scilit]
  19. Solovyev, R.; Wang, W.; Gabruseva, T. Weighted boxes fusion: Ensembling boxes from different object detection models. Image Vis. Comput. 2021, 107, 104117. [Google Scholar] [CrossRef] [Scilit]
  20. News Image Caption Dataset (cdnic19k). Available online: https://github.com/fi94/News_Dataset (accessed on 1 January 2026).
  21. Gomez, D.E.; Calderon, J.M. Visual Disaster Classification and Relevant Object Detection for Multi-Robot in Search and Rescue Operations Using Deep Learning. In Presented at the 2025 IEEE 16th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON), Yorktown Heights, NY, USA, 22–224 October 2025; IEEE: New York, NY, USA, 2025; pp. 0340–0345. [Google Scholar]
  22. Hao, S.; Zhao, Q.; Ma, X.; Wu, Y.; Gao, S.; Yang, C.; He, T. YOLO-MSFR: Real-time natural disaster victim detection based on improved YOLOv5 network. J. Real.-Time Image Process. 2024, 21, 7. [Google Scholar] [CrossRef] [Scilit]
  23. Ciccone, F.; Ceruti, A. Real-time search and rescue with drones: A deep learning approach for small-object detection based on YOLO. Drones 2025, 9, 514. [Google Scholar] [CrossRef] [Scilit]
  24. Kyrkou, C.; Theocharides, T. EmergencyNet: Efficient aerial image classification for drone-based emergency monitoring using atrous convolutional feature fusion. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2020, 13, 1687–1699. [Google Scholar] [CrossRef] [Scilit]
  25. Zhou, J.; Zhu, Y.; Zhang, Y.; Yang, C.; Pan, H. Spatial-aware topic-driven-based image Chinese caption for disaster news. Neural Comput. Appl. 2023, 35, 9481–9500. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  26. Gong, M.; Wang, D.; Zhao, X.; Guo, H.; Luo, D.; Song, M. A review of non-maximum suppression algorithms for deep learning target detection. In Presented at the Seventh Symposium on Novel Photoelectronic Detection Technology and Applications, Kunming, China, 5–7 November 2021; SPIE: Bellingham, WA, USA, 2021; Volume 11763, pp. 821–828. [Google Scholar]
  27. Giakoumoglou, N.; Pechlivani, E.-M.; Frangakis, N.; Tzovaras, D. Enhancing tuta absoluta detection on tomato plants: Ensemble techniques and deep learning. AI 2023, 4, 996–1009. [Google Scholar] [CrossRef] [Scilit]
  28. Lin, T.-Y.; Maire, M.; Belongie, S.; Hays, J.; Perona, P.; Ramanan, D.; Dollár, P.; Zitnick, C.L. Microsoft COCO: Common objects in context. In Presented at the European Conference on Computer Vision, Zurich, Switzerland, 6–12 September 2014; Springer: Berlin/Heidelberg, Germany, 2014; pp. 740–755. [Google Scholar]
  29. Zheng, Z.; Wang, P.; Liu, W.; Li, J.; Ye, R.; Ren, D. Distance-IoU loss: Faster and better learning for bounding box regression. AAAI Conf. Artif. Intell. 2020, 34, 12993–13000. [Google Scholar] [CrossRef] [Scilit]
  30. Yu, J.; Jiang, Y.; Wang, Z.; Cao, Z.; Huang, T. Unitbox: An advanced object detection network. In Proceedings of the 24th ACM International Conference on Multimedia, Amsterdam, The Netherlands, 15–19 October 2016; pp. 516–520. [Google Scholar]
  31. Rezatofighi, H.; Tsoi, N.; Gwak, J.; Sadeghian, A.; Reid, I.; Savarese, S. Generalized intersection over union: A metric and a loss for bounding box regression. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–20 June 2019; pp. 658–666. [Google Scholar]
  32. Zhao, Y.; Lv, W.; Xu, S.; Wei, J.; Wang, G.; Dang, Q.; Liu, Y.; Chen, J. Detrs beat yolos on real-time object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 17–21 June 2024; pp. 16965–16974. [Google Scholar]
Figure 1. System architecture of the proposed framework. Individual heads are optimized in Stage 1 with frozen backbones, and multi-model predictions are synthesized in Stage 2 via a WBF engine for precise disaster detection. Arrows indicate the workflow sequence, and ellipses indicate continuous numerical sequences.
Figure 1. System architecture of the proposed framework. Individual heads are optimized in Stage 1 with frozen backbones, and multi-model predictions are synthesized in Stage 2 via a WBF engine for precise disaster detection. Arrows indicate the workflow sequence, and ellipses indicate continuous numerical sequences.
Technologies 14 00530 g001
Figure 2. Comparison of mAP50 heat maps across varying confidence and IoU thresholds using (a) WBF and (b) NMS, illustrating how parameter selection influences detection performance under different fusion strategies.
Figure 2. Comparison of mAP50 heat maps across varying confidence and IoU thresholds using (a) WBF and (b) NMS, illustrating how parameter selection influences detection performance under different fusion strategies.
Technologies 14 00530 g002
Figure 3. Precision–recall trade-off at optimal operating points that maximize mAP50, comparing WBF-based ensemble strategies (green marker) and NMS-based strategies (blue marker), highlighting differences in balance between precision and recall. The star markers denote the optimal operating points that achieve the highest mAP50 for the WBF and NMS strategies, respectively.
Figure 3. Precision–recall trade-off at optimal operating points that maximize mAP50, comparing WBF-based ensemble strategies (green marker) and NMS-based strategies (blue marker), highlighting differences in balance between precision and recall. The star markers denote the optimal operating points that achieve the highest mAP50 for the WBF and NMS strategies, respectively.
Technologies 14 00530 g003
Figure 4. Sensitivity analysis of mAP50 for ensemble strategies: (a) variation with confidence threshold under a fixed IoU (IoU = 0.4), and (b) variation with IoU threshold under a fixed confidence level (confidence = 0.001), demonstrating the robustness of model performance to parameter changes.
Figure 4. Sensitivity analysis of mAP50 for ensemble strategies: (a) variation with confidence threshold under a fixed IoU (IoU = 0.4), and (b) variation with IoU threshold under a fixed confidence level (confidence = 0.001), demonstrating the robustness of model performance to parameter changes.
Technologies 14 00530 g004
Table 1. Comparison of the distribution of objects of class between CDNIC19k and the proposed rescue-oriented dataset.
Table 1. Comparison of the distribution of objects of class between CDNIC19k and the proposed rescue-oriented dataset.
CategoryCDNIC19k
(Original)
Proposed Dataset
(Re-Annotated)
Rescue Personnel9061824
Firefighters634882
Medical Staff46134
Injured Individuals197371
Total objects17833211
Table 2. Class distribution of the training set using rotation-based selective augmentation.
Table 2. Class distribution of the training set using rotation-based selective augmentation.
CategoryBefore
Augmentation
After
Augmentation
Ratio
(Original → Aug.)
Rescue Personnel1453239156.8% → 50.3%
Firefighters70273927.4% → 15.5%
Medical Staff1074324.2% → 9.1%
Injured Individuals297119211.6% → 25.1%
Total objects25594754-
Total images18552778-
Table 3. Performance comparison of different detection frameworks under frozen and trainable backbone settings, evaluated using mAP50 and highlighting the impact of backbone optimization on model accuracy. Values in bold indicate the best mAP50 performance within the same framework.
Table 3. Performance comparison of different detection frameworks under frozen and trainable backbone settings, evaluated using mAP50 and highlighting the impact of backbone optimization on model accuracy. Values in bold indicate the best mAP50 performance within the same framework.
FrameworkmAP50 Performance
Trainable BackboneFrozen BackboneΔmAP50
Single-modelYOLOv5x0.5540.619−0.065
YOLOv8x0.5210.617−0.096
YOLOv9e0.5760.572+0.004
YOLOv10x0.5120.637−0.125
YOLOv11x0.5480.676−0.128
YOLOv12n0.4650.515−0.050
YOLOv12x0.4950.686−0.191
YOLOv26x0.5570.670−0.113
EnsembleNMS0.5980.675−0.077
WBF0.6300.715−0.085
Table 4. Performance comparison of different detection frameworks under frozen backbone settings, illustrating the relative effectiveness of each framework when feature extraction is fixed. Values in bold indicate the best performance for each metric within their respective categories (Single-model and Ensemble).
Table 4. Performance comparison of different detection frameworks under frozen backbone settings, illustrating the relative effectiveness of each framework when feature extraction is fixed. Values in bold indicate the best performance for each metric within their respective categories (Single-model and Ensemble).
FrameworkPrecisionRecallF1-ScoremAP50mAP50-95
Single-modelYOLOv5x0.6600.6300.6450.6190.405
YOLOv8x0.7850.5610.6540.6170.410
YOLOv9e0.5090.5930.5480.5720.396
YOLOv10x0.6530.5780.6130.6370.430
YOLOv11x0.7080.6380.6710.6760.446
YOLOv12n0.5680.5140.5400.5150.321
YOLOv12x0.7230.6670.6940.6860.490
YOLOv26x0.6700.6530.6610.6700.471
EnsembleNMS0.3690.9080.5240.6750.479
WBF0.3730.9100.5290.7150.513
Table 5. Optimal confidence and IoU threshold settings used to evaluate WBF and NMS under identical conditions, ensuring a fair comparison of their detection performance at maximum mAP50. Values in bold indicate the best results for each performance metric (mAP50, mAP50-95, and F1-Score) under identical threshold settings.
Table 5. Optimal confidence and IoU threshold settings used to evaluate WBF and NMS under identical conditions, ensuring a fair comparison of their detection performance at maximum mAP50. Values in bold indicate the best results for each performance metric (mAP50, mAP50-95, and F1-Score) under identical threshold settings.
MethodsConfidence
Threshold
IoU
Threshold
mAP50mAP50-95F1-Score
NMS0.250.70.6750.4790.524
WBF0.250.70.7150.5130.529
NMS0.0010.50.7150.4870.530
WBF0.0010.50.7520.4950.537
NMS0.0010.40.7130.4860.556
WBF0.0010.40.7560.4910.568
Table 6. Performance comparison of different ensemble compositions using WBF (confidence = 0.001, IoU = 0.4) relative to the best single-model baseline, where bold values highlight the superior performer in each baseline comparison and the maximum accuracy gain achieved.
Table 6. Performance comparison of different ensemble compositions using WBF (confidence = 0.001, IoU = 0.4) relative to the best single-model baseline, where bold values highlight the superior performer in each baseline comparison and the maximum accuracy gain achieved.
EnsembleVersionmAP50 PerformanceGain
NewBaseline
Early-YOLO5, 8, 9, 100.6600.637 (v10x)+0.023
Recent-YOLO11, 12, 260.7050.686 (v12x)+0.019
Full-MultiGenAll0.7560.686 (v12x)+0.070
Table 7. Quantitative analysis of accuracy–efficiency trade-offs within the YOLOv12 model family, comparing detection performance and computational cost across model scales to inform deployment decisions.
Table 7. Quantitative analysis of accuracy–efficiency trade-offs within the YOLOv12 model family, comparing detection performance and computational cost across model scales to inform deployment decisions.
ModelParams (M)GFLOPsModel Size (MB)Latency (ms)FPSmAP50
YOLOv12n2.573.245.2711.1389.810.519
YOLOv12s9.2510.7618.0513.4574.350.576
YOLOv12m20.1433.8838.8817.7256.430.577
YOLOv12l26.3944.7151.0521.5546.410.652
YOLOv12x59.1299.92113.5823.6342.320.696
Table 8. Quantitative comparison of detection accuracy and computational efficiency across single models and ensemble configurations, illustrating the trade-offs between performance gains and computational cost.
Table 8. Quantitative comparison of detection accuracy and computational efficiency across single models and ensemble configurations, illustrating the trade-offs between performance gains and computational cost.
ModelParams (M)GFLOPsModel Size (MB)Latency (ms)FPSmAP50
YOLOv26x58.82104.28112.8419.2152.050.669
YOLOv12x59.1299.92113.5823.6342.320.696
YOLOv12n2.573.245.2711.1389.810.519
YOLOv11x56.8897.73109.117.9855.630.69
YOLOv10x31.6685.5161.1417.1958.160.638
YOLOv9e58.1596.34111.8427.4536.430.579
YOLOv8x68.16129.07130.3919.0952.390.622
YOLOv5x97.2123.46185.9418.9452.80.636
Ensemble (12x + 26x + WBF)116197.65222.6848.0820.80.707
Ensemble (12x + 26x + NMS)116197.65222.6836.9427.070.701
Ensemble (12x + 26x + 10x + 8x + WBF)217.76418.78417.9579.8112.530.746
Ensemble (12x + 26x + 10x + 8x + NMS)217.76418.78417.9563.4915.750.711
Ensemble (8 models + WBF)432.56739.55830.1145.776.860.756
Ensemble (8 models + NMS)432.56739.55830.1122.48.170.715
Table 9. Performance comparison between 5-fold cross-validation and holdout evaluation, assessing the consistency and generalization ability of the proposed framework.
Table 9. Performance comparison between 5-fold cross-validation and holdout evaluation, assessing the consistency and generalization ability of the proposed framework.
Evaluation StrategymAP50–95mAP50PrecisionRecall
5-Fold CV (Mean ± Std)0.4816 ± 0.01900.6841 ± 0.01350.7215 ± 0.01670.6550 ± 0.0107
Hold-Out0.490.6860.7230.667
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Tseng, M.-H.; Huang, Y.-W. A Multi-Generational YOLO Ensemble with Weighted Boxes Fusion for Robust Rescue-Oriented Object Detection in Chaotic Disaster Scenes. Technologies 2026, 14, 530. https://doi.org/10.3390/technologies14090530

AMA Style

Tseng M-H, Huang Y-W. A Multi-Generational YOLO Ensemble with Weighted Boxes Fusion for Robust Rescue-Oriented Object Detection in Chaotic Disaster Scenes. Technologies. 2026; 14(9):530. https://doi.org/10.3390/technologies14090530

Chicago/Turabian Style

Tseng, Ming-Hseng, and Yi-Wei Huang. 2026. "A Multi-Generational YOLO Ensemble with Weighted Boxes Fusion for Robust Rescue-Oriented Object Detection in Chaotic Disaster Scenes" Technologies 14, no. 9: 530. https://doi.org/10.3390/technologies14090530

APA Style

Tseng, M.-H., & Huang, Y.-W. (2026). A Multi-Generational YOLO Ensemble with Weighted Boxes Fusion for Robust Rescue-Oriented Object Detection in Chaotic Disaster Scenes. Technologies, 14(9), 530. https://doi.org/10.3390/technologies14090530

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop