Author Contributions
Conceptualization, Y.S. and J.Y.; methodology, Y.S.; software, Y.S.; validation, Y.S., L.D. and X.X.; formal analysis, Y.S.; investigation, Y.S.; resources, J.Y.; data curation, Y.S.; writing—original draft preparation, Y.S.; writing—review and editing, J.Y., L.D. and X.X.; visualization, Y.S.; supervision, J.Y.; project administration, J.Y. All authors have read and agreed to the published version of the manuscript.
Figure 1.
Overall architecture of Spectral-DETR. DAFD improves frequency-aware features, DQCD regularizes decoder queries with a DAFD-modulated temperature, and SCU+LUE calibrates uncertainty for precision-weighted localization. Solid arrows denote inference computation; green and black dashed arrows denote training-only objectives and cross-stage reliability signals, respectively. Module colors identify DAFD (blue), DQCD (orange), SCU+LUE (green), and detector components (gray). Only representative negative queries are shown.
Figure 1.
Overall architecture of Spectral-DETR. DAFD improves frequency-aware features, DQCD regularizes decoder queries with a DAFD-modulated temperature, and SCU+LUE calibrates uncertainty for precision-weighted localization. Solid arrows denote inference computation; green and black dashed arrows denote training-only objectives and cross-stage reliability signals, respectively. Module colors identify DAFD (blue), DQCD (orange), SCU+LUE (green), and detector components (gray). Only representative negative queries are shown.
Figure 2.
Module design of Spectral-DETR. (
a) DAFD applies learnable Gaussian bands, FiLM, reliability gates, IFFT reconstruction, and cross-band fusion. (
b) DQCD applies DAFD-conditioned InfoNCE regularization to decoder queries during training [
62]. (
c) SCU+LUE predicts coordinate-level log-variances, uses them to precision-weight the L1 term, and retains standard GIoU. Localization and calibration paths are training-only; LUE outputs may optionally be retained for inference diagnostics. Dashed outlines denote auxiliary or training-only components, and solid outlines denote forward-computation blocks.
Figure 2.
Module design of Spectral-DETR. (
a) DAFD applies learnable Gaussian bands, FiLM, reliability gates, IFFT reconstruction, and cross-band fusion. (
b) DQCD applies DAFD-conditioned InfoNCE regularization to decoder queries during training [
62]. (
c) SCU+LUE predicts coordinate-level log-variances, uses them to precision-weight the L1 term, and retains standard GIoU. Localization and calibration paths are training-only; LUE outputs may optionally be retained for inference diagnostics. Dashed outlines denote auxiliary or training-only components, and solid outlines denote forward-computation blocks.
Figure 3.
Descriptive reliability diagnostics of Spectral-DETR. (a) Representative DAFD frequency-domain gate activations from encoder tap 0. (b) Mean per-band gate values across validation images for brightness, contrast, and blur diagnostics; error bars denote standard deviations across images. (c) Image-level DQCD adaptive-temperature distributions for clean and degraded subsets. Clean images have normalized mean degradation severity at or below the 30th percentile, whereas degraded images are at or above the 70th percentile; the middle 40% is excluded. The normalized mean severity is the average of darkness, contrast, and blur severities. Violin widths indicate density, white boxes show the interquartile range, red dots indicate medians, and whiskers extend to 1.5 times the interquartile range; each subset contains 92 images. (d) Degradation-stratified changes in validation AP@0.5:0.95 for darkness, contrast, and blur severity. Panels (a–c) provide descriptive mechanism-level diagnostics and are not treated as ground-truth degradation calibration.
Figure 3.
Descriptive reliability diagnostics of Spectral-DETR. (a) Representative DAFD frequency-domain gate activations from encoder tap 0. (b) Mean per-band gate values across validation images for brightness, contrast, and blur diagnostics; error bars denote standard deviations across images. (c) Image-level DQCD adaptive-temperature distributions for clean and degraded subsets. Clean images have normalized mean degradation severity at or below the 30th percentile, whereas degraded images are at or above the 70th percentile; the middle 40% is excluded. The normalized mean severity is the average of darkness, contrast, and blur severities. Violin widths indicate density, white boxes show the interquartile range, red dots indicate medians, and whiskers extend to 1.5 times the interquartile range; each subset contains 92 images. (d) Degradation-stratified changes in validation AP@0.5:0.95 for darkness, contrast, and blur severity. Panels (a–c) provide descriptive mechanism-level diagnostics and are not treated as ground-truth degradation calibration.
![Jimaging 12 00401 g003 Jimaging 12 00401 g003]()
Figure 4.
Summary of quantitative results and ablations. (a) Main benchmark comparison in AP@0.5:0.95. (b) Stage-wise ablation of the reliability modules. (c) DAFD-only band-count validation probe; three bands provide the best measured trade-off and are used by default. (d) Metric-specific validation gains associated with feature, query, and localization reliability.
Figure 4.
Summary of quantitative results and ablations. (a) Main benchmark comparison in AP@0.5:0.95. (b) Stage-wise ablation of the reliability modules. (c) DAFD-only band-count validation probe; three bands provide the best measured trade-off and are used by default. (d) Metric-specific validation gains associated with feature, query, and localization reliability.
Figure 5.
Matched qualitative comparison on identical degraded inputs. In each column, the top row shows the input image, the middle row shows the RF-DETR baseline prediction, and the bottom row shows the Spectral-DETR prediction; therefore, the baseline and proposed method are compared on exactly the same image. The first two columns show Mine-Objects scenes under glare, uneven illumination, and extreme darkness, while the third column shows an ExDark low-light vehicle scene. These examples are illustrative and are not used as quantitative evidence.
Figure 5.
Matched qualitative comparison on identical degraded inputs. In each column, the top row shows the input image, the middle row shows the RF-DETR baseline prediction, and the bottom row shows the Spectral-DETR prediction; therefore, the baseline and proposed method are compared on exactly the same image. The first two columns show Mine-Objects scenes under glare, uneven illumination, and extreme darkness, while the third column shows an ExDark low-light vehicle scene. These examples are illustrative and are not used as quantitative evidence.
Table 1.
Comparison on the held-out Mine-Objects test set. † Sm-AP is evaluated on seven categories with mean instance area < pixels (person, redlight, light, port, warn, gear, electric-wire) and is distinct from instance-level COCO APS. Bold = best.
Table 1.
Comparison on the held-out Mine-Objects test set. † Sm-AP is evaluated on seven categories with mean instance area < pixels (person, redlight, light, port, warn, gear, electric-wire) and is distinct from instance-level COCO APS. Bold = best.
| Method | Params (M) | Overall | Small-Object (†) |
|---|
| AP@0.5 |
AP@0.5:0.95
|
Sm-AP@0.5
|
Sm-AP@0.5:0.95
|
|---|
| YOLOv9s [27] | 7.1 | 0.898 | 0.487 | 0.853 | 0.435 |
| YOLOv9m [27] | 20.1 | 0.901 | 0.485 | 0.858 | 0.438 |
| YOLOv8m [26] | 25.9 | 0.898 | 0.481 | 0.859 | 0.430 |
| YOLOv8l [26] | 43.7 | 0.902 | 0.483 | 0.861 | 0.432 |
| RT-DETR [31] | 32.0 | 0.896 | 0.481 | 0.866 | 0.423 |
| Deformable DETR [13] | 40.0 | 0.862 | 0.410 | — | — |
| Frequency-aware DETR baseline | 31.5 | 0.887 | 0.468 | 0.845 | 0.411 |
| Spectral-DETR (Ours) | 33.5 | 0.917 | 0.493 | 0.892 | 0.451 |
Table 2.
Comparison on ExDark. † Sm-AP is evaluated on categories with mean instance area pixels (Bottle, Cup, Cat, Dog) and is distinct from instance-level COCO APS. Bold = best.
Table 2.
Comparison on ExDark. † Sm-AP is evaluated on categories with mean instance area pixels (Bottle, Cup, Cat, Dog) and is distinct from instance-level COCO APS. Bold = best.
| | | Overall | Small-Object (†) |
|---|
| Method | Params (M) | AP@0.5 | AP@0.5:0.95 | Sm-AP@0.5 | Sm-AP@0.5:0.95 |
|---|
| YOLOv9s [27] | 7.1 | 0.785 | 0.517 | 0.717 | 0.455 |
| YOLOv9m [27] | 20.1 | 0.793 | 0.529 | 0.722 | 0.467 |
| YOLOv8m [26] | 25.9 | 0.785 | 0.525 | 0.718 | 0.462 |
| YOLOv8l [26] | 43.7 | 0.797 | 0.534 | 0.725 | 0.471 |
| RT-DETR [31] | 32.0 | 0.763 | 0.495 | 0.700 | 0.445 |
| Frequency-aware DETR baseline | 30.8 | 0.774 | 0.508 | 0.711 | 0.450 |
| Spectral-DETR (Ours) | 33.5 | 0.848 | 0.571 | 0.785 | 0.498 |
Table 3.
Component ablation on ExDark validation. All rows use the identical DINOv2-Small backbone, resolution, 75-epoch budget, and evaluation protocol.
Table 3.
Component ablation on ExDark validation. All rows use the identical DINOv2-Small backbone, resolution, 75-epoch budget, and evaluation protocol.
| Method | AP@0.5:0.95 | AP@0.5 | APS |
|---|
| Baseline (RF-DETR) | 0.518 | 0.796 | 0.450 |
| + DAFD | 0.540 | 0.822 | 0.462 |
| + DQCD | 0.522 | 0.800 | 0.451 |
| + SCU+LUE | 0.526 | 0.802 | 0.459 |
| +Full (Spectral-DETR) | 0.563 | 0.843 | 0.478 |
Table 4.
Comparison on the converted validation partition of the Coal Mine Underground Drilling Site Object Detection Dataset (ScienceDB V1).
Table 4.
Comparison on the converted validation partition of the Coal Mine Underground Drilling Site Object Detection Dataset (ScienceDB V1).
| Model | Backbone | Params (M) | AP@0.5 | AP@0.5:0.95 |
|---|
| YOLOv8n | CSPDarknet | 3.0 | 0.951 | 0.438 |
| YOLOv8s | CSPDarknet | 11.2 | 0.958 | 0.447 |
| YOLOv8m | CSPDarknet | 25.9 | 0.962 | 0.452 |
| RT-DETR-R18 | ResNet-18 | 20.0 | 0.955 | 0.441 |
| Frequency-aware DETR baseline | ViT-S | 31.5 | 0.959 | 0.465 |
| Spectral-DETR (Ours) | ViT-S | 33.5 | 0.973 | 0.495 |
Table 5.
Primary component ablation on the Mine-Objects validation set. Each row uses the fixed dataset split, 75-epoch budget, common evaluation protocol, and standard post-processing. The final test-set result is reported separately in
Table 1.
Table 5.
Primary component ablation on the Mine-Objects validation set. Each row uses the fixed dataset split, 75-epoch budget, common evaluation protocol, and standard post-processing. The final test-set result is reported separately in
Table 1.
| Method | AP@0.5:0.95 | AP@0.5 | APS | APM | Prec. | Recall |
|---|
| Baseline (RF-DETR) | 0.472 | 0.883 | 0.290 | 0.518 | 0.905 | 0.815 |
| + DAFD (Stage 1) | 0.476 | 0.905 | 0.297 | 0.523 | 0.907 | 0.825 |
| + DQCD (Stage 2) | 0.474 | 0.886 | 0.292 | 0.520 | 0.904 | 0.817 |
| + SCU+LUE (Stage 3) | 0.477 | 0.890 | 0.301 | 0.523 | 0.906 | 0.820 |
| + Stage 1 + 2 | 0.480 | 0.908 | 0.302 | 0.525 | 0.909 | 0.823 |
| + Stage 1 + 3 | 0.483 | 0.910 | 0.308 | 0.527 | 0.908 | 0.824 |
| + Stage 2 + 3 | 0.479 | 0.893 | 0.303 | 0.524 | 0.907 | 0.821 |
| + Stage 1 + 2 + 3 (Full) | 0.486 | 0.913 | 0.312 | 0.530 | 0.911 | 0.826 |
| Full, lr drop at epoch 40 (schedule control) | 0.485 | 0.910 | 0.310 | 0.527 | 0.908 | 0.823 |
Table 6.
DAFD-to-DQCD coupling controls on Mine-Objects validation. All rows use the full Spectral-DETR configuration; only the temperature modulation mode varies.
Table 6.
DAFD-to-DQCD coupling controls on Mine-Objects validation. All rows use the full Spectral-DETR configuration; only the temperature modulation mode varies.
| Gate Mode | AP@0.5:0.95 | AP@0.5 | APS |
|---|
| Adaptive (our design) | 0.485 | 0.913 | 0.310 |
| Fixed temperature | 0.483 | 0.910 | 0.309 |
| Shuffled gate | 0.483 | 0.911 | 0.308 |
| Random gate | 0.481 | 0.909 | 0.305 |
Table 7.
DAFD band-count sensitivity on Mine-Objects validation. All models use DAFD-only with other reliability modules disabled.
Table 7.
DAFD band-count sensitivity on Mine-Objects validation. All models use DAFD-only with other reliability modules disabled.
| Bands | AP@0.5:0.95 | AP@0.5 | APS |
|---|
| 1 | 0.472 | 0.898 | 0.291 |
| 2 | 0.474 | 0.901 | 0.293 |
| 3 (default) | 0.475 | 0.904 | 0.295 |
| 4 | 0.475 | 0.903 | 0.294 |
| 5 | 0.474 | 0.902 | 0.293 |
Table 8.
SCU coefficient sensitivity on Mine-Objects validation. Default parameters are , .
Table 8.
SCU coefficient sensitivity on Mine-Objects validation. Default parameters are , .
| Setting | AP@0.5:0.95 | AP@0.5 | APS |
|---|
| Default () | 0.476 | 0.889 | 0.300 |
| 0.476 | 0.889 | 0.299 |
| 0.475 | 0.888 | 0.300 |
| 0.476 | 0.890 | 0.300 |
| 0.475 | 0.888 | 0.299 |
Table 9.
Descriptive degradation-stratified ΔAP@0.5:0.95 over the RF-DETR baseline on the 308-image Mine-Objects validation set. Terciles are constructed independently for each degradation attribute.
Table 9.
Descriptive degradation-stratified ΔAP@0.5:0.95 over the RF-DETR baseline on the 308-image Mine-Objects validation set. Terciles are constructed independently for each degradation attribute.
| Degradation Type | Low Severity | Mid Severity | High Severity |
|---|
| Brightness (dark) | +0.003 | +0.008 | +0.013 |
| Contrast | +0.004 | +0.007 | +0.010 |
| Blur | +0.004 | +0.009 | +0.017 |
Table 10.
Reliability evidence across the three stages. Each stage is linked to the ablation metric that best captures its mechanism.
Table 10.
Reliability evidence across the three stages. Each stage is linked to the ablation metric that best captures its mechanism.
| Stage | Evidence Metric | Observed Evidence | Source |
|---|
| DAFD (Feature) | AP@0.5 (standalone) | 0.883 → 0.905 (+0.022) | Table 5 |
| | Degradation-stratified ΔAP (blur) | +0.017 (high severity) | Table 9 |
| | Gate activation heatmaps | degradation-dependent | Figure 3a,b |
| DQCD (Query) | AP@0.5:0.95 (standalone) | 0.472 → 0.474 (+0.002) | Table 5 |
| | Stage 1 + 2 combined Recall | 0.815 → 0.823 (+0.008) | Table 5 |
| | DQCD temperature () separation | clean ≈ 0.20, degraded ≈ 0.12 | Figure 3c |
| SCU+LUE (Local.) | APS (standalone) | 0.290 → 0.301 (+0.011) | Table 5 |
| | AP@0.5:0.95 (standalone) | 0.472 → 0.477 (+0.005) | Table 5 |
| | Error-uncertainty correlation | 0.60 (moderate Pearson) | validation diagnostics |
Table 11.
Efficiency and component-wise validation AP on Mine-Objects. AP uses the fixed validation protocol; FPS is measured with batch size 1 at
on an RTX 3090. Test-set accuracy is reported separately in
Table 1.
Table 11.
Efficiency and component-wise validation AP on Mine-Objects. AP uses the fixed validation protocol; FPS is measured with batch size 1 at
on an RTX 3090. Test-set accuracy is reported separately in
Table 1.
| Method | Params (M) | FLOPs (G) | FPS | AP@0.5:0.95 |
|---|
| YOLOv8m | 25.9 | 76.0 | 120.5 | 0.481 |
| Baseline (RF-DETR) | 32.2 | 116.7 | 21.3 | 0.472 |
| + DAFD (Stage 1) | 33.0 | 121.1 | 18.6 | 0.476 |
| + DQCD (Stage 2) | 32.2 | 116.7 | 21.3 | 0.474 |
| + SCU+LUE (Stage 3) | 32.7 | 117.8 | 20.2 | 0.477 |
| Full | 33.5 | 122.2 | 17.5 | 0.486 |