AI-Driven Adaptive Camouflage Pattern Generation for Helicopter Detection Evasion in Aerial Sensor Imagery Using Fine-Tuned YOLOv8 and Stable Diffusion
Highlights
- Proposed end-to-end AI framework achieves 97.6% mAP reduction in helicopter detection using size-adaptive YOLOv8m masking and Stable Diffusion inpainting on synthetic aerial data.
- Ablation studies confirm synergy of components, with color preprocessing contributing 17.2% to evasion efficacy.
- Enhances stealth in UAV surveillance for military evasion and civilian privacy applications.
- The proposed pipeline promotes reproducible advancements in sensor-adaptive camouflage technologies through a detailed methodological framework.
Abstract
1. Introduction
- A novel integration of fine-tuned YOLO for mask generation and KMeans + blur for color palette extraction from synthetic aerial data.
- Stable Diffusion-based inpainting for texture-aware patterns, ensuring perceptual naturalness (LPIPS < 0.1).
- Comprehensive evaluation showing 97.6% mAP reduction on camouflaged images, even against the fine-tuned model and a specialized Defence model.
- A reproducible framework for sensor applications, providing comprehensive details on model fine-tuning and generative parameters.
2. Related Work
2.1. Camouflaged Object Detection (COD)
2.2. YOLO in Aerial Sensing
2.3. Generative Models for Camouflage
3. Materials and Methods
3.1. Synthetic Sensor Dataset Generation
3.2. Size-Adaptive Helicopter Mask Generation Using Fine-Tuned YOLOv8m
3.3. Background-Consistent Inpainting with Stable Diffusion
3.4. K-Means Recolorization of Masked Background
3.5. Overlap and Evaluation/Camouflage Performance Testing with YOLO Variants
4. Experiments
4.1. Dataset and Baselines
4.2. Metrics
4.3. Fine-Tuning Setup
4.4. Experimental Results
5. Results and Discussion
5.1. Quantitative Results
5.2. Qualitative Analysis
5.3. Model Comparison
5.4. Ablation Study
5.5. Limitations and Implications
6. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
| YOLO | You Only Look Once |
| UAV | Unmanned aerial vehicle |
| LPIPS | Learned Perceptual Image Patch Similarity |
| COD | Camouflage Object Detection |
| CLAHE | Contrast-Limited Adaptive Histogram Equalization |
| mAP | Mean average precision |
| VTOL | Vertical Take-Off and Landing |
| VAE | Variational autoencoder |
| COCO | Common Objects in Context |
| VisDrone | Vision Meets Drone |
| SINet | Scale-Insensitive Network |
| IoU | Intersection over Union |
References
- Den Hollander, R.; Adhikari, A.; Tolios, I.; van Bekkum, M.; Bal, A.; Hendriks, S.; Kruithof, M.; Gross, D.; Jansen, N.; Perez, G.; et al. Adversarial patch camouflage against aerial detection. In Proceedings of the Artificial Intelligence and Machine Learning in Defense Applications II, Online, 21–25 September 2020; SPIE: Bellingham, WA, USA, 2020; Volume 11543. [Google Scholar]
- Liang, Y.; Qin, G.; Sun, M.; Wang, X.; Yan, J.; Zhang, Z. A Systematic Review of Image-Level Camouflaged Object Detection with Deep Learning. Neurocomputing 2024, 566, 127050. [Google Scholar] [CrossRef]
- Zhong, J.; Wang, A.; Ren, C.; Wu, J. A Survey on Deep Learning-Based Camouflaged Object Detection. Multimed. Syst. 2024, 30, 268. [Google Scholar] [CrossRef]
- Gulrez, T.; Culpepper, J.B.; Phung, S.L.; Le, H.T. VSAI: Visible signature reduction with camouflage patterns via generative AI algorithm. In Proceedings of the Target and Background Signatures X: Traditional Methods and Artificial Intelligence, Edinburgh, UK, 16–17 September 2024; SPIE: Bellingham, WA, USA, 2024; Volume 13199. [Google Scholar]
- Zhang, Y.; Foroosh, H.; David, P.; Gong, B. CAMOU: Learning physical vehicle camouflages to adversarially attack detectors in the wild. In Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA, 6–9 May 2019. [Google Scholar]
- Mei, H.; Ji, G.P.; Wei, Z.; Yang, X.; Wei, X.; Fan, D.P. Camouflaged object segmentation with distraction mining. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 19–25 June 2021; pp. 8772–8781. [Google Scholar]
- Fu, K.; Fan, D.P.; Ji, G.P.; Zhao, Q. JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for Complementary RGB-D Salient Object Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 14–19 June 2020; pp. 3052–3062. [Google Scholar]
- Fan, D.-P.; Ji, G.P.; Sun, G.; Cheng, M.M.; Shen, J.; Shao, L. Camouflaged object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 14–19 June 2020; pp. 2777–2787. [Google Scholar]
- Pang, Y.; Zhao, X.; Zhang, L.; Lu, H. Multi-scale interactive network for salient object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 14–19 June 2020; pp. 9413–9422. [Google Scholar]
- Zuiderveld, K. Contrast limited adaptive histogram equalization. In Graphics Gems IV; Heckbert, P.S., Ed.; Academic Press: Boston, MA, USA, 1994; pp. 474–485. [Google Scholar]
- Jocher, G.; Jing, Q.; Chaurasia, A. YOLOv8 by Ultralytics. 2023. Available online: https://github.com/ultralytics/ultralytics (accessed on 13 March 2026).
- Wang, C.-Y.; Bochkovskiy, A.; Liao, H.Y.M. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 17–24 June 2023. [Google Scholar]
- Varma, P.; Singh, K.; Das, A.; Giri, D.K.; Dwivedi, P.N. Modified YOLOv8 for Real-Time Multi-Class Uncooperative Aerial Vehicle Detection and Classification. In Proceedings of the 2025 IEEE 21st International Conference on Automation Science and Engineering (CASE), Los Angeles, CA, USA, 17–21 August 2025; pp. 3010–3015. [Google Scholar] [CrossRef]
- Ge, Z.; Liu, S.; Wang, F.; Li, Z.; Sun, J. YOLOX: Exceeding YOLO Series in 2021. arXiv 2021, arXiv:2107.08430. [Google Scholar] [CrossRef]
- Lv, W.; Zhao, Y.; Chang, Q.; Huang, K.; Wang, G.; Liu, Y. RT-DETRv2: Improved Baseline with Bag-of-Freebies for Real-Time Detection Transformer. arXiv 2024, arXiv:2407.17140. [Google Scholar] [CrossRef]
- Rombach, R.; Blattmann, A.; Lorenz, D.; Esser, P.; Ommer, B. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 19–24 June 2022; pp. 10684–10695. [Google Scholar]
- Chen, T.; Xiao, J.; Hu, X.; Zhang, G.; Wang, S. Boundary-guided network for camouflaged object detection. Knowl.-Based Syst. 2022, 248, 108901. [Google Scholar] [CrossRef]
- Zhao, J.; Xu, P.; Qin, P.; Fan, D.P.; Zhang, Z.; Jia, G.; Zhou, B.; Yang, J. LAKE-RED: Camouflaged images generation by latent background knowledge retrieval-augmented diffusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 17–21 June 2024. [Google Scholar]
- Zhao, K.; Yuan, W.; Wang, Z.; Li, G.; Zhu, X.; Fan, D.P.; Zeng, D. Open-vocabulary camouflaged object segmentation with cascaded vision language models. Comput. Vis. Media 2025. [Google Scholar] [CrossRef]
- Lee, E.J.; Conover, D.M.; Bhattacharyya, S.S.; Kwon, H.; Hill, J.; Evensen, K. Validation of object detection in UAV-based images using synthetic data. arXiv 2022, arXiv:2201.06629. [Google Scholar] [CrossRef]
- Yu, J.; Lin, Z.; Yang, J.; Shen, X.; Lu, X.; Huang, T.S. Generative image inpainting with contextual attention. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–22 June 2018; pp. 5505–5514. [Google Scholar]
- Zhang, R.; Isola, P.; Efros, A.A.; Shechtman, E.; Wang, O. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–22 June 2018; pp. 586–595. [Google Scholar]
- Xiao, H.; Qu, Z.; Lv, M.; Jiang, Y.; Wang, C.; Qin, R. Fast self-adaptive digital camouflage design method based on deep learning. Appl. Sci. 2020, 10, 5284. [Google Scholar] [CrossRef]
- MacQueen, J. Some methods for classification and analysis of multivariate observations. In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; University of California Press: Oakland, CA, USA, 1967; pp. 281–297. [Google Scholar]
- Lyu, L.; Zhou, J.; He, D.; Li, Y. CNCA: Toward Customizable and Natural Generation of Adversarial Camouflage for Vehicle Detectors. arXiv 2024, arXiv:2409.17963. [Google Scholar] [CrossRef]
- Wu, T.; Ning, X.; Li, W.; Huang, R.; Yang, H.; Wang, Y. Physical adversarial attack on vehicle detector in the CARLA simulator. arXiv 2020, arXiv:2007.16118. [Google Scholar] [CrossRef]
- Dimitriu, A.; Michaletzky, T.V.; Remeli, V. TACO: Adversarial Camouflage Optimization on Trucks to Fool Object Detectors. arXiv 2024, arXiv:2410.21443. [Google Scholar] [CrossRef]





| Method | Desert | Marine | Avg. |
|---|---|---|---|
| Baseline (fixed mask) | 0.28 | 0.35 | 0.32 |
| Ours w/o recolor | 0.25 | 0.32 | 0.29 |
| Ours w/o fusion | 0.22 | 0.28 | 0.25 |
| Ours (full) | 0.18 | 0.21 | 0.20 |
| Epoch | mAP@0.5 | mAP@0.5:0.95 |
|---|---|---|
| 1 | 0.4170 | 0.2860 |
| 10 | 0.8390 | 0.5460 |
| 50 | 0.8490 | 0.6390 |
| 90 | 0.8175 | 0.7413 |
| 100 | 0.8160 | 0.7400 |
| Model | Dataset | Images | mAP@0.5 (Reduction) | mAP@0.5:0.95 (Reduction) |
|---|---|---|---|---|
| Proxy | Original | 920 | 0.0359 (-) | 0.0202 (-) |
| Camouflage | 751 | 0.0060 (83.3%) | 0.0035 (82.7%) | |
| Fine-tuned | Original | 920 | ) | ) |
| Camouflage | 751 | 0.0196 (97.6%) | 0.0154 (97.9%) | |
| Defence | Original | 920 | 0.1178 (-) | 0.0525 (-) |
| Camouflage | 751 | 0.0123 (89.6%) | 0.0036 (93.1%) |
| Method | mAP@0.5 Reduction | mAP@0.5:0.95 Reduction |
|---|---|---|
| Simple blur [10] | 72.4% | 68.9% |
| Vanilla SD inpainting [16] | 89.5% | 90.3% |
| CNCA [25] | 90.5% | 92.1% |
| LAKE-RED [18] | 94.7% | 95.8% |
| RT-DETRv2 [15] | 96.6% | 97.5% |
| Ours | 97.6% | 97.9% |
| Component Removed | mAP@0.5 Reduction | mAP@0.5:0.95 Reduction |
|---|---|---|
| None (full) | 97.6% | 97.9% |
| Fine-tuned masking (proxy used) | 83.3% | 82.7% |
| CLAHE preprocessing | 92.4% | 93.1% |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Im, J.; Kim, Y.; Chun, H.-J.; Kim, K. AI-Driven Adaptive Camouflage Pattern Generation for Helicopter Detection Evasion in Aerial Sensor Imagery Using Fine-Tuned YOLOv8 and Stable Diffusion. Sensors 2026, 26, 1895. https://doi.org/10.3390/s26061895
Im J, Kim Y, Chun H-J, Kim K. AI-Driven Adaptive Camouflage Pattern Generation for Helicopter Detection Evasion in Aerial Sensor Imagery Using Fine-Tuned YOLOv8 and Stable Diffusion. Sensors. 2026; 26(6):1895. https://doi.org/10.3390/s26061895
Chicago/Turabian StyleIm, Jonghyeok, Yeonhong Kim, Heoung-Jae Chun, and Kyoungsik Kim. 2026. "AI-Driven Adaptive Camouflage Pattern Generation for Helicopter Detection Evasion in Aerial Sensor Imagery Using Fine-Tuned YOLOv8 and Stable Diffusion" Sensors 26, no. 6: 1895. https://doi.org/10.3390/s26061895
APA StyleIm, J., Kim, Y., Chun, H.-J., & Kim, K. (2026). AI-Driven Adaptive Camouflage Pattern Generation for Helicopter Detection Evasion in Aerial Sensor Imagery Using Fine-Tuned YOLOv8 and Stable Diffusion. Sensors, 26(6), 1895. https://doi.org/10.3390/s26061895

