Balancing Accuracy and Speed: Improved D-FINE for Real-Time Ocean Internal Wave Detection
Abstract
1. Introduction
- To enhance IW feature capture, we integrate the parameter-free attention mechanism into the feature extraction stage, significantly improving feature extraction accuracy and efficiency;
- To address the multi-scale and shape diversity of IWs, we redesign the encoder structure: we integrate a feature fusion strategy that aggregates information across different scales to capture multi-scale characteristics, and incorporate a lightweight feature modeling component that dynamically enhances key feature associations (by focusing on both channel importance and spatial distribution) to strengthen the representation of complex features;
- Using 49 SAR IW images collected from the Yunhai-3 satellite for testing, the proposed model excels in complex ocean scenarios, providing reliable practical support for its application.
2. Methods
2.1. Feature Aggregation Method Optimization
2.2. Multi-Scale Feature Fusion Encoder Design
3. Experimental Results and Analysis
3.1. Datasets Introduction
3.2. Experimental Details and Evaluation Indicators
3.3. Comparison of Feature Extraction Capabilities
3.4. Ablation Experiment
3.5. Comparative Test of Similar Algorithms
3.6. Visualization of Test Results Comparison
4. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Garrett, C.; Munk, W. Internal waves in the ocean. Annu. Rev. Fluid Mech. 1979, 11, 339–369. [Google Scholar] [CrossRef] [Scilit]
- Klemas, V. Remote sensing of coastal and ocean currents: An overview. J. Coastal Res. 2012, 28, 576–586. [Google Scholar] [CrossRef] [Scilit]
- Whalen, C.B.; MacKinnon, J.A.; Talley, L.D. Large-scale impacts of the diapycnal mixing induced by internal waves. Geophys. Res. Lett. 2018, 45, 9848–9857. [Google Scholar] [CrossRef] [Scilit]
- Jefferson University. What are Internal Waves in the Ocean and Why Are They Important? 2022. Available online: https://www.jefferson.edu/news/2022/05/what-are-internal-waves-in-the-ocean-and-why-are-they-important.html (accessed on 1 May 2025).
- Osadchiev, A.A. Small-scale and mesoscale oceanic features in the Black Sea: Case studies based on in-situ observations. Oceanology 2018, 58, 497–505. [Google Scholar] [CrossRef]
- Dosser, H.V.; Rainville, L. Dynamics of the changing near-inertial internal wave field in the Arctic Ocean. J. Phys. Oceanogr. 2016, 46, 395–415. [Google Scholar] [CrossRef] [Scilit]
- Hughes, B.A. The effect of internal waves on surface wind waves, Part 1: Theoretical analysis. J. Geophys. Res. Oceans 1978, 83, 455–465. [Google Scholar] [CrossRef] [Scilit]
- Rizal, S.; Iskandar, I.; Muhammad, A. Numerical modeling of internal waves in the Andaman Sea. In IOP Conference Series: Earth and Environmental Science; IOP: London, UK, 2019; Volume 348, p. 012069. [Google Scholar] [CrossRef] [Scilit]
- Alpers, W. Theory of radar imaging of internal waves. Nature 1985, 314, 245–247. [Google Scholar] [CrossRef] [Scilit]
- Thompson, D.; Gasparovic, R. Intensity modulation in SAR images of internal waves. Nature 1986, 320, 345–348. [Google Scholar] [CrossRef] [Scilit]
- Magalhaes, J.M.; Da Silva, J.C.B. Internal waves in the Atlantic Ocean: A new look from SAR imagery. Remote Sens. Environ. 2018, 211, 379–398. [Google Scholar] [CrossRef] [Scilit]
- Ren, S.; He, K.; Girshick, R.; Sun, J. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 1137–1149. [Google Scholar] [CrossRef] [Scilit]
- Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You only look once: Unified, real-time object detection. In IEEE Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2016; pp. 779–788. [Google Scholar] [CrossRef] [Scilit]
- Zhao, Y.; Lv, W.; Xu, S.; Wei, J.; Wang, G.; Dang, Q.; Liu, Y.; Chen, J. DETRs beat YOLOs on real-time object detection. arXiv 2023, arXiv:2304.08069. [Google Scholar]
- Lv, W.; Zhao, Y.; Chang, Q.; Huang, K.; Wang, G.; Liu, Y. RT-DETRv2: Improved baseline with bag-of-freebies for real-time detection transformer. arXiv 2024, arXiv:2407.17140. [Google Scholar]
- Peng, Y.; Li, H.; Wu, P.; Zhang, Y.; Sun, X.; Wu, F. D-FINE: Redefine regression task in DETRs as fine-grained distribution refinement. arXiv 2024, arXiv:2410.13842. [Google Scholar]
- Bao, S.; Meng, J.; Sun, L.; Liu, Y. Detection of ocean internal waves based on Faster R-CNN in SAR images. J. Oceanol. Limnol. 2020, 38, 55–63. [Google Scholar] [CrossRef] [Scilit]
- Sun, H. Deep Learning-Based Ocean Internal Waves Detection from SAR Images. Master’s Thesis, Guilin University of Technology, Guilin, China, 2021. [Google Scholar]
- Tao, M.; Xu, C.; Guo, L.; Wang, X.; Xu, Y. An internal waves dataset from Sentinel-1 synthetic aperture radar imagery and preliminary detection. Earth Space Sci. 2022, 9, e2022EA002528. [Google Scholar] [CrossRef] [Scilit]
- Ma, Z.; Huang, L.; Yang, J.; Ren, L.; Li, X.; He, S.; Liu, B.; Liu, A.K. Transformer-based hierarchical multiscale feature fusion internal wave detection and dataset. Ocean-Land-Atmos. Res. 2024, 3, 0061. [Google Scholar] [CrossRef] [Scilit]
- Hu, J.; Shen, L.; Sun, G. Squeeze-and-excitation networks. In IEEE Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2018; pp. 7132–7141. [Google Scholar] [CrossRef] [Scilit]
- Yang, L.; Zhang, R.Y.; Li, L.; Xie, X. SimAM: A simple, parameter-free attention module for convolutional neural networks. In Proceedings of the 38th International Conference on Machine Learning, Virtual, 18–24 July 2021; pp. 11863–11874. [Google Scholar]
- Wang, C.Y.; Liao, H.Y.M. YOLOv9: Learning what you want to learn using programmable gradient information. arXiv 2024, arXiv:2402.13616. [Google Scholar] [CrossRef] [Scilit]
- Zhou, Z.; He, A.; Wu, Y.; Yao, R.; Xie, X.; Li, T. Spatial-frequency dual domain attention network for medical image segmentation. In 2024 IEEE International Conference on Bioinformatics and Biomedicine (BIBM); IEEE: New York, NY, USA, 2024; pp. 4076–4081. [Google Scholar] [CrossRef] [Scilit]
- Yu, W.; Luo, M.; Zhou, P.; Si, C.; Zhou, Y.; Feng, J.; Yan, S.; Wang, X. MetaFormer is actually what you need for vision. In IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2022; pp. 10819–10829. [Google Scholar] [CrossRef] [Scilit]
- Yu, W.; Zhou, P.; Yan, S.; Wang, X. InceptionNeXt: When Inception meets ConvNeXt. In IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2024; pp. 2235–2245. [Google Scholar] [CrossRef] [Scilit]
- Xia, Z.; Pan, X.; Song, S.; Li, L.E.; Huang, G. Vision transformer with deformable attention. In IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: New York, NY, USA, 2022; pp. 4794–4803. [Google Scholar] [CrossRef] [Scilit]
- Selvaraju, R.R.; Cogswell, M.; Das, A.; Vedantam, R.; Parikh, D.; Batra, D. Grad-CAM: Visual explanations from deep networks via gradient-based localization. Int. J. Comput. Vis. 2020, 128, 336–359. [Google Scholar] [CrossRef] [Scilit]
- Huang, Z.; Li, L.; Krizek, G.; Sun, L. Research on Traffic Sign Detection Based on Improved YOLOv8. J. Comput. Commun. 2023, 11, 226–232. [Google Scholar] [CrossRef]
- Jocher, G.; Qiu, J. Ultralytics YOLOv11, Version 11.0.0; 2024. Available online: https://github.com/ultralytics/ultralytics (accessed on 1 May 2025).
- Tian, Y.; Ye, Q.; Doermann, D. YOLOv12: Attention-Centric Real-Time Object Detectors. arXiv 2025, arXiv:2502.12524. [Google Scholar]
- Kopyshov, I.; Kozlov, I.; Shiryborova, A.; Myslenkov, S.A. Properties of Short-Period Internal Waves in the Kara Gates Strait Revealed from Spaceborne SAR Data. Russ. J. Earth Sci. 2023, 23, 1–11. [Google Scholar] [CrossRef] [Scilit]
- Morozov, E. Oceanic Internal Tides: Observations, Analysis and Modeling; Springer: Berlin/Heidelberg, Germany, 2018. [Google Scholar] [CrossRef] [Scilit]
- Kozlov, I.E.; Mihaylichenko, T.V.; Petrenko, L.A. Properties of Short-Period Internal Waves Near Svalbard from Sentinel-1 Satellite Data. Russ. J. Earth Sci. 2024, 24, ES5008. [Google Scholar] [CrossRef] [Scilit]
- Kozlov, I.E.; Kopyshov, I.O.; Frey, D.I.; Morozov, E.G.; Medvedev, I.P.; Shiryborova, A.I.; Silvestrova, K.P.; Gavrikov, A.V.; Ezhova, E.A.; Soloviev, D.M.; et al. Multi-Sensor Observations Reveal Large-Amplitude Nonlinear Internal Waves in the Kara Gates, Arctic Ocean. Remote Sens. 2023, 15, 5769. [Google Scholar] [CrossRef] [Scilit]





| Hyperprameter | Value |
|---|---|
| Learning Rate | 0.0001 |
| Weight Decay | 0.0001 |
| Betas | (0.9, 0.999) |
| Batch size | 4 |
| Input size | (1024,1024) |
| Epoch | 600 epochs |
| D-FINE | SimAM | MPCA | MetaFormer | AP@0.5/% | AP@0.75/% | AP@0.5:0.95/% | AR@0.5/% | AR@0.5:0.95/% |
|---|---|---|---|---|---|---|---|---|
| √ | 87.2 | 76.0 | 65.1 | 98.1 | 84.3 | |||
| √ | √ | 88.1 | 78.3 | 68.5 | 98.0 | 85.7 | ||
| √ | √ | √ | 90.3 | 80.4 | 69.3 | 97.2 | 84.7 | |
| √ | √ | √ | √ | 90.5 | 81.4 | 70.5 | 98.1 | 85.5 |
| Algorithms | AP@0.5/% | AP@0.5:0.95/% | Time/ms |
|---|---|---|---|
| YOLOv8l | 83.3 | 51.8 | 8.3 |
| YOLO11l | 85.3 | 54.5 | 11.9 |
| YOLO12l | 81.7 | 50.5 | 23.6 |
| DETRv2-resnet50 | 79.4 | 57.9 | 18.6 |
| D-FINE | 87.2 | 65.1 | 13.8 |
| IW-D-FINE | 90.5 | 70.5 | 15.5 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Yu, L.; Tian, Y.; Chen, J.; Chi, C.; Li, T.; Li, J. Balancing Accuracy and Speed: Improved D-FINE for Real-Time Ocean Internal Wave Detection. J. Mar. Sci. Eng. 2026, 14, 388. https://doi.org/10.3390/jmse14040388
Yu L, Tian Y, Chen J, Chi C, Li T, Li J. Balancing Accuracy and Speed: Improved D-FINE for Real-Time Ocean Internal Wave Detection. Journal of Marine Science and Engineering. 2026; 14(4):388. https://doi.org/10.3390/jmse14040388
Chicago/Turabian StyleYu, Lu, Yanping Tian, Jie Chen, Cheng Chi, Tingting Li, and Jianwei Li. 2026. "Balancing Accuracy and Speed: Improved D-FINE for Real-Time Ocean Internal Wave Detection" Journal of Marine Science and Engineering 14, no. 4: 388. https://doi.org/10.3390/jmse14040388
APA StyleYu, L., Tian, Y., Chen, J., Chi, C., Li, T., & Li, J. (2026). Balancing Accuracy and Speed: Improved D-FINE for Real-Time Ocean Internal Wave Detection. Journal of Marine Science and Engineering, 14(4), 388. https://doi.org/10.3390/jmse14040388

