Underwater Target Recognition with Fusion of Multi-Domain Temporal Features
Abstract
1. Introduction
- We extracted time series features of underwater target scattering in the spatial, time–frequency, and Doppler domains. These three complementary feature representations capture distinct physical characteristics of the target response, thereby providing enhanced discriminative capability. By systematically analyzing fusion strategies for multi-domain temporal features, we propose a feature vector-level (or mid-level) multi-domain temporal feature fusion mechanism specifically designed for few-shot learning scenarios.
- We designed a meta-knowledge-driven multi-stream feature extraction network and introduced an internal memory module for multi-domain feature tensors, leading to the construction of a Multi-domain Temporal Fusion Network (MTFF-Net). This architecture enables the effective fusion of multi-domain temporal features through a pipelined processing framework, facilitating both real-time implementation and practical engineering deployment.
- We established a comprehensive time series dataset using both simulation-generated signals and experimental data to evaluate the proposed method. The experimental results demonstrate a recognition accuracy of 96.25% for real targets and multi-source interferences, validating the robustness of the proposed approach. The results confirm that the proposed method significantly improves target recognition performance in complex environments involving channel fluctuations (e.g., interface reverberation, low signal-to-noise ratio) and time-varying target perspective.
2. Methods
2.1. Extraction of Multi-Dimensional Features
2.2. Temporal Echo Features
2.3. Network Construction
2.3.1. Multi-Domain Feature Extractor
2.3.2. Internal Memory Module
2.3.3. Multi-Domain Temporal Feature Fusion Classifier
2.3.4. Multi-Domain Temporal Feature Fusion Recognition Network
3. Results and Discussion
3.1. Dataset
3.2. Evaluation Metrics
3.3. Validation
3.3.1. Overview of the Validation Process
3.3.2. Multi-Domain Feature Extractor Training
3.3.3. MT-FFC Training
3.3.4. MTFF-RNet Testing
3.4. Discussion
3.4.1. Ablation Studies
3.4.2. Stratified Evaluation Metrics
3.4.3. Performance Comparison
4. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| ASTR | Active Sonar Target Recognition |
| CNN | Convolutional Neural Network |
| CWT | Continuous Wavelet Transform |
| D3SF | Three-dimensional Spatial Feature |
| DFSD | Doppler Frequency Shift Distribution |
| FFC | Feature Fusion Classifier |
| IMM | Internal Memory Module |
| MFCC | Mel-Frequency Cepstral Coefficients |
| MSI | Multi-Source Interference |
| MUSIC | Multiple Signal Classification |
| PWVD | Pseudo Wigner–Ville Distribution |
| SPWVD | Smoothed Pseudo Wigner–Ville Distribution |
| WVD | Wigner–Ville Distribution Spectrum |
References
- Aubard, M.; Madureira, A.; Teixeira, L.; Pinto, J. Sonar-Based Deep Learning in Underwater Robotics: Overview, Robustness, and Challenges. IEEE J. Ocean. Eng. 2025, 50, 1866–1884. [Google Scholar] [CrossRef]
- Feng, S.; Ma, S.; Zhu, X.; Yan, M. Artificial Intelligence-Based Underwater Acoustic Target Recognition: A Survey. Remote Sens. 2024, 16, 3333. [Google Scholar] [CrossRef]
- Yang, H.; Byun, S.H.; Lee, K.; Choo, Y.; Kim, K. Underwater acoustic research trends with machine learning: Active SONAR applications. J. Ocean Eng. Technol. 2020, 34, 277–284. [Google Scholar] [CrossRef]
- Luo, X.; Chen, L.; Zhou, H.; Cao, H. A Survey of Underwater Acoustic Target Recognition Methods Based on Machine Learning. J. Mar. Sci. Eng. 2023, 11, 384. [Google Scholar] [CrossRef]
- Darmon, M.; Dorval, V.; Baqué, F. Acoustic Scattering Models from Rough Surfaces: A Brief Review and Recent Advances. Appl. Sci. 2020, 10, 8305. [Google Scholar] [CrossRef]
- Abraham, D.A. Underwater Acoustics Signal Processing Modeling, Detection, and Estimation; Springer: Cham, Switzerland, 2019; pp. 95–196. [Google Scholar] [CrossRef]
- Zhao, S.; Li, L.; Zhang, X.; Zhang, D.; Li, M. Simulation of backscatter signal of submarine target based on spatial distribution characteristics of target intensity. In Proceedings of the 2021 OES China Ocean Acoustics, Harbin, China, 14–17 July 2021; pp. 234–239. [Google Scholar] [CrossRef]
- Chen, Y.; Guo, Y. Optimal Combination Strategy for Two Swim-Out Acoustic Decoys to Countermeasure Acoustic Homing Torpedo. In Proceedings of the 2017 4th International Conference on Information Science and Control Engineering (ICISCE), Changsha, China, 21–23 July 2017; pp. 1061–1065. [Google Scholar] [CrossRef]
- Wang, Z.; Wu, J.; Wang, H.; Hao, Y.; Wang, H. A Torpedo Target Recognition Method Based on the Correlation between Echo Broadening and Apparent Angle. Appl. Sci. 2022, 12, 12345. [Google Scholar] [CrossRef]
- Malarkodi, A.; Manamalli, D.; Kavitha, G.; Latha, G. Acoustic Scattering of Underwater Targets. In Proceedings of the 2013 Ocean Electronics (SYMPOL), Kochi, India, 23–25 October 2013; pp. 127–132. [Google Scholar] [CrossRef]
- Stinco, P.; Tesei, A.; LePage, K.D. Unsupervised Active Sonar Contact Classification through Anomaly Detection. EURASIP J. Adv. Signal Process. 2023, 2023, 59. [Google Scholar] [CrossRef]
- Wang, Q.; Du, S.; Wang, F.; Chen, Y. Underwater target recognition method based on multi-domain active sonar echo images. In Proceedings of the 2021 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), Xi’an, China, 17–19 August 2021; pp. 1–5. [Google Scholar] [CrossRef]
- Wang, Q.; DU, S.; Zhang, W.; Wang, F. Active sonar target recognition method based on multi-domain transformations and attention-based fusion network. IET Radar Sonar Navig. 2024, 18, 1814–1828. [Google Scholar] [CrossRef]
- Chen, Y.; Liang, H.; Dai, Z. Differentiable Architecture Search with Multi-Domain Time-Frequency Features for Underwater Target Recognition. In Proceedings of the OCEANS 2025 Brest, Brest, France, 16–19 June 2025; pp. 1–4. [Google Scholar] [CrossRef]
- Chen, Y.; Liang, H.; Li, H.; Song, S. A Lightweight Time–Frequency–Space Dual-Stream Network for Active Sonar-Based Underwater Target Recognition. IEEE Sens. J. 2025, 25, 11416–11427. [Google Scholar] [CrossRef]
- Dai, Z.; Liang, H.; Duan, T.; Yue, L.; Gou, W.; Zhu, W. Active Sonar Target Recognition Based on Sub-Beam Filling and Time-Frequency Fusion Tensor. Appl. Acoust. 2025, 239, 110864. [Google Scholar] [CrossRef]
- Chen, Y.; Liang, H.; Li, H.; Gou, W.; Zhu, L. PBGMR: A Physics-Informed Bayesian Graph Neural Network for Robust Multimodal Underwater Target Recognition. IEEE Trans. Instrum. Meas. 2025, 74, 6508312. [Google Scholar] [CrossRef]
- Liu, X.; Yang, Y.; Hu, Y.; Yang, X.; Liu, L.; Shi, L.; Liu, J. A Meta-Learning-Based Recognition Method for Multidimensional Feature Extraction and Fusion of Underwater Targets. Appl. Sci. 2025, 15, 5744. [Google Scholar] [CrossRef]
- Dai, Z.; Liang, H.; Chen, Y. An underwater moving target recognition method based on inter-frame motion feature cyclic reconstruction. In Proceedings of the OCEANS 2024—Halifax, Halifax, NS, Canada, 23–26 September 2024; pp. 1–5. [Google Scholar] [CrossRef]
- Xiang, W.; Song, Z.; Gao, Z.; Zhang, B.; Fu, W.; Zhang, C.; Zhang, Y. Underwater target classification based on the combination of dolphin click trains and convolutional neural networks. J. Acoust. Soc. Am. 2025, 157, 647–658. [Google Scholar] [CrossRef] [PubMed]
- Zaharis, Z.D.; Gravas, I.P.; Lazaridis, P.I.; Yioultsis, T.V.; Antonopoulos, C.S.; Xenos, T.D. An Effective Modification of Conventional Beamforming Methods Suitable for Realistic Linear Antenna Arrays. IEEE Trans. Antennas Propag. 2020, 68, 5269–5279. [Google Scholar] [CrossRef]
- Liu, X.; Yang, Y.; Hu, Y.; Wang, C.; Li, Y. Research on the Extraction and Recognition of Space-Time-Frequency Features for Underwater Moving Targets. J. Unmanned Undersea Syst. 2025, 34, 85–93. [Google Scholar] [CrossRef]
- Mulinde, R.; Attygalle, M.; Aziz, S.M. Pre-Processing-Based Performance Enhancement of DOA Estimation for Wideband LFM Signals. In Proceedings of the 2023 IEEE International Radar Conference (RADAR), Sydney, Australia, 6–10 November 2023; pp. 1–6. [Google Scholar] [CrossRef]
- Liu, Y.; Wu, P.; Black, A.W.; Anumanchipalli, G.K. A Fast and Accurate Pitch Estimation Algorithm Based on the Pseudo Wigner-Ville Distribution. In Proceedings of the ICASSP 2023—2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 4–10 June 2023; pp. 1–5. [Google Scholar] [CrossRef]
- Zou, Y.; Li, X.; Yu, G. Adaptive WVD Cross-Term Removal Method Based on Multidimensional Property Differences. J. Mar. Sci. Appl. 2024, 24, 774–788. [Google Scholar] [CrossRef]
- Hague, D.A.; Buck, J.R. The Generalized Sinusoidal Frequency-Modulated Waveform for Active Sonar. IEEE J. Ocean. Eng. 2017, 42, 109–123. [Google Scholar] [CrossRef]
- Jiang, W.; Liu, Y.; Wei, Q.; Wang, W.; Ren, Y.; Wang, C. A High-Resolution Radar Automatic Target Recognition Method for Small UAVs Based on Multi-Feature Fusion. In Proceedings of the 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD), Hangzhou, China, 4–6 May 2022; pp. 775–779. [Google Scholar] [CrossRef]
- Graves, A.; Wayne, G.; Reynolds, M.; Harley, T.; Danihelka, I.; Grabska-Barwińska, A.; Colmenarejo, S.G.; Grefenstette, E.; Ramalho, T.; Agapiou, J.; et al. Hybrid Computing Using a Neural Network with Dynamic External Memory. Nature 2016, 538, 471–476. [Google Scholar] [CrossRef]
- Liu, X.; Yang, Y.; Hu, Y.; Yang, X.; Li, Y.; Xiao, L. Data Augmentation Based on Highlight Image Models of Underwater Maneuvering Target. Xibei Gongye Daxue Xuebao/J. Northwestern Polytech. Univ. 2024, 42, 417–425. [Google Scholar] [CrossRef]
- Dong, W.; Fu, J.; Zou, N.; Zhao, C.; Miao, Y.; Shen, Z. CAF-ViT: A Cross-Attention Based Transformer Network for Underwater Acoustic Target Recognition. Ocean. Eng. 2025, 318, 120049. [Google Scholar] [CrossRef]
- Saito, T.; Rehmsmeier, M. The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets. PLoS ONE 2015, 10, e0118432. [Google Scholar] [CrossRef]
- Veit, A.; Wilber, M.; Belongie, S. Residual networks behave like ensembles of relatively shallow networks. In Advances in Neural Information Processing Systems 29 (NIPS 2016); Curran Associates: San Jose, CA, USA, 2016; pp. 550–558. [Google Scholar]
- Sandler, M.; Howard, A.; Zhu, M.; Zhmoginov, A.; Chen, L. MobileNetV2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 18–23 June 2018; pp. 4510–4520. [Google Scholar] [CrossRef]
- Ma, N.; Zhang, X.; Zheng, H.; Sun, J. ShuffleNet V2: Practical guidelines for efficient CNN architecture design. In Proceedings of the European Conference on Computer Vision (ECCV); Springer: Cham, Switzerland, 2018; pp. 122–138. [Google Scholar] [CrossRef]
- Tan, M.; Le, Q. EfficientNet: Rethinking model scaling for convolutional neural networks. In Proceedings of the 36th International Conference on Machine Learning (ICML), Long Beach, CA, USA, 9–15 June 2019; pp. 6105–6114. Available online: https://proceedings.mlr.press/v97/tan19a.html (accessed on 25 November 2025).
















| HasNet-5 | TFasNet-7 | DasNet-9 |
|---|---|---|
| Input: [3 32 96] | Input: [1 224 672] | Input: [1 224 672] |
| Conv2d1: in = 3, out = 8, k = 3 × 3, s = 2, p = 1, relu and bn | Conv2d1: in = 1, out = 8, k = 3 × 3, s = 2, p = 1, relu and bn | Conv2d1: in = 1, out = 32, k = 7 × 7, s = 2, p = 3, relu and bn |
| Conv2d2: in = 16, out = 32, k = 1 × 1, s = 2, p = 0, bn | Conv2d2: in = 8, out = 16, k = 3 × 3, s = 1, p = 1, relu and bn | Maxpool2d: k = 2 × 2, s = 2 |
| Conv2d3: in = 32, out = 64, k = 3 × 3, s = 1, p = 1, relu and bn | Maxpool2d: k = 2 × 2, s = 2 | Conv2d2: in = 32, out = 32, k = 3 × 3, s = 1, p = 1, relu and bn |
| Maxpool2d: k = 2 × 2, s = 2 | Conv2d3: in = 16, out = 32, k = 3 × 3, s = 1, p = 1, relu and bn | Conv2d3: in = 32, out = 64, k = 1 × 1, s = 2, p = 0, bn |
| Conv2d4: in = 64, out = 256, k = 8 × 8, s = 8, p = 0 | MRConv2d1: in = 32, out = 64, k = 3 × 3, s = 1, p = 1, relu and bn | Conv2d4: in = 64, out = 64, k = 3 × 3, s = 1, p = 1, relu and bn |
| Flatten | MRConv2d2: in = 128, out = 256, k = 3 × 3, s = 1, p = 1, relu and bn | Conv2d5: in = 64, out = 128, k = 1 × 1, s = 2, p = 0, bn |
| Liner: in = 768, out = n_way | Maxpool2d: k = 2 × 2, s = 2 | Conv2d6: in = 128, out = 128, k = 3 × 3, s = 1, p = 1, relu and bn |
| Conv2d4: in = 512, out = 512, k = 7 × 7, s = 7, p = 0 | Conv2d7: in = 128, out = 256, k = 1 × 1, s = 2, p = 0, bn | |
| Flatten | Conv2d8: in = 256, out = 256, k = 3 × 3, s = 1, p = 1, relu and bn | |
| Liner1: in = 1536, out = n_way | Avg_pool2d: k = 7 × 7, s = 7, p = 0 | |
| Flatten | ||
| Liner1: in = 768, out = n_way |
| Sample Type | MFTD | MFVD | MFRD |
|---|---|---|---|
| Simulated samples | 600 | 270 | 255 |
| Experimental samples | 140 | 150 | 225 |
| Total sample size | 740 | 420 | 480 |
| Sample Type | MFTsTD | MFTsVD | MFTsRD |
|---|---|---|---|
| Simulated samples | 400 | 180 | 170 |
| Experimental samples | 80 | 100 | 150 |
| Total sample size | 480 | 280 | 320 |
| Sample Type | Sample Size | Accuracy | Precision | Recall | F1-Score | AUC-PR (95% CI) |
|---|---|---|---|---|---|---|
| Simulated samples | 170 | 0.9647 | 0.8750 | 0.9333 | 0.9032 | 0.9641 (0.9130–0.9945) |
| Experimental samples | 150 | 0.9600 | 0.9355 | 0.9667 | 0.9508 | 0.9808 (0.9560–0.9981) |
| All samples | 320 | 0.9625 | 0.9149 | 0.9556 | 0.9348 | 0.9765 (0.9538–0.9928) |
| Memory Rule | Sample Size | Accuracy | Precision | Recall | F1-Score | AUC-PR (95% CI) |
|---|---|---|---|---|---|---|
| MR1 | 320 | 0.9469 | 0.8842 | 0.9333 | 0.9081 | 0.9658 (0.9385–0.9871) |
| MR2 | 320 | 0.9500 | 0.8936 | 0.9333 | 0.9130 | 0.9703 (0.9442–0.9897) |
| MR3 | 320 | 0.9594 | 0.9140 | 0.9444 | 0.9290 | 0.9732 (0.9479–0.9909) |
| MR4 | 320 | 0.9625 | 0.9149 | 0.9556 | 0.9348 | 0.9765 (0.9538–0.9928) |
| Sample Type | Sample Size | Accuracy | Precision | Recall | F1-Score | AUC-PR (95% CI) |
|---|---|---|---|---|---|---|
| SNR ≥ 3 dB | 180 | 0.9667 | 0.9322 | 0.9649 | 0.9483 | 0.9916 (0.9766–1.0000) |
| SNR < 3 dB | 140 | 0.9571 | 0.8857 | 0.9394 | 0.9118 | 0.9388 (0.8655–0.9842) |
| Sample Type | Sample Size | Accuracy | Precision | Recall | F1-Score | AUC-PR (95% CI) |
|---|---|---|---|---|---|---|
| SRR ≥ 3 dB | 212 | 0.9717 | 0.9420 | 0.9701 | 0.9559 | 0.9918 (0.9770–1.0000) |
| SRR < 3 dB | 108 | 0.9444 | 0.8400 | 0.9130 | 0.8750 | 0.9205 (0.8130–0.9834) |
| Module | Parameters (M) | FLOPs (M) | Accuracy (%) | Precision (%) | Recall (%) | F1-Score (%) | AUC-PR (95% CI) (%) | |
|---|---|---|---|---|---|---|---|---|
| ResNet-18 | 11.68 | 1824.0 | 90.94 | 82.11 | 86.67 | 84.32 | 92.97 (88.80–96.15) | |
| MobileNetV2 | 3.51 | 327.6 | 89.69 | 80.00 | 84.44 | 82.16 | 92.82 (88.68–96.31) | |
| EfficientNetB0 | 5.29 | 412.8 | 90.63 | 81.91 | 85.56 | 83.70 | 93.57 (89.23–96.66) | |
| ShuffleNetV2x1 | 1.26 | 146.0 | 88.44 | 77.32 | 83.33 | 80.21 | 89.88 (84.36–94.02) | |
| MFasNetV1 | HasNet-5 | 1.06 | 11.1 | 93.13 | 85.42 | 91.11 | 88.17 | 95.86 (92.62–98.22) |
| TFasNet-7 | 3.56 | 324.5 | ||||||
| DasNet-9 | 0.84 | 428.4 | ||||||
| FFC | 0.39 | 0.4 | ||||||
| Total | 5.85 | 764.4 | ||||||
| MTFF_RNet | HasNet-5 | 1.06 | 11.1 | 96.25 | 91.49 | 95.56 | 93.48 | 97.65 (95.38–99.28) |
| TFasNet-7 | 3.56 | 324.5 | ||||||
| DasNet-9 | 0.84 | 428.4 | ||||||
| MT_FFC | 3.15 | 6.3 | ||||||
| Total | 8.61 | 770.3 | ||||||
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Liu, X.; Wang, C.; Yang, Y.; Yang, X.; Hu, Y.; Liu, J. Underwater Target Recognition with Fusion of Multi-Domain Temporal Features. Acoustics 2026, 8, 22. https://doi.org/10.3390/acoustics8020022
Liu X, Wang C, Yang Y, Yang X, Hu Y, Liu J. Underwater Target Recognition with Fusion of Multi-Domain Temporal Features. Acoustics. 2026; 8(2):22. https://doi.org/10.3390/acoustics8020022
Chicago/Turabian StyleLiu, Xiaochun, Chenyu Wang, Yunchuan Yang, Xiangfeng Yang, Youfeng Hu, and Jianguo Liu. 2026. "Underwater Target Recognition with Fusion of Multi-Domain Temporal Features" Acoustics 8, no. 2: 22. https://doi.org/10.3390/acoustics8020022
APA StyleLiu, X., Wang, C., Yang, Y., Yang, X., Hu, Y., & Liu, J. (2026). Underwater Target Recognition with Fusion of Multi-Domain Temporal Features. Acoustics, 8(2), 22. https://doi.org/10.3390/acoustics8020022

