3.1. Data Description
To validate the effectiveness of the proposed method in AUV fault diagnosis, this study conducts experimental investigations using the publicly available dataset of the “HaiZhe” small quadrotor AUV, with fault data derived from the “HaiZhe” dataset [
27]. The dataset covers five operating conditions: normal operation, added-weight fault, depth sensor fault, mild propeller damage, and severe propeller damage, thereby capturing typical abnormal patterns associated with propulsion, payload, and perception subsystems. Specifically, the added-weight fault is used to simulate payload variations caused by foreign-object attachment to the vehicle; the depth sensor fault is used to simulate bathymetric deviations induced by abnormal pressure gain; and mild and severe propeller damage correspond to different degrees of propulsion performance degradation. As illustrated in
Figure 3, these three fault categories correspond to (a) added-weight fault, (b) depth sensor fault, and (c) propeller health conditions (including mild and severe damage).
For each fault type, the dataset provides raw operational records obtained through multiple repeated experiments. The state sequence from each individual trial is constructed as one sample, and the sample label is assigned based on the corresponding fault mode. The collected variables include multidimensional state quantities such as PWM control signals, depth, pressure, voltage, attitude angles, angular velocities, and accelerations, as shown in
Table 1. These variables can comprehensively characterize the coupling relationship between the dynamic response and perception information of the AUV during fault evolution.
Table 1 lists the multivariate state variables acquired from the AUV, including control signals, depth, pressure, attitude, angular velocities, and accelerations. The corresponding experimental setup and data acquisition workflow are depicted in
Figure 4, which outlines the overall procedure for collecting these time-series signals under each fault condition. As shown in the figure, the data collection process involves running the AUV under controlled normal and fault-injected scenarios, with each trial recording the full dynamic response of the vehicle over a complete operational episode.
In terms of data representation, each sample can be expressed as a two-dimensional time-series matrix, , where denotes the length of the time series and denotes the number of sensor channels. In the experiments of this study, the time-series length is fixed at 296. During data processing, the recorded time variable is removed, resulting in 16 channels. Each sample is associated with a fault label, and the label space contains five categories, denoted as Class 0 to Class 4. Different categories represent the characteristic behaviors of the system under different fault modes or operating states.
To improve the training stability of the model under limited-sample conditions, the raw time-series data are first partitioned into different subsets and subsequently normalized using statistics calculated exclusively from the training set. It should be noted that the data used in this study have been pre-constructed into independent samples according to individual experimental trials. Each sample corresponds to a complete multivariate time series, with a length of 296 and 16 channels, and is accompanied by the corresponding fault label. The dataset contains 980 independent trial-level samples in total, including 146 normal-state samples, 214 added-weight-fault samples, 213 depth-sensor-fault samples, 199 severe-propeller-fault samples, and 208 mild-propeller-fault samples. Each sample corresponds to one complete multivariate experimental trial with a temporal length of 296 and 16 input channels after removal of the recorded time variable. No overlapping sliding-window segmentation is used to artificially increase the number of samples. Therefore, this study does not adopt an overlapping sliding-window sampling method; instead, modeling and analysis are directly conducted with each sample as the basic unit. For dataset partitioning, a stratified random sampling strategy is adopted to divide the dataset into training, validation, and test sets at ratios of 70%, 15%, and 15%, respectively. This ensures consistent distributions of different fault categories across the subsets and prevents class imbalance from interfering with model training and evaluation. During data preprocessing, the minimum and maximum values of each channel are calculated based on the training set, and min–max normalization is then applied to all data. This maps features with different physical units onto a unified scale interval, thereby improving the stability and convergence speed of model training. While ensuring data independence, this sample-level partitioning strategy also provides a unified data basis for fair comparisons among different models. It avoids data leakage caused by overlapping windows and thereby ensures the objectivity and reliability of the model evaluation results. Because the complete stratified split is independently regenerated for each random seed, the identities of the samples assigned to the training, validation, and test subsets change across repeated runs, while the class-wise sample counts remain fixed under the stratified 70%/15%/15% allocation.
Table 2 therefore reports the total number of independent trial-level samples for each fault category, while the common splitting protocol is described in the text.
To ensure the fairness of comparison, all models are trained and tested under a unified experimental framework. During training, the Adam optimizer and gradient clipping are adopted. The validation subset is used exclusively for checkpoint and hyperparameter selection and is not used for class-difficulty estimation, class-difficulty-guided ordering, or pseudo-feature generation. To evaluate robustness against random initialization and sampling variance, the complete experimental procedure, including data partitioning and model training, is repeated with five independent random seeds (2021, 2022, 2023, 2024, and 2025). The main comparative experiments, noise-robustness experiments, and the main-module and internal-mechanism ablation experiments are reported as the mean ± standard deviation over five runs. The hyperparameter sensitivity analysis uses three independent random seeds, as specified in
Section 3.4. In this paper, DCK-CAM-TCN [
28], DRSN, WDCNN-BiLSTM [
29], Transformer, Informer, and PatchTST are selected as comparative models. Among them, DCK-CAM-TCN mainly employs convolutional structures to extract local temporal patterns and exhibits strong inductive capability for local features. DRSN serves as the residual shrinkage network baseline and is used to verify the effectiveness of the attention enhancement and boundary-aware feature augmentation mechanisms. WDCNN-BiLSTM models temporal dependencies through a bidirectional recurrent structure, enabling full utilization of sequential contextual information when the number of samples is limited. Transformer directly models global correlations among different temporal positions and can be used to evaluate the diagnostic performance of global temporal dependency modeling methods. The Informer model reduces the modeling cost of long sequences through a sparse attention mechanism, representing a further evolution of this route toward efficient long-sequence modeling. PatchTST combines local segment representation with long- and short-term dependency modeling through patch partitioning, representing an important model in the evolution of time-series diagnosis from point-wise modeling to segment-based temporal representation. The above models cover several fault diagnosis technical routes, including convolutional modeling, recurrent modeling, residual shrinkage feature extraction, and attention-based modeling. The evaluation metrics used in this paper include test accuracy, Macro-F1, worst-class Accuracy, and the consistency between validation-set and test-set performance. On this basis, multiple noise disturbance conditions are further constructed to systematically evaluate diagnostic accuracy, class balance, and noise robustness.
To ensure a fair comparison, the hyperparameters of WDCNN-BiLSTM, Transformer, Informer, and PatchTST were optimized using the training and validation sets only. Candidate configurations were trained on the training subset, and the final configuration was selected according to validation accuracy. The test set was used only after model selection had been completed. The selected hyperparameter settings for each baseline model are detailed in
Table 3, including the learning rate, dropout, weight decay, and other architecture-specific parameters.
Validation-based tuning improved the test Accuracy of PatchTST from approximately 72.97% under the original configuration to 76.08 ± 2.97% under the revised configuration. Although this confirms that the original setting underestimated the achievable performance of PatchTST, a substantial performance gap remains after tuning; therefore, the remaining difference is interpreted cautiously in terms of architecture–task compatibility rather than as a result of insufficient hyperparameter optimization alone.
3.2. Comparative Model Analysis
Figure 5a presents the five-seed test Accuracy of each model under the noise-free condition. Following the revised protocol, in which class-difficulty feedback is estimated exclusively from the complete training subset, AE-DRSN-ABHFA achieves a mean Accuracy of 95.27 ± 1.17%, compared with 94.73 ± 2.05% for DRSN, 91.62 ± 1.89% for DCK-CAM-TCN, 91.22 ± 2.14% for WDCNN-BiLSTM, 84.86 ± 1.23% for Informer, 83.11 ± 3.31% for Transformer, and 76.08 ± 2.97% for PatchTST. Thus, the proposed model achieves the highest mean clean-condition Accuracy among the evaluated models. These repeated-run results indicate that AE-DRSN-ABHFA maintains favorable discriminative capability under noise-free conditions while reducing the possibility that the reported performance is attributable to a single favorable initialization or data partition.
Figure 5b further compares the accuracy of each model on the validation and test sets. The relatively small discrepancy between validation and test set performance suggests stable within-dataset generalization under the evaluated HaiZhe data partitions. DCK-CAM-TCN and DRSN also maintain high recognition accuracy, whereas PatchTST exhibits a relatively pronounced decline in test-set performance.
Figure 5c shows the five-seed worst-class Accuracy. AE-DRSN-ABHFA achieves the highest mean value of 87.89 ± 5.94%, compared with 80.23 ± 14.72% for DRSN, 76.70 ± 2.26% for WDCNN-BiLSTM, 69.20 ± 5.91% for Informer, 68.58 ± 4.11% for Transformer, 67.64 ± 5.13% for DCK-CAM-TCN, and 61.02 ± 7.89% for PatchTST. The results suggest that the proposed model raises the recognition lower bound for difficult classes on average. The relatively large SD values observed for several models also highlight the importance of repeated-run evaluation when assessing class-level stability in this limited-sample setting.
Figure 5d presents the Macro-F1 comparison across five random seeds. AE-DRSN-ABHFA obtains the highest mean Macro-F1 of 0.9498 ± 0.0128, followed by DRSN at 0.9406 ± 0.0273, DCK-CAM-TCN at 0.9065 ± 0.0181, WDCNN-BiLSTM at 0.9050 ± 0.0215, Informer at 0.8450 ± 0.0164, Transformer at 0.8265 ± 0.0349, and PatchTST at 0.7597 ± 0.0319. Since Macro-F1 assigns equal weight to each category, these results suggest that the proposed method maintains a favorable balance across fault categories rather than obtaining its overall Accuracy primarily from easily classified classes.
To further examine the stability of the observed performance differences, two-sided paired t-tests were conducted using the results obtained under the same five random seeds. Because six paired comparisons were performed across two baselines and three evaluation metrics, Holm–Bonferroni correction was applied to control for multiple comparisons, and 95% confidence intervals (CIs) of the paired mean differences and Cohen’s were additionally calculated.
Compared with DRSN, the mean paired differences are +0.54 percentage points for Accuracy (95% CI: −1.07 to 2.15, Cohen’s = 0.416, raw p = 0.4050, Holm-adjusted p = 0.6159), +0.0091 for Macro-F1 (95% CI: −0.0126 to 0.0308, = 0.522, raw p = 0.3079, Holm-adjusted p = 0.6159), and +7.66 percentage points for worst-class Accuracy (95% CI: −3.41 to 18.73, = 0.859, raw p = 0.1272, Holm-adjusted p = 0.3816). None of these differences reach the conventional significance level after multiplicity correction.
Compared with DCK-CAM-TCN, AE-DRSN-ABHFA shows a mean paired Accuracy difference of +3.65 percentage points (95% CI: 0.42 to 6.88, = 1.404, raw p = 0.0349, Holm-adjusted p = 0.1396) and a Macro-F1 difference of +0.0432 (95% CI: 0.0127 to 0.0738, = 1.758, raw p = 0.0171, Holm-adjusted p = 0.0855). Although these two comparisons exhibit positive differences and large standardized effect sizes, they do not remain statistically significant after Holm–Bonferroni correction. In contrast, the worst-class Accuracy difference is +20.25 percentage points (95% CI: 17.42 to 23.08, = 8.876, raw p = 3.80 × 10−5, Holm-adjusted p = 2.28 × 10−4), and remains statistically significant after correction. Given the limited number of five paired repetitions, these confidence intervals and effect sizes should be interpreted cautiously, and the results should not be regarded as definitive evidence of universal superiority.
In addition, to verify the timeliness of the proposed model under the limited computational resources of AUVs, this paper conducts a comparative analysis of different models from three aspects: the number of trainable parameters, model size, and single-sample inference time. Specifically, the number of trainable parameters reflects the structural complexity of the model; a larger number of parameters generally implies higher storage and computational resource requirements during model training and deployment. Model size reflects the storage space occupied by the model file, which is directly related to the feasibility of deploying the model on embedded or edge devices. Single-sample inference time reflects the time cost required for the model to complete one fault diagnosis and is a key indicator for evaluating the timeliness of online diagnosis. During inference-time measurement, all models were operated in evaluation mode without gradient computation on the same RTX 4060 Laptop GPU. Inference efficiency was evaluated under Batch = 1 and Batch = 32, and the corresponding per-sample latency is reported in
Table 4.
As shown in
Table 4, AE-DRSN-ABHFA has 143,407 trainable parameters and a model size of only 0.551 MB, which is only slightly higher than that of DRSN and smaller than those of the other models. This indicates that, after introducing channel attention, temporal attention, and the ABHFA mechanism, the proposed model does not significantly increase the parameter scale and still maintains a lightweight network structure. In terms of inference time, the single-sample inference time of AE-DRSN-ABHFA is 2.711 ms under Batch = 1 and further decreases to 1.422 ms under Batch = 32. Both are within the millisecond range and are markedly lower than those of temporal models such as Transformer, Informer, and PatchTST. Although WDCNN-BiLSTM exhibits faster inference speed, both its parameter count and model size are larger than those of AE-DRSN-ABHFA. Although DRSN is close to AE-DRSN-ABHFA in terms of parameter count and inference time, it lacks attention enhancement and hard feature augmentation mechanisms, resulting in relatively insufficient class recognition stability under complex noise conditions. It should be noted that ABHFA is mainly used for boundary-aware pseudo-feature augmentation during the training stage. During testing and deployment, pseudo-feature generation is no longer performed; therefore, no additional online inference burden is introduced. These results indicate computational feasibility on the tested GPU platform and suggest potential for future lightweight onboard deployment; however, actual real-time performance on embedded AUV hardware remains to be validated.
3.3. Performance Analysis Under Noisy Conditions
To systematically evaluate the diagnostic robustness of the models under complex interference conditions, this study considers four noise-contaminated scenarios: Gaussian noise at 20 dB, Gaussian noise at 10 dB, impulse noise parameterized using a 20 dB reference SNR, and mixed Gaussian–sinusoidal interference parameterized using a 20 dB reference SNR. The proposed model is compared with WDCNN-BiLSTM, DRSN, DCK-CAM-TCN, Transformer, Informer, and PatchTST.
Artificial disturbances were introduced after data normalization. For each normalized training, validation, or test subset
, the mean signal power was calculated as follows:
and the reference noise power corresponding to a specified SNR is defined as
For Gaussian noise, independent zero-mean Gaussian disturbances were sampled from
For the impulse-noise condition, a random corruption mask with a probability of 0.03 was generated independently over the signal elements. The disturbance was zero at unselected positions, whereas the selected positions were perturbed using zero-mean Gaussian impulses with a standard deviation of
, thereby representing sparse transient high-amplitude disturbances. For the mixed-noise condition, Gaussian noise was combined with periodic sinusoidal interference. The sinusoidal component was defined as
where
was uniformly sampled over the normalized temporal interval
. The mixed disturbance was therefore defined as
For each investigated noisy condition, the corresponding disturbance was independently introduced into the normalized training, validation, and test subsets. Each model was therefore retrained, validation-selected, and tested under the same specified noisy condition rather than being trained only on clean data. Within each random seed and noise condition, all compared models used the same data split and the same artificially generated noise realization. Accordingly, the present experiments evaluate diagnostic performance under controlled matched noisy operating conditions rather than the out-of-distribution robustness of a clean-trained model to previously unseen test disturbances. For AE-DRSN-ABHFA, under each noisy condition, class-difficulty scores were still calculated exclusively from the corresponding complete training subset, while the validation subset was used only for checkpoint selection and did not participate in class-difficulty-guided ordering or pseudo-feature generation.
In the noise experiments, the models are trained using the Adam optimizer, together with a cosine annealing learning rate scheduling strategy. The main training parameters of AE-DRSN-ABHFA are set as follows: the learning rate is 0.0003, the batch size is 32, the number of training epochs is 200, and the weight decay coefficient is 0.0001. ABHFA is activated after 50 warm-up epochs, and the maximum number of accepted pseudo-features is set to four per mini-batch. The actual number of retained pseudo-features may be smaller than four depending on the available boundary candidates, valid same-class neighbors, and the semantic-validity check; the weight of the pseudo-feature classification loss is 0.15; the weight of the batch-hard triplet loss is 0.05; the triplet margin is 0.3; the boundary sample selection ratio is 0.30; and the momentum coefficient for difficult classes is 0.85. The experimental hardware platform is a Lenovo Legion R7000 laptop (manufacturer: Lenovo (Beijing) Limited, Beijing, China), equipped with an AMD Ryzen 7 8745H CPU, an NVIDIA GeForce RTX 4060 Laptop GPU with 8 GB of video memory, and 16 GB of DDR5 memory. The experimental programs were implemented using Python 3.8 and PyTorch 2.13.0, with key dependencies including NumPy 1.24.3, scikit-learn 1.2.2, Matplotlib 3.7.1, and Seaborn 0.12.2. The code is configured to prioritize the CUDA GPU for training and testing; when the GPU is unavailable, the program automatically switches to CPU execution. Each noise condition is evaluated over the same five independent random seeds, and
Table 5 reports mean ± SD.
Figure 6,
Figure 7,
Figure 8 and
Figure 9 are retained as representative single-run confusion-matrix and t-SNE visualizations for qualitative interpretation; the quantitative conclusions are based on the five-seed aggregate results in
Table 5.
As shown in
Table 5, AE-DRSN-ABHFA achieves the highest mean clean-condition Accuracy of 95.27 ± 1.17% among the evaluated models. Across the four noisy operating conditions, the proposed model achieves an average Accuracy of 85.37 ± 2.76%, an average Macro-F1 of 0.8253 ± 0.0317, and an average worst-class Accuracy of 75.39 ± 5.98%. These are the highest mean values among the compared models, suggesting that AE-DRSN-ABHFA maintains a favorable balance between overall diagnostic accuracy and class-level recognition performance under the evaluated noisy conditions.
Among the investigated disturbances, Gaussian noise at 10 dB produces the most pronounced performance degradation for all models. Under this severe condition, AE-DRSN-ABHFA achieves a mean Accuracy of 70.69 ± 6.44%, compared with 65.14 ± 3.90% for DCK-CAM-TCN, 64.46 ± 4.32% for Transformer, 63.11 ± 8.20% for DRSN, 62.57 ± 1.13% for WDCNN-BiLSTM, 56.35 ± 2.60% for Informer, and 42.70 ± 3.32% for PatchTST. Thus, the proposed model retains the highest mean Accuracy under the strongest Gaussian interference considered in this study, although the relatively large standard deviation of 6.44% indicates noticeable run-to-run variability.
Under Gaussian noise at 20 dB, AE-DRSN-ABHFA achieves a mean Accuracy of 89.43 ± 0.91%, exceeding DCK-CAM-TCN by 0.65 percentage points (88.78 ± 3.33%). Under impulse noise at 20 dB, the proposed model achieves 92.03 ± 3.49%, compared with 90.54 ± 1.07% for DCK-CAM-TCN, corresponding to a numerical advantage of 1.49 percentage points. Under mixed Gaussian–sinusoidal noise at 20 dB, AE-DRSN-ABHFA obtains 89.32 ± 2.21%, which is 2.43 percentage points higher than DCK-CAM-TCN at 86.89 ± 2.73%. Among the architecture-level models compared in
Table 5, the proposed method achieves the highest mean Accuracy under all four evaluated noisy conditions, although the magnitude of the advantage varies across disturbance types.
When the four noisy conditions are aggregated, AE-DRSN-ABHFA achieves an average Accuracy of 85.37 ± 2.76%, compared with 82.84 ± 2.34% for DCK-CAM-TCN and 81.45 ± 3.31% for DRSN. The corresponding numerical improvements are 2.53 and 3.92 percentage points, respectively. Among the architecture-level models listed in
Table 5, AE-DRSN-ABHFA also achieves the highest average noisy-condition Macro-F1 of 0.8253 ± 0.0317, compared with 0.8150 ± 0.0260 for DCK-CAM-TCN and 0.8073 ± 0.0344 for DRSN.
The advantage is more pronounced in worst-class recognition. AE-DRSN-ABHFA achieves an average noisy-condition worst-class Accuracy of 75.39 ± 5.98%, compared with 62.76 ± 6.94% for DRSN and 58.21 ± 10.77% for DCK-CAM-TCN, corresponding to numerical improvements of 12.63 and 17.18 percentage points, respectively. This result is consistent with the design objective of ABHFA, which uses class-difficulty information to determine the class-processing order and boundary-aware scores to identify ambiguous augmentation candidates during training.
Nevertheless, the repeated-run results also show that the numerical advantage of AE-DRSN-ABHFA is not equally pronounced under every disturbance type. In particular, the difference relative to DCK-CAM-TCN is only 0.65 percentage points under Gaussian noise at 20 dB, and the standard deviation reaches 6.44% under Gaussian noise at 10 dB. Therefore, the present results are interpreted as evidence of favorable average robustness and class-level recognition balance under the evaluated conditions rather than deterministic superiority for every individual data partition or noise realization.
The remaining temporal models exhibit comparatively lower average performance under the present limited-sample and noisy diagnostic setting. Transformer and Informer achieve average noisy-condition Accuracies of 76.93 ± 1.92% and 73.72 ± 1.47%, respectively, while PatchTST obtains 59.32 ± 2.60%. Its average worst-class Accuracy decreases to 35.28 ± 5.67%, indicating substantial difficulty in maintaining recognition of the hardest class under noisy conditions. Overall, the repeated-run results suggest that the combination of adaptive soft-threshold shrinkage, channel–temporal attention, and boundary-aware hard feature augmentation provides a favorable balance among overall Accuracy, Macro-F1, and worst-class recognition under the evaluated noisy operating conditions.
To further investigate the classification behavior and learned feature distributions of the proposed model under different noise conditions, representative confusion matrices and t-SNE visualizations are shown in
Figure 6,
Figure 7,
Figure 8 and
Figure 9. The confusion matrices illustrate class-specific recognition patterns, whereas the t-SNE visualizations provide a qualitative view of intra-class compactness and inter-class separability in the learned feature space. It should be emphasized that these visualizations correspond to representative individual runs, whereas the quantitative conclusions in
Table 5 are based on the mean ± standard deviation across five independent random seeds.
Under the noise-free condition, as shown in
Figure 6, the representative confusion matrix shows that most predictions are concentrated along the main diagonal, indicating high recognition accuracy across the different operating conditions. The corresponding t-SNE visualization shows that samples from different classes form relatively compact and distinguishable clusters, with comparatively clear inter-class boundaries. This qualitative observation is consistent with the five-seed quantitative result of 95.27 ± 1.17% reported in
Table 5 and indicates that the proposed model maintains strong discriminative performance under the noise-free condition.
Under impulse noise at 20 dB, as shown in
Figure 7, the representative confusion matrix still exhibits a strong diagonal distribution, while the t-SNE visualization indicates that most class clusters retain useful intra-class compactness and inter-class separation despite the presence of transient disturbances. Across five independent runs, AE-DRSN-ABHFA achieves a mean Accuracy of 92.03 ± 3.49% under this condition, representing a moderate decrease relative to the clean-condition Accuracy of 95.27 ± 1.17%. The result suggests that the proposed architecture retains favorable diagnostic performance in the presence of transient high-amplitude disturbances.
Under the strong Gaussian noise condition of 10 dB, the classification difficulty of both models increases substantially. In the representative run shown in
Figure 8, DCK-CAM-TCN achieves an overall Accuracy of 68.24%. In particular, only 14 of the 32 Class 4 samples are correctly recognized, corresponding to a Class 4 accuracy of 43.75%. The remaining Class 4 samples are mainly misclassified as Class 3, with additional confusion involving Classes 1 and 2. The corresponding t-SNE visualization also shows substantial overlap among several fault categories, indicating reduced feature separability under strong Gaussian interference.
In contrast, the representative AE-DRSN-ABHFA result shown in
Figure 9 achieves an overall Accuracy of 70.27%. Although noticeable overlap remains among some classes in the t-SNE space under severe Gaussian interference, the corresponding confusion matrix illustrates that useful class-specific discriminative information is still retained in this representative run.
Figure 9 is used only for qualitative interpretation and should not be interpreted as the aggregate quantitative results.
The five-seed results in
Table 5 show that AE-DRSN-ABHFA achieves a mean Accuracy of 70.69 ± 6.44% under Gaussian noise at 10 dB, compared with 65.14 ± 3.90% for DCK-CAM-TCN. Across the four evaluated noisy conditions, the proposed model achieves an average worst-class Accuracy of 75.39 ± 5.98%. These aggregate results indicate favorable class-level recognition under the evaluated disturbances, although the relatively large variability under severe Gaussian noise also highlights the sensitivity of the model to random initialization and data partitioning in particularly challenging conditions.
Overall, the noise-condition experiments indicate that AE-DRSN-ABHFA maintains favorable diagnostic performance across Gaussian, impulse, and mixed disturbances. AE-DRSN combines adaptive soft-threshold shrinkage with channel and temporal attention to enhance fault-sensitive feature extraction, while ABHFA directs feature augmentation toward ambiguous boundary samples through class prototypes, boundary-aware scoring, and training-derived class-difficulty-guided ordering. Among the architecture-level models in
Table 5, the five-seed aggregate results show that the proposed model achieves the highest mean Accuracy under all four evaluated noisy conditions, together with the highest average noisy-condition Macro-F1 and worst-class Accuracy. Nevertheless, the relatively large variability under severe Gaussian noise indicates that the method does not guarantee deterministic superiority for every individual run.
3.4. Ablation and Mechanism Analyses
To systematically evaluate the effectiveness of each core module in the proposed AE-DRSN-ABHFA method and to further verify that the performance improvement of ABHFA does not originate from simple random perturbations, two sets of ablation experiments are designed in this section: a main-module ablation experiment, which analyzes the contributions of channel attention (CA), temporal attention (TA), and ABHFA to the overall performance; and an internal mechanism ablation experiment of ABHFA, which evaluates the roles of prototype guidance, boundary score, difficulty-guided ordering, pseudo-feature cross-entropy (CE) constraint, and triplet loss under the given experimental sample conditions.
The experiments adopt Accuracy, Macro-F1, and worst-class Accuracy as evaluation metrics. Among them, Accuracy reflects the overall classification performance of the model, Macro-F1 reflects the balance of multi-class recognition, and Worst-class Accuracy is used to measure the recognition lower bound for the most difficult class. Since unstable recognition of certain classes is likely to occur in AUV multi-fault diagnosis, comparing only the overall accuracy is insufficient; Macro-F1 and Worst-class Accuracy should also be considered in the analysis.
As shown in
Table 6, the DRSN baseline achieves an Accuracy of 94.73 ± 2.05%, a Macro-F1 of 0.9406 ± 0.0273, and a worst-class Accuracy of 80.23 ± 14.72%. Adding channel attention alone maintains the same mean Accuracy of 94.73 ± 2.50%, while increasing the Macro-F1 to 0.9447 ± 0.0246 and the worst-class Accuracy to 85.28 ± 5.86%. Temporal attention alone achieves an Accuracy of 94.59 ± 1.26%, corresponding to a difference of −0.14 percentage points relative to DRSN, while increasing the worst-class Accuracy to 87.33 ± 5.02%. Combining both attention mechanisms in AE-DRSN yields an Accuracy of 94.73 ± 1.11%, a Macro-F1 of 0.9441 ± 0.0127, and a worst-class Accuracy of 85.50 ± 5.80%. These results suggest that the attention mechanisms primarily improve class-level recognition balance rather than producing a large increase in overall Accuracy.
When ABHFA is directly incorporated into the DRSN backbone without the attention-enhanced feature extractor, DRSN + ABHFA achieves an Accuracy of 94.46 ± 1.21%, which is 0.27 percentage points lower than that of the DRSN baseline. Its Macro-F1 is 0.9401 ± 0.0141, while its worst-class Accuracy reaches 84.66 ± 7.58%, which is numerically 4.43 percentage points higher than that of DRSN. This result suggests that ABHFA alone provides limited improvement in overall Accuracy, while its effect is more evident in difficult-class recognition. In contrast, the complete AE-DRSN-ABHFA model achieves the highest mean Accuracy of 95.27 ± 1.17%, a Macro-F1 of 0.9498 ± 0.0128, and a worst-class Accuracy of 87.89 ± 5.94%. Relative to DRSN, the corresponding mean differences are +0.54 percentage points in Accuracy, +0.0092 in Macro-F1, and +7.66 percentage points in worst-class Accuracy. Compared with AE-DRSN, introducing ABHFA further increases the mean Accuracy by 0.54 percentage points, the Macro-F1 by 0.0057, and the worst-class Accuracy by 2.39 percentage points. Overall, these results support a complementary relationship between the attention-enhanced feature representation and boundary-aware hard-feature augmentation.
To further investigate the contributions of the individual mechanisms within ABHFA and their interactions, a systematic internal ablation study was conducted under the same five-seed data-partitioning and evaluation protocol. AE-DRSN without ABHFA was adopted as the reference backbone. Starting from this backbone, prototype-guided pseudo-feature augmentation, boundary-aware sample selection, class-difficulty-guided ordering, and the batch-hard triplet constraint were progressively incorporated. The pseudo-feature classification constraint was introduced together with prototype-guided augmentation so that the generated features could participate in supervised optimization. All variants used the same AE-DRSN backbone, data-splitting protocol, optimizer settings, and training schedule. Because these mechanisms jointly affect augmentation-target selection and feature-space optimization, the results are interpreted in terms of their complementary interactions rather than assuming that each individual addition must produce a monotonic improvement in all evaluation metrics.
The five-seed internal ablation results in
Table 7 show that the contributions of the ABHFA components are complementary but not strictly monotonic. Starting from the AE-DRSN baseline, which achieves an Accuracy of 94.73 ± 1.11%, a Macro-F1 of 0.9441 ± 0.0127, and a worst-class Accuracy of 85.50 ± 5.80%, introducing prototype-guided augmentation alone maintains essentially the same overall Accuracy at 94.73 ± 0.88% and Macro-F1 at 0.9443 ± 0.0113, while the worst-class Accuracy decreases to 83.81 ± 8.31%. This indicates that prototype-guided feature generation by itself does not consistently improve difficult-class recognition.
After boundary-aware sample selection is incorporated, the mean Accuracy increases to 95.00 ± 0.37%, and the Macro-F1 increases to 0.9478 ± 0.0050, while the worst-class Accuracy recovers to 85.23 ± 1.18%. Further introducing class-difficulty-guided ordering results in an Accuracy of 94.86 ± 1.40%, a Macro-F1 of 0.9463 ± 0.0144, and a worst-class Accuracy of 86.59 ± 5.59%. Compared with the boundary-score variant, this configuration does not further increase the overall Accuracy or Macro-F1, but it raises the mean worst-class Accuracy by 1.36 percentage points. This suggests that the class-difficulty mechanism is more closely associated with improving recognition of difficult classes than with uniformly increasing overall classification performance.
The complete ABHFA configuration, which additionally incorporates the batch-hard triplet constraint, achieves the best overall balance among the internal variants, with an Accuracy of 95.27 ± 1.17%, a Macro-F1 of 0.9498 ± 0.0128, and a worst-class Accuracy of 87.89 ± 5.94%. Relative to the AE-DRSN baseline, the corresponding mean changes are +0.54 percentage points in Accuracy, +0.0057 in Macro-F1, and +2.39 percentage points in worst-class Accuracy. These results indicate that the individual ABHFA components should not be interpreted as providing strictly additive gains. Instead, prototype guidance, boundary-aware selection, class-difficulty feedback, and metric learning interact to produce a more balanced feature-augmentation mechanism, with the complete configuration providing the most favorable combined performance under the present experimental setting.
To further examine whether the additional feature-space optimization introduced by ABHFA provides advantages over simpler and widely used training strategies, AE-DRSN was additionally combined with Focal Loss, Hard Negative Mining (HNM), and SMOTE. All methods used the same AE-DRSN backbone, data-partitioning protocol, optimizer settings, and training schedule, and were evaluated using the same five random seeds (2021–2025). The results are reported as mean ± standard deviation in
Table 8.
As shown in
Table 8, under the noise-free condition, AE-DRSN + SMOTE achieves an Accuracy of 95.92 ± 1.67% and a Macro-F1 of 0.9553 ± 0.0191, slightly exceeding the 95.27 ± 1.17% Accuracy and 0.9498 ± 0.0128 Macro-F1 obtained by AE-DRSN-ABHFA. In contrast, the proposed method achieves the highest worst-class Accuracy of 87.89 ± 5.94%, compared with 85.70 ± 6.44% for SMOTE. Therefore, the clean-condition comparison does not indicate the universal superiority of ABHFA over generic feature interpolation. Rather, the results suggest that SMOTE is effective at increasing feature diversity in the present limited-sample setting, whereas the effect of ABHFA is more closely associated with maintaining the recognition performance of difficult classes.
To further clarify this distinction and directly evaluate the reviewer-raised noisy-condition scenario, AE-DRSN + SMOTE was additionally evaluated using the same four controlled noise conditions and the same five random seeds as AE-DRSN-ABHFA. The focused comparison is shown in
Table 8. Across the four noisy conditions, AE-DRSN-ABHFA achieves an average Accuracy of 85.37 ± 2.76%, compared with 83.84 ± 1.39% for SMOTE, corresponding to a numerical improvement of 1.53 percentage points. The difference becomes substantially more pronounced for worst-class recognition. AE-DRSN-ABHFA obtains an average noisy-condition worst-class Accuracy of 75.39 ± 5.98%, whereas SMOTE obtains 66.23 ± 9.02%, corresponding to a 9.16-percentage-point improvement. In contrast, their average Macro-F1 values remain close, with 0.8253 ± 0.0317 for ABHFA and 0.8290 ± 0.0222 for SMOTE.
The largest overall-Accuracy difference between the two approaches is observed under Gaussian noise at 10 dB, which represents the strongest Gaussian interference considered in this study. AE-DRSN-ABHFA achieves an Accuracy of 70.69 ± 6.44% under this condition, whereas AE-DRSN + SMOTE achieves 63.54 ± 2.83%, corresponding to a numerical improvement of 7.15 percentage points. This result suggests that targeted boundary-aware augmentation becomes more beneficial when severe interference substantially degrades the separability between fault categories.
The advantage is not uniform across all disturbance types. Under Gaussian noise at 20 dB, the two methods achieve almost identical mean Accuracy, with 89.43% for ABHFA and 89.52% for SMOTE. A similarly small difference is observed under impulse noise at 20 dB, where ABHFA and SMOTE achieve 92.03% and 91.84%, respectively. Under mixed Gaussian–sinusoidal noise at 20 dB, SMOTE achieves a slightly higher mean Accuracy of 90.48%, compared with 89.32% for ABHFA. Therefore, these results should not be interpreted as evidence that ABHFA deterministically or uniformly outperforms SMOTE under every noisy operating condition.
Instead, the comparison reveals a more specific advantage that is consistent with the motivation of ABHFA. SMOTE primarily increases feature diversity through interpolation between same-class samples, whereas ABHFA uses class prototypes, boundary-aware scoring, and training-derived class-difficulty-guided ordering to preferentially augment ambiguous samples associated with difficult decision boundaries. As a result, the benefit of ABHFA is more evident under severe boundary-degrading interference and in the recognition lower bound of the most difficult class. In particular, although SMOTE remains highly competitive in terms of average Macro-F1, ABHFA increases average noisy-condition worst-class Accuracy by 9.16 percentage points while simultaneously improving average noisy-condition Accuracy by 1.53 percentage points.
Overall, the additional comparison indicates that the principal advantage of ABHFA over SMOTE does not lie in universally maximizing clean-condition overall Accuracy. Rather, ABHFA provides a more favorable balance between overall diagnostic robustness and difficult-class recognition when the feature space is affected by substantial interference. This finding is consistent with the specific design objective of the proposed boundary-aware and class-difficulty-guided augmentation mechanism.
Table 9 shows that the performance of AE-DRSN-ABHFA remains relatively stable across reasonable ranges of the investigated hyperparameters. Overall Accuracy and Macro-F1 vary within comparatively limited ranges for most settings, whereas worst-class Accuracy exhibits greater sensitivity to several parameters directly related to boundary-sample selection and pseudo-feature displacement. This observation is consistent with the design of ABHFA, because these parameters primarily determine which difficult samples are augmented and how far the generated features are displaced within the local boundary region.
Based on the validation-based model-development procedure and the consideration that the auxiliary objectives should not dominate the primary classification objective, the final configuration was fixed at a pseudo-feature classification loss weight of 0.15, a triplet-loss weight of 0.05, a triplet margin of 0.30, a boundary-sample ratio of 0.30, a neighbor-blending coefficient of 0.25, a competing-prototype repulsion coefficient of 0.10, and a difficulty-momentum coefficient of 0.85. Importantly, these values were frozen before the final five-seed test evaluation. Therefore, the sensitivity analysis was used to characterize the local stability of the proposed mechanism rather than to select hyperparameters retrospectively from the test results.
As shown in
Table 10, replacing the Stage 1 wide convolution (
) with a pointwise projection (
) decreases the mean Accuracy from 95.27 ± 1.17% to 93.38 ± 1.68%, corresponding to a mean paired improvement of 1.89 percentage points. Macro-F1 decreases from 0.9498 ± 0.0128 to 0.9304 ± 0.0197, while worst-class Accuracy decreases from 87.89 ± 5.94% to 81.88 ± 4.29%. The full model achieves higher values than the pointwise variant in four out of five matched runs for all three metrics. These results suggest that initial local temporal aggregation provides a consistent practical benefit to the subsequent robust feature-learning process, particularly for difficult fault categories.
The two variants are not exactly parameter-matched. The Stage 1 wide-convolution configuration contains 7296 trainable parameters, whereas the point-wise projection contains 1152, resulting in 6144 additional parameters. Correspondingly, the complete models contain 143,407 and 137,263 trainable parameters, respectively. Therefore, the observed performance difference should not be attributed exclusively to the enlarged temporal receptive field. Paired comparisons across the five matched random seeds show mean Full-minus-Ablation differences of 1.89 percentage points for Accuracy (95% CI: −1.21 to 5.00, , Cohen’s ), 0.0194 for Macro-F1 (95% CI: −0.0155 to 0.0542, , ), and 6.01 percentage points for worst-class Accuracy (95% CI: −5.40 to 17.42, , ). After Holm correction across the three outcomes, the adjusted -value is 0.4980 for each comparison. Thus, although the full configuration exhibits moderate paired effect sizes and wins in four of five matched runs, the differences do not reach conventional statistical significance with only five paired repetitions. The Stage 1 ablation is therefore interpreted as evidence of a consistent performance trend rather than definitive statistical proof of superiority.
3.5. Robustness to Sensing Abnormalities
In addition to additive noise, practical AUV sensing systems may experience persistent sensor degradation or intermittent measurement loss. To evaluate robustness to such abnormalities, two additional test-stage experiments were conducted using a model trained only on the original clean training data: single-sensor gain degradation and random missing measurements. No degraded or incomplete test samples were used for model retraining or parameter adjustment. Therefore, these experiments evaluate the direct tolerance of a clean-trained model to previously unseen sensing abnormalities.
After removing the time variable, the model input contains 16 channels. Because PWM1–PWM4 are actuator/control commands rather than measurement variables, sensor degradation was evaluated only on the remaining twelve measurement channels. For each experiment, one measurement channel was degraded at a time while all remaining channels were kept unchanged. Degradation levels of 10%, 30%, and 50% were considered. The resulting data were normalized using the channel-wise minimum and maximum values calculated exclusively from the training set. For the sensing-abnormality experiments, the clean-trained checkpoint obtained using random seed 2024 was fixed for all degradation and missing-data evaluations. The quantitative results for single-sensor gain degradation at these three levels are summarized in
Table 11.
Mean ± SD represents variability across the 12 independently degraded measurement channels rather than variability across random model initializations. The results exhibit pronounced channel-dependent robustness. Although the mean Accuracy decreases with increasing degradation, the corresponding median remains substantially higher, reaching 91.84% even under 50% single-channel degradation. This difference indicates that the low mean values are driven mainly by a small number of highly informative channels rather than by uniform sensitivity across all sensors. In particular, pressure and voltage are the most sensitive channels: under 50% degradation, the associated Accuracies decrease to approximately 21.77% and 14.97%, respectively, whereas several attitude and angular-velocity channels retain approximately 95% Accuracy. Therefore, the proposed model should not be interpreted as universally robust to persistent failure of every sensor; its tolerance depends strongly on the affected measurement channel.
Random measurement loss was further introduced into the same 12 measurement channels at missing ratios of 10%, 20%, and 30%, whereas PWM1–PWM4 remained complete. For each missing ratio, ten independent missing-pattern realizations were generated. Missing values within each sensor channel were reconstructed using temporal linear interpolation; missing values at sequence boundaries were filled using the nearest valid observation. When an entire channel within one sample contained no valid observation, the corresponding training-set channel mean was used as a fallback. The reconstructed samples were subsequently normalized using the training-set Min-Max statistics. The diagnostic performance under random missing measurements with these three missing ratios is summarized in
Table 12.
Values are reported as mean ± SD across ten independently generated missing-pattern realizations. The model retains an Accuracy of 92.86 ± 0.92% when 10% of the measurements are randomly missing. As the missing ratio increases to 20% and 30%, the Accuracy decreases to 89.73 ± 1.13% and 85.24 ± 1.02%, respectively. The relatively small variation across the ten independently generated missing patterns indicates a stable degradation trend rather than sensitivity to one particular missing-data realization. Together with the single-sensor degradation results, these experiments reveal two different robustness characteristics: the model exhibits useful tolerance to spatially distributed random measurement loss after temporal reconstruction, whereas persistent degradation of a small number of highly informative sensors can cause substantially larger performance deterioration. Accordingly, sensor-health monitoring, redundant sensing, abnormal-channel detection, or dedicated measurement-reconstruction mechanisms remain necessary for safety-critical deployment.