4.2. Evaluation Metrics
In order to evaluate model performance comprehensively, this paper uses the root mean square error (RMSE), prediction stability index (uncertainty), and temporal order reliability index (reliability) as evaluation metrics. Among them, a smaller RMSE indicates lower prediction error; smaller uncertainty means that the model has better prediction consistency under different time perturbation views; larger reliability indicates that the model can maintain the correct temporal evolution order.
The RMSE (root mean square error) is adopted as the primary metric for evaluating prediction accuracy. It measures the overall deviation between the predicted RUL values and the corresponding ground truth labels. Since the RMSE penalizes large prediction errors more heavily than absolute-error-based metrics, it provides an effective assessment of the overall regression performance and has become one of the standard evaluation criteria for RUL prediction tasks. A lower RMSE indicates higher prediction accuracy.
To evaluate the confidence of model predictions under multi-view temporal perturbations, the proposed framework further introduces the uncertainty metric. Specifically, multiple prediction results are obtained from different temporal views of the same sample, and predictive uncertainty is quantified according to the dispersion of these predictions. Lower uncertainty indicates that the model produces more consistent predictions under different temporal observations, reflecting stronger robustness against temporal perturbations and noisy degradation signals. We consider supervising the value within the window before and after the current observation. Therefore, the statistical results are divided into the observation
, the result before the observation
, and the result after the observation
, all of which are model predictions. The uncertainty metric measures the dispersion among predictions generated from different temporal views:
where
represents the minimum value for preventing overflow. Besides predictive uncertainty, reliability is employed to evaluate the consistency between the model confidence and its prediction accuracy. Reliability measures whether prediction confidence is well calibrated with the actual prediction errors. A model with higher reliability not only achieves accurate predictions but also produces confidence estimates that better reflect its true predictive performance. Therefore, higher reliability indicates that the proposed method provides more trustworthy and stable RUL predictions for practical predictive maintenance applications. We use the ordering consistency to characterize this indicator. When the preceding result, the observed value, and the subsequent result are in descending order, this indicates that the current prediction conforms to the RUL output. This can be described as follows:
To ensure a fair comparison, all baseline models were implemented or reproduced under the same experimental settings as the proposed method, including identical dataset partitioning, preprocessing procedures, input features, and evaluation metrics. The reported results of baseline models were obtained from our independent implementations rather than directly copied from previous studies. Each experiment was conducted five times with different random seeds, and the final performance is reported as the mean value with standard deviation. For data preprocessing, all sensor measurements were normalized using z-score normalization based on the statistics calculated from the training set. A sliding window strategy was adopted to generate training samples, with the input sequence length fixed to 40. The proposed model was optimized using the Adam optimizer with an initial learning rate of 0.001. The batch size was set to 2048, and the model was trained for 150 epochs. All experiments were implemented using the PyTorch 2.1 and conducted on an RTX 3090 GPU. Unless otherwise stated, all experiments were performed with fixed random seeds to ensure reproducibility.
4.3. Results of Framework Ablation Experiments
To verify the effectiveness of the proposed method, comparative experiments were conducted on the FD001, FD002, FD003 and FD004 subsets of the NASA C-MAPSS dataset using several representative deep learning models, including a CNN, bi-RNN, Attention–LSTM, 1D-CNN-LSTM, BiLSTM Attention, Deep Quantile Regression, and CNN-BGRU-SA. Three evaluation metrics, namely RMSE, uncertainty, and reliability, were adopted to comprehensively evaluate prediction accuracy, predictive uncertainty, and prediction reliability. For baseline methods, the results were categorized into two groups. Some results were directly obtained from the corresponding publications, while others were reproduced using publicly available implementations or reimplemented according to the descriptions in the original papers. For reproduced methods, the same preprocessing pipeline and evaluation protocol were adopted to ensure fairness. All comparison models were trained and evaluated using identical data partitioning and evaluation protocols to ensure a fair comparison.
As shown in
Table 1,
Table 2,
Table 3 and
Table 4, the proposed method consistently achieves competitive or superior performance on all four datasets. Compared with conventional CNN and RNN-based methods, our approach demonstrates clear advantages in terms of prediction accuracy, prediction stability, and prediction reliability across degradation scenarios with different levels of complexity. Although advanced models such as Deep Quantile Regression and CNN-BGRU-SA improve certain aspects of prediction performance through uncertainty estimation or enhanced feature extraction, they do not explicitly exploit the temporal structural relationships among different observation windows. The higher the indicator with up arrow in the header of all tables, the better. The lower the indicator with down arrow, the better.
Regarding prediction accuracy, CNN-based methods mainly rely on local convolution operations to extract degradation features and therefore have limited capability in modeling long-range temporal dependencies. Recurrent models, including bi-RNN, Attention–LSTM, and BiLSTM Attention, improve temporal dependency modeling by incorporating recurrent structures and attention mechanisms, leading to noticeable improvements over conventional CNN models. Deep Quantile Regression further enhances prediction accuracy by modeling predictive distributions, while CNN-BGRU-SA combines convolutional feature extraction, gated recurrent units, and self-attention mechanisms to learn richer degradation representations. Nevertheless, these methods still optimize each observation independently and do not explicitly model the structural relationships among temporally adjacent views.
In contrast, the proposed method introduces a multi-view temporal perturbation learning framework built upon a dual-branch Transformer–GRN backbone. By jointly optimizing regression loss, multi-view consistency learning, and temporal ordering constraints, the proposed framework learns not only accurate degradation representations but also the structural relationships among different temporal observations. Consequently, the proposed method achieves the best overall performance across datasets with different degradation complexities. Specifically, when roll_k = 3, the proposed method obtains the lowest RMSE values of 13.44, 15.41, 13.80, and 16.63 on FD001, FD002, FD003, and FD004, respectively, demonstrating its strong capability in modeling degradation processes under both single/multiple operating conditions and single/multiple fault modes.
Besides prediction accuracy, predictive uncertainty is further evaluated through the uncertainty metric. As shown in
Table 1,
Table 2,
Table 3 and
Table 4, the proposed method consistently achieves lower uncertainty compared with most competing approaches. On FD001, the uncertainty decreases from 5.10 under roll_k = 1 to 4.15 under roll_k = 3. Similarly, on FD002, FD003, and FD004, uncertainty reaches 4.98, 3.76, and 5.18, respectively, when roll_k = 3. These results indicate that the proposed multi-view temporal perturbation strategy effectively reduces prediction dispersion caused by different temporal observations. By learning degradation-invariant representations across diverse temporal views, the model maintains stable prediction performance under different operating conditions and fault modes.
Reliability is further employed to evaluate the consistency between prediction confidence and actual prediction performance. The proposed method achieves the highest reliability values on the four datasets when roll_k = 3, reaching 0.85, 0.81, 0.81, and 0.79 on FD001, FD002, FD003, and FD004, respectively. Compared with Deep Quantile Regression, which explicitly models predictive uncertainty, the proposed framework achieves better reliability while maintaining competitive uncertainty estimation. These results demonstrate that the proposed multi-view learning strategy not only improves prediction accuracy but also provides better-calibrated confidence estimation for practical predictive maintenance applications.
The influence of different temporal perturbation magnitudes was investigated by varying the roll_k parameter. The experimental results show that increasing the perturbation range generally improves overall model performance. On FD001, FD002, FD003, and FD004, roll_k = 3 achieves the best comprehensive performance among different perturbation settings. Larger temporal perturbations expose the model to more diverse degradation observations, allowing it to capture invariant degradation characteristics across temporal views while reducing prediction variance. This advantage becomes more significant on FD002 and FD004, where multiple operating conditions introduce additional variations into degradation trajectories. The results demonstrate that the proposed temporal perturbation strategy is effective not only for relatively simple degradation scenarios but also for more challenging environments involving complex operating conditions and multiple fault modes.
We present the prediction results of the two FD001 machines in the form of a line graph, as shown in
Figure 2. It can be seen that the prediction results are basically close to the actual results. The experimental results demonstrate that the proposed multi-view temporal structure-aware learning framework effectively integrates multi-view temporal perturbation, consistency learning, and temporal ordering constraints into a unified optimization framework. By jointly improving prediction accuracy, reducing predictive uncertainty, and enhancing prediction reliability, the proposed method achieves robust and trustworthy Remaining Useful Life (RUL) prediction across the four C-MAPSS benchmark datasets with different levels of degradation complexity.
4.6. Hyperparameter Sensitivity Analysis
To investigate the influence of key hyperparameters on the performance of the proposed framework, extensive sensitivity analyses were conducted on the FD001 dataset. The investigated parameters include the temporal perturbation magnitude k, the consistency loss weight λ1, the temporal ordering loss weight λ2, and the margin parameter m. The FD001 dataset was selected as the evaluation benchmark because it represents a relatively simple degradation scenario, allowing for the clearer observation of the effects caused by individual parameter variations.
It should be noted that all hyperparameters were determined according to their performance on the validation set rather than the test set. The test set was only used for the final evaluation after completing model selection. During sensitivity analysis, one parameter was varied while keeping other parameters fixed to their default values.
As shown in
Table 7, increasing k from 1 to 3 gradually improves the overall performance, indicating that moderate temporal perturbations provide more effective multi-view degradation information. However, excessively large perturbations (k = 4 or 5) slightly degrade performance because overly shifted temporal observations may introduce irrelevant variations. Therefore, k = 3 was selected as the optimal perturbation magnitude.
Table 8 indicates that a moderate consistency constraint improves prediction stability and reliability. When λ1 is too small, the model cannot fully exploit multi-view consistency information. Conversely, an excessively large λ1 causes over-regularization and weakens regression optimization. Therefore, λ1 = 0.1 provides the best balance.
Similar observations can be found for λ2. We select an appropriate value for λ2 based on the ratio of λ1 to λ2. As shown in
Table 9, increasing the ordering loss weight improves the reliability metric by enhancing degradation monotonicity. However, an excessively large value introduces strong ranking constraints and limits the flexibility of regression learning. The optimal value is obtained at λ2 = 0.2 (λ1 = 0.1 and λ1/λ2 = 0.5).
The margin parameter affects the strength of temporal ordering constraints. A small margin may provide insufficient degradation ordering supervision, while a very large margin makes the constraint excessively strict. As shown in
Table 10, the model achieves the best performance when m = 0.5, which provides an appropriate balance between degradation ordering and regression accuracy.