Physics-Informed Monotonic Conformer for Remaining Useful Life Prediction of Hydraulic Systems
Abstract
1. Introduction
- 1.
- A hydraulic-specific conformer architecture is proposed. This design utilizes convolutional bias to help the standard transformer identify subtle, local fault signatures.
- 2.
- A physics-informed loss mechanism is introduced. This translates the principle of irreversible degradation into differentiable constraints, preventing the model from generating physically implausible predictions.
- 3.
- Extensive testing on hydraulic data demonstrates the effectiveness of the proposed method.
2. Related Work
2.1. Self-Attention Mechanism and Global Dependency Modeling
2.2. Principles of the Conformer Architecture
3. Proposed Method
3.1. Overall Framework
3.2. Hydraulic Conformer Design
- 1.
- Signal Embedding: Raw multivariable sensors are projected into a latent space and fused with learnable positional encodings to preserve temporal sequence order.
- 2.
- Macaron-Style Blocks: The core extraction utilizes three identical Conformer blocks. Each block employs a “macaron-like” residual connection scheme, sandwiching the multi-head self-attention (MHSA) and convolutional modules between two half-step Feed-Forward Networks (FFNs) for stable gradient flow.
- 3.
- Local-Global Fusion: Within each block, the MHSA module first captures global, long-range degradation dependencies. Subsequently, the custom Convolutional Module extracts high-frequency localized impulses. Notably, a Gated Linear Unit (GLU) is applied before the large-kernel depthwise convolution, acting as an adaptive fusion gate to filter irrelevant noise.
- 4.
- HI Generation: The temporal features are compressed via global average pooling and mapped into a continuous HI bounded between [0, 1] through a Sigmoid-activated regressor.
3.2.1. Signal Embedding and Positional Encoding
3.2.2. Enhanced Convolution Module
3.2.3. Global Pooling and Regression Head
3.3. Physics-Informed Loss Function
3.3.1. Data Fidelity Term
3.3.2. Physics-Consistency Term
3.3.3. Total Objective Function
4. Experimental Verification
4.1. Dataset Description and Preprocessing
4.1.1. EHA Test Bench
4.1.2. Data Acquisition and Labeling Strategy
4.2. Experimental Setup
4.2.1. Baseline Models
4.2.2. Evaluation Metrics
4.2.3. Implementation Details
4.3. Analysis of Main Comparative Results
4.3.1. Visual Analysis of Experimental Results
4.3.2. Numerical Accuracy Analysis
4.3.3. Physical Consistency Analysis
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Jiao, Z.; Li, Z.; Shang, Y.; Wu, S.; Song, Z.; Pan, Q. Active load sensitive electro-hydrostatic actuator on more electric aircraft: Concept, design, and control. IEEE Trans. Ind. Electron. 2021, 69, 5030–5040. [Google Scholar] [CrossRef]
- Lin, T.; Wang, Q.; Hu, B.; Gong, W. Development of hybrid powered hydraulic construction machinery. Autom. Constr. 2010, 19, 11–19. [Google Scholar] [CrossRef]
- Brecher, C.; Jasper, D.; Fey, M. Analysis of new, energy-efficient hydraulic unit for machine tools. Int. J. Precis. Eng. Manuf.-Green Technol. 2017, 4, 5–11. [Google Scholar] [CrossRef]
- Hong, R.; Nie, S.; Ji, H.; Ma, Z. Physics-informed machine learning for high-speed on/off valve performance degradation prediction in water hydraulic manipulator. Reliab. Eng. Syst. Saf. 2025, 261, 111106. [Google Scholar] [CrossRef]
- Zhang, G.; Zhang, K.; Shen, W.; Xu, G.; Lin, Y.J. Intelligent fault diagnosis of multi-way directional valves in hydraulic systems using digital twin and deep learning approaches. Mech. Syst. Signal Process. 2025, 230, 112579. [Google Scholar] [CrossRef]
- Xiao, Y.; Shao, H.; Liu, B. Evaluating calibration of deep fault diagnostic models under distribution shift. Comput. Ind. 2025, 171, 104334. [Google Scholar] [CrossRef]
- Peng, Y.; Shao, H.; Xiao, Y.; Wang, J.; Liu, B. Dual-stage interpretable domain generalization fault diagnosis: Integrating prior knowledge and gradient-weighted class activation mapping. Eng. Appl. Artif. Intell. 2026, 166, 113655. [Google Scholar] [CrossRef]
- Shao, H.; Ming, Y.; Liu, Y.; Liu, B. Small sample gearbox fault diagnosis based on improved deep forest in noisy environments. Nondestruct. Test. Eval. 2025, 40, 3935–3956. [Google Scholar] [CrossRef]
- Tian, A.; Yu, H.; Hu, Z.; Wang, Y.; Wu, T.; Jiang, J. A novel remaining useful life prediction method based on CNN-Attention combined with SMA-GPR. Energy 2025, 321, 135233. [Google Scholar] [CrossRef]
- Guo, S.; Wei, Z.; Yin, Y.; Zhai, X. A physics-guided RNN-KAN for multi-step prediction of heat pump operation states. Energy 2025, 320, 135108. [Google Scholar] [CrossRef]
- Sun, F.; Li, L.; Bian, D.; Bian, W.; Wang, Q.; Wang, S. Photovoltaic power prediction based on multi-scale photovoltaic power fluctuation characteristics and multi-channel LSTM prediction models. Renew. Energy 2025, 246, 122866. [Google Scholar] [CrossRef]
- Kumar, R.; Anand, R. A deep learning-based CNN-GRU prediction model for early fault diagnosis in rolling ball bearings. Neural Comput. Appl. 2025, 37, 17015–17030. [Google Scholar] [CrossRef]
- Couto, S.; Gonçalves, D.P.; Santos, M.; Neves, S.F.; Silva, M.C. Computational fluid dynamics-derived correlations for power transformer thermal–hydraulic performance prediction. Electr. Power Syst. Res. 2026, 255, 112832. [Google Scholar]
- Kim, A.R.; Kim, H.S.; Kim, S.Y. Transformer-based fault detection using pressure signals for hydraulic pumps. IEEE Access 2024, 12, 145795–145808. [Google Scholar] [CrossRef]
- Yu, Q.; Sun, C.; Yang, Y.; Yang, P. Hydraulic support pressure prediction via deep learning with multilevel temporal feature integration. Sci. Rep. 2025, 15, 45680. [Google Scholar] [CrossRef]
- Wang, Z.; Yang, S.; Mi, J.; Zhao, X. MSRAN-ATE: A Novel Hydraulic Fault Diagnosis Method Fusing Multi-Scale Attention and Adaptive Transformer. IEEE Access 2026, 14, 14410–14423. [Google Scholar] [CrossRef]
- Gao, J.; Wang, S.; Chen, R.; Zhang, C.; Zio, E.; Zhang, Y.; Lu, Y. ZSTT: A Zero-Shot Time-Series Prediction Model Based on Transformer and Its Application to Hydraulic Actuator Performance Degradation Prediction. IEEE/ASME Trans. Mechatron. 2025; early access.
- Wang, Y.; Li, M.; Zheng, L.; Shi, M.; Zheng, Z.; Pei, X. Phyformer: A degradation physics-informed self-data driven approach to machinery prognostics. Adv. Eng. Inform. 2024, 62, 102772. [Google Scholar]
- Chen, X.; Ma, M.; Zhao, Z.; Zhai, Z.; Mao, Z. Physics-informed deep neural network for bearing prognosis with multisensory signals. J. Dyn. Monit. Diagn. 2022, 1, 200–207. [Google Scholar] [CrossRef]
- Nagaraj, S.; Hickok, T. Physics Informed Machine Learning (PIML) methods for estimating the remaining useful lifetime (RUL) of aircraft engines. In Proceedings of the 2024 AIAA DATC/IEEE 43rd Digital Avionics Systems Conference (DASC); IEEE: Piscataway, NJ, USA, 2024; pp. 1–7. [Google Scholar]
- Wang, F.; Liu, W.; Sun, M.; Zhai, Z.; Zhao, Z.; Chen, X. Merging physics and neural network: A promising tool for prognostics and health management. Eng. Appl. Artif. Intell. 2026, 165, 113385. [Google Scholar] [CrossRef]
- Dhibi, K.; Nounou, H.; El-Mellouhi, F.; Nounou, M. Physics-Informed Deep Learning for Bearing Remaining Useful Life: Adaptive Paris-Law Regularization with Gaussian Processes. Integr. Mater. Manuf. Innov. 2026, 15, 148–168. [Google Scholar]
- Cruz, Y.J.; Castano, F.; Villalonga, A.; Mishra, M.; Haber, R.E. A Data-Driven Approach for Predicting Remaining Useful Life of Semiconductor Devices Based on Machine Learning and Synthetic Data Generation: A Review and Case Study on SiC MOSFETs. IEEE Access 2025, 13, 138834–138850. [Google Scholar] [CrossRef]
- Shang, D.; Yuan, R.; Lv, Y.; Wu, H.; Liu, H.; Chen, Z. Iteratively modified variational mode extraction (IMVME): A noise-robust transient feature nonlinear extraction approach for aero-engine fault diagnosis. Adv. Eng. Inform. 2026, 71, 104284. [Google Scholar] [CrossRef]
- Yuan, R.; Liu, H.; Lv, Y.; Chen, Y.; Yang, X.; Li, H.; Chelidze, D. Ball tree structure-informed phase space warping: A robust algorithm for dynamic degradation tracking under variable speed conditions. Adv. Eng. Inform. 2026, 71, 104288. [Google Scholar] [CrossRef]
- Gulati, A.; Qin, J.; Chiu, C.C.; Parmar, N.; Zhang, Y.; Yu, J.; Han, W.; Wang, S.; Zhang, Z.; Wu, Y.; et al. Conformer: Convolution-augmented transformer for speech recognition. arXiv 2020, arXiv:2005.08100. [Google Scholar] [CrossRef]






| Module/Layer | Key Components & Operations | Input Dim. | Output Dim. |
|---|---|---|---|
| Input | Raw multisource hydraulic signals | - | |
| 1. Embedding | Linear Projection + Positional Encoding | ||
| 2. Conformer Block | 2.1 Half-Step FFN 1 (+Residual) | ||
| (Repeated ) | 2.2 Multi-Head Attention: 4 heads (+Residual) | ||
| 2.3 Conv Module: GLU Gating → Depthwise Conv1d (k = 31) → Pointwise Conv (+Residual) | |||
| 2.4 Half-Step FFN 2 (+Residual) | |||
| 3. Aggregation | Global Adaptive Average Pooling | ||
| 4. Regressor | MLP (Swish) + Sigmoid Activation |
| Name | Specification |
|---|---|
| EPU | Moog SEPU019ADN1H0C |
| Pressure sensor | MEAS-US175-C00002-200BG |
| A/D Converter card | Advantech PCI-1716 |
| Grating ruler | Heidenhain LC485 |
| D/A Converter card | Advantech PCI-1723 |
| Counter card | Heidenhain IK-220 |
| Industrial computer | Advantech IPC-610 |
| Parameter | Value |
|---|---|
| Safety Valve Set Pressure | 16 MPa |
| Hydraulic Pump Displacement | 0.019 mL/rev |
| Rated Rotational Speed | 3000 rev/min |
| Hydraulic Cylinder Stroke | 0.1 m |
| Effective Piston Area | 1.527 × 10−3 m2 |
| Initial Volume of Both Chambers (at mid-position) | 7.635 × 10−5 m3 |
| Accumulator Pressure | 0.6 MPa |
| Compression Spring Stiffness | 245,000 N/m |
| Oil Elastic Modulus | 700 MPa |
| Load Mass | 13.5 kg |
| Health Indicators | Leakage Rate (L/min/bar) | Description |
|---|---|---|
| 1 | 0.00 | Baseline Health |
| 0.975 | 0.02 | Incipient Fault |
| 0.935 | 0.05 | ↓ |
| 0.875 | 0.10 | ↓ |
| 0.8125 | 0.15 | ↓ |
| 0.75 | 0.20 | Progressive Degradation |
| 0.625 | 0.30 | ↓ |
| 0.5 | 0.40 | ↓ |
| 0.375 | 0.50 | ↓ |
| 0.25 | 0.60 | Severe Fault |
| 0.125 | 0.70 | ↓ |
| 0 | 0.80 | Near Failure |
| Architecture | Loss | Params (k) | FLOPs (M) | RMSE | MAE | R2 | CRA | |
|---|---|---|---|---|---|---|---|---|
| Bi-LSTM | MSE | 313.5 | 608.3 | 0.0553 | 0.0463 | 0.9723 | 0.9229 | 0.9705 |
| mono | 313.5 | 608.3 | 0.0411 | 0.0349 | 0.9848 | 0.9419 | 0.9821 | |
| CNN | MSE | 377.6 | 620.7 | 0.0676 | 0.0559 | 0.9588 | 0.9068 | 0.9846 |
| mono | 377.6 | 620.7 | 0.0644 | 0.0466 | 0.9625 | 0.9224 | 0.9886 | |
| Transformer | MSE | 398.6 | 529.5 | 0.0398 | 0.0312 | 0.9857 | 0.9481 | 0.9774 |
| mono | 398.6 | 529.5 | 0.0369 | 0.0295 | 0.9877 | 0.9509 | 0.9856 | |
| Proposed | MSE | 308.7 | 385.9 | 0.0269 | 0.0212 | 0.9934 | 0.9647 | 0.9900 |
| mono | 308.7 | 385.9 | 0.0265 | 0.0211 | 0.9937 | 0.9648 | 0.9941 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
He, X.; Zhang, C.; Wang, J.; Zhao, X.; Yao, J.; Lu, C.; Yang, X. Physics-Informed Monotonic Conformer for Remaining Useful Life Prediction of Hydraulic Systems. Sensors 2026, 26, 2178. https://doi.org/10.3390/s26072178
He X, Zhang C, Wang J, Zhao X, Yao J, Lu C, Yang X. Physics-Informed Monotonic Conformer for Remaining Useful Life Prediction of Hydraulic Systems. Sensors. 2026; 26(7):2178. https://doi.org/10.3390/s26072178
Chicago/Turabian StyleHe, Xiansong, Chen Zhang, Jinyuan Wang, Xiaoli Zhao, Jianyong Yao, Chuanjie Lu, and Xiaowei Yang. 2026. "Physics-Informed Monotonic Conformer for Remaining Useful Life Prediction of Hydraulic Systems" Sensors 26, no. 7: 2178. https://doi.org/10.3390/s26072178
APA StyleHe, X., Zhang, C., Wang, J., Zhao, X., Yao, J., Lu, C., & Yang, X. (2026). Physics-Informed Monotonic Conformer for Remaining Useful Life Prediction of Hydraulic Systems. Sensors, 26(7), 2178. https://doi.org/10.3390/s26072178

