Liquid-Augmented MPC in Quadrupedal Robot for Disturbance Learning
Abstract
1. Introduction
- The formulation of a novel hybrid control framework, Liquid-Augmented Model Predictive Control (LA-MPC), which integrates a continuous-time Liquid Time-Constant (LTC) network for disturbance learning with a first-principles, geometric MPC on the manifold.
- A proactive disturbance compensation strategy wherein the LTC’s predicted disturbance wrench is directly embedded within the dynamic constraints of the optimal control problem. This mechanism transforms the controller from a reactive system, which corrects for state error, to an anticipatory one that proactively counteracts unmodeled dynamics.
- The systematic optimization of the LTC disturbance model using a multi-stage Neural Architecture Search (NAS), and the demonstration of the complete LA-MPC framework’s real-time viability, achieved on the MuJoCo platform [22] during diverse, dynamic locomotion tasks.
- This paper is organized as follows: Section 2 reviews the related literature on quadrupedal locomotion, MPC, and learning augmented strategies. Section 3 details the proposed methodology. It begins by formulating the single rigid body dynamic template and the geometric nonlinear model predictive controller. This section then introduces the Liquid Time Constant neural network for disturbance modeling and describes its formal integration into the unified Liquid Augmented MPC framework. Section 4 presents the result validation, detailing the simulation setup and providing empirical evidence to confirm the framework’s robustness, tracking performance, and real-time viability. This paper concludes with a discussion of the findings and an outlook on future work, such as adaptive contact modeling. Section 5 shows the conclusion of this work and our future plan.
2. Related Work
3. Methodology
3.1. Dynamics of Single Body
3.2. Nonlinear MPC
3.3. Liquid Neural Network
3.4. Liquid-Augmented Model Predictive Control (LA-MPC)
| Algorithm 1: Liquid–Augmented Model Predictive Control |
| Require: Current state , history buffer of recent , references , contact schedule , horizon N, step size h, weights , , , physical parameters |
| Models |
| Continuous rigid–body template |
| Geometric discretization with |
| Disturbance wrench , mapping |
| Liquid Time–Constant module : with wrench readout |
| ⠀ |
|
4. Result Validation
4.1. Simulation Setup
4.2. Results Analysis
5. Conclusions
6. Discussion
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Rezazadeh, S.; Abate, A.; Hatton, R.L.; Hurst, J.W. Robot leg design: A constructive framework. IEEE Access 2018, 6, 54369–54387. [Google Scholar] [CrossRef]
- Wang, S.; Chen, Z.; Li, J.; Wang, J.; Li, J.; Zhao, J. Flexible motion framework of the six wheel-legged robot: Experimental results. IEEE/ASME Trans. Mech. 2021, 27, 2246–2257. [Google Scholar] [CrossRef]
- Bjelonic, M.; Klemm, V.; Lee, J.; Hutter, M. A survey of wheeled-legged robots. In Proceedings of the Climbing and Walking Robots Conference, Ponta Delgada, Portugal, 12–14 September 2022; Springer: London, UK, 2022; pp. 83–94. [Google Scholar]
- Li, Q.; Cicirelli, F.; Vinci, A.; Guerrieri, A.; Qi, W.; Fortino, G. Quadruped Robots: Bridging Mechanical Design, Control, and Applications. Robotics 2025, 14, 57. [Google Scholar] [CrossRef]
- Minniti, M.V.; Grandia, R.; Farshidian, F.; Hutter, M. Adaptive CLF-MPC with application to quadrupedal robots. IEEE Robot. Autom. Lett. 2021, 7, 565–572. [Google Scholar] [CrossRef]
- Kim, K.; Spieler, P.; Lupu, E.S.; Ramezani, A.; Chung, S.J. A bipedal walking robot that can fly, slackline, and skateboard. Sci. Robot. 2021, 6, eabf8136. [Google Scholar] [CrossRef] [PubMed]
- Arroyo, J.; Manna, C.; Spiessens, F.; Helsen, L. Reinforced model predictive control (RL-MPC) for building energy management. Appl. Energy 2022, 309, 118346. [Google Scholar] [CrossRef]
- Pandala, A.; Fawcett, R.T.; Rosolia, U.; Ames, A.D.; Hamed, K.A. Robust predictive control for quadrupedal locomotion: Learning to close the gap between reduced-and full-order models. IEEE Robot. Autom. Lett. 2022, 7, 6622–6629. [Google Scholar] [CrossRef]
- Lucia, D.J.; Beran, P.S.; Silva, W.A. Reduced-order modeling: New approaches for computational physics. Prog. Aerosp. Sci. 2004, 40, 51–117. [Google Scholar] [CrossRef]
- Huang, S.J.; Huang, C.L. Control of an inverted pendulum using grey prediction model. IEEE Trans. Ind. Appl. 2000, 36, 452–458. [Google Scholar] [CrossRef]
- Kajita, S.; Morisawa, M.; Miura, K.; Nakaoka, S.; Harada, K.; Kaneko, K.; Kanehiro, F.; Yokoi, K. Biped walking stabilization based on linear inverted pendulum tracking. In Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 18–22 October 2010; pp. 4489–4496. [Google Scholar]
- Li, L.; Xie, Z.; Luo, X.; Li, J. Trajectory planning of flexible walking for biped robots using linear inverted pendulum model and linear pendulum model. Sensors 2021, 21, 1082. [Google Scholar] [CrossRef]
- Khan, A.; Zhang, C.; Atanasov, N.; Karydis, K.; Kumar, V.; Lee, D.D. Memory augmented control networks. arXiv 2017, arXiv:1709.05706. [Google Scholar]
- Laskin, M.; Lee, K.; Stooke, A.; Pinto, L.; Abbeel, P.; Srinivas, A. Reinforcement learning with augmented data. Adv. Neural Inf. Process. Syst. 2020, 33, 19884–19895. [Google Scholar]
- Yarats, D.; Fergus, R.; Lazaric, A.; Pinto, L. Mastering visual continuous control: Improved data-augmented reinforcement learning. arXiv 2021, arXiv:2107.09645. [Google Scholar] [CrossRef]
- Biswal, P.; Mohanty, P.K. Development of quadruped walking robots: A review. Ain Shams Eng. J. 2021, 12, 2017–2031. [Google Scholar] [CrossRef]
- Li, Y.; Lyu, Q.; Yang, J.; Salam, Y.; Wang, W. A Hybrid Framework Using Diffusion Policy and Residual RL for Force-Sensitive Robotic Manipulation. IEEE Robot. Autom. Lett. 2025, 10, 10266–10273. [Google Scholar] [CrossRef]
- Hosseinpoor, S.; Torresen, J.; Mantelli, M.; Pitto, D.; Kolberg, M.; Maffei, R.; Prestes, E. Traversability analysis by semantic terrain segmentation for mobile robots. In Proceedings of the 2021 IEEE 17th International Conference on Automation Science and Engineering (CASE), Lyon, France, 23–27 August 2021; pp. 1407–1413. [Google Scholar]
- Gangapurwala, S.; Campanaro, L.; Havoutis, I. Learning low-frequency motion control for robust and dynamic robot locomotion. arXiv 2022, arXiv:2209.14887. [Google Scholar]
- Kuck, E.; Sands, T. Space robot sensor noise amelioration using trajectory shaping. Sensors 2024, 24, 666. [Google Scholar] [CrossRef] [PubMed]
- Voight, J. Quaternion Algebras; Springer Nature: London, UK, 2021. [Google Scholar]
- Todorov, E.; Erez, T.; Tassa, Y. Mujoco: A physics engine for model-based control. In Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura-Algarve, Portugal, 7–12 October 2012; pp. 5026–5033. [Google Scholar]
- Xin, G.; Wolfslag, W.; Lin, H.C.; Tiseo, C.; Mistry, M. An optimization-based locomotion controller for quadruped robots leveraging cartesian impedance control. Front. Robot. AI 2020, 7, 48. [Google Scholar] [CrossRef]
- Aldair, A.A.; Al-Mayyahi, A.; Wang, W. Design of a stable an intelligent controller for a quadruped robot. J. Electr. Eng. Technol. 2020, 15, 817–832. [Google Scholar] [CrossRef]
- Mason, M.T. Compliance and force control for computer controlled manipulators. IEEE Trans. Syst. Man, Cybern. 2007, 11, 418–432. [Google Scholar] [CrossRef]
- Schumacher, C.; Sharbafi, M.; Seyfarth, A.; Rode, C. Biarticular muscles in light of template models, experiments and robotics: A review. J. R. Soc. Interface 2020, 17, 20180413. [Google Scholar] [CrossRef]
- Shen, J.; Hong, D. Convex model predictive control of single rigid body model on so (3) for versatile dynamic legged motions. In Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA, 23–27 May 2022; pp. 6586–6592. [Google Scholar]
- Kamidi, V.R.; Kim, J.; Fawcett, R.T.; Ames, A.D.; Hamed, K.A. Distributed quadratic programming-based nonlinear controllers for periodic gaits on legged robots. IEEE Control Syst. Lett. 2022, 6, 2509–2514. [Google Scholar] [CrossRef]
- Reher, J.; Ames, A.D. Dynamic walking: Toward agile and efficient bipedal robots. Annu. Rev. Control. Robot. Auton. Syst. 2021, 4, 535–572. [Google Scholar] [CrossRef]
- Dallas, J.; Cole, M.P.; Jayakumar, P.; Ersal, T. Terrain adaptive trajectory planning and tracking on deformable terrains. IEEE Trans. Veh. Technol. 2021, 70, 11255–11268. [Google Scholar] [CrossRef]
- Junkins, J.L.; Turner, J.D. Optimal Spacecraft Rotational Maneuvers; Elsevier: Amsterdam, The Netherlands, 2012; Volume 3. [Google Scholar]
- Raghuraman, V.; Koeln, J.P. Tube-based robust MPC with adjustable uncertainty sets using zonotopes. In Proceedings of the 2021 American Control Conference (ACC), New Orleans, LA, USA, 26–28 May 2021; pp. 462–469. [Google Scholar]
- Chen, Y.; Nguyen, Q. Learning agile locomotion and adaptive behaviors via rl-augmented mpc. In Proceedings of the 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan, 13–17 May 2024; pp. 11436–11442. [Google Scholar]
- Chahine, M.; Hasani, R.; Kao, P.; Ray, A.; Shubert, R.; Lechner, M.; Amini, A.; Rus, D. Robust flight navigation out of distribution with liquid neural networks. Sci. Robot. 2023, 8, eadc8892. [Google Scholar] [CrossRef] [PubMed]
- Kirillov, A.A. An Introduction to Lie Groups and Lie Algebras; Cambridge University Press: Cambridge, UK, 2008; Volume 113. [Google Scholar]
- Stellato, B.; Banjac, G.; Goulart, P.; Bemporad, A.; Boyd, S. OSQP: An operator splitting solver for quadratic programs. Math. Program. Comput. 2020, 12, 637–672. [Google Scholar] [CrossRef]
- Chaslot, G.M.J.; Winands, M.H.; Herik, H.J.V.D.; Uiterwijk, J.W.; Bouzy, B. Progressive strategies for Monte-Carlo tree search. New Math. Nat. Comput. 2008, 4, 343–357. [Google Scholar] [CrossRef]
- Liu, H.; Simonyan, K.; Yang, Y. Darts: Differentiable architecture search. arXiv 2018, arXiv:1806.09055. [Google Scholar]
- Zoph, B.; Le, Q.V. Neural architecture search with reinforcement learning. arXiv 2016, arXiv:1611.01578. [Google Scholar]







| Task | Metrics | SAC | TD3 | GAIL | AMP | DDPG | LA-MPC |
|---|---|---|---|---|---|---|---|
| Walking | Success Rate(%) | 87 | 82 | 74 | 78 | 85 | 94 |
| Tracking error () | 0.20 | 0.18 | 0.15 | 0.14 | 0.22 | 0.09 | |
| MSE () | 0.041 | 0.033 | 0.023 | 0.020 | 0.049 | 0.008 | |
| FPE () | 0.35 | 0.31 | 0.26 | 0.22 | 0.38 | 0.12 | |
| Bipedal walking | Success Rate(%) | 82 | 76 | 71 | 75 | 80 | 91 |
| Tracking error () | 0.24 | 0.21 | 0.18 | 0.16 | 0.27 | 0.11 | |
| MSE () | 0.058 | 0.045 | 0.033 | 0.026 | 0.074 | 0.012 | |
| FPE () | 0.42 | 0.36 | 0.30 | 0.27 | 0.48 | 0.15 | |
| Pronking | Success Rate(%) | 85 | 79 | 77 | 83 | 82 | 90 |
| Tracking error () | 0.28 | 0.22 | 0.19 | 0.17 | 0.30 | 0.12 | |
| MSE () | 0.079 | 0.049 | 0.037 | 0.029 | 0.091 | 0.015 | |
| FPE () | 0.49 | 0.38 | 0.32 | 0.28 | 0.55 | 0.18 | |
| Flipping | Success Rate(%) | 88 | 83 | 72 | 79 | 86 | 95 |
| Tracking error () | 0.40 | 0.32 | 0.28 | 0.25 | 0.45 | 0.18 | |
| MSE () | 0.162 | 0.104 | 0.079 | 0.063 | 0.205 | 0.033 | |
| FPE () | 0.65 | 0.52 | 0.45 | 0.39 | 0.72 | 0.21 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Mao, Y.; Zhang, Y.; Gao, L. Liquid-Augmented MPC in Quadrupedal Robot for Disturbance Learning. Electronics 2025, 14, 4843. https://doi.org/10.3390/electronics14244843
Mao Y, Zhang Y, Gao L. Liquid-Augmented MPC in Quadrupedal Robot for Disturbance Learning. Electronics. 2025; 14(24):4843. https://doi.org/10.3390/electronics14244843
Chicago/Turabian StyleMao, Yuhui, Yaxing Zhang, and Longsen Gao. 2025. "Liquid-Augmented MPC in Quadrupedal Robot for Disturbance Learning" Electronics 14, no. 24: 4843. https://doi.org/10.3390/electronics14244843
APA StyleMao, Y., Zhang, Y., & Gao, L. (2025). Liquid-Augmented MPC in Quadrupedal Robot for Disturbance Learning. Electronics, 14(24), 4843. https://doi.org/10.3390/electronics14244843

