Safe Autonomous UAV Target-Tracking Under External Disturbance, Through Learned Control Barrier Functions
Abstract
1. Introduction and Related Works
- We introduce an offline, neural network-powered approach tailored for UAVs, to learn Control Barrier Function (CBF) constraints. This empowers the system to adeptly manage unmodeled dynamics and external disturbances prevalent in UAV flight.
- The proposed CBF is combined with a Sliding Mode Controller (SMC) to achieve robustness against model uncertainties. This ensures safe and reliable tracking even when the UAV’s behavior deviates from its nominal model.
- We thoroughly evaluate the effectiveness of our proposed technique through an AirSim platform enabled with the PX4 controller. The results demonstrate its ability to maintain safe target tracking despite external disturbances and modeling errors, which is suitable in real-time applications.
2. System Dynamics and Problem Formulation
- Gravitational effect along the negative z direction: , where g is gravitational constant.
- Thrust vector in inertial frame: , where m is the mass of UAV and is the rotation matrix
- Lumped term for unmodelled dynamical effects (drag forces) and external disturbances in three dimensions:
- is the unit vector in the z-direction.
- represent thrust vector in body frame.
- is the lumped uncertainty.
Problem Definition
3. Sliding Mode Control Law
4. Learned CBF for External Wind Disturbances
4.1. Dynamical System Safety
4.2. Control Barrier Function
4.3. Learned CBF
4.4. Training the Neural Network
4.5. Learned CBF-QP with Sliding Mode Control
5. AirSim Experiments and Results
5.1. Results
5.2. Straight Line Trajectory
5.3. Circular Trajectory
6. Conclusions
Author Contributions
Funding
Conflicts of Interest
References
- Ames, A.D.; Xu, X.; Grizzle, J.W.; Tabuada, P. Control barrier function based quadratic programs for safety critical systems. IEEE Trans. Autom. Control 2016, 62, 3861–3876. [Google Scholar] [CrossRef]
- Ames, A.D.; Coogan, S.; Egerstedt, M.; Notomista, G.; Sreenath, K.; Tabuada, P. Control barrier functions: Theory and applications. In Proceedings of the 2019 18th European Control Conference (ECC), Naples, Italy, 25–28 June 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 3420–3431. [Google Scholar]
- Panja, P. Survey Paper on Control Barrier Functions. arXiv 2024, arXiv:2408.13271. [Google Scholar]
- Xu, B.; Sreenath, K. Safe teleoperation of dynamic uavs through control barrier functions. In Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia, 21–25 May 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 7848–7855. [Google Scholar]
- Lerch, C.; Dong, D.; Abraham, I. Safety-critical ergodic exploration in cluttered environments via control barrier functions. In Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK, 29 May–2 June 2023; IEEE: Piscataway, NJ, USA, 2023; pp. 10205–10211. [Google Scholar]
- Panja, P.; Hoagg, J.B.; Baidya, S. Control Barrier Function Based UAV Safety Controller in Autonomous Airborne Tracking and Following Systems. arXiv 2023, arXiv:2312.17215. [Google Scholar] [CrossRef]
- Fox, D.; Burgard, W.; Thrun, S. The dynamic window approach to collision avoidance. IEEE Robot. Autom. Mag. 1997, 4, 23–33. [Google Scholar] [CrossRef]
- Schouwenaars, T. Safe Trajectory Planning of Autonomous Vehicles. Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA, USA, 2006. [Google Scholar]
- Zitar, R.A.; Mohsen, A.; Seghrouchni, A.E.; Barbaresco, F.; Al-Dmour, N.A. Intensive review of drones detection and tracking: Linear Kalman filter versus nonlinear regression, an analysis case. Arch. Comput. Methods Eng. 2023, 30, 2811–2830. [Google Scholar] [CrossRef]
- Hsu, Y.H.; Gau, R.H. Reinforcement learning-based collision avoidance and optimal trajectory planning in UAV communication networks. IEEE Trans. Mob. Comput. 2020, 21, 306–320. [Google Scholar] [CrossRef]
- Fraga-Lamas, P.; Ramos, L.; Mondéjar-Guerra, V.; Fernández-Caramés, T.M. A review on IoT deep learning UAV systems for autonomous obstacle detection and collision avoidance. Remote Sens. 2019, 11, 2144. [Google Scholar] [CrossRef]
- Dai, X.; Nagahara, M. Platooning control of drones with real-time deep learning object detection. Adv. Robot. 2023, 37, 220–225. [Google Scholar] [CrossRef]
- Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016; pp. 779–788. [Google Scholar]
- Tayal, M.; Kolathaya, S. Control Barrier Functions in Dynamic UAVs for Kinematic Obstacle Avoidance: A Collision Cone Approach. arXiv 2023, arXiv:2303.15871. [Google Scholar]
- Chen, Y.; Singletary, A.; Ames, A.D. Guaranteed obstacle avoidance for multi-robot operations with limited actuation: A control barrier function approach. IEEE Control Syst. Lett. 2020, 5, 127–132. [Google Scholar] [CrossRef]
- Zhang, H.; Zhang, X.; Li, T.; Zhang, S.; Zhang, X. Barrier Function Enhanced Geometric Controller for Safe Control of a Quadrotor UAV. In Proceedings of the 2022 International Conference on Advanced Robotics and Mechatronics (ICARM), Guilin, China, 9–11 July 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 187–192. [Google Scholar]
- Wang, Z.; Hu, T.; Long, L. Multi-UAV safe collaborative transportation based on adaptive control barrier function. IEEE Trans. Syst. Man Cybern. Syst. 2023, 53, 6975–6983. [Google Scholar] [CrossRef]
- Wang, L.; Theodorou, E.A.; Egerstedt, M. Safe learning of quadrotor dynamics using barrier certificates. In Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia, 21–25 May 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 2460–2465. [Google Scholar]
- Machida, M.; Ichien, M. Consensus-based control barrier function for swarm. In Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China, 30 May–5 June 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 8623–8628. [Google Scholar]
- Qing, W.; Chen, H.; Wang, X.; Yin, Y. Collision-free trajectory generation for UAV swarm formation rendezvous. In Proceedings of the 2021 IEEE International Conference on Robotics and Biomimetics (ROBIO), Sanya, China, 27–31 December 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 1861–1867. [Google Scholar]
- Gunnarsson, H.; Åsbrink, A. Intelligent Drone Swarms: Motion Planning and Safe Collision Avoidance Control of Autonomous Drone Swarms; Chalmers University of Technology: Gothenburg, Sweden, 2022. [Google Scholar]
- Ghommam, J.; Luque-Vega, L.F.; Saad, M. Distance-based formation control for quadrotors with collision avoidance via Lyapunov barrier functions. Int. J. Aerosp. Eng. 2020, 2020, 2069631. [Google Scholar] [CrossRef]
- Jang, I.; Kim, H.J. Safe Control for Navigation in Cluttered Space using Multiple Lyapunov-Based Control Barrier Functions. IEEE Robot. Autom. Lett. 2024, 9, 2056–2063. [Google Scholar] [CrossRef]
- Dan, H.; Hatanaka, T.; Yamauchi, J.; Shimizu, T.; Fujita, M. Persistent object search and surveillance control with safety certificates for drone networks based on control barrier functions. Front. Robot. AI 2021, 8, 740460. [Google Scholar] [CrossRef]
- Cohen, M.H.; Belta, C. High order robust adaptive control barrier functions and exponentially stabilizing adaptive control lyapunov functions. In Proceedings of the 2022 American Control Conference (ACC), Atlanta, GA, USA, 8–10 June 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 2233–2238. [Google Scholar]
- Lopez, B.T.; Slotine, J.J.E.; How, J.P. Robust adaptive control barrier functions: An adaptive and data-driven approach to safety. IEEE Control Syst. Lett. 2020, 5, 1031–1036. [Google Scholar] [CrossRef]
- Taylor, A.J.; Ames, A.D. Adaptive safety with control barrier functions. In Proceedings of the 2020 American Control Conference (ACC), Denver, CO, USA, 1–3 July 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 1399–1405. [Google Scholar]
- Xiao, W.; Belta, C.; Cassandras, C.G. Adaptive control barrier functions. IEEE Trans. Autom. Control 2021, 67, 2267–2281. [Google Scholar] [CrossRef]
- Liu, S.; Xiao, W.; Belta, C.A. Auxiliary-Variable Adaptive Control Barrier Functions for Safety Critical Systems. In Proceedings of the 2023 62th IEEE Conference on Decision and Control (CDC), Singapore, 13–15 December 2023. [Google Scholar]
- Xiao, W.; Belta, C.; Cassandras, C. Adaptive Control Barrier Functions for Safety-Critical Systems. arXiv 2020, arXiv:2002.04577. [Google Scholar] [CrossRef]
- Tayal, M.; Zhang, H.; Jagtap, P.; Clark, A.; Kolathaya, S. Learning a Formally Verified Control Barrier Function in Stochastic Environment. arXiv 2024, arXiv:2403.19332. [Google Scholar] [CrossRef]
- Taylor, A.; Singletary, A.; Yue, Y.; Ames, A. Learning for safety-critical control with control barrier functions. In Proceedings of the Learning for Dynamics and Control. PMLR, Virtual, 10–11 June 2020; pp. 708–717. [Google Scholar]
- Wu, Z.; Christofides, P.D. Control Lyapunov-barrier function-based predictive control of nonlinear processes using machine learning modeling. Comput. Chem. Eng. 2020, 134, 106706. [Google Scholar] [CrossRef]
- Choi, J.; Castaneda, F.; Tomlin, C.J.; Sreenath, K. Reinforcement learning for safety-critical control under model uncertainty, using control lyapunov functions and control barrier functions. arXiv 2020, arXiv:2004.07584. [Google Scholar] [CrossRef]
- Cheng, R.; Khojasteh, M.J.; Ames, A.D.; Burdick, J.W. Safe multi-agent interaction through robust control barrier functions with learned uncertainties. In Proceedings of the 2020 59th IEEE Conference on Decision and Control (CDC), Jeju Island, Republic of Korea, 14–18 December 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 777–783. [Google Scholar]
- So, O.; Serlin, Z.; Mann, M.; Gonzales, J.; Rutledge, K.; Roy, N.; Fan, C. How to train your neural control barrier function: Learning safety filters for complex input-constrained systems. In Proceedings of the 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan, 13–17 May 2024; IEEE: Piscataway, NJ, USA, 2024; pp. 11532–11539. [Google Scholar]
- Microsoft AirSim. Available online: https://microsoft.github.io/AirSim/ (accessed on 14 September 2023).
- Shah, S.; Dey, D.; Lovett, C.; Kapoor, A. AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles. arXiv 2017, arXiv:1705.05065. [Google Scholar]
- Liu, B.; Wang, L.; Liu, M.; Xu, C.Z. Federated imitation learning: A novel framework for cloud robotic systems with heterogeneous sensor data. IEEE Robot. Autom. Lett. 2020, 5, 3509–3516. [Google Scholar] [CrossRef]
- Liu, B.; Wang, L.; Chen, X.; Huang, L.; Han, D.; Xu, C.Z. Peer-assisted robotic learning: A data-driven collaborative learning approach for cloud robotic systems. In Proceedings of the 2021 IEEE international conference on robotics and automation (ICRA), Xi’an, China, 30 May–5 June 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 4062–4070. [Google Scholar]
- Ghods, R.; Durkin, W.J.; Schneider, J. Multi-agent active search using realistic depth-aware noise model. In Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China, 30 May–5 June 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 9101–9108. [Google Scholar]
- Baldini, F.; Anandkumar, A.; Murray, R.M. Learning pose estimation for UAV autonomous navigation and landing using visual-inertial sensor data. In Proceedings of the 2020 American Control Conference (ACC), Denver, CO, USA, 1–3 July 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 2961–2966. [Google Scholar]
- Saunders, J.; Saeedi, S.; Lil, W. Parallel reinforcement learning simulation for visual quadrotor navigation. In Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK, 29 May–2 June 2023; IEEE: Piscataway, NJ, USA, 2023; pp. 1357–1363. [Google Scholar]
- PX4 Autopilot. Available online: https://px4.io/software/software-overview/ (accessed on 14 September 2023).
- Meier, L.; Honegger, D.; Pollefeys, M. PX4: A node-based multithreaded open source robotics framework for deeply embedded platforms. In Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA, 26–30 May 2015; IEEE: Piscataway, NJ, USA, 2015; pp. 6235–6240. [Google Scholar] [CrossRef]
- Michael, N.; Mellinger, D.; Lindsey, Q.; Kumar, V. The grasp multiple micro-uav testbed. IEEE Robot. Autom. Mag. 2010, 17, 56–65. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Panja, P.; Rayguru, M.M.; Baidya, S. Safe Autonomous UAV Target-Tracking Under External Disturbance, Through Learned Control Barrier Functions. Robotics 2025, 14, 108. https://doi.org/10.3390/robotics14080108
Panja P, Rayguru MM, Baidya S. Safe Autonomous UAV Target-Tracking Under External Disturbance, Through Learned Control Barrier Functions. Robotics. 2025; 14(8):108. https://doi.org/10.3390/robotics14080108
Chicago/Turabian StylePanja, Promit, Madan Mohan Rayguru, and Sabur Baidya. 2025. "Safe Autonomous UAV Target-Tracking Under External Disturbance, Through Learned Control Barrier Functions" Robotics 14, no. 8: 108. https://doi.org/10.3390/robotics14080108
APA StylePanja, P., Rayguru, M. M., & Baidya, S. (2025). Safe Autonomous UAV Target-Tracking Under External Disturbance, Through Learned Control Barrier Functions. Robotics, 14(8), 108. https://doi.org/10.3390/robotics14080108