Dynamic Bearing–Angle for Vision-Based UAV Target Motion Analysis
Abstract
1. Introduction
- We propose a dynamic filtering mechanism based on real-time noise statistics with dynamic smoothing factor adjustment. This addresses the parameter mismatch issue of traditional fixed covariance models in non-stationary noise scenarios, thereby improving estimation accuracy and convergence speed.
- We innovatively integrate M-estimation with filtering algorithms by dynamically allocating observation weights through the Huber robust loss function. This approach assigns low weights to abnormal data caused by sudden jitter in detection bounding boxes or sensor outliers, overcoming the dependency of traditional filtering on Gaussian noise assumptions. The enhanced robustness effectively prevents outliers from dominating state estimation.
- A Dynamic Kalman Filter framework is constructed based on a dual robust mechanism of weights to suppress outliers and dynamic adaptation of noise intensity in parallel. It suppresses observational anomalies through the anti-differential property of M-estimation and compensates model uncertainty through the adaptive property of dynamic filtering. The filtering framework can handle more complex noise types and significantly extends the generalizability of the algorithm in high-noise and strong dynamic scenarios.
2. Related Works
2.1. Visual-Based Target Motion Estimation
2.2. Adaptive Filtering Algorithm
3. Method
3.1. Dynamic Bearing–Angle Overview
3.2. System Modeling
3.3. Dynamic Bearing–Angle Estimator
3.3.1. Estimator Construction
- Initialization step: In the initialization step, we need to establish the initial process noise covariance matrix and measurement noise covariance matrix , as well as the initial state estimate and state covariance matrix . Here, “+” indicates that the estimate is a posteriori. Also, we initialize the M-estimation parameter .
- Time Update step: We then perform Time Update; at which point, we need to predict the state and predict the state covariance matrix separately:Here, “−” indicates that the estimate is a priori. denotes the state transfer function at time step , and “” in the equation is to distinguish between different time steps.
- Measurement Update step: We need to calculate the residuals first:It is important to note that is the difference between actual measurements and predicted measurements based on a priori estimates, ; is the difference between actual measurements and predicted measurements based on a posteriori estimates.Then, we introduce outlier suppression based on M-estimation by constructing a weight matrix using the Huber loss function to dynamically weight the residual components:The filtering update using the weighting matrix and solving for the weighted posterior residual covariance after calculating the computational Jacobi matrix obtainUpdate the Kalman gain:denotes the Jacobi matrix of the measurement function at time step .The a posteriori state estimates and covariances are finally obtained:
- Dynamic Adjustment step: At this time, the system needs to manually adjust the process noise and measurement noise covariance matrices relying on experience and trial and error. In reality, however, the process noise and measurement noise of the system are not fixed, especially in the dynamic situation that the UAV is in, where the noise characteristics may change over time. In this condition, manual adjustment of the covariance matrix may not be able to accommodate these changes in a timely manner. We propose to optimize the performance of the filter by dynamically adjusting the covariance matrix using the errors in the analytical prediction and update steps in order to overcome the problems posed by the system in a dynamic noise environment.For the process noise covariance matrix Q, we use the difference between the actual measurements and the predicted measurements based on a priori state estimation to dynamically adjust, which ensures that the system can accurately change dynamically. For the measurement noise covariance matrix R, we adjusted it using the difference between the actual measurements and the predicted measurements based on a posteriori state estimation to ensure that the filter accurately modeled the measurement error.These two approaches work together to enable the original Kalman filter to automatically adapt to changes in the noise characteristics of the system and improve the accuracy and robustness of the state estimation. The detailed calculation formula is as follows:Also, considering that the system is in a dynamically changing environment, the extreme noise characteristics may cause the system sensitivity to be too high when a fixed value of may lead to unstable filter performance. Therefore, we include a dynamic adjustment rule for the smoothing coefficient in adjusting the covariance matrix, which dynamically adjusts its value according to the magnitude of real-time data or noise.We use the variance adjustment of the prior residual series. To illustrate, a larger-than-expected variance in the prior residual series may indicate an underestimation of measurement noise, which can then be reduced. Specifically, the sample variance of the prior residual series is first calculated as a measure of prior residual intensity:Based on the relations between the variance of the prior residual sequence and the measurement noise covariance, we designed the following formula for adaptive adjustment:For systems with suboptimal initial conditions or inaccurate models, dynamic tuning can help the filter converge to the correct state estimate more quickly. Adaptive tuning can improve the robustness of the filter in the face of external disturbances or internal system uncertainties. This adaptive setting approach can further improve the performance of the filter, especially when the noise intensity of the system changes rapidly.
3.3.2. Estimator Coupling Relationship Analysis
- Hierarchical Complementation of Noise Suppression and Statistical Adaptation:The M-estimation weighs the discrete outliers generated by the sudden jitter of the detection frame through the Huber weight function to construct an anomaly filter barrier in the observation layer, while the DEKF tracks the continuously time-varying characteristics of sensor noise through real-time updating of the noise covariance matrices Q and R. The M-estimation is based on a combination of the following two methods. When the jitter of the detection frame generates sudden noise, the estimation M first reduces the weight of the noise so that the residual sequence of the DEKF covariance calculation is closer to the true distribution; DEKF then adjusts Q and R based on the `’purified” residuals to form a cascading effect of `’suppression followed by adaptation”. The DEKF then adjusts Q and R according to the `’purified” residuals, forming a cascade effect `’suppression and adaptation”.
- Lost Loop for Error Compensation in Nonlinear Systems:In the target maneuvering scenario, DEKF compensates for the uncertainty of the state transfer model by adjusting the Q matrix, while M-estimation mitigates the error amplification caused by the nonlinearity of the measurement model through weight assignment. The two form a mathematical coupling through the residual sequence: the weight matrix generated by M-estimation reconstructs the observation noise covariance, while the covariance updating formula of DEKF relies on the statistical properties of the weighted residuals, which ultimately results in a positive iterative cycle of “outlier suppression → covariance optimization → state estimation accuracy enhancement”.
4. Numerical Simulation Experiments
4.1. Simulation Experiment Setup
- Implement details
- Metrics
- Baselines
4.2. Numerical Simulation Experimental Scenario Setting
- Numerical Simulation Scenario 1:
- Numerical Simulation Scenario 2:
- Numerical Simulation Scenario 3:
4.3. Comparison with the State of the Arts
- Results under scenario 1:
- Results under scenario 2:
- Results under scenario 3:
4.4. Comparison with Other Adaptive Filtering Algorithms
5. Real-World Experimental Results
5.1. Experimental Dataset
5.2. Test Results with Actual Sensor Data
5.2.1. Quantitative Analysis Results
5.2.2. Results of Qualitative Analysis of Examples
- Small amplitude deviation noise at low-speed motion:
- Large deviation noise at high-speed motion:
5.3. Ablation Experiment
- Results of ablation experiments on the MAV6D dataset:
- Validation of validity using probability density functions of residuals:
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Minaeian, S.; Liu, J.; Son, Y.J. Vision-based target detection and localization via a team of cooperative UAV and UGVs. IEEE Trans. Syst. Man Cybern. Syst. 2015, 46, 1005–1016. [Google Scholar] [CrossRef]
- Wang, B.; Li, Q.; Mao, Q.; Wang, J.; Chen, C.P.; Shangguan, A.; Zhang, H. A Survey on Vision-Based Anti Unmanned Aerial Vehicles Methods. Drones 2024, 8, 518. [Google Scholar] [CrossRef]
- Yang, K.; Bai, C.; She, Z.; Quan, Q. High-Speed Interception Multicopter Control by Image-based Visual Servoing. arXiv 2024, arXiv:2404.08296. [Google Scholar] [CrossRef]
- Sui, D.; Deghat, M.; Sun, Z.; Greiff, M. Unbiased bearing-only localization and circumnavigation of a constant velocity target. IEEE Trans. Intell. Veh. 2024. [Google Scholar] [CrossRef]
- Ning, Z.; Zhang, Y.; Li, J.; Chen, Z.; Zhao, S. A bearing-angle approach for unknown target motion analysis based on visual measurements. Int. J. Robot. Res. 2024, 43, 1228–1249. [Google Scholar] [CrossRef]
- Khather, S.I.; Ibrahim, M.A.; Ibrahim, M.H. PID Controller for A Bearing Angle Control in Self-Driving Vehicles. J. Robot. Control (JRC) 2024, 5, 647–654. [Google Scholar] [CrossRef]
- Hoelzer, H.; Johnson, G.; Cohen, A. Modified polar coordinates-the key to well behaved bearings only ranging. IR D Rep. 1978, 78-M19. [Google Scholar]
- Fogel, E.; Gavish, M. Nth-order dynamics target observability from angle measurements. IEEE Trans. Aerosp. Electron. Syst. 1988, 24, 305–308. [Google Scholar] [CrossRef]
- He, S.; Shin, H.S.; Tsourdos, A. Trajectory optimization for target localization with bearing-only measurement. IEEE Trans. Robot. 2019, 35, 653–668. [Google Scholar] [CrossRef]
- Li, J.; Ning, Z.; He, S.; Lee, C.H.; Zhao, S. Three-dimensional bearing-only target following via observability-enhanced helical guidance. IEEE Trans. Robot. 2022, 39, 1509–1526. [Google Scholar] [CrossRef]
- Aidala, V.J.; Nardone, S.C. Biased estimation properties of the pseudolinear tracking filter. IEEE Trans. Aerosp. Electron. Syst. 1982, AES-18, 432–441. [Google Scholar] [CrossRef]
- Hammel, S.E.; Liu, P.T.; Hilliard, E.J.; Gong, K.F. Optimal observer motion for localization with bearing measurements. Comput. Math. Appl. 1989, 18, 171–180. [Google Scholar] [CrossRef]
- Sabet, M.; Fathi, A.; Daniali, H.M. Optimal design of the own ship maneuver in the bearing-only target motion analysis problem using a heuristically supervised extended Kalman filter. Ocean Eng. 2016, 123, 146–153. [Google Scholar] [CrossRef]
- Anjaly, P.; Ratnoo, A. Observability enhancement of maneuvering target with bearings-only information. J. Guid. Control Dyn. 2018, 41, 184–198. [Google Scholar] [CrossRef]
- Yang, Y.; Liu, Z.; Qin, Y.; Pan, Q. Novel pseudo-linear Kalman filtering for 3D angle-only tracking in the presence of observer’s location errors. Automatica 2023, 155, 111114. [Google Scholar] [CrossRef]
- Asgharian, M. On the singularities of the information matrix and multipath change-point problems. Theory Probab. Its Appl. 2014, 58, 546–561. [Google Scholar] [CrossRef]
- Griewank, A. On solving nonlinear equations with simple singularities or nearly singular solutions. SIAM Rev. 1985, 27, 537–563. [Google Scholar] [CrossRef]
- Zhang, Y.; Guo, Z.; Wu, J.; Tian, Y.; Tang, H.; Guo, X. Real-time vehicle detection based on improved yolo v5. Sustainability 2022, 14, 12274. [Google Scholar] [CrossRef]
- Aidala, V.J. Kalman filter behavior in bearings-only tracking applications. IEEE Trans. Aerosp. Electron. Syst. 1979, AES-15, 29–39. [Google Scholar] [CrossRef]
- Lin, X.; Kirubarajan, T.; Bar-Shalom, Y.; Maskell, S. Comparison of EKF, pseudomeasurement, and particle filters for a bearing-only target tracking problem. In Proceedings of the Signal and Data Processing of Small Targets 2002, Orlando, FL, USA, 1–5 April 2002; Volume 4728, pp. 240–250. [Google Scholar]
- Griffin, B.A.; Corso, J.J. Depth from camera motion and object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 20–25 June 2021; pp. 1397–1406. [Google Scholar]
- Rodriguez, A.; Moreno, F. Evolutionary computing and particle filtering: A hardware-based motion estimation system. IEEE Trans. Comput. 2015, 64, 3140–3152. [Google Scholar] [CrossRef]
- Nardone, S.C.; Aidala, V.J. Observability criteria for bearings-only target motion analysis. IEEE Trans. Aerosp. Electron. Syst. 1981, AES-17, 162–166. [Google Scholar] [CrossRef]
- Lingren, A.G.; Gong, K.F. Position and velocity estimation via bearing observations. IEEE Trans. Aerosp. Electron. Syst. 1978, AES-14, 564–577. [Google Scholar]
- Narasimhappa, M.; Mahindrakar, A.D.; Guizilini, V.C.; Terra, M.H.; Sabat, S.L. MEMS-based IMU drift minimization: Sage Husa adaptive robust Kalman filtering. IEEE Sens. J. 2019, 20, 250–260. [Google Scholar] [CrossRef]
- Fox, D. KLD-sampling: Adaptive particle filters. In Advances in Neural Information Processing Systems 14 (NIPS); MIT Press: Cambridge, MA, USA, 2001; Volume 14. [Google Scholar]
- Sun, F.; Hu, X.; Zou, Y.; Li, S. Adaptive unscented Kalman filtering for state of charge estimation of a lithium-ion battery for electric vehicles. Energy 2011, 36, 3531–3540. [Google Scholar] [CrossRef]
- Mohamed, A.; Schwarz, K. Adaptive Kalman filtering for INS/GPS. J. Geod. 1999, 73, 193–203. [Google Scholar] [CrossRef]
- Akhlaghi, S.; Zhou, N.; Huang, Z. Adaptive adjustment of noise covariance in Kalman filter for dynamic state estimation. In Proceedings of the 2017 IEEE Power & Energy Society General Meeting, Chicago, IL, USA, 16–20 July 2017; pp. 1–5. [Google Scholar]
- Cho, N.; Kim, Y. Modified pure proportional navigation guidance law for impact time control. J. Guid. Control Dyn. 2016, 39, 852–872. [Google Scholar] [CrossRef]
- Zheng, Y.; Zheng, C.; Shen, J.; Liu, P.; Zhao, S. Keypoint-guided efficient pose estimation and domain adaptation for micro aerial vehicles. IEEE Trans. Robot. 2024, 40, 2967–2983. [Google Scholar] [CrossRef]
Method | Frame 0 to 20 | Frame 21 to 40 | Frame 41 to 100 | Frame After 100 | Average FPS | ||||
---|---|---|---|---|---|---|---|---|---|
ME | RMSE | ME | RMSE | ME | RMSE | ME | RMSE | ||
Bearing-Only | 2.7629 | 3.6741 | 2.8384 | 3.2344 | 1.9722 | 2.0180 | 2.4395 | 2.8725 | 6667.08 |
Baseline–Angle | 2.1502 | 2.2752 | 1.4824 | 1.4825 | 1.1017 | 1.1349 | 1.3070 | 1.5678 | 2940.63 |
Dynamic Bearing–Angle | 1.2404 | 1.5808 | 0.4986 | 0.7352 | 0.4237 | 0.4814 | 0.3631 | 0.3660 | 2142.72 |
Method | Frame 0 to 20 | Frame 21 to 40 | Frame 41 to 100 | Frame After 100 | ||||
---|---|---|---|---|---|---|---|---|
ME | RMSE | ME | RMSE | ME | RMSE | ME | RMSE | |
Baseline | 2.1922 | 2.3080 | 1.4927 | 1.9105 | 1.4123 | 1.4124 | 1.2103 | 1.2199 |
Baseline + M-estimation | 1.4921 | 1.5385 | 1.0055 | 1.0177 | 0.8645 | 0.9211 | 1.0421 | 1.1699 |
Baseline + Dynamic smoothing factor | 1.4714 | 1.5202 | 0.8427 | 0.8642 | 0.8859 | 0.9359 | 1.0001 | 1.0858 |
Dynamic Bearing–Angle | 1.2404 | 1.5808 | 0.4986 | 0.7352 | 0.4237 | 0.4814 | 0.3631 | 0.3660 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Luo, Y.; Fu, H.; Fu, T.; Cha, H.; Tian, B.; Tang, H.; Liu, F. Dynamic Bearing–Angle for Vision-Based UAV Target Motion Analysis. Sensors 2025, 25, 4396. https://doi.org/10.3390/s25144396
Luo Y, Fu H, Fu T, Cha H, Tian B, Tang H, Liu F. Dynamic Bearing–Angle for Vision-Based UAV Target Motion Analysis. Sensors. 2025; 25(14):4396. https://doi.org/10.3390/s25144396
Chicago/Turabian StyleLuo, Yu, Hongwei Fu, Tingting Fu, Hao Cha, Bing Tian, Huatao Tang, and Feng Liu. 2025. "Dynamic Bearing–Angle for Vision-Based UAV Target Motion Analysis" Sensors 25, no. 14: 4396. https://doi.org/10.3390/s25144396
APA StyleLuo, Y., Fu, H., Fu, T., Cha, H., Tian, B., Tang, H., & Liu, F. (2025). Dynamic Bearing–Angle for Vision-Based UAV Target Motion Analysis. Sensors, 25(14), 4396. https://doi.org/10.3390/s25144396