Multi-Target Tracking with Collaborative Roadside Units Under Foggy Conditions
Abstract
1. Introduction
1.1. Lidar Point Cloud Denoising Method in Foggy Conditions
1.2. Multi-Target Tracking Methods
1.2.1. Data Association
1.2.2. Random Finite Set
2. Main Methods
2.1. System Framework: Multi-Target Tracking of Roadside Unit Coordination
2.2. Adaptive Lidar Point Cloud Denoising Method
2.2.1. Point Cloud Preprocessing
2.2.2. Voxelisation and Local Noise Estimation
2.2.3. Parameter Adaptive Adjustment
2.2.4. Edge Updates
2.2.5. Bilateral Filtering
2.3. Multi-Object Tracking Method with Roadside Unit Collaboration
2.3.1. Measurement Fusion
2.3.2. State Estimation
- (1)
- Prediction
- (2)
- Update
- (3)
- Resample
- (4)
- Target Number and State Estimation
2.3.3. Trajectory Extraction
- (1)
- Surviving Target Identification
- (2)
- Newborn Target Identification
- (3)
- Spawned Target Handling
| Algorithm 1 Particle-Labeled PHD Filter |
| 1: procedure MAIN (InitialParticleSet, MeasurementSequence) 2: for k = 2 to K do 3: PREDICTION(k) 4: UPDATE(k) 5: RESAMPLE(k) 6: ESTIMATE_TARGETS(k) 7: EXTRACT_TRAJECTORIES(k) 8: end for 9: end procedure 10: procedure PREDICTION(k) 11: for do 12: 13: 14: 15: end for 16: do 17: 18: 19: 20: end for 21: Combine predicted particle sets 22: end procedure 23: procedure UPDATE(k) 24: do 25: 26: 27: 28: end for 29: end procedure 30: procedure RESAMPLE(k) 31: 32: 33: 34: do 35: (parent particle) 36: end for 37: 38: end procedure 39: procedure ESTIMATE_TARGETS(k) 40: Perform k-means clustering on weighted particles 41: do 42: if cluster states too close then re-cluster by velocity 43: 44: 45: end for 46: Output clusters [10] 47: end procedure 48: procedure EXTRACT_TRAJECTORIES(k) 49: Compute matrices A and B using Equations (33) and (34) 50: for each previous cluster g do 51: then target survives 52: then target disappears 53: end for 54: for each current cluster h do 55: then new target declared 56: end for 57: Use matrix B to handle target spawning cases 58: Link targets with same labels across time steps 59: end procedure |
3. Results
3.1. Experimental Platfrom
3.1.1. Point Cloud Denoising
3.1.2. Multi-Target Tracking Experiments and Analysis
- Straight Scenario
- Curved Scenario
3.2. Computational Performance and Analysis
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Song, Y. Connected Autonomous Vehicles in Cooperative Vehicle-Infrastructure System. Master’s Thesis, University of Windsor, Windsor, ON, Canada, 2024. [Google Scholar]
- Yamada, S. The strategy and deployment plan for VICS. IEEE Commun. Mag. 1996, 34, 94–97. [Google Scholar] [CrossRef]
- Ko, B.; Liu, K.; Son, S.H.; Park, K.-J. RSU-Assisted Adaptive Scheduling for Vehicle-to-Vehicle Data Sharing in Bidirectional Road Scenarios. IEEE Trans. Intell. Transp. Syst. 2021, 22, 977–989. [Google Scholar] [CrossRef]
- Ogunrinde, I.; Bernadin, S. Deep Camera-Radar Fusion with an Attention Framework for Autonomous Vehicle Vision in Foggy Weather Conditions. Sensors 2023, 23, 6255. [Google Scholar] [CrossRef] [PubMed]
- Qian, K.; Zhu, S.; Zhang, X.; Li, L.E. Robust Multimodal Vehicle Detection in Foggy Weather Using Complementary Lidar and Radar Signals. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 19–25 June 2021. [Google Scholar]
- Xiong, M.; Xu, X.; Yang, D.; Steinbach, E. Robust Depth Estimation in Foggy Environments Combining RGB Images and mmWave Radar. In Proceedings of the 24th IEEE International Symposium on Multimedia (IEEE ISM), Naples, Italy, 5–7 December 2022. [Google Scholar]
- Li, Y.; Duthon, P.; Colomb, M.; Ibanez-Guzman, J. What happens for a ToF LiDAR in fog? IEEE Trans. Intell. Transp. Syst. 2020, 22, 6670–6681. [Google Scholar] [CrossRef]
- Hevisov, D.; Liemert, A.; Reitzle, D.; Kienle, A. Impact of Multi-Scattered LiDAR Returns in Fog. Sensors 2024, 24, 5121. [Google Scholar] [CrossRef]
- Usmani, K.; O’Connor, T.; Wani, P.; Javidi, B. Overview of 3D object detection through fog and occlusion: Passive integral imaging vs active LiDAR sensing. In Proceedings of the Conference on Three-Dimensional Imaging, Visualization, and Display, National Harbor, MD, USA, 22–24 April 2024. [Google Scholar]
- Singh, A.K. Major Development Under Gaussian Filtering Since Unscented Kalman Filter. IEEE-Caa J. Autom. Sin. 2020, 7, 1308–1325. [Google Scholar] [CrossRef]
- Hu, J.; Fu, Y.; Kang, J.; Zhong, Q.; Wang, X. An improved wavelet domain mean filtering algorithm. Sci. Surv. Mapp. 2021, 46, 55–60. [Google Scholar]
- Tsurkan, O.; Kupchuk, L.; Polievoda, Y.; Wozniak, O.; Hontaruk, Y.; Prysiazhniuk, Y. Digital processing of one-dimensional signals based on the median filtering algorithm. Prz. Elektrotechniczny 2022, 98, 51–56. [Google Scholar] [CrossRef]
- Shelke, S.K.; Sinha, S.K.; Patel, G.S. Study of Improved Median Filtering using adaptive window architecture. In Proceedings of the 11th International Conference of Computer Communication and Informatics (ICCCI), Coimbatore, India, 27–29 January 2021. [Google Scholar]
- Ren, S.; He, K.; Girshick, R.; Sun, J. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 1137–1149. [Google Scholar] [CrossRef]
- Scarselli, F.; Gori, M.; Tsoi, A.C.; Hagenbuchner, M.; Monfardini, G. The Graph Neural Network Model. IEEE Trans. Neural Netw. 2009, 20, 61–80. [Google Scholar] [CrossRef]
- Qi, C.R.; Su, H.; Mo, K.; Guibas, L.J. IEEE PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. In Proceedings of the 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017. [Google Scholar]
- Qi, C.R.; Yi, L.; Su, H.; Guibas, L.J. PointNet plus plus: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. In Proceedings of the 31st Annual Conference on Neural Information Processing Systems (NIPS), Long Beach, CA, USA, 4–9 December 2017. [Google Scholar]
- Guo, G.; Zhao, S. 3D Multi-Object Tracking with Adaptive Cubature Kalman Filter for Autonomous Driving. IEEE Trans. Intell. Veh. 2023, 8, 512–519. [Google Scholar] [CrossRef]
- Arulampalam, M.; Maskell, S.; Gordon, N.; Clapp, T. A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 2002, 50, 174–188. [Google Scholar] [CrossRef]
- Zhang, Y.; Wang, C.; Wang, X.; Zeng, W.; Liu, W. FairMOT: On the Fairness of Detection and Re-identification in Multiple Object Tracking. Int. J. Comput. Vis. 2021, 129, 3069–3087. [Google Scholar] [CrossRef]
- Da, K.; Li, T.; Zhu, Y.; Fan, H.; Fu, Q. Recent advances in multisensor multitarget tracking using random finite set. Front. Inf. Technol. Electron. Eng. 2021, 22, 5–24. [Google Scholar] [CrossRef]
- Yu, K.; Ji, L.; Zhang, X. Kernel nearest-neighbor algorithm. Neural Process. Lett. 2002, 15, 147–156. [Google Scholar] [CrossRef]
- Bu, L.; Rao, B.; Song, D. A group target track-before-detect approach using two-stage strategy with maximum-likelihood probabilistic data association. IET Radar Sonar Navig. 2024, 18, 1351–1363. [Google Scholar] [CrossRef]
- Svensson, L.; Svensson, D.; Guerriero, M.; Willett, P. Set JPDA Filter for Multitarget Tracking. IEEE Trans. Signal Process. 2011, 59, 4677–4691. [Google Scholar] [CrossRef]
- Yang, H.; Sun, Z.; Qi, G.; Li, Y.; Sheng, A. A multi-group target tracking algorithm based on probabilistic multi-hypothesis tracking. In Proceedings of the 43rd Chinese Control Conference (CCC), Kunming, China, 28–31 July 2024. [Google Scholar]
- Zeng, F.; Dong, B.; Zhang, Y.; Wang, T.; Zhang, X.; Wei, Y. MOTR: End-to-End Multiple-Object Tracking with Transformer. In Proceedings of the 17th European Conference on Computer Vision (ECCV), Tel Aviv, Israel, 23–27 October 2022. [Google Scholar]
- Sun, P.; Cao, J.; Jiang, Y.; Zhang, R.; Xie, E.; Yuan, Z.; Wang, C.; Luo, P. Transtrack: Multiple object tracking with transformer. arXiv 2020, arXiv:2012.15460. [Google Scholar]
- Cao, X.; Zhu, C.; Yi, W. PHD Filter Based Traffic Target Tracking Framework with FMCW Radar. In Proceedings of the 11th International Conference on Control, Automation and Information Sciences (ICCAIS), Hanoi, Vietnam, 21–24 November 2022. [Google Scholar]
- Zhang, M.; Zhao, Y.; Niu, B. Trajectory PHD and CPHD Filters for the Pulse Doppler Radar. Remote Sens. 2024, 16, 4671. [Google Scholar] [CrossRef]
- Wei, S.; Zhang, B.; Yi, W. Trajectory PHD and CPHD Filters with Unknown Detection Profile. IEEE Trans. Veh. Technol. 2022, 71, 8042–8058. [Google Scholar] [CrossRef]
- Vo, B.-N.; Ma, W.-K. The Gaussian mixture probability hypothesis density filter. IEEE Trans. Signal Process. 2006, 54, 4091–4104. [Google Scholar] [CrossRef]
- Yang, Z.; Li, X.; Yao, X.; Sun, J.; Shan, T. Gaussian Process Gaussian Mixture PHD Filter for 3D Multiple Extended Target Tracking. Remote Sens. 2023, 15, 3224. [Google Scholar] [CrossRef]
- Zhang, X.; Xi, L.; Chen, H.; Zhang, W.; Fan, Y.; Li, T.; Liu, J. Multi-objective Sensor Management Method Based on Twin Delayed Deep Deterministic policy gradient algorithm. In Proceedings of the 43rd Chinese Control Conference (CCC), Kunming, China, 28–31 July 2024. [Google Scholar]
- Marukatat, S. Tutorial on PCA and approximate PCA and approximate kernel PCA. Artif. Intell. Rev. 2023, 56, 5445–5477. [Google Scholar] [CrossRef]
- Lv, H.; Shan, P.; Shi, H.; Zhao, L. An adaptive bilateral filtering method based on improved convolution kernel used for infrared image enhancement. Signal Image Video Process. 2022, 16, 2231–2237. [Google Scholar] [CrossRef]
- WMO. WMO Guide to Meteorological Instruments and Methods of Observation; WMO: Geneva, Switzerland, 2008. [Google Scholar]
- Luiten, J.; Osep, A.; Dendorfer, P.; Torr, P.; Geiger, A.; Leal-Taixé, L.; Leibe, B. HOTA: A Higher Order Metric for Evaluating Multi-object Tracking. Int. J. Comput. Vis. 2021, 129, 548–578. [Google Scholar] [CrossRef]
- Zhang, K.; Liu, Y.; Mei, F.; Jin, J.; Wang, Y. Boost Correlation Features with 3D-MiIoU-Based Camera-LiDAR Fusion for MODT in Autonomous Driving. Remote. Sens. 2023, 15, 874. [Google Scholar] [CrossRef]
- Miah, M.; Bilodeau, G.A.; Saunier, N. Learning data association for multi-object tracking using only coordinates. Pattern Recognit. 2025, 160, 111169. [Google Scholar] [CrossRef]
















| Parameter | Specifications |
|---|---|
| Lines | 80 |
| Range | 230 m (160 m@10% NIST) |
| Range Precision (Typical) | Up to ±3 cm |
| Frame Rate | 10 Hz/20 Hz |
| Horizontal FOV | 360° |
| Vertical FOV | 40° (−25°~+15°) |
| Horizontal Resolution | [Balance] 0.2°/0.4° [High performance] 0.1°/0.2° |
| Vertical Resolution | Up to 0.1° |
| Parameter | Value |
|---|---|
| Horizontal Visibility/m | 500~3000 |
| Temperature Range/°C | 6~13 |
| Relative Humidity/% | 65~76 |
| Wind Speed/km/h | 8–14 |
| Noise Reduction Methods | Total Target Number | Number of False Positives | Accuracy Rate (%) |
|---|---|---|---|
| Unprocessed | 757 | 210 | 72% |
| Statistical filtering | 671 | 124 | 82% |
| Proposed method | 564 | 57 | 90% |
| Noise Reduction Methods | Total Target Number | Number of False Positives | Accuracy Rate (%) |
|---|---|---|---|
| Unprocessed | 384 | 313 | 18% |
| Statistical filtering | 415 | 249 | 40% |
| Proposed method | 336 | 104 | 69% |
| Methods | HOTA ↑ | MOTA ↑ | MOTP ↑ | IDF1 ↑ | MT ↑ | ML ↓ | IDs ↓ |
|---|---|---|---|---|---|---|---|
| BcMODT [38] | 72.64 | 83.18 | 85.82 | 62.96 | 44.69 | 12.58 | 89 |
| C-TwiX [39] | 78.91 | 88.56 | 85.46 | 56.82 | 49.32 | 14.92 | 241 |
| JPDA | 69.88 | 75.23 | 72.14 | 51.19 | 41.51 | 30.05 | 23 |
| Ours | 82.76 | 89.69 | 87.30 | 66.57 | 46.74 | 11.63 | 52 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Shi, T.; Wang, X.; Jiang, W.; Huang, X.; Cen, M.; Cao, S.; Zhou, H. Multi-Target Tracking with Collaborative Roadside Units Under Foggy Conditions. Sensors 2026, 26, 998. https://doi.org/10.3390/s26030998
Shi T, Wang X, Jiang W, Huang X, Cen M, Cao S, Zhou H. Multi-Target Tracking with Collaborative Roadside Units Under Foggy Conditions. Sensors. 2026; 26(3):998. https://doi.org/10.3390/s26030998
Chicago/Turabian StyleShi, Tao, Xuan Wang, Wei Jiang, Xiansheng Huang, Ming Cen, Shuai Cao, and Hao Zhou. 2026. "Multi-Target Tracking with Collaborative Roadside Units Under Foggy Conditions" Sensors 26, no. 3: 998. https://doi.org/10.3390/s26030998
APA StyleShi, T., Wang, X., Jiang, W., Huang, X., Cen, M., Cao, S., & Zhou, H. (2026). Multi-Target Tracking with Collaborative Roadside Units Under Foggy Conditions. Sensors, 26(3), 998. https://doi.org/10.3390/s26030998

