Sensor-Model Matching for Controlled Comparison of Bayesian and Belief-Function Occupancy Grid Fusion
Abstract
1. Introduction
- Pignistic matching methodology. A pignistic-transform-based procedure that matches per-observation decision probabilities across frameworks, enabling controlled comparison independent of sensor parameterization (Section 3.2).
- Confound demonstration. Independent parameterization from community defaults produces a moderate mismatch ( vs. ) that reversed boundary sharpness by 23–36 percentage points across two noise conditions in our experiments (Section 3.1).
- BetP-matched empirical comparison. Under matched comparison in single-agent simulation and on two real indoor lidar datasets, the two frameworks produce practically equivalent maps with a small directional advantage for Bayesian log-odds (absolute differences 0.001–0.022 on scales; Section 5).
- Transform dependence. Under normalized plausibility () matching, the direction reverses for boundary sharpness and Brier score (Section 5.3).
2. Related Work
2.1. Bayesian Occupancy Grid Mapping
2.2. Belief Function Occupancy Grid Mapping
Alternative Combination Rules
2.3. Comparison Studies and the Sensor Model Gap
The Methodological Gap
3. Matching Methodology
3.1. The Sensor Model Equivalence Problem
3.2. Pignistic Transform Matching
3.2.1. Choice of Probability Transform
3.2.2. Consonant Mass Functions
3.3. Per-Observation Locality
3.4. Accumulation Divergence
4. Experimental Setup
4.1. Single-Agent Simulation Setup
4.2. Real Data: Intel Lab and Freiburg 079
4.2.1. Intel Research Lab (Dataset)
4.2.2. Freiburg Building 079 (Dataset)
4.3. Metrics
4.3.1. Cell Accuracy
4.3.2. Boundary Sharpness
4.3.3. Brier Score
4.3.4. Map Entropy
4.4. Statistical Analysis Framework
5. Results
5.1. Single-Agent Simulation
5.2. Multi-Robot Results
5.3. Sensitivity to Matching Criterion
5.4. Real-Data Validation
5.4.1. Intel Research Lab
5.4.2. Freiburg Building 079
Real-Data Summary
6. Discussion
6.1. The Sensor Model Confound
6.2. Transform Dependence
6.3. Conflict Level and Metric Divergence
6.4. Limitations
6.4.1. Point-Probability Evaluation Only
6.4.2. BetP-Conditional Comparison
6.4.3. Real-Data Scope
6.4.4. Downstream Evaluation Limitations
6.4.5. Statistical Design
7. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Elfes, A. Using occupancy grids for mobile robot perception and navigation. Computer 1989, 22, 46–57. [Google Scholar] [CrossRef]
- Thrun, S.; Burgard, W.; Fox, D. Probabilistic Robotics; MIT Press: Cambridge, MA, USA, 2005. [Google Scholar]
- Grisetti, G.; Stachniss, C.; Burgard, W. Improved techniques for grid mapping with Rao-Blackwellized particle filters. IEEE Trans. Robot. 2007, 23, 34–46. [Google Scholar] [CrossRef]
- Hess, W.; Kohler, D.; Rapp, H.; Andor, D. Real-time loop closure in 2D LIDAR SLAM. In Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden, 16–21 May 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 1271–1278. [Google Scholar] [CrossRef]
- Macenski, S.; Jambrecic, I. SLAM Toolbox: SLAM for the dynamic world. J. Open Source Softw. 2021, 6, 2783. [Google Scholar] [CrossRef]
- Dempster, A.P. Upper and lower probabilities induced by a multivalued mapping. Ann. Math. Stat. 1967, 38, 325–339. [Google Scholar] [CrossRef]
- Shafer, G. A Mathematical Theory of Evidence; Princeton University Press: Princeton, NJ, USA, 1976. [Google Scholar]
- Smets, P.; Kennes, R. The transferable belief model. Artif. Intell. 1994, 66, 191–234. [Google Scholar] [CrossRef]
- Smets, P. Decision making in the tbm: The necessity of the pignistic transformation. Int. J. Approx. Reason. 2005, 38, 133–147. [Google Scholar] [CrossRef]
- Moras, J.; Cherfaoui, V.; Bonnifait, P. Moving objects detection by conflict analysis in evidential grids. In Proceedings of the 2011 IEEE Intelligent Vehicles Symposium (IV), Baden-Baden, Germany, 5–9 June 2011; IEEE: Piscataway, NJ, USA, 2011; pp. 1122–1127. [Google Scholar] [CrossRef]
- Huletski, A.; Kartashov, D.; Krinkin, K. VinySLAM: An indoor SLAM method for low-cost platforms based on the Transferable Belief Model. In Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada, 24–28 September 2017; IEEE: Piscataway, NJ, USA, 2017; pp. 6770–6776. [Google Scholar] [CrossRef]
- Dempster, A.P. A generalization of Bayesian inference. J. R. Stat. Soc. Ser. (Methodol.) 1968, 30, 205–247. [Google Scholar] [CrossRef]
- Cuzzolin, F. The Geometry of Uncertainty: The Geometry of Imprecise Probabilities; Springer: Cham, Switzerland, 2020. [Google Scholar] [CrossRef]
- Moras, J.; Cherfaoui, V.; Bonnifait, P. Credibilist occupancy grids for vehicle perception in dynamic environments. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 9–13 May 2011; IEEE: Piscataway, NJ, USA, 2011; pp. 84–89. [Google Scholar] [CrossRef]
- Nuss, D.; Reuter, S.; Thom, M.; Yuan, T.; Krehl, G.; Maile, M.; Gern, A.; Dietmayer, K. A random finite set approach for dynamic occupancy grid maps with real-time application. Int. J. Robot. Res. 2018, 37, 841–866. [Google Scholar] [CrossRef]
- Ben Ayed, S.; Dachraoui, J.; Laghmara, H.; Boutteau, R. Overview on evidential fusion approaches in the context of collaborative perception for occupancy modeling. Appl. Intell. 2025, 55, 822. [Google Scholar] [CrossRef]
- Zadeh, L.A. On the Validity of Dempster’s Rule of Combination of Evidence, Tech. Rep. UCB/ERL M79/24; Electronics Research Laboratory; University of California: Berkeley, CA, USA, 1979. [Google Scholar]
- Yager, R.R. On the Dempster-Shafer framework and new combination rules. Inf. Sci. 1987, 41, 93–137. [Google Scholar] [CrossRef]
- Dubois, D.; Prade, H. Representation and combination of uncertainty with belief functions and possibility measures. Comput. Intell. 1988, 4, 244–264. [Google Scholar] [CrossRef]
- Denœux, T. Conjunctive and disjunctive combination of belief functions induced by nondistinct bodies of evidence. Artif. Intell. 2008, 172, 234–264. [Google Scholar] [CrossRef]
- Smarandache, F.; Dezert, J. Proportional conflict redistribution rules for information fusion. In Advances and Applications of DSmT for Information Fusion; American Research Press: Rehoboth, NM, USA, 2006; Volume 2, pp. 3–68. [Google Scholar]
- Porębski, J. Customizable inverse sensor model for Bayesian and Dempster-Shafer occupancy grid frameworks. In Advanced, Contemporary Control, Volume 1196 of Advances in Intelligent Systems and Computing; Springer International Publishing: Cham, Switzerland, 2020; pp. 1225–1236. [Google Scholar] [CrossRef]
- Haehnel, D. Intel Research Lab Dataset, Radish: The Robotics Data Set Repository. 2003. Available online: http://radish.sourceforge.net/ (accessed on 10 April 2026).
- Schuirmann, D.J. A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability. J. Pharmacokinet. Biopharm. 1987, 15, 657–680. [Google Scholar] [CrossRef] [PubMed]
- Lakens, D. Equivalence tests: A practical primer for t tests, correlations, and meta-analyses. Soc. Psychol. Personal. Sci. 2017, 8, 355–362. [Google Scholar] [CrossRef] [PubMed]
- Holm, S. A simple sequentially rejective multiple test procedure. Scand. J. Stat. 1979, 6, 65–70. [Google Scholar]
- Stachniss, C. Freiburg building 079 dataset, University of Freiburg, Department of Computer Science. 2003. Available online: https://dspace.mit.edu/handle/1721.1/62290 (accessed on 10 April 2026).
- Han, J.; Min, Y.; Chae, H.-J.; Jeong, B.-M.; Choi, H.-L. DS-K3DOM: 3-D dynamic occupancy mapping with kernel inference and Dempster–Shafer evidential theory. arXiv 2023, arXiv:2209.07764. [Google Scholar] [CrossRef]
- Richter, S.; Wang, Y.; Beck, J.; Wirges, S.; Stiller, C. Semantic evidential grid mapping using monocular and stereo cameras. Sensors 2021, 21, 3380. [Google Scholar] [CrossRef] [PubMed]
- Kim, J.; Seo, J.; Min, J. Evidential semantic mapping in off-road environments with uncertainty-aware Bayesian kernel inference. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Abu Dhabi, United Arab Emirates, 14–18 October 2024. [Google Scholar] [CrossRef]
- Casella, G.; Berger, R.L. Statistical Inference, 2nd ed.; Duxbury/Thomson Learning: Pacific Grove, CA, USA, 2002. [Google Scholar]
- Hedges, L.V.; Olkin, I. Statistical Methods for Meta-Analysis; Academic Press: New York, NY, USA, 1985. [Google Scholar]
- Steiger, J.H. Beyond the F test: Effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis. Psychol. Methods 2004, 9, 164–182. [Google Scholar] [CrossRef] [PubMed]


| Environment | Metric | Δ | Evidence |
|---|---|---|---|
| Single-agent (15 runs) | Cell acc. | +0.001 | 15/15 |
| Bdry sharp. | +0.010 | 15/15 | |
| Brier score | −0.006 | 15/15 | |
| Multi-robot, dynamic | Cell acc. | +0.011 | 15/15 |
| Bdry sharp. | +0.070 | 15/15 | |
| Map entropy | −0.026 | 15/15 | |
| Multi-robot, noisy | Cell acc. | +0.009 | 15/15 |
| Bdry sharp. | +0.063 | 15/15 | |
| Map entropy | −0.026 | 15/15 | |
| Intel Lab (R = 2, 4) | Cell acc. | +0.018 to +0.022 | CI excl. 0 |
| Bdry sharp. | — | n.s. | |
| Brier score | −0.013 to −0.017 | CI excl. 0 | |
| Freiburg 079 (R = 2, 4) | Cell acc. | +0.007 | CI excl. 0 |
| Bdry sharp. | +0.010 to +0.011 | CI excl. 0 | |
| Brier score | −0.007 | CI excl. 0 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Berlenko, T.; Krinkin, K. Sensor-Model Matching for Controlled Comparison of Bayesian and Belief-Function Occupancy Grid Fusion. Sensors 2026, 26, 4266. https://doi.org/10.3390/s26134266
Berlenko T, Krinkin K. Sensor-Model Matching for Controlled Comparison of Bayesian and Belief-Function Occupancy Grid Fusion. Sensors. 2026; 26(13):4266. https://doi.org/10.3390/s26134266
Chicago/Turabian StyleBerlenko, Tatiana, and Kirill Krinkin. 2026. "Sensor-Model Matching for Controlled Comparison of Bayesian and Belief-Function Occupancy Grid Fusion" Sensors 26, no. 13: 4266. https://doi.org/10.3390/s26134266
APA StyleBerlenko, T., & Krinkin, K. (2026). Sensor-Model Matching for Controlled Comparison of Bayesian and Belief-Function Occupancy Grid Fusion. Sensors, 26(13), 4266. https://doi.org/10.3390/s26134266
