Comparative Performance Evaluation of Multi-Type LiDAR Sensors and Their Applicability to Sidewalk HD Mapping
Abstract
1. Introduction
1.1. Background and Motivation
1.2. Objectives and Scope
2. Materials and Methods
2.1. Evaluation Procedure and Study Sites
2.2. Sensor Configuration and Survey Operation
2.2.1. Terrestrial LiDAR
2.2.2. Cart-Mounted Mobile Mapping System
2.2.3. Backpack-Type LiDAR
2.2.4. Handheld LiDAR
2.3. Data Processing and Registration Procedure
2.4. Definition of Evaluation Items and Indicators
3. Results of Platform Performance Comparison
3.1. Segment-Based Performance Comparison
3.1.1. Comparison of Positional Accuracy
3.1.2. Point Density and Continuity of Coverage
3.1.3. Barrier Extraction and Occlusion Recovery Performance
3.1.4. Work Productivity and On-Site Safety
3.2. Applicability to Sidewalk HD Map Construction
3.2.1. Applicability for RD_PATHWAY and PDST_LINK
3.2.2. Applicability for PDST_NODE, PDST_FACILITY and Barrier Representation
4. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Park, S.; Kwon, Y. A Study on Pedestrians’ Satisfaction and Preferences for Green Patterns according to the Sidewalk Width Using VR: The Case of Seoul, South Korea. Land 2023, 12, 552. [Google Scholar] [CrossRef]
- He, B.; Wei, D. Human Factor Performance Evaluation Model for Barrier-Free Access Facilities in Residential Communities Based on Demand Priority Levels of Four Typical Ramps. Sustainability 2024, 16, 7035. [Google Scholar] [CrossRef]
- Tam, V.W.Y.; Fung, I.W.H.; Tsang, Y.T.; Chan, L. Development of a Universal Design-Based Guide for Handrails: An Empirical Study for Hong Kong Elderly. Sustainability 2018, 10, 4233. [Google Scholar] [CrossRef]
- Zhou, Z.; Xu, Z. Detecting the Pedestrian Shed and Walking Route Environment of Urban Parks with Open-Source Data: A Case Study in Nanjing, China. Int. J. Environ. Res. Public Health 2020, 17, 4826. [Google Scholar] [CrossRef]
- Fonseca, F.; Rodrigues, A.; Silva, H. Pedestrian Perceptions of Sidewalk Paving Attributes: Insights from a Pilot Study in Braga. Infrastructures 2025, 10, 79. [Google Scholar] [CrossRef]
- Xu, X.; Zhang, B.; Wang, Y.; Wang, R.; Li, D.; White, M.; Huang, X. Evaluating and Optimizing Walkability in 15-Min Post-Industrial Community Life Circles. Buildings 2025, 15, 3143. [Google Scholar] [CrossRef]
- Kim, L.; Jeong, C. Exploring Pedestrian Satisfaction and Environmental Consciousness in a Railway-Regenerated Linear Park. Land 2025, 14, 1475. [Google Scholar] [CrossRef]
- Soares Müller, A.P.; Goulart Dorneles, V.; Ruiz-Padillo, A.; Vieira Romano, F. Sidewalk Assessment from the Perspective of Accessibility: A Systematic Literature Review. J. Urban Plan. Dev. 2023, 149, 04023032. [Google Scholar] [CrossRef]
- Fernández-Arango, D.; Varela-García, F.-A.; González-Aguilera, D.; Lagüela-López, S. Automatic Generation of Urban Road 3D Models for Pedestrian Studies from LiDAR Data. Remote Sens. 2022, 14, 1102. [Google Scholar] [CrossRef]
- Jeong, J.; Yoon, J.Y.; Lee, H.; Darweesh, H.; Sung, W. Tutorial on High-Definition Map Generation for Automated Driving in Urban Environments. Sensors 2022, 22, 7056. [Google Scholar] [CrossRef] [PubMed]
- Shin, D.; Park, K.-m.; Park, M. High Definition Map-Based Localization Using ADAS Environment Sensors for Application to Automated Driving Vehicles. Appl. Sci. 2020, 10, 4924. [Google Scholar] [CrossRef]
- Wang, Y.; Chen, Q.; Zhu, Q.; Liu, L.; Li, C.; Zheng, D. A Survey of Mobile Laser Scanning Applications and Key Techniques over Urban Areas. Remote Sens. 2019, 11, 1540. [Google Scholar] [CrossRef]
- Wan, R.; Huang, Y.; Xie, R.; Ma, P. Combined Lane Mapping Using a Mobile Mapping System. Remote Sens. 2019, 11, 305. [Google Scholar] [CrossRef]
- Maghami, M.R. Impact of Dust Deposition on Photovoltaic Systems and Mitigation Strategies. Technologies 2026, 14, 15. [Google Scholar] [CrossRef]
- Park, W.; Lee, J.; Moon, C. Geohash-Based High-Definition Map Provisioning System Using Smart RSU. Sensors 2025, 25, 5509. [Google Scholar] [CrossRef]
- Elhashash, M.; Albanwan, H.; Qin, R. A Review of Mobile Mapping Systems: From Sensors to Applications. Sensors 2022, 22, 4262. [Google Scholar] [CrossRef] [PubMed]
- Suleymanoglu, B.; Soycan, M.; Toth, C. 3D Road Boundary Extraction Based on Machine Learning Strategy Using LiDAR and Image-Derived MMS Point Clouds. Sensors 2024, 24, 503. [Google Scholar] [CrossRef]
- Kalenjuk, S.; Lienhart, W. A Method for Efficient Quality Control and Enhancement of Mobile Laser Scanning Data. Remote Sens. 2022, 14, 857. [Google Scholar] [CrossRef]
- Al-Durgham, K.; Lichti, D.D.; Kwak, E.; Dixon, R. Automated Accuracy Assessment of a Mobile Mapping System with Lightweight Laser Scanning and MEMS Sensors. Appl. Sci. 2021, 11, 1007. [Google Scholar] [CrossRef]
- Kaartinen, H.; Hyyppä, J.; Kukko, A.; Jaakkola, A.; Hyyppä, H. Benchmarking the Performance of Mobile Laser Scanning Systems Using a Permanent Test Field. Sensors 2012, 12, 12814–12835. [Google Scholar] [CrossRef]
- Karam, S.; Vosselman, G.; Peter, M.; Hosseinyalamdary, S.; Lehtola, V. Design, Calibration, and Evaluation of a Backpack Indoor Mobile Mapping System. Remote Sens. 2019, 11, 905. [Google Scholar] [CrossRef]
- Gharineiat, Z.; Tarsha Kurdi, F.; Henny, K.; Gray, H.; Jamieson, A.; Reeves, N. Assessment of NavVis VLX and BLK2GO SLAM Scanner Accuracy for Outdoor and Indoor Surveying Tasks. Remote Sens. 2024, 16, 3256. [Google Scholar] [CrossRef]
- Wei, P.; Fu, K.; Villacres, J.; Ke, T.; Krachenfels, K.; Stofer, C.R.; Bayati, N.; Gao, Q.; Zhang, B.; Vanacker, E.; et al. A Compact Handheld Sensor Package with Sensor Fusion for Comprehensive and Robust 3D Mapping. Sensors 2024, 24, 2494. [Google Scholar] [CrossRef]
- Hyyppä, E.; Yu, X.; Kaartinen, H.; Hakala, T.; Kukko, A.; Vastaranta, M.; Hyyppä, J. Comparison of Backpack, Handheld, Under-Canopy UAV, and Above-Canopy UAV Laser Scanning for Field Reference Data Collection in Boreal Forests. Remote Sens. 2020, 12, 3327. [Google Scholar] [CrossRef]
- Maset, E.; Matellon, A.; Gubiani, S.; Visintini, D.; Beinat, A. Introducing SLAM-Based Portable Laser Scanning for the Metric Testing of Topographic Databases. Remote Sens. 2025, 17, 3316. [Google Scholar] [CrossRef]
- Cheng, L.; Chen, S.; Liu, X.; Xu, H.; Wu, Y.; Li, M.; Chen, Y. Registration of Laser Scanning Point Clouds: A Review. Sensors 2018, 18, 1641. [Google Scholar] [CrossRef] [PubMed]
- Liu, H.; Zhang, Y.; Lei, L.; Xie, H.; Li, Y.; Sun, S. Hierarchical Optimization of 3D Point Cloud Registration. Sensors 2020, 20, 6999. [Google Scholar] [CrossRef]
- Mikrut, S.; Kohut, P.; Pyka, K.; Tokarczyk, R.; Barszcz, T.; Uhl, T. Mobile Laser Scanning Systems for Measuring the Clearance Gauge of Railways: State of Play, Testing and Outlook. Sensors 2016, 16, 683. [Google Scholar] [CrossRef]
- Li, Z.; Tan, J.; Liu, H. Rigorous Boresight Self-Calibration of Mobile and UAV LiDAR Scanning Systems by Strip Adjustment. Remote Sens. 2019, 11, 442. [Google Scholar] [CrossRef]
- Yuan, H.; Li, G.; Wang, L.; Li, X. Research on the Improved ICP Algorithm for LiDAR Point Cloud Registration. Sensors 2025, 25, 4748. [Google Scholar] [CrossRef]
- Clotet, E.; Palacín, J. SLAMICP Library: Accelerating Obstacle Detection in Mobile Robot Navigation via Outlier Monitoring following ICP Localization. Sensors 2023, 23, 6841. [Google Scholar] [CrossRef] [PubMed]
- Aijazi, A.K.; Checchin, P. Non-Repetitive Scanning LiDAR Sensor for Robust 3D Point Cloud Registration in Localization and Mapping Applications. Sensors 2024, 24, 378. [Google Scholar] [CrossRef] [PubMed]
- Cao, Q.; Liao, Y.; Fu, Z.; Peng, H.; Ding, Z.; Huang, Z.; Huang, N.; Xiong, X.; Cai, S. An Iterative Closest Point Method for Lidar Odometry with Fused Semantic Features. Appl. Sci. 2023, 13, 12741. [Google Scholar] [CrossRef]
- Han, Z.; Xie, X.; Tang, G.; Li, P.; Li, S. A K-Dimensional Tree–Iterative Closest Point Algorithm for Overbreak and Underbreak Assessment of Mountain Tunnels. Appl. Sci. 2025, 15, 566. [Google Scholar] [CrossRef]
- Chen, Y.; Tang, J.; Jiang, C.; Zhu, L.; Lehtomäki, M.; Kaartinen, H.; Kaijaluoto, R.; Wang, Y.; Hyyppä, J.; Hyyppä, H.; et al. The Accuracy Comparison of Three Simultaneous Localization and Mapping (SLAM)-Based Indoor Mapping Technologies. Sensors 2018, 18, 3228. [Google Scholar] [CrossRef]
- Ryding, J.; Williams, E.; Smith, M.J.; Eichorn, M.P. Assessing Handheld Mobile Laser Scanners for Forest Surveys. Remote Sens. 2015, 7, 1095–1111. [Google Scholar] [CrossRef]
- Kovanič, L.; Peťovský, P.; Topitzer, B.; Blišťan, P.; Tokarčík, O. Qualitative Assessment of Point Cloud from SLAM-Based MLS for Quarry Digital Twin Creation. Appl. Sci. 2025, 15, 12326. [Google Scholar] [CrossRef]
- Huang, L. Review on LiDAR-Based SLAM Techniques. In Proceedings of the 2021 International Conference on Signal Processing and Machine Learning (CONF-SPML), Stanford, CA, USA, 14 November 2021; pp. 163–168. [Google Scholar] [CrossRef]
- Chrbolková, A.; Štroner, M.; Urban, R.; Michal, O.; Křemen, T.; Braun, J. A Comparative Study of Indoor Accuracies Between SLAM and Static Scanners. Appl. Sci. 2025, 15, 8053. [Google Scholar] [CrossRef]
- Ran, Y.; Xu, X.; Tan, Z.; Luo, M. A Review of 2D Lidar SLAM Research. Remote Sens. 2025, 17, 1214. [Google Scholar] [CrossRef]









| ID | Section Name | Location | Length |
|---|---|---|---|
| 1 | Park-road sidewalk inside Olympic Park | 424, Olympic-ro, Songpa-gu, Seoul | 3.4 km |
| 2 | Downtown sidewalk near Gwanak Elementary School | Around 1733-7, Gwanyang-dong, Dongan-gu, Anyang-si | 1.7 km |
| Acquisition Mode | Static (Tripod) |
|---|---|
| SLAM | Not applied |
| GNSS | Not equipped |
| Correction | GCP |
| LiDAR rate (pts/s) | 2,000,000 |
| Channels | 1 |
| Range (m) | 0.5–130 |
| Fine accuracy | 0.1 cm |
| Cameras | - |
| Coverage (FOV) | - |
| Acquisition Mode | Cart-Mounted Mobile Mapping |
|---|---|
| SLAM | Not applied |
| GNSS | Equipped |
| Correction | PPK |
| LiDAR rate (pts/s) | 1,000,000 |
| Channels | 1 |
| Range (m) | 0–119 |
| Fine accuracy | 1–2 cm |
| Cameras | 4 × 4000 × 3000 |
| Coverage (FOV) | 360° |
| Acquisition Mode | Backpack (Pedestrian) |
|---|---|
| SLAM | Not applied |
| GNSS | Equipped |
| Correction | PPK |
| LiDAR rate (pts/s) | 600,000/300,000 |
| Channels | 16/32 |
| Range (m) | 0–100 |
| Fine accuracy | 2–3 cm |
| Cameras | 5 × 2046 × 2046 |
| Coverage (FOV) | 360° |
| Acquisition Mode | Backpack (Pedestrian) |
|---|---|
| SLAM | Applied |
| GNSS | Equipped |
| Correction | RTK/PPK |
| LiDAR rate (pts/s) | 640,000 |
| Channels | 32 |
| Range (m) | 0.3–120 |
| Fine accuracy | 1 cm |
| Cameras | 4 × 1920×1280 |
| Coverage (FOV) | 360° |
| Acquisition Mode | Handheld (Near-Field) |
|---|---|
| SLAM | Not applied |
| GNSS | Not equipped |
| Correction | GCP/external alignment |
| LiDAR rate (pts/s) | 420,000 |
| Channels | 1 |
| Range (m) | 0.5–25 |
| Fine accuracy | 1 cm |
| Cameras | 3 × 4096 × 2048 |
| Coverage (FOV) | 360° |
| Acquisition Mode | Handheld (Pedestrian) |
|---|---|
| SLAM | Applied |
| GNSS | Equipped |
| Correction | RTK/PPK |
| LiDAR rate (pts/s) | 320,000 |
| Channels | 16 |
| Range (m) | 0.05–120 |
| Fine accuracy | 1 cm |
| Cameras | 3 × 2592 × 1944 |
| Coverage (FOV) | 270° |
| Platform | RMSE (XY) | RMSE (Z) | 95% CI (XY) | 95% CI (Z) | Absolute Accuracy (≤0.2 m) | MMS Alignment (95% CI ≤ 0.1 m) |
|---|---|---|---|---|---|---|
| Cart-mounted MMS | 0.045 | 0.012 | 0.078 | 0.024 | Yes | Yes |
| Backpack LiDAR | 0.020 | 0.020 | 0.035 | 0.039 | Yes | Yes |
| SLAM-based backpack | 0.042 | 0.021 | 0.073 | 0.041 | Yes | Yes |
| Handheld LiDAR | 0.091 | 0.079 | 0.158 | 0.155 | Yes | No |
| SLAM-based handheld | 0.020 | 0.009 | 0.035 | 0.018 | Yes | Yes |
| Platform | Measured Width | TLS (GT) | Δabs (= |Platform − TLS|) |
|---|---|---|---|
| TLS (Ground Truth) | 3.090 | 3.090 | 0.000 |
| Cart-mounted MMS | 3.126 | 3.090 | 0.036 |
| Backpack LiDAR | 3.128 | 3.090 | 0.038 |
| SLAM-based backpack | 3.123 | 3.090 | 0.033 |
| Handheld LiDAR | 3.136 | 3.090 | 0.046 |
| SLAM-based handheld | 3.089 | 3.090 | 0.001 |
| Platform | LiDAR Rate (pts/s) | (PDI_{Max}) (pts/m2) | Surface Density (Open Sky) (pts/m2) | Surface Density (Occluded/Downtown) (pts/m2) |
|---|---|---|---|---|
| Terrestrial LiDAR | 1,802,347 | 409,612 | 3217 | 1893 |
| Cart-mounted MMS | 903,581 | 121,437 | 1963 | 1241 |
| Backpack LiDAR | 552,904 | 16,732 | 4786 | 2917 |
| SLAM-based backpack | 618,429 | 22,389 | 6143 | 3712 |
| Handheld LiDAR | 383,116 | 9764 | 2287 | 1463 |
| SLAM-based handheld | 312,578 | 14,183 | 3024 | 1821 |
| Platform | Estimated Grade (%) | Error vs. 5.0% (% p) | Absolute Error (% p) | Pass (±1.0% p) |
|---|---|---|---|---|
| Cart-mounted MMS | 4.9 | −0.1 | 0.1 | Yes |
| Backpack LiDAR | 5.2 | +0.2 | 0.2 | Yes |
| SLAM-based backpack | 5.2 | +0.2 | 0.2 | Yes |
| Handheld LiDAR | 5.3 | +0.3 | 0.3 | Yes |
| SLAM-based handheld | 5.1 | +0.1 | 0.1 | Yes |
| Terrestrial LiDAR | 5.0 | – | – | – |
| Platform | Meets Positional-Accuracy Criterion | Detects 2 cm Steps | Represents Longitudinal Grade (±1%) | Detailed Barrier Geometry |
|---|---|---|---|---|
| Terrestrial LiDAR | ○ | ○ | ○ | ○ |
| Cart-mounted MMS | ○ | ○ | ○ | △ |
| Backpack LiDAR | ○ | X | ○ | ○ |
| SLAM-based backpack | ○ | ○ | ○ | ○ |
| Handheld LiDAR | ○ | X | ○ | △ |
| SLAM-based handheld | ○ | ○ | ○ | ○ |
| Environment/Purpose | Primary Platform | Supplementary Platform | Expected Benefits |
|---|---|---|---|
| Open-sky, long baseline reference tracks | Cart-mounted MMS | Backpack | Continuous trajectories; high vertical precision |
| Facility-dense neighborhood streets | Backpack | Handheld | Enhanced planimetric alignment and mapping continuity |
| Hard-to-access areas and around street furniture | Handheld | Backpack | Reinforcement of fine features; improved boundary depiction |
| Road–sidewalk boundary connections | Cart-mounted MMS (reference) + backpack/handheld in combination | - | Ensured boundary continuity and relative alignment |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Lee, D.; Kang, S.; Lee, J.; Kim, J. Comparative Performance Evaluation of Multi-Type LiDAR Sensors and Their Applicability to Sidewalk HD Mapping. Sensors 2026, 26, 1480. https://doi.org/10.3390/s26051480
Lee D, Kang S, Lee J, Kim J. Comparative Performance Evaluation of Multi-Type LiDAR Sensors and Their Applicability to Sidewalk HD Mapping. Sensors. 2026; 26(5):1480. https://doi.org/10.3390/s26051480
Chicago/Turabian StyleLee, Dongha, Sungho Kang, Jaecheol Lee, and Junghyun Kim. 2026. "Comparative Performance Evaluation of Multi-Type LiDAR Sensors and Their Applicability to Sidewalk HD Mapping" Sensors 26, no. 5: 1480. https://doi.org/10.3390/s26051480
APA StyleLee, D., Kang, S., Lee, J., & Kim, J. (2026). Comparative Performance Evaluation of Multi-Type LiDAR Sensors and Their Applicability to Sidewalk HD Mapping. Sensors, 26(5), 1480. https://doi.org/10.3390/s26051480

