Optimizing RTAB-Map Viewability to Reduce Cognitive Workload in VR Teleoperation: A User-Centric Approach
Abstract
1. Introduction
2. Related Works
2.1. 2D Video-Based Teleoperation Systems
2.2. 3D Video-Based Teleoperation Systems
2.3. RTAB-Map-Based Teleoperation Systems
3. Materials and Methods
3.1. RTAB-Map Processing Pipeline Overview
3.2. Selection of Viewability-Related RTAB-Map Parameters
3.3. Taguchi Experimental Design for Viewability Optimization
3.4. Subjective Workload and Immersion Assessment
4. Results
4.1. Experiment Setup
4.2. Taguchi-Based Experimental Design for Viewability Optimization
4.3. Target Object Picking Using 3D-Map Experiment
5. Discussion
Limitations
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Phan, V.D.; Mai, T.A.; Ho, S.P.; Dang, T.S.; Le, V.C.; Dinh, V.N. Development of an Adaptive Integral Terminal Sliding Mode Tracking Control for a Wheeled Mobile Robot with Time Delay Estimation. Int. J. Control Autom. Syst. 2025, 23, 2399–2410. [Google Scholar] [CrossRef]
- Liu, H.; Nasiriany, S.; Zhang, L.; Bao, Z.; Zhu, Y. Robot learning on the job: Human-in-the-loop autonomy and learning during deployment. Int. J. Rob. Res. 2025, 44, 1727–1742. [Google Scholar] [CrossRef]
- Frijns, H.A.; Hirschmanner, M.; Sienkiewicz, B.; Hönig, P.; Indurkhya, B.; Vincze, M. Human-in-the-loop error detection in an object organization task with a social robot. Front. Robot. AI 2024, 11, 1356827. [Google Scholar] [CrossRef] [PubMed]
- Zhou, J.; Liang, B.; Huang, J.; Zhang, I.; Abbeel, P.; Tomizuka, M. Global-local interface for on-demand teleoperation. arXiv 2025, arXiv:2502.09960. [Google Scholar]
- Martinetti, A.; Chemweno, P.K.; Nizamis, K.; Fosch-Villaronga, E. Redefining safety in light of human-robot interaction: A critical review of current standards and regulations. Front. Chem. Eng. 2021, 3, 666237. [Google Scholar] [CrossRef]
- Rosa-Garcia, A.D.L.; Marrufo, A.I.S.; Luviano-Cruz, D.; Rodriguez-Ramirez, A.; Garcia-Luna, F. Bridging Remote Operations and Augmented Reality: An Analysis of Current Trends. IEEE Access 2025, 13, 36502–36526. [Google Scholar] [CrossRef]
- Wan, K.; Li, C.; Lo, F.S.; Zheng, P. A virtual reality-based immersive teleoperation system for remote human-robot collaborative manufacturing. Manuf. Lett. 2024, 41, 43–50. [Google Scholar] [CrossRef]
- Kasno, M.A.; Yahaya, I.N.; Jung, J.-W. Affordable 3D Orientation Visualization Solution for Working Class Remotely Operated Vehicles (ROV). Sensors 2024, 24, 5097. [Google Scholar] [CrossRef]
- Su, Y.; Chen, X.; Zhou, T.; Pretty, C.; Chase, G. Mixed reality-integrated 3D/2D vision mapping for intuitive teleoperation of mobile manipulator. Robot. Comput. Integr. Manuf. 2022, 77, 102332. [Google Scholar] [CrossRef]
- Kuo, C.Y.; Huang, C.C.; Tsai, C.H.; Shi, Y.S.; Smith, S. Development of an immersive SLAM-based VR system for teleoperation of a mobile manipulator in an unknown environment. Comput. Ind. 2021, 132, 103502. [Google Scholar] [CrossRef]
- Naceri, A.; Mazzanti, D.; Bimbo, J.; Tefera, Y.T.; Prattichizzo, D.; Caldwell, D.G.; Mattos, L.S.; Deshpande, N. The vicarios virtual reality interface for remote robotic teleoperation: Teleporting for intuitive tele-manipulation. J. Intell. Robot. Syst. 2021, 101, 80. [Google Scholar] [CrossRef]
- Prunella, M.; Altini, N.; D’Alessandro, R.; Schirizzi, A.; Ricci, A.D.; Lotesoriere, C.; Scarabaggio, P.; Carli, R.; Dotoli, M.; Giannelli, G.; et al. Pharmacometric and Digital Twin Modeling for Adaptive Scheduling of Combination Therapy in Advanced Gastric Cancer. Comput. Methods Programs Biomed. 2025, 270, 108919. [Google Scholar] [CrossRef]
- Gallipoli, M.; Buonocore, S.; Selvaggio, M.; Fontanelli, G.A.; Grazioso, S.; Di Gironimo, G. A virtual reality-based dual-mode robot teleoperation architecture. Robotica 2024, 42, 1935–1958. [Google Scholar] [CrossRef]
- Ferrari, A.; Zenezini, G.; Rafele, C.; Carlin, A. A Roadmap towards an Automated Warehouse Digital Twin: Current implementations and future developments. IFAC-PapersOnLine 2022, 55, 1899–1905. [Google Scholar] [CrossRef]
- Huang, X.; Chen, X.; Zhang, N.; He, H.; Feng, S. ADM-SLAM: Accurate and Fast Dynamic Visual SLAM with Adaptive Feature Point Extraction, Deeplabv3pro, and Multi-View Geometry. Sensors 2024, 24, 3578. [Google Scholar] [CrossRef] [PubMed]
- Mur-Artal, R.; Montiel, J.M.M.; Tardos, J.D. ORB-SLAM: A versatile and accurate monocular SLAM system. IEEE Trans. Robot. 2015, 31, 1147–1163. [Google Scholar] [CrossRef]
- Labbé, M.; Michaud, F. RTAB-Map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and long-term online operation. J. Field Robot. 2019, 36, 416–446. [Google Scholar] [CrossRef]
- Teed, Z.; Deng, J. Droid-slam: Deep visual slam for monocular, stereo, and rgb-d cameras. Adv. Neural Inf. Process. Syst. 2021, 34, 16558–16569. [Google Scholar]
- Sumikura, S.; Shibuya, M.; Sakurada, K. OpenVSLAM: A versatile visual SLAM framework. In Proceedings of the 27th ACM International Conference on Multimedia, Nice, France, 21–25 October 2019. [Google Scholar]
- Vedadi, A.; Yousefi-Koma, A.; Yazdankhah, P.; Mozayyan, A. Comparative evaluation of rgb-d slam methods for humanoid robot localization and mapping. In Proceedings of the 11th RSI International Conference on Robotics and Mechatronics (ICRoM), Tehran, Iran, 19–21 December 2023. [Google Scholar]
- Trejos, K.; Rincón, L.; Bolaños, M.; Fallas, J.; Marín, L. 2D SLAM algorithms characterization, calibration, and comparison considering pose error, map accuracy as well as CPU and memory usage. Sensors 2022, 22, 6903. [Google Scholar] [CrossRef]
- Ferreira, F.C.; Zaera, M.; Karfakis, P.T.; Couceiro, M.S. Tailoring 3d mapping frameworks for field robotics. In Proceedings of the ICRA 2022 Workshop in Innovation in Forestry Robotics: Research and Industry Adoption, Philadelphia, PA, USA, 23–27 May 2022. [Google Scholar]
- Lin, C.-J.; Peng, C.-C.; Lu, S.-Y. Real-Time Localization for an AMR Based on RTAB-MAP. Actuators 2025, 14, 117. [Google Scholar] [CrossRef]
- Lee, Y.; Kim, H.; Ji, H.; Heo, J.; Lee, Y.; Kang, J.; Lee, J.; Lee, D. Human-in-the-Loop Gaussian Splatting for Robotic Teleoperation. IEEE Robot. Autom. Lett. 2025, 11, 105–112. [Google Scholar] [CrossRef]
- Jin, Y.; Soto, D.A.P.; Rossiter, J.A.; Veres, S.M. Advanced environment modelling for remote teleoperation to improve operator experience. In Proceedings of the International Conference on Artificial Intelligence and Its Applications, Virtual, 9–10 December 2021. [Google Scholar]
- Page, I.; Susbielle, P.; Aycard, O.; Wieber, P.B. Real-time Photorealistic Mapping for Situational Awareness in Robot Teleoperation. arXiv 2025, arXiv:2509.06433. [Google Scholar] [CrossRef]
- Doisy, G.; Ronen, A.; Edan, Y. Comparison of Three Different Techniques for Camera and Motion Control of a Teleoperated Robot. Appl. Ergon. 2017, 58, 527–534. [Google Scholar] [CrossRef]
- Liu, X.; Ye, J.; Xue, Y.; Sheng, Y.; Wang, Y.; Lin, J.; Song, Z.; Chen, J.; Xi, N. Optimal Viewpoints Selection for Monitoring Teleoperators Based on Event Artificial Potential Method. In Proceedings of the 2024 WRC Symposium on Advanced Robotics and Automation (WRC SARA), Beijing, China, 23 August 2024; pp. 28–33. [Google Scholar]
- Shao, S.; Zhou, Q.; Liu, Z. Mental Workload Characteristics of Manipulator Teleoperators with Different Spatial Cognitive Abilities. Int. J. Adv. Robot. Syst. 2019, 16, 1729881419888042. [Google Scholar] [CrossRef]
- Jung, Y.; Han, K.; Bae, J. A Tele-Operated Display with a Predictive Display Algorithm. IEEE Access 2019, 7, 154447–154456. [Google Scholar] [CrossRef]
- Dybvik, H.; Løland, M.; Gerstenberg, A.; Slåttsveen, K.B.; Steinert, M. A Low-Cost Predictive Display for Teleoperation: Investigating Effects on Human Performance and Workload. Int. J. Hum.-Comput. Stud. 2021, 145, 102536. [Google Scholar] [CrossRef]
- Alexopoulos, A.; Bompotas, A.; Kalogeropoulos, N.R.; Kechagias, P.; Kalogeras, A.P.; Alexakos, C. Digital Twin Based Automatic Reconfiguration of Robotic Systems in Smart Environments. arXiv 2025, arXiv:2511.00094. [Google Scholar]
- Mori, Y.; Wada, M. Development of 3D Digital-Twin System for Remote-Control Operation in Construction. In Proceedings of the 41st International Symposium on Automation and Robotics in Construction (ISARC), Lille, France, 3–5 June 2024; pp. 958–964. [Google Scholar]
- Hroob, I.; Polvara, R.; Molina, S.; Cielniak, G.; Hanheide, M. Benchmark of visual and 3D lidar SLAM systems in simulation environment for vineyards. In Annual Conference Towards Autonomous Robotic Systems (TAROS); Springer: Cham, Switzerland, 2021. [Google Scholar]
- Jamaludin, A.; Yatim, N.M.; Masuan, N.A.; Adam, N.M.; Suarin, N.A.S.; Sulong, P.M.; Radzi, S.S.M. SLAM Performance Evaluation on Uneven Terrain Under Varying Illuminance Conditions and Trajectory Lengths. IEEE Access 2025, 13, 4642–46447. [Google Scholar] [CrossRef]
- Nagarajan, N.; Zhang, H.; Liu, W.; Gu, J. Multi-Objective Optimization of RTAB-Map parameters using Genetic Algorithm for indoor 2D SLAM. Procedia Comput. Sci. 2024, 250, 172–181. [Google Scholar] [CrossRef]
- Yun, H.; Yoo, S. Semantic Zone Based 3D Map Management for Mobile Robot. arXiv 2025, arXiv:2512.12228. [Google Scholar] [CrossRef]
- Stedman, H.; Kocer, B.B.; Kovac, M.; Pawar, V.M. VRTAB-Map: A Configurable Immersive Teleoperation Framework with Online 3D Reconstruction. In Proceedings of the 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Singapore, 17–21 October 2022; pp. 104–110. [Google Scholar]
- Stotko, P.; Krumpen, S.; Schwarz, M.; Lenz, C.; Behnke, S.; Klein, R.; Weinmann, M. A VR System for Immersive Teleoperation and Live Exploration with a Mobile Robot. In Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China, 3–8 November 2019; pp. 3630–3637. [Google Scholar]
- Palazzo, L.; Suglia, V.; Grieco, S.; Buongiorno, D.; Pagano, G.; Bevilacqua, V.; D’Addio, G. Optimized Deep Learning-Based Pathological Gait Recognition Explored Through Network Analysis of Inertial Data. In Proceedings of the 2025 IEEE Medical Measurements & Applications Conference (MeMeA), Chania, Greece, 28–30 May 2025; pp. 1–5. [Google Scholar]
- Suglia, V.; Brunetti, A.; Pasquini, G.; Caputo, M.; Marvulli, T.M.; Sibilano, E.; Della Bella, S.; Carrozza, P.; Beni, C.; Naso, D.; et al. A Serious Game for the Assessment of Visuomotor Adaptation Capabilities during Locomotion Tasks Employing an Embodied Avatar in Virtual Reality. Sensors 2023, 23, 5017. [Google Scholar] [CrossRef]
- Labbé, M.; Michaud, F. Appearance-Based Loop Closure Detection for Online Large-Scale and Long-Term Operation. IEEE Trans. Robot. 2013, 29, 734–745. [Google Scholar] [CrossRef]
- Labbé, M.; Michaud, F. Memory Management for Real-Time Appearance-Based Loop Closure Detection. In Proceedings of the 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), San Francisco, CA, USA, 25–30 September 2011; pp. 1271–1276. [Google Scholar]
- García, A.; Javier-López, J.; Monsalve-Serrano, J.; Iñiguez, E. Optimization Methodology Combining Taguchi Design and Response Surface Method to Maximize a Compression Ignition Engine Efficiency Fueled with Oxygenated Synthetic Fuel. Fuel 2025, 381, 133372. [Google Scholar] [CrossRef]
- Jiang, J.; Legrand, D.; Severn, R.; Miikkulainen, R. A Comparison of the Taguchi Method and Evolutionary Optimization in Multivariate Testing. In Proceedings of the 2020 IEEE Congress on Evolutionary Computation (CEC), Glasgow, UK, 19–24 July 2020; pp. 1–6. [Google Scholar]
- Prokhorov, D.; Zhukov, D.; Barinova, O.; Konushin, A.; Vorontsova, A. Measuring Robustness of Visual SLAM. In Proceedings of the 2019 16th International Conference on Machine Vision Applications (MVA), Tokyo, Japan, 27–31 May 2019; pp. 1–6. [Google Scholar]
- Agustinah, T.; Nugraha, Y.E.; Nurhadi, A.R.; Maynad, V.C. Dynamic Mapping and 3D Perception Using Voxel Grid and Modified Artificial Potential Fields for Indoor Locomotion. IEEE Access 2025, 13, 71288–71305. [Google Scholar] [CrossRef]
- Hart, S.G.; Staveland, L.E. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Adv. Psychol. 1988, 52, 139–183. [Google Scholar]
- Noh, D.; Choi, H.; Jeon, H.; Kim, T.; Lee, D. Upper Extremity Motion-Based Telemanipulation with Component-Wise Rescaling of Spatial Twist and Parameter-Invariant Skeletal Kinematics. Mathematics 2024, 12, 358. [Google Scholar] [CrossRef]










| Stage | Group | Parameter |
|---|---|---|
| Node generation | Node generation criteria | RGBD/LinearUpdate |
| RGBD/AngularUpdate | ||
| RGBD/ProximityBySpace | ||
| Input feature quality | Mem/ImagePreDecimation | |
| Kp/MaxFeatures | ||
| Kp/DetectorStrategy | ||
| Map generation | Resolution density | Grid/CellSize |
| Grid/DepthDecimation | ||
| Grid/RangeMax | ||
| Noise removal | Grid/NoiseFilteringMinNeighbors | |
| Grid/NoiseFilteringRadius | ||
| Grid/NormalsK |
| Stage | Parameter | Description |
|---|---|---|
| Node generation | RGBD/LinearUpdate | Node generation based on distance moved. |
| RGBD/AngularUpdate | Node generation based on angle rotated. | |
| Mem/ImagePreDecimation | Downsampling rate for input image resolution. | |
| Loop & Proximity | Rtabmap/DetectionRate | Frequency of loop closure detection. |
| Map generation | Grid/CellSize | Resolution of the occupancy grid. |
| Grid/DepthDecimation | Ratio to downsample depth images. | |
| Grid/NoiseFilteringMinNeighbors | Minimum neighbors for a point to be valid. | |
| Grid/NoiseFilteringRadius | Radius size for neighbor searching. |
| DepthDecimation | ImagePreDecimation | DetectionRate (Hz) | Process Time (s) |
|---|---|---|---|
| 2 | 4 | 1 | 0.5 |
| 4 | 4 | 1 | 0.1 |
| DepthDecimation (Rate) | CellSize (m) | ImagePreDecimation (Rate) | NoiseFilteringMinNeighbors (No.) | |
|---|---|---|---|---|
| Level1 | 4 | 0.002 | 1 | 9 |
| Level2 | 5 | 0.004 | 2 | 5 |
| Level3 | - | 0.008 | 4 | 1 |
| Default | 4 | 0.05 | 1 | 5 |
| NoiseFilteringRadius (m) | DetectionRate (Hz) | AngularUpdate (rad) | LinearUpdate (m) | |
| Level1 | 0.2 | 0.5 | 0.1 | 0.1 |
| Level2 | 0.1 | 1.0 | 0.01 | 0.01 |
| Level3 | 0.0 | 2.0 | 0.0 | 0.0 |
| Default | 0.0 | 1.0 | 0.1 | 0.1 |
| Parameter | Levels | Test | df | Statistic | p (Raw) | p (Holm) |
|---|---|---|---|---|---|---|
| DepthDecimation | 2 | Wilcoxon | 1 | |||
| CellSize | 3 | Friedman | 2 | |||
| ImagePreDecimation | 3 | Friedman | 2 | |||
| NoiseFilteringMinNeighbors | 3 | Friedman | 2 | |||
| NoiseFilteringRadius | 3 | Friedman | 2 | |||
| DetectionRate | 3 | Friedman | 2 | |||
| AngularUpdate | 3 | Friedman | 2 | |||
| LinearUpdate | 3 | Friedman | 2 |
| Question | Scale | Test | df | Statistic | p (Raw) | p (Holm) |
|---|---|---|---|---|---|---|
| Q1 (Mental) | Likert (1–5) | Friedman | 2 | |||
| Q2 (Physical) | Likert (1–5) | Friedman | 2 | |||
| Q3 (Temporal) | Likert (1–5) | Friedman | 2 | |||
| Q4 (Performance) | Likert (1–5) | Friedman | 2 | |||
| Q5 (Effort) | Likert (1–5) | Friedman | 2 | |||
| Q6 (Frustration) | Likert (1–5) | Friedman | 2 | |||
| Q7 (Immersion) | Likert (1–5) | Friedman | 2 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Yoon, H.; Choi, H.; Jeong, J.; Lee, D. Optimizing RTAB-Map Viewability to Reduce Cognitive Workload in VR Teleoperation: A User-Centric Approach. Mathematics 2026, 14, 579. https://doi.org/10.3390/math14030579
Yoon H, Choi H, Jeong J, Lee D. Optimizing RTAB-Map Viewability to Reduce Cognitive Workload in VR Teleoperation: A User-Centric Approach. Mathematics. 2026; 14(3):579. https://doi.org/10.3390/math14030579
Chicago/Turabian StyleYoon, Hojin, Haegyeom Choi, Jaehoon Jeong, and Donghun Lee. 2026. "Optimizing RTAB-Map Viewability to Reduce Cognitive Workload in VR Teleoperation: A User-Centric Approach" Mathematics 14, no. 3: 579. https://doi.org/10.3390/math14030579
APA StyleYoon, H., Choi, H., Jeong, J., & Lee, D. (2026). Optimizing RTAB-Map Viewability to Reduce Cognitive Workload in VR Teleoperation: A User-Centric Approach. Mathematics, 14(3), 579. https://doi.org/10.3390/math14030579

