Measurement Error of Markerless Motion Capture Systems Applied to Tracking Movements in Human–Object Interaction Tasks: A Systematic Review with Best Evidence Synthesis
Abstract
1. Introduction
2. Materials and Methods
2.1. Search Strategy
2.2. Eligibility Criteria
2.3. Study Selection Process
2.4. Data Extraction and Evidence Synthesis
3. Results
3.1. Characteristics of the Included Studies
3.2. Measurement Properties—Overview
3.3. Methodological Quality and Risk of Bias in the Included Studies
3.4. Evidence Synthesis
4. Discussion
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Wade, L.; Needham, L.; McGuigan, P.; Bilzon, J. Applications and limitations of current markerless motion capture methods for clinical gait biomechanics. PeerJ 2022, 10, e12995. [Google Scholar] [CrossRef]
- Jeyasingh-Jacob, J.; Crook-Rumsey, M.; Shah, H.; Joseph, T.; Abulikemu, S.; Daniels, S.; Sharp, D.J.; Haar, S. Markerless Motion Capture to Quantify Functional Performance in Neurodegeneration: Systematic Review. JMIR Aging 2024, 7, e52582. [Google Scholar] [CrossRef] [PubMed]
- Das, K.; de Paula Oliveira, T.; Newell, J. Comparison of markerless and marker-based motion capture systems using 95% functional limits of agreement in a linear mixed-effects modelling framework. Sci. Rep. 2023, 13, 22880. [Google Scholar] [CrossRef] [PubMed]
- Scataglini, S.; Abts, E.; Van Bocxlaer, C.; Van den Bussche, M.; Meletani, S.; Truijen, S. Accuracy, Validity, and Reliability of Markerless Camera-Based 3D Motion Capture Systems versus Marker-Based 3D Motion Capture Systems in Gait Analysis: A Systematic Review and Meta-Analysis. Sensors 2024, 24, 3686. [Google Scholar] [CrossRef] [PubMed]
- Needham, L.; Evans, M.; Cosker, D.P.; Wade, L.; McGuigan, P.M.; Bilzon, J.L.; Colyer, S.L. The accuracy of several pose estimation methods for 3D joint centre localisation. Sci. Rep. 2021, 11, 20673. [Google Scholar] [CrossRef]
- Lam, W.W.T.; Tang, Y.M.; Fong, K.N.K. A systematic review of the applications of markerless motion capture (MMC) technology for clinical measurement in rehabilitation. J. NeuroEng. Rehabil. 2023, 20, 57. [Google Scholar] [CrossRef]
- Franco, A.; Russo, M.; Amboni, M.; Ponsiglione, A.M.; Di Filippo, F.; Romano, M.; Amato, F.; Ricciardi, C. The Role of Deep Learning and Gait Analysis in Parkinson’s Disease: A Systematic Review. Sensors 2024, 24, 5957. [Google Scholar] [CrossRef]
- Ripic, Z.; Signorile, J.; Kuenze, C.; Eltoukhy, M. Concurrent validity of artificial intelligence-based markerless motion capture for over-ground gait analysis: A study of spatiotemporal parameters. J. Biomech. 2022, 143, 111278. [Google Scholar] [CrossRef]
- Wren, T.; Isakov, P.; Rethlefsen, S. Comparison of kinematics between Theia markerless and conventional marker-based gait analysis in clinical patients. Gait Posture 2023, 104, 9–14. [Google Scholar] [CrossRef]
- Torvinen, P.; Ruotsalainen, K.S.; Zhao, S.; Cronin, N.; Ohtonen, O.; Linnamo, V. Evaluation of 3D Markerless Motion Capture System Accuracy during Skate Skiing on a Treadmill. Bioengineering 2024, 11, 136. [Google Scholar] [CrossRef]
- Coll, I.; Mavor, M.P.; Karakolis, T.; Graham, R.B.; Clouthier, A.L. Validation of Markerless Motion Capture for Soldier Movement Patterns Assessment Under Varying Body-Borne Loads. Ann. Biomed. Eng. 2025, 53, 358–370. [Google Scholar] [CrossRef]
- Bonakdar, A.; Riahi, N.; Shakourisalim, M.; Miller, L.; Tavakoli, M.; Rouhani, H.; Golabchi, A. Validation of markerless vision-based motion capture for ergonomics risk assessment. Int. J. Ind. Ergon. 2025, 107, 103734. [Google Scholar] [CrossRef]
- Bae, K.; Lee, S.; Bak, S.Y.; Kim, H.S.; Ha, Y.; You, J.H. Concurrent validity and test reliability of the deep learning markerless motion capture system during the overhead squat. Sci. Rep. 2024, 14, 29462. [Google Scholar] [CrossRef] [PubMed]
- Lam, W.W.T.; Fong, K.N.K. The application of markerless motion capture (MMC) technology in rehabilitation programs: A systematic review and meta-analysis. Virtual Real. 2023, 27, 3363–3378. [Google Scholar] [CrossRef]
- Bhola, S.; Kim, H.B.; Kim, H.S.; Gu, B.; Yoo, J.I. Does advancement in marker-less pose-estimation mean more quality research? A systematic review. Front. Behav. Neurosci. 2025, 19, 1663089. [Google Scholar] [CrossRef]
- Scott, B.; Seyres, M.; Philp, F.; Chadwick, E.K.; Blana, D. Healthcare applications of single camera markerless motion capture: A scoping review. PeerJ 2022, 10, e13517. [Google Scholar] [CrossRef] [PubMed]
- Osness, E.; Isley, S.; Bertrand, J.; Dennett, L.; Bates, J.; Van Decker, N.; Stanhope, A.; Omkar, A.; Dolgoy, N.; Ezeugwu, V.E.; et al. Markerless Motion Capture Parameters Associated with Fall Risk or Frailty: A Scoping Review. Sensors 2025, 25, 5741. [Google Scholar] [CrossRef]
- Scataglini, S.; Fontinovo, E.; Khafaga, N.; Khan, M.U.; Faizan Khan, M.; Truijen, S. A Systematic Review of the Accuracy, Validity, and Reliability of Markerless Versus Marker Camera-Based 3D Motion Capture for Industrial Ergonomic Risk Analysis. Sensors 2025, 25, 5513. [Google Scholar] [CrossRef]
- Sethi, D.; Prakash, C.; Bharti, S. Latest Trends in Gait Analysis Using Deep Learning Techniques: A Systematic Review. In Proceedings of the International Conference on Artificial Intelligence and Speech Technology. AIST 2021; Communications in Computer and Information Science; Dev, A., Agrawal, S.S., Sharma, A., Eds.; Springer: Cham, Switzerland, 2022; Volume 1546, pp. 363–375. [Google Scholar] [CrossRef]
- Huang, Y.; Taheri, O.; Black, M.J.; Tzionas, D. InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interaction from Multi-view RGB-D Images. Int. J. Comput. Vis. 2024, 132, 2551–2566. [Google Scholar] [CrossRef]
- García-Gil, G.; López-Armas, G.d.C.; Navarro, J.d.J., Jr. Human-Machine Interaction: A Vision-Based Approach for Controlling a Robotic Hand Through Human Hand Movements. Technologies 2025, 13, 169. [Google Scholar] [CrossRef]
- Kwak, W.; Yin, J.; Wang, S.; Chen, J. Advances in triboelectric nanogenerators for self-powered wearable respiratory monitoring. FlexMat 2024, 1, 5–22. [Google Scholar] [CrossRef]
- Lu, L.; Wu, J.; Zhang, Y.; Liu, C.; Hu, Y.; Chen, B.; Zhu, Y.; Mao, Y. Noncontact 3D gesture recognition enabled VR human–machine interface via electret-nanofiber-based triboelectric sensor. Nano Res. 2024, 18, 94907924. [Google Scholar] [CrossRef]
- Mehrizi, R.; Peng, X.; Xu, X.; Zhang, S.; Metaxas, D.; Li, K. A computer vision based method for 3D posture estimation of symmetrical lifting. J. Biomech. 2018, 69, 40–46. [Google Scholar] [CrossRef]
- Steinebach, T.; Grosse, E.; Glock, C.; Wakula, J.; Lunin, A. Accuracy evaluation of two markerless motion capture systems for measurement of upper extremities: Kinect V2 and Captiv. Hum. Factors Ergon. Manuf. Serv. Ind. 2020, 30, 291–302. [Google Scholar] [CrossRef]
- Remedios, S.; Fischer, S. Towards the Use of 2D Video-Based Markerless Motion Capture to Measure and Parameterize Movement During Functional Capacity Evaluation. J. Occup. Rehabil. 2021, 31, 754–767. [Google Scholar] [CrossRef]
- Scano, A.; Mira, R.; Cerveri, P.; Tosatti, L.; Sacco, M. Analysis of upper-limb and trunk kinematic variability: Accuracy and reliability of an RGB-D sensor. Multimodal Technol. Interact. 2020, 4, 14. [Google Scholar] [CrossRef]
- Unger, T.; Moslehian, A.S.; Peiffer, J.D.; Ullrich, J.; Gassert, R.; Lambercy, O.; Cotton, R.J.; Easthope, C.A. Differentiable Biomechanics for Markerless Motion Capture in Upper Limb Stroke Rehabilitation: A Comparison with Optical Motion Capture. arXiv 2024, arXiv:2411.14992. [Google Scholar] [CrossRef]
- Brunner, O.; Mertens, A.; Nitsch, V.; Brandl, C. Accuracy of a markerless motion capture system for postural ergonomic risk assessment in occupational practice. Int. J. Occup. Saf. Ergon. 2022, 28, 1865–1873. [Google Scholar] [CrossRef]
- Pfister, A.; West, A.; Bronner, S.; Noah, J. Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysis. J. Med. Eng. Technol. 2014, 38, 274–280. [Google Scholar] [CrossRef]
- Page, M.; McKenzie, J.; Bossuyt, P.; Boutron, I.; Hoffmann, T.; Mulrow, C.; Shamseer, L.; Tetzlaff, J.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Syst. Rev. 2021, 10, 89. [Google Scholar] [CrossRef] [PubMed]
- Higgins, J.; Thomas, J.; Chandler, J.; Cumpston, M.; Li, T.; Page, M.J.; Welch, V.A. Cochrane Handbook for Systematic Reviews of Interventions, 2nd ed.; Wiley Cochrane, John Wiley & Sons, Incorporated: Hoboken, NJ, USA, 2019. [Google Scholar]
- ICMJE|Recommendations|Protection of Research Participants. Available online: https://www.icmje.org/recommendations/browse/roles-and-responsibilities/protection-of-research-participants.html (accessed on 11 July 2025).
- Palucci Vieira, L.H.; Clemente, F.M.; Silva, R.M.; Vargas-Villafuerte, K.R.; Carpes, F.P. Measurement Properties of Wearable Kinematic-Based Data Collection Systems to Evaluate Ball Kicking in Soccer: A Systematic Review with Evidence Gap Map. Sensors 2024, 24, 7912. [Google Scholar] [CrossRef] [PubMed]
- Camomilla, V.; Cereatti, A.; Cutti, A.G.; Fantozzi, S.; Stagni, R.; Vannozzi, G. Methodological factors affecting joint moments estimation in clinical gait analysis: A systematic review. Biomed. Eng. Online 2017, 16, 106. [Google Scholar] [CrossRef]
- Vergnes, J.N.; Marchal-Sixou, C.; Nabet, C.; Maret, D.; Hamel, O. Ethics in systematic reviews. J. Med. Ethics 2010, 36, 771–774. [Google Scholar] [CrossRef] [PubMed]
- Winter, E.; Maughan, R. Requirements for ethics approvals. J. Sports Sci. 2009, 27, 985. [Google Scholar] [CrossRef]
- Reponen, E.; Rundall, T.; Shortell, S.; Blodgett, J.; Juarez, A.; Jokela, R.; Mäkijärvi, M.; Torkki, P. Benchmarking outcomes on multiple contextual levels in lean healthcare: A systematic review, development of a conceptual framework, and a research agenda. BMC Health Serv. Res. 2021, 21, 161. [Google Scholar] [CrossRef]
- Jain, M.; Duvendack, M.; Shisler, S.; Parsekar, S.; Leon, M. Effective interventions for improving routine childhood immunisation in low and middle-income countries: A systematic review of systematic reviews. BMJ Open 2024, 14, e074370. [Google Scholar] [CrossRef]
- Specialist Unit for Review Evidence (SURE). Questions to Assist with the Critical Appraisal of Randomised Controlled Trials and Other Experimental Studies, 2018. Available online: https://www.cardiff.ac.uk/__data/assets/pdf_file/0005/1142969/SURE-CA-form-for-RCTs-and-other-experimental-studies_2018.pdf (accessed on 23 April 2025).
- Bishop, C.; Turner, A.; Read, P. Effects of inter-limb asymmetries on physical and sports performance: A systematic review. J. Sports Sci. 2018, 36, 1135–1144. [Google Scholar] [CrossRef]
- van Tulder, M.; Furlan, A.; Bombardier, C.; Bouter, L.; Editorial Board of the Cochrane Collaboration Back Review Group. Updated method guidelines for systematic reviews in the cochrane collaboration back review group. Spine 2003, 28, 1290–1299. [Google Scholar] [CrossRef]
- Kwolek, B.; Michalczuk, A.; Krzeszowski, T.; Switonski, A.; Josinski, H.; Wojciechowski, K. Calibrated and synchronized multi-view video and motion capture dataset for evaluation of gait recognition. Multimed. Tools Appl. 2019, 78, 32437–32465. [Google Scholar] [CrossRef]
- Perrott, M.; Pizzari, T.; Cook, J.; McClelland, J. Comparison of lower limb and trunk kinematics between markerless and marker-based motion capture systems. Gait Posture 2017, 52, 57–61. [Google Scholar] [CrossRef]
- Gupta, I.; Kalra, P.; Iqbal, R. Gait Parameters in School Going Children Using a Marker-Less Approach. Curr. Sci. 2016, 111, 1668. [Google Scholar] [CrossRef]
- Mehrizi, R.; Peng, X.; Metaxas, D.; Xu, X.; Zhang, S.; Li, K. Predicting 3-D lower back joint load in lifting: A deep pose estimation approach. IEEE Trans. Hum.-Mach. Syst. 2019, 49, 85–94. [Google Scholar] [CrossRef]
- Wagh, V.; Scott, M.; Kraeutner, S. Quantifying Similarities Between MediaPipe and a Known Standard to Address Issues in Tracking 2D Upper Limb Trajectories: Proof of Concept Study. JMIR Form. Res. 2024, 8, e56682. [Google Scholar] [CrossRef]
- Colyer, S.L.; Evans, M.; Cosker, D.P.; Salo, A.I.T. A Review of the Evolution of Vision-Based Motion Analysis and the Integration of Advanced Computer Vision Methods Towards Developing a Markerless System. Sports Med.-Open 2018, 4, 24. [Google Scholar] [CrossRef]
- Turner, J.; Chaaban, C.; Padua, D. Validation of OpenCap: A low-cost markerless motion capture system for lower-extremity kinematics during return-to-sport tasks. J. Biomech. 2024, 171, 112200. [Google Scholar] [CrossRef]
- Leite de Barros, R.M.; Guedes Russomanno, T.; Brenzikofer, R.; Jovino Figueroa, P. A method to synchronise video cameras using the audio band. J. Biomech. 2006, 39, 776–780. [Google Scholar] [CrossRef] [PubMed]
- Drazan, J.; Phillips, W.; Seethapathi, N.; Hullfish, T.; Baxter, J. Moving outside the lab: Markerless motion capture accurately quantifies sagittal plane kinematics during the vertical jump. J. Biomech. 2021, 125, 110547. [Google Scholar] [CrossRef]
- Tosi, F.; Zhang, Y.; Gong, Z.; Sandström, E.; Mattoccia, S.; Oswald, M.R.; Poggi, M. How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: A Survey. arXiv 2025, arXiv:2402.13255. [Google Scholar] [CrossRef]
- Antognini, C.; Ortigas-Vásquez, A.; Knowlton, C.; Utz, M.; Sauer, A.; Wimmer, M.A. Comparison of markerless and marker-based motion analysis accounting for differences in local reference frame orientation. J. Biomech. 2025, 185, 112683. [Google Scholar] [CrossRef]
- Moura, F.A.; Caetano, F.G.; da Silva Torres, R. Tracking Methods in Sports: A Review of Advances, Quality, and Challenges in Performance Data. Int. J. Sports Med. 2025, 46, 621–660. [Google Scholar] [CrossRef]
- Wang, J.; Lyu, K.; Xue, J.; Gao, P.; Yan, Y. A Markerless Body Motion Capture System for Character Animation Based on Multi-view Cameras. In Proceedings of the ICASSP 2019—2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK, 12–17 May 2019; pp. 8558–8562. [Google Scholar] [CrossRef]
- Pokhariya, C.; Shah, I.N.; Xing, A.; Li, Z.; Chen, K.; Sharma, A.; Sridhar, S. MANUS: Markerless Grasp Capture Using Articulated 3D Gaussians. In Proceedings of the 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 16–22 June 2024; pp. 2197–2208. [Google Scholar] [CrossRef]
- Rajakumar, V.; Rethinam, P.; Manoharan, S.; Kirupakaran, A.M.; Sadananda Hegde, R.; Srinivasan, B. 3D Markerless Velocity Based Weight Training System for Athletes: Detection, Estimation and Validation. In Proceedings of the 2024 IEEE International Workshop on Sport, Technology and Research (STAR), Lecco, Italy, 8–10 July 2024; pp. 228–233. [Google Scholar] [CrossRef]
- Fu, R.; Zhang, D.; Jiang, A.; Fu, W.; Funk, A.; Ritchie, D.; Sridhar, S. GigaHands: A Massive Annotated Dataset of Bimanual Hand Activities. In Proceedings of the 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 10–17 June 2025; pp. 17461–17474. [Google Scholar] [CrossRef]
- Taylor, C.; McNicholas, R.; Cosker, D. Towards An Egocentric Framework for Rigid and Articulated Object Tracking in Virtual Reality. In Proceedings of the 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Atlanta, GA, USA, 22–26 March 2020; pp. 354–359. [Google Scholar] [CrossRef]
- Li, J.; Zhang, J.; Wang, Z.; Shen, S.; Wen, C.; Ma, Y.; Xu, L.; Yu, J.; Wang, C. LiDARCap: Long-range Markerless 3D Human Motion Capture with LiDAR Point Clouds. In Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 18–24 June 2022; pp. 20470–20480. [Google Scholar] [CrossRef]
- Yunardi, R.T.; Sardjono, T.A.; Mardiyanto, R. Motion Capture System based on RGB Camera for Human Walking Recognition using Marker-based and Markerless for Kinematics of Gait. In Proceedings of the 2023 IEEE 13th Symposium on Computer Applications & Industrial Electronics (ISCAIE), Penang, Malaysia, 20–21 May 2023; pp. 262–267. [Google Scholar] [CrossRef]
- Duver, M.; Wiederhold, N.; Kyrarini, M.; Banerjee, S.; Banerjee, N.K. VR-Hand-in-Hand: Using Virtual Reality (VR) Hand Tracking For Hand-Object Data Annotation. In Proceedings of the 2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), Los Angeles, CA, USA, 17–19 January 2024; pp. 325–329. [Google Scholar] [CrossRef]
- Liang, Y.; Du, G.; Li, F.; Zhang, P. Markerless Human-Manipulator Interface with Vibration Feedback Using Multi-sensors. In Proceedings of the 2019 IEEE International Conference on Real-time Computing and Robotics (RCAR), Irkutsk, Russia, 4–9 August 2019; pp. 935–940. [Google Scholar] [CrossRef]
- Chen, Y.H.; Huang, J.H. Measurement and Tracking System for Movement of the Pilot’s Body During Flight Operations. In Proceedings of the 2022 IEEE International Conference on Consumer Electronics—Taiwan, Taipei, Taiwan, 6–8 July 2022; pp. 539–540. [Google Scholar] [CrossRef]
- Scargill, T.; Premsankar, G.; Chen, J.; Gorlatova, M. Here To Stay: A Quantitative Comparison of Virtual Object Stability in Markerless Mobile AR. In Proceedings of the 2022 2nd International Workshop on Cyber-Physical-Human System Design and Implementation (CPHS), Milan, Italy, 3–6 May 2022; pp. 24–29. [Google Scholar] [CrossRef]
- Wang, Y.; Wang, Y.; Guo, J. Rapid Analysis of Human Musculoskeletal Dynamics Combining Markerless Motion Capture, Extended Kalman Filtering and Semi-Recursive Method. In Proceedings of the 2025 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2025, Hangzhou, China, 14–18 July 2025. [Google Scholar] [CrossRef]
- Zhou, Z.; Shuai, Q.; Wang, Y.; Fang, Q.; Ji, X.; Li, F.; Bao, H.; Zhou, X. QuickPose: Real-time Multi-view Multi-person Pose Estimation in Crowded Scenes. In Proceedings of the ACM SIGGRAPH 2022 Conference Proceedings, SIGGRAPH’22, Vancouver, BC, Canada, 7–11 August 2022. [Google Scholar] [CrossRef]
- Winkler, A.; Won, J.; Ye, Y. QuestSim: Human Motion Tracking from Sparse Sensors with Simulated Avatars. In Proceedings of the SIGGRAPH Asia 2022 Conference Papers, SA’22, Vancouver, BC, Canada, 7–11 August 2022. [Google Scholar] [CrossRef]
- Han, S.; Wu, P.C.; Zhang, Y.; Liu, B.; Zhang, L.; Wang, Z.; Si, W.; Zhang, P.; Cai, Y.; Hodan, T.; et al. UmeTrack: Unified multi-view end-to-end hand tracking for VR. In Proceedings of the SIGGRAPH Asia 2022 Conference Papers, SA’22, Daegu, Republic of Korea, 6–9 December 2022. [Google Scholar] [CrossRef]
- Ranganathan, R.; Wang, R.; Gebara, R.; Biswas, S. Detecting Compensatory Trunk Movements in Stroke Survivors using a Wearable System. In Proceedings of the 2017 Workshop on Wearable Systems and Applications, WearSys’17, Niagara Falls, NY, USA, 19 June 2017; pp. 29–32. [Google Scholar] [CrossRef]
- Moro, M.; Casadio, M.; Mrotek, L.A.; Ranganathan, R.; Scheidt, R.; Odone, F. On the Precision of Markerless 3d Semantic Features: An Experimental Study on Violin Playing. In Proceedings of the 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, AK, USA, 19–22 September 2021; pp. 2733–2737. [Google Scholar] [CrossRef]
- Li, S.; Schieber, H.; Corell, N.; Egger, B.; Kreimeier, J.; Roth, D. GBOT: Graph-Based 3D Object Tracking for Augmented Reality-Assisted Assembly Guidance. In Proceedings of the 2024 IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2024, Orlando, FL, USA, 16–21 March 2024; pp. 513–523. [Google Scholar] [CrossRef]
- D’Antonio, E.; Taborri, J.; Palermo, E.; Rossi, S.; Patanè, F. A markerless system for gait analysis based on OpenPose library. In Proceedings of the 2020 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Dubrovnik, Croatia, 25–28 May 2020; pp. 1–6. [Google Scholar] [CrossRef]
- Li, S.; Li, B.; Zhang, S.; Fu, H.; Lo, W.L.; Yu, J.; Sit, C.H.P.; Li, R. A markerless visual-motor tracking system for behavior monitoring in DCD assessment. In Proceedings of the 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Kuala Lumpur, Malaysia, 12–15 December 2017; pp. 774–777. [Google Scholar] [CrossRef]
- Balta, D.; Kuo, H.; Wang, J.; Porco, I.; Schladen, M.; Cereatti, A.; Lum, P.; Croce, U.D. Estimating infant upper extremities motion with an RGB-D camera and markerless deep neural network tracking: A validation study. In Proceedings of the 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Glasgow, UK, 11–15 July 2022; pp. 2548–2551. [Google Scholar] [CrossRef]
- Milef, N.; Keyser, J.; Kong, S. Towards Unstructured Unlabeled Optical Mocap: A Video Helps! In Proceedings of the ACM SIGGRAPH 2024 Conference Papers, SIGGRAPH’24, Denver, CO, USA, 27 July–1 August 2024. [Google Scholar] [CrossRef]
- North, R.; Wurr, R.; Macon, R.; Mannion, C.; Hyde, J.; Torres-Espin, A.; Rosenzweig, E.S.; Ferguson, A.R.; Tuszynski, M.H.; Beattie, M.S.; et al. Quantifying the kinematic features of dexterous finger movements in nonhuman primates with markerless tracking. In Proceedings of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Virtual, 1–5 November 2021; pp. 6110–6115. [Google Scholar] [CrossRef]
- Liangsorn, N.; Tretriluxana, S. Evaluating Marker-Based and Markerless Motion Capture Systems in Reach-to-Grasp Task. In Proceedings of the 2024 16th Biomedical Engineering International Conference (BMEiCON), Chon Buri, Thailand, 21–24 November 2024; pp. 306–309. [Google Scholar] [CrossRef]
- Jin, Y.; Qiu, Z.; Shi, Y.; Sun, S.; Wang, C.; Pan, D.; Zhao, J.; Liang, Z.; Wang, Y.; Li, X.; et al. Audio Matters Too! Enhancing Markerless Motion Capture with Audio Signals for String Performance Capture. ACM Trans. Graph. 2024, 43, 90. [Google Scholar] [CrossRef]
- Chua, Z.Y.; Yan, S.B.; Hu, J.; Lu, S. Impedance identification using tactile sensing and its adaptation for an underactuated gripper manipulation. Int. J. Control. Autom. Syst. 2018, 16, 875–886. [Google Scholar] [CrossRef]
- Lu, Y.; Chang, Z.; Lu, Y.; Wang, Y. Development and kinematics/statics analysis of rigid-flexible-soft hybrid finger mechanism with standard force sensor. Robot. Comput.-Integr. Manuf. 2021, 67, 101978. [Google Scholar] [CrossRef]
- Fan, S.; Gu, H.; Zhang, Y.; Jin, M.; Liu, H. Research on adaptive grasping with object pose uncertainty by multi-fingered robot hand. Int. J. Adv. Robot. Syst. 2018, 15, 101978. [Google Scholar] [CrossRef]
- Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef] [PubMed]


| P | E | C | O |
|---|---|---|---|
| human | markerless | gold standard | kinematics |
| able-bodied | marker-less | marker-based | valid * |
| patient | markerless motion capture | 3D marker-based motion analysis | concurrent validity |
| clinical | markerless motion capture technology | optoelectronic system | accuracy |
| load carriage | dynamic movement capture | Vicon | error |
| body-borne load | body scan | OptiTrack | correlation |
| backpack | pose estimation | Qualisys | concordance |
| walker | kinect | manual tracking | comparison |
| crutches | deeplabcut | reference | |
| cane | openpose | ||
| assisted-gait | alphapose | ||
| handling | Theia3D | ||
| neural network |
| Reference | Metrics Collected | Markerless System | Reference System | Experimental Protocol | Statistical Treatment |
|---|---|---|---|---|---|
| Bonakdar et al., 2025 [12] | Joint angles (back, knee, shoulder, elbow), JRF, REBA | PoseChecker (ML-OMC) | MB-OMC (Vicon), IMUs, force plates | Lift 12.7 kg box floor → pelvis; recordings with markers, IMUs, force plates, iPhone. | Correlations; RMSE, normalized RMSE; REBA vs. expert estimates. |
| Mehrizi et al., 2018 [24] | 3D joint angles (hip, knee, ankle, lumbar, shoulder, elbow), joint positions | Modified Twin Gaussian Process + 2 camcorders | Motion Analysis Corp. (marker-based, 45 markers) | Three symmetric lifts (floor–knuckle, knuckle–shoulder, floor–shoulder) with 10 kg box. | Euclidean distance; joint-angle diff (mean ± SD); paired t-tests. |
| Ripic et al., 2022 [8] | Spatiotemporal gait (speed, step/stride time, step length, etc.) | KinaTrax (AI-based) | SMART-DX (BTS) + force plates | 5 m walkway, self-selected speed, 3 trials; synchronous MB and ML; DLS emphasized. | ICC(2,k), Lin’s CCC; Bland–Altman; paired tests; agreement levels (poor–excellent). |
| Perrott et al., 2017 [44] | 13 joint angles (trunk, pelvis, hip/knee/ankle flexion/rotation) | Organic Motion | Vicon (Helen Hayes model) | (1) Knee Flexion Test with stick; (2) Single-Leg Squat; non-simultaneous sessions. | Paired t/Wilcoxon; Pearson/Spearman; start → peak change and peak-angle comparisons. |
| Wren et al., 2023 [9] | Lower-limb kinematics; RMSD, RMSDoffset, mean diff over gait cycle | Theia3D | Vicon Nexus (Plug-in-Gait) | Pediatric gait; concurrent capture; subgroups: orthoses, deformities, devices. | RMSD, RMSDoffset, mean diff; subgroup analyses; visual waveforms. |
| Torvinen et al., 2024 [10] | Joint-center 3D distance, joint-vector angles (elbow, shoulder, hip, knee, ankle); RMSE, ICC, r | DeepLabCut (custom) | Vicon Nexus 2.8.1 (8 cams) | Experienced skiers; G1/G3 skating on treadmill with poles; ML model trained on separate cohort. | Bland–Altman; RMSE; Pearson r; ICC; mean ± SD; LoA; . |
| Wagh et al., 2024 [47] | 2D index-finger trajectories; RMSE vs. touchscreen; frame- rate effect | MediaPipe Hands | Touchscreen (Surface Pro 7) | Trace animated shapes on touchscreen; camera capture (GoPro); resampling, normalization, Procrustes. | RMSE; TOST for equivalence; t-tests across 30/60/120 FPS; . |
| Gupta et al., 2016 [45] | Stride length/width, height of earlobe; with/without backpack | Kinect V2 | Clinical manual method | 7 m walkway; pre/post ergonomic repacking (AOTA); with vs. without backpack. | Paired t-tests; Bland–Altman; Pearson r; ; % error; linear/cubic regressions. |
| Steinebach et al., 2020 [25] | Shoulder (abd, flex) and elbow (flex) angles; static and dynamic; with/without box | Kinect V2 × 2 + Captiv IMUs | Goniometer (static), angle scale (dynamic) | (1) Static postures; (2) movements w/o objects; (3) with box (occlusion). | MAE, RMSE; Pearson/Spearman; Wilcoxon; Bland–Altman; . |
| Scano et al., 2020 [27] | 3D joint angles (shoulder, elbow, wrist, trunk); 11 DoF; angular distance; test–retest | Kinect V2 | Vicon Vero (10 IR cams) | Seated right-arm pointing and workspace exploration across 3 sectors. | RMSE; angular distance; ICC (retest); two-way ANOVA (DoF × sector), Tukey HSD; Bland–Altman; . |
| Mehrizi et al., 2019 [46] | 3D body pose; L5/S1 force and moment (kinetics); peaks & time series | DNN + 2 RGB cams | Motion Analysis Corp. (marker-based) | Sym/asym lifting of 10 kg crate across 9 conditions (3 heights × 3 end angles); synchronized capture. | RMSE; R coefficient; ICC (peaks); Bland–Altman; ICC for peak moments/forces. |
| Coll et al., 2025 [11] | Joint angles (hip, knee, ankle); joint reaction forces; EMG timing | Theia3D (7 RGB cams) | Vicon (11 IR cams, 120 Hz) + force plates + EMG | Walk/run under 4 military loads (5–41 kg) over 6 m; real rifle; OpenSim modeling. | RMSE; Pearson r; Bland–Altman LOA; RM-ANOVA (joint × load), Tukey; forces to body-weight (×BW). |
| Remedios & Fischer, 2021 [26] | Peak joint angles (knee, trunk, shoulder); shoulder abd; FSL; COG-to-load; hip–knee MARP | Wrnch AI (2D, sagittal) | Vicon 3D (60 Hz) | Box lifts floor → waist under 3 loads; simultaneous 2D vs. 3D posture/balance/ coordination. | Bland–Altman; LOA; Shapiro–Wilk; outlier checks; descriptives. |
| Kwolek et al., 2019 [43] | 3D joint trajectories; Euclidean joint-position error (ankle, knee, hip, etc.) | Not reported (8 RGB cams) | Vicon MX-T40 (10 cams) | 166 sequences; walking under 4 conditions (normal, clothes change, backpack, varied gait); RGB 25 Hz, Vicon 100 Hz. | Mean joint error (cm) per joint; no inferential stats (dataset benchmarking). |
| Bae et al., 2024 [13] | 3D joint angles (shoulder, hip, knee); ROM; time-series and peaks; test–retest | Ergo system (18 RGB + DL) | Qualisys (8 cams); 36 markers (Helen Hayes) | 3 trials of overhead squat with 120 cm dowel; concurrent capture. | ICC(2,1), ICC(3,1); RMSE; Bland–Altman; CV; linear regression |
| Reference | Sample (N, Sex, Age) | Markerless System | Object | Validity Results | Summary |
|---|---|---|---|---|---|
| Bonakdar et al., 2025 [12] | ; 4M/4F; y | PoseChecker (ML-OMC) | Box (11.3 kg); ergonomic load; repetitive lifts | RMSE –; – | Authors report good validity; posture scoring aligns with experts. |
| Mehrizi et al., 2018 [24] | ; all male; y | 2 RGB cams + ML model | Box (10 kg); lifts with postural constraints | RMSE – | Valid for estimating spinal joint loads during lifting. |
| Ripic et al., 2022 [8] | ; 10M/12F; y | KinaTrax (AI skeletal) | Force plate (5 m walkway); stepped during walking | ICC ≈ 0.87–0.93 | Valid for spatiotemporal gait analysis. |
| Perrott et al., 2017 [44] | ; 10M/10F; median 28.1 (22–40) | Organic Motion | PVC stick + squat box; used during squats | RMSD –; very weak-to-strong correlations | Acceptable validity for squats and reach movements. |
| Wren et al., 2023 [9] | ; 20M/16F; 2–25 y (mixed) | Theia3D | Pediatric orthoses, walkers; worn during gait | RMSD and offset | Valid for pediatric gait with assistive devices. |
| Torvinen et al., 2024 [10] | ; 5M/5F; F: y; M: y | DeepLabCut (4 RGB) | Roller skis + poles; treadmill skating | RMSE –; ICC ; r = 0.82–0.97 | Provided valid kinematics in treadmill skiing. |
| Wagh et al., 2024 [47] | ; 9F/1M; y | MediaPipe Hands | Touchscreen panel; fingertip tracing of shapes | RMSE – mm | Valid for capturing 2D fingertip trajectories. |
| Gupta et al., 2016 [45] | ; 60M; y | Kinect V2 | Backpack (∼10% BW); worn during 7 m walkway gait | strong correlation (r1 and 2 > 0.90) | Limited but acceptable validity in children’s gait. |
| Steinebach et al., 2020 [25] | ; 7M/5F; y | Kinect V2 + Captiv IMUs | Box; overhead reach/ lift task | RMSE –; ICC ; r | Valid for upper-limb angles during lifting. |
| Scano et al., 2020 [27] | ; 8F/7M; y | Kinect V2 | Tabletop targets; seated pointing | RMSE ; ICC | Accurate and repeatable for seated pointing tasks. |
| Mehrizi et al., 2019 [46] | ; 12M; y | 2 RGB cams + DNN | Box (10 kg); simulated lift postures | RMSE –; ICC ; R | Valid for estimating lumbar loads during lifting. |
| Coll et al., 2025 [11] | ; 8F/8M; y | Theia3D | Military gear (helmet, vest, rifle); worn during tasks | ICC ; ; significant ANOVA effects | Robust validity in high-load military simulations. |
| Remedios & Fischer, 2021 [26] | ; 11M/9F; M: y; F: y | Wrnch AI (2D) | Box; lifts to 3 levels for posture scoring | Mean differences – between 2D MMC and 3D reference; Bland–Altman LoA | Valid for ergonomic posture classification. |
| Kwolek et al., 2019 [43] | ; 10F/22M; age NR | 8 RGB cams + ML triangulation | Backpack (7 trials); worn during walking | Rank-1 accuracy | High gait-recognition accuracy; not a biomechanical validity study. |
| Bae et al., 2024 [13] | ; 22M/9F; y | Ergo system (DL, multicam) | Overhead squat; full- body kinematics | RMSE –; ICC –; = 0.88–0.99 | Excellent concurrent validity and high test–retest reliability. |
| Reference | Q1 | Q2 | Q3 | Q4 | Q5 | Q6 | Q7 | Q8 | Q9 | Q10 | Q11 | Q12 | QS | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Bae et al., 2024 [13] | 2 | 2 | 1 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 23 | 96 |
| Bonakdar et al., 2025 [12] | 2 | 2 | 1 | 1 | 2 | 2 | 0 | 2 | 2 | 2 | 2 | 2 | 20 | 83 |
| Coll et al., 2025 [11] | 2 | 2 | 1 | 1 | 2 | 2 | 0 | 2 | 2 | 2 | 2 | 2 | 20 | 83 |
| Gupta et al., 2016 [45] | 2 | 2 | 1 | 2 | 0 | 1 | 0 | 1 | 0 | 1 | 2 | 0 | 12 | 50 |
| Kwolek et al., 2019 [43] | 2 | 2 | 1 | 1 | 0 | 2 | 0 | 2 | 2 | 2 | 2 | 0 | 16 | 67 |
| Mehrizi et al., 2018 [24] | 2 | 0 | 1 | 1 | 2 | 2 | 0 | 2 | 0 | 2 | 2 | 2 | 16 | 67 |
| Mehrizi et al., 2019 [46] | 2 | 2 | 1 | 1 | 2 | 2 | 0 | 2 | 1 | 2 | 2 | 2 | 19 | 79 |
| Perrott et al., 2017 [44] | 2 | 2 | 1 | 1 | 0 | 1 | 0 | 2 | 0 | 2 | 2 | 2 | 15 | 63 |
| Remedios & Fischer, 2021 [26] | 2 | 2 | 1 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 23 | 96 |
| Ripic et al., 2022 [8] | 2 | 2 | 1 | 0 | 2 | 2 | 0 | 2 | 1 | 2 | 2 | 2 | 18 | 75 |
| Scano et al., 2020 [27] | 2 | 0 | 1 | 1 | 2 | 2 | 0 | 2 | 1 | 2 | 2 | 2 | 17 | 71 |
| Steinebach et al., 2020 [25] | 2 | 2 | 1 | 1 | 2 | 2 | 0 | 2 | 1 | 2 | 2 | 2 | 19 | 79 |
| Torvinen et al., 2024 [10] | 2 | 2 | 1 | 1 | 2 | 2 | 0 | 2 | 2 | 2 | 2 | 2 | 20 | 83 |
| Wagh et al., 2024 [47] | 2 | 2 | 1 | 1 | 0 | 2 | 0 | 2 | 2 | 2 | 2 | 2 | 18 | 75 |
| Wren et al., 2023 [9] | 2 | 2 | 1 | 2 | 2 | 2 | 0 | 2 | 2 | 2 | 2 | 2 | 21 | 88 |
| Mean | 2.00 | 1.73 | 1.00 | 1.20 | 1.47 | 1.87 | 0.27 | 1.93 | 1.33 | 1.93 | 2.00 | 1.73 | 18.47 | 76.94 |
| SD | 0.00 | 0.70 | 0.00 | 0.56 | 0.92 | 0.35 | 0.70 | 0.26 | 0.82 | 0.26 | 0.00 | 0.70 | 2.97 | 12.39 |
| Group of Tasks | Methodological Quality | Validity Confirmed | Validity not Confirmed | Judgement Evidence |
|---|---|---|---|---|
| Lifting | High-quality | Bonakdar et al., 2025 [12]; Mehrizi et al., 2019 [46]; Steinebach et al., 2020 [25]; Remedios & Fischer, 2021 [26] | — | Strong evidence |
| Low-quality | Mehrizi et al., 2018 [24] | — | ||
| Locomotion | High-quality | Coll et al., 2025 [11] | Wren et al., 2023 [9] | Conflicting evidence |
| Low-quality | — | Gupta et al., 2016 [45]; Ripic et al., 2022 [8]; Kwolek et al., 2019 [43] | ||
| Squat/knee flexion | High-quality | Bae et al., 2024 [13] | — | Moderate evidence |
| Low-quality | Perrott et al., 2017 [44] | — | ||
| Reaching/ manipulation | High-quality | Torvinen et al., 2024 [10] | — | Conflicting evidence |
| Low-quality | Wagh et al., 2024 [47] | Scano et al., 2020 [27] |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Unsihuay, N.; Clavo, R.F.; Palucci Vieira, L.H. Measurement Error of Markerless Motion Capture Systems Applied to Tracking Movements in Human–Object Interaction Tasks: A Systematic Review with Best Evidence Synthesis. Technologies 2026, 14, 28. https://doi.org/10.3390/technologies14010028
Unsihuay N, Clavo RF, Palucci Vieira LH. Measurement Error of Markerless Motion Capture Systems Applied to Tracking Movements in Human–Object Interaction Tasks: A Systematic Review with Best Evidence Synthesis. Technologies. 2026; 14(1):28. https://doi.org/10.3390/technologies14010028
Chicago/Turabian StyleUnsihuay, Nicole, Rene F. Clavo, and Luiz H. Palucci Vieira. 2026. "Measurement Error of Markerless Motion Capture Systems Applied to Tracking Movements in Human–Object Interaction Tasks: A Systematic Review with Best Evidence Synthesis" Technologies 14, no. 1: 28. https://doi.org/10.3390/technologies14010028
APA StyleUnsihuay, N., Clavo, R. F., & Palucci Vieira, L. H. (2026). Measurement Error of Markerless Motion Capture Systems Applied to Tracking Movements in Human–Object Interaction Tasks: A Systematic Review with Best Evidence Synthesis. Technologies, 14(1), 28. https://doi.org/10.3390/technologies14010028

