Effectiveness of Virtual and Augmented Reality for Emergency Healthcare Training: A Randomized Controlled Trial
Abstract
:1. Introduction
2. Materials and Methods
2.1. Participants
2.2. Sample Size
2.3. Randomization
2.4. Intervention
2.5. Study Variables and Data Collection
2.6. Blinding
2.7. Statistical and Qualitative Data Analysis
3. Results
3.1. Effectiveness of AR and VR in Emergency and Urgent Healthcare Training and Student Satisfaction
3.2. Qualitative Results About Positive and Negative Aspects of Augmented Reality
3.3. Qualitative Results About Positive and Negative Aspects of Virtual Reality
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Castillo, J. Juegos serios en emergencias: Una herramienta formativa sanitaria. GARNATA 2021, 91, e212414. [Google Scholar]
- Moro, C.; Štromberga, Z.; Raikos, A.; Stirling, A. The effectiveness of virtual and augmented reality in health sciences and medical anatomy. Anat. Sci. Educ. 2017, 10, 549–559. [Google Scholar] [CrossRef] [PubMed]
- Castillo, J.M. Realidad virtual en emergencias: Una herramienta formativa sanitaria. GARNATA 2021, 91, e212411. [Google Scholar]
- Sakai, D.; Joyce, K.; Sugimoto, M.; Horikita, N.; Hiyama, A.; Sato, M.; Devitt, A.; Watanabe, M. Augmented, virtual and mixed reality in spinal surgery: A real-world experience. J. Orthop. Surg. 2020, 28, 2309499020952698. [Google Scholar] [CrossRef]
- Ricci, S.; Calandrino, A.; Borgonovo, G.; Chirico, M.; Casadio, M. Viewpoint: Virtual and augmented reality in basic and advanced life support training. JMIR Serious Games 2022, 10, e28595. [Google Scholar] [CrossRef]
- Shumaker, R. Virtual, Augmented and Mixed Reality Systems and Applications, 5th ed.; Board: Las Vegas, NV, USA, 2013; pp. 83–89. [Google Scholar]
- Ingrassia, P.L.; Mormando, G.; Giudici, E.; Strada, F.; Carfagna, F.; Lamberti, F. Augmented reality learning environment for basic life support and defibrillation training: Usability study. J. Med. Internet Res. 2020, 22, e14910. [Google Scholar] [CrossRef]
- Cutolo, F.; Cattari, N.; Fontana, U.; Ferrari, V. Optical see-through head-mounted displays with short focal distance: Conditions for mitigating parallax-related registration error. Front. Robot. AI 2020, 7, 572001. [Google Scholar] [CrossRef]
- Kwon, C.; Kim, D. A comparative study on the effectiveness of the training system of an augmented reality-based automated external defibrillator with an added tactile sense. Int. J. Innov. Technol. Explor. Eng. 2019, 8, 1091–1096. [Google Scholar]
- Strada, F.; Bottino, A.; Lamberti, F.; Mormando, G.; Ingrassia, P.L. Holo-BLSD—A holographic tool for self-training and self-evaluation of emergency response skills. IEEE Trans. Emerg. Top. Comput. 2021, 9, 1581–1595. [Google Scholar] [CrossRef]
- Balian, S.; McGovern, S.K.; Abella, B.S.; Blewer, A.L.; Leary, M. Feasibility of an augmented reality cardiopulmonary resuscitation training system for health care providers. Heliyon 2019, 5, e02205. [Google Scholar] [CrossRef]
- Sadek, O.; Baldwin, F.; Gray, R.; Khayyat, N.; Fotis, T. Impact of virtual and augmented reality on quality of medical education during the COVID-19 pandemic: A systematic review. J. Grad. Med. Educ. 2023, 15, 328–338. [Google Scholar] [CrossRef] [PubMed]
- Barteit, S.; Lanfermann, L.; Bärnighausen, T.; Neuhann, F.; Beiersmann, C. Augmented, mixed, and virtual reality-based head-mounted devices for medical education: Systematic review. In JMIR Serious Games; JMIR Publications Inc.: Toronto, ON, Canada, 2021; Volume 9. [Google Scholar]
- Barré, J.; Michelet, D.; Truchot, J.; Jolivet, E.; Recanzone, T.; Stiti, S.; Tesnière, A.; Pourcher, G. Virtual reality single-port sleeve gastrectomy training decreases physical and mental workload in novice surgeons: An exploratory study. Obes. Surg. 2019, 29, 1309–1316. [Google Scholar] [CrossRef] [PubMed]
- Barteit, S.; Jahn, A.; Banda, S.S.; Bärnighausen, T.; Bowa, A.; Chileshe, G.; Guzek, D.; Jorge, M.M.; Lüders, S.; Malunga, G.; et al. E-learning for medical education in sub-Saharan Africa and low-resource settings: Viewpoint. J. Med. Internet Res. 2019, 21, e12449. [Google Scholar] [CrossRef] [PubMed]
- Rus-Calafell, M.; Garety, P.; Sason, E.; Craig, T.J.K.; Valmaggia, L.R. Virtual reality in the assessment and treatment of psychosis: A systematic review of its utility, acceptability and effectiveness. Psychol. Med. 2018, 48, 362–391. [Google Scholar] [CrossRef]
- Harrington, C.M.; Kavanagh, D.O.; Quinlan, J.F.; Ryan, D.; Dicker, P.; O'Keeffe, D.; Traynor, O.; Tierney, S. Development and evaluation of a trauma decision-making simulator in Oculus virtual reality. Am. J. Surg. 2017, 215, 42–47. [Google Scholar] [CrossRef]
- Pantelidis, P.; Chorti, A.; Papagiouvanni, I.; Paparoidamis, G.; Drosos, C.; Panagiotakopoulos, T.; Lales, G.; Sideris, M. Virtual and augmented reality in medical education. In Medical and Surgical Education—Past, Present and Future; InTech: London, UK, 2018. [Google Scholar]
- Fealy, S.; Jones, D.; Hutton, A.; Graham, K.; McNeill, L.; Sweet, L.; Hazelton, M. The integration of immersive virtual reality in tertiary nursing and midwifery education: A scoping review. Nurse Educ. Today 2019, 79, 14–19. [Google Scholar] [CrossRef]
- Bevilacqua, R.; Maranesi, E.; Riccardi, G.R.; Di Donna, V.; Pelliccioni, P.; Luzi, R.; Lattanzio, F.; Pelliccioni, G. Non-immersive virtual reality for rehabilitation of the older people: A systematic review into efficacy and effectiveness. J. Clin. Med. 2019, 8, 1882. [Google Scholar] [CrossRef]
- Tene, T.; López, D.F.V.; Aguirre, P.E.V.; Puente, L.M.O.; Gomez, C.V. Virtual reality and augmented reality in medical education: An umbrella review. Front. Digit. Health 2024, 6, 1365345. [Google Scholar] [CrossRef]
- Helou, S.; Khalil, N.; Daou, M.; El Helou, E. Virtual reality for healthcare: A scoping review of commercially available applications for head-mounted displays. Digital Health 2023, 9, 20552076231178619. [Google Scholar] [CrossRef]
- Othman, S.Y.; Ghallab, E.; Eltaybani, S.; Mohamed, A.M. Effect of using gamification and augmented reality in mechanical ventilation unit of critical care nursing on nurse students’ knowledge.; motivation, and self-efficacy: A randomized controlled trial. Nurse Educ. Today 2024, 142, 106329. [Google Scholar] [CrossRef]
- Liao, S.C.; Shao, S.C.; Gao, S.Y.; Lai, E.C.C. Augmented reality visualization for ultrasound-guided interventions: A pilot randomized crossover trial to assess trainee performance and cognitive load. BMC Med. Educ. 2024, 24, 1–15. [Google Scholar] [CrossRef] [PubMed]
- Pickering, J.D.; Panagiotis, A.; Ntakakis, G.; Athanassiou, A.; Babatsikos, E.; Bamidis, P.D. Assessing the difference in learning gain between a mixed reality application and drawing screencasts in neuroanatomy. Anat. Sci. Educ. 2022, 15, 628–635. [Google Scholar] [CrossRef] [PubMed]
- Saruwatari, M.S.; Nguyen, T.N.; Talari, H.F.; Matisoff, A.J.; Sharma, K.V.; Donoho, K.G.; Basu, S.; Dwivedi, P.; Bost, J.E.; Shekhar, R. Assessing the effect of augmented reality on procedural outcomes during ultrasound-guided vascular access. Ultrasound Med. Biol. 2023, 49, 2346–2353. [Google Scholar] [CrossRef] [PubMed]
- Kim, J.Y.; Lee, J.S.; Lee, J.H.; Park, Y.S.; Cho, J.; Koh, J.C. Virtual reality simulator’s effectiveness on the spine procedure education for trainee: A randomized controlled trial. Korean J. Anesthesiol. 2023, 76, 213–226. [Google Scholar] [CrossRef]
- Lo, Y.T.; Yang, C.C.; Yeh, T.F.; Tu, H.Y.; Chang, Y.C. Effectiveness of immersive virtual reality training in nasogastric tube feeding education: A randomized controlled trial. Nurse Educ. 2022, 119, 105601. [Google Scholar] [CrossRef]
- Frithioff, A.; Frendø, M.; Mikkelsen, P.T.; Sørensen, M.S.; Andersen, S.A.W. Ultra-high-fidelity virtual reality mastoidectomy simulation training: A randomized, controlled trial. Eur. Arch. Oto-Rhino-Laryngol. 2020, 277, 1335–1341. [Google Scholar] [CrossRef]
- Wang, Z.; He, R.; Chen, K. Thermal comfort and virtual reality headsets. Appl. Ergon. 2020, 85, 103066. [Google Scholar] [CrossRef]
- Benelli, A.; Neri, F.; Cinti, A.; Pasqualetti, P.; Romanella, S.M.; Giannotta, A.; de Monte, D.; Mandalà, M.; Smeralda, C.; Prattichizzo, D.; et al. Frequency-Dependent Reduction of Cybersickness in Virtual Reality by Transcranial Oscillatory Stimulation of the Vestibular Cortex. Neurotherapeutics 2023, 20, 1796–1807. [Google Scholar] [CrossRef]
- Shamali, M.; Vilmann, P.; René Johansen, N.; Konradsen, H. Virtual reality intervention to improve quality of care during colonoscopy: A hybrid type 1 randomized controlled trial. Gastrointest. Endosc. 2024, 100, 914–922. [Google Scholar] [CrossRef]
- Abelsson, A.; Rystedt, I.; Suserud, B.O.; Lindwall, L. Mapping the use of simulation in prehospital care—A literature review. Scand. J. Trauma. Resusc. Emerg. Med. 2014, 22, 22. [Google Scholar] [CrossRef]
- Manzie, T.; MacDougall, H.; Cheng, K.; Venchiarutti, R.; Fox, R.; Sharman, A.; Charters, E.; Seyfi, D.; Dunn, M.; Mukherjee, P.; et al. Virtual reality digital surgical planning for jaw reconstruction: A usability study. ANZ J. Surg. 2023, 93, 1341–1347. [Google Scholar] [CrossRef]
- Yang, S.Y.; Oh, Y.H. The effects of neonatal resuscitation gamification program using immersive virtual reality: A quasi-experimental study. Nurse Educ. Today 2022, 117, 105464. [Google Scholar] [CrossRef]
- Checa, D.; Bustillo, A. Virtual Reality for Learning. In Virtual Reality in Behavioral Neuroscience: New Insights and Methods; Current Topics in Behavioral Neurosciences; Maymon, C., Grimshaw, G., Wu, Y.C., Eds.; Springer: Cham, Switzerland, 2023; Volume 65. [Google Scholar] [CrossRef]
Study Variables | Group | p-Value | |||
---|---|---|---|---|---|
AR (n = 31) | VR (n = 30) | Control (n = 32) | |||
Sex | Female | 75.16% | 75.16% | 75.16% | 0.846 Chi-square test |
Male | 24.73% | 24.73% | 24.73% | ||
Age (years) | Maximum | 30 | 31 | 31 | 0.794 ANOVA test |
Mean | 25.09 | 25.70 | 25.41 | ||
Minimum | 20 | 21 | 20 | ||
Professional level | Student | 19.38% | 19.98% | 28.12% | 0.836 Chi-square test |
Graduate and Master’s Degree | 77.52% | 76.59% | 68.25% | ||
Ph.D. | 3.23% | 3.33% | 3.12% | ||
Marital status | Married/partnered | 71% | 62% | 63% | 0.174 Chi-square test |
Single | 29% | 38% | 37% |
Variable/Group | Mean (SD) | p | ANOVA (F) | Eta Squared (95%CI) |
---|---|---|---|---|
Knowledge | 0.019 | 4.158 | 0.085 (0.02–0.195) | |
Control | 7.96 (1.09) | |||
Augmented reality | 8.19 (0.94) | |||
Virtual reality | 8.66 (0.84) | |||
Training satisfaction * | 0.066 | 2.802 | 0.059 (0.00–0.159) | |
Control | 4.01 (0.84) | |||
Augmented reality | 4.22 (0.61) | |||
Virtual reality | 4.43 (0.67) |
Item | Group | |
---|---|---|
AR | VR | |
I felt stressed while using AR/VR. | 1.2 | 1.8 |
I felt anxious while using AR/VR. | 1.1 | 1.6 |
My attention was concentrated while using AR/VR. | 4.7 | 4.8 |
I felt I was in control of the AR/VR simulation. | 4.4 | 4.6 |
I liked using the AR/VR simulation. | 5 | 5 |
Using the AR/VR simulation encouraged me to learn. | 4.8 | 5 |
I take AR/VR seriously. | 5 | 5 |
The AR/VR simulation of the health emergency was realistic. | 4.1 | 4.4 |
It was interesting to use AR/VR. | 5 | 5 |
I would recommend using AR/VR in other courses. | 5 | 5 |
The use of AR/VR was intuitive | 4.5 | 4.7 |
I didn’t enjoy using AR/VR in my professional training. | 1.3 | 1.2 |
It was easy for me to control the AR/VR. | 4.3 | 4.1 |
Using AR/VR hindered my professional training. | 1.1 | 1.4 |
Using AR/VR complemented my professional training. | 5 | 5 |
Using AR/VR helped me empathise with patients. | NA | 2 |
I felt physically and mentally secure while using AR/VR. | 5 | 5 |
I felt secure being able to make mistakes during AR/VR simulation. | 5 | 5 |
I deliberately made mistakes during AR/VR simulation in order to learn more. | 1.4 | 1 |
I was able to change my approach/try again/rectify mistakes during AR/VR simulation. | 5 | 5 |
Using AR/VR improved my practical skills. | 5 | 5 |
Using AR/VR improved my theoretical knowledge. | 5 | 5 |
I applied operating protocols correctly during the use of AR/VR. | 5 | 5 |
I have learnt from my mistakes during the use of AR/VR. | 5 | 5 |
I completed the full scheduled AR/VR experience. | 5 | 5 |
I had no problem with time management while using AR/VR. | 5 | 5 |
Using AR/VR helped me prioritise different clinical situations. | 3.9 | 4 |
I believe AR/VR makes it easier to acquire theoretical knowledge. | 5 | 5 |
I believe AR/VR makes it easier to acquire practical knowledge. | 4.8 | 5 |
I think AR/VR should be used more in healthcare training. | 5 | 5 |
I agree with the use of AR/VR in healthcare training. | 5 | 5 |
I would use AR/VR again in another training course. | 5 | 5 |
I believe AR/VR will be of crucial importance in healthcare training in the future. | 4.7 | 4.9 |
I believe that using AR/VR in healthcare training improves patient care. | 4 | 4.3 |
I believe that using AR/VR in healthcare training benefits decision making in clinical practice. | 3.9 | 4.0 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Castillo-Rodríguez, J.M.; Gómez-Urquiza, J.L.; García-Oliva, S.; Suleiman-Martos, N. Effectiveness of Virtual and Augmented Reality for Emergency Healthcare Training: A Randomized Controlled Trial. Healthcare 2025, 13, 1034. https://doi.org/10.3390/healthcare13091034
Castillo-Rodríguez JM, Gómez-Urquiza JL, García-Oliva S, Suleiman-Martos N. Effectiveness of Virtual and Augmented Reality for Emergency Healthcare Training: A Randomized Controlled Trial. Healthcare. 2025; 13(9):1034. https://doi.org/10.3390/healthcare13091034
Chicago/Turabian StyleCastillo-Rodríguez, Jose Manuel, Jose Luis Gómez-Urquiza, Sofía García-Oliva, and Nora Suleiman-Martos. 2025. "Effectiveness of Virtual and Augmented Reality for Emergency Healthcare Training: A Randomized Controlled Trial" Healthcare 13, no. 9: 1034. https://doi.org/10.3390/healthcare13091034
APA StyleCastillo-Rodríguez, J. M., Gómez-Urquiza, J. L., García-Oliva, S., & Suleiman-Martos, N. (2025). Effectiveness of Virtual and Augmented Reality for Emergency Healthcare Training: A Randomized Controlled Trial. Healthcare, 13(9), 1034. https://doi.org/10.3390/healthcare13091034