Development and Usability Assessment of Virtual Reality- and Haptic Technology-Based Educational Content for Perioperative Nursing Education
Abstract
:1. Introduction
- To analyze the literature and investigate the current status and user needs for VR and haptic technology-based OR clinical field education for prospective healthcare professionals;
- To develop VR and haptic technology-based OR clinical field education content for experiential learning by prospective healthcare professionals;
- To evaluate the efficacy of the developed VR and haptic technology-based OR clinical field education content through expert assessments and usability evaluations by prospective healthcare professionals.
2. Materials and Methods
2.1. Research Design and Setting
2.2. Methodology
2.2.1. Phase 1: Analysis
2.2.2. Phase 2: Design
2.2.3. Phase 3: Implementation
2.2.4. Phase 4: Evaluation
2.3. Research Instruments
2.3.1. Heuristic Evaluation
2.3.2. VR Content and UI Design Assessment
2.3.3. Presence
2.3.4. Usability
2.3.5. Satisfaction
2.4. Data Analysis
2.5. Ethical Considerations
3. Results
3.1. Phase 1: Analysis
3.2. Phase 2: Design
3.3. Phase 3: Implementation
3.4. Phase 4: Evaluation
3.4.1. Heuristic Evaluation
3.4.2. VR Content and UI Design Assessment
3.4.3. Presence
3.4.4. Usability
3.4.5. Satisfaction
4. Discussion
Contributions
- Innovative Integration of Haptic Technology in Nursing Education: This study pioneers the integration of haptic feedback into a perioperative nursing education program, offering a multi-sensory learning experience that enhances realism and skill acquisition in operating room procedures;
- Development of Specialized VR Content for Nursing Students: Unlike prior studies that focus on medical or dental students, this research fills a gap by creating surgical scenarios specifically tailored for nursing students, addressing the competencies required in the nursing field;
- Addressing Key Competencies in High-Stakes Environments: This work contributes to closing the competency gap between new nursing graduates and nurse managers’ expectations by providing a practical platform for students to develop essential skills such as critical decision-making and precise hand coordination;
- Pilot Study for Future Research and Practical Application: As one of the first usability assessments of VR and haptic technology-based content in nursing education, this study serves as a foundational piece for future research on the effectiveness of such programs in real-world nursing education.
5. Conclusions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Lim, S.H. Content analysis on online non-face-to-face adult nursing practice experienced by graduating nursing students in the Ontact era. J. Korea Acad. Ind. Coop. Soc. 2021, 22, 195–205. [Google Scholar] [CrossRef]
- Kang, G.Y.; Kim, J.J. Nursing student’s psychiatric nursing simulation experience using standardized patients: A Parse research method study. J. Healthc. Simul. 2023, 7, 84–91. [Google Scholar] [CrossRef]
- Giuffrida, S.; Silano, V.; Ramacciati, N.; Prandi, C.; Baldon, A.; Bianchi, M. Teaching strategies of clinical reasoning in advanced nursing clinical practice: A scoping review. Nurse Educ. Pract. 2023, 67, 103548. [Google Scholar] [CrossRef] [PubMed]
- Kang, K.H. Effect of Appraisal Effectiveness on the Organizational Performance of Perioperative Nursing Department. Ph.D. Thesis, Seoul National University, Seoul, Republic of Korea, 2012. [Google Scholar]
- Niu, A.; Ma, H.; Chen, Z.; Zhu, X.; Luo, Y. Exploring the competencies of operating room nurses in mobile surgical teams based on the onion model: A qualitative study. BMC Nurs. 2023, 22, 254. [Google Scholar] [CrossRef]
- Kang, Y.K.; Kim, K.M.; Kim, Y.Y.; Park, H.O.; Seo, K.H.; Song, S.; Lee, H.S.; Cho, E.Y. Analysis of anesthesia and recovery room nurses’ activities. J. Korean Acad. Nurs. Admin. 2006, 12, 63–75. [Google Scholar]
- Jeong, S.Y.; Choi, J.H.; Kim, E.K.; Kim, S.M.; Son, H.J.; Cho, N.H.; Choi, J.Y.; Park, E.S.; Park, J.H.; Lee, J.Y.; et al. Actual disinfection and sterilization control in Korean healthcare facilities. J. Korean Fund. Nurs. 2014, 21, 392–402. [Google Scholar] [CrossRef]
- Song, M.S.; Park, K.M. Practice experience of nursing student in operating room. J. Converg. Cult. Technol. 2020, 6, 357–367. [Google Scholar] [CrossRef]
- Shorey, S.; Ng, E.D. The use of virtual reality simulation among nursing students and registered nurses: A systematic review. Nurse Edu. Today 2021, 98, 104662. [Google Scholar] [CrossRef] [PubMed]
- Jeffries, P.R. Designing Simulations for Nursing Education; Annual review of nursing education: New York, NY, USA, 2006; pp. 161–177. [Google Scholar]
- Chun, H.S. Application of Virtual Reality in the Medical Field, in Electronics and Telecommunications Trends; ETRI: Daejeon, Republic of Korea, 2019; Volume 34, pp. 19–28. [Google Scholar] [CrossRef]
- Park, H.J. A Study on the effectiveness of airline safety VR education: Focusing on the relations safety VR education, emotional immersion and safety behavior. J. Tour. Sci. 2019, 43, 31–47. [Google Scholar] [CrossRef]
- Yoo, M.H.; Kim, J.H.; Koo, Y.H.; Song, J.H. A meta-analysis on effects of VR, AR, MR-based learning in Korea. J. Educ. Inf. Media 2018, 24, 459–488. [Google Scholar] [CrossRef]
- Hagelsteen, K.; Johansson, R.; Ekelund, M.; Bergenfelz, A.; Anderberg, M. Performance and perception of haptic feedback in a laparoscopic 3D virtual reality simulator. Minim. Invasive Ther. Allied Technol. 2019, 28, 309–316. [Google Scholar] [CrossRef] [PubMed]
- Vece, C.D.; Luciano, C.; Momi, E.D. Psychomotor skills development for verses needle placement using a virtual reality and haptics-based simulator. Int. J. Comput. Assist. Radiol. Surg. 2021, 16, 639–647. [Google Scholar] [CrossRef]
- Butt, A.L.; Kardong-Edgren, S.; Ellertson, A. Using game-based virtual reality with haptics for skill acquisition. Clin. Simul. Nurs. 2018, 16, 25–32. [Google Scholar] [CrossRef]
- Al-Saud, L.M.; Mushtaq, F.; Mann, R.P.; Mirghani, I.; Balkhoyor, A.; Harris, R.; Osnes, C.; Keeling, A.; Mon-Williams, M.A.; Manogue, M. Early Assessment with a virtual reality haptic simulator predicts performance in clinical practice. BMJ Simul. Technol. Enhanc. Learn. 2020, 6, 274–278. [Google Scholar] [CrossRef]
- Langer, A.M.; Langer, A.M. System Development Life Cycle (SDLC), 3rd ed.; Analysis and Design of Information Systems: New York, NY, USA, 2008; pp. 10–20. [Google Scholar]
- Nielsen, J. Usability inspection methods. In Proceedings of the Conference Companion on Human Factors in Computing Systems, Boston, MA, USA, 24–28 April 1994; Association for Computing Machinery: New York, NY, USA, 1994; pp. 413–414. [Google Scholar] [CrossRef]
- Murtza, R.; Monroe, S.; Youmans, R.J. Heuristic evaluation for virtual reality systems. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 2017, 61, 2067–2071. [Google Scholar] [CrossRef]
- Ko, J.Y.; Jung, A.R. Augmented reality-based surgical nursing practice application development and evaluation. J. Converg. Inf. Technol. 2021, 11, 47–56. [Google Scholar] [CrossRef]
- Schubert, T.; Friedmann, F.; Regenbrecht, H. The experience of presence: Factor analytic insights. Presence Teleoperators Virtual Environ. 2001, 10, 266–281. [Google Scholar] [CrossRef]
- Kang, Y.G. The Effects of Media Characteristics on Learning Flow and Learning Transition in ViFrtual Reality-Based Hands-on Training: Focusing on the Moderating Effect of Presence. Master’s Thesis, Chung-Ang University, Seoul, Republic of Korea, 2020. [Google Scholar]
- Brooke, J. SUS: “A quick and dirty” usability scale. In Usability Evaluation in Industry; CRC Press: Boca Raton, FL, USA, 1996; Volume 21, pp. 189–194. [Google Scholar]
- Bangor, A.; Kortum, P.; Miller, J. Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale. J. Usability Stud. 2009, 4, 114–123. [Google Scholar]
- Kim, H.Y.; Kim, E.Y. Effects of Medical Education Program Using Virtual Reality: A Systematic Review and Meta-Analysis. Int. J. Environ. Res. Public Health 2023, 20, 3895. [Google Scholar] [CrossRef]
- Tarabeih, M.; Na’amnih, W. Assessment of Differential Perceptions of Core Nursing Competencies between Nurse Managers and Nursing Graduates: A Cross-Sectional Study. Nurs. Rep. 2023, 13, 1751–1760. [Google Scholar] [CrossRef]
- Ricca, A.; Chellali, A.; Otmane, S. Influence of hand visualization on tool-based motor skills training in an immersive VR simulator. In Proceedings of the 19th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2020), Recife, Brazil, 9–13 November 2020. [Google Scholar]
- Pérez-Escamirosa, F.; Medina-Alvarez, D.; Ruíz-Vereo, E.A.; Ordorica-Flores, R.M.; Minor-Martínez, A.; Tapia-Jurado, J. Immersive Virtual Operating Room Simulation for Surgical Resident Education During COVID-19. Surg. Innov. 2020, 27, 549–550. [Google Scholar] [CrossRef] [PubMed]
- Zhai, X.; Sun, Y.; Wang, M.; Asmi, F.; Cai, W.; Chu, X. Exploring the Effect of Virtual Reality with Haptics on Educational Research: A Meta-Analysis from 2010 to 2020. In Proceedings of the 2022 8th International Conference of the Immersive Learning Research Network (iLRN), Vienna, Austria, 30 May–4 June 2022. [Google Scholar] [CrossRef]
- Jensen, L.; Konradsen, F. A Review of the Use of Virtual Reality Head-ounted displays in education and training. Educ. Inf. Technol. 2018, 23, 1515–1529. [Google Scholar] [CrossRef]
- Hamza-Lup, F.G.; Bogdan, C.M.; Popovici, D.M.; Costea, O.D. A survey of visuo-haptic simulation in surgical training. arXiv 2019, arXiv:1903.03272. [Google Scholar]
- Reinkemeyer, E.A.; Chrisman, M.; Patel, S.E. Escape rooms in nursing education: An integrative review of their use, outcomes, and barriers to implementation. Nurse Educ. Today 2022, 119, 105571. [Google Scholar] [CrossRef]
- Rodrigues, P.; Esteves, A.; Botelho, J.; Machado, V.; Zagalo, C.; Zorzal, E.R.; Mendes, J.J.; Lopes, D.S. Usability, acceptance, and educational usefulness study of a new haptic operative dentistry virtual reality simulator. Comput. Methods Programs Biomed. 2022, 221, 106831. [Google Scholar] [CrossRef]
- Woo, J.; Kim, J.W.; Kim, K.; Jarzembak, J.; James, A.; Biggs, J.; Clements, R.; Dunlosky, J. Comparative design and analysis of multimodal VR simulations for IV needle insertion training. In Proceedings of the 2024 IEEE 37th International Symposium on Computer-Based Medical Systems (CBMS), Guadalajara, Mexico, 26–28 June 2024; pp. 315–319. [Google Scholar] [CrossRef]
No | Heuristic | Improvement Content |
---|---|---|
1 | Synchronous Body Movements | - |
2 | Physical space constraints | Increased the distance between objects and the user during movement |
Changed the movement method from manual adjustments to a teleportation system | ||
3 | Immersion | - |
4 | Glitches | Adjusted the haptic feedback to ensure that only one gauze was pulled at a time during the gauze count process |
5 | Switch between actual and virtual world | - |
6 | Cord design | - |
7 | Headset comfort | - |
8 | Mental comfort | Adjusted the stereoscopic resolution of the HMD |
Modified the screen display and character movement speed in the HMD | ||
9 | User interface design | Redesigned the algorithm for module selection to simplify the process |
Added a Reset button at each location to allow the repetition of tasks | ||
Changed the color of directional arrows to improve visibility and ease of recognition | ||
Introduced a menu selection screen to enable users to choose their desired options | ||
Implemented the surgical count list and correspondingly displayed arrows on the screen, ensuring that the count numbers and guidance voice were accurately synchronized |
Evaluation Factor | No | Questions | SD | |
---|---|---|---|---|
Contents | Accuracy | 1 | There is confidence in the healthcare information provided by the app | 0.50 |
2 | The healthcare information provided by the app is clear | 0.58 | ||
Understanding | 3 | It is easy to understand healthcare information | 0.50 | |
4 | Health-related terms provided by the app are familiar to the public | 0.50 | ||
5 | The level of health care information provided by the app is easy to read | 0.50 | ||
Objectivity | 6 | Healthcare information is professional information | 0.50 | |
7 | Healthcare information is systematic and specific | 0.50 | ||
8 | There is a sign indicating that the information is provided by an authority | 0.50 | ||
9 | Health information is provided by medical experts | 0.58 | ||
Interface design | Consistency | 1 | Consistent in color, placement, and presentation | 0.50 |
2 | The arrangement of icons in the app matches the overall app design | 0.50 | ||
3 | Icons in the app are grouped consistently | 0.82 | ||
Compatibility | 4 | It is easy to understand logically by arranging contents so that they can be accessed sequentially | 0.50 | |
5 | It clearly expresses what the icon means | 0.82 | ||
6 | The letters used in the app are in a size and font that can be easily to read by the viewer | 0.82 | ||
7 | The visual element works comfortably for the user | 0.50 | ||
8 | You can understand the structure of the app at a glance | 0.50 | ||
Vocabulary Accuracy | 9 | The phrase used in the app is concise | 0.58 | |
10 | The phrase used in the app is correct | 0.58 | ||
11 | The phrase used in the app is grammatical | 0.50 |
No | Questions | SD |
---|---|---|
1 | I felt as though a virtual object was moving toward me | 1.06 |
2 | I felt as if a virtual object was right beside me | 1.01 |
3 | I felt that a virtual object was part of my reality | 1.00 |
4 | While participating in the program, I felt like I was interacting with a fictional character or object | 0.77 |
No | Questions | SD |
---|---|---|
1 | I think that I would like to use this system frequently | 0.69 |
2 | I found the system unnecessarily complex | 0.98 |
3 | I thought the system was easy to use | 0.81 |
4 | I think that I would need the support of a technical person to be able to use this system | 0.69 |
5 | I found that the various functions in this system were integrated | 0.73 |
6 | I thought there was too much inconsistency in this system | 0.86 |
7 | I imagine that most people would learn to use this system very quickly | 0.35 |
8 | I found the system very cumbersome to use | 0.78 |
9 | I felt very confident using the system | 0.63 |
10 | I needed to learn a lot of things before I could get going with this system | 0.87 |
No | Questions | SD |
---|---|---|
1 | I was actively engaged in nursing practice | 0.46 |
2 | My interest in practice has increased | 0.48 |
3 | The atmosphere in this practice is positive | 0.44 |
4 | The nursing practice content is logically organized | 0.57 |
5 | The practical textbook is appropriate and useful for learning | 0.63 |
6 | The amount of learning was adequate | 0.73 |
7 | The pace of the training was appropriate | 0.69 |
8 | The content of the practice was engaging | 0.38 |
9 | The practice method was easy to comprehend | 0.61 |
10 | The content of the practice was well structured | 0.98 |
11 | I was able to understand the preparation process before entering the operating room | 0.73 |
12 | I was able to understand the attire required when entering the operating room | 0.63 |
13 | I could understand the procedures involved in applying the correct positioning for surgical patients | 1.25 |
14 | I was able to understand the surgical count procedure | 0.68 |
15 | I am familiar with the surgical timeout process essential for patient safety | 0.73 |
16 | The current practice method was understood without assistance | 1.21 |
17 | The goals set for the practice were successfully achieved | 0.73 |
18 | I was able to acquire the skills needed to perform nursing in an actual operating room | 0.88 |
19 | I gained new knowledge | 0.86 |
20 | I am satisfied with the current practice method | 0.62 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Kim, H.-Y. Development and Usability Assessment of Virtual Reality- and Haptic Technology-Based Educational Content for Perioperative Nursing Education. Healthcare 2024, 12, 1947. https://doi.org/10.3390/healthcare12191947
Kim H-Y. Development and Usability Assessment of Virtual Reality- and Haptic Technology-Based Educational Content for Perioperative Nursing Education. Healthcare. 2024; 12(19):1947. https://doi.org/10.3390/healthcare12191947
Chicago/Turabian StyleKim, Hyeon-Young. 2024. "Development and Usability Assessment of Virtual Reality- and Haptic Technology-Based Educational Content for Perioperative Nursing Education" Healthcare 12, no. 19: 1947. https://doi.org/10.3390/healthcare12191947
APA StyleKim, H.-Y. (2024). Development and Usability Assessment of Virtual Reality- and Haptic Technology-Based Educational Content for Perioperative Nursing Education. Healthcare, 12(19), 1947. https://doi.org/10.3390/healthcare12191947