Understanding VR-Based Construction Safety Training Effectiveness: The Role of Telepresence, Risk Perception, and Training Satisfaction
Abstract
:1. Introduction
2. Theoretical Background
2.1. Training Transfer
2.2. Modified Technology Acceptance Model
2.3. VR and Telepresence
3. Research Model and Hypotheses
3.1. Modified TAM
3.2. External Variables of TAM
3.2.1. Telepresence in VR
3.2.2. Risk Perception: Perceived Vulnerability and Severity
3.3. Training Effectiveness
4. Materials and Methods
4.1. Survey Items
4.2. Sample
5. Results
5.1. Measurement Model Testing
5.2. Hypotheses Testing
6. Discussion and Implications
6.1. Discussion
6.2. Implications
6.2.1. Theoretical Implications
6.2.2. Managerial Implications
7. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Conflicts of Interest
References
- Hussain, R.; Pedro, A.; Lee, D.Y.; Phan, H.C.; Park, C.S. Impact of safety training and interventions on training-transfer: Targeting migrant construction workers. Int. J. Occup. Saf. Ergon. 2020, 26, 272–284. [Google Scholar] [CrossRef] [PubMed]
- The Korea Ministry of Employment and Labor (MoEL). Analysis of Industrial Accidents. 2018. Available online: http://www.moel.go.kr/policy/policydata/view.do?bbs_seq=20191200830 (accessed on 1 February 2021). (In Korean)
- Zhao, D.; Lucas, J. Virtual reality simulation for construction safety promotion. Int. J. Inj. Contr. Saf. Promot. 2015, 22, 57–67. [Google Scholar] [CrossRef] [PubMed]
- Martínez-Caro, E. Factors affecting effectiveness in e-learning: An analysis in production management courses. Comput. Appl. Eng. Educ. 2011, 19, 572–581. [Google Scholar] [CrossRef]
- Park, C.H.; Jang, G.; Chai, Y.H. Development of a virtual reality training system for live-line workers. Int. J. Hum.-Comput. Int. 2006, 20, 285–303. [Google Scholar] [CrossRef]
- Conges, A.; Evain, A.; Benaben, F.; Chabiron, O.; Rebiere, S. Crisis management exercises in virtual reality. In Proceedings of the 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Atlanta, GA, USA, 22–26 March 2020; pp. 87–92. [Google Scholar]
- Xie, B.; Liu, H.; Alghofaili, R.; Zhang, Y.; Jiang, Y.; Lobo, F.D.; Li, C.; Li, W.; Huang, H.; Akdere, M.; et al. A review on virtual reality skill training applications. Front. Virtual Real. 2021, 2, 645153. [Google Scholar] [CrossRef]
- Alzahrani, N.M. Augmented reality: A systematic review of its benefits and challenges in e-learning contexts. Appl. Sci. 2020, 10, 5660. [Google Scholar] [CrossRef]
- Lee, S.M.; Lee, D. “Untact”: A new customer service strategy in the digital age. Serv. Bus. 2020, 14, 1–22. [Google Scholar] [CrossRef]
- Sacks, R.; Perlman, A.; Barak, R. Construction safety training using immersive virtual reality. Constr. Manag. Econ. 2013, 31, 1005–1017. [Google Scholar] [CrossRef]
- Kontoghiorghes, C. Factors affecting training effectiveness in the context of the introduction of new technology—A US case study. Int. J. Train. Dev. 2001, 5, 248–260. [Google Scholar] [CrossRef]
- Yamnill, S.; McLean, G.N. Factors affecting transfer of training in Thailand. Hum. Resour. Dev. Q. 2005, 16, 323–344. [Google Scholar] [CrossRef]
- Baldwin, T.T.; Ford, J.K. Transfer of training: A review and directions for future research. Pers. Psychol. 1988, 41, 63–105. [Google Scholar] [CrossRef]
- Lim, D.H.; Morris, M.L. Influence of trainee characteristics, instructional satisfaction, and organizational climate on perceived learning and training transfer. Hum. Resour. Dev. Q. 2006, 17, 85–115. [Google Scholar] [CrossRef]
- Blume, B.D.; Ford, J.K.; Surface, E.A.; Olenick, J. A dynamic model of training transfer. Hum. Resour. Manag. R. 2019, 29, 270–283. [Google Scholar] [CrossRef]
- Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 1989, 13, 319–340. [Google Scholar] [CrossRef] [Green Version]
- Al-Emran, M.; Mezhuyev, V.; Kamaludin, A. Technology Acceptance Model in M-Learning Context: A Systematic Review. Comput. Educ. 2018, 125, 389–412. [Google Scholar] [CrossRef]
- Riantini, R.E. Adoption of E-Commerce Online to Offline with Technology Acceptance Model (TAM) Approach. In Proceedings of the 2018 4th International Conference on Computer and Information Sciences, Kuala Lumpur, Malaysia, 13–14 August 2018; pp. 1–6. [Google Scholar]
- Wang, Y.; Wang, S.; Wang, J.; Wei, J.; Wang, C. An empirical study of consumers’ intention to use ride-sharing services: Using an extended technology acceptance model. Transportation 2020, 47, 397–415. [Google Scholar] [CrossRef]
- Venkatesh, V.; Bala, H. Technology acceptance model 3 and a research agenda on interventions. Decision Sci. 2008, 39, 273–315. [Google Scholar] [CrossRef] [Green Version]
- Venkatesh, V.; Davis, F.D. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Manag. Sci. 2000, 46, 186–204. [Google Scholar] [CrossRef] [Green Version]
- Sagnier, C.; Loup-Escande, E.; Lourdeaux, D.; Thouvenin, I.; Valléry, G. User acceptance of virtual reality: An extended technology acceptance model. Int. J. Hum. Comput. Interact. 2020, 36, 993–1007. [Google Scholar] [CrossRef]
- Guner, H.; Acarturk, C. The use and acceptance of ICT by senior citizens: A comparison of technology acceptance model (TAM) for elderly and young adults. Univers. Access Inf. Soc. 2020, 19, 311–330. [Google Scholar] [CrossRef]
- Park, Y.; Son, H.; Kim, C. Investigating the determinants of construction professionals’ acceptance of web-based training: An extension of the technology acceptance model. Autom. Constr. 2012, 22, 377–386. [Google Scholar] [CrossRef]
- Steuer, J. Defining virtual reality: Dimensions determining telepresence. J. Commun. 1992, 42, 73–93. [Google Scholar] [CrossRef]
- Radianti, J.; Majchrzak, T.A.; Fromm, J.; Wohlgenannt, I. A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Comput. Educ. 2020, 147, 103778. [Google Scholar] [CrossRef]
- Coyle, J.R.; Thorson, E. The effects of progressive levels of interactivity and vividness in web marketing sites. J. Advert. 2001, 30, 65–77. [Google Scholar] [CrossRef]
- Kim, D.; Ko, Y.J. The impact of virtual reality (VR) technology on sport spectators’ flow experience and satisfaction. Comput. Hum. Behav. 2019, 93, 346–356. [Google Scholar] [CrossRef]
- Jang, Y.; Park, E. An adoption model for virtual reality games: The roles of presence and enjoyment. Telemat. Inform. 2019, 42, 101239. [Google Scholar] [CrossRef]
- Wu, H.; Cai, T.; Luo, D.; Liu, Y.; Zhang, Z. Immersive virtual reality news: A study of user experience and media effects. Int. J. Hum. Comput. Stud. 2021, 147, 102576. [Google Scholar] [CrossRef]
- Clark, C.S.; Dobbins, G.H.; Ladd, R.T. Exploratory field study of training motivation: Influence of involvement, credibility, and transfer climate. Goup. Organ. Manag. 1993, 18, 292–307. [Google Scholar] [CrossRef]
- Manis, K.T.; Choi, D. The virtual reality hardware acceptance model (VR-HAM): Extending and individuating the technology acceptance model (TAM) for virtual reality hardware. J. Bus. Res. 2019, 100, 503–513. [Google Scholar] [CrossRef]
- Scherer, R.; Siddiq, F.; Tondeur, J. The technology acceptance model (TAM): A meta-analytic structural equation modeling approach to explaining teachers’ adoption of digital technology in education. Comput. Educ. 2019, 128, 13–35. [Google Scholar] [CrossRef]
- Chang, C.T.; Hajiyev, J.; Su, C.R. Examining the students’ behavioural intention to use e-learning in Azerbaijan? The general extended technology acceptance model for e-learning approach. Comput. Educ. 2017, 111, 128–143. [Google Scholar] [CrossRef]
- Wu, W.C.; Vu, V.H. Application of Virtual Reality Method in Aircraft Maintenance Service—Taking Dornier 228 as an Example. Appl. Sci. 2022, 12, 7283. [Google Scholar] [CrossRef]
- Nah, F.F.H.; Tan, X.; The, S.H. An empirical investigation on end-users’ acceptance of enterprise systems. Inf. Resour. Manag. J. 2004, 17, 32–53. [Google Scholar] [CrossRef] [Green Version]
- Huang, T.L.; Liao, S. A model of acceptance of augmented-reality interactive technology: The moderating role of cognitive innovativeness. Electron. Commer. Res. 2015, 15, 269–295. [Google Scholar] [CrossRef] [Green Version]
- Oh, J.; Yoon, S.J. Validation of haptic enabling technology acceptance model (HE-TAM): Integration of IDT and TAM. Telemat. Inform. 2014, 31, 585–596. [Google Scholar] [CrossRef]
- Ahadzadeh, A.S.; Sharif, S.P.; Ong, F.S.; Khong, K.W. Integrating health belief model and technology acceptance model: An investigation of health-related internet use. J. Med. Internet. Res. 2015, 17, e45. [Google Scholar] [CrossRef] [Green Version]
- Hansen, J.M.; Saridakis, G.; Benson, V. Risk, Trust, and the Interaction of Perceived Ease of Use and Behavioral Control in Predicting Consumers’ Use of Social Media for Transactions. Comput. Hum. Behav. 2018, 80, 197–206. [Google Scholar] [CrossRef] [Green Version]
- Dou, K.; Yu, P.; Deng, N.; Liu, F.; Guan, Y.; Li, Z.; Ji, Y.; Du, N.; Lu, X.; Duan, H. Patients’ acceptance of smartphone health echnology for chronic disease management: A theoretical model and empirical test. JMIR Mhealth Uhealth 2017, 5, e177. [Google Scholar] [CrossRef]
- Gegenfurtner, A.; Festner, D.; Gallenberger, W.; Lehtinen, E.; Gruber, H. Predicting autonomous and controlled motivation to transfer training. Int. J. Train. Dev. 2009, 13, 124–138. [Google Scholar] [CrossRef]
- Kodwani, A.D. Decoding Training Effectiveness: The Role of Organisational Factors. J. Workplace Learn. 2017, 29, 200–216. [Google Scholar] [CrossRef]
- Hyman, L.; Lamb, J.; Bulmer, M. The use of pre-existing survey questions: Implications for data quality. In Proceedings of the Q2006 European Conference on Quality in Survey Statistics, Cardiff, Wales, UK, 24–26 April 2006; pp. 1–8. [Google Scholar]
- Yoon, C.; Kim, H. Understanding computer security behavioural intention in the workplace. Inform. Technol. People 2013, 26, 401–419. [Google Scholar] [CrossRef]
- Sun, Y.; Wang, N.; Guo, X.; Peng, Z. Understanding the acceptance of mobile health services: A comparison and integration of alternative models. J. Electron. Commer. Res. 2013, 14, 183–200. [Google Scholar]
- Latif, K.F. An integrated model of training effectiveness and satisfaction with employee development interventions. Ind. Commer. Train. 2012, 44, 211–222. [Google Scholar] [CrossRef]
- Sun, P.C.; Tsai, R.J.; Finger, G.; Chen, Y.Y.; Yeh, D. What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction. Comput. Educ. 2008, 50, 1183–1202. [Google Scholar] [CrossRef]
- Kelley, C.A.; Gaidis, W.C.; Reingen, P.H. The use of vivid stimuli to enhance comprehension of the content of product warning messages. J. Consum. Aff. 1989, 23, 243–266. [Google Scholar] [CrossRef]
- Yim, M.Y.C.; Chu, S.C.; Sauer, P.L. Is augmented reality technology an effective tool for e-commerce? An interactivity and vividness perspective. J. Interact. Mark. 2017, 39, 89–103. [Google Scholar] [CrossRef]
- Korea Occupational Safety & Health Agency. Video-Based VR Content—Scaffolding. 2019. Available online: https://www.kosha.or.kr/kosha/data/mediaBankMain.do?mode=detail&medSeq=40591 (accessed on 1 November 2020). (In Korean).
- Fincham, J.E. Response rates and responsiveness for surveys, standards, and the Journal. Am. J. Pharm. Educ. 2008, 72, 43. [Google Scholar] [CrossRef] [Green Version]
- Hair, J.F.; Hult, G.T.M.; Ringle, C.M.; Sarstedt, M. A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM); Sage Publications: Thousand Oaks, CA, USA, 2013. [Google Scholar]
- Hair, J.F.; Risher, J.J.; Sarstedt, M.; Ringle, C.M. When to use and how to report the results of PLS-SEM. Eur. Bus. Rev. 2019, 31, 2–24. [Google Scholar] [CrossRef]
- Novikova, S.; Richman, D.; Supekar, K.; Barnard-Brak, L.; Hall, D. NDAR: A model federal system for secondary analysis in developmental disabilities research. Int. Rev. Res. Dev. Disabil. 2013, 45, 123–153. [Google Scholar]
- Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Lawrence Erlbaum Associates: Hillsdale, NJ, USA, 1988. [Google Scholar]
- Falk, R.F.; Miller, N.B. A Primer for Soft Modeling; University of Akron Press: Akron, OH, USA, 1992. [Google Scholar]
- Granić, A.; Marangunić, N. Technology acceptance model in educational context: A systematic literature review. Br. J. Educ. Technol. 2019, 50, 2572–2593. [Google Scholar] [CrossRef]
- Grabowski, A.; Jankowski, J.; Wodzyński, M. Teleoperated mobile robot with two arms: The influence of a human-machine interface, VR training and operator age. Int. J. Hum. Comput. Stud. 2021, 156, 102707. [Google Scholar] [CrossRef]
- Bailenson, J.; Patel, K.; Nielsen, A.; Bajscy, R.; Jung, S.H.; Kurillo, G. The effect of interactivity on learning physical actions in virtual reality. Media Psychol. 2008, 11, 354–376. [Google Scholar] [CrossRef]
- Vidal-Balea, A.; Blanco-Novoa, O.; Fraga-Lamas, P.; Vilar-Montesinos, M.; Fernández-Caramés, T.M. Creating collaborative augmented reality experiences for industry 4.0 training and assistance applications: Performance evaluation in the shipyard of the future. Appl. Sci. 2020, 10, 9073. [Google Scholar] [CrossRef]
- Muñoz-Saavedra, L.; Miró-Amarante, L.; Domínguez-Morales, M. Augmented and virtual reality evolution and future tendency. Appl. Sci. 2020, 10, 322. [Google Scholar] [CrossRef] [Green Version]
- Miguel-Alonso, I.; Rodriguez-Garcia, B.; Checa, D.; Bustillo, A. Countering the Novelty Effect: A Tutorial for Immersive Virtual Reality Learning Environments. Appl. Sci. 2023, 13, 593. [Google Scholar] [CrossRef]
- Checa, D.; Miguel-Alonso, I.; Bustillo, A. Immersive virtual-reality computer-assembly serious game to enhance autonomous learning. Virtual Real. 2021, 1–18. [Google Scholar] [CrossRef]
Variable | Measurement Item |
---|---|
Vividness | VI1. The contents of the VR safety training were very well-defined |
VI2. The contents of the VR safety training were very clear | |
VI3. The contents of the VR safety training were very detailed | |
VI4. The contents of the VR safety training were very vivid | |
Interactivity | IN1. I was in control of my navigation through the VR safety training |
IN2. I was in control of seeing the contents of the VR safety training | |
IN3. I was in control over the pace of the VR safety training | |
IN4. The VR safety training environment responded to my commands quickly and efficiently | |
Perceived Vulnerability | PV1. I am at risk of suffering from workplace accidents at the construction site |
PV2. It is likely that I will suffer from workplace accidents at the construction site | |
PV3. It is possible for me to suffer from workplace accidents at the construction site | |
PV4. There is a chance that I will suffer from workplace accidents at the construction site | |
Perceived Severity | PS1. If I were to suffer from workplace accidents at the construction site, the damage would be severe |
PS2. If I were to suffer from workplace accidents at the construction site, the damage would be critical | |
PS3. If I were to suffer from workplace accidents at the construction site, the damage would be significant | |
PS4. If I were to suffer from workplace accidents at the construction site, I will have difficulty with my work | |
Perceived Usefulness | PU1. The VR safety training will be helpful for staying safe at the construction site |
PU2. The VR safety training is effective for staying safe at the construction site | |
PU3. Upon applying the knowledge and skills obtained from the VR safety training, I will be less likely to be injured at the construction site | |
Perceived Ease of Use | PEOU1. It is easy for me to complete the VR safety training and apply it to my work |
PEOU2. I have the ability to complete the VR safety training and fully apply it to my work | |
PEOU3. I am able to complete the VR safety training and apply it to my work without much difficulty | |
Training Satisfaction | TS1. The VR safety training contents were relevant to the job I perform |
TS2. The VR safety training increased my understanding of the subject | |
TS3. If I had an opportunity to undergo another safety training using VR, I would gladly do so | |
TS4. Overall, I was very satisfied with the VR safety training | |
Training Transfer | TT1. I will try to transfer the knowledge and skills obtained from the VR safety training to the construction site |
TT2. I feel that I am able to use the knowledge and skills gained from the VR safety training at the construction site | |
TT3. The VR safety training prepared me well for applying the related knowledge and skills at the construction site | |
TT4. I will continuously use the knowledge and skills obtained from the safety training at the construction site |
Classification | Frequency (N = 248) | Percentage (%) | |
---|---|---|---|
Gender | Male | 218 | 87.9 |
Female | 30 | 12.1 | |
Age | 20s | 15 | 6.0 |
30s | 67 | 27.1 | |
40s | 92 | 37.1 | |
50s | 61 | 24.6 | |
60 and over | 13 | 5.2 | |
Experience in the construction industry | <1 year | 18 | 7.3 |
1–5 years | 40 | 16.1 | |
6–10 years | 45 | 18.1 | |
11–15 years | 63 | 25.4 | |
16–20 years | 54 | 21.8 | |
>20 years | 28 | 11.3 | |
Avg. working hours per day | <3 h | 2 | 0.8 |
4–8 h | 145 | 58.5 | |
9–12 h | 96 | 38.7 | |
>12 h | 5 | 2.0 |
Variable | Factor Loadings | AVE | CR | Cronbach’s α |
---|---|---|---|---|
Vividness | 0.784, 0.871, 0.888, 0.902 | 0.744 | 0.921 | 0.885 |
Interactivity | 0.881, 0.902, 0.832, 0.790 | 0.726 | 0.914 | 0.875 |
Perceived Vulnerability | 0.903, 0.942, 0.951, 0.954 | 0.879 | 0.967 | 0.954 |
Perceived Severity | 0.967, 0.962, 0.962, 0.948 | 0.921 | 0.979 | 0.971 |
Perceived Usefulness | 0.934, 0.942, 0.907 | 0.861 | 0.949 | 0.919 |
Perceived Ease of Use | 0.936, 0.947, 0.940 | 0.886 | 0.959 | 0.936 |
Training Satisfaction | 0.867, 0.878, 0.888, 0.875 | 0.769 | 0.930 | 0.900 |
Training Transfer | 0.921, 0.925, 0.914, 0.882 | 0.829 | 0.951 | 0.931 |
VI | IN | PV | PS | PU | PEOU | TS | TT | |
---|---|---|---|---|---|---|---|---|
VI | ||||||||
IN | 0.744 | |||||||
PV | 0.097 | 0.131 | ||||||
PS | 0.180 | 0.179 | 0.556 | |||||
PU | 0.521 | 0.443 | 0.069 | 0.260 | ||||
PEOU | 0.487 | 0.487 | 0.094 | 0.185 | 0.775 | |||
TS | 0.701 | 0.677 | 0.155 | 0.171 | 0.642 | 0.585 | ||
TT | 0.638 | 0.533 | 0.069 | 0.165 | 0.588 | 0.588 | 0.757 |
PU | PEOU | TS | TT | |
---|---|---|---|---|
VI | 1.903 | 1.772 | ||
IN | 1.867 | 1.772 | ||
PV | 1.408 | |||
PS | 1.449 | |||
PEOU | 1.362 | 2.074 | ||
PU | 2.074 | |||
TS | 1.000 |
Path | Hypotheses | Beta | Results | f2 |
---|---|---|---|---|
PU → TS | H1 | 0.403 ** | Supported | 0.125 |
PEOU → TS | H2 | 0.254 ** | Supported | 0.050 |
PEOU → PU | H3 | 0.621 ** | Supported | 0.642 |
VI → PU | H4(a) | 0.160 * | Supported | 0.031 |
VI → PEOU | H4(b) | 0.303 ** | Supported | 0.070 |
IN → PU | H5(a) | 0.008 | Not supported | - |
IN → PEOU | H5(b) | 0.255 ** | Supported | 0.049 |
PV → PU | H6 | −0.088 | Not Supported | - |
PS → PU | H7 | 0.155 * | Supported | 0.038 |
TS → TT | H8 | 0.698 ** | Supported | 0.951 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Yoo, J.W.; Park, J.S.; Park, H.J. Understanding VR-Based Construction Safety Training Effectiveness: The Role of Telepresence, Risk Perception, and Training Satisfaction. Appl. Sci. 2023, 13, 1135. https://doi.org/10.3390/app13021135
Yoo JW, Park JS, Park HJ. Understanding VR-Based Construction Safety Training Effectiveness: The Role of Telepresence, Risk Perception, and Training Satisfaction. Applied Sciences. 2023; 13(2):1135. https://doi.org/10.3390/app13021135
Chicago/Turabian StyleYoo, Joon Woo, Jun Sung Park, and Hee Jun Park. 2023. "Understanding VR-Based Construction Safety Training Effectiveness: The Role of Telepresence, Risk Perception, and Training Satisfaction" Applied Sciences 13, no. 2: 1135. https://doi.org/10.3390/app13021135
APA StyleYoo, J. W., Park, J. S., & Park, H. J. (2023). Understanding VR-Based Construction Safety Training Effectiveness: The Role of Telepresence, Risk Perception, and Training Satisfaction. Applied Sciences, 13(2), 1135. https://doi.org/10.3390/app13021135