Safer Working at Heights: Exploring the Usability of Virtual Reality for Construction Safety Training among Blue-Collar Workers in Kuwait
Abstract
:1. Introduction and Background
Purpose
- Is there a significant difference between the awareness and knowledge retention related to working at heights before versus after the VR training?
- Is there a significant difference between the learning effectiveness based on traditional training versus training using VR?
- How do construction workers perceive the usability of the VR approach?
2. Methodology
2.1. Sampling Approach
- The case is critical and allows testing a well-formulated theory;
- The case is unique or extreme;
- The case is representative or typical;
- The case allows the analysis of a previously inaccessible phenomenon; and,
- The case is longitudinal in nature (i.e., covering an extended period of time) and allows analysis at different points of time.
2.2. Developing the Training Modules
- (1)
- The control group, utilizing a traditional training approach;
- (2)
- The experimental group, utilizing a Head Mounted Display (HMD) VR approach.
2.2.1. HMD VR Module
- Securing floor openings;
- Supporting outliers of a scissor lift;
- Handling a ladder; and,
- Using a Personal Fall Arrest System (PFAS) consisting of body harness and lanyard.
2.2.2. Traditional Training
2.3. Pre- and Post-Test
- Securing floor openings;
- supporting outliers of scissor lift;
- handling a ladder; and
- Using Personal Fall Arrest System (PFAS) consisting of body harness and lanyard.
- No previous major accident;
- No previous experience with using VR; and,
- Low personal risk acceptance.
- U1.
- I think that I would like to use this system frequently;
- U2.
- I found the system to be unnecessarily complex;
- U3.
- I thought the system was easy to use;
- U4.
- I think that I would need the support of a technical person to be able to use this system;
- U5.
- I found the various functions in this system were well integrated;
- U6.
- I thought there was too much inconsistency in this system;
- U7.
- I would imagine that most people would learn to use this system very quickly;
- U8.
- I found the system very cumbersome to use;
- U9.
- I felt very confident using the system; and,
- U10.
- I needed to earn a lot of things before I could get going with this system.
3. Results and Discussion
3.1. Demographic Data Analysis
3.2. Pre- and Post-Test Results
3.3. SUS Scores
- (1)
- All VR group workers reflected difficulties with the hand controllers;
- (2)
- Workers required extra encouragement to use the teleporting function;
- (3)
- In total, five workers of the VR group expressed explicitly that using the VR approach was too complicated;
- (4)
- In total, two workers of the VR group expressed explicitly that they enjoyed using the VR approach;
- (5)
- One younger worker, although struggling much less with the VR approach than most of the other VR users, remarked: “I still like the traditional training more”.
3.4. Correlation Analysis
- U1 (I think that I would like to use this system frequently) and age;
- U3 (I thought the system was easy to use) and experience;
- U3 (I thought the system was easy to use) and training; and,
- U5 (I found the various functions in this system were well integrated) and injuries.
- (1)
- More experienced workers more often expressed dissatisfaction with the virtual tablet and using the hand controllers than younger workers;
- (2)
- More experienced workers verbally expressed that the virtual safety challenges were common situations which were very easy to deal with;
- (3)
- Less experienced workers considered unacceptable scissors lift supports to be acceptable;
- (4)
- One older worker loudly expressed his dissatisfaction at not realizing the importance of looking upwards to see the electrocution hazard resulting from the ladder touching the electricity line by saying: “Of course I would look upward. Everybody knows that I have the best safety record”. The cause of not looking upward was obviously not related to negligence or a lack of knowledge, but it was clearly related to feeling overwhelmed with wearing the headset, and the impact of hand and body movements on the displayed virtual reality and the visual disconnection with others present in the training venue.
- (1)
- All five safety engineers of the five companies supporting this study observed their workers’ performance and stated that the VR approach requires significant preparation of workers regarding the virtual usage of tablets and hand controllers;
- (2)
- The safety engineers were excited to try the VR training themselves and faced almost no difficulties;
- (3)
- An iterative three-stage approach to the VR training (starting with a video-based introduction, continuing with familiarization with the headset and hand controllers based on a module different from “working at heights”, and finally using the module “working at heights”) led to a slightly higher level of confidence of workers, but did still not lead to an observable higher appreciation of the VR approach by workers;
- (4)
- Necessary interventions, such as when trainees accidentally crossed the space boundary and a user code had to be re-entered by the authors of this study since it was too complicated for workers to do themselves, contributed to workers perception of limited usability of the VR approach.
4. Conclusions and Limitations
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Ojha, A.; Seagers, J.; Shayesteh, S.; Habibnezhad, M. Construction Safety Training Methods and their Evaluation Approaches: A Systematic Literature Review. In Proceedings of the 8th International Conference on Construction Engineering and Project Management, Hong Kong, China, 7–8 December 2020. [Google Scholar]
- ILO. Construction: A Hazardous Work. Available online: https://www.ilo.org/safework/areasofwork/hazardous-work/WCMS_356576/lang--en/index.htm#:~:text=At%20least%20108%20thousand%20workers,die%20from%20accidents%20at%20work (accessed on 31 July 2023).
- U.S. Bureau of Labor Statistics202. Construction Deaths Due to Falls, Slips, and Trips Increased 5.9 Percent in 2021. U.S. Bureau of Labor Statistics. Available online: https://www.bls.gov/opub/ted/2023/construction-deaths-due-to-falls-slips-and-trips-increased-5-9-percent-in-2021.htm#:~:text=In%202021%2C%20nearly%201%20in,slips%2C%20and%20trips%20in%202021 (accessed on 31 July 2023).
- Sacks, R.; Perlman, A.; Barak, R. Construction safety training using immersive virtual reality. Constr. Manag. Econ. 2013, 31, 1005–1017. [Google Scholar] [CrossRef]
- Toyoda, R.; Russo-Abegão, F.; Glassey, J. VR-based health and safety training in various high-risk engineering industries: A literature review. Int. J. Educ. Technol. High. Educ. 2022, 19, 42. [Google Scholar] [CrossRef]
- Gao, Y.; Gonzalez, V.A.; Yiu, T.W. The effectiveness of traditional tools and computer-aided technologies for health and safety training in the construction sector: A systematic review. Comput. Educ. 2019, 138, 101–115. [Google Scholar] [CrossRef]
- Bhagwat, K.; Kumar, P.; Delhi, V.S.K. Usability of Visualization Platform–Based Safety Training and Assessment Modules for Engineering Students and Construction Professionals. J. Civ. Eng. Educ. 2021, 147, 04020016. [Google Scholar] [CrossRef]
- Al-Khiami, M.I.; Jaeger, M.; Soleimani, S.M. The Integration of Digital Techniques in Engineering Education: A Case Study to Evaluate Student’s Motivation and Performance. Int. J. Inf. Educ. Technol. 2023, 13, 844–848. [Google Scholar] [CrossRef]
- Al-Khiami, M.I.; Jaeger, M.; Soleimani, S.M. The Use of Disruptive Technologies in the Construction Industry: A Case Study to Compare 2D and VR Methods of Concrete Design Interpretation. Proceedings 2023, 85, 1. [Google Scholar] [CrossRef]
- Pham, H.C.; Dao, N.; Pedro, A.; Le, Q.T.; Hussain, R.; Cho, S.; Park, C.S. Virtual Field Trip for Mobile Construction Safety Education Using 360-Degree Panoramic Virtual Reality*. Int. J. Eng. Educ. 2018, 34, 1174–1191. [Google Scholar]
- Stiles, S.; Ryan, B.; Golightly, D. Use of Virtual Reality: Evaluating the effectiveness of safety training interventions on rail engineering projects. In Proceedings of the Irish Rail Safety Council Conference, Dublin, Ireland, 22–26 October 2018. [Google Scholar]
- Zhang, M.; Shu, L.; Luo, X.; Yuan, M.; Zheng, X. Virtual reality technology in construction safety training: Extended technology acceptance model. Autom. Constr. 2022, 135, 104113. [Google Scholar] [CrossRef]
- Yoo, J.W.; Park, J.S.; Park, H.J. Understanding VR-Based Construction Safety Training Effectiveness: The Role of Telepresence, Risk Perception, and Training Satisfaction. Appl. Sci. 2023, 13, 1135. [Google Scholar] [CrossRef]
- Kartam, N.A.; Bouz, R.G. Fatalities and injuries in the Kuwaiti construction industry. Accid. Anal. Prev. 1998, 30, 805–814. [Google Scholar] [CrossRef] [PubMed]
- Al-Humaidi, H.M.; Tan, F.H. Construction Safety in Kuwait. J. Perform. Constr. Facil. 2010, 24, 70–77. [Google Scholar] [CrossRef]
- Al-Sadhan, A. The Minister and the Blacklist. Alrai. Available online: https://www.alraimedia.com/article/1559052/مقالات/الوزير-والقائمة-السوداء (accessed on 1 August 2023).
- Yin, R.K. Case Study Research: Design and Methods; Sage Publication: London, UK, 2014. [Google Scholar]
- Bellgardt, M.; Pick, S.; Zielasko, D.; Vierjahn, T.; Weyers, B.; Kuhlen, T.W. Utilizing immersive virtual reality in everydaywork. In Proceedings of the 2017 IEEE 3rd Workshop on Everyday Virtual Reality (WEVR), Los Angeles, CA, USA, 19 March 2017; pp. 1–4. [Google Scholar] [CrossRef]
- Brooke, J. SUS: A ’Quick and Dirty’ Usability Scale. Usability Eval. Ind. 1996, 189, 4–7. [Google Scholar]
- Kirkpatrick, D.L.; Kirkpatrick, J.D. Evaluating Training Programs: The Four Levels; Berrett-Koehler: San Francisco, CA, USA, 2006. [Google Scholar]
- Cohen, J.; Cohen, P.; West, S.G.; Aiken, L.S. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences; Routledge: New York, NY, USA; London, UK, 2015. [Google Scholar]
- Brooke, J. SUS: A retrorespective. J. Usability Stud. 2013, 8, 29–40. [Google Scholar]
- Rey-Becerra, E.; Barrero, L.H.; Ellegast, R.; Kluge, A. The effectiveness of virtual safety training in work at heights: A literature review. Appl. Ergon. 2021, 94, 103419. [Google Scholar] [CrossRef]
- Al-Khiami, M.I.; Jaeger, M.; Soleimani, S.M. A Gamified Approach to Concrete Structure’s Interpretation using Virtual Reality: A Study of Performance and Simulation Sickness. In Proceedings of the 2023 IEEE Global Engineering Education Conference (EDUCON), Kuwait, Kuwait, 1–4 May 2023; pp. 1–6. [Google Scholar] [CrossRef]
Variable [Unit] | Traditional (n = 15) | VR (n = 16) | ||
---|---|---|---|---|
Mean | SD | Mean | SD | |
Age [years] | 37.80 | 6.98 | 40.25 | 7.28 |
Experience [years] | 12.07 | 6.10 | 12.81 | 7.74 |
Training [sessions] | 20.07 | 34.34 | 11.69 | 14.61 |
Injuries [injuries] | 0.47 | 1.02 | 0.63 | 1.41 |
Participant Groups | Measures | Pre-Test | Post-Test | Difference Score |
---|---|---|---|---|
Traditional | Mean | 0.69 | 0.70 | 0.01 |
SD | 0.14 | 0.14 | 0.16 | |
VR | Mean | 0.68 | 0.71 | 0.03 |
SD | 0.14 | 0.17 | 0.14 |
Pre-T vs. Pre-VR | Post-T vs. Post-VR | Post-T vs. Pre-T | Post-VR vs. Pre-VR | Diff T vs. Diff VR | |
---|---|---|---|---|---|
df | 29 | 29 | 14 | 15 | 29 |
t-Value | 0.205 | −0.140 | 0.293 | 0.861 | −0.336 |
Crit t0.95 | 1.699 | 1.699 | 1.761 | 1.753 | 1.699 |
p-Value | 0.419 | 0.445 | 0.387 | 0.201 | 0.369 |
Participant Groups | Measure | SUS Score (Percentile) |
---|---|---|
Traditional | Mean | 67.83 |
SD | 17.79 | |
VR | Mean | 59.67 |
SD | 17.50 |
SUS T vs. SUS VR | |
---|---|
df | 29 |
t-Value | 1.243 |
Crit t0.95 | 1.699 |
p-Value | 0.112 |
Age | Experience | Training | Injuries | Pre-Test Score | SUS Score | |
---|---|---|---|---|---|---|
Age | 1 | |||||
Experience | 0.599 | 1 | ||||
Training | −0.076 | −0.103 | 1 | |||
Injuries | −0.212 | 0.093 | 0.080 | 1 | ||
Pre-test score | −0.007 | 0.138 | 0.284 | −0.010 | 1 | |
SUS score | −0.473 | −0.388 | 0.131 | 0.234 | −0.076 | 1 |
Age | Experience | Training | Injuries | Pre-Test Score | |
---|---|---|---|---|---|
U1 | −0.501 | −0.348 | 0.163 | −0.085 | 0.067 |
U2 | −0.124 | −0.001 | 0.041 | 0.065 | −0.309 |
U3 | −0.032 | 0.548 | −0.540 | 0.405 | −0.014 |
U4 | 0.420 | 0.200 | −0.286 | 0.306 | −0.172 |
U5 | 0.392 | 0.425 | 0.034 | 0.522 | −0.255 |
U6 | −0.057 | −0.194 | −0.139 | −0.088 | −0.157 |
U7 | −0.238 | −0.204 | 0.367 | −0.138 | −0.063 |
U8 | 0.042 | −0.0475 | −0.239 | 0.192 | −0.451 |
U9 | −0.467 | −0.249 | 0.021 | −0.052 | 0.110 |
U10 | −0.030 | −0.006 | −0.474 | 0.015 | −0.276 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Al-Khiami, M.I.; Jaeger, M. Safer Working at Heights: Exploring the Usability of Virtual Reality for Construction Safety Training among Blue-Collar Workers in Kuwait. Safety 2023, 9, 63. https://doi.org/10.3390/safety9030063
Al-Khiami MI, Jaeger M. Safer Working at Heights: Exploring the Usability of Virtual Reality for Construction Safety Training among Blue-Collar Workers in Kuwait. Safety. 2023; 9(3):63. https://doi.org/10.3390/safety9030063
Chicago/Turabian StyleAl-Khiami, Mohamad Iyad, and Martin Jaeger. 2023. "Safer Working at Heights: Exploring the Usability of Virtual Reality for Construction Safety Training among Blue-Collar Workers in Kuwait" Safety 9, no. 3: 63. https://doi.org/10.3390/safety9030063
APA StyleAl-Khiami, M. I., & Jaeger, M. (2023). Safer Working at Heights: Exploring the Usability of Virtual Reality for Construction Safety Training among Blue-Collar Workers in Kuwait. Safety, 9(3), 63. https://doi.org/10.3390/safety9030063