The Design and Assessment of a Virtual Reality System for Driver Psychomotor Evaluation
Abstract
1. Introduction
2. Materials and Methods
2.1. Background on Licensing Tests
2.2. Hardware and Devices
2.3. Software and Development Environment
2.4. Scoring Method
2.5. Test Design and Implementation
2.6. Validation and Data Collection
2.7. Rationale for Test Selection and Relation to Driving Performance
3. Results
3.1. Functional Assessment Using Black-Box Testing
3.2. Usability Testing
3.2.1. Q1. Realism of Virtual Scenarios
3.2.2. Q2. Ease of Use of the VR System
3.2.3. Q3. Accuracy in the Capture of Psychosensory and Sensometric Skills
3.2.4. Q4. Recommendation for the Use of VR for Testing
3.2.5. Q5. Physical Discomfort or Eye Fatigue During Use
3.2.6. Q6. Adequate Duration of Tests
3.2.7. Q7. Clarity of Test Indications
4. Discussion
4.1. General Findings and Realism of Scenarios
4.2. Psychomotor Test Performance
4.3. Usability, Acceptance, and Demographic Analyses
4.4. Comparison with Conventional Tools and Educational Value
4.5. Heterogeneity in User Experience and Limitations
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Pajković, V.; Grdinić-Rakonjac, M. Age-related differences in attitudes and perception on road safety issues in Montenegro. Transp. Res. Procedia 2022, 6, 584–591. [Google Scholar] [CrossRef]
- Pajković, V.; Grdinić-Rakonjac, M. Road users’ attitudes and perception on selected road safety issues—Age-related comparison. Eur. Transp.—Trasp. Eur. 2021, 85, 7. [Google Scholar] [CrossRef]
- Farooq, D.; Juhasz, J. Statistical evaluation of risky driver behavior factors that influence road safety based on drivers age and driving experience in Budapest and Islamabad. Eur. Transp.—Trasp. Eur. 2020, 80, 2. [Google Scholar] [CrossRef]
- Farooq, D.; Juhasz, J. Analysis of Young Driver behaviour related to road safety issues in Pakistan and Hungary. In Proceedings of the World Congress on Civil, Structural, and Environmental Engineering, Budapest, Hungary, 8–10 April 2018. [Google Scholar] [CrossRef]
- Su, Z.; Woodman, R.; Smyth, J.; Elliott, M. The relationship between aggressive driving and driver performance: A systematic review with meta-analysis. Accid. Anal. Prev. 2023, 183, 106972. [Google Scholar] [CrossRef]
- Borovec, K. The relation of driver characteristics with their punishable behavior in traffic. Sigurnost 2023, 65, 373–393. [Google Scholar] [CrossRef]
- Alonso, F.; Esteban, C.; Montoro, L.; Useche, S.A. Knowledge, perceived effectiveness and qualification of traffic rules, police supervision, sanctions and justice. Cogent Soc. Sci. 2017, 3, 1393855. [Google Scholar] [CrossRef]
- Wang, W.; Yang, Y.; Chen, A.; Pan, Z. A scoring method for driving safety credit using trajectory data. In Proceedings of the 2019 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Internet of People and Smart City Innovation, SmartWorld/UIC/ATC/SCALCOM/IOP/SCI 2019, Leicester, UK, 19–23 August 2019; pp. 558–565. [Google Scholar] [CrossRef]
- Palk, G.; Freeman, J.; Kee, A.G.; Steinhardt, D.; Davey, J. The prevalence and characteristics of self-reported dangerous driving behaviours among a young cohort. Transp. Res. Part F Traffic Psychol. Behav. 2011, 14, 147–154. [Google Scholar] [CrossRef][Green Version]
- Saeidi, T.; Mishra, S.; Mehran, B. Influencing factors on drivers’ support for traffic safety laws in Canada. Case Stud. Transp. Policy 2024, 15, 101150. [Google Scholar] [CrossRef]
- Divyasri, C.; Neelima, N.; Smitha, T.V. Machine Learning for Road Safety Enhancement Through In-Vehicle Sensor Analysis. In Proceedings of the 2024 3rd International Conference on Electrical, Electronics, Information and Communication Technologies, ICEEICT 2024, Trichy, India, 24–26 July 2024. [Google Scholar] [CrossRef]
- Ucar, S.; Hoh, B.; Oguchi, K. Differential Deviation Based Abnormal Driving Behavior Detection. In Proceedings of the IEEE Conference on Intelligent Transportation Systems, ITSC, Indianapolis, IN, USA, 19–22 September 2021; pp. 1553–1558. [Google Scholar] [CrossRef]
- Chuah, K.M.; Chen, C.J.; Teh, C.S. ViSTREET: An educational virtual environment for the teaching of road safety skills to school students. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Springer: Berlin/Heidelberg, Germany, 2009; pp. 392–403. [Google Scholar] [CrossRef]
- Fokides, E.; Tsolakidis, C. A pilot project to teach road safety using desktop virtual reality. In Cases on Technology Enhanced Learning Through Collaborative Opportunities; Information Science Reference: Hershey, PA, USA, 2010; pp. 111–136. [Google Scholar] [CrossRef]
- Pandey, K.; Grimes, G.J.; Schwebel, D.C. A low cost approach to pediatric pedestrian safety in virtual reality. In Proceedings of the 2009 3rd Asia International Conference on Modelling and Simulation, AMS 2009, Bandung, Indonesia, 25–29 May 2009; pp. 549–554. [Google Scholar] [CrossRef]
- De Cet, G.; Baldassa, A.; Tagliabue, M.; Rossi, R.; Vianello, C.; Gastaldi, M. The Application of Immersive Virtual Reality for Children’s Road Education: Validation of a Pedestrian Crossing Scenario. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Springer: Berlin/Heidelberg, Germany, 2022; pp. 128–140. [Google Scholar] [CrossRef]
- Tzanavari, A.; Matsentidou, S.; Christou, C.G.; Poullis, C. User experience observations on factors that affect performance in a road-crossing training application for children using the CAVE. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Springer: Berlin/Heidelberg, Germany, 2014; pp. 91–101. [Google Scholar] [CrossRef]
- Khan, N.; Muhammad, K.; Hussain, T.; Nasir, M.; Munsif, M.; Imran, A.S.; Sajjad, M. An adaptive game-based learning strategy for children road safety education and practice in virtual space. Sensors 2021, 21, 3661. [Google Scholar] [CrossRef]
- Szczurowski, K.; Smith, M. ‘Woodlands’-A Virtual Reality Serious Game Supporting Learning of Practical Road Safety Skills. In Proceedings of the 2018 IEEE Games, Entertainment, Media Conference, GEM 2018, Galway, Ireland, 15–17 August 2018; pp. 427–435. [Google Scholar] [CrossRef]
- Raju, A.D.J.; Briyolan, B.G.; Stephy, K.A.; Byju, B. The Integration of Virtual Reality (VR) in Driver Education. In Proceedings of the 6th International Conference on Innovative Trends in Information Technology: Secure, Trustworthy and Socially Responsible AI, ICITIIT 2025, Kottayam, India, 21–22 February 2025. [Google Scholar] [CrossRef]
- Xuan, T.J.; Albert, Q. The study about using VR with smart phones for road safety awareness and timing. In Proceedings of the ACM International Conference Proceeding Series, Bali, Jakarta, Surabaya, Indonesia, 1–9 April 2019; pp. 142–146. [Google Scholar] [CrossRef]
- Gomes, A.; Alcaso, D.; Páris, C. TRAINER: Virtual Reality Game for Teaching Road Safety. In Lecture Notes in Bioengineering; Springer: Berlin/Heidelberg, Germany, 2023; pp. 413–422. [Google Scholar] [CrossRef]
- Sánchez, J.S.; Ortiz, J.S.; Mayorga, O.A.; Sánchez, C.R.; Andaluz, G.M.; Bonilla, E.L.; Andaluz, V.H. Virtual Simulator for the Taking and Evaluation of Psychometric Tests to Obtain a Driver’s License. In Augmented Reality, Virtual Reality, and Computer Graphics, Proceedings of the 6th International Conference, AVR 2019, Santa Maria al Bagno, Italy, 24–27 June 2019; Part I; Springer: Berlin/Heidelberg, Germany, 2019; pp. 138–149. [Google Scholar] [CrossRef]
- Biela, A.; Wontorczyk, A.; Gorbaniuk, O. Searching for Predictors of Safe Driving Behaviour as an Important Activity in Achieving an Integrated Traffic System. Research on the Behavioural Criterion of the Psychometric Test Validity for Drivers. J. Perspect. Econ. Political Soc. Integr. 2021, 27, 2. [Google Scholar] [CrossRef]
- LOTAIP_6_Ley-Organica-de-Transporte-Terrestre-Transito-y-Seguridad-Vial-2021.pdf. Available online: https://www.obraspublicas.gob.ec/wp-content/uploads/downloads/2021/08/LOTAIP_6_Ley-Organica-de-Transporte-Terrestre-Transito-y-Seguridad-Vial-2021.pdf (accessed on 27 July 2025).
- Innes, C.R.H.; Jones, R.D.; Anderson, T.J.; Hollobon, S.G.; Dalrymple-Alford, J.C. Performance in normal subjects on a novel battery of driving-related sensory-motor and cognitive tests. Behav. Res. Methods 2009, 41, 284–294. [Google Scholar] [CrossRef]
- Innes, C.R.H.; Jones, R.; Anderson, T.; Dalrymple-Alford, J.; Hayes, S.; Hollobon, S.; Severinsen, J.; Smith, G.; Nicholls, A. Prediction of driving ability in persons with brain disorders using sensory-motor and cognitive tests. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology—Proceedings, Shanghai, China, 1–4 September 2005; pp. 5439–5442. [Google Scholar] [CrossRef]
- Innes, C.R.H.; Jones, R.D.; Dalrymple-Alford, J.C.; Hayes, S.; Hollobon, S.; Severinsen, J.; Smith, G.; Nicholls, A.; Anderson, T.J. Sensory-motor and cognitive tests predict driving ability of persons with brain disorders. J. Neurol. Sci. 2007, 260, 188–198. [Google Scholar] [CrossRef]
- Pečečnik, K.S.; Medarević, J.; Čižman-Štaba, U.; Rutar, M.; Sremec, M.; Sodnik, J. Can Simulated Driving-Based Tasks Reliably Assess Fitness to Drive? In Lecture Notes in Networks and Systems; Springer: Dordrecht, The Netherlands, 2024; pp. 410–424. [Google Scholar] [CrossRef]
- He, Y.; Sun, W.; Leung, P.S.-W.; Chow, Y.-T. Effect of static magnetic field of electric vehicles on driving performance and on neuro-psychological cognitive functions. Int. J. Environ. Res. Public Health 2019, 16, 3382. [Google Scholar] [CrossRef]
- He, Y.; Leung, P.S.W. The effect of static magnetic field exposure to drivers cognitive ability. In Proceedings of the 2019 Joint International Symposium on Electromagnetic Compatibility, Sapporo and Asia-Pacific International Symposium on Electromagnetic Compatibility, EMC Sapporo/APEMC 2019, Sapporo, Japan, 3–7 June 2019; pp. 166–169. [Google Scholar] [CrossRef]
- Ferreira, I.S.; Simões, M.R.; Marôco, J. The Addenbrooke’s Cognitive Examination Revised as a potential screening test for elderly drivers. Accid. Anal. Prev. 2012, 49, 278–286. [Google Scholar] [CrossRef]
- Shanmugaratnam, S.; Kass, S.J.; Arruda, J.E. Age differences in cognitive and psychomotor abilities and simulated driving. Accid. Anal. Prev. 2010, 42, 802–808. [Google Scholar] [CrossRef]
- Aksan, N.; Anderson, S.W.; Dawson, J.D.; Johnson, A.M.; Uc, E.Y.; Rizzo, M. Cognitive functioning predicts driver safety on road tests 1 and 2 years later. J. Am. Geriatr. Soc. 2012, 60, 99–105. [Google Scholar] [CrossRef] [PubMed]
- Gimeno, P.T.; Cerezuela, G.P.; Crespo, A. Exploración Visual Y Movimientos Oculares En Conductores Con Distinta Experiencia: Una Revisión. An. Psicol./Ann. Psychol. 2004, 20, 1. [Google Scholar]
- Svärd, M.; Bärgman, J.; Victor, T. Detection and response to critical lead vehicle deceleration events with peripheral vision: Glance response times are independent of visual eccentricity. Accid. Anal. Prev. 2021, 150, 105853. [Google Scholar] [CrossRef]
- Sanchez-Mateo, S. Análisis del Comportamiento Visual del Conductor Aplicado a la Toma de Decisiones en Vehículos Autónomos. Ph.D. Thesis, Universidad Politécnica de Madrid, Madrid, Spain, 2023. [Google Scholar] [CrossRef]
- González, T.; Ibeas, C.; Gravert, I.; León, A.; Rojas, M. Characteristics of a Virtual Reality scenario for anatomy learning: A literature review. Rev. Española Educ. Médica 2022, 3, 3. [Google Scholar] [CrossRef]
- Xiong, J.; Hsiang, E.-L.; He, Z.; Zhan, T.; Wu, S.-T. Augmented reality and virtual reality displays: Emerging technologies and future perspectives. Light. Sci. Appl. 2021, 10, 216. [Google Scholar] [CrossRef]
- Xie, B.; Liu, H.; Alghofaili, R.; Zhang, Y.; Jiang, Y.; Lobo, F.D.; Li, C.; Li, W.; Huang, H.; Akdere, M.; et al. A Review on Virtual Reality Skill Training Applications. Front. Virtual Real. 2021, 2, 645153. [Google Scholar] [CrossRef]
- Kourtesis, P.; MacPherson, S.E. How immersive virtual reality methods may meet the criteria of the National Academy of Neuropsychology and American Academy of Clinical Neuropsychology: A software review of the Virtual Reality Everyday Assessment Lab (VR-EAL). Comput. Hum. Behav. Rep. 2021, 4, 100151. [Google Scholar] [CrossRef]
- Luciani, M.; De Maria, M.; Page, S.D.; Barbaranelli, C.; Ausili, D.; Riegel, B. Measuring Self-Care in the General Adult Population: Development and Psychometric Testing of the Self-Care Inventory. BMC Public Health 2022, 22, 598. [Google Scholar] [CrossRef]
- Navon—Eyal, M.; Taubman—Ben-Ari, O. Can Emotion Regulation Explain the Association between Age and Driving Styles? Transp. Res. Part F Traffic Psychol. Behav. 2020, 74, 439–445. [Google Scholar] [CrossRef]
- Fiorenzato, E.; Zabberoni, S.; De Simone, M.S.; Costa, A.; Tieri, G.; Taglieri, S.; Peppe, A.; Carlesimo, G.A.; Caltagirone, C.; Antonini, A.; et al. Effects of Virtual Reality Cognitive Training on Executive Function and Prospective Memory in Parkinson’s Disease and Healthy Aging. J. Neurol. Sci. 2025, 473, 123507. [Google Scholar] [CrossRef]
- Gårdinger, M.B.; Johansson, R.; Lidestam, B.; Selander, H. Validation of a Computerized Driving Simulator Test of Cognitive Abilities for Fitness-to-Drive Assessments. Front. Psychol. 2023, 14, 1294965. [Google Scholar] [CrossRef] [PubMed]
- Krasniuk, S.; Toxopeus, R.; Knott, M.; McKeown, M.; Crizzle, A.M. The Effectiveness of Driving Simulator Training on Driving Skills and Safety in Young Novice Drivers: A Systematic Review of Interventions. J. Saf. Res. 2024, 91, 20–37. [Google Scholar] [CrossRef] [PubMed]
- Boboc, R.G.; Butilă, E.V.; Butnariu, S. Leveraging Wearable Sensors in Virtual Reality Driving Simulators: A Review of Techniques and Applications. Sensors 2024, 24, 4417. [Google Scholar] [CrossRef]
- Roh, Y.S.; In Jang, K.; Lee, E.A.L. Influencing Factors and Learning Outcomes in Virtual Simulation Learning Experiences: A Structural Equation Modeling. Nurse Educ. Today 2025, 150, 106681. [Google Scholar] [CrossRef] [PubMed]
- Himmels, C.; Venrooij, J.; Parduzi, A.; Peller, M.; Riener, A. The Bigger the Better? Investigating the Effects of Driving Simulator Fidelity on Driving Behavior and Perception. Transp. Res. Part F Traffic Psychol. Behav. 2024, 101, 250–266. [Google Scholar] [CrossRef]
- Piaseczna, N.; Doniec, R.; Sieciński, S.; Barańska, K.; Jędrychowski, M.; Grzegorzek, M. Driving Reality vs. Simulator: Data Distinctions. Electronics 2024, 13, 2708. [Google Scholar] [CrossRef]
- Smyth, J.; Birrell, S.; Mouzakitis, A.; Jennings, P. Motion Sickness and Human Performance—Exploring the Impact of Driving Simulator User Trials. Adv. Intell. Syst. Comput. 2019, 786, 445–457. [Google Scholar] [CrossRef]
- Han, J.; Wang, X.; Wang, G. Modeling the Car-Following Behavior with Consideration of Driver, Vehicle, and Environment Factors: A Historical Review. Sustainability 2022, 14, 8179. [Google Scholar] [CrossRef]
- Jongen, S.; Perrier, J.; Vuurman, E.F.; Ramaekers, J.G.; Vermeeren, A. Sensitivity and Validity of Psychometric Tests for Assessing Driving Impairment: Effects of Sleep Deprivation. PLoS ONE 2015, 10, e0117045. [Google Scholar] [CrossRef]
- Roelofs, E.C.; Emons, W.H.M.; Verschoor, A.J. Exploring Task Features That Predict Psychometric Quality of Test Items: The Case for the Dutch Driving Theory Exam. Int. J. Test. 2021, 21, 80–104. [Google Scholar] [CrossRef]
- Cutler, B.L.; Kravitz, D.A.; Cohen, M.; Schinas, W. The Driving Appraisal Inventory: Psychometric Characteristics and Construct Validity1. J. Appl. Soc. Psychol. 1993, 23, 1196–1213. [Google Scholar] [CrossRef]




| Test | Hits (Median ± SD) | Errors (Median ± SD) | Time (Median ± SD) |
|---|---|---|---|
| Peripheral vision | 35.96 ± 5.22 | 4.03 ± 5.22 | 1:06 ± 0.0033 |
| Reaction | 34.74 ± 4.68 | 5.26 ± 4.68 | 1:17 ± 0.0043 |
| Precision | N/A | 1.67 ± 2.96 | 0:47 ± 0.0043 |
| Item | F | p-Value |
|---|---|---|
| Q1 | 0.78 | 0.379 |
| Q2 | 0.46 | 0.501 |
| Q3 | 0.00 | 1.000 |
| Q4 | 0.74 | 0.393 |
| Q5 | 6.19 | 0.015 |
| Q6 | 0.31 | 0.579 |
| Q7 | 0.50 | 0.480 |
| Item | F | p-Value |
|---|---|---|
| Q1 | 0.67 | 0.51 |
| Q2 | 2.04 | 0.14 |
| Q3 | 0.82 | 0.44 |
| Q4 | 1.27 | 0.28 |
| Q5 | 2.56 | 0.09 |
| Q6 | 1.11 | 0.33 |
| Q7 | 0.73 | 0.48 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Veloz, J.L.; Alcívar-Cedeño, A.; Cedeño-Zambrano, T.M.; Zamora-Plaza, D.M.; Fernández-Arias, P.; Vergara, D.; del Bosque, A. The Design and Assessment of a Virtual Reality System for Driver Psychomotor Evaluation. Eng 2025, 6, 301. https://doi.org/10.3390/eng6110301
Veloz JL, Alcívar-Cedeño A, Cedeño-Zambrano TM, Zamora-Plaza DM, Fernández-Arias P, Vergara D, del Bosque A. The Design and Assessment of a Virtual Reality System for Driver Psychomotor Evaluation. Eng. 2025; 6(11):301. https://doi.org/10.3390/eng6110301
Chicago/Turabian StyleVeloz, Jorge Luis, Andrea Alcívar-Cedeño, Tony Michael Cedeño-Zambrano, Deiter Miguel Zamora-Plaza, Pablo Fernández-Arias, Diego Vergara, and Antonio del Bosque. 2025. "The Design and Assessment of a Virtual Reality System for Driver Psychomotor Evaluation" Eng 6, no. 11: 301. https://doi.org/10.3390/eng6110301
APA StyleVeloz, J. L., Alcívar-Cedeño, A., Cedeño-Zambrano, T. M., Zamora-Plaza, D. M., Fernández-Arias, P., Vergara, D., & del Bosque, A. (2025). The Design and Assessment of a Virtual Reality System for Driver Psychomotor Evaluation. Eng, 6(11), 301. https://doi.org/10.3390/eng6110301

