Applications of Virtual Reality Simulations and Machine Learning Algorithms in High-Risk Environments †
Abstract
1. Introduction
2. Uses of Virtual Reality for Safety and Education
3. Uses of Machine Learning Algorithms in High-Risk Environments
- In evacuation scenarios, Deep Q-Networks (DQN) and Q-Networks algorithms are used to optimize evacuation routes and improve the efficiency of evacuation procedures. Other reinforcement learning algorithms, such as Proximal Policy Optimization and Soft Actor-Critic, enable agents to learn from interactions with the environment, allowing them to devise strategies that minimize evacuation time while accounting for the dynamic nature of the environment’s behavior. Imitation learning algorithms such as behavioral cloning (BC) and generative adversarial imitation learning (GAIL) can also find escape routes from dangerous environments, with varying success depending on the number of demonstrations and the dynamic nature of the environment;
- A wide range of algorithms are used to prevent accidents in industrial settings, including Hidden Markov Models (HMM), Multilayer Perceptron (MLP), and Ant Colony Optimization. Advanced and modified models such as BOA–NARX and ARIMAX are used for time series forecasting, while Linear Dimension Reduction, Maximal Marginal Likelihood Estimation, and Multiclass Support Vector Machines (SVM) help in analyzing complex datasets. Collectively, these algorithms contribute to early detection and prevention of faults and reduce the risks associated with equipment failures.
- Fire prediction and prevention strategies can be made as a combination of reinforcement learning and traditional prediction models. Algorithms such as value iteration, policy iteration, and Monte Carlo Tree Search simulate and evaluate potential fire spread scenarios. Asynchronous Advantage Actor-Critic (A3C) improves decision-making processes in dynamic environments. Frequency Ratio Multilayer Perceptron (FR-MLP) and linear regression are used to analyze data and identify fire risk factors for timely intervention.
- The search for new conductive elements is performed using supervised learning techniques, including logistic regression and logistic functions. They can help researchers identify patterns and relationships within experimental data to develop innovative materials with improved conductive properties.
4. Research of the Algorithms with a Wide Range of Application
5. Discussion
- Unity or Unreal Engine v2023.2.20f1 (for VR development).
- Python with TensorFlow or PyTorch v2.2.1 (for training ML models).
- ONNX v1.14.0 or TensorFlow Lite (for integrating trained models into real-time VR apps).
- Sensor and input integration (Leap Motion, eye trackers, VR controllers).
- NVIDIA DeepStream v6.0 (for complex video/gesture processing).
- OpenCV v4.8.1 (for real-time image and video processing).
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
VR | Virtual Reality |
ML | Machine Learning |
DQN | Deep Q-Network |
SAC | Soft Actor-Critic |
PPO | Proximal Policy Optimization |
IL | Imitation Learning |
RL | Reinforcement Learning |
GAIL | Generative Adversarial Imitation Learning |
BC | Behavioral Cloning |
SVM | Support Vector Machine |
HMM | Hidden Markov Model |
NARX | Nonlinear autoregressive with external input |
SVR | Support Vector Regressor |
BOA | Bayesian optimization algorithm |
ARIMAX | Autoregressive integrated moving average with exogenous inputs |
DL | Deep Learning |
References
- Gutiérrez A., M.A.; Vexo, F.; Thalmann, D. Stepping into Virtual Reality; Springer Nature Switzerland: Cham, Switzerland, 2023. [Google Scholar] [CrossRef]
- Virtual Reality System—An Overview|ScienceDirect Topics. Available online: https://www.sciencedirect.com/topics/computer-science/virtual-reality-system (accessed on 6 May 2025).
- Architecture of Virtual Reality System-Twin Reality. Available online: https://twinreality.in/architecture-of-virtual-reality-system/ (accessed on 6 May 2025).
- Sindu, I.G.P.; Hartati, R.S.; Sudarma, M.; Gunantara, N. Systematic literature review of machine learning in virtual reality and augmented reality. J. Nas. Pendidik. Tek. Inform. JANAPATI 2023, 12, 108–118. [Google Scholar] [CrossRef]
- Le, H.; Nguyen, M.; Yan, W.Q.; Nguyen, H. Augmented Reality and Machine Learning Incorporation Using YOLOv3 and ARKit. Appl. Sci. 2021, 11, 6006. [Google Scholar] [CrossRef]
- Jiang, H.; Padebettu, R.R.; Sakamoto, K.; Bastani, B. Architecture of Integrated Machine Learning in Low Latency Mobile VR Graphics Pipeline. In SIGGRAPH Asia 2019 Technical Briefs, in SA ‘19; Association for Computing Machinery: New York, NY, USA, 2019; pp. 41–44. [Google Scholar] [CrossRef]
- FileCloud, T. The Limitations of Machine Learning in an Enterprise Setting. FileCloud blog. Available online: https://www.filecloud.com/blog/2018/06/top-5-limitations-of-machine-learning-in-an-enterprise-setting/ (accessed on 5 May 2025).
- Li, Y.; Wang, Y.; Liu, Q.; Bi, C.; Jiang, X.; Sun, S. Incremental semi-supervised learning on streaming data. Pattern Recognit. 2019, 88, 383–396. [Google Scholar] [CrossRef]
- What Is Transfer Learning?|IBM. Available online: https://www.ibm.com/think/topics/transfer-learning (accessed on 5 May 2025).
- Alsheikhy, A.A.; Shawly, T.; Said, Y.E.; Ahmed, H.E.; Alazzam, M.B. Developing machine learning models for personalized game-based stroke rehabilitation therapy in virtual reality. Alex. Eng. J. 2025, 121, 358–369. [Google Scholar] [CrossRef]
- Herne, R.; Shiratuddin, M.F.; Rai, S.; Blacker, D.; Laga, H. Improving Engagement of Stroke Survivors Using Desktop Virtual Reality-Based Serious Games for Upper Limb Rehabilitation: A Multiple Case Study. IEEE Access 2022, 10, 46354–46371. [Google Scholar] [CrossRef]
- Daş, F.; Elmas, E.T.; Bucak, İ.Ö. Innovative Use of Machine Learning-Aided Virtual Reality and Natural Language Processing Technologies in Dyslexia Diagnosis and Treatment Phases. In Digital Frontiers-Healthcare, Education, and Society in the Metaverse Era; IntechOpen: Rijeka, Croatia, 2024. [Google Scholar] [CrossRef]
- Fathy, F.; Mansour, Y.; Sabry, H.; Refat, M.; Wagdy, A. Virtual reality and machine learning for predicting visual attention in a daylit exhibition space: A proof of concept. Ain Shams Eng. J. 2023, 14, 102098. [Google Scholar] [CrossRef]
- Covaciu, F.; Pisla, A.; Iordan, A.-E. Development of a Virtual Reality Simulator for an Intelligent Robotic System Used in Ankle Rehabilitation. Sensors 2021, 21, 1537. [Google Scholar] [CrossRef]
- Towards AI-Architecture Liberty: A Comprehensive Survey on Design and Generation of Virtual Architecture by Deep Learning. Available online: https://arxiv.org/html/2305.00510v4 (accessed on 6 May 2025).
- Galvan-Bobadilla, I.; Ayala-Garcia, A.; Rodriguez-Gallegos, E.; Arroyo-Figueroa, G. Virtual reality training system for the maintenance of underground lines in power distribution system. In Proceedings of the Third International Conference on Innovative Computing Technology (INTECH 2013), London, UK, 29–31 August 2013; IEEE: London, UK, 2013; pp. 199–204. [Google Scholar] [CrossRef]
- Giraldo, J.S.; Kok, K.; Paterakis, N.G. A structured review on game-based learning applied to electrical power and energy engineering. Comp Applic Eng. 2024, 32, e22686. [Google Scholar] [CrossRef]
- Lopez, J.M.G.; Betancourt, R.O.J.; Arredondo, J.M.R.; Laureano, E.V.; Haro, F.R. Incorporating Virtual Reality into the Teaching and Training of Grid-Tie Photovoltaic Power Plants Design. Appl. Sci. 2019, 9, 4480. [Google Scholar] [CrossRef]
- Loch, F.; Koltun, G.; Karaseva, V.; Pantförder, D.; Vogel-Heuser, B. Model-based training of manual procedures in automated production systems. Mechatronics 2018, 55, 212–223. [Google Scholar] [CrossRef]
- Andaluz, V.H.; Pérez, J.A.; Carvajal, C.P.; Ortiz, J.S. Virtual environment for teaching and learning robotics applied to industrial processes. In Augmented Reality, Virtual Reality, and Computer Graphics, Proceedings of the 6th International Conference, AVR 2019, Santa Maria al Bagno, Italy, 24–27 June 2019; Proceedings, Part II 6; Springer International Publishing: Cham, Switzerland, 2019; pp. 442–455. [Google Scholar] [CrossRef]
- Fuller, A.; Fan, Z.; Day, C.; Barlow, C. Digital Twin: Enabling Technologies, Challenges and Open Research. IEEE Access 2020, 8, 108952–108971. [Google Scholar] [CrossRef]
- Ilie, R.; Shaffer, E.; D’Angelo, C.M.; Cermak, D.; Lin, M.Y.; Chen, H. Virtual reality laboratory experiences for electricity and magnetism courses. In Proceedings of the 2021 ASEE Virtual Annual Conference Content Access, Virtual, 2021 July 26. [Google Scholar]
- Pérez, S.S.; Lopez, J.M.G.; Barba, M.A.V.; Betancou, R.O.J.; Solís, J.M.; Ornelas, J.L.R.; García, G.I.R.; Haro, F.R. On the Use of Augmented Reality to Reinforce the Learning of Power Electronics for Beginners. Electronics 2022, 11, 302. [Google Scholar] [CrossRef]
- Morelot, S.; Garrigou, A.; Dedieu, J.; NKaoua, B. Virtual reality for fire safety training: Influence of immersion and sense of presence on conceptual and procedural acquisition. Comput. Educ. 2021, 166, 104145. [Google Scholar] [CrossRef]
- Digital Engineering and Magic, VR Electrical Safety Training/OSHA VR Training. Available online: https://www.youtube.com/watch?v=D4LarinRBFA (accessed on 10 May 2025).
- AAT Training hub, Training For Electrical Safety. Available online: https://aattraininghub.com/services/vr-developersingapore/technology-vr-ar-immersive-singapore-5/ (accessed on 10 May 2025).
- Lima, G.F.M.; Cardoso, A.; Lamounier, E.A., Jr.; Macedo, J.R., Jr. Development of a Virtual Reality Environment of Electric Power Substations for Quality of Service Improvement. Available online: https://www.academia.edu/47180297/Development_of_a_Virtual_Reality_environment_of_electric_power_substations_for_quality_of_service_improvement (accessed on 10 May 2025).
- E-Spaces, Electrical Substation VR Simulator-E-Spaces. Available online: https://e-spaces.com/electrical-substation-vr-simulator/ (accessed on 10 May 2025).
- Greenwald, S.W.; Corning, W.; McDowell, G.; Maes, P.; Belcher, J. ElectroVR: An Electrostatic Playground for Collaborative, Simulation-Based Exploratory Learning in Immersive Virtual Reality. In Proceedings of the International Conference on CSCL 2019 Proceedings, Lyon, France, 17–21 June 2019; pp. 997–1000. [Google Scholar]
- Perez-Ramirez, M.; Arroyo-Figueroa, G.; Ayala, A. The use of a virtual reality training system to improve technical skill in the maintenance of live-line power distribution networks. J. Interact. Learn. Environ. 2021, 29, 1–18. [Google Scholar] [CrossRef]
- Silva, A.C.; Cardoso, A.; Lamounier, E.A.; Barreto, C.L. Virtual Reality for Monitor and Control of Electrical Substations. An. Acad. Bras. Ciências 2021, 93, e20200267. [Google Scholar] [CrossRef]
- Memik, N. The Virtual reality electrical substation field trip: Exploring student perceptions and cognitive learning. STEM Educ. 2021, 1, 47–59. [Google Scholar] [CrossRef]
- Xue, Y.; Wu, R.; Liu, J.; Tang, X. Crowd Evacuation Guidance Based on Combined Action Reinforcement Learning. Algorithms 2021, 14, 26. [Google Scholar] [CrossRef]
- Ibrahim Sohail, M.; Dong, W.; Yang, Q. Machine learning driven smart electric power systems: Current trends and new perspectives. Appl. Energy 2020, 272, 115237. [Google Scholar] [CrossRef]
- Zheng, W.; He, Q.; Zhao, Y. Machine learning for battery research. J. Power Sources 2022, 549, 232125. [Google Scholar] [CrossRef]
- Pang, Y.; Li, Y.; Feng, Z.; Feng, Z.; Zhao, Z.; Chen, S.; Zhang, H. Forest fire occurrence prediction in China based on machine learning methods. Remote Sens. 2022, 14, 5546. [Google Scholar] [CrossRef]
- Mohajane, M.; Costache, R.; Karimi, F.; Pham, Q.B.; Essahlaoui, A.; Nguyen, H.; Laneve, G.; Oudija, F. Application of remote sensing and machine learning algorithms for forest fire mapping in a Mediterranean area. Ecol. Indic. 2021, 129, 107869. [Google Scholar] [CrossRef]
- Subramanian, S.; Crowley, M. Using Spatial Reinforcement Learning to Build Forest Wildfire Dynamics Models From Satellite Images. Frontiers 2018, 5, 6. [Google Scholar] [CrossRef]
- Tüfekci, P. Prediction of full load electrical power output of a base load operated combined cycle power plant using machine learning methods. Int. J. Electr. Power Energy Syst. 2014, 60, 126–140. [Google Scholar] [CrossRef]
- Kunxiang, D.; Zhang, Q.; Zhang, H.; Xiao, P.; Chen, J. Optimal Emergency Evacuation Route Planning Model Based on Fire Prediction Data. Mathematics 2022, 10, 3146. [Google Scholar] [CrossRef]
- Preeti, T.; Kanakaraddi, S.; Beelagi, A.; Malagi, S.; Sudi, A. Forest fire prediction using machine learning techniques. In Proceedings of the 2021 International Conference on Intelligent Technologies (CONIT), Hubli, India, 25–27 June 2021. [Google Scholar]
- Coffield, S.R.; Graff, C.A.; Chen, Y.; Smyth, P.; Foufoula-Georgiou, E.; Randerson, J.T. Machine learning to predict final fire size at the time of ignition. Int. J. Wildland Fire 2019, 28, 861–873. [Google Scholar] [CrossRef]
- Almuhaini, S.H.; Sultana, N. Forecasting Long-Term Electricity Consumption in Saudi Arabia Based on Statistical and Machine Learning Algorithms to Enhance Electric Power Supply Management. Energies 2023, 16, 2035. [Google Scholar] [CrossRef]
- Torp, S. Prediction of Battery Materials Properties with Machine Learning: Developing Algorithms to Discover Electrodes for Li-ion and Mg-Ion Batteries. Master’s Thesis, University of Oslo, Oslo, Norway, 2020. [Google Scholar]
- Flamenbaum, R.D.; Pompo, T.; Havenstein, C.; Thiemsuwan, J. Machine Learning in Support of Electric Distribution Asset Failure Prediction, (SMU Data Science Review 2019). Volume 2: No. 2, Article 16. Available online: https://scholar.smu.edu/datasciencereview/vol2/iss2/16 (accessed on 10 May 2025).
- Goodfellow, I.; Bengio, Y.; Courville, A.; Bengio, Y. Deep Learning; MIT Press: Cambridge, MA, USA, 2016; Volume 1, no. 2. [Google Scholar]
- Byoungjun, K.; Lee, J. A video-based fire detection using deep learning models. Appl. Sci. 2019, 9, 2862. [Google Scholar] [CrossRef]
- Ozcanli Asiye, K.; Yaprakdal, F.; Baysal, M. Deep learning methods and applications for electrical power systems: A comprehensive review. Int. J. Energy Res. 2020, 44, 7136–7157. [Google Scholar] [CrossRef]
- Sun, L.; Yan, J.; Qin, W. Path planning for multiple agents in an unknown environment using soft actor critic and curriculum learning. Comput. Animat. Virtual Worlds 2023, 34, e2113. [Google Scholar] [CrossRef]
- Viola, N. A Reinforcement Learning Approach to Real-Time Emergency Evacuation. 2024. Available online: https://www.diva-portal.org/smash/get/diva2:1891315/FULLTEXT01.pdf (accessed on 10 May 2025).
- Couto, G.C.K.; Antonelo, E.A. Generative adversarial imitation learning for end-to-end autonomous driving on urban environments. In Proceedings of the 2021 IEEE Symposium Series on Computational Intelligence (SSCI), Orlando, FL, USA, 5–7 December 2021. [Google Scholar]
- Codevilla, F.; Santana, E.; López, A.M.; Gaidon, A. Exploring the limitations of behavior cloning for autonomous driving. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea, 27 October–2 November 2019. [Google Scholar]
- Omran, S.; El Houby, E.M. Prediction of electrical power disturbances using machine learning techniques. J. Ambient. Intell. Humaniz. Comput. 2020, 11, 2987–3003. [Google Scholar] [CrossRef]
- Yu, N. Machine Learning and Big Data Analytics in Power Distribution Systems, (IEEE BDA Tutorial Series). IEEE Power & Energy Society. Available online: https://www.youtube.com/watch?v=4TdHoZYPk68 (accessed on 10 May 2025).
- Saad, M.H.; Said, A. Machine learning-based fault diagnosis for research nuclear reactor medium voltage power cables in fraction Fourier domain. Electr. Eng. 2023, 105, 25–42. [Google Scholar] [CrossRef]
- Dampage, U.; Bandaranayake, L.; Wanasinghe, R.; Kottahachchi, K.; Jayasanka, B. Forest fire detection system using wireless sensor networks and machine learning. Sci. Rep. 2022, 12, 46. [Google Scholar] [CrossRef]
- Sendek, A.; Cubuk, E.D.; Antoniuk, E.; Cheon, G.; Cui, Y.; Reed, E.J. Machine Learning-Assisted Discovery of Solid Li-Ion Conducting Materials. Chem. Mater. 2018, 31. [Google Scholar] [CrossRef]
- Sendek, A. Stanford ENERGY. Available online: https://www.youtube.com/watch?v=TSdgXlwIgtU (accessed on 10 May 2025).
Training Model Area | Models/Examples |
---|---|
Electricity and Safety | Electrical safety, VR training for electrical workers, power substation simulations, and electrical panel repairs [25,26,27,28,31,32] |
Fire Safety | Fire safety training in VR, modes of fire propagation and protection [24] |
Student Training | Electrical safety, VR training in electricity and magnetism, power electronics, and ElectroVR [22,23,29] |
Specialist Training | Virtual reality training system; technical skill improvement [30] |
Algorithms for Work in a High-Risk Environment | ||
---|---|---|
Algorithms used for pathfinding and evacuation in a high-risk environment | DQN [33] | SVM [34,35,36,37] Q-Learning [34,38] Neural Network/Artificial Neural Network [34,36,39,40,41] Decision Tree [34,41,42] Radial Basis Function [36,39] SVR [35,43] Random Forest [35,36,37,41,44,45] Deep Learning [46,47,48] |
Q network [33] | ||
SAC [49] | ||
PPO [50] | ||
GAIL [51] | ||
BC [52] | ||
Algorithms used for fault prevention | HMM [34] | |
Multi-Layer Perceptron [39] | ||
Ant Colony Optimization [53] | ||
BOA–NARX [43] | ||
ARIMAX [43] | ||
Linear Dimension Reduction [54] | ||
Maximal Marginal Likelihood Estimation [54] | ||
Multiclass SVM [55] | ||
Algorithms used for fire forecast and prevention | Value Iteration [38] | |
Policy Iteration [38] | ||
Monte Carlo Tree Search [38] | ||
Asynchronous Advantage Actor-Critic (A3C) [38] | ||
Frequency Ratio-Multilayer Perceptron (FR-MLP) [37] | ||
Linear Regression [56] | ||
Algorithms used for finding new conductive elements | Logistic Function [57] | |
Supervised Learning [58] | ||
Logistic Regression [58] |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Vasilev, V.; Budakova, D.; Petrova-Dimitrova, V. Applications of Virtual Reality Simulations and Machine Learning Algorithms in High-Risk Environments. Eng. Proc. 2025, 100, 19. https://doi.org/10.3390/engproc2025100019
Vasilev V, Budakova D, Petrova-Dimitrova V. Applications of Virtual Reality Simulations and Machine Learning Algorithms in High-Risk Environments. Engineering Proceedings. 2025; 100(1):19. https://doi.org/10.3390/engproc2025100019
Chicago/Turabian StyleVasilev, Velyo, Dilyana Budakova, and Veselka Petrova-Dimitrova. 2025. "Applications of Virtual Reality Simulations and Machine Learning Algorithms in High-Risk Environments" Engineering Proceedings 100, no. 1: 19. https://doi.org/10.3390/engproc2025100019
APA StyleVasilev, V., Budakova, D., & Petrova-Dimitrova, V. (2025). Applications of Virtual Reality Simulations and Machine Learning Algorithms in High-Risk Environments. Engineering Proceedings, 100(1), 19. https://doi.org/10.3390/engproc2025100019