Next Article in Journal
Novel Exploit Feature-Map-Based Detection of Adversarial Attacks
Previous Article in Journal
Application of the Signal Spectrum-Based Image Pattern Recognition in the Vibration Process Analysis
Previous Article in Special Issue
Model Establishment of Cross-Disease Course Prediction Using Transfer Learning
 
 
Article

Deep-Learning-Incorporated Augmented Reality Application for Engineering Lab Training

1
Department of Electrical and Computer Engineering, Purdue University Northwest, Hammond, IN 46323, USA
2
Department of Applied Computing, Michigan Technological University, Houghton, MI 49931, USA
*
Author to whom correspondence should be addressed.
Academic Editor: Luis Javier Garcia Villalba
Appl. Sci. 2022, 12(10), 5159; https://doi.org/10.3390/app12105159
Received: 14 April 2022 / Revised: 12 May 2022 / Accepted: 17 May 2022 / Published: 20 May 2022
(This article belongs to the Special Issue Application of Artificial Intelligence, Deep Neural Networks)
Deep learning (DL) algorithms have achieved significantly high performance in object detection tasks. At the same time, augmented reality (AR) techniques are transforming the ways that we work and connect with people. With the increasing popularity of online and hybrid learning, we propose a new framework for improving students’ learning experiences with electrical engineering lab equipment by incorporating the abovementioned technologies. The DL powered automatic object detection component integrated into the AR application is designed to recognize equipment such as multimeter, oscilloscope, wave generator, and power supply. A deep neural network model, namely MobileNet-SSD v2, is implemented for equipment detection using TensorFlow’s object detection API. When a piece of equipment is detected, the corresponding AR-based tutorial will be displayed on the screen. The mean average precision (mAP) of the developed equipment detection model is 81.4%, while the average recall of the model is 85.3%. Furthermore, to demonstrate practical application of the proposed framework, we develop a multimeter tutorial where virtual models are superimposed on real multimeters. The tutorial includes images and web links as well to help users learn more effectively. The Unity3D game engine is used as the primary development tool for this tutorial to integrate DL and AR frameworks and create immersive scenarios. The proposed framework can be a useful foundation for AR and machine-learning-based frameworks for industrial and educational training. View Full-Text
Keywords: artificial intelligence; augmented reality; machine learning; object detection; computer in education; lab equipment tutorial artificial intelligence; augmented reality; machine learning; object detection; computer in education; lab equipment tutorial
Show Figures

Figure 1

MDPI and ACS Style

Estrada, J.; Paheding, S.; Yang, X.; Niyaz, Q. Deep-Learning-Incorporated Augmented Reality Application for Engineering Lab Training. Appl. Sci. 2022, 12, 5159. https://doi.org/10.3390/app12105159

AMA Style

Estrada J, Paheding S, Yang X, Niyaz Q. Deep-Learning-Incorporated Augmented Reality Application for Engineering Lab Training. Applied Sciences. 2022; 12(10):5159. https://doi.org/10.3390/app12105159

Chicago/Turabian Style

Estrada, John, Sidike Paheding, Xiaoli Yang, and Quamar Niyaz. 2022. "Deep-Learning-Incorporated Augmented Reality Application for Engineering Lab Training" Applied Sciences 12, no. 10: 5159. https://doi.org/10.3390/app12105159

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop