A Mixed Reality-Based Training and Guidance System for Quality Control

Saraiva, Luzia; Henriques, João; Silva, José; Barbosa, André; Oliveira, Serafim M.

doi:10.3390/computers14110479

This is an early access version, the complete PDF, HTML, and XML versions will be available soon.

Open AccessArticle

A Mixed Reality-Based Training and Guidance System for Quality Control

by

Luzia Saraiva

^1,2,

João Henriques

^1,2,3,*

,

José Silva

^1,2

,

André Barbosa

⁴ and

Serafim M. Oliveira

^1,2

¹

Higher School of Technology and Management, Polytechnic University of Viseu, 3504-510 Viseu, Portugal

²

CISeD—Research Centre in Digital Services, Polytechnic of Viseu, 3504-510 Viseu, Portugal

³

Centre for Informatics and Systems of the University of Coimbra, Department of Informatics Engineering, University of Coimbra, 3030-290 Coimbra, Portugal

⁴

Inklusion Entertainment S.A., 6200-284 Covilhã, Portugal

^*

Author to whom correspondence should be addressed.

Computers 2025, 14(11), 479; https://doi.org/10.3390/computers14110479

Submission received: 30 September 2025 / Revised: 27 October 2025 / Accepted: 30 October 2025 / Published: 3 November 2025

(This article belongs to the Special Issue Extended or Mixed Reality (AR + VR): Technology and Applications (2nd Edition))

Download Versions Notes

Abstract

The increasing demand for customized products has raised the significant challenges of increasing performance and reducing costs in the industry. Facing that demand requires operators to enhance their capabilities to cope with complexity, demanding skills, and higher cognitive levels, performance, and errors. To overcome this scenario, a virtual instructor framework is proposed to instruct operators and support procedural quality, enabled by the use of You Only Look Once (YOLO) models and by equipping the operators with Magic Leap 2 as a Head-Mounted Display (HMD). The framework relies on key modules, such as Instructor, Management, Core, Object Detection, 3D Modeling, and Storage. A use case in the automotive industry helped validate the Proof-of-concept (PoC) of the proposed framework. This framework can contribute to guiding the development of new tools supporting assembly operations in the industry.

Keywords: Industry 4.0; mixed reality; YOLO; computer vision; virtual instructor; automotive industry

Share and Cite

MDPI and ACS Style

Saraiva, L.; Henriques, J.; Silva, J.; Barbosa, A.; Oliveira, S.M. A Mixed Reality-Based Training and Guidance System for Quality Control. Computers 2025, 14, 479. https://doi.org/10.3390/computers14110479

AMA Style

Saraiva L, Henriques J, Silva J, Barbosa A, Oliveira SM. A Mixed Reality-Based Training and Guidance System for Quality Control. Computers. 2025; 14(11):479. https://doi.org/10.3390/computers14110479

Chicago/Turabian Style

Saraiva, Luzia, João Henriques, José Silva, André Barbosa, and Serafim M. Oliveira. 2025. "A Mixed Reality-Based Training and Guidance System for Quality Control" Computers 14, no. 11: 479. https://doi.org/10.3390/computers14110479

APA Style

Saraiva, L., Henriques, J., Silva, J., Barbosa, A., & Oliveira, S. M. (2025). A Mixed Reality-Based Training and Guidance System for Quality Control. Computers, 14(11), 479. https://doi.org/10.3390/computers14110479

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Menu

A Mixed Reality-Based Training and Guidance System for Quality Control

Abstract

Share and Cite

Article Metrics

Article Access Statistics

Further Information

Guidelines

MDPI Initiatives

Follow MDPI