Enhancing Industrial Processes Through Augmented Reality: A Scoping Review
Abstract
1. Introduction
2. Methodology
2.1. Research Questions
2.2. Document Search
2.3. Paper Selection
- D1. Inclusion criteria bias: Inaccuracy of selection criteria will lead to bias [18]: According to the research objective, this article clearly delimits the topic of study and the type of literature review approach, thus establishing the keywords to be searched for. Criteria, such as period and search language, are established to control any potential bias. In this domain, it was decided to include articles that despite not being within the established time period are of high relevance to the research.
- D2. Data completeness bias: This refers to the completeness and accuracy of the data collected during the assessment of industrial processes and whether methods were applied to ensure the objectivity and validity of the results.
- D3. Methodological quality bias: To assess the methodological quality of the studies included in the review, considering aspects such as study design, sample size, blinding and other elements that may influence the validity of the results, specifically in the context of AR in industrial processes.
- D4. Evidence synthesis: Synthesising the results of the studies included in the review in a transparent and objective manner, considering the risk of bias in the interpretation of the results. This involves careful assessment of consistency and heterogeneity among studies, as well as consideration of possible bias in the interpretation of results. It allows the identification of all the components necessary to judge the risk of bias in reporting to improve the credibility of evidence syntheses.
- D5. Researcher experience bias: Allows the identification of whether he or she or the authors consciously or unconsciously influence the results of the study, either in the design of the study or the interpretation of the data, which may affect the validity of the results.
3. Results
Literature Review
4. Discussion
Research Questions
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A. Application of AR in Industrial Processes
Title | Process | AR Description | Benefits | Limitations |
---|---|---|---|---|
A Multi-User Collaborative AR System for Industrial Applications [25] | Design | Mucsys is a system that provides AR services for various industrial processes through three collaborative components: Mucstudio, which generates scenes; Mucview, which offers AR experiences through camera tracking for collision detection, object editing, data loading, annotation editing and virtual object rendering; and Muccserver, which manages databases and collaborative services. In CNC cutting design, Mucsys allows transforming the CAD model of the cutting head to the “obj” format for visualisation and determines the relative position between the cutting head and the marker. The sensor data are linked to the cutting head model, and the designer prints and places the marker in the corresponding location using Mucstudio. Finally, to verify the design of the model, Mucview represents the virtual CAD model on the real machine | The AR system can identify and avoid errors, reduce time and costs, and reduce the number of physical prototypes through AR technology. This technology efficiently helps operators understand design procedures by superimposing virtual information and instructions on the real environment. | The main difficulty in implementing the system lies in the learning curve in which operators and designers may need time and training to become familiar with the tools and techniques necessary to use the system effectively. |
A Smart Factory in a Smart City: Virtual and Augmented Realityin a Smart Assembly Line [20] | Maintenance and assembly | AR makes it possible to provide 3D animated instructions that help workers perform assembly and maintenance tasks by projecting information directly onto the workplace using a projector installed above the task. This technique allows instructions to be displayed directly on the object or work area allowing operators to perform the process effectively. | Significant reduction in the error rate. Reduction in task completion times. | Portable devices require too much computational power. |
An Augmented Reality Assisted Order-Picking System using IoT [36] | Order preparation | The RASPICK system has two components: a head-mounted AR device and a web-based warehouse management system. The picker sets up the device, which connects to Wi-Fi and downloads a list of items to be picked. The device displays a list of items to pick along with the required quantity of each. The picker uses the information provided by the device to find the aisle corresponding to the item, identified by an assigned letter displayed on the device’s screen. Once the picker locates the correct aisle, it touches a touch sensor on the side of the device to receive the container number where the item is located. The device guides the picker to the correct aisle and container, displaying the required quantity of each item. The picker scans the QR code of the picked item, and the system confirms the pickup. This process is repeated until the pick list is complete. | The system also reduces the picker’s overall cognitive load, allowing the picker to be more efficient in their work. | The system cannot map the most efficient picking sequence so that the picker spends the least amount of time to travel on his or her picking trips. |
An Augmented Reality System for Operator Training in the Footwear Sector [33] | Training | The system uses Microsoft HoloLens smart glasses, allowing users to interact with both virtual and real-world elements. The software architecture comprises three layers: interface, management and data. The interface layer allows learners and users to access training content through an intuitive interface, using voice commands or gestures. The management layer allows administrators and trainers to organise and manage training activities, user groups and training materials, ensuring an efficient and effective training process that minimises interference with daily production activities. | Training can be conducted in a dedicated environment, minimising disruption to daily production operations and improving overall efficiency. | The high initial cost of implementing AR systems requires significant investments in specialised hardware and software development tailored to the specific needs of each process. |
An Augmented Reality System to Support Fault Visualisation in Industrial Robotic Tasks [37] | Fault man-agement and diagnostics | AR is applied in the process of diagnosing and managing faults in industrial robots. Using the Microsoft HoloLens device, an adaptive AR system was developed that displays 3D virtual metaphors in real time, close to the location of the robot fault. This dynamic visualisation allows technicians to quickly identify problems, as fault icons are positioned so that they are always visible and not hidden by the manipulator. | The adaptive AR mode allows users to recognise faults faster and with fewer movements, improving efficiency and reducing robot downtime. | The narrow field of view of the HoloLens device may limit the amount of information simultaneously visible, which may make it difficult to fully perceive fault icons in some situations. |
An Intelligent Product Service System for Adaptive Maintenance of Engineered-to-Order Manufactur-ing Equipment Assisted by Augmented Reality [34] | Inspection and maintenance | In injection mould maintenance and inspection, AR is used to provide interactive instructions during the maintenance process. This includes visual guides for component assembly and disassembly, as well as inspection tests facilitated by implemented precedence algorithms. Technicians can access these AR instructions through devices equipped with unique QR codes, which allow the visualisation of mould status through a colour-coding system (green, yellow and red), indicating the condition of components quickly and clearly. | AR enables accurate and guided visualisation of procedures, which can reduce human error and increase the efficiency of the maintenance process. | The initial implementation of AR systems can be costly, especially the installation and configuration of infrastructure such as wireless sensor networks (WSNs) for real-time monitoring. |
ARiana: Augmented Reality Based In Situ Annotation of Assembly Videos [38] | Maintenance | ARiana, a portable augmented reality-based in situ video annotation tool that guides field experts to create annotations efficiently while performing assembly or maintenance tasks. Ariana has three key features, including context awareness enabled by hand-object interaction, multimodal interaction for on-the-fly annotation, and real-time audiovisual guidance enabled by edge download. | It reduces the need for additional communications between field workers and annotators, thus improving the efficiency of the video annotation process. | Creating interactive 3D models and implementing AR technologies can be costly and require a significant investment in time and money. |
Assessing user performance in augmented reality assembly guidance for industry 4.0 operators [39] | Mounting-assembly | In the assembly process, AR is effectively applied through a guidance tool that provides users with a detailed, real-time virtual visualisation of assembly procedures. This enables workers to perform tasks with greater accuracy and efficiency, regardless of their level of prior experience. AR facilitates an intuitive understanding of component position and orientation, reduces ambiguity and improves coordination between physical actions and visual instructions. | AR has the potential to improve assembly performance by reducing errors and the time required for assembly tasks, ensuring a very low mental workload. | The effectiveness of AR may depend significantly on the quality and compatibility of the hardware devices used, which may result in additional costs for companies or individual users wishing to implement this technology. |
Assessment of Augmented Reality in Manual Wiring Production Process with Use of Mobile AR Glasses [40] | Mounting-assembly | The AR system developed for the cable assembly and production process in control cabinets has proven to be an effective assistive device. This system, equipped with AR glasses, works online by identifying elements in the environment and providing meaningful support to the operator on the assembly line. By automatically recognising units and providing appropriate data, the system facilitates the wiring of control cabinets, improving the efficiency and accuracy of the process. | The AR system reduces downtime in case of failure. This is achieved by providing contextual and meaningful information automatically at hand, enabling faster and more efficient maintenance of control cabinets. | The implementation of augmented reality systems involves a significant upfront cost in terms of hardware and software development. |
Augmented Reality for Industrial Quality Inspection: An Experiment Assessing Task Performance and Human Factors [41] | Inspection and quality control | The application of AR in this context focuses on optimising industrial quality inspection using HMD (head-mounted display) HoloLens 2. Using 3D models and 2D images, AR makes it possible to detect and highlight possible defects in physical products by means of visual signals projected directly onto the inspected object. The AR system not only facilitates accurate product tracking in real time, automatically adjusting to movements and turns, but also improves efficiency by clearly grouping and visualising problem areas. With support for multimodal interaction, this innovative approach not only increases accuracy in defect detection, but also streamlines the inspection process, thus improving final product quality and operational efficiency in industrial environments. | Using an AR HMD for industrial quality control can significantly reduce task completion time, as well as the number of task errors | Implementing AR systems involves a significant upfront cost in terms of hardware and software development. This can be a barrier for companies that are not willing to make a high initial investment. |
Augmented Reality System and Maintenance of Oil Pumps [21] | Maintenance | AR is effectively employed in pump maintenance through interactive visualisation of procedures. In the study, a physical model of an oil transfer demonstration unit including Grundfos vertical electric vertical centrifugal pumps was used. AR facilitates the creation of algorithms for disassembly and assembly of pumps, thus optimising maintenance procedures, which streamlines maintenance processes by providing accurate and guided visualisations, but also contributes to the standardisation and continuous improvement of processes. | Reduction in the time required to perform maintenance. This is achieved through guided visualisation of the necessary actions, which optimises the process and minimises errors. | While AR can improve the user experience once mastered, it may require additional time and training for workers to become familiar with the technology and learn how to use it effectively. |
Augmented Reality-Assisted Deep Reinforcement Learning-Based Model towards Industrial Training and Maintenance for NanodropSpectrophotometer [42] | Maintenance and training | The proposed system uses a model based on deep reinforcement learning assisted by AR. This involves using a machine learning model to help guide workers during maintenance and training tasks. AR is integrated with this model to provide clear and easily understandable instructions for maintenance operators using their devices.The process starts with scanning an image or model of the target object. Features are then extracted and compared to determine its position and orientation in the environment. This is combined with the operator’s action to generate a 3D visualisation on the device’s display. The reinforcement learning algorithm is used to improve the localisation and tracking of objects in the system. | Improves process efficiency and reduces costs for training and industrial maintenance. The system offers opportunities for continuous performance improvement that can lead to significant improvements in system performance over time. | The system will require ongoing maintenance and upgrades to ensure optimal performance, which may require additional resources and time. |
Augmented Reality-Based Method forRoad Maintenance Operators inHuman–Robot Collaborative Interventions [43] | Maintenance | The application of AR augmented reality in the road maintenance process significantly improves safety and operational efficiency. The proposed methodology integrates a set of AR tools that provide real-time visualisations, interactive instruction, and human–robot collaboration (HRC). In a dynamic and hazardous environment, such as road maintenance, operators receive up-to-date information about safe areas and events in their immediate and extended environment. Detailed instructions, including 3D models, images and text, guide operators through each step of the process, enabling accurate and fast execution of tasks. In addition, collaboration with robots, controlled through AR interfaces, facilitates the completion of complex tasks, such as installing safety barriers and sealing cracks, reducing risk exposure and improving work efficiency. This approach not only improves productivity and accuracy, but also minimises the time operators spend in hazardous environments, thus contributing to safer road maintenance operations. | Improved process efficiency. AR provides visual instructions directly superimposed on the physical environment, which facilitates and speeds up the process of executing tasks such as installing safety barriers or sealing cracks in roads, thus reducing errors. | The high initial cost of implementing AR systems requires significant investments in specialised hardware and software development tailored to the specific needs of each application. |
Data Mining and Augmented Reality: An Application to the Fashion Industry [44] | Quality control | AR offers differential support to both experts and trainees in the fast-paced quality control process in the fashion industry. First of all, it is used to display the updated sample size for the selected control order, strategically redefining the sampling rules. In addition, it allows the areas to be controlled to be displayed sequentially on the screen, organised according to defect detection. The controllers have direct access to the description of the control set by simply clicking on the corresponding icon on the interface. Moreover, on the physical site, workers can use AR glasses or mobile devices to overlay construction drawings and instructions, facilitating assembly and precise component placement. | By providing accurate real-time data and visualisations, AR reduces construction errors and helps maintain alignment with design specifications. | There may be resistance from workers and stakeholders who are accustomed to traditional methods and may be reluctant to adopt new technologies. |
Design of Augmented Reality Training Content for Railway Vehicle Maintenance Focusing on the Axle-Mounted Disc Brake System [26] | Maintenance | AR is applied in rail vehicle maintenance by developing training content that visualises maintenance procedures in a three-dimensional (3D) space. Using mobile devices such as tablets or smartphones, maintenance operators can access detailed, interactive maintenance manuals that project virtual images onto the real environment. These AR manuals include warning signs for risky procedures and allow operators to control the position, scale and rotation of 3D models using touch gestures. This provides an immersive, hands-on training experience that improves understanding and proficiency in the maintenance of critical components such as axle-mounted disc brake systems. | AR allows operators to visualise and practice complex maintenance procedures in a controlled and safe environment, reducing human error and enabling faster and more effective training. | Creating interactive 3D models and implementing AR technologies can be costly and require a significant investment in time and money. |
Development of Augmented RealityApplication for Onsite Inspection of Expressway Structures Using Microsoft HoloLens [45] | Inspection | AR is applied in the inspection process of highway structures through the use of the Arinspector application, developed for the first-generation Microsoft HoloLens device. During inspection activities, the AR system allows inspectors to perform inspection tasks hands-free by overlaying relevant information such as highway history, technical drawings, previous inspection reports, and specification and standards manuals over the actual scene while the inspector visualises the highway structure. This facilitates detailed and accurate inspections, optimising the time and resources used in the process. | Improved communication and data management with online databases as by using the application, highway inspectors can send data to the online database in real time, where everyone can access, edit and share with other relevant people. | While the time and resource savings on daily inspections may justify the investment in the long run, the initial cost can be a significant barrier to immediate adoption of this technology, especially for organisations with limited budgets. |
Development of Augmented Reality System for Productivity Enhancement in Offshore Plant Construction [46] | Inspection and manufacturing | The in-process AR system improves manufacturing and inspection by allowing users to adjust the transparency of 3D representations to easily compare CAD design to actual parts, visualise only relevant disciplines to avoid confusion, adjust the field of view to inspect hidden parts in complex environments, and facilitate access and comparison of drawings and CAD data by selecting parts on the screen, thus improving accuracy and efficiency in installation and inspection. | Improved productivity and efficiency: AR allows marine plant construction workers to view crucial information, such as CAD drawings and installation instructions, directly in their field of view | Training and learning curve: Learning to use AR effectively can take time and effort. This may require additional training for workers, especially those less familiar with advanced technologies. |
Development of Augmented Reality Technology Imple-mentation in a Ship-building ProjectRealisation Process [31] | Mounting-assembly and repair | The implementation of AR augmented reality in the marine outfitting process offers multiple significant benefits. First, it automates the digital recording of the start and end of work activities through smart devices and QR codes, enabling accurate time and productivity management by recording who performs each task and for how long. In addition, 3D virtual objects projected onto the real environment make it easy for supervisors and managers to visually monitor the progress of assembly activities, generating real-time daily reports to compare progress against planned standard hours, thus optimising planning and resource allocation. AR also plays a crucial role in the early detection of assembly errors by identifying discrepancies before they become costly repairs, such as missing cuts between blocks, potentially significantly reducing costs and procedure times. | Reduced costs and time by enabling early detection of errors during assembly through AR prevents major problems at later stages, significantly reducing repair and rework costs, as well as related downtime. | Insufficient illumination and high presence of dust slow down and complicate the initialisation and follow-up in the process, and there may be resistance to change in the process. |
Dynamic Mixed-Reality Assembly Guidance UsingOptical Recogni-tion Methods [22] | Mounting-assembly | The AR application developed for this process aims to guide users during component assembly using the capabilities of the HoloLens 2 and the Vuforia engine. The AR application provides visual instructions overlaid directly in the user’s field of view, thus facilitating an intuitive and efficient assembly experience. In addition, it uses the HoloLens 2’s hand tracking to validate the user’s actions, ensuring that components are correctly selected and positioned in real time. This is achieved by accurately identifying and tracking objects recognised by the system, enabling greater accuracy and control during the assembly process. | Allows manual tracking to validate user actions, ensuring that components are selected and positioned correctly in real time, reducing errors. | Implementing AR technology and motion capture systems can be costly, including hardware, software and staff training. |
Effect of Augmented Reality Support on Quality Inspection of Welded Structures [35] | Inspection | Applied in the industrial weld quality control process, AR is used to guide inspectors during the visual inspection of welds. This is achieved by superimposing digital information directly on the physical parts, allowing inspectors to quickly compare welds to ideal standards and detect potential defects more efficiently. In addition to enabling visual guidance, AR also aids in requirements interpretation and part evaluation by facilitating the requirements interpretation process by providing clear and direct indications of the characteristics that welds must meet. | It allows for reduced inspection time, especially among less experienced inspectors, and less mental workload by allowing a quick comparison between the inspected parts and the ideal model. | Lighting conditions may affect the stability of the display in some cases. |
Effectiveness on Training Method Using Virtual Reality and AugmentedReality Applications in Automobile Engine Assembly [47] | Training | AR is effectively used to enhance training in motor assembly. Markerless AR was used to allow students to interact with virtual components in a physical environment, using smart glasses. This facilitated visualisation and manipulation of engine parts, improving understanding and execution of complex tasks. On the other hand, AR with markers provided additional visual guidance during assembly, improving accuracy and efficiency compared to traditional video-based methods. Both approaches provided a more immersive and effective educational experience than conventional methods. | AR increases motivation and learning performance compared to traditional video-based methods | The initial cost and resources required to develop and deploy AR content. Creating interactive 3D models and deploying AR technologies can be costly and require significant investment in time and money. |
Evaluating Digital Work Instructions with Augmented Reality Versus Paper-based Docu-ments for Manual, Object-specific Re-pair tasks in a Case Study with Experienced Workers [32] | Maintenance | AR is applied in the repair of turbine blades in the metallurgical industry. To do this in the turbine blade repair process, AR provides digital work instructions that are more intuitive and accessible compared to traditional paper-based methods. Cognitive assistance systems (CAS) enhance cognitive abilities by providing digital work instructions. These digital instructions can include 3D models of parts, interactive diagrams and real-time data, all of which help workers better understand tasks and reduce the possibility of errors. AR enables detailed and clear visualisation of turbine components, making it easier to identify and repair problem areas. | The AR-based assistance system displays all necessary information by default. This ensures that workers do not skip important steps, such as checking measurements, thus improving job accuracy. | Resistance to change: Some workers, especially those with little familiarity with the technology, tend to ignore screen-based AR. This suggests that, while AR is powerful, it takes time and training for users to become accustomed to its use. |
Holorailway: an Augmented RealitySystem to Support Assembly Opera-tions in the Railway Industry [48] | Maintenance and assembly | In the process of insulating panel assembly in the industrial rail sector, AR is innovatively and effectively applied through the Holorailway system based on the HoloLens 2 visualisation device. This system uses advanced computer vision technologies to automatically align virtual content with actual railcar components so that workers receive accurate, real-time visual instructions on panel placement and assembly, simplifying the process and significantly improving panel assembly efficiency. | The AR system guides workers with accurate, real-time visual instructions, which improves assembly accuracy and reduces the number of errors, and eliminates the need for extensive prior knowledge on the part of operators, facilitating training and reducing the learning curve. | The implementation of augmented reality systems such as HoloLens 2 involves a significant upfront cost in terms of hardware and software development. This can be a barrier for companies that are not willing to make a high initial investment. |
Improving Effi-ciency of Industrial Maintenance with Context-awareAdaptive Authoring in Augmented Reality [23] | Maintenance | Through the use of AR technology, technicians can access real-time contextualised and visualised information about the specific equipment and components they are repairing or maintaining. This information includes step-by-step guides, animations overlaid on physical devices and relevant equipment data, which facilitates understanding and executing tasks more efficiently. In addition, AR enables better adaptive data management, dynamically adjusting to the specific needs of the end user, contributing to greater accuracy and speed in the execution of maintenance activities. | AR improves maintenance efficiency by providing contextualised and visual information in real time, making tasks easier to understand and reducing the time required to complete them. | The implementation of augmented reality systems involves a significant upfront cost in terms of hardware and software development. |
Integrated Aug-mented and Virtual Reality Technologies for Realistic Fire Drill Training [49] | Training | AR is used in fire training to provide a comprehensive and realistic training experience that combines the real and virtual worlds. Implemented AR uses the VIVE Pro HMD device, which is originally dedicated to VR, but takes advantage of its augmented reality capabilities through its built-in stereo camera. The srworks SDK is used to take advantage of the stereo camera’s capabilities, which include depth perception and approximate object recognition. Artificial intelligence (AI) models are used to recognise detailed information about objects, such as volume and mass, and are used to generate realistic virtual fire effects on which operators can be trained, providing them with a more complete and versatile training experience. | Augmented reality provides a safe and controlled training environment where users can practice emergency situations without real risks. | The implementation of augmented reality systems involves a significant upfront cost in terms of hardware and software development. This can be a barrier for companies that are not willing to make a high initial investment. |
MANTRA: an Effective System Based on Augmented Reality and Infrared Thermography for Industrial Maintenance [50] | Maintenance | MANTRA is an innovative solution that combines AR with infrared thermography (IRT) for specific applications in industrial maintenance. MANTRA automates the superimposition of virtual information and temperature data on 3D objects in real time through the joint use of an RGB-D sensor and an IRT camera. This approach ensures high accuracy and robustness in maintenance operations by detecting and estimating the pose of 3D objects with advanced methods such as YOLOV4 for object detection and LINEMOD for pose estimation. | MANTRA facilitates faster and more accurate maintenance operations and makes it easier to view crucial information without requiring technicians to take their eyes off the equipment or device they are repairing, which can reduce errors and improve safety. | Implementing augmented reality systems such as MANTRA can require significant upfront investment in hardware and specialised software development. |
MARMA: A Mobile Augmented Reality Maintenance Assistant for Fast-Track Repair Procedures in the Context of Industry 4.0 [24] | Maintenance | MARMA is an AR system that can locate a component in the manufacturing plant and display the corresponding failure mode maintenance instructions in a portable and vivid manner on the operators’ mobile device. A camera acts as the sensory input of the proposed AR system, recording the activity inside the industrial plant. First, the asset of interest is detected in the image plane, while subsequently, a robust tracking algorithm is responsible for tracking the position and scale of the detected asset for subsequent frames of the recording. Based on the calculated position and scale values, the 3D CAD of the specific asset is projected onto the image plane in a user-friendly manner. When the operator approaches the machine, the proposed system provides instructions on the first steps of the maintenance procedure. Then, the user easily controls the system through appropriate buttons that proceed to the previous or subsequent maintenance steps of the asset. | Improving the process by replacing paper instructions with digital instructions, taking advantage of AR functions to limit retrieval times. | The implementation of MARMA requires specific hardware, such as high-quality cameras and devices capable of running AR applications, which leads to increased implementation costs. |
Multimodal Mixed-Reality Impact on a Hand-Guiding Task with a Holographic Cobot [51] | Maintenance | AR in manual interaction processes, especially in maintenance and repair tasks, has shown promise in combining virtual and real information, significantly improving efficiency and accuracy. In the context of pick-and-place tasks, the implementation of AR-based systems allows users to manipulate holographic objects with remarkable positioning accuracy while maintaining a margin of error below 3 mm. The integration of tactile feedback through haptic actuators in the air enhances the sense of control and physical perception of the hologram, providing a more natural and familiar experience. This makes it easier for users to immediately confirm their actions, reducing the time demand and improving the execution of complex tasks without the need for extensive learning. | AR enables intuitive interaction with holographic objects, reducing the need for extensive learning and enabling more efficient execution of complex tasks. | AR systems and haptic actuators may require frequent maintenance and upgrades to ensure optimal performance. |
Pervasive Aug-mented Reality to Support LogisticsOperators in Industrial Scenarios:A Shopfloor User Study on Kit Assembly [52] | Logistics | AR assists logistics operators during order-picking tasks in industrial plants. A human-centered design (HCD) methodology was used with industrial partners to identify operators’ difficulties and challenges and define requirements. Two methods, HMD and HHD (hand-held device), were then developed, which allow AR content to be configured and visualised in the industrial environment. In short, virtual content can be visualised, allowing operators to know how to perform picking operations, i.e., to have step-by-step instructions, including text, images and 3D models, on how to assemble a given kit. | AR offers a more immersive experience, keeping AR information directly in the user’s field of view, which can improve concentration and reduce time spent searching for information. | HMD devices tend to be more expensive compared to HHD devices, which can be a barrier to adoption, especially in small and mid-sized businesses |
Presenting Job Instructions Using an Augmented Reality Device, a Printed Manual, and a Video Display for Assembly and Disassembly Tasks: What Are the Differences? [53] | Mounting-assembly | AR to present task instructions. This device comprises transparent holographic lenses. Users can see both virtual instruction and computer components. Dynamics 365 Guides application was adopted in HoloLens 2 to present the job instructions. The text of each step for both assembly and disassembly tasks was incorporated into the Dynamics 365 application. Virtual circles and squares are added using the AR toolkit to highlight screw locations and cable connections, respectively, to provide supplemental information. When a cable needed to be plugged or unplugged, a virtual hand appeared to highlight the operation. Virtual hands also appeared when pushing or pulling a component was required. The virtual hands disappeared after the participant followed this instruction. The participant could click on a virtual arrow in the upper right corner of the instruction to go to the next step when he or she had completed a step with his or her index finger. | By providing a 3D visual representation of components and assembly/disassembly processes, AR can help users better understand the tasks they are performing, which can lead to moreaccurate execution. | While AR can improve the user experience once mastered, it may require additional time and training for workers to become familiar with the technology and learn how to use it effectively. |
Process Monitoring of Economic and Environmental Performance of a Material Extrusion Printer using anAugmented Reality-based Digital Twin [54] | Monitoring | AR is used to develop digital twins for process monitoring of a material extrusion printer in the additive manufacturing industry. AR allows virtual elements, such as 3D models and performance data, to be integrated into the user’s physical environment in real time, superimposing them over the real-world view captured by an AR device, or an HHD, such as a cell phone or tablet like Samsung Galaxy S21. AR enables remote monitoring of the printing process from any location with adequate connectivity. Users can monitor print progress, check parameters and make adjustments in real time without being physically present on the manufacturing floor. | It allows operators and technicians to visualise digital models of components and printing processes directly on the actual 3D-printer or on the workbench. This facilitates a clearer understanding of how the digital models behave compared to the actual physical process. | Users may need time and training to become familiar with AR technology and use it effectively, which can delay adoption and initial benefits. |
Process of Materials Picking Using Augmented Reality [55] | Order preparation | AR is used to improve the order-picking process by reducing information search time and improving accuracy. Only relevant data are displayed in the HMD, making it easier to identify storage locations and verify required parts. Employees use devices equipped with AR technology, such as smart glasses or headsets, which allow them to view digital information overlaid on the physical environment in real time. This information can include details on material storage locations, quantities required and any other instructions relevant to the order-picking process, enabling the identification of material locations in the warehouse. | It allows shortening the completion time of collection orders by reducing the search and selection time of materials, thus making the process more efficient. | Deploying AR technologies, including HMD devices, can be costly, which could be a barrier for small organisations. |
Real-Time RemoteMaintenance Support Based on Augmented Reality (AR) [56] | Maintenance | AR in the maintenance process allows shopfloor technicians to receive real-time remote assistance from expert engineers without the need for their physical presence on site. Using devices such as head-mounted displays via HMD, technicians can transmit a live video feed of the work environment to the expert engineer. The latter, in turn, can guide the technician in troubleshooting through annotations and the overlay of AR content directly in the technician’s field of view. This real-time interaction facilitates an accurate understanding of malfunctions and enables the creation of specific AR content as problems arise, eliminating the need to prepare predefined AR scenarios. | Ability to reduce mean time to repair (MTTR). Expert engineers can provide immediate and accurate assistance to shopfloor technicians, minimising machine downtime and improving operational efficiency. | Dependence on an advanced technological infrastructure, including HMD devices and stable, high-speed network connections. This can be a challenge in technologically constrained industrial environments. |
Smart Augmented Reality Instruc-tional System for Mechanical Assembly TowardsWorker-Centered Intelligent Manufacturing [27] | Mounting-assembly | AR in the assembly process is used to superimpose visual instructions directly into the operator’s work environment. These instructions can include text, videos, 3D animations and other visual aids that guide the worker through the various stages of assembly. AR helps improve operator accuracy and efficiency by providing clear and detailed real-time directions. The integrated system uses a region-based convolutional neural network (Faster R-CNN), trained on a synthetic tooling dataset generated from CAD models, to detect real physical tooling. | The system can decrease completion time and the number of errors compared to traditional paper-based instructional methods. | Implementing AR systems can be costly and requires workers to adapt to new work methods, which could generate resistance or an initial learning curve. |
Use of Projector-based Augmented Reality to Improve Manual Spot-welding Precision and Accuracy for Automotive Manufacturing [28] | Welding | AR is applied in the welding process using a projector-based projection system that highlights spot-weld locations on vehicle panels. This system helps manual welding operators improve the precision and accuracy of spot-weld placement through the use of visual cues. These cues are projected directly onto the panel surfaces, providing visual guidance that facilitates quick and accurate identification of the correct spot-welds, thereby reducing errors and improving the quality of the final product. | The use of AR in the welding process improves the precision and accuracy of the welds, which significantly reduces the variability in the location of the welding points, which is crucial to maintain high quality standards in production. | Need for ongoing calibration and maintenance of the projection system to ensure that the visual cues are accurate and correctly aligned with the panels. This may require additional resources and time. |
Using Augmented Reality to Reduce Workload inOffshore Environments [29] | Training | AR overlays virtual information over the pilots’ actual field of view through an HMD. During simulated missions, pilots used the HMD to receive additional symbology and critical data, such as engine control indicators, displayed directly in their line of sight. This allowed them to perform complex tasks, such as hovering and landing and takeoff maneuvers, with greater awareness of their surroundings and aircraft status, improving their ability to handle unforeseen situations and reducing the risk of errors. | Increased pilot situational awareness. Overlaying vital information in the pilot’s field of view enables faster and more accurate decision making, which is crucial in high-workload operations and adverse environmental conditions. | Potential ergonomic discomfort and visibility issues with HMD devices especially in low light conditions, which may hinder prolonged use and negatively affect user experience |
Using Eye-Tracking to Measure WorkerSituation Aware-ness in Augmented Reality [30] | Training | AR is applied to the process of improving the situational awareness of workers in the construction industry. The use of AR focuses specifically on the creation of visual warning systems that alert workers to immediate hazards in their work environment, such as the proximity of moving objects (trucks, forklifts, etc.). These AR warning systems are designed to improve workers’ ability to perceive and react to these hazards, thereby improving safety on the construction site. | AR is used to generate visual signals that warn workers of hazards in their environment. These warnings are superimposed on the workers’ field of vision, helping them to quickly identify and react to hazards. | AR eye-tracking devices can be expensive and require regular maintenance. Acquiring high-quality AR devices and accurate eye-tracking systems can be a significant investment for construction companies. |
WARM: Wearable AR and Tablet-Based Assistant Systems for BusMaintenance [57] | Maintenance | The application of AR in bus fleet maintenance has been developed using Microsoft HoloLens headsets. This AR solution employs different tracking methods, such as spatial mapping and object detection, to analyse the environment and locate the user in relation to the environment and the bus. Once the bus is identified and located, virtual objects can be added to assist in maintenance. Tests conducted under real-world conditions at the DBUS garage in San Sebastian showed that, although the tablet-based solution was more efficient in terms of data management and processing, AR provided significant added value. The AR allows workers to perform maintenance tasks hands-free and access additional multimedia information, such as videos and photos, which enriches the information system. | The application on the tablet connects directly to the maintenance management system, enabling fast and efficient assignment of work orders and data transmission without the need for additional intervention by maintenance managers. | Deploying AR technologies, including HMD devices and sensors, can be costly, which could be a barrier for small organisations. |
Appendix B. Hardware and Software
Title | Hardware | Approximate Cost (USD) | Graphic Engine |
---|---|---|---|
A Multi-User Collaborative AR System for Industrial Applications [25] | Smartphones or tablets | Smartphones: Mid-range: USD 400–700 High-end: USD 700–1500 Tablets: Mid-range: USD 300–700 High-end: USD 700–1200 | Unity 3D and through the CAD Exchanger SDK. |
A Smart Factory in a Smart City: Virtual and Augmented Reality in a Smart Assembly Line [20] | AR In Situ uses projectors | USD 800 to 1200 | Unity 3D (2021.4.05.f1) |
An Augmented Reality-Assisted Order-Picking System using IoT [36] | RASPICK Raspberry Pi Zero W board: Used as the brain of the device. | Not specified | Not specified |
An Augmented Reality System for Operator Training in the Footwear Sector [33] | HoloLens | HoloLens 1: Around USD 3000 HoloLens 2 with ISO 14644-14: About USD 5407.18 | Not specified |
An Augmented Reality System to Support Fault Visualisation in Industrial Robotic Tasks [37] | HoloLens | HoloLens 1: Around USD 3000. HoloLens 2 with ISO 14644-14: About USD 5407.18. | Unity 3D del SDK Vuforia and MRTK (Mixed-Reality Tool Kit) |
An Intelligent Product Service System for Adaptive Maintenance of Engineered-to-Order Manufacturing Equipment Assisted by Augmented Reality [34] | Smartphones or tablets | Smartphones: Mid-range: USD 400–700 High-end: USD 700–1500 Tablets: Mid-range: USD 300–700 High-end: USD 700–1200 | Unity 3D and Vuforia SDK. |
ARiana: Augmented Reality-Based In Situ Annotation of Assembly Videos [38] | Vuzix M400 | About USD 1500 to USD 1800 | SaliencyMDC algorithm and KCF (Kernelised Correlation Filters) tracing algorithm |
Assessing User Performance in Augmented Reality Assembly Guidance for Industry 4.0 Operators [39] | Apple iPad Pro 2020 | Approximately USD 1050–1650 | Unity 3D |
Assessment of Augmented Reality in Manual Wiring Production Process with Use of Mobile AR Glasses [40] | HoloLens | HoloLens 1: Around USD 3000 HoloLens 2 with ISO 14644-14: About USD 5407.18. | Unity 3D |
Augmented Reality for Industrial Quality Inspection: An Experiment Assessing Task Performance and Human Factors [41] | HoloLens | HoloLens 1: Around USD 3000. HoloLens 2 with ISO 14644-14: About USD 5407.18. | Unity3D together with the Mixed-Reality Toolkit 2 (MRTK 2) SDK and Vuforia. |
Augmented Reality System and Maintenance of Oil Pumps [21] | Smartphones or tablets | Smartphones: Mid-range: USD 400–700 High-end: USD 700–1500 Tablets: Mid-range: USD 300–700 High-end: USD 700–1200 | Unity 3D and SDK Vuforia |
Augmented Reality-Assisted Deep Reinforcement Learning-Based Model towards Industrial Training and Maintenance for Nanodrop Spectrophotometer [42] | HP Pavilion Huawei Nova Y70 Notebook One HP 320 | HP Pavilion Laptop: USD 600 to USD 1800 Huawei Nova Y70: USD 200 to USD 600 HP 320 camera: USD 80 to USD 300 | Unity 3D |
Augmented Reality-based Method for Road Maintenance Operators in Human–Robot Collaborative Interventions [43] | HoloLens and tablet | HoloLens 1: Around USD 3000. HoloLens 2 with ISO 14644-14: Around USD 5407.18 Tablets: Mid-range: USD 300–700 High-end: USD 700–1200 | Unity 3D and SDK Mixed-Reality Toolkit (MRTK) |
Data Mining and Augmented Reality: An Application to the Fashion Industry [44] | Commercial tablet with dual camera | Tablets: Mid-range: USD 300–700 High-end: USD 700–1200 | Web application developed with Xamarin and linked to a LAMP server (Linux, Apache, MySQL and PHP). |
Design of Augmented Reality Training Content for Railway Vehicle Maintenance Focusing on the Axle-Mounted Disc Brake System [26] | Smartphones or tablets with Android system | Smartphones: Mid-range: USD 400–700 High-end: USD 700–1500. Tablets: Mid-range: USD 300–700 High-end: USD 700–1200 | Unity 3D and Blender software |
Development of Augmented Reality Application for Onsite Inspection of Expressway Structures Using Microsoft HoloLens [45] | HoloLens | HoloLens 1: Around USD 3000. HoloLens 2 with ISO 14644-14: About USD 5407.18 | Unity 3D |
Development of Augmented Reality System for Productivity Enhancement in Offshore Plant Construction [46] | Mobile Phones | Smartphones: Mid-range: USD 400–700 USD High-end: USD 700–1500 | Project Tango Development Kit (PTDK) integrates with graphics engines such as Unity and Unreal Engine |
Development of Augmented Reality Technology Implementation in a Shipbuilding Project Realisation Process [31] | Tablet or smartphone | Smartphones: Mid-range: USD 400–700 High-end: USD 700–1500 Tablets: Mid-range: USD 300–700 High-end: USD 700–1200 | Unity3D and the ARCore SDK |
Dynamic Mixed-Reality Assembly Guidance Using Optical Recognition Methods [22] | HoloLens | HoloLens 1: Around USD 3000 HoloLens 2 with ISO 14644-14: Around USD 5407.18 Tablets: Mid-range: USD 300–700 High-end: USD 700–1200 | Unity Engine and the Vuforia Engine SDK |
Effect of Augmented Reality Support on Quality Inspection of Welded Structures [35] | Samsung Galaxy Table 8 | Around USD 250 | Unity 3D and Vuforia Engine SDK |
Effectiveness on Training Method Using Virtual Reality and Augmented Reality Applications in Automobile Engine Assembly [47] | EPSON MOVERIO BT-300 | EPSON Moverio BT-2000: USD 2196.15 | Unity 3D |
Evaluating Digital Work Instructions with Augmented Reality Versus Paper-based Documents for Manual, Object-specific Repair Tasks in a Case Study with Experienced Workers [32] | Microsoft Azure Kinect 3D Cameras Cognex DataMan DM 8600 Scanner, 27-inch touchscreen monitor and 43-inch monitor | Cameras: About USD 399 Scanner: Around USD 1000 27-inch monitor: Around USD 500 to USD 100 43-inch monitor: About USD 1000 to USD 2000 | Not specified |
Holorailway: an Augmented Reality System to Support Assembly Operations in the Railway Industry [48] | HoloLens | HoloLens 1: Around USD 3000 HoloLens 2 with ISO 14644-14: About USD 5407.18 | Unity3D, Mixed-Reality SDK Toolkit and Vuforia |
Improving Efficiency of Industrial Maintenance with Context-aware Adaptive Authoring in Augmented Reality [23] | Smartphones or tablets | Smartphones: Mid-range: USD 400–700 High-end: USD 700–1500 Tablets: Mid-range: USD 300–700 High-end: USD 700–1200 | Unity 3D and Vuforia SDK |
Integrated Augmented and Virtual Reality Technologies for Realistic Fire Drill Training [49] | VIVE Pro HMD | About USD 1199–USD 1400 | Unity 3D and SRWorks SDK |
MANTRA: an Effective System Based on Augmented Reality and Infrared Thermography for Industrial Maintenance [50] | Microsoft Surface Book 2, Intel RealSense d415 RGB-D camera and Optris PI640 thermal imaging camera | Microsoft Surface Book 2: About USD 400 to 600 Intel RealSense d415 RGB-D camera: About USD 450 Optris thermal imager: PI640 USD 7834.00 | Unity 3D |
MARMA: A Mobile Augmented Reality Maintenance Assistant for Fast-Track Repair Procedures in the Context of Industry 4.0 [24] | Smartphones that can load the application | Smartphones: Mid-range: 400–700 USD High-end: 700–1500 USD | Unity and Vuforia SDK |
Multimodal Mixed-Reality Impact on a Hand-Guiding Task with a Holographic Cobot [51] | HoloLens | HoloLens 1: Around USD 3000 HoloLens 2 with ISO 14644-14: About USD 5407.18 | Unity 3D |
Pervasive Augmented Reality to Support Logistics Operators in Industrial Scenarios: a Shopfloor User Study on Kit Assembly [52] | HoloLens for the HMD method; Asus Zenfone AR or Samsung Galaxy A52 for the HHD method. | HoloLens 1: Around USD 3000. HoloLens 2 with ISO 14644-14: Around USD 5407.18 Asus Zenfone AR: USD 300 to 600 Samsung Galaxy A52: USD 300 to 500 | Unity and Arcore SDK |
Presenting Job Instructions Using an Augmented Reality Device, a Printed Manual, and a Video Display for Assembly and Disassembly Tasks: What Are the Differences? [53] | HoloLens | HoloLens 1: Around 3000 USD. HoloLens 2 with ISO 14644-14: About 5407.18 USD. | Dynamics 365 Guides |
Process Monitoring of Economic and Environmental Performance of a Material Extrusion Printer Using an Augmented Reality-based Digital Twin [54] | Samsung Galaxy S21 | Around USD 480 | Unity 3D |
Process of Materials Picking Using Augmented Reality [55] | Epson MOVERIO BT-300 and Vuzix MT300 | EPSON Moverio BT-2000: USD 2196.15 Vuzix MT300: Around USD 1500 to USD 1800 | Unity 3D |
Real-Time Remote Maintenance Support Based on Augmented Reality (AR) [56] | HoloLens and desktop PCs | HoloLens 1: Around USD 3000 HoloLens 2 with ISO 14644-14: About USD 5407.18 Desktop PC: Around USD 600 | Unity 3D, Vuforia SDK and MRTK (Mixed Reality Tool Kit). |
Smart Augmented Reality Instructional System for Mechanical Assembly Towards Worker-Centered Intelligent Manufacturing [27] | Logitech C920 Pro webcams and a monitor | Cameras: About USD 100 Monitor: About USD 600 to USD 1800 | Unity3D |
Use of Projector-based Augmented Reality to Improve Manual Spot-welding Precision and Accuracy for Automotive Manufacturing [28] | Projectors (NEC NP-PA500UG) and Cameras | Projectors: About USD 2000 Cameras: About USD 100 | SAR software does not specify exact. |
Using Augmented Reality to Reduce Workload in Offshore Environments [29] | HoloLens | HoloLens 1: Around USD 3000 HoloLens 2 with ISO 14644-14: About USD 5407.18 | Unity3D |
Using Eye-Tracking to Measure Worker Situation Awareness in Augmented Reality [30] | HoloLens and iPhone SE | HoloLens 1: Around USD 3000 HoloLens 2 with ISO 14644-14: About USD 5407.18 iPhone SE: Around USD 600 | Unity with Mixed-Reality Toolkit 2 (MRTK2) |
WARM: Wearable AR and Tablet-Based Assistant Systems for Bus Maintenance [57] | HoloLens | HoloLens 1: Around USD 3000 HoloLens 2 with ISO 14644-14: About USD 5407.18 | Unity 3D, Mixed-Reality Toolkit SDK and Vuforia. |
Appendix C. Impact of AR Implementation in Industrial Processes
Title | Before AR Implementation | After AR Implementation | Percentage of Optimisation (%) |
---|---|---|---|
A Multi-User Collaborative AR System for Industrial Applications [25] | The time taken to perform the design task was 23 min. | The time taken to perform the activity using the system was 12.6 min. | It is observed that the design task was completed 45.22% faster. |
A Smart Factory in a Smart City: Virtual and Augmented Reality in a Smart Assembly Line [20] | The time to execute the assembly task using paper instructions was 3:24 min | The time to execute the assembly task using 3D guide was 2:34 min | The time to execute the task is reduced by 25 %. |
An Augmented Reality-Assisted Order-Picking System Using IoT [36] | The collection time for 10 items was 145 s and for 20 items, it was 280 s | The collection time for picking up 10 items was 131 s and for 20 items, it was 240 s | A decrease in the time to collect the items is observed by 9% for lists of 10 items and 12.55% for lists of 20 items. |
An Augmented Reality System for Operator Training in the Footwear Sector [33] | Time spent by trainers with interruptions in their work in the traditional way (% of total training hours) 20/100% | Time spent by trainers with interruptions in their work with AR (% of total hours of training) 10/100%. | Productivity increase of 10% is seen. |
An Augmented Reality System to Support Fault Visualisation in Industrial Robotic Tasks [37] | The average time of the system to recognise the type of failure in a non-adaptive way in seconds 97.85 | The average time of the system to recognise the type of failure in an adaptive way in seconds 71.82 | A 26% decrease in the time to recognise the fault is observed. |
An Intelligent Product Service System for Adaptive Maintenance of Engineered-to-Order Manufacturing Equipment Assisted by Augmented Reality [34] | Inspection time in days = 2 and fault documentation time = 1.5 h | Inspection time in days = 1 and fault documentation time = 0.5 h | Reduction in mould inspection time by up to 50% and fault documentation time by approximately 66%. |
ARiana: Augmented Reality Based In Situ Annotation of Assembly Videos [38] | Time to annotate the assembly process with Ajalon (state-of-the-art video annotation tool) 17.86 min. | Time to annotate the assembly process with ARiana (AR-based video annotation tool) 5.2 min. | Implementing ARiana reduces the time by approximately 70%. |
Assessing User Performance in Augmented Reality Assembly Guidance for Industry 4.0 Operators [39] | Average time to complete assembly activity with technical documents 839 s | Average time to perform the assembly activity with AR 583 s | A 30.51% reduction in the assembly activity is observed. |
Assessment of Augmented Reality in Manual Wiring Production Process with Use of Mobile AR Glasses [40] | Average time in minutes of assembly time without AR glasses by Tester 1: 17:40 and by Tester 2: 19:03 | Average time in minutes of the assembly duration with AR glasses by Tester 1: 11:06 and by Tester 2: 7:00 | By using AR glasses in the assembly process, a decrease of 37% is observed for Tester 1 and 36% for Tester 2. |
Augmented Reality for Industrial Quality Inspection: An Experiment Assessing Task Performance and Human Factors [41] | Task completion time and number of errors of a simple task with a display time: 630 s | Task completion time and number of errors of a task with AR time: 439 s | 30.31% time reduction by using AR with an HMD device |
Augmented Reality System and Maintenance of Oil Pumps [21] | Average time performed during oil pump maintenance with manual instructions only = 672 s. | Average time executed during oil pump maintenance with system recommen-dations = 424.5. | Using the recommendations of the AR system, a time reduction of 36.83% could be seen. |
Augmented Reality-Assisted Deep Reinforcement Learning-Based Model towards Industrial Training and Maintenance for Nanodrop Spectrophotometer [42] | The accuracy of the Chan et al. model and other 3D systems with geometry recognition using GAN is = 87.2%. | Accuracy of the RL-PipTrack system: AR-assisted deep RL-based model has an average Reward = 1000 + standard deviation = 0%. | RL-PipTrack improves performance by approximately 14.68% compared to the model of Chan et al. |
Augmented Reality-based Method for Road Maintenance Operators in Human–Robot Collaborative Interventions [43] | Time to execute the task by expert users without AR—2.5 min. | Time to execute the task by expert users with AR—3.5 min | Using AR shows a clear increase in efficiency when performing the task as it reduces the time by about 28%. |
Data Mining and Augmented Reality: An Application to the Fashion Industry [44] | Standardised duration of the quality control procedure Expert OK = 10.19 Non-expert OK = 9.84 | Standardised duration of QC procedure with AR technology Expert OK = 7.68 Non-expert OK = 5.01 | It is observed that the normalised duration of the quality control process using AR of expert operators is 24.63% faster and 49.08% faster in non-expert operators. |
Design of Augmented Reality Training Content for Railway Vehicle Maintenance Focusing on the Axle-Mounted Disc Brake System [26] | Group A obtains an efficiency score of the executed task of the axle-mounted disc brake system through manual brochure type 47.2 | Group A obtains an efficiency score of the light maintenance task of the axle-mounted disc brake system through AR 63.5 | A higher efficiency of 32.53% of the task performed by AR guide is observed. |
Development of Augmented Reality Application for Onsite Inspection of Expressway Structures Using Microsoft HoloLens [45] | The actual inspection cycle from an on-site inspection to data entry in the office takes approximately 4.5 h. | Using the digital AR approach developed for an in situ inspection of highway structures can be performed in an inspection time of 1 h | Using an AR approach can decrease inspection time by approximately 78%. |
Development of Augmented Reality System for Productivity Enhancement in Offshore Plant Construction [46] | Average working time (min.) for interference check of the system > 40; Estimated workload > 180 | Average working time (min) for interference check at the plant < 15; Estimated workload < 60 | In the inspection process, the checking and interference time is reduced by 62.5% and the workload time by 33.33%. |
Development of Augmented Reality Technology Implementation in a Shipbuilding Project Realisation Process [31] | The number of labour hours required for repair activities in the equipment process prior to AR is 12,973.06 h. | The number of labour hours required for repair activities in the equipment process with AR is 9600 h. | The application of AR technology in the repair process reduces the process time by 26%. |
Dynamic Mixed-Reality Assembly Guidance Using Optical Recognition Methods [22] | Number of components placed in the assembly task by inexperienced users 71 | Number of components placed in the assembly task by experienced users 80 | It is observed that the number of components placed by experienced users is 12.67% higher than that of |
Effect of Augmented Reality Support on Quality Inspection of Welded Structures [35] | Mean task completion time of G1 = 1238.3 s and G2 achieved a mean time of 1528 s with paper support. | Mean task completion time of G1 = 927.8 s and G2 achieved a mean time of 1051.5 s with the AR approach. | G1 task completion time is reduced by 25.07% and G2 by 31.18%. |
Effectiveness on Training Method Using Virtual Reality and Augmented Reality Applications in Automobile Engine Assembly [47] | The percentage improvement after performing the task with VR training is calculated to be 23/40. | The percentage improvement after performing the task with AR training without markers is 37/40. | An improvement is observed when performing the task when trained with AR without markers 60% higher than that of VR. |
Evaluating Digital Work Instructions with Augmented Reality Versus Paper-based Documents for Manual, Object-specific Repair Tasks in a Case Study with Experienced Workers [32] | The time to repair with paper guide is 466.1 s | The repair time using AR CAS guide is 367.3 s | The time is reduced by 21.19% using the AR CAS guide. |
Holorailway: an Augmented Reality System to Support Assembly Operations in the Railway Industry [48] | The overall average time in assembly by traditional method is 108.37 s and the number of errors is 17 | The overall average time in assembly by AR method is 56.5 s and the number of errors is 2 | By using AR in the assembly, the time is reduced by 52.13% and the errors decreased by 88%. |
Improving Efficiency of Industrial Maintenance with Context-aware Adaptive Authoring in Augmented Reality [23] | The time to perform maintenance tasks with manual paper-based procedure is approximately 13 min | The time to perform maintenance tasks with the use of AR is 7 min | A reduction in time to perform the maintenance activity of about 46% is observed. |
Integrated Augmented and Virtual Reality Technologies for Realistic Fire Drill Training [49] | According to [58], the time to complete the fire training was 6 min with VR. | The training lasted 5 min, during which time the participants were asked to simulate AR/VR firefighting training using the system. | This reduced the training time by 16.66% compared to the VR method. |
MANTRA: An Effective System Based on Augmented Reality and Infrared Thermography for Industrial Maintenance [50] | The time to perform the diagnostic task in minutes with detailed guidance is 6.74 and the number of errors is 3.60 | Time to perform the diagnostic task in minutes with AR is 6.00 and the number of errors is 1.33 | There is a decrease in time of 10.98% and a decrease in errors of 62.96%. |
MARMA: A Mobile Augmented Reality Maintenance Assistant for Fast-Track Repair Procedures in the Context of Industry 4.0 [24] | Compressor repair is performed with paper-based procedure. | Compressor repair is performed with the MARMA procedure, an AR system. | Experts mentioned that MARMA can reduce the total compressor repair time by 30% compared to the paper-based procedure. |
Multimodal Mixed-Reality Impact on a Hand-Guiding Task with a Holographic Cobot [51] | The time spent during cobot execution without (V) haptic feedback is 26.614 s | The time taken during cobot execution with (V + H) with haptic feedback is 24.027 s | Cobot execution time with (V+ H) is reduced by 9.72 with respect to (V). |
Pervasive Augmented Reality to Support Logistics Operators in Industrial Scenarios: a Shopfloor User Study on Kit Assembly [52] | The average collection time per component, instructed by role, considering sequential order is 36 s and non-sequential order is 28 s | The average collection time per component, instructed by HMD sequentially is 11 s and non-sequentially is 13 s and by an HHD sequentially is 25 s and non-sequentially is 17 s. | Sequentially by HMD and HHD, the task is executed 70% and 31% faster, respectively, while non-sequentially it is executed 54% and 39% faster, respectively. |
Presenting Job Instructions Using an Augmented Reality Device, a Printed Manual, and a Video Display for Assembly and Disassembly Tasks: What Are the Differences? [53] | The number of errors when performing a task by printed manual is 1.33. | The number of errors when performing a task by AR is 0.33. | Errors are reduced by 75.19% using AR. |
Process Monitoring of Economic and Environmental Performance of a Material Extrusion Printer Using an Augmented Reality-based Digital Twin [54] | The porosities of PLA by Hebeeb et al. and Liao et al. are calculated to be 22.5% and 10.1%, respectively. | The average porosity of this study is calculated to be 7.56% | Product porosity is reduced by 14.94% compared to Hebeeb and 2.54% compared to Liai. |
Process of Materials Picking Using Augmented Reality [55] | Time to select the part 4.04 s | Time to pick up the part with the EPSON Moverio HMD 4.01 s | The HMD reduces the picking time by 1.47%. |
Real-Time Remote Maintenance Support Based on Augmented Reality (AR) [56] | Approximate time to execute the maintenance task of the current method = 140 s | Approximate time to execute the maintenance task of the current method = 62 s | It is inferred that the time of the maintenance task can be reduced by approximately 55%. |
Smart Augmented Reality Instructional System for Mechanical Assembly Towards Worker-Centered Intelligent Manufacturing [27] | Time for spindle assembly task with paper manual instructions = 755 s and 34 errors. | Time for the spindle assembly task with AR instruction = 504 s and 23 errors. | Time decrease of 33.24% and 32.35% decrease in errors is observed for the spindle assembly task with AR instruction. |
Use of Projector-based Augmented Reality to Improve Manual Spot-welding Precision and Accuracy for Automotive Manufacturing [28] | Accuracy for the six spot-welding positions welded without AR is 4.08 mm. | Accuracy for the six spot-welding positions welded with AR is 1.94 mm | Increase of approximately 52% in operator accuracy when spot-welding. |
Using Augmented Reality to Reduce Workload in Offshore Environments [29] | Average distance travelled in (m) from EDYV platform to turbine 4 without HMD 3855 | Average distance traveled in (m) from EDYV platform to turbine 4 without HMD 3551 | AR reduces the distance traveled by 8.92%. |
Using Eye-Tracking to Measure Worker Situation Awareness in Augmented Reality [30] | The number of failures in an assembly task without receiving AR warnings is 74 | The number of failures in an assembly task with HMD and receiving AR warnings is 14 | The number of failures in the assembly task is reduced by 81.08%. |
WARM: Wearable AR and Tablet-Based Assistant Systems for Bus Maintenance [57] | The maintenance personnel costs per vehicle EUR/(vehicle × 10,000 km) is EUR 24.78 | The maintenance personnel costs per vehicle EUR/(vehicle × 10,000 km) is EUR 24.7 | Costs are minimised by 0.32%. |
References
- Mourtzis, D.; Zogopoulos, V.; Vlachou, E. Augmented Reality Application to Support Remote Maintenance as a Service in the Robotics Industry. Procedia CIRP 2017, 63, 46–51. [Google Scholar] [CrossRef]
- Nardo, M.D.; Madonna, M.; Addonizio, P.; Gallab, M. A mapping analysis of maintenance in Industry 4.0. J. Appl. Res. Technol. 2021, 19, 653–675. [Google Scholar] [CrossRef]
- Reyes, J.F.; Lopez, M.X.; Portero, E.O.; Lopez, W.O.; Garcia, M.V.; Naranjo, J.E. A FlexSim-Based Approach to Efficient Layout Planning for a Tire Company. In Proceedings of the CSEI: International Conference on Computer Science, Electronics and Industrial Engineering (CSEI), Ambato, Ecuador, 14–18 November 2022; Garcia, M.V., Gordón-Gallegos, C., Eds.; Springer: Cham, Switzerland, 2023; pp. 532–542. [Google Scholar]
- Fortuna, S.; Barbieri, L.; Marino, E.; Bruno, F. A comparative study of Augmented Reality rendering techniques for industrial assembly inspection. Comput. Ind. 2024, 155, 104057. [Google Scholar] [CrossRef]
- Kollatsch, C.; Schumann, M.; Klimant, P.; Wittstock, V.; Putz, M. Mobile Augmented Reality Based Monitoring of Assembly Lines. Procedia CIRP 2014, 23, 246–251. [Google Scholar] [CrossRef]
- Rajalah, H.; Jusoh, M.; Jaafar, S.; Abdullah, S. Optimization of the material handling system in adapting the real-time AR simulation. In Proceedings of the International Conference on Smart Materials and Structures ICSMS-2022, Nambur, India, 15–16 February 2022; Volume 2571, ISSN 0094-243X. [Google Scholar] [CrossRef]
- Marques, B.; Silva, S.; Alves, J.; Araújo, T.; Dias, P.; Santos, B.S. A Conceptual Model and Taxonomy for Collaborative Augmented Reality. IEEE Trans. Vis. Comput. Graph. 2022, 28, 5113–5133. [Google Scholar] [CrossRef]
- Martin-Gomez, A.; Weiss, J.; Keller, A.; Eck, U.; Roth, D.; Navab, N. The Impact of Focus and Context Visualization Techniques on Depth Perception in Optical See-Through Head-Mounted Displays. IEEE Trans. Vis. Comput. Graph. 2022, 28, 4156–4171. [Google Scholar] [CrossRef]
- Gervasi, O.; Perri, D.; Simonetti, M. Empowering Knowledge With Virtual and Augmented Reality. IEEE Access 2023, 11, 144649–144662. [Google Scholar] [CrossRef]
- Jang, J.; Ko, Y.; Shin, W.S.; Han, I. Augmented Reality and Virtual Reality for Learning: An Examination Using an Extended Technology Acceptance Model. IEEE Access 2021, 9, 6798–6809. [Google Scholar] [CrossRef]
- Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Br. Med. J. 2021, 372, n71. [Google Scholar] [CrossRef]
- Bramer, W.M.; Rethlefsen, M.L.; Kleijnen, J.; Franco, O.H. Optimal database combinations for literature searches in systematic reviews: A prospective exploratory study. Syst. Rev. 2017, 6, 245. [Google Scholar] [CrossRef]
- Baas, J.; Schotten, M.; Plume, A.; Côté, G.; Karimi, R. Scopus as a curated, high-quality bibliometric data source for academic research in quantitative science studies. Quant. Sci. Stud. 2020, 1, 377–386. [Google Scholar] [CrossRef]
- Walden, R.L. SpringerLink Platform Review. J. Electron. Resour. Med Libr. 2021, 18, 188–197. [Google Scholar] [CrossRef]
- Okagbue, H.; Teixeira da Silva, J.; Anake, T. Exploring the relationship between journal indexing and article processing charges of journals published by mdpi, the multidisciplinary digital publishing institute. Eur. Sci. Ed. 2020, 46, e54523. [Google Scholar] [CrossRef]
- Naranjo, J.E.; Caiza, G.; Velastegui, R.; Castro, M.; Alarcon-Ortiz, A.; Garcia, M.V. A Scoping Review of Pipeline Maintenance Methodologies Based on Industry 4.0. Sustainability 2022, 14, 16723. [Google Scholar] [CrossRef]
- Naranjo, J.E.; Mora, C.A.; Bustamante Villagómez, D.F.; Mancheno Falconi, M.G.; Garcia, M.V. Wearable Sensors in Industrial Ergonomics: Enhancing Safety and Productivity in Industry 4.0. Sensors 2025, 25, 1526. [Google Scholar] [CrossRef]
- McGuinness, L.A.; Higgins, J.P.T. Risk-of-bias VISualization (robvis): An R package and Shiny web app for visualizing risk-of-bias assessments. Res. Synth. Methods 2021, 12, 55–61. [Google Scholar] [CrossRef] [PubMed]
- ISO 14644-14:2016; Cleanrooms and Associated Controlled Environments—Part 14: Assessment of Suitability for Use of Equipment by Airborne Particle Concentration. ISO: Geneva, Switzerland, 2016.
- Horejsi, P.; Novikov, K.; Simon, M. A smart factory in a smart city: Virtual and augmented reality in a smart assembly line. IEEE Access 2020, 8, 94330–94340. [Google Scholar] [CrossRef]
- Koteleva, N.; Buslaev, G.; Valnev, V.; Kunshin, A. Augmented reality system and maintenance of oil pumps. Int. J. Eng. Trans. B Appl. 2020, 33, 1620–1628. [Google Scholar] [CrossRef]
- Maffei, A.; Dalle Mura, M.; Monetti, F.; Boffa, E. Dynamic Mixed Reality Assembly Guidance Using Optical Recognition Methods. Appl. Sci. 2023, 13, 1760. [Google Scholar] [CrossRef]
- Erkoyuncu, J.; del Amo, I.; Dalle Mura, M.; Roy, R.; Dini, G. Improving efficiency of industrial maintenance with context aware adaptive authoring in augmented reality. CIRP Ann.-Manuf. Technol. 2017, 66, 465–468. [Google Scholar] [CrossRef]
- Konstantinidis, F.; Kansizoglou, I.; Santavas, N.; Mouroutsos, S.; Gasteratos, A. Marma: A mobile augmented reality maintenance assistant for fast-track repair procedures in the context of industry 4.0. Machines 2020, 8, 88. [Google Scholar] [CrossRef]
- Wang, J.; Qi, Y. A Multi-User Collaborative AR System for Industrial Applications. Sensors 2022, 22, 1319. [Google Scholar] [CrossRef]
- Kwon, H.J.; Lee, S.I.; Park, J.H.; Kim, C.S. Design of augmented reality training content for railway vehicle maintenance focusing on the axle-mounted disc brake system. Appl. Sci. 2021, 11, 9090. [Google Scholar] [CrossRef]
- Lai, Z.H.; Tao, W.; Leu, M.; Yin, Z. Smart augmented reality instructional system for mechanical assembly towards worker-centered intelligent manufacturing. J. Manuf. Syst. 2020, 55, 69–81. [Google Scholar] [CrossRef]
- Doshi, A.; Smith, R.; Thomas, B.; Bouras, C. Use of projector based augmented reality to improve manual spot-welding precision and accuracy for automotive manufacturing. Int. J. Adv. Manuf. Technol. 2017, 89, 1279–1293. [Google Scholar] [CrossRef]
- Maibach, M.J.; Jones, M.; Walko, C. Using augmented reality to reduce workload in offshore environments. CEAS Aeronaut. J. 2022, 13, 559–573. [Google Scholar] [CrossRef]
- Wu, S.; Chen, H.; Hou, L.; Zhang, G.; Li, C.Q. Using Eye-Tracking to Measure Worker Situation Awareness in Augmented Reality. Autom. Constr. 2024, 165, 105582. [Google Scholar] [CrossRef]
- Kunkera, Z.; Željković, I.; Mimica, R.; Ljubenkov, B.; Opetuk, T. Development of Augmented Reality Technology Implementation in a Shipbuilding Project Realization Process. J. Mar. Sci. Eng. 2024, 12, 550. [Google Scholar] [CrossRef]
- Eversberg, L.; Lambrecht, J. Evaluating digital work instructions with augmented reality versus paper-based documents for manual, object-specific repair tasks in a case study with experienced workers. Int. J. Adv. Manuf. Technol. 2023, 127, 1859–1871. [Google Scholar] [CrossRef]
- Rossi, M.; Papetti, A.; Germani, M.; Marconi, M. An augmented reality system for operator training in the footwear sector. Comput.-Aided Des. Appl. 2020, 18, 692–703. [Google Scholar] [CrossRef]
- Angelopoulos, J.; Mourtzis, D. An Intelligent Product Service System for Adaptive Maintenance of Engineered-to-Order Manufacturing Equipment Assisted by Augmented Reality. Appl. Sci. 2022, 12, 5349. [Google Scholar] [CrossRef]
- Havlíková, K.; Hořejší, P.; Kopeček, P. Effect of Augmented Reality Support on Quality Inspection of Welded Structures. Appl. Sci. 2023, 13, 11655. [Google Scholar] [CrossRef]
- Nagda, M.; Sinha, S.; Poovammal, E. An augmented reality assisted order picking system using IoT. Int. J. Recent Technol. Eng. 2019, 8, 744–749. [Google Scholar] [CrossRef]
- Avalle, G.; De Pace, F.; Fornaro, C.; Manuri, F.; Sanna, A. An Augmented Reality System to Support Fault Visualization in Industrial Robotic Tasks. IEEE Access 2019, 7, 132343–132359. [Google Scholar] [CrossRef]
- Pham, T.; Moesgen, T.; Siltanen, S.; Bergstrom, J.; Xiao, Y. ARiana: Augmented Reality Based In-Situ Annotation of Assembly Videos. IEEE Access 2022, 10, 111704–111724. [Google Scholar] [CrossRef]
- Marino, E.; Barbieri, L.; Bruno, F.; Muzzupappa, M. Assessing user performance in augmented reality assembly guidance for industry 4.0 operators. Comput. Ind. 2024, 157–158, 104085. [Google Scholar] [CrossRef]
- Szajna, A.; Stryjski, R.; Woźniak, W.; Chamier-Gliszczyński, N.; Kostrzewski, M. Assessment of augmented reality in manual wiring production process with use of mobile AR glasses. Sensors 2020, 20, 4755. [Google Scholar] [CrossRef]
- Seeliger, A.; Cheng, L.; Netland, T. Augmented reality for industrial quality inspection: An experiment assessing task performance and human factors. Comput. Ind. 2023, 151, 103985. [Google Scholar] [CrossRef]
- Alatawi, H.; Albalawi, N.; Shahata, G.; Aljohani, K.; Alhakamy, A.; Tuceryan, M. Augmented Reality-Assisted Deep Reinforcement Learning-Based Model towards Industrial Training and Maintenance for NanoDrop Spectrophotometer. Sensors 2023, 23, 6024. [Google Scholar] [CrossRef]
- Bavelos, A.; Anastasiou, E.; Dimitropoulos, N.; Oikonomou, G.; Makris, S. Augmented reality-based method for road maintenance operators in human–robot collaborative interventions. Comput.-Aided Civ. Infrastruct. Eng. 2024, 39, 1077–1095. [Google Scholar] [CrossRef]
- Fani, V.; Antomarioni, S.; Bandinelli, R.; Ciarapica, F. Data Mining and Augmented Reality: An Application to the Fashion Industry. Appl. Sci. 2023, 13, 2317. [Google Scholar] [CrossRef]
- Kouch, K.; Panuwatwanich, K.; Sancharoen, P.; Sahachaisaree, S. Development of Augmented Reality Application for Onsite Inspection of Expressway Structures Using Microsoft HoloLens. J. Constr. Dev. Ctries. 2021, 26, 87–116. [Google Scholar] [CrossRef]
- Choi, S.; Park, J.S. Development of augmented reality system for productivity enhancement in offshore plant construction. J. Mar. Sci. Eng. 2021, 9, 209. [Google Scholar] [CrossRef]
- Win, L.; Aziz, F.; Hairuddin, A.; Abdullah, L.; Yap, H.; Saito, H.; Seyajah, N. Effectiveness on training method using virtual reality and augmented reality applications in automobile engine Assembly. ASEAN Eng. J. 2022, 12, 83–88. [Google Scholar] [CrossRef]
- Garcia, C.; Ortega, M.; Ivorra, E.; Contero, M.; Mora, P.; Alcañiz, M. Holorailway: An augmented reality system to support assembly operations in the railway industry. Adv. Manuf. 2024, 12, 764–783. [Google Scholar] [CrossRef]
- Kang, H.; Yang, J.; Ko, B.S.; Kim, B.S.; Song, O.Y.; Choi, S.M. Integrated Augmented and Virtual Reality Technologies for Realistic Fire Drill Training. IEEE Comput. Graph. Appl. 2024, 44, 89–99. [Google Scholar] [CrossRef]
- Ortega, M.; Ivorra, E.; Juan, A.; Venegas, P.; Martínez, J.; Alcañiz, M. Mantra: An effective system based on augmented reality and infrared thermography for industrial maintenance. Appl. Sci. 2021, 11, 385. [Google Scholar] [CrossRef]
- Pinto, A.; Kildal, J.; Lazkano, E. Multimodal mixed reality impact on a hand guiding task with a holographic cobot. Multimodal Technol. Interact. 2020, 4, 78. [Google Scholar] [CrossRef]
- Maio, R.; Santos, A.; Marques, B.; Ferreira, C.; Almeida, D.; Ramalho, P.; Batista, J.; Dias, P.; Santos, B. Pervasive Augmented Reality to support logistics operators in industrial scenarios: A shop floor user study on kit assembly. Int. J. Adv. Manuf. Technol. 2023, 127, 1631–1649. [Google Scholar] [CrossRef]
- Dorloh, H.; Li, K.W.; Khaday, S. Presenting Job Instructions Using an Augmented Reality Device, a Printed Manual, and a Video Display for Assembly and Disassembly Tasks: What Are the Differences? Appl. Sci. 2023, 13, 2186. [Google Scholar] [CrossRef]
- Yi, L.; Glatt, M.; Ehmsen, S.; Duan, W.; Aurich, J. Process monitoring of economic and environmental performance of a material extrusion printer using an augmented reality-based digital twin. Addit. Manuf. 2021, 48, 102388. [Google Scholar] [CrossRef]
- Zywicki, K.; Bun, P. Process of Materials Picking Using Augmented Reality. IEEE Access 2021, 9, 102966–102974. [Google Scholar] [CrossRef]
- Mourtzis, D.; Siatras, V.; Angelopoulos, J. Real-time remote maintenance support based on augmented reality (AR). Appl. Sci. 2020, 10, 1855. [Google Scholar] [CrossRef]
- Borro, D.; Suescun, A.; Brazález, A.; González, J.; Ortega, E.; González, E. WARM: Wearable AR and tablet-based assistant systems for bus maintenance. Appl. Sci. 2021, 11, 1443. [Google Scholar] [CrossRef]
- Saghafian, M.; Laumann, K.; Akhtar, R.S.; Skogstad, M.R. The Evaluation of Virtual Reality Fire Extinguisher Training. Front. Psychol. 2020, 11, 593466. [Google Scholar] [CrossRef]
Number | Question | Motivation |
---|---|---|
RQ1 | What are the main benefits of applying AR in the optimisation of industrial processes? | Identify the advantages of applying AR in industrial processes. |
RQ2 | What is the most used graphics engine? | Identify market trends and benefit from a large support community to make informed decisions. |
RQ3 | In which industrial processes is it recommended to implement AR? | Ensure a strategic and beneficial adoption of AR in industrial processes. |
RQ4 | What challenges and limitations do industries face when implementing AR? | Identify the drawbacks that arise when implementing AR. |
Abbreviation | Criteria | Description |
---|---|---|
C1 | Study Design | Articles related to applications of AR in industrial processes. |
C2 | Language | Only articles written in English were selected. |
C3 | Time Range | Articles published between 2019 and 2024 were selected. |
C4 | Significant Contribution | Articles that provide information on the applications of AR in engineering through implementation and obtaining tangible results. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Miranda, A.; Vallejo, A.M.; Ayala, P.; Garcia, M.V.; Naranjo, J.E. Enhancing Industrial Processes Through Augmented Reality: A Scoping Review. Future Internet 2025, 17, 358. https://doi.org/10.3390/fi17080358
Miranda A, Vallejo AM, Ayala P, Garcia MV, Naranjo JE. Enhancing Industrial Processes Through Augmented Reality: A Scoping Review. Future Internet. 2025; 17(8):358. https://doi.org/10.3390/fi17080358
Chicago/Turabian StyleMiranda, Alba, Aracely M. Vallejo, Paulina Ayala, Marcelo V. Garcia, and Jose E. Naranjo. 2025. "Enhancing Industrial Processes Through Augmented Reality: A Scoping Review" Future Internet 17, no. 8: 358. https://doi.org/10.3390/fi17080358
APA StyleMiranda, A., Vallejo, A. M., Ayala, P., Garcia, M. V., & Naranjo, J. E. (2025). Enhancing Industrial Processes Through Augmented Reality: A Scoping Review. Future Internet, 17(8), 358. https://doi.org/10.3390/fi17080358