Next Article in Journal
Cluster2Former: Semisupervised Clustering Transformers for Video Instance Segmentation
Previous Article in Journal
UAV-Based Secure Data Communication: Multilevel Authentication Perspective
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Approach to Develop Digital Twins in Industry

by
Raúl González-Herbón
,
Guzmán González-Mateos
,
José R. Rodríguez-Ossorio
,
Manuel Domínguez
,
Serafín Alonso
and
Juan J. Fuertes
*
Grupo de Investigación en Supervisión, Control y Automatización de Procesos Industriales (SUPPRESS), Escuela de Ingenierías Industrial, Informática y Aeroespacial, Universidad de León, Campus de Vegazana s/n, 24007 León, Spain
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(3), 998; https://doi.org/10.3390/s24030998
Submission received: 21 December 2023 / Revised: 19 January 2024 / Accepted: 1 February 2024 / Published: 3 February 2024
(This article belongs to the Section Internet of Things)

Abstract

:
The industry is currently undergoing a digital revolution driven by the integration of several enabling technologies. These include automation, robotics, cloud computing, industrial cybersecurity, systems integration, digital twins, etc. Of particular note is the increasing use of digital twins, which offer significant added value by providing realistic and fully functional process simulations. This paper proposes an approach for developing digital twins in industrial environments. The novelty lies in not only focusing on obtaining the model of the industrial system and integrating virtual reality and/or augmented reality but also in emphasizing the importance of incorporating other enabled technologies of Industry 4.0, such as system integration, connectivity with standard and specific industrial protocols, cloud services, or new industrial automation systems, to enhance the capabilities of the digital twin. Furthermore, a proposal of the software tools that can be used to achieve this incorporation is made. Unity is chosen as the real-time 3D development tool for its cross-platform capability and streamlined industrial system modeling. The integration of augmented reality is facilitated by the Vuforia SDK. Node-RED is selected as the system integration option, and communications are carried out with MQTT protocol. Finally, cloud-based services are recommended for effective data storage and processing. Furthermore, this approach has been used to develop a digital twin of a robotic electro-pneumatic cell.

1. Introduction

Industrial digitization is taking place through the integration of various technologies into production processes, such as cloud computing, cyber–physical systems (CPS), cybersecurity, the Internet of Things (IoT), and digital twins [1]. These enabling technologies have brought about significant changes and emerging trends in the industry, marking a profound transformation known as Industry 4.0 [2]. This transformation has been proven to be a valuable asset for businesses, minimizing downtime and optimizing resource utilization, enhancing the overall efficiency of smart factories [3].
Digital twins are among the most interesting enabling technologies, capturing significant attention [4]. They are virtual representations of physical systems, staying synchronized with the real world at defined intervals and with precise accuracy [5]. This technology has the ability to predict responses to unexpected events through a bidirectional data exchange with the physical system and the utilization of algorithms that characterize the system’s behavior. Consequently, digital twins are highly advantageous for optimizing industrial processes, identifying failures and enhancing energy efficiency, among various other applications.
Creating a digital twin involves the development of virtual models that mirror the functional attributes of the physical system. In industry, these models have been usually designed employing specialized tools offered by automation system manufacturers [6]. However, graphics engines, traditionally employed in video game development, are becoming an alternative because of their ability to simulate complex scenarios and lower economic costs. They are cost-effective alternatives to the proprietary tools offered by automation system manufacturers. This paper proposes a methodology for the implementation of digital twins using one of these cost-effective alternatives, offering an analysis of the requirements and functionalities to be achieved. Furthermore, this methodology has been used to develop a digital twin for a robotic electro-pneumatic cell.
The main contribution of this work is a method for developing digital twins that provides a realistic industrial environment where several enabling technologies of Industry 4.0 are seamlessly integrated to interact with real equipment. These technologies include automation, robotics, connectivity with standard protocols, system integration, cloud-based storage and data processing, machine learning, virtual and augmented reality, among others. Most of the previous works are centered on obtaining industrial system models and incorporating virtual and/or augmented reality to enhance the functionality of digital twins. However, they do not focus on the importance of adding other enabled technologies of Industry 4.0 to the industrial digital twin. It is crucial to assess the integration of complementary technologies to develop a digital twin that supports real-time simulation and analysis. This integration facilitates optimization, predictive maintenance and enhanced monitoring, ultimately leading to improved operational efficiency. The proposed methodology aims to achieve the following objectives:
  • To develop precise scenarios of virtual and augmented reality. There are open-source graphic engines that, although initially associated with video game development, are progressively being utilized for engineering, marketing, and architectural applications. Additionally, these engines are equipped with a powerful physics engine that streamlines the 3D modeling of industrial systems and enables the adaptation of applications to augmented reality.
  • To manage automation and robotic systems based on distributed and decentralized architectures where control systems communicate with each other through standard industrial communication protocols, aiming to enhance efficiency, speed, and repeatability.
  • To ensure connectivity using standard communication protocols, such as Message Queuing Telemetry Transport (MQTT), and specific industrial protocols that are traditionally used for the operation or configuration of control systems, such as PROFINET, Modbus TCP, etc. Also connectivity with OPC UA, which is a modern industrial communication standard, is based on the classic client/server architecture.
  • To achieve system integration, with tools such as Node-RED, an open-source visualization tool created by the IBM Emerging Technology team that allows for interconnecting all the elements of the Internet of Things.
  • To store and process data in the cloud. Virtual machines or services allocated in the cloud have advantages over other local tools, including cost-effectiveness, flexibility, continuous support, and heightened security. Furthermore, cloud services enable the implementation of data analysis techniques by facilitating real-time and decentralized decision making.
  • To add industrial cybersecurity. Although industrial cybersecurity, as well as other main enabling technologies in digital industry, have not been incorporated into our functional digital twin proposal, the robotic electro-pneumatic cell used for experimentation currently features an industrial firewall to ensure network security. The plan for incorporating this aspect into the digital twin in future work is described.
This paper is organized as follows: Section 2 provides a current state of the art with an overview of the technologies employed in digital twin development; next, Section 3 explains the proposed methodology to develop a digital twin. Section 4 presents the digital twin developed for a robotic electro-pneumatic cell using the proposed methodology. The conclusions of the paper are in Section 5.

2. Digital Twins

The digital twin is not a novel concept but rather integrates other previously recognized components such as 3D modeling, simulations, or Product Life-cycle Management (PLM) [7,8]. This concept can be described as the utilization of data-driven insights for the supervision, administration, and ongoing enhancement of a system or product [9]. However, the actual trend of fusing the physical world with the virtual world has significantly increased the popularity of this concept [10], following its introduction by Grieves through its relation to Product Life-cycle Management and the concept of “Mirrored Spaces Models” [11,12]. This trend has evolved from the concept presented by NASA and the U.S. Air Force in 2012 [13,14,15] to an expansion of the term presented by Grieves [16] and, subsequently, in collaboration with Vickers [17] defining three components (real space, virtual space and data link information process) as the basis for its development. In addition, the complexity of the systems is increasing, so the incorporation of other technologies such as augmented reality helps to work better with the digital twin data [18,19].
There are several previous works on digital twins for industrial applications in multiple sectors [20]. In [21], the authors present a digital twin that incorporates an anomaly detection system for asset monitoring, along with its data integration method based on extended IFCs (Industry Foundation Classes), in daily operation and maintenance management. In addition, they incorporate a case study applying anomaly detection on centrifugal pumps in HVAC (Heating, Ventilation, and Air Conditioning) systems. In [22], the authors propose a model for predictive maintenance of a CNC (Computer Numerical Control) machine tool using the data and the digital twin model. This model is used in a case study on cutting tool life prediction. Another example of predictive maintenance can be found in [23], where a methodology for calculating the Remaining Useful Life (RUL) of machinery equipment by utilizing physics-based simulation models and the digital twin concept is presented and applied to an industrial robot. In other sectors such as wind farms, the use of predictive digital twins is also interesting [24]. This paper presents a digital twin based on Unity for visualization, OPC-UA for communications and the Prophet prediction algorithm to detect potential failures in wind turbine components. In addition, the authors incorporate augmented reality to enhance user experience. In the automotive sector, digital twins for connected and automated vehicles (CAVs) also stand out [25]. In this work, a digital twin simulation architecture is proposed. This architecture is based on three layers: Unity game objects to represent the “CAVs hardware”, Unity scripting API to represent the “CAVs software” and external tools for the simulation functionalities. These works focus on acquiring the model of the industrial system and integrating virtual reality and/or augmented reality to improve functionalities of the digital twin. However, they do not define the importance of incorporating other enabled technologies of Industry 4.0 into the industrial digital twin. These technologies include system integration, connectivity with standard and specific industrial protocols and cloud services, or new industrial automation systems. One of the main contributions of this work is to propose a method to develop digital twins where these enabling technologies are integrated to interact with the real system and work collectively. Furthermore, a proposal of the software tools that can be used for this is made.
Currently, there are many tools on the market for the development of digital twins [8]: Siemens has the NX family of software that, together with SIMIT and PLCSIM Advanced, form a pack to develop digital twins; Rockwell Automation provides a software called Emulated 3D for this purpose. These tools have the disadvantages of not being very flexible in their tasks and of being completely dependent on the manufacturers as they are proprietary solutions. There are also cloud alternatives as offered by Amazon with AWS IoT TwinMaker or Microsoft with Azure Digital Twins. Alternatively, there are free open-source tools such as Easy Java/JavaScript Simulations (EJS), Unreal Engine or Unity. This tools have the advantage of not depending on any manufacturer by having a very strong support community behind them. In addition, the access to the source code allows a great flexibility in the development. EJS stands as a versatile development and modeling tool, facilitating the construction of Java and JavaScript applications through straightforward programming. There are widespread applications in the developing of simulations and remote laboratories [26,27]. This is due to the possibility of establishing communication with physical systems over the network, its capacity to model using physical equations, and its user-friendly implementation of applications accessible through web browsers and mobile devices. On the other hand, tools like Unreal Engine or Unity provide an extra benefit compared to the previously mentioned ones, as they are equipped with a physics engine that enhances the 3D modeling of industrial systems. Furthermore, these tools are cross-platform, easing the adaptation of applications to augmented reality and virtual reality environments [28]. Unity and Unreal Engine are open-source graphic engines primarily associated with video game development. However, they are progressively being used together with frameworks for engineering, marketing, and architectural applications [29].
Unity serves as a real-time 2D and 3D application development platform, offering a multitude of benefits. Featuring object-oriented programming in the C# language, it proves to be a versatile tool applicable to various sectors: video games, engineering, construction and architecture. In particular, it is multi-platform compatible, enabling the export of applications developed for virtual reality (VR) and augmented reality (AR) to platforms such as Windows, Linux, Android, iOS, or even web pages. Furthermore, since it is programmed in C#, it provides support for a wide range of communication protocols as Modbus TCP, OPC UA, HTTPS, MQTT, and others. Unity easily integrates with other widely used tools like Blender and Maya, and it seamlessly interacts with other digital twin development platforms such as Azure Digital Twins by Azure and SIMIT by Siemens. Finally, it benefits from an active community and comprehensive documentation, offering substantial resources for 3D application development.

3. Methodology to Develop Digital Twins

Implementing digital twins requires a methodical approach to ensure an efficient development. As previously discussed throughout the document, the main aim of this work is to propose a method to develop digital twins that provides a realistic industrial environment where the multiple enabling technologies of Industry 4.0 are integrated to interact with real equipment and to work collectively. Below, we outline a set of guidelines describing the key steps involved in creating digital twins and linking them to enabling technologies. This proposed method is graphically represented in Figure 1.

3.1. Implementation and Functionality Definition

Initially, it is fundamental to define the intended functionality of the model, whose considerations will form the basis for development. This involves defining the level of detail desired. To achieve this, a decision must be made regarding how to establish communication between the application and the real system. If there is no bidirectional data communication where the changes between the system and the application are not reflected, it will be considered as a digital model. If changes are reflected in both directions, it will be classified as a digital twin. However, if changes are only reflected from the physical system to the application, it will be a digital shadow [5,30]. In addition, it is also necessary to define the fidelity of the data to be used, implying the usage of only some relevant variables from the system (Partial DT), all the relevant variables (Clone DT) or all the possible variables and also historical data (Augmented DT). Furthermore, it is necessary to decide the purpose for which the digital twin application is to be used with respect to the hierarchy of the system: if it is employed to make decisions regarding the design of the future process, it is called Prototype DT; if, in contrast, it is used as a digital model of a specific system element, it is named Instance DT; if it is a set of system elements, it is defined as Aggregate DT, and if it is a set of Aggregate DTs, it forms what is known as Augmented DT [7,17]. Finally, other considerations, such as the implementation of augmented reality functionalities, should be taken into account in this step.

3.2. Virtual Space

This step involves acquiring a three-dimensional model of the real system, according to the predefined specifications. Various methods can be used: CAD/CAE design tools, such as CATIA, SolidWorks etc., software-based scanners that leverage the device’s cameras and sensors (e.g., LIDAR sensors in iOS), or professional scanners [8]. Next, this 3D model has to be imported into a real-time 3D development platform, like Unity software. If augmented reality wants to be integrated, Unity offers various methods. The recommended one for this purpose is using a SDK (Software Development Kit known as Vuforia. Developed by PTC, Vuforia seamlessly integrates with Unity [31], using computer vision to identify elements referred to as targets. Once these targets are detected, Vuforia triggers an event that Unity captures, simplifying the development of the AR application. Consequently, targets are defined as the elements that the application must recognize to enable interaction with the real system. Targets can take the form of QR codes linked to specific elements or components of the system, or they may be 3D models representing parts of the system for recognition. Furthermore, a decision must be made regarding the storage of these targets: they can either be stored locally within the application itself or hosted remotely, such as in a cloud-based repository.

3.3. Communication System

This step involves establishing a communication system that enables bidirectional interaction between the digital model and the physical system. Communication links, with a wide range of devices and applications, have to be defined [32]. For this, Message Queuing Telemetry Transport (MQTT) [33] communication protocol must be highlighted. It is a publisher/subscriber approach where a central element, known as the ‘broker’, is in charge of directing all data generated under a specific ‘topic’ (essentially, a variable tag) to subscribed clients. This approach eliminates the need for listening confirmation and simplifies the integration of new devices. MQTT shares this messaging pattern with other protocols such as Java Messaging Service (JMS), Extensible Messaging and Presence Protocol (XMPP) or Advanced Message Queuing Protocol (AMQP) [34]. Another option is to use protocols like Modbus TCP, Profinet, etc. or the OPC UA standard, which is designed for industrial communications. OPC UA uses the same publisher/subscriber mechanism and incorporates multiple security measures [35]. To manage all these communications of different nature, a variety of interconnection tools have emerged, which are mainly rooted in visual programming environments. In these tools, the organization of data connections is represented through flows, each one composed of several nodes that serve specific functions, similar to the functions found in text-based programming languages [36]. Among the available tools, it is noteworthy to mention Node-RED, which has gained popularity due to its strong and engaged community support, its extensive utilization across diverse application domains, and its growing adoption for the development of digital twins [37]. There are additional tools available for similar purposes: Crosser [38], known for its integration with Python and its machine learning capabilities; ioBroker [39], primarily geared toward home automation; and OPC Router [40], with a focus on standardizing information exchange within the industrial domain.

3.4. Data Storage and Processing

It is necessary to select a data storage system that facilitates the collection and utilization of large amounts of data by the digital twin. Ensuring fast and efficient access to these data can be a complex task, as approaches focused on local storage and processing are suitable only for smaller systems. The Internet of Things (IoT), accompanied by the proliferation of devices generating and consuming different data types, also implies the need for data processing methods capable of addressing the decentralized nature of the information. In this regard, several options have emerged for the development of cloud-based services, including IBM Cloud, Microsoft Azure, Amazon Web Services, and Google Cloud [41]. Alternatively, it is possible to select on-premise non-relational databases like MongoDB, CouchDB, Cassandra, and Neo4J [42,43]. Furthermore, for complex systems, implementing data processing and data preprocessing using cloud computing techniques lightens the computational load of the digital twin.

3.5. Interactive Functionalities

After establishing the communication and data management system, the next phase is to use these data to develop the digital model with the functionalities defined in the first phase. Animating various components of the system, energizing mobile parts, or creating visual representations by using different colors to mirror real-time behavior might take place in this phase. Furthermore, it is valuable to visualize these data in a similar way to a monitoring system. This can involve employing various graphs or diagrams or generating CSV documents that facilitate an in-depth analysis of the acquired information. In addition, interactive functionalities associated with data-based models can be incorporated for preventive maintenance, anomaly detection, the simulation of different operating states, etc.
Based on the proposed method, a schema for developing a digital twin with direct bidirectional communication with the industrial system is shown in Figure 2. This proposal has been used to develop a digital twin for a robotic electro-pneumatic cell, as explained in the next section. To define the virtual space, it is necessary to obtain a 3D model of the system using some of the options presented previously. A VR application (computer application), at the top of the figure, and an AR application (mobile device application), at the bottom, are developed with Unity. Interactive functionalities such as animations, texture rendering, data visualization, etc., have to be defined for each of the applications. The AR application is based on the Vuforia SDK that collects the necessary information through the mobile device’s camera and uses computer vision techniques to identify targets. Once these are identified, an event is triggered in the application to perform the interactive functionalities. The Node-RED system integration tool is running on an IoT gateway. It uses services provided by the cloud for deploying cloud computing applications and decentralized storage. Node-RED can also use edge computing methods to preprocess system data. Finally, industrial communications such as Modbus TCP and/or OPC UA are used to receive data from the industrial system and the MQTT protocol to send data to the cloud.

4. Results

The proposed method has been employed to create a digital twin for a robotic electro-pneumatic cell. The cell performs the classification of pieces, emulating a production process (see Figure 3). The first subsystem of the cell is a conveyor belt equipped with pneumatic cylinders. This belt uses photoelectric sensors to detect the presence of pieces and a video camera for identifying them through an alphabetical code. There are six cylinders, three on the left of the belt (L1, L2, L3) and three on the right (R1, R2, R3). Three different sequences for the pneumatic cylinders can be selected for each processed piece to simulate different production processes. Sequence 0 is (R1-L1-L2-R3), sequence 1 is (R2-L1-L2-R3), and sequence 2 is (L1-L2-R3).
The second subsystem is the pneumatic manipulator, which is situated at the end of the conveyor. Its function is to collect the pieces and redirect them to the three storage lanes. The pieces are classified in these lanes based on the codes printed on them, which is a task performed by the video camera in the first subsystem. The last subsystem is an industrial robot that loads the pieces at the conveyor belt when each cycle starts and retrieves the pieces stored in the lanes when the cycle finishes. All the aforementioned subsystems are controlled using up-to-date controllers that support distributed architectures and programming paradigms. This enables not only high processing capabilities but also event-driven control strategies, which are more convenient within the current industrial reality. The distributed architecture includes two frequency inverters whose aim is to control motors associated with the conveyor belt and the manipulator. Communication with these inverters is achieved using Modbus TCP protocol. On the other hand, the industrial robot operates independently, equipped with its own control system and strategy, but in order to facilitate information exchange, multiple signals are wired from an I/O module to the external signal card of the robot. Leveraging these signals, a controller shares information and triggers various robot movements based on the cell’s state. Even though these up-to-date controllers also offer superior memory protection functionalities and options to prevent program or subsection modifications, the system is provided with an industrial firewall in order to ensure a series of filtering rules to apply to the traffic, restricting communication with the control devices. The operation of the electro-pneumatic cell and a web version of the developed application can be explored on the research group’s website (SUPPRESS website (accessed on 2 January 2024): https://lra.unileon.es/physical-systems/robotic-electropneumatic-cell/simulations/).
The VR application of the robotic electro-pneumatic cell is shown in Figure 4. The real-time 3D development platform used for its creation is Unity. Although originally linked to video game development, Unity is increasingly finding applications in engineering, marketing, and architecture. This trend is attributed to its robust physics engine and its seamless adaptability to augmented reality. The 3D model of the system was created using the well-known 3D CAD design software SolidWorks. The VR application receives real-time operation data from the robotic electro-pneumatic cell through Modbus TCP protocol and utilizes this information to animate various parts of the 3D model, including the manipulator, conveyor belt, and other components. The VR application features a manual operation mode allowing adjustments to system parameters, including the speed of internal elements, piece selection for sorting, unrestricted free movement within the workspace, etc. In automatic operation mode, pieces are classified based on the codes printed on them. In addition, the application provides an option to generate a CSV file for storing the generated information.
The IoT gateway used is a Harmony IIOT EDGE Box from the manufacturer Schneider Electric. The Node-RED system integration tool is running on it. This tool reads system data via the Modbus TCP protocol and sends it to the IBM Cloud, which is the chosen data storage and processing system, using the MQTT standard. The VR application also communicates with the IoT Gateway using the Modbus TCP protocol to obtain data coming from the cloud. These devices and technologies guarantee connectivity by employing established IoT communication protocols and industry-specific protocols typically utilized for controlling or configuring systems.
The developed digital twin has augmented reality capabilities through a mobile application (see Figure 5). Vuforia in combination with Unity has been used to develop this AR application. It captures images using the device’s camera and overlays process-related information onto these images. This information is updated in real time and is sourced from the app’s communication with the IoT Gateway using Modbus TCP. The captured images (targets) have been developed using QR codes placed on the devices. These targets have been previously uploaded to the application for real-time recognition. At the bottom of the figure, an example of use with one of the variable speed drives (used for the conveyor belt and the pneumatic manipulator) can be seen, showing a box with the main operating parameters and a button to display more detailed information on the current status. At the top of the figure, another functionality can be seen, representing the general status of the system in a smartphone.
Finally, in Figure 6, a digital twin dashboard running in the IBM Cloud is shown. This dashboard provides information about communications with the cloud and the current cylinder sequence. At the bottom, the cylinder activation sequence over time is represented, showing the sequence as 0-1-2-0-1. In the top-left corner, data traffic in megabytes per day is displayed, while on the right side, the number of devices connected to the IoT Platform is shown. The IoT platform is an IBM Cloud service used to enable communication between the IoT Gateway and other cloud services. In the figure, it can be seen that ten different devices are connected at that moment. Every device represents a logical abstraction related to data with common characteristics. It can be a physical device (such as electrical variables read from an engine) or a set of data with the same nature (like signals associated with different security beacons). Eight physical devices have been created to rationalize and organize engineering data generated during the process, while another two devices have been defined separately with the aim of organizing data associated with safety considerations and cloud computing calculations. Each device has a specific token associated with it to secure communication with the IoT Platform. In this way, different nodes with the same token can be deployed to communicate various data units to the IoT Platform under the same device identification. These cloud-based services offer distinct advantages over local tools, presenting cost-effectiveness, flexibility, ongoing support, and enhanced security. Moreover, these services empower the implementation of data analysis techniques, facilitating real-time and decentralized decision making.
In summary, Table 1 provides a comparison between our digital twin solution and those proposed by the works discussed in Section 2. These works only present a partial implementation of the aforementioned enabling technologies. In contrast, our work aims to highlight the importance of the combined implementation of Industry 4.0-enabling technologies for the development of digital twins.

5. Conclusions

This paper presents a method for developing digital twins in industrial environments. Creating virtual spaces that include innovative features such as augmented reality provides a more interactive and immersive approach to monitoring and improving industrial process efficiency. The complexity of deploying a digital twin partly arises from the need to combine different technologies to facilitate the connection between devices of diverse nature. Additionally, it involves addressing the storage and processing of large volumes of data. Another challenge in the development of digital twins is their demands for fidelity and fast response times, which further complicates the difficult task of technological integration.
The first phase for creating digital twins involves a definition of the expected functionality of the model. This includes specifying the desired level of detail, the data communication integration or the fidelity of the system. The next step is to define the virtual space, which consists of acquiring the 3D model of the process using CAD/CAE software or a professional scanner. Then, this model must be imported into a real-time 3D development platform.Unity is the cross-platform choice for this approach because it is equipped with a physics engine that streamlines the 3D modeling of industrial systems. An essential consideration is the integration of augmented reality capabilities. Adapting Unity applications to augmented reality is easy with the Vuforia SDK. It uses computer vision to identify targets and trigger events captured by Unity, simplifying AR application development.
Next, it is necessary to define the communication system that facilitates two-way interaction between the digital model and the physical system. In this case, industrial communications such as Modbus TCP or OPC UA must be highlighted. These protocols allow easy communication between the VR/AR application and the industrial system. Another required communication for this implementation is the connection to the cloud. To this end, the MQTT communication protocol is of particular interest. This protocol eliminates the need to listen to confirmation and speeds up the integration of new devices. In addition, interconnection tools should be used, particularly those based on visual programming environments. Among these tools, Node-RED stands out for its widespread adoption, community support, and increasing utilization in various application domains. Finally, it is essential to choose a data storage system that can effectively handle the extensive data generated from a digital twin. The best option for ensuring rapid and efficient data access are cloud-based services, where also powerful data processing methods can be used.
The proposed methodology for developing digital twins offers several advantages. Firstly, it provides a more comprehensive understanding of the modeled process. Real-time interaction and the dynamic visualization of physical systems in virtual space enable engineers and operators to comprehend the complexity of processes and make informed decisions. This information leads to improved process control, faster problem resolution, and optimized overall efficiency. The proposed method also serves as a reference for similar approaches in the development of digital twins applied to other industrial processes. By creating a standardized framework, it becomes a useful resource for industry professionals looking to implement digital twin solutions in a variety of situations. It is important to note some limitations related to the current methodology, such as the impossibility of working with certain real-time constrains, because using cloud-based tools implies latency and dead times, which can be unacceptable in some specific environments. Another limitation could be the current impossibility of using the developed digital twin for advanced cybersecurity analysis, although improvements in this field have been conceptualised for future works.
Regarding future work, it is recommended to conduct further testing on other plants or industrial systems to verify the effectiveness and adaptability of the digital twin methodology in different environments. Additionally, it is important to ensure that the digital twin methodology can be extended to larger plants or processes, thus evaluating the performance and feasibility of the developed models when applied to industrial systems of high complexity and scale. The successful expansion paves the way for widespread adoption, making digital twins a versatile solution for a variety of industrial environments. On the other hand, some improvements in the field of cybersecurity should also be addressed, such as replacing the industrial firewall with a more advanced device such as an Intrusion Prevention System (IPS), which allows a thorough analysis of the network traffic in the plant. The implementation of such devices would enable the collection of information on the analyzed traffic to be incorporated into the digital twin. With these data, the digital twin could be enhanced with the ability to detect anomalous or even malicious traffic compared to normal traffic. Future research should address these issues to contribute to the maturity and widespread application of digital twin technology in industrial settings.

Author Contributions

Conceptualization, M.D. and J.J.F.; Methodology, R.G.-H., S.A. and J.J.F.; Software, R.G.-H., G.G.-M. and J.R.R.-O.; Validation, G.G.-M., J.R.R.-O., S.A. and J.J.F.; Formal analysis, M.D. and S.A.; Investigation, R.G.-H., G.G.-M. and J.R.R.-O.; Resources, R.G.-H., G.G.-M. and J.R.R.-O.; Writing – original draft, R.G.-H., G.G.-M., J.R.R.-O., M.D., S.A. and J.J.F.; Supervision, S.A.; Project administration, M.D. and J.J.F.; Funding acqui-sition, M.D. All authors have read and agreed to the published version of the manuscript.

Funding

Grant PID2020-117890RB-I00 funded by MCIN/AEI/10.13039/501100011033. The work of José Ramón Rodríguez-Ossorio and Guzmán González-Mateos has been supported by grants from the Research Program of the University of León.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors on request.

Conflicts of Interest

The authors declare no conflicts of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Bigliardi, B.; Bottani, E.; Casella, G. Enabling technologies, application areas and impact of industry 4.0: A bibliographic analysis. Procedia Manuf. 2020, 42, 322–326. [Google Scholar] [CrossRef]
  2. Xu, L.D.; Xu, E.L.; Li, L. Industry 4.0: State of the art and future trends. Int. J. Prod. Res. 2018, 56, 2941–2962. [Google Scholar] [CrossRef]
  3. Ustundag, A.; Cevikcan, E. Industry 4.0: Managing the Digital Transformation; Springer Series in Advanced Manufacturing: Berlin/Heidelberg, Germany, 2017. [Google Scholar]
  4. de la Peña, D.M.; Domínguez, M.; Gomez-Estern, F.; Reinoso, Ó.; Torres, F.; Dormido, S. Estado del arte de la educación en automática. Rev. Iberoam. AutomáTica InformáTica Ind. 2022, 19, 117–131. [Google Scholar] [CrossRef]
  5. Boyes, H.; Watson, T. Digital twins: An analysis framework and open issues. Comput. Ind. 2022, 143, 103763. [Google Scholar] [CrossRef]
  6. Guerra-Zubiaga, D.; Kuts, V.; Mahmood, K.; Bondar, A.; Nasajpour-Esfahani, N.; Otto, T. An approach to develop a digital twin for industry 4.0 systems: Manufacturing automation case studies. Int. J. Comput. Integr. Manuf. 2021, 34, 933–949. [Google Scholar] [CrossRef]
  7. Singh, M.; Fuenmayor, E.; Hinchy, E.P.; Qiao, Y.; Murray, N.; Devine, D. Digital twin: Origin to future. Appl. Syst. Innov. 2021, 4, 36. [Google Scholar] [CrossRef]
  8. Qi, Q.; Tao, F.; Hu, T.; Anwer, N.; Liu, A.; Wei, Y.; Wang, L.; Nee, A. Enabling technologies and tools for digital twin. J. Manuf. Syst. 2021, 58, 3–21. [Google Scholar] [CrossRef]
  9. Jones, D.; Snider, C.; Nassehi, A.; Yon, J.; Hicks, B. Characterising the Digital Twin: A systematic literature review. CIRP J. Manuf. Sci. Technol. 2020, 29, 36–52. [Google Scholar] [CrossRef]
  10. Errandonea, I.; Beltrán, S.; Arrizabalaga, S. Digital Twin for maintenance: A literature review. Comput. Ind. 2020, 123, 103316. [Google Scholar] [CrossRef]
  11. Grieves, M. Back to the future: Product lifecycle management and the virtualization of product information. In Product Realization: A Comprehensive Approach; Springer: Berlin/Heidelberg, Germany, 2009; pp. 1–13. [Google Scholar]
  12. Grieves, M.W. Product lifecycle management: The new paradigm for enterprises. Int. J. Prod. Dev. 2005, 2, 71–84. [Google Scholar] [CrossRef]
  13. Glaessgen, E.; Stargel, D. The digital twin paradigm for future NASA and US Air Force vehicles. In Proceedings of the 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference 20th AIAA/ASME/AHS Adaptive Structures Conference 14th AIAA, Honolulu, HI, USA, 23–26 April 2012; p. 1818. [Google Scholar]
  14. Nasirahmadi, A.; Hensel, O. Toward the next generation of digitalization in agriculture based on digital twin paradigm. Sensors 2022, 22, 498. [Google Scholar] [CrossRef] [PubMed]
  15. Bado, M.F.; Tonelli, D.; Poli, F.; Zonta, D.; Casas, J.R. Digital twin for civil engineering systems: An exploratory review for distributed sensing updating. Sensors 2022, 22, 3168. [Google Scholar] [CrossRef] [PubMed]
  16. Grieves, M. Digital twin: Manufacturing excellence through virtual factory replication. White Pap. 2014, 1, 1–7. [Google Scholar]
  17. Grieves, M.; Vickers, J. Digital twin: Mitigating unpredictable, undesirable emergent behavior in complex systems. In Transdisciplinary Perspectives on Complex Systems: New Findings and Approaches; Springer: Berlin/Heidelberg, Germany, 2017; pp. 85–113. [Google Scholar]
  18. Zhu, Z.; Liu, C.; Xu, X. Visualisation of the digital twin data in manufacturing by using augmented reality. Procedia Cirp 2019, 81, 898–903. [Google Scholar] [CrossRef]
  19. Schroeder, G.; Steinmetz, C.; Pereira, C.E.; Muller, I.; Garcia, N.; Espindola, D.; Rodrigues, R. Visualising the digital twin using web services and augmented reality. In Proceedings of the 2016 IEEE 14th International Conference on Industrial Informatics (INDIN), Poitiers, France, 19–21 July 2016; pp. 522–527. [Google Scholar]
  20. Botín-Sanabria, D.M.; Mihaita, A.S.; Peimbert-García, R.E.; Ramírez-Moreno, M.A.; Ramírez-Mendoza, R.A.; Lozoya-Santos, J.d.J. Digital Twin Technology Challenges and Applications: A Comprehensive Review. Remote Sens. 2022, 14, 1335. [Google Scholar] [CrossRef]
  21. Lu, Q.; Xie, X.; Parlikad, A.K.; Schooling, J.M. Digital twin-enabled anomaly detection for built asset monitoring in operation and maintenance. Autom. Constr. 2020, 118, 103277. [Google Scholar] [CrossRef]
  22. Luo, W.; Hu, T.; Ye, Y.; Zhang, C.; Wei, Y. A hybrid predictive maintenance approach for CNC machine tool driven by Digital Twin. Robot. Comput. Integr. Manuf. 2020, 65, 101974. [Google Scholar] [CrossRef]
  23. Aivaliotis, P.; Georgoulias, K.; Chryssolouris, G. The use of Digital Twin for predictive maintenance in manufacturing. Int. J. Comput. Integr. Manuf. 2019, 32, 1067–1080. [Google Scholar] [CrossRef]
  24. Haghshenas, A.; Hasan, A.; Osen, O.; Mikalsen, E.T. Predictive digital twin for offshore wind farms. Energy Inform. 2023, 6, 1. [Google Scholar] [CrossRef]
  25. Wang, Z.; Han, K.; Tiwari, P. Digital twin simulation of connected and automated vehicles with the unity game engine. In Proceedings of the 2021 IEEE 1st International Conference on Digital Twins and Parallel Intelligence (DTPI), Beijing, China, 15 July–15 August 2021; pp. 1–4. [Google Scholar]
  26. Dormido, R.; Vargas, H.; Duro, N.; SÁnchez, J.; Dormido-Canto, S.; Farias, G.; Esquembre, F.; Dormido, S. Development of a Web-Based Control Laboratory for Automation Technicians: The Three-Tank System. IEEE Trans. Educ. 2008, 51, 35–44. [Google Scholar] [CrossRef]
  27. Chacon, J.; Goncalves, D.; Besada, E.; López-Orozco, J.A. Un laboratorio remoto de código abierto y bajo coste para el brazo robótico educativo Dobot Magician. Rev. Iberoam. Automática Informática Ind. 2023, 20, 124–136. [Google Scholar] [CrossRef]
  28. Lee, A.; Chang, Y.S.; Jang, I. Planetary-scale geospatial open platform based on the Unity3D environment. Sensors 2020, 20, 5967. [Google Scholar] [CrossRef]
  29. Schluse, M.; Rossmann, J. From simulation to experimentable digital twins: Simulation-based development and operation of complex technical systems. In Proceedings of the 2016 IEEE International Symposium on Systems Engineering (ISSE), Edinburgh, UK, 3–5 October 2016; pp. 1–6. [Google Scholar] [CrossRef]
  30. Kritzinger, W.; Karner, M.; Traar, G.; Henjes, J.; Sihn, W. Digital Twin in manufacturing: A categorical literature review and classification. IFAC-PapersOnline 2018, 51, 1016–1022. [Google Scholar] [CrossRef]
  31. Sarosa, M.; Chalim, A.; Suhari, S.; Sari, Z.; Hakim, H. Developing augmented reality based application for character education using unity with Vuforia SDK. Proc. J. Phys. Conf. Ser. 2019, 1375, 012035. [Google Scholar] [CrossRef]
  32. Fuertes, J.J.; González-Herbón, R.; Rodríguez-Ossorio, J.R.; González-Mateos, G.; Alonso, S.; Morán, A. Guidelines to develop demonstration models on industry 4.0 for engineering training. Int. J. Comput. Integr. Manuf. 2023, 36, 1465–1481. [Google Scholar] [CrossRef]
  33. Banks, A.; Gupta, R. MQTT Version 3.1.1 OASIS Standard. 2014, Volume 29, p. 89. Available online: https://webstore.iec.ch/preview/info_isoiec20922%7Bed1.0%7Den.pdf (accessed on 30 January 2024).
  34. Iglesias-Urkia, M.; Orive, A.; Barcelo, M.; Moran, A.; Bilbao, J.; Urbieta, A. Towards a lightweight protocol for Industry 4.0: An implementation based benchmark. In Proceedings of the 2017 IEEE International Workshop of Electronics, Control, Measurement, Signals and Their Application to Mechatronics (ECMSM), Donostia, Spain, 24—26 May 2017; pp. 1–6. [Google Scholar] [CrossRef]
  35. Profanter, S.; Tekat, A.; Dorofeev, K.; Rickert, M.; Knoll, A. OPC UA versus ROS, DDS, and MQTT: Performance Evaluation of Industry 4.0 Protocols. In Proceedings of the 2019 IEEE International Conference on Industrial Technology (ICIT), Melbourne, Australia, 13–15 February 2019; pp. 955–962. [Google Scholar] [CrossRef]
  36. Ray, P.P. A Survey on Visual Programming Languages in Internet of Things. Sci. Program. 2017, 2017, 1231430. [Google Scholar] [CrossRef]
  37. Steinmetz, C.; Schroeder, G.N.; Binotto, A.; Panikkar, S.; Papenfuß, B.; Schmidt, C.; Rettberg, A.; Pereira, C.E. Digital Twins modeling and simulation with Node-RED and Carla. IFAC-PapersOnLine 2022, 55, 97–102. [Google Scholar] [CrossRef]
  38. Balducci, F.; Buono, P.; Desolda, G.; Impedovo, D.; Piccinno, A. Improving smart interactive experiences in cultural heritage through pattern recognition techniques. Pattern Recognit. Lett. 2020, 131, 142–149. [Google Scholar] [CrossRef]
  39. Triantafyllou, A.; Sarigiannidis, P.; Lagkas, T.D. Network Protocols, Schemes, and Mechanisms for Internet of Things (IoT): Features, Open Challenges, and Trends. Wirel. Commun. Mob. Comput. 2018, 2018, 5349894. [Google Scholar] [CrossRef]
  40. Lipp, J.; Rath, M.; Rudack, M.; Vroomen, U.; Bührig-Polaczek, A. Flexible OPC UA Data Load Optimizations on the Edge of Production. In Proceedings of the Enterprise Information Systems; Filipe, J., Śmiałek, M., Brodsky, A., Hammoudi, S., Eds.; Springer: Cham, Switzerland, 2021; pp. 43–61. [Google Scholar]
  41. Derhamy, H.; Eliasson, J.; Delsing, J.; Priller, P. A survey of commercial frameworks for the internet of things. In Proceedings of the 20th IEEE Conference on Emerging Technologies & Factory Automation (ETFA), Luxembourg, 8–11 September 2015; pp. 1–8. [Google Scholar]
  42. Chickerur, S.; Goudar, A.; Kinnerkar, A. Comparison of Relational Database with Document-Oriented Database (MongoDB) for Big Data Applications. In Proceedings of the 2015 8th International Conference on Advanced Software Engineering & Its Applications (ASEA), Jeju, Republic of Korea, 25–28 November 2015; pp. 41–47. [Google Scholar] [CrossRef]
  43. Fraczek, K.; Plechawska-Wojcik, M. Comparative Analysis of Relational and Non-relational Databases in the Context of Performance in Web Applications. In Beyond Databases, Architectures and Structures. Towards Efficient Solutions for Data Analysis and Knowledge Representation; Springer International Publishing: Berlin/Heidelberg, Germany, 2017; pp. 153–164. [Google Scholar] [CrossRef]
Figure 1. Methodology to develop digital twins.
Figure 1. Methodology to develop digital twins.
Sensors 24 00998 g001
Figure 2. Unity applications scheme.
Figure 2. Unity applications scheme.
Sensors 24 00998 g002
Figure 3. Robotic electro-pneumatic cell.
Figure 3. Robotic electro-pneumatic cell.
Sensors 24 00998 g003
Figure 4. Virtual reality application with Unity.
Figure 4. Virtual reality application with Unity.
Sensors 24 00998 g004
Figure 5. Augmented reality application.
Figure 5. Augmented reality application.
Sensors 24 00998 g005
Figure 6. Digital twin dashboard in the cloud.
Figure 6. Digital twin dashboard in the cloud.
Sensors 24 00998 g006
Table 1. Comparison of different digital twin solutions.
Table 1. Comparison of different digital twin solutions.
Referenced WorkEnabling Technologies
VRSoftware BIM
[21]AutomationCentrifugal pumps
ConnectivityIndustry Foundation Classes (IFCs)
VRCAD/CAE software
[22]AutomationCNC machine tool
ConnectivityMapping interface (OPC UA, Sockets, …)
AutomationSix-axis robotic structure
[23]ConnectivityMQTT
System integrationSignal processing gateway
VRUnity
AutomationSensors for monitoring
[24]ConnectivityOPC UA
System integrationNode-RED
ARVuforia Engine with Unity
VRUnity
AutomationConnected and automated vehicles (CAVs)
[25]ConnectivityMQTT and sockets
System integrationUnity Scripting API
CloudComputing with AWS
VRUnity
AutomationRobot and distributed architecture
ConnectivityModbus TCP, OPC UA and MQTT
Current workSystem integrationIoT Gateway with Node-RED
ARVuforia Engine with Unity
CloudStorage and computing with IBM Cloud
CybersecurityIndustrial firewall
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

González-Herbón, R.; González-Mateos, G.; Rodríguez-Ossorio, J.R.; Domínguez, M.; Alonso, S.; Fuertes, J.J. An Approach to Develop Digital Twins in Industry. Sensors 2024, 24, 998. https://doi.org/10.3390/s24030998

AMA Style

González-Herbón R, González-Mateos G, Rodríguez-Ossorio JR, Domínguez M, Alonso S, Fuertes JJ. An Approach to Develop Digital Twins in Industry. Sensors. 2024; 24(3):998. https://doi.org/10.3390/s24030998

Chicago/Turabian Style

González-Herbón, Raúl, Guzmán González-Mateos, José R. Rodríguez-Ossorio, Manuel Domínguez, Serafín Alonso, and Juan J. Fuertes. 2024. "An Approach to Develop Digital Twins in Industry" Sensors 24, no. 3: 998. https://doi.org/10.3390/s24030998

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop