Machine Learning for Industry 4.0: From Manufacturing and Embedded Systems to Cloud Computing and Data Centers

A special issue of Applied Sciences (ISSN 2076-3417). This special issue belongs to the section "Computing and Artificial Intelligence".

Deadline for manuscript submissions: closed (31 May 2022) | Viewed by 9699

Special Issue Editors


E-Mail Website
Guest Editor
DISI department of University of Bologna, Engineering School, Viale Risorgimento 2, 40136 Bologna BO, Italy
Interests: artificial intelligence; deep/machine learning; optimization; high performance computing systems; agent-based models; decision support systems

E-Mail
Guest Editor
DISI department of University of Bologna, Engineering School, Viale Risorgimento 2, 40136 Bologna BO, Italy
Interests: advanced compiling techniques; parallel programming models; optimization; emerging computing architectures; on-edge IoT computing

Special Issue Information

Dear Colleagues,

The quest towards Industry 4.0 and the associated requirement to create virtual replicas of physical devices (known as digital twins) has engendered the exploration of numerous research directions. Predictive and prescriptive maintenance, data center automation, fault detection, and root cause identification are among some of the most tackled challenges in this area. A wide variety of approaches have been proposed to address these issues, including full testing and deployment on real systems.

The wealth of big data originating from multiple sensors installed at various levels of granularity on industrial systems and components, as well as data centers and related computing nodes, has offered the possibility to create and train powerful data-driven machine learning (ML) and deep learning (DL) models, aimed at a variety of tasks.

There are strong motivations for the interest of researchers in this area. Firstly, the digitalization of complex manufacturing systems and computing facilities, and the automation of their management processes are of paramount importance for the sake of improving performance and reliability, reducing operating costs, and decreasing energy consumption. Secondly, the task of extracting meaningful information from the massive amount of data generated by the monitoring systems of modern industrial machines and large-scale computing facilities is overwhelming.

In this scenario, the adoption of ML/DL approaches is paramount to assist human activities and alleviate the burden of daunting tasks. Prospective fields of application for these techniques include data center automation, fault detection, and predictive maintenance. Moreover, additional concerns stem from their deployment on a wide range of target systems, ranging from the scalability issues of distributed DL models in the cloud to the limited computing resources of IoT edge devices.

The purpose of this Special Issue is to make the scientific community aware of the most recent advances in this area, and to show the current state of these technologies by analyzing different approaches and methodologies, identifying trends and challenges, and learning lessons from already deployed solutions and success stories. This review of the current state-of-the-art is not intended to make an exhaustive exploration of all of the existing works, but rather aims at providing an overview of the research targeting Machine Learning applied to Industry 4.0, bringing out the high level of activity of this area.

Prof. Dr. Andrea Borghesi
Prof. Dr. Giuseppe Tagliavini
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Applied Sciences is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2400 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • Digital twins for manufacturing
  • ML/DL applications for predictive maintenance
  • ML/DL applications for prescriptive maintenance
  • ML/DL models for anomaly detection and fault detection in data centers and HPC systems
  • On-edge inference of DL models for Industry 4.0
  • ML/DL models for root cause analysis
  • Explainable ML/DL models for Industry 4.0
  • Combining data-driven models and domain knowledge for predictive maintenance
  • Transfer learning approaches in Industry 4.0 and predictive maintenance
  • ML model implementations, deployment, and validation on real industrial and HPC systems
  • Deploying ML/DL models on IoT devices with severe power constraints
  • Static and dynamic mapping of ML/DL components at different levels of the IoT

Published Papers (3 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

Jump to: Review

24 pages, 1355 KiB  
Article
Handling Imbalanced Datasets for Robust Deep Neural Network-Based Fault Detection in Manufacturing Systems
by Jefkine Kafunah, Muhammad Intizar Ali and John G. Breslin
Appl. Sci. 2021, 11(21), 9783; https://doi.org/10.3390/app11219783 - 20 Oct 2021
Cited by 6 | Viewed by 2436
Abstract
Over the recent years, Industry 4.0 (I4.0) technologies such as the Industrial Internet of Things (IIoT), Artificial Intelligence (AI), and the presence of Industrial Big Data (IBD) have helped achieve intelligent Fault Detection (FD) in manufacturing. Notably, data-driven approaches in FD apply Deep [...] Read more.
Over the recent years, Industry 4.0 (I4.0) technologies such as the Industrial Internet of Things (IIoT), Artificial Intelligence (AI), and the presence of Industrial Big Data (IBD) have helped achieve intelligent Fault Detection (FD) in manufacturing. Notably, data-driven approaches in FD apply Deep Learning (DL) techniques to help generate insights required for monitoring complex manufacturing processes. However, due to the ratio of instances where actual faults occur, FD datasets tend to be imbalanced, leading to training challenges that result in inefficient DL-based FD models. In this paper, we propose Dual Logits Weights Perturbation (DLWP) loss, a method featuring weight vectors for improved dataset generalization in FD systems. The weight vectors act as hyperparameters adjusted on a case-by-case basis to regulate focus accorded to individual minority classes during training. In particular, our proposed method is suitable for imbalanced datasets from safety-related FD tasks as it generates DL models that minimize false negatives. Subsequently, we integrate human experts into the workflow as a strategy to help safeguard the system. A subset of the results, model predictions with uncertainties exceeding a preset threshold, are considered a preliminary output subject to cross-checking by human experts. We demonstrate that DLWP achieves improved Recall, AUC, F1 scores. Full article
Show Figures

Figure 1

Review

Jump to: Research

19 pages, 4208 KiB  
Review
A Survey of Machine Learning-Based System Performance Optimization Techniques
by Hyejeong Choi and Sejin Park
Appl. Sci. 2021, 11(7), 3235; https://doi.org/10.3390/app11073235 - 04 Apr 2021
Cited by 11 | Viewed by 4269
Abstract
Recently, the machine learning research trend expands to the system performance optimization field, where it has still been proposed by researchers based on their intuitions and heuristics. Compared to conventional major machine learning research areas such as image or speech recognition, machine learning-based [...] Read more.
Recently, the machine learning research trend expands to the system performance optimization field, where it has still been proposed by researchers based on their intuitions and heuristics. Compared to conventional major machine learning research areas such as image or speech recognition, machine learning-based system performance optimization fields are at the beginning stage. However, recent papers show that this approach is promising and has significant potential. This paper reviews 11 machine learning-based system performance optimization approaches from nine recent papers based on well-known machine learning models such as perceptron, LSTM, and RNN. This survey provides a detailed design and summarizes model, input, output, and prediction method of each approach. This paper covers various system performance areas from the data structure to essential system components of a computer system such as index structure, branch predictor, sort, and cache management. The result shows that machine learning-based system performance optimization has an important potential for future research. We expect that this paper shows a wide range of applicability of machine learning technology and provides a new perspective for system performance optimization. Full article
Show Figures

Figure 1

26 pages, 618 KiB  
Review
A Review on the Service Virtualisation and Its Structural Pillars
by Zeinab Farahmandpour, Mehdi Seyedmahmoudian and Alex Stojcevski
Appl. Sci. 2021, 11(5), 2381; https://doi.org/10.3390/app11052381 - 08 Mar 2021
Viewed by 1525
Abstract
Continuous delivery is an industry software development approach that aims to reduce the delivery time of software and increase the quality assurance within a short development cycle. The fast delivery and improved quality require continuous testing of the developed software service. Testing services [...] Read more.
Continuous delivery is an industry software development approach that aims to reduce the delivery time of software and increase the quality assurance within a short development cycle. The fast delivery and improved quality require continuous testing of the developed software service. Testing services are complicated and costly and postponed to the end of development due to unavailability of the requisite services. Therefore, an empirical approach that has been utilised to overcome these challenges is to automate software testing by virtualising the requisite services’ behaviour for the system being tested. Service virtualisation involves analysing the behaviour of software services to uncover their external behaviour in order to generate a light-weight executable model of the requisite services. There are different research areas which can be used to create such a virtual model of services from network interactions or service execution logs, including message format extraction, inferring control model, data model and multi-service dependencies. This paper reviews the state-of-the-art of how these areas have been used in automating the service virtualisation to make available the required environment for testing software. This paper provides a review of the relevant research within these four fields by carrying out a structured study on about 80 research works. These studies were then categorised according to their functional context as, extracting the message format, control model, data model and multi-service dependencies that can be employed to automate the service virtualisation activity. Based on our knowledge, this is the first structural review paper in service virtualisation fields. Full article
Show Figures

Figure 1

Back to TopTop