Abstract
Evaluating Industry 4.0 technology application in small and medium-sized enterprises (SMEs) is an issue that requires a multi-criteria strategy comprising quantitative and qualitative elements. The purpose of this study is to integrate performance estimation of Industry 4.0 technology application using the technology–organization–environment (TOE) framework. Relating TOE to Industry 4.0 technology application evaluation is more multifaceted than other methods and it requires comprehensive analysis. In this study, we applied a multiple-criteria decision-making (MCDM) approach to develop a model which integrates MCDM to perform an assessment that prioritizes the influence weights of Industry 4.0 technology application to SMEs’ factors. Firstly, we carried out a review of the literature and the TOE framework was selected to generate nine elements, along with three aspects used to measure Industry 4.0 technology application in SMEs. Secondly, the approach of the decision-making trial and evaluation laboratory (DEMATEL) was set up using an influence network relations digraph (INRD). The DEMATEL-based analytic network process (DANP) was used to indicate the influence weights linking the above aspects and elements. Lastly, the modified VlseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR) technique applied influence weights to assess the aspects/elements in the gaps identified and to investigate how to reduce the gaps so as to estimate the application of Industry 4.0 technology by SMEs. The results show that the technology aspect is the most influential factor.
1. Introduction
Owing to the advancement of science and technology, numerous fields are gradually moving toward automation and intellectualization. The technology of Industry 4.0 represents the convergence of a range of emerging and novel technologies, such as cloud computing, smart sensors, big data, additive manufacturing (AM), robotics, artificial intelligence (AI), machine learning (ML), Internet of Things (IoT), and augmented reality [1,2,3,4,5,6,7]. These progressive technologies’ participation in Industry 4.0 is reorganizing entire operational structures via centralized workflows and transforming analog to decentralized and digital manufacturing procedures [8,9,10,11,12]. The technologies have a high potential to importantly enhance the manufacturing productivity by converting regular manufacturing to automated production. Industry 4.0 has been beneficial to the production sector in three different ways: End-to-end engineering; vertical integration; and horizontal integration [13,14,15,16]. It combines data, machines, and people, thereby establishing more responsive and agile supply chains.
Industry 4.0 is incorporated into smart manufacturing and advanced manufacturing—for example, as an implementable structure where agile lines automatically adjust manufacturing procedures for multiple varying factors and products [17,18]. Industry 4.0 technologies enhance the flexibility, productivity, and quality and are able to assist with the execution of a broad scope of customized production and sustainable procedures with less resource consumption [18,19].
Existing studies have recorded different definitions of the Industry 4.0 technology model. Some of these studies have examined the sub-domains and contributions of Industry 4.0 technology, including the growth, organization, environment, and technology tendencies of the sub-domains of Industry 4.0 technology [20,21,22,23]. Nevertheless, some of these studies have only presented the Industry 4.0 technology application model, and did not evaluate the application of Industry 4.0 technology to strategic models through a systematic and process viewpoint. They also did not determine the influence relations and application models or main strategy of Industry 4.0 technology. Therefore, in this research, we propose a structured perspective for the evaluation of Industry 4.0 technology’s application in small and medium-sized enterprises (SMEs).
While IT application in SMEs relates to the combination of the technology–organization–environment (TOE) structure and moves to IT innovation enhancement, managers must improve its application to enhance procedures, practices, designs, and services when they adopt Industry 4.0 technology [19,24]. Owing to the lack of previous studies about the parameters for assessing Industry 4.0 technology application, this study investigates the Industry 4.0 technology application in SMEs to establish the potential for performance progress. The purpose of this research is to propose a fit approach for estimating Industry 4.0 technology’s potential to improve the performance in SMEs. Therefore, the paper has two contributions: It develops a theoretical basis linking Industry 4.0 technology application to the business performance in SMEs, and it estimates the influence of Industry 4.0 technology application on diverse aspects of the business performance. In light of hyper-competitive, commerce performance enhancement, SMEs need to formulate and apply schemes that protect their competitive advantage and improve their performances. As the most important sectors in Taiwan, it is especially necessary to notice the improvement of SMEs.
This study examines the effect of aspects of technology (technology readiness, technology security, and technology integration), organization (financial commitment, organization readiness, and top management support), and environmental criteria (regulatory support, competitive pressure, and environmental uncertainty) on Industry 4.0 technology application. The study’s model and assumed relations are tested via data collected from top managers and related studies of SMEs in Taiwan. This study’s findings contribute to empirical studies on the elements that impact Industry 4.0 technology application decisions. Importantly, this study applies group opinions of experts’ practical experience, rather than a few isolated cases. Given the significance of Industry 4.0 technology application in the present and future, this study’s findings will help administrators in targeting suitable decision-making models to effectively support Industry 4.0 technology application.
Industry 4.0 technology application strategies are independent and dependent, changing according to specialists’ opinions and experience. Some general multiple criteria decision-making (MCDM) prototypes cannot categorize complicated networks in relation to different hierarchical structures of factors in contexts such as SMEs [25]. Furthermore, MCDM models usually employ the average judgement of specialists regarding decision-making procedures [25,26,27,28]. Lately, numerous methods have been presented to deal with the performance of Industry 4.0 technology application, such as the analytical network process (ANP) and the analytic hierarchy process (AHP) [29,30]. Nevertheless, these evaluation methods have numerous limitations. First, based on their approaches of only a single element, they are unable to integrate numerous performance elements. Additionally, they are lacking in terms of perceiving the influence weights of sub-elements and main elements and, thus, impartiality when estimating the performance. Therefore, this paper offers an integrated MCDM model which addresses the various problems within aspects of Industry 4.0 technology application and meets administrators’ goals.
Most conservative multi-attribute decision analysis approaches cannot deal with the investigation of multifaceted interrelations between dissimilar hierarchical factors [27,28]. Adoption of the application of Industry 4.0 technology involves a decision approach structure that does just that. We can realize this research objective by applying the following methods: We can first build a mixed MCDM approach which integrates the decision-making trial and evaluation laboratory (DEMATEL) to establish an influence network relations digraph (INRD), known as the DEMATEL-based ANP (DANP), to indicate the influence weights of elements and the weights of the modified VlseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR) technique by applying the DANP’s influence weights to estimate and combine the gaps in performance. After that, we can study how to reduce these gaps through enhancement to enable the application of Industry 4.0 technology according to the INRD. These mixed techniques overcome the limits of existing evaluation approaches and can be applied to help us investigate the factors that impact the application of Industry 4.0 technology in real life. In this research, we used SMEs in Taiwan as a case study with which to consider the interdependence among factors that impact Industry 4.0 technology application, as well as assess alternative financial and business performances to reduce these gaps in performance among individual aspects in the bid to apply Industry 4.0 technology using an INRD in SMEs.
The study is organized as follows. We review the factors influencing technology, organization, and environmental aspects in the Industry 4.0 technology application model in Section 2. This section draws on the literature to build assessment elements. Section 3 describes the detailed methodology, including the hybrid MCDM method. Next, Section 4 introduces the case study. Lastly, Section 5 presents the study’s conclusions.
2. Literature Review
The objective of this section is to study papers related to the Industry 4.0 technology application procedure, to associate and explore numerous assessment contexts, and to classify possible elements that impact the application procedure of Industry 4.0 technology in SMEs. Owing to the shortage of prior studies on the factors applied in assessing Industry 4.0 technology application [31,32], this paper develops an assessment structure applied in other firms and industries, including three primary aspects—technology, organization, and environment—with the goal of recognizing the factors which are most relevant for the application of Industry 4.0 technology.
2.1. Related Literature on the Elements Influencing Industry 4.0 Technology Application in SMEs
Industry 4.0 technology is one of the most promising technologies with the tendency to enhance process effectiveness and increase supply chain visibility [15,16]. Rapid changes in demand and intensified competition in the market have pushed manufacturing industries to implement innovative technology to enhance smart manufacturing. Industry 4.0 is the present data exchange and automation trend in technology of production [33,34]. During the last ten years, future industrial developments have been regularly discussed within academia and industry, whereas numerous viewpoints have emerged to define such developments. The successful growth of such development is considered vital to establishing competitive advantages between national economies and manufacturing firms [35,36]. The most established is Industry 4.0 within Europe [37,38,39,40]. Industry 4.0 emerged in Germany and was intended to sustain national growth via promoting the development of manufacturing in 2011. [41]. There are a variety of other initiatives that can be employed to enhance the development, for example, “Future of Manufacturing” in the UK and “Smart Manufacturing” in the USA [13,36].
While Industry 4.0 is well-expected, a major study solving the implementation approaches has been established via multi-national enterprises or larger organizations [42]. Although multi-national enterprises promote the economy in an important way [43], it cannot be neglected that SMEs make up 90% of enterprises operating within the EU [44]. The influence of SMEs is also essential; they ensure social stability, create jobs, and promote economic growth [45,46]. Compared with multi-national enterprises, SMEs tend to face greater knowledge and financial resource constraints [47,48]. This has led to numerous researchers identifying a mismatch among present Industry 4.0 theory and the particular demands of SMEs [48,49,50,51]. Related research is changing in the wake of Industry 4.0 developments in terms of execution, planning, and associated investigation groups [52]. These responses to Industry 4.0 are full of numerous challenges in SMEs, particularly with regards to logistics, technologies, and managerial and organizational perspectives [53]. Fettermann et al. [54] inspected the demands of dissimilar technology, for example, cyber-physical systems, processing in cloud and radio frequency identifiers. Hofmann and Rüsch [55] stated the chances of Industry 4.0 in the logistics context. They stated that management is facing challenges in the adoption of Industry 4.0 because corporations may not detect any short-term financial performance after the adoption of Industry 4.0. In the management context, Barreto et al. [56] investigated the necessities that may enable companies to be more effective at adopting Industry 4.0. Oesterreich and Teuteberg [57] studied the challenges which Industry 4.0 poses for the industry of construction. Ben-Daya et al. [58] expanded the Industry 4.0 conception via the supply chain. Haddud et al. [59] investigated potential challenges and benefits related to the combination of Industry 4.0 from managerial and organizational perspectives.
The challenges associated with Industry 4.0 cause an unbalanced distribution of resources, which is important to and impactive in numerous other sectors of business [60,61,62,63,64]. Without a sufficient comprehension of the concerning Industry 4.0 elements, it is unlikely to exactly apply a suitable approach in response to this tendency [65,66,67,68]. Therefore, numerous industries are using Industry 4.0 technology for investigational developments to gain competitive advantages and enhance the operational efficiency through the viewpoint of technology, organization, environment and related business factors [20,21,22,23]. Industry 4.0 technology has also been receiving significant consideration in SMEs as it deals with the critical problems of automation and production efficiency in manufacturing operations, as indicated when inspecting the approaches in this study [69,70,71]. Industry 4.0 technology applications can be divided into several major performances (such as the finance performance, business performance, supply chain management performance, and so on), according to various SME objectives. Nevertheless, we only apply two alternatives (“finance performance (A1)” and “business performance (A2)”) in our approach as instances to indicate two comparatively good uses for Industry 4.0 technology applications.
The TOE structure illustrates how these contexts influence the implementation and adoption of innovation through three dissimilar factors [20,21,22,23,72]. The technology aspect focuses on the technology features that influence corporation implementation, the organization aspect focuses on implementation to the organization’s attributes, and the environment aspect reflects the environmental factors [20,21]. Researchers have used the TOE structure to explore the implementation of numerous technologies, such as e-commerce, 3D printing, radio frequency identification (RFID) adoption, and so on [25,73,74]. For example, Lu et al. [74] explored and identified RFID adoption according to the TOE structure and the study demonstrated that RFID adoption had an important influence on each related performance. In addition, Lu et al. [25] extended this generalizability of previous research on business to business implementation to keeping usage. They did this from the perspective of network reliability, data security, top management emphasis, technology complexity, firm size, employees’ information system (IS) knowledge, regulatory support, partner support, and competitive pressure. Mostly, the advantage of the TOE structure is its formidable background of theory and possible empirical adoption, which is beneficial in guiding scholars.
Previous researchers on Industry 4.0 technology application have seldom focused on all TOE aspects. Numerous researchers have restricted their argument to only a limited critical element and there is no systemic evaluation strategy in their studies. Therefore, in this study, these elements in each aspect are determined from a review of the related literature and numerous face-to-face interviews with these specialists in SMEs or related industry. Table 1 reviews references for all elements in the research. We state this TOE context as a base, resulting in the three aspects of our study’s context–TOE (technology, organization, and environment). The factors related to the Industry 4.0 technology application within each aspect are subsequently discussed.
Table 1.
Clarification of elements and aspects.
2.2. Elements for Assessing the Industry 4.0 Technology Application Procedure
The factors employed for assessing Industry 4.0 technology application will now be presented.
Technology aspect (G1): Technology elements are denoted as “innovation characteristics” in numerous studies on administrative application procedures [20,21,75]. Technology readiness, technology security, and technology integration have all been recommended as significant to Industry 4.0 technology applications and are applied in the assessment context [21,22].
Organization aspect (G2): Organizational features are present when applying novel technologies, as illustrated by Masood and Egger [21], and these are pertinent to the procedure of application. Numerous studies have highly esteemed Industry 4.0 technology application, with factors such as financial commitment, organizational readiness, and top management support considered to have a latent influence [20,21,22,23].
Environment aspect (G3): Masood and Egger [21] have stated the impact of the environment in a management’s strategies to implement novel technology. Competitive pressure, regulatory support, and environmental uncertainty are considered as being the most significant external elements [20,21,22,23].
This assessment structure focuses on TOE as the three aspects which significantly influence Industry 4.0 technology application in SMEs. Within each aspect, there are also lower-level factors, considered in former research. Our entire assessment structure, involving both the aspects and elements, is demonstrated in Table 1.
3. Methods
The mixed MCDM model assembled by applying the above mentioned research is considered to be an appropriate method for the prospecting of topics concerning the industry 4.0 technology application in SMEs. It can be employed as a case for managers to enhance TOE estimation approaches for each element. This mixed MCDM with pattern systematic approaches is not only applied for ranking and choosing, but also for explaining the issues among dissimilar elements and the aspects for Industry 4.0 technology application. The tendency in the present method is to divert through ranking and selection to obtain improvement of the commerce performance according to the INRD [1,25,26,27,28,75,76].
This DEMATEL approach is used to set up a matrix of total influence relations and to survey this effect and cause inter relations among parameters extracted through distinct criteria and elements. Then, we integrate the influence relations matrix acquired by the DEMATEL approach to set up the fundamental ANP [77] and determine the influence weights for each element.
3.1. DEMATEL Technique
DEMATEL is applied to establish this matrix of effect relations for aspects/elements to calculate the effects and causes for separate factors. The method is broadly used in numerous kinds of multifaceted research to understand the complexity of certain topics. DEMATEL involves five phases.
This primary phase checks the numberer of factors in a structure, , and advances the gages for determining the influence relations in separate factors, associating aspects/elements in pairs and applying the measure of 0–4, which represents a total lack of effect (0), low effect (1), medium effect (2), high effect (3), and very high effect (4).
The next phase detects a matrix of primary influence, associating effect interplay degree pairs to directly acquire the effect matrix , where indicates the degree to which element i influences element j. If these i-th elements directly affect the j-th element, then ; then, .
The next phase normalizes the matrix of the direct effect to acquire the matrix from Equations (1) and (2). The matrix for the diagonal is 0, and the largest summation of each column or row is 1.
The fourth phase acquires the total effect matrix from Equation (3):
where , ,, . If the column or row is equal to 1 for at least some total factors (but not all) in and , then we are able to determine that is the identity matrix and .
The final phase acquires the relations and prominence of these variables. Through all individual columns and rows of the total effect matrix , we can acquire the summation of all column and row vectors as follows:
The value , which is the summation of all rows in the total influence matrix , denotes the degree to which this element indirectly or directly impacts other elements. The value , which s the summation of all columns in , indicates the degree that the element is influenced by other elements. Based on this explanation, indicates the degree of the total relations among the elements, meaning “prominence”, whilst shows the degree of the impact and other elements, illustrating the “net influence relations”. If () is positive, then element i influences the other elements, and if () is negative, then element i is affected by other elements.
3.2. DANP Method
DEMATEL is not only used to build the interplay relations between each element, but also to acquire the most exact weight of the impact. The traditional ANP resolves these issues through the feedback and interdependence of elements. Therefore, we apply these fundamental ANP conceptions [77] as a foundation and associate them with the DEMATEL to resolve these problems [1,25,28,77,78]. In this way, DANP covers the next phases.
The first phase builds the framework of the specialist influence survey. The survey is broken down and divided into components.
The next phase uses an unweighted supermatrix , transposing separate normalized characteristics with the total degree of influence achieved by the matrix of the total effect by applying the DEMATEL, as illustrated in Equation (4).
The normalized with a total degree of effect offers the of the aspects illustrated in Equation (5).
We use to indicate the fundamental conception in Equations (6) and (7).
Then, it normalizes the matrix of the total influence into the matrix applying its aspects; formerly, the unweighted supermatrix is attained via transposing , i.e., , according to the fundamental ANP conception in an unweighted supermatrix , as illustrated in Equation (8).
This produces matrix , as shown in Equation (9). If these clusters or elements are independent, the consistent item in this matrix is zero or blank. The matrix is attained in a similar way.
The third phase acquires the weight of the supermatrix, aspectualizing the matrix of the total influence relations matrix (as shown in Equation (10)). Agreement per aspect of matrix is normalized by the full effect to acquire . Equation (11) illustrates the outcome:
Multiplying the normalized matrix via the unweighted supermatrix offers the normalized supermatrix , as illustrated in Equation (12).
The fourth phase acquires the normalized supermatrix . The supermatrix limitation can be acquired by multiplying this supermatrix with normalization via itself numerous times, until the supermatrix has become and converged into a long-term stabilizing supermatrix to provide a big enough power . Hence, these weights of the effect of individual elements are attained via , where indicates any numeral for the exponent. We apply these procedures to acquire the influence weights.
3.3. Modified VIKOR
The VIKOR technique, established by Opricovic and Tzeng [78,79], resolves MCDM issues with inconsistent elements. The technique is associated with negative-ideal and positive-ideal resolutions, with a preference for being close to the point of positive-ideal, that is, the fundamental plan of accustomed thinking. The conception of gap procedures indicates the closeness to the point of positive-ideal [78,79]. We will now define this modified VIKOR technique.
The primary phase indicates the values and in valuable element evaluation elements. The value denotes the positive-ideal point, that is, the best score for element , and denotes the point of the negative-ideal, representing the worst score for element . represents the score of the performance of the alternative for . This evolution of the VIKOR technique starts with the following procedure of _metric:
where and the influence of weight is derived through the DANP. In this study, we applied the conceptions of Equations (14) and (15) to acquire the next outcomes for enhancement of the gap of each aspect/element according to feedback and interdependence issues:
(traditional approach)
We built the aspiration levels (modified approach) via the following vector:
(traditional approach)
We built the worst values (modified approach) via the following vector:
The fundamental aspect of the modified method is that we apply the scores of the performance from 0 to 4 in surveys so that the aspired value can be established at 4 and the worst value at zero. Therefore, in this study, we established , j = 1,2,…, n as the aspired value and j = 1,2,…, n, as the worst level, representing a difference when compared to the traditional method. In the study, we established as the aspired value and as the worst value, and were able to prevent selection of the best among lower alternatives.
The second phase analyses the minimal mean of the group utility and maximal regret .
where indicates the gap ratio; indicates the ratios of the average gap through the aspired level to the value of performance in element of alternative in the study, and we focus on how to minimize this gap for the element . Formerly, indicates the respective influence weight of element ; can be obtained from the DANP according to the DEMATEL technique. indicates the maximum gap for all elements.
The last phase attains the overall factor and its sorted outcomes. Equation (17) computes the values. As shown in Equation (17), we can detect how to enhance the application of Industry 4.0 technology to decrease the gaps in reaching the desired value according to the influence network relation map.
The derived values are (as the gap is zero, achieving the desired level), (the worst situation)m (desired level), and (the worst situation). Therefore, in this study, we employed the gap for and , , and , and modified Equation (17) as . The weight only indicates how we are able to minimize this average gap, and the weight only indicates how to choose the maximum gap for previous enhancement. Generally, , which can be regulated, depending on the circumstances.
According to the above conceptions, we could simply attain how to enhance these gaps ( = 1,2,…,;), that is, the precedence for enhancement of the achieved aspired value.
4. Case Analysis
This empirical case focused on SMEs in Taiwan and is provided to show the application of the recommended MCDM pattern with the goal of choosing and evaluating the best approaches. The approach is able to help managers better handle matters of Industry 4.0 technology through the TOE structure and to realize their goals for distinct aspects/elements. A map of this study is shown in Figure 1.
Figure 1.
A map of the empirical case.
4.1. Data Collection
This study reviewed literature on Industry 4.0 technology and the application of information technology/information systems to SMEs, and relied on the context of TOE to choose Industry 4.0 technology application elements. The questionnaire was provided to specialists in the assessment of information technology application within associated fields. Firstly, the investigation applied a 5-point scale from 4 (very high effect) to 0 (completely no effect) to indicate the elements of impact of each aspect on the others. For these performance assessments, 12 specialists were questioned to assess their value of fulfillment for each element (see Table 2 in Note 1, where the gap error is 1.973%; the significant confidence is 98.027%, and it is more than 95%). Most of these specialists had more than 12 years’ experience as managers in SMEs. Professional viewpoints on all elements within the elements were gathered by a survey and individual interviews. The interviews with the specialists were carried out in December 2020, and they lasted for 25 to 30 min per session for the whole survey.
Table 2.
The total influence relationship matrix of for elements.
4.2. Results Analysis
In this research, we applied the strategic framework of DEMATEL and investigated it through nine (9) elements and three (3) aspects of the TOE context viewpoint on Industry 4.0 technology. By applying the expert surveys, we acquired the matrix of the total influence of aspects and elements illustrated in Table 2 and Table 3. We examined the opinions and thoughts of the specialists in terms of three (3) aspects, and the relations between the scopes of influence, which are compared to other aspects in Table 3.
Table 3.
The summation of the effects on the aspects and total influence relations matrix of .
Based on the total influence prominence (), the “technology aspect ” has the maximum influence of the relations detected; the “organization aspect ” includes all of the aspects which influence the others at the most basic level. Based on the influence relations (), we can also observe that the “environment aspect ” has the maximum level of impact in relation to other aspects calculated. Additionally, the “organization aspect ” has the weakest influence in comparison to other aspects. Based on Table 4, we can acquire data on the relational influence among elements. Table 4 illustrates the direct and indirect relations among the aspects in relation to other elements. “Organizational readiness ” is the most significant element considered; in addition, “top management support ” influences all other elements at the most basic level. Moreover, Table 4 illustrates that “competitive pressure ” has the maximum influence level in relation to the other elements. Moreover, “technology integration ” has the weakest influence in relation to the other elements.
Table 4.
The sum of the effects on the elements.
Previously, we applied DEMATEL to approve the relational influence for the elements, and we aimed to obtain the most precise influenced weights. DANP was used to resolve the interdependence and feedback issues of separate elements [25,26,27,28]. Therefore, we assembled the quality estimation model via DEMATEL, combined with DANP to acquire the weights of influence for the individual elements, as indicated in Table 5, Table 6 and Table 7.
Table 5.
The unweighted supermatrix .
Table 6.
The normalized supermatrix .
Table 7.
The stable matrix of the decision-making trial and evaluation laboratory-based analytic network process (DANP) with the power limit of , i.e., .
We defined the key elements in the application of Industry 4.0 technology to SMEs as top management support , technology security , and technology integration . DEMATEL was integrated with the influence weights to estimate the precedence of resolving issues, according to the gaps determined through the modified VIKOR and the influence network relations map.
In this research, a case study relating the Industry 4.0 technology application to SMEs was used to estimate and enhance approval gaps by applying the modified VIKOR technique, as shown in Table 8. Managers can detect problems through the values of gaps, either from the viewpoint of the element or separate aspects.
Table 8.
A gap evaluation of the application of Industry 4.0 technology by modified VlseKriterijumska Optimizacija I Kompromisno Resenje (VIKOR).
By applying these elements and aspects, the performances of the gap can be indicated by the enhancement of precedence arrangements to achieve the desired values. In the application of Industry 4.0 technology, technology security , with a high gap value of 0.560, is the primary element to be enhanced for the financial performance; top management support , with a high gap value of 0.600, is the primary element to be enhanced for the business performance. The enhancement precedence is also able to be used in separate aspects for the financial performance and business performance. In terms of the financial performance, for the technology aspect , for example, the precedence gap values are ordered as follows: Technology security , technology integration , and technology readiness . For the organization aspect , the precedence values of the gap are ordered as follows: Financial commitment , organizational readiness , and management support . For the environment aspect , the enhancement precedencies are ordered as follows: Competitive pressure , environmental uncertainty , and regulatory support . For the business performance, in terms of the technology aspect
, improvement priorities are ordered as follows: (g2), , and . The order is , , and within the organization aspect and , , and for the environment aspect . When applying the gap values offered by the specialists, the comprehensive priority systems of enhancement for the disparate aspects and for the general array of elements are obvious, as illustrated in Table 8. For managers, realizing the enhancement precedence of the application of Industry 4.0 technology for clients’ needs to be simpler to realize than these performance gaps in the SMEs.
4.3. Implications and Discussion
The outcomes of this paper will now be discussed. Initially, based on the DEMATEL, we can identify the interrelationship among separate elements and aspects from the influence relations network map for each element and aspect. In Figure 2, the “environment aspect ” impacts other aspects, specifically, the “technology aspect ” and “organization aspect ”; visibly, the environment aspect is a significant feature, and it has maximum strength impact in relation to other aspects. Therefore, the managers of SMEs need to prioritize enhancing this aspect. This is to be followed by the technology aspect and the organization aspect in assessing and enhancing the application of Industry 4.0 technology via SMEs.
Figure 2.
The influence network relations digraph (INRD) of each aspect and element.
Next, after inspecting these aspects, we focused on the elements, considered per aspect. Based on the findings, we developed a map of the influence relations of the elements in Figure 2. Therefore, for the effect relations among the elements, technology readiness was the most influential element in the technology aspect and thus needs to be prioritized for enhancement. This is to be followed by technology security and technology integration (check Figure 2 on the causal relations between , , and for more details). Each of the assessment elements and aspects comprise the necessities for influencing the Industry 4.0 technology application in SMEs. Therefore, SME managers need to assess all of the aspects and elements for Industry 4.0 technology in accordance with Figure 2. This assessment approach is applicable to most SMEs. Nevertheless, SME managers need to pay attention to the fact that, when using the approach, some modifications exist. The significance level for the nine (9) elements might change based on the characteristic of each firm or industry, and SME managers need to compare the assessment approaches for each Industry 4.0 technology model before determining the best application technique.
Lastly, the value of the gap is 0.258 (i.e., the distance to 0) for the finance performance and 0.228 for the business performance for the application of Industry 4.0 technology, as shown in Table 8, demonstrating room for enhancement. From the TOE viewpoint, the technology aspect , presenting the largest value of the gap of 0.428 for the finance performance and 0.392 for the organization aspect in terms of the business performance, needs to be the primary precedence for enhancement if managers of SMEs wish to attain the desired value. For long-term enhancement, managers need systematic and sensible administration, as stated above. With our empirical findings, as formulated in Table 9, we were able to realize the objective of this paper. The assessment pattern for the application of Industry 4.0 technology offered in this research is applicable to most SMEs. However, SME managers must be cautious when using the approach. The importance of the nine (9) elements might change based on different circumstances, and managers need to employ the application of Industry 4.0 technology to explain gaps before developing strategies on the best technology to apply.
Table 9.
Scheme of enhancement precedence for Industry 4.0 technology application.
5. Conclusions
This paper has examined issues surrounding the application of Industry 4.0 technology, and proposes a beneficial approach for the estimation and choice of elements for Industry 4.0 technology application using the TOE structure. To the best of our knowledge, that is one of the approaches dictating the Industry 4.0 technology application for SMEs in Taiwan. Industry 4.0 technology application is generally limited to certain fields in Taiwan, rather than within multifaceted topics encompassing technology, organization, and environmental elements. Therefore, the approach is important for presenting Industry 4.0 technology application findings on SMEs. These contributions are threefold. First, the assessment of Industry 4.0 technology application is a decision-making issue which is composed of multifaceted interactions and dependences. Next, the Industry 4.0 technology application technique is used to assess the performance and significance values that are alternated into the scores of performances. Lastly, a mixed method is devised to determine the hierarchical structure process and interdependence relationships among the Industry 4.0 technology application aspects and elements. Therefore, as the SMEs help to make use of more technological patterns like the research proposes, technological usages ought to be planned to enhance advantages in the target market. This pattern can be used in various kinds of instances to generate distinct results. These results can also support Industry 4.0 technology application to fit target areas.
There are numerous limitations to this study that require further inspection. Primarily, this study was conducted via surveying a comparatively restricted number of specialists. A greater sample could have allowed for a more multifaceted study of assessment methods, which could have generalized the outcomes of the paper. Next, these TOE assessment elements are concluded from prior literature on TOE assessment, which excluded several possible impacts on the Industry 4.0 technology assessment procedure. Future research can apply dissimilar approaches, such as longitudinal or fuzzy theory research, to detect other elements. Lastly, to offer more objective data on the applicability of the future TOE assessment pattern, future research can use specific performance assessments, such as, finance or the economy, and thus demonstrate the practicality of the general assessment context for the business assessment and Industry 4.0 technology application proposed in this paper.
Further research should focus on learning particular clusters or pairs of Industry 4.0 technology application that are more advantageous. As an approach, it can raise awareness on aspects where improvements are necessary. Additionally, different approaches can be applied, such as the entropy technique, to analyze the weights of the elements. Finally, to offer more objective information on the suitability of the stated Industry 4.0 technology application assessment model, future efforts could be made to use data mining approaches, for example, the support vector machine or random forest, to mention the most essential elements and enhance the feasibility of the universal assessment framework. The consequences of future study can then be associated with those stated here.
Author Contributions
Conceptualization, M.-T.L. & S.-C.C. & H.-H.C.; Methodology, M.-T.L.; Formal analysis, M.-T.L.; Investigation, M.-T.L.; Writing—original draft, M.-T.L.; Writing—review & editing, M.-T.L.; visualization, M.-T.L.; supervision, M.-T.L.; project administration, S.-C.C. & H.-H.C.; funding acquisition, S.-C.C. & H.-H.C. All authors have read and agreed to the published version of the manuscript.
Funding
This research was not funded.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Raj, A.; Dwivedi, G.; Sharma, A.; Jabbour, A.B.L.D.S.; Rajak, S. Barriers to the adoption of industry 4.0 technologies in the manufacturing sector: An inter-country comparative perspective. Int. J. Prod. Econ. 2020, 224, 107546. [Google Scholar] [CrossRef]
- Li, L. China’s manufacturing locus in 2025: With a comparison of “Made-in-China 2025” and “Industry 4.0”. Technol. Forecast. Soc. Chang. 2018, 135, 66–74. [Google Scholar] [CrossRef]
- Lu, Y. Industry 4.0: A survey on technologies, applications and open research issues. J. Ind. Inf. Integrat. 2017, 6, 1–10. [Google Scholar] [CrossRef]
- Lu, Y.; Papagiannidis, S.; Alamanos, E. Internet of Things: A systematic review of the business literature from the user and organizational perspectives. Technol. Forecast. Soc. Chang. 2018, 136, 285–297. [Google Scholar] [CrossRef]
- Gardan, J. Additive manufacturing technologies: State of the art and trends. Int. J. Prod. Res. 2016, 10, 3118–3132. [Google Scholar] [CrossRef]
- Urbinati, A.; Borges, M.; Chiesa, V.; Frattini, F. Creating and capturing value from Big Data: A multiple-case study analysis of provider companies. Technovation 2019, 84, 21–36. [Google Scholar] [CrossRef]
- Nuccio, M.; Guerzoni, M. Big Data: Hell or Heaven? Digital platforms and market power in the data-driven economy. Compet. Chang. 2019, 23, 312–328. [Google Scholar] [CrossRef]
- Nosalska, K.; Piatek, Z.M.; Mazurek, G.; Rzadca, R. Industry 4.0: Coherent definition framework with technological and organizational interdependencies. J. Manuf. Technol. Manag. 2020, 31, 837–862. [Google Scholar] [CrossRef]
- Fatorachian, H.; Kazemi, H. A critical investigation of Industry 4.0 in manufacturing: Theoretical operationalisation framework. Prod. Plann. Control. 2018, 29, 633–644. [Google Scholar] [CrossRef]
- Xu, D.X.; Xu, E.L.; Li, L. Industry 4.0: State of the art and future trends. Int. J. Prod. Res. 2018, 56, 2941–2962. [Google Scholar] [CrossRef]
- Pournader, M.; Shi, Y.; Seuring, S.; Koh, S.C.L. Blockchain applications in supply chains, transport and logistics: A systematic review of the literature. Int. J. Prod. Res. 2020, 58, 2063–2081. [Google Scholar] [CrossRef]
- Osterrieder, P.; Budde, L.; Friedli, T. The smart factory as a key construct of Industry 4.0: A systematic literature review. Int. J. Prod. Econ. 2020, 221, 107476. [Google Scholar] [CrossRef]
- Liao, Y.; Deschamps, F.; Loures, E.D.F.R.; Ramos, L.F.P. Past, present and future of Industry 4.0-a systematic literature review and research agenda proposal. Int. J. Prod. Res. 2017, 55, 3609–3629. [Google Scholar] [CrossRef]
- Chiarini, A.; Belvedere, V.; Grando, A. Industry 4.0 strategies and technological developments. An exploratory research from Italian manufacturing companies. Prod. Plann. Control. 2020, 31, 1385–1398. [Google Scholar] [CrossRef]
- Schniederjans, D.G.; Curado, C.; Khalajhedayati, M. Supply chain digitalization trends: An integration of knowledge management. Int. J. Prod. Econ. 2020, 220, 107439. [Google Scholar] [CrossRef]
- Garay-Rondero, C.L.; Martinez-Flores, J.L.; Smith, N.R.; Caballero Morales, S.O.; Aldrette-Malacara, A. Digital supply chain model in Industry 4.0. J. Manuf. Technol. Manag. 2020, 31, 887–933. [Google Scholar] [CrossRef]
- Wang, S.; Wan, J.; Zhang, D.; Li, D.; Zhang, C. Towards smart factory for industry 4.0: A self-organized multi-agent system with big data based feedback and coordination. Comput. Netw. 2016, 101, 158–168. [Google Scholar] [CrossRef]
- De Sousa Jabbour, A.B.L.; Jabbour, C.J.C.; Foropon, C.; Godinho Filho, M. When titans meet–Can industry 4.0 revolutionise the environmentally-sustainable manufacturing wave? The role of critical success factors. Technol. Forecast. Soc. Chang. 2018, 132, 18–25. [Google Scholar] [CrossRef]
- Dalenogare, L.S.; Benitez, G.B.; Ayala, N.F.; Frank, A.G. The expected contribution of Industry 4.0 technologies for industrial performance. Int. J. Prod. Econ. 2018, 204, 383–394. [Google Scholar] [CrossRef]
- Masood, T.; Egger, J. Augmented reality in support of Industry 4.0—Implementation challenges and success factors. Robot. Comput. Integr. Manuf. 2019, 58, 181–195. [Google Scholar] [CrossRef]
- Masood, T.; Egger, J. Adopting augmented reality in the age of industrial digitalisation. Comput. Ind. 2020, 115, 103112. [Google Scholar] [CrossRef]
- Lin, D.; Lee, C.K.M.; Lau, H.; Yang, Y. Strategic response to Industry 4.0: An empirical investigation on the Chinese automotive industry. Ind. Manag. Data Syst. 2018, 118, 589–605. [Google Scholar] [CrossRef]
- Ardito, L.; Petruzzelli, A.M.; Panniello, U.; Garavelli, A.C. Towards Industry 4.0: Mapping digital technologies for supply chain management-marketing integration. Bus. Process Manag. J. 2019, 25, 323–346. [Google Scholar] [CrossRef]
- Mariani, M.; Borghi, M. Industry 4.0: A bibliometric review of its managerial intellectual structure and potential evolution in the service industries. Technol. Forecast. Soc. Chang. 2019, 149, 119752. [Google Scholar] [CrossRef]
- Lu, M.T.; Hu, S.K.; Huang, L.H.; Tzeng, G.H. Evaluating the implementation of business-to-business m-commerce by SMEs based on a new hybrid MADM model. Manag. Decis. 2015, 53, 290–317. [Google Scholar] [CrossRef]
- Liou, J.J.H.; Lu, M.T.; Hu, S.K.; Cheng, C.H.; Chuang, Y.C. A hybrid MCDM model for Improving the Electronic Health Record to Better Serve Client Needs. Sustainability 2017, 9, 1819. [Google Scholar] [CrossRef]
- Lu, M.T.; Tzeng, G.H.; Tang, L.L. Environmental strategic orientations for improving green innovation performance in fuzzy environment-Using new fuzzy Hybrid MCDM model. Int. J. Fuzzy Syst. 2013, 15, 297–316. [Google Scholar]
- Lu, M.T.; Tsai, J.F.; Shen, S.P.; Lin, M.H. Hu, Y.C. Estimating sustainable development performance in the electrical wire and cable industry: Applying the integrated fuzzy MADM approach. J. Clean Prod. 2020, 277, 122440. [Google Scholar] [CrossRef]
- Sevinç, A.; Gür, Ş.; Eren, T. Analysis of the Difficulties of SMEs in Industry 4.0 Applications by Analytical Hierarchy Process and Analytical Network Process. Processes 2018, 6, 264. [Google Scholar]
- Çalık, A. A novel Pythagorean fuzzy AHP and fuzzy TOPSIS methodology for green supplier selection in the Industry 4.0 era. Soft Comput. 2020, 23, 1–13. [Google Scholar] [CrossRef]
- Braziotis, C.; Rogers, H.; Jimo, A. 3D printing strategic deployment: The supply chain perspective. Supply Chain Manag. 2019, 24, 397–404. [Google Scholar] [CrossRef]
- Gress, D.R.; Kalafsky, R.V. Geographies of production in 3D: Theoretical and research implications stemming from additive manufacturing. Geoforum 2015, 60, 43–52. [Google Scholar] [CrossRef]
- Ancarani, A.; Di Mauro, C.; Legenvre, H.; Cardella, M.S. Internet of Things adoption: A typology of projects. Int. J. Oper. Prod. Manag. 2020, 40, 849–872. [Google Scholar] [CrossRef]
- Castelo-Branco, I.; Cruz-Jesus, F.; Oliveira, T. Assessing Industry 4.0 readiness in manufacturing: Evidence for the European Union. Comput. Ind. 2019, 197, 22–32. [Google Scholar] [CrossRef]
- Doh, S.; Kim, B. Government support for SME innovations in the regional industries: The case of government financial support program in South Korea. Res. Policy. 2014, 43, 1557–1569. [Google Scholar] [CrossRef]
- Kusiak, A. Smart manufacturing. Int. J. Prod. Res. 2018, 56, 508–517. [Google Scholar] [CrossRef]
- Strozzi, F.; Colicchia, C.; Creazza, A.; Noè, C. Literature review on the ‘smart factory’ concept using bibliometric tools. Int. J. Prod. Res. 2017, 55, 6572–6591. [Google Scholar] [CrossRef]
- Galati, F.; Bigliardi, B. Industry 4.0: Emerging themes and future research avenues using a text mining approach. Comput. Ind. 2019, 109, 100–113. [Google Scholar] [CrossRef]
- Frank, G.A.; Dalenogare, L.S.; Ayala, N.F. Industry 4.0 technologies: Implementation patterns in manufacturing companies. Int. J. Prod. Econ. 2019, 210, 15–26. [Google Scholar] [CrossRef]
- Sharp, R.; Lopik, K.V.; Neal, A.; Goodall, P.; Conway, P.P.; West, A.A. An industrial evaluation of an Industry 4.0 reference architecture demonstrating the need for the inclusion of security and human components. Comput. Ind. 2019, 108, 37–44. [Google Scholar] [CrossRef]
- Yin, Y.; Stecke, K.E.; Li, D. The evolution of production systems from Industry2.0 through Industry 4.0. Int. J. Prod. Res. 2018, 56, 848–861. [Google Scholar] [CrossRef]
- Mittal, S.; Khan, M.; Muztoba, A.; Romero, D.; Wuest, T. A critical review of smart manufacturing & Industry 4.0 maturity models: Implications for small and medium-sized enterprises (SMEs). J. Manuf. Syst. 2018, 49, 194–214. [Google Scholar]
- Etemad, H. Internationalization of small and medium sized enterprises: A grounded theoretical framework and an overview. Can. J. Adm. Sci. Rev. Can. Des Sci. L Adm. 2009, 21, 1–21. [Google Scholar] [CrossRef]
- European Commission. User Guide to the SME Definition; Publications Office-of-the European Union: Luxembourg, 2016; pp. 3–44. [Google Scholar]
- Knight, G. Entrepreneurship and marketing strategy: The SME under globalization. J. Int. Mark. 2000, 8, 12–32. [Google Scholar] [CrossRef]
- Wallsten, S.J. The effects of government industry R&D programs on private R&D: The case of the Small Business Innovation Research program. Rand J. Econ. 2000, 31, 82–100. [Google Scholar]
- Brunswicker, S.; Vanhaverbeke, W. Open Innovation in Small and Medium Sized Enterprises (SMEs): External Knowledge Sourcing Strategies and Internal Organizational Facilitators. J. Small Bus. Manag. 2015, 53, 1241–1263. [Google Scholar] [CrossRef]
- Kaartinen, H.; Pieska, S.; Vahasoyrinki, J. Digital manufacturing toolbox for supporting the manufacturing SMEs. In Proceedings of the 7th IEEE International Conference on Cognitive Infocommunications, Wroclaw, Poland, 16–18 October 2016; pp. 71–76. [Google Scholar]
- Müller, J.; Voigt, K.I. Industry 4.0 for small and medium sized enterprises. Product. Manag. 2016, 21, 28–30. [Google Scholar]
- Moeuf, A.; Pellerin, R.; Lamouri, S.; Tamayo-Giraldo, S.; Barbaray, R. The industrial management of SMEs in the era of Industry 4.0. Int. J. Prod. Res. 2018, 56, 1118–1136. [Google Scholar] [CrossRef]
- Vrchota, J.; Volek, T.; Novotná, M. Factors introducing industry 4.0 to SMES. Soc. Sci. 2019, 8, 130. [Google Scholar] [CrossRef]
- Rauch, E.; Linder, C.; Dallasega, P. Anthropocentric perspective of production before and within Industry 4.0. Comput. Ind. Eng. 2020, 139, 105644. [Google Scholar] [CrossRef]
- Modrak, V.; Soltysova, Z.; Poklemba, R. Mapping requirements and roadmapdefinition for introducing I 4.0 in SME environment. In Advances in Manufacturing Engineering and Materials, Proceedings of the International Conference on Manufacturing Engineering and Materials (ICMEM 2018), Nový Smokovec, Slovakia, 18–22 June 2018; Hloch, S., Klichová, D., Krolczyk, G., Chattopadhyaya, S., Ruppenthalová, L., Eds.; Springer Nature Switzerland AG: Cham, Switzerland, 2019. [Google Scholar]
- Fettermann, D.C.; Cavalcante, C.G.S.; Almeida, T.D.D.; Tortorella, G.L. How does Industry 4.0 contribute to operations management? J. Ind. Prod. Eng. 2018, 35, 255–268. [Google Scholar] [CrossRef]
- Hofmann, E.; Rüsch, M. Industry 4.0 and the current status as well as future prospects on logistics. Comput. Ind. 2017, 89, 23–34. [Google Scholar] [CrossRef]
- Barreto, L.; Amaral, A.; Pereira, T. Industry 4.0 implications in logistics: An overview. Procedia Manuf. 2017, 13, 1245–1252. [Google Scholar] [CrossRef]
- Oesterreich, T.D.; Teuteberg, F. Understanding the implications of digitisation and automation in the context of Industry 4.0: A triangulation approach and elements of a research agenda for the construction industry. Comput. Ind. 2016, 83, 121–139. [Google Scholar] [CrossRef]
- Ben-Daya, M.; Hassini, E.; Bahroun, Z. Internet of things and supply chain management: A literature review. Int. J. Prod. Res. 2017, 57, 4719–4742. [Google Scholar] [CrossRef]
- Haddud, A.; DeSouza, A.; Khare, A.; Lee, H. Examining potential benefits and challenges associated with the Internet of Things integration in supply chains. J. Manuf. Technol. Manag. 2017, 28, 1055–1085. [Google Scholar] [CrossRef]
- Mellor, S.; Hao, L.; Zhang, D. Additive manufacturing: A framework for implementation. Int. J. Prod. Econ. 2014, 149, 194–201. [Google Scholar] [CrossRef]
- Svan, F.; Lars, M.; Rikard, L. Embracing digital innovation in incumbent firms: How Volvo cars managed competing concerns. MIS Q. 2017, 41, 239–254. [Google Scholar] [CrossRef]
- Zangiacomi, A.; Pessot, E.; Fornasiero, R.; Beretti, M.; Sacco, M. Moving towards digitalization: A multiple case study in manufacturing. Prod. Plann. Control. 2020, 31, 143–157. [Google Scholar] [CrossRef]
- Tortorella, G.L.; Cawley Vergara, A.M.; Garza-Reyes, J.A.; Sawhney, R. Organizational learning paths based upon Industry 4.0 adoption: An empirical study with Brazilian manufacturers. Int. J. Prod. Econ. 2020, 219, 284–294. [Google Scholar] [CrossRef]
- Veile, J.W.; Kiel, D.; Müller, J.M.; Voigt, K.I. Lessons learned from Industry 4.0 implementation in the German manufacturing industry. J. Manuf. Technol. Manag. 2020, 31, 977–997. [Google Scholar] [CrossRef]
- Reynolds, E.B.; Yilmaz, U. Strengthening advanced manufacturing innovation ecosystem: The case of Massachusetts. Technol. Forecast. Soc. Chang. 2018, 136, 178–191. [Google Scholar] [CrossRef]
- Sung, T. Industry 4.0: A Korea perspective. Technol. Forecast. Soc. Chang. 2018, 132, 40–45. [Google Scholar] [CrossRef]
- Kummitha, R.K.R.; Crutzen, N. Smart cities and the citizen-driven Internet of Things: A qualitative inquiry into an emerging smart city. Technol. Forecast. Soc. Chang. 2019, 140, 44–53. [Google Scholar] [CrossRef]
- Fukuda, K. Science, technology and innovation ecosystem transformation toward Society 5.0. Int. J. Prod. Econ. 2020, 220, 107460. [Google Scholar] [CrossRef]
- Horváth, D.; Szabó, R.Z. Driving forces and barriers of Industry 4.0: Do multinational and small and medium-sized companies have equal opportunities? Technol. Forecast. Soc. Chang. 2019, 146, 119–132. [Google Scholar] [CrossRef]
- Moeuf, A.; Lamouri, S.; Pellerin, R.; Tamayo-Giraldo, S.; Tobon-Valencia, S.; Eburdy, R. Identification of critical success factors, risks and opportunities of Industry 4.0 in SMEs. Int. J. Prod. Res. 2020, 58, 1384–1400. [Google Scholar] [CrossRef]
- Arcidiacono, F.; Ancarani, A.; Di Mauro, C.; Schupp, F. Where the rubber meets the road. Industry 4.0 among SMEs in the automotive sector. IEEE Eng. Manag. Rev. 2019, 47, 86–93. [Google Scholar]
- Tornatzky, L.G.; Fleischer, M. The Processes of Technological Innovation; Lexington Books: Lanham, MD, USA, 1990. [Google Scholar]
- Yeh, C.C.; Chen, Y.F. Critical success factors for adoption of 3D printing. Technol. Forecast. Soc. Chang. 2018, 132, 209–216. [Google Scholar] [CrossRef]
- Lu, M.T.; Lin, S.W.; Tzeng, G.H. Improving RFID adoption in Taiwan’s healthcare industry based on a DEMATEL technique with a hybrid MCDM model. Decis. Support Syst. 2013, 56, 259–269. [Google Scholar] [CrossRef]
- Lu, M.T.; Hsu, C.C.; Liou, J.J.; Lo, H.W. A hybrid MCDM and sustainability balanced scorecard model to establish sustainable performance evaluation for international airports. J. Air Transp. Manag. 2018, 71, 9–19. [Google Scholar] [CrossRef]
- Lu, M.T.; Tzeng, G.H.; Cheng, H.; Hsu, C.C. Exploring mobile banking services for user behavior in intention adoption: Using new hybrid MADM model. Serv. Bus. 2015, 9, 541–565. [Google Scholar] [CrossRef]
- Saaty, T.L. Decision Making with Dependence and Feedback: The Analytic Network Process; RWS Publications: Pittsburgh, PA, USA, 1996. [Google Scholar]
- Opricovic, S.; Tzeng, G.H. Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS. Eur. J. Oper. Res. 2004, 156, 445–455. [Google Scholar] [CrossRef]
- Opricovic, S.; Tzeng, G.H. Extended VIKOR method in comparison with outranking methods. Eur. J. Oper. Res. 2007, 178, 514–529. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).