1. Introduction
During the past decades, the structure of the world economy has undergone significant changes with demand for energy saving and environmental protection becoming increasingly urgent [
1,
2,
3]. To cope with this situation, developing countries need to transform and upgrade their manufacturing industries with process innovation to reduce energy consumption and achieve sustainable development; developed countries, accordingly, are trying to guide and accelerate the return of manufacturing industries for enhancing global competitive advantage by means of process innovation [
4,
5,
6,
7]. Manufacturing process innovation, which includes the creation of new technical principles, methods and production modes, is a basic guarantee for the ultimate realization of product innovation and a fundamental means to achieve sustainable development of the manufacturing industry [
8,
9]. In recent years, systematic innovation methodologies and technologies for manufacturing processes have gained greater attention in academic research and industry [
10,
11,
12]. Nevertheless, process innovation typically relies on cross-industry collaboration and potentially complex interdisciplinary system engineering [
9]; thus, in addition to sophisticated manufacturing environments, the delivery of innovation is more dependent on highly qualified knowledge and knowledge-based systematic innovation methods [
13,
14,
15,
16,
17]. Consequently, formalized process innovation-oriented knowledge acquisition and its management are becoming increasingly important and challenging for knowledge intensive manufacturing industries, such as aviation, aerospace and automotive sector.
The latest Web 2.0 technologies provide a technical means for open knowledge management, enabling large amounts of discrete knowledge to be shared in open environments [
18,
19], such as social wiki platforms. From the perspective of knowledge application in Computer-Aided Process Innovation (CAPI) [
9], a formalized knowledge-oriented systematic design process is a prerequisite and basis for innovation implementation. Therefore, it is necessary to establish an effective knowledge evaluation method in open innovation environments. Process innovation knowledge evaluation is needed to identify the validity and novelty of such knowledge and to further analyze and understand the potential practicability and profitability in current manufacturing processes by considering the knowledge characteristics and manufacturing capacity. To select process innovation-oriented candidate knowledge, a reasonable evaluation index system is required. A quantitative index and qualitative factors based on the evaluation criteria can be evaluated by multiple domain experts. Accordingly, process innovation knowledge evaluation should be regarded as a group Multi-Criteria Decision-Making (MCDM) problem [
20,
21], concerned with how to evaluate candidate knowledge and how to raise improvement suggestions.
Due to the complexity and fuzziness of the above problems, it is difficult for decision makers to evaluate given objects using exact values, but they can express preferences using fuzzy linguistic values [
22,
23]. Experts devote themselves to judging knowledge comprehensive values by subjective perception or experiential cognition during the decision-making process. However, there exists a certain extent of fuzziness, uncertainty and heterogeneity [
24,
25]. In addition, there is a tendency towards information loss during integration processes and this can cause the evaluation results of knowledge performance levels to be inconsistent with the expectation of experts [
26,
27]. In this event, there is a need to identify reasonable ways of calculating the performance ratings of process innovation-oriented knowledge during the process of evaluation integration.
Therefore, the main objective of this research is to develop a comprehensive knowledge evaluation approach for supporting knowledge-driven CAPI. Firstly, an evaluation index system for process innovation knowledge is designed by domain experts, and necessary data from the expert committee are gathered to determine criteria weightings and performance ratings of candidate knowledge. Then, by combining an Analytic Hierarchy Process (AHP) with fuzzy linguistic computing, a comprehensive criteria weighting determination method for the knowledge evaluation index system is explored. What follows is the fuzzy linguistic evaluation of the performance ratings for each criterion and the corresponding sub-criteria can be calculated. Furthermore, it is possible to compute the process innovation-oriented knowledge comprehensive value and propose improvement suggestions based on the evaluation results.
The rest of this paper is organized as follows. In
Section 2, background research and related work with definitions are introduced, while operations relating to 2-tuple fuzzy linguistic variable are explored. In
Section 3, we introduce the comprehensive evaluation index system for process innovation knowledge, the model and procedure for process innovation-oriented knowledge evaluation, and the determination of comprehensive fuzzy weights. Then, a real case study of process innovation knowledge capture and evaluation for micro-cutting is illustrated in
Section 4 and further studied, with a process problem solving example of a micro-turbine manufacturing issue being given. Finally, conclusions and future directions for research are discussed.
3. The Proposed Approach
3.1. Proposed Comprehensive Evaluation Index System for Process Innovation Knowledge
Knowledge evaluation is an important part of process innovation knowledge acquisition, which requires not only an effective evaluation method, but also a practical index system as the basis for evaluation. The selection of a knowledge evaluation index depends on the specific application environment and innovation objects, thus reasonable control of the size and flexibility of the index system is necessary. In this research, through a review of literature and discussion with domain experts, we present a comprehensive hierarchy evaluation index system for process innovation knowledge, as illustrated in
Figure 2. The evaluation index system is composed of three levels: the first level is the overall goal; the second level comprises evaluation criteria; and the third level denotes corresponding sub-criteria for each criterion. The goal layer represents the core value of knowledge in the innovative application scenario, named Process Innovation Knowledge Comprehensive Value (PIKCV). The PIKCV is then divided into four parts through analysis of the characteristics of manufacturing process innovation: knowledge validity, knowledge novelty, potential practicability and manufacturing profitability.
3.2. Process Innovation-Oriented Knowledge Evaluation Model
In an open knowledge acquisition context, candidate innovation knowledge generally includes new theories, new methods and/or practical examples. Due to the novelty of knowledge and the complexity of process problems, it is difficult to fully evaluate the value of candidate process innovation knowledge from multiple criteria using exact values. In this situation, fuzzy linguistic variables are considered more reasonable for domain experts to evaluate the performance of PIKCV. Consequently, based on analysis of the comprehensive evaluation index system, a suitable evaluation model, using fuzzy linguistic computing, is proposed to measure the level of process innovation-oriented knowledge, as represented in
Figure 3. The specific procedures of this proposed evaluation model are summarized as follows.
Step 1. Form a suitable expert committee with members who are familiar with manufacturing process innovation design and the structure of the evaluation index system for the corresponding innovation knowledge. Let be the established expert committee and be a set of candidate process innovation knowledge. Additionally, assume that there are criteria , and each criterion includes several sub-criteria in the evaluation index system for process innovation knowledge.
Step 2. Select appropriate granularity for the linguistic term set according to experience and the preference of decision makers, and gather necessary data containing criteria weights and the performance ratings from the expert committee. Transform these linguistic terms into 2-tuple linguistic variables; for example, can denote the 2-tuple fuzzy criteria weights of the jth sub-criteria regarding the ith criteria of the mth expert.
Step 3. Aggregate the fuzzy linguistic evaluations of criteria weights generated by the expert committee for each criterion and corresponding sub-criteria. According to the arithmetic mean Formula (3), the aggregated criteria weighting values of
M experts are calculated as follows:
where
is the fuzzy importance of sub-criteria
with respect to
of the
th expert,
is the fuzzy importance of
of the
th expert, and
is the expert weight of the
th expert in determination of criteria importance,
.
In particular, when the expert weights are equal to each other, the aggregated criteria weighting values can be obtained using Formula (3):
Step 4. Aggregate the fuzzy linguistic evaluations of performance rating for each sub-criterion with respect to each criterion. Assuming that expert weights are the same in performance evaluation of process innovation knowledge, we can obtain the aggregation of fuzzy linguistic evaluation values.
where
is the fuzzy rating of sub-criteria
with respect to
of the
th expert.
Step 5. Compute the fuzzy aggregated ratings of each criterion by applying Formula (4):
where
Step 6. Calculate the process innovation knowledge comprehensive value. The linguistic term
can be used to represent the overall value level of process innovation knowledge in innovative design.
where
Step 7. Rank the candidate knowledge based on PIKCV results, and propose improvement suggestions, according to evaluation results in the corresponding criteria and sub-criteria.
3.3. Determination of Fuzzy Comprehensive Weights
The determination of weights is crucial to fuzzy comprehensive evaluation of process innovation knowledge; however, due to the complexity of creative problem-solving and the ambiguity of human thinking, it is difficult to give a clear standard weight. In general, experts are used to determine the weights using two methods: fuzzy linguistic representation and AHP. Here, to meet the diversity requirements of the expert group in weight determination, and to ensure the reliability of the weight coefficient, we compute the comprehensive weight of the knowledge evaluation system by combining AHP with fuzzy linguistic computing.
3.3.1. Weight Coefficient of AHP
The AHP method, developed by Saaty [
43] in the 1970s, is widely used for dealing with MCDM problems in practical production engineering [
7,
20,
25,
44,
45,
46]. It decomposes complex decision problems into hierarchical structures, which can include goal layer, criterion layer and sub-criterion layer. Then, a series of pairwise comparisons is conducted among the elements at the same level, so as to construct the judgment matrix. The specific steps for determination of weight coefficient are as follows:
A numerical rating for judgment matrix of pairwise comparison is suggested. Furthermore, a judgment matrix
is constructed according to pairwise comparisons.
where
is the relative importance comparison value of element
to element
, and
.
Calculate the weighted weight set
according to the judgment matrix by using the following formula:
An index, called consistency index (CI), is then used to measure the amount of inconsistency within the pairwise comparison matrix
.
where
is the largest eigenvalue of
, calculated as follows:
Accordingly, the Consistency Rate
is used to measure the degree of
by using the following formula:
where
is the random consistency index, its value being dependent on the order of matrix (as listed in
Table 1).
When , the judgment matrix and weights of elements are acceptable. Otherwise, the comparison matrix must be adjusted and decision makers should be asked to re-judge.
3.3.2. Weight Coefficient of Fuzzy Linguistic Computing
The aggregated criteria weighting values for each criterion and corresponding sub-criteria can be obtained using Formulae (6)–(9). Then, the following formulae are used to normalize these aggregated weights:
where
is the aggregated result of
th criterion in the criterion layer and
is the number of criteria.
where
is the aggregated result of
th sub-criterion in the sub-criterion layer and
is the number of sub-criteria for
th criterion.
3.3.3. Fuzzy Comprehensive Weights
By considering the weight information from the expert group of AHP and fuzzy linguistic computing, we can obtain the fuzzy comprehensive weights.
where
is the fuzzy comprehensive weight set of knowledge evaluation;
is the weighted weight set of the AHP expert group;
is the aggregated weight set of fuzzy linguistic computing; and
and
are the sums of expert weights from expert groups of AHP and fuzzy linguistic computing, respectively;
4. An Illustrative Example
To illustrate the applicability of the developed approach, a real case study of process innovation knowledge capture and evaluation for micro-cutting is presented. A contrastive analysis and discussion between the proposed method and traditional simple weight additive (SWA) method is performed. Thereafter, knowledge-inspired process problem solving for micro-turbine manufacturing is illustrated.
4.1. Process Innovation Knowledge Capturing and Evaluating
Process innovation knowledge, which exists in the entire life cycle of CAPI, is used to support process innovation activities and, if correctly implemented, produces new process knowledge. According to Wang et al. [
9] and Geng et al. [
12], process innovation knowledge can be divided into several types, including problem description template (PDT), process contradiction matrix (PCM), manufacturing scientific effect (MSE), innovative scheme instance (ISI), manufacturing capability description (MCD), etc. Through knowledge contributors’ social wiki activities in the context of open innovation, multiple types of process innovation knowledge for micro-cutting technology have been initially accumulated. Among this knowledge, there are six solving principles of PCM that need to be evaluated for a specific innovation scenario:
. In the following section, we take principle knowledge as an example to illustrate the concrete process of innovation knowledge evaluation and selection.
4.1.1. Gathering of Evaluation Data
To gather necessary data, the researchers conducted in-depth interviews with an expert committee, the members of which include a process designer, innovation expert and technical manager and who were introduced to the linguistic variables and their semantics. The committee consisted of three experts:
. The Linguistic variables of the importance and rating are displayed in
Table 2.
In determining the weights of the evaluation system, two experts (
) used fuzzy linguistic variables and one expert (
) used AHP. Linguistic evaluation and weighting values from
are listed in
Table 3, and the judgment matrices of criteria and sub-criteria from
are shown as follows.
The performance ratings of sub-criteria for candidate knowledge are given in
Table 4.
4.1.2. Determination of Criteria Weights
In determining the criteria weights for this study, we assume that the vector of expert weight is
according to the experts’ professional knowledge and innovation background. Thus, by using Formulae (6)–(9), the aggregated criteria weights of each criterion and corresponding sub-criteria are obtained, as shown in the rightmost column of
Table 3. For example, the weights of “Reliability” and “Knowledge validity” are calculated as
After normalizing the aggregated weighting value in
Table 3, we obtain fuzzy linguistic weights for criterion layer and sub-criterion layer.
Based on the judgment matrix from Expert
and Formulae (16)–(19), we can obtain the AHP weight of criterion layer
,
,
,
, and
. Thus, this judgment matrix passes the consistency test. Similarly, the AHP weights of sub-criterion layer are obtained.
When the above steps are completed, the fuzzy comprehensive weight of the criterion layer can be calculated according to Formula (22), namely
. Similarly, we can obtain the fuzzy comprehensive weights of sub-criterion layer.
4.1.3. Calculation of the PIKCV
In performance evaluation, we assume expert weights are equal and use Formula (10) to compute the aggregation of fuzzy linguistic evaluation values of sub-criteria. For example, the evaluation value of “Reliability” for K
1 is calculated as
Similarly, the fuzzy aggregated ratings of each criterion of K
1 can be calculated, as shown in
Table 5. For example, the aggregated rating value of “Knowledge validity” for K
1 is obtained by using Formula (11):
Based on the above steps, we can compute the PIKCV of six candidates’ knowledge by using Formula (13), as shown in
Table 6. For example, the PIKCV of K
1 is calculated as
4.2. Comparison and Analysis of Knowledge Evaluation Results
It may be seen in
Table 6 that the PIKCV of alternative K
1,
, represents slightly higher than “Good”, and the alternative K
1 is worse than K
3, since K
3 is closer to the linguistic term
. The overall ranking of the six principle knowledge candidates is
. K
5 is the best knowledge candidate with K
3 following thereafter. These aggregated results are consistent with experts’ opinion. On the other hand, the overall evaluation result of K
1 is 0.39, which was calculated using the SWA method with the same data, as shown in
Table 7. This translates into the degree of membership, which is 0.56 and 0.44. In other words, the overall evaluation result of K
1 is worse than “Fair” when applying the SWA method. It is obvious that the evaluation results obtained by the SWA method are not consistent with the opinions of the expert committee. Hence, to some extent, it demonstrates that the proposed method in this study can effectively aggregate fuzzy linguistic evaluation data among criteria and sub-criteria, and obtain reasonable overall evaluation results, while avoiding information loss.
From the perspective of 2-tuple linguistic expression, K5 and K3 have the same central value and their transitive values are close, so it may be determined that both offer superior knowledge innovation. Thus, they are expected to effectively support process innovation design in the context of particular application scenarios, yet other candidate knowledge should be improved based on the evaluation results of criteria and the corresponding sub-criteria. To achieve this potential application, the knowledge of these candidates could be further fused and refined on an open knowledge management platform.
4.3. Knowledge-Inspired Manufacturing Process Problem-Solving
Based on the above knowledge evaluation approach, a total of 265 knowledge items have been evaluated and improved for manufacturing process innovation of aerospace structures. In this section, the specific procedure for micro-turbine process problem-solving using process innovation knowledge will be briefly described.
The micro-turbine in this case is a core component of a micro turbojet engine and it has the following characteristics: (1) a complex curved structure and poor rigidity; (2) a thin blade prone to machining deformation; and (3) no through hole in the center of the turbine. Thus, it is difficult to manufacture using current manufacturing resources, as the core shaft positioning and clamping method, which is commonly used in general turbine machining, cannot be applied in this instance. Hence, it is necessary to solve the process problem of turbine manufacturing through innovation knowledge.
The process of innovative problem solving can be sub-divided into: process problem identification and formal description, process contradiction extraction and resolution, innovation scheme design, iterative solution and scheme optimization. The innovation process mainly involves several kinds of formal knowledge, as illustrated in
Figure 4. Specifically, the main procedures for the micro-turbine process problem-solving are as follows:
- (1)
Process problem identification and formal description. With the help of PHS and PDT, the problem can be formally expressed as the specific information of “expectation and avoidance”.
- (2)
Process contradiction extraction and resolution. According to the problem description, the innovation system can conveniently extract conflicting parameters, i.e., strengthening parameter and weakening parameter. Then, the innovative solving principles will be presented based on PCM, namely solving principles 1, 6, 7 and 9. These principles help to inspire the designer’s creative thinking. Through a detailed analysis, two principle solutions (as shown in
Figure 4) are considered effective in the problem-solving. By associating with MSE, an initial solution for thin-walled blade machining is obtained: Utilizing its cylindrical surface for clamping, but not handling the ball surface during this step.
- (3)
Innovation scheme design. With the support of ISI and MCD, we can design the detailed scheme in the existing manufacturing environment. After two iterations of conflict resolution, we get the scheme for spherical convex processing: By means of the threaded connection (its own structure/function) to realize positioning and clamping, and to ensure the dimensional precision of blades.
In this case, the innovative solutions of micro-turbine machining have been gradually revealed through multiple types of knowledge application and design thinking inspiration. We can see that quality evaluation and rational application of innovation knowledge are of great importance in innovation realization and the proposed method in this research is applicable for open manufacturing process innovation.
5. Conclusions and Implications
5.1. Conclusions
As competition in global markets intensifies, process innovation has been recognized as a key factor for enhancing sustainable competitive advantage in manufacturing organizations. However, in the implementation of knowledge-driven CAPI, an important challenge that must be faced is how to evaluate and select appropriate process innovation knowledge from an open knowledge acquisition environment. In this paper, we have presented a manufacturing process innovation-oriented knowledge evaluation approach using MCDM and fuzzy linguistic computing. Some of the key contributions of this study are listed below:
By considering process innovation knowledge characteristics and innovative applications, a comprehensive hierarchy evaluation index system is designed to measure the PIKCV, which can express the core value of knowledge in potential manufacturing innovation scenarios.
A manufacturing process innovation-oriented knowledge evaluation model, based on AHP and fuzzy linguistic computing, is applied to effectively aggregate the evaluation value into the expert committee’s comprehensive evaluation information in criteria weights and performance ratings. This model can meet the needs of rapid evaluation and selection of massive and multiple types of candidate knowledge in open innovation environments.
A comparative analysis shows that the proposed method could obtain reliable evaluation results and avoid information loss during the processes of evaluation integration. Furthermore, an integrated procedure of knowledge capture, evaluation and process problem-solving for micro-turbine machining reflects the practicability of reliable and formalized knowledge in manufacturing process innovation design.
5.2. Limitations and Future Research
With regard to application instances, this paper has confirmed that the combination of MCDM and fuzzy linguistic computing can reasonably aggregate evaluation information from the expert committee for process innovation knowledge. From the perspective of continuous application of computer-aided innovation, a large amount of knowledge and data could be accumulated on the CAPI platform. It is necessary, therefore, for further studies to be conducted to consider objective evaluation and dynamic updating, based on knowledge application on the innovation system. In addition, reconciling mechanisms of experts’ conflict evaluations should be further studied in practice.
The evaluation results in criteria and sub-criteria can provide a reference for knowledge improvement and this may contribute to effective knowledge evolution. The results highlighted in this paper can be broadly applied to open knowledge management practices of manufacturing enterprises. Future research will expand and deepen these results more comprehensively, including just-in-time knowledge recommendation for innovation design life cycle, integrated management of product design knowledge and process knowledge, optimal selection of innovation knowledge in cloud manufacturing environment, etc.