Manufacturing Process Innovation-Oriented Knowledge Evaluation Using MCDM and Fuzzy Linguistic Computing in an Open Innovation Environment

: In today’s complex, constantly evolving and innovation-supporting manufacturing systems, knowledge plays a vital role in sustainable manufacturing process planning and problem-solving, especially in the case of Computer-Aided Process Innovation (CAPI). To obtain formalized and promising process innovation knowledge under the open innovation paradigm, it is necessary to evaluate candidate knowledge and encourage improvement suggestions based on actual innovation situations. This paper proposes a process innovation-oriented knowledge evaluation approach using Multi-Criteria Decision-Making (MCDM) and fuzzy linguistic computing. Firstly, a comprehensive hierarchy evaluation index system for process innovation knowledge is designed. Secondly, by combining an analytic hierarchy process with fuzzy linguistic computing, a comprehensive criteria weighting determination method is applied to effectively aggregate the evaluation of criteria weights for each criterion and corresponding sub-criteria. Furthermore, fuzzy linguistic evaluations of performance ratings for each criterion and corresponding sub-criteria are calculated. Thus, a process innovation knowledge comprehensive value can be determined. Finally, an illustrative example of knowledge capture, evaluation and knowledge-inspired process problem solving for micro-turbine machining is presented to demonstrate the applicability of the proposed approach. It is expected that our model would lay the foundation for knowledge-driven CAPI in sustainable manufacturing.


Introduction
During the past decades, the structure of the world economy has undergone significant changes with demand for energy saving and environmental protection becoming increasingly urgent [1][2][3].To cope with this situation, developing countries need to transform and upgrade their manufacturing industries with process innovation to reduce energy consumption and achieve sustainable development; developed countries, accordingly, are trying to guide and accelerate the return of manufacturing industries for enhancing global competitive advantage by means of process innovation [4][5][6][7].Manufacturing process innovation, which includes the creation of new technical principles, methods and production modes, is a basic guarantee for the ultimate realization of product innovation and a fundamental means to achieve sustainable development of the manufacturing industry [8,9].In recent years, systematic innovation methodologies and technologies for manufacturing processes have gained greater attention in academic research and industry [10][11][12].Nevertheless, process innovation typically relies on cross-industry collaboration and potentially complex interdisciplinary system engineering [9]; thus, in addition to sophisticated manufacturing environments, the delivery of innovation is more dependent on highly qualified knowledge and knowledge-based systematic innovation methods [13][14][15][16][17]. Consequently, formalized process innovation-oriented knowledge acquisition and its management are becoming increasingly important and challenging for knowledge intensive manufacturing industries, such as aviation, aerospace and automotive sector.
The latest Web 2.0 technologies provide a technical means for open knowledge management, enabling large amounts of discrete knowledge to be shared in open environments [18,19], such as social wiki platforms.From the perspective of knowledge application in Computer-Aided Process Innovation (CAPI) [9], a formalized knowledge-oriented systematic design process is a prerequisite and basis for innovation implementation.Therefore, it is necessary to establish an effective knowledge evaluation method in open innovation environments.Process innovation knowledge evaluation is needed to identify the validity and novelty of such knowledge and to further analyze and understand the potential practicability and profitability in current manufacturing processes by considering the knowledge characteristics and manufacturing capacity.To select process innovation-oriented candidate knowledge, a reasonable evaluation index system is required.A quantitative index and qualitative factors based on the evaluation criteria can be evaluated by multiple domain experts.Accordingly, process innovation knowledge evaluation should be regarded as a group Multi-Criteria Decision-Making (MCDM) problem [20,21], concerned with how to evaluate candidate knowledge and how to raise improvement suggestions.
Due to the complexity and fuzziness of the above problems, it is difficult for decision makers to evaluate given objects using exact values, but they can express preferences using fuzzy linguistic values [22,23].Experts devote themselves to judging knowledge comprehensive values by subjective perception or experiential cognition during the decision-making process.However, there exists a certain extent of fuzziness, uncertainty and heterogeneity [24,25].In addition, there is a tendency towards information loss during integration processes and this can cause the evaluation results of knowledge performance levels to be inconsistent with the expectation of experts [26,27].In this event, there is a need to identify reasonable ways of calculating the performance ratings of process innovation-oriented knowledge during the process of evaluation integration.Therefore, the main objective of this research is to develop a comprehensive knowledge evaluation approach for supporting knowledge-driven CAPI.Firstly, an evaluation index system for process innovation knowledge is designed by domain experts, and necessary data from the expert committee are gathered to determine criteria weightings and performance ratings of candidate knowledge.Then, by combining an Analytic Hierarchy Process (AHP) with fuzzy linguistic computing, a comprehensive criteria weighting determination method for the knowledge evaluation index system is explored.What follows is the fuzzy linguistic evaluation of the performance ratings for each criterion and the corresponding sub-criteria can be calculated.Furthermore, it is possible to compute the process innovation-oriented knowledge comprehensive value and propose improvement suggestions based on the evaluation results.
The rest of this paper is organized as follows.In Section 2, background research and related work with definitions are introduced, while operations relating to 2-tuple fuzzy linguistic variable are explored.In Section 3, we introduce the comprehensive evaluation index system for process innovation knowledge, the model and procedure for process innovation-oriented knowledge evaluation, and the determination of comprehensive fuzzy weights.Then, a real case study of process innovation knowledge capture and evaluation for micro-cutting is illustrated in Section 4 and further studied, with a process problem solving example of a micro-turbine manufacturing issue being given.Finally, conclusions and future directions for research are discussed.

Knowledge-Driven Computer-Aided Process Innovation
The concept of process innovation was first proposed by Schumpeter [8] from the perspective of economic development and, soon after, received attention in both academic research and industry, especially in the context of energy saving and environmental protection [28,29].In recent years, some scholars have carried out useful explorations into specific types manufacturing process innovation by using the Theory of Inventive Problem Solving (Russian acronym: TRIZ) and knowledge engineering [11,[30][31][32].With the development of Computer-Aided Innovation (CAI) technology and the requirements of manufacturing process problem-solving [33], the concept of computer-aided process innovation was advanced, with some specific application cases being used to illustrate the feasibility of structured/systematic process innovation design [9,12,[34][35][36].In fact, the traditional computer aided methods of manufacturing process (e.g., Computer-Aided Process Planning (CAPP) and Computer-Aided Manufacturing (CAM)) are mainly used for improving the efficiency and standardization of process planning [37,38], while CAPI is more focused on solving manufacturing process problems, improving process methodologies, fostering whole process innovation design cycles and even enhancing the overall manufacturing innovation capability of enterprises.
As is commonly recognized, knowledge is an essential asset for organizations and plays a crucial role in innovation; innovation can be regarded as the knowledge-based creation, and the knowledge-based outcome [13,39,40].Process innovation knowledge is used to support process innovation activities correctly implemented and to produce new process knowledge.Obviously, the knowledge acquisition and management of CAPI is crucial to innovative design, especially in the context of open innovation.Hüsig and Kohn [18] introduced the "Open CAI 2.0" concept based on analysis of open innovation strategy and Web 2.0 technologies.By combining the technical characteristics of social networks with wiki technology, Wang et al. [9] proposed a novel process innovation knowledge accumulation schema based on bilayer social wiki network for CAPI.
In social wiki networks for CAPI, process innovation knowledge could be accumulated in a public knowledge space through participants' social interactions and knowledge activities, however, this generated knowledge may not be able to meet actual requirements-it still needs to be evaluated and optimized through reasonable means to ensure the quality of knowledge and support for knowledge-inspired innovation design, as shown in Figure 1.Hence, it is necessary to establish an evaluation index system for process innovation knowledge and to provide evaluation results and suggestions for improvement based on the evaluation information from expert groups.In this study, we will focus on knowledge evaluation for CAPI in an open-innovation environment.
this generated knowledge may not be able to meet actual requirements-it still needs to be evaluated and optimized through reasonable means to ensure the quality of knowledge and support for knowledge-inspired innovation design, as shown in Figure 1.Hence, it is necessary to establish an evaluation index system for process innovation knowledge and to provide evaluation results and suggestions for improvement based on the evaluation information from expert groups.In this study, we will focus on knowledge evaluation for CAPI in an open-innovation environment.

Definition and Computing of the Fuzzy Linguistic Method
In group decision making for knowledge evaluation, decision makers usually apply fuzzy linguistic evaluation based on subjective experiences due to the complexity of process innovation and decision making.In fuzzy linguistic approach, two traditional computational models can be identified: (1) a linguistic computing model based on membership functions [41]; and (2) a symbolic linguistic computing model which produces loss of information due to approximation processes and hence produces a lack of precision in results [42].To avoid information loss and to improve computational precision, Herrera and Martínez [26] proposed the 2-tuple fuzzy linguistic representation model.It not only inherits the existing advantage of fuzzy linguistic computing, but also overcomes the disadvantage of information loss experienced by other methods.
The 2-tuple linguistic computational model provides accurate and understandable results because they are represented by means of a linguistic term and a numerical value.A 2-tuple linguistic variable can be denoted as (s i , α i ), where s i represents the central value of the ith linguistic term, and α i denotes the distance to the central value of the ith linguistic term.A 2-tuple linguistic variable set typically comprises three, five, seven or more terms.Usually, a five-term set has more practical applications [22].Basic definitions and concepts of fuzzy linguistic variables are briefly given as follows.
Definition 1.Let S = s 0 , s 1 , . . ., s g be a linguistic term set, and β ∈ [0, 1] be a number value representing the aggregation result of linguistic symbolic.Then, the generalized translation function (∆ ) applied to translate β into a 2-tuple linguistic variable is defined as where round(•) is the usual round operation, s i has the closest attribute label to β, and α is the value of the symbolic translation.
Definition 2. On the contrary, a reverse equation ∆ −1 is necessary to convert the 2-tuple linguistic variable into its equivalent value β ∈ [0, 1] , which can be computed by the following formula Definition 3. Let S = {(s 1 , α 1 ), . . . ,(s n , α n )} be a set of 2-tuple fuzzy linguistic variable, where their arithmetic mean S is calculated as Definition 4. Let S = {(s 1 , α 1 ), . . . ,(s n , α n )} be a 2-tuple fuzzy linguistic variable set, and W = {w 1 , . . . ,w n } be the weight set of linguistic terms; their 2-tuple linguistic weighted average S w is calculated as Additionally, when W = {(w 1 , α w1 ), . . . ,(w n , α wn )} is the linguistic weight set of each s i , this linguistic weighted average operator can be computed as Definition 5. Let (s i , α i ) and (s j , α j ) be two 2-tuple fuzzy linguistic variables, where the comparison of both linguistic variables can be shown as: (c) If i = j and α i > α j , then (s i , α i ) is better than (s j , α j ).
(d) If i = j and α i < α j , then (s i , α i ) is worse than (s j , α j ).

Proposed Comprehensive Evaluation Index System for Process Innovation Knowledge
Knowledge evaluation is an important part of process innovation knowledge acquisition, which requires not only an effective evaluation method, but also a practical index system as the basis for evaluation.The selection of a knowledge evaluation index depends on the specific application environment and innovation objects, thus reasonable control of the size and flexibility of the index system is necessary.In this research, through a review of literature and discussion with domain experts, we present a comprehensive hierarchy evaluation index system for process innovation knowledge, as illustrated in Figure 2. The evaluation index system is composed of three levels: the first level is the overall goal; the second level comprises evaluation criteria; and the third level denotes corresponding sub-criteria for each criterion.The goal layer represents the core value of knowledge in the innovative application scenario, named Process Innovation Knowledge Comprehensive Value (PIKCV).The PIKCV is then divided into four parts through analysis of the characteristics of manufacturing process innovation: knowledge validity, knowledge novelty, potential practicability and manufacturing profitability.

Process Innovation-Oriented Knowledge Evaluation Model
In an open knowledge acquisition context, candidate innovation knowledge generally includes new theories, new methods and/or practical examples.Due to the novelty of knowledge and the complexity of process problems, it is difficult to fully evaluate the value of candidate process innovation knowledge from multiple criteria using exact values.In this situation, fuzzy linguistic variables are considered more reasonable for domain experts to evaluate the performance of PIKCV.Consequently, based on analysis of the comprehensive evaluation index system, a suitable evaluation model, using fuzzy linguistic computing, is proposed to measure the level of process innovation-oriented knowledge, as represented in Figure 3.The specific procedures of this proposed evaluation model are summarized as follows.

Process Innovation-Oriented Knowledge Evaluation Model
In an open knowledge acquisition context, candidate innovation knowledge generally includes new theories, new methods and/or practical examples.Due to the novelty of knowledge and the complexity of process problems, it is difficult to fully evaluate the value of candidate process innovation knowledge from multiple criteria using exact values.In this situation, fuzzy linguistic variables are considered more reasonable for domain experts to evaluate the performance of PIKCV.Consequently, based on analysis of the comprehensive evaluation index system, a suitable evaluation model, using fuzzy linguistic computing, is proposed to measure the level of process innovation-oriented knowledge, as represented in Figure 3.The specific procedures of this proposed evaluation model are summarized as follows.

Process Innovation-Oriented Knowledge Evaluation Model
In an open knowledge acquisition context, candidate innovation knowledge generally includes new theories, new methods and/or practical examples.Due to the novelty of knowledge and the complexity of process problems, it is difficult to fully evaluate the value of candidate process innovation knowledge from multiple criteria using exact values.In this situation, fuzzy linguistic variables are considered more reasonable for domain experts to evaluate the performance of PIKCV.Consequently, based on analysis of the comprehensive evaluation index system, a suitable evaluation model, using fuzzy linguistic computing, is proposed to measure the level of process innovation-oriented knowledge, as represented in Figure 3.The specific procedures of this proposed evaluation model are summarized as follows.Step 1. Form a suitable expert committee with members who are familiar with manufacturing process innovation design and the structure of the evaluation index system for the corresponding innovation knowledge.Let E = {E 1 , E 2 , . . . ,E M } be the established expert committee and K = {K 1 , K 2 , . . . ,K N } be a set of candidate process innovation knowledge.Additionally, assume that there are n criteria B i (i = 1, 2, . . ., n), and each criterion includes several sub-criteria C ij (i = 1, 2, . . ., n; j = 1, 2, . . ., t) in the evaluation index system for process innovation knowledge.
Step 2. Select appropriate granularity for the linguistic term set according to experience and the preference of decision makers, and gather necessary data containing criteria weights and the performance ratings from the expert committee.Transform these linguistic terms into 2-tuple linguistic variables; for example, (s w ijm , α w ijm ) can denote the 2-tuple fuzzy criteria weights of the jth sub-criteria regarding the ith criteria of the mth expert.
Step 3. Aggregate the fuzzy linguistic evaluations of criteria weights generated by the expert committee for each criterion and corresponding sub-criteria.According to the arithmetic mean Formula (3), the aggregated criteria weighting values of M experts are calculated as follows: where s w ijm is the fuzzy importance of sub-criteria j with respect to B i of the mth expert, s w im is the fuzzy importance of B i of the mth expert, and w E m ∈ [0, 1] is the expert weight of the mth expert in determination of criteria importance, In particular, when the expert weights are equal to each other, the aggregated criteria weighting values can be obtained using Formula (3): Step 4. Aggregate the fuzzy linguistic evaluations of performance rating for each sub-criterion with respect to each criterion.Assuming that expert weights are the same in performance evaluation of process innovation knowledge, we can obtain the aggregation of fuzzy linguistic evaluation values.
where s ijm is the fuzzy rating of sub-criteria j with respect to B i of the mth expert.
Step 5. Compute the fuzzy aggregated ratings of each criterion by applying Formula (4): where Step 6. Calculate the process innovation knowledge comprehensive value.The linguistic term s o can be used to represent the overall value level of process innovation knowledge in innovative design. where Step 7. Rank the candidate knowledge based on PIKCV results, and propose improvement suggestions, according to evaluation results in the corresponding criteria and sub-criteria.

Determination of Fuzzy Comprehensive Weights
The determination of weights is crucial to fuzzy comprehensive evaluation of process innovation knowledge; however, due to the complexity of creative problem-solving and the ambiguity of human thinking, it is difficult to give a clear standard weight.In general, experts are used to determine the weights using two methods: fuzzy linguistic representation and AHP.Here, to meet the diversity requirements of the expert group in weight determination, and to ensure the reliability of the weight coefficient, we compute the comprehensive weight of the knowledge evaluation system by combining AHP with fuzzy linguistic computing.

Weight Coefficient of AHP
The AHP method, developed by Saaty [43] in the 1970s, is widely used for dealing with MCDM problems in practical production engineering [7,20,25,[44][45][46].It decomposes complex decision problems into hierarchical structures, which can include goal layer, criterion layer and sub-criterion layer.Then, a series of pairwise comparisons is conducted among the elements at the same level, so as to construct the judgment matrix.The specific steps for determination of weight coefficient are as follows: 1.
A numerical rating for judgment matrix of pairwise comparison is suggested.Furthermore, a judgment matrix A is constructed according to pairwise comparisons.
where a ij is the relative importance comparison value of element u i to element u j , and Calculate the weighted weight set W A according to the judgment matrix by using the following formula: 3.
An index, called consistency index (CI), is then used to measure the amount of inconsistency within the pairwise comparison matrix A.
where λ max is the largest eigenvalue of A, calculated as follows: Accordingly, the Consistency Rate CR is used to measure the degree of CI by using the following formula: where RI is the random consistency index, its value being dependent on the order of matrix (as listed in Table 1).When CR < 0.1, the judgment matrix and weights of elements are acceptable.Otherwise, the comparison matrix must be adjusted and decision makers should be asked to re-judge.

Weight Coefficient of Fuzzy Linguistic Computing
The aggregated criteria weighting values for each criterion and corresponding sub-criteria can be obtained using Formulae ( 6)-( 9).Then, the following formulae are used to normalize these aggregated weights: where β w i is the aggregated result of ith criterion in the criterion layer and n is the number of criteria.
where β w ij is the aggregated result of jth sub-criterion in the sub-criterion layer and n is the number of sub-criteria for ith criterion.

Fuzzy Comprehensive Weights
By considering the weight information from the expert group of AHP and fuzzy linguistic computing, we can obtain the fuzzy comprehensive weights.
where W C is the fuzzy comprehensive weight set of knowledge evaluation; W A is the weighted weight set of the AHP expert group; W L is the aggregated weight set of fuzzy linguistic computing; and ∑ A w E m and ∑ L w E m are the sums of expert weights from expert groups of AHP and fuzzy linguistic computing, respectively;

An Illustrative Example
To illustrate the applicability of the developed approach, a real case study of process innovation knowledge capture and evaluation for micro-cutting is presented.A contrastive analysis and discussion between the proposed method and traditional simple weight additive (SWA) method is performed.Thereafter, knowledge-inspired process problem solving for micro-turbine manufacturing is illustrated.

Process Innovation Knowledge Capturing and Evaluating
Process innovation knowledge, which exists in the entire life cycle of CAPI, is used to support process innovation activities and, if correctly implemented, produces new process knowledge.According to Wang et al. [9] and Geng et al. [12], process innovation knowledge can be divided into several types, including problem description template (PDT), process contradiction matrix (PCM), manufacturing scientific effect (MSE), innovative scheme instance (ISI), manufacturing capability description (MCD), etc.Through knowledge contributors' social wiki activities in the context of open innovation, multiple types of process innovation knowledge for micro-cutting technology have been initially accumulated.Among this knowledge, there are six solving principles of PCM that need to be evaluated for a specific innovation scenario: {K 1 , K 2 , K 3 , K 4 , K 5 , K 6 }.In the following section, we take principle knowledge as an example to illustrate the concrete process of innovation knowledge evaluation and selection.

Gathering of Evaluation Data
To gather necessary data, the researchers conducted in-depth interviews with an expert committee, the members of which include a process designer, innovation expert and technical manager and who were introduced to the linguistic variables and their semantics.The committee consisted of three experts: {E 1 , E 2 , E 3 }.The Linguistic variables of the importance and rating are displayed in Table 2. Unimportant (U) Poor (P) (0, 0.25, 0.5) s 2 Fair (F) Fair (F) (0.25, 0.5, 0.75) s 3 Important (I) Good (G) (0.5, 0.75, 1.0) s 4 Very important (VI) Very good (VG) (0.75, 1.0, 1.0) In determining the weights of the evaluation system, two experts (E 1 , E 2 ) used fuzzy linguistic variables and one expert (E 3 ) used AHP.Linguistic evaluation and weighting values from E 1 , E 2 are listed in Table 3, and the judgment matrices of criteria and sub-criteria from E 3 are shown as follows.
Linguistic evaluation and weighting value of importance of each criterion and corresponding sub-criteria.The performance ratings of sub-criteria for candidate knowledge are given in Table 4.

. Determination of Criteria Weights
In determining the criteria weights for this study, we assume that the vector of expert weight is [0.3, 0.3, 0.4] according to the experts' professional knowledge and innovation background.Thus, by using Formulae ( 6)-( 9), the aggregated criteria weights of each criterion and corresponding sub-criteria are obtained, as shown in the rightmost column of Table 3.For example, the weights of "Reliability" and "Knowledge validity" are calculated as After normalizing the aggregated weighting value in Table 3, we obtain fuzzy linguistic weights for criterion layer and sub-criterion layer.

Calculation of the PIKCV
In performance evaluation, we assume expert weights are equal and use Formula (10) to compute the aggregation of fuzzy linguistic evaluation values of sub-criteria.For example, the evaluation value of "Reliability" for K 1 is calculated as Similarly, the fuzzy aggregated ratings of each criterion of K 1 can be calculated, as shown in Table 5.For example, the aggregated rating value of "Knowledge validity" for K 1 is obtained by using Formula (11): Based on the above steps, we can compute the PIKCV of six candidates' knowledge by using Formula (13), as shown in Table 6.For example, the PIKCV of K 1 is calculated as

Comparison and Analysis of Knowledge Evaluation Results
It may be seen in Table 6 that the PIKCV of alternative K 1 , (s 3 , 0.043), represents slightly higher than "Good", and the alternative K 1 is worse than K 3 , since K 3 is closer to the linguistic term s 4 .The overall ranking of the six principle knowledge candidates is K 5 K 3 K 1 K 6 K 4 K 2 .K 5 is the best knowledge candidate with K 3 following thereafter.These aggregated results are consistent with experts' opinion.On the other hand, the overall evaluation result of K 1 is 0.39, which was calculated using the SWA method with the same data, as shown in Table 7.This translates into the degree of membership, which is 0.56 and 0.44.In other words, the overall evaluation result of K 1 is worse than "Fair" when applying the SWA method.It is obvious that the evaluation results obtained by the SWA method are not consistent with the opinions of the expert committee.Hence, to some extent, it demonstrates that the proposed method in this study can effectively aggregate fuzzy linguistic (2) Process contradiction extraction and resolution.According to the problem description, the innovation system can conveniently extract conflicting parameters, i.e., strengthening parameter and weakening parameter.Then, the innovative solving principles will be presented based on PCM, namely solving principles 1, 6, 7 and 9.These principles help to inspire the designer's creative thinking.Through a detailed analysis, two principle solutions (as shown in Figure 4) are considered effective in the problem-solving.By associating with MSE, an initial solution for thin-walled blade machining is obtained: Utilizing its cylindrical surface for clamping, but not handling the ball surface during this step.(3) Innovation scheme design.With the support of ISI and MCD, we can design the detailed scheme in the existing manufacturing environment.After two iterations of conflict resolution, we get the scheme for spherical convex processing: By means of the threaded connection (its own structure/function) to realize positioning and clamping, and to ensure the dimensional precision of blades.

Conclusions
As competition in global markets intensifies, process innovation has been recognized as a key factor for enhancing sustainable competitive advantage in manufacturing organizations.However, in the implementation of knowledge-driven CAPI, an important challenge that must be faced is how to evaluate and select appropriate process innovation knowledge from an open knowledge acquisition environment.In this paper, we have presented a manufacturing process innovation-oriented knowledge evaluation approach using MCDM and fuzzy linguistic computing.Some of the key contributions of this study are listed below:  By considering process innovation knowledge characteristics and innovative applications, a comprehensive hierarchy evaluation index system is designed to measure the PIKCV, which In this case, the innovative solutions of micro-turbine machining have been gradually revealed through multiple types of knowledge application and design thinking inspiration.We can see that quality evaluation and rational application of innovation knowledge are of great importance in innovation realization and the proposed method in this research is applicable for open manufacturing process innovation.

Conclusions
As competition in global markets intensifies, process innovation has been recognized as a key factor for enhancing sustainable competitive advantage in manufacturing organizations.However, in the implementation of knowledge-driven CAPI, an important challenge that must be faced is how to evaluate and select appropriate process innovation knowledge from an open knowledge acquisition environment.In this paper, we have presented a manufacturing process innovation-oriented knowledge evaluation approach using MCDM and fuzzy linguistic computing.Some of the key contributions of this study are listed below:

•
By considering process innovation knowledge characteristics and innovative applications, a comprehensive hierarchy evaluation index system is designed to measure the PIKCV, which can express the core value of knowledge in potential manufacturing innovation scenarios.

•
A manufacturing process innovation-oriented knowledge evaluation model, based on AHP and fuzzy linguistic computing, is applied to effectively aggregate the evaluation value into the expert committee's comprehensive evaluation information in criteria weights and performance ratings.This model can meet the needs of rapid evaluation and selection of massive and multiple types of candidate knowledge in open innovation environments.

•
A comparative analysis shows that the proposed method could obtain reliable evaluation results and avoid information loss during the processes of evaluation integration.Furthermore, an integrated procedure of knowledge capture, evaluation and process problem-solving for micro-turbine machining reflects the practicability of reliable and formalized knowledge in manufacturing process innovation design.

Limitations and Future Research
With regard to application instances, this paper has confirmed that the combination of MCDM and fuzzy linguistic computing can reasonably aggregate evaluation information from the expert committee for process innovation knowledge.From the perspective of continuous application of computer-aided innovation, a large amount of knowledge and data could be accumulated on the CAPI platform.It is necessary, therefore, for further studies to be conducted to consider objective evaluation and dynamic updating, based on knowledge application on the innovation system.In addition, reconciling mechanisms of experts' conflict evaluations should be further studied in practice.
The evaluation results in criteria and sub-criteria can provide a reference for knowledge improvement and this may contribute to effective knowledge evolution.The results highlighted in this paper can be broadly applied to open knowledge management practices of manufacturing enterprises.Future research will expand and deepen these results more comprehensively, including just-in-time knowledge recommendation for innovation design life cycle, integrated management of product design knowledge and process knowledge, optimal selection of innovation knowledge in cloud manufacturing environment, etc.

Figure 1 .
Figure 1.Process innovation-oriented knowledge evaluation in an open innovation environment.Figure 1. Process innovation-oriented knowledge evaluation in an open innovation environment.

Figure 1 .
Figure 1.Process innovation-oriented knowledge evaluation in an open innovation environment.Figure 1. Process innovation-oriented knowledge evaluation in an open innovation environment.

Figure 2 .
Figure 2. The proposed comprehensive evaluation index system for process innovation knowledge.

Figure 3 .
Figure 3.The procedure of manufacturing process innovation-oriented knowledge evaluation.

Figure 2 .
Figure 2. The proposed comprehensive evaluation index system for process innovation knowledge.

Figure 2 .
Figure 2. The proposed comprehensive evaluation index system for process innovation knowledge.

Figure 3 .
Figure 3.The procedure of manufacturing process innovation-oriented knowledge evaluation.Figure 3. The procedure of manufacturing process innovation-oriented knowledge evaluation.

Figure 3 .
Figure 3.The procedure of manufacturing process innovation-oriented knowledge evaluation.Figure 3. The procedure of manufacturing process innovation-oriented knowledge evaluation.

Figure 4 .
Figure 4.A micro-turbine process problem-solving by using process innovation knowledge.

Figure 4 .
Figure 4.A micro-turbine process problem-solving by using process innovation knowledge.

Table 1 .
Random consistency index of judgment matrix.

Table 2 .
Linguistic variable and its semantics for the importance and rating.

Table 4 .
Performance ratings of sub-criteria for candidate knowledge.

Table 5 .
The aggregated results of fuzzy comprehensive evaluation for K 1 .

Table 6 .
The overall evaluation results and ranking of candidate knowledge.