Next Article in Journal
A New Method for Analyzing the Performance of the Harmony Search Algorithm
Next Article in Special Issue
A Two-Phase Model for Personnel Selection Based on Multi-Type Fuzzy Information
Previous Article in Journal
An Iteration Function Having Optimal Eighth-Order of Convergence for Multiple Roots and Local Convergence
Previous Article in Special Issue
A Proposal of an Adaptive Neuro-Fuzzy Inference System for Modeling Experimental Data in Manufacturing Engineering
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Supplier Selection by Fuzzy Assessment and Testing for Process Quality under Consideration with Data Imprecision

by
Kuen-Suan Chen
1,2,
Tsang-Chuan Chang
3,* and
Chien-Che Huang
4,*
1
Department of Industrial Engineering and Management, National Chin-Yi University of Technology, Taichung 41170, Taiwan
2
Department of Business Administration, Chaoyang University of Technology, Taichung 41349, Taiwan
3
College of Intelligence, National Taichung University of Science and Technology, Taichung 40401, Taiwan
4
Department of Leisure and Recreation Management, National Taichung University of Science and Technology, Taichung 40401, Taiwan
*
Authors to whom correspondence should be addressed.
Mathematics 2020, 8(9), 1420; https://doi.org/10.3390/math8091420
Submission received: 7 August 2020 / Revised: 18 August 2020 / Accepted: 20 August 2020 / Published: 24 August 2020
(This article belongs to the Special Issue Fuzzy Applications in Industrial Engineering)

Abstract

:
Supply chain management models integrate upstream and downstream organizations to enable rapid response to consumer needs. For the manufacturing industry, the process quality of suppliers is thus the foundation of sustainable growth for firms and an important indicator of whether a firm can effectively reduce waste and protect the environment. To this end, this paper proposes a model of supplier selection for manufacturers based on process quality assessment. First of all, Six Sigma quality index Q p k is adopted as the assessment tool to conveniently measure the quality level of process. Practical applications require estimates of Q p k from the data collected to analyze the process quality of each supplier. The fact that uncertainty is unavoidable in the collected data means that using the crisp estimate of Q p k can lead to misjudgment of the process quality. To enhance the reliability of evaluation and reduce the risk of misjudgment, the fuzzy number Q ^ ˜ p k is proposed to perform the fuzzy testing of two indices Q p k provided by suppliers with the intent of making reliable decisions on supplier selection.

1. Introduction

Due to globalization, firms have been developing technologies and products with large markets and high added value based on industry differences and similarities as well as the potentially massive demands of future markets to satisfy the requirements of various consumers and achieve sustainable development. To maintain industrial competitiveness, firms must continually enhance their technical capabilities, improve product quality, shorten lead time, and cut down costs. They must also maintain flexible production processes and respond quickly to changes in the market. These capabilities are well supported by supply chain management models that integrate upstream and downstream organizations. The growing prevalence of these intercorporation business models have led to the introduction of strategic alliances in which profits are shared with supply chain members so as to enable rapid response to consumer needs.
A good supply chain requires coordination among many cooperating organizations, among which material suppliers or service providers have the closest relationship with firms. When a firm is allied with a good supplier, it can obtain the support of outsourced services and even increase the competitiveness of the entire industry chain. In contrast, working with a supplier performing poorly may result in inconsistent product quality and delayed deliveries, thereby causing the firm to lose its competitive advantage in the market. Current trends in business development have made supplier quality vital to a firm’s operational success. The development of an objective supplier selection model therefore represents a valuable contribution to the field.
As time goes on, changes in corporate competitive models, production strategies, and industry characteristics mean the factors that firms take into consideration in supplier selection and their relevant weights also change. In existing literature regarding supplier selection, the three attributes frequently employed to evaluate suppliers are quality, cost price, and delivery [1,2,3,4,5]. However, as Kellner et al. [6] pointed out, supplier selection usually involves multiple criteria, and criteria often conflict with each other. For instance, lower procurement costs may mean inconsistent quality with respect to components and parts. This may affect the firm’s processing performance and product quality. Chen and Chen [7] indicated that shortening the lead time may also affect product quality. As a result, firms should endeavor to maintain or enhance product quality as their primary objective with the prerequisite of not delaying the lead time. Furthermore, the most important attribute for a firm in evaluating the optimal supplier is to have quality [8,9,10] as their primary consideration in supplier selection. By comparison, high process quality and good service are the most important attributes for strategic partners.
On the other hand, increasing awareness of the need for environmental protection and sustainable development has also placed the environmental impact of products under scrutiny. Many nations and firms have thus been advocating for a circular economy in recent years. This entails dismantling the conventional linear economy in favor of industry models that circulate resources. In the industrial production and consumption system of a linear economy, resources undergo the process of take, make, use, and dispose. This means that many resources are only used once before they are considered devoid of usefulness and value. In contrast, a circular economy emphasizes the full utilization of resources to eliminate waste. This increases resource utilization efficiency and strikes a balance between the needs of the economy and the environment. Clearly, the implementation of a circular economy contributes to minimizing pollution in production and consumption as well as turning waste into resources or nonhazardous waste.
Increasing environmental awareness has solidified the place of the 4Rs in the production and supply systems of firms in pursuit of sustainable development. To attain the production requirements of this trend, increasing the process quality of products is a crucial implementation strategy. Increasing process quality reduces scrap and rework rates of production (reduce), increases product availability and thereby increases the proportion of products that are reused (reuse), and ensures the quality of all product components, which not only enhances their recovery rate (recover) but also increases the likelihood of their transformation into new products (recycle). Thus, quality improvement in processes can effectively assist firms in striking a balance between the needs of the economy and the environment to attain sustainable development. Ahujaet and Khamba [11] and Cornuel [12] also indicated that quality enhancement has become a trend in organizational operation and management as well as a critical factor of sustainable development. From the above, we can see that the process quality of products is the foundation of corporate survival and an important indicator of whether a firm can protect the environment by reducing waste. Thus, this paper proposes a model for optimal supplier selection based on process quality from the perspective of a circular economy.
In view of the fact that the value of Six Sigma quality index (SSQI) Q p k represents the achieved quality level for a process of interest, we used it to assess the process quality provided by suppliers. In practice, the Q p k value must be calculated using the collected sample data. This increases uncertainty assessment due to sampling error. Consequently, using point estimates Q ^ p k for index calculation may procure inaccuracy in assessing the process quality provided by a supplier. For this reason, we attempted to derive the 100 ( 1 α ) % confidence interval (CI) of Q p k and applied this in development of a supplier selection model aimed at long-term collaboration. On the other hand, the inherent uncertainty in the collected data is unavoidable. Therefore, the approach with crisp estimate of Q p k is not suitable for use in the quality assessment of a supplier. To enhance the reliability of evaluation and reduce the risk of miscalculation, we proposed a triangular-shaped fuzzy number (TFN) of Q ^ p k and further developed a fuzzy model of selecting a supplier with the intent of making reliable selection decisions for optimal supplier selection. Thus, in addition to ensuring that the products produced by firms satisfy the needs of the end customer, the proposed model can also lead firms toward sustainable development.
The structure of this paper is as follows. In Section 2, the SSQI Q p k corresponding to assessing the quality level of each process characteristic is given. Section 3 presents the derivation of 100 ( 1 α ) % confidence intervals for Q p k . In Section 4, the fuzzy hypothesis testing for two indices Q p k is proposed to select a supplier with consideration of data imprecision. An illustrative example is conducted in Section 5 to demonstrate the applicability of the proposed fuzzy testing approach for supplier selection. The conclusion and the summary of this paper are drawn in Section 6.

2. SSQI Q p k

A process capability index (PCI) uses numerical quantification to examine the relationship between process performance and product specification. Many studies have used PCIs to judge whether a given process reaches the ability or quality demanded by customers [13,14,15,16,17,18,19,20]. At present, C p k is the most frequently used PCI for manufacturing industries [21]. A general formula of C p k is as follows:
C p k = min { U S L μ 3 σ , μ L S L 3 σ }
where μ and σ denote the process mean and standard deviation of the process, respectively, and U S L and L S L represent the upper and lower specification limits, respectively. As indicated by Boyles [22], the measurement index C p k is defined by process yield. Under the assumptions that the process data follows N ( μ , σ 2 ) , the relationship between process yield and C p k is 2 Φ ( 3 C p k ) 1 Y i e l d % Φ ( 3 C p k ) . Clearly, process yield can be reflected fully by C p k .
Six Sigma strategies introduced in the 1980s can identify and eliminate the causes of process defects to enhance the quality of the output of a process [23,24,25]. Linderman et al. [26] observed that the quality of a given process achieves the 6 σ level when σ = d / 6 and | μ T | 1.5 σ , where d = ( U S L L S L ) / 2 . This means that only when σ = d / k and | μ T | 1.5 σ can the quality for a given process in question be claimed to achieve the k σ level. Based on the above criteria, numerous researchers have conducted studies on the relationship between quality level in Six Sigma and various PCIs to judge whether the quality of a given process achieves the level required by customers [27,28,29,30,31]. Although these studies effectively evaluated process quality level, their PCI values could only indicate the range of the achieved quality level. To overcome this inconvenience in assessing the quality level, Chen et al. [32] proposed the SSQI Q p k based on the concept of quality level in Six Sigma. A general formula of Q p k is as follows:
Q p k = min { U S L μ + 1.5 σ σ , μ L S L + 1.5 σ σ }
Unfortunately, a single index value does not convey sufficient information. In the event that the quality level corresponding to a quality characteristic does not meet the needs of customers, the Q p k value cannot point toward the cause of poor performance or provide the manufacturer with reference for improvement. In view of the fact that γ and δ can analyze the degrees of variance and shift in quality characteristics, respectively, many researchers convert PCIs into both of their functions. This approach can lead manufacturers to formulate targeted improvement measures [33,34,35,36,37]. γ and δ are the precision and accuracy indices [38], respectively, defined as follows:
γ = σ d   and   δ = μ T d
where T denotes the process target value. Clearly, in case the quality of a given process achieves the k σ level, Equation (3) can be re-expressed based on the previous point as follows:
γ = σ d = 1 k   and   | δ | = | μ T | d 1.5 k
Thus, according to Equation (2), Q p k can be written as functions of γ and δ to more accurately indicate the causes of poor process quality level:
Q p k = min ( 1 δ γ + 1.5 , 1 + δ γ + 1.5 ) = { 1 δ γ + 1.5 ,   for   δ > 0 1 γ + 1.5 ,   for   δ = 0 1 + δ γ + 1.5 ,   for   δ < 0
From Equations (4) and (5), Q p k = k can be obtained. This means that the value k of Q p k equals the k σ level achieved for the quality of an interested process. Thus, Q p k makes manufacturers conveniently available to analyze the quality level and the cause of poor quality. Furthermore, Chen et al. [32] indicated that Q p k has a one-to-one relationship Y i e l d % 2 Φ ( Q p k 1.5 ) 1 with process yield. It is relatively easy to see that a larger Q p k means better process performance and higher process yield.

3. Confidence Interval of Q p k

In practice, both σ and μ are definitely unknown population parameters. For this reason, manufacturers need to estimate σ and μ from collected sample data and judge whether the quality level corresponding to a quality characteristic achieves the required needs of customers. Without loss of generality, we assumed that the quality characteristic X with two-sided specification limits follows N ( μ , σ 2 ) . We can obtain n sample observations X 1 , X 2 , , X n via random sampling. Furthermore, let Y = ( X T ) / d , then Y ~ N ( δ , γ 2 ) . The estimate of Q p k can be expressed as follows:
Q ^ p k = { 1 δ ^ γ ^ + 1.5 ,   for   δ ^ > 0 1 γ ^ + 1.5 ,   for   δ ^ = 0 1 + δ ^ γ ^ + 1.5 ,   for   δ ^ < 0
where δ ^ = ( X ¯ T ) / d = Y ¯ = i = 1 n Y i / n , X ¯ = i = 1 n X i / n , γ ^ = s / d = i = 1 n ( Y i Y ¯ ) 2 / n , s = i = 1 n ( X i X ¯ ) 2 / n . Clearly, Q ^ p k is the maximum likelihood estimate (MLE) of Q p k because s 2 and X ¯ are the MLEs of σ 2 and μ , respectively.
However, the structure of the samples may not be exactly the same as that of the population, which means that it is impossible to completely eliminate sampling error. Consequently, the estimated value Q ^ p k cannot be expected to be equal to the true value of Q p k . It is clear that using Q ^ p k to judge the quality level of a given process may lead to misjudgment. In contrast, the CI is a range that estimates where the true population value lies. For this reason, many studies have employed the CI to judge whether the quality of a given process achieves the level required by customers [39,40,41,42,43,44]. In view of this, we derived the 100 ( 1 α ) % CI for Q p k to analyze whether the quality level of an interested process meets the acceptable level. This approach effectively handles the uncertainty involved in process quality assessment. We then used the CI to develop a supplier selection model.
First, let Z = n ( δ ^ δ ) / γ and K = n γ ^ 2 / γ 2 . Then, K and Z follow χ n 1 2 and N ( 0 , 1 ) , respectively, under the assumption of normality. This implies P ( K l K K u ) = 1 α and P { Z u Z Z u } = 1 α , where Z u denotes Z α / 2 , and K l and K u denote χ α / 2 , n 1 2 and χ 1 ( α / 2 ) , n 1 2 , respectively. More specifically, χ α / 2 , n 1 2 denotes the lower α / 2 quantile of χ n 1 2 , and Z α / 2 is the upper α / 2 quantile of N ( 0 , 1 ) , where α = 1 1 α and α is the significance level. As δ ^ and γ ^ 2 are mutually independent, so are Z and K . Based on this relationship, the following equation can be easily obtained:
P { K l K K u , Z u Z Z u } = 1 α
Equivalently,
P { γ ^ n K u γ γ ^ n K l , δ ^ γ Z u n δ δ ^ + γ Z u n } = 1 α
The interval of δ , [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ] , may or may not include 0. We examined these two cases. Let straight line L and set C R be as follows:
L : δ = 0   and   C R = { ( γ , δ ) | γ ^ n K u γ γ ^ n K l , δ ^ γ Z u n δ δ ^ + γ Z u n }
Case 1. 
0 [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ]
When the intersection between L and C R is not an empty set (i.e., L C R ϕ ), 0 [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ] . We can thus infer that δ = 0 . Thus, Q p k = γ 1 + 1.5 . In this case, Equation (8) can be re-expressed as follows:
P { γ ^ n K u γ γ ^ n K l } = 1 α s
Clearly, when 0 [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ] , the 100 ( 1 α ) % CI of Q p k , [ L Q p k , U Q p k ] , can be written as follows:
[ L Q p k , U Q p k ] = [ ( Q ^ p k 1.5 ) K l n + 1.5 , ( Q ^ p k 1.5 ) K u n + 1.5 ]
Case 2. 
0 [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ]
When the intersection between L and C R is an empty set (i.e., L C R = ϕ ), 0 [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ] . We can infer that δ 0 . We can then derive the 100 ( 1 α ) % CI of Q p k when δ > 0 and δ < 0 :
a. 
When δ > 0 , Equations (5) and (8) indicate that Q p k = ( 1 δ ) γ 1 + 1.5 and δ ^ Z u ( γ ^ / K l ) > 0 , so Q ^ p k = ( 1 δ ^ ) γ ^ 1 + 1.5 . Equation (8) can therefore be rewritten as follows:
P { 1 δ ^ γ Z u n + 1.5 1 δ γ + 1.5 1 δ ^ γ + Z u n + 1.5 , γ ^ n K u γ γ ^ n K l } } = 1 α P { 1 δ ^ γ ^ ( K l n ) Z u n + 1.5 Q p k 1 δ ^ γ ^ ( K u n ) + Z u n + 1.5 } = 1 α P { ( Q ^ p k 1.5 ) K l n Z u n + 1.5 Q p k ( Q ^ p k 1.5 ) K u n + Z u n + 1.5 } = 1 α
Clearly, when 0 [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ] and δ ^ Z u ( γ ^ / K l ) > 0 , the 100 ( 1 α ) % CI of Q p k , [ L Q p k , U Q p k ] , can be written as follows:
[ L Q p k , U Q p k ] = [ ( Q ^ p k 1.5 ) K l n Z u n + 1.5 , ( Q ^ p k 1.5 ) K u n + Z u n + 1.5 ]
b. 
Similarly, when δ < 0 , Equations (5) and (8) indicate that Q p k = ( 1 + δ ) γ 1 + 1.5 and δ ^ + Z u γ ^ / K l < 0 , so Q ^ p k = ( 1 + δ ^ ) γ ^ 1 + 1.5 . Equation (8) can therefore be rewritten as follows:
P { 1 + δ ^ γ Z u n + 1.5 1 + δ γ + 1.5 1 + δ ^ γ + Z u n + 1.5 , γ ^ n K u γ γ ^ n K l } } = 1 α P { 1 + δ ^ γ ^ ( K l n ) Z u n + 1.5 Q p k 1 + δ ^ γ ^ ( K u n ) + Z u n + 1.5 } = 1 α P { ( Q ^ p k 1.5 ) K l n Z u n + 1.5 Q p k ( Q ^ p k 1.5 ) K u n + Z u n + 1.5 } = 1 α
c. 
Clearly, when 0 [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ] and δ ^ + Z u γ ^ / K l < 0 , the 100 ( 1 α ) % CI of Q p k , [ L Q p k , U Q p k ] , can be written as follows:
[ L Q p k , U Q p k ] = [ ( Q ^ p k 1.5 ) K l n Z u n + 1.5 , ( Q ^ p k 1.5 ) K u n + Z u n + 1.5 ]
For reasons of convenience, based on Equations (11), (13), and (15), L Q p k and U Q p k of the 100 ( 1 α ) % CI for Q p k can be expressed as follows:
L Q p k = ( Q ^ p k 1.5 ) K l n I × Z u n + 1.5
U Q p k = ( Q ^ p k 1.5 ) K u n + I × Z u n + 1.5
where I = 0 if 0 [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ] , and I = 1 if 0 [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ] .

4. A Fuzzy Model of Supplier Selection

4.1. Model of Supplier Selection by General Hypothesis Testing

To effectively construct an objective and scientific supplier selection model, we used statistical hypothesis testing to assist firms in comparing the index Q p k provided from two suppliers and further established criteria for judgment. We let Q p k i and Q p k j represent the process quality level of suppliers i and j , respectively, where i j . The statistical hypothesis testing of the process quality levels between suppliers i and j is as follows:
{ H 0 : Q p k i = Q p k j H 1 : Q p k i Q p k j
Using Equations (11), (13) and (15), we can obtain the 100 ( 1 α ) % CIs D i = [ L Q p k i , U Q p k i ] and D j = [ L Q p k j , U Q p k j ] for Q p k i and Q p k j , respectively. We thus employed CI to compare the process quality levels between suppliers i and j . The recommended selection criteria are as follows:
  • If D i D j ϕ , then L Q p k i U Q p k j U Q p k i or L Q p k i L Q p k j U Q p k i . In this case, we did not reject H 0 because of insufficient evidence, which means Q p k i = Q p k j . The firm can select supplier i or j as a long-term partner.
  • If D i D j = ϕ , then we have sufficient evidence against the null hypothesis H 0 to reject it. The supplier the firm should choose as a long-term partner depends on the following conditions:
    (1)
    If U Q p k j < L Q p k i , then Q p k i > Q p k j . The firm should therefore choose supplier i to ensure that their end products offer features required to meet customers’ needs and that they progress toward sustainable development.
    (2)
    Conversely, if L Q p k j > U Q p k i , then Q p k j > Q p k i . This means that the process quality level of supplier j is higher than that of supplier i . The firm should therefore choose supplier j as a long-term partner.

4.2. Fuzzy Estimator for Q p k h of Supplier h

As mentioned before, fuzziness and stochastic uncertainty exist in data collected from real-world situations. Taking this into account, it is possible for the above hypothesis testing to make a misjudgment. We thus proposed a TFN of Q ^ p k and further developed a fuzzy model of selecting a supplier to enhance the reliability of evaluation and reduce the risk of miscalculation. According to Equations (6), (11), (13) and (15), we can obtain the Q ^ p k of supplier h as follows:
Q ^ p k h = { 1 δ ^ h γ ^ h + 1.5 ,   for   δ ^ h Z u ( γ ^ h / K l ) > 0 1 γ ^ h + 1.5 ,   for   0 [ δ ^ h Z u ( γ ^ h / K l ) , δ ^ h + Z u ( γ ^ h / K l ) ] 1 + δ ^ h γ ^ h + 1.5 ,   for   δ ^ h + Z u ( γ ^ h / K l ) < 0
By the inspiration of Buckley [45], the α - cuts of the TFN Q ^ ˜ p k h for supplier h can be obtained as follows:
Q ^ ˜ p k h [ α ] = { [ Q ^ p k h 1 ( α ) , Q ^ p k h 2 ( α ) ] ,   for   0.01 α 1 [ Q ^ p k h 1 ( 0.01 ) , Q ^ p k h 2 ( 0.01 ) ] ,   for   0 α 0.01
where Q ^ p k h 1 ( α ) = ( Q ^ p k h 1.5 ) K l n I × Z u n + 1.5 and Q ^ p k h 2 ( α ) = ( Q ^ p k h 1.5 ) K u n + I × Z u n + 1.5 .
For 0.01 α 1 , starting at 0.01 is arbitrary so we can begin at 0.001 or 0.005, etc. When α = 1 , then Q ^ p k h 1 ( 1 ) = [ ( Q ^ p k h 1.5 ) χ 0.5 , n 1 2 / n ] + 1.5 = Q ^ p k h 2 ( 1 ) . Thus, the TFN Q ^ ˜ p k h of Q ^ p k h can be defined as follows:
Q ^ ˜ p k h = [ Q ^ p k h 1 ( 0.01 ) , Q ^ p k h 1 ( 1 ) = Q ^ p k h 2 ( 1 ) , Q ^ p k h 2 ( 0.01 ) ]
where
Q ^ p k h 1 ( 0.01 ) = ( Q ^ p k h 1.5 ) χ 0.0025 , n 1 2 n I × Z 0.0025 n + 1.5 , Q ^ p k h 1 ( 1 ) = Q ^ p k h 2 ( 1 ) = ( Q ^ p k h 1.5 ) χ 0.5 , n 1 2 n + 1.5 , Q ^ p k h 2 ( 0.01 ) = ( Q ^ p k h 1.5 ) χ 0.9975 , n 1 2 n + I × Z 0.0025 n + 1.5 .
Under the circumstances, the membership function (MF) of Q ^ ˜ p k h can be presented as follows:
ψ Q ^ ˜ p k h ( x ) = { 0 ,   if   x < Q ^ p k h 1 ( 0.01 ) α 1 ,   if   Q ^ p k h 1 ( 0.01 ) x < Q ^ p k h 1 ( 1 ) 1 ,   if   x = Q ^ p k h 1 ( 1 ) = Q ^ p k h 2 ( 1 ) α 2 ,   if   Q ^ p k h 2 ( 1 ) < x Q ^ p k h 2 ( 0.01 ) 0 ,   if   Q ^ p k h 2 ( 0.01 ) < x
where α 1 and α 2 are determined by Q ^ p k h 1 ( α 1 ) = x and Q ^ p k h 2 ( α 2 ) = x , respectively. Figure 1 presents the MF of Q ^ ˜ p k h with Q ^ p k h = 4 , 0 [ δ ^ h Z u ( γ ^ h / K l ) , δ ^ h + Z u ( γ ^ h / K l ) ] for n = 50 , 70, and 100.

4.3. Fuzzy Model of Supplier Selection by Fuzzy Hypothesis Testing

We know from Section 4.1 that the quality level of supplier i is better than supplier j when U Q p k j < L Q p k i ; conversely, the quality level of supplier j is better than supplier i when U Q p k i < L Q p k j . As Q ^ p k h of supplier h changes into a TFN Q ^ ˜ p k h with consideration of data uncertainty, the decision rule for fuzzy hypothesis testing of the index Q ^ p k h provided from suppliers i and j is based on the relationship between Q ^ ˜ p k i and Q ^ ˜ p k j . Firstly, the situation of Q ^ p k j > Q ^ p k i is discussed to develop the fuzzy hypothesis testing model. With regard to this situation, it can be best explained by studying Figure 2. It is worth mentioning that the individual vertices ψ Q ^ ˜ p k i ( x ) and ψ Q ^ ˜ p k j ( x ) are at x = Q ^ p k i 1 ( 1 ) = Q ^ p k i 2 ( 1 ) and x = Q ^ p k j 1 ( 1 ) = Q ^ p k j 2 ( 1 ) , respectively. If the situation is Q ^ p k j < Q ^ p k i , then the same conclusion will be made as soon as these two are swapped.
The ratio of two specific defined areas is used to perform testing with a TFN [45]. In view of this, we defined A T as the total area under the graph of ψ Q ^ ˜ p k i ( x ) and A R as the area under the graph of ψ Q ^ ˜ p k i ( x ) but to the right of the vertical line through c (see Figure 2). Unfortunately, the complexity of ψ Q ^ ˜ p k i ( x ) greatly hinders the computing of A T and A R . Thus, we proposed an approximate approach to compute A T and A R for making a final decision in fuzzy hypothesis testing. First, let l = 100 α because of 0.01 α 1 , where l is the greatest integer that is less than or equal to 100 α , then α = 1 1 0.01 l and l = 1 , 2 , , 100 . Obviously, d l can be calculated as follows:
d l = ( Q ^ p k i 1.5 ) ( χ 1 ( ( 1 1 0.01 l ) / 2 ) , n 1 2 n χ ( 1 1 0.01 l ) / 2 , n 1 2 n ) + I × 2 Z ( 1 1 0.01 l ) / 2 n
It is worth noting that d 0 = d 1 , which can be expressed as follows:
d 0 = d 1 = ( Q ^ p k i 1.5 ) ( χ 0.9975 , n 1 2 n χ 0.0025 , n 1 2 n ) + I × 2 Z 0.0025 n
Likewise, we let w = 100 a because of 0.01 α a . That is, l = 1 , 2 , , h . In addition, c can be obtained based on the following Equation (25).
c = ( Q ^ p k j 1.5 ) χ ( 1 1 0.01 w ) / 2 , n 1 2 n I × Z ( 1 1 0.01 w ) / 2 n + 1.5 = ( Q ^ p k i 1.5 ) χ ( 1 1 0.01 w ) / 2 , n 1 2 n + I × Z ( 1 1 0.01 w ) / 2 n + 1.5
Thus, r l can be expressed as follows:
r l = ( Q ^ p k i 1.5 ) χ 1 ( ( 1 1 0.01 l ) / 2 ) , n 1 2 n + Z ( 1 1 0.01 l ) / 2 n + 1.5 c ,   l = 1 , 2 , , h
In addition, r 0 = r 1 . Therefore, A T and A R can be approximately obtained as follows:
A T = l = 1 100 ( d l 1 + d l 2 ) × ( 0.01 )   and   A R = l = 1 h ( r l 1 + r l 2 ) × ( 0.01 )
In conclusion, we can calculate the ratio of A R to A T according to Equation (27) and further make reliable decisions to select the best supplier with our proposed fuzzy estimator Q ^ ˜ p k h . Thus, we chose two numbers ϕ 1 and ϕ 2 , such as 0 < ϕ 1 < ϕ 2 < 0.5 , and the decision rules are as follows:
(1)
If A R / A T ϕ 1 , then reject H 0 and conclude that Q p k i < Q p k j .
(2)
For ϕ 1 < A R / A T < ϕ 2 , make no decision on reject/not reject.
(3)
For A R / A T ϕ 2 , do not reject H 0 and conclude that Q p k i = Q p k j .
According to the abovementioned evaluation rules, we conducted comparisons and tests on all suppliers one after another so as to find the suppliers with better quality level. Furthermore, the proposed fuzzy model is based on the CI of estimator Q ^ p k h provided by supplier h . From the perspective of statistical theory, the degree of imprecision can be indicated according to the length of the CI. We can see from Equations (16) and (17) that the length of the confidence interval for Q p k h of supplier h depends on sample size n and confidence level α . More specifically, the length of the confidence interval for Q p k h decreases with an increase in n for fixed α , whereas the length of the confidence interval for Q p k h decreases with an increase in α for fixed n . Obviously, the stability of the proposed fuzzy model depends on n and α . Thus, a number of researchers have applied this concept to analyze the sensitivity and stability of the fuzzy model [46,47].

5. Illustrative Example

In order to illustrate how the proposed approach can be utilized in practical applications, we considered a case study involving a gear product. Gears change the direction and speed of power within machines, making them an integral aspect of mechanized industries. In practice, gear manufacturing follows the 4R concept and includes several procedures; grinding is one such important process involving high precision and fairly small grinding surfaces. As grinding is associated with several quality characteristics, we considered only the process quality level of the most crucial quality characteristic, which is the internal diameter. Furthermore, there is no place in the world like Taichung, Taiwan, with the entire machinery industry clustered together. In view of this, we assisted a machine tool factory located in Taichung to select the optimal supplier of gear components. Thus, the specification limits of internal diameter for the gear specified by the factory were set as follows: LSL = 21.8 mm, T = 21.85 mm and USL = 21.9 mm. We applied the proposed approach to compare the process quality offered by two gear suppliers located in Taichung, Taiwan.
For a mass-produced gear product, a process engineer used the simple random sampling to collect 60 samples each of internal diameter from Supplier 1 and Supplier 2 during the month of April 2020 (i.e., n = 60 ). However, the proposed supplier selection model in this paper is based on theoretical assumptions of normality for the process data. Thus, we cannot use the proposed approach to select a supplier when the collected data is not normally distributed. For this reason, we employed the Anderson–Darling test to confirm the assumption of normality with p-value > 0.05. Therefore, it is reasonable to assume that the collected data are normally distributed. Table 1 presents the statistics of the collected samples.
Supposing that significance level α is set to 0.05 (i.e., α = 0.025321 ), [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ] = [ 0.57231 , 0.64369 ] for Supplier 1 can be obtained, and it can be further concluded that 0 [ δ ^ Z u ( γ ^ / K l ) , δ ^ + Z u ( γ ^ / K l ) ] and δ ^ Z u ( γ ^ / K l ) > 0 , respectively. Therefore, the 95 % CI D 1 = [ 3.2887 , 4.9368 ] of Q p k 1 for Supplier 1 can be obtained from Equation (12). In a manner similar to Supplier 1, we can derive the 95 % CI D 2 = [ 4.0901 , 6.15129 ] of Q p k 2 for Supplier 2. These results indicate that L Q p k 2 U Q p k 1 U Q p k 2 ; therefore D 1 D 2 ϕ . As we do not have enough statistical evidence to reject H 0 : Q p k 1 = Q p k 2 , we can conclude that there is no significant difference between the process quality levels of Supplier 1 and Supplier 2.
As mentioned above, we can decide to reject H 0 or not by comparing the CIs of Q p k 1 and Q p k 2 . However, taking into consideration data imprecision, we further employed the decision-making procedure for fuzzy hypothesis testing of Q p k h to assess whether the relationship between the process quality levels of Supplier 1 and Supplier 2 is equal or not. Thus, Q ^ p k 1 and Q ^ p k 2 became TFN Q ^ ˜ p k 1 and Q ^ ˜ p k 2 , respectively, with our proposed approach. For the sake of illustration, Figure 3 plots the relationship between Q ^ ˜ p k 1 and Q ^ ˜ p k 2 as it pertains to this example.
Therefore, Equations (23) and (27) can be used to obtain A T = 83.0000 . On the other hand, a = 0.40258 and w = 40 can be solved with Equation (25). In such a case, c = 4.545096 and A R = 7.7737 are obtained from Equations (25)–(27). Thus, we can further calculate A R / A T = 0.0937 . Let the two numbers in the fuzzy testing be ϕ 1 = 0.2 and ϕ 2 = 0.4 , A R / A T 0.2 can be found based on the abovementioned criterion of judgment. Obviously, this result shows that the null hypothesis H 0 of the hypothesis testing can be rejected. There is sufficient evidence showing that a difference exists between process quality levels of Supplier 1 and Supplier 2. However, a greater Q ^ p k value indicates higher process quality levels and higher process yield. Thus, the buying firm should choose Supplier 2 as a long-term partner due to Q ^ p k 1 < Q ^ p k 2 . In this way, buying firms can more effectively ensure the quality levels of their products and increase global competitiveness.

6. Conclusions and Research Limitations

Faced with swift market changes and globalized competition, firms must respond quickly to the varying demands of customers to maintain their own competitive advantages. Supply chain management allows firms to integrate both upstream and downstream. Supplier selection is a vital aspect of a firm’s development and actual gains. In view of this, this study developed a supplier selection model based on process quality from the perspective of a circular economy. We first employed the SSQI Q p k , which can directly reflect process quality levels, to evaluate the process quality of suppliers. In practice, process mean μ and standard deviation σ are generally unknown population parameters. This means that Q p k must be estimated based on collected sample data. Using the point estimate Q ^ p k to determine the process quality of suppliers may lead to miscalculation. Thus, to enhance the reliability of evaluation, we derived the 100 ( 1 α ) % CI of Q p k for application to a supplier selection model.
The fact that fuzziness and stochastic uncertainty are unavoidable features for collected data has led some researchers to assess process quality by taking into consideration data imprecision. For this reason, this study proposed a TFN of Q ^ p k and further developed a fuzzy testing model of selecting a supplier with the intent of reducing the risk of miscalculation and making reliable selection decisions for the evaluation of process quality level. To illustrate the applicability of the proposed approach, we demonstrated its implementation through a case study involving a gear component product. In the general hypothesis testing, the results showed that there was no significant difference between the process quality levels of Supplier 1 and Supplier 2. However, it is worth noting that Q ^ p k 2 was 1.015 higher than Q ^ p k 1 . This meant the difference between the process yield of the two was 0.008247 (i.e., 8247.05 defects per million opportunities). In view of this, we were bewildered by the inference results of the general hypothesis testing.
To this end, we further investigated the TFN of Q ^ p k 1 and Q ^ p k 2 and performed the proposed fuzzy hypothesis testing for H 0 : Q p k 1 = Q p k 2 . These results showed that there was sufficient evidence showing that a difference existed between the process quality levels of Supplier 1 and Supplier 2. More specifically, Supplier 2 would be better than Supplier 1 from a strategic perspective for the firm. Thus, the fuzzy model proposed in this study can more reliably assist firms in choosing the optimal supplier for long-term collaborations, thereby leading to a reduction in the amount of scrap and rework and helping firms move toward sustainability and production. In conclusion, the proposed model can help firms make reliable decisions in a fuzzy environment, ensuring that their products meet the needs of the end customer and leading firms toward sustainable development. The limitations in this study, however, is that in order to effectively assess process quality provided by suppliers and select the optimal supplier by the proposed fuzzy model, the collected sample data must come from a stable process and follow a normal distribution.

Author Contributions

Conceptualization, K.-S.C.; methodology, K.-S.C. and T.-C.C.; formal analysis, T.-C.C. and C.-C.H.; investigation, T.-C.C. and C.-C.H.; data curation, C.-C.H.; writing—original draft preparation, K.-S.C., T.-C.C., and C.-C.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hadian, H.; Chahardoli, S.; Golmohammadi, A.M.; Mostafaeipour, A. A practical framework for supplier selection decisions with an application to the automotive sector. Int. J. Prod. Res. 2020, 58, 2997–3014. [Google Scholar] [CrossRef]
  2. Chen, K.S.; Chung, L.; Chang, T.C. Developing a quality-based supplier selection model from the buying company perspective. Qual. Technol. Quant. Manag. 2020. [Google Scholar] [CrossRef]
  3. Mari, S.I.; Memon, M.S.; Ramzan, M.B.; Qureshi, S.M.; Iqbal, M.W. Interactive fuzzy multi criteria decision making approach for supplier selection and order allocation in a resilient supply chain. Mathematics 2019, 7, 137. [Google Scholar] [CrossRef] [Green Version]
  4. Kaya, R.; Yet, B. Building Bayesian networks based on DEMATEL for multiple criteria decision problems: A supplier selection case study. Expert Syst. Appl. 2019, 134, 234–248. [Google Scholar] [CrossRef]
  5. Fallahpour, A.; Wong, K.Y.; Olugu, E.U.; Musa, S.N. A predictive integrated genetic-based model for supplier evaluation and selection. Int. J. Fuzzy Syst. 2017, 19, 1041–1057. [Google Scholar] [CrossRef]
  6. Kellner, F.; Lienland, B.; Utz, S. An a posteriori decision support methodology for solving the multi-criteria supplier selection problem. Eur. J. Oper. Res. 2019, 272, 505–522. [Google Scholar] [CrossRef]
  7. Chen, K.S.; Chen, K.L. Supplier selection by testing the process incapability index. Int. J. Prod. Res. 2006, 44, 589–600. [Google Scholar] [CrossRef]
  8. Hwang, B.N.; Chen, T.T.; Lin, J.T. 3PL selection criteria in integrated circuit manufacturing industry in Taiwan. Supply Chain Manag. 2016, 21, 103–124. [Google Scholar] [CrossRef]
  9. Simpson, P.M.; Siguaw, J.A.; White, S.C. Measuring the performance of suppliers: An analysis of evaluation processes. J. Supply Chain Manag. 2002, 38, 29–41. [Google Scholar] [CrossRef]
  10. Dickson, G.W. An analysis of supplier selection systems and decisions. J. Purch. 1966, 2, 5–17. [Google Scholar] [CrossRef]
  11. Ahuja, I.P.S.; Khamba, J.S. Strategies and success factors for overcoming challenges in TPM implementation in Indian manufacturing industry. J. Qual. Maint. Eng. 2008, 14, 123–147. [Google Scholar] [CrossRef]
  12. Cornuel, E. Challenges facing business schools in the future. J. Manag. Dev. 2007, 26, 87–92. [Google Scholar] [CrossRef]
  13. Hadian, H.; Rahimifard, A. Multivariate statistical control chart and process capability indices for simultaneous monitoring of project duration and cost. Comput. Ind. Eng. 2019, 130, 788–797. [Google Scholar] [CrossRef]
  14. Chen, K.S.; Chen, D.F.; Huang, M.C.; Chang, T.C. Analyzing processing quality of machine tools via processed product: Example of ball valve processing machine. Proc. Inst. Mech. Eng. Part. E J. Process. Mech. Eng. 2020, 234, 331–341. [Google Scholar] [CrossRef]
  15. Brik, A.; Goddi, M.; Dhahri, J.; Fredj, N.B. Assessing process capability index using sampling plan in the presence of measurement system errors. Int. J. Adv. Manuf. Technol. 2019, 102, 3301–3313. [Google Scholar] [CrossRef]
  16. Rodríguez-Picón, L.A.; Méndez-González, L.C.; Flores-Ochoa, V.H.; Rodríguez-Medina, M.A. Capability indices for circular tolerance regions based on a Gaussian copula. Int. J. Adv. Manuf. Technol. 2019, 104, 4143–4153. [Google Scholar] [CrossRef]
  17. Chen, K.S.; Wang, K.J.; Chang, T.C. A novel approach to deriving the lower confidence limit of indices Cpu, Cpl, and Cpk in assessing process capability. Int. J. Prod. Res. 2017, 55, 4963–4981. [Google Scholar] [CrossRef]
  18. Tiwari, V.; Singh, N.K. Process capability index for bivariate exponentially distributed quality characteristics and its sampling properties. Commun. Stat.-Theory Methods 2017, 46, 11099–11109. [Google Scholar] [CrossRef]
  19. Guevara, R.D.; Vargas, J.A. Evaluation of process capability in multivariate nonlinear profiles. J. Stat. Comput. Simul. 2016, 86, 2411–2428. [Google Scholar] [CrossRef]
  20. Chang, T.C.; Wang, K.J.; Chen, K.S. Sputtering process assessment of ITO film for multiple quality characteristics with one-sided and two-sided specifications. J. Test. Eval. 2014, 42, 196–203. [Google Scholar] [CrossRef]
  21. Kane, V.E. Process capability indices. J. Qual. Technol. 1986, 18, 41–52. [Google Scholar] [CrossRef]
  22. Boyles, R.A. The Taguchi capability index. J. Qual. Technol. 1991, 23, 17–26. [Google Scholar] [CrossRef]
  23. Ravichandran, J. Estimation of DPMO and EGPMO for higher-the-better and lower-the-better quality characteristics for quality evaluation. Total Qual. Manag. Bus. Excell. 2016, 27, 1112–1120. [Google Scholar] [CrossRef]
  24. Gupta, A.; Sharma, P.; Malik, S.C.; Agarwal, N.; Jha, P.C. Productivity improvement in the chassis preparation stage of the amplifier production process: A DMAIC Six Sigma methodology. Int. J. Reliab. Qual. Saf. Eng. 2016, 23, 1640012. [Google Scholar] [CrossRef]
  25. Huang, C.T.; Chen, K.S.; Chang, T.C. An application of DMADV methodology for increasing the yield rate of surveillance cameras. Microelectron. Reliab. 2010, 50, 266–272. [Google Scholar] [CrossRef]
  26. Linderman, K.; Schroeder, R.G.; Zaheer, S.; Choo, A.S. Six Sigma: A goal-theoretic perspective. J. Oper. Manag. 2003, 21, 193–203. [Google Scholar] [CrossRef]
  27. Chen, K.S.; Huang, C.F.; Chang, T.C. A mathematical programming model for constructing the confidence interval of process capability index Cpm in evaluating process performance: An example of five-way pipe. J. Chin. Inst. Eng. 2017, 40, 126–133. [Google Scholar] [CrossRef]
  28. Yu, K.T.; Chen, K.S. Testing and analyzing capability performance for products with multiple characteristics. Int. J. Prod. Res. 2016, 54, 6633–6643. [Google Scholar] [CrossRef]
  29. Chang, T.C.; Wang, K.J.; Chen, K.S. Capability performance analysis for processes with multiple characteristics using accuracy and precision. Proc. Inst. Mech. Eng. Part. B J. Eng. Manuf. 2014, 228, 766–776. [Google Scholar] [CrossRef]
  30. Ouyang, L.Y.; Chen, K.S.; Yang, C.M.; Hsu, C.H. Using a QCAC-Entropy-TOPSIS approach to measure quality characteristics and rank improvement priorities for all substandard quality characteristics. Int. J. Prod. Res. 2014, 52, 3110–3124. [Google Scholar] [CrossRef]
  31. Chen, K.S.; Ouyang, L.Y.; Hsu, C.H.; Wu, C.C. The communion bridge to six sigma and process capability indices. Qual. Quant. 2009, 43, 463–469. [Google Scholar] [CrossRef]
  32. Chen, K.S.; Chen, H.T.; Chang, T.C. The construction and application of Six Sigma quality indices. Int. J. Prod. Res. 2017, 55, 2365–2384. [Google Scholar] [CrossRef]
  33. Albing, M.; Vännman, K. Elliptical safety region plots for Cpk. J. Appl. Stat. 2011, 38, 1169–1187. [Google Scholar] [CrossRef]
  34. Yu, K.T.; Shen, C.Y. Combining tolerance design and monitoring process capability in a design-manufacturing integration procedure. Proc. Inst. Mech. Eng. Part. B J. Eng. Manuf. 2009, 223, 1389–1394. [Google Scholar] [CrossRef]
  35. Wu, C.W.; Pearn, W.L.; Kotz, S. An overview of theory and practice on process capability indices for quality assurance. Int. J. Prod. Econ. 2009, 117, 338–359. [Google Scholar] [CrossRef]
  36. Chen, K.S.; Chen, T.W. Multi-process capability plot and fuzzy inference evaluation. Int. J. Prod. Econ. 2008, 111, 70–79. [Google Scholar] [CrossRef]
  37. Vännman, K. The circular safety region: A useful graphical tool in capability analysis. Qual. Reliab. Eng. Int. 2005, 21, 529–538. [Google Scholar] [CrossRef]
  38. Deleryd, M.; Vännman, K. Process capability plots—A quality improvement tool. Qual. Reliab. Eng. Int. 1999, 15, 213–227. [Google Scholar] [CrossRef]
  39. Chang, T.C.; Chen, K.S. Testing process quality of wire bonding with multiple gold wires from the viewpoint of producers. Int. J. Prod. Res. 2019, 57, 5400–5413. [Google Scholar] [CrossRef]
  40. Kanichukattu, J.K.; Luke, J.A. Comparison between two process capability indices using generalized confidence intervals. Int. J. Adv. Manuf. Technol. 2013, 69, 2793–2798. [Google Scholar] [CrossRef]
  41. Parchami, A.; Mashinchi, M. Confidence interval of generalized Taguchi index. J. Intell. Fuzzy Syst. 2013, 25, 577–585. [Google Scholar] [CrossRef]
  42. Chang, Y.C. Interval estimation of capability index Cpmk for manufacturing processes with asymmetric tolerances. Comput. Ind. Eng. 2009, 56, 312–322. [Google Scholar] [CrossRef]
  43. Daniels, L.; Edgar, B.; Burdick, R.K.; Hubele, N.F. Using confidence intervals to compare process capability indices. Qual. Eng. 2005, 17. [Google Scholar] [CrossRef]
  44. Zimmer, L.S.; Hubele, N.F.; Zimmer, W.J. Confidence intervals and sample size determination for Cpm. Qual. Reliab. Eng. Int. 2001, 17, 51–68. [Google Scholar] [CrossRef]
  45. Buckley, J.J. Fuzzy statistics: Hypothesis testing. Soft Comput. 2005, 9, 512–518. [Google Scholar] [CrossRef]
  46. Chen, K.S.; Chang, T.C. Fuzzy testing model for the lifetime performance of products under consideration with exponential distribution. Ann. Oper. Res. 2020. [Google Scholar] [CrossRef]
  47. Chen, K.S. Two-tailed Buckley fuzzy testing for operating performance index. J. Comput. Appl. Math. 2019, 361, 55–63. [Google Scholar] [CrossRef]
Figure 1. The membership function (MF) of triangular-shaped fuzzy number (TFN) Q ^ ˜ p k h with Q ^ p k h = 4 , 0 [ δ ^ h Z u ( γ ^ h / K l ) , δ ^ h + Z u ( γ ^ h / K l ) ] for n = 50 , 70, and 100.
Figure 1. The membership function (MF) of triangular-shaped fuzzy number (TFN) Q ^ ˜ p k h with Q ^ p k h = 4 , 0 [ δ ^ h Z u ( γ ^ h / K l ) , δ ^ h + Z u ( γ ^ h / K l ) ] for n = 50 , 70, and 100.
Mathematics 08 01420 g001
Figure 2. The relationship of Q ^ ˜ p k i and Q ^ ˜ p k j in the decision rule.
Figure 2. The relationship of Q ^ ˜ p k i and Q ^ ˜ p k j in the decision rule.
Mathematics 08 01420 g002
Figure 3. Relationship between fuzzy estimator Q ^ ˜ p k 1 and Q ^ ˜ p k 2 for illustrative case.
Figure 3. Relationship between fuzzy estimator Q ^ ˜ p k 1 and Q ^ ˜ p k 2 for illustrative case.
Mathematics 08 01420 g003
Table 1. Statistics of collected samples.
Table 1. Statistics of collected samples.
Supplier Code X ¯ h s h δ ^ h γ ^ h Q ^ p k h
h = 1 21.88040.00750.6080.1494.131
h = 2 21.89130.00240.8250.0485.146

Share and Cite

MDPI and ACS Style

Chen, K.-S.; Chang, T.-C.; Huang, C.-C. Supplier Selection by Fuzzy Assessment and Testing for Process Quality under Consideration with Data Imprecision. Mathematics 2020, 8, 1420. https://doi.org/10.3390/math8091420

AMA Style

Chen K-S, Chang T-C, Huang C-C. Supplier Selection by Fuzzy Assessment and Testing for Process Quality under Consideration with Data Imprecision. Mathematics. 2020; 8(9):1420. https://doi.org/10.3390/math8091420

Chicago/Turabian Style

Chen, Kuen-Suan, Tsang-Chuan Chang, and Chien-Che Huang. 2020. "Supplier Selection by Fuzzy Assessment and Testing for Process Quality under Consideration with Data Imprecision" Mathematics 8, no. 9: 1420. https://doi.org/10.3390/math8091420

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop