An Extended Picture Fuzzy VIKOR Approach for Sustainable Supplier Management and Its Application in the Beef Industry

.


Introduction
In the competitive global marketplace, companies have started to look after sustainability issues throughout their supply chain activities because of strict environmental legislation, scarcity of natural resources, and growing consumer awareness of environmental issues [1,2].Organizations are expecting their suppliers or partners to boost up sustainability in their collective work.These also lead manufacturers to practice the integration of environmental, economic, and social factors in production and supply chain activities.Sustainability refers to the ability of an enterprise to make present decisions without negatively affecting the future circumstances of the natural environment, societies and business viability [3,4].The aim of sustainable supply chain management (SSCM) is to cut down environmental pollution caused by the supply chain activities of an organization [5].In the SSCM, supplier selection plays a significant role and has great influence on the competitive advantage of a company.It is a process of selecting the most appropriate sustainable supplier with the right price and quality at the right time and quantity [6].Supplier selection based on sustainability criteria represents a strategic decision and is regarded as a crucial concern in the implementation of SSCM.Unsuitable suppliers will increase the production and inventory costs, lower product quality, and ultimately decrease profitability and customer satisfaction [7,8].Therefore, in recent years, ranking and selecting sustainable suppliers has achieved a considerable amount of attention among researchers and practitioners who are attempting to move towards sustainable production [9][10][11].
Sustainable supplier selection is generally modelled as a type of multi-criteria decision-making (MCDM) problem that includes a wide variety of alternatives and conflicting assessment criteria.Hence, researchers considered the MCDM methods as a suitable and effective methodology for selecting sustainable suppliers in the literature [12][13][14].The VIKOR (in Serbian: VlseKriterijumska Optimizacija I Kompromisno Resenje) method [15] is a famous MCDM tool to improve the quality of decision making.It has been developed for MCDM and takes into account contradictory and noncommensurable criteria to determine a compromise solution that is acceptable for all decision makers [16].Due to its characteristics and potential benefits in compromise ranking, the VIKOR approach has been used in many of fields in recent years [17][18][19][20].The detailed literature reviews regarding the VIKOR approach and its applications can be found in [21,22].Although it is popular application, one limitation with the VIKOR technique is that it is neutral regarding the attitudinal character of a decision maker.In the real world, there are many situations in which the decisions should be underestimated or overestimated in order to be more or less pessimistic against indefinite issues affecting the future [23,24].But no or few research has been carried out focusing on this issue in the application of the VIKOR method.
On the other hand, in realistic sustainable supplier selection processes, it is common that evaluation criteria data are vague and ambiguous because of a lack of information and knowledge.Some valuable theories and methods (e.g., intuitionistic fuzzy sets (IFSs) [25]) were suggested to represent the uncertainty in applied sustainable supplier evaluation situations [20,26,27].Picture fuzzy sets (PFSs), first proposed by Cuong [28], are a valuable extension of IFSs, which are characterized by membership degree and non-membership degree.In contrast, PFSs are described by positive membership, neutral membership, and negative membership functions [29,30].Because of the consideration of new parameters, PFSs can represent imprecise assessments that IFSs can otherwise handle, and, moreover, they can depict more complex and uncertain information for decision makers [31].Recently, the PFS theory has been increasingly used as an ideal method for modelling uncertainty in real MCDM problems [32][33][34].
Against the above background, this article aims to present a new sustainable supplier selection model by extending the VIKOR method with ordered weighted distance operators and PFSs.To achieve this target, we first introduce two new distance operators: the picture fuzzy-ordered weighted standardized distance (PFOWSD) operator and the picture fuzzy Euclidean-ordered weighted standardized distance (PFEOWSD) operator.Then, we suggest applying the picture fuzzyordered weighted distance (PFOWD) operators to calculate the separation measures in the VIKOR method.The fundamental characteristic of the PFOWD-VIKOR technique is that it calculates the separation measures from the best and the worst values with the developed distance operators, and consequently, the sustainable supplier selection problem can be addressed by the decision maker according to more complete information.In addition, an empirical case is given for illustrating the efficiency of the PFOWD-VIKOR model for choosing the optimal sustainable suppliers in the beef industry.
The remainder of this article is structured as follows.Section 2 gives a literature review on sustainable supplier selection, paying particular attention to the use of MCDM methods.Section 3 provides the basic notions and definitions of PFSs briefly.In Section 4, we introduce the PFOWSD and the PFEOWSD operators and present extensions by the hybrid average (HA) operator [35].Section 5 develops the sustainable supplier selection model with the aid of the PFOWD operators and VIKOR technique.In Section 6, the proposed approach is applied to sustainable supplier selection in the beef supply chain.Finally, conclusions of this article and potential topics for further research are discussed in Section 7.

Literature Review
In past decade, a variety of sustainable supplier selection methods were proposed for purchase managers in the literature.For example, Arabsheybani et al. [6] developed a fuzzy multi-objective optimization model based on ratio analysis (MOORA) in order to select the best sustainable supplier in view of quantity discounts and supplier risk.Lu et al. [4] applied an integrated approach using rough sets and the ELECTRE (ELimination Et Choix Traduisant la REalité) method to evaluate sustainable suppliers under the vague environment.Quan et al. [8] described a hybrid MCDM framework that combined interval-valued intuitionistic uncertain linguistic sets and MULTIMOORA (MOORA plus full multiplicative form) for green supplier selection in a large group environment.In [12], the grey relational analysis (GRA) was combined with technique for order preference by similarity to ideal solution (TOPSIS), called the GRA-TOPSIS method, for determining suitable green suppliers based on interval-valued intuitionistic uncertain linguistic assessments.In [36], a big data cloud computing framework based on fuzzy analytic hierarchy process (AHP), decision making trial and evaluation laboratory (DEMATEL), and fuzzy TOPSIS was put forward to facilitate low-carbon supplier selection.Tseng et al. [5] employed an interval-valued triangular fuzzy numbers-GRA method with cost and benefit concerns to assist purchase managers in green supply supplier selection.Van et al. [7] used a hybrid approach using quality function deployment, interval neutrosophic sets, and TOPSIS method in support of green supplier selection.Zhou and Xu [9] put forward an integrated evaluation method based on hybrid information aggregation for sustainable supplier selection, and Zhu and Li [2] introduced a green supplier selection model by combing the consensus process, prioritized operator, and Choquet integral under the hesitant fuzzy linguistic environment.Sen et al. [27] reported a sustainable supplier selection approach by using three different MCDM methods (namely, TOPSIS, MOORA and GRA) in the intuitionistic fuzzy setting.
In [37], a grey-based group decision-support approach based on the best-worst method (BWM) and TODIM (an acronym in Portuguese of interactive and multicriteria decision making) was proposed for social sustainable supplier evaluation and selection.In [38], a hybrid model composed of Shannon entropy and fuzzy TOPSIS method was introduced for performance evaluation of green suppliers in the furniture industry.In [39], a hybrid multi-criteria framework integrating the Copeland method, the AHP method, and the ELECTRE-TRI method was presented for the selection of suppliers considering social, ethical, and environmental criteria.Liu et al. [40] used the BWM and alternative queuing method (AQM) to evaluate and select sustainable suppliers under the intervalvalued intuitionistic uncertain linguistic environment.Liu et al. [41] combined triangular fuzzy numbers, AHP, and TOPSIS to improve the sustainable performance of an agri-food value chain.Liu et al. [11] developed an ordered weighted hesitant fuzzy group decision-making model for green supplier selection, and Wang et al. [14] proposed a MCDM method with q-rung interval-valued orthopair fuzzy information to solve the green supplier selection problem.Lu et al. [42] proposed the use of cloud model and possibility degree for green supplier selection in the straw biomass industry, and Xu et al. [43] applied the sorting method, AHPSort II, and interval type-2 fuzzy sets for sustainable material supplier selection.In addition, detailed literature reviews on the current sustainable supplier selection methods can be seen in [44][45][46].

Picture Fuzzy Sets
On the basis of IFSs [25], the concept of PFSs was proposed by Cuong [28] to model complex and uncertain assessments of experts in real decision-making problems.[29].Let Φ be the set of all PFNs in X.The score function of a PFN  

Definition 1. A PFS P on the universe X is expressed by
is defined by [29,47]: where Using the score function S and the accuracy function H, the comparison laws of PFNs are defined as given below.Definition 4. Supposing there are two PFNs  

S p S p and H p H p
Motivated by the distance measure between intuitionistic fuzzy sets [48], Dutta [33] proposed a distance formula for PFSs taking into account the parameters of positive membership, neutral membership, and negative membership.
Based on the basic operational rules of PFNs, Wei [49] developed the picture fuzzy-weighted averaging (PFWA) operator for decision making.

The OWAD Operator
The ordered weighted averaging distance (OWAD) operator [23,24] is an extension of the traditional Hamming distance by using the ordered weighted average (OWA) operator [50].An important feature of the OWAD operator is the reordering of the arguments of the individual distances according to their values.It can be defined as follows for two sets of = , ,..., n Y y y y .

Definition 7. An OWAD operator of dimension n is a mapping
where j d denotes the jth largest of the individual distance x y  and i x and i y represent the ith elements of the sets X and Y.
Similarly, the Euclidean ordered weighted averaging distance (EOWAD) operator, an extension of the traditional Euclidean distance, was defined in [51].

The Picture Fuzzy-Ordered Weighted Standardized Distance (PFOWSD) Operator
This section gives the definition of the PFOWSD operator for sustainable supplier selection using the VIKOR method.Suppose that the three PFSs , ,...,  denote, respectively, the ideal solution, the nadir (negative ideal) solution, and the ith considered alternative in a sustainable supplier selection problem with n evaluation criteria.Then, the PFOWSD operator can be explained as follows.
Note that the PFOWSD operator is commutative, monotonic, idempotent, and bounded.The proofs of these properties are straightforward and, thus, omitted here.Like the OWAD operator, the PFOWSD operator includes a parameterized family of picture fuzzy distance operators by changing the weights, such as the descending PFOWSD operator, the picture fuzzy maximum, the picture fuzzy minimum, the picture fuzzy normalized Hamming standardized distance (PFNHSD) operator, and the picture fuzzy-weighted Hamming standardized distance (PFWHSD).

The Picture Fuzzy Euclidean-Ordered Weighted Standardized Distance (PFEOWSD) Operator
Suppose that the three PFSs * , R  R   , and i R  denote, respectively, the ideal solution, the nadir solution, and the ith considered alternative in a sustainable supplier selection problem with n evaluation criteria.Then, the definition of the PFEOWSD operator is given as follows.
It should be noted that the PFEOWSD operator is commutative, monotonic, idempotent, and bounded.By using different weighting vectors, we can determine different types of picture fuzzy distance operators, which include the picture fuzzy maximum, the picture fuzzy minimum, the picture fuzzy-normalized Euclidean standardized distance (PFNESD), and the picture fuzzyweighted Euclidean standardized distance (PFWESD).

The Hybrid Picture Fuzzy-Ordered Weighted Standardized Distance (HPFOWSD) Operator
Motivated by the HA operator [35], the hybrid PFOWSD (HPFOWSD) operator is introduced in this part.Suppose that the three PFSs * , R  R   , and i R  denote, respectively, the ideal solution, the nadir solution, and the ith considered alternative in a sustainable supplier selection problem with n evaluation criteria.Then, the HPFOWSD operator is explained as below.
, for all k, the PFWHSD operator is derived and if , for all k and j, we get the PFNHSD operator.The HPFOWSD operator has similar properties than the PFOWSD operator.But it is not idempotent nor commutative.Besides, a wide range of families of the HPFOWSD operator can be obtained following the method given in the PFOWSD operator.

The Hybrid Picture Fuzzy Euclidean-Ordered Weighted Standardized Distance (HPFEOWSD) Operator
Similarly, the hybrid PFEOWSD (HPFEOWSD) operator is a generalization of the PFEOWSD operator.Suppose that the three PFSs * , R  R   , and i R  denote, respectively, the ideal solution, the nadir solution, and the ith considered alternative in a sustainable supplier selection problem with n evaluation criteria.Then, the definition of the HPFEOWSD operator is given as below.
Definition 11.For an associated weighting vector define the HPFEOWSD operator as: , , , where ˆk d represents the kth largest of the , , for all k and j, the PFNESD operator is obtained.It can be seen that the HPFEOWSD operator accomplishes similar properties than the HPFOWSD operator.

The Proposed Approach for Sustainable Supplier Selection
In what follows, we present an ordered weighted distance-based VIKOR method for solving sustainable supplier selection problems with conflicting criteria and picture fuzzy information.The proposed sustainable supplier selection approach, called PFOWD-VIKOR, can be useful in many of situations such as in those where a decision maker wants to underestimate the results so as to take a more prudent selection than in normal cases.
The process to follow in evaluating sustainable suppliers with the PFOWD-VIKOR approach is based on the procedure developed in [15,51], with the differences that the criteria values are given in the form of PFNs and the separation measures are calculated with the PFOWSD operator.Let us consider a sustainable supplier selection problem, which contains m alternatives (potential suppliers)

 
1, 2,..., .Then, by using the PFOWD-VIKOR algorithm, the multi-criteria sustainable supplier selection problem can be approached with the following steps: Step 1. Obtain the picture fuzzy evaluation matrix The first step is to convert the decision makers' linguistic expressions for the alternatives into PFNs to establish the picture fuzzy evaluation matrixes The picture fuzzy evaluation matrixes are aggregated with the PFWA operator, as the formula in Equation ( 11) to obtain the matrix R  .
Step 3. Find the best * j r and the worst j r   values of all criteria ratings using Equations ( 13) and ( 14), for j = 1, 2, ..., n.
* max , for benefit criteria , 1, 2,..., , min , for cost criteria min , for benefit criteria , 1, 2,..., .max , for cost criteria Step 4. Obtain the values Si and Ri, i = 1, 2, ..., m, by employing the below equations: PFOWSD , , ,..., , , , where k  is the ordered weights of criteria.It may be mentioned here that we can use the picture fuzzy distance operators presented in the last section in the above equations.
Step 5. Obtain the values Qi, i = 1, 2, ..., m, by the following equation: where * * min , max , min , max In addition, v means the weight for the strategy of maximum group utility, and 1 − v is the weight of the individual regret.In the real application, we can take the value of v as 0.5.
Step 6.Based on the ascending orders of the values S, R, and Q, all the alternatives can be acquired.As a result, three ranking lists can be yielded.
Step 7.This step is to determine a compromise solution (A (1) ), which is best ranked by the measure Q (minimum) and, at the same time, the following two conditions should be satisfied: A ranks the second according to the values of Q. C2.Acceptable stability in decision making: The alternative A (1) should be the first alternative by S or/and R. The compromise solution is stable in a sustainable supplier selection process, which could be "voting by majority rule" (v > 0.5), or "by consensus" 0.5 v  , or "with veto" (v < 0.5).If one of the conditions is not fulfilled, then we can obtain a set of compromise solutions in line with the following rules:

•
Alternatives A (1) and A (2) if only C2 is not fulfilled or • Alternatives A (1) , A (2) , ..., A (M) if C1 is not fulfilled; A (M) is determined by the relation

Case Study
In this section, we applied the PFOWD-VIKOR methodology to an empirical sustainable supplier selection case in the beef supply chain [36] to demonstrate its applicability and effectiveness.In what follows, the background information and the implementation process are discussed in detail.

Background Description
In recent years, carbon footprint reduction has received great attention from researchers and practitioners around the world.Apart from the manufacturing and transportation industries, the agriculture sector is one of the main contributors to global carbon emission.Compared to other agrifood products, beef has the uppermost carbon footprint, and the majority of its emissions takes place at beef farms [36].The is particularly true in developing countries where the majority of global cattle are raised, but farmers in these areas are often not aware of modern technology to curtail carbon emissions from their farms.Furthermore, there is an increasing pressure on the beef industry from the government and clients to reduce carbon emissions in its supply chain.Therefore, it is of vital importance to increase consciousness of beef farmers and, thus, incorporate sustainable criteria in selecting the best cattle supplier by abattoir and processor.
To mitigate carbon emission, the proposed approach was applied for the selection of a supplier for a beef abattoir and processor company.After premilitary screening, ten potential alternatives (beef farmers) of this company were considered, which are denoted as . The green performance of these suppliers was evaluated according to the following seven criteria: quality of meat (C1), age of cattle (C2), diet fed to cattle (C3), average weight (C4), traceability (C5), carbon footprint (C6), and price (C7).An expert group consisting of three decision makers (DM1, DM2, and DM3) was established to conduct the performance rating of each supplier.The decision makers' weights were assumed as since they had different levels of technical knowledge and expertise.According to the linguistic terms defined in Table 1, the evaluation result of the three decision makers for the ten suppliers is listed in Table 2.
Table 2. Linguistic evaluation matrixes of the decision makers.

Implementation Results
To identify the supplier that performed the best on sustainability requirements, the proposed PFOWD-VIKOR framework was implemented.The obtained results are given as follows: Step 1.The linguistic evaluation data of the decision makers are transformed into PFNs according to Table 1.For example, for DM1, the obtained picture fuzzy evaluation matrix is demonstrated as in Table 3.
Step 2. The collective picture fuzzy evaluation matrix of the suppliers is obtained by Equation (11).Table 4 displays the aggregated picture fuzzy evaluations of the alternatives.
Step 3. Based on the matrix R  and Equations ( 19) and ( 20), the best * j r and the worst j r   values for the seven criteria are determined as listed in Table 4.
Steps 4 and 5. Now we need to determine the values Si, Ri, and Qi for the ten alternative suppliers with Equations ( 21)-( 16).
Note that it is possible to employ different picture fuzzy distance operators to calculate the Si index.In the case study, we considered the PFNHSD, the PFWHSD, the PFOWSD, the PFHOWSD, the PFNESD, the PFWESD, the PFEOWSD, and the HPFEOWSD operators.The following weighting vectors were selected: .The results of these calculations are shown in Tables 5   and 6.
Steps 6 and 7.All the alternative suppliers are ranked in ascending order based on the values of Si, Ri, and Qi.The lowest value of Qi in each method is the optimal result.As a result, the ranking results are displayed in Table 7.
As one can note, depending on the particular type of picture fuzzy distance operators, the priority of the alternative suppliers was dissimilar.For some situations, the most suitable supplier was A10 because it had the lowest distance to the ideal alternative.For other circumstances, we observed that the optimal choice was A6.However, according to the related rules in Section 5, both A10 and A6 were compromise solutions since only the acceptability condition C1 was valid.Besides, by using the dominance theory [54], an aggregated ranking of the alternatives can be acquired based Therefore, in the given application, the focal abattoir and processor company can select A10 or A6 as the best beef cattle supplier for procurement.

Comparative Analysis
In this section, to show the effectiveness of the proposed model, we made a comparison analysis using the same case study in the beef supply chain, with the fuzzy TOPSIS [36], the IF-VIKOR [20], and the IF-GRA [27] methods.Figure 1 shows the order results of the suppliers that were produced by using the listed methods.It can be seen that A10 was rated first among the four methods.Especially, the top two and the last two suppliers determined by the proposed model agreed with the ones using the fuzzy TOPSIS and the IF-VIKOR methods.This confirms the efficiency of the proposed PFOWD-VIKOR method.On the other hand, there was a difference in the ranking orders of other suppliers derived with the four methods.For example, A8 ranked third and was better than A4 when using the proposed approach.However, the third highest ranking supplier was A4 and A8 had a lower priority when the fuzzy TOPSIS and the IF-VIKOR methods were used.According to the IF-GRA method, A3 was ranked behind A5.In reality, the former was more important, and, thus, the result of the proposed approach suggested that A3 had a higher priority in comparison with A5.This was also validated by the fuzzy TOPSIS and the IF-VIKOR methods.Besides, when balancing all the criteria the two suppliers A1 and A2 should be given the same priority for selection, as derived by the proposed approach.But the other three methods produced the opposite results: A1 was better than A2 by the fuzzy TOPSIS and the IF-GRS, and A2 ranked higher than A1 using the IF-VIKOR method.Thus, a more reasonable ranking can be achieved by the use of the PFOWD-VIKOR algorithm.
In addition, the inconsistency in the rankings of suppliers can be explained by different features of the compared methods.The proposed approach employed PFSs to handle the inherent lack of precision of the data gathered in the sustainable supplier evaluation and selection problem, unlike the fuzzy TOPSIS approach on the basis of fuzzy sets and the IF-VIKOR and the IF-GRA methods using IFSs.Moreover, another reason for the different ranking results from the presented approach and the fuzzy TOPSIS method is that the VIKOR method ranked the sustainable alternatives based on the closeness to the ideal solution.The TOPSIS method selected the optimum alternative, which should have the "shortest distance" from the idea solution and the "farthest distance" from the "negative-idea" solution.The proposed approach and the IF-GRA method produced vastly different priority results for the suppliers.This is, in part, due to the fact that the GRA method used only one "reference" point in determining the ranking of the alternative suppliers.

Managerial Implications
This study presented a new decision-making approach for purchase managers to select the best sustainable supplier to increase the competitiveness and economic level of an enterprise.The literature review suggested that the proposed sustainable supplier selection approach was unique in its integration of ordered weighted distance operators and the VIKOR approach in a picture fuzzy environment.The case example showed that the proposed approach led to superior results, compared to other methods.In summary, the new approach proposed for sustainable supplier selection has several implications for practitioners and academicians in the sustainable supplier management field.First, by using PFSs, the proposed approach is more appropriate to address the challenge of decision makers in assessing the green performance of suppliers.It incorporates a complete degree of confidence in the experts' opinions and can easily represent the uncertainty of evaluation information in solving sustainable supplier selection approach problems.Second, by using picture fuzzy distance operators in the sustainable supplier selection process, various methods can be provided for managers.In real-word cases, we often do not know which scenario is the correct one by reason of uncertainty.Hence, representing different specific cases that might occur is valuable for gaining the whole picture of a different, future status quo.Finally, the proposed approach determines the ranking of alternative suppliers following the basic procedure of the VIKOR method.The ranking result or compromise solution obtained is more accurate and reliable and can be easily accepted by decision makers since it offers a maximum "group utility" of the "majority" and a minimum individual regret of the "opponent".Therefore, our study provides practical and theoretical guidance for the organizations that are implementing or will implement SSCM.

Conclusions
Sustainable supplier selection is a key part of SSCM, which has attracted the increasing attention of academics in recent years.In the article, a PFOWD-VIKOR framework was established to solve sustainable supplier selection problems under a picture fuzzy environment.We first introduced the PFOWSD and the PFEOWSD operators as new types of picture fuzzy distance operators.Then, the normal VIKOR technique was modified using the developed distance operators to obtain the performance ranking of sustainable suppliers.The key benefit of the proposed approach is that we can manipulate the neutrality of the results according to the optimism degree of a decision maker.Therefore, the decision maker is able to choose the optimal supplier according to his or her attitudinal character and thus, obtain a more comprehensive view of a sustainable supplier selection problem.Finally, the PFOWD-VIKOR approach was applied in beef supply chain management concerning the selection of eco-friendly cattle suppliers.Further, through comparison with existing methods, the advantages and practicalities of the presented approach were illustrated.
In our future research, it is a meaningful topic to further extend the proposed approach by including new characteristics in the sustainable supplier selection, such as the incorporation of a consensus level and the bounded rationality behavior of decision makers.Considering that suppliers may change their sustainability performances with time, it is interesting to study a dynamic evaluation and selection model to determine the best supplier in future research.In addition, the integrated decision-making approach presented in this paper can be utilized for selecting green suppliers in other industries, such as healthcare and retail, to further validate the approach being presented in this paper.

kd
represents the kth largest of the individual picture fuzzy standardized distance  represent the ideal value and the nadir value of the jth criterion, respectively.ij r is the picture fuzzy value of ith alternative regarding Cj, 1,2,..., .i m  Example 1.Let

kdExample 2 .
represents the kth largest of the individual picture fuzzy standardized distance     denote the idea value and the nadir value of the jth criterion, respectively.ij r is the picture fuzzy value of ith alternative regarding Cj, 1,2,..., .i m  For the three PFSs * , R R    , and i R  , and the weighting vector ω given in Example 1, the PFEOWSD operator is determined by

2 =Example 3 .
idea value and the nadir value of the jth criterion, respectively.ij f is the picture fuzzy value of ith alternative regarding Cj, Let * , R R    , and i R  be three PFSs and the weighting vector ω is the same as Example 1.
alternative is evaluated against the n criteria.The decision makers   1, 2,..., k D k l  utilize linguistic terms to score the ratings of alternatives with respect to each criterion.Thus, the performance ratings of decision makers   1, 2,..., k D k l  assigned for each alternative form a linguistic evaluation matrix denoted by importance weights of the l decision makers are denoted by   1, 2,...,

Figure 1 .
Figure 1.Rankings of suppliers by the compared methods. ,..., i R  be three PFSs, the weighting vector ω is the same as Example 1, and the

Table 1 .
Linguistic terms for assessing the alternatives.

Table 3 .
Picture fuzzy evaluation matrix of DM1.

Table 4 .
Collective picture fuzzy evaluation matrix R  .

Table 5 .
Results with picture fuzzy Hamming operators.

Table 6 .
Results with picture fuzzy Euclidean operators.