Comparative Analysis of Five Widely-Used Multi-Criteria Decision-Making Methods to Evaluate Clean Energy Technologies: A Case Study

: Over the last decade, the total primary energy consumption has increased from 479 × 10 15 BTU in 2010 to 528 × 10 15 BTU in 2020. To address this ever-increasing energy demand, as well as prevent environmental pollution, clean energies are presented as a potential solution. In this regard, evaluating and selecting the most appropriate clean energy solution for a speciﬁc area is of particular importance. Therefore, in this study, a comparative analysis in Jiangsu province in China was performed by describing and implementing ﬁve prominent multi-criteria decision-making methods in the ﬁeld of energy technology selection, including SAW, TOPSIS, ELECTRE, VIKOR, and COPRAS. The decision problem here consists of four clean energy options, including solar photovoltaic, wind, nuclear, and biomass, which have been evaluated by twelve basic and important criteria for ranking clean energy options. The obtained results, according to all ﬁve MCDM methods, indicate that solar photovoltaic was the optimal option in this study, followed by wind energy. The nuclear and biomass options placed third and fourth, respectively, except in the ELECTRE method ranking, in which both options scored the same and thus neither was superior. Finally, by conducting a comprehensive two-stage sensitivity analysis, in the ﬁrst stage, it was found that changes in the weights of land use and water consumption criteria had the greatest impact on the performance of options, among which biomass and nuclear showed high sensitivity to variations in criteria weights. In the second stage, by deﬁning ﬁve scenarios, the ranking of options was evaluated from different aspects so that the decision maker/organization would be able to make appropriate decisions in different situations.


Introduction
Global primary energy consumption drastically increased from 479 × 10 15 BTU in 2010 to 528 × 10 15 BTU in 2020 [1]. However, different sources of fossil fuels have different expenses and carbon pollutants [2]. Increasing concerns about global warming because of the impact of fossil fuels have forced many countries to concentrate on developing and implementing emerging clean energy sources, such as hydro, wind, solar, biomass, and nuclear [3].
Sustainability 2022, 14, 1403 4 of 33 ment of biogas plants in Turkey using the integrated SWARA (step-wise weight assessment ratio analysis) and COPRAS (complex proportional assessment) MCDM methods utilizing 12 different indicators. Ervural et al. [28] evaluated energy investment planning using a proposed integrated model comprising AHP methods, target planning (energy policy target), and fuzzy TOPSIS. Ramezanzade et al. [29] employed four MCDM methods, including MOORA (multi-objective optimization based on ratio analysis), VIKOR, ARAS, and EDAS (evaluation based on distance from average solution), in a fuzzy environment to rank renewable energy projects in North Khorasan province, Iran. For this purpose, 30 different criteria were considered and by conducting evaluations in a fuzzy environment, it was reported that solar and small hydropower projects are the most suitable renewable projects, respectively.
Wang et al. [30] evaluated four energy distribution systems (gas turbine, fuel cell, photovoltaic, and internal combustion engine) by means of eight different criteria, including capital cost, operating cost, energy consumption, primary energy efficiency rate, technological maturity, annual CO 2 /NO x emissions, and social acceptance. They used a combination of two MCDM methods, interval DEMATEL (decision making trial and evaluation laboratory) and interval VIKOR, and reported that the photovoltaic scenario was the best alternative.
This study aims to comprehensively study the solutions of clean energy sources for electricity generation in Jiangsu province in China with the help of five widely used MCDM methods. For this purpose, five multi-criteria decision-making methods, namely SAW, TOPSIS, ELECTRE, VIKOR, and COPRAS, have been described and implemented. Using a set of widely used MCDM methods, a complete comparison between ranking results can be made, and finally a highly reliable prioritization can be provided that was not carried out in [4]. On the other hand, in [4] the evaluation was conducted by considering only seven criteria, which does not seem to be comprehensive enough for prioritizing options in the field of clean energy. Therefore, some of the most important effective criteria in decision making in this field, such as system life, water consumption, system efficiency, etc., are included in the multi-criteria decision analysis process. In addition, the reference study was performed in a fuzzy environment; thus, comparing the results of this study with the results of the reference study will be useful for a better understanding of the performance of MCDM methods. Finally, this study tries to provide a complete model for decision-makers by providing a ranking and performing two types of sensitivity analysis by evaluating the effect of changes in criteria weights on the performance of options (defining five different scenarios) and evaluating how options are ranked.

Case Study: Jiangsu Province
The geographical location of Jiangsu province is shown in Figure 1. Jiangsu, with an area of about 102,000 square kilometers and a population of about 80 million, is one of China's most populous provinces. Since 1990, Jiangsu has been one of China's most advanced provinces. On the other hand, with rapid economic growth and vast urbanization, scarcities of resources and environmental pollution have become important problems in Jiangsu's development.
The reducing effect on energy supply caused by adaptation to clean energy sources is a critical factor in the long-term development of Jiangsu province to guarantee economic development and the growth of urbanization [3,31]. Possible clean energy sources that can be used by Jiangsu are solar photovoltaic, wind, hydro, biomass, geothermal, and nuclear. However, geothermal, due to the low temperature of geothermal resources in this region, is not a practical solution for power generation and can only be used for low-temperature heating applications [3]. Moreover, the development of most water resources in Jiangsu has already been implemented [32]. Therefore, in this investigation, four types of clean energy are considered, namely solar photovoltaic, wind, biomass, and nuclear energy. It is worth noting that solar energy is generally the strongest option with 83 terawatt hours per year for potential exploitation in Jiangsu [33]. is not a practical solution for power generation and can only be used for low-temperature heating applications [3]. Moreover, the development of most water resources in Jiangsu has already been implemented [32]. Therefore, in this investigation, four types of clean energy are considered, namely solar photovoltaic, wind, biomass, and nuclear energy. It is worth noting that solar energy is generally the strongest option with 83 terawatt hours per year for potential exploitation in Jiangsu [33].  [34]. Now the basic problem for Jiangsu province is how to prioritize and rank clean energy sources to find the convenient clean energy strategy for designation and implementation. Since clean energy is not only a solution to energy shortages and is a solution to reduce climate changes and environmental pollutions [35], other factors such as technological, environmental, social and economic factors must also be included. The total sustainability rates of clean energy sources should be determined on the basis of all relevant criteria to comprehensively evaluate energy sources [36]. Energy sources can then be prioritized based upon those values. The MCDM is a viable method for evaluating clean energy sources, since various criteria should be considered.

Multi-Criteria Decision-Making Approach
As stated in the Introduction, decision-making analysis is an excellent tool for problem solving and is characterized by multiple operators, criteria, and goals. MCDM issues generally consist of five different components, namely: purpose, decision-making preferences, alternatives, criteria, and outcomes [37,38]. MCDM can be categorized as shown in Figure 2. In MCDM, the inherent features are covered, which leads to fewer options being considered, thus making the prioritization difficult-making evaluation more difficult as well. The final output is obtained by comparing different options according to each available criterion [38,39]. A classification of such models is presented in Figure 3. A schematic overview of the MCDM approach is shown in Figure 4. Now the basic problem for Jiangsu province is how to prioritize and rank clean energy sources to find the convenient clean energy strategy for designation and implementation. Since clean energy is not only a solution to energy shortages and is a solution to reduce climate changes and environmental pollutions [35], other factors such as technological, environmental, social and economic factors must also be included. The total sustainability rates of clean energy sources should be determined on the basis of all relevant criteria to comprehensively evaluate energy sources [36]. Energy sources can then be prioritized based upon those values. The MCDM is a viable method for evaluating clean energy sources, since various criteria should be considered.

Multi-Criteria Decision-Making Approach
As stated in the Introduction, decision-making analysis is an excellent tool for problem solving and is characterized by multiple operators, criteria, and goals. MCDM issues generally consist of five different components, namely: purpose, decision-making preferences, alternatives, criteria, and outcomes [37,38]. MCDM can be categorized as shown in Figure 2. In MCDM, the inherent features are covered, which leads to fewer options being considered, thus making the prioritization difficult-making evaluation more difficult as well. The final output is obtained by comparing different options according to each available criterion [38,39]. A classification of such models is presented in Figure 3. A schematic overview of the MCDM approach is shown in Figure 4.
The classification of MCDM methods presented in Figure 4 is only a small component of these methods. Many MCDM methods have been developed and introduced by researchers, each of which has been developed on a specific basis. In general, none of the MCDM methods can be considered superior to the others, so the selection and application of one MCDM method depends on expert opinion and the type of decision problem. Some MCDM methods, due to their nature, can be appropriate and useful in certain study fields (depending on the type and scale of the initial decision data). In the field of energy, some MCDM methods are more widely used and more reliable than others [40,41]. In this study, we try to provide a comprehensive review and comparison of clean energy sources by selecting different MCDM methods from different groups of categories of these methods. In this regard, five MCDM methods (SAW, TOPSIS, ELECTRE, VIKOR, and COPRAS) have been selected. Each of these methods has strengths and weaknesses. Some of these are summarized in Table 1. The SAW method is one of the oldest and simplest decision-making methods that has a compensatory nature and has been widely used in the field of energy systems engineering [37]. TOPSIS is also a method of compensatory nature and is one of the most accepted and reliable methods of MCDM, which in this study has been used to rank clean energy options. The third method, ELECTRE, is based on the law of pairwise comparisons. This method also considers the incompatibility between the options and has a non-compensatory nature, which has made it one of the most widely used outranking methods. For problems that have conflicting and incomparable criteria, the use of the VIKOR method is suggested. In this method, it is assumed that the compromise solution can be acceptable for conflict resolution analysis. The last MCDM method used in this study is the COPRAS method, which is referred to as a real MCDM method and takes less time to introduce than the other methods. Does not work well in conflicting situations. Interaction between criteria is not considered in this method.

COPRAS
Ratio-based (Scoring) method Low Applies the effect of positive and negative criteria separately. It is a solid method and is suitable for evaluating a single alternative.
In the case of data diversity, it provides unstable results and may not reflect the true nature of the data. The ranking results will be sensitive to small changes in the data. solid method and is suitable for evaluating a single alternative.
The ranking results will be sensitive to small changes in the data .    The ranking results will be sensitive to small changes in the data .  Multi-criteria decision-making models [43]. Figure 3. Multi-criteria decision-making models [43].

Determination of Criteria Weights
Each issue that the decision maker confronts may include several criteria. Therefore, a sufficient knowledge of the significance of each criterion is of notable interest. Thereby,

Determination of Criteria Weights
Each issue that the decision maker confronts may include several criteria. Therefore, a sufficient knowledge of the significance of each criterion is of notable interest. Thereby, a weight is assigned to each criterion so that the criteria weights' summation is equal to the one. These weights indicate the relative importance and degree of superiority of each criterion compared with the other criteria for decision making. There are various methods to evaluate the weights of criteria. Some of the most important ones are the Shannon entropy, LINMAP, least squares, and special vector techniques.

Implementation of Shannon Entropy Method
The Shannon entropy method, introduced by Shannon and Weaver in 1974, is a multicriteria decision-making method for calculating the weights of criteria. This method can be applied when the data of a decision matrix are completely clear. Entropy represents the value of uncertainty in a continuous probability distribution. The basic idea of this method is that the higher the dispersion in the values of a criterion, the more important the criterion is [37].
Shannon showed an inverse relationship between the probability of an event occurring and the resulting information. The more likely an event is to occur, the less information it can obtains and vice versa. With the acquisition of new information, uncertainties actually decrease and the value of new information is equal to the value by which the uncertainties decrease. As a result, uncertainties and information are interdependent parameters. Assume that m alternatives (A 1 , A 2 , . . . , A m ) and n criteria (C 1 , C 2 , . . . , C n ) are available for a decision-making problem. The decision matrix would be as follows: where a ij is the i-th alternative and j-th criterion.
To calculate the weights of the criteria, we must perform the four steps presented in Figure 5. where is the -th alternative and -th criterion. To calculate the weights of the criteria, we must perform the four steps presented in Figure 5.
Step1. Normalize the decision-making matrix Step2. Calculate the reliability associated with each criterion Step3. Obtain the uncertainty associated with each criterion Step4. Determine the weights for each criterion Figure 5. Flowchart of the process of calculating the weights of the criteria by the Shannon entropy method.
Step 1: The decision matrix is normalized using the following equation: where denotes the normalized value of each array in the decision matrix.
Step 2: The reliability of each index ( ) is calculated using the following equation: 1 Figure 5. Flowchart of the process of calculating the weights of the criteria by the Shannon entropy method.
Step 1: The decision matrix is normalized using the following equation: where P ij denotes the normalized value of each array in the decision matrix.
Step 2: The reliability of each index (E j ) is calculated using the following equation: Step 3: The uncertainty of each indicator (d j ) is obtained by the following equation: Step 4: Finally, the weight of each indicator (W j ) is calculated from the following equation:

SAW Method
The simple additive weighting (SAW) or weighted sum method (WSM) is the simplest MCDM method. In 1967, this method was presented by Fishburn [44]. In this method, only the decision matrix and the vector of criteria weights used for evaluation are required. Since this method uses a linear increment function to represent decision makers' preferences, it can be considered the simplest and most direct method of dealing with multi-criteria decision problems [45,46]. The steps involved in this method are shown in the flowchart in Figure 6. Step1. Quantitative the decision matrix Step2. Linear normalization of the decision-making matrix Step3. Determining the criteria weights Step4. Multiplying the normalized decision matrix by the weights of the criteria Step5. Choosing the best alternative Step 1: Quantifying the decision matrix.
To perform multi-criteria decision-making calculations, all decision matrix values need to be quantitative. If there are qualitative values in the decision matrix, the qualitative values should be converted into quantitative values using Tables 2 and 3.  Step 2: linear descaling (normalization) of decision matrix values. Step 1: Quantifying the decision matrix.
To perform multi-criteria decision-making calculations, all decision matrix values need to be quantitative. If there are qualitative values in the decision matrix, the qualitative values should be converted into quantitative values using Tables 2 and 3.  Step 2: linear descaling (normalization) of decision matrix values.
The criteria values with different dimensions must be converted to dimensionless criteria values. In the SAW method, a linear method is used for normalization and the following equations are used for positive and negative criteria, respectively.
where n ij indicates the normalized value of each array in the decision matrix.
Step 3: Obtain the weights of the criteria and multiply them by the normalized decision matrix calculated in the previous step.
In the present paper, the Shannon entropy method is used to obtain the criteria weights.
Step 4: Rank the alternatives and select the best alternative (A * ) according to the following equation:

TOPSIS Method
The technique for order of preference by similarity to ideal solution (TOPSIS) method is based on a simple principle: the best choice should have the closest possible distance from the ideal positive solution in geometric terms while being the furthest possible distance from the ideal negative solution [47]. This model undertakes that each criterion is uniformly increasing or decreasing its benefit.
The TOPSIS model was proposed by Hwang and Yoon [48] in 1981, and it is one of the best multi-criteria decision-making methods for ranking alternatives. In this method, m alternatives are evaluated by n criteria, which is based on the two concepts of "ideal solution" and "similarity to ideal solution". Ideal solution, as its name implies, is the best solution that is not generally possible in practice and one tries to approach it in order to measure the similarity of a design (or alternative) to an ideal and anti-ideal solution. The distance of that design (or alternative) from the ideal and anti-ideal solution is measured and then the alternatives are ranked based on the ratio of the distance from the anti-ideal solution to the total distance from the ideal and anti-ideal solution. In this method it is assumed that the desirability of each criterion is uniformly incremental or decreasing, the criteria are independent of each other, and the distance between the ideal and the anti-ideal solutions is calculated in Euclidean terms [49].
To apply this method to multi-criteria decision problems, we can follow the steps in the flowchart in Figure 7.
solution to the total distance from the ideal and anti-ideal solution. In this method it is assumed that the desirability of each criterion is uniformly incremental or decreasing, the criteria are independent of each other, and the distance between the ideal and the antiideal solutions is calculated in Euclidean terms [49].
To apply this method to multi-criteria decision problems, we can follow the steps in the flowchart in Figure 7.
Step1. Vector normalization of the decision-making matrix Step2. Determining the criteria weights Step3. Establish the balanced normalized decision matrix Step4. Identify the positive and negative ideal solutions Step5. Separation measures from positive and negative ideal solutions Step6. Measure of the relative closeness to the ideal solutions and ranking the alternatives Step 1: Normalize the decision matrix. At this stage, we attempt to transform the criteria values with different dimensions into dimensionless criteria values. In the TOPSIS method, the following equation is used for normalization: Step 1: Normalize the decision matrix. At this stage, we attempt to transform the criteria values with different dimensions into dimensionless criteria values. In the TOPSIS method, the following equation is used for normalization: Step 2: Determine the criteria weight matrix W n×n . The Shannon entropy method is used to determine the criteria weight matrix.
Step 3: Form the weighted normalized matrix of V m×n . The weighted normalized matrix (V m×n ) is obtained through multiplying the diagonal matrix of criteria weights (W n×n ) by the normalized decision matrix (N m×n ) according to the following equation: Step 4: Determine the ideal positive solution and the ideal negative solution.
The following equations are used to determine the ideal positive and negative solutions, respectively.
where A + indicates the ideal positive solution that represents the least possible risk, and A − indicates the ideal negative solution that represents the highest possible risk.
Step 5: Calculate the distance between the ideal positive and negative solutions. The degree of deviation between the ideal positive solution (d + i ) and ideal negative solution (d − i ) for each alternative using the Euclidean method are calculated from the following equations, respectively.
Step 6: Calculate the similarity index (Cl i ) to the ideal positive solution and rank the alternatives.
The similarity index indicates the score of each alternative and is calculated based on the following equation: The closer the indicator is to 1, the better the alternative.

ELECTRE Method
The elimination et choix traduisant la realité (ELECTRE) method was presented by Benjamin, Zinc, and Susman in 1966 and modified and upgraded by Zinc in 1971. There are two main steps for most ELECTRE methods: creating ranking relationships (outranking) and exploiting these relationships to achieve the final score of the alternatives. Different ELECTRE models may vary in terms of how they specify the scoring schemes between the different alternatives and how they use these schemes to achieve the final scoring assessment for different alternatives [50][51][52][53].
The distinctive element of ELECTRE is how it utilizes a scoring scheme by making pairwise comparisons between alternatives separately based on each criterion. This approach is based on studying the relations between ratings and the concepts of coordination. The construction of the scoring scheme is such that it enables the comparison of options. The ELECTRE method uses the concordance and discordance of the criteria as well as the threshold values to assess the scoring schemes between the available options [37]. To decide based on the ELECTRE method, one must first proceed to the formation of a weighted normalized matrix (V m×n )-similar to the TOPSIS method. To apply this method we must follow the steps in Figure 8. proach is based on studying the relations between ratings and the concepts of coordination. The construction of the scoring scheme is such that it enables the comparison of options. The ELECTRE method uses the concordance and discordance of the criteria as well as the threshold values to assess the scoring schemes between the available options [37].
To decide based on the ELECTRE method, one must first proceed to the formation of a weighted normalized matrix ( × )-similar to the TOPSIS method. To apply this method we must follow the steps in Figure 8.
Step1. Form the concordant and discordance sets Step2. Build the concordance and discordance matrices Step3. Determine the dominance concordance matrix Step4. Determine the dominance discordance matrix Step5. Compute the aggregate credibility matrix Step6. Prioritize the alternatives Figure 8. Flowchart of steps for implementing the ELECTRE method.
Step 1: Form concordance and discordance sets. At this stage, all alternatives are evaluated according to all criteria. The concordance set of the alternatives of and , denoted by , , will contain all the criteria under which is more desirable than . A discordance set of and alternatives, denoted by , , will include all the criteria under which is less desirable than . The following equations are used, respectively, to create concordance and discordance sets for the positive criteria: Step 1: Form concordance and discordance sets. At this stage, all alternatives are evaluated according to all criteria. The concordance set of the alternatives of k and l, denoted by S k,l , will contain all the criteria under which A k is more desirable than A l . A discordance set of k and l alternatives, denoted by D k,l , will include all the criteria under which A k is less desirable than A l . The following equations are used, respectively, to create concordance and discordance sets for the positive criteria: Additionally, to create concordance and discordance sets for the negative criteria, the following equations are used, respectively: Step 2: Construct concordance and discordance matrixes. The concordance matrix I k,l and the discordance matrix N I k,l are square matrices (m × m) whose main diameter is without value. Other elements of this matrix are derived from the sum of the weights of the criteria belonging to the concordance and discordance sets, which in mathematical language will be according to the following equations, respectively: These indexes express the relative importance of the alternative A k over A l . The value of this numerical criterion is between zero and one. The larger the value, the more superior A k is to A l .
Step 3: Form the dominance concordance matrix.
To form a revised concordance matrix represented by H, one needs to define a threshold I according to the following equation. The elements of the effective concordance matrix H are determined with respect to the concordance matrix I and by the following equations: Step 4: Form the dominance discordance matrix. At this stage, the effective uncoordinated matrix represented by G, like the effective coordinate matrix, needs to define a threshold (N I), which is determined by the values of this matrix via the following equations: Step 5: Form the dominated total matrix. The revised total matrix F is obtained by multiplying every element of the dominated concordance matrix by every element of the dominated discordance matrix G according to the following equation: Step 6: Prioritize the alternatives and select the best alternative. Finally, the dominated total matrix F expresses the partial outranking of the alternatives so that if F k,l = 1, it can be said that A k is superior to A l . Of course, this preference may be affected by other alternatives. Therefore, A k is the superior alternative, if for at least one L, F k,l = 1 and for others F k,l = 0.

VIKOR Method
The basics of the VIKOR model were first presented by Yu [54] and Zeleny [55] and later supported by Opricovic and Tzeng [56,57]. The model was developed for multicriteria optimization of complex systems and to solve decision-making problems with respect to contradictory and disproportionate criteria (different units of measurement). In the VIKOR method, a multi-criteria measurement is developed for compromise rankings using the L P metric, which is used as a cumulative function in a compromise programming method. The L P measurement provides the distance of A j as an alternative to the ideal solution. Each of the different alternatives A 1 , A 2 , . . . , A J , which are measured against different criteria C 1 , C 2 , . . . , C i , is indicated by f ij .
In this model, compromise ranking is achieved by comparing the degree of closeness with the ideal solution. VIKOR's key feature is that it maximizes the benefits of the group and minimizes the individual regret so that its compromise solution can be accepted by decision makers. VIKOR's compromise solution F C , as shown in Figure 9, is based on the closeness to the ideal solution F * among all the solutions, which results in the compromise of two criteria, f * 1 and f C 2 [58].
In this model, compromise ranking is achieved by comparing the degree of closeness with the ideal solution. VIKOR's key feature is that it maximizes the benefits of the group and minimizes the individual regret so that its compromise solution can be accepted by decision makers. VIKOR's compromise solution , as shown in Figure 9, is based on the closeness to the ideal solution * among all the solutions, which results in the compromise of two criteria, * and [58]. To implement the VIKOR method, the steps presented in Figure 10 must be taken.
Step1. Determine Positive and negative ideal solutions Step2. Compute maximum group utility and individual regret Step3. Calculate the VIKOR index for each alternative To implement the VIKOR method, the steps presented in Figure 10 must be taken. Figure 9. Ideal compromise solution diagram [58].
To implement the VIKOR method, the steps presented in Figure 10 must be taken.

Step1. Determine Positive and negative ideal solutions
Step2. Compute maximum group utility and individual regret Step3. Calculate the VIKOR index for each alternative Step4. Rank the alternatives Figure 10. Flowchart for Implementing the VIKOR method.
Step 1: Determine the positive ideal solution * and the negative ideal solution for every criterion. * = | ∈ , * = | ∈ where and are the set of positive and negative criteria, respectively.
Step 2: Calculate the benefit and regret values: Figure 10. Flowchart for Implementing the VIKOR method.
Step 1: Determine the positive ideal solution f * j and the negative ideal solution f − j for every criterion. f where I 1 and I 2 are the set of positive and negative criteria, respectively.
Step 2: Calculate the benefit S i and regret R i values: Step 3: Calculate the VIKOR index Q i for every criterion: where S * = minS i , S − = maxS i , R * = minR i , R − = maxR i and ν is weight assigned to maximum group utility, whereas (1 − ν) is the weight of individual regret. Generally, ν is considered 0.5. However, it can also be any value between 0 and 1.
Step 4: Rank the alternatives with respect to the calculated values of Q i in an incremental order, where the alternative with the lowest Q i is preferred.

COPRAS Method
Complex proportional asessment (COPRAS) is one of the most accepted multi-criteria decision-making methods and was introduced and used by Zavadskas and Kaklauskas in 1994 [59]. COPRAS is one of the methods that has been developed rapidly and has been used in various fields such as medicine, materials, energy, etc. In this method, the ranking of options is done step by step by considering the ideal and worst solutions based on the relative and direct dependence on their degree of application and importance [60]. In addition, it is possible to use this method to maximize or minimize a criterion (when more than one criterion is available) [61]. To use the COPRAS method, the steps illustrated in Figure 11 must be implemented.
used in various fields such as medicine, materials, energy, etc. In this method, the ranking of options is done step by step by considering the ideal and worst solutions based on the relative and direct dependence on their degree of application and importance [60]. In addition, it is possible to use this method to maximize or minimize a criterion (when more than one criterion is available) [61]. To use the COPRAS method, the steps illustrated in Figure 11 must be implemented.

Step1. Normalization of the decision-making matrix
Step2. Forming the weighted normalized decision-making matrix Step3. Calculate the sum of weighted normalized values for both of positive and negative criteria Step4. Determination of each alternative's relative significance Step5. Prioritize alternatives according to calculated utility degree values for each alternative Figure 11. Flowchart of the implementation steps of the COPRAS method.
In this method, the following equation is used to normalize the decision matrix and to make the values comparable: Step 2: Form a balanced normalized decision matrix. Figure 11. Flowchart of the implementation steps of the COPRAS method.
In this method, the following equation is used to normalize the decision matrix and to make the values comparable: Step 2: Form a balanced normalized decision matrix. Similar to the TOPSIS method, by applying the weight of the criteria to the normalized decision matrix, the weighted normalized decision matrix is calculated according to the following equation: Step 3: Calculate the sum of the weighted normalized values for the positive (useful) S + i and negative (non-useful) S − i criteria. For each of the options, the sum of the balanced normalized values according to the type of criteria are obtained as follows: In above equations, + and − represent the useful and non-useful, respectively.
Step 4: Calculate the relative importance or priority of each of the options (Q i ).
To do this, S − min must first be specified, which represents the minimum value of S − i . Q i is then set for each of the options as follows: Step 5: Determine the percentage of efficiency (UD i ) and rank the options. In the last step, to rank (prioritize) the options, UD i is determined for each of the options as follows: where Q max denotes the maximum relative importance among options. The highest value of UD i indicates the best option for selection.

Selection of Evaluation Criteria
Common criteria that serve as a basis for RE solution assessment are: technical, economic, environmental, and social policy aspects. The priorities or interests of different stakeholders can be met by using different assessment techniques. For instance, technological readiness level (TRL), lifetime, investment cost, O&M cost, and feed-in-tariff (FIT) may be most important factors for investors. Meanwhile, carbon dioxide emissions, land use, and water consumption are the most important matters for governments and job creation and safety are the biggest concerns for people. A thorough list of crucial evaluation criteria is provided, taking into account all the views of major stakeholders, the accessibility of specific current information for Jiangsu, and the possibility of ranking solutions. Table 4 shows the list of criteria used to assess the alternatives for clean energy resources available in Jiangsu province. Available clean energy alternatives include solar photovoltaic, wind, nuclear and biomass. The reasons for choosing the evaluation criteria listed in Table 4 are explained below.

Technology Readiness Level (TRL)
Because Jiangsu is a developed province and is located in China, the TRL criterion must not be neglected. TRL can be a factor when evaluating clean energy alternatives by designing, manufacturing, and installing related equipment, transmitting or storing generated energy, etc., given that this technology can be transferred to any county. TRL values for wind, solar, and biomass energy are considered according to Ref. [64], where "1" specifies that TRL is confirmed by the government of Jiangsu, while "3" means that TRL is at a very low level. Additionally, TRL is set to "3" for nuclear power since clean energy sources require the most technological focus. It is noteworthy that Russia supports the nuclear power technologies in Jiangsu province.

Safety
Safety criterion can be a benchmark for the technical assessment of technology and also a social criterion for demonstrating the impact of different energy systems on society and people [37]. Safety values are determined according to the specific characteristics of each clean energy alternative [63]. The risk of nuclear energy is small, but because of the possibility of nuclear leakage or explosion its potential is high. Wind energy technology has a high probability but relatively low impact with the potential for birds to fly into installed turbines, unusual scenery effects, and moderate noise pollution. Because obtaining a cardinal number for safety matters is not easy, a range of 1 to 4 is applied to specify the relative safety of any other technology. The value 4 is applied to represent the most secure technologies.

Efficiency
The amount of useful output that can be received from input energy in a system is called the energy efficiency of that system. In other words, energy efficiency is the ratio of useful energy output to energy input in a system. This parameter has a range for different technologies and in this study the average value of the reported values is used. The energy efficiencies of solar photovoltaic, wind energy, nuclear energy, and biomass have been extracted from [65,66].

Lifetime
The lifetime of any energy system is the average expected time during which that system can remain fully operational. Each power generation system, due to its nature, can provide service over a certain period of time and it is clear that over time the probability of failure of a system increases. The average lifetime data for solar photovoltaic and wind technologies are derived from [65] and for nuclear and biomass technologies from [26].

Investment Cost (IC)
The investment cost (IC) for each technology can vary depending on its nature. However, in general the IC includes items such as the cost of purchasing mechanical equipment, installation of equipment, engineering services, construction of required structures, construction of communication routes with the network, etc. Information on IC in solar PV, wind, nuclear, and biomass in Jiangsu province is adopted from [67][68][69][70], respectively. (The conversion exchange rate of the US Dollar to the Chinese Yuan was 6.139).

Operation and Maintenance (O&M) Costs
This economic indicator consists of two important parts: (1) Operating costs, which consist of staff wages and the total cost of fuel, products, and services required to operate an energy system, and (2) Maintenance costs, which includes the total cost of repairing and servicing the system in order to increase the lifetime of the system and its proper operation during the expected life. The average of the reported values for this parameter is extracted from [33].

Feed-in-Tarrif (FIT)
FIT is a feed-in tariff for the purchase of each kWh of electricity generated by clean energy sources, often set by the government to encourage the use of clean energy in designated areas for energy production. The amount of this tariff for different technologies is determined according to the conditions of energy resources in the country, government pol-icy, the level of maturity of technologies, and other issues. FIT values for solar photovoltaic, wind, nuclear, and biomass in Jiangsu are calculated using methods in [68][69][70][71], respectively.

Carbon Dioxide (CO 2 ) Emission
Carbon dioxide emissions are one of the most important criteria when selecting the best clean energy option and evaluating the sustainability of renewable energy sources. Although energy systems powered by renewable energy sources such as solar and wind do not emit any carbon dioxide during the power generation process, the manufacturing and installation processes of these technologies, as well as the disposal or recycling of equipment after the end of their lifetime, will be accompanied by greenhouse gas emissions. Therefore, in fact, this measure indicates the amount of carbon dioxide emissions in the life cycle of each of the clean energy options. Carbon dioxide emission values for solar photovoltaic, wind and biomass technologies have been calculated by [64] and for nuclear by [72].

Land Use
The required land is obtained by biomass energy in Jiangsu according to [70,73]. Based on those findings, the land needed for solar photovoltaics and wind energy could be quantified with respect to [64]. Additionally, since there is only one nuclear power plant in Jiangsu, the required land is calculated according to the data on the nuclear company's website [74].

Water Consumption
The water consumption index indicates the amount of water that is consumed and wasted during the production of each unit of energy in different technologies. Water consumption is one of the most important parameters for the sustainability of energy systems; for this reason, it is necessary to consider this indicator when deciding on the choice of clean power generation technology. Water consumption values for different options were obtained from [66].

Job Creation
Due to the population density of the region and its economic condition, creating new jobs is also important for Jiangsu. The values of this criterion are calculated according to [75][76][77].

2050 Installed Capacity Projection
The installed capacity projection for 2050 for each of the clean energy options in Jiangsu province is based on a study conducted in [33]. In this study, the installed capacity projection for 2050 is based on an ambitious policy scenario to move towards a sustainable energy path that will lead to a major improvement in the efficiency of Jiangsu's energy system. It should be noted that the values reported for this criterion are subject to the full use of renewable energy sources that can be used in Jiangsu province.
Obviously, other criteria like environmental impacts are necessary for Jiangsu. For instance, birds can be damaged with wind turbines, leakage of toxic substances can adversely influence the marine life balance, and the utilization of biomass energy may cause food-related safety problems. However, due to the fact that statistical data are scarce and in some cases inaccessible, other possible influential criteria have not been considered in this study. Table 5 summarizes the values for each clean energy solution according to each criterion. Each criterion has a different unit, so it is necessary to perform normalization before performing the evaluation.

Results and Discussion
The aim of this study is to select the optimal alternative among the four clean energy technologies selected for energy production in Jiangsu province, China as evaluated by 12 criteria. To do so, the Shannon entropy method is used to calculate the criteria weight and then five widely used MCDM methods (SAW, TOPSIS, ELECTRE, VIKOR, and COPRAS) are used and the results of each are discussed.

Evaluation Criteria Weights
Here, the Shannon entropy method is used to calculate the weights of the criteria in all five methods. We calculate the weight for each criterion using the available decision matrix ( Table 5). The results are the summarized in Table 6. In Table 5, the third column represents the criteria weights. As can be seen, the maximum calculated weight is associated with the land use criterion with a value of 0.2734 because dispersion in the values of this criterion is high. After that, water consumption, job creation, 2050 projection installed capacity, and CO 2 emission criteria have the highest dispersion and maximum impact, respectively.

SAW Method Ranking
In the SAW method, the calculations are carried out directly and simply. The criteria weight matrix is used to calculate the normalized matrix. For this purpose, the normalized matrix is calculated linearly (Table 7). Finally, by multiplying the linear normalized matrix by the weight matrix, the final matrix that represents the ranking of the alternatives is obtained. According to Table 8, the ranking is as follows: Solar PV > Wind > Nuclear > Biomass.

TOPSIS Method Ranking
In the TOPSIS method, the weights calculated for the criteria in the previous section are used. In this method, the norm method is used to normalize the decision matrix and the normalized decision matrix can be seen in Table 9. Then, by obtaining the weighted normalized matrix, the positive ideal solution (A + ) and the negative ideal solution (A − ) are determined, which are illustrated in Table 10.
Finally, by calculating the distance of every alternative to the criteria from positive to negative ideal solution and calculating the closeness index to the ideal solution, the ranking of the alternatives is conducted by the TOPSIS method. According to Table 11, the ranking is: Solar PV > Wind > Nuclear > Biomass.

ELECTRE Method Ranking
In ELECTRE ranking, normalizing is used as in the TOPSIS method. Similar to the TOPSIS method (Table 9). First, the weighted normalized matrix (V) is calculated and then the concordance (S k,l ) and discordance sets (D k,l ) are determined. Then, with the help of the specified sets, one creates the concordance matrix (I) and the discordance matrix (N I) in the form of matrices (Equations (29) and (30)). In the following, the threshold values for concordance and discordance matrices are obtained by applying Equations (22) and (25), where I = 0.5030 and N I = 0.6530. Finally, by means of Equations (23), (24), (26) and (27), I and N I are converted into a revised concordance matrix (H) and a revised discordance matrix (G) and by multiplying every element of matrix H by elements of matrix G, the revised total matrix (F) is obtained using Equation (31).
According to the matrix, the final ranking result obtained from this method shows that the optimal alternatives for Jiangsu are Solar PV and Wind, which are superior to the other alternatives with a double domination.

VIKOR Method Ranking
When ranking the alternatives by the VIKOR method, the calculated weights for the criteria (according to Table 6) are used. The values of the positive ideal solution and the negative ideal solution are determined according to Equations (30) and (31). The values of the positive ideal solution f j * will be the largest value for the positive effect criteria and the lowest value for the negative effect criteria. Additionally, the values of the negative ideal solution ( f j − ) will be the smallest value for the positive effect criteria and the largest value for the negative effect criteria. Based on this, Table 12 shows the vectors f j * and f j − for seven different criteria in this study. Finally, utilizing Equations (32)-(34) the values of R, S, and Q are calculated for each alternative, the results of which are listed in Table 13.

COPRAS Method Ranking
In the COPRAS method, the normalization of the decision matrix is different from that of the other methods presented in this study. By applying Equation (35) to the initial decision matrix, the normalized decision matrix is obtained according to Table 14. Then, by multiplying the diameter matrix of the criteria weights (W n×n ) in the normalized decision matrix (N m×n ), the weighted normalized matrix (V m×n ) is calculated, which is given in Table 15. With the balanced normalized matrix, the sum of the total balanced normalized values for the positive (S + i ) and negative (S − i ) criteria for each of the clean energy options is calculated and can be seen in the second and third columns of Table 15, respectively. Finally, to calculate the relative priority for each of the options based on Equation (39), the first the parameter S − min = 0.0626 is determined and then Q i and the efficiency Q i are calculated for all four clean energy options and are summarized in the 4th and 5th columns of Table 16. As can be seen in the ranking of options using the COPRAS method, the best option is solar photovoltaic and the other options are prioritized as follows: Solar PV > Wind > Nuclear > Biomass.

Comparing Results
In the present study we used five widely used MCDM methods (SAW, TOPSIS, ELEC-TRE, VIKOR and COPRAS) to evaluate four clean energy alternatives using 12 different criteria for Jiangsu province in China. The results obtained by the various methods are compared with the results obtained from [4] in Table 17. In [4], two methods, ordered weighting averaging (OWA) and Choquet integral, were used in the fuzzy environment. In both, solar PV is the preferred alternative and wind is in second place. However, the biomass and nuclear alternatives used in both methods are in different positions. In this study, five widely used MCDM methods are used to evaluate the ranking. According to the results listed in Table 17, the ranking obtained with the SAW, TOPSIS, VIKOR, and COPRAS methods is: Solar PV > Wind > Nuclear > Biomass.
The ranking of clean energy options with the ELECTRE method is: Solar PV > Wind> Biomass = Nuclear. This indicates the same priority of Biomass and Nuclear, both of which are in the third rank. This shows that ranking based on the extracted decision matrix is highly reliable, and a decision maker can make a decision with complete confidence according to that priority.

Sensitivity Analysis
In the previous sections, the weights of the criteria are calculated according to the data extracted from the relevant references. Since the criteria weights directly affect the ranking of the alternatives, it is necessary to consider variations in the weight of the criteria and how they affect the classification of the options. Therefore, two sensitivity analysis models are considered to show how changes are made in the ranking of alternatives as a result of variations in the weights of the criteria. First, an incremental and decreasing rate of 15%, 30%, and 45% is applied to all criteria and in order to maintain a sum of the weights equal to 1, when the weight of one criterion increases/decreases, the rest of the weights of the criteria must decrease/increase proportionally. In order to obtain higher-precision calculations and to save time, the developed code in MATLAB software was used and the obtained sensitivity analysis outputs are demonstrated in Figure 12. To report changes in the performance value of every clean energy alternative as a result of variations in the weight of the criteria, the TOPSIS method is used. As can be seen in Figure 12, the majority of the changes occurred in the land use (C9) criterion, in which biomass is the most sensitive alternative. This means that by changing the weight of the C9 criterion, the performance of the options (especially biomass) changes significantly compared to other criteria. Based on the diagram of the C9 criterion, it is clear that as the weight of this criterion decreases, the performance of the biomass option increases significantly, while other options, especially nuclear ones, have an inverse relationship with biomass. Meanwhile, increasing the weighting of the C9 criterion increases their performance. The large changes in the C9 criterion are due to its higher weight, which shows its crucial role in the performance of clean energy options.
After C9, water consumption (C10) and O&M costs (C6) are more sensitive than the other criteria. According to the chart related to the C10 criterion, it is clear that the inverse of the nuclear option has a great effect on the weight changes of this index, the performance of which decreases significantly with an increase in the weight of the C10 criterion. Meanwhile other clean energy options, especially biomass, directly improve their performance by increasing the weight of C10. However, as can be seen in Figure 12F, C6, it is only biomass that has a significant direct impact on changes in the weight of this index. In addition, it should be noted that job creation criteria (C11) and installed capacity projection for 2050 (C12) in the next categories are criteria that are sensitive to weight changes. In C11, wind energy is the most sensitive option to weight changes of this criterion, and its performance is inversely related to C11 weight changes. Finally, C12 is included in the list of sensitive criteria where solar photovoltaic is the most effective option against changes in its weight. Its performance is inversely related to changes in the weight of this criterion. In contrast, changes in the weight of investment cost measures (C5), efficiency (C3), FIT (C7), TRL (C1), and lifetime (C4) have little effect on the performance of clean energy options. This is due to the low weight of these criteria in the decision-making process. Changes in the weight of the two criteria of CO 2 emission (C8) and safety (C2) also have little effect on the performance of the options, except for biomass, which, unlike other clean energy options, is inversely related to the change in weight of the C8 benchmark. Additionally, according to the C2 criterion diagram, it is clear that biomass has a positive effect on the weight of this criterion. In summary, it could be said that by applying the weight change rates to criteria with lower weight, less effect on the performance of alternatives is experienced.
Second, there are five different scenarios for assessing the effect of criteria weight variations on ranking clean energy alternatives, which are listed in Table 18. In the first scenario, the significance of all aspects is assumed to be constant, and the other four scenarios focus on technical, economic, environmental, and social-policy aspects, respectively. The five defined scenarios are evaluated by 12 criteria using the five methods described in this study (SAW, TOPSIS, ELECTRE, VIKOR, and CORPAS). To be precise in calculating and saving time, the code developed in MATLAB software was used. The results of ranking based on scenarios and various methods are illustrated in Figure 13. As expected, the results of ranking are different for every scenario and the biggest variations in prioritizing occurred for the biomass alternative, which is highly sensitive to criteria weight variations. photovoltaic. Based on the results obtained from the ELECTRE method, two options of solar photovoltaic and wind with the same priority are in first place and nuclear and biomass are in second place with the same priority. From an environmental point of view, it is illustrated that biomass has the worst performance and that nuclear is in third place. In the last scenario, wind energy is the preferred option with the three methods of SAW, ELECTRE, and COPRAS, while with the other two methods, TOPSIS and VIKOR, solar photovoltaic is the preferred option. In this scenario, biomass overtakes nuclear and is in third place due to nuclear being less socially acceptable than biomass. As described, different rankings have been obtained from the different perspectives defined in the five scenarios presented. Depending on the preferences and priorities that a decision-maker has, the best clean energy option will be selected based on the proposed scenarios. However, if an optimal decision is to be made considering all the various technical, economic, environmental, and socio-political aspects, a single overall ranking among the clean energy options considered for Jiangsu province in China can be applied.
For this purpose, an aggregation approach is utilized to obtain a comprehensive ranking considering the sensitivity analysis and MCDM models. In the aggregation approach, the best choice receives a k score (for example, 4 score) for being the first choice, In the first scenario, where all four technical, economic, environmental, and sociopolitical dimensions are given the same weight, the wind energy option in the four decisionmaking methods of SAW, ELECTRE, VIKOR, and COPRAS is chosen as the most attractive option. According to the TOPSIS method, solar photovoltaic is the most attractive option. In this scenario, solar photovoltaic is the most common option in the second place. However, the biomass and nuclear options have different positions in different MCDM methods.
From a technical point of view, the ranking of options with the SAW method is similar to the first scenario, but the ranking with other MCDM methods is different. With the TOPSIS and COPRAS methods, the positions of biomass and nuclear options have been swapped, and with the ELECTRE method solar photovoltaic and biomass are in joint first place, overcoming other options. However, with the VIKOR method, a completely different ranking is obtained from other methods, and biomass is the superior option according to this method.
In the third scenario, which focuses on the economic perspective of the options, the most frequent option in the first priority is wind energy. However, in the TOPSIS and VIKOR methods, the nuclear and biomass methods have been selected as attractive options. It is noteworthy that among the clean energy options, solar photovoltaic is the third or fourth priority using various methods (except for the COPRAS method, where A1 is in second place). That is, from an economic point of view, solar photovoltaic will not be an attractive option for investors.
In the fourth scenario, the emphasis is on minimizing the negative environmental impacts. The results depict that wind energy is the best choice, followed by solar photovoltaic. Based on the results obtained from the ELECTRE method, two options of solar photovoltaic and wind with the same priority are in first place and nuclear and biomass are in second place with the same priority. From an environmental point of view, it is illustrated that biomass has the worst performance and that nuclear is in third place.
In the last scenario, wind energy is the preferred option with the three methods of SAW, ELECTRE, and COPRAS, while with the other two methods, TOPSIS and VIKOR, solar photovoltaic is the preferred option. In this scenario, biomass overtakes nuclear and is in third place due to nuclear being less socially acceptable than biomass.
As described, different rankings have been obtained from the different perspectives defined in the five scenarios presented. Depending on the preferences and priorities that a decision-maker has, the best clean energy option will be selected based on the proposed scenarios. However, if an optimal decision is to be made considering all the various technical, economic, environmental, and socio-political aspects, a single overall ranking among the clean energy options considered for Jiangsu province in China can be applied.
For this purpose, an aggregation approach is utilized to obtain a comprehensive ranking considering the sensitivity analysis and MCDM models. In the aggregation approach, the best choice receives a k score (for example, 4 score) for being the first choice, k-1 score (3 score) for being the second choice, and so on. The alternative with the greatest number of points is the best choice. Therefore, the ranking results after applying the aggregation method are shown in Figure 13F. k-1 score (3 score) for being the second choice, and so on. The alternative with the greatest number of points is the best choice. Therefore, the ranking results after applying the aggregation method are shown in Figure 13F.

Conclusions
The evaluation of clean energy sources is of particular importance for governments because making the right decision provides opportunities for new economic markets and job creation. For this purpose, in this article, four clean energy alternatives suitable for Jiangsu province, including solar photovoltaic, wind, nuclear, and biomass, were evaluated using the 12 criteria of technology readiness level (TRL), safety, efficiency, lifetime, investment cost, O&M costs, feed-in-tariff (FIT), carbon dioxide emission, land use, water consumption, job creation, and 2050 projection installed capacity. The results of implementing the five extensively used MCDM methods of SAW, TOPSIS, ELECTRE, VIKOR, and COPRAS to evaluate and rank these clean energy alternatives, as well as perform a two-stage sensitivity analysis, are summarized as follows: (1) In this study, the environmental aspect has the highest weight and the greatest impact on the evaluation of options with a value of 0.5851, with land use criteria (C9) and water consumption (C10) having the highest weight and the most important role in evaluating the options in this category with values of 0.2734 and 0.2337, respectively.
(2) The ranking of alternatives based on the initial decision matrix was obtained using the four methods of SAW, TOPSIS, VIKOR, and COPRAS as solar PV > wind > nuclear > biomass. When using the ELECTRE method, the ranking is the same but the nuclear and biomass both have the same score and neither dominates the other.
(3) Given that the prioritization of clean energy options through the five different MCDM methods used in this study is on the basis of the same decision matrix extracted from the references, the presented rankings are highly reliable.
(4) Solar photovoltaic and wind energy are the top two alternatives in the study, so a combination of these two sources of clean energy increases efficiency and technological benefits, as well as reducing costs.
(5) Land use among all criteria has the highest weight and the highest sensitivity to the rate of change of weight, so it is possible to achieve significant improvements in their overall performance by making minor positive changes in land use. (6) The investment cost criterion in this study has the lowest weight and the lowest sensitivity to weight change rates; therefore, it is possible to make significant improvements in their overall performance by applying improvements in other aspects of clean energy alternatives, especially environmental and social aspects.
(7) By defining five different scenarios and presenting the final ranking resulting from the five MCDM methods used in this study, the decision maker can find the proper ranking with respect to the special conditions and the relative importance of technological, economic, environmental, and social-policy aspects ( Figure 13).
Finally, future work may include a comparative study of the use of different weighted methods-either subjective or objective methods. In addition, adding more appropriate options to the decision-making problem can make the work more comprehensive and improve the decision-making process. The use of hybrid multi-criteria decision-making methods in such studies will also improve the scientific content of the work and increase the attractiveness of the project.