1. Introduction
Multi-criteria decision-making (MCDM) is an essential and interdisciplinary field in operations research that has been taken into consideration in the past years. This field can be categorized into two different branches: multi-objective decision-making (MODM) and multi-attribute decision-making (MADM) [
1]. In MODM, we usually address the problems of determining an optimal or near-optimal solution in a feasible solution space based on multiple objectives and several variables, parameters, and constraints. Solving linear and ono-linear programming models is a common way to deal with MODM problems. On the other hand, MADM is a branch of MCDM that deals with issues defined by discrete decision variables, a limited number of alternatives and attributes [
2,
3,
4,
5]. The focus of this study is on this branch of MCDM. Many researchers have usually used the two terms: MADM and MCDM. We also use the term MCDM to refer to the current research problems.
In practical situations, we can be confronted with some problems in which a finite set of alternatives need to be evaluated in terms of multiple criteria [
6,
7,
8,
9]. MCDM methods provide us with a process that results in rational, explainable, and justifiable decisions. Several MCDM methods and techniques have been proposed in the literature. WSM (Weighted Sum Model), WASPAS (Weighted Aggregated Sum Product ASsessment), TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution), VIKOR (Vise Kriterijumska Optimizacija I Kompromisno Resenje), PROMETHEE (Preference Ranking Organization METHod for Enrichment of Evaluations), ELECTRE (ELimination Et Choix Traduisant la REalité), COPRAS (COmplex PRoportional ASsessment), EDAS (Evaluation based on Distance from Average Solution), AHP (Analytic Hierarchy Process), and BWM (Best-Worst Method) are some of the popular MCDM methods which have been utilized by many researchers in different fields of study [
10,
11,
12,
13,
14,
15]. Generally, there are four steps in the evaluation process using MCDM approaches: (i) defining the alternatives and criteria related to the problem, (ii) determining weights of each measure, (iii) assigning individual performance to each option on each measure, and (iv) evaluate the alternatives based on the aggregate performance of them on all criteria [
16,
17]. The second step is the focus of this study. We can say that determination of criteria weights is one of the most critical and complicated processes in dealing with MCDM problems.
The weights of criteria show the importance of them. The easiest way, which has been utilized in many studies, is to assign equal weights to the criteria [
18]. However, the final evaluation results are highly dependent on the weights of criteria, which is not appropriate [
19]. Several methods have been introduced to obtain criteria weights. These methods fall into three categories—subjective weighting methods, objective weighting methods, and hybrid weighting methods. In subjective methods, the determination of criteria weights is dependent on the preferences of decision-makers. Direct ranking, point allocation, pairwise comparisons, and SMART (Simple Multi-attribute Ranking Technique) are examples of subjective methods [
20]. The main disadvantage of these methods is that they are not efficient enough when the number of criteria increases. In other words, expressing preferences is a mental task for decision-makers, and the accuracy of their preferences decreases by increasing the number of criteria [
17]. In objective weighting methods, the preferences of decision-makers have no role in determining criteria weights [
20]. The objective weighting methods yield criteria weights using a specific computational process based on the initial data or decision-matrix (each alternative’s performance on each criterion).
In these methods, we do not use direct data on the significance of criteria expressed by decision-makers [
21]. Entropy method, Standard Deviation method, CRITIC (CRiteria Importance Through Inter-criteria Correlation) and SECA (Simultaneous Evaluation of Criteria and Alternatives) are in the category of objective weighting methods [
9,
20,
22]. Hybrid methods use a combination of different subjective and objective weighting methods. These methods have no distinctive characteristics, and they borrow the features of other methods. Since the hybrid methods can utilize the decision-makers’ preferences and the data of decision-matrix, they could give more realistic weights [
23,
24,
25,
26,
27,
28]. Each of these methods has its advantages and disadvantages and can be efficient in different situations. Here, we do not aim to study these advantages and disadvantages.
This study proposes a new objective weighting method, called MEREC (MEthod based on the Removal Effects of Criteria), for determining criteria weights. As mentioned previously, the objective weighting methods use the initial data or the decision-matrix to determine criteria weights. These methods usually exploit the variations in different alternatives’ performances concerning each criterion to determine the weights. The criteria with more variations have greater weights [
20]. Unlike the other methods, the proposed method uses removal effects of each criterion on the aggregate performance of alternatives for calculating criteria weights. In the proposed method, a criterion has a greater weight when its removal leads to more effects on alternatives’ aggregate performances. Besides weighting each criterion, this perspective may help decision-makers to exclude some criteria from the decision-making process. Considering the variations, the performance of an alternative based on removing criteria is a new perspective on determining the weights of criteria. In other words, the concept of causality is the basis of the proposed method. A logarithmic function is used in this study to measure the aggregate performance of alternatives; however, as the main advantage of the proposed method, it is flexible so that decision-makers can use different functions to calculate the performances. Introducing new MCDM methods based on novel perspectives could help experts and decision-makers increase the robustness of results based on integration and combination of approaches.
In this paper, after presenting the proposed method, it is illustrated through a simple MCDM example. Another numerical example is used to make a computational study on the method and compare it with some other objective weighting methods. Besides, a simulation-based analysis is conducted to make a more comprehensive comparison and verify the stability of the results of MEREC by testing the homogeneity of variances of the criteria weights. Symmetrical data are generated for the simulation-based analysis using the normal distribution. The analysis of means (ANOM) for variances is applied to show the homogeneity of variances in the simulation results. The comparative study results show that the weights obtained by MEREC are consistent with those of other objective weighting methods. Moreover, the simulation-based analysis demonstrates that MEREC yields homogeneous variances and can give stable criteria weights.
The remainder of this paper is organized as follows.
Section 2 reviews some recent studies on the objective weighting methods and their applications.
Section 3 systematically presents MEREC.
Section 4 examines the introduced method based on computational analyses. This section includes three sub-sections. The first sub-section illustrates the procedure of using MEREC for the determination of criteria weights. The second sub-section uses an MCDM problem to present the results of a comparison between MEREC and three objective weighting methods (CRITIC, Entropy, and Standard Deviation). The third sub-section provides simulation-based analysis results to verify the credibility, reliability and stability of the results determined using MEREC. Finally,
Section 5 discusses conclusions.
2. Recent Studies on Objective Weighting Methods
In this section, some of the most recent studies on the applications and developments of objective weighting methods are briefly surveyed. We focus on the three common methods (Entropy, Standard Deviation, and CRITIC) because they are used in this study’s computational analysis.
In a recent study, Nguyen et al. [
29] studied the financial performance of retailer companies traded in the Vietnam Stock Exchange Market. They examined the financial performance concerning several ratios, including valuation, profitability, growth rate, liquidity, efficiency, and leverage. Twelve companies were considered in different quarters of 2019 and 2020. They used the Standard Deviation method to compute the weights of eighteen financial ratios. Then, the Grey relational analysis was applied to rank each company in each quarter (time). Their study showed that the leverage ratio could highly impact the retailer companies’ financial performance and long-term investment planning.
Sałabun et al. [
30] addressed the problem of choosing appropriate methods for MCDM problems. Their study focused on benchmarking some of the prevalent methods in this field based on a simulation-based analysis. TOPSIS, VIKOR, COPRAS, and PROMETHEE II were selected to perform the analysis. Besides, they used different normalization techniques and different weighting methods, including the Equal Weights, Entropy, and Standard Deviation methods. It was concluded that the Equal Weights method was not the right choice for weighting criteria compared with the Entropy and Standard Deviation methods. Moreover, they found that using the Entropy weighting method led to smaller changes in the correlation between rankings.
Another study was performed on the dimensions of cultural environment and development. To evaluate the Czech theatres’ economy, Vavrek and Bečica [
31] selected 11 criteria related to financial and technical efficiency. Three objective weighting methods, including Coefficient of Variation, Standard Deviation, and Mean Weight (Equal Weights) methods, were applied to determine the selected criteria’ importance and the variation coefficient indicated that financial criteria are more significant than technical criteria, but standard deviation gave importance to technical criteria. The TOPSIS method is then utilized to make the overall evaluation concerning these two categories of criteria.
Narayanamoorthy et al. [
32] used the standard deviation as an objective weighting method and hesitant fuzzy sets to develop three multi-criteria decision-making approaches: hesitant fuzzy standard deviation with multi-objective optimization method by ratio analysis (HFSDV-MOORA), hesitant fuzzy standard deviation with VIKOR (HFSDV-VIKOR), and hesitant fuzzy standard deviation with TOPSIS (HFSDV-TOPSIS). They applied the proposed approaches to evaluate water distribution systems and improve water resources. Their problem consisted of four alternatives and five criteria. To validate the results of the proposed approaches, they made a comparative analysis based on the studies of Liao and Xu [
33], Xu and Zhang [
34], and Li [
35].
In a recent research, Anitha and Das [
36] tackled a problem to optimize electro-discharge machines’ process parameters. They considered four input parameters of the problem, including pulse-on time, current, voltage, and duty cycle and their effects on surface roughness (Ra), and material removal rate (MRR). The Standard Deviation method was utilized to obtain the criteria weights (MRR and Ra). Based on experimental results, they applied the full multiplicative form of MOORA (MULTIMOORA) and multi-objective optimization based on simple-ratio analysis (MOOSRA) to determine the best scenario of parameters in the considered process. In this field, Anitha and Das [
37] also made a similar study and utilized the MOOSRA and Standard Deviation methods.
Maheshwari et al. [
38] performed a study on design parameters of the solid ventilated brake disc. They defined seven criteria, including inboard plate thickness, outboard plate thickness, vane height, effective offset, central radius, fatigue life, and axial deflection. The authors constructed several scenarios through a full factorial design (design of experiments), and used the Standard Deviation method for weighting the criteria. They applied the EDAS, COPRAS, TOPSIS, and ARAS (Additive Ratio ASsessment) methods to evaluate the designed scenarios. The authors also compared results of the considered MCDM methods to verify the optimum design parameters.
Ramasamy et al. [
39] applied the TOPSIS method in research for choosing the optimized set of experimental conditions to synthesize Bismuth Iron Tri Oxide (BiFeO
3–BFO) nano-powder using the sol-gel route based on changing time duration and slotted calcination temperature. Their study’s main goal was to identify the optimum time duration and slotted calcination temperature required to get single-phase powders with minimum strain and crystallite size. The input weights of TOPSIS were assigned based on two approaches: Equal Weights and Standard Deviation methods. Due to the low number of criteria, there was not much difference in the results of these two approaches.
Şahin [
40] addressed the material selection problem in the process of designing a product. The Standard Deviation and CRITIC methods were used to determine the criteria’ importance, and the GRA (Grey Relational Analysis), TOPSIS, and ORESTE (Organization, Rangement Et Synthese De Donnes Relationnelles) methods were applied to evaluate the alternatives. Six approaches were proposed based on these methods: Standard Deviation-GRA, Standard Deviation-TOPSIS, Standard Deviation-ORESTE, CRITIC-GRA, CRITIC-TOPSIS, and CRITIC-ORESTE. The author analyzed and compared the proposed approaches and used the Copeland method to aggregate the results.
Yazdani et al. [
41] made a study on the evaluation of renewable energy resources. They developed a multi-criteria decision-making approach to handle this evaluation process with conflicting objectives. Five renewable resources, including solar thermal, solar photovoltaic, wind power, biomass, and geothermal, were chosen for evaluation. The set of evaluation criteria consisted of economic, social, environmental and technical dimensions. Their developed methodology was based on the EDAS and Entropy methods. A case-based analysis (a case in Saudi Arabia) was performed to show the developed methodology’s application, and wind power was selected as the most suitable alternative. They also made a sensitivity analysis to verify the stability of the results.
In another study, Afshar et al. [
42] tackled the subcontractor evaluation problem. They used type-2 fuzzy sets to deal with the uncertainty of information in the qualification assessment of subcontractors. Their study’s methodology was based on the TOPSIS method, and they utilized the Entropy method to determine criteria weights. More than ten criteria and their corresponding sub-criteria were defined for the evaluation process. They used the centroid of the interval type-2 fuzzy values in the decision matrix for determining criteria weights by Entropy. To validate their methodology, they compared it with an approach based on type-1 fuzzy sets.
Arya and Kumar [
43] designed a methodology using the picture fuzzy set theory. They study a new picture fuzzy entropy approach based on the probability theory to determine criteria weights. The standard Entropy method is the basis of their proposed picture fuzzy Entropy approach. They utilized the VIKOR and TODIM (a Portuguese acronym for Interactive Multi-Criteria Decision Making) to evaluate alternatives in MCDM problems. Mathematical properties of the proposed Entropy were investigated. Besides, they carried out computational and comparative analyses to confirm the validity and stability of the results.
Li et al. [
44] addressed the machine tool selection problem in the manufacturing industry. They employed an integrated approach based on the fuzzy DEMATEL (DEcision MAking Trial and Evaluation Laboratory) and Entropy methods to calculate the criteria weights. Then a methodology based on the VIKOR method was applied to select an appropriate machining tool. A case-based analysis and a sensitivity analysis were performed to assess the efficiency of the proposed approach. The analyses showed that their method is efficient, and the results are valid.
A study carried out by Görçün [
45] on the problem of selecting an appropriate container seaport in the Black Sea region. The study presented two hybrid multi-criteria decision-making approaches. The first approach used the Entropy and OCRA (Operational Competitiveness RAting) methods, and the second was based on the Entropy and EATWIOS (Efficiency Analysis Technique WIth Output Satisfying). The Borda method was also used to merge the results of the approaches. Although the proposed approaches were applied to a significant problem, there were not enough analyses to verify and compare the results.
Zha et al. [
46] developed a hybrid multi-criteria decision-making approach. The problem of facility layout evaluation was addressed in their study. An integration of Delphi, fuzzy ANP (Analytic Network Process), and Entropy were employed to obtain the criteria weights. Then a fuzzy extension of PROMETHEE was applied to evaluate facility layout alternatives. They compared the results of their proposed approach with several MCDM approaches in different levels of uncertainty. The comparative analysis showed that the approach could efficiently deal with this type of problem.
Alao et al. [
47] presented a study on evaluating technologies used in the waste-to-energy process. They defined this problem as a multi-criteria decision-making problem. The Entropy method was applied to compute the weights of criteria. Electricity generation potential, technology maturity, investment cost, cost of energy, operation and maintenance cost, and carbon dioxide emission were the criteria for the evaluation. Moreover, the TOPSIS method was applied to make the evaluation. They used a case in Lagos, Nigeria, to show the applicability of their methodology.
A study in the field of crisis management was also used as an objective weighting method. Salehi et al. [
48] chose five petrochemical plants and evaluated their crisis management systems in three criteria: technical, human, and organizational. They calculated the weights of these criteria using the Entropy method. According to their results, the human factor was the most critical criterion in their study. Then, the TOPSIS method and the obtained weights were utilized to evaluate the petrochemical plants. A shortcoming of their study was the lack of comparative analysis and sensitivity analyses to verify and validate the results.
In a study of groundwater vulnerability assessment, Torkashvand et al. [
49] used the Entropy, SWARA (Stepwise Weight Assessment Ratio Analysis), and GA (Genetic Algorithm) methods to improve the DRASTIC (Depth to the water table, net Recharge, Aquifer media, Soil media, Topography, Impact of the vadose zone, and hydraulic Conductivity) framework. They used the data of nitrate concentration gathered from 50 wells in the study region. Their study shows the importance of using objective and subjective weighting methods in dealing with vital environmental problems and improving the decisions related to human lives.
Wang et al. [
50] focused on a particular supplier selection problem. They studied battery-swapping stations as essential infrastructures in promoting electric vehicles (EVs) and their inevitable concerns about selecting appropriate battery suppliers. An MCDM framework was proposed in their article to evaluate the suppliers under uncertainty. The uncertainty of data was defined using triangular fuzzy numbers. The problem of their study consisted of four suppliers and fifteen criteria. They utilized the Entropy method to determine the weights of criteria. Then, the MULTIMOORA method was employed in evaluating the suppliers.
In addition to the Entropy and Standard Deviation methods, the CRITIC method is an efficient objective weighting method that incorporates the standard deviation of data related to each criterion and the correlation between the criteria. Like the Standard Deviation and Entropy methods, this method has also been developed in many research types and applied to different MCDM problems. Shipboard crane selection [
51], healthcare management evaluation [
52], configuration optimization in energy systems [
53], supply chain risk management [
54], financial risk evaluation [
52], quality assessment of wireless networks [
55], urban transportation [
56], location planning [
57], third-party logistics providers [
58], air quality assessment [
59], waste disposal [
60], and outsourcing evaluation [
61] are some of the recent and essential real-life problems in which the CRITIC method has been applied.
Table 1 presents a summary of the above-mentioned studies.
The basis of the objective weighting methods used in the MCDM field is commonly the input or the decision matrix. Unlike the former methods, this study aims to introduce a novel objective weighting method, called MEREC, based on the relation between input or decision-matrix and its effect on the output or the performance of alternatives. In other words, we can say that causality is the foundation of MEREC.
3. Proposed Method
In this section, a new method based on the removal effects of criteria (MEREC) is proposed to determine the criteria’ weights in a multi-criteria decision-making problem. This method is in the category of objective weighting methods for obtaining criteria weights. As previously mentioned, the MEREC uses each criterion’s removal effect on the performance of alternatives to determine criteria weights. Greater weights are assigned to the criteria that have higher effects on the performances. In this method, we should define a measure for the performances of alternatives first. In this study, a simple logarithmic measure is used with equal weights to calculate alternatives’ performances. To identify the effects of removing each criterion, we use the absolute deviation measure. This measure reflects the difference between the overall alternative’s performance and its performance in removing a criterion. The following steps are used to calculate objective weights by MEREC.
Step 1: Construct the decision matrix. A decision matrix is constructed in this step, which shows each alternative’s ratings or values concerning each criterion. The elements of this matrix are denoted by
, and these elements should be greater than zero (
). If we have negative values in the decision matrix, they should be transformed into positive values using an appropriate technique. Suppose that there are
alternatives and
criteria, and the form of the decision-matrix is as follows:
Step 2: Normalize the decision matrix (
). In this step, a simple linear normalization is used to scale the elements of the decision-matrix. The elements of the normalized matrix are denoted by
. If
shows the set of beneficial criteria, and
represents the set of non-beneficial criteria, we can utilize the following equation for normalization:
It should be noted that the normalization process is similar but different from the process used in methods like WASPAS. The difference is in switching between the formulas of beneficial and non-beneficial criteria. Unlike many other studies, we transform all the criteria into the minimization type criteria.
Step 3: Calculate the overall performance of the alternatives (
). A logarithmic measure with equal criteria weights is applied to obtain alternatives’ overall performances in this step. This measure is based on a non-linear function depicted in
Figure 1. According to the normalized values obtained from the previous step, we can ensure that smaller values of
yield greater values of performances (
). The following equation is used for this calculation:
Step 4: Calculate the performance of the alternatives by removing each criterion. In this step, we use the logarithmic measure in a similar way to the previous step. The difference between this step and Step 3 is that the alternatives’ performances are calculated based on removing each criterion separately. Therefore, we have
sets of performances associated with
criteria. Let us denote by
the overall performance of
th alternative concerning the removal of
th criterion. The following equation is used for the calculations of this step:
Step 5: Compute the summation of absolute deviations. In this step, we calculate the removal effect of the
th criterion based on the values obtained from Step 3 and Step 4. Let
denote the effect of removing
th criterion. We can calculate the values of
using the following formula:
Step 6: Determine the final weights of the criteria. In this step, each criterion’s objective weight is calculated using the removal effects (
) of Step 5. In what follows,
stands for the weight of the
th criterion. The following equation is used for the calculation of
:
5. Conclusions
Determination of criteria weights is a vital function in a multi-criteria decision-making process. Researchers usually divide weighting methods into subjective and objective methods. Direct judgements and opinions of decision-makers are the basis for determining the subjective weights of criteria. Meanwhile, the initial data defined in the MCDM problem-solving matrices support objective criteria weights. In this study, we focused on objective weighting methods. A new objective weighting method, called MEREC, has been introduced in this research. The idea of the proposed method is different from the other objective weighting methods. Most of the methods for determining objective weights use variations in criteria to calculate the weights. However, in the method introduced, the removal effects of criteria on alternatives’ performances are considered a measure for weighting. It is a novel perspective on the determination of objective criteria weights. MCDM methods may yield different results for individual problems. However, their various perspectives in defining problems and providing solutions can help researchers and practitioners justify their application. While a method could be efficient for solving a problem, it may be less efficient or inefficient for dealing with another. For example, the SAW and TOPSIS methods use completely different decision-making ideas, and decision-makers can use them depending on different circumstances and problems’ characteristics.
Although we defined the process of weighting criteria based on a new perspective in the proposed method, the results were consistent with the other objective weighting methods. The simulation-based analysis shows that the correlation between the MEREC and the results of other methods decreases with increasing problem size. Therefore, we cannot say that the MEREC behaves like the other methods in all circumstances. However, the way we used for validation (i.e., comparative and simulation-based analyses) is the most prevalent literature approach. It may be considered an essential limitation of this study and many other studies addressing MCDM problems. We can claim that introducing new MCDM methods based on novel perspectives could ensure the robustness of results. Specifically, by integrating weighting methods, decision-makers can obtain weights that are more reliable.
We have used a simple example to illustrate the steps of using the MEREC. The authors used another numerical example to compare the results of the MEREC with the results of the CRITIC, Entropy, and Standard Deviation methods. The values of the correlation coefficients between the results have shown that MEREC yields credible weights for the criteria. Finally, the authors performed a simulation-based analysis, generating MCDM problems whose data follow a prevalent symmetric distribution (normal distribution). The authors carried out two types of analyses based on the generated data. First, a comparison verifies the reliability of the results of MEREC. Then, the use of the ANOM for variances checked the stability of the results. The simulation-based analysis shows that the weights resulted from the MEREC are relatively reliable and stable weights. Thus, the method introduced is efficient and suitable to determine objective criteria weights. The performance measure function plays an essential role in the determination of the weight by MEREC. We used a logarithmic function to measure alternatives performances. Future research can investigate using other functions like multiplicative functions, distance-based functions, i.e., functions used in WASPAS, TOPSIS, and VIKOR.
Moreover, integrating MEREC with the other objective and subjective weighting methods like Entropy, IDOCRIW (Integrated Determination of Objective CRIteria Weights), WEBIRA (Weight Balancing Indicator Ranks Accordance), ACW (Adaptive Criteria Weights), SWARA and considering other methods of expert evaluation can be the focus in future research [
68,
69,
70,
71,
72]. Another area for future research could be to apply the proposed method to real-world problems, such as designing geographic information systems, economic indicators assessment, evaluations in tourism management, and pollution management [
2,
73,
74,
75]. Future research can be enriched by the proposed method in a vaguely determined environment, e.g., fuzzy and neutrosophic environments [
3,
76,
77].