4.2. Application of Stage 1: Determining the Priorities of the Criteria
Step 1.1: Define the alternatives, the criteria groups, and the decision-makers.
In the case study, four provinces affected by the earthquake are alternatives: Adıyaman (
), Hatay (
), Kahramanmaraş (
), and Malatya (
). These provinces are evaluated by eleven criteria derived from a study conducted for the ILO in 2024 [
47]. The first criteria group (human and operational losses) consists of 5 criteria
and the second criteria group (commercial and economic losses) consists of 6 criteria set
. The definitions and the notations of the criteria are depicted in
Figure 4.
Three different decision-makers who experienced the earthquakes were chosen to represent different perspectives: an employer (company owner/manager) (), an employee (), and a government representative (). The employer () is a person who directly experienced the earthquake, whose 32-year-old medium-sized food business is unusable, and who has lost a large portion of their employees. The employee () is a person directly affected by the earthquake, who has lost family members, lost their income, and has limited alternative opportunities. The government representative () is a person appointed to oversee public interests in the earthquake zone, promote economic recovery, and develop social assistance and employment policies.
Step 1.2: Obtain the initial decision matrix.
The initial decision matrix is given in
Table A1. All the criteria show the percentage of losses. For example,
is the percentage of reduction in talent/candidate pool (
) for Hatay (
in
Table A1.
The graphical representation of the initial decision matrix for HOL group and the CEL group by provinces are depicted in
Figure 5 and
Figure 6, respectively. In
Figure 5, Hatay has the highest losses in all criteria, especially
(loss of life among business employes) and
(permanent disability) criteria. Particularly, Adıyaman has high rates in
and
criteria, indicating a high level of losses in production, equipment, and labor. Kahramanmaraş has lower rates across all criteria, while Malatya generally exhibits moderate losses. This distribution reflects the different economic structures among the provinces and the diversity of how they are affected by the earthquake.
Figure 6 shows the percentage values for the six criteria in the CEL group by province. Overall, Hatay represents the province with the highest rates for many criteria (especially
,
and
representing the highest trade and supply chain losses. Adıyaman and Kahramanmaraş show a similar trend, exhibiting moderate-to-high losses, while Malatya, with relatively lower rates across all criteria, represents the province with the most limited economic impact. Particularly, customer (
) and market losses (
) are prominent in all four provinces, revealing the impact of the earthquake on regional trade networks.
Step 1.3: Normalize the initial decision matrix.
In the case study, since all criteria show the losses, all of them are turned into benefit-type by taking the inverse. The normalized initial decision matrices for HOL and CEL (
and
), calculated using Equations (2) and (3), are depicted in
Table A2. All criteria used in the study are based on percentage loss rates. Therefore, the assumption is that each criterion defined in the 0 and 100 range is positive and directly comparable. This increases the reliability of normalization in datasets where there are no negative values, and all criteria are expressed on the same scale.
Step 1.4: Determine the decision-makers’ preferences about the criteria.
In this step, the criteria in each group are ranked by the decision-makers. If a decision-maker ranks a criterion as 1, this criterion is the most important one among others in the group. In this study, three decision-makers are determined to reflect the different perspectives: an employer (company owner/manager) (
), an employee (
), and a government representative (
). The ranking preferences of the decision-makers are given in
Table A3.
To statistically assess the level of agreement between the decision-makers’ rankings in
Table A3, Kendall’s Coefficient of Concordance (
) was calculated separately for the HOL and CEL criteria groups. According to the results of Kendall’s
analysis for the HOL and CEL groups, the levels of agreement among decision-makers differ. For the HOL group, Kendall’s
indicates a high level of agreement among the three decision-makers. This finding suggests that decision-makers prioritize similar issues regarding human and operational losses (e.g., loss of life, physical damage, equipment loss). In contrast, for the CEL group, Kendall’s
indicates a moderate level of agreement among decision-makers. The result indicates that stakeholders’ perspectives differed somewhat in the assessment of commercial and economic losses (e.g., market, customer, and supplier losses), but their overall ranking trends were similar. The finding of
in both analyses indicates that there was no full statistical consensus among the decision-makers, but the observed agreement was far from randomness and was reliable.
The radar charts of the ranking of decision-makers’ preferences for HOL and CEL are given in
Figure 7 and
Figure 8, respectively.
In prioritizing the criteria in the HOL group in
Figure 7,
prioritized infrastructure and operational continuity, as the sustainability of the business was critical. In
’s assessment, life safety and health were the most important considerations, so these criteria were ranked highest.
prioritized both the protection of human life and the maintenance of economic stability.
When evaluating the criteria in the CEL group in
Figure 8, for
, customer loss is one of the biggest risks directly affecting the company’s future. While product losses can cause short-term losses, market loss and supplier issues can also hinder long-term growth, so they were not considered as critical as other factors. For
, production continuity is crucial. Supplier and raw material losses directly impact their business. Product losses also threaten job security. While customer and market losses pose long-term risks, they are not a priority for employees. For
, maintaining large-scale economic stability is the most important concern. Market losses can affect overall economic stability and growth. Customer losses can weaken the economy by reducing consumption. Supplier and raw material losses are important because they can disrupt the production chain. Distribution and product losses are relatively lower priority criteria for
.
Step 1.5: Form the priority matrix of each decision-maker for the criteria groups.
The priority matrices of decision-makers for each criteria group are obtained using Equation (4).
shows the priority matrix of the first decision-maker in Equation (17) as an example.
Since the priority ranking of the criteria HOL for the first decision-maker is , the element at row 2, column 5 of the matrix is equal to 1 in Equation (17). It is denoted by and means that the second criterion is more important than the fifth criterion (or the ranking of the second criterion is less than that of the fifth criterion). Similarly, the priority matrices of CEL are obtained .
Step 1.6: Find the distance between the priorities assigned by the decision-makers and the median priority components (MPCs).
The priority distances of the decision-makers are calculated as
and
for HOL using Equation (5). In Equation (18), the priority distance of the first decision-maker is calculated as an example.
Equation (18) calculates the total absolute difference between the priority matrix elements of the first decision-maker and the priority matrix values of the other decision-makers. The value that minimizes the sum of the absolute differences is the median. Therefore, the decision-maker closest to everyone’s views is designated as the median decision-maker, and his or her criteria ranking is adopted as the MPC for the group of interest in the continuation of the decision problem. given in Equation (6) is the minimum value obtained for the third decision-maker. Therefore, the MPC of HOL is which is the priority ranking of the third decision-maker. The criteria weights of HOL must satisfy the MPC; that is, the weights of the criteria of HOL must satisfy . Similarly, the priority distances of the decision-makers for CEL are obtained as and . The minimum value of the priority distances for CEL is . Therefore, the MPC of CEL is which is the priority ranking of the first decision-maker. Thus, the weights of the criteria of CEL must satisfy the following condition: .
4.3. Application of Stage 2: Computing the Criteria Weights with the RANCOM Method
Step 2.1: Define the criteria rankings.
According to the KEMIRA-M method, the MPCs found in Stage 1 determine the priority rankings of the criteria and the relations between the criteria weights. Since the relational operator between the criteria in MPC is , the relational operators between the criteria can be more important than () or identical to (). Therefore, the relational operators between the weights of the corresponding criteria will also be greater than (>) or equal to (=).
Since there are five criteria in HOL, there are four relational operators between the weights of the criteria. Then, there are
possible weight combinations for HOL (
). Similarly, there are six criteria in CEL, so there are
possible weight combinations for CEL (
). As a result, there are
pairs of the criteria groups combinations obtained for the KEMIRA-M’s weight selection procedure, which will be explained in the second step of the third stage. All possible weight combinations can be seen in
Table A4 and
Table A5.
Step 2.2: Construct the matrix of ranking comparison (MAC).
The MACs of HOL and CEL are obtained for each possible weight combination using Equation (7). The MAC for the priority rankings of the criteria
(corresponding to the weight combination
) is given in
Table 2 as an example.
Another MAC example for the priority rankings of the criteria
(corresponding to the weight combination
) is given in
Table 3.
Step 2.3: Calculate the summed criteria weights .
After calculating the MACs for HOL and CEL, the row sums are obtained to have the summed criteria weights
using Equation (8). Example calculations for HOL and CEL are depicted in
Table 2 and
Table 3, respectively.
Step 2.4: Obtain the criteria weights.
In this step, all final criteria weights for both groups using
values are calculated by Equation (9). Again, example calculations can be seen in
Table 2 and
Table 3.
Step 2.5: Check the consistency of rankings.
In the case study, there are 15 weight combinations for HOL and 32 weight combinations for CEL. Since there are five criteria in HOL, the number of triads is
. For each criteria weight combination, 10 triads are evaluated according to
Table 1. Then, each criteria combination is checked for consistency using Equation (11). All the weight combinations are consistent, as seen in
Table A4 and
Table A5. The reason all weight combinations are consistent is that the third decision-maker for HOL and the first decision-maker for CEL, who determine the MPCs, made consistent prioritizations.
4.5. Sensitivity Analysis
When performing alternative ranking with the KEMIRA-M method, numerous criteria can be considered. It allows decision-makers to evaluate the criteria, which are divided into two groups, internally. Thus, it stands out among other MCDM methods, considering that criteria can be consistently evaluated in each criteria group.
In contrast, the weakest point of the KEMIRA-M method is how to determine the criteria weights based on the ranking of MPCs obtained at the end of Stage 1. According to the MPC, the criteria weights must be determined consistently, and their sum must be 1. Selecting the appropriate combinations from an infinite number of criteria weights remains a hot topic among researchers. In this study, the use of the RANCOM method facilitated obtaining consistent criteria weights that sum to 1. Subsequently, the most suitable criterion weight pair is selected using KEMIRA-M’s criteria selection procedure, and the final alternative ranking is obtained.
In the study conducted to test the robustness of the proposed method, the ranking of the criteria weights obtained for each group using the KEMIRA-M method’s criterion selection procedure was taken into account. The criteria weights used in the final ranking, corresponding to the rankings tested using the Triad consistency check, are as follows:
and
. These rankings are provided in the
and
columns of
Table A9 and
Table A10, respectively. Since
and
are of equal importance in the HOL group, they are calculated as
. That is, the rankings of criteria having the same importance are shared with each other equally. The others are
, and
. The rankings of criteria for the CEL group were also obtained similarly in
Table A10.
In this analysis, the following three different objective criteria weighting methods were used, in accordance with the rankings determined here: The Rank Sum (RS) method, The Rank Reciprocal (RR) method, and The Rank Exponent (RE) method [
48].
In the RS method, the rankings of the criteria are first converted into criteria loads using the formula
Then, the normalization procedure is applied to obtain the criteria weights: The
values are divided by the sum of all loads. The RR weights are obtained from the normalization of
values, where
In the RE method, the first
values are calculated using
and then
values are normalized. All of the calculated values and the criteria weights for HOL and CEL are depicted in
Table A9 and
Table A10, respectively.
In
Figure 9, the weights obtained for the five criteria are compared for HOL. When examining how each method prioritizes the criteria, some consistent trends and differences are observed:
and
have the same and high importance levels. Therefore, this criterion carries the highest weight in all methods. The values among the RANCOM, RS, and RR methods are quite close (between 0.30 and 0.32), but the RE method weighted this criterion slightly higher than the others (0.37). When examining the weights determined for criterion
, it is observed that the weight obtained by the RE method is the lowest (0.07), while there are small differences between the RANCOM, RS, and RR methods (0.12 and 0.13). While criterion
has the same weight for the RANCOM and RS methods (0.20), the RR and RE methods are close to each other but have a lower weight (0.16 and 0.17). For
, especially in the RE and RANCOM methods, the criterion weight falls below 5%.
The graphical comparison of the criteria weights for CEL is shown in
Figure 10. According to
Figure 10, since
,
, and
are the same and have the lowest level of importance, their criteria weights are the same. While consistency was observed among the RANCOM, RS, and RR methods, the lowest criterion weight was found using the RE method. Similarly,
and
also have the highest and same criteria weights. Although the RANCOM, RS, and RR methods yielded similar weights, the weight of this criterion was high with the RE method. The RANCOM and RS methods yielded the same weight values (0.19) for
, which is close to the weight found by the RE method (0.18). In the RR method, the lowest weight value was obtained.
As a result, the RANCOM method generally produced results quite consistent with the RS and RR methods, thus demonstrating that the method is robust in terms of consistency and reliability.
For the criterion weights of each method, weighted normalized vectors were calculated using Equations (12) and (13). Then, using these weighted vectors, the final rankings of the provinces were obtained using the weighted sum scores in Equation (16). The weighted sum scores (
) and the rankings of provinces for each method are given in
Table 5.
Table 5 shows how the final rankings of the provinces change under four different methods (RANCOM, RS, RR, and RE). Based on the operational relationship between the criteria based on RANCOM-KEMIRA-M, sensitivity analysis was performed to test the stability of the ranking results and the robustness of the model, depending on the method used.
In all the methods, Malatya (A4) ranked first, while Hatay (A2) ranked last. Kahramanmaraş (A3) came in second in every method, while Adıyaman (A1) came in third. Therefore, all the methods produced the same ranking order. This result indicates that the model has a high degree of consistency and that differences related to the method do not change the relative positions of the provinces. The fact that Malatya and Kahramanmaraş are at the top of the list indicates that labor force losses in these provinces are relatively low and economic activities can recover more quickly. Hatay consistently ranking last indicates that sustainable recovery policies should be particularly directed toward social employment support, supply chain repair, and infrastructure strengthening in this province.
When examining the score differences, the difference between Malatya and Kahramanmaraş is quite small, indicating that these two provinces have similar rates of job losses. The fact that Hatay scored the lowest by a wide margin in all methods confirms that it is the most vulnerable province in terms of both human and economic losses.
All four methods (RANCOM, RS, RR, RE) produced the same ranking result. This situation indicates that the KEMIRA-M model is not very sensitive to parametric changes, meaning the decision outputs are stable. Since the deviation between the highest and lowest scores (e.g., 1.3493–1.4423 for Malatya) is small, it can be said that weight changes did not affect the ranking. This finding supports the robustness of the integrated RANCOM–KEMIRA–M approach used in the study against decision-making inconsistencies.
Sensitivity analysis confirmed the robustness of the integrated RANCOM–KEMIRA-M approach. The identical ranking order across all four methods demonstrates that the final prioritization is stable and not significantly affected by methodological variations, which strengthens the reliability of the proposed model in post-disaster sustainability assessments. The results are reliable and suitable for policy development.