Skip to Content
SustainabilitySustainability
  • Article
  • Open Access

20 February 2020

An Extended GRA Method Integrated with Fuzzy AHP to Construct a Multidimensional Index for Ranking Overall Energy Sustainability Performances

,
,
and
1
Institute of Pure and Applied Sciences, Marmara University, Istanbul 34722, Turkey
2
Faculty of Business Administration, Marmara University, Istanbul 34722, Turkey
3
Faculty of Engineering and Natural Sciences, Maltepe University, Istanbul 34857, Turkey
*
Author to whom correspondence should be addressed.

Abstract

In an age of rapid technological advancement, the increasing need for energy and its related services to satisfy economic and social development has become a critical concern of national governments worldwide. This has triggered researchers to work on metrics for tracking and tracing energy sustainability in order to provide monitoring mechanisms for policy makers. In this regard, multicriteria decision-making (MCDM) methods are becoming more popular to deal with the multidimensional and complex nature of sustainability. We have proposed an extended and revised version of the grey relational analysis (GRA) method, which is integrated with the fuzzy analytic hierarchy process (AHP), to develop a new composite index for comparing the overall energy sustainability performances of 35 OECD member countries. Our case study revealed the performances of selected countries by providing their strengths and weaknesses based on determined criteria as well as the level of change in performances with different criteria weights. The proposed GRA model can be used in different applications of sustainability due to its flexible nature, which provides benefits from goal-oriented extensions in order to adequately capture different aspects of sustainability.

1. Introduction

Energy plays a key role in improving social and economic wellbeing and is essential to fulfill the needs of modern life [1]. Thus, it is crucial to provide energy services based on the principles of sustainability, which is a dynamic, complex, and multidimensional concept depending on context-specific and long-term goals [2,3]. Overall energy sustainability can be achieved by providing affordable, accessible, and reliable energy services in an environmentally friendly manner by considering the needs of economic and social development for present and future generations [1,4]. The dimensions of energy sustainability should be determined from that point of view, since these dimensions are not fixed due to the dynamic nature of sustainable development and new ideas continue to emerge [5,6,7,8,9].
In order to measure a country’s overall energy sustainability, its performance should be represented as quantitative data so that comparisons can be performed in a systematic way. Using indicators is a reliable way to transform condense, voluminous, and complex data into a simpler and usable form. A set of properly designed indicators is useful to determine the long-term implications of current decisions as well as interconnections and trade-offs among different dimensions [1,6]. Therefore, energy sustainability indicators can be considered as a tool to reveal the performance of a system to meet predetermined goals so that progress toward sustainability can be easily monitored by reviewing any change in indicator values over time.
Compiling indicators into a single metric in accordance with an underlying model simplifies the measurement of multidimensional problems such as energy sustainability [10]. Indices are useful tools to find common trends across different indicators [11] and to assess the performance of countries or entities on complex concepts that are not directly measurable [12]. Various indices have been proposed by researchers to overcome complex problems regarding different aspects of energy [3,5,6,7,8,9,13,14,15,16,17]. Table 1 provides information about the main pros and cons of using indices.
Table 1. Main pros and cons of an index.
To construct an index, the underlying model should be clearly defined so that the formulation strategy for normalization, weighting, and aggregation techniques can be determined [10]. In this regard, multicriteria decision-making (MCDM) methods provide promising opportunities to deal with the multidimensional and complex nature of sustainability [20]. MCDM refers to a set of methods to be used for supporting decision-making in a multicriteria environment by analyzing a series of possible alternatives [21,22]. These methods allow users to make their decisions based on their predetermined preferences. The main strategy is breaking the problem into smaller components to obtain the relative preferences of alternatives for each property, and to synthesize the results for ranking alternatives [23].
MCDM methods are distinguished based on their underlying models, and the results obtained may be different from each other [23]. Although the aim of MCDM methods are in common, a method can be developed to fulfill the needs of a specific problem instead of providing a solution for different subject areas. For instance, Stević et al. [24] introduced the measurement of alternatives and ranking according to compromise solution (MARCOS) method for sustainable supplier selection in healthcare industries. Introducing new extensions to existing multicriteria decision-making models such as the extended TOPSIS method by Yu et al. [25] are also gaining popularity for solving specific sustainability problems [26,27,28]. Furthermore, there are integrated approaches that include multiple MCDM techniques to deal with such problems; for example, the integrated grey based multicriteria decision-making approach for the evaluation of renewable energy sources developed by Çelikbilek and Tüysüz [29].
The general structure of the MCDM process is composed of three major stages: determination of the criteria and evaluation metrics, determination of weights, and execution of MCDM methods. The weight of each criterion plays an important role in the MCDM process, since it reflects the importance over others and, therefore, influences the final decision-making. Consequently, it is common to use a separate MCDM method to deal with the weighting of criteria [30,31,32].
There are two types of weighting methods: subjective and objective weighting. The relative importance of an individual indicator is determined by considering judgements of decision makers, if a subjective weighting method is used. On the other hand, objective weighting methods benefit from data statistical methods without personal interference to calculate the weights. Both methods have advantages and disadvantages. While subjective methods are preferred to deal with potential uncertainties in human intuitive judgment, objective methods are considered as being easier to be executed and they are less time-consuming [33].
In this paper, we propose an extended grey relational analysis (GRA) method to be used in the overall energy sustainability index (OESI) that is developed for comparing the performances of 35 OECD member countries. The OESI is based on the GRA method integrated with the fuzzy analytic hierarchy process (AHP). While fuzzy AHP is used to determine the weights of criteria defined for decision-making, GRA is used for ranking alternatives. The proposed GRA method includes revisions and extensions to precisely meet the goals of overall energy sustainability. This new method can also be used for other applications of sustainability. The OESI focuses on three dimensions namely, economic and security, environmental, and social for ranking countries in terms of overall energy sustainability performances. Although other dimensions could still be defined, these three dimensions provide a strong and adequate representation of the multidimensionality of energy sustainability. Proposing energy sustainability indicators and combining them with a new goal-oriented MCDM method will help policy makers and researchers to precisely obtain a snapshot of a country’s performance on energy sustainability and will allow them to determine, develop, and implement policies.

2. Materials and Methods

2.1. OESI Index

To construct an index, the first step is to formulate the vision of sustainability, so that the objective can be defined and issues that are relevant in this context can be determined [34]. The purpose of the OESI has been elaborated in the previous section. Table 2 provides information about the issues to be addressed in order to calculate the dimensions of the OESI.
Table 2. Issues to be addressed for calculating the dimensions of the overall energy sustainability index (OESI).
The selection of indicators plays a significant role in addressing the OESI. Although there are guidelines such as the Bellagio principles [35] or frameworks such as the systems approach [36] formulated for indicator selection, there is no commonly accepted methodology [34]. However, there have been studies on the requirements that should be met by selected indicators [3,17,37,38,39,40,41]. They can be summarized as sensitivity, interpretability, relevance, accessibility, sensitivity, and timeliness (presented in Table 3).
Table 3. Criteria for indicator selection.
The hierarchical structure of the OESI is presented in Table 4.
Table 4. Hierarchical structure of the OESI.
The relevance of energy sustainability indicators is presented in Table 5.
Table 5. Indicators and relevance.
Each indicator identified has an impact on the index. An indicator can be
  • Larger the better
  • Smaller the better
  • Closer to the desired value the better
  • Closer to the desired set of values the better.
Table 6 shows the impact of each indicator value on the index.
Table 6. Impacts of indicators.
The value of IEC3 was determined by applying the GRA method to indicators represented in Table 7 with equal weights.
Table 7. Subindicators for calculating IEC3 (closer to the desired value the better).

2.2. Fuzzy AHP

AHP is a useful MCDM method to cope with different problematic situations that may include selection of alternatives in a multi-objective environment, allocation of scarce resources, and forecasting [47]. This methodology is based on pairwise comparisons along with judgments from decision makers in a hierarchical manner for calculating weights of criteria within a complex decision-making process [48,49]. AHP has a flexible nature that allows it to be integrated with other methods, so that benefiting from the combined methods becomes possible [50,51,52,53].
AHP is a method in which judgements from experts are based on crisp logic. Criteria belonging to the same level in a hierarchical structure are compared with each other by using a nine-point numerical scale to determine how much more a criterion is important than another [54,55]. Since there is vagueness in personal judgments in real-life applications, something greater than a nine-point numerical scale is required to describe the opinion of a decision maker [56]. In order to deal with such uncertainties of a decision problem, fuzzy integrated AHP is commonly used in the literature [57,58,59,60].
In this study a fuzzy AHP methodology was used to determine the criteria weights required for ranking alternatives with the GRA method. This was achieved by transforming linguistic variables from decision maker(s) to triangular fuzzy numbers to find fuzzy weights with the geometric mean approach. The linguistic variables used in this work are indicated in Table 8.
Table 8. Linguistic terms and corresponding triangular fuzzy numbers.
A triangular fuzzy number is defined as (l, m, u), where (l ≤ m ≤ u). While m indicates the most promising value, l and u denote smallest and largest possible value, respectively. The mathematical notation of a fuzzy number and algebraic operations between two fuzzy numbers are indicated by the following equations [62]:
M ˜ = ( l , m , u )
( M ˜ ) 1 = ( l , m , u ) 1 = ( 1 u , 1 m , 1 l )
M ˜ 1 M ˜ 2 = ( l 1 m 1 u 1 ) ( l 2 m 2 u 2 ) = ( l 1 + l 2 , m 1 + m 2 , u 1 + u 2 )
M ˜ 1 M ˜ 2 = ( l 1 m 1 u 1 ) ( l 2 m 2 u 2 ) = ( l 1 l 2 , m 1 m 2 , u 1 u 2 )
M ˜ 1 M ˜ 2 = ( l 1 m 1 u 1 ) ( l 2 m 2 u 2 ) = ( l 1 l 2 , m 1 m 2 , u 1 u 2 )
Based on Equations (3) and (5), multiplication and addition of fuzzy numbers can be indicated as following equations:
i = 1 n M ˜ i = ( i = 1 n l , i = 1 n m , i = 1 n u )
i = 1 n M ˜ i = ( i = 1 n l , i = 1 n m , i = 1 n u )
Based on the responses from the decision maker, a judgement matrix is formed to demonstrate triangular fuzzy numbers, as indicated by Equation (8):
M ˜ i j = [ M ˜ 11 M ˜ 12 M ˜ 1 n M ˜ 21 M ˜ 22 M ˜ 2 n M ˜ n 1 M ˜ n 2 M ˜ n n ] = [ l 11 m 11 u 11 l 12 m 12 u 12 l 1 n m 1 n u 1 n l 21 m 21 u 21 l 22 m 22 u 22 l 2 n m 2 n u 2 n l n 1 m n 1 u n 1 l n 2 m n 2 u n 2 l n n m n n u n n ]   for   i = 1 , 2 , , n j = 1 , 2 , , n
For each criterion, the geometric mean of fuzzy comparison values should be calculated before converting them back into crisp values and performing normalization. This is achieved by Equation (9).
F ˜ i = R ˜ G ˜ i = ( i = 1 n j = 1 n M ˜ i j n ) 1 j = 1 n M ˜ i j n
where
  • G ˜ i represents the geometric mean value of triangular fuzzy numbers for criterion C i ,
  • R ˜ represents the reciprocal of the sum of the geometric mean of fuzzy comparison values, and
  • F ˜ i represents the fuzzy weight for criterion C i .
The final steps to determine the final criteria weights with fuzzy AHP include taking the arithmetic mean of fuzzy weights and normalizing it so that the sum of the weights is equal to 1. If there is more than one decision maker, the arithmetic means of the final criteria weights calculated for each decision maker should be taken.

2.3. GRA

GRA depends on the concept of grey theory, which was introduced by Deng in 1982 in order to make decisions where there was incomplete information and data sample. A system is called “grey” if it has incomplete and uncertain information, while a “white” system contains all the information and a “black” system contains no data. In addition to the ability of computing with uncertainty and incomplete information, another key advantage of the grey system is its ability to provide methods which do not require an excessive sample size and any sample distribution for ranking alternatives [63,64].
GRA aims to determine the correlation between sequences by using the data available. This is achieved by creating comparative sequences based on the performances of alternatives as well as by defining the ideal sequence, so that the trend correlation between the reference sequence (ideal sequence) and comparative sequences can be calculated. The comparative sequence that leans more toward concordance with the reference sequence has the highest grey relational degree and, therefore, the related alternative will be the best choice [65,66,67].

2.3.1. Existing GRA Procedure

The decision matrix for a MCDM problem that consists of a set of alternatives ( A 1 ,   A 2 , ,   A m ) and criteria ( C 1 ,   C 2 , ,   C m ) is formed as shown in Equation (10):
X i j = [ X 11 X 12 X 1 n X 21 X 22 X 2 n X n 1 X n 2 X n n ]   for   i = 1 , 2 , , m j = 1 , 2 , , n
where
  • X i j represents the performance of alternative A i for criterion C j .
After the decision matrix is formed, the ideal sequence should be determined and added to the decision matrix as a reference. The reference sequence may consist of “larger the better” criteria, “smaller the better” criteria, and “closer to the desired value the better” criteria.
It is important to perform normalization for transforming input data into a comparable form. Normalization for GRA, which is also called grey relational generating, is performed by one of the three equations described below. Equation (11) is used for larger the better criteria, Equation (12) is used for smaller the better criteria, and Equation (13) is used for closer to the desired value the better criteria [68,69]:
X i j * = X i j min ( X i j , i = 1 , 2 , , m ) max ( X i j , i = 1 , 2 , , m ) min ( X i j , i = 1 , 2 , , m )   for   i = 1 , 2 , , m j = 1 , 2 , , n
X i j * = max ( X i j , i = 1 , 2 , , m ) X i j max ( X i j , i = 1 , 2 , , m ) min ( X i j , i = 1 , 2 , , m )   for   i = 1 , 2 , , m j = 1 , 2 , , n
X i j * =   1 | X i j X d v j | max { max ( X i j , i = 1 , 2 , , m ) X d v j ,   X d v j min ( X i j , i = 1 , 2 , , m ) }   for   i = 1 , 2 , , m j = 1 , 2 , , n
where
  • X i j * represents the normalized data of alternative A i for criterion C j , and
  • X d v j is the desired value for criterion C j .
With the grey relational generating process, data are adjusted in a way so that each value falls within the range of [0,1]. If the normalized value of an alternative is equal to 1 or closer to 1 than any other normalized alternative value for a specific criterion, the performance of that alternative is the best one for that criterion. In contrast, if the normalized value of an alternative is equal to 0 or closer to 0 than any other normalized alternative value for a specific criterion, the performance of that alternative is the worst one for that criterion.
The grey relational coefficient should be calculated after the normalization process. It is used to determine how close the normalized sequence is to the corresponding reference sequence. It is calculated by using Equations (14) and (15):
Δ i j = | X i j * X o j |   for   i = 1 , 2 , m     j = 1 , 2 , n
γ ( X o j , X i j * ) = min ( Δ i j , i = 1 , 2 , m ; j = 1 , 2 , n ) + ς max ( Δ i j , i = 1 , 2 , , m ; j = 1 , 2 , , n ) Δ i j + ς max ( Δ i j , i = 1 , 2 , , m ; j = 1 , 2 , , n )   for   i = 1 , 2 , , m j = 1 , 2 , , n
where
  • γ ( X o j , X i j * ) is the grey relational coefficient of alternative A i for criterion C j ,
  • X o j * is the reference sequence for criterion C j and takes the value of 1, and
  • ς is defined as the identification coefficient.
The identification coefficient is used for either compressing or expanding the range of the grey relational coefficient to be calculated. The identification coefficient is determined as 0.5 in the literature [64,65,66,68,69].
The grey relational grade represents the final correlation between the comparative and reference sequences. It is calculated by Equation (16):
Γ ( X i ) = j = 1 n W j γ ( X o j , X i j * )   for   i = 1 , 2 , , m
where
  • Γ ( X i ) represents the grey relational grade for alternative A i , and
  • W j is the weight of C j obtained with fuzzy AHP.
The higher the value of the grey relational grade, the better the performance of the corresponding alternative.

2.3.2. Revised GRA Normalization Procedure

The normalization procedure for the closer to the desired value the better criteria mentioned in the previous section, represented by Equation (13), does not align with the concept of the procedures applied for the larger the better and the smaller the better criteria indicated by Equations (11) and (12), respectively. The idea should be to assign 1 to the best alternative available and 0 to the worst alternative available based on their performance. However, this cannot be achieved by using Equation (13) if there is no alternative available with the desired value. In that case, the performance of the best alternative cannot reach 1.
Our proposed solution is to add another normalization step to overcome this problem. The proposed method is demonstrated by Equations (17) and (18). Equation (17) is a prenormalization step and Equation (18) is used for normalizing values obtained by using Equation (17):
Y i j = | X i j X d v j | max ( X i j , i = 1 , 2 , , m ) min ( X i j , i = 1 , 2 , , m )   for   i = 1 , 2 , , m j = 1 , 2 , , n
X i j * = max ( Y i j , i = 1 , 2 , , m ) Y i j max ( Y i j , i = 1 , 2 , , m ) min ( Y i j , i = 1 , 2 , , m )   for   i = 1 , 2 , , m j = 1 , 2 , , n
where
  • Y i j is the prenormalization value.
By using the abovementioned equations, the range of data is adjusted so that each value falls within the range of [0,1]. The alternative that is closest to desired value takes 1 and the value of the outmost alternative takes 0.

2.3.3. Extended GRA Normalization Procedure

There may be cases where a set of values is considered optimum instead of a single value. We propose two-step normalization procedures, such as the one applied in the previous section, to solve such issues. If the set of optimal values lies between the maximum and minimum alternative values, Equation (19) can be used to determine the prenormalization value before using Equation (18):
Y i j = { | X i j X m a x o p t | max ( X i j , i = 1 , 2 , , m ) min ( X i j , i = 1 , 2 , , m ) , where   X m a x o p t < X i j m a x ( X i j , i = 1 , 2 , , m ) 0 , where   X m i n o p t X i j X m a x o p t | X i j X m i n o p t | max ( X i j , i = 1 , 2 , , m ) min ( X i j , i = 1 , 2 , , m ) , where   m i n ( X i j , i = 1 , 2 , , m ) X i j < X m i n o p t
where
  • X m a x o p t represents the maximum value of the optimal data set, and
  • X m i n o p t represents the minimum value of the optimal data set.
Equation (19) ensures that best alternative(s) takes the value of 1 after the grey relational generating process, whether there is any optimum or not. However, the proposed equation is not useful in cases where the set optimal values do not lie between maximum and minimum alternative values. It is easy to compute if the minimum value of the optimal data set is greater than the maximum alternative value or if the maximum value of the optimal data set is smaller than the minimum alternative value, since Equations (11) or (12) can be used, respectively. On the other hand, Equation (20) should be used to determine the prenormalization value in cases where the set of optimal values includes the minimum or maximum alternative value and not the other:
Y i j = { | X i j X m i n o p t | X m i n o p t min ( X i j , i = 1 , 2 , , m ) , where m i n ( X i j , i = 1 , 2 , , m ) < X m i n o p t < m a x ( X i j , i = 1 , 2 , , m ) < X m a x o p t X i j < X m i n o p t   | X i j X m a x o p t | max ( X i j , i = 1 , 2 , , m ) X m a x o p t , where   X m i n o p t < m i n ( X i j , i = 1 , 2 , , m ) < X m a x o p t < m a x ( X i j , i = 1 , 2 , , m ) X i j > X m a x o p t  
Flow chart of the procedures used for calculating the OESI is presented in Appendix B (Figure A1 and Figure A2).

3. Results and Discussion

The weights of the criteria had a considerable effect on the results of the OESI. Table 9 and Table 10 show the weights of criteria and indicators determined by applying fuzzy AHP procedures. It was observed that the economic and security dimension had the greatest impact, while the environmental and social dimensions had similar impacts on the index.
Table 9. Indicator weights.
Table 10. Criteria weights.
Among 35 OECD member countries, Iceland took first place in terms of overall energy sustainability performance. Iceland ranked first among other OECD member countries in the economic and security, and the environmental dimensions, and ranked eighth in the social dimension.
By comparing other energy sustainability indices with the OESI, similarities were observed in the results. Although each energy sustainability index has its own objective and considers different indicators, European countries take the highest scores. For instance, Norway, Sweden, Switzerland, New Zealand, and Austria scored in the top 10 in the OESI, the Global Energy Architecture Performance Index [8], and World Energy Trilemma Index [9]. Results are presented in Table 11.
Table 11. Results of OESI.
OESI is a tool that provides a snapshot of overall energy sustainability performances of countries on a comparative scale and its significance must be interpreted with circumspection. Although a country with a high value of OESI may be perceived as more developed than other countries with lower values, a disaggregated evaluation at the subcriteria level is further required in order to gain a comprehensive insight into energy sustainability. This allows policy makers to focus on areas that needs to be improved. Table 12, Table 13 and Table 14 present weighted indicator values.
Table 12. Weighted indicator values (economic and security dimension).
Table 13. Weighted indicator values (environmental dimension).
Table 14. Weighted indicator values (social dimension).
The results indicate that countries with high performance in OESI managed to link various aspects of energy sustainability. Overall scores were distributed between 0.807 and 0.518 out of 1. Since OECD member countries were considered as alternatives in the study, the absence of scores under 0.5 is not surprising.
From the dimension point of view, economic and security dimension had much more effect on the OESI among other dimensions. Countries which were efficient in energy use, benefitted from various energy resources, and had high productive uses of energy, achieved high points in this dimension. Thus, policy makers should put their best efforts to improve these areas in order to maximize energy sustainability.
Environmental dimension occupied the second place in reference to other dimensions. With respect to this dimension, climate related issues (CO2, N2O, and CH4 emissions) were the main drivers of environmental problems. Furthermore, creating environmental awareness and promoting environmental education are the means to ensure pressure on governments from society to develop laws and regulations aimed at protecting the environment. Enforcement of regulations is also required for proper environmental care.
Social dimension held the last place in the list. Any policy aiming to implement a transition towards energy sustainability needs to be evaluated regarding their influences on accessibility, quality and affordability of energy services.
“Diversification of sources for electricity generation” is one of the most significant indicators in terms of criteria weights. In recent studies, the importance of diversification of energy supply has been emphasized with other factors, such as political stability, energy resource availability, energy dependence, and reserve-to-production ratio [8,70,71]. Using the GRA method to create an additional energy security dimension by including such factors may provide a more comprehensive approach to rank countries in future works. Those factors should be dependent on each other and their weights must be arranged on a country basis. Furthermore, taking steps to include future projection data for all dimensions can contribute to the efforts of developing the OESI.
As a future direction, using an integrated method consisting of a specific function that determines the overall weights of indicators based on obtained data from both subjective and objective weighting procedures will be highly beneficial. In addition, taking further steps in developing existing fuzzy AHP methodology or proposing a more suitable subjective weighting model to allow more scalability may provide the ability to benefit from additional dimensions. Especially, creating a separated energy policy dimension will significantly contribute to the efforts to improve the OESI.
The analyses performed in the OESI were mostly based on data with a five-year time frame due to data unavailability. Since the precision of the indicated results increases along with improvements in timely data collection, further efforts should include improved data collection to track performances of countries on an annual basis.

4. Conclusions

In our study, a framework was built to develop an index for measuring the overall energy sustainability of various countries. The aim of proposing such an index was to provide a benchmark for policy makers to assess energy sustainability performances by introducing a new underlying model that can also be used in different applications of sustainability. Such an approach contributes to efforts of researchers working on decision-making methods for dealing with sustainability issues.
Three major contributions of this research can be summarized as follows:
  • providing a research strategy that benefits from a specific, integrated MCDM method (fuzzy AHP with GRA) to deal with complex sustainability issues;
  • introducing new extensions for the existing GRA method due to its insufficiency in providing accurate results after the grey relational generating process in specific situations; and
  • proposing an index with the purpose of assessing the overall energy sustainability performances of various countries serving as a mechanism to monitor their strengths and weaknesses.
Our research has mainly focused on proposing revisions and extensions regarding the normalization procedure of GRA method. We introduced a simple procedure to overcome the inconsistency problem encountered in the normalization step for the closer to the desired value the better criteria. Furthermore, we used this approach to develop additional steps in the normalization process to solve problems that include closer to the desired set of values the better criteria. We believe these additional procedures make GRA a very suitable method for ranking alternatives in sustainability problems, due to their contribution to provide solutions in dealing with criteria that cannot be modelled as larger the better or smaller the better. This can also make an important contribution to MCDM literature.
While the OESI was rigorously developed, there are some limitations providing opportunities for future papers. This study used fuzzy AHP in order to determine the weights of each indicator, due to its specific properties such as simplicity, and flexibility. However, difficulties in deciding whether an expert is qualified in the selected research area, reaching adequate number of experts, and receiving timely feedback from them pose problems. Moreover, we have faced scalability issues due to the increasing number of comparisons, which quickly becomes unmanageable. Therefore, including integrated methods using both subjective and objective weighting, and any procedure that provides solutions for scalability issues in subjective weighting is important in the future work. This will increase the reliability of the study and will allow to increase the number of dimensions, criteria and indicators to be used in the OESI. In addition to constraints caused by fuzzy AHP, data availability has been also an important issue. Even though criteria for indicator selection presented in Table 3 has been carefully considered during indicator selection, further efforts are required in timely data collection. Replicating the methodology in regions with less information (especially non-developed nations) may be difficult due to data unavailability.
For further research, using non-linear functions such as radical functions instead of a linear approach in the normalization step can be a promising area for interested researchers. Although this would be a more comprehensive approach for ranking purposes, it would include more subjectivity (determining the function, using multiple functions etc.). Nevertheless, we believe it is a promising research area which is applicable especially for creating an additional security dimension.

Supplementary Materials

The following are available online at https://www.mdpi.com/2071-1050/12/4/1602/s1, Excel File S1: Data, Excel File S2: Matlab_Output, Excel File S3: Questionnaire & Answers, Excel File S4: Results of Questionnaire, Excel File S5: RESULTS (ALTINTAS), Excel File S6: RESULTS (GURBUZ), Excel File S7: RESULTS (KAVAKLIOGLU), MATLAB File S8: FUZZY_AHP, Figure S9: Flow chart of the overall procedure, Figure S10: Flow chart of the revised & extended GRA procedure, Text File S11:FUZZY_AHP, Word File S12: General.

Author Contributions

Conceptualization, K.A., O.V., S.A., and E.C.; methodology, K.A., O.V., S.A., and E.C.; software, K.A.; validation, O.V., S.A., and E.C; formal analysis, K.A and S.A.; investigation, K.A.; resources, K.A.; data curation, K.A.; writing—original draft preparation, K.A.; writing—review and editing, K.A., O.V., S.A. and E.C.; supervision, O.V., S.A., and E.C.; project administration, K.A., O.V., S.A., and E.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Indicators, units, and brief descriptions.
Table A2. Academic sources used for determining indicators.

Appendix B

MATLAB (R2018b) was used for calculating weights with fuzzy AHP and Microsoft Excel (2016) was used to apply GRA methods.
Figure A1. Flow chart of the overall procedure (Supplementary Materials).
Figure A2. Flow chart of the revised and extended GRA procedure (Supplementary Materials).

References

  1. Vera, I.; Langlois, L. Energy indicators for sustainable development. Energy 2007, 32, 875–882. [Google Scholar] [CrossRef] [Scilit]
  2. Mog, J.M. Struggling with sustainability—A comparative framework for evaluating sustainable development programs. World Dev. 2004, 32, 2139–2160. [Google Scholar] [CrossRef] [Scilit]
  3. Cîrstea, S.; Moldovan-Teselios, C.; Cîrstea, A.; Turcu, A.; Darab, C. Evaluating renewable energy sustainability by composite index. Sustainability 2018, 10, 811. [Google Scholar] [CrossRef] [Scilit]
  4. Rosen, M. Energy sustainability: A pragmatic approach and illustrations. Sustainability 2009, 1, 55–80. [Google Scholar] [CrossRef] [Scilit]
  5. Mainali, B.; Pachauri, S.; Rao, N.D.; Silveira, S. Assessing rural energy sustainability in developing countries. Energy Sustain. Dev. 2014, 19, 15–28. [Google Scholar] [CrossRef] [Scilit]
  6. Iddrisu, I.; Bhattacharyya, S.C. Sustainable Energy Development Index: A multi-dimensional indicator for measuring sustainable energy development. Renew. Sustain. Energy Rev. 2015, 50, 513–530. [Google Scholar] [CrossRef] [Scilit]
  7. García-Álvarez, M.T.; Moreno, B.; Soares, I. Analyzing the sustainable energy development in the EU-15 by an aggregated synthetic index. Ecol. Indic. 2016, 60, 996–1007. [Google Scholar] [CrossRef] [Scilit]
  8. World Economic Forum. Global Energy Architecture Performance Index Report 2017; World Economic Forum: Geneva, Switzerland, 2017. [Google Scholar]
  9. World Energy Council; Oliver Wyman. World Energy Trilemma Index, 2016 Benchmarking the Sustainability of National Energy Systems; World Energy Council: London, UK, 2016. [Google Scholar]
  10. Singh, R.K.; Murty, H.R.; Gupta, S.K.; Dikshit, A.K. An overview of sustainability assessment methodologies. Ecol. Indic. 2009, 9, 189–212. [Google Scholar] [CrossRef] [Scilit]
  11. Nhemachena, C.; Matchaya, G.; Nhemachena, C.R.; Karuaihe, S.; Muchara, B.; Nhlengethwa, S. Measuring baseline agriculture-related sustainable development goals index for Southern Africa. Sustainability 2018, 10, 849. [Google Scholar] [CrossRef] [Scilit]
  12. Becker, W.; Saisana, M.; Paruolo, P.; Vandecasteele, I. Weights and importance in composite indicators: Closing the gap. Ecol. Indic. 2017, 80, 12–22. [Google Scholar] [CrossRef] [Scilit]
  13. Goldrath, T.; Ayalon, O.; Shechter, M.A. combined sustainability index for electricity efficiency measures. Energy Policy 2015, 86, 574–584. [Google Scholar] [CrossRef] [Scilit]
  14. Narula, K.; Reddy, B.S.; Pachauri, S. Sustainable energy security for India: An assessment of energy demand sub-system. Appl. Energy 2017, 186, 126–139. [Google Scholar] [CrossRef] [Scilit]
  15. Raza, S.S.; Janajreh, I.; Ghenai, C. Sustainability index approach as a selection criteria for energy storage system of an intermittent renewable energy source. Appl. Energy 2014, 136, 909–920. [Google Scholar] [CrossRef] [Scilit]
  16. Mainali, B.; Silveira, S. Using a sustainability index to assess energy technologies for rural electrification. Renew. Sustain. Energy Rev. 2015, 41, 1351–1365. [Google Scholar] [CrossRef] [Scilit]
  17. Lee, C.W.; Zhong, J. Construction of a responsible investment composite index for renewable energy industry. Renew. Sustain. Energy Rev. 2015, 51, 288–303. [Google Scholar] [CrossRef] [Scilit]
  18. Profit, J.; Typpo, K.V.; Hysong, S.J.; Woodard, L.D.; Kallen, M.A.; Petersen, L.A. Improving benchmarking by using an explicit framework for the development of composite indicators: An example using pediatric quality of care. Implement. Sci. 2010, 5, 13. [Google Scholar] [CrossRef] [Scilit]
  19. Saisana, M.; Saltelli, A.; Tarantola, S. Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators. J. R. Stat. Soc. Ser. A (Stat. Soc.) 2005, 168, 307–323. [Google Scholar] [CrossRef] [Scilit]
  20. Bertoni, M. Multi-criteria decision making for sustainability and value assessment in early PSS design. Sustainability 2019, 11, 1952. [Google Scholar] [CrossRef] [Scilit]
  21. Cinelli, M.; Coles, S.R.; Kirwan, K. Analysis of the potentials of multi criteria decision analysis methods to conduct sustainability assessment. Ecol. Indic. 2014, 46, 138–148. [Google Scholar] [CrossRef] [Scilit]
  22. Samira, E.G.; Gómez, T.; Ruiz, F. Building composite indicators using multicriteria methods: A review. J. Bus. Econ. 2019, 89, 1–24. [Google Scholar] [CrossRef] [Scilit]
  23. Pavan, M.; Todeschini, R. 1.19—Multicriteria Decision-Making Methods. In Comprehensive Chemometrics: Chemical and Biochemical Data Analysis, 1st ed.; Brown, S.D., Tauler, R., Walczak, B., Eds.; Elsevier: Oxford, UK, 2009; Volume 1, pp. 591–629. [Google Scholar]
  24. Stević, Ž.; Pamučar, D.; Puška, A.; Chatterjee, P. Sustainable supplier selection in healthcare industries using a new MCDM method: Measurement alternatives and ranking according to compromise solution (MARCOS). Comput. Ind. Eng. 2020, 140, 106231. [Google Scholar] [CrossRef] [Scilit]
  25. Yu, C.; Shao, Y.; Wang, K.; Zhang, L. A group decision making sustainable supplier selection approach using extended TOPSIS under interval-valued Pythagorean fuzzy environment. Expert Syst. Appl. 2019, 121, 1–17. [Google Scholar] [CrossRef] [Scilit]
  26. Phochanikorn, P.; Tan, C. A new extension to a multi-criteria decision-making model for sustainable supplier selection under an intuitionistic fuzzy environment. Sustainability 2019, 11, 5413. [Google Scholar] [CrossRef] [Scilit]
  27. Stojčić, M.; Zavadskas, E.K.; Pamučar, D.; Stević, Ž.; Mardani, A. Application of MCDM methods in sustainability engineering: A literature review 2008–2018. Symmetry 2019, 11, 350. [Google Scholar] [CrossRef] [Scilit]
  28. Mao, R.J.; You, J.X.; Duan, C.Y.; Shao, L.N. A heterogeneous MCDM framework for sustainable supplier evaluation and selection based on the IVIF-TODIM method. Sustainability 2019, 11, 5057. [Google Scholar] [CrossRef] [Scilit]
  29. Çelikbilek, Y.; Tüysüz, F. An integrated grey based multi-criteria decision making approach for the evaluation of renewable energy sources. Energy 2016, 115, 1246–1258. [Google Scholar] [CrossRef] [Scilit]
  30. Arce, M.E.; Saavedra, Á.; Míguez, J.L.; Granada, E. The use of grey-based methods in multi-criteria decision analysis for the evaluation of sustainable energy systems: A review. Renew. Sustain. Energy Rev. 2015, 47, 924–932. [Google Scholar] [CrossRef] [Scilit]
  31. San Cristóbal, J.R. Multi-criteria decision-making in the selection of a renewable energy project in Spain: The vikor method. Renew. Energy 2011, 36, 498–502. [Google Scholar] [CrossRef] [Scilit]
  32. Kaya, T.; Kahraman, C. Multicriteria renewable energy planning using an integrated fuzzy VIKOR & AHP methodology: The case of Istanbul. Energy 2010, 35, 2517–2527. [Google Scholar] [CrossRef] [Scilit]
  33. Gao, R.; Nam, H.O.; Ko, W.I.; Jang, H. National options for a sustainable nuclear energy system: MCDM evaluation using an improved integrated weighting approach. Energies 2017, 10, 2017. [Google Scholar] [CrossRef] [Scilit]
  34. Kemmler, A.; Spreng, D. Energy indicators for tracking sustainability in developing countries. Energy Policy 2007, 35, 2466–2480. [Google Scholar] [CrossRef] [Scilit]
  35. Hardi, P.; Zdan, T. Assessing Sustainable Development: Principles in Practice; International Institute for Sustainable Development: Winnipeg, MB, Canada, 1997. [Google Scholar]
  36. Bossel, H. Indicators for Sustainable Development: Theory, Method, Applications; International Institute for Sustainable Development: Winnipeg, MB, Canada, 1999. [Google Scholar]
  37. Afgan, N.H.; Carvalho, M.G.; Hovanov, N.V. Energy system assessment with sustainability indicators. Energy Policy 2000, 28, 603–612. [Google Scholar] [CrossRef] [Scilit]
  38. Harger, J.R.E.; Meyer, F.M. Definition of indicators for environmentally sustainable development. Chemosphere 1996, 33, 1749–1775. [Google Scholar] [CrossRef] [Scilit]
  39. Reisi, M.; Aye, L.; Rajabifard, A.; Ngo, T. Transport sustainability index: Melbourne case study. Ecol. Indic. 2014, 43, 288–296. [Google Scholar] [CrossRef] [Scilit]
  40. Haghshenas, H.; Vaziri, M. Urban sustainable transportation indicators for global comparison. Ecol. Indic. 2012, 15, 115–121. [Google Scholar] [CrossRef] [Scilit]
  41. Li, F.; Liu, X.; Hu, D.; Wang, R.; Yang, W.; Li, D.; Zhao, D. Measurement indicators and an evaluation approach for assessing urban sustainable development: A case study for China’s Jining City. Landsc. Urban Plan. 2019, 90, 134–142. [Google Scholar] [CrossRef] [Scilit]
  42. International Atomic Energy Agency (IAEA); United Nations Department of Economic and Social Affairs (UNDESA); International Energy Agency (IEA); Eurostat; European Environment Agency (EEA). Energy Indicators for Sustainable Development: Methodologies and Guidelines; International Atomic Energy Agency (IAEA): Vienna, Austria, 2005. [Google Scholar]
  43. Chirwa, T.G.; Odhiambo, N.M. Macroeconomic determinants of economic growth: A review of international literature. South East Eur. J. Econ. Bus. 2016, 11, 33–47. [Google Scholar] [CrossRef] [Scilit]
  44. Bleicher, S.A. An Overview of International Environmental Regulation. Ecology 1972, 2, 1–90. [Google Scholar]
  45. Gunningham, N. Enforcing environmental regulation. J. Environ. Law 2011, 23, 169–201. [Google Scholar] [CrossRef] [Scilit]
  46. Schwab, K.; Sala-i-Martin, X. The Global Competitiveness Report 2017–2018; World Economic Forum: Cologny, Switzerland; Geneva, Switzerland, 2017. [Google Scholar]
  47. Forman, E.H.; Gass, S.I. The analytic hierarchy process—An exposition. Oper. Res. 2001, 49, 469–486. [Google Scholar] [CrossRef] [Scilit]
  48. Chai, J.; Liu, J.N.K.; Ngai, E.W.T. Application of decision-making techniques in supplier selection: A systematic review of literature. Expert Syst. Appl. 2013, 40, 3872–3885. [Google Scholar] [CrossRef] [Scilit]
  49. De FSM Russo, R.; Camanho, R. Criteria in AHP: A systematic review of literature. Procedia Comput. Sci. 2015, 55, 1123–1132. [Google Scholar] [CrossRef] [Scilit]
  50. Vaidya, O.S.; Kumar, S. Analytic hierarchy process: An overview of applications. Eur. J. Oper. Res. 2006, 169, 1–29. [Google Scholar] [CrossRef] [Scilit]
  51. Mafakheri, F.; Breton, M.; Ghoniem, A. Supplier selection-order allocation: A two-stage multiple criteria dynamic programming approach. Int. J. Prod. Econ. 2011, 132, 52–57. [Google Scholar] [CrossRef] [Scilit]
  52. Bhattacharya, A.; Geraghty, J.; Young, P. Supplier selection paradigm: An integrated hierarchical QFD methodology under multiple-criteria environment. Appl. Soft Comput. 2010, 10, 1013–1027. [Google Scholar] [CrossRef] [Scilit]
  53. Ishizaka, A.; Pearman, C.; Nemery, P. AHPSort: An AHP-based method for sorting problems. Int. J. Prod. Res. 2012, 50, 4767–4784. [Google Scholar] [CrossRef] [Scilit]
  54. Benítez, J.; Delgado-Galván, X.; Gutiérrez, J.A.; Izquierdo, J. Balancing consistency and expert judgment in AHP. Math. Comput. Model. 2011, 54, 1785–1790. [Google Scholar] [CrossRef] [Scilit]
  55. Wang, Y.M.; Chin, K.S. Fuzzy analytic hierarchy process: A logarithmic fuzzy preference programming methodology. Int. J. Approx. Reason. 2011, 52, 541–553. [Google Scholar] [CrossRef] [Scilit]
  56. Kilincci, O.; Onal, S.A. Fuzzy AHP approach for supplier selection in a washing machine company. Expert Syst. Appl. 2011, 38, 9656–9664. [Google Scholar] [CrossRef] [Scilit]
  57. Haq, A.N.; Kannan, G. Fuzzy analytical hierarchy process for evaluating and selecting a vendor in a supply chain model. Int. J. Adv. Manuf. Technol. 2006, 29, 826–835. [Google Scholar] [CrossRef] [Scilit]
  58. Chamodrakas, I.; Batis, D.; Martakos, D. Supplier selection in electronic marketplaces using satisficing and fuzzy AHP. Expert Syst. Appl. 2010, 37, 490–498. [Google Scholar] [CrossRef] [Scilit]
  59. Chan, F.T.S.; Kumar, N.; Tiwari, M.K.; Lau, H.C.W.; Choy, K.L. Global supplier selection: A fuzzy-AHP approach. Int. J. Prod. Res. 2008, 46, 3825–3857. [Google Scholar] [CrossRef] [Scilit]
  60. Lu, L.Y.; Wu, C.H.; Kuo, T.C. Environmental principles applicable to green supplier evaluation by using multi-objective decision analysis. Int. J. Prod. Res. 2007, 45, 4317–4331. [Google Scholar] [CrossRef] [Scilit]
  61. Yıldırım, B.F.; Yeşilyurt, C. Bulanık analitik hiyerarşi prosesi yaklaşımı ile proje değerlendirme kriterlerinin önceliklendirilmesi: Kalkınma ajansı örneği. Atatürk İletişim Derg. 2014, 6, 23–50. [Google Scholar]
  62. Kahraman, C.; Cebeci, U.; Ulukan, Z. Multi-criteria supplier selection using fuzzy AHP. Logist. Inf. Manag. 2003, 16, 382–394. [Google Scholar] [CrossRef] [Scilit]
  63. He, H. Research on prediction of internet public opinion based on grey system theory and fuzzy neural network. J. Intell. Fuzzy Syst. 2018, 35, 325–332. [Google Scholar] [CrossRef] [Scilit]
  64. Sofyalioğlu, Ç.; Öztürk, Ş. Application of grey relational analysis with fuzzy AHP to FMEA method. Doğuş Üniversitesi Derg. 2012, 13, 114–130. [Google Scholar] [CrossRef] [Scilit]
  65. Mohamed, S.A.N.; Zainudin, E.S.; Sapuan, S.M.; Deros, M.A.M.; Arifin, A.M.T. Integration of taguchi-grey relational analysis technique in parameter process optimization for rice husk composite. BioResources 2009, 14, 1110–1126. [Google Scholar] [CrossRef] [Scilit]
  66. Lin, Y.H.; Lee, P.C.; Chang, T.P. Practical expert diagnosis model based on the grey relational analysis technique. Expert Syst. Appl. 2009, 36, 1523–1528. [Google Scholar] [CrossRef] [Scilit]
  67. Wei, G.W. GRA method for multiple attribute decision making with incomplete weight information in intuitionistic fuzzy setting. Knowl. Based Syst. 2010, 23, 243–247. [Google Scholar] [CrossRef] [Scilit]
  68. Kuo, Y.; Yang, T.; Huang, G.W. The use of grey relational analysis in solving multiple attribute decision-making problems. Comput. Ind. Eng. 2008, 55, 80–93. [Google Scholar] [CrossRef] [Scilit]
  69. Malekpoor, H.; Chalvatzis, K.; Mishra, N.; Mehlawat, M.K.; Zafirakis, D.; Song, M. Integrated grey relational analysis and multi objective grey linear programming for sustainable electricity generation planning. Ann. Oper. Res. 2018, 269, 475–503. [Google Scholar] [CrossRef] [Scilit]
  70. Fang, D.; Shi, S.; Yu, Q. Evaluation of sustainable energy security and an empirical analysis of china. Sustainability 2018, 10, 1685. [Google Scholar] [CrossRef] [Scilit]
  71. Radovanović, M.; Filipović, S.; Pavlović, D. Energy security measurement—A sustainable approach. Renew. Sustain. Energy Rev. 2017, 68, 1020–1032. [Google Scholar] [CrossRef] [Scilit]
  72. Crotti, R.; Misrahi, T. The Travel & Tourism Competitiveness Report 2017 Paving the Way for a More Sustainable and Inclusive Future; World Economic Forum: Cologny, Switzerland; Geneva, Switzerland, 2017. [Google Scholar]
  73. Evans, A.; Strezov, V.; Evans, T.J. Assessment of sustainability indicators for renewable energy technologies. Renew. Sustain. Energy Rev. 2009, 13, 1082–1088. [Google Scholar] [CrossRef] [Scilit]

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.