Next Article in Journal
Mitigating Energy Poverty: Mobilizing Climate Finance to Manage the Energy Trilemma in Indonesia
Previous Article in Journal
Impact of Economic Policy Uncertainty on Trade Credit Provision: The Role of Social Trust
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Extended GRA Method Integrated with Fuzzy AHP to Construct a Multidimensional Index for Ranking Overall Energy Sustainability Performances

1
Institute of Pure and Applied Sciences, Marmara University, Istanbul 34722, Turkey
2
Faculty of Business Administration, Marmara University, Istanbul 34722, Turkey
3
Faculty of Engineering and Natural Sciences, Maltepe University, Istanbul 34857, Turkey
*
Author to whom correspondence should be addressed.
Sustainability 2020, 12(4), 1602; https://doi.org/10.3390/su12041602
Submission received: 4 February 2020 / Accepted: 10 February 2020 / Published: 20 February 2020
(This article belongs to the Section Sustainable Engineering and Science)

Abstract

:
In an age of rapid technological advancement, the increasing need for energy and its related services to satisfy economic and social development has become a critical concern of national governments worldwide. This has triggered researchers to work on metrics for tracking and tracing energy sustainability in order to provide monitoring mechanisms for policy makers. In this regard, multicriteria decision-making (MCDM) methods are becoming more popular to deal with the multidimensional and complex nature of sustainability. We have proposed an extended and revised version of the grey relational analysis (GRA) method, which is integrated with the fuzzy analytic hierarchy process (AHP), to develop a new composite index for comparing the overall energy sustainability performances of 35 OECD member countries. Our case study revealed the performances of selected countries by providing their strengths and weaknesses based on determined criteria as well as the level of change in performances with different criteria weights. The proposed GRA model can be used in different applications of sustainability due to its flexible nature, which provides benefits from goal-oriented extensions in order to adequately capture different aspects of sustainability.

1. Introduction

Energy plays a key role in improving social and economic wellbeing and is essential to fulfill the needs of modern life [1]. Thus, it is crucial to provide energy services based on the principles of sustainability, which is a dynamic, complex, and multidimensional concept depending on context-specific and long-term goals [2,3]. Overall energy sustainability can be achieved by providing affordable, accessible, and reliable energy services in an environmentally friendly manner by considering the needs of economic and social development for present and future generations [1,4]. The dimensions of energy sustainability should be determined from that point of view, since these dimensions are not fixed due to the dynamic nature of sustainable development and new ideas continue to emerge [5,6,7,8,9].
In order to measure a country’s overall energy sustainability, its performance should be represented as quantitative data so that comparisons can be performed in a systematic way. Using indicators is a reliable way to transform condense, voluminous, and complex data into a simpler and usable form. A set of properly designed indicators is useful to determine the long-term implications of current decisions as well as interconnections and trade-offs among different dimensions [1,6]. Therefore, energy sustainability indicators can be considered as a tool to reveal the performance of a system to meet predetermined goals so that progress toward sustainability can be easily monitored by reviewing any change in indicator values over time.
Compiling indicators into a single metric in accordance with an underlying model simplifies the measurement of multidimensional problems such as energy sustainability [10]. Indices are useful tools to find common trends across different indicators [11] and to assess the performance of countries or entities on complex concepts that are not directly measurable [12]. Various indices have been proposed by researchers to overcome complex problems regarding different aspects of energy [3,5,6,7,8,9,13,14,15,16,17]. Table 1 provides information about the main pros and cons of using indices.
To construct an index, the underlying model should be clearly defined so that the formulation strategy for normalization, weighting, and aggregation techniques can be determined [10]. In this regard, multicriteria decision-making (MCDM) methods provide promising opportunities to deal with the multidimensional and complex nature of sustainability [20]. MCDM refers to a set of methods to be used for supporting decision-making in a multicriteria environment by analyzing a series of possible alternatives [21,22]. These methods allow users to make their decisions based on their predetermined preferences. The main strategy is breaking the problem into smaller components to obtain the relative preferences of alternatives for each property, and to synthesize the results for ranking alternatives [23].
MCDM methods are distinguished based on their underlying models, and the results obtained may be different from each other [23]. Although the aim of MCDM methods are in common, a method can be developed to fulfill the needs of a specific problem instead of providing a solution for different subject areas. For instance, Stević et al. [24] introduced the measurement of alternatives and ranking according to compromise solution (MARCOS) method for sustainable supplier selection in healthcare industries. Introducing new extensions to existing multicriteria decision-making models such as the extended TOPSIS method by Yu et al. [25] are also gaining popularity for solving specific sustainability problems [26,27,28]. Furthermore, there are integrated approaches that include multiple MCDM techniques to deal with such problems; for example, the integrated grey based multicriteria decision-making approach for the evaluation of renewable energy sources developed by Çelikbilek and Tüysüz [29].
The general structure of the MCDM process is composed of three major stages: determination of the criteria and evaluation metrics, determination of weights, and execution of MCDM methods. The weight of each criterion plays an important role in the MCDM process, since it reflects the importance over others and, therefore, influences the final decision-making. Consequently, it is common to use a separate MCDM method to deal with the weighting of criteria [30,31,32].
There are two types of weighting methods: subjective and objective weighting. The relative importance of an individual indicator is determined by considering judgements of decision makers, if a subjective weighting method is used. On the other hand, objective weighting methods benefit from data statistical methods without personal interference to calculate the weights. Both methods have advantages and disadvantages. While subjective methods are preferred to deal with potential uncertainties in human intuitive judgment, objective methods are considered as being easier to be executed and they are less time-consuming [33].
In this paper, we propose an extended grey relational analysis (GRA) method to be used in the overall energy sustainability index (OESI) that is developed for comparing the performances of 35 OECD member countries. The OESI is based on the GRA method integrated with the fuzzy analytic hierarchy process (AHP). While fuzzy AHP is used to determine the weights of criteria defined for decision-making, GRA is used for ranking alternatives. The proposed GRA method includes revisions and extensions to precisely meet the goals of overall energy sustainability. This new method can also be used for other applications of sustainability. The OESI focuses on three dimensions namely, economic and security, environmental, and social for ranking countries in terms of overall energy sustainability performances. Although other dimensions could still be defined, these three dimensions provide a strong and adequate representation of the multidimensionality of energy sustainability. Proposing energy sustainability indicators and combining them with a new goal-oriented MCDM method will help policy makers and researchers to precisely obtain a snapshot of a country’s performance on energy sustainability and will allow them to determine, develop, and implement policies.

2. Materials and Methods

2.1. OESI Index

To construct an index, the first step is to formulate the vision of sustainability, so that the objective can be defined and issues that are relevant in this context can be determined [34]. The purpose of the OESI has been elaborated in the previous section. Table 2 provides information about the issues to be addressed in order to calculate the dimensions of the OESI.
The selection of indicators plays a significant role in addressing the OESI. Although there are guidelines such as the Bellagio principles [35] or frameworks such as the systems approach [36] formulated for indicator selection, there is no commonly accepted methodology [34]. However, there have been studies on the requirements that should be met by selected indicators [3,17,37,38,39,40,41]. They can be summarized as sensitivity, interpretability, relevance, accessibility, sensitivity, and timeliness (presented in Table 3).
The hierarchical structure of the OESI is presented in Table 4.
The relevance of energy sustainability indicators is presented in Table 5.
Each indicator identified has an impact on the index. An indicator can be
  • Larger the better
  • Smaller the better
  • Closer to the desired value the better
  • Closer to the desired set of values the better.
Table 6 shows the impact of each indicator value on the index.
The value of IEC3 was determined by applying the GRA method to indicators represented in Table 7 with equal weights.

2.2. Fuzzy AHP

AHP is a useful MCDM method to cope with different problematic situations that may include selection of alternatives in a multi-objective environment, allocation of scarce resources, and forecasting [47]. This methodology is based on pairwise comparisons along with judgments from decision makers in a hierarchical manner for calculating weights of criteria within a complex decision-making process [48,49]. AHP has a flexible nature that allows it to be integrated with other methods, so that benefiting from the combined methods becomes possible [50,51,52,53].
AHP is a method in which judgements from experts are based on crisp logic. Criteria belonging to the same level in a hierarchical structure are compared with each other by using a nine-point numerical scale to determine how much more a criterion is important than another [54,55]. Since there is vagueness in personal judgments in real-life applications, something greater than a nine-point numerical scale is required to describe the opinion of a decision maker [56]. In order to deal with such uncertainties of a decision problem, fuzzy integrated AHP is commonly used in the literature [57,58,59,60].
In this study a fuzzy AHP methodology was used to determine the criteria weights required for ranking alternatives with the GRA method. This was achieved by transforming linguistic variables from decision maker(s) to triangular fuzzy numbers to find fuzzy weights with the geometric mean approach. The linguistic variables used in this work are indicated in Table 8.
A triangular fuzzy number is defined as (l, m, u), where (l ≤ m ≤ u). While m indicates the most promising value, l and u denote smallest and largest possible value, respectively. The mathematical notation of a fuzzy number and algebraic operations between two fuzzy numbers are indicated by the following equations [62]:
M ˜ = ( l , m , u )
( M ˜ ) 1 = ( l , m , u ) 1 = ( 1 u , 1 m , 1 l )
M ˜ 1 M ˜ 2 = ( l 1 m 1 u 1 ) ( l 2 m 2 u 2 ) = ( l 1 + l 2 , m 1 + m 2 , u 1 + u 2 )
M ˜ 1 M ˜ 2 = ( l 1 m 1 u 1 ) ( l 2 m 2 u 2 ) = ( l 1 l 2 , m 1 m 2 , u 1 u 2 )
M ˜ 1 M ˜ 2 = ( l 1 m 1 u 1 ) ( l 2 m 2 u 2 ) = ( l 1 l 2 , m 1 m 2 , u 1 u 2 )
Based on Equations (3) and (5), multiplication and addition of fuzzy numbers can be indicated as following equations:
i = 1 n M ˜ i = ( i = 1 n l , i = 1 n m , i = 1 n u )
i = 1 n M ˜ i = ( i = 1 n l , i = 1 n m , i = 1 n u )
Based on the responses from the decision maker, a judgement matrix is formed to demonstrate triangular fuzzy numbers, as indicated by Equation (8):
M ˜ i j = [ M ˜ 11 M ˜ 12 M ˜ 1 n M ˜ 21 M ˜ 22 M ˜ 2 n M ˜ n 1 M ˜ n 2 M ˜ n n ] = [ l 11 m 11 u 11 l 12 m 12 u 12 l 1 n m 1 n u 1 n l 21 m 21 u 21 l 22 m 22 u 22 l 2 n m 2 n u 2 n l n 1 m n 1 u n 1 l n 2 m n 2 u n 2 l n n m n n u n n ]   for   i = 1 , 2 , , n j = 1 , 2 , , n
For each criterion, the geometric mean of fuzzy comparison values should be calculated before converting them back into crisp values and performing normalization. This is achieved by Equation (9).
F ˜ i = R ˜ G ˜ i = ( i = 1 n j = 1 n M ˜ i j n ) 1 j = 1 n M ˜ i j n
where
  • G ˜ i represents the geometric mean value of triangular fuzzy numbers for criterion C i ,
  • R ˜ represents the reciprocal of the sum of the geometric mean of fuzzy comparison values, and
  • F ˜ i represents the fuzzy weight for criterion C i .
The final steps to determine the final criteria weights with fuzzy AHP include taking the arithmetic mean of fuzzy weights and normalizing it so that the sum of the weights is equal to 1. If there is more than one decision maker, the arithmetic means of the final criteria weights calculated for each decision maker should be taken.

2.3. GRA

GRA depends on the concept of grey theory, which was introduced by Deng in 1982 in order to make decisions where there was incomplete information and data sample. A system is called “grey” if it has incomplete and uncertain information, while a “white” system contains all the information and a “black” system contains no data. In addition to the ability of computing with uncertainty and incomplete information, another key advantage of the grey system is its ability to provide methods which do not require an excessive sample size and any sample distribution for ranking alternatives [63,64].
GRA aims to determine the correlation between sequences by using the data available. This is achieved by creating comparative sequences based on the performances of alternatives as well as by defining the ideal sequence, so that the trend correlation between the reference sequence (ideal sequence) and comparative sequences can be calculated. The comparative sequence that leans more toward concordance with the reference sequence has the highest grey relational degree and, therefore, the related alternative will be the best choice [65,66,67].

2.3.1. Existing GRA Procedure

The decision matrix for a MCDM problem that consists of a set of alternatives ( A 1 ,   A 2 , ,   A m ) and criteria ( C 1 ,   C 2 , ,   C m ) is formed as shown in Equation (10):
X i j = [ X 11 X 12 X 1 n X 21 X 22 X 2 n X n 1 X n 2 X n n ]   for   i = 1 , 2 , , m j = 1 , 2 , , n
where
  • X i j represents the performance of alternative A i for criterion C j .
After the decision matrix is formed, the ideal sequence should be determined and added to the decision matrix as a reference. The reference sequence may consist of “larger the better” criteria, “smaller the better” criteria, and “closer to the desired value the better” criteria.
It is important to perform normalization for transforming input data into a comparable form. Normalization for GRA, which is also called grey relational generating, is performed by one of the three equations described below. Equation (11) is used for larger the better criteria, Equation (12) is used for smaller the better criteria, and Equation (13) is used for closer to the desired value the better criteria [68,69]:
X i j * = X i j min ( X i j , i = 1 , 2 , , m ) max ( X i j , i = 1 , 2 , , m ) min ( X i j , i = 1 , 2 , , m )   for   i = 1 , 2 , , m j = 1 , 2 , , n
X i j * = max ( X i j , i = 1 , 2 , , m ) X i j max ( X i j , i = 1 , 2 , , m ) min ( X i j , i = 1 , 2 , , m )   for   i = 1 , 2 , , m j = 1 , 2 , , n
X i j * =   1 | X i j X d v j | max { max ( X i j , i = 1 , 2 , , m ) X d v j ,   X d v j min ( X i j , i = 1 , 2 , , m ) }   for   i = 1 , 2 , , m j = 1 , 2 , , n
where
  • X i j * represents the normalized data of alternative A i for criterion C j , and
  • X d v j is the desired value for criterion C j .
With the grey relational generating process, data are adjusted in a way so that each value falls within the range of [0,1]. If the normalized value of an alternative is equal to 1 or closer to 1 than any other normalized alternative value for a specific criterion, the performance of that alternative is the best one for that criterion. In contrast, if the normalized value of an alternative is equal to 0 or closer to 0 than any other normalized alternative value for a specific criterion, the performance of that alternative is the worst one for that criterion.
The grey relational coefficient should be calculated after the normalization process. It is used to determine how close the normalized sequence is to the corresponding reference sequence. It is calculated by using Equations (14) and (15):
Δ i j = | X i j * X o j |   for   i = 1 , 2 , m     j = 1 , 2 , n
γ ( X o j , X i j * ) = min ( Δ i j , i = 1 , 2 , m ; j = 1 , 2 , n ) + ς max ( Δ i j , i = 1 , 2 , , m ; j = 1 , 2 , , n ) Δ i j + ς max ( Δ i j , i = 1 , 2 , , m ; j = 1 , 2 , , n )   for   i = 1 , 2 , , m j = 1 , 2 , , n
where
  • γ ( X o j , X i j * ) is the grey relational coefficient of alternative A i for criterion C j ,
  • X o j * is the reference sequence for criterion C j and takes the value of 1, and
  • ς is defined as the identification coefficient.
The identification coefficient is used for either compressing or expanding the range of the grey relational coefficient to be calculated. The identification coefficient is determined as 0.5 in the literature [64,65,66,68,69].
The grey relational grade represents the final correlation between the comparative and reference sequences. It is calculated by Equation (16):
Γ ( X i ) = j = 1 n W j γ ( X o j , X i j * )   for   i = 1 , 2 , , m
where
  • Γ ( X i ) represents the grey relational grade for alternative A i , and
  • W j is the weight of C j obtained with fuzzy AHP.
The higher the value of the grey relational grade, the better the performance of the corresponding alternative.

2.3.2. Revised GRA Normalization Procedure

The normalization procedure for the closer to the desired value the better criteria mentioned in the previous section, represented by Equation (13), does not align with the concept of the procedures applied for the larger the better and the smaller the better criteria indicated by Equations (11) and (12), respectively. The idea should be to assign 1 to the best alternative available and 0 to the worst alternative available based on their performance. However, this cannot be achieved by using Equation (13) if there is no alternative available with the desired value. In that case, the performance of the best alternative cannot reach 1.
Our proposed solution is to add another normalization step to overcome this problem. The proposed method is demonstrated by Equations (17) and (18). Equation (17) is a prenormalization step and Equation (18) is used for normalizing values obtained by using Equation (17):
Y i j = | X i j X d v j | max ( X i j , i = 1 , 2 , , m ) min ( X i j , i = 1 , 2 , , m )   for   i = 1 , 2 , , m j = 1 , 2 , , n
X i j * = max ( Y i j , i = 1 , 2 , , m ) Y i j max ( Y i j , i = 1 , 2 , , m ) min ( Y i j , i = 1 , 2 , , m )   for   i = 1 , 2 , , m j = 1 , 2 , , n
where
  • Y i j is the prenormalization value.
By using the abovementioned equations, the range of data is adjusted so that each value falls within the range of [0,1]. The alternative that is closest to desired value takes 1 and the value of the outmost alternative takes 0.

2.3.3. Extended GRA Normalization Procedure

There may be cases where a set of values is considered optimum instead of a single value. We propose two-step normalization procedures, such as the one applied in the previous section, to solve such issues. If the set of optimal values lies between the maximum and minimum alternative values, Equation (19) can be used to determine the prenormalization value before using Equation (18):
Y i j = { | X i j X m a x o p t | max ( X i j , i = 1 , 2 , , m ) min ( X i j , i = 1 , 2 , , m ) , where   X m a x o p t < X i j m a x ( X i j , i = 1 , 2 , , m ) 0 , where   X m i n o p t X i j X m a x o p t | X i j X m i n o p t | max ( X i j , i = 1 , 2 , , m ) min ( X i j , i = 1 , 2 , , m ) , where   m i n ( X i j , i = 1 , 2 , , m ) X i j < X m i n o p t
where
  • X m a x o p t represents the maximum value of the optimal data set, and
  • X m i n o p t represents the minimum value of the optimal data set.
Equation (19) ensures that best alternative(s) takes the value of 1 after the grey relational generating process, whether there is any optimum or not. However, the proposed equation is not useful in cases where the set optimal values do not lie between maximum and minimum alternative values. It is easy to compute if the minimum value of the optimal data set is greater than the maximum alternative value or if the maximum value of the optimal data set is smaller than the minimum alternative value, since Equations (11) or (12) can be used, respectively. On the other hand, Equation (20) should be used to determine the prenormalization value in cases where the set of optimal values includes the minimum or maximum alternative value and not the other:
Y i j = { | X i j X m i n o p t | X m i n o p t min ( X i j , i = 1 , 2 , , m ) , where m i n ( X i j , i = 1 , 2 , , m ) < X m i n o p t < m a x ( X i j , i = 1 , 2 , , m ) < X m a x o p t X i j < X m i n o p t   | X i j X m a x o p t | max ( X i j , i = 1 , 2 , , m ) X m a x o p t , where   X m i n o p t < m i n ( X i j , i = 1 , 2 , , m ) < X m a x o p t < m a x ( X i j , i = 1 , 2 , , m ) X i j > X m a x o p t  
Flow chart of the procedures used for calculating the OESI is presented in Appendix B (Figure A1 and Figure A2).

3. Results and Discussion

The weights of the criteria had a considerable effect on the results of the OESI. Table 9 and Table 10 show the weights of criteria and indicators determined by applying fuzzy AHP procedures. It was observed that the economic and security dimension had the greatest impact, while the environmental and social dimensions had similar impacts on the index.
Among 35 OECD member countries, Iceland took first place in terms of overall energy sustainability performance. Iceland ranked first among other OECD member countries in the economic and security, and the environmental dimensions, and ranked eighth in the social dimension.
By comparing other energy sustainability indices with the OESI, similarities were observed in the results. Although each energy sustainability index has its own objective and considers different indicators, European countries take the highest scores. For instance, Norway, Sweden, Switzerland, New Zealand, and Austria scored in the top 10 in the OESI, the Global Energy Architecture Performance Index [8], and World Energy Trilemma Index [9]. Results are presented in Table 11.
OESI is a tool that provides a snapshot of overall energy sustainability performances of countries on a comparative scale and its significance must be interpreted with circumspection. Although a country with a high value of OESI may be perceived as more developed than other countries with lower values, a disaggregated evaluation at the subcriteria level is further required in order to gain a comprehensive insight into energy sustainability. This allows policy makers to focus on areas that needs to be improved. Table 12, Table 13 and Table 14 present weighted indicator values.
The results indicate that countries with high performance in OESI managed to link various aspects of energy sustainability. Overall scores were distributed between 0.807 and 0.518 out of 1. Since OECD member countries were considered as alternatives in the study, the absence of scores under 0.5 is not surprising.
From the dimension point of view, economic and security dimension had much more effect on the OESI among other dimensions. Countries which were efficient in energy use, benefitted from various energy resources, and had high productive uses of energy, achieved high points in this dimension. Thus, policy makers should put their best efforts to improve these areas in order to maximize energy sustainability.
Environmental dimension occupied the second place in reference to other dimensions. With respect to this dimension, climate related issues (CO2, N2O, and CH4 emissions) were the main drivers of environmental problems. Furthermore, creating environmental awareness and promoting environmental education are the means to ensure pressure on governments from society to develop laws and regulations aimed at protecting the environment. Enforcement of regulations is also required for proper environmental care.
Social dimension held the last place in the list. Any policy aiming to implement a transition towards energy sustainability needs to be evaluated regarding their influences on accessibility, quality and affordability of energy services.
“Diversification of sources for electricity generation” is one of the most significant indicators in terms of criteria weights. In recent studies, the importance of diversification of energy supply has been emphasized with other factors, such as political stability, energy resource availability, energy dependence, and reserve-to-production ratio [8,70,71]. Using the GRA method to create an additional energy security dimension by including such factors may provide a more comprehensive approach to rank countries in future works. Those factors should be dependent on each other and their weights must be arranged on a country basis. Furthermore, taking steps to include future projection data for all dimensions can contribute to the efforts of developing the OESI.
As a future direction, using an integrated method consisting of a specific function that determines the overall weights of indicators based on obtained data from both subjective and objective weighting procedures will be highly beneficial. In addition, taking further steps in developing existing fuzzy AHP methodology or proposing a more suitable subjective weighting model to allow more scalability may provide the ability to benefit from additional dimensions. Especially, creating a separated energy policy dimension will significantly contribute to the efforts to improve the OESI.
The analyses performed in the OESI were mostly based on data with a five-year time frame due to data unavailability. Since the precision of the indicated results increases along with improvements in timely data collection, further efforts should include improved data collection to track performances of countries on an annual basis.

4. Conclusions

In our study, a framework was built to develop an index for measuring the overall energy sustainability of various countries. The aim of proposing such an index was to provide a benchmark for policy makers to assess energy sustainability performances by introducing a new underlying model that can also be used in different applications of sustainability. Such an approach contributes to efforts of researchers working on decision-making methods for dealing with sustainability issues.
Three major contributions of this research can be summarized as follows:
  • providing a research strategy that benefits from a specific, integrated MCDM method (fuzzy AHP with GRA) to deal with complex sustainability issues;
  • introducing new extensions for the existing GRA method due to its insufficiency in providing accurate results after the grey relational generating process in specific situations; and
  • proposing an index with the purpose of assessing the overall energy sustainability performances of various countries serving as a mechanism to monitor their strengths and weaknesses.
Our research has mainly focused on proposing revisions and extensions regarding the normalization procedure of GRA method. We introduced a simple procedure to overcome the inconsistency problem encountered in the normalization step for the closer to the desired value the better criteria. Furthermore, we used this approach to develop additional steps in the normalization process to solve problems that include closer to the desired set of values the better criteria. We believe these additional procedures make GRA a very suitable method for ranking alternatives in sustainability problems, due to their contribution to provide solutions in dealing with criteria that cannot be modelled as larger the better or smaller the better. This can also make an important contribution to MCDM literature.
While the OESI was rigorously developed, there are some limitations providing opportunities for future papers. This study used fuzzy AHP in order to determine the weights of each indicator, due to its specific properties such as simplicity, and flexibility. However, difficulties in deciding whether an expert is qualified in the selected research area, reaching adequate number of experts, and receiving timely feedback from them pose problems. Moreover, we have faced scalability issues due to the increasing number of comparisons, which quickly becomes unmanageable. Therefore, including integrated methods using both subjective and objective weighting, and any procedure that provides solutions for scalability issues in subjective weighting is important in the future work. This will increase the reliability of the study and will allow to increase the number of dimensions, criteria and indicators to be used in the OESI. In addition to constraints caused by fuzzy AHP, data availability has been also an important issue. Even though criteria for indicator selection presented in Table 3 has been carefully considered during indicator selection, further efforts are required in timely data collection. Replicating the methodology in regions with less information (especially non-developed nations) may be difficult due to data unavailability.
For further research, using non-linear functions such as radical functions instead of a linear approach in the normalization step can be a promising area for interested researchers. Although this would be a more comprehensive approach for ranking purposes, it would include more subjectivity (determining the function, using multiple functions etc.). Nevertheless, we believe it is a promising research area which is applicable especially for creating an additional security dimension.

Supplementary Materials

The following are available online at https://www.mdpi.com/2071-1050/12/4/1602/s1, Excel File S1: Data, Excel File S2: Matlab_Output, Excel File S3: Questionnaire & Answers, Excel File S4: Results of Questionnaire, Excel File S5: RESULTS (ALTINTAS), Excel File S6: RESULTS (GURBUZ), Excel File S7: RESULTS (KAVAKLIOGLU), MATLAB File S8: FUZZY_AHP, Figure S9: Flow chart of the overall procedure, Figure S10: Flow chart of the revised & extended GRA procedure, Text File S11:FUZZY_AHP, Word File S12: General.

Author Contributions

Conceptualization, K.A., O.V., S.A., and E.C.; methodology, K.A., O.V., S.A., and E.C.; software, K.A.; validation, O.V., S.A., and E.C; formal analysis, K.A and S.A.; investigation, K.A.; resources, K.A.; data curation, K.A.; writing—original draft preparation, K.A.; writing—review and editing, K.A., O.V., S.A. and E.C.; supervision, O.V., S.A., and E.C.; project administration, K.A., O.V., S.A., and E.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Indicators, units, and brief descriptions.
Table A1. Indicators, units, and brief descriptions.
CodeUnitDescription
IEC1kgoe 1 per capitaprimary energy consumption 2 on a per capita basis
IEC2kgoe per GDP 3primary energy consumption on a GDP basis
IEC3#level of energy supply diversification
IEC4%level of supply efficiency for electricity generation
IEC5%level of losses during electric power transmission 4
IEC6%annual growth rate of GDP
IEC7%budget surplus or deficit as a percentage of GDP
IEC8%annual change in goods and services
IEC9%gross general government debt as a percentage of GDP
IEN1ton of CO2 equivalent per capitaN2O emissions from energy-related processes on a per capita basis
IEN2ton of CO2 equivalent per capitaCH4 emissions from energy-related processes on a per capita basis
IEN3ton of CO2 per capita CO2 emissions from solid fuel combustion on a per capita basis
IEN4ton of CO2 per capita CO2 emissions from liquid fuel combustion on a per capita basis
IEN5ton of CO2 per capita CO2 emissions from gaseous fuel combustion on a per capita basis
IEN6score 1–7level of stringency of environmental regulations
IEN7score 1–7level of enforcement of environmental regulations
ISO1%percentage of population with access to electricity
ISO2score 1–7quality of electricity supply
ISO3#affordability of electricity consumption
ISO4#affordability of diesel consumption
ISO5#affordability of gasoline consumption
1 kgoe (kilograms of oil equivalent) refers to the amount of energy generated from burning kg ton of crude oil. 2 primary energy refers to any energy form that has not been transformed to other end-use fuels. 3 GDP is converted to USD by using 2011 rates of purchasing power parity. 4 pilferage is included.
Table A2. Academic sources used for determining indicators.
Table A2. Academic sources used for determining indicators.
CodeSourcesCode SourcesCode Sources
IEC1[42]IEC8[3,9,43,46]IEN6[44,45,72,73]
IEC2[42]IEC9[9,43,46]IEN7[44,45,72,73]
IEC3[42]IEN1[8]ISO1[42]
IEC4[42,73]IEN2[8]ISO2[9]
IEC5[42]IEN3[6]ISO3[9,42]
IEC6[3,9,43] IEN4[6]ISO4[9,42]
IEC7[9,43,46]IEN5[6]ISO5[9,42]

Appendix B

MATLAB (R2018b) was used for calculating weights with fuzzy AHP and Microsoft Excel (2016) was used to apply GRA methods.
Figure A1. Flow chart of the overall procedure (Supplementary Materials).
Figure A1. Flow chart of the overall procedure (Supplementary Materials).
Sustainability 12 01602 g0a1
Figure A2. Flow chart of the revised and extended GRA procedure (Supplementary Materials).
Figure A2. Flow chart of the revised and extended GRA procedure (Supplementary Materials).
Sustainability 12 01602 g0a2

References

  1. Vera, I.; Langlois, L. Energy indicators for sustainable development. Energy 2007, 32, 875–882. [Google Scholar] [CrossRef]
  2. Mog, J.M. Struggling with sustainability—A comparative framework for evaluating sustainable development programs. World Dev. 2004, 32, 2139–2160. [Google Scholar] [CrossRef]
  3. Cîrstea, S.; Moldovan-Teselios, C.; Cîrstea, A.; Turcu, A.; Darab, C. Evaluating renewable energy sustainability by composite index. Sustainability 2018, 10, 811. [Google Scholar] [CrossRef] [Green Version]
  4. Rosen, M. Energy sustainability: A pragmatic approach and illustrations. Sustainability 2009, 1, 55–80. [Google Scholar] [CrossRef] [Green Version]
  5. Mainali, B.; Pachauri, S.; Rao, N.D.; Silveira, S. Assessing rural energy sustainability in developing countries. Energy Sustain. Dev. 2014, 19, 15–28. [Google Scholar] [CrossRef]
  6. Iddrisu, I.; Bhattacharyya, S.C. Sustainable Energy Development Index: A multi-dimensional indicator for measuring sustainable energy development. Renew. Sustain. Energy Rev. 2015, 50, 513–530. [Google Scholar] [CrossRef] [Green Version]
  7. García-Álvarez, M.T.; Moreno, B.; Soares, I. Analyzing the sustainable energy development in the EU-15 by an aggregated synthetic index. Ecol. Indic. 2016, 60, 996–1007. [Google Scholar] [CrossRef]
  8. World Economic Forum. Global Energy Architecture Performance Index Report 2017; World Economic Forum: Geneva, Switzerland, 2017. [Google Scholar]
  9. World Energy Council; Oliver Wyman. World Energy Trilemma Index, 2016 Benchmarking the Sustainability of National Energy Systems; World Energy Council: London, UK, 2016. [Google Scholar]
  10. Singh, R.K.; Murty, H.R.; Gupta, S.K.; Dikshit, A.K. An overview of sustainability assessment methodologies. Ecol. Indic. 2009, 9, 189–212. [Google Scholar] [CrossRef]
  11. Nhemachena, C.; Matchaya, G.; Nhemachena, C.R.; Karuaihe, S.; Muchara, B.; Nhlengethwa, S. Measuring baseline agriculture-related sustainable development goals index for Southern Africa. Sustainability 2018, 10, 849. [Google Scholar] [CrossRef] [Green Version]
  12. Becker, W.; Saisana, M.; Paruolo, P.; Vandecasteele, I. Weights and importance in composite indicators: Closing the gap. Ecol. Indic. 2017, 80, 12–22. [Google Scholar] [CrossRef]
  13. Goldrath, T.; Ayalon, O.; Shechter, M.A. combined sustainability index for electricity efficiency measures. Energy Policy 2015, 86, 574–584. [Google Scholar] [CrossRef]
  14. Narula, K.; Reddy, B.S.; Pachauri, S. Sustainable energy security for India: An assessment of energy demand sub-system. Appl. Energy 2017, 186, 126–139. [Google Scholar] [CrossRef]
  15. Raza, S.S.; Janajreh, I.; Ghenai, C. Sustainability index approach as a selection criteria for energy storage system of an intermittent renewable energy source. Appl. Energy 2014, 136, 909–920. [Google Scholar] [CrossRef]
  16. Mainali, B.; Silveira, S. Using a sustainability index to assess energy technologies for rural electrification. Renew. Sustain. Energy Rev. 2015, 41, 1351–1365. [Google Scholar] [CrossRef]
  17. Lee, C.W.; Zhong, J. Construction of a responsible investment composite index for renewable energy industry. Renew. Sustain. Energy Rev. 2015, 51, 288–303. [Google Scholar] [CrossRef]
  18. Profit, J.; Typpo, K.V.; Hysong, S.J.; Woodard, L.D.; Kallen, M.A.; Petersen, L.A. Improving benchmarking by using an explicit framework for the development of composite indicators: An example using pediatric quality of care. Implement. Sci. 2010, 5, 13. [Google Scholar] [CrossRef] [Green Version]
  19. Saisana, M.; Saltelli, A.; Tarantola, S. Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators. J. R. Stat. Soc. Ser. A (Stat. Soc.) 2005, 168, 307–323. [Google Scholar] [CrossRef]
  20. Bertoni, M. Multi-criteria decision making for sustainability and value assessment in early PSS design. Sustainability 2019, 11, 1952. [Google Scholar] [CrossRef] [Green Version]
  21. Cinelli, M.; Coles, S.R.; Kirwan, K. Analysis of the potentials of multi criteria decision analysis methods to conduct sustainability assessment. Ecol. Indic. 2014, 46, 138–148. [Google Scholar] [CrossRef] [Green Version]
  22. Samira, E.G.; Gómez, T.; Ruiz, F. Building composite indicators using multicriteria methods: A review. J. Bus. Econ. 2019, 89, 1–24. [Google Scholar] [CrossRef]
  23. Pavan, M.; Todeschini, R. 1.19—Multicriteria Decision-Making Methods. In Comprehensive Chemometrics: Chemical and Biochemical Data Analysis, 1st ed.; Brown, S.D., Tauler, R., Walczak, B., Eds.; Elsevier: Oxford, UK, 2009; Volume 1, pp. 591–629. [Google Scholar]
  24. Stević, Ž.; Pamučar, D.; Puška, A.; Chatterjee, P. Sustainable supplier selection in healthcare industries using a new MCDM method: Measurement alternatives and ranking according to compromise solution (MARCOS). Comput. Ind. Eng. 2020, 140, 106231. [Google Scholar] [CrossRef]
  25. Yu, C.; Shao, Y.; Wang, K.; Zhang, L. A group decision making sustainable supplier selection approach using extended TOPSIS under interval-valued Pythagorean fuzzy environment. Expert Syst. Appl. 2019, 121, 1–17. [Google Scholar] [CrossRef]
  26. Phochanikorn, P.; Tan, C. A new extension to a multi-criteria decision-making model for sustainable supplier selection under an intuitionistic fuzzy environment. Sustainability 2019, 11, 5413. [Google Scholar] [CrossRef] [Green Version]
  27. Stojčić, M.; Zavadskas, E.K.; Pamučar, D.; Stević, Ž.; Mardani, A. Application of MCDM methods in sustainability engineering: A literature review 2008–2018. Symmetry 2019, 11, 350. [Google Scholar] [CrossRef] [Green Version]
  28. Mao, R.J.; You, J.X.; Duan, C.Y.; Shao, L.N. A heterogeneous MCDM framework for sustainable supplier evaluation and selection based on the IVIF-TODIM method. Sustainability 2019, 11, 5057. [Google Scholar] [CrossRef] [Green Version]
  29. Çelikbilek, Y.; Tüysüz, F. An integrated grey based multi-criteria decision making approach for the evaluation of renewable energy sources. Energy 2016, 115, 1246–1258. [Google Scholar] [CrossRef]
  30. Arce, M.E.; Saavedra, Á.; Míguez, J.L.; Granada, E. The use of grey-based methods in multi-criteria decision analysis for the evaluation of sustainable energy systems: A review. Renew. Sustain. Energy Rev. 2015, 47, 924–932. [Google Scholar] [CrossRef]
  31. San Cristóbal, J.R. Multi-criteria decision-making in the selection of a renewable energy project in Spain: The vikor method. Renew. Energy 2011, 36, 498–502. [Google Scholar] [CrossRef]
  32. Kaya, T.; Kahraman, C. Multicriteria renewable energy planning using an integrated fuzzy VIKOR & AHP methodology: The case of Istanbul. Energy 2010, 35, 2517–2527. [Google Scholar] [CrossRef]
  33. Gao, R.; Nam, H.O.; Ko, W.I.; Jang, H. National options for a sustainable nuclear energy system: MCDM evaluation using an improved integrated weighting approach. Energies 2017, 10, 2017. [Google Scholar] [CrossRef] [Green Version]
  34. Kemmler, A.; Spreng, D. Energy indicators for tracking sustainability in developing countries. Energy Policy 2007, 35, 2466–2480. [Google Scholar] [CrossRef]
  35. Hardi, P.; Zdan, T. Assessing Sustainable Development: Principles in Practice; International Institute for Sustainable Development: Winnipeg, MB, Canada, 1997. [Google Scholar]
  36. Bossel, H. Indicators for Sustainable Development: Theory, Method, Applications; International Institute for Sustainable Development: Winnipeg, MB, Canada, 1999. [Google Scholar]
  37. Afgan, N.H.; Carvalho, M.G.; Hovanov, N.V. Energy system assessment with sustainability indicators. Energy Policy 2000, 28, 603–612. [Google Scholar] [CrossRef]
  38. Harger, J.R.E.; Meyer, F.M. Definition of indicators for environmentally sustainable development. Chemosphere 1996, 33, 1749–1775. [Google Scholar] [CrossRef]
  39. Reisi, M.; Aye, L.; Rajabifard, A.; Ngo, T. Transport sustainability index: Melbourne case study. Ecol. Indic. 2014, 43, 288–296. [Google Scholar] [CrossRef]
  40. Haghshenas, H.; Vaziri, M. Urban sustainable transportation indicators for global comparison. Ecol. Indic. 2012, 15, 115–121. [Google Scholar] [CrossRef]
  41. Li, F.; Liu, X.; Hu, D.; Wang, R.; Yang, W.; Li, D.; Zhao, D. Measurement indicators and an evaluation approach for assessing urban sustainable development: A case study for China’s Jining City. Landsc. Urban Plan. 2019, 90, 134–142. [Google Scholar] [CrossRef]
  42. International Atomic Energy Agency (IAEA); United Nations Department of Economic and Social Affairs (UNDESA); International Energy Agency (IEA); Eurostat; European Environment Agency (EEA). Energy Indicators for Sustainable Development: Methodologies and Guidelines; International Atomic Energy Agency (IAEA): Vienna, Austria, 2005. [Google Scholar]
  43. Chirwa, T.G.; Odhiambo, N.M. Macroeconomic determinants of economic growth: A review of international literature. South East Eur. J. Econ. Bus. 2016, 11, 33–47. [Google Scholar] [CrossRef] [Green Version]
  44. Bleicher, S.A. An Overview of International Environmental Regulation. Ecology 1972, 2, 1–90. [Google Scholar]
  45. Gunningham, N. Enforcing environmental regulation. J. Environ. Law 2011, 23, 169–201. [Google Scholar] [CrossRef] [Green Version]
  46. Schwab, K.; Sala-i-Martin, X. The Global Competitiveness Report 2017–2018; World Economic Forum: Cologny, Switzerland; Geneva, Switzerland, 2017. [Google Scholar]
  47. Forman, E.H.; Gass, S.I. The analytic hierarchy process—An exposition. Oper. Res. 2001, 49, 469–486. [Google Scholar] [CrossRef]
  48. Chai, J.; Liu, J.N.K.; Ngai, E.W.T. Application of decision-making techniques in supplier selection: A systematic review of literature. Expert Syst. Appl. 2013, 40, 3872–3885. [Google Scholar] [CrossRef]
  49. De FSM Russo, R.; Camanho, R. Criteria in AHP: A systematic review of literature. Procedia Comput. Sci. 2015, 55, 1123–1132. [Google Scholar] [CrossRef] [Green Version]
  50. Vaidya, O.S.; Kumar, S. Analytic hierarchy process: An overview of applications. Eur. J. Oper. Res. 2006, 169, 1–29. [Google Scholar] [CrossRef]
  51. Mafakheri, F.; Breton, M.; Ghoniem, A. Supplier selection-order allocation: A two-stage multiple criteria dynamic programming approach. Int. J. Prod. Econ. 2011, 132, 52–57. [Google Scholar] [CrossRef]
  52. Bhattacharya, A.; Geraghty, J.; Young, P. Supplier selection paradigm: An integrated hierarchical QFD methodology under multiple-criteria environment. Appl. Soft Comput. 2010, 10, 1013–1027. [Google Scholar] [CrossRef]
  53. Ishizaka, A.; Pearman, C.; Nemery, P. AHPSort: An AHP-based method for sorting problems. Int. J. Prod. Res. 2012, 50, 4767–4784. [Google Scholar] [CrossRef]
  54. Benítez, J.; Delgado-Galván, X.; Gutiérrez, J.A.; Izquierdo, J. Balancing consistency and expert judgment in AHP. Math. Comput. Model. 2011, 54, 1785–1790. [Google Scholar] [CrossRef]
  55. Wang, Y.M.; Chin, K.S. Fuzzy analytic hierarchy process: A logarithmic fuzzy preference programming methodology. Int. J. Approx. Reason. 2011, 52, 541–553. [Google Scholar] [CrossRef] [Green Version]
  56. Kilincci, O.; Onal, S.A. Fuzzy AHP approach for supplier selection in a washing machine company. Expert Syst. Appl. 2011, 38, 9656–9664. [Google Scholar] [CrossRef]
  57. Haq, A.N.; Kannan, G. Fuzzy analytical hierarchy process for evaluating and selecting a vendor in a supply chain model. Int. J. Adv. Manuf. Technol. 2006, 29, 826–835. [Google Scholar] [CrossRef]
  58. Chamodrakas, I.; Batis, D.; Martakos, D. Supplier selection in electronic marketplaces using satisficing and fuzzy AHP. Expert Syst. Appl. 2010, 37, 490–498. [Google Scholar] [CrossRef]
  59. Chan, F.T.S.; Kumar, N.; Tiwari, M.K.; Lau, H.C.W.; Choy, K.L. Global supplier selection: A fuzzy-AHP approach. Int. J. Prod. Res. 2008, 46, 3825–3857. [Google Scholar] [CrossRef]
  60. Lu, L.Y.; Wu, C.H.; Kuo, T.C. Environmental principles applicable to green supplier evaluation by using multi-objective decision analysis. Int. J. Prod. Res. 2007, 45, 4317–4331. [Google Scholar] [CrossRef]
  61. Yıldırım, B.F.; Yeşilyurt, C. Bulanık analitik hiyerarşi prosesi yaklaşımı ile proje değerlendirme kriterlerinin önceliklendirilmesi: Kalkınma ajansı örneği. Atatürk İletişim Derg. 2014, 6, 23–50. [Google Scholar]
  62. Kahraman, C.; Cebeci, U.; Ulukan, Z. Multi-criteria supplier selection using fuzzy AHP. Logist. Inf. Manag. 2003, 16, 382–394. [Google Scholar] [CrossRef]
  63. He, H. Research on prediction of internet public opinion based on grey system theory and fuzzy neural network. J. Intell. Fuzzy Syst. 2018, 35, 325–332. [Google Scholar] [CrossRef]
  64. Sofyalioğlu, Ç.; Öztürk, Ş. Application of grey relational analysis with fuzzy AHP to FMEA method. Doğuş Üniversitesi Derg. 2012, 13, 114–130. [Google Scholar] [CrossRef]
  65. Mohamed, S.A.N.; Zainudin, E.S.; Sapuan, S.M.; Deros, M.A.M.; Arifin, A.M.T. Integration of taguchi-grey relational analysis technique in parameter process optimization for rice husk composite. BioResources 2009, 14, 1110–1126. [Google Scholar] [CrossRef]
  66. Lin, Y.H.; Lee, P.C.; Chang, T.P. Practical expert diagnosis model based on the grey relational analysis technique. Expert Syst. Appl. 2009, 36, 1523–1528. [Google Scholar] [CrossRef]
  67. Wei, G.W. GRA method for multiple attribute decision making with incomplete weight information in intuitionistic fuzzy setting. Knowl. Based Syst. 2010, 23, 243–247. [Google Scholar] [CrossRef]
  68. Kuo, Y.; Yang, T.; Huang, G.W. The use of grey relational analysis in solving multiple attribute decision-making problems. Comput. Ind. Eng. 2008, 55, 80–93. [Google Scholar] [CrossRef]
  69. Malekpoor, H.; Chalvatzis, K.; Mishra, N.; Mehlawat, M.K.; Zafirakis, D.; Song, M. Integrated grey relational analysis and multi objective grey linear programming for sustainable electricity generation planning. Ann. Oper. Res. 2018, 269, 475–503. [Google Scholar] [CrossRef] [Green Version]
  70. Fang, D.; Shi, S.; Yu, Q. Evaluation of sustainable energy security and an empirical analysis of china. Sustainability 2018, 10, 1685. [Google Scholar] [CrossRef] [Green Version]
  71. Radovanović, M.; Filipović, S.; Pavlović, D. Energy security measurement—A sustainable approach. Renew. Sustain. Energy Rev. 2017, 68, 1020–1032. [Google Scholar] [CrossRef]
  72. Crotti, R.; Misrahi, T. The Travel & Tourism Competitiveness Report 2017 Paving the Way for a More Sustainable and Inclusive Future; World Economic Forum: Cologny, Switzerland; Geneva, Switzerland, 2017. [Google Scholar]
  73. Evans, A.; Strezov, V.; Evans, T.J. Assessment of sustainability indicators for renewable energy technologies. Renew. Sustain. Energy Rev. 2009, 13, 1082–1088. [Google Scholar] [CrossRef]
Table 1. Main pros and cons of an index.
Table 1. Main pros and cons of an index.
ProsCons
supports decision-making by summarizing complex issues may lead to misleading results if poorly constructed
allows assessing progress over time may lead to simplistic policy conclusions
makes benchmarking easier by facilitating the interpretation of the resultsmay require substantial data (depending on the number of sub-indicators)
allows to include more information within the existing size limitinvolves judgement (identification of underlying model, selection of sub-indicators and related weights)
Source: [11,18,19].
Table 2. Issues to be addressed for calculating the dimensions of the overall energy sustainability index (OESI).
Table 2. Issues to be addressed for calculating the dimensions of the overall energy sustainability index (OESI).
DimensionsIssues to Be Addressed
Economic and SecurityThe level of energy consumption
The level of efficiency of energy production and transmission from an economic point of view
The status of the economic condition to provide continuous and adequate energy services
The level of ability to provide continuous energy services without any interruptions (assessed from a source diversification point of view)
EnvironmentalThe impact on the environment of energy-related activities
Environmental law and regulation effectiveness 1
SocialThe level of quality, affordability, and accessibility of energy services
1 Stringency and enforcement of environmental legislations.
Table 3. Criteria for indicator selection.
Table 3. Criteria for indicator selection.
CriteriaBrief Description
SensitivityIndicators should be sensitive to any change in the system in order to reflect the changes [39,40,41].
InterpretabilityIndicators should be clearly defined. They must be understandable and measurable [17,37,39,40,41].
RelevanceIndicators should have relevancy to the sustainability [37].
AccessibilityRelevant data must be available 1 [17,39,40,41].
TimelinessIndicators should be based on timely information [17].
1 Information provided should be relevant to the time.
Table 4. Hierarchical structure of the OESI.
Table 4. Hierarchical structure of the OESI.
DimensionsCriteriaIndicatorsCode
Economic and SecurityEnergy use patterns and diversificationEnergy use per capita IEC1
Energy use per GDPIEC2
Diversification of sources for electricity generationIEC3
Supply efficiencySupply efficiency of electricity generation
Electric power transmission and distribution losses
IEC4
IEC5
Macroeconomic contextEconomic growth rate
Government budget balance
Inflation rate
Government debt
IEC6
IEC7
IEC8
IEC9
EnvironmentalN2O and CH4 emissions N2O emissions from energy processesIEN1
CH4 emissions from energy processesIEN2
CO2 emissionsCO2 emissions from solid fuel combustionIEN3
CO2 emissions from liquid fuel combustionIEN4
CO2 emissions from gaseous fuel combustionIEN5
Environmental regulationsStringency of environmental regulationsIEN6
Enforcement of environmental regulationsIEN7
SocialQuality of supply and equityAccess to electricityISO1
Quality of electricity supplyISO2
AffordabilityAffordability of electricity price for household consumersISO3
Affordability of pump price for diesel fuelISO4
Affordability of pump price for gasoline fuelISO5
Note: Criteria at the first level are referred to as “dimensions”, subcriteria at the second level are referred to as “criteria”, and subcriteria at the third level are referred to as “indicators” for simplifying the representation.
Table 5. Indicators and relevance.
Table 5. Indicators and relevance.
CodeRelevance
IEC1Plays a role in aggregating energy intensity [42].
IEC2Reflects the relationship between economic development and energy use [42].
IEC3The mixture of energy supply is considered as a key determinant of energy security [42].
IEC4
IEC5
Taking steps to improve the efficiency of energy supplies and to reduce losses during transmission contributes to effective utilization of energy resources [42].
IEC6
IEC7
IEC8
IEC9
Macroeconomic stability plays an important role in economic growth, as instability creates uncertainty about future values of economic variables. Since economic development enables the provision of better energy services, macroeconomic conditions of an economy have an effect on the economic dimension [43].
IEN1
IEN2
The amount of N2O and CH4 emissions per capita is considered as an indicator for environmental sustainability [8].
IEN3
IEN4
IEN5
CO2 emissions from combustion of fuels for energy contribute heavily to global warming [6].
IEN6
IEN7
Developing environmental legislation is an important step for the international community to organize itself to take environmental action [44]. Not only the design but also the enforcement of legislation plays an important role for it to “work” [45].
ISO1Access to modern energy services is required to avoid poverty as well as deprivation [42].
ISO2The level of access to electricity supply is considered as an indicator of environmental energy equity [9].
ISO3
ISO4
ISO5
For social development, affordability of modern energy services across the population should be examined [42].
Note: Subindicators used for calculating the level of diversification of sources for electricity generation are excluded.
Table 6. Impacts of indicators.
Table 6. Impacts of indicators.
Larger the Better Smaller the BetterCloser to the Desired Value or Set of Values the Better
IEC1IEC5IEC8 1
IEC2IEC9
IEC3IEN1
IEC4IEN2
IEC6IEN3
IEC7IEN4
IEN6IEN5
IEN7ISO3
ISO1ISO4
ISO2ISO5
1 The desired set of values is determined as the values lying between 0.5% and 2.9% [46].
Table 7. Subindicators for calculating IEC3 (closer to the desired value the better).
Table 7. Subindicators for calculating IEC3 (closer to the desired value the better).
IndicatorsCode
Electricity generation from coal sources 1 ISE1
Electricity generation from oil sources 1 ISE2
Electricity generation from natural gas sources 1 ISE3
Electricity generation from nuclear sources 1 ISE4
Electricity generation from hydroelectric sources 1ISE5
Electricity generation from renewable sources (except hydroelectric) 1ISE6
1 The desired value was determined to be 16.667% (authors’ projection based on World Bank data). Units, and brief descriptions of indicators are presented in Appendix A.
Table 8. Linguistic terms and corresponding triangular fuzzy numbers.
Table 8. Linguistic terms and corresponding triangular fuzzy numbers.
DefinitionFuzzy Triangular Scale M ˜ = ( l , m , u )
equally important(1,1,1)
weakly important(1,3,5)
fairly important(3,5,7)
strongly important(5,7,9)
absolutely important(7,9,9)
Note: All criteria at the same level are compared with each other in the sets of two by using the abovementioned definitions. Therefore, there would be (n2-n)/2 comparisons if there were n criteria at the same level. Fuzzy triangular scale was determined based on the work of Yıldırım and Yeşilyurt [61].
Table 9. Indicator weights.
Table 9. Indicator weights.
IndicatorsWeightsCriteriaWeightsIndicatorsWeights
IEC10.065IEC80.012IEN60.019
IEC20.065IEC90.009IEN70.012
IEC30.111IEN10.033ISO10.063
IEC40.104IEN20.064ISO20.071
IEC50.104IEN30.039ISO30.052
IEC60.02IEN40.039ISO40.015
IEC70.013IEN50.071ISO50.021
Note: Weights indicated in the table are out of 1. Sum of the weights indicated in the table may not be equal to 1 due to fractional rounding.
Table 10. Criteria weights.
Table 10. Criteria weights.
DimensionsWeights (%)CriteriaWeights (%)
Economic and Security50.33Energy use patterns and diversification24.06
Supply efficiency20.81
Macroeconomic context5.46
Environmental27.61N2O and CH4 emissions9.70
CO2 emissions14.84
Environmental regulations3.06
Social22.07Quality of supply and equity18.54
Affordability3.53
Note: Sum of the weights indicated in the table may not be equal to 100 due to fractional rounding.
Table 11. Results of OESI.
Table 11. Results of OESI.
CountriesScore (Total) Rank (Total)Score
(Ec. and Se.) 1
Rank
(Ec. and Se.) 1
Score
(Env.) 2
Rank (Env.) 2Score
(Soc.) 3
Rank (Soc.) 3
Australia0.5482310.2477160.1387350.161722
Austria0.655960.268660.2085110.178715
Belgium0.6076210.2357230.1956240.176317
Canada 0.6174160.25590.1685330.19386
Chile0.6013230.2517130.221440.128132
Czechia0.5893260.2373210.199210.15325
Denmark0.633190.2217310.216360.1955
Estonia0.5655290.2329240.1902270.142428
Finland0.661150.27540.198220.1889
France0.6124180.2197320.2026170.19027
Germany0.6187140.2511140.2005190.167120
Greece0.6244120.279830.210190.134630
Hungary0.5528300.2149340.2083120.129631
Iceland0.806710.377210.239310.19018
Ireland0.5764270.2176330.1892280.169619
Israel0.6183150.2479150.1997200.170718
Italy0.6011240.2416190.2036140.155924
Japan0.635680.2523110.2032150.180113
Korea0.6281110.264970.1843290.178914
Latvia0.5444330.2256290.197230.121733
Luxembourg0.6089200.2425180.1713310.19514
Mexico0.5177350.2233300.2096100.084835
Netherlands0.6163170.2358220.1945260.18611
New Zealand0.644970.2525100.1952250.19723
Norway0.674930.285620.1686320.22071
Poland0.5465320.2302250.1804300.135929
Portugal0.5933250.2276280.221450.144326
Slovakia0.6206130.274250.2037130.142627
Slovenia0.606220.241200.2018180.163321
Spain0.6331100.2680.213770.159423
Sweden0.676420.2519120.237430.187110
Switzerland0.671940.2286270.237920.20552
Turkey0.5331340.2028350.210180.120334
United Kingdom0.6096190.2288260.2029160.177916
United States0.5673280.2432170.1415340.182712
1 Ec. and Se. refers to Economic and Security. 2 Env. refers to Environmental. 3 Soc. refers to Social.
Table 12. Weighted indicator values (economic and security dimension).
Table 12. Weighted indicator values (economic and security dimension).
CountriesIEC1 IEC2IEC3IEC4IEC5IEC6IEC7IEC8IEC9
Australia0.0260.0240.0480.0450.0710.0090.0050.0120.007
Austria0.0240.0230.0580.0620.0710.0080.0050.0120.006
Belgium0.0250.0240.0500.0360.0710.0080.0050.0120.005
Canada 0.0290.0280.0550.0630.0500.0080.0050.0120.005
Chile0.0220.0230.0660.0520.0590.0080.0050.0090.008
Czechia0.0240.0250.0430.0400.0710.0090.0060.0120.007
Denmark0.0220.0220.0460.0350.0640.0090.0050.0110.007
Estonia0.0250.0270.0430.0430.0590.0100.0060.0120.009
Finland0.0270.0270.0680.0430.0800.0090.0050.0110.006
France0.0240.0240.0430.0370.0640.0080.0050.0110.005
Germany0.0240.0230.0540.0390.0800.0090.0060.0110.006
Greece0.0220.0230.1110.0440.0540.0070.0060.0100.004
Hungary0.0220.0230.0600.0370.0410.0090.0050.0110.006
Iceland0.0650.0650.0390.0660.0900.0200.0130.0120.007
Ireland0.0230.0220.0460.0400.0540.0120.0050.0090.006
Israel0.0230.0230.0380.0440.0900.0110.0050.0080.006
Italy0.0220.0220.0690.0430.0590.0080.0050.0090.004
Japan0.0230.0230.0580.0440.0800.0070.0050.0090.003
Korea0.0250.0270.0480.0410.0900.0090.0060.0120.007
Latvia0.0220.0240.0460.0520.0500.0080.0050.0100.008
Luxembourg0.0280.0220.0480.0470.0640.0090.0060.0100.008
Mexico0.0220.0230.0660.0440.0370.0090.0050.0120.006
Netherlands0.0240.0230.0460.0410.0710.0090.0050.0100.006
New Zealand0.0250.0250.0510.0570.0590.0100.0060.0120.008
Norway0.0260.0230.0370.1040.0640.0080.0070.0090.008
Poland0.0220.0240.0430.0440.0640.0100.0050.0120.007
Portugal0.0220.0230.0640.0430.0470.0080.0050.0120.004
Slovakia0.0220.0240.0540.0400.1040.0100.0050.0080.007
Slovenia0.0230.0240.0460.0460.0710.0100.0050.0090.006
Spain0.0220.0230.1000.0390.0470.0100.0040.0090.005
Sweden0.0250.0240.0490.0490.0710.0090.0050.0120.007
Switzerland0.0230.0220.0390.0570.0590.0080.0060.0090.007
Turkey0.0220.0220.0470.0510.0350.0100.0050.0040.008
United Kingdom0.0230.0220.0610.0380.0540.0080.0050.0120.005
United States0.0280.0250.0540.0420.0640.0080.0050.0120.005
Note: Fractional rounding is performed.
Table 13. Weighted indicator values (environmental dimension).
Table 13. Weighted indicator values (environmental dimension).
CountriesIEN1 IEN2IEN3IEN4IEN5IEN6IEN7
Australia0.0180.0280.0190.0220.0300.0130.009
Austria0.0250.0550.0330.0260.0400.0190.011
Belgium0.0280.0590.0340.0240.0330.0120.007
Canada 0.0170.0330.0300.0190.0550.0090.006
Chile0.0330.0540.0320.0290.0590.0080.006
Czechia0.0210.0480.0390.0320.0440.0100.005
Denmark0.0240.0550.0380.0280.0470.0140.010
Estonia0.0240.0430.0130.0390.0530.0110.007
Finland0.0110.0580.0260.0240.0480.0190.012
France0.0290.0460.0360.0280.0470.0100.006
Germany0.0270.0570.0250.0270.0390.0160.009
Greece0.0270.0570.0290.0280.0570.0080.004
Hungary0.0330.0560.0340.0330.0410.0070.004
Iceland0.0310.0640.0340.0220.0710.0110.007
Ireland0.0270.0490.0310.0260.0390.0100.007
Israel0.0320.0580.0270.0290.0400.0080.005
Italy0.0290.0600.0350.0300.0380.0070.004
Japan0.0290.0630.0250.0250.0380.0140.008
Korea0.0280.0580.0200.0270.0380.0080.005
Latvia0.0270.0410.0380.0320.0460.0080.005
Luxembourg0.0190.0540.0370.0130.0280.0130.008
Mexico0.0330.0510.0370.0310.0470.0070.004
Netherlands0.0310.0520.0380.0250.0260.0140.009
New Zealand0.0270.0540.0330.0250.0360.0130.008
Norway0.0280.0210.0360.0200.0360.0170.010
Poland0.0240.0360.0220.0340.0520.0080.004
Portugal0.0300.0580.0340.0300.0530.0110.006
Slovakia0.0270.0570.0290.0350.0410.0090.006
Slovenia0.0270.0460.0300.0270.0540.0110.006
Spain0.0290.0610.0340.0290.0470.0090.006
Sweden0.0220.0590.0350.0270.0650.0190.011
Switzerland0.0300.0580.0390.0270.0530.0190.012
Turkey0.0310.0560.0310.0360.0460.0060.004
United Kingdom0.0320.0550.0310.0290.0360.0110.007
United States0.0160.0420.0220.0190.0240.0110.007
Note: Fractional rounding is performed.
Table 14. Weighted indicator values (social dimension).
Table 14. Weighted indicator values (social dimension).
CountriesISO1 ISO2ISO3ISO4ISO5
Australia0.0630.0360.0350.0120.017
Austria0.0630.0570.0340.0100.014
Belgium0.0630.0540.0340.0110.015
Canada 0.0630.0570.0450.0120.017
Chile0.0390.0430.0260.0090.011
Czechia0.0630.0540.0210.0060.009
Denmark0.0630.0660.0390.0120.016
Estonia0.0630.0380.0260.0070.009
Finland0.0630.0610.0390.0110.015
France0.0630.0660.0380.0100.014
Germany0.0630.0450.0330.0110.015
Greece0.0630.0320.0250.0060.009
Hungary0.0630.0290.0240.0050.008
Iceland0.0630.0610.0420.0100.014
Ireland0.0630.0480.0340.0110.015
Israel0.0630.0510.0370.0090.012
Italy0.0630.0390.0320.0090.013
Japan0.0630.0610.0310.0110.014
Korea0.0630.0510.0420.0100.014
Latvia0.0630.0300.0170.0050.007
Luxembourg0.0630.0610.0420.0120.017
Mexico0.0210.0270.0230.0060.008
Netherlands0.0630.0660.0340.0100.014
New Zealand0.0630.0540.0480.0140.019
Norway0.0630.0710.0520.0150.021
Poland0.0630.0330.0240.0070.010
Portugal0.0630.0450.0200.0070.009
Slovakia0.0630.0410.0240.0060.009
Slovenia0.0630.0510.0300.0080.012
Spain0.0630.0450.0290.0090.013
Sweden0.0630.0570.0400.0110.016
Switzerland0.0630.0710.0430.0120.017
Turkey0.0630.0240.0200.0060.008
United Kingdom0.0630.0610.0310.0100.014
United States0.0630.0450.0440.0130.018
Note: Fractional rounding was performed.

Share and Cite

MDPI and ACS Style

Altintas, K.; Vayvay, O.; Apak, S.; Cobanoglu, E. An Extended GRA Method Integrated with Fuzzy AHP to Construct a Multidimensional Index for Ranking Overall Energy Sustainability Performances. Sustainability 2020, 12, 1602. https://doi.org/10.3390/su12041602

AMA Style

Altintas K, Vayvay O, Apak S, Cobanoglu E. An Extended GRA Method Integrated with Fuzzy AHP to Construct a Multidimensional Index for Ranking Overall Energy Sustainability Performances. Sustainability. 2020; 12(4):1602. https://doi.org/10.3390/su12041602

Chicago/Turabian Style

Altintas, Koray, Ozalp Vayvay, Sinan Apak, and Emine Cobanoglu. 2020. "An Extended GRA Method Integrated with Fuzzy AHP to Construct a Multidimensional Index for Ranking Overall Energy Sustainability Performances" Sustainability 12, no. 4: 1602. https://doi.org/10.3390/su12041602

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop