Next Article in Journal
Mismatch Negativity and Stimulus-Preceding Negativity in Paradigms of Increasing Auditory Complexity: A Possible Role in Predictive Coding
Next Article in Special Issue
Global Sensitivity Analysis Based on Entropy: From Differential Entropy to Alternative Measures
Previous Article in Journal
An Efficient DenseNet-Based Deep Learning Model for Malware Detection
Previous Article in Special Issue
A New Algorithm for Digital Image Encryption Based on Chaos Theory
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Assessing the Europe 2020 Strategy Implementation Using Interval Entropy and Cluster Analysis for Interrelation between Two Groups of Headline Indicators

by
Natalja Kosareva
* and
Aleksandras Krylovas
Department of Mathematical Modelling, Vilnius Gediminas Technical University, Saulėtekio al. 11, 10223 Vilnius, Lithuania
*
Author to whom correspondence should be addressed.
Entropy 2021, 23(3), 345; https://doi.org/10.3390/e23030345
Submission received: 10 February 2021 / Revised: 8 March 2021 / Accepted: 9 March 2021 / Published: 15 March 2021

Abstract

:
The research analyzes the progress of Member States in the implementation of Europe 2020 strategy targets and goals in 2016–2018. Multiple criteria decision-making approaches applied for this task. The set of headline indicators was divided into two logically explained groups. Interval entropy is proposed as an effective tool to make prioritization of headline indicators in separate groups. The sensitivity of the interval entropy is its advantage over classical entropy. Indicator weights were calculated by applying the WEBIRA (weight-balancing indicator ranks accordance) method. The WEBIRA method allows the best harmonization of ranking results according to different criteria groups—this is its advantage over other multiple-criteria methods. Final assessing and ranking of the 28 European Union countries (EU-28) was implemented through the α-cut approach. A k-means clustering procedure was applied to the EU-28 countries by summarizing the ranking results in 2016–2018. Investigation revealed the countries–leaders and countries–outsiders of the Europe 2020 strategy implementation process. It turned out that Sweden, Finland, Denmark, and Austria during the three-year period were the countries that exhibited the greatest progress according to two headline indicator groups’ interrelation. Cluster analysis results are mainly consistent with the EU-28 countries’ categorizations set by other authors.

1. Introduction

Europe 2020 is the EU’s agenda for smart, sustainable, and inclusive growth. The goals are to deliver high levels of employment, productivity, and social cohesion in the Member States while reducing the impact on the natural environment [1]. Ambitious targets in the areas of employment, research and development (R&D), climate change, energy, education, and poverty reduction, to be reached by 2020, were set by the EU. Nine headline indicators show how fast each Member State is reaching overall targets and how much more effort is needed to achieve these targets.
There have been a number of publications on Europe 2020 strategy in the last few years. In many publications, the authors suggest comparable composite indicators to assess the performance of the Member States with respect to implementation of the goals described by the Europe 2020 strategy—see, for example, [2,3,4,5,6,7,8,9,10,11].
Some of the publications pay special attention to the results of individual countries or groups of countries in the implementation of the Europe 2020 strategy. Thus, in [11], diversity between new Member States that joined the European Union in 2004 and 2007 (EU-10) and old European Union Members (EU-15) with special concentration on the situation in the Visegrad Group as the biggest economies of the EU-10, has been analyzed. The aim of [10] was to evaluate and compare the level of regional development in the selected EU countries (Czech Republic, Poland, Slovakia). The emphasis on the southern countries of the European Union is made in [12], on the Baltic states in [13], and on the situation in Poland and Slovakia in [14]. The disparities between the highly developed western countries and south European countries in the level of implementation of the strategy are revealed in [9]. Article [15] focused on levels of competitiveness in EU countries and especially in Slovakia. Heterogeneity gaps and pure performance differences between old and new European members are analyzed in [5].
Some articles do not cover the trends in progress of all headline indicators, but only certain optional indicators have been selected. The authors were interested in these areas of Europe 2020 strategy development: the performance of education systems [3,12], poverty and social exclusion [16], research and development management [14], unemployment [17], resource efficiency [8], issues of the labor market, income disparities and poverty [18], and greenhouse gas emissions [13].
Research methods most often used in articles are as follows: statistical methods [2,9,14,15,17,19,20], multiple-criteria decision making [4,8,10,11], the DEA (data envelopment analysis) method [3,18], and fuzzy goal programming [7].
Multiple-criteria decision-making approach is a convenient methodology in solving problems like this, where alternatives need to be assessed against certain, often conflicting, criteria (indicators). In the study by Fedajev et al. [4], the progress made in achieving the Europe 2020 goals has been evaluated using the MULTIMOORA (the full multiplicative form of multiobjective optimization by a ratio analysis) method and the Shannon Entropy Index. The study period covers 2016. The resource-efficiency capacity index (RECI) proposed in [8], measures the progress of the member states in these three dimensions: (i) transforming the economy, (ii) improving buildings, and (iii) ensuring efficient mobility. The VIKOR (visekriterijumska optimizacija i kompromisno resenje) method elaborated in [10] was used to evaluate and compare the level of regional development in the selected EU countries in the period 2010–2013.
As the evaluation of the Europe 2020 strategy implementation is a multidimensional and multilayered task, the cross-sections of individual evaluation criteria, countries or groups of countries, over different periods, can be assessed. To get a complete picture, the problem needs to be considered from different perspectives.
The intention of the authors of this article is to analyze the data on the Europe 2020 strategy priorities of smart, sustainable, and inclusive growth, divide the set of headline indicators into two logically explained groups (subsets) and rank European countries according to interrelations between two groups of indicators. Europe 2020 headline indicators have been chosen to monitor countries’ progress towards the strategy’s targets. The data on the Europe 2020 headline indicators has been gathered from the Eurostat database (see [21]). Due to the latest data availability, the analysis is based on the time period for the years 2016 to 2018, for which the data for all nine headline indicators are published.
Interval entropy was introduced as an effective tool to make prioritization of headline indicators in separate groups. Interval entropy responds adequately to small changes of initial data. The sensitivity of this method is its advantage compared with classical entropy.
In order to evaluate the weights of headline indicators, the multiple-criteria decision-making approach WEBIRA (weight-balancing indicator ranks accordance) was used. The WEBIRA method requires solving the optimization problem. In the sense of this task, it allows the best harmonization of different groups criteria and this is its advantage over other methods. Note that in this article, the goal function of the optimization task is constructed on the basis of calculated ranks. Therefore, the rankings obtained from the criteria of the different groups should be best matched to each other, compared to other methods that do not formulate such goals.
Final assessing and ranking of the EU-28 countries was implemented through the α-cut approach, which assigns ranks to countries according to the interrelation between two groups of indicators. The results of k-means cluster analysis are generally consistent with results obtained in the research of other authors.
The rest of the article is organized as follows. Section 2 presents an overview of Europe 2020 strategy targets and headline indicators. Section 3 includes decision-making matrices –values of indicators for 2016–2018, the concept of interval entropy, and the WEBIRA method for calculation criteria weights. In Section 4, the main results of the paper are provided. Section 5 is devoted to discussion on the problems considered in the article, while Section 6 includes conclusions and recommendations for future work.

2. Overview of Europe 2020 Strategy Targets and Headline Indicators

There are three mutually reinforcing priorities of smart, sustainable, and inclusive growth defined in the Europe 2020 strategy. The strategy’s targets and goals related to these priorities are as follows:
  • Increasing combined public and private investment in research and development (R&D) to 3% of GDP (gross domestic product);
  • Reducing school drop-out rates to less than 10%;
  • Increasing the share of the population aged 30–34 having completed tertiary education to at least 40%;
  • Reducing greenhouse gas emissions by at least 20% compared to 1990 levels;
  • Increasing the share of renewable energy in final energy consumption to 20%;
  • Moving towards a 20% increase in energy efficiency;
  • Increasing the employment rate of the population aged 20–64 to at least 75%;
  • Lifting at least 20 million people out of the risk of poverty and social exclusion.
Every EU member state declares its own national targets that generally do not coincide with Europe 2020 strategy targets. National targets reflect each country’s economy, energy consumption, innovation, and education levels and are more or less ambitious, but altogether they have to ensure implementation of the Europe 2020 strategy. Europe 2020 headline indicators are divided into five groups: employment; research and development; climate change and energy; education; poverty and social exclusion. Headline indicators C1–C9, their values for EU-28 countries in 2016–2018, and targets to be attained by 2020, are presented in Table 1.
The chart on Figure 1 was drawn using the data given in Table 1. The radar chart shows how far EU-28 countries are from corresponding targets as a percentage of the targets reached. Targets are denoted as red line, and the EU-28 situation in 2018 as blue line. The distance between the blue line and the red line for each indicator shows how far the EU-28 was from the target in 2018. If 2018 data points (blue line) are outside the red line, it means that this target has been exceeded, while data points inside show that progress wasn’t sufficient. Let us notice that targets were exceeded for greenhouse gas emission and tertiary education attainment. Other indicators were not sufficiently improved in 2018. The most significant retardation is noticeable for gross domestic expenditure on research and development (percentage of GDP on R&D), people at risk of poverty and social exclusion and share of renewable energy in gross final energy consumption.
It is worth mentioning that the biggest differences between countries’ targets are for gross domestic expenditure on research and development (minimum 0.5% for Cyprus, maximum 3.76% for Austria) and share of renewable energy in gross final energy consumption (minimum 10% for Malta, maximum 46% for Sweden).

3. Materials and Methods

3.1. Description of the Europe 2020 Headline Indicators

In the calculations below, units of measure for some indicators were changed in order to make data from different countries comparable. Primary energy consumption and final energy consumption (measured in million tonnes of oil equivalent (TOE)) were recalculated to million TOE per capita. Data for people at risk of poverty and social exclusion (measured in millions of people) were recalculated to percent of population.
C1—Employment rate. Unit of measure: percentage of population aged 20 to 64. Employed persons are defined as persons who during the reference week were working at least one hour for pay, or were not working but had jobs from which they were temporarily absent. Paid employment contributes to economic performance, quality of life, and social inclusion. It is a base of socioeconomic development and well-being.
C2—Gross domestic expenditure on research and development. Unit of measure: percentage of gross domestic product. “Research and experimental development (R&D) comprise creative work undertaken on a systematic basis in order to increase the stock of knowledge, including knowledge of man, culture, and society, and the use of this stock of knowledge to devise new applications [22].”
C3—GHG (greenhouse gas) emissions. Unit of measure: index 1990 = 100. The indicator measures total national emissions of greenhouse gases, including carbon dioxide (CO2), methane (CH4), nitrous oxide (N2O), and the so-called F-gases (hydrofluorocarbons, perfluorocarbons, nitrogen trifluoride (NF3), and sulfur hexafluoride (SF6)) from all sectors of the GHG emission inventories. Using each gas’s individual global warming potential (GWP), they are being integrated into a single indicator expressed in units of CO2 equivalents.
C4—Share of renewable energy in gross final energy consumption. Unit of measure: percent. The gross final energy consumption is the energy used by end consumers, plus grid losses and self-consumption of power plants.
C5—Primary energy consumption. Unit of measure: million tonnes of oil equivalent (TOE) per capita. The indicator measures the energy consumption by end users, such as industry, transport, households, services, and agriculture, plus the energy consumption of the energy sector itself for production and transformation of energies, losses occurring during the transformation of energies, and the transmission and distribution losses of energy.
C6—Final energy consumption. Unit of measure: million tonnes of oil equivalent (TOE) per capita. Covers only the energy consumed by end users, such as industry, transport, households, services and agriculture; it excludes energy consumption of the energy sector itself and losses occurring during transformation and distribution of energy.
C7—Early leavers from education and training. Unit of measure: percent of population aged 18 to 24. The share of the population aged 18 to 24 with, at most, lower-secondary education, who were not involved in any education or training during the four weeks preceding the survey. People with a low level of education may not only face greater difficulties in the labor market but also have a higher risk of poverty and social exclusion.
C8—Tertiary education attainment. Unit of measure: percent of population aged 30 to 34. The share of the population aged 30–34 who have successfully completed tertiary studies (e.g., university, higher technical institution, etc.). High levels of education boost productivity, innovation, and competitiveness.
C9—People at risk of poverty and social exclusion. Unit of measure: percent of population. This indicator corresponds to the persons who are: at risk of poverty after social transfers, severely materially deprived, or living in households with very low work intensity.
In Table 2, Table 3 and Table 4, the initial decision-making matrices data—Europe 2020 strategy headline indicator values in 2016–2018—are presented. The main results of the article are provided in Section 3.
Some indicators in our research must be maximized (C1, C2, C4, C8) and others (C3, C5, C6, C7, C9)—minimized. Before applying the WEBIRA method, the set of indicators was divided into two groups. Indicators C3, C4, C5, C6 which describe climate change and energy, i.e., the amount of energy consumed and its structure as well as the exhaust gas emissions, were assigned to the first group X. The remaining indicators C1, C2, C7, C8, C9 describe the social-economic situation of countries and the situation in education. They were assigned to the second group Y.
The next step is data normalization and criteria priority setting in each group. To compare the results with the EU-28 countries ranking results obtained in [4], the same vector normalization formulas for criteria to be maximized (1) and for criteria to be minimized (2) were applied to the initial decision-making matrix data xij:
x ˜ ij = x ij j = 1 m x ij 2   ,   i = 1 , 2 , , n ,   j = 1 , 2 , , m ,
x ˜ ij = 1 x ij j = 1 m x ij 2   ,   i = 1 , 2 , , n ,   j = 1 , 2 , , m .  
Here n = 9 is the number of headline indicators and m = 28 is the number of alternatives (countries). In Table 5, normalized data matrix for 2016 is presented. Normalized data for 2017–2018 are calculated similarly.
Hereinafter, interval entropy is applied to identify the priorities of indicators in each group. Interval entropy indicates strategic priorities where the biggest differences amongst the European countries have been identified.

3.2. The Concept of Interval Entropy

The entropy concept was first introduced in thermodynamics, by the German physicist Rudolf Clausius in 1850 [23], as the measure of a system’s thermal energy per unit temperature that is unavailable for doing useful work. The concept of entropy provides deep insight into the direction of spontaneous change for many everyday phenomena.
In information theory, the entropy of a random variable is the average level of information or uncertainty in the variable’s possible outcomes. The concept of information entropy was introduced by Claude Shannon in 1948 [24].
In 1949 Edward Guggenheim [25], defined entropy as a measure of energy dispersal or spread at a specific temperature.
Now entropy is commonly associated with a state of disorder, randomness, or uncertainty of the system and is widely used in various research fields for solving scientific tasks. Entropy formula, proposed by Shannon, is often used for solving multiple criteria optimization tasks to determine the objective weights of evaluation criteria.
Suppose that:
R = { r 1 ,   r 2 , , r n } ,
p j = P ( R = r j ) ,   0 < p j < 1   ,   j = 1 , 2 , , n , j = 1 n p j = 1
is a source of information (discrete probability distribution) { ( r 1 , p 1 ) , ( r 2 , p 2 ) , , ( r n , p n ) } . The classical measure of the entropy E ( R ) , proposed by Shannon, is determined by the formula:
E ( R ) = j = 1 n p j log p j .
Here log is natural logarithm. The entropy E ( R ) acquires its maximum value E ( R ) = log n , when a source of information is distributed evenly: p 1 = p 2 = = p n = 1 n . Note that the values of r j ,   j = 1 , 2 , , n   are not required for calculation of entropy (3). Suppose that R = { r i ,   i = 1 , 2 , , m } is data array having n different values r i . Let us count how many times each different value r i is repeated, and mark the corresponding frequencies d i : j = 1 n d i = m ,   p i = d i m . The data array R can then be treated as a particular source of information and its entropy calculated according to Formula (3).
When R is a result of certain measurements, the entropy calculated in this way may be sensitive to small changes in the data. For example, data array R 1 = { 0.24 ,   0.25 ,   0.29 ,   0.31 ,   0.32 ,   0.85 ,   0.86 ,   0.87 ,   0.88 ,   0.89 } has all different r i values, therefore d i = 1 ,   p i = 1 10 ,   i = 1 , 2 , , 10 and entropy acquires its maximum value E ( R 1 ) = log 10 2.303 . If the measurement accuracy is ± 0.5 , we round the values and obtain a discrete probability distribution in Table 6:
Entropy in this case will be equal to
E ( R 1 ) = ( 0.2   log 0.2 + 0.3   log 0.3   + 0.3   log 0.3   + 0.2   log 0.2   ) 1.336  
and is significantly lower than E ( R 1 ) : E ( R 1 ) E ( R 1 ) 0.593 .
The idea of the WEBIRA method is to solve optimization problems minimizing disagreement between the weighted sums:
S X ( j ) = i = 1 n x w X i x i ( j ) ,   S Y ( j ) = i = 1 n y w Y i y i ( j ) .
Here x i ( j ) (   y i ( j ) ) denote the normalized response of the alternative j to the criterion i . Weight coefficients w X i ,   w Y i must satisfy inequalities that correspond the identified priorities of indicators:
w X 1 w X 2 w X n x ,   w Y 1 w Y 2 w Y n y   .
So, X 1   is the most important indicator, X n x is the least important indicator in the criteria group X , accordingly Y 1 and Y n y are the most and the least important indicators in the criteria group Y . The priority of indicators x i ,   y i may be determined by external requirements, such as expert estimates. The entropy method sets the importance of criteria x i   and y i in calculating entropies of the sources:
X i = { x i ( 1 ) , x i ( 2 ) , , x i ( m ) } ,   Y i = { y i ( 1 ) , y i ( 2 ) , , y i ( m ) } .
Priorities (4) are set in descending order of entropy values. When all the values of r i ( j )   ,   j = 1 , 2 , , m are different, the classical entropy (3) will acquire maximum value log m . In this case, several optimization tasks need to be addressed and this reduces the effectiveness of the WEBIRA method. This encouraged the authors of this article to modify the entropy calculation algorithm and introduce the notion of interval entropy. Interval [ a , b ] ,   a = min j = 1 , 2 , , m r i ( j ) ,   b = max j = 1 , 2 , , m r i ( j ) is divided into m parts of equal length and frequencies d i calculated. d i   means how many values r j fall into the corresponding interval. It is clear that:
j = 1 m d i = m   .
Denote p i = d i m and calculate entropy by Formula (3). For example, in the case of data source R 1 , we have a division interval length: h = b a m = 0.89 0.24 10 = 0.065 ,   a 0 = a = 0.24 ,   a i = a i 1 + h ,   b   = 0.89 . Intermediate calculations for R 1   are presented in Table 7.
Entropy value is
E ( R 1 ) = ( 0.3   log 0.3 + 0.2   log 0.2   + 0.5   log 0.5   ) 1.030 .  
Note that the entropy calculated in this way can change quite significantly with small changes in the data. This is the shortcoming of classical entropy. For example, the source R 2 = { 0.24 ,   0.25 ,   0.29 ,   0.30 ,   0.32 ,   0.85 ,   0.86 ,   0.87 ,   0.88 ,   0.89 } , which differs from R 1 by only one value at 0.30 instead of 0.31 , and p 1 = 0.4 ,   p 2 = 0.1 , p 3 = 0.5 , so that
E ( R 2 ) = ( 0.4   log 0.4 + 0.1   log 0.1   + 0.5   log 0.5   ) 0.943 .  
In this paper, we define the interval entropy as a function of the interval number k :
E k ( R ) = 1 log k i = 1 k p i log p i ,  
where the values p i = d i n   and frequencies d i ( i = 1 k d i = n ) are defined as before. Note that the values E k ( R ) are normalized by the multiplier 1 log k   and do not depend on the logarithm base. Changing the parameter k of the function (5) allows efficient comparison of different information sources. Let us look at two more examples of information sources:
R 3 = { 0.1 ,   0.2 ,   0.3 ,   0.4 ,   0.5 ,   0.6 ,   0.7 ,   0.8 ,   0.9 , 1.0 } , R 4 = { 0.1 ,   0.16 ,   0.34 ,   0.35 ,   0.57 ,   0.58 ,   0.72 ,   0.73 ,   0.95 , 1.0 } .
When k = 2 , we obtain probability distributions for R 3 and R 4   in Table 8:
E 2 ( R 3 ) = 1.0 ,   E 2 ( R 4 ) = 0.4   log 0.4 + 0.6   log 0.6 log 2 0.971 .
When k = 5 , in Table 9 we get the same frequencies and the same interval entropy values for data sources R3 and R4:
E 5 ( R 3 ) =   E 5 ( R 4 ) = 1.0 .
In the article below, we use the averages of the interval entropies (5) to compare the entropies of the sources X i , Y i :
E 2 , 4 , 8 , 16 ( R ) = 1 4 ( E 2 ( R ) + E 4 ( R ) + E 8 ( R ) + E 16 ( R ) ) ,
E 2 , 4 , 7 , 14 ( R ) = 1 4 ( E 2 ( R ) + E 4 ( R ) + E 7 ( R ) + E 14 ( R ) ) .
When the data is uniformly distributed in an interval, dividing it into 2 , 4 , 8 , etc. parts, each part should have similar data numbers. Thus, the closer the uniform distribution is to the information source data, the higher is the average (6). Since the amount of data in sources X i , Y i   is not large ( m = 28 ), it should be noted that in the case of the uniform distribution, the amount of data in the division intervals should be equal to the divisor of the number ( m = 28 ), i.e., 2 , 4 , 7 , 14 . This is the reason to use both Formulas (6) and (7).

3.3. The Procedure of the WEBIRA Method for Calculating Criteria Weights

There is a wide variety of strategies to calculate criteria weights for solving multiple-criteria decision-making (MCDM) problems. In research [26], systematic review of the methods of determining criteria weights is presented. Two main directions of such strategies are subjective and objective methods of criteria weighting. Subjective methods are based on experts’ evaluations, while objective methods often use entropy. An integrated method is applied in [27] for this purpose.
In this Section, the weight-balancing method WEBIRA is used for calculation of indicator weights. Recall that nine indicators were divided into two groups X and Y . Indicators C 3 , C 4 ,   C 5 ,   C 6 ,   describing the energy consumed and its structure, entered the first criteria group X ; meanwhile, indicators C 1 ,   C 2 ,   C 7 , C 8 ,   C 9 , describing the social–economic levels of countries and the situations in education, were assigned to the second group Y . The initial decision-making matrix is:
R = ( X | Y ) ,   X = ( x i ( j ) ) m × n x ,   Y = ( y i ( j ) ) m × n y ,   n x + n y = n .
Here, m = 28 is the number of alternatives (EU countries); n x = 4 and n y = 5 are the numbers of indicators in the first and second groups correspondingly. We determined weighted sums for each alternative separately for X and Y group indicators:
S X ( j ) = i = 1 n x   w x i x i ( j ) ,   S Y ( j ) = i = 1 n y w y i y i ( j ) ,   j = 1 , 2 , , m ,
and for arbitrary weight vectors:
W X = ( w x 1 , w x 2 , , w xn x ) ,   W Y = ( w y 1 , w y 2 , , w yn y ) ,
satisfying the conditions:
1 w x 1 w x 2 w xn x 0 ,     1 w y 1 w y 2 w yn y 0
and:
i = 1 n x   w x i = i = 1 n y   w y i =   1 .
Weight prioritization in Formula (8) must match the prioritization of indicators, established according to decreasing interval entropy values. For example, in 2017 we have the unique indicator’s prioritization (15); consequently, prioritization of weights may be as follows:
1 w x 4 w x 3 w x 5 w x 6 0 ,     1 w y 8 w y 9 w y 7 w y 2 w y 1 0 .
We denoted R X j ( R Y j ) ,   j = 1 , 2 , , m ranks of alternatives assigned by decreasing weighted sum S X ( j )   ( S Y ( j ) )   values. Our purpose was to calculate weights W X and W Y , which minimize disagreements between two EU countries’ prioritizations: only by X and by Y indicators. In the papers [28,29,30,31] the weights satisfying conditions (8)–(9) were calculated by solving the optimization problem:
S ( W X , W Y ) = min W X , W Y j = 1 m ( S X ( j ) S Y ( j ) ) 2 .
Unfortunately, the goal function (11) is not acceptable for our data due to insufficient sensitivity. In this article, the two-component goal function is applied: sum of the differences of weighted sums’ absolute values, and sum of the differences of ranks, calculated separately in each group of indicators.
F ( W X , W Y ) = min W X , W Y (   1 m   j = 1 m | S X ( j ) S Y ( j ) | + j = 1 m | R X ( j ) R Y ( j ) | ) .

3.4. Algorithm for Criteria Weight Calculation

In this research, the following algorithm is implemented to calculate criteria weights:
(i)
Algorithm parameters are determined:
10 3 < ε < 10 1 , 10 2 < max iter < 10 6 .
(ii)
The initial vector of weights w 0 satisfying conditions (8) is chosen:
w 0 = ( w x ( 1 ) 0 , w x ( 2 ) 0 , , w x ( n x ) 0 ;   w y ( 1 ) 0 , w y ( 2 ) 0 , , w y ( n y ) 0 ) .
(iii)
Randomly selected vector of direction:
Δ w = ( Δ w x ( 1 ) , Δ w x ( 2 ) , , Δ w x ( n x ) ;   Δ w y ( 1 ) , Δ w y ( 2 ) , , Δ w y ( n y ) ) .
(iv)
Vector w 1 = w 0 + ε Δ w is calculated. If it does not satisfy conditions (8), the following corrections must be done:
(a)
If w x , y ( i ) 1 < 0 , change w x , y ( i ) 1 = 0 ;
(b)
w x , y ( i ) 1 < w x , y ( i + 1 ) 1 , change w x , y ( i ) 1 = w x , y ( i + 1 ) 1 ;
(c)
If s = i = 1 n x , n y w x , y ( i ) 1 1 , change w x , y ( i ) 1 = w x , y ( i ) 1 s .
(v)
The number of iterations iter is calculated.
(vi)
If iter > max iter , then the algorithm is finishing calculations.
(vii)
If F(w1) > F(w0) then go to point (iii) of the algorithm, or else assign w0 = w1 and go to point (iii) of the algorithm.

4. Results

4.1. Prioritization of Europe-28 Headline Indicators

Classical entropy values E ( R ) of indicators C 1 C 9 , and interval entropies E 2 ,   E 4 ,   E 7 ,   E 8 ,   E 14 ,   E 16 , as well as their average values E 2 , 4 , 7 , 14 ,   E 2 , 4 , 8 , 16 were calculated using normalized data. The results of calculations for entropies of Europe 2020 headline indicators in 2016 are given in Table 10.
Note that prioritization is calculated separately for the two groups of indicators, X and Y. For 2016 data we obtained two prioritizations. The first one is according to decreasing entropy E 2 , 4 , 8 , 16   values:
X :   C 4 C 3 C 5 C 6 ,   Y :   C 8 C 2 C 1 C 9 C 7 .
Second prioritization has been set according to decreasing entropy E 2 , 4 , 7 , 14   values:
X :   C 4 C 3 C 5 C 6 ,   Y :   C 2 C 8 C 9 C 1 C 7 .
By analogously calculating entropies for 2017 and 2018 data, we obtained the results written in Table 11 and Table 12.
Data in Table 11 for 2017 leads in the unique indicator’s prioritization:
X :   C 4 C 3 C 5 C 6 ,   Y :   C 8 C 9 C 7 C 2 C 1 .
Entropies E 2 , 4 , 8 , 16 and E 2 , 4 , 7 , 14 in Table 12 give two different prioritizations of indicators for 2018, accordingly:
X :   C 3 C 4 C 5 C 6 ,   Y :   C 9 C 2 C 7 C 8 C 1 ,
X :   C 3 C 4 C 5 C 6 ,   Y :   C 9 C 8 C 7 C 2 C 1 .
Note, that in the first group of indicators X , priorities change minimally in subsequent years—with only C 3 and C 4   changing places. So, the main important indicators in group X are C 4 (share of renewable energy in gross final energy consumption) in 2016–2017 and C 3 (greenhouse gas emission) in 2018. In the second group Y the main important are C 8 (tertiary education attainment) in 2016–2017 and C 9 (people at risk of poverty and social exclusion). The main important indicators identify areas with the greatest inequalities between countries.

4.2. Results of Criteria Weight Calculation

The algorithm described in Section 3.4 was applied to the initial decision-making matrices data for 2016–2018 submitted in Table 2, Table 3 and Table 4. Values of indicators were preliminarily normalized by the Formulas (1) and (2). For 2016 data we have two prioritizations. Accordingly, two weight vectors were obtained. The first one matched criteria prioritization (13) according to decreasing entropy E 2 , 4 , 8 , 16   values:
X :   w x 4 w x 3 w x 5 w x 6 ,   Y : w y 8 w y 2 w y 1 w y 9 w y 7 .  
Weight values and the goal function F ( W X , W Y )   value were obtained as follows:
w x 4 = 0.8637 ,   w x 3 = 0.1264 ,   w x 5 = 0.0099 , w x 6 = 0 ; w y 8 = 0.4286 ,   w y 2 = 0.2009 ,   w y 1 = 0.2009 , w y 9 = 0.0848 , w y 7 = 0.0848 ; F ( W X 0 , W Y 0 ) = 224.076686 .
The second solution of the optimization problem (12) corresponds with criteria prioritization (14) according to decreasing entropy E 2 , 4 , 7 , 14   values:
X :   w x 4 w x 3 w x 5 w x 6 ,   Y : w y 2 w y 8 w y 9 w y 1 w y 7 .  
Weight values and the goal function value are:
w x 4 = 0.8173 ,   w x 3 = 0.1816 ,   w x 5 = 0.0011 , w x 6 = 0 ; w y 2 = 0.9290 ,   w y 8 = 0.0182 ,   w y 9 = 0.0182 , w y 1 = 0.0173 , w y 7 = 0.0173 ; F ( W X 0 , W Y 0 ) = 204.109514 .
The goal function value is lower for the second solution, so we choose it as an optimal solution for 2016.
Criteria weight prioritization for 2017 is unique (see (15)):
X :   w x 4 w x 3 w x 5 w x 6 ,   Y : w y 8 w y 9 w y 7 w y 2 w y 1 .  
Weight values and the goal function value are:
w x 4 = 0.6719 ,   w x 3 = 0.3281 ,   w x 5 = 0 , w x 6 = 0 ; w y 8 = 0.4019 ,   w y 9 = 0.1572 ,   w y 7 = 0.1572 , w y 2 = 0.1419 , w y 1 = 0.1419 ; F ( W X 0 , W Y 0 ) = 230.062190 .
There are also two criteria prioritizations for 2018. The weights matching the first prioritization (16) are:
X :   w x 3 w x 4 w x 5 w x 6 ,   Y : w y 9 w y 2 w y 7 w y 8 w y 1 ,
w x 3 = 0.5745 ,   w x 4 = 0.4135 ,   w x 5 = 0.0099 , w x 6 = 0.0021 ; w y 9 = 0.3482 ,   w y 2 = 0.3086 ,   w y 7 = 0.2385 , w y 8 = 0.1042 , w y 1 = 0.0005 ; F ( W X 0 , W Y 0 ) = 220.053163
and the second prioritization (17) are:
X :   w x 3 w x 4 w x 5 w x 6 ,   Y : w y 9 w y 8 w y 7 w y 2 w y 1 ,  
w x 3 = 0.5759 ,   w x 4 = 0.4240 ,   w x 5 = 0.0001 , w x 6 = 0 ; w y 9 = 0.3384 ,   w y 8 = 0.2206 ,   w y 7 = 0.2205 , w y 2 = 0.2205 , w y 1 = 0 ; F ( W X 0 , W Y 0 ) = 228.053106 .
Goal function value is lower for the first solution, so we choose it as an optimal solution for 2018. Table 13 summarizes information about indicator weights that minimize the value of goal function (12).
In 2016–2017, the most informative X group indicator is C4 (share of renewable energy in gross final energy consumption), then goes C3 (greenhouse gas emission). In 2018, C3 and C4 swap places, C3 becomes most informative. The least informative X group indicators in 2016–2018 are C5, C6 (primary energy consumption, final energy consumption).
Y group indicator C2 (gross domestic expenditure on research and development) has the highest priority in 2016, C8 (tertiary education attainment) in 2017, and C9 (people at risk of poverty and social exclusion) in 2018. In most cases, the least important indicators are C1 (employment rate) and C7 (early leavers from education and training).
Note that the distribution of weights is more even in 2017–2018 compared to 2016 when the most informative indicators have extremely high values.

4.3. Ranking the Alternatives

The alternatives ranking procedure was carried out taking into account both ranks assigned to the alternatives in separate groups of indicators X and Y. The α-cuts procedure is elaborated for this purpose.
Suppose that initial decision-making matrix is a concatenation of two matrices X and Y:
R = ( X | Y ) ,   X = ( x i ( j ) ) m × n x ,   Y = ( y i ( j ) ) m × n y ,   n x + n y = n .
Here, m = 28 is the number of alternatives (EU countries); nx and ny are numbers of indicators in the first and second indicator groups. Determine weighted sums
S X ( j ) ( W X 0 ) = i = 1 n x   w x i 0 x i ( j ) ,   S Y ( j ) ( W Y 0 ) = i = 1 n y w y i 0 y i ( j ) ,   j = 1 , 2 , , m ,  
where W X 0 = ( w x 1 0 ,   , w x n x 0 ) and W Y 0 = ( w y 1 0 ,   , w x n y 0 ) are solutions of optimization problem (12) satisfying the conditions (8–9). Let α be a positive number and 0 < α < 1 . Denote A α –the set of alternatives j ( 1 ) ,   j ( 2 ) , , j ( k α ) for which two inequalities are fulfilled:
S X ( j ) ( W X 0 ) α ,   S Y ( j ) ( W Y 0 ) α ,   j A α .
We call A α   the α-cut of the set of alternatives   { 1 , 2 , , m } . The α-cut accumulates the best alternatives, taking into account both groups of indicators. It is clear that A 1 is an empty set. By lowering the threshold α, the number of alternatives that satisfy inequalities (18) increases. Consequently, the number of alternatives in Aα increases. Finally, α-cut A0 contains all m alternatives. Let the initial value of α be equal to 1. By gradually reducing the value of α we will obtain α-cuts containing respectively 1 , 2 , , m alternatives and assign them corresponding ranks. In other words, ranks are assigned to alternatives according to decreasing values of:
min ( S X ( j ) ( W X 0 ) ,   S Y ( j ) ( W Y 0 ) )
The results of the α-cut procedure—ranks of EU-28 countries according to interrelation between indicators of X and Y groups in 2016–2018—are given in Table 14, Table 15 and Table 16. Respective weights ( W X 0 ,   W Y 0 )   solutions of the optimization problem (12) satisfying conditions (8–9) are presented in Table 13. In the third column of Table 14, Table 15 and Table 16, there are countries that enter the α-cut at the respective α level. In 2016 (see Table 14), the first country entering α-cut A 0.3616 is Sweden. Inequalities (18) are satisfied for α = 0.3616. Rank 1 is assigned to this European country. The second country is Austria, having rank 2; this country together with Sweden enters A 0.3477 . Continuing this process in the last step, we include Romania in α-cut A 0.0771 and assign rank 28. This α-cut involves all 28 European countries.

4.4. Countries Clustering Solution

A k-means clustering procedure was applied to the EU-28 countries. Calculations were performed with the help of software package R. In the first experiment, the clustering procedure was applied to nine variables—headline indicators. The obtained result distinguished two clusters of strong and weak countries, and a third cluster was formed from only three countries—Luxembourg, Netherlands, and Belgium. Being economically strong, these countries have not shown a major breakthrough in implementing the Europe 2020 strategy. However, the aim of this study was to create three clusters based on the WEBIRA method of ranking results of European countries and to compare these clusters with the grouping of countries into three groups formed in the study by Fedajev et al. [4]. Therefore, in the second experiment, Member States were clustered by three variables—the WEBIRA ranking results obtained for 2016–2018 presented in the last columns of Table 14, Table 15 and Table 16. This clustering solution is compared with assigning countries to three groups in [4]. In Fedajev et al. [4], with final ranking implemented by the MULTIMOORA method, countries were assigned to the core, semi-periphery, and periphery groups, which are analogues of Clusters 1, 2, and 3. Both clustering results presented in comparison Table 17. In general, countries’ categorization results in [4] coincide with three clusters of k-means clustering (see Table 17). However, there were discrepancies that are marked with a gray background. In current research, Croatia and Lithuania belong to the middle group (Cluster 2), while in [4], these countries are categorized to the core group (Cluster 1). Poland and Ireland belong to the weakest group (Cluster 3) according to our classification and to the semi-periphery group (Cluster 2) by [4]. By summarizing the ranking results in 2016–2018, Germany is in Cluster 1 (the most advanced group) and in Cluster 2 according to [4]. The three-clusters solution obtained by the WEBIRA method is depicted in Figure 2, and the four-clusters solution—in Figure 3. Here we can see three and four clusters against the first two principal components. The first principal component separates very well all three clusters in Figure 2; meanwhile, the second principal component separates well only Cluster 2 from other clusters, but cannot separate Clusters 1 and 3. The four-clusters solution leaves the same clusters of the most advanced and weakest countries and divides the middle cluster into two parts. One part includes the Baltic countries—Estonia, Latvia, Lithuania—and two south European countries—Greece and Portugal (Cluster 4). The second part includes Croatia, Slovakia, Hungary, and the United Kingdom (Cluster 2). Thus, the four-clusters solution confirms the stability of clusters of the strongest and weakest countries.
It is worth mentioning that the first two principal components separate the initial variables very well and accumulate 95.4% of initial data variability. Principal components are linear combinations of the initial variables. The following expressions of the main components were obtained after non-orthogonal oblimin rotation:
F 1 = 0.035 R 2016 + 0.589 R 2017 + 0.473 R 2018 ;
F 2 = 0.973 R 2016 0.136 R 2017 + 0.145 R 2018 .
Here F 1 and F 2 are first two principal components, R 2016 R 2018 are WEBIRA rankings of EU-28 countries. So, variables R 2017 and R 2018 have the highest weights in F 1 ; meanwhile, F 2 consists mainly of variable R 2016 . In Figure 4, variables R 2016 R 2018 are represented in rotated component space. The figure confirms that the first principal component is related to R 2017 and R 2018 , and the second component to the variable R 2018 .

5. Discussion

The set of headline indicators that are the main criteria for evaluating countries was subjectively divided into two logically explained groups. However, in some cases it could be possible to apply objective methods, such as the principal components method, for this purpose. On the other hand, this method is not universal, as it is known that it is not suitable for all data sets. The principal components method is not applicable if correlations between variables are not high enough. In such cases we could not be able to unambiguously assign variables to factors. The same problem has occurred with the Europe 2020 strategy headline indicators for 2016–2018. Attempts to distinguish principal components using headline indicators were unsuccessful.
In this paper, interval entropy has been applied to prioritize indicators within groups. Classical entropy has an undesirable property—after making small changes to the original data, the value of entropy changes drastically. It was shown that interval entropy, unlike classical entropy, responds adequately to small changes in baseline data. This allows the indicators to be prioritized more correctly.
The WEBIRA method was chosen to calculate the weights of the indicators. The WEBIRA method has an advantage in its weight-balancing procedure, that assigns weights to indicators by solving the optimization problem—the difference between ranking results according to both groups of indicators have to be minimized. Consequently, calculated weights minimize disagreement between two EU countries’ prioritizations–only by X and only by Y indicators. There is a wide variety of MCDM methods that can be used to calculate criteria weights. This step is very important in the whole analysis, since the ranking of countries depends crucially on how the weights are assigned.
Traditionally, MCDM methods construct a goal function, which is used to rank countries. In this research, the α -cuts procedure was used for ranking European countries by interdependence between two groups of indicators. This choice, in our opinion, is logical because it takes into account the rankings of countries according to separate groups of indicators, and aggregates and generalizes these results.
Finally, the k-means clustering procedure, based on 2016–2018 ranking results, made it possible to identify groups of countries that had achieved different results in implementing the Europe 2020 strategy. It should be noted that clustering by using the initial variables did not yield a satisfactory result. Despite the choice of a three-cluster solution, almost all countries were classified into two clusters, with only Luxembourg, the Netherlands, and Belgium in the third.
The proposed methodology could be applied to many tasks that require optimization problems according to a heterogeneous set of conflicting criteria. Interval entropy allows more precise ranking of evaluation criteria according to their importance. The α-cuts ranking technology evaluates all alternatives according to the interdependence of several groups of criteria.

6. Conclusions and Future Research

In our study, we raised the objective of ranking European Union member states in the implementation of the Europe 2020 strategy on the basis of the results achieved in 2016–2018 and propose a clustering solution of the countries based on 2016–2018 rankings.
Table 14, Table 15 and Table 16 show the final ranking of European countries according to the interrelation between consumed energy structure and its quantity ( X group of indicators) and social–economic level of countries and situation in education ( Y group of indicators). The rating leaders, Sweden, Austria, Denmark, and Finland, don’t change during the three years 2016–2018. It is obvious that these European countries are distinguished by their responsible approach to the sustainable use of natural resources; these countries are also more successful in solving education system problems and challengers; and their economies are strong. The outsiders of this rating are Cyprus, Romania, Malta, and Bulgaria. In 2016–2018 they were not as successful as other countries in meeting national targets.
Some countries have made significant progress over a three-year period. For example, Croatia’s rank changed from 22nd in 2016, to 10th in 2017, and to 7th in 2018. The Czech Republic’s rank rose from 9th in 2016–2017, to 5th in 2018; Lithuania—from 21st place in 2016 to 5th in 2017, and 10th in 2018. Great progress has been demonstrated by Slovakia: 2016—23rd, 2017—16th, and 2018—8th. But not all countries were such successful. The situation got worse over a three-year period for Ireland, Spain, Italy, and Cyprus. Two countries—new Members of the European Union, Slovenia and the Czech Republic, took their places between leaders in the Europe 2020 strategy implementation. However, Slovenia is lagging on greenhouse gas emission, the Czech Republic on share of renewable energy in gross final energy consumption, and both countries stand behind on gross domestic expenditure on research and development. Considering that there is very little time left until the end of the strategy implementation period, it is doubtful that this indicator can reach the target value of three percent in these countries.
k-means clustering results were compared to formal classification of EU-28 members into three groups: core, semi-periphery, and periphery obtained in [4] (investigation is based on the results in 2016). In general, the classification results are very similar, but there are also discrepancies shown in Table 17.
Looking at the perspective of future research, the authors believe that it would be appropriate to form three groups of logically related indicators instead of two groups: indicators that describe the amount of energy consumed and its structure as well as the exhaust gas emissions; social–economic indicators; and indicators describing the situations in education. It would be interesting to compare the ranking results of European countries for the cases of two and three groups of indicators.
Another possible direction for further research could be the analysis of panel data, when the raw data is treated both as a data frame and as time series data. In this way, it would become possible to model available data sequences and make predictions.
Numerical analysis of three entropy-based methods in [31] revealed that WEBIRA demonstrates higher efficiency comparing to other entropy-based methods. However, we did not perform similar comparative analysis on the WEBIRA and MULTIMOORA methods. Such a study could be carried out in the future work.
In our future research, we are going forward to look for important emerging application areas of our methodology. MCDM methods have a very wide range of applications—in economics, technology, construction, logistics, energy, the supplier/provider/material selection, etc. We plan to adapt our methodology to address public health issues, such as comparing the effectiveness of vaccines, drugs and treatment methodologies.

Author Contributions

Conceptualization, A.K. and N.K.; methodology, A.K. and N.K.; software, A.K.; formal analysis, A.K. and N.K.; investigation, A.K. and N.K.; resources, N.K.; data curation, N.K.; writing—original draft preparation, A.K. and N.K.; writing, review and editing, N.K.; visualization, N.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The authors have used publicly archived Eurostat dataset named Europe 2020 Headline Indicators. The dataset is available at https://ec.europa.eu/eurostat/web/europe-2020-indicators/europe-2020-strategy/main-tables (accessed on 10 January 2021).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Smarter, Greener, More Inclusive? Indicators to Support the Europe 2020 Strategy, Eurostat (European Commission) 2019 edition. Available online: https://op.europa.eu/s/oGP3 (accessed on 15 January 2021).
  2. Landaluce-Calvo, M.I.; Gozalo-Delgado, M. Proposal for a Dynamic Composite Indicator: Application in a Comparative Analysis of Trends in the EU Member States Towards the Europe 2020 Strategy. Soc. Indic. Res. 2020. [Google Scholar] [CrossRef]
  3. Stumbriene, D.; Camanho, A.S.; Jakaitiene, A. The performance of education systems in the light of Europe 2020 strategy. Ann. Oper. Res. 2020, 288, 577–608. [Google Scholar] [CrossRef]
  4. Fedajev, A.; Stanujkic, D.; Karabašević, D.; Brauers, W.K.M.; Zavadskas, E.K. Assessment of progress towards “Europe 2020” strategy targets by using the MULTIMOORA method and the Shannon Entropy Index. JOCP 2020, 244, 118895. [Google Scholar] [CrossRef]
  5. Walheer, B. Disentangling Heterogeneity Gaps and Pure Performance Differences in Composite Indexes over Time: The Case of the Europe 2020 Strategy. Soc. Indic. Res. 2019, 143, 25–45. [Google Scholar] [CrossRef]
  6. Rogge, N. EU countries’ progress towards ‘Europe 2020 strategy targets’. J. Policy Model. 2019, 41, 255–272. [Google Scholar] [CrossRef]
  7. Vié, A.; Colapinto, C.; La Torre, D.; Liuzzi, D. The long-run sustainability of the European Union countries: Assessing the Europe 2020 strategy through a fuzzy goal programming model. Manag. Decis. 2019, 57, 523–542. [Google Scholar] [CrossRef]
  8. Moreno, B.; García-Álvarez, M.T. Measuring the progress towards a resource-efficient European Union under the Europe 2020 strategy. JOCP 2018, 170, 991–1005. [Google Scholar] [CrossRef]
  9. Fura, B.; Wojnar, J.; Kasprzyk, B. Ranking and classification of EU countries regarding their levels of implementation of the Europe 2020 strategy. JOCP 2017, 165, 968–979. [Google Scholar] [CrossRef]
  10. Minarcikova, E. Assessment of regional development in the selected EU countries in the context of Europe 2020 Strategy. In Proceedings of the 18th International Colloquium on Regional Sciences, Hustopece, Czech Republic, 17–19 June 2015; pp. 25–33. [Google Scholar]
  11. Balcerzak, A.P. Europe 2020 Strategy and Structural Diversity between Old and New Member States. Application of Zero Unitarization Method for Dynamic Analysis in the Years 2004–2013. Econ. Sociol. 2015, 8, 190–210. [Google Scholar] [CrossRef]
  12. Spišáková, E.D.; Gontkovičová, B.; Hajduová, Z. Education from the Perspective of the Europe 2020 Strategy: The Case of Southern Countries of the European Union. Econ. Sociol. 2016, 9, 266–278. [Google Scholar] [CrossRef]
  13. Liobikiene, G.; Butkus, M.; Bernatoniene, J. Drivers of greenhouse gas emissions in the Baltic states: Decomposition analysis related to the implementation of Europe 2020 strategy. Renew. Sustain. Energy Rev. 2016, 54, 309–317. [Google Scholar] [CrossRef]
  14. Spisakova, D.E.; Gontkovicova, B.; Majernikova, J. Management of research and development activities in the context of strategy Europe 2020. Pol. J. Manag. Stud. 2018, 10, 21–37. [Google Scholar] [CrossRef]
  15. Dobrovic, J.; Gallo, P.; Mihalcova, B. Competitiveness Measurement in Terms of the Europe 2020 Strategy. J. Compet. 2018, 10, 21–37. [Google Scholar] [CrossRef]
  16. Lafuente, J.Á.; Marco, A.; Monfort, M.; Ordóñez, J. Social Exclusion and Convergence in the EU: An Assessment of the Europe 2020 Strategy. Sustainability 2020, 12, 1843. [Google Scholar] [CrossRef] [Green Version]
  17. Pal’ova, D.; Vejacka, M. Analysis of Employment in EU According to Europe 2020 Strategy Targets. Econ. Sociol. 2018, 11, 96–112. [Google Scholar] [CrossRef] [Green Version]
  18. Stanickova, M. Can the implementation of the Europe 2020 Strategy goals be efficient? The challenge for achieving social equality in the European Union. Equilib. Q. J. Econ. Econ. Policy 2017, 12, 383–398. [Google Scholar] [CrossRef] [Green Version]
  19. Stec, M.; Grzebyk, M. The implementation of the Strategy Europe 2020 objectives in European Union countries: The concept analysis and statistical evaluation. Qual. Quant. 2018, 52, 119–133. [Google Scholar] [CrossRef] [Green Version]
  20. Szymanska, A.; Zalewska, E. Towards the Goals of the Europe 2020 Strategy: Convergence or Divergence of the European Union Countries? Comp. Econ. Res. 2018, 21, 67–82. [Google Scholar] [CrossRef] [Green Version]
  21. Eurostat. Europe 2020 Headline Indicators. Available online: https://ec.europa.eu/eurostat/web/europe-2020-indicators/europe-2020-strategy/main-tables (accessed on 15 January 2021).
  22. Frascati Manual. Proposed Standard Practice for Surveys on Research and Experimental Development. Available online: https://www.oecd-ilibrary.org/science-and-technology/frascati-manual-2002_9789264199040-en (accessed on 15 January 2021).
  23. Clausius, R. Ueber die bewegende Kraft der Wärme und die Gesetze, welche sich daraus für die Wärmelehre selbst ableiten lassen. Ann. Phys. 1850, 155, 368–397. [Google Scholar] [CrossRef]
  24. Shannon, C.E. A Mathematical Theory of Communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar] [CrossRef] [Green Version]
  25. Guggenheim, E.A. Statistical basis of thermodynamics. Res. J. Sci. Appl. 1949, 2, 450–454. [Google Scholar]
  26. Kosareva, N.; Zavadskas, E.K.; Krylovas, A.; Dadelo, S. Entropy-KEMIRA Approach for MCDM Problem Solution in Human Resources Selection Task. IJITDM 2017, 16, 1183–1209. [Google Scholar] [CrossRef]
  27. Dadelo, S.; Turskis, Z.; Zavadskas, E.K.; Kačerauskas, T.; Dadelienė, R. Is the evaluation of the students’ values possible? An integrated approach to determining the weights of students’ personal goals using multiple-criteria methods. EURASIA J. Math. Sci. Technol. Ed. 2016, 12, 2771–2781. [Google Scholar] [CrossRef]
  28. Krylovas, A.; Dadeliene, R.; Kosareva, N.; Dadelo, S. Comparative Evaluation and Ranking of the European Countries Based on the Interdependence between Human Development and Internal Security Indicators. Mathematics 2019, 7, 293. [Google Scholar] [CrossRef] [Green Version]
  29. Krylovas, A.; Kosareva, N.; Dadelo, S. European Countries Ranking and Clustering Solution by Children’s Physical Activity and Human Development Index Using Entropy-Based Methods. Mathematics 2020, 8, 1705. [Google Scholar] [CrossRef]
  30. Krylovas, A.; Kosareva, N.; Dadeliene, R.; Dadelo, S. Evaluation of elite athletes training management efficiency based on multiple criteria measure of conditioning using fewer data. Mathematics 2020, 8, 66. [Google Scholar] [CrossRef] [Green Version]
  31. Krylovas, A.; Kosareva, N.; Zavadskas, E.K. WEBIRA—Comparative Analysis of Weight Balancing Method. IJCCC 2017, 12, 238–253. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Radar chart for EU-28 countries’ Europe 2020 headline indicator values in 2018 and their targets.
Figure 1. Radar chart for EU-28 countries’ Europe 2020 headline indicator values in 2018 and their targets.
Entropy 23 00345 g001
Figure 2. k-means three-clusters solution obtained by the weight-balancing indicator ranks accordance (WEBIRA) method from 2016–2018 European countries’ ranking.
Figure 2. k-means three-clusters solution obtained by the weight-balancing indicator ranks accordance (WEBIRA) method from 2016–2018 European countries’ ranking.
Entropy 23 00345 g002
Figure 3. k-means four-clusters solution obtained by the WEBIRA method from 2016–2018 European countries’ ranking.
Figure 3. k-means four-clusters solution obtained by the WEBIRA method from 2016–2018 European countries’ ranking.
Entropy 23 00345 g003
Figure 4. Variables R 2016 , R 2017 ,   R 2018 in rotated space of principal components F 1 and F 2 .
Figure 4. Variables R 2016 , R 2017 ,   R 2018 in rotated space of principal components F 1 and F 2 .
Entropy 23 00345 g004
Table 1. EU-28 countries Europe 2020 headline indicator values in 2016–2018 and their targets.
Table 1. EU-28 countries Europe 2020 headline indicator values in 2016–2018 and their targets.
Indicator201620172018Target
C1Employment Rate, age group 20–64 (%)71.1072.2073.2075
C2Gross Domestic Expenditure on Research and Development (% of GDP)2.042.082.113
C3Greenhouse Gas Emission, Base Year 1990, Index (1990 = 100)77.9278.3876.7680
C4Share of Renewable Energy in Gross Final Energy Consumption (%)16.99517.47417.9820
C5Primary Energy Consumption (million tonnes of oil equivalent (TOE) )1544.931562.401551.921483
C6Final Energy Consumption (million TOE)1110.021122.931124.141086.00
C7Early Leavers From Education and Training (% of the Population aged 18–24)10.710.510.510
C8Tertiary Education Attainment, Age Group 30–34 (%)39.239.940.740
C9People at Risk of Poverty and Social Exclusion (Million People)118.06112.93109.8796.2
Source: Eurostat (Europe 2020 headline indicators [21]).
Table 2. EU-28 countries’ Europe 2020 headline indicator values in 2016.
Table 2. EU-28 countries’ Europe 2020 headline indicator values in 2016.
C1C2C3C4C5C6C7C8C9
Belgium67.702.5281.968.714.353.228.8045.6020.90
Bulgaria67.700.7758.5218.762.471.3513.8033.8040.40
Czech Republic76.701.6866.0614.933.792.356.6032.8013.30
Denmark76.003.0973.7431.843.082.567.5046.5016.80
Germany78.602.9474.1714.893.622.6410.3033.2019.70
Estonia76.601.2548.9828.684.482.1610.9045.4024.40
Ireland71.401.17113.349.263.092.456.0054.6024.40
Greece56.200.9989.7415.392.121.556.2042.7035.60
Spain63.901.19116.5117.432.571.7719.0040.1027.90
France70.002.2285.4415.683.602.248.8043.7018.20
Croatia61.400.8676.1528.271.921.582.8029.3027.90
Italy61.601.3785.8017.422.441.9113.8026.2030.00
Cyprus68.700.52151.009.862.862.097.6053.4027.70
Latvia73.200.4443.5537.142.181.9410.0042.8028.50
Lithuania75.200.8442.7725.612.091.774.8058.7030.10
Luxembourg70.701.3087.985.447.207.015.5054.6019.80
Hungary71.501.1965.4814.322.411.8112.4033.0026.30
Malta71.100.5783.846.211.581.2919.2032.0020.30
Netherlands77.102.0091.575.833.812.938.0045.7016.70
Austria74.803.12103.0533.373.673.236.9040.1018.00
Poland69.300.9684.5611.272.501.755.2044.6021.90
Portugal70.601.28115.3230.872.101.5714.0034.6025.10
Romania66.300.4846.2925.031.551.1318.5025.6038.80
Slovenia70.102.0194.6921.293.172.364.9044.2018.40
Slovakia69.800.7957.7212.032.831.927.4031.5018.10
Finland73.402.7283.1639.015.914.597.9046.1016.60
Sweden81.203.2576.9953.374.613.257.4051.0018.30
United Kingdom77.501.6663.768.982.742.0511.2048.1022.20
Source: Eurostat (Europe 2020 headline indicators [21]).
Table 3. EU-28 countries’ Europe 2020 headline indicator values in 2017.
Table 3. EU-28 countries’ Europe 2020 headline indicator values in 2017.
C1C2C3C4C5C6C7C8C9
Belgium68.502.6682.149.064.323.188.9045.9020.60
Bulgaria71.300.7460.8818.702.581.3912.7032.8038.90
Czech Republic78.501.7965.5614.803.812.416.7034.2012.20
Denmark76.603.0570.6734.723.112.588.8048.2017.20
Germany79.203.0773.2215.473.612.6510.1034.0019.00
Estonia78.701.2852.2629.134.292.1810.8048.4023.40
Ireland73.001.24113.2910.593.012.455.0054.5022.70
Greece57.801.1393.6216.952.151.566.0043.7034.80
Spain65.501.21121.4917.562.701.8218.3041.2026.60
France70.602.2186.3516.013.582.228.8044.4017.00
Croatia63.600.8678.7127.282.011.673.1028.7026.40
Italy62.301.3785.0518.272.461.9014.0026.9028.90
Cyprus70.800.55155.7510.492.962.198.5055.9025.20
Latvia74.800.5143.9439.022.292.068.6043.8028.20
Lithuania76.000.9043.2426.042.161.885.4058.0029.60
Luxembourg71.501.2790.886.297.267.087.3052.7021.50
Hungary73.301.3368.2513.522.501.8912.5032.1025.60
Malta73.000.5893.457.271.761.3517.7033.5019.30
Netherlands78.001.9890.786.463.812.947.1047.9017.00
Austria75.403.05106.1733.143.743.267.4040.8018.10
Poland70.901.0387.7010.962.611.875.0045.7019.50
Portugal73.401.32123.7830.612.211.6112.6033.5023.30
Romania68.800.5047.3924.451.651.1818.1026.3035.70
Slovenia73.401.8793.4721.063.262.404.3046.4017.10
Slovakia71.100.8959.3111.472.972.059.3034.3016.30
Finland74.202.7379.5940.925.834.598.2044.6015.70
Sweden81.803.3776.5254.204.653.237.7051.3017.70
United Kingdom78.201.6862.709.732.692.0310.6048.2022.00
Source: Eurostat (Europe 2020 headline indicators [21]).
Table 4. EU-28 countries’ Europe 2020 headline indicator values in 2018.
Table 4. EU-28 countries’ Europe 2020 headline indicator values in 2018.
C1C2C3C4C5C6C7C8C9
Belgium69.702.7682.679.424.113.198.6047.6020.00
Bulgaria72.400.7657.1620.532.601.4112.7033.7032.80
Czech Republic79.901.9364.8215.153.812.396.2033.7012.20
Denmark77.503.0370.6935.713.112.5910.4048.4017.00
Germany79.903.1370.4416.483.522.6010.3034.9018.70
Estonia79.501.4049.9830.004.682.2411.3047.2024.40
Ireland74.101.15113.6011.063.012.545.0056.3021.10
Greece59.501.1890.8418.002.091.484.7044.3031.80
Spain67.001.24119.7417.452.671.8617.9042.4026.10
France71.302.2083.1016.593.572.198.7046.2017.40
Croatia65.200.9775.2328.021.991.673.3034.1024.80
Italy63.001.3984.4117.782.431.9314.5027.8027.30
Cyprus73.900.55153.8113.882.952.157.8057.1023.90
Latvia76.800.6445.9540.292.422.168.3042.7028.40
Lithuania77.800.9442.6424.452.251.984.6057.6028.30
Luxembourg72.101.2194.169.067.417.236.3056.2021.90
Hungary74.401.5367.8212.492.501.9012.5033.7019.60
Malta75.500.5796.147.981.721.3917.4034.7019.00
Netherlands79.202.1688.587.393.772.937.3049.4016.70
Austria76.203.17102.6633.433.603.167.3040.7017.50
Poland72.201.2187.4211.282.661.894.8045.7018.90
Portugal75.401.36118.9030.322.201.6411.8033.5021.60
Romania69.900.5046.8423.881.661.2016.4024.6032.50
Slovenia75.401.9594.3521.153.232.414.2042.7016.20
Slovakia72.400.8459.1611.902.902.048.6037.7016.30
Finland76.302.7581.4141.165.984.698.3044.2016.50
Sweden82.403.3275.2854.654.623.167.5051.8018.00
United Kingdom78.701.7061.5911.022.662.0310.7048.8023.10
Source: Eurostat (Europe 2020 headline indicators [21]).
Table 5. Normalized Europe 2020 headline indicators values in 2016.
Table 5. Normalized Europe 2020 headline indicators values in 2016.
C1C2C3C4C5C6C7C8C9
Belgium0.17960.26970.81630.07120.75910.76930.84030.20340.8403
Bulgaria0.17960.08240.86890.15320.86310.90340.74950.15080.6913
Czech Republic0.20350.17980.85200.12190.78980.83160.88020.14630.8984
Denmark0.20160.33060.83480.26000.82940.81640.86390.20750.8716
Germany0.20850.31460.83380.12160.79930.81100.81310.14810.8495
Estonia0.20320.13380.89020.23430.75160.84540.80220.20260.8136
Ireland0.18940.12520.74600.07560.82870.82420.89110.24360.8136
Greece0.14910.10590.79890.12570.88230.88870.88750.19050.7280
Spain0.16950.12730.73890.14230.85770.87320.65510.17890.7868
France0.18570.23760.80860.12810.80030.83950.84030.19500.8609
Croatia0.16290.09200.82940.23090.89360.88650.94920.13070.7868
Italy0.16340.14660.80770.14220.86480.86310.74950.11690.7708
Cyprus0.18230.05560.66160.08050.84130.85060.86210.23820.7884
Latvia0.19420.04710.90240.30330.87930.86100.81850.19100.7823
Lithuania0.19950.08990.90420.20920.88410.87350.91290.26190.7700
Luxembourg0.18760.13910.80290.04440.60090.49790.90020.24360.8487
Hungary0.18970.12730.85330.11690.86620.87010.77490.14720.7991
Malta0.18860.06100.81210.05070.91270.90780.65150.14280.8449
Netherlands0.20460.21400.79480.04760.78860.79000.85480.20390.8724
Austria0.19850.33390.76910.27250.79680.76850.87480.17890.8625
Poland0.18390.10270.81050.09200.86160.87440.90560.19900.8327
Portugal0.18730.13700.74160.25210.88340.88780.74590.15440.8082
Romania0.17590.05140.89630.20440.91410.91940.66420.11420.7036
Slovenia0.18600.21510.78780.17390.82440.83070.91110.19720.8594
Slovakia0.18520.08450.87070.09820.84300.86270.86570.14050.8617
Finland0.19470.29110.81370.31860.67250.67130.85660.20570.8732
Sweden0.21540.34780.82750.43590.74460.76700.86570.22750.8602
United Kingdom0.20560.17760.85710.07340.84830.85350.79670.21460.8304
Source: Author’s calculations.
Table 6. Calculation of interval entropy for data source R1.
Table 6. Calculation of interval entropy for data source R1.
R 1 0.250.300.850.9
d i 2332
p i 0.20.30.30.2
Source: Author’s calculations.
Table 7. Calculation of interval entropy for data source R1.
Table 7. Calculation of interval entropy for data source R1.
[ a i 1 ,   a i ) [ 0.240 ,   0.305 ) [ 0.305 , 0.370 ) [ 0.370 ,   0.435 ) [ 0.435 ,   0.500 ) [ 0.500 ,   0.565 )
d i 3 2 0 0 0
p i 0.3 0.2 0 0 0
[ a i 1 ,   a i ) [ 0.565 ,   0.630 ) [ 0.630 ,   0.695 ) [ 0.695 ,   0.760 ) [ 0.760 ,   0.825 ) [ 0.825 ,   0.890 )
d i 0 0 0 0 5
p i 0 0 0 0 0.5
Source: Author’s calculations.
Table 8. Calculation of interval entropy for data sources R3 and R4 and k = 2.
Table 8. Calculation of interval entropy for data sources R3 and R4 and k = 2.
R3[0.1, 0.55)[0.55, 1.0)
di55
pi0.50.5
R4[0.1, 0.55)[0.55, 1.0)
di46
pi0.40.6
Source: Author’s calculations.
Table 9. Calculation of interval entropy for data sources R3 and R4 and k = 5.
Table 9. Calculation of interval entropy for data sources R3 and R4 and k = 5.
R3, R4[0.1, 0.28)[0.28, 0.46)[0.46, 0.64)[0.64, 0.82)[0.82, 1.0)
di22222
pi0.20.20.20.20.2
Source: Author’s calculations.
Table 10. Entropy values for indicators C1–C9 in 2016.
Table 10. Entropy values for indicators C1–C9 in 2016.
C1C2C3C4C5C6C7C8C9
E(R)0.98510.98511.00000.98511.00000.98510.95540.97030.9703
E20.86310.90590.67690.74960.59170.37120.86310.98520.9059
E40.91470.95090.79950.79900.77630.54920.91470.92250.9337
E70.88610.93430.81660.82140.78200.63570.88530.86870.8977
E80.87870.92200.84200.85050.82550.61580.86070.89350.8401
E140.88770.89660.79440.85020.79480.69240.86620.85820.8653
E160.85930.87130.78640.86280.81360.68150.80860.85170.8356
E2,4,7,140.88790.92190.77190.80500.73620.56210.88230.90860.9007
E2,4,8,160.87900.91250.77620.81550.75180.55440.86180.91320.8788
Source: Author’s calculations.
Table 11. Entropy values for indicators C1–C9 in 2017.
Table 11. Entropy values for indicators C1–C9 in 2017.
C1C2C3C4C5C6C7C8C9
E(R)0.97030.98510.97031.00000.98511.00000.97030.97030.9851
E20.74960.86310.67690.74960.49120.37120.86310.98520.9059
E40.85340.90200.80860.79900.71570.50890.90150.92250.9392
E70.88220.90890.87730.85640.78200.64240.92650.86300.8793
E80.87600.89550.85640.84590.79540.60120.88480.93410.8940
E140.86280.86620.88150.87230.81450.65850.86280.86530.8850
E160.83470.82450.85340.84140.80340.66050.87800.89500.8578
E2,4,7,140.83700.88510.81110.81930.70090.54530.88850.90900.9023
E2,4,8,160.82840.87130.79880.80900.70140.53550.88190.93420.8992
Source: Author’s calculations.
Table 12. Entropy values for indicators C1–C9 in 2018.
Table 12. Entropy values for indicators C1–C9 in 2018.
C1C2C3C4C5C6C7C8C9
E(R)0.95540.98511.00001.00000.98510.98510.95540.94981.0000
E20.74960.94030.67690.67690.59170.37120.90590.96660.9666
E40.86540.96210.79950.7670.76080.50890.94540.90200.9629
E70.89470.93930.85390.85210.76170.63570.94060.98080.9302
E80.88970.87430.84450.82940.76460.59960.89350.87900.9356
E140.87690.87690.85110.85910.78340.65490.93660.88960.9003
E160.87480.87370.85340.83380.75960.67040.84820.80970.8458
E2,4,7,140.84660.92970.79540.78880.72440.54270.93210.93470.9400
E2,4,8,160.84490.91260.79360.77680.71920.53750.89830.88930.9277
Source: Author’s calculations.
Table 13. Indicator weight values and the goal function (12) values for 2016–2018.
Table 13. Indicator weight values and the goal function (12) values for 2016–2018.
2016
Wx4Wx3Wx5Wx6Wy2Wy8Wy9Wy1Wy7 F ( W X 0 , W Y 0 )
0.81730.18160.001100.92900.01820.01820.01730.0173204.109514
2017
Wx4Wx3Wx5Wx6Wy8Wy9Wy7Wy2Wy1 F ( W X 0 , W Y 0 )
0.67190.3281000.40190.15720.15720.14190.1419230.062190
2018
Wx3Wx4Wx5Wx6Wy9Wy2Wy7Wy8Wy1 F ( W X 0 , W Y 0 )
0.57450.41350.00990.00210.34820.30860.23850.10420.0005220.053163
Source: Author’s calculations.
Table 14. α values, α-cuts, and final ranks of European countries for 2016.
Table 14. α values, α-cuts, and final ranks of European countries for 2016.
αAαCountryNoRank
0.361627Sweden271
0.347720,27Austria202
0.34524,20,27Denmark43
0.30824,20,26,27Finland264
0.25244,10,20,26,27France105
0.25174,5,10,20,26,27Germany56
0.23804,5,10,20,24,26,27Slovenia247
0.20721,4,5,10,20,24,26,27Belgium18
0.20481,3,4,5,10,20,24,26,27Czech Republic39
0.20141,3,4,5,10,20,24,26,27,28UK2810
0.18411,3,4,5,10,19,20,24,26,27,28Netherlands1911
0.16811,3,4,5,10,12,19,20,24,26,27,28Italy1212
0.16791,3,4,5,10,12,16,19,20,24,26,27,28Luxembourg1613
0.16091,3,4,5,10,12,16,19,20,22,24,26,27,28Portugal2214
0.16011,3,4,5,6,10,12,16,19,20,22,24,26,27,28Estonia615
0.15421,3,4,5,6,7,10,12,16,19,20,22,24,26,27,28Ireland716
0.15221,3,4,5,6,7,10,12,16,17,19,20,22,24,26,27,28Hungary1717
0.15011,3,4,5,6,7,9,10,12,16,17,19,20,22,24,26,27,28Spain918
0.13301,3,4,5,6,7,8,9,10,12,16,17,19,20,22,24,26,27,28Greece819
0.13301,3,4,5,6,7,8,9,10,12,16,17,19,20,21,22,24,26,27,28Poland2120
0.12151,3,4,5,6,7,8,9,10,12,15,16,17,19,20,21,22,24,26,27,28Lithuania1521
0.12141,3,4,5,6,7,8,9,10,11,12,15,16,17,19,20,21,22,24,26,27,28Croatia1122
0.11501,3,4,5,6,7,8,9,10,11,12,15,16,17,19,20,21,22,24,25,26,27,28Slovakia2523
0.10791,2,3,4,5,6,7,8,9,10,11,12,15,16,17,19,20,21,22,24,25,26,27,28Bulgaria224
0.08921,2,3,4,5,6,7,8,9,10,11,12,15,16,17,18,19,20,21,22,24,25,26,27,28Malta1825
0.08841,2,3,4,5,6,7,8,9,10,11, 12,13,15,16,17,18,19,20,21,22,24,25,26,27,28Cyprus1326
0.07901,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,24,25,26,27,28Latvia1427
0.07711,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28Romania2328
Source: Author’s calculations.
Table 15. α values, α-cuts, and final ranks of European countries for 2017.
Table 15. α values, α-cuts, and final ranks of European countries for 2017.
αAαCountryNoRank
0.440927Sweden271
0.42624,27Denmark42
0.41784,26,27Finland263
0.41564,20,26,27Austria204
0.40554,15,20,26,27Lithuania155
0.38734,6,15,20,26,27Estonia66
0.37394,6,15,20,24,26,27Slovenia247
0.36664,6,14,15,20,24,26,27Latvia148
0.36043,4,6,14,15,20,24,26,27Czech Republic39
0.35933,4,6,11,14,15,20,24,26,27Croatia1110
0.35853,4,5,6,11,14,15,20,24,26,27Germany511
0.35453,4,5,6,11,14,15,20,22,24,26,27Portugal2212
0.35193,4,5,6,10,11,14,15,20,22,24,26,27France1013
0.35183,4,5,6,8,10,11,14,15,20,22,24,26,27Greece814
0.34963,4,5,6,8,10,11,14,15,17,20,22,24,26,27Hungary1715
0.34703,4,5,6,8,10,11,14,15,17,20,22,24,25,26,27Slovakia2516
0.33523,4,5,6,8,10,11,14,15,17,20,22,24,25,26,27,28UK2817
0.33503,4,5,6,8,9,10,11,14,15,17,20,22,24,25,26,27,28Spain918
0.32843,4,5,6,8,9,10,11,12,14,15,17,20,22,24,25,26,27,28Italy1219
0.32402,3,4,5,6,8,9,10,11,12,14,15,17,20,22,24,25,26,27,28Bulgaria220
0.32382,3,4,5,6,8,9,10,11,12,14,15,17,20,21,22,24,25,26,27,28Poland2121
0.31771,2,3,4,5,6,8,9,10,11,12,14,15,17,20,21,22,24,25,26,27,28Belgium122
0.30341,2,3,4,5,6,7,8,9,10,11,12,14,15,17,20,21,22,24,25,26,27,28Ireland723
0.29991,2,3,4,5,6,7,8,9,10,11,12,14,15,17,18,20,21,22,24,25,26,27,28Malta1824
0.29751,2,3,4,5,6,7,8,9,10,11,12,14,15,17,18,19,20,21,22,24,25,26,27,28Netherlands1925
0.29651,2,3,4,5,6,7,8,9,10,11,12,14,15,16,17,18,19,20,21,22,24,25,26,27,28Luxembourg1626
0.29631,2,3,4,5,6,7,8,9,10,11,12,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28Romania2327
0.27241,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28Cyprus1328
Source: Author’s calculations.
Table 16. α values, α-cuts, and final ranks of European countries for 2018.
Table 16. α values, α-cuts, and final ranks of European countries for 2018.
αAαCountryNoRank
0.628927Sweden271
0.608226,27Finland 262
0.60814,26,27Denmark43
0.56184,20,26,27Austria204
0.55063,4,20,26,27Czech Republic35
0.54793,4,5,20,26,27Germany56
0.54553,4,5,11,20,26,27Croatia117
0.54403,4,5,11,20,25,26,27Slovakia258
0.54203,4,5,11,20,25,26,27,28UK289
0.53913,4,5,11,15,20,25,26,27,28Lithuania1510
0.53683,4,5,11,15,17,20,25,26,27,28Hungary1711
0.53283,4,5,11,15,17,20,24,25,26,27,28Slovenia2412
0.53223,4,5,10,11,15,17,20,24,25,26,27,28France1013
0.53023,4,5,6,10,11,15,17,20,24,25,26,27,28Estonia614
0.52863,4,5,6,10,11,15,17,20,22,24,25,26,27,28Portugal2215
0.52783,4,5,6,8,10,11,15,17,20,22,24,25,26,27,28Greece816
0.50993,4,5,6,8,10,11,15,17,20,21,22,24,25,26,27,28Poland2117
0.50901,3,4,5,6,8,10,11,15,17,20,21,22,24,25,26,27,28Belgium118
0.50591,3,4,5,6,8,10,11,14,15,17,20,21,22,24,25,26,27,28Latvia1419
0.49821,3,4,5,6,8,10,11,12,14,15,17,20,21,22,24,25,26,27,28Italy1220
0.49511,3,4,5,6,8,10,11,12,14,15,17,19,20,21,22,24,25,26,27,28Netherlands1921
0.49081,3,4,5,6,8,10,11,12,14,15,16,17,19,20,21,22,24,25,26,27,28Luxembourg1622
0.48821,3,4,5,6,8,9,10,11,12,14,15,16,17,19,20,21,22,24,25,26,27,28Spain923
0.48651,3,4,5,6,8,9,10,11,12,14,15,16,17,18,19,20,21,22,24,25,26,27,28Malta1824
0.47561,3,4,5,6,7,8,9,10,11,12,14,15,16,17,18,19,20,21,22,24,25,26,27,28Ireland725
0.47291,2,3,4,5,6,7,8,9,10,11,12,14,15,16,17,18,19,20,21,22,24,25,26,27,28Bulgaria226
0.44481,2,3,4,5,6,7,8,9,10,11,12,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28Romania2327
0.43361,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28Cyprus1328
Source: Author’s calculations.
Table 17. Comparison of the clustering solution calculated in the current research with the categorization results by Fedajev et al. [4].
Table 17. Comparison of the clustering solution calculated in the current research with the categorization results by Fedajev et al. [4].
Rank 2016Rank 2017Rank 2018Three Clusters
k-Means
Rank
Fedajev et al.
Category
Fedajev et al.
Four Clusters
k-Means
Belgium82218320Periphery3
Bulgaria242026324Periphery3
Czech Republic99519Core1
Denmark32312Core1
Germany6116111Semi-Periphery1
Estonia15614210Semi-Periphery4
Ireland162325319Semi-Periphery3
Greece191416216Semi-Periphery4
Spain181823325Periphery3
France5131318Core1
Croatia2210726Core2
Italy121920322Periphery3
Cyprus262828326Periphery3
Latvia27819212Semi-Periphery4
Lithuania2151024Core4
Luxembourg132622328Periphery3
Hungary171511218Semi-Periphery2
Malta252424327Periphery3
Netherlands112521322Periphery3
Austria24413Core1
Poland202117313Semi-Periphery3
Portugal141215215Semi-Periphery4
Romania282727320Periphery3
Slovenia771215Core1
Slovakia23168217Semi-Periphery2
Finland43217Core1
Sweden11111Core1
UK10179214Semi-Periphery2
Source: Author’s calculations.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kosareva, N.; Krylovas, A. Assessing the Europe 2020 Strategy Implementation Using Interval Entropy and Cluster Analysis for Interrelation between Two Groups of Headline Indicators. Entropy 2021, 23, 345. https://doi.org/10.3390/e23030345

AMA Style

Kosareva N, Krylovas A. Assessing the Europe 2020 Strategy Implementation Using Interval Entropy and Cluster Analysis for Interrelation between Two Groups of Headline Indicators. Entropy. 2021; 23(3):345. https://doi.org/10.3390/e23030345

Chicago/Turabian Style

Kosareva, Natalja, and Aleksandras Krylovas. 2021. "Assessing the Europe 2020 Strategy Implementation Using Interval Entropy and Cluster Analysis for Interrelation between Two Groups of Headline Indicators" Entropy 23, no. 3: 345. https://doi.org/10.3390/e23030345

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop