Next Article in Journal
Interval-Valued General Residuated Lattice-Ordered Groupoids and Expanded Triangle Algebras
Next Article in Special Issue
Use of the WASPAS Method to Select Suitable Helicopters for Aerial Activity Carried Out by the Military Police of the State of Rio de Janeiro
Previous Article in Journal
Existence Results for Generalized Vector Quasi-Equilibrium Problems in Hadamard Manifolds
Previous Article in Special Issue
Efficient Cancelable Template Generation Based on Signcryption and Bio Hash Function
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Improved Multidimensional Quality of Life Index Based on Outranking Relations

by
María Auxiliadora De Vicente Oliva
1 and
Alberto Romero-Ania
2,*
1
Department of Finance Economy and Accounting, Rey Juan Carlos University, Paseo Artilleros s/n, 28032 Madrid, Spain
2
Department of Applied Economics, Rey Juan Carlos University, Paseo Artilleros s/n, 28032 Madrid, Spain
*
Author to whom correspondence should be addressed.
Axioms 2023, 12(1), 41; https://doi.org/10.3390/axioms12010041
Submission received: 30 November 2022 / Revised: 24 December 2022 / Accepted: 26 December 2022 / Published: 30 December 2022

Abstract

:
The aim of this research is to propose an improved multidimensional quality of life index, which could replace the current methodology designed by Eurostat and applied by the national statistical institutes of the European Union member states. The novelty of the proposed index is that it is based on a non-compensatory multicriteria decision method (ELECTRE III). All other quality of life indices propose compensatory aggregation methods at some stage in the construction of the index. The data used in this study are openly available on the website of the INE, which is the Spanish National Statistics Institute, and were obtained by INE from population surveys. The data were entered by the authors in the Diviz software to conduct an ELECTRE III method. Three innovative versions for the multidimensional quality of life index are proposed in this study, which are called Basic ELECTRE, Full ELECTRE, and Full Fuzzy ELECTRE. The comparison of the results obtained by INE with the results provided by our proposals shows that it is possible to construct an improved multidimensional quality of life index to be applied by the member states of the European Union.

1. Introduction

The problem that this research solves is the contradiction, that we have identified, in the multidimensional quality of life index methodology designed by Eurostat [1], and consequently applied by European Union national statistical institutes, such as the INE, which is the Spanish National Statistics Institute [2]. The contradiction in the methodology is due to the aggregation with non-compensation between indicators in the first phase and the aggregation by compensating between dimensions in the second phase. From our point of view, the non-compensatory condition should be respected in both phases.
The purpose of this research is to apply alternative aggregation methodologies for the construction of an improved multidimensional quality of life index, which can replace the current methodology designed by Eurostat and applied by INE. Thus, this is research aims to improve the multidimensional quality of life index used by INE, and, consequently, helps economists and policy makers to better understand the quality of life and to make more accurate decisions. The contribution of this research is to provide a more accurate approach by using “non-compensatory” aggregation methods in both phases (both in the aggregation of indicators and in the aggregation of dimensions). The INE method uses a non-compensatory method for aggregating indicators, but a “compensatory” one (the arithmetic mean) for aggregating dimensions. Although it cannot be said that there is a “perfect” type of aggregation, we believe that it is much better to use a multi-criteria approach that captures the complexity of the phenomenon under study and that does not allow for trade-offs between different criteria.
Multidimensional indices are necessary to understand the quality of life of a society, as well as to compare and rank the well-being of societies and, more importantly, to make informed policy decisions. The idea of multidimensional measurement of quality of life is to be able to aggregate all elements into a single indicator. In this way, a quality of life indicator would be constructed that would make it possible to compare countries, regions, or population groups with each other. By contrast, a sole indicator of well-being, often income or GDP per capita, fails to capture the heterogeneous complexity of human well-being, although it is undoubtedly an indicator that should have an important weight in an aggregate index, as improved socio-economic conditions contribute to higher quality of life [3,4,5]. In fact, it is not only the objective indicators and dimensions that must be considered, but also the subjective dimensions, including subjective indicators such as the individual’s cognitive perception of his or her well-being, level of satisfaction, and assessment of his or her quality of life [6]. Well-being indices, also known as composite indicators of well-being, or indices of quality of life, are indices whose value is created by the aggregation of many indicators. Those indices are easier to understand, present and communicate than the results of all indicators at the same time.
Classifying well-being using a combination of objective and subjective indicators of quality of life, in a single index, is a difficult mission that faces two different problems. On the one hand, the technical complexity of the mathematical models used to create the index, and on the other hand, the problem derived from the subjective decision to weight the indicators according to their relative importance in human well-being, which is always open to discussion and may vary across cultures and time [7,8].
The INE decided to integrate in 2017, within the publication “Quality of Life Indicators” [9], an aggregate indicator of the 9 dimensions. The individual indicators are aggregated into a single indicator for each dimension, using as a synthetic indicator the adjusted Mazziotta-Pareto method (AMPI). In a second phase, the AMPI indicators for each dimension are aggregated into a single quality of life indicator by means of an unweighted arithmetic mean where all dimensions are equally important. The INE allows the user to assign each dimension the importance he/she considers appropriate.
The 9 dimensions calculated by INE are obtained by aggregating a large but limited number of indicators (currently 55). The 9 dimensions are as follows: 1.-Material living conditions; 2.-Work; 3.-Health; 4.-Education; 5.-Leisure and social relations; 6.-Physical and personal safety; 7.-Governance and basic rights; 8.-Environment; and 9.-General experience of life. For each of these 9 dimensions, a series of indicators are chosen, mainly obtained from population surveys, such as the Living Conditions Survey or the Labor Force Survey, which are considered representative of the quality of life in this dimension.
Although it cannot be said that there is a “perfect” type of aggregation, we believe that it is much better to use a multi-criteria approach that captures the complexity of the phenomenon under study and that does not allow for trade-offs between different criteria (allowing e.g., poor health outcomes to be compensated by good environmental sustainability outcomes). Furthermore, although we will not go into the question of weights in depth in our article, both our approach and that presented by the Spanish National Statistics Institute understand weights as parameters that reflect the relative importance of the criteria. Taking this fact into account, [10] concludes that “…the use of non-linear/non-compensatory aggregation rules to construct composite indicators is compulsory for reasons of theoretical consistency when weights with the meaning of importance coefficients are used or when the assumption of preferential independence (where no phenomenon of synergy or conflict can be taken into account) does not hold”.
Specifically, we will use an approach based on ELECTRE methods where the weights are considered as parameters that reflect the intrinsic importance of the criteria and that could even, if necessary, take into account possible interactions between criteria. The problem to be solved is to eliminate the contradiction in the INE (and Eurostat) multidimensional quality of life index methodology in relation to the non-compensatory aggregation between indicators in the first phase and in the compensatory aggregation between dimensions in the second phase. This paper solves this important problem by respecting the no-compensatory condition in the two phases of the index creation.
Our aim, in this article, is to propose alternative aggregation methodologies for the construction of an improved multidimensional quality of life index. In addition, this research aims to demonstrate that it is possible to construct an index that is completely non-compensatory. In this article the authors present three approaches that offer three improved alternatives to the current INE (and Eurostat) procedure: 1.-Basic ELECTRE, 2.-Full ELECTRE, and 3.-Full Fuzzy ELECTRE.
The great novelty is that by applying our methodological proposals it would be possible to obtain, for the first time, non-compensatory European quality of life indexes. It should be borne in mind that, although this research has been carried out based on the methodology and data of INE, the results and conclusions are fully applicable at European level and for all European Union member states, due to the fact that the methodology is designed by Eurostat and is applied in the same way both by INE and by all national statistical offices in all European Union member states. All national statistical offices in EU countries follow Eurostat’s methodological guidelines and apply the same procedure to calculate quality of life indices in each country. However, not all national statistical offices have managed to obtain data for all variables.
Therefore, this study raises the following research question: Can the INE (and Eurostat) multidimensional quality of life index be improved? A priori, the most logical answer to the above research question is the following hypothesis: Yes, the INE (and Eurostat) multidimensional quality of life index can be improved. The above a priori observation is based on the fact that it is apparently not very logical the procedure applied by the statistical office of the European Union, and consequently by the European national statistical institutes, such as the INE. The contradiction of the model applied by Eurostat and INE is that this procedure respects in the first phase of aggregation the non-compensation between indicators, and in the second phase it aggregates data by compensating between dimensions.
The rest of this paper is organized as follows. Section 2 shows the literature review. Section 3 presents the data source and methodology, which include the INE methodology and our reasoning and formulations to improve it. Section 4 is dedicated to compare the results obtained by INE with the results provided by our research, including a comparative summary between the ranking obtained based on the scores given to each Autonomous Regions by the INE and the rankings obtained using our three innovative methodologies: Basic ELECTRE, Full ELECTRE, and Full Fuzzy ELECTRE. Section 5 is devoted to discussing why and how our methodological innovation improves the current INE (and Eurostat) methodology, and at drawing some conclusions, including the identification of specific lines of future research.

2. Literature Review

A systematic literature review on the concept of quality of life shows that it has been largely studied not only by economists and mathematicians, but also by philosophers due to inherent moral debate on selecting and weighting well-being indicators [11,12,13].
The mainstream literature in this field of study defends the suitability of the use of multidimensional indicators and perspective on the notion of well-being [14,15,16,17].
However, as can be seen in the following proposals, there is no unanimity as to which indicators should be included. Ref. [18] states that happiness and overall life satisfaction are affected by many aspects of life, such as health, employment, material resources and marital status. According to [19], social welfare, political affairs, education, and medical services are more suitable for assessing quality of life as a whole. Ref. [20] measured well-being with affective and cognitive indicators, including the use of four items (happy, sad, angry, and afraid) as an affective measure of well-being.
There is a wide range of multidimensional quality of life index methodologies [21] depending on criteria related to three elements of design: the dimensions and indicators selected, the methodology of aggregation, and the relative weights assigned to each dimension and indicator [14].
The Stiglitz-Sen-Fitoussi report [22] clearly recommends the construction of an aggregate indicator but does not go so far as to propose one. What it suggests is that statistical offices work together and reach a consensus.
Several aggregate indicators are already being constructed in academia. In the field of international organizations, the United Nations’ Human Development Index (HDI) [23] is worth mentioning, although perhaps the best example is the OECD’s Better Life Index [24]. In the OECD Well-being Framework, current well-being is comprised of 11 dimensions. These dimensions relate to material conditions that shape people’s economic options (Income and Wealth, Housing, Work and Job Quality) and quality of life factors that encompass how well people are (and how well they feel they are), what they know and can do, and how healthy and safe their places of living are (Health, Knowledge and Skills, Environmental Quality, Subjective Well-being, Safety). Quality of life also encompasses how connected and engaged people are, and how and with whom they spend their time (Work-Life Balance, Social Connections, Civic Engagement). After constructing these 11 dimensions, the next step should be to aggregate them into a single indicator. This step is left to the user’s discretion by proposing to use a weighted arithmetic mean where the weights would take values from 1 to 5.
If we stick to the European level, the European Statistical Office (Eurostat) has not yet constructed any aggregate indicators. Aggregation, as we have seen in the case of the OECD index, should be carried out in two steps: first by aggregating the indicators for each dimension and then by aggregating the different dimensions into a single quality of life indicator.
Most multidimensional well-being indices use aggregators such as Factor Analysis or Principal Component Analysis, such as [25,26]. Some other studies introduce fuzzy set theory [27] or other methods such as geometric benefit-of-the-doubt (BoD)-method [28].
But, out of the many aggregation methodologies that exist on the subject, one of the most widely used, for the construction of aggregate indices in multidimensional social phenomena such as quality of life, is the Mazziota-Pareto method (MPI), developed by the authors of ISTAT (Italian Statistical Institute). A variation of MPI has been used as aggregation method in recent experiments by the OECD; this variation is the adjusted Mazziota-Pareto method (AMPI) [29].
In relation to composite indicators, it should be taken into consideration that a composite indicator is an aggregate of all dimensions, objectives, individual indicators and variables used for its construction. This implies that what defines a composite indicator is the set of properties underlying its mathematical aggregation convention” [10].
In relation to the reliability of composite indicators, it should also be taken into consideration if the uncertainty in single indicators affect the reliability of composite indexes [30]. In the literature on social indicators (including welfare indices) there have been traditionally two distinct fields: aggregators versus non-aggregators. The first group supports the construction of synthetic indices to describe an overall complex phenomenon. The second group opposes it, claiming that the final product is statistically meaningless. Nowadays, synthetic (or composite) indicators resulting from aggregation of variables are the most widely used and the ways of constructing them are very diverse. A fundamental article to know the methodologies used in the construction of the synthetic indicators is [31]. This article re-examines the literature focusing on the methodological framework of composite indicators. The steps that are the focus of the paramount criticism as well as the recent development in the construction of aggregate indicators are weighting and aggregation. In [31] a final step is also added that is beginning to be discussed: robustness.
In our article we will focus primarily on aggregation of composite indicators. According to the latest handbook on constructing composite indices, aggregation methods may be divided into three distinctive categories: linear, geometric, and multi-criteria [32]. Another type of categorization of the aggregation methods in the literature is between ‘compensatory’ and ‘non-compensatory’ approaches [33].
We will use a multi-criteria, non-compensatory approach in the construction of our index. As noted in [31]: “Despite its desirable properties, judging from the number of applications existing in this literature, the non-compensatory multi-criteria approach is not met hugely popular. This could be attributed to the simplicity of construction of other methods (e.g., linear or geometric aggregation) or the issue of being computationally costly to calculate. [33] urge developers to reflect on the cost of oversimplification that other techniques bear (e.g., linear), and, whenever possible, to use non-compensatory multi-criteria approaches”.
It is apparent from the latest publications that, after a vast number of suggestions in the literature, there is a shift towards the spectrum of non-compensatory approaches. Ref. [29] applies this approach to the measurement of socio-economic phenomena. However, there is still no agreed multidimensional (or multi-criteria) and non-compensatory index of quality of life in the social indicators’ literature [34].
Recent studies have proposed models for analyzing composite indicators based on MCDM. In this area of research, a number of different computer programmes are used. Among them, the SOCRATES (SOcial multi-CRiteria AssessmenT of European policieS) software stands out as a software tool designed explicitly for impact assessment problems [35]. The Table 1 shows selected studies on composite indicators based on MCDM.
Table 2 shows selected literature review on papers on MCDM and computational intelligence, whereas Table 3 shows research papers using MCDM and computational intelligence to build composite indicators.
The above literature review discussion shows a research gap to consider. The novelty of our contribution is precisely to present, for the first time, an article dedicated to proposing a multidimensional index of quality of life that is completely non-compensatory.

3. Methodology and Data

The quality of life index that we propose is an improvement on the INE’s multidimensional quality of life index. In order to understand the process of constructing our index (in fact the three versions of the index that are proposed) it is necessary to begin by presenting which parts of the INE index are maintained and which are the variations introduced.
The information used for the construction of our index is the same as that used by the INE. Initially, it consists of 55 indicators, which are then grouped into 9 dimensions.
The INE aggregates the indicators in two stages [49]:
  • The elementary indicators of each dimension are aggregated into a single indicator representative of the dimension using the AMPI method, hence they are called AMPI indicators.
  • The 9 indicators are aggregated into a single MQLI by weighted arithmetic mean, by default with equal weights. Although they are weighted by default with equal weights, the application allows the user to vary the relative weight of each dimension.
The first part of this section presents the indicators used. This is followed by an explanation of the INE dimensions as well as the dimensions we will use in the different variations of our index. Together with the explanation of the dimensions, we also show the hierarchical relationship between indicators and dimensions, both in the case of the INE and in our proposed variations of the index. This is followed by an analysis of the weaknesses of the INE index and our proposal with the variations of our index. The final sections are devoted to the methods used in the study (Adjusted Mazziotta-Pareto Method (AMPI) and ELECTRE III), ending with a reference to the source and justification of the data used.

3.1. Indicators

There are 55 indicators used to compose the MQLI are all taken from the INE publication Indicators of Quality of Life (QLI) [2]. Not all indicators that appear in the QLI publication are included in the calculation of the MQLI. Some indicators are very similar to each other and only one of them is chosen as representative (for example, between average and median income, only the latter is taken).
On the other hand, not all indicators are available every year. The most extreme case is the governance and basic rights dimension for which there is not really a time series as there is currently only data for 2013. Another relevant case is that of “General experience of life” where the most recent data are from 2018. The 9 dimensions and 55 indicators used by INE are listed in Appendix A Table A1 [9,49].

3.2. Dimensions

The INE aggregate the 55 indicators into 9 dimensions. These 9 dimensions in the second phase are aggregated into 1 index.
The 9 dimensions resulting from aggregating groups of indicators are:
  • Dimension 1. Material living conditions
  • Dimension 2. Work
  • Dimension 3. Health
  • Dimension 4. Education
  • Dimension 5. Leisure and social relations
  • Dimension 6. Physical and personal security
  • Dimension 7. Governance and basic rights
  • Dimension 8. Environment
  • Dimension 9. Overall experience of life
The Figure 1 shows which indicators define each of the nine dimensions.
In the case of the INE, the dimensions are obtained by aggregating elementary indicators with the Mazziota-Pareto method.
In our case, the dimensions will be obtained in the same way as the INE does in the variation of the index called BASIC ELECTRE. In the case of FULL ELECTRE and FULL FUZZY ELECTRE, the dimensions are obtained by aggregating the same elementary indicators but through the ELECTRE method.
As mentioned above, the INE aggregates the dimensions through an arithmetic mean. We will always aggregate the dimensions through an ELECTRE III.

3.3. The Weaknesses of the INE Index and Our Proposal for a Multidimensional Quality of Life Index

The main characteristics of the Mazziota-Pareto method applied to multidimensional phenomena are based on the aggregation of indicators that are not substitutable with each other, all with the same relevance in the phenomenon analyzed, and which do not compensate each other (a low value in one indicator is not compensated by a high value in another).
The INE points out that, the AMPI method is only one of the possible methods for aggregating, being the choice of one method or another arbitrary. Moreover, INE implicitly weights all the dimensions equally, which is also arbitrary.
From our point of view, there are two debatable aspects in the construction of the multidimensional quality of life index proposed by the INE:
  • The methodology proposed for the aggregation of the 9 dimensions, the arithmetic mean, since it is a compensatory method, unlike the aggregator used in the first phase which was non-compensatory (AMPI method). The “non-compensatory” condition should be respected in both phases.
  • The weighting of the dimensions. Although, as mentioned in the INE document itself, the weighting must be “subjective”, a method must be proposed that can incorporate as closely as possible the importance that the user attaches to each dimension. It should be borne in mind here that the user is not always able to assign a numerical value that faithfully represents the relative importance of the dimensions.
Our aim, in this article, is to propose an aggregation methodology for the construction of the multidimensional quality of life index (MIQL) that is non-compensatory, in coherence with the non-compensatory character of the AMPI method used in the first phase of aggregation.
Specifically, we propose the following three variations of the multidimensional quality of life index:
  • BASIC ELECTRE: To use the AMPI method to aggregate elementary indicators into 9 dimensions. To use ELECTRE III to create a ranking that allows us to compare Autonomous Regions. Figure 2 shows the first variation that we propose: BASIC ELECTRE Index.
  • FULL ELECTRE: To use ELECTRE III to aggregate indicators in the first phase and again ELECTRE III to aggregate the 9 dimensions resulting from the first phase to create a final index in the form of a ranking. Figure 3 shows the second variation that we propose: FULL ELECTRE Index.
  • FULL FUZZY ELECTRE: To use ELECTRE III to aggregate indicators in the first phase and again ELECTRE III to aggregate the 9 dimensions resulting from the first phase to create a final index in the form of a ranking. The difference between this index and FULL ELECTRE is that thresholds are introduced when aggregating indicators (this will be explained later). Figure 4 shows the third variation that we propose: FULL FUZZY ELECTRE Index
The data were entered by authors into the Diviz software [50,51,52,53] to conduct an ELECTRE III method. The reason to choose the ELECTRE III method to implement the application of a multicriteria decision-making (MCDM) technique in the three innovative methodologies that we propose, is that it is most suitable technique for outranking relations that deal with ranking problematic [54].
We will present the results obtained with our proposal and compare them with those obtained by INE. Precisely, to make a direct comparison with the INE results, we will not introduce weights for the dimensions (all nine dimensions will have the same weight) and we will compare our results with the one from INE.
The question of how to weight the nine dimensions, as well as whether the initial indicators should also be weighted, is of course a problem that remains to be solved. A large part of the problem lies in whether such weights should be consensual or whether complete subjectivity should be allowed.

3.3.1. The Adjusted Mazziotta-Pareto Method (AMPI)

As it has been stated by INE [49], the Mazziota-Pareto method consists of the following steps:

Standardization

Given the matrix X = x i j with n rows and m columns.
The normalised matrix Z = z i j is calculated. Where indicator j has mean 100 and standard deviation 10:
Z i j = 100 ± X i j M x j S x j 10
where M x j and S x j   are the mean and standard deviation of indicator j. The sign ± will depend on the relationship of indicator j to the phenomenon to be measured (+ in the case of indicator j will depend on the relationship of indicator j to the phenomenon to be measured (+ if the indicator represents a positive change and—if it represents a negative change).

Aggregation

Let c v i the coefficient of variation of the standardised values of the indicators j = 1 , , m in statistical unit i , M z j and S z j be the mean and standard deviation of the standardized values of the indicators j = 1 , , m in statistical unit i . The generalized form of the MPI is:
M P I i + / = M z i 1 ± c v i 2 = M z i ± S z i 2 M z i = M z i ± s Z i c v i
The ± sign depends on the type of phenomenon to be measured. If the composite index measures a positive phenomenon, i.e., increasing values of the index correspond to positive variations of the phenomenon M P I + is used. On the contrary, if the composite index measures a negative phenomenon, i.e., increasing values of the index correspond to increases of the negative phenomenon (e.g., increased poverty), M P I is used.
The Mazziotta Pareto method is recommended for single-year analyses. Subsequently, the same authors developed an adjusted version of the MPI method, called AMPI (Adjusted Mazziotta Pareto Index) which allows for spatial and/or temporal comparisons.
The Adjusted Mazziotta-Pareto Index (AMPI) is an adjustment of the Mazziotta Pareto method, beforehand explained, to allow comparisons in space and/or time.
To be able to make absolute comparisons over a period of time we need a re-scaling of the values of each of the indicators with respect to two benchmarks to two reference points: the “maximum value” and the “minimum value”, which represents the range of each variable in all periods of time and in all statistical units.
The steps for the calculation of the AMPI are as follows:
Given the matrix X = x i j with n rows (statistical units) and m columns (indicators), the normalized matrix R = r i j is calculated:
r i j = x i j M i n x j M a x x j M i n x j 60 + 70
where x i j is the value of indicator j for unit i   and M i n x j   and M a x x j are the extreme reference points of indicator j . If indicator j has a negative polarity, the complement of r i j with respect to 200 is applied. The range of the normalized values is (70; 130). This range can be changed to (85; 115).
Where M r i and S r i are the mean and standard deviation of the normalized values of unit i , the generalized form of the adjusted MPI is M P I i + / = M r i ± S r i c v i where c v i = S r i M r i is the coefficient of variation of unit i . The sign ± depends on the type of phenomenon to be measured as detailed in the MPI method.
This method allows comparisons to be made over time, between dimensions and between groups (by sex, age, by Autonomous Community). The results are obtained on a relative scale relative to a reference value of 100. In particular, the AMPI indicators chosen for the construction of the MQLI are calculated taking as a range the values (85; 115) and taking 2008 as the base year. As a first approximation, it is calculated only by Autonomous Community.

3.4. ELECTRE III

ELECTRE III is a method based on outranking relations that deals with ranking problematic. The goal is to propose a ranking of alternatives (Autonomous Regions in our case) ordered from best to worst by means or pairwise comparisons [55].
Let A = A 1 , , A m be the set of alternatives.
Let C = C 1 , , C n be a coherent family of criteria.
Let g i a j be the value of the criterion g i for the alternative a j .
Let w i be the weight of the criterion C i .
An outranking relation, where alternative a outranks alternative b (denoted by a S b), expresses the fact that there are sufficient arguments to decide whether a is at least as good as b and there are no essential reasons to refute this. An outranking degree S(a,b) between a and b will be computed in order to ‘measure’ or to ‘evaluate’ this assertion. Outranking relations are based on binary relations. Three basics binary relations are considered: preference, indifference (ELECTRE III considers that indifference is not necessarily transitive), and incomparability.
If we consider two alternatives a and b, four situations may occur:
Numbered lists can be added as follows:
  • aSb and not bSa, i.e., aPb (a is strictly preferred to b);
  • bSa and not aSb, i.e., bPa (b is strictly preferred to a);
  • aSb and bSa, i.e., aIb (a is indifferent to b);
  • Not aSb and not bSa, i.e., aRb (a is incomparable to b).
ELECTRE methods are built on the basis of two principles: the principle of concordance and the principle of discordance with an assertion given. The concordance principle states that if a is demonstrably as good as or better than b according to a sufficiently large weight of criteria, then this is considered to be evidence in favour of a outranking b. The discordance principle states that if b is very strongly preferred to a on one or more criteria, then this is considered to be evidence against a outranking b.
In a first phase ELECTRE III constructs the outranking relationship between the alternatives. In a second phase ELECTRE III exploits the outranking relation constructed before.
To construct the outranking relationship, ELECTRE III uses different kind of parameters to model intra and inter criteria information. The inter criteria information is contained into the weights of criteria. The intra criteria information models decision-maker’s preferences, these parameters are the preference, indifference, and veto thresholds. Criteria can be increasing or decreasing. In what follows, and without lack of generality, we will consider the criteria to be increasing.
The indifference threshold indicates the largest difference between the alternatives’ performances on a given criterion that makes the two performances indifferent to the decision-maker. Let q i be the indifference threshold for criterion i. Alternative b is weakly preferred to alternative a in terms of criterion i if g i b > g i a + q i   g i a .
The preference threshold indicates the largest difference between the performances of the two alternatives such that one is preferred over the other for the criterion under consideration. Let p i be the preference threshold for criterion i. Alternative b is strictly preferred to alternative a in terms of criterion i if g i b > g i a + p i g i a .
The veto threshold for a criterion is the difference between the performances of the two alternatives above which it seems reasonable to reject any credibility about the outranking of one alternative by the other alternative, even when all other criteria are in line with this outranking. Let v i be the veto threshold for criterion i. Alternative a cannot outrank alternative b if the performance of b exceeds that of a by an amount greater than the veto threshold, i.e., if g i b g i a + v i g j a .
ELECTRE III constructs a partial concordance index per criterion. Next, an overall concordance index and a discordance index are defined. The credibility index is then calculated based on the above two indices.
Below we specify what each of the indices introduced above measures:
  • Partial Concordance index measures the strength of support, given the available evidence, that a is at least as good as b considering criteria one specific criterion;
  • Global Concordance index measures the strength of support, given the available evidence, that a is at least as good as b considering criteria all criteria;
  • Discordance index measures, for each criterion, the strength of the evidence against the hypothesis that a is at least as good as b. Credibility index measures the strength of the claim that “alternative a is at least as good as alternative b”.
The decision-maker must provide information relative to the value of the parameters that represent the indifference q i , preference p i , and veto v i thresholds, and the weight of each criterion w i .
These values allow the calculation of the partial concordance, overall concordance, and discordance indices, as well as the credibility index.
Partial concordance index per each criterion i :
C i a , b = 0 ,   i f   g i b g i a + p i g i a 1 ,   i f   g i b g i a + q i g i a g i a + p i g i a g i b p i g i a q i g i a ,   o t h e r w i s e
Global concordance index:
C a , b = w i C i a , b w i
Discordance index for each criterion:
D i a , b = 0 ,   i f   g i b g i a + p i g i a 1 ,   i f   g i b g i a + v i g i a g i b g i a p i g i a v i g i a p i g i a ,   o t h e r w i s e
If no veto threshold v i is specified, D i a , b = 0 for all pairs of alternatives.
Credibility index:
S a , b = C a , b ,   i f   D i a , b C a , b i C a , b D i a , b > C a , b 1 D i a , b 1 C a , b ,   o t h e r w i s e
If no veto threshold v i is specified, S(a,b) = C(a,b) for all pairs of alternatives.
Once the credibility index has been calculated, the second phase of ELECTRE III, the exploitation phase of the outranking relations, can be moved on. This phase consists of the exploitation of the pairwise outranking indices through bottom-up and top-down distillations.
Each one of the distillation procedures calculate a complete pre-order where each pre-order takes into account the behaviour of each alternative when outranking or being outranked by the other alternatives. These two distillations can lead to two different complete pre-orders. The final partial pre-order is obtained as the intersection of these two complete pre-orders [56].

3.5. Data

The data used in this study are openly available at the webpage of the INE and were obtained by INE from population surveys [2]. The latest available data, prior to the start of the confinement in Spain due to the COVID-19 pandemic, have been used, being these data corresponding to the year 2019. It has been considered that in March 2020 there was a turning point in quality of life due to a temporary issue that significantly affected quality of life, so that, although data for 2020 are available, no conclusions can be drawn for 2020, and for 2021 the data are not currently published, although even if they were, no conclusions could be drawn with the data for 2021 due to the anomaly in quality of life during the years of the pandemic.

4. Results

We will now compare the results obtained by INE with the results provided by our research.
First, we will compare the global INE result with the result of aggregating the nine dimensions obtained by INE with an ELECTRE III assuming that all weights are equal to 1 and no threshold is introduced. We will call this approach “BASIC ELECTRE III: INE Dimensions aggregated with an ELECTRE III”.
Second, a more complex model is proposed below. The variables that make up each dimension will be aggregated with an ELECTRE III. All variables will have a weight equal to 1 and no thresholds will be introduced. This model has been named “Full ELECTRE III”.
Then, a third model is proposed where ELECTRE III is used for the aggregation in the first phase and indifference and preference thresholds will be introduced (but not for veto). The indifference threshold will be equal to 1% of the difference between the maximum and minimum value of the variable. The preference threshold shall be equal to 5% of the difference between the maximum and the minimum value of the variable. In this way, for each dimension a ranking (a partial pre-order) will be obtained. The 9 rankings will be aggregated again thanks to ELECTRE III. An alternative approach, that could be addressed in future lines of research, is to apply the Revised Simos method [42] to assign weights to each of the nine dimensions.
The indifference and preference threshold will not be introduced this time because each dimension is a ranking. This approach will be referred to as “Full Fuzzy ELECTRE III: ELECTRE III two-stage approach”.

4.1. Basic ELECTRE: INE Dimensions Aggregated with an ELECTRE III

Our Improved Multidimensional Quality of Life Index (IMQLI) is constructed based on the INE’s Quality of Life Indicators [57] and is broken down into nine dimensions: 1.-Material living conditions; 2.-Work; 3.-Health; 4.-Education; 5.-Leisure and social relations; 6.-Physical and personal safety; 7.-Governance and basic rights; 8.-Environment; and 9.-General experience of life.
Table 4 shows the 9 dimensions obtained by INE for the year 2019 as well as the global value of the MQLI by Autonomous Communities. For each one of the 9 dimensions, indicators are aggregated using the Adjusted Mazziotta-Pareto Index (AMPI). Then, the 9 dimensions are aggregated by weighted arithmetic mean, by default with equal weights, although it should be noted that the INE application allows the user to vary the relative weight of each dimension.
Our first approach is to aggregate the 9 dimensions of the INE with an ELECTRE III where all weights are equal to 1 (we will see later how to vary these weights) and where no indifference, preference or veto thresholds is introduced (we will also see later how thresholds can be introduced). Figure 5 shows the ELECTRE III ranking obtained. The full name of each Autonomous Communities is shown in Table 5.
The comparison between our result, aggregating the 9 dimensions with ELECTRE III, and the result obtained by INE, aggregating the 9 dimensions with an arithmetic mean, can be seen in Table 5.
Thus, the first difference we find is that we compare ranks with scores. Moreover, as the ELECTRE III aggregator is a non-compensatory methodology, it is to be expected that some alternatives have a different comparative position in our approach than in the INE methodology.

4.2. ELECTRE III Two-Stage Approach

In this section we are going to apply an ELECTRE III both for the aggregation of the indicators that make up each of the 9 dimensions and for the aggregation of the 9 dimensions. We believe that this approach is more appropriate since a non-compensatory aggregator is used in both steps and, in addition, the outranking relationships allow us to establish 4 types of relationships for each pair of alternatives (strict preference, weak preference, indifference, and incomparability).

4.2.1. Full ELECTRE: ELECTRE III Two-Stage Approach with Weights Equal to 1 in Both Stages and No Thresholds

First, we will apply the ELECTRE III aggregator in both phases and in both cases, we will assign weights equal to 1 for all criteria (indicators or dimensions) and we will also not set any thresholds. In this way we want to compare the solutions obtained with our approach with the INE results progressively, as we refine our approach. Finally, we will introduce weights on the criteria and also thresholds. It is in this last way that we believe the approach is more suitable for comparing the multidimensional index of quality of life between the Autonomous Regions.
The ranks for the nine dimensions obtained with ELECTRE III from the original INE indicators [49] are presented in Table 6.
The final ranking aggregating these nine dimensions with ELECTRE III with all weights equal to 1 and no thresholds can be seen in Figure 6 and the comparison with the global ranking provided by INE in Table 7.
Figure 6 shows the final ranking aggregating the nine dimensions with ELECTRE III with all weights equal to 1.

4.2.2. Full Fuzzy ELECTRE: ELECTRE III Two-Stage Approach with Thresholds on the Indicators of the Dimensions

Now we present a new proposal introducing thresholds in the first stage of ELECTRE III, but maintaining weights equal to 1 on the 9 dimensions to compare the results with the INE result.
Indifference thresholds are calculated for each indicator as 1% of the difference between the maximum and the minimum value of each indicator. Preference thresholds are calculated for each indicator as 5% of the difference between the maximum and the minimum value of each indicator. Table 8 shows the indifference and preference thresholds for each one of the indicators of the 9 dimensions.
Each of the 9 dimensions will be obtained by aggregating their indicators with ELECTRE III and using the indifference and preference thresholds defined above. No veto thresholds will be used to make the result more objective and comparable with the dimensions obtained by INE with the AMPI method. For this same reason no weights will be introduced for the indicators as the INE gives all indicators the same importance. Table 9 shows the 9 dimensions obtained aggregated with ELECTRE III including thresholds.
We need now to aggregate these 9 dimensions with ELECTRE III. Weights will be set to 1 to make comparisons with the INE results. No thresholds will be set here as the criteria (dimensions) are rankings.
The final ranking aggregating these nine dimensions with ELECTRE III with all weights equal to 1 and no thresholds can be seen in Figure 7 and the comparison with the global ranking provided by INE in Table 10.
Table 10 shows the comparison between our result (ELECTRE III with all weights equal to 1 and no thresholds) and INE result (arithmetic mean).
At this point, we believe it is interesting to make a comparative summary between the ranking obtained based on the scores given to each Autonomous Regions by the INE and the rankings obtained using our three innovative methodologies:
  • Basic ELECTRE: Ranking by aggregating with an ELECTRE III the 9 dimensions calculated with the AMPI method.
  • Full ELECTRE: Ranking with ELECTRE III two-stage with no thresholds on the indicators and weights always equal to 1.
  • Full Fuzzy ELECTRE: Ranking with ELECTRE III two-stage with thresholds on the indicators and weights always equal to 1.
Table 11 shows the comparison between our result for each one of the three innovative methodologies that we propose, that is Basic ELECTRE, Full ELECTRE, and Full Fuzzy ELECTRE, versus INE result using arithmetic mean.

ELECTRE III Two-Stage Approach with Thresholds on the Indicators of the Dimensions and Different Weights on the Dimensions

We will now make a final comparison between our results and the INE results by introducing a set of weights for the 9 dimensions.
The INE allows us to introduce a weight for each dimension on a scale from 1 to 10. Let us assume that we introduce the weights shown on Table 12, which shows the weight for each dimension introduced by authors in INE model.
Table 13 displays the data used to create Figure 8. Figure 8 shows the ranking generated by the INE including the Table 13 weights. It is a self-elaborated image created by authors using INE data and Tableau Public software. The grey dots represent the overall ranking with weights and the red dots represent the values of the corresponding Autonomous Regions with all weights of the 9 dimensions equal to 1. The axes represent the quantitative values of the weighted average of the 9 dimensions (global with weights) and the unweighted average (global).
Table 14 displays the data used to create Figure 9. Figure 9 shows our ranking generated by ELECTRE III two-stage approach with thresholds on the indicators of the dimensions and with and without the different weights on the dimensions. For the bars interpretation of the image, it must first be noted that ELECTRE III only gives the ranking, so the first position (the best position) is the ranking number 1. Secondly, we observe that while in the solution without weights there were 14 positions in the ranking, when weights are introduced, they are reduced to 13. This is evidently due to the ties. The grey dots represent the ranking with weights and the red dots represent the ranking with all weights of the 9 dimensions equal to 1. This figure is also a self-elaborated image created by authors using INE data and Tableau Public software.
In this final comparison, it is interesting to see, in the two graphs above, separately the variation in the index calculated by INE with and without weights on the one hand, and on the other hand, the variation in the ranking calculated by authors with ELECTRE III two-stage with thresholds with and without weights. The idea is to show the variations produced by the introduction of weights in each of the calculation methods. For this reason, the INE comparative graph has also been presented with the quantitative values of the index while, obviously, in the case of ELECTRE, the comparison between the ranking positions obtained with and without weights is shown.

5. Conclusions

The multivariate quality of life index developed by INE is based on a two-stage aggregation. First of a set of indicators to create 9 dimensions, the quality of life dimensions, and then of the 9 dimensions into a single index. In the first phase of the aggregation, the one that generates the 9 dimensions, a non-compensatory type of aggregation (the AMPI method), is in our view judiciously used. However, for the aggregation of the 9 dimensions into a single indicator, a simple arithmetic mean is used. It does not seem very logical that, if non-compensation between indicators was used in the first phase, it is now necessary to compensate in the second phase.
What we propose is to create an index in which the principle of non compensation is maintained in both phases. To this end, we propose two alternatives:
  • To use the AMPI method in the first phase and ELECTRE III in the second phase to create a ranking that allows us to compare the established subgroups (in our case the Autonomous Regions). This is the Basic ELECTRE methodology.
  • To use ELECTRE III to aggregate indicators in the first phase and again ELECTRE III to aggregate the 9 dimensions resulting from the first phase to create a final index in the form of a ranking. We have named Full ELECTRE to this methodology in the case of no thresholds have been introduced in the first phase. And we have named Full Fuzzy ELECTRE to the methodology when thresholds have been introduced.
To sum up, the main advantage of our Improved Multidimensional Quality of Life Index (IMQLI), is based on the benefits of using the ELECTRE III over AMPI, as ELECTRE III allows modelling user (decision-maker) to introduce preferences, indifference and veto thresholds. Consequently, this refines the comparison between alternatives (Autonomous Regions), and the final ranking also allows for equivalence classes of Autonomous Regions and even incomparability between 2 or more of them.
The index generated by the INE is a quantitative index, each Autonomous Region is assigned a score. The ranking generated by ELECTRE III is an ordering of the Autonomous Regions from the best to the least good where ties and incomparability are allowed. It could be argued that assigning a score is more accurate than assigning a rank. But, in our opinion, and since the ultimate purpose of the index is the comparison between Autonomous Regions (or sub-populations in general), a ranking actually provides the necessary information.
The reason why our approach is more accurate than the one used by the INE is that our approach uses “non-compensatory” aggregation methods in both phases (both in the aggregation of indicators and in the aggregation of dimensions). The INE method uses a non-compensatory method for aggregating indicators, but a “compensatory” one (the arithmetic mean) for aggregating dimensions. Although it cannot be said that there is a “perfect” type of aggregation, we believe that it is much better to use a multi-criteria approach that captures the complexity of the phenomenon under study and that does not allow for trade-offs between different criteria (allowing e.g., poor “Material living conditions” outcomes to be compensated by good “Leisure and social relations” outcomes). With our approach it cannot happen that a bad value in one dimension cannot be compensated by a good value in another.
In the construction of the INE index, the question of the weightings of the 9 dimensions remains to be addressed. The INE proposes that the user/decider enters his/her subjective weights. We have approached the problem in the same way by introducing the same weights in the average used by INE and in ELECTRE III of the second stage aggregation. As we have seen, the solutions vary greatly depending on whether weights are introduced or not.
In relation to future lines of research, we believe that the question of weights needs to be addressed in more depth. Above all, there is a fundamental question: should the weights be derived from information provided by experts? We believe that yes, experts should be consulted, and a consensus method should be sought for assigning weights to the 9 dimensions. And furthermore, should the original indicators also be weighted (remember that they all had a weight equal to 1)? Although, as mentioned in the INE document itself, the weighting must be “subjective”, a method must be proposed that can incorporate as closely as possible the importance that the user attaches to each dimension. It should be borne in mind here that the user is not always able to assign a numerical value that faithfully represents the relative importance of the dimensions.
The question of how to weight the nine dimensions, as well as whether the initial indicators should also be weighted, is of course a problem that remains to be solved. A large part of the problem lies in whether such weights should be consensual or whether complete subjectivity should be allowed.
These questions will be lines of future research by the authors to propose a robust method for constructing multidimensional quality of life indices.

Author Contributions

Conceptualization, M.A.D.V.O.; Data curation, M.A.D.V.O.; Formal analysis, M.A.D.V.O.; Investigation, M.A.D.V.O. and A.R.-A.; Methodology, M.A.D.V.O. and A.R.-A.; Project administration, A.R.-A.; Software, M.A.D.V.O.; Supervision, A.R.-A.; Validation; M.A.D.V.O.; Visualization, M.A.D.V.O. and A.R.-A.; Writing—original draft preparation M.A.D.V.O. and A.R.-A.; Writing—review and editing, M.A.D.V.O. and A.R.-A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study did not require ethical approval.

Informed Consent Statement

Not applicable. The study did not involve humans.

Data Availability Statement

The data used in this study are openly available at the webpage of the INE, National Statistics Institute—Spanish Statistical Office. More specifically, the data are freely accessible and available at the following web address: https://www.ine.es/experimental/imcv/experimental_ind_multi_calidad_vida.htm, accessed on 30 November 2022.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. The 55 indicators used by INE.
Table A1. The 55 indicators used by INE.
Dimension 1. Material Living Conditions
1.1. Economic conditions
1.1.1. Median income
1.1.2. Population at risk of relative poverty according to thresholds
1.1.4. Inequality (S80/S20)
1.1.5. Satisfaction with household economic situation
1.2. Material conditions
1.2.1. Difficulties to make ends meet
1.2.2. Material deprivation
1.2.3. Population living in households with certain housing deficiencies
1.2.4. Population living in households with a lack of housing space
1.2.5. Population with high housing expenditure
1.2.6. Satisfaction with the dwelling
1.3. Economic security
1.3.2. Inability to cope with unforeseen financial expenses
1.3.3. Late payments
Dimension 2. Work
2.1. Quantity
2.1.1. Employment rate
2.1.2. Unemployment rate
2.1.3. Long-term unemployment rate (as a percentage of the labor force)
2.1.4. Involuntary part-time employment (percentage of total part-time)
2.2. Quality
2.2.1. Low wages
2.2.2. Long working hours
2.2.3. Temporary work
2.2.4. Job satisfaction
Dimension 3. Health
3.1. Outcomes
3.1.1. Life expectancy at birth
3.1.3. Self-perceived health
3.1.4. Chronic morbidity. People with diseases or health problems
3.1.5. Persons with limitations in daily activity in the last 6 months
3.2. Access to health care
3.2.1. Unmet need for health care
3.3. Health determinants
3.3.1. Body mass index
3.3.2. Daily smokers
3.3.3. Regular physical exercise and leisure time sedentary behavior
Dimension 4. Education
4.1. Competences and skills
4.1.1. Educational attainment of the total population
4.1.2. Adult population (25-64 years old) with higher education level
4.1.3. Level of education by the young population (18-24 years old)
4.1.4. Early school leavers in the 18-24 age group
4.2. Lifelong learning
4.2.1. 25 to 64 year old who have received training in the last 4 weeks
Dimension 5. Leisure and social relations
5.1. Leisure
5.1.1. Satisfaction with time available
5.1.2. Attendance at cultural and sporting events
5.2. Social relations
5.2.1. Frequency of meetings with friends, family or colleagues
5.2.2. Satisfaction with personal relationships
5.2.4. Having someone to talk to about personal issues
5.2.5. Trusting others
Dimension 6. Physical and personal security
6.1. Physical and personal security
6.1.1.1 Homicides
6.1.1.2 Crime
6.1.2. Crime or vandalism in the area
6.1.3. Perception of security (when walking alone at night)
Dimension 7. Governance and basic rights
7.1. Public institutions and services
7.1.1. Trust in the political system
7.1.2. Trust in the judicial system
7.1.3. Trust in the Police
7.2. Citizen participation
7.2.1. Participation in political activities
Dimension 8. Environment
8.1. Pollution, noise
8.1.1. Population suffering from pollution and environmental problems
8.1.2. Population suffering from noise problems produced by neighbors
8.1.3. Urban population and air pollution (micro particles PM10, PM2.5)
8.2. Access to green and recreational areas
8.2.1. Satisfaction with green spaces and recreation areas
8.3. Environmental setting
8.3.1. Satisfaction with the environment in which you live
Dimension 9. Overall experience of life
9.1. Overall life satisfaction
9.1.1. Overall satisfaction with life
9.2. Feelings and emotions
9.2.1 Positive feelings
9.3. Meaning and purpose in life
9.3.1. Evaluation of meaning and purpose in life
Source: [49].

References

  1. Eurostat Quality of Life Indicators. Available online: https://ec.europa.eu/eurostat/statistics-explained/index.php?title=Quality_of_life_indicators (accessed on 30 November 2022).
  2. INE Press Release on Multidimensional Quality of Life Indicator. Available online: https://www.ine.es/en/prensa/experimental_ind_multi_calidad_vida_en.pdf (accessed on 30 November 2022).
  3. Bradshaw, Y.; Fraser, E. City size, economic development and quality of life in China: New empirical evidence. Am. Sociol. Rev. 1989, 54, 986–1003. [Google Scholar] [CrossRef]
  4. Kao, C.H.; Liu, B.C. Socioeconomic advance in the Republic of China (Taiwan): An inter- temporal analysis of its quality of life indicators. Am. J. Econ. Sociol 1984, 43, 399–412. [Google Scholar] [CrossRef]
  5. Shin, D.C.; Snyder, W. Economic growth, quality of life, and development policy: A case study of South Korea. Comp. Political Stud. 1983, 16, 195–213. [Google Scholar] [CrossRef]
  6. Sumner, L.W. Welfare, Happiness, and Ethics, 1st ed.; Claredon Press: Oxford, UK, 1996; pp. 1–239. [Google Scholar]
  7. Schokkaert, E. Capabilities and satisfaction with life. Hum. Dev. 2007, 8, 415–430. [Google Scholar] [CrossRef]
  8. Arrow, K. A difficulty in the concept of social welfare. J. Political Econ. 1950, 58, 328–346. [Google Scholar] [CrossRef]
  9. INE Quality of Life Indicators. Available online: https://bit.ly/3ioAnLk (accessed on 30 November 2022).
  10. Munda, G. Choosing aggregation rules for composite indicators. Soc. Indic. Res. 2012, 109, 337–354. [Google Scholar] [CrossRef]
  11. Chamberlain, K. Value dimensions cultural differences, and the prediction of perceived quality of life. Soc. Indic. Res. 1985, 17, 345–401. [Google Scholar] [CrossRef]
  12. Diener, E. Assessing subjective well-being: Progress and opportunities. Soc. Indic. Res. 1994, 31, 103–157. [Google Scholar] [CrossRef]
  13. Diener, E.; Suh, E. Measuring quality of life: Economic, social, and subjective indicators. Soc. Indic. Res. 1997, 40, 189–216. [Google Scholar] [CrossRef]
  14. Rawls, J. A Theory of Justice, 1st ed.; Belknap Press of Harvard University Press: Cambridge, MA, USA, 1971; pp. 1–560. [Google Scholar]
  15. Sen, A.K. Commodities and Capabilities, 1st ed.; Oxford University Press: Amsterdam, The Netherlands, 1985; pp. 1–104. [Google Scholar]
  16. Sen, A.K. The Idea of Justice, 1st ed.; Allen-Lane: London, UK, 2009; pp. 1–467. [Google Scholar]
  17. Nussbaum, M. Women and Human Development, 1st ed.; Cambridge University Press: Cambridge, MA, USA, 2000; pp. 1–336. [Google Scholar]
  18. Kahneman, D.; Krueger, A.B. Developments in the measurements of subjective well-being. J. Econ. Perspect. 2006, 20, 3–24. [Google Scholar] [CrossRef]
  19. Hsieh, C.T.; Liu, B.C. The pursuance of better quality of life: In the long run, better quality of social life is the most important factor in migration. Am. J. Econ. Sociol. 1983, 42, 431–440. [Google Scholar] [CrossRef]
  20. Schimmack, U.; Schupp, J.; Wagner, G.G. The influence of environment and personality on the affective and cognitive component of subjective wellbeing. Soc. Indic. Res. 2008, 89, 41–60. [Google Scholar] [CrossRef]
  21. Shynkaruk, O.; Denisova, L. Methods for Assessing Quality of Life: International Experience. Phys. Educ. Sport. Health Cult. Mod. Soc. 2017, 1, 36–42. [Google Scholar] [CrossRef] [Green Version]
  22. Stiglitz, J.E.; Sen, A.; Fitoussi, J.P. Informe de la Comisión Sobre la Medición del Desarrollo Económico y del Progreso Social; European Commission: Brussels, Belgium, 2009; pp. 1–292. [Google Scholar]
  23. UNDP Human Development Index. Available online: https://hdr.undp.org/data-center/human-development-index#/indicies/HDI (accessed on 30 November 2022).
  24. OECD Better Life Index. Available online: https://www.oecdbetterlifeindex.org/ (accessed on 30 November 2022).
  25. Krishnakumar, J.; Nagar, A.L. On exact statistical properties of multidimensional indices based on principal components, factor analysis, MIMIC and structural equation models. Soc. Indic. Res. 2008, 86, 481–496. [Google Scholar] [CrossRef] [Green Version]
  26. Haq, R.; Zia, U. Multidimensional wellbeing: An index of quality of life in a developing economy. Soc. Indic. Res. 2013, 114, 997–1012. [Google Scholar] [CrossRef]
  27. Betti, G.; Soldi, R.; Talev, I. Fuzzy multidimensional indicators of quality of life: The empirical case of Macedonia. Soc. Indic. Res. 2016, 127, 39–53. [Google Scholar] [CrossRef]
  28. Rogge, N.; Van Nijverseel, I. Quality of life in the European Union: A multidimensional analysis. Soc. Indic. Res. 2019, 141, 765–789. [Google Scholar] [CrossRef]
  29. Mazziotta, M.; Pareto, A. On a generalized non-compensatory composite index for measuring socio-economic phenomena. Soc. Indic. Res. 2016, 127, 983–1003. [Google Scholar] [CrossRef]
  30. Mauroa, V.; Giusti, C.; Marchetti, S.; Pratesi, M. Does uncertainty in single indicators affect the reliability of composite indexes? An application to the measurement of environmental performances of Italian regions. Ecol. Indic. 2021, 127, 107740. [Google Scholar] [CrossRef]
  31. Greco, S.; Ishizaka, A.; Tasiou, M.; Torrisi, G. On the methodological framework of composite indices: A review of the issues of weighting, aggregation, and robustness. Soc. Indic. Res. 2019, 141, 61–94. [Google Scholar] [CrossRef]
  32. OECD; European Commission. Handbook on Constructing Composite Indicators: Methodology and User Guide; OECD Publishing: Ispra, Italy, 2008; pp. 1–162. [Google Scholar]
  33. Munda, G. Multiple criteria decision analysis and sustainable development. In Multiple Criteria Decision Analysis, 1st ed.; Greco, S., Ehrgott, M., Figueira, J., Eds.; Springer: New York, NY, USA, 2016; Volume 233, pp. 1235–1267. [Google Scholar]
  34. Paruolo, P.; Saisana, M.; Saltelli, A. Ratings and rankings: Voodoo or science? J. R. Stat. Soc. 2013, 176, 609–634. [Google Scholar] [CrossRef] [Green Version]
  35. SOCRATES Software. Available online: https://publications.jrc.ec.europa.eu/repository/handle/JRC131755 (accessed on 24 December 2022).
  36. Pereira, D.V.S.; Mota, C.M.M. Human development index based on ELECTRE TRI-C multicriteria method: An application in the city of Recife. Soc Indic Res 2016, 125, 19–45. [Google Scholar] [CrossRef]
  37. Gharizadeh Beiragh, R.; Alizadeh, R.; Shafiei Kaleibari, S.; Cavallaro, F.; Zolfani, S.H.; Bausys, R.; Mardani, A. An integrated multi-criteria decision making model for sustainability performance assessment for insurance companies. Sustainability 2020, 12, 789. [Google Scholar] [CrossRef] [Green Version]
  38. El Gibari, S.; Gómez, T.; Ruiz, F. Building composite indicators using multicriteria methods: A review. J. Bus. Econ. 2019, 89, 1–24. [Google Scholar] [CrossRef]
  39. Diaz-Balteiro, L.; González-Pachón, J.; Romero, C. Measuring systems sustainability with multi-criteria methods: A critical review. Eur. J. Oper. Res. 2017, 258, 607–616. [Google Scholar] [CrossRef]
  40. Attardi, R.; Cerreta, M.; Sannicandro, V.; Torre, C.M. Non-compensatory composite indicators for the evaluation of urban planning policy: The Land-Use Policy Efficiency Index. Eur. J. Oper. Res. 2018, 264, 491–507. [Google Scholar] [CrossRef]
  41. Munda, G.; Nardo, M. Noncompensatory/nonlinear composite indicators for ranking countries: A defensible setting. J. Appl. Econ. 2009, 41, 1513–1523. [Google Scholar] [CrossRef] [Green Version]
  42. Jardim, R.R.J.; Santos, M.; Neto, E.; da Silva, E.; De Barros, F. Integration of the waterfall model with ISO/IEC/IEEE 29148: 2018 for the development of military defense system. IEEE Lat. Am. Trans. 2020, 18, 2096–2103. [Google Scholar] [CrossRef]
  43. Doumpos, M.; Grigoroudis, E. Decision Aid and Artificial Intelligence: Links, Theory and Applications, 1st ed.; John Wiley & Sons: Hoboken, NJ, USA, 2013; pp. 1–368. [Google Scholar]
  44. Doumpos, M.; Zopounidis, C. Computational intelligence techniques for multicriteria decision aiding: An overview. In Multicriteria Decision Aid and Artificial Intelligence: Links, Theory and Applications, 1st ed.; Doumpos, M., Grigoroudis, E., Eds.; John Wiley & Sons: Hoboken, NJ, USA, 2013; pp. 1–23. [Google Scholar]
  45. Kartal, H.; Oztekin, A.; Gunasekaran, A.; Cebi, F. An integrated decision analytic framework of machine learning with multi-criteria decision making for multi-attribute inventory classification. Comput. Ind. Eng. 2016, 101, 599–613. [Google Scholar] [CrossRef]
  46. Shu, Z.; Carrasco, R.A.; García-Miguel, J.P.; Sánchez-Montañés, M. Multiple Scenarios of Quality of Life Index Using Fuzzy Linguistic Quantifiers: The Case of 85 Countries in Numbeo. Mathematics 2022, 10, 2091. [Google Scholar] [CrossRef]
  47. Tsaples, G.; Papathanasiou, J.; Georgiou, A.C. An Exploratory DEA and Machine Learning Framework for the Evaluation and Analysis of Sustainability Composite Indicators in the EU. Mathematics 2022, 10, 2277. [Google Scholar] [CrossRef]
  48. Siskos, E.; Askounis, D.; Psarras, J. Multicriteria decision support for global e-government evaluation. Omega 2014, 46, 51–63. [Google Scholar] [CrossRef]
  49. INE Indicador Multidimensional de Calidad de Vida. Available online: https://www.ine.es/experimental/imcv/exp_calidad_vida_multi.pdf (accessed on 30 November 2022).
  50. Diviz Software. Available online: https://www.diviz.org/Xxx (accessed on 30 November 2022).
  51. Meyer, P.; Bigaret, S. Diviz: A software for modeling, processing and sharing algorithmic workflows in MCDA. Intell. Decis. Technol. 2012, 6, 283–296. [Google Scholar] [CrossRef] [Green Version]
  52. Ishizaka, A.; Nemery, P. Multi-Criteria Decision Analysis: Methods and Software, 1st ed.; John Wiley & Sons: Hoboken, NJ, USA, 2013; pp. 1–310. [Google Scholar]
  53. Bisdorff, R.; Dias, L.C.; Meyer, P.; Mousseau, V.; Pirlot, M. Evaluation and Decision Models with Multiple Criteria, 1st ed.; Springer: Berlin/Heidelberg, Germany, 2015; pp. 1–643. [Google Scholar]
  54. Romero-Ania, A.; Rivero Gutiérrez, L.; De Vicente Oliva, M.A. Multiple Criteria Decision Analysis of Sustainable Urban Public Transport Systems. Mathematics 2021, 9, 1844. [Google Scholar] [CrossRef]
  55. Figueira, J.R.; Mousseau, V.; Roy, B. ELECTRE methods. In Multiple Criteria Decision Analysis, 1st ed.; Springer: New York, NY, USA, 2016; pp. 155–185. [Google Scholar]
  56. Roy, B. The outranking approach and the foundations of ELECTRE methods. In Readings in Multiple Criteria Decision Aid, 1st ed.; Springer: Berlin/Heidelberg, Germany, 1990; pp. 155–183. [Google Scholar]
  57. de Vicente Oliva, M.A.; Romero-Ania, A. How to incorporate preference information in a weight-restricted DEA model: A straightforward solution ap-plied in the field of economics, based on Simos’ revised method. Axioms 2022, 11, 367. [Google Scholar] [CrossRef]
Figure 1. The indicators that define each of the nine dimensions.
Figure 1. The indicators that define each of the nine dimensions.
Axioms 12 00041 g001
Figure 2. The first variation that we propose: BASIC ELECTRE Index.
Figure 2. The first variation that we propose: BASIC ELECTRE Index.
Axioms 12 00041 g002
Figure 3. The second variation that we propose: FULL ELECTRE Index.
Figure 3. The second variation that we propose: FULL ELECTRE Index.
Axioms 12 00041 g003
Figure 4. The third variation that we propose: FULL FUZZY ELECTRE Index.
Figure 4. The third variation that we propose: FULL FUZZY ELECTRE Index.
Axioms 12 00041 g004
Figure 5. The ranking obtained using ELECTRE III.
Figure 5. The ranking obtained using ELECTRE III.
Axioms 12 00041 g005
Figure 6. The final ranking aggregating the nine dimensions with ELECTRE III with all weights equal to 1.
Figure 6. The final ranking aggregating the nine dimensions with ELECTRE III with all weights equal to 1.
Axioms 12 00041 g006
Figure 7. The final ranking aggregating the nine dimensions with ELECTRE III with all weights equal to 1 and no thresholds.
Figure 7. The final ranking aggregating the nine dimensions with ELECTRE III with all weights equal to 1 and no thresholds.
Axioms 12 00041 g007
Figure 8. The ranking generated by the INE including the Table 13 weights.
Figure 8. The ranking generated by the INE including the Table 13 weights.
Axioms 12 00041 g008
Figure 9. Our ranking generated by ELECTRE III two-stage approach with thresholds on the indicators of the dimensions with and without weights.
Figure 9. Our ranking generated by ELECTRE III two-stage approach with thresholds on the indicators of the dimensions with and without weights.
Axioms 12 00041 g009
Table 1. Literature review on composite indicators based on MCDM.
Table 1. Literature review on composite indicators based on MCDM.
ReferenceAdded Value
[36]ELECTRE TRI-C multicriteria method is used in order to attenuate the compensatory effect of the Human Development Index, to reduce calculation problems and to allow comparison year by year.
[37]Insurance companies were evaluated using different indices. The indices were ranked by expert judgment though an analytical hierarchy process as subjective weighting, and then principal component analysis as objective weighting was used to reduce the number of indices. The obtained principal components were then used as variables in the data envelopment analysis model. So, subjective and objective evaluations were integrated.
[38]The article shows a review of methods in which MCDM methods are used to build composite indicators.
[39]Determining the sustainability of a system (e.g., through a criteria and indicators approach) has been the focus of research in many branches of science. Frequently, this research used multiple criteria decision making techniques. In this work, it is analyzed and critically assessed the literature published on these topics.
[40]In this article an ELECTRE III-based approach is defined and tested to the construction of non-compensatory composite indicators; these indicators are used for the evaluation of environmental and social performances of urban and regional planning policies
[41]This article aims at contributing to the improvement of the overall quality of composite indicators (or indexes) by looking at one of their technical weaknesses, that is, the aggregation convention used for their construction. Concepts coming from multi-criteria decision analysis, measurement theory and social choice are used.
Table 2. Literature review on papers on MCDM and computational intelligence.
Table 2. Literature review on papers on MCDM and computational intelligence.
ReferenceAdded Value
[42]This paper obtain lessons learned through a case study. A software development lifecycle was obtained that integrates the waterfall model and ISO/IEC/IEEE 29,148 recommendations.
[43]Presents recent advances in both models and systems for intelligent decision making.
[44]The chapter provides an overview of the main contributions of popular computational intelligence approaches in multicriteria decision aid (MCDA), covering areas such as multiobjective optimization, preference modeling, and model building through preference disaggregation.
[45]The article develops a hybrid methodology that integrates machine learning algorithms with multi-criteria decision making (MCDM) techniques to effectively conduct multi-attribute inventory analysis
Table 3. Literature review on papers using MCDM and computational intelligence to build composite indicators.
Table 3. Literature review on papers using MCDM and computational intelligence to build composite indicators.
ReferenceAdded Value
[46]This paper aims to construct various scenarios of the QOLI, using linguistic quantifiers of the ordered weighted averaging (OWA) operator, and the 2-tuple linguistic model.
[47]The purpose of this paper is to propose an alternative, multi-dimensional DEA model that handles weight flexibility using a different metric (an alternative optimization criterion) and the inclusion of a computational stage that attempts to incorporate different perceptions in the measurement of sustainability and integrates machine learning to explore country sustainability composite indices under different perceptions and assumptions.
[48]This paper outlines a multicriteria methodology to evaluate e-government using a system of eight evaluation criteria. The overall evaluation is obtained through UTA II whose interactive application process is divided in two phases. Its implementation is supported by MIIDAS (multicriteria interactive intelligent decision aiding system).
Table 4. Values of the 9 dimensions and the MQLI obtained by INE for the year 2019.
Table 4. Values of the 9 dimensions and the MQLI obtained by INE for the year 2019.
Dim 1 INEDim 2 INEDim 3 INEDim 4 INEDim 5 INEDim 6 INEDim 7 INEDim 8 INEDim 9 INEMQLI INE 2019
Andalucía97.3894.71102.28100.6296.53101.3994.87100.22102.3798.93
Aragón105.33102.85103.73105.76104.91106.5897.36108.22110.51105.03
Asturias, Principado de102.3699.03101.71106.2197.97108.15100.23107.00104.94103.07
Balears, Illes102.50102.03103.93101.05103.9399.96109.35101.76112.49104.11
Canarias98.1795.26101.67102.9595.45102.7599.07101.46107.59100.49
Cantabria103.71101.45105.94108.15105.59108.2096.03108.13106.38104.84
Castilla y León104.26100.44103.64106.41102.90106.6791.22108.6098.06101.67
Castilla-La Mancha100.9098.21102.72100.5997.17105.41101.29107.34101.37102.47
Cataluña101.79102.68106.20105.6696.3797.47102.27103.05106.62102.46
Comunitat Valenciana101.4999.31103.01106.02100.05101.89107.37104.31108.66103.57
Extremadura98.1394.45103.99100.34101.62106.4298.23106.35107.25101.87
Galicia100.9699.39100.77106.56101.61106.1994.36100.4193.81100.45
Madrid, Comunidad de102.04101.94109.28110.7099.5094.77102.85101.91103.60102.95
Murcia, Región de97.9396.95100.53101.7396.2798.54105.42101.33103.29100.22
Navarra, Comunidad Foral de106.86103.30106.53111.28101.82103.46102.37109.13107.42105.80
País Vasco105.40102.80103.93114.3299.4699.7591.28105.76102.49102.80
Rioja, La105.68102.12104.88106.19102.41108.35105.15105.41106.64105.20
Ceuta93.4794.6698.3297.0997.6992.61100.7597.11107.9197.73
Melilla94.1194.49108.38101.57107.28100.5599.8796.26109.31101.31
Table 5. Comparison between our result (ELECTRE III) and INE result (arithmetic mean).
Table 5. Comparison between our result (ELECTRE III) and INE result (arithmetic mean).
AlternativeAutonomous RegionOur Rank ELECTRE
(AMPI Dimensions)
INE Rank AM (Arithmetic Mean)
NAVANavarra, Comunidad Foral de11
ARAGAragón23
LRIORioja, La22
CANTACantabria34
BALEBalears, Illes45
CVALComunitat Valenciana46
MELIMelilla414
CYLCastilla y León510
MADRMadrid, Comunidad de58
PVASPaís Vasco59
CATACataluña611
EXTREExtremadura612
ASTUAsturias, Principado de77
CLMCastilla-La Mancha813
CANACanarias915
GALIGalicia916
MURCMurcia, Región de1017
CEUTCeuta1019
ANDAAndalucía1118
Table 6. The ranks for the nine dimensions obtained with ELECTRE III from the original INE indicators.
Table 6. The ranks for the nine dimensions obtained with ELECTRE III from the original INE indicators.
RANK D1 (Dim1)RANK D2 (Dim2)RANK D3 (Dim3)RANK D4 (Dim4)RANK D5 (Dim5)RANK D6 (Dim6)RANK D7 (Dim7)RANK D8 (Dim8)RANK D9 (Dim9)
ANDAAndalucía13107118911119
ARAGAragón3177231022
ASTUAsturias, Principado de8611653857
BALEBalears, Illes7351038191
CANACanarias1298978794
CANTACantabria643413925
CATACataluña11128710485
CEUTCeuta157131036671
CLMCastilla-La Mancha981011855310
CVALComunitat Valenciana779557252
CYLCastilla y León4587421219
EXTREExtremadura12861032935
GALIGalicia77754411611
LRIORioja, La224631266
MADRMadrid, Comunidad de1051369477
MELIMelilla14729187123
MURCMurcia, Región de1381298103103
NAVANavarra, Comunidad Foral de123237544
PVASPaís Vasco5261661268
Table 7. Comparison between our result (ELECTRE III with all weights equal to 1) and INE result (arithmetic mean).
Table 7. Comparison between our result (ELECTRE III with all weights equal to 1) and INE result (arithmetic mean).
AlternativesAutonomous RegionsOur ELECTRE III
Two-Stage
No Thresholds
INE Rank AM (Arithmetic Mean)
ARAGAragón13
LRIORioja, La12
CANTACantabria24
NAVANavarra, Comunidad Foral de21
BALEBalears, Illes35
CVALComunitat Valenciana36
MELIMelilla314
EXTREExtremadura412
MADRMadrid, Comunidad de48
CYLCastilla y León510
PVASPaís Vasco69
ASTUAsturias, Principado de77
CEUTCeuta719
CATACataluña811
GALIGalicia916
CANACanarias1015
CLMCastilla-La Mancha1013
MURCMurcia, Región de1017
ANDAAndalucía1118
Table 8. The indifference and preference thresholds for each one of the indicators of the 9 dimensions.
Table 8. The indifference and preference thresholds for each one of the indicators of the 9 dimensions.
Dimension 1
d11d12d13d14d15d16d17d18d19d110d111d112
indf.101.380.330.100.250.310.120.200.200.090.230.320.11
prefer.506.901.650.501.231.530.600.981.010.461.161.580.57
Dimension 2
d21d22d23d24d25d26d27d28
indf.0.140.190.150.340.210.200.160.24
prefer.0.690.940.731.701.041.000.791.22
Dimension 3
d31d32d33d34d35d36d37d38
indf.0.040.220.380.210.010.190.070.29
prefer.0.221.101.921.050.060.950.351.44
Dimension 4
d41d42d43d44d45
indf.0.270.290.130.180.04
prefer.1.341.440.650.900.22
Dimension 5
d51d52d53d54d55d56d57
indf.0.310.200.210.380.140.090.32
prefer.1.541.021.041.910.700.451.62
Dimension 6
d61d62d63d64
indf.0.050.400.190.18
prefer.0.242.010.970.91
Dimension 7
d71d72d73d74
indf.0.050.070.220.13
prefer.0.250.361.100.63
Dimension 8
d81d82d83d84d85
indf.0.190.190.140.570.31
prefer.0.970.960.702.861.55
Dimension 9
d91d92d93
indf.0.310.360.28
prefer.1.541.811.42
Table 9. The 9 dimensions obtained aggregated with ELECTRE III including thresholds.
Table 9. The 9 dimensions obtained aggregated with ELECTRE III including thresholds.
Dimensions Aggregated with ELECTRE III Including Thresholds
RANK D1 (Dim1)RANK D2 (Dim2)RANK D3 (Dim3)RANK D4 (Dim4)RANK D5 (Dim5)RANK D6 (Dim6)RANK D7 (Dim7)RANK D8 (Dim8)RANK D9 (Dim9)
ANDA1211898911109
ARAG318523922
ASTU7711453657
BALE846837191
CANA11109778684
CANTA5433131028
CATA9226710476
CEUT12712945571
CLM881010855310
CVAL679456252
CYL46954212110
EXTRE1097842837
GALI68845411611
LRIO135631267
MADR951269479
MELI11725177115
MURC10912599383
NAVA234246543
PVAS5161681268
Table 10. Comparison between our result (ELECTRE III with all weights equal to 1 and no thresholds) and INE result (arithmetic mean).
Table 10. Comparison between our result (ELECTRE III with all weights equal to 1 and no thresholds) and INE result (arithmetic mean).
AlternativesAutonomous RegionsOur ELECTRE III Two-StageINE Rank AM (Arithmetic Mean)
With Thresholds
ARAGAragón23
LRIORioja, La12
CANTACantabria34
NAVANavarra, Comunidad Foral de21
BALEBalears, Illes45
CVALComunitat Valenciana36
MELIMelilla814
EXTREExtremadura912
MADRMadrid, Comunidad de68
CYLCastilla y León510
PVASPaís Vasco59
ASTUAsturias, Principado de77
CEUTCeuta1019
CATACataluña711
GALIGalicia1016
CANACanarias1215
CLMCastilla-La Mancha1313
MURCMurcia, Región de1117
ANDAAndalucía1418
Table 11. Comparison between our results versus INE result using arithmetic mean.
Table 11. Comparison between our results versus INE result using arithmetic mean.
AlternativesAutonomous RegionsBasic ELECTRE:
Rank ELECTRE
Full ELECTRE:
ELECTRE III Two-Stage
Full Fuzzy ELECTRE:
ELECTRE III Two-Stage
INE
Rank AM (Arithmetic Mean).
(AMPI Dimensions)No ThresholdsWith Thresholds
ARAGAragón1123
LRIORioja, La2112
CANTACantabria2234
NAVANavarra, Comunidad Foral de3221
BALEBalears, Illes4345
CVALComunitat Valenciana4336
MELIMelilla43814
EXTREExtremadura54912
MADRMadrid, Comunidad de5468
CYLCastilla y León55510
PVASPaís Vasco6659
ASTUAsturias, Principado de6777
CEUTCeuta771019
CATACataluña88711
GALIGalicia991016
CANACanarias9101215
CLMCastilla-La Mancha10101313
MURCMurcia, Región de10101117
ANDAAndalucía11111418
Table 12. Weight for each dimension introduced by authors in INE model.
Table 12. Weight for each dimension introduced by authors in INE model.
DimensionDimension MeaningWeight
D1Material living conditions10
D2Work10
D3Health10
D4Education10
D5Leisure and social relations5
D6Physical and personal safety5
D7Governance and basic rights5
D8Environment and the environment5
D9General experience of life3
Table 13. Data used to create the Figure 8.
Table 13. Data used to create the Figure 8.
Autonomous RegionsGlobal with WeightsGlobal
Andalucía98.7698.93
Aragón104.66105.03
Asturias, Principado de102.77103.07
Balears, Illes103.29104.11
Canarias99.95100.49
Cantabria104.78104.84
Castilla y León103.00102.47
Castilla-La Mancha101.34101.67
Cataluña102.84102.46
Comunitat Valenciana103.06103.57
Extremadura100.86101.87
Galicia101.13100.45
Madrid, Comunidad de103.90102.95
Murcia, Región de99.83100.22
Navarra, Comunidad Foral de106.13105.80
País Vasco104.02102.80
Rioja, La105.00105.20
Ceuta96.8297.73
Melilla100.53101.31
Table 14. Data used to create the Figure 9.
Table 14. Data used to create the Figure 9.
Autonomous RegionsELECTRE III with ThresholdsELECTRE III with Thresholds and Weights
Aragón24
Rioja, La13
Cantabria31
Navarra, Comunidad Foral de22
Balears, Illes48
Comunitat Valenciana37
Melilla88
Extremadura99
Madrid, Comunidad de66
Castilla y León55
País Vasco55
Asturias, Principado de79
Ceuta1011
Cataluña77
Galicia107
Canarias1212
Castilla-La Mancha1310
Murcia, Región de1111
Andalucía1413
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

De Vicente Oliva, M.A.; Romero-Ania, A. Improved Multidimensional Quality of Life Index Based on Outranking Relations. Axioms 2023, 12, 41. https://doi.org/10.3390/axioms12010041

AMA Style

De Vicente Oliva MA, Romero-Ania A. Improved Multidimensional Quality of Life Index Based on Outranking Relations. Axioms. 2023; 12(1):41. https://doi.org/10.3390/axioms12010041

Chicago/Turabian Style

De Vicente Oliva, María Auxiliadora, and Alberto Romero-Ania. 2023. "Improved Multidimensional Quality of Life Index Based on Outranking Relations" Axioms 12, no. 1: 41. https://doi.org/10.3390/axioms12010041

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop