Next Article in Journal
Hydrothermal Liquefaction of Pinewood Sawdust: Influence of Reaction Atmosphere
Previous Article in Journal
Environmentally Friendly Materialism: How It Is Generated and How Luxury Apparel Addresses Environmental Problems
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Smart Cities Maturity Model—A Multicriteria Approach

by
Franciely Velozo Aragão
1,*,
Daiane Maria de Genaro Chiroli
2,*,
Fernanda Cavicchioli Zola
3,
Emanuely Velozo Aragão
2,
Luis Henrique Nogueira Marinho
4,
Ana Lidia Cascales Correa
2 and
João Carlos Colmenero
3
1
Textile Engineering Department, Federal University of Santa Catarina, Blumenau 89036-004, Brazil
2
Graduate Program in Urban Engineering, State University of Maringá, Maringa 87020-900, Brazil
3
Graduate Program in Production Engineering, Federal University of Technology—Paraná, Ponta Grossa 81280-340, Brazil
4
Postgraduate Program in Biotechnology, Londrina State University, Londrina 86057-970, Brazil
*
Authors to whom correspondence should be addressed.
Sustainability 2023, 15(8), 6695; https://doi.org/10.3390/su15086695
Submission received: 9 November 2022 / Revised: 5 December 2022 / Accepted: 19 December 2022 / Published: 15 April 2023

Abstract

:
The concept of smart cities has gained relevance over the past few years. Public managers have been planning investments to turn their cities into smart cities. Maturity models can help managers to monitor the performance of urban indicators; however, these maturity models are not always capable of meeting their proposed goals. In this sense, this research aims to develop a maturity model that ranks the “smartness” of a city based on social and technological indicators. The Smart Cities Maturity Model (MMSC) variables were extracted from ISO’s 37153:2017, 37120:2018, 37107:2019. The MMSC is structured on a hybrid TOPSIS multicriteria decision-making method. In this paper, we modified TOPSIS and used it to generate a synthetic indicator, called smart index, that designates the level of maturity of a real city. For this change to be possible, we fixed some alternatives and changed the positive ideal and negative ideal solution. The methodology is proven to be very efficient in measuring the smart city maturity level, and it can be easily adapted for the upcoming ISOs.

1. Introduction

Approximately 55% of the world’s population lives in urban areas, and this number is estimated to grow in the upcoming years [1]. This population increase is often disorderly, mainly in underdeveloped or developing countries, and has negative consequences for urban centers, especially related to health, safety, education, and urban mobility [2,3,4,5], leaving citizens vulnerable. Urban planning is the best way to solve such problems, since it aims to balance population needs with policies promoting efficient development [6,7]. In this process, emerging smart cities aim to identify the needs of people with a strategic focus on improving the quality of life.
The term smart cities can be defined as cities that promote energy efficiency, renewable energy, green mobility, and technological development, encouraging the exploration of knowledge management in urban environments [8,9,10]. Within its concept, smart actions provide the population with better quality of life through the growing process of innovation in their environment [11,12]. Smart cities seek to promote information and knowledge of the city for more effective management. Thus, managers become aware of the importance of integrating data between health, public security, education, and transport systems [13,14]; thus using them in a way to minimize the costs and waste that urban life generates, in terms of wellbeing and inclusion [15,16,17,18,19]. A smart city is the result of the implementation of advanced technological solutions for different infrastructures and urban activities such as services, business, transport, communication, water, and energy [20,21,22]. However, cities are considered smart when their technology becomes able to optimize the use of limited resources, assisting the main urban systems [23,24,25,26]. Several organizations have started a process of developing standards, specifications, and characteristics for smart cities [27,28]. Smart city solutions must play an important role supporting cities in achieving sustainable development goals (SDGs) [29,30,31], hence helping stakeholders to monitor the state and managing progress toward achieving the SDGs [32].
Improving the quality of life in cities is necessary; however, not all cities are smart and it is challenging to implement. Although several cities in the world are adhering to the smart city concept, there are no standards in the practices to identify the set of characteristics and processes that make a city smart, or in which level of performance it fits. The question then arises: How do we determine whether the smart practices adopted by a given city are capable of making it a smart city? In other words, how do we measure the smart performance of a city, given its local needs? In this way, it becomes relevant to develop a maturity model that is capable of embedding the specific characteristics of a city that wants to monitor its “smartness” and sustainable performance.
There is a range of studies in the literature that address maturity models [33,34,35] and focus on structures that measure the smartness of a city [36,37]. Torrinha and Machado [36] identifed a maturity model for smart cities and evaluated it, highlighting that the existing models, although meeting the need to assess the current state of a city, do not allow guidelines for progression along with the maturity levels. Cledou et al. [38] proposed taxonomy on intelligent mobility services. Sharifi [39] analyzed thirty-four tools to measure the performance of a smart city in order to identify its strengths and weaknesses in terms of content, structure, and procedures. Vidiasova et al. [40] evaluated the results of benchmarking worldwide practices in twenty smart cities and sought to determine the most successful cases that may be of interest for better urban development. Firmansyah et al. [41] used a participatory modeling approach to create interrelation maps with 52 factors (or concepts) connected by 98 links extracted from a systematic review carried out by the authors, transforming intuitive characterizations into numbers through diffuse logic. Warnecke et al. [42] provided a tool for evaluating the performance of smart cities such as focusing on urban mobility, monitoring development progress, and determining their competitive position through benchmarking.
In this process, the use of indicators helps cities to set goals and monitor their performance over time. These indicators were standardized by ISO 37120:2018 [43], created in 2014 and updated in 2018, being the first international standardization of standards created with a set of indicators to guide and measure municipal services performance and quality of life. The ISO 37120:2018 is based on a set of indicators focusing on guiding and measuring the performance of municipal services and quality of life. It is composed of 19 dimensions, subdivided into 111 indicators. The dimensions are economy, education, energy, environment and climate change, finance, governance, health, housing, social and population conditions, recreation, security, solid waste, sport and culture, telecommunications, transportation, urban/local agriculture and food security, urban planning, wastewater, and water. Currently, smart city assessment models focus on generating a ranking to classify cities, rather than focusing on the performance of the indicators. As a consequence, there are flawed assessment models that do not allow the identification of points for improvement, only generating ranking but not providing an action plan for decision-making that can improve a city’s intelligence levels [44]. As far as it was possible to carry out our research, we did not find similar works to the proposed one. It is an exclusive work with a academic and social contribution, and it makes it possible to identify the maturity and the development of an action plan focused on the city’s weaknesses, allowing the implementation of focal projects and enabling agility in actions to improve the quality of life of the population.
In order to provide standardized metrics for smart cities analysis, the World Council on City Data (WCCD) and the Global Cities Registry developed the first certification system based on ISO 37120. Currently, the WCCD Global Cities Registry has 103 cities certified based on ISO 37120. In addition to the WCCD, there are studies that present structures to identify the level of smartness of a city, although it is not characterized as a maturity model (MM), being only a structure that evaluates and ranks the analyzed cities, using a set of smart indicators. Several studies have been carried out using multicriteria methods for the construction of indicators, which can be elementary methods such as SAW, WPM, and AHP [45,46,47,48,49,50,51]; utility value-based methods such as MAUT, MAVT, SMART, and MACBETH [52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68]; methods based on peer comparison such as ELECTRE and PROMETHEE [69,70,71,72,73,74]; methods based on data envelopment analysis such as MCDM-DEA and BoD [75,76,77,78,79,80,81,82,83,84,85,86]; and methods based on distance functions such as the goal programming method, commitment programming methods, TOPSIS, and GRA [87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104]. Not all of these methods are characterized as noncompensatory.
The research gap of this study is structured on a maturity model capable of quantitatively evaluating the elements defined as ”smartness” for a city. Thus, the proposed model is based on an evaluation process that allows the development of a smart city, helping it to achieve its objectives.
Therefore, based on these premises, the main goals of this work are the following:
  • Present a maturity model focused on smart cities.
  • Understand the maturity levels that characterize a city as smart. This stage was supported by the five reference levels presented in the International Organization for Standardization (ISO) ISO 37153:2017—Smart community infrastructures—Maturity model for assessment and improvement and ISO 37107:2019—Sustainable cities and communities—Maturity model for smart sustainable communities.
  • Use the proposed modified methodology of the TOPSIS method—Technique for Order Preference by Similarity to Ideal Solution, where, unlike the original function of the method, which is to rank the alternatives, here it was used to generate a synthetic indicator called smart index.
  • Present the application of the maturity model in the city of London/UK, currently considered the most intelligent city in the world by the IESE—Business Schools Center for Globalization and Strategy ranking.
In this sense, this work is organized as follows: Section 2 presents the state of art regarding existing research to measure the maturity of smart cities. In the sequence, Section 3 presents the methodology and the variables used to determine the maturity of smart cities. The results of the application of the proposed model are in Section 4. Finally, Section 5 presents the main conclusions of the research. Figure 1 shows the conceptual diagram of the study.

2. State of the Art

A smart city is considered the result of a learning process based on local evidence, which places the individual at the center of urban politics. To this end, some researchers detected three different ways of characterizing a city as smart based on the context of urban and economic development [18], its strategic planning [105], and, finally, in the context of technologies, people, and institutions in an aggregate form [106].
The smart city concept is guided by characteristics of smartness, being characteristics of intelligence applied to the urban environment, following international standards. Several organizations have started a process of developing standards, specifications, and characteristics for smart cities. This is to clarify domains of a smart city and how they are treated in the performance-measuring process of the smartness of an urban environment [27,28]. Smart city solutions must play an important role supporting cities in achieving sustainable development goals (SDGs) [29,30] by helping stakeholders to monitor the state, and managing progress towards achieving the SDGs [32].
ISO 37122:2019 was developed based on ISO 37120:2018. ISO 37120:2018 deals with indicators for smart cities, and ISO 37123:2019 deals with indicators for resilient cities [43]. Currently, there are several international standards for city indicators that are relevant for the evaluation and reporting of smart and sustainable cities.
In order to provide standardized metrics for smart cities’ analysis, the World Council on City Data (WCCD) and the Global Cities Registry developed the first certification system based on ISO 37120. WCCD leads the development of standards to create smart, sustainable, and resilient cities, which must follow the standards set out by ISO 37120 [107]. These indicators have been tested by the GlobalCity Indicators Facility in more than 250 member cities worldwide. The standard is a measurement model for cities that want to become smart and sustainable.
Currently, the WCCD Global Cities Registry has 103 cities certified based on ISO 37120. In 2018, the following cities obtained a platinum certification level: Piedras Negras (Mexico), Welland (Canada), Mississauga (Canada), Taipei (Taiwan), Aalter (Belgium), Tainan City (Taiwan), Brisbane (Australia), Whitby (Canada), Oakville (Canada), Quebec City (Canada), and Kópavogur (Iceland) [108]. In 2019, the platinum cities were Guadalupe (Mexico), Guelph (Canada), Mississauga (Canada), Whitby (Canada), and Brisbane (Australia).
In addition to the WCCD, there are studies that present structures to identify the level of smartness of a city, although it is not characterized as a maturity model (MM), being only a structure that evaluates and ranks the analyzed cities using a set of smart indicators. In these studies, the IDC Smart City Maturity Model (IDC SCMM) developed by Clarke [109] is an MM aimed at smart cities, which makes an assessment of the current state as a planning tool. The model does not provide any calculation measures and also does not present its composition of indicators.
The Maturity Model to Measure and Compare Inequality in Brazilian Cities (Br-SCMM), proposed by Afonso et al. [110], offers a tool to identify areas and objectives to be strategically planned towards a smart city paradigm. Br-SCMM uses only the Z-score to define the value of the indicator and, given the values established by the statistical method, it incorporates them in the established levels of maturity, with five levels of maturity.
The Smart City Maturity Model, developed by Sustainability Outlook (SO SCMM) and proposed by Mani and Banerjee [111], provides a comprehensive set of indicators based on ISO 37120. This maturity model consists of an evaluation framework and a solution framework. The assessment framework helps a city or a state assess the conditions of its social, physical, and technological developments, identifying its readiness for the implementation of smart city solutions. As a form of calculation, it presents a structured ranking, based on the number of computed indicators, and determines the level of maturity of the city.
Considering its purpose, the IDC SCMM, Br-SCMM, and SO SCMM are models that focus on the assessment of the current state of the city. Although Br-SCMM and SO SCMM fulfill their goal of allowing an assessment of the city by providing measurements, even if only for the first level, IDCSCMM fails to do so. Despite its intention to assess the current state of a city, the model does not provide measures to achieve such a proposal, nor does it guide how to do so.
Góngora and Bernal [112] presented a validation of the maturity model for information technology management in smart cities. The model proposed for Colombian cities is still in the testing phase, and it did not present its calculation steps. Anand et al. [113] used the fuzzy-AHP technique to identify the importance of sustainability-oriented indicators for a smart city. They also used data envelopment analysis (DEA) to determine the efficiency of each indicator. It allowed them to identify which sustainability indicators have poor results, thus focusing on improving the performance of these indicators. Anthopoulos and Giannakidis [114] conducted a study that focused on standardizing the process of formulating public policies in smart cities. It used the task-based modeling method to map the process of formulating policies related to the public planning of a city and identified the groups of criteria. Later, the study used the Promethee multicriteria technique to identify the underperforming scenarios. In addition, it identified nine cities in the world [38,115,116] (Curitiba, Seattle, Surrey, Dubai, Songdo, Amsterdam, Barcelona, Copenhagen, Vienna) that have already been recognized as cities that stand out in some of the six dimensions [105] for a smart city.
These studies show that the present structures for monitoring the smartness of a city are mostly supported by ISO indicators, but these structures are not clear regarding their calculations and are flawed for presenting proposals for improvements in smart dimensions, which makes the structures complex in their replication.
Several aspects must be taken into consideration when choosing the indicators to measure urban characteristics, such as the relevance of the indicator for the region studied, the possibility of measuring the trend over time, and its relationship among the indicators, since it should assist in the development of strategic decision-making in the analyzed city [117,118]. In the combination of the different indicators for the composition of a synthetic indicator [119], a series of techniques can be used in the stages of standardization, weighting, and aggregation.
In this context, several studies have been carried out using multicriteria methods for the construction of indicators, which can be elementary methods such as SAW, WPM, and AHP [45,46,47,48,49,50,51]; utility-value-based methods such as MAUT, MAVT, SMART, and MACBETH [52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68]; methods based on peer comparison such as ELECTRE and PROMETHEE [69,70,71,72,73,74]; methods based on data envelopment analysis such as MCDM-DEA and BoD [75,76,77,78,79,80,81,82,83,84,85,86]; and methods based on distance functions such as the goal programming method, commitment programming methods, TOPSIS, and GRA [87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104]. Not all of these methods are characterized as noncompensatory. The SAW, UTA, SMART, DEA, and TOPSIS methods are characterized by total compensation between the criteria; the methods MAUT and MAVT adopt multiplicative functions in their mathematical composition, limiting the compensation between the criteria; and the ELECTRE and PROMETHEE methods are characterized as noncompensatory methods [120].

3. Materials and Methods

The first stage of the proposed model refers to the definition of the levels of maturity that characterize a city as smart. This stage was supported by the five reference levels presented in ISO 37153:2017—Smart community infrastructures—Maturity model for assessment and improvement and ISO 37107:2019 Sustainable cities and communities—Maturity model for smart sustainable communities [121,122].
The characterization of the maturity levels that compose the MMSC was based on the levels proposed by ISO 37153:2017 and ISO 37107:2019. The levels of the MMSC are:
  • Level 1—No smartness infrastructure working;
  • Level 2—Smartness working but not meeting future needs;
  • Level 3—Smartness meets current needs;
  • Level 4—Smartness partially initiated for future needs;
  • Level 5—Smartness continuously improving to meet future needs.
It is noteworthy that ISO 37153:2017 and ISO 37107:2019, when defining the performance of the maturity levels, are presented qualitatively and each level assumes that the requirements of the previous levels have been met. Thus, for the levels to be measured quantitatively, we will use the system of standards and classification for urban sustainability indicators proposed by Wang and Xu [123] and Li et al. [124]. Table 1 lists the smart axis/dimension classification criteria proposed by these authors.
The model variables will be considered here as “smart axes”. The “smart axes” encloses the “smart dimensions”, which, in turn, include the “smart indicators” group. The smart axes ( E s ) represent the characteristics that a smart city should have. The smart dimensions ( D s ) define the theme of each indicator, and the smart indicators ( I s ) measure the smartness performance of a city.
The first variables to be defined in the proposed model are the smart axes. Some authors have systematized the smart cities approach in axes that guide the sets of indicators, which will be part of the smart city assessment tools. Giffinger et al. [105] conceptualized six axes for a smart city, which are smart economy, smart people, smart living, smart governance, smart mobility, and smart environment. Subsequently, the evaluation alternatives were defined as utopian city ( A + ), reference city ( A R ), real city (A), and limit city ( A 0 ). For the six smart axes, based on ISO 37120:2018 (Sustainable cities and communities—Indicators for city services and quality of life), we identified 19 smart dimensions, which in turn have 111 indicators that will compose the MMSC. ISO 37120:2018 presents 19 dimensions for smart cities, which aim to guide and evaluate the performance management of urban activities. This standard considers sustainability as its general principle and the “smart city” as a guiding concept in the development of urban spaces.
Therefore, for each dimension, we defined respective indicators, as prescribed by ISO 37120:2018. Thus, the study contemplates the 6 smart axes conceptualized by Giffinger et al. [105]; the 19 smart dimensions and 111 smart indicators conceptualized by ISO 37120:2018; and the levels of maturity conceptualized by ISO 37153:2017 and ISO 37107:2019. Figure 2 presents the hierarchical structure of the MMSC.

Model Methodology

To achieve the study goal, we developed a methodology for a maturity model for smart cities. The multicriteria method Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) used in this step was proposed by Tzeng and Huang [125] and has been used in several works; it is one of the most widely used multicriteria methods [126], and it stands out for looking for the alternative that is furthest from the negative ideal solution and closer to the positive ideal solution. In this study, the TOPSIS method was structured as a mathematical instrument for measuring the MMSC smartness in the health area [127,128], environment and sustainability [129,130,131,132,133,134,135,136,137,138], technology [139,140,141,142,143,144], and urban spaces and developments [145,146,147,148,149], among many others in the engineering fields [150,151,152,153,154,155,156,157,158,159,160,161,162].
The method starts with the construction of the decision matrix with the data of each indicator for each city, followed by the normalization process, by using the following equation:
r i j = x i j / i = 1 m x i j
where r i j is between 0 and 1.
In the sequence, it is necessary to weigh the matrix. The v i j elements of the weighted normalized matrix are calculated using the following equation:
v i j = ω i · r i j , j = 1 , . . . , m ; i = 1 , . . . , n
With the normalized and weighted matrix, the next step is to determine the positive ideal ( A * ) and negative ideal ( A ) solution using the following equations:
A * = { v i + , . . . , v n + } = { ( m a x j v i j i B ) , ( m i n j v i j i C ) }
A = { v i , . . . , v n } = { ( m i n j v i j i B ) , ( m a x j v i j i C ) }
where B are the benefit (or maximization) criteria and C are the cost (or minimization) criteria.
In this methodology, we modified the TOPSIS method. We give the positive ideal solution the value of 1 for maximization criteria and 0 for minimization criteria, and for the negative ideal solution, maximizing criteria have a value of 0 and minimization criteria a value of 1. This change in method occurred to measure the maturity of the smart city.
Then, the method calculates the Euclidean distance between each alternative to the positive ideal solution ( S * ) and the negative ideal solution ( S ), respectively, according to the following equations:
S i * = j = 1 n v i j v j * 2
S i = j = 1 n v i j v j 2
Finally, the last step of the method consists of determining the relative proximity of each alternative ( C i * ) tothe positive ideal solution, using the following equation:
C i * = S i S i * + S i
From the values of the C C i of each city, the smart index ( I s m a r t ) is calculated, which determines the maturity level of the real city, as shown in Equation (8).
I s m a r t = A n A +
Note that in the proposed model, the axes, dimensions, and indicators have the same importance. The study proposed by Vavrek and Chovancová [163] reports that it is not possible to determine the weight of an extensive set of indicators (as in this case) using expert opinion; thus, the weights of the axes, dimensions, and indicators were defined by being equally distributed.
Unlike the original proposal of the TOPSIS method, the proposed model does not intend to generate a ranking among the alternatives ( A n ). Here, the TOPSIS is used to generate a synthetic indicator that measures the maturity level of a city in the smart context. Therefore, the utopian city ( A + ), reference city ( A R ), and limit city ( A 0 ) are fixed alternatives that will determine the maturity level of the real city (A).

4. Results

Application of the Maturity Model for Smart Cities

The Smart Cities Maturity Model (MMSC) was structured based on ISO 37153:2017, ISO 37107:2019, and ISO 37120:2018, which were tested using data from the city of London/UK. The British capital led the ranking of the IESE Business Schools Center for Globalization and Strategy for the year 2019.
The first step consists of applying the TOPSIS method. The weights (W) of the smart indicators are the same because when considering a smart city, all the variables that define it must be structured in an equal way, not compensating for the other variables. Thus, the decision matrix is first assembled with the 11 indicators (criteria) and the 4 alternatives: utopian city ( A + ), reference city ( A R ), limit city ( A 0 ), and real city (A) (Table 2).
The values of the utopian city indicators are utopian (in order of magnitude). The indicators of the reference city are represented by the best value among the most intelligent cities in the world according to IESE (London, New York, Amsterdam, Paris, and Reykjavík). Regarding the indicators of limit city, their values are represented by the minimum performance between London, New York, Amsterdam, Paris, and Reykjavík. Regarding the real city, the values of the London indicators were used.
The data referring to the indicators of the utopian city, limit city, reference city, and real city were extracted from the following databases: WCCD Global Cities Registry, Numbeo, The World Bank, Global SDG Indicators Database, World Health Organization.
After defining the values of each smart indicator and its respective alternative, the TOPSIS multicriteria method was applied. This method was used because it is quite widespread in the construction of synthetic indicators. For its use in this model, it was necessary to make a change in the method, and in the proposed model the alternatives utopian city, reference city, and limit city are fixed. Thus, they become fixed alternatives, since the focus is not to build a ranking, but, through the coefficient proximity to real city, generate a synthetic indicator that allows measuring its level of maturity.
Indicator values I.12, I.17, I.19, I.24, I.28, I.32, I.33, I.35, I.42, I.48, I.54, I.56, I.63, I.64, I.68, I.69, I.70, I.71, I.72, I.74, I.77, I.79, I.83, I.84, I.85, I.87, I.120, and I.121 were not found either, because they are not measured or the responsible authorities do not disclose them; thus, they were excluded from the analysis, but they should be used whenever available. Table 3 presents the initial decision matrix.
Table 4 shows the weighted normalized decision matrix, obtained by the application of Equations (1) and (2).
For the definition of the positive ideal and negative ideal solutions, the values were set to 1 for maximization criteria and 0 for minimization criteria in the positive ideal solution, and for the negative ideal solution, the maximization criteria received a value of 0 and the minimization received the value of 1. Applying Equations (5) and (6), it was possible to calculate the positive ideal and negative ideal distances, as shown in Table 5.
In the final step, the proximity coefficient C C i was calculated by Equations (7) and (8). The C C i defines the smart index that represents the cities maturity level. Table 6 show the values for this step.
Based on Table 1, which refers to the maturity levels defined by ISO 37153:2017 and ISO 37107:2019, and Table 1, which shows the values of these levels, London (represented here by the real city) is characterized as having a maturity level of 4. Therefore, the city is considered intelligent, with actions that meet the current needs within the concept of smartness. The other cities were used only to mark the smart index of the real city, which, in this case, is represented by London. Thus, the utopian city has a maturity level of 5, the limit city has a maturity level of 2, and the reference city has a maturity level of 4. Figure 3 presents a graph with the cities analyzed.
In addition, for the MMSC to be considered predescriptive in addition to measuring the level of maturity of the real city, it must still be able to drive improvements so that the indicators can increase its performance value. Thus, the present methodology presents as a gap the impracticality of the prescriptive part of the model, as there is a complexity inserted in being able to distinguish, from each axis, the dimensions and indicators that negatively impact the maturity of the smart city.

5. Conclusions

Currently, it is the ISO norms that deal with the city of the future, referring to sustainability as an “umbrella” that includes both the intelligence and the resilience of cities. It was in this sense that ISOs 37120:2018, 37122:2019, and 37123:2019 were developed so that they can structure indicators capable of measuring the performance of a city with a focus on improving municipal services and the quality of life in its environment.
ISO 37122:2019 proposes an extremely technological focus for world cities, which is very distant for developing countries such as Brazil, that has a lot to evolve in terms of urban intelligence and sustainability. Thus, this study was based on ISO 37120:2018 because it brings the indicators that are already measurable by large organizations around the world, making the application of the proposed model based on reliable data.
In this work, a modified TOPSIS method was used, and, unlike its original function that ranks the alternatives, here it was used to generate a synthetic indicator called the smart index. Another modification made to the method was concerning the alternatives, since the alternatives utopian city, reference city, and limit city were fixed to guide the level of smart maturity of a city. One of the disadvantages of the TOPSIS method is the reverse ranking, which does not occur with the proposed method change in this study. In this way, in a future application, the beacon cities remain and only the real city is modified. Finally, the last modification concerns the positive ideal and negative ideal values which, unlike the traditional method, are fixed at 1 and 0 here, allowing the model to analyze the city based on the best and worst possible scenario, even if this scenario is not present in the fixed alternatives (utopian, reference, and limit).
The proposed model proved to be efficient for assessing the smart maturity level of a city. Despite indicating the smart level of the analyzed city, the model does not allow each indicator to be assessed separately, making it difficult to identify the improved points in the city under analysis.
In addition, it is important to note that the proposed model can be easily adapted to measure the city’s maturity level for other ISOs, especially encompassing ISOs 37122:2019 and 37123:2019, which were not used in the study due to lack of reliable data regarding the indicators.
Despite its significant importance, for the model to be able to measure the maturity of the city, it is necessary to insert the largest number of indicators data, and these data need to be reliable. Many cities, despite calling themselves smart, do not disclose data related to indicators, even though they have actions related to them. Therefore, to be able to accurately measure the maturity of cities, these data must be easily accessible to researchers and nongovernmental organizations so that they can be analyzed constantly by the community.
Finally, the proposed MMSC has a quantitative structure with the aid of a hybrid multicriteria technique and variables belonging to internationally known standards, a structure that has not yet been explored in the literature so far.

Author Contributions

Conceptualization, L.H.N.M.; Methodology, D.M.d.G.C.; Investigation, A.L.C.C.; Data curation, E.V.A.; Writing—review & editing, F.C.Z.; Project administration, F.V.A.and J.C.C. All authors have read and agreed to the published version of the manuscript.

Funding

This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior Brasil (CAPES)—Finance Code 001.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. United Nations Department of Economic and Social Affairs/Population Division. World Urbanization Prospects: The 2009 Revision; United Nations Department of Economic and Social Affairs/Population Division: New York, NY, USA, 2006. [Google Scholar]
  2. Bolívar, M.P.R. Mapping dimensions of governance in smart cities: Practitioners versus prior research. In Proceedings of the Proceedings of the 17th International Digital Government Research Conference on Digital Government Research, ACM, Shanghai, China, 8–10 June 2016; pp. 312–324. [Google Scholar]
  3. Gil-Garcia, J.R.; Pardo, T.A.; Nam, T. What makes a city smart? Identifying core components and proposing an integrative and comprehensive conceptualization. Inf. Polity 2015, 20, 61–87. [Google Scholar] [CrossRef]
  4. Pettit, C.; Lieske, S.N.; Jamal, M. CityDash: Visualising a changing city using open data. In Proceedings of the International Conference on Computers in Urban Planning and Urban Management; Springer: Cham, Switzerland, 2017; pp. 337–353. [Google Scholar]
  5. Mello, V.G.; Kovaleski, J.L.; Zola, F.C.; Lima Junior, F.R.; Aragão, F.V.; Chiroli, D.M.G. Proposal of a Fuzzy-QFD model for startup selection. Technol. Anal. Strateg. Manag. 2022, 34, 1–16. [Google Scholar] [CrossRef]
  6. Soares, A.M.; Kovaleski, J.L.; Gaia, S.; Chiroli, D.M.G. Building sustainable development through technology transfer offices: An approach based on levels of maturity. Sustainability 2020, 12, 1795. [Google Scholar] [CrossRef] [Green Version]
  7. Alizadeh, T. An investigation of IBM’s Smarter Cites Challenge: What do participating cities want? Cities 2017, 63, 70–80. [Google Scholar] [CrossRef]
  8. Yigitcanlar, T.; Kamruzzaman, M.; Foth, M.; Sabatini-Marques, J.; da Costa, E.; Ioppolo, G. Can cities become smart without being sustainable? A systematic review of the literature. Sustain. Cities Soc. 2019, 45, 348–365. [Google Scholar] [CrossRef]
  9. Bibri, S.E. A foundational framework for smart sustainable city development: Theoretical, disciplinary, and discursive dimensions and their synergies. Sustain. Cities Soc. 2018, 38, 758–794. [Google Scholar] [CrossRef]
  10. de Moura, E.H.; Cruz, T.B.R.; Chiroli, D.M.G. A framework proposal to integrate humanitarian logistics practices, disaster management and disaster mutual assistance: A Brazilian case. Safety Sci. 2020, 132, 104965. [Google Scholar] [CrossRef]
  11. Chourabi, H.; Nam, T.; Walker, S.; Gil-Garcia, J.R.; Mellouli, S.; Nahon, K.; Pardo, T.A.; Scholl, H.J. Understanding smart cities: An integrative framework. In Proceedings of the 2012 45th Hawaii International Conference on System Sciences, Maui, HI, USA, 4–7 January 2012; pp. 2289–2297. [Google Scholar]
  12. Komninos, N. The architecture of intelligent cities. Intell. Environ. 2006, 6, 53–61. [Google Scholar]
  13. Capdevila, I.; Zarlenga, M.I. Smart city or smart citizens? The Barcelona case. J. Strategy Manag. 2015, 8, 266–282. [Google Scholar] [CrossRef]
  14. Hatuka, T.; Rosen-Zvi, I.; Birnhack, M.; Toch, E.; Zur, H. The political premises of contemporary urban concepts: The global city, the sustainable city, the resilient city, the creative city, and the smart city. Plan. Theory Pract. 2018, 19, 160–179. [Google Scholar] [CrossRef]
  15. Sanseverino, E.R. The Role of Technology in Participative Processes. In Smart Cities Atlas; Springer: Cham, Switzerland, 2017; pp. 207–231. [Google Scholar]
  16. Pinna, F.; Masala, F.; Garau, C. Urban policies and mobility trends in Italian smart cities. Sustainability 2017, 9, 494. [Google Scholar] [CrossRef] [Green Version]
  17. Kummitha, R.K.R.; Crutzen, N. How do we understand smart cities? An evolutionary perspective. Cities 2017, 67, 43–52. [Google Scholar] [CrossRef]
  18. Caragliu, A.; Del Bo, C.; Nijkamp, P. Smart cities in Europe. J. Urban Technol. 2011, 18, 65–82. [Google Scholar] [CrossRef]
  19. Mashal, I.; Alsaryrah, O.; Chung, T.Y.; Yuan, F.C. A multi-criteria analysis for an internet of things application recommendation system. Technol. Soc. 2020, 60, 101216. [Google Scholar] [CrossRef]
  20. Mattoni, B.; Pompei, L.; Losilla, J.; Bisegna, F. Planning smart cities: Comparison of two quantitative multicriteria methods applied to real case studies. Sustain. Cities Soc. 2020, 60, 102249. [Google Scholar] [CrossRef]
  21. Wang, M.; Zhou, T.; Wang, D. Tracking the evolution processes of smart cities in China by assessing performance and efficiency. Technol. Soc. 2020, 63, 101353. [Google Scholar] [CrossRef]
  22. Braga, I.F.; Ferreira, F.A.; Ferreira, J.J.; Correia, R.J.; Pereira, L.F.; Falcão, P.F. A DEMATEL analysis of smart city determinants. Technol. Soc. 2021, 66, 101687. [Google Scholar] [CrossRef]
  23. Neirotti, P.; De Marco, A.; Cagliano, A.C.; Mangano, G.; Scorrano, F. Current trends in Smart City initiatives: Some stylised facts. Cities 2014, 38, 25–36. [Google Scholar] [CrossRef] [Green Version]
  24. Kitchin, R. Making sense of smart cities: Addressing present shortcomings. Camb. J. Reg. Econ. Soc. 2015, 8, 131–136. [Google Scholar] [CrossRef] [Green Version]
  25. Albino, V.; Berardi, U.; Dangelico, R.M. Smart cities: Definitions, dimensions, performance, and initiatives. J. Urban Technol. 2015, 22, 3–21. [Google Scholar] [CrossRef]
  26. Walravens, N.; Ballon, P. Platform business models for smart cities: From control and value to governance and public value. IEEE Commun. Mag. 2013, 51, 72–79. [Google Scholar] [CrossRef]
  27. Anthopoulos, L. Smart utopia VS smart reality: Learning by experience from 10 smart city cases. Cities 2017, 63, 128–148. [Google Scholar] [CrossRef]
  28. Anthopoulos, L.; Janssen, M.; Weerakkody, V. Anthopoulos, L.; Janssen, M.; Weerakkody, V. A Unified Smart City Model (USCM) for smart city conceptualization and benchmarking. In Smart Cities and Smart Spaces: Concepts, Methodologies, Tools, and Applications; IGI Global: Hershey, PA, USA, 2019; pp. 247–264. [Google Scholar]
  29. Silva, B.N.; Khan, M.; Han, K. Towards sustainable smart cities: A review of trends, architectures, components, and open challenges in smart cities. Sustain. Cities Soc. 2018, 38, 697–713. [Google Scholar] [CrossRef]
  30. Aragão, F.V.; Gomes, P.F.d.O.; Chiroli, D.d.G.; Zola, F.C.; Rocha Loures, E.d.F.; Santos, E.A.P.; Colmenero, J.C. Projects aimed at smart cities: A hybrid MCDA evaluation approach. Technol. Anal. Strateg. Manag. 2021, 33, 1–13. [Google Scholar] [CrossRef]
  31. Kusumastuti, R.D.; Nurmala, N.; Rouli, J.; Herdiansyah, H. Analyzing the factors that influence the seeking and sharing of information on the smart city digital platform: Empirical evidence from Indonesia. Technol. Soc. 2022, 68, 101876. [Google Scholar] [CrossRef]
  32. United Nations. The 2030 Agenda for Sustainable Development; United Nations: New York, NY, USA, 2015. [Google Scholar]
  33. Röglinger, M.; Pöppelbuß, J.; Becker, J. Maturity models in business process management. Bus. Process. Manag. J. 2012, 18, 328–346. [Google Scholar] [CrossRef]
  34. Becker, J.; Knackstedt, R.; Pöppelbuß, J. Developing maturity models for IT management. Bus. Inf. Syst. Eng. 2009, 1, 213–222. [Google Scholar] [CrossRef]
  35. van Hillegersberg, J. The Need for a Maturity Model for Maturity Modeling. In The Art of Structuring; Springer: Enschede, The Netherlands, 2019; pp. 145–151. [Google Scholar]
  36. Torrinha, P.; Machado, R.J. Assessment of maturity models for smart cities supported by maturity model design principles. In Proceedings of the 2017 IEEE International Conference on Smart Grid and Smart Cities (ICSGSC), Singapore, 23–26 July 2017; IEEE: Piscataway, NJ, USA; pp. 252–256. [Google Scholar]
  37. Mattoni, B.; Gugliermetti, F.; Bisegna, F. A multilevel method to assess and design the renovation and integration of Smart Cities. Sustain. Cities Soc. 2015, 15, 105–119. [Google Scholar] [CrossRef]
  38. Cledou, G.; Estevez, E.; Barbosa, L.S. A taxonomy for planning and designing smart mobility services. Gov. Inf. Q. 2018, 35, 61–76. [Google Scholar] [CrossRef]
  39. Sharifi, A. A critical review of selected smart city assessment tools and indicator sets. J. Clean. Prod. 2019, 233, 1269–1283. [Google Scholar] [CrossRef]
  40. Vidiasova, L.; Kachurina, P.; Cronemberger, F. Smart cities prospects from the results of the world practice expert benchmarking. Procedia Comput. Sci. 2017, 119, 269–277. [Google Scholar] [CrossRef]
  41. Firmansyah, H.S.; Supangkat, S.H.; Arman, A.A.; Giabbanelli, P.J. Identifying the Components and Interrelationships of Smart Cities in Indonesia: Supporting Policymaking via Fuzzy Cognitive Systems. IEEE Access 2019, 7, 46136–46151. [Google Scholar] [CrossRef]
  42. Warnecke, D.; Wittstock, R.; Teuteberg, F. Benchmarking of European smart cities—A maturity model and web-based self-assessment tool. Sustain. Accounting, Manag. Policy J. 2019, 10, 654–684. [Google Scholar] [CrossRef]
  43. ISO 37120; Sustainable Cities and Communities—Indicators for City Services and Quality of Life. International Organization for Standardization: Geneva, Switzerland, 2018.
  44. Soyata, T.; Habibzadeh, H.; Ekenna, C.; Nussbaum, B.; Lozano, J. Smart City in Crisis: Technology and Policy Concerns. Sustain. Cities Soc. 2019, 50, 101566. [Google Scholar] [CrossRef]
  45. Haider, H.; Hewage, K.; Umer, A.; Ruparathna, R.; Chhipi-Shrestha, G.; Culver, K.; Holland, M.; Kay, J.; Sadiq, R. Sustainability assessment framework for small-sized urban neighbourhoods: An application of fuzzy synthetic evaluation. Sustain. Cities Soc. 2018, 36, 21–32. [Google Scholar] [CrossRef]
  46. Zhou, P.; Ang, B.; Poh, K. Comparing aggregating methods for constructing the composite environmental index: An objective measure. Ecol. Econ. 2006, 59, 305–311. [Google Scholar] [CrossRef]
  47. Kropp, W.W.; Lein, J.K. Assessing the geographic expression of urban sustainability: A scenario based approach incorporating spatial multicriteria decision analysis. Sustainability 2012, 4, 2348–2365. [Google Scholar] [CrossRef] [Green Version]
  48. Giannetti, B.; Bonilla, S.; Silva, C.; Almeida, C. The reliability of experts’ opinions in constructing a composite environmental index: The case of ESI 2005. J. Environ. Manag. 2009, 90, 2448–2459. [Google Scholar] [CrossRef]
  49. Arbolino, R.; De Simone, L.; Carlucci, F.; Yigitcanlar, T.; Ioppolo, G. Towards a sustainable industrial ecology: Implementation of a novel approach in the performance evaluation of Italian regions. J. Clean. Prod. 2018, 178, 220–236. [Google Scholar] [CrossRef] [Green Version]
  50. Azevedo, S.G.; Govindan, K.; Carvalho, H.; Cruz-Machado, V. An integrated model to assess the leanness and agility of the automotive industry. Resour. Conserv. Recycl. 2012, 66, 85–94. [Google Scholar] [CrossRef]
  51. Wang, Y.M.; Luo, Y. Integration of correlations with standard deviations for determining attribute weights in multiple attribute decision making. Math. Comput. Model. 2010, 51, 1–12. [Google Scholar] [CrossRef]
  52. Hajkowicz, S. Multi-attributed environmental index construction. Ecol. Econ. 2006, 57, 122–139. [Google Scholar] [CrossRef]
  53. Van Calker, K.; Berentsen, P.; Romero, C.; Giesen, G.; Huirne, R. Development and application of a multi-attribute sustainability function for Dutch dairy farming systems. Ecol. Econ. 2006, 57, 640–658. [Google Scholar] [CrossRef]
  54. Frank, A.G.; Dalle Molle, N.; Gerstlberger, W.; Bernardi, J.A.B.; Pedrini, D.C. An integrative environmental performance index for benchmarking in oil and gas industry. J. Clean. Prod. 2016, 133, 1190–1203. [Google Scholar] [CrossRef]
  55. Cracolici, M.F.; Nijkamp, P. The attractiveness and competitiveness of tourist destinations: A study of Southern Italian regions. Tour. Manag. 2009, 30, 336–344. [Google Scholar] [CrossRef]
  56. Würtenberger, L.; Koellner, T.; Binder, C.R. Virtual land use and agricultural trade: Estimating environmental and socio-economic impacts. Ecol. Econ. 2006, 57, 679–697. [Google Scholar] [CrossRef]
  57. Dantsis, T.; Douma, C.; Giourga, C.; Loumou, A.; Polychronaki, E.A. A methodological approach to assess and compare the sustainability level of agricultural plant production systems. Ecol. Indic. 2010, 10, 256–263. [Google Scholar] [CrossRef]
  58. Langhans, S.D.; Reichert, P.; Schuwirth, N. The method matters: A guide for indicator aggregation in ecological assessments. Ecol. Indic. 2014, 45, 494–507. [Google Scholar] [CrossRef] [Green Version]
  59. Carayannis, E.G.; Grigoroudis, E.; Goletsis, Y. A multilevel and multistage efficiency evaluation of innovation systems: A multiobjective DEA approach. Expert Syst. Appl. 2016, 62, 63–80. [Google Scholar] [CrossRef]
  60. Grigoroudis, E.; Orfanoudaki, E.; Zopounidis, C. Strategic performance measurement in a healthcare organisation: A multiple criteria approach based on balanced scorecard. Omega 2012, 40, 104–119. [Google Scholar] [CrossRef]
  61. Papapostolou, A.; Karakosta, C.; Nikas, A.; Psarras, J. Exploring opportunities and risks for RES-E deployment under Cooperation Mechanisms between EU and Western Balkans: A multi-criteria assessment. Renew. Sustain. Energy Rev. 2017, 80, 519–530. [Google Scholar] [CrossRef]
  62. Plakas, K.; Georgiadis, A.; Karabelas, A. Sustainability assessment of tertiary wastewater treatment technologies: A multi-criteria analysis. Water Sci. Technol. 2016, 73, 1532–1540. [Google Scholar] [CrossRef] [PubMed]
  63. Bezama, A.; Szarka, N.; Wolfbauer, J.; Lorber, K.E. Application of a balanced scorecard system for supporting decision-making in contaminated sites remediation. Water Air Soil Pollut. 2007, 181, 3–16. [Google Scholar] [CrossRef]
  64. Clivillé, V.; Berrah, L.; Mauris, G. Quantitative expression and aggregation of performance measurements based on the MACBETH multi-criteria method. Int. J. Prod. Econ. 2007, 105, 171–189. [Google Scholar] [CrossRef]
  65. Marques, G.; Gourc, D.; Lauras, M. Multi-criteria performance analysis for decision making in project management. Int. J. Proj. Manag. 2011, 29, 1057–1069. [Google Scholar] [CrossRef]
  66. Junior, A.G.M.; Junior, M.M.C.; Belderrain, M.C.N.; Correia, A.R.; Schwanz, S.H. Multicriteria and multivariate analysis for port performance evaluation. Int. J. Prod. Econ. 2012, 140, 450–456. [Google Scholar]
  67. Lavoie, R.; Deslandes, J.; Proulx, F. Assessing the ecological value of wetlands using the MACBETH approach in Quebec City. J. Nat. Conserv. 2016, 30, 67–75. [Google Scholar] [CrossRef]
  68. Rodrigues, T.C.; Montibeller, G.; Oliveira, M.D.; e Costa, C.A.B. Modelling multicriteria value interactions with reasoning maps. Eur. J. Oper. Res. 2017, 258, 1054–1071. [Google Scholar] [CrossRef] [Green Version]
  69. Attardi, R.; Cerreta, M.; Sannicandro, V.; Torre, C.M. Non-compensatory composite indicators for the evaluation of urban planning policy: The Land-Use Policy Efficiency Index (LUPEI). Eur. J. Oper. Res. 2018, 264, 491–507. [Google Scholar] [CrossRef]
  70. Petrović, M.; Bojković, N.; Anić, I.; Stamenković, M.; Tarle, S.P. An ELECTRE-based decision aid tool for stepwise benchmarking: An application over EU Digital Agenda targets. Decis. Support Syst. 2014, 59, 230–241. [Google Scholar] [CrossRef]
  71. Wu, Y.; Zhang, J.; Yuan, J.; Geng, S.; Zhang, H. Study of decision framework of offshore wind power station site selection based on ELECTRE-III under intuitionistic fuzzy environment: A case of China. Energy Convers. Manag. 2016, 113, 66–81. [Google Scholar] [CrossRef]
  72. Antanasijević, D.; Pocajt, V.; Ristić, M.; Perić-Grujić, A. A differential multi-criteria analysis for the assessment of sustainability performance of European countries: Beyond country ranking. J. Clean. Prod. 2017, 165, 213–220. [Google Scholar] [CrossRef]
  73. Hernandez-Perdomo, E.A.; Mun, J. Active management in state-owned energy companies: Integrating a real options approach into multicriteria analysis to make companies sustainable. Appl. Energy 2017, 195, 487–502. [Google Scholar] [CrossRef]
  74. Hély, V.; Antoni, J.P. Combining indicators for decision making in planning issues: A theoretical approach to perform sustainability assessment. Sustain. Cities Soc. 2019, 44, 844–854. [Google Scholar] [CrossRef]
  75. Cherchye, L.; Lovell, C.K.; Moesen, W.; Van Puyenbroeck, T. One market, one number? A composite indicator assessment of EU internal market dynamics. Eur. Econ. Rev. 2007, 51, 749–779. [Google Scholar] [CrossRef]
  76. Cherchye, L.; Moesen, W.; Rogge, N.; Van Puyenbroeck, T.; Saisana, M.; Saltelli, A.; Liska, R.; Tarantola, S. Creating composite indicators with DEA and robustness analysis: The case of the Technology Achievement Index. J. Oper. Res. Soc. 2008, 59, 239–251. [Google Scholar] [CrossRef]
  77. Murias, P.; de Miguel, J.C.; Rodríguez, D. A composite indicator for university quality assesment: The case of Spanish higher education system. Soc. Indic. Res. 2008, 89, 129–146. [Google Scholar] [CrossRef]
  78. Dobos, I.; Vörösmarty, G. Green supplier selection and evaluation using DEA-type composite indicators. Int. J. Prod. Econ. 2014, 157, 273–278. [Google Scholar] [CrossRef]
  79. Martí, L.; Martín, J.C.; Puertas, R. A DEA-logistics performance index. J. Appl. Econ. 2017, 20, 169–192. [Google Scholar] [CrossRef]
  80. Amado, C.A.; São José, J.M.; Santos, S.P. Measuring active ageing: A data envelopment analysis approach. Eur. J. Oper. Res. 2016, 255, 207–223. [Google Scholar] [CrossRef]
  81. Hatefi, S.; Torabi, S. A common weight MCDA–DEA approach to construct composite indicators. Ecol. Econ. 2010, 70, 114–120. [Google Scholar] [CrossRef]
  82. Rogge, N. On aggregating benefit of the doubt composite indicators. Eur. J. Oper. Res. 2018, 264, 364–369. [Google Scholar] [CrossRef]
  83. Verbunt, P.; Rogge, N. Geometric composite indicators with compromise Benefit-of-the-Doubt weights. Eur. J. Oper. Res. 2018, 264, 388–401. [Google Scholar] [CrossRef]
  84. Van Puyenbroeck, T.; Rogge, N. Geometric mean quantity index numbers with Benefit-of-the-Doubt weights. Eur. J. Oper. Res. 2017, 256, 1004–1014. [Google Scholar] [CrossRef]
  85. Kao, C.; Hung, H.T. Management performance: An empirical study of the manufacturing companies in Taiwan. Omega 2007, 35, 152–160. [Google Scholar] [CrossRef]
  86. Zhou, P.; Ang, B.; Poh, K. A mathematical programming approach to constructing composite indicators. Ecol. Econ. 2007, 62, 291–297. [Google Scholar] [CrossRef]
  87. Blancas, F.J.; Caballero, R.; González, M.; Lozano-Oyola, M.; Pérez, F. Goal programming synthetic indicators: An application for sustainable tourism in Andalusian coastal counties. Ecol. Econ. 2010, 69, 2158–2172. [Google Scholar] [CrossRef]
  88. Molinos-Senante, M.; Marques, R.C.; Perez, F.; Gómez, T.; Sala-Garrido, R.; Caballero, R. Assessing the sustainability of water companies: A synthetic indicator approach. Ecol. Indic. 2016, 61, 577–587. [Google Scholar] [CrossRef]
  89. Jadidi, O.; Cavalieri, S.; Zolfaghari, S. An improved multi-choice goal programming approach for supplier selection problems. Appl. Math. Model. 2015, 39, 4213–4222. [Google Scholar] [CrossRef]
  90. Voces, R.; Diaz-Balteiro, L.; Romero, C. Characterization and explanation of the sustainability of the European wood manufacturing industries: A quantitative approach. Expert Syst. Appl. 2012, 39, 6618–6627. [Google Scholar] [CrossRef]
  91. Trenado, M.; Romero, M.; Cuadrado, M.L.; Romero, C. Corporate social responsibility in portfolio selection: A “goal games” against nature approach. Comput. Ind. Eng. 2014, 75, 260–265. [Google Scholar] [CrossRef] [Green Version]
  92. Blancas, F.; Lozano-Oyola, M.; González, M.; Guerrero, F.M.; Caballero, R. How to use sustainability indicators for tourism planning: The case of rural tourism in Andalusia (Spain). Sci. Total. Environ. 2011, 412, 28–45. [Google Scholar] [CrossRef]
  93. Gu, D.X.; Liang, C.Y.; Bichindaritz, I.; Zuo, C.R.; Wang, J. A case-based knowledge system for safety evaluation decision making of thermal power plants. Knowl.-Based Syst. 2012, 26, 185–195. [Google Scholar] [CrossRef]
  94. Garcia, S.; Cintra, Y.; Rita de Cássia, S.; Lima, F.G. Corporate sustainability management: A proposed multi-criteria model to support balanced decision-making. J. Clean. Prod. 2016, 136, 181–196. [Google Scholar] [CrossRef]
  95. Wang, Q.; Dai, H.N.; Wang, H. A smart MCDM framework to evaluate the impact of air pollution on city sustainability: A case study from China. Sustainability 2017, 9, 911. [Google Scholar] [CrossRef] [Green Version]
  96. Wang, J.; Wang, Z.; Yang, C.; Wang, N.; Yu, X. Optimization of the number of components in the mixed model using multi-criteria decision-making. Appl. Math. Model. 2012, 36, 4227–4240. [Google Scholar] [CrossRef]
  97. Wang, D.; Wan, K.; Song, X. Coal miners’ livelihood vulnerability to economic shock: Multi-criteria assessment and policy implications. Energy Policy 2018, 114, 301–314. [Google Scholar] [CrossRef]
  98. Escrig-Olmedo, E.; Rivera-Lirio, J.M.; Muñoz-Torres, M.J.; Fernández-Izquierdo, M.Á. Integrating multiple ESG investors’ preferences into sustainable investment: A fuzzy multicriteria methodological approach. J. Clean. Prod. 2017, 162, 1334–1345. [Google Scholar] [CrossRef]
  99. Chen, F.; Wang, J.; Deng, Y. Road safety risk evaluation by means of improved entropy TOPSIS–RSR. Saf. Sci. 2015, 79, 39–54. [Google Scholar] [CrossRef]
  100. Boggia, A.; Massei, G.; Pace, E.; Rocchi, L.; Paolotti, L.; Attard, M. Spatial multicriteria analysis for sustainability assessment: A new model for decision making. Land Use Policy 2018, 71, 281–292. [Google Scholar] [CrossRef] [Green Version]
  101. Mi, Z.F.; Wei, Y.M.; He, C.Q.; Li, H.N.; Yuan, X.C.; Liao, H. Regional efforts to mitigate climate change in China: A multi-criteria assessment approach. Mitig. Adapt. Strateg. Glob. Chang. 2017, 22, 45–66. [Google Scholar] [CrossRef]
  102. Bao, Q.; Ruan, D.; Shen, Y.; Hermans, E.; Janssens, D. Improved hierarchical fuzzy TOPSIS for road safety performance evaluation. Knowl. Based Syst. 2012, 32, 84–90. [Google Scholar] [CrossRef]
  103. Hu, Y.J.; Li, X.Y.; Tang, B.J. Assessing the operational performance and maturity of the carbon trading pilot program: The case study of Beijing’s carbon market. J. Clean. Prod. 2017, 161, 1263–1274. [Google Scholar] [CrossRef]
  104. Jun, K.S.; Chung, E.S.; Sung, J.Y.; Lee, K.S. Development of spatial water resources vulnerability index considering climate change impacts. Sci. Total. Environ. 2011, 409, 5228–5242. [Google Scholar] [CrossRef] [PubMed]
  105. Giffinger, R.; Fertner, C.; Kramar, H.; Kalasek, R.; Pichler-Milanovic, N.; Meijers, E. Smart Cities-Ranking of European Medium-Sized Cities; Final Report; Vienna University of Technology: Vienna, Austria, 2007. [Google Scholar]
  106. Nam, T.; Pardo, T.A. Conceptualizing smart city with dimensions of technology, people, and institutions. In Proceedings of the Proceedings of the 12th Annual International Digital Government Research Conference: Digital Government Innovation in Challenging Times, ACM, College Park, MD, USA, 12–15 June 2011; pp. 282–291. [Google Scholar]
  107. Picioroagă, I.I.; Eremia, M.; Sănduleac, M. SMART CITY: Definition and Evaluation of Key Performance Indicators. In Proceedings of the 2018 International Conference and Exposition on Electrical And Power Engineering (EPE), Iasi, Romania, 18–19 October 2018; IEEE: Piscataway, NJ, USA; pp. 217–222. [Google Scholar]
  108. Word Council on City Data—WCCD. CITY DATA FOR THE UNITED NATIONS SUSTAINABLE DEVELOPMENT GOALS. World Council on City Data, Toronto. 2019. Available online: https://www.dataforcities.org/wccd-iso-37120-series-on-city-data (accessed on 8 November 2022).
  109. Clarke, R.Y. Smart Cities and the Internet of Everything: The Foundation for Delivering Next-Generation Citizen Services. 2013. Available online: https://www.google.com.hk/search?q=Smart+cities+and+the+internet+of+everything%3A+The+foundation+for+++delivering+next-generation+citizen+services&hl=en&ei=0GjaY6TnOZqohwOU_Z2oAg&ved=0ahUKEwikj_nOtvT8AhUa1GEKHZR-ByUQ4dUDCA4&uact=5&oq=Smart+cities+and+the+internet+of+everything%3A+The+foundation+for+++delivering+next-generation+citizen+services&gs_lcp=Cgxnd3Mtd2l6LXNlcnAQA0oECEEYAEoECEYYAFDhBljhBmCyDmgAcAB4AIABAIgBAJIBAJgBAKABAqABAcABAQ&sclient=gws-wiz-serp (accessed on 8 November 2022).
  110. Afonso, R.A.; dos Santos Brito, K.; do Nascimento, C.H.; Garcia, V.C.; Álvaro, A. Brazilian smart cities: Using a maturity model to measure and compare inequality in cities. In Proceedings of the 16th Annual International Conference on Digital Government Research, ACM, Phoenix, AZ, USA, 27–30 May 2015; pp. 230–238. [Google Scholar]
  111. Mani, D.; Banerjee, S. Smart City Maturity Model (SCMM)-BSI. Retrieved May 2015, 14, 2017. [Google Scholar]
  112. Góngora, G.P.M.; Bernal, W.N. Validation architecture for information technology management in smart cities. In Proceedings of the 2016 11th Iberian Conference on Information Systems and Technologies (CISTI), Gran Canaria, Spain, 15–18 June 2016; IEEE: Piscataway, NJ, USA; pp. 1–6. [Google Scholar]
  113. Anand, A.; Rufuss, D.D.W.; Rajkumar, V.; Suganthi, L. Evaluation of sustainability indicators in smart cities for India using MCDM approach. Energy Procedia 2017, 141, 211–215. [Google Scholar] [CrossRef]
  114. Anthopoulos, L.; Giannakidis, G. Task-based process modeling for policy making in smart cities. In Proceedings of the 2016 ITU Kaleidoscope: ICTs for a Sustainable World (ITU WT), Bangkok, Thailand, 14–16 November 2016; IEEE: Piscataway, NJ, USA; pp. 1–8. [Google Scholar]
  115. Claudel, M.; Birolo, A.; Ratti, C. Government’s Role in Growing a Smart City. In Smart Cities as Democratic Ecologies; Palgrave Macmillan: London, UK, 2015; pp. 23–34. [Google Scholar]
  116. Anthopoulos, L.; Janssen, M.; Weerakkody, V. Smart service portfolios: Do the cities follow standards? In Proceedings of the 25th International Conference Companion on World Wide Web. International World Wide Web Conferences Steering Committee, Montréal, QC, Canada, 11–15 April 2016; pp. 357–362. [Google Scholar]
  117. Graymore, M.L.; Wallis, A.M.; Richards, A.J. An Index of Regional Sustainability: A GIS-based multiple criteria analysis decision support system for progressing sustainability. Ecol. Complex. 2009, 6, 453–462. [Google Scholar] [CrossRef]
  118. Hagerty, M.R.; Land, K.C. Constructing summary indices of social well-being: A model for the effect of heterogeneous importance weights. In Proceedings of the Revision of a paper presented at the annual meeting of the American Sociological Association, Davis, CA, USA, 16–19 August 2002. [Google Scholar]
  119. Bruni, E.; Panza, A.; Sarto, L.; Khayatian, F. Evaluation of cities’ smartness by means of indicators for small and medium cities and communities: A methodology for Northern Italy. Sustain. Cities Soc. 2017, 34, 193–202. [Google Scholar]
  120. El Gibari, S.; Gómez, T.; Ruiz, F. Building composite indicators using multicriteria methods: A review. J. Bus. Econ. 2019, 89, 1–24. [Google Scholar] [CrossRef]
  121. International Organization for Standardization. Smart Community Infrastructures—Maturity Model for Assessment and Improvement; International Organization for Standardization: Geneva, Switzerland, 2017. [Google Scholar]
  122. ISO/TS 37107:2019; Sustainable Cities and Communities—Maturity Model for Smart Sustainable Communities. International Organization for Standardization: Geneva, Switzerland, 2019.
  123. Wang, R.; Xu, H. A Comprehensive Approach for Yangzhou Eco-City Development; China Science and Technology Press: Beijing, China, 2005; pp. 3–20. [Google Scholar]
  124. Li, F.; Liu, X.; Hu, D.; Wang, R.; Yang, W.; Li, D.; Zhao, D. Measurement indicators and an evaluation approach for assessing urban sustainable development: A case study for China’s Jining City. Landsc. Urban Plan. 2009, 90, 134–142. [Google Scholar] [CrossRef]
  125. Tzeng, G.H.; Huang, J.J. Multiple Attribute Decision Making: Methods and Applications; Springer: Berlin/Heidelberg, Germany; CRC Press: Boca Raton, FL, USA, 2011. [Google Scholar]
  126. Behzadian, M.; Otaghsara, S.K.; Yazdani, M.; Ignatius, J. A state-of the-art survey of TOPSIS applications. Expert Syst. Appl. 2012, 39, 13051–13069. [Google Scholar] [CrossRef]
  127. Wielki, J.; Jurczyk-Bunkowska, M.; Madera, D. Application of TOPSIS Method for Evaluation of IT Application in the Hospital. In Proceedings of the European Conference on Knowledge Management. Academic Conferences International Limited, Lisbon, Portugal, 5–6 September 2019. [Google Scholar] [CrossRef]
  128. Aragão, F.V.; Zola, F.C.; Marinho, L.H.N.; de Genaro Chiroli, D.M.; Junior, A.B.; Colmenero, J.C. Choice of unmanned aerial vehicles for identification of mosquito breeding sites. Geospat. Health 2020, 15, 92–100. [Google Scholar] [CrossRef]
  129. Roszkowska, E.; Filipowicz-Chomko, M. Measuring Sustainable Development Using an Extended Hellwig Method: A Case Study of Education. Soc. Indic. Res. 2020, 153, 299–322. [Google Scholar] [CrossRef]
  130. Lan, H.; Pan, Y. Analysis and Research on Influencing Factors of Haze Weather. J. Phys. Conf. Ser. 2019, 1267, 012031. [Google Scholar] [CrossRef]
  131. Kamali, M.; Hewage, K.; Milani, A.S. Life cycle sustainability performance assessment framework for residential modular buildings: Aggregated sustainability indices. Build. Environ. 2018, 138, 21–41. [Google Scholar] [CrossRef]
  132. Kalbar, P.P.; Birkved, M.; Nygaard, S.E.; Hauschild, M. Weighting and aggregation in life cycle assessment: Do present aggregated single scores provide correct decision support? J. Ind. Ecol. 2017, 21, 1591–1600. [Google Scholar] [CrossRef] [Green Version]
  133. Gumus, S.; Kucukvar, M.; Tatari, O. Intuitionistic fuzzy multi-criteria decision making framework based on life cycle environmental, economic and social impacts: The case of US wind energy. Sustain. Prod. Consum. 2016, 8, 78–92. [Google Scholar] [CrossRef]
  134. Shafiee, M.; Saffarian, S.; Zaredar, N. Risk assessment of human activities on protected areas: A case study. Hum. Ecol. Risk Assessment Int. J. 2015, 21, 1462–1478. [Google Scholar] [CrossRef]
  135. Gallego-Ayala, J.; Dimene, C.; Munhequete, A.; Amos, R. Assessing the performance of urban water utilities in Mozambique using a water utility performance index. Water SA 2014, 40, 665–676. [Google Scholar] [CrossRef] [Green Version]
  136. Jozi, S.; Hosseini, S.; Khayatzadeh, A.; TABIB, S.M. Physical Risk Analysis of Construction Phase in Khuzestan Balarood Dam in Iran Using Multi-Attribute Decision Making Method. J. Environ. Stud. 2011, 36, 25–38. [Google Scholar]
  137. Nie, R.x.; Tian, Z.p.; Wang, J.q.; Zhang, H.y.; Wang, T.l. Water security sustainability evaluation: Applying a multistage decision support framework in industrial region. J. Clean. Prod. 2018, 196, 1681–1704. [Google Scholar] [CrossRef]
  138. Zola, F.C.; Colmenero, J.C.; Aragão, F.V.; Rodrigues, T.; Junior, A.B. Multicriterial model for selecting a charcoal kiln. Energy 2020, 190, 116377. [Google Scholar] [CrossRef]
  139. Liern, V.; Pérez-Gladish, B. Multiple criteria ranking method based on functional proximity index: Un-weighted TOPSIS. Ann. Oper. Res. 2020, 311, 1099–1121. [Google Scholar] [CrossRef]
  140. Zhang, H.; Liao, H.; Wu, X.; Zavadskas, E.K.; Al-Barakati, A. Internet Financial Investment Product Selection with Pythagorean Fuzzy DNMA Method. Eng. Econ. 2020, 31, 61–71. [Google Scholar] [CrossRef] [Green Version]
  141. He, W.; Wang, J.; Wu, B.; Luan, H.; Liang, H.; Chen, C. IoT Nodes Equipment Selection Based on MADM: A Case Study of Groundwater Quality Detection Equipment. In Proceedings of the 2019 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), Fukuoka, Japan, 5–8 August 2019; pp. 94–100. [Google Scholar]
  142. Murugaanandam, S.; Ganapathy, V. Reliability-based cluster head selection methodology using fuzzy logic for performance improvement in WSNs. IEEE Access 2019, 7, 87357–87368. [Google Scholar] [CrossRef]
  143. Prakash, S.; Patel, R.; Jain, V. A Multi-Attribute Intuitionistic Fuzzy Group Decision Method For Network Selection In Heterogeneous Wireless Networks Using TOPSIS. TIIS 2016, 10, 5229–5252. [Google Scholar]
  144. Chu, T.C.; Lin, Y.C. A fuzzy TOPSIS method for robot selection. Int. J. Adv. Manuf. Technol. 2003, 21, 284–290. [Google Scholar] [CrossRef]
  145. Wang, Z.; He, X.; Zhang, C.; Xu, J.; Wang, Y. Evaluation of Geological and Ecological Bearing Capacity and Spatial Pattern along Du-Wen Road Based on the Analytic Hierarchy Process (AHP) and the Technique for Order of Preference by Similarity to an Ideal Solution (TOPSIS) Method. ISPRS Int. J. Geo-Inf. 2020, 9, 237. [Google Scholar] [CrossRef]
  146. Pilehforooshha, P.; Karimi, M. An integrated framework for linear pattern extraction in the building group generalization process. Geocarto Int. 2019, 34, 1000–1021. [Google Scholar] [CrossRef]
  147. Ma, F.; Liu, F.; Sun, Q.; Wang, W.; Li, X. Measuring and Spatio-Temporal Evolution for the Late-Development Advantage in China’s Provinces. Sustainability 2018, 10, 2773. [Google Scholar] [CrossRef] [Green Version]
  148. Singaraju, S.; Pasupuleti, S.; Hernandez, E.A.; Uddameri, V. Prioritizing Groundwater Monitoring in Data Sparse Regions using Atanassov Intuitionistic Fuzzy Sets (A-IFS). Water Resour. Manag. 2018, 32, 1483–1499. [Google Scholar] [CrossRef]
  149. Zhu, S.; Li, D.; Feng, H. Is smart city resilient? Evidence from China. Sustain. Cities Soc. 2019, 50, 101636. [Google Scholar] [CrossRef]
  150. Lee, P.C.; Zhao, Y.; Lo, T.P.; Long, D. A multi-period comprehensive evaluation method of construction safety risk based on cloud model. J. Intell. Fuzzy Syst. 2019, 37, 5203–5215. [Google Scholar] [CrossRef]
  151. Thuong, N.T.H.; Zhang, R.; Li, Z.; Hong, P.T.D. Multi-criteria evaluation of financial statement quality based on hesitant fuzzy judgments with assessing attitude. Int. J. Manag. Sci. Eng. Manag. 2018, 13, 254–264. [Google Scholar] [CrossRef]
  152. Zhou, X.; Xu, Z. An integrated sustainable supplier selection approach based on hybrid information aggregation. Sustainability 2018, 10, 2543. [Google Scholar] [CrossRef] [Green Version]
  153. Bhandari, S.B.; Nalmpantis, D. Application of various multiple criteria analysis methods for the evaluation of rural road projects. Open Transp. J. 2018, 12, 57–76. [Google Scholar] [CrossRef]
  154. Haider, H.; Al-Salamah, I.S.; Ghumman, A.R. Development of groundwater quality index using fuzzy-based multicriteria analysis for Buraydah, Qassim, Saudi Arabia. Arab. J. Sci. Eng. 2017, 42, 4033–4051. [Google Scholar] [CrossRef]
  155. Cortes Arevalo, V.J.; Sterlacchini, S.; Bogaard, T.A.; Junier, S.; van de Giesen, N. Decision support method to systematically evaluate first-level inspections of the functional status of check dams. Struct. Infrastruct. Eng. 2016, 12, 1487–1504. [Google Scholar] [CrossRef] [Green Version]
  156. Li, M.; Wu, C. Green supplier selection based on improved intuitionistic fuzzy TOPSIS model. Metall. Min. Ind. 2015, 6, 193–205. [Google Scholar]
  157. Naim, S.; Hagras, H. A type 2-hesitation fuzzy logic based multi-criteria group decision making system for intelligent shared environments. Soft Comput. 2014, 18, 1305–1319. [Google Scholar] [CrossRef]
  158. Rao, R. Evaluation of environmentally conscious manufacturing programs using multiple attribute decision-making methods. Proc. Inst. Mech. Eng. Part J. Eng. Manuf. 2008, 222, 441–451. [Google Scholar] [CrossRef]
  159. Shih, H.S. Incremental analysis for MCDM with an application to group TOPSIS. Eur. J. Oper. Res. 2008, 186, 720–734. [Google Scholar] [CrossRef]
  160. Chu, T.C. Facility location selection using fuzzy TOPSIS under group decisions. Int. J. Uncertain. Fuzziness Knowl.-Based Syst. 2002, 10, 687–701. [Google Scholar] [CrossRef]
  161. Bai, S.; Hua, Q.; Elwert, T.; Wang, Q. Development of a method based on MADM theory for selecting a suitable cutting fluid for granite sawing process. J. Clean. Prod. 2018, 185, 211–229. [Google Scholar] [CrossRef]
  162. Bai, S.; Elwert, T.; Jia, S.; Wang, Q.; Liu, T.; Yao, R. Methodologies for evaluating sawability of ornamental granite and relation modeling combining sawability with environmental impacts: An application in a stone industrial park of China. J. Clean. Prod. 2020, 246, 119004. [Google Scholar] [CrossRef]
  163. Vavrek, R.; Chovancová, J. Assessment of economic and environmental energy performance of EU countries using CV-TOPSIS technique. Ecol. Indic. 2019, 106, 105519. [Google Scholar] [CrossRef]
Figure 1. Conceptual diagram.
Figure 1. Conceptual diagram.
Sustainability 15 06695 g001
Figure 2. Hierarchical structure of the problem.
Figure 2. Hierarchical structure of the problem.
Sustainability 15 06695 g002
Figure 3. Maturity level.
Figure 3. Maturity level.
Sustainability 15 06695 g003
Table 1. Value of maturity levels [123,124].
Table 1. Value of maturity levels [123,124].
LevelValueQualitative Evaluation
5>0.91Great
40.90–0.76Good
30.75–0.51Moderate
20.50–0.26Low
1<0.25Poor
Table 2. Alternatives.
Table 2. Alternatives.
CodeCity
A + Utopian
A 0 Limit
A R Reference
AReal
Table 3. Decision matrix.
Table 3. Decision matrix.
Index A + A 0 A R A (London)Index A + A 0 A R A (London)
I.110.06.02.82.8I.66345,000114,000129,000129,000
I.131.00.01.01.0I.67860.04.0700.013.5
I.140.01.00.00.1I.73502109480480
I.15100.00.09.39.3I.7564.70.01.21.2
I.16100.00.086.586.5I.760.0100.03.03.0
I.18920,000450,000515,811515,811I.7812.0162.020.0162.0
I.200.03.00.00.0I.801.010.02.15.1
I.210.025.00.20.2I.811.00.00.80.8
I.221.00.00.30.3I.821.00.01.01.0
I.230.050.031.030.6I.860.0168.024.04.0
I.250.02.00.00.1I.880.0125.025.00.1
I.260.02.00.00.0I.890.0250.050.050.0
I.270.031.027.026.8I.900.00.10.00.7
I.2924.05.018.018.0I.911.00.00.30.3
I.3040.05.022.014.0I.9201130200134
I.3110000676676I.9308002014
I.3410000.030.030.0I.94020010066
I.360.010.00.02.0I.950.085.070.053.4
I.371000010635635I.971.00.01.01.0
I.380.030.01.20.8I.981.00.0 1.0
I.3910000.010.021.717.7I.991.00.10.40.4
I.402.060.05.03.0I.100100328989
I.430.05.00.01.4I.1021.00.10.20.2
I.440.00.10.00.0I.1030.01.00.30.3
I.450.01.00.00.1I.1040.01.00.00.0
I.460100,00038108I.1050.0100.00.00.1
I.470.01.00.01.0I.1061.00.00.60.6
I.491.00.01.01.0I.1081.00.00.80.8
I.501.00.01.01.0I.1090.01.00.00.0
I.511.00.71.01.0I.1100.01.00.00.0
I.521.00.310.010.0I.1111.00.91.01.0
I.531.00.51.01.0I.1121.00.50.80.8
I.550.50.60.40.4I.1131.00.60.70.7
I.57100.080.0100.093.0I.1141.00.71.01.0
I.58100.036.0100.096.0I.1151.00.81.01.0
I.5985.025.083.083.0I.1161.00.91.01.0
I.601870.00.0650.0650.0I.1171070110110
I.611.00.00.50.5I.1181.00.10.20.2
I.620.01000.02.02.0I.1191070110110
I.65100,00078,00099,00099,000
Table 4. Normalized decision matrix.
Table 4. Normalized decision matrix.
Index A + A 0 A R A (London)Index r A + A 0 A R A (London)
I.110.000.520.240.24I.660.480.160.180.18
I.130.340.000.330.33I.670.550.000.440.01
I.140.000.900.040.06I.730.320.070.310.31
I.150.840.000.080.08I.750.960.000.020.02
I.160.370.000.320.32I.760.000.940.030.03
I.180.380.190.210.21I.780.030.460.060.46
I.200.001.000.000.00I.800.050.550.120.28
I.210.000.980.010.01I.810.390.000.300.30
I.220.660.000.170.17I.820.330.000.330.33
I.230.000.450.280.27I.860.000.860.120.02
I.250.000.950.000.05I.880.000.830.170.00
I.260.001.000.000.00I.890.000.710.140.14
I.270.000.370.320.32I.900.000.130.010.87
I.290.370.080.280.28I.910.600.000.200.20
I.300.490.060.270.17I.920.000.770.140.09
I.310.430.000.290.29I.930.000.960.020.02
I.340.000.890.110.00I.940.000.550.270.18
I.360.000.830.000.17I.950.000.410.340.26
I.370.890.000.060.06I.970.330.000.330.33
I.380.000.940.040.02I.980.510.000.000.49
I.391.000.000.000.00I.990.560.060.190.19
I.400.030.860.070.04I.1000.320.100.290.29
I.430.000.780.000.22I.1020.680.070.120.12
I.440.001.000.000.00I.1030.000.660.170.17
I.450.000.930.020.05I.1040.001.000.000.00
I.460.001.000.000.00I.1050.001.000.000.00
I.470.000.500.000.50I.1060.440.000.280.28
I.490.330.000.330.33I.1080.400.000.300.30
I.500.330.000.330.33I.1090.000.960.010.03
I.510.270.190.270.27I.1100.000.980.020.00
I.520.050.010.470.47I.1110.260.220.260.26
I.530.290.140.290.29I.1120.340.150.250.25
I.550.260.320.210.21I.1130.340.190.230.23
I.570.270.210.270.25I.1140.270.190.270.27
I.580.300.110.300.29I.1150.260.210.260.26
I.590.310.090.300.30I.1160.260.230.260.26
I.600.590.000.210.21I.1170.330.000.340.34
I.610.500.000.250.25I.1180.690.070.120.12
I.620.001.000.000.00I.1190.330.000.340.34
I.650.270.210.260.26
Table 5. Positive and negative ideal distances.
Table 5. Positive and negative ideal distances.
Index S * S Index S * S
A + A 0 A R A A + A 0 A R A A + A 0 A R A A + A 0 A R A
I.110.00.50.20.2−1.0−0.5−0.8−0.8I.66−0.5−0.8−0.8−0.80.50.20.20.2
I.13−0.7−1.0−0.7−0.70.30.00.30.3I.67−0.5−1.0−0.6−1.00.50.00.40.0
I.14−1.0−0.1−1.0−0.90.00.90.00.1I.73−0.7−0.9−0.7−0.70.30.10.30.3
I.15−0.2−1.0−0.9−0.90.80.00.10.1I.750.0−1.0−1.0−1.01.00.00.00.0
I.16−0.6−1.0−0.7−0.70.40.00.30.3I.760.00.90.00.0−1.0−0.1−1.0−1.0
I.18−0.6−0.8−0.8−0.80.40.20.20.2I.780.030.460.060.46−0.97−0.54−0.94−0.54
I.200.01.00.00.0−1.00.0−1.0−1.0I.80−0.9−0.5−0.9−0.70.10.50.10.3
I.210.01.00.00.0−1.00.0−1.0−1.0I.81−0.6−1.0−0.7−0.70.40.00.30.3
I.220.70.00.20.2−0.3−1.0−0.8−0.8I.82−0.7−1.0−0.7−0.70.30.00.30.3
I.230.00.40.30.3−1.0−0.6−0.7−0.7I.860.00.90.10.0−1.0−0.1−0.9−1.0
I.250.01.00.00.0−1.00.0−1.0−1.0I.880.00.80.20.0−1.0−0.2−0.8−1.0
I.260.01.00.00.0−1.00.0−1.0−1.0I.890.00.70.10.1−1.0−0.3−0.9−0.9
I.270.00.40.30.3−1.0−0.6−0.7−0.7I.90−1.0−0.9−1.0−0.10.00.10.00.9
I.29−0.6−0.9−0.7−0.70.40.10.30.3I.91−0.4−1.0−0.8−0.80.60.00.20.2
I.30−0.5−0.9−0.7−0.80.50.10.30.2I.920.00.80.10.1−1.0−0.2−0.9−0.9
I.31−0.6−1.0−0.7−0.70.40.00.30.3I.930.01.00.00.0−1.00.0−1.0−1.0
I.34−1.0−0.1−0.9−1.00.00.90.10.0I.940.00.50.30.2−1.0−0.5−0.7−0.8
I.360.00.80.00.2−1.0−0.2−1.0−0.8I.950.00.40.30.3−1.0−0.6−0.7−0.7
I.37−0.1−1.0−0.9−0.90.90.00.10.1I.97−0.7−1.0−0.7−0.70.30.00.30.3
I.380.00.90.00.0−1.0−0.1−1.0−1.0I.98−0.5−1.0−1.0−0.50.50.00.00.5
I.390.0−1.0−1.0−1.01.00.00.00.0I.99−0.4−0.9−0.8−0.80.60.10.20.2
I.400.00.90.10.0−1.0−0.1−0.9−1.0I.100−0.7−0.9−0.7−0.70.30.10.30.3
I.430.00.80.00.2−1.0−0.2−1.0−0.8I.102−0.3−0.9−0.9−0.90.70.10.10.1
I.440.01.00.00.0−1.00.0−1.0−1.0I.1030.00.70.20.2−1.0−0.3−0.8−0.8
I.450.00.90.00.0−1.0−0.1−1.0−1.0I.1040.01.00.00.0−1.00.0−1.0−1.0
I.460.01.00.00.0−1.00.0−1.0−1.0I.1050.01.00.00.0−1.00.0−1.0−1.0
I.470.00.50.00.5−1.0−0.5−1.0−0.5I.106−0.6−1.0−0.7−0.70.40.00.30.3
I.49−0.7−1.0−0.7−0.70.30.00.30.3I.108−0.6−1.0−0.7−0.70.40.00.30.3
I.50−0.7−1.0−0.7−0.70.30.00.30.3I.1090.01.00.00.0−1.00.0−1.0−1.0
I.51−0.7−0.8−0.7−0.70.30.20.30.3I.1100.01.00.00.0−1.00.0−1.0−1.0
I.52−1.0−1.0−0.5−0.50.00.00.50.5I.111−0.7−0.8−0.7−0.70.30.20.30.3
I.53−0.7−0.9−0.7−0.70.30.10.30.3I.112−0.7−0.8−0.7−0.70.30.20.30.3
I.55−0.7−0.7−0.8−0.80.30.30.20.2I.113−0.7−0.8−0.8−0.80.30.20.20.2
I.57−0.7−0.8−0.7−0.80.30.20.30.2I.114−0.7−0.8−0.7−0.70.30.20.30.3
I.58−0.7−0.9−0.7−0.70.30.10.30.3I.115−0.7−0.8−0.7−0.70.30.20.30.3
I.59−0.7−0.9−0.7−0.70.30.10.30.3I.116−0.7−0.8−0.7−0.70.30.20.30.3
I.60−0.4−1.0−0.8−0.80.60.00.20.2I.117−0.7−1.0−0.7−0.70.30.00.30.3
I.61−0.5−1.0−0.8−0.80.50.00.20.2I.118−0.3−0.9−0.9−0.90.70.10.10.1
I.620.01.00.00.0−1.00.0−1.0−1.0I.119−0.7−1.0−0.7−0.70.30.00.30.3
I.65−0.7−0.8−0.7−0.70.30.20.30.3
Table 6. Classification.
Table 6. Classification.
City S i * S i C i RankingSmart Index
A + 0.470.740.6111.00
A 0 0.890.200.1840.29
A R 0.600.620.5120.83
A (London)0.590.610.5130.82
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Aragão, F.V.; Chiroli, D.M.d.G.; Zola, F.C.; Aragão, E.V.; Marinho, L.H.N.; Correa, A.L.C.; Colmenero, J.C. Smart Cities Maturity Model—A Multicriteria Approach. Sustainability 2023, 15, 6695. https://doi.org/10.3390/su15086695

AMA Style

Aragão FV, Chiroli DMdG, Zola FC, Aragão EV, Marinho LHN, Correa ALC, Colmenero JC. Smart Cities Maturity Model—A Multicriteria Approach. Sustainability. 2023; 15(8):6695. https://doi.org/10.3390/su15086695

Chicago/Turabian Style

Aragão, Franciely Velozo, Daiane Maria de Genaro Chiroli, Fernanda Cavicchioli Zola, Emanuely Velozo Aragão, Luis Henrique Nogueira Marinho, Ana Lidia Cascales Correa, and João Carlos Colmenero. 2023. "Smart Cities Maturity Model—A Multicriteria Approach" Sustainability 15, no. 8: 6695. https://doi.org/10.3390/su15086695

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop