1. Introduction
Information and communication technologies (ICT) are an important factor in the socioeconomic well-being of countries, regions, and cities. Global trends include the rapid digitalization of services, the integration of generative and predictive AI, a growing focus on digital identity and data management, the shift towards remote work, and the increasing reliance on data and emerging technologies for policymaking. ICTs are widely used for planning, servicing, and managing cities, enabling faster and more efficient information delivery to communities and individuals and increasing participation and accountability in government and municipal policy. They are clearly based on the integration of digital technologies into urban infrastructure, i.e., information (communications) and city portals for electronic information services [
1].
Cities around the world are developing different types of models, depending on the context of the vision of urban development and the ways in which digital technologies support the city. Such models can be referred to as Digital City, Intelligent City, or Smart City models. A Digital City is clearly based on the integration of digital technology into the city infrastructure, i.e., information (communication) and city portals for online information services. Intelligent Cities have intelligent systems (functionality) and online web-based e-learning systems that are integrated and interoperable with other city platforms. Smart Cities, alongside technology integration, also include innovation (advanced visualization and simulation tools), an e-learning platform, knowledge management, and benchmarking requirements. The major difference between Intelligent Cities and Smart Cities is the special focus of the latter on social and human concerns (quality of life) and ecological systems (sustainability) [
2].
A smart city is defined as an urban environment that uses technology to increase the benefits and reduce the disadvantages of urbanization for residents. Both theory and practice have changed the perception of the e-city from a technology-oriented approach to a more holistic one that takes into account the so-called soft components, such as social participation. The development of a smart city should occur through mechanisms of shared governance, such as the creation of a citizen-oriented, accessible, accountable, transparent, and inclusive city with a sense of safety and security [
3]. ICT integration can expand and improve the delivery of urban services, streamline and optimize internal processes, and allow residents to interact with institutions and public issues in a variety of ways at both the national [
4] and local levels [
5,
6]. This approach ensures that all voices are heard and that the impact of digital advancements on all groups is thoroughly considered, monitored, and evaluated.
In the context of increasing uncertainty (geopolitical, environmental, social, and economic), cities can perform better than nation states and be more human-centric and sustainable. This digital transformation extends into sectors like education, employment, social protection, healthcare, justice, and the environment, prioritizing digital skills and contributing to a workforce equipped for a digital-first economy. Smart cities are also seen as the best entry point for achieving the national sustainable development goals of countries [
7]. According to the OECD (Organization for Economic Co-operation and Development), national achievements in the sustainable development of countries largely depend on the sustainable development results at the local level; 65% of the Sustainable Development Goals will not be achieved without the proper involvement of, and coordination with, local and regional authorities [
8].
The ratings and rankings are used to assess the states of urban smartness, and their indicators are often the basis for further development and decision-making on the implementation of necessary projects, programmes, and strategies. Worldwide, investors, city leaders, and ordinary citizens are paying increasing attention to the results of smart city indices. There are many indices for assessing smart cities, most of which have their own specific assessment criteria and ranking methodologies. Some organizations, including universities and private consulting companies, are assessing and ranking cities to generate global indices (e.g., IMD-SUTD Smart City Index, AT Kearney Global Cities Index, IESE Cities in Motion Ranking (CIMI), Cities of the Future Index (CFI), Mori-Foundation Global Power City Index (GPCI), Digital City Index (DCI), Global E-Government Survey (GEGS), Smart Eco-City Index (SECI), etc.), and researchers are increasingly interested in comparing them [
9,
10,
11,
12,
13].
Smart city assessment is a new field with great scientific and practical potential. Currently, there are no unified and generally accepted methods for comprehensively assessing smart cities. This is a problem because no rating is universally accepted and recognized. The authors discuss the choice of using primary or secondary data to compile smart city indices and their possible impact on the objectivity of the results. The smart city frameworks presented in the indices are also analyzed, and attempts are made to assess the validity of the criteria used. There is a noticeable lack of balance between indicators across different dimensions within the usual smart city framework [
13]. The debate is also raised as to whether it is necessary to seek a balanced distribution of assessment indicators across the different domains of a smart city. The optimal approach to assessing the smartness of cities remains a challenging academic objective. The methodology of smart city indices is controversially assessed by researchers. In particular, concerning the Smart City Index [
14], some authors consider it “the most objective” [
10], and others, “not clear enough” [
11]. In [
15], it is proposed to contextualize smart initiatives by moving from “smart in the box” (limited technological solutions) to the concept of “smart in the city” (social sustainability is a key component). In [
16], the author emphasizes the role of macro factors (political, economic, institutional) in shaping the level of “smartness”. The author points out that technological development is not sufficient without the active participation of citizens and effective governance. In [
17], the focus is on environmental indicators that allow assessing the effectiveness of environmental initiatives in Indian cities. The authors propose an index of environmental sustainability for Indian smart cities, which is an example of a specific approach to sustainability assessment under the national Smart Cities Mission program. Study [
18] presents an analysis of the impact of smart initiatives in European cities on urban inequality, including digital inequality. Analysis of data for 106 European cities shows that smart cities are associated with lower levels of urban income inequality. This suggests that the assessment of smart cities still needs to be deeply understood.
This research aims to develop the methodology of the Smart City Index in terms of assessing the value of e-services in the case of the cities in the Visegrad region.
In order to achieve this, the following tasks need to be accomplished:
To analyze the methodology for assessing the Smart City Index;
To carry out a comparative analysis of technological services of the cities in the Visegrad region according to city profiles from the Smart City Index;
To propose a methodological framework for assessing the value of e-services (IT projects) based on the importance of the priority areas of city life and the satisfaction level of service providers among its residents.
To sum up, this research addresses the concept of smart cities and the trend of using global indices to evaluate smartness in cities. While smart city rankings have been criticized for insufficient transparency in their calculation, they offer opportunities to rethink digital urban transformations. This paper highlights the importance of understanding the architectonics of technological service indicators in smart indices to drive the development of smart city infrastructure and addresses the knowledge gap by comparing the values of the Smart City Index for cities in the Visegrad region. This paper’s originality lies in its focus on the deep analysis of technological services as the ranking factor for cities in the Visegrad region, which made it possible to develop a methodological framework for accounting for the city rankings in policymakers’ decision-making with respect to future smart infrastructure projects.
Following this introduction,
Section 2 presents a concise review of the literature, the methodological approach, and the case study context;
Section 3 reveals the results of the analysis; and
Section 4 offers a discussion and concludes the paper with key findings and future research directions.
2. Materials and Methods
The ratings for smart city development are becoming important tools for assessing attractiveness, particularly in terms of quality of life. The cities are compared and ranked according to the various characteristics of smart infrastructure [
13]. This, to some extent, is due to the complexity and multi-component nature of the smartness of the urban environment.
Meanwhile, one of the key problems of all city rankings is that public attention is mainly focused on the final ranking without taking into account the underlying methodological aspects of the rankings. Due to the lack of in-depth analysis of the ranking indicators and their strengths and weaknesses, cities miss the opportunity to use the results constructively. The actual strengths and weaknesses of cities can only be identified through a broad discussion of all the indicators that make up a city’s overall rank, and based on this, priority urban areas for further digital transformation can be determined. It is assumed that smart index scores are an important prerequisite for city data presented in the ratings to be used by cities for decision-making on the necessary programs and projects.
The city rankings differ in their methods, and there is a wide range of ways in which rankings can be compiled. Those rankings that focus on a more detailed and well-defined issue are considered to provide more applicable results than those that provide just a general list. This investigation is focused on highlighting the Smart City Index scorecard from the International Institute for Management Development (IMD and the Singapore University of Technology and Design (SUTD). The fact is that this index is quite well-known among the public, although the detailed evaluation procedure is not published. The SCI methodology briefly states that all indicators are grouped into two ranking factors (or “pillars”): structure and technology. The two pillars are a reflection of a clear understanding that it is through the deployment of digital technologies that information can also be obtained on the effectiveness of the existing urban infrastructure. The cities are classified into four groups based on their performance on the Global Data Lab’s Human Development Index (HDI); then, within each group, cities are assigned a rating scale (from AAA to D) based on the city’s perception score compared to the scores of all other cities in the same group [
14]. The overall SCI presents the city rankings as a list, as well as the city rating in the form of letters.
Table 1 shows the rating and ranking indicators of the SCI for the top cities and the cities in the Visegrad region.
A feature of the SCI methodological approach is that the data for the city profiles are obtained by interviewing residents in each city. This distinguishes it from other smart city rankings (CIMI, CFI, and GPCI) that do not rely on subjective data representing a perceptual level of evaluation of technical services. The subjectivity, in understanding smart city assessments by residents, has its own value in understanding trends in sustainable smart city development. After all, SCI represents the smart city in terms of how the technological environment increases the advantages and reduces the disadvantages of urbanization for local residents. However, the methodology does not describe the means of data collection and processing in detail. The representativeness of the respondents’ samples amounts to 100 residents in each city, regardless of the total population (whether it is, for example, Prague, with 1,330,000 people, or Bratislava, with 420,000).
The SCI, in addition to the overall ranking, consists of city profiles that show indicators for both structure and technology services. Through in-depth analysis of the structure of these indicators, it is possible to find out which components of the smart city infrastructure are emphasized and which urban areas they “cover”. The scores of 20 urban technology services are grouped by urban life spheres: Health/safety (6), Mobility (5), Activity (1), Opportunities (4), Governance (5). Since a different number of services is defined for each sphere, the question of ensuring the completeness of representation of smart city indicators remains debatable. And there is also the question of whether it is necessary to strive for a balanced distribution of assessment indicators in different areas to ensure objectivity.
According to the structural logic of the index, the structural indicators are grouped into the same groups of urban areas as the technological ones. This is in line with the generally accepted smart city philosophy, which focuses on the development of an efficient infrastructure in which digital technologies are integrated with physical infrastructure for real-time monitoring, effective decision-making, and improved service delivery. A smart infrastructure should enable more comfortable, safer, and environmentally friendly living. This means that in order to achieve smart city goals, it is necessary to develop technologies without “disconnecting” from the structural factors of the urban infrastructure. That is why both structure and technology should be evaluated in the parameters of the significant spheres of urban life, of which there are six in the index.
Notably, there are still ongoing discussions about the completeness of the representation of smart infrastructure elements. The SCI has a different number of indicators for each of the urban spheres. Hence, a relevant question is whether the index developers should seek a balanced distribution of assessment indicators in the different spheres to ensure impartiality. While the search for the correct approach is ongoing, it is important to adhere to the critical principle of comprehensiveness when formulating smart city structures. In addition, there is the question of why a particular technological service is chosen to cover the physical infrastructure of the city. For example, there are questions about the technological indicators of medical infrastructure. Why was the online arranging of medical appointments chosen for the SCI, while many cities are already actively implementing digital patient records with many online services? It is noteworthy that the structural indicator “Green space” is not covered by any of the 20 technical services from the SCI.
In addition to the groups of services according to two ranking factors, structure and technology, the SCI cities’ profile presents data on the results of a survey of residents on the priority areas of cities. From a list of 15 indicators, respondents are asked to select 5 indicators that they consider most relevant for their city. In this method of data processing, the SCI city profiles include a general scale with 15 indicators of the spheres of urban life, where the percentage of respondents who included a certain sphere as one of their five priorities is indicated. A detailed analysis of these indicators for each city allows us to identify the peculiarities of their perception of the priority of areas of urban life (understanding of the quality of life in the city), as well as to compare with other cities or with global trends. In the city profiles, the results of this survey are presented autonomously, their numerical indicators are not included to calculate the smart ranking of cities. In addition, there is a partial lack of correlation between the surveys on 15 priority areas of cities and technological services, such as housing affordability, which is recognized as a global priority area, while among 20 technological services, there is not a single one that correlates with “affordable housing”.
The spatial scope of this research is cities in the Visegrad region, an alliance of four European Union countries: the Czech Republic (CZ), Hungary (HU), Poland (PL), and Slovakia (SK). These countries share the common experience of creating smart and digital innovations within a common Smart Visegrad platform [
9,
19,
20]. Smart Visegrad aims to strengthen the countries in the digital sphere to help them become EU leaders in sustainable smart development. The data from five cities were analyzed: Warsaw and Krakow/(PL), Bratislava/(SK), Prague/(CZ), and Budapest/(HU). Each city has a smart development strategy, where the use of information technology for effective city management and improving the quality of life of residents is noted [
21,
22,
23,
24].
Remarkably, there are no significant differences in smart aspirations among the cities of the Visegrad region, although each city has its own specific path to digital development and different positions in international rankings [
9,
19,
20]. The Visegrad region cities are included in different groups and have different Smart City Ratings (
Table 1): first—Prague (AA) and Bratislava (BB); second—Warsaw (BBB) and Budapest (CCC); and third—Krakow (B). The rankings of Polish [
25,
26], Slovak [
27], Czech [
28], and Hungarian [
29] cities are becoming a subject for research, but the evaluations of the technological services underlying the SCI have not yet been analyzed.
This research proposes a methodological solution for the development of an SCI methodology in terms of assessing the value of technological services of cities under uncertainty. Each city has its own strengths and weaknesses in smart infrastructure, so identifying the necessary priorities for further digital development is very important. The value has to be created as a result of each project action, based on the project management methodology. Therefore, an e-service (as an IT project) should also contain a value component. It is proposed to apply the principle of significance, weighting factors or indicators according to their impact on, or importance for, developing the smartness of cities, to assess the value of the e-project. This methodological tool allows for the evaluation of e-projects according to the extent to which they are able to address the significant problems mentioned by residents in the survey. In other words, if an IT project that has an insignificant impact on the city’s infrastructure assessment is planned to be accepted for implementation, it will receive lower scores from the experts and, accordingly, will have a lower value. Consequently, cities with deficiencies in a certain aspect may receive projects that are maximally aligned with the residents’ priorities.
To verify the hypothesis, the means and tools of mathematical modeling are used, namely, methods of multi-criteria evaluation and optimization under conditions of different degrees of certainty with respect to the initial information. The application of the value focus in the context of project management methodology will make it possible to create a model for assessing the value of e-services to the parameters of the Smart City Index.
3. Results
3.1. Representation of the Visegrad Region Cities in the Smart City Index
According to the 2023–2025 Smart Index, all cities in the Visegrad region have demonstrated progress in digital development, improving their rankings: Krakow, from 87th to 84th place; Budapest, from 79th to 70th place; Bratislava, from 62nd to 57th place; Warsaw, from 44th to 28th place; and Prague retains its place in the top twenty cities, rising from 14th to 12th place (
Table 1). For an in-depth analysis, we propose to take a closer look at the smart profiles of the Visegrad cities in terms of residents’ assessments of technological services. As mentioned above, the technology pillar of the CCI consists of twenty technological services grouped thematically into five dimensions of city life (Health and Safety, Mobility, Activities, Opportunities (Work and School), and Governance).
The Health and Safety area is assessed by six types of technological services. All Visegrad cities, except Warsaw, have low scores (less than 50 points) for online services for reporting problems with city services. The highest scores were given to the technical capabilities of video cameras installed in public spaces to improve the sense of security (
Table 2).
The technology analysis covers data from two reports, 2025 and 2024, which makes it possible to highlight the trends of progress or regression for each city and those in the Visegrad region. For example, Prague’s scores have dropped significantly over this period: online reporting on city problems, from 51.5 to 44.0; technical services that allow you to easily return things, from 60.6 to 43.6; public Wi-Fi, from 58. 9 to 49.8; technical services for monitoring air pollution, from 47.1 to 38.2; and online registration for medical services, from 62.3 to 58.8; and only one indicator improved—cameras increase the sense of security (from 63.4 to 66.6). In Warsaw, on the other hand, all but one of the indicators increased. Warsaw and Krakow are the leaders among the cities in the Visegrad region in terms of Health and Safety indicators (
Table 2).
The Mobility sphere is assessed via five types of technological services. The comparative analysis of the 2024–2025 city profile data shows the overall progress of all cities in the assessment of all technical services. All of the Visegrad cities have the highest scores for online scheduling and ticket sales, which have made public transport easier to use (from 67.1, Bratislava to 72.4, Prague and Budapest).
However, several technical services are rated low. For example, the mobile app for car sharing was rated less than 50 points by the residents of all cities except Prague. Mobile phone services for reporting traffic jams in three cities (Prague, Bratislava, and Krakow) were rated between 48.8 and 49.5. The bicycle hiring service having reduced congestion scored less than 50 points in Prague, as did apps that direct you to an available parking space reducing travel time in Bratislava and Budapest. All cities have the highest scores for public transportation (from 67.1 in Bratislava to 72.4 in Prague and Budapest). In general, Warsaw retains its leadership among the Warsaw region countries, while Bratislava has the lowest scores (
Table 3).
The Activities area is assessed via one type of technological service (i.e., online purchasing of tickets to shows and museums has made it easier to attend), which residents are satisfied with, ranging from 73.3 (Bratislava) to 81.0 (Warsaw) (
Table 4).
The Opportunities (Work and School) sphere is assessed by four types of technological opportunities and services available to residents (
Table 5). All cities in the Visegrad region demonstrate a positive development trend, with Warsaw being the obvious leader in all indicators, followed by Krakow in second place, and Bratislava in fifth.
The cities received high scores for IT infrastructure (high-speed internet), from 67.8 (Bratislava) to 80.0 (Warsaw), as well as online job search services, from 67.0 (Bratislava) to 76.5 (Warsaw). Online services for starting a new business received significantly lower scores, from 48.2 (Bratislava) to 64.5 (Warsaw). Another noteworthy trend is that the scores for the level of skills are lower than the scores for technical services. The scores range from 55.0 (Prague) to 66.0 (Warsaw).
The Governance area is assessed via four types of technological capabilities and services available to residents. Two Polish cities, Warsaw and Krakow, retain their leadership (
Table 6). Residents are most satisfied with the technical capabilities in processing identification documents online, reducing waiting times, from 57.7 (Bratislava) to 68.6 (Krakow). The most critical indicator for all cities is that the capabilities of online public access to city finances has reduced corruption, which falls below 50 points, from 35.5 (Budapest) to 45.7 (Krakow). This is especially critical for Budapest and Prague, whose residents have identified corruption/transparency as one of the five key areas of quality of life (Budapest—fourth priority (42.0%); Prague—fifth priority (39.8%)).
As for participatory e-decision-making, it remains low: “An online platform where residents can offer ideas has improved city life.” Bratislava and Budapest, although they have made some progress, have scores below 50, while the capitals of Poland and the Czech Republic have 55.1 and 56.5, respectively. However, it is worth noting that Prague has made a small progress, while Warsaw has made a significant regression, from 63.7 to 55.1 online voting increases participation, but the cities have low scores, from 49.4 (Bratislava) to 53.5 (Krakow). And in terms of online voting, Bratislava, although it has made progress, has not yet crossed the 50 mark. There is an obvious decline in participatory indicators (as in online voting: Warsaw regressed again, from 61.4 to 52.1). Budapest also demonstrates a smaller regression, from 53.6 to 52.0 (
Table 6).
Thus, the analysis of the data on the technical capabilities of the Visegrad cities showed, first, a certain discrepancy between the data in the city profiles and the generalized indicators for the technology factor in the smart city ranking. While in the generalized smart city ranking, Prague is the leader among the cities studied, and Warsaw’s position in the ranking is much lower. According to the city profiles, Warsaw is the leader in all five areas. In addition, while Bratislava ranks third among the cities studied in the generalized technology ranking, and Krakow ranks fourth. According to the city profiles and the assessments of technological services, Krakow has significantly higher scores for technical services than Bratislava (at the level of ½ place among the cities of the Visegrad region). According to the overall rating, Budapest is an outsider, but the profile indicators do not confirm this. Bratislava is the outsider in Activities, Management, and Opportunities (“Work and School”).
There are also examples where residents of developed smart cities rate services at the same level (or lower) than residents of the Visegrad cities. For example, residents of Zurich (Ranking 1) rated the e-service “Arranging medical appointments online has improved access” lower than residents of Krakow (Ranking 70), with 63.9 and 67.9, respectively. This may indicate not so much a difference in the quality of the e-service as the higher-level requirements of the residents of the leading cities.
The analysis confirmed that most of the indicators of all the cities analyzed are above average, while each city has its own strengths and weaknesses. Accordingly, the further smart development of these cities can be made more effective if the ranking positions in terms of technical services are taken into account when making decisions on the priority of electronic development and the growth points for progress in technical services, as well as improving their assessment by residents. It is important to take into account the electronic data of city profiles in the expert evaluation of city programs and projects in order to improve the quality (usefulness) of technological services.
In our opinion, this Smart Index data (city profiles) can be of great value if we apply it to assess the value of e-services while prioritizing areas of life in the city. It also enables decision makers to produce, evaluate, and select solutions that create positive synergies for sustainable smart city development. Cities should develop their own performance dashboards with relevant indicators, and assessing the value of e-services can serve as an initial basis for identifying key dimensions and critical indicators.
3.2. Modeling the Value Assessment of e-Services in the SCI Framework
The value assessment of e-services for the SCI framework remains a challenging task. Smart cities require a higher integration of e-services with urban infrastructure and the priority areas of city life. In this research, a scientific attempt is made to emphasize specific correlations between the e-services (technologies) used in the SCI rating at the level of the city profiles and the priority areas of city life. The correlations identified between five groups of e-services and fifteen areas of city life are as follows (
Table 7):
“Health and Safety” with such areas of city life as Air pollution (2), Basic amenities (water, waste) (3), Green spaces (7), Health services (8), Recycling (10), and Security (13);
“Mobility” with Public transport (9) and Social mobility/inclusiveness (14);
“Activities” with Social mobility/inclusiveness (14);
“Opportunities (Work and School)” with Fulfilling employment (6), School education (12), and Unemployment (15);
“Governance” with Citizen Engagement (4) and Corruption/transparency (5).
The identification of correlations between certain technologies (e-services, IT products) and areas of city life showed, first, that the number of correlations ranges from zero (“Affordable housing” and “Green spaces”) to eleven (“Free public Wi-Fi has improved access to city services”). Second, the list of technologies has “bottlenecks” in terms of the representativeness of the needs of city residents for digital city services. In particular, the SCI does not include an e-service or web application for residents regarding “Affordable housing”, even though it is recognized as the highest priority area. Considering that the SCI includes a score for “A website or app allows residents to effectively monitor air pollution,” it would be logical to include a similar technology (a website or app) that makes it easier for residents to find housing.
In the area of city life, “Health services,” is represented only by the possibility of online registration for an appointment with a doctor. In our opinion, additional e-services, such as an online consultation with a doctor or an online medical card for a patient, could effectively cover these areas electronically.
We also consider that “Activities” technologies should be presented more widely and not be limited to the “Online travel to exhibitions and museums that will be created for study” service. After all, there are many services, such as online excursions, immersive exhibitions, online broadcasts of performances, concerts, etc.
The measure of the effectiveness of digital technologies in the different areas of city life can be defined by an integral assessment of the value of e-services. This involves following a three-stage logical sequence of actions:
Stage 1: Analysis of data on the city’s e-services. Data selection (aggregation) involves 20 e-services and 15 areas of city life.
In the SCI reports, these data on e-services in points are presented as points, and for calculating the value of e-services, it is proposed to use them as input weight coefficients. Normalization is required to unify the heterogeneous data obtained through surveys and to ensure comparability between cities with different populations and different assessments of technologies (e-services) in each area. Also, weighting coefficients can be calculated according to the priority of life spheres identified by residents or experts, reflecting the importance of each aspect for the overall assessment of city smartness. The weighting coefficients must satisfy the normalization condition: λ1 + λ2 + …+ λn = 1, β1 + β2 +…+ βm = 1. This approach will make the assessment more representative and reasonable.
An example of the values of input weighting coefficients for 20 smart city e-services
λ1,
λ2, …,
λn and their calculated normalized analogs for five smart cities of the VR are presented in
Table 8. An example of the values of the input weighting coefficients for 15 smart city areas,
β1,
β2,
…,
βm, as well as their calculated normalized analogs for five smart cities of the VR, are presented in
Table 9.
Stage 2: Expert assessment of the value of technologies (e-services) in terms of ensuring quality of city life.
In the context of this project’s approach, the system of city e-services must meet the requirements of usefulness/value in ensuring a high-quality of city living. For expert assessment, it is proposed to use a continuous scale [–1, 1] with reference markers:
«1»—The e-service fully ensures the achievement of the quality of city life value (indicator);
«0»—The e-service does not imply the achievement of the quality of city life value (indicator);
«–1»—The e-service has a negative impact on the quality of city life value (indicator). How, for example, can this be related to the placement of video cameras, when some of the residents evaluate this positively and others negatively?
Experts from municipal administrations, city planning departments, and ICT consulting companies may be involved in the expert assessment of the value of technologies (e-services). The team of experts may include from 3 to 10 people. The criteria for selecting experts include the following: experience in implementing high-tech projects, experience in implementing smart infrastructure (5 years and above), and knowledge of the specifics of ICT implementation in a particular city in the Visegrad region. To ensure the reliability and consistency of expert assessments, consistency checks should be applied. In particular, the Cohen’s kappa coefficient can be used to measure the consistency of expert opinions. Analysis of deviations and the normalization of expert opinions can be carried out using the average deviation index.
An example of quantitative assessments of the value of e-services in each area of city life is presented in
Table 10.
Stage 3: Assessing the value of digital services using balanced regression ratios:
- (1)
A partial model of a balanced assessment for all five groups of technologies for each e-service, which has the following form:
where
Gjk—value assessment of the
j-th e-service
k-th group of digital technologies, where
and
;
m—number of e-services included in the SCI [
14], where
m = 20;
n—the number of areas of city life for which the assessment is carried out, where
n = 15;
VTj—a balanced assessment by groups of digital technologies for the
j-th e-service, where
; and
λ1,
λ2,
…,
λn—non-negative weighting factors satisfying the normalization condition
λ1 +
λ2 + …+ λn = 1.
A visualization of the balanced scores for the digital technology groups (
Figure 1) and for each area of smart city life (
Figure 2) in the form of profilograms makes it possible to identify the “emphases” and “gaps” in the e-services coverage.
Thus, in all VR cities, a significant advantage is preferred for the development of digital services for “Mobility”, and the list of available e-services mainly covers two priority areas: “Road congestion” (11) and “Security” (13). In Krakow, a significant share of the e-services covers the area “Air pollution” (2), in Bratislava and Budapest, “Health services” (8), and in Warsaw, Krakow, and Budapest, “Fulfilling employment” (6).
- (2)
A partial model of a balanced scorecard for all e-services of the SCI for each area of city life is as follows:
where
VTdk—balanced assessment of the value of smart city e-services in relation to the
k-th area of city life, where
; and
β1,
β2,
…,
βm—are non-negative weighting factors satisfying the normalization condition
β1 + β2 +…+ βm = 1.
The results of the balanced assessment of technology in all areas of city life clearly demonstrate the extent to which e-services are utilized in each of the 15 smart city areas. In particular, in Prague, the e-services “Current internet speed and reliability meet connectivity needs” and “Free public Wi-Fi has improved access to city services” provide the highest coverage (
Figure 3).
- (3)
The model of integral assessment of the value of smart city e-services (
VT), which can be presented either as a weighted average of the balanced scores by technology groups for all e-services (Formula (3)) or as a weighted average of the estimated balanced scores for the e-services of all smart city areas (Formula (4)):
Thus, a model has been formed for the integral assessment of the value of city e-services (
VT):
Mathematical relations (3) and (4) result in the equation:
which allows us to control the results of the calculation of the optimal values of the weighting factors
λ1,
λ2,
…,
λn and
β1,
β2,
…,
βm.
In general, the integral assessment of the value of e-services (
VT) of V4 smart cities based on expert estimates (
Table 8) was as follows:
VTPrague = 0.108;
VTKrakow = 0.102;
VTBudapest = 0.102;
VTWarsaw = 0.101;
VTBratislava = 0.100.
4. Discussion and Conclusions
The proposed methodology for quantifying the value of city e-services should become an important decision-making tool for municipalities with the introduction of a new e-service and/or the implementation of an IT project.
The city’s e-services, as defined by the SCI methodology, are an important focus of attention. Assessing their significance is determined by applying them to 15 areas of city life: 1—Affordable housing; 2—Air pollution; 3—Basic amenities (water, waste); 4—Citizen engagement; 5—Corruption/transparency; 6—Fulfilling employment; 7—Green spaces; 8—Health services; 9—Public transport; 10—Recycling; 11—Road congestion; 12—School education; 13—Security; 14—Social mobility/inclusiveness; 15—Unemployment.
The exploration of the methodology for calculating the Smart City Index made it possible to highlight the correlation and relationships between the assessed e-services (in SCI terminology, “technologies”) and the indicators (areas) of city life (
Table 7). It was revealed that among the e-services (technologies) proposed for assessment, there were no e-services related to affordable housing and green spaces, despite residents of all V4 smart cities noting “affordable housing” as the most priority indicator of quality of life in the city.
The combination of expert assessments (
Table 10), e-service weighting factors (
Table 8), and indicators (areas) of quality of city life (
Table 9) allows for a more comprehensive/quantitative assessment of the value of e-services (“technologies”) in ensuring the quality of city life. A continuous scale [–1; 1] is used for the assessment. The introduction of weighting coefficients for indicators of the quality of life in the city helps the decision-maker to determine the priority of the needs of residents requiring coverage/coverage by e-services.
Considering that the value of digital technologies depends on the e-service’s impact on improving quality of city life (in terms of residents’ level of satisfaction regarding different areas of city life), it is proposed to improve the existing SCI methodology to assess the value of e-service based on the interdependence of three variables:
The extent of the coverage of one or more areas of city life by the assessed e-service;
The significance of certain indicators (areas) of the quality of city life for citizens;
The assessment of the significance of an e-service, i.e., to what extent it improves the quality of life of citizens in an area (or areas) of city life.
This approach allows for the formation of a comprehensive//integrated assessment of the value of an e-service in accordance with the SCI methodology.
A comprehensive methodology for the quantitative assessment of the value of smart city e-services under uncertainty is proposed. This methodology is developed using the apparatus of fuzzy mathematics and takes into account the relative importance of e-services (“technologies”) specified in the SCI and indicators (areas) of the quality of city life. Basic mathematical models for assessing the value of e-services have been developed, in particular:
A partial model of balanced assessment across all categories/groups of technologies for each e-service (VTj);
A partial model of balanced assessment across all e-services of the smart city for each indicator (sphere) of city life (VTdk);
A model for the integrated assessment of the value of e-services of the smart city (VT).
Such a proposal for the development of the SCI methodology opens up the possibility of assessing the value of existing e-services for digital city transformations. And the use of mathematical tools (1)–(6) allows for the formalizing of the decision-making process under conditions of varying degrees of certainty with respect to the initial information. The proposed mathematical apparatus is basic; it can be supplemented and developed in accordance with the conditions and specifics of a particular smart city, IT project, and/or municipal program for the sustainable development of smart cities.
The correct use of the proposed approach requires the expert to have developed digital competencies and knowledge/understanding of the specifics of the implementation of municipal IT projects and the introduction of IT products (e-services) in the context of city projects and programs. The expert carries out his own research on pre-project solutions and forms a “personal vision (personal point of view)” regarding the effectiveness of these solutions in providing e-services, with indicators (areas) of urban life serving as “input data” in the form of tables of the accepted/established form. When filling out the table forms, the expert may include (intentional or accidental) omissions and/or errors in the cells, as well as violations of ethical rules (i.e., the prevalence of subjectivity over objectivity). Such a situation will result in individual numerical values of criterion assessments being obtained at the output outside of their agreed-upon ranges. Therefore, it is important that the proposed methodology for the quantitative assessment of the value of a city’s e-services makes it possible to promptly identify inconsistencies and to eliminate them. Also, when monitoring the input data of computational procedures, technical errors requiring elimination can be detected.
The proposed value-based methodology aligns with the digital maturity framework introduced by [
6], which underscores the need for integrating ICT capacities into both technical systems and institutional governance. Our model operationalizes this by offering a quantifiable and adaptable assessment of e-service impact across citizen-prioritized domains, thus translating digital maturity into actionable planning inputs. Likewise, it responds to [
9], who emphasize the administrative dynamism of V4 municipalities, by supplying a flexible matrix that enables local governments to match project selection with both strategic feasibility and societal demand.
In contrast to the typological model of ICT evolution [
11], which emphasizes hierarchical system maturity, our approach introduces a multi-input value framework grounded in stakeholder feedback and service-level optimization. It also reflects the call by [
13] to redesign smart city frameworks for greater contextual sensitivity and user alignment. From a transparency perspective, tour methodology directly addresses concerns raised by [
10], who criticized smart city indices for lacking methodological clarity and explainability in weighting schemes. By revealing expert-defined weights and scoring logic, our model offers a more interpretable and replicable structure.
Moreover, the approach aligns with [
15]’s argument for rethinking “smartness” beyond standardized boxes and toward embedded urban contexts. Our framework roots service evaluation in actual resident preferences, allowing smartness to be defined from the bottom up rather than imposed from the top down. Studies [
16,
18] have shown that macroeconomic and inequality factors can distort global index interpretations; our locally calibrated matrix mitigates this by linking digital initiatives directly to domain-specific needs. Differently from [
17], which focuses on Indian smart city sustainability metrics, we emphasize the creation of customized, replicable metrics that municipalities can adapt to regional realities. Overall, our methodology offers a responsive and analytically transparent alternative to traditional ranking systems, helping bridge the gap between policy abstraction and implementation.
The results of the assessment of the five cities in the Visegrad region, presented in the SCI, are considered as input information for finding growth/improvement points for digital landscapes from the perspective of sustainable development. An information and contextual analysis of the “Smart City Index” indicators was carried out in Prague (Czech Republic), Warsaw and Krakow (Poland), Bratislava (Slovakia), and Budapest (Hungary).
A comparative analysis of the indicators and values showed that in all V4 cities, e-services of the “Mobility” category are more developed (e.g., car-sharing apps, apps that direct you to an available parking space, bicycle hiring, online scheduling and ticket sales, the city providing information on traffic congestion through mobile phones).
The developed tools for assessing the sustainability of municipal/IT project management processes are for improving and developing the management system for high-tech municipal projects and programs from the perspective of sustainable development. The application of the analytical tools developed by the authors will be useful in the projects of municipal offices, IT companies, and investors, as well as in initiative projects that implement public–private partnership projects, public budgets, etc.
Along with it, the author’s approach requires additional scientific and practical investigations on processing specific data. The empirical basis for further research should be formed by analytical reports on other smart city indices. The presented analysis of e-services in the cities of the Visegrad region may be useful in developing programs to improve the digital infrastructure of other cities (urban contexts). A promising direction for further research lies in the consistent application of fuzzy logic methods for modeling ambiguity and uncertainty in smart governance decisions. In [
13,
30], it was shown that fuzzy multi-criteria decision-making (FMCDM) frameworks are particularly well-suited to handling qualitative judgments in urban policy contexts. These methods have been successfully implemented in public budgeting, urban resilience planning, and e-governance prioritization. Integrating fuzzy inference into the SCI-based value assessment offers a sound theoretical foundation and enhances adaptability to local sociopolitical conditions.
As a result, the application of the proposed model will allow decision-makers to evaluate IT projects and IT products (e-services) in the context of improving quality of life in the city (according to 15 indices/areas). Such an assessment is important in making a decision to fund the development of a technical task. The larger the scale of the IT project or IT program, the more visible the effects of the digitalization of the sphere of urban services. In general, the application of the proposed methodology and the tools for assessing the value of the e-services brings the e-government of the municipality to a higher level of digital maturity and improves the city’s representation in international smart city rankings.