A Study on Determinant Factors in Smart City Development: An Analytic Hierarchy Process Analysis

: Today, there are many discussions and guidelines on the issue of smart cities (meaning cities that introduced smart technology) from the perspective of traditional urban policy. Smart city policies focusing on technology have been criticized for eliminating the different levels of factors that surround smart cities. When governments fail to consider different factors in implementing smart policies, they might not effectively provide quality services to citizens, because smart cities involve not only technical elements, but also the complex elements surrounding them (e.g., the policy ecosystem and urban infrastructure). This exploratory study examines the determinants of smart cities and their priorities through an analytic hierarchy process analysis. In this study, the priority internal factors appeared in the order of citizen involvement, leadership, and infrastructure, and the priority external factors took the order of political will, stakeholders, and the fourth Industrial Revolution. In addition, this study shows that the presence of communication channels, public hearings, and direct stakeholders is important for analyzing each sub-factor.


Introduction
Around the world, urbanization is being progressed more rapidly than ever before.The global urbanization rate exceeded 50% in 2007, and is expected to exceed 70% by 2050.The urban population, which was 1.4 billion in 1970, will increase to 6.3 billion by 2050, with 60% of the world's population expected to be concentrated in urban areas [1].This has led to various ongoing discussions about how to solve new urban problems.Smart cities are one of the most sought after solutions.The smart city is a conceptual urban development model, which means city construction based on information and communication technology (ICT).The specific definition of a smart city differs according to the economic level and the city policy of the country, but it can be seen as a city that uses ICT to improve city competitiveness and quality of life, and pursue urban sustainability.As interest in smart cities grows, many countries are spurring their construction.China plans to invest two trillion yuan (about US $333 billion) by 2025 to transform 80% of its cities into smart cities.Since 2010, Japan has invested approximately 68 billion yen in smart city-related policies to rebuild cities in the regions that were affected by the Great East Japan Earthquake.In 2015, the White House announced a smart city plan that included a $160 million research and development (R&D) investment plan to solve various urban problems [2].Navigant Research's study reflects this trend, and the global smart city market is expected to grow steadily, more than doubling from $424 billion in 2017 to $12 trillion in 2020 [3].
Innovation in ICT has always been at the heart of the implementation of new cities, including smart cities.In fact, since smart cities were introduced, many different cities have discussed the development of ICT, using terms such as "virtual", "intelligent", "digital", and "ubiquitous" [4].As a result, in many studies, smart cities also focused on improving urban systems by using advanced technology.For example, the term "smart city" was first used in the 1990s; at that time, many studies focused on the importance of new ICTs in relation to modern infrastructure in cities.In other words, they focused on how smart communities could be smarter, and cities could be designed to implement information technology [5].
In contrast, some studies have criticized technology-oriented smart cities. Research studies on the roles of human capital, education, social and relational capital, environmental interests, smart city management, and leadership as important driving forces for urban growth are typical examples [6][7][8][9][10].Nevertheless, many studies related to smart cities are still focused on technological innovation, and there are few studies that deal with the different levels of the factors that influence the building of a smart city [6].In this situation, it is important to look at the variety of factors that influence smart cities, and search for the priorities in building desirable smart cities through a comparison of the factors.Therefore, this study examines the internal and external determinants related to smart cities, and analyzes what factors need to be focused on.
The composition of this paper is as follows.The second section looks at the theoretical background of the concept of smart cities and their determinants.Section 3 describes the research methodology and the process of factoring.In Section 4, the analysis is conducted using a questionnaire based on the research model, and the analysis results are explained.The main factors, sub-items and details are analyzed using AHP (Analytic Hierarchy Process) methodology.Finally, Section 5 discusses the policy implications of the study, and suggests policy alternatives as well as future research directions.

Smart City Concepts
Smart cities involve various concepts in academia, governments, global corporations, and international organizations.In other words, there is no consensus on the concept of a smart city.
Hollands [11] discussed the difficulties of establishing a smart city concept by explaining the hidden factors involved in the labeling of smart cities.First, the definition of smart cities has not been refined since 2000, and no new elements have been added.Second, there have been various studies on ICT, but the concept of quality of life is still uncertain, and the link between smart technology and quality of life has not been clearly established.Finally, he explained that the meaning of "smart" and its connection to cities remain ambiguous.
Hall [12] mentioned that the vision of "smart cities" is one of urban centers of the future made safe, secure, environmentally friendly, and efficient because all of the structures-whether for power, water, transportation, etc.-are designed, constructed, and maintained while making use of advanced integrated materials, sensors, electronics, and networks that are interfaced with computerized systems comprising databases, tracking technology, and decision-making algorithms.
Bakıcı et al. [13] argued that a smart city is a tech-intensive and advanced city that connects people, information, and city elements using new technologies in order to create a sustainable, greener city that features competitive and innovative commerce and an increased quality of life.
Giffinger [14] insisted that a smart city is a smart society in which various elements such as people, the environment, mobility, governance, and the economy are built within a smart infrastructure.
On the other hand, citizens must be included in a smart city.Citizens are a key element of smart cities as they form such a city through continuous interactions.For this reason, a smart populace is recognized as a key driver of smart cities; so education, learning, and knowledge are important strategies in smart cities [15].In addition, social infrastructures such as intellectual capital and social capital can be seen as essential elements of smart cities because they connect people and form relationships [5].Yigitcanlar et al. [16] found six subthemes as determinants of a smart city by reviewing 78 journal articles including 'productivity', 'sustainability', 'accessibility', 'well-being', 'liveability', and 'governance', which are considered desired outcomes of smart cities. Accordingly, the concept of a smart city implies a complex mixture of education, culture, art, business, economy, and commerce.
While there are a variety of views on the definition of a smart city, it is clear that a smart city adopts new technologies in order to improve the level of efficiency associated with utilizing urban infrastructure functions.A smart city also seeks to improve the quality of life of its citizens.Thus, the concept of a "smart city" can be defined as "a city that is sustained based on highly intelligent ICTs and social networking; communication between people and things and things and things, which goes beyond time and space; convergence between ICT and real time; and convergence with other industries by which new value-added contents and services are constantly re-created accompanied by innovation of society as a whole, including work styles, lifestyles, culture, politics, and the economy".

Smart City Diagnosis Index Analysis
The previous studies on smart cities mostly focused on analyzing the key factors in the field of technology and technical infrastructure.Using the existing smart city diagnostic index, it is possible to check what items or services are included in the diagnosis index and which services are evaluated in existing smart cities.Currently, it is based on the smart city index developed by various institutions and researchers, because there is no standard for analyzing the smart city.
A Study on Construction and Application Approaches of Smart City Maturity and Potential Diagnostic Models from the National Institute of Land Research of Korea in 2016 analyzed those smart city diagnostic indexes as shown in Table 1.In this study, diagnostic indexes in Europe tend to lose their smart city centered on technology, systems, and human factors, but the majority of indexes in Korea focus on maximizing the function of urban infrastructure by ICT.In this study, the contents of the questionnaire of the existing diagnostic indexes were analyzed and reconstructed into the categories of Table 2. Analyzing the items of the Smart City index used, we analyzed the frequency of the items with the same characteristics.As a result of analyzing the frequency of smart city performance evaluation indexes in the categories, the indexes of the smart city diagnostic model, including Living, Environment, Traffic, Plan/Strategy, and Governance, were found to be high.
There are limitations in that it is difficult to distinguish smart cities from sustainability indicators in the case of major EU-based diagnostic models as well as international cities and green city indexes, because they recognize smart cities as technology and systems, as well as human factors.
In the case of the smart city diagnosis model, there is a tendency to grasp smart cities mainly on Europe's technology, systems, and human factors.On the other hand, most domestic diagnostic models narrowly have focused on the technological factors functioning as an infrastructure building.The Navigant index and the Global System for Mobile Association (GSMA) and Ericsson indexes, which have a mental perspective and evaluating private companies, also have limitations by focusing too much on mobile functions.
Of course, technology infrastructure can be an important factor in developing a smart city, and it is blended with ICT technology.However, we cannot come to conclusions about a good smart city based on the above-mentioned indicators.In order for a city to develop, many factors must be developed in consideration of the internal and external environments, including leadership, organizational structure, governmental system, legal backgrounds, political processes, interest groups, citizen support and participation, local industries and vendor communities, and stakeholders.Smart city planning and development should include non-technological factors such as people's cooperation, governmental policy support, leadership, and local innovation, which is what we want to discuss.

Smart City Trend
According to the report "5 Ways to Make Our Cities Smarter" [17] by the World Economic Forum, there are five key elements of smart cities as shown in Figure 1: a global outlook and political will, smart standards, smart regulations, public-private partnerships, and local innovation.The five elements of smart cities mentioned by the World Economic Forum differ from the existing smart city evaluations and indicators, but they are key elements of smart cities.It is very important to understand the global trend of the smart city as well as the political will in the process of building smart cites, which had mentioned in the introduction: many countries are committed to developing smart city around the world.However, smart regulation is necessary as well.Smart regulation should not be an impediment to the development of the smart city, and should be accompanied by government policy efforts so that the smart city can be developed in accordance with government policy.It also explains that it can be a "smarter" city or smart city if the partnership between the public and private sector is established and harmonized.
Currently, various discussions and studies are being conducted in various countries around the world to create their own smart city.Siim Kallas, Vice-President of the European Commission's Transportation Department, said, "Transportation representatives, telecommunications carriers, vehicle manufacturers, city planners, and energy companies all gather together to discuss meaningful discussions about the future of cities in Europe.The Smart City Initiative will bring less congestion and new business opportunities."He also emphasized that we should move to action.Following these political will, great smart cities are in Europe, such as Amsterdam in the Netherlands and Copenhagen in Denmark.Most smart cities are developing with a focus on technology infrastructure such as smart traffic, smart buildings, and smart integrated management.For example, there are many studies focusing on technologies around the world such as smart traffic [18][19][20][21][22][23][24], urban planning [17,[25][26][27] and architecture, smart energy systems [19,20,[28][29][30], and so on.

Main Factors
We have found that many documents focus more on the results than on the smart city construction process.Accordingly, we have drawn inward and outward factors to clarify which determinants should be more important in the process of building smart cities.
In this study, the Analytic Hierarchy Process (AHP) technique was used to prioritize the determinants of smart city.The AHP is a decision-making method that obtains the importance through a pair comparison between attributes constituting a hierarchical structure.The AHP divides the decision-making process into several stages, and then proceeds to the final decision by objectifying the subjective judgment of the evaluator through the step-by-step analysis.This systematically ranks various alternatives and derives them as a percentage scale reflecting the weight.The AHP allows the importance of each alternative to be calculated by classifying the importance hierarchically, which is suitable for solving a large number of decision problems [31].
For the selection of smart city decision factors for this study, related literature and a smart city index were analyzed.Citizen participation [10,[32][33][34], leadership [35][36][37], and infrastructure [38][39][40][41]  The five elements of smart cities mentioned by the World Economic Forum differ from the existing smart city evaluations and indicators, but they are key elements of smart cities.It is very important to understand the global trend of the smart city as well as the political will in the process of building smart cites, which had mentioned in the introduction: many countries are committed to developing smart city around the world.However, smart regulation is necessary as well.Smart regulation should not be an impediment to the development of the smart city, and should be accompanied by government policy efforts so that the smart city can be developed in accordance with government policy.It also explains that it can be a "smarter" city or smart city if the partnership between the public and private sector is established and harmonized.
Currently, various discussions and studies are being conducted in various countries around the world to create their own smart city.Siim Kallas, Vice-President of the European Commission's Transportation Department, said, "Transportation representatives, telecommunications carriers, vehicle manufacturers, city planners, and energy companies all gather together to discuss meaningful discussions about the future of cities in Europe.The Smart City Initiative will bring less congestion and new business opportunities."He also emphasized that we should move to action.Following these political will, great smart cities are in Europe, such as Amsterdam in the Netherlands and Copenhagen in Denmark.Most smart cities are developing with a focus on technology infrastructure such as smart traffic, smart buildings, and smart integrated management.For example, there are many studies focusing on technologies around the world such as smart traffic [18][19][20][21][22][23][24], urban planning [17,[25][26][27] and architecture, smart energy systems [19,20,[28][29][30], and so on.

Main Factors
We have found that many documents focus more on the results than on the smart city construction process.Accordingly, we have drawn inward and outward factors to clarify which determinants should be more important in the process of building smart cities.
In this study, the Analytic Hierarchy Process (AHP) technique was used to prioritize the determinants of smart city.The AHP is a decision-making method that obtains the importance through a pair comparison between attributes constituting a hierarchical structure.The AHP divides the decision-making process into several stages, and then proceeds to the final decision by objectifying the subjective judgment of the evaluator through the step-by-step analysis.This systematically ranks various alternatives and derives them as a percentage scale reflecting the weight.The AHP allows the importance of each alternative to be calculated by classifying the importance hierarchically, which is suitable for solving a large number of decision problems [31].
For the selection of smart city decision factors for this study, related literature and a smart city index were analyzed.Citizen participation [10,[32][33][34], leadership [35][36][37], and infrastructure [38][39][40][41] were extracted as internal factors among the determinants of smart city in Section 3.1.We have also derived the fourth Industrial Revolution [42], policy commitment [43], and stakeholders [44] as important factors for smart decision making in Section 3.2.Then, opinions were exchanged on detailed factors through three brainstorming processes.In this section, we summarize the current status of the smart city and urban policy, and set up a hierarchy of smart city determinant factors, as shown in Figure 2.
Sustainability 2018, 10, x FOR PEER REVIEW 6 of 16 were extracted as internal factors among the determinants of smart city in Section 3.1.We have also derived the fourth Industrial Revolution [42], policy commitment [43], and stakeholders [44] as important factors for smart decision making in Section 3.2.Then, opinions were exchanged on detailed factors through three brainstorming processes.In this section, we summarize the current status of the smart city and urban policy, and set up a hierarchy of smart city determinant factors, as shown in Figure 2.

Citizen Participation
This factor refers to citizen or resident participation in urban policy decisions, not just as beneficiaries of simple urban policy decisions that can directly support their interests.The citizens or residents express their wishes and seek solutions to them; this also relates to the concept of the inhabitants [32].
Margerum [33] argued that for sustainable urban development, the planning and enforcement of planned urban policies are necessary, but that various groups such as citizens and civil society should participate in the formulation and enforcement of such urban policies.Therefore, the activation of citizen participation is essential in enhancing democracy and the efficiency of city policy.
Kim Han-Jun [34] argued that urban planning in the smart era should be expanded and transformed to be different from existing urban planning.The development of ICT has brought about changes in society and human behavior in various fields.In the process of smart city development, it has been argued that the expansion of citizen participation in the form of bottom-up, experimental innovation; open-source platforms; and living labs appeared as a new urban plan.
Deakin [10] said that the greatest virtue of a smart city is turning government-led policy decision making into citizen-led policy decision making.He called for citizens to actively intervene in the practice of social justice and environmental justice in the city by means of advisory groups, debates, civic participation budgets, and civic petitions.

Leadership
In terms of urban policy, the leadership of the local governor has a great influence on the success or failure of the policy.Lee [35] investigated the success factors of lifelong learning city policy in

Citizen Participation
This factor refers to citizen or resident participation in urban policy decisions, not just as beneficiaries of simple urban policy decisions that can directly support their interests.The citizens or residents express their wishes and seek solutions to them; this also relates to the concept of the inhabitants [32].
Margerum [33] argued that for sustainable urban development, the planning and enforcement of planned urban policies are necessary, but that various groups such as citizens and civil society should participate in the formulation and enforcement of such urban policies.Therefore, the activation of citizen participation is essential in enhancing democracy and the efficiency of city policy.
Kim Han-Jun [34] argued that urban planning in the smart era should be expanded and transformed to be different from existing urban planning.The development of ICT has brought about changes in society and human behavior in various fields.In the process of smart city development, it has been argued that the expansion of citizen participation in the form of bottom-up, experimental innovation; open-source platforms; and living labs appeared as a new urban plan.
Deakin [10] said that the greatest virtue of a smart city is turning government-led policy decision making into citizen-led policy decision making.He called for citizens to actively intervene in the practice of social justice and environmental justice in the city by means of advisory groups, debates, civic participation budgets, and civic petitions.

Leadership
In terms of urban policy, the leadership of the local governor has a great influence on the success or failure of the policy.Lee [35] investigated the success factors of lifelong learning city policy in terms of the leadership of local autonomous governments, and concluded that the leadership of the local government heads was able to execute the lifelong learning city policy more successfully, as the leader's political capacity was stronger.
Neirotti et al. [36] argued that the likelihood of increasing the quality level of a smart city depends on country-specific variables.Among them, leadership is argued to affect a smart city's political level, political risk, and corruption level.In order to reduce delays in implementing smart cities, policy makers in leadership roles must find ways to relieve the path dependence on technology adoption.
Washburn et al. [37] also discussed the qualities of leaders in the smart city era.For example, a CIO (chief information officer), as a digital leader, should exercise their influence in smart city building.In particular, CIOs in the smart city era must show leadership featuring ICT knowledge for the sake of successful smart city building, including skills in long-term financing, an appropriate allocation of expertise, employee education, staff accountability, and the standardization and interoperability of systems.

Infrastructure
The basis of the smart city concept is the development of ICTs such as wireless communication, big data, and the Internet of Things (IoT).The development of new technologies is realizing things that were not possible in the cities of the past.Smart technologies such as digital devices and Internet networks have been studied continuously, and various innovations and services have been achieved that were each independently developed and then connected with each other [38].In particular, city concepts such as the digital city, which emerged at the beginning of the discussion of efficient urban problem solving based on ICT, have been almost totally replaced by the concept of the smart city, which aims to operate integrated cities [39].
In other words, urban problem solving using ICT is a major task in smart city building.Toporkoff [40] argued that the development of digital technology affects various areas of a city (notably, there are big changes in urban administration and development), and that the large amount of data generated by various ICT systems is a major factor in smart cities.
Although the technology infrastructure is an important factor of a smart city, the effect of the technology infrastructure might be less if the human infrastructure is not built.For example, even if a power plant is built that produces electricity, it will become useless without human infrastructure that can run it.Building a human infrastructure is important as well as technology infrastructure.This is why we need to educate people in building a smart city for more effectively utilizing the cutting-edge technologies.

The Fourth Industrial Revolution
The term 'fourth Industrial Revolution' was first introduced at the 47th World Economic Forum Annual Meeting in Switzerland in January 2016.The fourth Industrial Revolution was defined as a next-generation industrial revolution led by artificial intelligence (AI), robotics, and life sciences.It is a technological revolution that combines digital, biotechnology, and physics based on the tertiary industrial revolution [41].
Once the fourth Industrial Revolution arrived, the paradigm for trying to solve complex and diverse urban problems changed.In particular, open innovation within smart city platforms focuses on a decentralized approach to innovation, as it has become apparent that knowledge and expertise cannot be found solely within the government, but rather are widely distributed across various sectors of society [42], which we discussed in Section 2.2.Artificial intelligence, IoT, and so on are becoming key elements of smart cities as they are merged with cities.In Korea, for example, the Korean government is deeply involved in the development of smart cities in response to the fourth Industrial Revolution.In addition, as shown in Figure 3, it expects to solve the existing urban problems through the convergence of ICT technologies and play a key role in revitalizing the economy as a new growth engine for smart city development.

Political Will
Following the flow of this smart city age, the governments of the world are firmly committed to developing smart cities.On 26 November 2013, the European Commission was held in Brussels, Belgium; they initiated a request for participation to establish "Smart City and Community Commitments."They also mentioned that the European Innovation Partnership (EIP) is needed, and the EIP will focus on effective solutions to the challenges facing European cities, smart cities, and communities.The European Commission also announced that it planned to invest approximately €200 million in smart cities and communities in the 2014-2015 budget of the Horizon 2020 Research and Innovation Program.As a result, there are well-developed smart cities in the Netherlands, Spain, and the United Kingdom (UK).In China, they are looking to urbanization to drive domestic demand growth and future growth.Since 2012, this country has been home to the world's largest smart city business, which was led by the city's rural construction department.It had invested a total of 78 billion dollars as of 2015.To do this, in August 2013, following the announcement of 90 demonstration sites in January, 103 additional sites were added.Japan is also aiming to export smart-related technology overseas.By 2020, it is expected to have an economic effect of 3.2 trillion yen and create more than 60,000 jobs.In Korea, smart cities will be built in the Cheongra and Songdo international cities and Yeongjong Sky cities by 2020, focusing on five areas: transportation, crime prevention, environment, facility management, and urban service provision.In addition, Songdo city will be built as a high-tech business city with ICT convergence through the Songdo City Integrated Operation Center, which had received investments totaling KRW 16.5 billion as of 2014 [43].Smart cities are being evaluated as new growth engines in response to the recession and the settlement of existing urban problems in the flow of the fourth Industrial Revolution.This trend was naturally achieved through policy intentions, and is regarded as a key external factor in the development of smart cities.
The government's efforts to build a smart city are interpreted mainly by the will of the central government (central government's political will).As shown in Figure 4, the policy agenda of the

Political Will
Following the flow of this smart city age, the governments of the world are firmly committed to developing smart cities.On 26 November 2013, the European Commission was held in Brussels, Belgium; they initiated a request for participation to establish "Smart City and Community Commitments."They also mentioned that the European Innovation Partnership (EIP) is needed, and the EIP will focus on effective solutions to the challenges facing European cities, smart cities, and communities.The European Commission also announced that it planned to invest approximately €200 million in smart cities and communities in the 2014-2015 budget of the Horizon 2020 Research and Innovation Program.As a result, there are well-developed smart cities in the Netherlands, Spain, and the United Kingdom (UK).In China, they are looking to urbanization to drive domestic demand growth and future growth.Since 2012, this country has been home to the world's largest smart city business, which was led by the city's rural construction department.It had invested a total of 78 billion dollars as of 2015.To do this, in August 2013, following the announcement of 90 demonstration sites in January, 103 additional sites were added.Japan is also aiming to export smart-related technology overseas.By 2020, it is expected to have an economic effect of 3.2 trillion yen and create more than 60,000 jobs.In Korea, smart cities will be built in the Cheongra and Songdo international cities and Yeongjong Sky cities by 2020, focusing on five areas: transportation, crime prevention, environment, facility management, and urban service provision.In addition, Songdo city will be built as a high-tech business city with ICT convergence through the Songdo City Integrated Operation Center, which had received investments totaling KRW 16.5 billion as of 2014 [43].Smart cities are being evaluated as new growth engines in response to the recession and the settlement of existing urban problems in the flow of the fourth Industrial Revolution.This trend was naturally achieved through policy intentions, and is regarded as a key external factor in the development of smart cities.
The government's efforts to build a smart city are interpreted mainly by the will of the central government (central government's political will).As shown in Figure 4, the policy agenda of the central government is confronted with the local government in the region where the city will be set up, which is related to the policy will of the local government.Even if the central government is strong in the will of the smart city, there are cases where it conflicts with local governments' self-governing laws or regulations, and there are also cases where limitations to the central government's laws and regulations are encountered.The government's policy agenda should always be considered together with the local government's political will.

Stakeholders
As smart cities are developing, the role of stakeholders directly or indirectly affected by smart cities has also become important.If urban planning-based cities were the product of central government-centered development, smart cities are the product of a combination of various decentralized stakeholders.Smart city project implementation and smart city vision formulation are subject to stakeholder integration, and their close collaboration is integral to the achievement of mutually beneficial end results [44].
As shown in Table 3 above, stakeholders surrounding the smart city can be divided into direct stakeholders and indirect stakeholders.Citizens and city government, government officials on smart city services and infrastructure building, and local enterprises are direct stakeholders.Citizens are the most direct beneficiaries of smart city services.Urban authorities and managers of city governments are the main actors in building smart cities and delivering services to citizens.Local enterprises in a smart city can benefit directly from creating new profits by leveraging smart city infrastructure.Indirect stakeholders include smart city technology and application providers, integrated system builders, and infrastructure service providers and operators.They provide smart city-related technology and infrastructure services in the process of creating value-added outputs and products of a smart city.

Stakeholders
As smart cities are developing, the role of stakeholders directly or indirectly affected by smart cities has also become important.If urban planning-based cities were the product of central government-centered development, smart cities are the product of a combination of various decentralized stakeholders.Smart city project implementation and smart city vision formulation are subject to stakeholder integration, and their close collaboration is integral to the achievement of mutually beneficial end results [44].
As shown in Table 3 above, stakeholders surrounding the smart city can be divided into direct stakeholders and indirect stakeholders.Citizens and city government, government officials on smart city services and infrastructure building, and local enterprises are direct stakeholders.Citizens are the most direct beneficiaries of smart city services.Urban authorities and managers of city governments are the main actors in building smart cities and delivering services to citizens.Local enterprises in a smart city can benefit directly from creating new profits by leveraging smart city infrastructure.Indirect stakeholders include smart city technology and application providers, integrated system builders, and infrastructure service providers and operators.They provide smart city-related technology and infrastructure services in the process of creating value-added outputs and products of a smart city.
Stakeholders are one of the critical external factors for smart cities.In order for smart cities to be successful, harmonization of the direct and indirect stakeholders is important.

Types Stakeholders
Direct stakeholders: city as a customer Citizens, city authorities, government managers of infrastructure building and service delivery, local enterprises Indirect stakeholders: enabling city as a customer Technology and application providers, system integrators, infrastructure service providers and operators In sum, smart cities have emerged as a means to solve the existing urban problems due to the fourth Industrial Revolution.Smart cities are being developed in various countries, and are recognized as a new economy growth engine.Governments are aware of this, and have shown policy intentions to develop smart cities.The implementation of such policy calls for the harmonization and integration of smart city stakeholders.The fourth Industrial Revolution, Smart City Policy Commitment, and stakeholders are key external elements of smart city building and need to be looked at carefully.

Data Collection and Expert Survey
Data was collected from 26 March to 13 April 2018.Twenty experts were selected to elucidate the importance of and priorities in building smart cities.An Analytic Hierarchy Process (AHP) questionnaire was conducted to gather external factors and detailed factors from the experts via e-mail.Twenty experts include professors, civil servants (city-related, smart city-related, etc.), and smart city-related researchers or experts.Their demographic details can be found in Table 4.In this study, the SPSS 18 package was used to analyze the descriptive statistics and determine their significance and priority.In addition, Microsoft Excel was used to identify the importance and priority of the derived key factors.
In multi-attribute decision making, it is difficult to determine the weight by considering the relative importance of each attribute.For this reason, AHP extracts two attributes and compares them.In order to evaluate the relative importance of the elements in the lower layer from the viewpoint of one attribute in a certain hierarchy, a pair comparison is performed between the evaluation criteria, and the result is represented as a matrix.In pair comparisons, the decision maker's preference for evaluation criteria first expressed and quantified.For this, a reliable evaluation scale is needed, and AHP is using the nine-point scale proposed by Saaty [45].Table 5 shows examples and paired comparison scales for measuring the relative importance used in the hierarchical analysis procedure for this study.

Reliability Verification through Consistency Analysis
The reliability analysis of the AHP technique can measure interpersonal judgment error by calculating a consistency ratio (CR) when evaluating the relative importance between each evaluation factor.Generally, the smaller the CR value, the more consistent it is.If the CR value is less than 10% (0.1), it is judged that the respondent consistently performed a binary comparison [45,46].Table 6 shows the verification of consistency smart city decision factors and sub-items.As shown in Table 7, The sub-items consisted of citizen participation, leadership, and infrastructure; they were ranked in order of priority.Citizen participation was highest at 0.448, leadership was 0.370, and infrastructure was 0.181.The most important internal factor of a smart city is that the experts highly appreciate the participation of citizens in the formation of a smart city, which shows that it is desirable to develop citizen participation and legal support in smart city development.As a result of the analysis of external factors shown in Table 8, political will was ranked first with 0.468, stakeholders were ranked second with 0.273, and the fourth Industrial Revolution was ranked third with 0.259.
Although smart cities emerged and developed in the flow of the fourth Industrial Revolution, it was judged by the experts that their development will be delayed without governments' political will.Also, the role of stakeholders in smart cities was seen as more important than the flow of the fourth Industrial Revolution.The results regarding the relative importance and priority of details from the internal factors are shown in Table 9.The details of the sub-items should be further refined to reflect the needs of residents through public hearings that determine the type of private activity policies in the process of implementing smart cities, such as public hearings, bottom-up approaches, and life experiments.The presence of creative communication channels was ranked first.Leadership includes innovative, open, and political leadership, and understanding of the political process in local governance, as well as ICT knowledge.Finally, the infrastructure items were classified into smart technology infrastructure including smart buildings, smart sensors, IoT, networks, artificial intelligence, and human infrastructure for providing smart city services.
The experts rated the existence of creative communication channels for city building as 0.24, the needs of residents expressed through public hearings as 0.229, understanding of IT technology as 0.162, political capacity of the head of the local government as 0.145, technology infrastructure as 0.117, and human infrastructure as 0.107.The high rating for the existence of creative communication channels for building is in line with the significant assessment of citizens' participation in the evaluation of sub-items.The experts rated citizens and participation as the most important internal factors of smart cities.The fourth Industrial Revolution transformed the paradigm for solving existing urban problems, and is regarded as one of the key elements of smart cities.In addition, we expect to be able to solve existing problems more efficiently by integrating various technologies into cities as a key engine of new growth during the recession.
Smart cities that have fused with next-generation technologies have emerged, and various smart city development policies are underway.Depending on the revision or reorganization of the legal system and the cooperation of local governments, smart cities can settle quickly.
While smart cities are emerging as a result of government-led policies, they are not sustainable without stakeholders, who are a major external component of smart cities' development.Stakeholders of smart cities include direct stakeholders (governments, civic groups, urban and local businesses, etc.) and indirect stakeholders (service providers such as technology/infrastructure providers and system builders).
As shown in Table 10, the experts ranked the revision or reorganization of legal systems first with 0.221, direct stakeholders second with 0.202, a paradigm to solve urban problems third with 0.169, local governments' willingness to cooperate fourth with 0.161, a core engine of new growth fifth with 0.151, and finally, indirect stakeholders were rated sixth with 0.096.
In addition, the importance of the internal factor of citizen participation and communication was emphasized, while governments' policy intentions were the most important external factor.This implies that an important step toward smart city development is revising and adjusting the current laws so as to not hinder smart cites' development and reflect the governments' political will.

Policy Implications and Conclusions
This investigated the determinant factors that influence smart city development, and suggested that smart city development include citizen participation with multi-communication channels in the process of smart city building.The results of the study can be summarized as follows:

•
First, as for the relative importance of the internal factors, the most important factor was citizen involvement (0.448).Leadership (0.370) and infrastructure (0.181) were next.The experts said that smart cities could not move in the right direction without citizen participation.Leadership by local governments regarding urban policy was also seen as an important factor.The technical and human infrastructure inside the city was relatively insignificant.

•
Second, the importance of internal factors was examined in terms of the existence of creative communication channels for city building (0.240), the needs of residents expressed through public hearings (0.229), understanding of ICT technology (0.162), technology infrastructure (0.117), and human infrastructure (0.107).

•
Finally, as for the relative importance of the external factors, the highest ranked was political will (0.468), followed by stakeholders (0.273) and the fourth Industrial Revolution (0.259).In the lower priority external factors, first was the revision or reorganization of the legal system (0.221), followed by direct stakeholders (0.202), a paradigm to solve urban problems (0.169), local governments' willingness to cooperate (0.161), a core engine of new growth (0.151), and indirect stakeholders (0.096).
This study suggests the following policy alternatives: • First, in order to build better smart cities, the processes of encouraging citizen participation and establishing various communication channels are vital.The "smart city" label is not limited to cities that simply adopt advanced technology.The ultimate goal of smart city development is to enhance the quality of life of individuals, families, and local people through advanced ICT, rather than the development of advanced technologies themselves.Therefore, it can be said that a bottom-up policy approach is required, rather than a top-down one, in the process of building a smart city.The people who best know the characteristics and problems of an area are its residents and citizens.Citizen participation is the most important factor and cannot be excluded from policy alternatives in smart city development to solve various urban problems.It would be better to create a smart city with ways to communicate with the public and listen to the needs of citizens and implement solutions in conjunction with policies.

•
Second, the participation of citizens should be guaranteed based on cooperative support between central and local governments.As the panel experts in this study stated, political will accompanied by strong support is a critical factor in determining a smart city's development.The central government should formulate laws and regulations that minimize the adverse effects of smart city technology adoption while mitigating excessive regulations that restrict the development of new technologies.In order to do so, the government should act as a volunteer, catalyst, and mediator, linking the central government with private enterprises, as well as with civil society.In addition, governance cooperation should be established between central and local governments, civil society, and private companies, including direct and indirect stakeholders, in order to suggest the right direction for smart city development.

•
Third, although the importance of infrastructure factors was relatively low, a smart city's construction depends heavily on the application and development of advanced ICT in the beginning stage.Therefore, investment in the research and development of smart city technology applications should be done in parallel.Similarly, the development and commercialization of technologies such as smart buildings, smart sensors, smart traffic, and smart disaster management need to be pursued in order to connect diverse functions such as neural networks throughout the city.At the same time, it is necessary to cultivate smart talents to utilize smart technologies in the right place utilize them in city policy on the whole.Administrative tasks in smart cities are likely to be reexamined and redefined due to the introduction of new technologies.Therefore, administrative manpower will also be required in the form of smart talent with the ability to predict, create, and communicate.

•
Finally, although this AHP panel study was conducted with an expert group to derive the determinants of smart cities and evaluate their priority, the size and scope of the sample were limited.In future research, it would be desirable to target smart city experts in a wider range of fields, such as technology researchers, engineers, and frontline administrative officials related to smart cities.The balanced scorecard (BSC) method needs to be employed in the future study to find out the causality between lagging (results) and leading (future) indicators on the basis of vision and strategies in building a smart city.Further, a field survey needs to be conducted for increasing the level of validity of the study, as well as the generalizability of the empirical results.

Figure 1 .
Figure 1.Five ways to make our cities smarter.

Figure 1 .
Figure 1.Five ways to make our cities smarter.

Figure 3 .
Figure 3.The fourth Industrial Revolution and smart cities.

Figure 4 .
Figure 4. Will conflicts and legal and institutional limitations.

Figure 4 .
Figure 4. Will conflicts and legal and institutional limitations.
is important to maintain logical consistency, because the two items that are compared in the survey are interrelated.Therefore, please cooperate to ensure consistency, as shown in the following example.Example: If A > B and B > C -> A > C.

Table 1 .
Smart city diagnosis indexes.

Table 2 .
Smart city performance evaluation index frequency.

Table 3 .
Types of stakeholders in smart cities.
Citizens, city authorities, government managers of infrastructure building and service delivery, local enterprises Indirect stakeholders:

Table 3 .
Types of stakeholders smart cities.

Table 4 .
Demographics of the research participants.

Table 6 .
Verification of consistency of smart city decision factors and sub-items.ICT: information and communication technology.Analyzing the Sub-Items and Details on Importance and Priority 4.2.1.Sub-Item Analysis: The Relative Importance and Priority of the Internal Factors

Table 7 .
The relative importance and priority of the internal factors.

Table 8 .
The relative importance and priority of the external factors.Analysis of the Relative Importance and Priority of Details from the Internal Factors

Table 9 .
The relative importance and priority of details from the internal factors.IT: information technology.Analysis of the Relative Importance and Priority of Details from the External Factors

Table 10 .
The relative importance and priority of details from the external factors.