You are currently viewing a new version of our website. To view the old version click .
MDPIMDPI
Search all articles
Urban Science
Download PDF
  • Editor’s Choice
  • Article
  • Open Access

22 October 2019

Prioritizing Sustainable City Indicators for Cambodia

and
1
Office of Sustainable Lifestyle, Ministry of Environment, Phnom Penh 12301, Cambodia
2
Graduate School of Urban Studies, Hanyang University, Seoul 04763, Korea
*
Author to whom correspondence should be addressed.
Urban Sci.2019, 3(4), 104;https://doi.org/10.3390/urbansci3040104
Version Notes
Order Reprints
Review Reports

Abstract

This research is based on our previous research that developed consensus sustainable city indicators for Cambodia through three-round Delphi panel surveys. That research developed indicators in the first round based on UN sustainable development goal 11, ASEAN environmentally sustainable city, Korean case study, and domestic green and clean city indicators, and validated the developed indicators in the last two rounds. After consensus analysis, that research obtained 32 assessment indicators categorized by nine criteria. However, these indicators are not prioritized yet due to the limitation of the Delphi technique. Hence, this research aims to prioritize these indicators by applying the Analytic Hierarchy Process (AHP) technique and to confirm whether the levels of importance verified by Delphi can be used for prioritizing or ranking the indicators. This research surveyed potential respondents experienced and working in relevant fields both offline and online. Online surveys were processed through E-mail, Facebook, and LinkedIn. A total of 118 questionnaires were gathered from the surveys, and 16 were inconsistent (consistency ratio > 0.1). The results showed that the highest and lowest weights are 0.0557 and 0.086. The top ten indicators are slum population (0.0557), unemployment (0.0516), crime prevention (0.0470), water supply (0.0469), city’s migration (0.0462), low-income housing (0.0445), solid waste collection (0.0437), labor-force (0.0421), construction safety (0.0400), and traffic congestion (0.0398). The rank of all indicators based on their levels of importance is completely different from the rank of their weights. Therefore, this research confirms that the levels of importance verified by Delphi cannot be used for ranking or prioritizing the consensus indicators. The priority weights in this research would be useful to policymaking, strategic direction, and budget allocation for the development and management of sustainable cities in Cambodia.

1. Introduction

1.1. Background and Purposes

Assessment indicators for the development and management of sustainable cities in Cambodia were developed by a previous research [1] through the processes of Delphi panel surveys. The Delphi technique was chosen to develop and validate the indicators in that research because this technique, as illustrated in many studies [2,3,4,5,6,7,8,9], is suitable to (a) obtain accurate information that is unavailable, (b) handle complex problems that require more judgmental analysis, (c) define areas where there is considerable uncertainty and/or a lack of agreed knowledge or disagreement, (d) allow for combining fragmentary perspectives into a collective understanding, (e) model a real world phenomena involving a range of viewpoints and for which there is little established quantitative evidence, and (f) highlight topics of concern and assess uncertainty in a quantitative manner.
That Delphi research was carried out through three-round panel surveys. The first round was to develop the indicators. The second round was to pre-validate the indicators (to identify the levels of importance). The third round was to validate the indicators (to confirm the levels of importance). The first-round questionnaire was developed based on the five major source indicators such as UN sustainable development goal 11, ASEAN environmentally sustainable city, Korean HAN case study, and domestic green and clean city indicators (see Appendix A, Table A1). The UN sustainable development goal 11 (SDG 11) indicators resulted from the major step forward and an improvement on the millennium development goals (MDGs) [10,11] and agreed in the UN 2030 agenda for sustainable development. The sustainable development goals addressed 17 goals and 169 targets [12,13,14,15]. The goal 11 addressed 10 targets, and its indicators were reviewed in the column ‘SDG 11′ [16,17]. The ASEAN environmentally sustainable city (ESC) indicators were developed by the Association of Southeast Asian Nations (Brunei, Cambodia, Indonesia, Laos, Malaysia, Myanmar, Philippines, Singapore, Thailand, and Vietnam) which was endorsed by ASEAN Environment Ministers in 2005. The goal is to pursue environmental sustainability in the rapidly growing cities of ASEAN countries [18]. The ASEAN ESC indicators were reviewed in the column ‘ESC’ [19]. The Korean HAN indicators refer to the Korean case study indicators developed by HAN Sang Mi [20]. This case study developed indicators based on the UN SDG 11 indicators, HABITAT indicators, and Korea’s relevant indicators. These indicators were reviewed in the column ‘HAN’ [21]. The green city indicators refer to the indicators developed under the green city development project in Cambodia. The Cambodia National Council for Sustainable Development (NCSD) implemented the project named “Green Urban Development Program” with the support from the Global Green Growth Institute (GGGI) and produced the green city strategic planning methodology [22] as well as green city strategic plan for Phnom Penh 2017 to 2026 [23]. The proposed indicators attached with their sectoral objectives were reviewed in the column ‘GC’. The clean city indicators refer to the indicators addressed in the clean city standard of Cambodia. This standard was developed by the Cambodia National Committee for Clean City Assessment (NCCCA) aiming to monitor and assess Cambodia’s cities through the clean city contest every three years. The winning cities will be awarded by the Prime Minister of Cambodia in the following three names “Clean City Romduol I, II, and III” upon the winning score [24,25]. The clean city indicators were reviewed in the column ‘CC’ [26].
The above Delphi research used these indicators to identify relative categories for developing the questionnaire for round one, especially to supplement the measurement-lacked indicators obtained from the round one. As a result, 69 initial indicators were obtained from the round-one survey. These 69 indicators were brought into the validation process. By using a 5-point Likert-type scale, the 69 indicators were reduced to 41 indicators in the first validation through the round-two survey. By using both the 5-point Likert-type scale and mean values (levels of importance) obtained from round two, the 41 indicators were reduced to 32 indicators in the final validation through the round-three survey. After validating the developed indicators, the research accordingly analyzed the consensus. Finally, the research obtained 32 consensus indicators categorized by nine criteria.
However, the above research does not prioritize these consensus indicators yet due to the limitation of the Delphi technique. As priority weight is necessary for the sectoral and inclusive assessment of sustainable cities [1,20], this research aims to prioritize these indicators. Furthermore, many studies showed that the Analytic Hierarchy Process (AHP) technique can be used for prioritizing issues such as policies, criteria, index, and indicators [27,28,29,30,31]. In particular, its special characteristic “Pairwise comparison” is very significant in the prioritization known as weight analysis [32,33,34,35]. Therefore, this research will apply the AHP technique for prioritizing the 32 consensus indicators, including the nine criteria and the assessment indicators in each criterion. Moreover, as the previous research verified the levels of importance of the consensus indicators by using the Delphi technique, this research also aims to address the question “How is the rank of the consensus indicators based on levels of importance (Delphi) compared to their rank based on relative weights (AHP)?” in order to confirm whether the levels of importance verified by Delphi can be used for ranking or prioritizing the consensus indicators. The hypothesis of this research is “AHP’s rank is different from the Delphi’s rank”.

1.2. Consensus Indicators

There are 32 consensus indicators developed by the previous research [1]. These indicators are categorized by nine criteria. The nine criteria are (1) Demography, (2) Employment, (3) Housing, (4) Transport, (5) Safety, (6) Water Use, (7) Waste Management, (8) Air Quality and Energy, and (9) Urban Spaces and Tourism. These criteria and their assessment indicators are shown in Table 1.
Table 1. The nine criteria and their assessment indicators.

2. Materials and Methods

As mentioned in Section 1.1, this research applied the Analytic Hierarchy Process (AHP) technique to prioritize the nine criteria and their assessment indicators. These prioritizations are divided into three parts. The first part is the prioritization of the nine criteria. The second part is the prioritization of the assessment indicators in each criterion. The third part is the prioritization of the 32 assessment indicators from all criteria. As shown in Figure 1, the nine criteria and their number of assessment indicators for AHP surveys are Demography (three indicators), Employment (three indicators), Housing (three indicators), Transport (four indicators), Safety (four indicators), Water Use (three indicators), Waste Management (three indicators), Air Quality and Energy (three indicators), and Urban Space and Tourism (five indicators).
Figure 1. The nine criteria and their assessment indicators for AHP surveys.

2.1. Questionnaire Development

There are two parts of the AHP questionnaire for the survey of this research. The first part is the AHP questionnaire for prioritizing the nine criteria. The sample of this questionnaire is shown in Figure A1. The second part is the AHP questionnaire for prioritizing the assessment indicators in each criterion. The sample of this questionnaire is shown in Figure A2, Figure A3 and Figure A4. Furthermore, the AHP questionnaire commonly uses the scale from 1 to 9 for its pairwise comparisons which is 1 “Equal importance”, 3 “Moderate importance”, 5 “Strong importance”, 7 “Very strong importance”, 9 “Extreme importance”, and 2,4,6,8 “Values in-between” [36]. Moreover, the questionnaire for prioritizing the nine criteria started with the question “Between the Criteria A and B, which one is more important for the assessment of sustainable city development and management in Cambodia?” Likewise, the questionnaire for prioritizing the assessment indicators in each criterion started with the question “Between the Indicator A and B, which one is more important for the assessment of sustainable city development and management in Cambodia?” These questions and their questionnaires are shown in Appendix B. Especially, all of the 32 indicators and their explanations were translated to Khmer language, and both Khmer and English versions including the published previous research paper were all attached with questionnaires sent to the targeted respondents.

2.2. AHP Survey and Data Analysis

AHP technique uses pairwise comparison for prioritizing the criteria and/or indicators wildly known as weight analysis [37,38,39]. This technique is very popular in qualitative assessment and used in various research, including the research theses/dissertations of the graduate students [40,41,42,43,44,45]. For inclusive assessment research, especially the research on the topics of sustainable cities, this technique requires the number of respondents to be at least 100 [20,21,46,47]. Moreover, the previous research suggested prioritizing the criteria and their assessment indicators with this sample size as well. The previous research further suggested that the respondents must be experienced and/or working in the fields related to clean, green, and sustainable city development and management, especially related to the nine categories (criteria) of the consensus indicators [1]. By following these studies, this research determined that the sample size for this next-step research must be at least 100 respondents who are working and experienced in the above-mentioned relevant fields. In this case, this research selected the relevant respondents from various institutions, such as governmental institutions, non-governmental organizations (NGOs), private firms/companies, and others (research institutions, independent researchers, research students, experienced retirees, and activists). Table 2 shows the number of respondents for both distributed and gathered surveys, including consistent (valid) and inconsistent samples classified by the types of workplaces and survey methods “Paper, Email, Facebook, and LinkedIn”. These offline- and online-survey methods were used to collect data from all relevant and potential respondents in order to obtain the valid sample size of “At least 100”.
Table 2. Statistics of the survey.
In fact, the pairwise comparisons through the AHP technique must be consistent [48,49]; thus, this research selected only consistent samples. The consistency ratio must be less than or equal to 0.1 (CR ≤ 0.1 or CR ≤ 10%) [36,50,51,52]. Therefore, the gathered questionnaires were analyzed from day to day during the time of the survey and sometimes immediately after the survey. This analysis used both Microsoft Excel and AHP-OS online program. The AHP-OS program (Figure 2) was developed by Prof. Dr. Klaus D. Goepel [36]. This program is accessible in [53], and its AHP Priority Calculator is accessible in [54]. This priority-calculator program is also available to download the data in Microsoft Excel easily and immediately after the analysis. The explanations of this program were published in [36,55]. Although this program is very accessible and easy to use, this research still used Microsoft Excel mostly. This was because the internet connection was limited during the mission to collect the data through the offline survey in Cambodia. It means that the offline surveys “Paper: Face-to-face interviews” have been conducted during the research mission of P.C. to Cambodia from 13 July 2019 to 11 August 2019. And the online surveys were started from 5 June 2019 until obtaining the consistent samples of 102 on 2 September 2019.
Figure 2. AHP-OS priority calculator.
The significant roles of the four-survey methods are as follows. Firstly, the Paper (face-to-face interview) method was used to survey the relevant government officials, especially senior officials. As shown in the table above, most of the valid samples from the governmental institutions were obtained from the paper survey. This method was also an alternative when observing that most of the distributed questionnaires through emails unlikely to reply (see Figure 3). Furthermore, this survey method also gave a chance to explain well about the AHP questionnaires to the respondents, and when the respondents were not sure about the questionnaires, they could ask immediately; consequently, this survey method obtained less inconsistent samples. Among the 39 gathered questionnaires, there are only two samples inconsistent (5.13%). However, this method was not really easy in terms of travelling to meet the targeted respondents and busy and limited time of them. Therefore, the online-survey methods are the best options to deal with these situations.
Figure 3. The number of distributed, gathered, and valid questionnaires by the survey methods.
According to the table above, the questionnaires distributed through emails are much more than other methods. Among the 174 (total) distributed questionnaires through all methods, there were 78 (44.83%) questionnaires distributed through emails. The email addresses were obtained from the Delphi surveys and the group emails of the green and sustainable city development program in Cambodia. The group emails contain the email addresses of the representatives from many organizations and agencies from all governmental and non-governmental organizations, private firms and companies, and others (research institutions, independent researchers, research students, experienced retirees, activists, and youth) experienced and working in the field of urban planning, development, management, and assessment in Cambodia. P.C. is in those groups as he has been one of the facilitators from the Ministry of Environment for the above green and sustainable city development program. There are more than 100 emails in the groups, but this research selected only the relevant ones for sending them questionnaires. Among 78 sent emails, we gathered 37 questionnaires and obtained 27 consistent samples. It means there were 10 gathered questionnaires inconsistent, equal to 27.03% (10/37). Another online-survey method is Facebook. Facebook is very popular and wisely used in Cambodia. It is also used in many purposes, including the surveys as it is very fast and easy to use and follow up. Furthermore, as P.C. has many friends as potential respondents on Facebook, this means was also an important means to obtain more potential respondents. There were 31 questionnaires sent to the well-known urban planners, Cambodia’s city assessment specialists, independent urban researchers, urban research students, real estate officers, architects, and constructors. As they are well-known respondents, and Facebook is easy to follow up, all of the 31 distributed questionnaires were gathered. More importantly, this method allowed the respondents to ask the questions easily and quickly after receiving the questionnaire and having questions. There were a few respondents who used the voice record function to ask the questions as well. Among 31 gathered questionnaires, there were three inconsistent, equal to 9.68% (3/31). The final online-survey method was LinkedIn. Even though LinkedIn is not popular for general people, it is popular for professional specialists, especially specialists in the fields of real estates. LinkedIn is also searchable for the fields and working addresses of the specialists. It generally shows us the levels of specialists’ education, expertise, and positions. This method was used to survey the respondents from the relevant private firms, independent research institutions, and especially real estate companies. As it is not popularly used by the governmental and non-governmental organizations in Cambodia, this research did not use LinkedIn to survey the respondents from these organizations. As shown in the above figure, there were the 26 questionnaires sent to potential respondents through LinkedIn. We gathered 11 questionnaires from them. Among the 11 gathered questionnaires, there was only one questionnaire inconsistent, which is equal to 9.10% (1/11).
By using the above four-survey methods, this research gathered 118 questionnaires. Among these gathered questionnaires, there were 16 inconsistent (consistency ratio > 0.1), equal to 13.56%. Therefore, this research remained with 102 valid samples (consistent samples), equal to 86.44%. These valid samples classified by the types of institutions are shown in Figure 4. This figure shows that 42% of the sample size, equal to 43 respondents, were from the relevant governmental institutions. Furthermore, 21% of the sample size, equal to 22 respondents, were from the relevant non-governmental organizations. Moreover, 21% of the sample size, equal to 21 respondents, were from the relevant private firms and companies. Finally, 16% of the sample size, equal to 16 respondents, were other potential respondents such as independent researchers, research students, experienced retirees, and activists. Since the online survey started from 5 June 2019, offline survey was from 13 July 2019 to 11 August 2019, until obtaining the 102 valid samples on 2 September 2019, this research took three months to get the required sample size.
Figure 4. Percentage of the 102 valid samples classified by the type of working places.

3. Results

The results of this research illustrated in three parts according to the step-by-step calculations. The first part presented the priority weights of the nine criteria. The second part presented the priority weights of the assessment indicators in each criterion. The third part presented the priority weights of the 32 assessment indicators from all criteria. As mentioned in Section 2, the results of the first and second parts were calculated through the Microsoft Excel and AHP-OS online program. A consistent sample calculated by this program illustrated in Appendix C. More importantly, the results of the third part were calculated by multiplying the priority weight of each indicator with the priority weight of their criteria. The priority weights in this part named total weights. All of the obtained priority weights from the first, second, and third parts, including the rank of the 32 assessment indicators by their total weights are shown in Table 3.
Table 3. Priority weights of the nine criteria and their assessment indicators and total weights of all indicator and their rank.

3.1. Priority Weights of the Nine Criteria

The priority weights of the nine criteria are as follows. “Demography” is 0.112, equal to 11.2% in percentage. “Employment” is 0.128, equal to 12.8% in percentage. “Housing” is 0.136, equal to 13.6% in percentage. “Transport” is 0.111, equal to 11.1% in percentage. “Safety” is 0.137, equal to 13.7% in percentage. “Water Use” is 0.115, equal to 11.5% in percentage. “Waste management” is 0.107, equal to 10.7% in percentage. “Air Quality and Energy” is 0.074, equal to 7.4% in percentage. “Urban Spaces and Tourism” is 0.080, equal to 8.0% in percentage. These relative weights are shown in Figure 5. Based on these weights, the nine assessment criteria for Cambodia’s cities are ranked as follows. “Safety” is at the first rank. “Housing” is at the second rank. “Employment” is at the third rank. “Water Use” is at the fourth rank. “Demography” is at the fifth rank. “Transport” is at the sixth rank. “Waste management” is at the seventh rank. “Urban Spaces and Tourism” is at the eighth rank. “Air Quality and Energy” is at the ninth rank.
Figure 5. Relative weights of the nine criteria.

3.2. Priority Weights of the Indicators in Each Criterion

3.2.1. Demography

The priority weights of the assessment indicators for “Demography” are as follows. “Population density” is 0.260, equal to 26.0% in percentage. “City’s migration” is 0.413, equal to 41.3% in percentage. “Household income” is 0.327, equal to 32.7% in percentage. These relative weights are shown in Figure 6. Based on these weights, the assessment indicators for “Demography” in Cambodia’s cities are ranked as follows. “City’s migration” is at the first rank. “Household income” is at the second rank. “Population density” is at the third rank.
Figure 6. Relative weights of the assessment indicators for “Demography”.

3.2.2. Employment

The priority weights of the assessment indicators for “Employment” are as follows. “Labor forces” is 0.328, equal to 32.8% in percentage. “Unemployment” is 0.403, equal to 40.3% in percentage. “New jobs creation” is 0.269, equal to 26.9% in percentage. These relative weights are shown in Figure 7. Based on these weights, the assessment indicators for “Employment” in Cambodia’s cities are ranked as follows. “Unemployment” is at the first rank. “Labor forces” is at the second rank. “New jobs creation” is at the third rank.
Figure 7. Relative weights of the assessment indicators for “Employment”.

3.2.3. Housing

The priority weights of the assessment indicators for “Housing” are as follows. “Slum population” is 0.410, equal to 41.0% in percentage. “Low-income housing” is 0.328, equal to 32.8% in percentage. “Quality of buildings” is 0.262, equal to 26.2% in percentage. These relative weights are shown in Figure 8. Based on these weights, the assessment indicators for “Housing” in Cambodia’s cities are ranked as follows. “Slum population” is at the first rank. “Low-income housing” is at the second rank. “Quality of buildings” is at the third rank.
Figure 8. Relative weights of the assessment indicators for “Housing”.

3.2.4. Transport

The priority weights of the assessment indicators for “Transport” are as follows. “Transport means” is 0.242, equal to 42.2% in percentage. “Sidewalks” is 0.211, equal to 21.1% in percentage. “Parking lots” is 0.189, equal to 18.9% in percentage. “Traffic congestion” is 0.359, equal to 35.9% in percentage. These relative weights are shown in Figure 9. Based on these weights, the assessment indicators for “Transport” in Cambodia’s cities are ranked as follows. “Traffic congestion” is at the first rank. “Transport means” is at the second rank. “Sidewalks” is at the third rank. “Parking lots” is at the fourth rank.
Figure 9. Relative weights of the assessment indicators for “Transport”.

3.2.5. Safety

The priority weights of the assessment indicators for “Safety” are as follows. “Crime prevention” is 0.342, equal to 34.2% in percentage. “Construction safety” is 0.291, equal to 29.1% in percentage. “Disaster prevention” is 0.199, equal to 19.9% in percentage. “Insurances” is 0.172, equal to 17.2% in percentage. These relative weights are shown in Figure 10. Based on these weights, the assessment indicators for “Safety” in Cambodia’s cities are ranked as follows. “Crime prevention” is at the first rank. “Construction safety” is at the second rank. “Disaster prevention” is at the third rank. “Insurances” is at the fourth rank.
Figure 10. Relative weights of the assessment indicators for “Safety”.

3.2.6. Water Use

The priority weights of the assessment indicators for “Water Use” are as follows. “Water supply” is 0.407, equal to 40.7% in percentage. “Water consumption” is 0.278, equal to 27.8% in percentage. “Water reservoirs” is 0.315, equal to 31.5% in percentage. These relative weights are shown in Figure 11. Based on these weights, the assessment indicators for “Water Use” in Cambodia’s cities are ranked as follows. “Water supply” is at the first rank. “Water reservoirs” is at the second rank. “Water consumption” is at the third rank.
Figure 11. Relative weights of the assessment indicators for “Water Use”.

3.2.7. Waste Management

The priority weights of the assessment indicators for “Waste management” are as follows. “Solid waste collection” is 0.408, equal to 40.8% in percentage. “Wastewater treatment” is 0.328, equal to 32.8% in percentage. “Waste reduction” is 0.265, equal to 26.5% in percentage. These relative weights are shown in Figure 12. Based on these weights, the assessment indicators for “Waste management” in Cambodia’s cities are ranked as follows. “Solid waste collection” is at the first rank. “Wastewater treatment” is at the second rank. “Waste reduction” is at the third rank.
Figure 12. Relative weights of the assessment indicators for “Waste Management”.

3.2.8. Air Quality and Energy

The priority weights of the assessment indicators for “Air Quality and Energy” are as follows. “Fine dust levels” is 0.168, equal to 16.8% in percentage. “Urban forests” is 0.204, equal to 20.4% in percentage. “Energy consumption” is 0.386, equal to 38.6% in percentage. “Renewable energy” is 0.242, equal to 24.2% in percentage. These relative weights are shown in Figure 13. Based on these weights, the assessment indicators for “Air Quality and Energy” in Cambodia’s cities are ranked as follows. “Energy consumption” is at the first rank. “Renewable energy” is at the second rank. “Urban forests” is at the third rank. “Fine dust levels” is at the fourth rank.
Figure 13. Relative weights of the assessment indicators for “Air Quality and Energy”.

3.2.9. Urban Spaces and Tourism

The priority weights of the assessment indicators for “Urban Spaces and Tourism” are as follows. “Urban parks” is 0.287, equal to 28.7% in percentage. “Botanic gardens” is 0.108, equal to 10.8% in percentage. “Heritage conservation” is 0.245, equal to 24.5% in percentage. “Tourism growth” is 0.217, equal to 21.7% in percentage. “Playgrounds” is 0.143, equal to 14.3% in percentage. These relative weights are shown in Figure 14. Based on these weights, the assessment indicators for “Urban Spaces and Tourism” in Cambodia’s cities are ranked as follows. “Urban parks” is at the first rank. “Heritage conservation” is at the second rank. “Tourism growth” is at the third rank. “Playgrounds” is at the fourth rank. “Botanic gardens” is at the fifth rank.
Figure 14. Relative weights of the assessment indicators for “Urban Spaces and Tourism”.

3.3. Priority Weights of All 32 Indicators

The priority weights of the 32 assessment indicators relatively compared to each other are shown in Figure 15. The highest-priority indicator is “Slum population (0.0557 = 5.57%)” and the lowest-priority indicator is “Botanic gardens (0.0086 = 0.86%)”. The order of all 32 assessment indicators from high to low priority is shown in Table 4. According to this table, there are two assessment indicators obtained priority weight above 0.05 (Rank no. 1 to 2). Furthermore, there are seven assessment indicators obtained priority weight in between 0.04 and 0.05 (Rank no. 3 to 9).
Figure 15. Relative weights of the 32 assessment indicators.
Table 4. The order of the 32 assessment indicators from high to low priority.
In addition, there are seven assessment indicators obtained priority weight between 0. 0.03 and 0.04 (Rank no. 10 to 16). Moreover, there are nine assessment indicators obtained priority weight between 0.02 and 0.03 (Rank no. 17 to 25). Furthermore, there are six assessment indicators obtained priority weight between 0.01 and 0.02 (Rank no. 26 to 31). Finally, there is one assessment indicator obtained priority weight below 0.01 (Rank no. 32). More importantly, as the average priority weight of assessment indicators is 0.0313 and according to Table 4, there are 16 assessment indicators (50%) above the average and 16 assessment indicators (50%) below the average.
The top ten assessment indicators are as follows. (1) Slum population is 0.0557. (2) Unemployment is 0.0516. (3) Crime prevention is 0.0470. (4) Water supply is 0.0469. (5) City’s migration is 0.0462. (6) Low-income housing is 0.0445. (7) Solid waste collection is 0.0437. (8) Labor-force is 0.0421. (9) Construction safety is 0.0400. (10) Traffic congestion is 0.0398. These assessment indicators and their description are shown in Table 5.
Table 5. Top 10 assessment indicators for sustainable city development and management in Cambodia.

4. Discussion

The results showed that the first priority criteria for sustainable city assessment in Cambodia is “Safety”. Its priority weight is 0.137. The priority weights of its assessment indicators ranked from high to low are 0.342 for crime prevention, 0.291 for construction safety, 0.199 for disaster prevention, and 0.172 for social welfare registration. These priority weights are important for assessing and ranking sustainable urban safety of Cambodian cities. These priority weights are also significant to policy making, strategic direction, and budget allocation for sustainable urban safety system development and management in Cambodia. The second priority criteria for sustainable city assessment in Cambodia is “Housing”. Its priority weight is 0.136. The priority weights of its assessment indicators ranked from high to low are 0.410 for residential and living environment improvement, 0.328 for low-income housing development, and 0.262 for quality residential buildings. These priority weights are important for assessing and ranking sustainable urban housing of Cambodian cities. These priority weights are also significant to policy making, strategic direction, and budget allocation for sustainable urban housing development and management in Cambodia. The third priority criteria for sustainable city assessment in Cambodia is “Employment”. Its priority weight is 0.128. The priority weights of its assessment indicators ranked from high to low are 0.403 for unemployment reduction, 0.328 for productive labor forces, and 0.262 for new jobs creation. These priority weights are important for assessing and ranking sustainable urban employment of Cambodia cities. These priority weights are also significant to policy making, strategic direction, and budget allocation for sustainable urban employment development and management in Cambodia.
Furthermore, the fourth priority criteria for sustainable city assessment in Cambodia is “Water Use”. Its priority weight is 0.115. The priority weights of its assessment indicators ranked from high to low are 0.407 for potable water supply infrastructure, 0.315 for freshwater supply sources, and 0.278 for water consumption. These priority weights are important for assessing and ranking sustainable urban water use of Cambodian cities. These priority weights are also significant to policy making, strategic direction, and budget allocation for sustainable urban water consumption and production in Cambodia. The fifth priority criteria for sustainable city assessment in Cambodia is “Demography”. Its priority weight is 0.112. The priority weights of its assessment indicators ranked from high to low are 0.413 for rural-urban migration management, 0.327 for household income improvement, and 0.260 for living space improvement. These priority weights are important for assessing and ranking sustainable urban demographic structure of Cambodian cities. These priority weights are also significant to policy making, strategic direction, and budget allocation for sustainable urban demographic development and management in Cambodia. The sixth priority criteria for sustainable city assessment in Cambodia is “Transport”. Its priority weight is 0.111. The priority weights of its assessment indicators ranked from high to low are 0.359 for traffic congestion reduction, 0.242 for public transport sharing rate, 0.211 for sidewalks improvement, and 0.189 for public parking lots preparation, management, and improvement. These priority weights are important for assessing and ranking sustainable urban transport of Cambodian cities. These priority weights are also significant to policy making, strategic direction, and budget allocation for sustainable urban transport development and management in Cambodia.
Moreover, the seventh priority criteria for sustainable city assessment in Cambodia is “Waste Management”. Its priority weight is 0.107. The priority weights of its assessment indicators ranked from high to low are 0.408 for solid waste collection, 0.328 for wastewater treatment, and 0.265 for waste reduction. These priority weights are important for assessing and ranking sustainable urban waste management of Cambodian cities. These priority weights are also significant to policy making, strategic direction, and budget allocation for sustainable urban waste management in Cambodia. The eighth priority criteria for sustainable city assessment in Cambodia is “Urban Spaces and Tourism”. Its priority weight is 0.080. The priority weights of its assessment indicators ranked from high to low are 0.287 for public and green spaces, 0.245 for cultural-historical and heritage conservation, 0.217 for tourism attraction and satisfaction, 0.143 for playground and leisure development, and 0.108 for biodiversity conservative parks/gardens preparation. These priority weights are important for assessing and ranking sustainable urban spaces and tourism of Cambodian cities. These weights are also significant to policy making, strategic direction, and budget allocation for sustainable urban spaces and tourism development and management in Cambodia. The ninth priority criteria for sustainable city assessment in Cambodia is “Air Quality and Energy”. Its priority weight is 0.074. The priority weights of its assessment indicators ranked from high to low are 0.386 for energy-efficient use and saving, 0.242 for renewable energy use and promotion, 0.204 for urban forest conservation and plantation, and 0.168 for air quality improvement. These priority weights are important for assessing and ranking sustainable urban air quality and energy of Cambodian cities. These priority weights are also significant to policy making, strategic direction, and budget allocation for air quality improvement and sustainable urban energy consumption and production in Cambodia.
More importantly, this research revealed the total weights of all 32 assessment indicators for the development and management of sustainable cities in Cambodia. These total weights are important for inclusive assessing and ranking the urban sustainability of Cambodia’s cities. These weights are also significant to policy making, strategic direction, and budget allocation for inclusive development and management of sustainable cities in Cambodia. Especially, the top ten indicators shown in Table 5 must be considered for monitoring and assessment in order to strongly improve urban sustainability as well as the ranking of sustainable cities in Cambodia. Furthermore, the previous research [1] showed that UN Sustainable Development Goal 11 (SDG 11) has nine indicators suitable for applying to Cambodia. Therefore, this research consequently prioritized and ranked these indicators based on the total weights of the correlated consensus indicators as shown in Table 6.
Table 6. Nine UN SDG 11 indicators prioritized for applying to Cambodia based on the priority weights of the correlated consensus indicators.
Furthermore, the mean values (levels of importance) of the 32 consensus indicators verified by Delphi and their rank based on these mean values are shown in Table 7. According to this table, the rank of the 32 indicators based on mean values are completely different from total weight’s rank. Therefore, this research confirms that the levels of importance verified by Delphi cannot be used for prioritizing or ranking the consensus indicators. As explained in Delphi’s characteristic [1,2,3], the level of importance shows how each indicator is important individually, not how each indicator is important comparatively with all indicators like the relative weight verified by AHP.
Table 7. AHP’s and Delphi’s ranks of the 32 assessment indicators.

5. Summary and Conclusions

Through the prioritization of the 32 assessment indicators by firstly prioritizing the nine criteria and then their assessment indicators, this research obtained the priority weights as follows. Firstly, the priority weights of the nine criteria ranked from high to low are Safety (0.137), Housing (0.136), Employment (0.128), Water Use (0.115), Demography (0.112), Transport (0.111), Waste management (0.107), Urban Spaces and Tourism (0.080), Air Quality and Energy (0.074). Furthermore, the priority weights of the assessment indicators in each criterion ranked from high to low are as follows. “Safety” obtained 0.342 for crime prevention, 0.291 for construction safety, 0.199 for disaster prevention, and 0.172 for social welfare registration. “Housing” obtained 0.410 for residential and living environment improvement, 0.328 for low-income housing development, and 0.262 for quality residential buildings. “Employment” obtained 0.403 for unemployment reduction, 0.328 for productive labor forces, and 0.262 for new jobs creation. “Water Use” obtained 0.407 for potable water supply infrastructure, 0.315 for freshwater supply sources, and 0.278 for water consumption. “Demography” obtained 0.413 for rural-urban migration management, 0.327 for household income improvement, and 0.260 for living spaces improvement. “Transport” obtained 0.359 for traffic congestion reduction, 0.242 for public transport sharing rate, 0.211 for sidewalks improvement, and 0.189 for public parking lots management and improvement. “Waste Management” obtained 0.408 for solid waste collection, 0.328 for wastewater treatment, and 0.265 for waste reduction. “Urban Spaces and Tourism” obtained 0.287 for public and green spaces, 0.245 for cultural-historical and heritage conservation, 0.217 for tourism attraction and satisfaction, 0.143 for playground and leisure development, and 0.108 for biodiversity conservative parks/gardens preparation. “Air Quality and Energy” obtained 0.386 for energy-efficient use and saving, 0.242 for renewable energy use and promotion, 0.204 for urban forest conservation and plantation, and 0.168 for air quality improvement. These priority weights are important for ranking sectoral development and management of sustainable cities in Cambodia. Likewise, these priority weights are also significant to policy making, strategic direction, and budget allocation for sectoral development and management of sustainable cities in Cambodia.
Importantly, the 32 assessment indicators obtained total prioritized weights as follows. There are two indicators that obtained priority weight above 0.05. Furthermore, there are seven indicators obtained priority weight between 0.04 and 0.05. In addition, there are seven indicators obtained priority weight between 0. 0.03 and 0.04. Moreover, there are nine indicators obtained priority weight between 0.02 and 0.03. Likewise, there are six indicators obtained priority weight between 0.01 and 0.02. Finally, there is one indicator that obtained priority weight below 0.01. Significantly, the top ten indicators ranked based on the total prioritized weights are ‘Residential and living environment management’ (0.0557), ‘Unemployment reduction’ (0.0516), ‘Crime prevention’ (0.0470), ‘Potable water supply infrastructure’ (0.0469), ‘Rural-urban migration management’ (0.0462), ‘Low-income housing development’ (0.0445), ‘Solid waste collection’ (0.0437), ‘Productive labor forces’ (0.0421), ‘Construction safety’ (0.0400), and ‘Traffic congestion reduction’ (0.0398). The average priority weight of all indicators is 0.0313, and half of them obtained priority weight above the average.
The total weights of the 32 assessment indicators are important for the development and management of sustainable cities in Cambodia. Primarily, these weights are important for (a) inclusive monitoring and assessment of the development and management of sustainable cities in Cambodia and (b) ranking the urban sustainability of Cambodian cities. Furthermore, these prioritized weights are significant to policy making, strategic direction, and budget allocation for inclusive development and management of sustainable cities. This research suggests using these indicators for monitoring and assessment of cities in Cambodia. Especially, the top ten indicators must be considered to use for monitoring and assessment in order to strongly improve urban sustainability. In the case of sustainable city contests, achieving these top indicators, the city can obtain good scores and rank. In addition, this research recommends selecting and applying the UN SDG 11’s indicators to Cambodia based on (i) the correlation of its indicators with the consensus indicators and (ii) the weights of the consensus indicators that correlated with its indicators.
The rank of the 32 consensus indicators based on the levels of importance verified by the Delphi technique in previous research are completely different from the total weight’s rank. Therefore, this research confirms that the levels of importance verified by the Delphi technique cannot be used for prioritizing or ranking the consensus indicators because the level of importance defines how each indicator is important individually based on the experienced panelists’ opinions, not how each indicator is important comparatively with all indicators like the total weights verified by the AHP technique. In this prioritization research, the following could be the limitations. As the AHP technique is very new to Cambodia, especially for the respondents there were limitations in terms of understanding—besides offline survey, online survey methods were challenging in that inconsistent samples were obtained. Therefore, in order to improve accuracy, face-to-face survey methods using panel groups or workshops would be the best option because in these methods the AHP technique and its questionnaires can be well explained to the respondents and their feedback can be received immediately. In this case, this research recommends that future AHP research in Cambodia must be considered on the survey methods. For the government projects, however, using the AHP technique will not be challenging because the government usually hosts the meeting and/or workshop with all relevant stakeholders for their research and development projects. Therefore, the survey through the meeting or workshop will be more consistent and accurate.

Author Contributions

Conceptualization, P.C.; data curation, P.C.; formal analysis, P.C.; funding acquisition, P.C.; investigation, P.C.; methodology, P.C.; project administration, P.C. and M.-H.L.; resources, P.C. and M.-H.L.; software, P.C.; supervision, M.-H.L.; validation, P.C. and M.-H.L.; visualization, P.C. and M.-H.L.; writing—original draft, P.C.; writing—review and editing, P.C. and M.-H.L.

Funding

This research received no external funding.

Acknowledgments

The authors would like to thank the Cambodian Ministry of Environment, Department of Green Economy, and General Secretariat of the National Council for Sustainable Development for administratively supporting this research, and National Institute of International Education of the Korean Ministry of Education for providing doctoral research scholarships to P.C. which were allocated for this research.

Conflicts of Interest

The author declares no conflict of interest.

Appendix A. Relevant Indicators

Table
Table A1. Review and classification of the five major source indicators.
Table A1. Review and classification of the five major source indicators.
CategoryIndicatorSDG11ESCHANGCCC
DemographyPopulation density● ●
Population growth rate● ●
The ratio of land consumption rate to the population growth rate● ●
Birth rate ●
Active population (20–65) rate ●
Elderly population (over 65) rate ●
Jobs and TourismLabor force participation rate ●
Unemployment rate● ●
Absence or presence of shopping centers or shopping outlets within tourist areas ●
Absence or presence of local products in shopping centers within tourist areas ●
Tourism growth rate per year ●
Number of registered foreigners ●
HousingPercentage of the population living in slums● ●
Percentage of the population spending more than 30% of their income on housing costs ●
Number of low-income housing units ●
Percentage of population living in owned houses ●
Percentage of aging residential buildings ●
TransportPercentage of population living within 0.5 km of public transport access●
Percentage of people using large public transports●
Public transport sharing rate ●
Investment in transports under the budget● ●
Number of taxi and bus ●
Proportion of environmentally friendly vehicles ●
Proportion of traffic congestion level (extra hours of travel time) ●●
SafetyAbsence or presence of measures to prevent crimes ● ●
Number of people affected by crimes; number of crimes ● ●
Number of affected people resulting from disasters●
Number of damaged or destroyed houses● ●
Proportion of disaster prevention facilities (constructed dams, reservoirs, pumping stations etc.)● ●●
Proportion of basic livelihood security ●
Clean Air and EnergyFine dust level●●●
Number of days in a year that Pollutant Standards Index (PSI) exceeded 100 (unhealthy) using USEPA standard ●
Proportion of the city government’s efforts in greenhouse gas reduction ●●
The ratio of forest conservation areas to the total land area of the city ●
Percentage of gasoline- and diesel-fueled vehicles that meet city or national standards during roadside inspection ●
Percentage of industries that fulfill the requirement of national standards ● ●
Types of alternative fuels used ●
Percentage of hotels using energy saving devices or renewable energy ●
Proportion of awareness campaigns on energy-saving techniques ●
Proportion of incentives for sustainable use of energy ●
Percentage of solar energy share in electricity supply ●
Number of buildings with solar PV installed ●
Number of green buildings in the city● ●
Waste ManagementPercentage of solid waste regularly collected and recycled●●●●●
Percentage of reduction in total waste generated a year ●
Percentage of waste collected from door to door/collection point ●
Percentage of waste transported in covered vehicles on a daily basis ●
Percentage of households and industries linked to sewerage system ●
Percentage of households with secured sanitation systems ●
Proportion of wastewater treatment plants in the city ●
Water UsePercentage of households with tap water that meets WHO drinking water standard ●
Percentage of school at all levels with water conservation education programs ●
Percentage of capacity of city in supplying water to meet average consumption ●
Percentage of available freshwater from ground and surface water extracted for use ●
Percentage of households with access to potable water infrastructure ●●
Public Space and HeritageThe ratio of public and green spaces compared to the total area of the city●●●
Frequency and time of maintaining and cleaning public and green spaces ●
Percentage of the area that complies with the stipulated spatial plan of the city ●●
Number of urban parks ●
Proportion of leisure areas in the city ●
Percentage of residents residing in public and green spaces accessible within 0.5 km●
Percentage of conservation status given to historical and cultural areas● ●
Percentage of the budget provided to maintain the cultural and natural heritage● ●
Note: The point “●” shows where the indicators were reviewed from, SDG 11, ESC, HAN, GC, or CC. Furthermore, SDG 11 refers to UN sustainable development goal 11 indicators. ESC refers to ASEAN environmentally sustainable city indicators. HAN refers to Korean HAN case study indicators. GC refers to Cambodian green city indicators. CC refers to Cambodian clean city indicators.

Appendix B. AHP Questionnaires

Question 1: Between the Criteria A and B, which one is more important for the assessment of sustainable city development and management in Cambodia?
Urbansci 03 00104 g0a1 550
Figure A1. AHP questionnaire for prioritizing the criteria. Note: 1 = Equal importance, 3 = Moderate importance, 5 = Strong importance, 7 = Very strong importance, 9 = Extreme importance (2,4,6,8- Values in-between).
Question 2: Between the Indicator A and B, which one is more important for the assessment of sustainable city development and management in Cambodia?
Urbansci 03 00104 g0a2 550
Figure A2. AHP questionnaire for prioritizing assessment indicators of Demography, Employment, and Housing. Note: 1 = Equal importance, 3 = Moderate importance, 5 = Strong importance, 7 = Very strong importance, 9 = Extreme importance (2,4,6,8- Values in-between).
Question 2: Cont.
Urbansci 03 00104 g0a3 550
Figure A3. AHP questionnaire for prioritizing assessment indicators of Transport, Safety, and Water Use. Note: 1 = Equal importance, 3 = Moderate importance, 5 = Strong importance, 7 = Very strong importance, 9 = Extreme importance (2,4,6,8- Values in-between).
Question 2: Cont.
Urbansci 03 00104 g0a4 550
Figure A4. AHP questionnaire for prioritizing assessment indicators of Waste Management, Air Quality and Energy, and Urban Spaces and Tourism. Note: 1 = Equal importance, 3 = Moderate importance, 5 = Strong importance, 7 = Very strong importance, 9 = Extreme importance (2,4,6,8- Values in-between).

Appendix C. A Consistent Sample Calculated by AHP-OS Program

Appendix C.1. Criteria

Urbansci 03 00104 i001

Appendix C.2. Indicators

Appendix C.2.1. Demography

Urbansci 03 00104 i002

Appendix C.2.2. Employment

Urbansci 03 00104 i003

Appendix C.2.3. Housing

Urbansci 03 00104 i004

Appendix C.2.4. Transport

Urbansci 03 00104 i005

Appendix C.2.5. Safety

Urbansci 03 00104 i006

Appendix C.2.6. Water Use

Urbansci 03 00104 i007

Appendix C.2.7. Waste Management

Urbansci 03 00104 i008

Appendix C.2.8. Air Quality and Energy

Urbansci 03 00104 i009

Appendix C.2.9. Urban Spaces and Tourism

Urbansci 03 00104 i010

References

  1. Chan, P.; Lee, M.-H. Developing sustainable city indicators for cambodia through Delphi Processes of panel surveys. Sustainability 2019, 11, 3166. [Google Scholar] [CrossRef]
  2. Sourani, A.; Sohail, M. The Delphi method: Review and use in construction management research. Int. J. Constr. Education Res. 2015, 11, 54–76. [Google Scholar] [CrossRef]
  3. Gupta, U.G.; Clarke, R.E. Theory and applications of the Delphi technique: A bibliography (1975–1994). J. Technol. Forecast. Soc. Chang. 1996, 53, 185–211. [Google Scholar] [CrossRef]
  4. Hinks, J.; McNay, P. The creation of a management-by-variance tool for facilities management performance assessment. Facilities 1999, 17, 31–53. [Google Scholar] [CrossRef]
  5. Bradley, L.; Stewart, K. A Delphi study of the drivers and inhibitors of Internet banking. Int. J. Bank Mark. 2002, 20, 250–260. [Google Scholar] [CrossRef]
  6. Padel, S.; Midmore, P. The development of the European market for organic products: Insights from a Delphi study. Br. Food J. 2005, 107, 626–647. [Google Scholar] [CrossRef]
  7. Bendaña, R.; del Caño, A.; de la Cruz, M.P. Contractor selection: Fuzzy control approach. Can. J. Civ. Eng. 2008, 35, 473–486. [Google Scholar] [CrossRef]
  8. Yeung, J.F.Y.; Chan, A.P.C.; Chan, D.W.M. Developing a performance index for relationship-based construction projects in Australia: Delphi study. J. Manag. Eng. 2009, 25, 59–68. [Google Scholar] [CrossRef]
  9. Lucko, G.; Rojas, E.M. Research validation: Challenges and opportunities in the construction domain. J. Constr. Eng. Manag. 2010, 136, 127–135. [Google Scholar] [CrossRef]
  10. United Nations—General Assembly. Transforming Our World: The 2030 Agenda for Sustainable Development; Resolution adopted by the General Assembly; United Nations: New York, NY, USA, 2015. [Google Scholar]
  11. Kumar, S.; Kumar, N.; Vivekadhish, S. Millennium development goals (MDGS) to sustainable development goals (SDGS): Addressing unfinished agenda and strengthening sustainable development and partnership. Ind. J. Community Med. 2016, 41, 1–4. [Google Scholar] [CrossRef]
  12. Battersby, J. MDGs to SDGs—New goals, same gaps: The continued absence of urban food security in the post-2015 global development agenda. J. Afr. Geogr. Rev. 2017, 36, 115–129. [Google Scholar] [CrossRef]
  13. WHO. Health in 2015: From Millennium Development Goals to Sustainable Development Goals. 2015. Available online: https://apps.who.int/iris/bitstream/handle/10665/200009/9789241565110_eng.pdf (accessed on 21 April 2019).
  14. Carl, D.; Clive, G. Doing biopolitics differently? Radical potential in the post-2015 MDG and SDG debates. Globalizations 2015, 12, 597–612. [Google Scholar]
  15. Li, L.; Shefali, O.; Dan, H.; Yue, C.; Jamie, P.; Jun, Z.; Joy, E.L.; Simon, C.; Colin, M.; Robert, E.B. Global, regional, and national causes of under-5 mortality in 2000–2015: An updated systematic analysis with implications for the sustainable development goals. Lancet 2016, 388, 3027–3035. [Google Scholar] [CrossRef]
  16. United Nations. About the Sustainable Development Goals (17 Goals). Available online: https://un.org/sustainabledevelopment/sustainable-development-goals/ (accessed on 11 January 2019).
  17. UN-Habitat. SDG Goal 11 Monitoring Framework. A Guide to Assist National and Local Governments to Monitor & Report on SDG 11 Indicators. 2016. Available online: https://unhabitat.org/wp-content/uploads/2016/02/SDG-Goal%2011%20Monitoring%20Framework%2025-02-16.pdf (accessed on 21 January 2019).
  18. ASEAN. ASEAN Cooperation on Environmentally Sustainable City (ESC). The Introduction. Available online: https://environment.asean.org (accessed on 21 January 2019).
  19. ASEAN. Annex C—Environmentally Sustainable City (ESC) Key Indicators. Available online: http://environment.asean.org/wp-content/uploads/2017/01/Key-Indicators_2017-Endorsed.pdf (accessed on 14 January 2019).
  20. Han, S.M. A Study on the Development and Application of Evaluation Indicators for Sustainable Urban Development and Management. Ph.D. Thesis, Hanyang University, Seoul, Korea, 2019. [Google Scholar]
  21. Han, S.M.; Lee, M.H. Analysis of Evaluation Indicators for the Development and Management of Sustainable and Resilient Cities: Focusing on the Goal 11 of UN Sustainable Developments Goals (SDGs). J. Korean Regional Dev. Assoc. 2017, 29, 1–24. [Google Scholar]
  22. NCSD; GGGI; ICEM. The Green City Strategic Planning Methodology. 2016. Available online: http://gggi.org/wp-content/uploads/2016/08/Annex-A-AAS1507-REP-006-Final-Green-city-strategic-planning-methodology.pdf (accessed on 14 January 2019).
  23. NCSD; GGGI; ICEM. The Phnom Penh Green City Strategic Plan 2017–2026 and List of Priority Green City Investment Projects for Phnom Penh; NCSD: Phnom Penh, Cambodia, 2016; pp. 11–13. [Google Scholar]
  24. Royal Government of Cambodia, NCCCA. Why Clean City Contest? Available online: http://www.cambodiacleancity.gov.kh/kh (accessed on 14 January 2019).
  25. Royal Government of Cambodia, NCCCA. The Action Plan 2011–2014. Available online: http://www.cambodiacleancity.gov.kh/kh/documents (accessed on 14 January 2019).
  26. Royal Government of Cambodia, NCCCA. The Clean City Standard. 2012. Available online: http://www.cambodiacleancity.gov.kh/kh/documents (accessed on 21 January 2019).
  27. Guarini, M.R.; Battisti, F.; Chiovitti, A. Public initiatives of settlement transformation: A theoretical-methodological approach to selecting tools of multi-criteria decision analysis. Buildings 2018, 8, 1. [Google Scholar] [CrossRef]
  28. Li, Y.; Thomas, M.A. A multiple criteria decision analysis (MCDA) software selection framework. In Proceedings of the 47th Hawaii International Conference on System Science (HICSS), Waikoloa, HI, USA, 6–9 January 2014; pp. 1084–1094. [Google Scholar]
  29. Guarini, M.R.; Battisti, F.; Chiovitti, A. A methodology for the selection of multi-criteria decision analysis methods in real estate and land management processes. Sustainability 2018, 10, 507. [Google Scholar] [CrossRef]
  30. Sepasgozar, S.M.E.; Davis, S. Construction technology adoption cube: An investigation on process, factors, barriers, drivers and decision makers using NVivo and AHP analysis. Buildings 2018, 8, 74. [Google Scholar] [CrossRef]
  31. Kaspar, R.; Ossadnik, W. Evaluation of AHP software from a management accounting perspective. J. Model. Manag. 2013, 8, 305–319. [Google Scholar]
  32. Baudry, G.; Macharis, C.; Vallée, T. Range-based multi-actor multi-criteria analysis: A combined method of multi-actor multi-criteria analysis and Monte Carlo simulation to support participatory decision making under uncertainty. Eur. J. Oper. Res. 2018, 264, 257–269. [Google Scholar] [CrossRef]
  33. Wang, J.-J.; Jing, Y.-Y.; Zhang, C.-F.; Zhao, J.-H. Review on multi-criteria decision analysis aid in sustainable energy decision-making. Renew. Sustain. Energy Rev. 2009, 13, 2263–2278. [Google Scholar] [CrossRef]
  34. Ribeiro, F.; Ferreira, P.; Araújo, M. Evaluating future scenarios for the power generation sector using a multi-criteria decision analysis (MCDA) tool: The Portuguese case. J. Energy 2013, 52, 126–136. [Google Scholar] [CrossRef]
  35. Shen, Y.C.; Grace, T.R.L.; Tzeng, G.H. Combined DEMATEL techniques with novel MCDM for the organic light emitting diode technology selection. J. Expert Syst. Appl. 2011, 38, 1468–1481. [Google Scholar] [CrossRef]
  36. Goepel, K.D. Implementation of an online software tool for the analytic hierarchy process (AHP-OS). Int. J. Anal. Hierarchy Process 2018, 10, 469–487. [Google Scholar]
  37. Lee, J.H. Assessment of the Development of the Market Utilizing Traditional AHP. Ph.D. Thesis, Hanyang University, Seoul, Korea, 2016. [Google Scholar]
  38. Kim, S.J. A Study on the Risk Factor of Global Procurement Project by Using AHP Method. Ph.D. Thesis, Hanyang University, Seoul, Korea, 2015. [Google Scholar]
  39. Cho, H.I. A Study on Risk Factors of PPI Projects Using Analytic Hierarchy Process. Ph.D. Thesis, Hanyang University, Seoul, Korea, 2008. [Google Scholar]
  40. Kim, J.J. Importance Analysis of Obstacle Factors on the CM at Risk Project Using AHP Method. Ph.D. Thesis, Hanyang University, Seoul, Korea, 2018. [Google Scholar]
  41. Lee, H.J. A Study on Deduction of Planning Indicators and AHP for Development Plan of Industrial Complex: Focusing on Industrial Complex in Gyeonggi Province. Ph.D. Thesis, Hanyang University, Seoul, Korea, 2013. [Google Scholar]
  42. Kim, B.H. A Case Study on Determining Process Improvement Priorities in a 3PL Company Using the Analytic Hierarch Process. Ph.D. Thesis, Hanyang University, Seoul, Korea, 2013. [Google Scholar]
  43. Kim, K.S. Analysis of Priority for Certification Criteria of Environment-friendly Building by AHP. Ph.D. Thesis, Hanyang University, Seoul, Korea, 2019. [Google Scholar]
  44. Oh, T.J. Analyzing the Importance of Change Orders in Apartment Projects Using AHP. Ph.D. Thesis, Hanyang University, Seoul, Korea, 2015. [Google Scholar]
  45. Lee, D.J. Evaluation of Urban Growth Management in Metropolis of Korea. Ph.D. Thesis, Hanyang University, Seoul, Korea, 2015. [Google Scholar]
  46. Han, S.M.; Lee, M.H. Application of Evaluation Index for Urban Sustainability and Resilience: Focused on the Goal 11 of UN Sustainable Development Goals (SDGs). J. Korea Real Estate Manag. Res. 2019, 29, 7–27. [Google Scholar]
  47. Nam, K.J. By Using AHP, Analysis for Importance of Visiting Factors about Integrated Resort. Ph.D. Thesis, Hanyang University, Seoul, Korea, 2018. [Google Scholar]
  48. Saaty, T.L. A scaling method for priorities in hierarchical structures. J. Math. Psychol. 1977, 15, 234–281. [Google Scholar] [CrossRef]
  49. Saaty, T.L. The Analytical Hierarchy Process—What it is and how it is used. Math. Modell. 1987, 9, 161–176. [Google Scholar] [CrossRef]
  50. Saaty, T.L. Decision making with the analytic hierarchy process. Int. J. Serv. Sci. 2008, 1, 83–98. [Google Scholar] [CrossRef]
  51. Rimba, A.B.; Setiawati, M.D.; Sambah, A.B.; Miura, F. Physical Flood Vulnerability Mapping Applying Geospatial Techniques in Okazaki City, Aichi Prefecture, Japan. Urban Sci. 2017, 1, 7. [Google Scholar] [CrossRef]
  52. Cappai, F.; Forgues, D.; Glaus, M. The Integration of Socio-Economic Indicators in the CASBEE-UD Evaluation System: A Case Study. Urban Sci. 2018, 2, 28. [Google Scholar] [CrossRef]
  53. AHP Online System—AHP-OS: Multi-criteria Decision Making Using the Analytic Hierarchy Process. Available online: https://bpmsg.com/ahp/ (accessed on 17 August 2019).
  54. AHP Online System—AHP-OS: AHP Priority Calculator. Available online: https://bpmsg.com/ahp/ahp-calc.php (accessed on 17 August 2019).
  55. Goepel, K.D. Implementation of an Online Software Tool for the Analytic Hierarchy Process: Challenges and Practical Experiences. Available online: https://bpmsg.com/wordpress/wp-content/uploads/2017/09/ahp-software.pdf (accessed on 17 August 2019).

Article Metrics

Citations

Article Access Statistics

Journal Statistics
Multiple requests from the same IP address are counted as one view.
Download PDF
Enhancing Biodiversity in Urban Green Space; An Exploration of the IAD Framework Applied to Ecologically Mature Trees
Previous
The Character of Urban Japan: Overview of Osaka-Kobe’s Cityscapes
Next