Next Article in Journal
Modeling Surface Processes on Debris-Covered Glaciers: A Review with Reference to the High Mountain Asia
Previous Article in Journal
Real-Time Control of the Middle Route of South-to-North Water Diversion Project
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Effects of Different Normalization, Aggregation, and Classification Methods on the Construction of Flood Vulnerability Indexes

by
Luana Lavagnoli Moreira
1,
Mariana Madruga de Brito
2,* and
Masato Kobiyama
1
1
Institute of Hydraulic Research, Federal University of Rio Grande do Sul, Avenida Bento Gonçalves, 9500, Bairro Agronomia, P.O. Box 15029, Porto Alegre 91501-970, Rio Grande do Sul, Brazil
2
Department of Urban and Environmental Sociology, Helmholtz-Zentrum für Umweltforschung, Permoserstraße 15, 04318 Leipzig, Germany
*
Author to whom correspondence should be addressed.
Water 2021, 13(1), 98; https://doi.org/10.3390/w13010098
Submission received: 2 December 2020 / Revised: 22 December 2020 / Accepted: 28 December 2020 / Published: 4 January 2021
(This article belongs to the Section Water Resources Management, Policy and Governance)

Abstract

:
Index-based approaches are widely employed for measuring flood vulnerability. Nevertheless, the uncertainties in the index construction are rarely considered. Here, we conducted a sensitivity analysis of a flood vulnerability index in the Maquiné Basin, Southern Brazil, considering distinct normalization, aggregation, classification methods, and their effects on the model outputs. The robustness of the results was investigated by considering Spearman’s correlations, the shift in the vulnerability rank, and spatial analysis of different normalization techniques (min-max, z-scores, distance to target, and raking) and aggregation methods (linear and geometric). The final outputs were classified into vulnerability classes using natural breaks, equal interval, quantiles, and standard deviation methods. The performance of each classification method was evaluated by spatial analysis and the Akaike’s information criterion (AIC). The results presented low sensitivity regarding the normalization step. Conversely, the geometric aggregation method produced substantial differences on the spatial vulnerability and tended to underestimate the vulnerability where indicators with low values compensated for high values. Additionally, the classification of the vulnerability into different classes led to overly sensitive outputs. Thus, given the AIC performance, the natural breaks method was most suitable. The obtained results can support decision-makers in reducing uncertainty and increasing the quality of flood vulnerability assessments.

1. Introduction

Vulnerability has an important role in flood risk assessment, as hazards only become disasters if there are vulnerable people or infrastructure located in hazard-exposed areas [1]. Indeed, flood impacts strongly depend on the vulnerability of the exposed system or community [2,3]. Thus, the knowledge of vulnerability is fundamental for assessing flood risk, as it allows computing the susceptibility of the exposed elements [4] by considering multiple dimensions [5]. Furthermore, the assessment of vulnerability allows identifying hot spot areas and the main drivers that contribute to it (e.g., social, economic, physical, cultural, environmental, and institutional) [6].
According to Nasiri et al. [7], flood vulnerability is usually assessed by employing the following methods: (i) vulnerability curve, (ii) disaster loss data, (iii) computer modeling, and (iv) index-based. The latter is recommended by several authors, because it allows for a holistic analysis of the vulnerability dimensions, aiming to ensure a better representation of reality [5,7,8,9]. Additionally, the use of indexes allows to simplify the system conditions and behavior, to summarize complex and multidimensional issues, to facilitate interpretations by end-users, and to reduce the number of indicators [10].
Despite the advantages of index-based approaches, there are some limitations as each step of the index construction carries uncertainty [11,12]. Such uncertainties are mainly related to the normalization of indicators, criteria weighting, and the aggregation method, as well as the quality and availability of data, natural variability, and human judgment [13,14,15,16]. They influence the final vulnerability patterns [17]. Hence, the methodological choices made during the composite index construction implicate assumptions, subjectivity, and uncertainties that must be identified and recognized [18,19].
In order to understand the uncertainties and guarantee the robustness of the flood vulnerability index assessments, the construction and stability of the model outputs should be investigated under a wide range of possible conditions. In this regard, sensitivity and uncertainty analyses are needed [20,21]. Nevertheless, these analyses are seldom conducted in flood vulnerability studies [22,23]. Most of the published articles deal only with the uncertainty associated to the weighting process [24,25,26,27,28,29] or deal with understanding the uncertainties in hazard models [30,31,32,33]. However, other steps that are also relevant, such as the uncertainty introduced by the normalization and aggregation [12,34], and the classification of the results into different vulnerability classes are understudied.
Previous studies have shown that sensitivity and uncertainty analyses applied to the normalization and aggregation steps are crucial to guarantee the robustness of the flood vulnerability index [35], as they can strongly influence the outputs. The choice of methods can mask the real vulnerability by over- or underestimating its values. Moreover, the classification process of the flood vulnerability map results in different outcomes, as demonstrated by studies focusing on landslide susceptibility [36] and intelligent compaction data [37]. Indeed, some studies [38,39] found that the use of different normalization methods influences the final composite indicator. Similarly, Caccavale and Giuffrida [40] argued that, after weighting, normalization, database, and aggregation are the main sources of output variation. In contrast, Santeramo [41] showed that normalization and weighting have a minimal effect on the construction of an index for food security and that attention should be paid to the database and aggregation steps.
Despite these studies, few researchers have addressed the uncertainty introduced by the use of different index construction methods in the context of flood vulnerability. Usually, attention is often paid to the uncertainty introduced by criteria weights [24,25,26,27,28,29]. Nevertheless, the choice of the normalization, aggregation, and classification methods is usually done without transparency [6,42]. Therefore, the potential of different techniques in influencing the vulnerability assessment outcomes is still unclear.
To provide solutions for the aforementioned gaps, the present study aims to understand the flood vulnerability behavior by considering different normalization, aggregation, and classification methods in order to construct a robust flood vulnerability index. Here, the following questions are addressed: (i) Can the choices of normalization, aggregation, and classification methods affect the outputs of flood vulnerability? (ii) How do the flood vulnerability maps vary in space for each method choice? (iii) Which methods are more appropriate for building flood vulnerability indexes? The study case of the Maquiné River Basin, located in the South of Brazil, is used to illustrate the proposed approach.

2. Materials and Methods

2.1. Study Area

The proposed methodology was applied to the Maquiné River Basin (510 km2), Southern Brazil (Figure 1). This basin is located in a mountainous area, and its altitude varies between 9 to 975 m. The climate is mostly humid subtropical. However, at altitudes above 700 m, the climate becomes humid temperate. The mean annual rainfall is between 1700 and 2109 mm. The basin is mostly covered by forest (78.3%), followed by crops (11.7%), bare soil (5.5%), reforestation (3.0%), water (0.9%), and urban area (0.7%). The basin has a population of 6024 inhabitants, 70.0% of which live in rural areas [43]. This area is divided into twenty census blocks, where one is represented by a forest protection area. This basin was chosen as a case study because flood disasters occur annually or biannually, routinely affecting the citizens. One of the most significant events occurred in May 2008, when the river discharge reached 568 m3/s, much higher than the average one (15.2 m3/s), damaging houses and displacing people [44].

2.2. Flood Vulnerability Index Construction

The construction of indexes usually consists of the following steps: (i) choice of the phenomenon to be measured, (ii) indicators selection, (iii) normalization, (iv) weighting, (v) aggregation, (vi) classification of the results in different classes, (vii) sensitivity and uncertainty analysis, and (viii) validation [19].
In order to investigate uncertainty in the construction of a flood vulnerability index for our case study, we (i) chose relevant indicators based on a systematic literature review [45,46]; (ii) normalized these indicators by using the four most common methods (min-max, z-scores, distance to target, and raking); (iii) employed an equal-weights scheme; (iv) aggregated the normalized indicators with equal weights by two aggregation methods: linear and geometric; (v) classified flood vulnerability outputs by considering four methods; and (vi) performed a sensitivity and uncertainty analysis of the normalization and aggregation methods by computing the Spearman correlation between the outputs and the rankings using a box plot. Furthermore, the performance of the different classification methods was evaluated by using the Akaike’s information criterion (AIC) (Figure 2).
The indicators used to represent flood vulnerability were selected according to: (i) their relevance, as evidenced by a systematic literature review conducted in a previous step of this research, (ii) the availability of data to represent them, and (iii) their suitability to the Brazilian context. Based on these criteria, we selected 19 indicators (Table 1). The datasets used to represent them were obtained from the Brazilian 2010 Census [43]. The spatial resolution of this data corresponds to the census block level [43]. Among the 20 census blocks in Maquiné River Basin, two were ignored (8 and 9, see Figure 1), because there are no people living there and, consequently, no vulnerability. The selected indicators were grouped into three vulnerability dimensions: social, economic, and physical (Table 1). Given to data availability limitations, relevant criteria such as distance to critical infrastructure and risk perception were not considered.
The indicators were normalized, (i.e., were changed into the same units) to allow their aggregation. The following methods were chosen, as proposed by Saisana and Saltelli [47].
  • Min-max—rescales values from 0 (worst rank for a specific indicator) to 1 (the best). It subtracts the minimum value and divides it by the range of the maximum value subtracting the minimum value:
    y in = x in min ( x in ) max ( x in ) min ( x in )
  • Z-cores—converts all the indicators to a common scale with a mean of zero and a standard deviation of one:
    y in = x in   x in σ   x   in
  • Distance to target—normalizes indicators by dividing the unit’s value by a reference target (i.e., maximum value):
    y in = x in max ( x in )
  • Ranking—based on ordinal variables that can be turned into quantitative variables:
    y in = Rank ( x in )
where y in is the normalized indicator, x in is the indicator value,   x   in is the indicator’s average, and σ   x   in is the indicator standard deviation.
After normalizing the indicators, they were aggregated by two methods: linear and geometric, as shown by Equations (5) and (6), respectively. All the indicators had the same weight, thus receiving the same importance. This allowed focusing only on the uncertainties of the normalization and aggregation methods, because different weights would interfere in the final results.
Index = i = 1 q w i I i
Index = i = 1 q x w i
where i n w i = 1   and   0   w i   1 ,   for   all   i = 1 , , n , and w is the weight associated with a normalized value ( I ) for the indicator i , and q is the number of indicators.
Finally, the flood vulnerability index was spatialized and classified into five categories: “very low”, “low”, “medium”, “high”, and “very high”. This classification was made by four methods:
  • Natural breaks (Jenks)—class breaks are identified by the best group similar values that maximize the differences between classes. The features are divided into classes whose boundaries are set where there are relatively big differences in the data values.
  • Equal interval—it divides the values into equal-sized classes. After specifying the number of intervals, the class breaks based on the value range are automatically determined.
  • Quantile—each class contains an equal number of features.
  • Standard deviation—shows how much a feature’s attribute value varies from the mean. Class breaks are created with equal value ranges that are a proportion of the standard deviation, usually at intervals of one, one-half, one-third, or one-fourth the standard deviations using mean values and the standard deviations.

2.3. Sensitivity Analysis

The sensitivity analysis or robustness test was conducted to understand how the variation in the output parameters can be apportioned to different choices of normalization and aggregation methods, as well as the index classification methods.
We tested the robustness of our results by changing the input data parameters, considering a local sensitivity analysis (SA) termed one-at-a-time SA [48]. By variating the normalization, aggregation, and classification methods, we verified how these disturbances affected the results when all the other parameters remained constant [49]. The similarity of the outputs when considering these changes was measured by conducting a correlation analysis using Spearman’s rank correlation [12,34,39]. This nonparametric correlation allows measuring the strength of the association between two variables [50]. Additionally, we computed the sensitivity according to the rank methodology proposed by Hudrliková [51] to examine the relative vulnerability ranking of the census block with different normalization and aggregation approaches.
To investigate the sensitivity of the different classification method schemes and identify the most suitable one, we adopted the Akaike’s information criterion (AIC) [52]. At first, we mapped all the indexes by using all the classification methods to investigate the spatial differences. Then, the AIC was applied to the classification of geospatial data [37] by using Equations (7) and (8).
AIC = 2 K = 1 m i G k x i log   q ^ k + 2 ( m 1 )
where
q ^ k = i ϵ G k x i / Xn k
where x i is the geospatial data (index value), m is the number of classes, G k is the kth class of data, X is the global sum of x i data, and n k is the number of data in class G k .

3. Results

Based on four normalization and two aggregation methods, six flood vulnerability indexes or scenarios (N1AL, N2AL, N3AL, N4AL, N2AG, and N4AG) were generated (Figure 3). Two normalization methods were unable to be used with geometric aggregation: min-max and distance to target. The former transformed the minimum value to zero, resulting in a final vulnerability of zero. Similarly, with the distance to the target method, it was only possible to aggregate indicators with nonzero values. This indicates that the geometric aggregation operator does not possess the ability to aggregate such types of information effectively [53]. In this case, it was necessary to exclude seven indicators that presented values equal to zero in some census blocks.
The correlations between the flood vulnerability indexes (Figure 3) show that the majority of indexes have a high correlation with each other, with values ranging from 0.818 to 0.998. However, the lowest correlations were found with N2AG with all the indexes, with Spearman correlation coefficients near to zero. This occurs because Z-scores normalize some values near to zero. Hence, when these indicators are aggregated using the geometric method, the high scores result into values near zero (low vulnerability). Besides, the correlation between N2AG and N4AG is negative, which indicates that the flood vulnerability values vary in contrast to each other.
All scenarios with linear aggregations have linear and positive correlations (Figure 4a–f). This is not the case for all correlations between the indexes based on geometric aggregation and the others (Figure 4g–o). Although N4AG (Figure 4m) has a high correlation with all the indexes that used linear aggregation, it is not linear.
The robustness of the results when considering the normalization and aggregation steps was also tested by computing the shift in rank for each census block (CB) (Figure 5). Overall, the vulnerability outcomes for each CB obtained by the different normalization and aggregation methods confirmed the flood vulnerability independence of the normalization scheme selection. On the other hand, flood vulnerability tends to be sensitive to the aggregation schemes.
CB1 and CB7 had, overall, the highest vulnerability scores (i.e., they were usually ranked with high vulnerability by all scenarios), with a relatively low sensitivity. This is mainly because these are the most urbanized areas, and hence, after normalization, they had the highest vulnerability scores, given their higher population density. CB11 was the census block with the highest variability, whereas CB12, CB19, CB13, CB3, and CB4 were the least sensitive ones. In Figure 5, the higher sensitivities are observed in all census blocks for the N2AG index. Similarly, N4AG presents relative differences in most of the census blocks in comparison to the other indexes. Indeed, the geometric aggregation method carries the most sensitive in the flood vulnerability outputs. Meanwhile, all normalization techniques with linear aggregation stayed almost in the same rank position, except when considering the distance to target normalization (N4AL) for the CB4.
To understand how these methods affect the spatial behavior of flood vulnerability, maps with the class switches were generated by using four classification methods. These maps were classified into “very low”, “low”, “medium”, “high”, and “very high” flood vulnerabilities [3,54,55] based on the natural breaks and equal interval classification methods (Figure 6) and quantile and standard deviation classification methods (Figure 7).
When considering the linear aggregation (AL), the spatial distributions of the vulnerability obtained by the Min-max (N1), z-scores (N2), and distance to target (N3) normalization methods are identical for all the census blocks for the natural breaks (Figure 6a–c), quantile (Figure 7a–c), and standard deviation (Figure 7g–i) classification methods. The only exception occurs when using the equal interval approach (Figure 6a,g,h) and the ranking normalization (N4).
The flood vulnerability classes generated by the geometric aggregation (AG) method are, in some cases, drastically different when compared with linear aggregation for all classification methods. Indeed, some census blocks change from the “very low” (Figure 6a–c) to “very high” (Figure 6e) vulnerability class. Such a high sensitivity from using different aggregation methods can result in inaccurate outputs. The major differences were observed in the equal interval (Figure 6k,l) and standard deviation (Figure 7k,l) classification methods, where most census blocks were classified with a “very low” and “low” vulnerability, according to the geometric aggregation method. This tends to underestimate the real vulnerability.
When fixing the index and focusing on the classes generated by different classification methods, significant differences can be found. For instance, for the N1AL index, one census block changed from the “high” to “medium” vulnerability class created by the natural breaks (Figure 6a) and equal interval (Figure 6g) methods, respectively. In comparison, in the same index, four census blocks changed their classes from the natural breaks (Figure 6a) to quantile (Figure 7a) classification method. These differences took place for all the indexes in all classification methods. Indeed, the index classification methods introduced great uncertainty.
Figure 8 demonstrates the percentage of the areas classified according to each index and classification method. The percentage of the census block for each class was similar, except for the standard deviation method, where the quantities of the census block in each class changed significantly in all the normalization and aggregation methods. For example, for the N1AL and N2AL indexes, 16.67% of the census block was classified as having “very high” vulnerability, which strongly disagrees with the standard deviation classification method, which calculated 5.56%.
Other percentage differences took place in the same classification methods as the N4AL and aggregation methods when compared with the N1Al, N2Al, and N3AL indexes. It is important to note that all indexes have the same quantities for all classes in the quantile classification method. Although the percentage is the same, there are spatial changes (e.g., in the N1AL index, 22% of the census block was classified as having “medium” vulnerability in the natural breaks and quantile classification methods); when a census block was classified as having “medium” vulnerability for the N1AL index classified using natural breaks, the same blocks were classified as having “low” vulnerability for the N1AL index using the quantile method.
Finally, the performances of the classification methods were analyzed by the AIC estimations (Table 2), where the lowest values indicate the best performances. These estimations were not performed for the indexes based on z-scores normalization with linear (N2AL) and geometric aggregation (N2AG), because the sum of all the indicators was zero, and some indicators had negative values. Overall, the natural breaks method provides the lowest AIC for the N1AL and N3AL indexes; however, for the equal interval methods, we found the lowest AIC for N4AL and N4AG. As shown in Table 2, the geometric aggregation method (N4AG) also resulted in higher variances when compared to the other indexes that used linear aggregation.

4. Discussion

We verified the sensitivity of the different normalization and aggregation methods to construct a flood vulnerability index. Additionally, we investigated how different index classification methods could modify the flood vulnerability results. By analyzing the outputs, we could derive the following general summary: (i) most of the indexes have a high positive and linear correlation between each other, except for indexes generated with geometric aggregation, (ii) a high sensitivity to flood vulnerability arises from indexes created by geometric aggregation when compared with linear aggregation, (iii) the results are not sensitive to the different normalization methods, (iv) the flood vulnerability classes vary significantly for the indexes based on geometric aggregation for most classification methods, except quantile, (v) significant spatial changes of the flood vulnerability class occur for equal intervals for indexes that do not change outputs the for other classification methods, and (vi) according to the AIC, the natural breaks and equal intervals have the best performances among the investigated classification methods.
No significant differences were observed among the min-max, z-scores, and distance to target normalization methods with linear aggregation. The low sensitivity by normalization methods based on linear aggregation were also demonstrated by the shift in rank (Figure 5). Even though ranking normalization with liner aggregation brought a high Spearman’s correlations coefficient (0.92 to 0.93), there were small spatial changes in the flood vulnerability class in comparison with the other normalization methods with linear aggregation. High Spearman’s correlation coefficients (>0.98) for the min-max and z-scores were also found in the vulnerability indexes elaborated by other authors [12,34]. However, for other application areas (e.g., the agricultural sustainability index), significant differences were found according to the different normalization methods [39].
On the other hand, when the flood vulnerability indexes were created by geometric aggregation, the outputs were very distinct. This is because indicators with very low values were fully compensated by indicators with high values [19]. This can be observed in Figure 6 and Figure 7, where most of all parts of the Maquiné Basin were classified as “low” or “very low” flood vulnerabilities. Simultaneously, this method forbids to use indicators with zero scores or with normalization techniques that result in zero scores, such as the min-max. Since studies of vulnerability normally include social, economic, cultural, environmental, and other dimensions, these indicators are mutually preferentially independent. In these cases, linear aggregation is preferred [56].
In addition to uncertainty regarding the aggregation method, we identified high uncertainties in the index classification. High spatial sensitivities were observed in all the classification methods. For the equal intervals, different from other methods, changes occurred with the N1AL, N2AL, and N3AL indexes. Since it divides the score data into equal-sized classes, its performance might not be optimal for different types of normalization and aggregation methods whose distributions scores are different. The best performance confirmed with the AIC were attributed to natural breaks and equal intervals.
Based on the disadvantages of the equal interval methods mentioned above and based on the AIC, the natural breaks method performed more efficiently than the others. Since the quantile method divides the data by the quantities of elements in each class, its performance might not be optimal for different distributions, and the standard methods do not show real scores, only how far these are from the average. On the other hand, the natural breaks method could show the variance of each class from the average and determine the location of class breaks based on the numerical scores of the features. These methods generated the most suitable classification map for other index studies as landslide susceptibility [36] and intelligent compaction data [37].
The spatial analysis of the elaborated indexes showed that some regions tend to be overly sensitive to model changes, whereas others present robust outcomes (e.g., CB12, CB19, CB13, CB3, and CB4 in Figure 5). Furthermore, the vulnerability classification into different classes also contributed to the spatial variation. This information can be used by end users to conduct further studies aiming to investigate the role of the different criteria in shaping the vulnerability outcomes.
Notwithstanding the advances of our study, the limitations should be also pointed out. Although the investigated methods are most commonly used in flood vulnerability studies, there are others, such as the categorical scale, binary standardization, division by total and fuzzy for normalization methods, and non-compensatory aggregation technique. Therefore, future studies should focus on understanding the uncertainty underpinning these methods. Likewise, the choice of the criteria and the variation of their weights also generate significant uncertainty [25,42] and should be the subject of future research. Here, we decided to use equal weights because of difficulties in finding an acceptable weighting scheme. Nevertheless, when information on the indicator’s importance is available, weighted indexes are recommended.

5. Conclusions

The present study investigated the effects of the use of different normalization, aggregation, and classification methods in order to construct a flood vulnerability index. The sensitivity analysis results provided information on the regions with high sensitivity, as well as the techniques that increased this variability. Overall, we concluded that:
  • Normalization techniques such as the min-max, z-scores, and distance to target do not make significant changes in the flood vulnerability outputs. Among the normalization methods, the ranking method was most sensitive.
  • The choice of aggregation method strongly affects the vulnerability outcomes. For our case study, the geometric aggregation method was more sensitive when compared with linear aggregation, as it offered inferior compensability for the indexes, with lower scores.
  • For each classification method (natural breaks, equal interval, quantile, and standard deviation), there were changes in the same census block with respect to over- and underestimating the flood vulnerability. However, the natural breaks method had the best performance, according to the AIC values.
The present study contributes to addressing the importance of measuring the sensitivity of different steps while building vulnerability indexes. Based on our results, efforts can be taken to reduce the uncertainty. Focus should be given to census blocks classified with high and very high vulnerability and high sensitivity. These blocks are potentially vulnerable but need to be further examined due to their degree of uncertainty. Hence, the outcomes can support end users in reducing uncertainty and improving decision-making. The proposed approach can be transferred to other case studies, providing insights regarding the sensitivity of the flood vulnerability indexes.

Author Contributions

Conceptualization, L.L.M. and M.M.d.B.; Data curation, L.L.M.; Formal analysis, L.L.M., M.M.d.B. and M.K.; Investigation, L.L.M.; Methodology, L.L.M. and M.M.d.B.; Resources, L.L.M. and M.M.d.B.; Supervision, M.M.d.B. and M.K.; Writing—original draft, L.L.M.; Writing—review & editing, L.L.M., M.M.d.B. and M.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Council for Scientific and Technological Development, CNPq, Brazil, grant number 141387/2019-0.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

No new data were created or analyzed in this study. Data sharing is not applicable to this article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kobiyama, M.; Goerl, R.F.; Monteiro, L.R. Integração das ciências e das tecnologias para redução de desastres naturais: Sócio-hidrologia e sócio-tecnologia. Revista Gestão Sustentabilidade Ambiental 2018, 7, 206. [Google Scholar] [CrossRef]
  2. Reilly, B. Disaster and Human History: Case Studies in Nature, Society and Catastrophe; McFarland & Company: Jefferson, NC, USA, 2009. [Google Scholar]
  3. De Brito, M.M.; Evers, M.; Almoradie, A.D.S. Participatory flood vulnerability assessment: A multi-criteria approach. Hydrol. Earth Syst. Sci. 2018, 22, 373–390. [Google Scholar] [CrossRef] [Green Version]
  4. Karagiorgos, K.; Thaler, T.; Heiser, M.; Hübl, J.; Fuchs, S. Integrated flash flood vulnerability assessment: Insights from East Attica, Greece. J. Hydrol. 2016, 541, 553–562. [Google Scholar] [CrossRef]
  5. Birkmann, J.; Cardona, O.D.; Carreño, M.L.; Barbat, A.H.; Pelling, M.; Schneiderbauer, S.; Kienberger, S.; Keiler, M.; Alexander, D.; Zeil, P.; et al. Framing vulnerability, risk and societal responses: The MOVE framework. Nat. Hazards 2013, 67, 193–211. [Google Scholar] [CrossRef]
  6. Rufat, S.; Tate, E.; Burton, C.G.; Maroof, A.S. Social vulnerability to floods: Review of case studies and implications for measurement. Int. J. Disaster Risk Reduct. 2015, 14, 470–486. [Google Scholar] [CrossRef] [Green Version]
  7. Nasiri, H.; Mohd Yusof, M.J.; Mohammad Ali, T.A. An overview to flood vulnerability assessment methods. Sustain. Water Resour. Manag. 2016, 2, 1–6. [Google Scholar] [CrossRef] [Green Version]
  8. Balica, S.F.; Popescu, I.; Beevers, L.; Wright, N.G. Parametric and physically based modelling techniques for flood risk and vulnerability assessment: A comparison. Environ. Model. Softw. 2013, 41, 84–92. [Google Scholar] [CrossRef]
  9. Fuchs, S.; Kuhlicke, C.; Meyer, V. Editorial for the special issue: Vulnerability to natural hazards-the challenge of integration. Nat. Hazards 2011, 58, 609–619. [Google Scholar] [CrossRef] [Green Version]
  10. Saisana, M.; Tarantola, S. State-of-the-Art Report on Current Methodologies and Practices for Composite Indicator Development; Institute for the Protection and Security of the Citizen Technological and Economic Risk Management: Ispra, Italy, 2002. [Google Scholar]
  11. Jorgensen, S.E.; Burkhard, B.; Müller, F. Twenty volumes of ecological indicators-An accounting short review. Ecol. Indic. 2013, 28, 4–9. [Google Scholar] [CrossRef]
  12. Nazeer, M.; Bork, H.R. Flood vulnerability assessment through different methodological approaches in the context of North-West Khyber Pakhtunkhwa, Pakistan. Sustainability 2019, 11, 6695. [Google Scholar] [CrossRef] [Green Version]
  13. Malczewski, J. GIS-based multicriteria decision analysis: A survey of the literature. Int. J. Geogr. Inf. Sci. 2006, 20, 703–726. [Google Scholar] [CrossRef]
  14. Chen, H.; Wood, M.D.; Linstead, C.; Maltby, E. Uncertainty analysis in a GIS-based multi-criteria analysis tool for river catchment management. Environ. Model. Softw. 2011, 26, 395–405. [Google Scholar] [CrossRef]
  15. Ligmann-Zielinska, A.; Jankowski, P. Spatially-explicit integrated uncertainty and sensitivity analysis of criteria weights in multicriteria land suitability evaluation. Environ. Model. Softw. 2014, 57, 235–247. [Google Scholar] [CrossRef]
  16. Crosetto, M.; Tarantola, S.; Saltelli, A. Sensitivity and uncertainty analysis in spatial modelling based on GIS. Agric. Ecosyst. Environ. 2000, 81, 71–79. [Google Scholar] [CrossRef]
  17. Tate, E. Social vulnerability indices: A comparative assessment using uncertainty and sensitivity analysis. Nat. Hazards 2012, 63, 325–347. [Google Scholar] [CrossRef]
  18. Balica, S.; Wright, N.G. Reducing the complexity of the flood vulnerability index. Environ. Hazards 2010. [Google Scholar] [CrossRef]
  19. Nardo, M.; Saisana, M.; Saltelli, A.; Tarantola, S. Handbook of Contructing Compsoite Indicators: Methodology and User Guide; OECD Publishing: Paris, France, 2008. [Google Scholar]
  20. Chen, K.F.; Leandro, J.A. Conceptual time-varying flood resilience index for urban areas: Munich city. Water 2019, 11, 830. [Google Scholar] [CrossRef] [Green Version]
  21. Fernandez, P.; Mourato, S.; Moreira, M.; Pereira, L. A new approach for computing a flood vulnerability index using cluster analysis. Phys. Chem. Earth 2016, 94, 47–55. [Google Scholar] [CrossRef]
  22. De Brito, M.M.; de Evers, M. Multi-criteria decision-making for flood risk management: A survey of the current state of the art. Nat. Hazards Earth Syst. Sci. 2016, 16, 1019–1033. [Google Scholar] [CrossRef] [Green Version]
  23. Burgass, M.J.; Halpern, B.S.; Nicholson, E.; Milner-Gulland, E.J. Navigating uncertainty in environmental composite indicators. Ecol. Indic. 2017, 75, 268–278. [Google Scholar] [CrossRef]
  24. Becker, W.; Saisana, M.; Paruolo, P.; Vandecasteele, I. Weights and importance in composite indicators: Closing the gap. Ecol. Indic. 2017, 80, 12–22. [Google Scholar] [CrossRef] [PubMed]
  25. De Brito, M.M.; Almoradie, A.; Evers, M. Spatially-explicit sensitivity and uncertainty analysis in a MCDA-based flood vulnerability model. Int. J. Geogr. Inf. Sci. 2019, 33, 1788–1806. [Google Scholar] [CrossRef]
  26. Chen, Y.; Yu, J.; Khan, S. The spatial framework for weight sensitivity analysis in AHP-based multi-criteria decision making. Environ. Model. Softw. 2013, 48, 129–140. [Google Scholar] [CrossRef]
  27. Xu, E.; Zhang, H. Spatially-explicit sensitivity analysis for land suitability evaluation. Appl. Geogr. 2013, 45, 1–9. [Google Scholar] [CrossRef]
  28. Müller, A.; Reiter, J.; Weiland, U. Assessment of urban vulnerability towards floods using an indicator-based approach-a case study for Santiago de Chile. Nat. Hazards Earth Syst. Sci. 2011, 11, 2107–2123. [Google Scholar] [CrossRef] [Green Version]
  29. Rogelis, M.C.; Werner, M.; Obregón, N.; Wright, N. Regional prioritisation of flood risk in mountainous areas. Nat. Hazards Earth Syst. Sci. 2016, 16, 833–853. [Google Scholar] [CrossRef] [Green Version]
  30. Liu, Z.; Merwade, V.; Jafarzadegan, K. Investigating the role of model structure and surface roughness in generating flood inundation extents using one- and two-dimensional hydraulic models. J. Flood Risk Manag. 2019, 12. [Google Scholar] [CrossRef] [Green Version]
  31. Liu, Z.; Merwade, V. Accounting for model structure, parameter and input forcing uncertainty in flood inundation modeling using Bayesian model averaging. J. Hydrol. 2018, 565, 138–149. [Google Scholar] [CrossRef]
  32. Liu, Z.; Merwade, V. Separation and prioritization of uncertainty sources in a raster based flood inundation model using hierarchical Bayesian model averaging. J. Hydrol. 2019, 578, 124100. [Google Scholar] [CrossRef]
  33. Rajib, A.; Liu, Z.; Merwade, V.; Tavakoly, A.A.; Follum, M.L. Towards a large-scale locally relevant flood inundation modeling framework using SWAT and LISFLOOD-FP. J. Hydrol. 2020, 581, 124406. [Google Scholar] [CrossRef]
  34. Yoon, D.K. Assessment of social vulnerability to natural disasters: A comparative study. Nat. Hazards 2012, 63, 823–843. [Google Scholar] [CrossRef]
  35. Abebe, Y.; Kabir, G.; Tesfamariam, S. Assessing urban areas vulnerability to pluvial flooding using GIS applications and Bayesian Belief Network model. J. Clean. Prod. 2018, 174, 1629–1641. [Google Scholar] [CrossRef]
  36. Baeza, C.; Lantada, N.; Amorim, S. Statistical and spatial analysis of landslide susceptibility maps with different classification systems. Environ. Earth Sci. 2016, 75, 1–17. [Google Scholar] [CrossRef] [Green Version]
  37. Mazari, M.; Tirado, C.; Nazarian, S.; Aldouri, R. Impact of Geospatial Classification Method on Interpretation of Intelligent Compaction Data. Transp. Res. Rec. 2017, 2657, 37–46. [Google Scholar] [CrossRef]
  38. Floridi, M.; Pagni, S.; Falorni, S.; Luzzati, T. An exercise in composite indicators construction: Assessing the sustainability of Italian regions. Ecol. Econ. 2011, 70, 1440–1447. [Google Scholar] [CrossRef]
  39. Talukder, B.; Hipel, K.W.; van Loon, G.W. Developing composite indicators for agricultural sustainability assessment: Effect of normalization and aggregation techniques. Resources 2017, 6, 66. [Google Scholar] [CrossRef] [Green Version]
  40. Caccavale, O.M.; Giuffrida, V. The Proteus composite index: Towards a better metric for global food security. World Dev. 2020, 126, 104709. [Google Scholar] [CrossRef]
  41. Santeramo, F.G. On the composite indicators for Food Security: Decisions matter! Food Rev. Int. 2015, 31, 63–73. [Google Scholar] [CrossRef] [Green Version]
  42. De Brito, M.M.; Evers, M.; Höllermann, B. Prioritization of flood vulnerability, coping capacity and exposure indicators through the Delphi technique: A case study in Taquari-Antas basin, Brazil. Int. J. Disaster Risk Reduct. 2017, 24, 119–128. [Google Scholar] [CrossRef]
  43. IBGE Censo Demográfico 2010. Available online: http://www.ibge.gov.br/home/estatistica/populacao/censo2010/default.shtm (accessed on 18 November 2016).
  44. De Castro, D.; Mello, R.S.P. Bacia Hidrográfica do Rio Tramandaí: Atlas Ambiental; Via Sapiens livraria: Porto Alegre, Brazil, 2013. [Google Scholar]
  45. Kienberger, S.; Contreras, D.; Zeil, P. Chapter 3-Spatial and Holistic Assessment of Social, Economic, and Environmental Vulnerability to Floods—Lessons from the Salzach River Basin, Austria. In Assessment of Vulnerability to Natural Hazards; Birkmann, J., Kienberger, S., Alexander, D.E.B.T.-A., Eds.; Elsevier: Amsterdam, The Netherlands, 2014; pp. 53–73. [Google Scholar]
  46. Contreras, D.; Chamorro, A.; Wilkinson, S. Review article: The spatial dimension in the assessment of urban socio-economic vulnerability related to geohazards. Nat. Hazards Earth Syst. Sci. 2020, 20, 1663–1687. [Google Scholar] [CrossRef]
  47. Saisana, M.; Saltelli, A. Rankings and ratings: Instructions for use. Hague J. Rule Law 2011, 3, 247–268. [Google Scholar] [CrossRef]
  48. Damm, M. Mapping Social-Ecological Vulnerability to Flooding: A Sub-National Approach for Germany. Ph.D. Thesis, Rheinischen Friedrich-Wilhelms-Universität, Bonn, Germany, 2010. [Google Scholar]
  49. Loucks, D.P.; van Beek, E. Water Resource Systems Planning and Management; Springer: Berlin/Heidelberg, Germany, 2017; Volume 4. [Google Scholar]
  50. Hauke, J.; Kossowski, T. Comparison of values of pearson’s and spearman’s correlation coefficients on the same sets of data. Quaest. Geogr. 2011, 30, 87–93. [Google Scholar] [CrossRef] [Green Version]
  51. Hudrliková, L. Composite indicators as a useful tool for international comparison: The Europe 2020 example. Prague Econ. Pap. 2013, 22, 459–473. [Google Scholar] [CrossRef] [Green Version]
  52. Akaike, H. Akaike’s Information Criterion Statistics; Lovric, M., Ed.; Springe: Berlin/Heidelberg, Germany, 2011; p. 25. [Google Scholar]
  53. Garg, H.; Munir, M.; Ullah, K.; Mahmood, T.; Jan, N. Algorithm for T-spherical fuzzy multi-attribute decision making based on improved interactive aggregation operators. Symmetry 2018, 10, 670. [Google Scholar] [CrossRef] [Green Version]
  54. Aroca-Jiménez, E.; Bodoque, J.M.; García, J.A.; Díez-Herrero, A. A quantitative methodology for the assessment of the regional economic vulnerability to flash floods. J. Hydrol. 2018, 565, 386–399. [Google Scholar] [CrossRef]
  55. Aroca-Jimenez, E.; Bodoque, J.M.; Antonio Garcia, J.; Diez-Herrero, A. Construction of an integrated social vulnerability index in urban areas prone to flash flooding. Nat. Hazards Earth Syst. Sci. 2017, 17, 1541–1557. [Google Scholar] [CrossRef] [Green Version]
  56. Gan, X.; Fernandez, I.C.; Guo, J.; Wilson, M.; Zhao, Y.; Zhou, B.; Wu, J. When to use what: Methods for weighting and aggregating sustainability indicators. Ecol. Indic. 2017, 81, 491–502. [Google Scholar] [CrossRef]
Figure 1. Location of the Maquiné River Basin, census blocks (CB), DEM (digital elevation model), and annual precipitation (mm).
Figure 1. Location of the Maquiné River Basin, census blocks (CB), DEM (digital elevation model), and annual precipitation (mm).
Water 13 00098 g001
Figure 2. Flowchart with the methodological outline. The uncertainty of the different normalization and aggregation methods was evaluated using both the Spearman correlation and the ranking index analysis (blue boxes). The uncertainty coming from the index classification step was evaluated by employing the Akaike’s information criterion (AIC) analysis (green boxes).
Figure 2. Flowchart with the methodological outline. The uncertainty of the different normalization and aggregation methods was evaluated using both the Spearman correlation and the ranking index analysis (blue boxes). The uncertainty coming from the index classification step was evaluated by employing the Akaike’s information criterion (AIC) analysis (green boxes).
Water 13 00098 g002
Figure 3. Correlation between the flood vulnerability indexes based on the different normalization and aggregation methods. Numbers represent Spearman correlation coefficients; colors represent the strength of the correlation.
Figure 3. Correlation between the flood vulnerability indexes based on the different normalization and aggregation methods. Numbers represent Spearman correlation coefficients; colors represent the strength of the correlation.
Water 13 00098 g003
Figure 4. Correlations between the flood vulnerability indexes of normalization and aggregation methods. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Figure 4. Correlations between the flood vulnerability indexes of normalization and aggregation methods. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Water 13 00098 g004
Figure 5. Ranking by different normalization and aggregation methods. The census blocks (CB) are organized according to their rank score values. High ranks indicate higher vulnerability, whereas lower values represent CB ranked with low vulnerability. Outliers are denoted by circles and extremes by asterisks. The CB spatial location is shown in Figure 1. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Figure 5. Ranking by different normalization and aggregation methods. The census blocks (CB) are organized according to their rank score values. High ranks indicate higher vulnerability, whereas lower values represent CB ranked with low vulnerability. Outliers are denoted by circles and extremes by asterisks. The CB spatial location is shown in Figure 1. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Water 13 00098 g005
Figure 6. Vulnerability class switches for the different normalization and aggregation methods based on the natural breaks and equal interval classification methods. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Figure 6. Vulnerability class switches for the different normalization and aggregation methods based on the natural breaks and equal interval classification methods. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Water 13 00098 g006
Figure 7. Vulnerability class switches for the different normalization and aggregation methods based on the quantile and standard deviation classification methods. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Figure 7. Vulnerability class switches for the different normalization and aggregation methods based on the quantile and standard deviation classification methods. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Water 13 00098 g007
Figure 8. Percentage of the census block (n = 18) for each vulnerability class according to the different normalization and aggregation methods. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Figure 8. Percentage of the census block (n = 18) for each vulnerability class according to the different normalization and aggregation methods. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Water 13 00098 g008
Table 1. Input flood vulnerability indicators, their dimensions, and units.
Table 1. Input flood vulnerability indicators, their dimensions, and units.
DimensionIndicatorUnit
Social vulnerabilityTotal populationpersons
Population densitypersons km2
Number of womenpersons
Dependency rate *percentage
Households with more than 5 peoplepercentage
Number of women head of homespersons
Inhabitants aged 0 to 4 yearspersons
Inhabitants aged more than 65 yearspersons
Illiterate peoplepersons
Economic vulnerabilityPer capita income1000/R$
Unemployed peoplepersons
People living in rented housespersons
Household’s per capita monthly income equal 1/8 of the minimum wagepercentage
House head without incomepercentage
House head’s income less than 1 minimum wagepercentage
House head’s income less than 2 minimum wagespercentage
Physical vulnerabilityHouseholds with open sewagepercentage
Households without garbage collectpercentage
Households without access to electricitypercentage
Indicators that quantify households were transformed to percentages (number of households divided by the total of households in the census block) to avoid misleading with the number of persons. Data source is Brazilian 2010 Census [43]. R$ denotes the Brazilian currency. * Dependency rate is an age–population ratio of persons that are not in the labor force (persons’ ages 0 to 14 and 65+).
Table 2. Performances of the classification methods for the flood vulnerability indexes based on the different normalizations and aggregation techniques. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Table 2. Performances of the classification methods for the flood vulnerability indexes based on the different normalizations and aggregation techniques. N1 = Min-max normalization, N2 = Z-scores normalization, N3 = distance to target normalization, N4 = ranking normalization, AL = linear aggregation, and AG = geometric aggregation.
Classification MethodsN1ALN3ALN4ALN4AG
Natural Breaks296.89314.037892.39−13.98
Equal Interval296.90314.117886.24−48.06
Quantile297.04314.337893.19−5.92
Standard Deviation297.07314.267890.35−29.60
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Moreira, L.L.; de Brito, M.M.; Kobiyama, M. Effects of Different Normalization, Aggregation, and Classification Methods on the Construction of Flood Vulnerability Indexes. Water 2021, 13, 98. https://doi.org/10.3390/w13010098

AMA Style

Moreira LL, de Brito MM, Kobiyama M. Effects of Different Normalization, Aggregation, and Classification Methods on the Construction of Flood Vulnerability Indexes. Water. 2021; 13(1):98. https://doi.org/10.3390/w13010098

Chicago/Turabian Style

Moreira, Luana Lavagnoli, Mariana Madruga de Brito, and Masato Kobiyama. 2021. "Effects of Different Normalization, Aggregation, and Classification Methods on the Construction of Flood Vulnerability Indexes" Water 13, no. 1: 98. https://doi.org/10.3390/w13010098

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop