Abstract
Human vulnerability to heat varies at a range of spatial scales, especially within cities where there can be noticeable intra-urban differences in heat risk factors. Mapping and visualizing intra-urban heat vulnerability offers opportunities for presenting information to support decision-making. For example the visualization of the spatial variation of heat vulnerability has the potential to enable local governments to identify hot spots of vulnerability and allocate resources and increase assistance to people in areas of greatest need. Recently there has been a proliferation of heat vulnerability mapping studies, all of which, to varying degrees, justify the process of vulnerability mapping in a policy context. However, to date, there has not been a systematic review of the extent to which the results of vulnerability mapping studies have been applied in decision-making. Accordingly we undertook a comprehensive review of 37 recently published papers that use geospatial techniques for assessing human vulnerability to heat. In addition, we conducted an anonymous survey of the lead authors of the 37 papers in order to establish the level of interaction between the researchers as science information producers and local authorities as information users. Both paper review and author survey results show that heat vulnerability mapping has been used in an attempt to communicate policy recommendations, raise awareness and induce institutional networking and learning, but has not as yet had a substantive influence on policymaking or preventive action.
Keywords:
heat stress; vulnerability; mapping; decision support; implementation; awareness; local authorities 1. Introduction
The direct and indirect health effects of a changing climate, along with an increasing frequency and intensity of extreme weather events such as storms, floods, cold spells and heat waves are considered to be this century’s challenge for society [1,2]. Cities are of particular interest in the context of climate variability and change because this is where potentially a large number of people are exposed to threats from extreme climate events [3]. This is made more germane given current rates of urbanization with just over 50 percent of the world’s population currently living in urban centers. It is estimated that nearly 9% of the world’s population will be living in just 41 megacities by 2030 (UN, 2015). At the same time, the high concentration of people in urban areas, make cities a good place for innovation and social learning. For example initiatives such as the C40 Cities Climate Leadership Group (http://www.c40.org) have resulted in actions that will reduce greenhouse gas emissions and address climate risks and impacts locally and globally, through creating a network of megacities that share knowledge. In relation to this transformative approach to dealing with climate risk and as the paradigm of adaptive management becomes increasingly accepted, it is becoming clear that joint action at the community level, in tandem with top-down interventions from public health agencies are needed to promote resilience to climate change and other stressors [4].
Vulnerability assessments increase the understanding of complex processes and aim at providing decision support for stakeholders and government at a variety of levels. Ideally priorities in adaptation should target areas in greatest need. Spatial assessments of vulnerability are especially appealing to policymakers, as vulnerability maps provide a convenient way to communicate risk related information [5,6]. During the past two decades, the increase in data availability, computational processing and storage capability and the development of geospatial analysis techniques has advanced the possibilities of spatial assessments [7]. Pelling [8], Birkmann and Fuchs [9,10], provide a critical view of both deductive and inductive modeling assuming that vulnerability mapping can induce institutional learning at multiple levels and Hess et al. see it is part of a repository of tools that help to improve adaptive management and increase the resilience of local public health systems [11]. Vulnerability mapping has been developed for health risks related to hazards such as earthquakes [12], flood, infectious diseases [13] and others. For example, English et al. (2009) reviewed a number of environmental health indicators for multiple hazards associated with climate change (heat stress, flooding, fire, drought, allergens, infectious disease) that included vulnerability indicators among others [14].
Of the aforementioned range of hazards, heat or extreme high temperature events have begun to receive an increasing amount of attention because of their discernible impacts on health and infrastructure. The health impacts of recent heat events such as the 2003 European [15], 2009 Melbourne [16], 2010 Russian [17] and 2014 Japan heatwaves [18] have been considerable, either in terms of number of deaths or those hospitalized. Accordingly, and occasionally at the encouragement of local authorities, researchers have begun to explore the possibility of heat vulnerability mapping as an aid to the development of adaptive management strategies focused on heat as a health problem. Since Smoyer [19] and Wilhelmi [20] called for developing integrated, spatial vulnerability assessments for heat, at least 26 papers on this subject have been published. Theoretically, integrated spatial assessments of vulnerability to heat stress, with the intent to identify hot spots of vulnerability, should assist with indicating where health protection from extreme heat should receive major attention. Reid [21], Maier [22], Harlan [23] and Wolf et al. [24] have tested the performance of heat vulnerability indices (HVIs) in different cities and claim, because of the utility in relation to policy development, that they are more than theoretical constructs. Very recently, and therefore not included in this analysis, is Morabito’s [25] mapping heat-related elderly risk index and surface temperature. Bao et al. [26] have provided a review of some HVIs, comparing in detail the different input variables.
The question however remains, whether policy makers use the outputs from vulnerability mapping studies. Given this, the goal of this paper is to comprehensively explore the extent to which the published literature on heat vulnerability mapping has been taken up by the policy development community. In relation to this overarching aim, specifically we address the following questions
- (1)
- how has the research concerning heat vulnerability indices (HVI) been conducted, in terms of methods and data used (inductive versus deductive)?
- (2)
- what are the limitations and potential problems of current approaches to developing HVIs;
- (3)
- what are the policy recommendations of the research?
- (4)
- are there discernible linkages between HVI research and policy application?
- (5)
- what is the degree of interaction and collaboration between the heat vulnerability research and policy making communities?
By exploring these questions through the critically reflective review and by surveying the authors, our hope is to identify whether current practice facilitates or impedes the inclusion of heat vulnerability (science) mapping in policy making. By analyzing the challenges and limitations in building and applying HVIs we make a contribution to the wider question of bridging the gap between (HVI-) research and policy making. Given the burgeoning number of vulnerability index development and mapping studies and the need for the information generated by such studies to be useable in a policy sense, the aim of this paper is to establish whether there is a gap between research and practice. Accordingly we were interested in posing and answering the question “is there evidence for the application of research findings from vulnerability index and mapping studies to policy development?”
2. Methodology
In order to address the above mentioned aim we identified and reviewed “heat vulnerability mapping papers” that had been published up until 15 April 2015; a total of 37 papers were identified. In addition we invited the lead authors of each paper to partake in a short online survey (see Appendix A) composed of 10 core questions designed to elicit information related to vulnerability assessment development and whether the resultant information was incorporated into the formation of any local to regional heat management strategies. In the following sections the methodology for identifying the 37 papers along with the related review criteria and the nature of the online survey questions are described. Paper review results and an analysis of author survey responses is then presented, followed by a discussion of the review and survey results in the context of main question posed by this study.
2.1. Paper Identification and Review Criteria
The criteria used in the literature search was informed by previous research undertaken by the authors [24,27,28]. Specifically we used the web resources PubMed.gov (US National Library of Medicine, National Institute of Health), Web of Science and Science Direct to identify heat vulnerability mapping papers. The following keywords were used to search for relevant peer-reviewed articles: Heat, vulnerability to heat, heat waves, and vulnerability mapping. We then screened the search results and kept the papers that applied geospatial techniques. The search was limited to papers published in the English language. Papers were then screened for information about the approach used, policy recommendation given and any indications concerning cooperation with local stakeholders or links between science and action. Information was extracted and summarized in three tables. Based on the extracted information, a qualitative classification of the nature of cooperation between the vulnerability index/mapping producers (“the scientists”) and the decision makers was undertaken; the categories used were “Yes”, “No” and “Vague”. Further, the policy recommendations in these papers were also extracted (see Appendix B).
2.2. Author Survey
A survey was set up using an online tool for surveys (eSurv.org). The aims of the survey were to: (a) identify grey literature that provides evidence of the application of the different heat vulnerability indices in local settings; (b) collect examples of good practice of knowledge transfer and cooperation between scientists and local decision makers; (c) understand limitations and obstacles in bridging science and policy. Nine multiple-choice and three open questions (see Appendix A) were posed to the 34 corresponding authors of the papers listed in Table 1, Table 2 and Table 3 (some authors have multiple papers). The questions covered data collection for the development of the heat vulnerability index, the interaction with local authorities, the impact of the work in terms of application of the index and awareness raised, as well as the whether the index was being used to support decision-making. Two questions explored if the authors plan to undertake further research on heat vulnerability or other vulnerability mapping. The consent to publish the survey results was also requested. Authors were invited to partake in the survey in May 2015 and two follow up reminders were subsequently sent to non-responding authors.
3. Results
3.1. Results of the Literature Review
Based on the search criteria, 37 papers were identified. 21 papers were from the USA and Canada, twelve from Europe and four from Australia. The number of spatial units used for vulnerability mapping varied from 15 (local-government-area scale) to 92,000 (census-block scale). The GIS intrinsically implied possibility to “overlay” risk from hazard (high temperature), exposure to it and population vulnerability is further referred to as the “Crichton’s Risk Triangle” approach [25,29,30]. A series of studies reduce the dimensionality of data of several input variables. The studies identified by the literature search are displayed in tables 1, 2 and 3 according to the approach used to construct the vulnerability index, namely: (1) “a-priori”/inductive index without testing with empirical health data (11 studies); (2) “a-priori”/inductive index and with testing with health data (6 studies, two are the testing part of studies from Table 1); and (3) a “bottom-up” approach to mapping health outcomes and subsequently exploring vulnerability factors (9 studies). These studies analyze health data to derive information about spatial vulnerability patterns from empirical data. We did not observe any HVI studies that adopt a deductive approach, which utilizes available theories or frameworks to derive an HVI—this may be because there is lack of a strong theory or framework for developing vulnerability indices [31], and vulnerability being a “place-based” concept which makes it rather context specific.
Table 1 summarizes the details of 18 studies that use census data and methods of dimensionality reduction, such as Principal Components (PCA) or Factor Analysis, to produce an “a-priori” vulnerability index that is then mapped. Such an approach could be considered as a “top–down” approach. Tate refers to this type of research method as “inductive” [32], as it uses variables that directly or in a proxy sense represent heat risk factors, to construct vulnerability indices. Reid, for example, performs a Factor Analysis of ten variables (demographics, prevalence of air condition, vegetation cover from satellite images and diabetes rate) and combines the resulting components into a vulnerability index for urban areas in the US [33]. Some studies also include projections of climate and population and thus try to estimate future vulnerability [34,35]. In some cases, the heat/temperature hazard is mapped separately [28], in others it is integrated into the index [36].
Table 2 summarizes details of seven studies that apply the “top down”- approach as outlined above for Table 1 but further use spatial health data to test the performance of the index or elements of it. Wolf et al. [24] and Reid et al [21] in fact describe the testing/validation of vulnerability indices based on PCA or Factor Analysis presented in separate papers. Also risk-mapping studies [37] using health data are included here.
Table 3 summarizes details of the remaining twelve studies with a “bottom-up” approach: They all use health data to weight components in a HVI or directly map adverse health outcomes (e.g., excess heat deaths or heat related illness) and then identify characteristics of the vulnerable populations using an array of statistical methods. The heterogeneous methods here range from General Linear and Mixed Models applied to different factors for heat mortality and heat distress calls [38], Principal Component Analysis with inclusion of mortality data into the analysis rather than for validation [39,40], identification of areas with excess mortality and subsequent identification of risk factors through principal component regression [41], mapping of heat related mortality rate ratios and evaluation of spatial association between variables that describe neighborhood-scale characteristics and excess deaths amongst the elderly [42], vulnerability and exposure modeling with standard linear regression relating temperature to morbidity and mortality indicators [43], a forward selection algorithm based on Bayesian information criterion [44] and a series of hierarchical Bayesian models to examine associations between temperature and morbidity [45].
Table 1.
Papers on “a-priori”/inductive heat vulnerability mapping.
Table 2.
Papers on “a-priori”/inductive heat vulnerability mapping using health data to test the index.
Table 3.
Papers on mapping health outcomes and exploring vulnerability factors.
In 15 out of the 37 papers identified geo-referenced health outcome data is used. The type of health outcome data used in the studies listed in Table 2 and Table 3 varies. There are, for example, different ways to identify “heat related” mortality: in some studies mortality includes “all causes”, in other studies some specific causes of death (e.g., “external causes”) are excluded. The same applies to morbidity measures such as (all or selected) hospital admissions and (all or selected) ambulance calls.
Indications relating to cooperation with local stakeholders or links between science and action were extracted and are summarized in Table 1, Table 2 and Table 3 and classified into “Yes”, “No” and “Vague”. This categorization reveals that most studies in group 1 (inductive/top down approach without health data) (6 out of 18 papers) give an indication about concrete cooperation with decision makers, whereas this can be confirmed for only one study (out of 7) in group 2 (inductive/top down approach with health data testing). Group 3 (bottom-up approach with use of health data) records 2 “Yes” (out of 12). For details see Table 4. The papers’ information about policy recommendations is summarized in Table A1, Table A2 and Table A3 in Appendix B.
Table 4.
Cooperation with decision makers, determined by the review of literature.
3.2. Results of the Survey
Authors were invited to partake in the survey in May 2015 and two follow up reminders were subsequently sent to non-responding authors; 21 out of 34 authors completed the survey by closure of the survey in July 2015 (61% response rate). The replies were as follows:
- Data collection: Most of the data were available for free (76%), a minor fee of less than US$100 or equivalent was charged to some (10%) and 14% paid a higher fee. Although not specified by the respondents, some of the high costs may be related to the acquisition of satellite images Data were available online for 29% of the respondents. Local authorities were supportive in data collection (48%) or helpful after considerable follow up by researchers (19%).
- Interaction with local authorities: The levels of interaction with local authorities varied. 86% reported that there was interaction with local authorities at different levels. 24% report much interaction (oral presentation/discussion at conferences, meetings or workshops, joint publications, email and phone), 38% “some” interaction and 24% “some but not much” interaction. 71% report that local officials commented on the vulnerability index, 29% did not know or did not get feedback. The overall tenor of the discussions and comments received by the survey respondents was considered fruitful and constructive. Only 14% of the respondents reported that there was no interaction. This probably applies to those studies with a pure focus on research where the exploration of the vulnerability assessment was the primary goal.
- Use of the analysis: Overall, respondents were positive about their index being applied. 71% think—to low, mid and high degree—that the respective vulnerability index is or will be used to support decisions on where to take action. Further, more than half of the respondents think that the results of the work are or will be applied in the local context: 14% thought the research results have already had significant influence in the local context and 43% saw or envisaged some local application. But there are also skeptics: 14% of respondents thought that the degree of application was very limited. 19% of respondents do think that results are not being applied in the local context and 10% of respondents do not know. 29% of respondents replied “I don’t know” to the question “do you think the index is or will be used to support decisions on where to take action”.
- Awareness raised: 90% of the respondents think that the respective work has increased awareness among the authorities and/or in the public to a low (38%), mid (33%) or high (19%) degree.
- Risk communication: 76% stated that the work has been used to communicate risks. In 40% the work was used by researchers to communicate risks to local agencies and/or experts or to the general public (30%). Only in 6% the local authorities were considered active in risk communication to the general public using the scientific work.
- Further research: 76% of the replying authors are planning to undertake further work on the topic of vulnerability to heat in the same or another urban area, 5% exclude this and 19% do not know. Consideration given to building a vulnerability index for other hazards is rather scarce, half of the respondents replied “no” or “do not know”. Some also claim that similar criteria (social cohesion) define vulnerability to heat as well as other hazards. Others have done, know about or envisage vulnerability mapping for flooding and for several other hazards (severe storms, tsunamis, droughts, wild fires, disease vectors, earthquakes, land-slides environmental refugees, food shortages).
4. Discussion
This literature review has shown that there have been numerous attempts to assess and map vulnerability to heat stress in urban areas. Among the 37 papers reviewed, almost half adopted a similar set of methods and variables that were established by a few foundation studies, such as Cutter [66]. This indicates that Cutter’s inductive approach to developing a SoVI (Social Vulnerability Index) for environmental hazards in general, significantly influenced the majority of subsequent heat vulnerability work. The use of ready and often freely available (census) data and by now relatively accessible computation methods (PCA/factor analysis) has provided the opportunity to apply a “Cutter-type” approach to a variety of different urban areas. However, Tate [32] has indicated that the SoVI has limitations in measuring actual vulnerability; these weaknesses apply to some HVI as well. Indicator selection according to local availability, scale of analysis, measurement error, data transformation, normalization, and weighting as well as aggregation are all possible sources of index inaccuracy. In addition, the contextual effects from the complex interactions of a place’s unique socio-ecological systems could also limit the predictability of generic vulnerability indicators [55]. Further, as Romero-Lankao [67] concludes in her meta-analysis, researchers often make rather subjective modeling decisions with little or no stated justification in urban heat vulnerability index studies. While she argues that subjectivity is not inherently a bad thing and inevitable to some extent, she underlines that the effects of subjective choices on the output index need to be assessed before applying and using it to prioritize action. Similarly, Tate [32] claims that uncertainty and sensitivity analysis is often missing in such research. This is largely borne out by the review of studies presented in this paper.
While uncertainty originating from model development procedures is acknowledged in some papers (e.g., [68,69]), the implications that uncertainties associated with vulnerability assessment hold for policy development and decision making are not addressed explicitly. In fact, the way in which many of the papers present the science in relation to policy fits the linear communication model [70] such that information is provided with the expectation that there will be uptake by a relatively amorphous policy community. Some researchers have referred to this as the “loading dock” approach [71] to the provision of scientific information for policy development and have expressed the inappropriateness of this method, especially in the case of communicating scientific content that may possess elements of uncertainty [72]. In a similar vein, Knaggard [73] highlights the issues associated with evidence-based decision-making in the context of a paradigm of rationality. Despite the best intentions of some of the studies reviewed here, the fact that uncertainty in relation to policy and decision making is not addressed unambiguously raises the possible spectre of unusable science or non-actionable knowledge [74,75]. Although this situation is regrettable it is not irretrievable as the opportunity exists to adopt some imaginative approaches to assessing or simulating the effects of uncertainty on policy development in future studies that build on those reviewed here. For example van Pelt et al. [72] discuss the utility of intermediaries or boundary objects in acknowledging and communicating uncertainty and Head [76] outlines strategies for addressing the challenges arising from so called “wicked problems”, a category of problem in which the impacts of heat on society comfortably sits. Dany et al. [77] and Berkhout et al. [78] both emphasize the critical role that stakeholder opinions play in how research and policy can develop in a mutually beneficial way and Reed et al. [79] suggest a number of principles that should be followed for effective practice of knowledge exchange.
Given that many of the heat vulnerability indices reviewed here have been developed in isolation of local knowledge, not only about micro-climates but also known socially determined hotspots of vulnerability, the suggestion by Kniveton et al. [80] that integrating local and scientific knowledge can be beneficial for addressing uncertainty, is particularly pertinent. Millner et al. [81] also describe how expert elicitation can assist with gauging the impact of uncertainty on decision making.
While there is agreement on the awareness raised (only 10% are not sure about this), several respondents claim that the application of the developed index at the local level is limited. Only 14% think that the research results have had a significant influence in the local context. When it comes to the use of the index to support decisions, merely 5% of the respondents clearly stated “yes, to a high degree”; 29% replied “I don’t know” and 43% (24%) replied yes, to a mid (low) degree. This shows that the mapping and index development does seem to have a positive effect in awareness raising, but less so in triggering action or supporting decisions. Alternatively, the researchers are simply not informed to what extent their scientific results are used for decision support.
The inherent subjectivity and uncertainty of the index development methods, although known but not explicitly expressed by the index developers, could be the reason for limited uptake. Accordingly Tate underlines that the addition of uncertainty analysis to the index construction process is therefore an important step toward improving the quality of the next generation of social vulnerability indexes. Epistemic uncertainty is associated with all vulnerability models. The lack of its assessment and portrayal does not deny its existence [32]. Clearly a challenge for the vulnerability index development community, who want their science to be applied in policy making, is how to quantify uncertainties and effectively communicate these. This remains an area to be explored.
Along these lines Romero-Lankao [67] points to another weakness of vulnerabiltiy mapping science when she writes: “equally fundamental dimensions and determinants of vulnerability are ignored just because of lack of data and (index development) omits any attempt to gain ethnographic knowledge of behavioural norms, social networks and risk perceptions that are equally relevant to understanding urban vulnerability.” Klinenberg [82] has shown this in his “social autopsy” for Chicago as well. Social cohesion as a protective factor is something that appears even more difficult or impossible to “measure” as a determining component of vulnerability. New perspectives or approaches, such as applying qualitative methods that capture for example, measures of social cohesion, may improve the performance and acceptability of vulnerability indices. Social cohesion could even be of relevance when victims of heatwaves do not belong to the classic risk groups (single, frail elderly) as Duneier [83] showed for Chicago.
Hinkel [31] has confronted the scientific limitations of vulnerability indicators and the issues they profess to address. He concludes that vulnerability indicators (and indices) are only good for identifying vulnerable people, communities or regions. Other common expectations regarding indicators such as identifying mitigation targets (and adaptation actions), raising awareness, allocating adaptation funds, monitoring adaptation policy and conducting scientific research he suggested cannot be fulfilled. This means that the studies identified here seem to best serve purposes (raising awareness, conducting research, identifying adaptation action) that they were not originally intended to serve. Hinkel [31] points to the problems intrinsic to risk communication: accordingly vulnerability indicators (and indices) are not the right means to raise awareness of climate change.
5. Conclusions
Heat vulnerability index development and associated risk mapping has developed significantly during the past decade. This is a result of the recognition that levels of vulnerability to heat vary within the population and that certain combinations of a range of risk factors may conspire at the individual to community level to increase the level of vulnerability to heat during extreme temperature events. As for other natural hazards, the visual presentation of vulnerability using coloured maps is experienced and seen as an effective communication device to raise awareness and as a possible input into policy and decision making. The increasing availability of high resolution spatial data at the intra-urban scale and advances in GIS technology have created the possibility for the natural hazards and social determinants of risk communities to create information that will assist with protecting the health of the vulnerable. The hypothesis that information at higher spatial resolution is better absorbed for protective action warrants further testing. However this normative view, based around potentialities and aspirations must be tempered by a positivist view of the current situation. The analysis presented in this paper has attempted to do this.
Although a considerable effort has been invested in heat vulnerability mapping research, the analysis presented here, based on a review of available literature and a survey of vulnerability index mapping paper authors, demonstrates the persistence of an unambiguous gap between vulnerability mapping science and policy. At the heart of this issue is a lack of understanding of how to mainstream this type of science into decision making, notwithstanding of course the issues that something as complex as vulnerability can be captured in a single index and that methodological issues related to vulnerability index construction need to be resolved before proceeding to policy development. Other substantive issues highlighted by this analysis include how effective or accurate (in terms of predicting impacts or outcomes) does a vulnerability index need to be in order to be “reliable”? The answer to this question not only lies with improving the science of vulnerability index based predictions of health responses but rests with the ethics of what is a socially acceptable level of vulnerability assessment inaccuracy. Allied with this is the issue of uncertainty. In relation to this, our analysis of vulnerability mapping papers and author survey results reveal that not only is there an inherent uncertainty associated with the indices on which vulnerability mapping is based, but a critical analysis of how uncertainty may cascade through the decision making and policy development process is lacking in the heat vulnerability mapping literature. This may relate to the nature of interaction that the vulnerability index development community has with policy developers in local authorities, in that it is one-way in the direction of end users, as opposed to a truly reciprocal interaction, which may assist with improving the understanding and communication of uncertainty.
While the results of our analysis point to a number of commonalities within the vulnerability index and mapping literature that may militate against mainstreaming of research outcomes into policy development, we are hopeful that the gap between science and policy will lessen. This will be achieved by both science and policy makers working within a co-production of knowledge paradigm and developing a greater mutual understanding of the barriers, constraints and limitation faced by both communities in terms of what they are striving for, such as the achievement of social justice and the reduction of inequalities in the context of the societal impacts of extreme heat events. In addition to this paper, to gather researchers active in this field to develop common guidelines could be a way forward.
Lastly, it should be acknowledged that this being an emerging field of research with more studies appearing during finalization of the manuscript, this review might not have captured all the published literature on recent heat vulnerability mapping. Further, 39% of the contacted authors did not reply to the questionnaire. Accordingly the findings from the analysis presented here should be treated as only indicative of current heat vulnerability mapping activity, application and use of the research results. To what extent these findings for heat vulnerability mapping may be applicable, or not, to other hazards, is another interesting question to be explored.
Acknowledgments
We thank the participants to the survey and five anonymous reviewers for constructive comments.
Author Contributions
Tanja Wolf generated the idea for the paper and wrote the main parts of the text. She developed the survey in close collaboration with Wen-Ching Chuang. Wen-Ching Chuang performed the set up of the survey in e-Surv and provided the summary of the survey results. Wen-Ching Chuang identified some of the papers for the literature review in a separate paper and provided the full text of most papers as well as constructive comments that shaped the article. Glenn McGregor provided input on an earlier version of the paper and added substantive sections to the paper during the revision phase.
Conflicts of Interest
The authors declare no conflict of interest.
Appendix
A. Survey Questions
- For the vulnerability paper(s) you have published, did you perceive the local authorities to be supportive in making data available?
- ○
- Yes, local authorities provided some support after considerable following up on my part.
- ○
- Yes, local authorities were supportive and helped a lot to get necessary data.
- ○
- No. Most data was publicly available online, no support from local authorities was needed.
- ○
- No. I did not perceive the local authorities as supportive at all.
- ○
- I don’t know.
- Did you pay a fee for the data?
- ○
- No, data was freely available.
- ○
- Yes, I paid a very minor fee (less than USD $100 or equivalent).
- ○
- Yes, I was charged more than USD $100 or equivalent.
- ○
- I don’t know.
- Did you have a chance to discuss and develop your work and its results with representatives of local authorities?
- ○
- Yes, but not much interaction.
- ○
- Yes, with some interaction.
- ○
- Yes, with much interaction.
- ○
- No.
- ○
- I don’t know.
If you answer “Yes” above, in what form do you interact with local authorities? (ex. Oral presentation, report, etc.)
- 4.
- Did representatives/local officials comment on your vulnerability index?
- ○
- Yes, but not much.
- ○
- Yes, to some degree.
- ○
- No.
- ○
- I don’t know.
- 5.
- Do you think that the results of your work are or will be applied in the local context (ex. municipality)?
- ○
- Yes, but I think that the degree of application is very limited.
- ○
- Yes, I think results (will) have some local application.
- ○
- Yes, I think my research results have had significant influence in the local context.
- ○
- No, I think that the results are not being applied in the local context.
- ○
- I don’t know
Can you give examples or link to publications when your results have been applied, or explain what limitations are?
- 6.
- Do you think that your work has increased awareness among the authorities and/or in the public?
- ○
- Yes (low degree).
- ○
- Yes (mid degree).
- ○
- Yes (high degree)
- ○
- No.
- ○
- I don’t know
- 7.
- Was your work (on mapping vulnerability to heat) used to communicate risk (by any means of risk communication) to, or by local authorities and/or policy makers? (You can select multiple answers)
- ○
- Yes, I (or my colleagues) use the work to communicate risks to local agencies and/or experts.
- ○
- Yes, I (or my colleagues) use the work to communicate risks to general public.
- ○
- Yes, local authorities and/or policy makers used (cited) to communicate risk to the general public.
- ○
- No.
- ○
- I don’t know.
- 8.
- Do you think that your vulnerability index is used or will be used to support decisions on where to take action?
- ○
- Yes (low degree).
- ○
- Yes (mid degree).
- ○
- Yes (high degree).
- ○
- No.
- ○
- I don’t know.
- 9.
- Are you planning further work on the same topic (vulnerability to heat) in the same or another urban area?
- ○
- Yes.
- ○
- No.
- ○
- I don’t know.
- 10.
- Are you considering building a vulnerability index for other hazards? If yes, for what hazard and in what area?
B. Policy Recommendations
Table A1.
Policy recommendation from “a-priori”/inductive heat vulnerability mapping.
Table A2.
Policy recommendations “a-priori”/inductive heat vulnerability mapping using health data to test the index.
Table A3.
Policy recommendations on mapping health outcomes and exploring vulnerability factors.
References
- Costello, A.; Abbas, M.; Allen, A.; Ball, S.; Bell, S.; Bellamy, R.; Friel, S.; Groce, N.; Johnson, A.; Kett, M.; et al. Managing the health effects of climate change: Lancet and University College London Institute for Global Health Commission. Lancet 2009. [Google Scholar] [CrossRef]
- McMichael, T.; Montgomery, H.; Costello, A. Health risks, present and future, from global climate change. BMJ 2012. [Google Scholar] [CrossRef] [PubMed]
- United Nations World Urbanisation Prospects. Available online: http://esa.un.org/unpd/wup/Highlights/WUP2014-Highlights.pdf (accessed on 6 February 2015).
- Ebi, K.L.; Semenza, J.C. Community-based adaptation to the health impacts of climate change. Am. J. Prev. Med. 2008, 35, 501–507. [Google Scholar] [CrossRef] [PubMed]
- NRC (National Research Council). Successful Response Starts with a Map: Improving Geospatial Support for Disaster Management; The National Academies Press: Washington, DC, USA, 2007. [Google Scholar]
- Preston, B.L.; Yuen, E.J.; Westaway, R.M. Putting vulnerability to climate change on the map: A review of approaches, benefits, and risks. Sustain. Sci. 2011, 6, 177–202. [Google Scholar] [CrossRef]
- Anselin, L. From SpaceStat to CyberGIS twenty years of spatial data analysis software. Int. Reg. Sci. Rev. 2012, 35, 131–157. [Google Scholar] [CrossRef]
- Pelling, M. Global, national and sub-national assessment approaches. In Measuring Vulnerability to Natural Hazards; Birkmann, J., Ed.; United Nations University Press: Tokyo, Japan; New York, NY, USA; Paris, France, 2013; pp. 165–196. [Google Scholar]
- Birkmann, J.; Cardona, O.D.; Carreño, M.L.; Barbat, A.H.; Pelling, M.; Schneiderbauer, S.; Kienberger, S.; Keiler, M.; Alexander, D.E.; Zeil, P.; et al. Chapter 1—Theoretical and Conceptual Framework for the Assessment of Vulnerability to Natural Hazards and Climate Change in Europe: The MOVE Framework. In Assessment of Vulnerability to Natural Hazards; Alexander, J.B.K.E., Ed.; Elsevier: San Francisco, CA, USA, 2014; pp. 1–19. [Google Scholar]
- Fuchs, S.; Birkmann, J.; Glade, T. Vulnerability assessment in natural hazard and risk analysis: Current approaches and future challenges. Nat. Hazards 2012, 64, 1969–1975. [Google Scholar] [CrossRef]
- Hess, J.J.; McDowell, J.Z.; Luber, G. Integrating climate change adaptation into public health practice: Using adaptive management to increase adaptive capacity and build resilience. Environ. Health Perspect. 2012, 120, 171–179. [Google Scholar] [CrossRef] [PubMed]
- Welle, T.; Depietri, Y.; Angignard, M.; Birkmann, J.; Renaud, F.; Greiving, S. Chapter 5—Vulnerability Assessment to Heat Waves, Floods, and Earthquakes Using the MOVE Framework: Test Case Cologne, Germany. In Assessment of Vulnerability to Natural Hazards; Alexander, J.B.K.E., Ed.; Elsevier: San Francisco, CA, USA, 2014; pp. 91–124. [Google Scholar]
- Dickin, S.K.; Schuster-Wallace, C.J.; Elliott, S.J. Developing a vulnerability mapping methodology: applying the water-associated disease index to dengue in Malaysia. PLoS ONE 2013, 8. [Google Scholar] [CrossRef] [PubMed]
- English, P.B.; Sinclair, A.H.; Ross, Z.; Anderson, H.; Boothe, V.; Davis, C.; Ebi, K.; Kagey, B.; Malecki, K.; Shultz, R.; et al. Environmental health indicators of climate change for the United States: Findings from the state environmental health indicator collaborative. Environ. Health Perspect. 2009, 117, 1673–1681. [Google Scholar] [CrossRef] [PubMed]
- Robine, J.M.; Cheung, S.L.; le Roy, S.; van Oyen, H.; Griffith, C.; Michel, J.P.; Herrmann, F.R. Death toll exceede 70,000 in Europe during the summer of 2003. C. R. Biol. 2008, 331, 171–178. [Google Scholar] [CrossRef] [PubMed]
- Department of Health. January 2009 Heatwave in Victoria: An Assessment of Health Impacts. Available online: https://www2.health.vic.gov.au/getfile//?sc_itemid={78C32CE8-A619-47A6-8ED1-1C1D34566326} (accessed on 21 October 2015).
- Revich, B.A. Heat-wave, air quality and mortality in European Russia in summer 2010: Preliminary assessment. Yekologiya Cheloveka Hum. Ecol. 2011, 7, 3–9. [Google Scholar]
- Heat wave sweeps Japan; many areas log hottest day of summer. Jpn. Times Online. 2014. Available online: http://www.japantimes.co.jp/news/2014/07/23/national/heat-wave-sweeps-japan-many-areas-log-hottest-day-summer/#.VifT2aTrIgQ (accessed on 21 October 2015).
- Smoyer, K. Putting risk in its place: Methodological considerations for investigating extreme event health risk. Soc. Sci. Med. 1998, 47, 1809–1824. [Google Scholar] [CrossRef]
- Wilhelmi, O.V. Designing a geospatial information infrastructure for mitigation of heat wave hazards in urban areas. Nat. Hazard Rev. 2004, 5, 147–158. [Google Scholar] [CrossRef]
- Reid, C.E.; Mann, J.K.; Alfasso, R.; English, P.B.; King, G.C.; Lincoln, R.A.; Margolis, H.G.; Rubado, D.J.; Sabato, J.E.; West, N.L.; et al. Evaluation of a heat vulnerability index on abnormally hot days: An environmental public health tracking study. Environ. Health Perspect. 2012, 120, 715–720. [Google Scholar] [CrossRef] [PubMed]
- Maier, G.; Grundstein, A.; Jang, W.; Li, C.; Naeher, L.P.; Shepherd, M. Assessing the performance of a vulnerability index during oppressive heat across Georgia, United States. Weather Clim. Soc. 2013, 6, 253–263. [Google Scholar] [CrossRef]
- Harlan, S.L.; Declet-Barreto, J.H.; Stefanov, W.L.; Petitti, D.B. Neighborhood effects on heat deaths: Social and environmental predictors of vulnerability in Maricopa County, Arizona. Environ. Health Perspect. 2013, 121, 197–204. [Google Scholar] [PubMed]
- Wolf, T.; McGregor, G.; Analitis, A. Performance assessment of a heat wave vulnerability index for greater London, United Kingdom. Weather Clim. Soc. 2013, 6, 32–46. [Google Scholar] [CrossRef]
- Morabito, M.; Crisci, A.; Gioli, B.; Gualtieri, G.; Toscano, P.; di Stefano, V.; Orlandini, S.; Gensini, G.F. Urban-hazard risk analysis: Mapping of heat-related risks in the elderly in major Italian cities. PLoS ONE 2015, 10. [Google Scholar] [CrossRef] [PubMed]
- Bao, J.; Li, X.; Yu, C. The construction and validation of the heat vulnerability index, a review. Int. J. Environ. Res. Public Health 2015, 12, 7220–7234. [Google Scholar] [CrossRef] [PubMed]
- Chuang, W.C.; Gober, P. Predicting hospitalization for heat-related illness at the census tract level: Accuracy of a generic heat vulnerability index in Phoenix, Arizona (USA). Environ. Health Perspect. 2015, 123, 606–612. [Google Scholar] [CrossRef] [PubMed]
- Wolf, T.; McGregor, G. The development of a heat wave vulnerability index for London, United Kingdom. Weather Clim. Extrem. 2013, 1, 59–68. [Google Scholar] [CrossRef]
- Buscail, C.; Upegui, E.; Viel, J.F. Mapping heatwave health risk at the community level for public health action. Int. J. Health Geogr. 2012, 11. [Google Scholar] [CrossRef] [PubMed]
- Tomlinson, C.; Chapman, L.; Thornes, J.; Baker, C. Including the urban heat island in spatial heat health risk assessment strategies: A case study for Birmingham, UK. Int. J. Health Geogr. 2011, 10. [Google Scholar] [CrossRef] [PubMed]
- Hinkel, J. “Indicators of vulnerability and adaptive capacity”: Towards a clarification of the science—Policy interface. Glob. Environ. Chang. 2011, 21, 198–208. [Google Scholar] [CrossRef]
- Tate, E. Social vulnerability indices: A comparative assessment using uncertainty and sensitivity analysis. Nat. Hazards 2012, 63, 325–347. [Google Scholar] [CrossRef]
- Reid, C.E.; O’Neill, M.S.; Gronlund, C.J.; Brines, S.J.; Brown, D.G.; Diez-Roux, A.V.; Schwartz, J. Mapping community determinants of heat vulnerability. Environ. Health Perspect. 2009, 117, 1730–1736. [Google Scholar] [CrossRef] [PubMed]
- Vescovi, L.; Rebetez, M.; Rong, F. Assessing public health risk due to extremely high temperature events: Climate and social parameters. Clim. Res. 2005, 30, 71–78. [Google Scholar] [CrossRef]
- Lindley, S.J.; Handley, J.; McEvoy, D.; Peet, E.; Theuray, N. The role of spatial risk assessment in the context of planning for adaptation in UK urban areas. Built Environ. 2007, 33, 46–69. [Google Scholar] [CrossRef]
- Depietri, Y.; Welle, T.; Renaud, F.G. Social vulnerability assessment of the Cologne urban area (Germany) to heat waves: Links to ecosystem services. Int. J. Disaster Risk Reduct. 2013, 6, 98–117. [Google Scholar] [CrossRef]
- Crider, K.G.; Maples, E.H.; Gohlke, J.M. Incorporating occupational risk in heat stress vulnerability mapping. J. Environ. Health 2014, 77, 16–22. [Google Scholar] [PubMed]
- Uejio, C.K.; Wilhelmi, O.V.; Golden, J.S.; Mills, D.M.; Gulino, S.P.; Samenow, J.P. Intra-urban societal vulnerability to extreme heat: The role of heat exposure and the built environment, socioeconomics, and neighborhood stability. Health Place 2011, 17, 498–507. [Google Scholar] [CrossRef] [PubMed]
- Johnson, D.P.; Stanforth, A.; Lulla, V.; Luber, G. Developing an applied extreme heat vulnerability index utilizing socioeconomic and environmental data. Appl. Geogr. 2012, 35, 23–31. [Google Scholar] [CrossRef]
- Loughnan, M.; Nicholls, N.; Tapper, N.J. Mapping heat health risks in urban areas. Int. J. Popul. Res. 2012, 2012, 1–12. [Google Scholar] [CrossRef]
- Hondula, D.M.; Davis, R.E.; Leisten, M.J.; Saha, M.V.; Veazey, L.M.; Wegner, C.R. Fine-scale spatial variability of heat-related mortality in Philadelphia County, USA, from 1983 to 2008: A case-series analysis. Environ. Health Glob. Access. Sci. Source 2012, 11, 16. [Google Scholar] [CrossRef] [PubMed]
- Klein Rosenthal, J.; Kinney, P.L.; Metzger, K.B. Intra-urban vulnerability to heat-related mortality in New York City, 1997–2006. Health Place 2014, 30, 45–60. [Google Scholar] [CrossRef] [PubMed]
- Boumans, R.J. M.; Phillips, D.L.; Victery, W.; Fontaine, T.D. Developing a model for effects of climate change on human health and health-environment interactions: Heat stress in Austin, Texas. Urban Clim. 2014, 8, 78–99. [Google Scholar] [CrossRef]
- Heaton, M.J.; Sain, S.R.; Greasby, T.A.; Uejio, C.K.; Hayden, M.H.; Monaghan, A.J.; Boehnert, J.; Sampson, K.; Banerjee, D.; Nepal, V.; et al. Characterizing urban vulnerability to heat stress using a spatially varying coefficient model. Spat. Spatio-Tempor. Epidemiol. 2014, 8, 23–33. [Google Scholar] [CrossRef] [PubMed]
- Hondula, D.M.; Barnett, A.G. Heat-related morbidity in brisbane, australia: Spatial variation and area-level predictors. Environ. Health Perspect. 2014, 122, 831–836. [Google Scholar] [CrossRef] [PubMed]
- Lindley, S.J.; Handley, J.F.; Theuray, N.; Peet, E.; Mcevoy, D. Adaptation strategies for climate change in the urban environment: assessing climate change related risk in UK urban areas. J. Risk Res. 2006, 9, 543–568. [Google Scholar] [CrossRef]
- Rinner, C.; Patychuk, D.; Bassil, K.; Nasr, S.; Gower, S.; Campbell, M. The role of maps in neighborhood-level heat vulnerability assessment for the City of Toronto. Cartogr. Geogr. Inf. Sci. 2010, 37, 31–44. [Google Scholar] [CrossRef]
- Bassil, K.; Claus, R.; Dianne, P. Validating the Toronto Spatial Heat Vulnerability Assessment: Research Findings & Proposed Methods. Final Report December 2010; Toronto Public Health: Toronto, ON, Canada, 2010. [Google Scholar]
- Kershaw, S.E.; Millward, A.A. A spatio-temporal index for heat vulnerability assessment. Environ. Monit. Assess. 2012, 184, 7329–7342. [Google Scholar] [CrossRef] [PubMed]
- Chow, W.T.L.; Chuang, W.C.; Gober, P. Vulnerability to extreme heat in metropolitan phoenix: Spatial, temporal, and demographic dimensions. Prof. Geogr. 2012, 64, 286–302. [Google Scholar] [CrossRef]
- El-Zein, A.; Tonmoy, F.N. Assessment of vulnerability to climate change using a multi-criteria outranking approach with application to heat stress in Sydney. Ecol. Indic. 2015, 48, 207–217. [Google Scholar] [CrossRef]
- Aubrecht, C.; Özceylan, D. Identification of heat risk patterns in the U.S. National Capital Region by integrating heat stress and related vulnerability. Environ. Int. 2013, 56, 65–77. [Google Scholar] [CrossRef] [PubMed]
- Van der Hoeven, F.; Wandl, A. Amsterwarm: Mapping the landuse, health and energy-efficiency implications of the Amsterdam urban heat island. Build. Serv. Eng. Res. Technol. 2015, 36, 67–88. [Google Scholar] [CrossRef]
- Dugord, P.A.; Lauf, S.; Schuster, C.; Kleinschmit, B. Land use patterns, temperature distribution, and potential heat stress risk—The case study Berlin, Germany. Comput. Environ. Urban Syst. 2014, 48, 86–98. [Google Scholar] [CrossRef]
- Merbitz, H.; Buttstädt, M.; Michael, S.; Dott, W.; Schneider, C. GIS-based identification of spatial variables enhancing heat and poor air quality in urban areas. Appl. Geogr. 2012, 33, 94–106. [Google Scholar] [CrossRef]
- Oven, K.J.; Curtis, S.E.; Reaney, S.; Riva, M.; Stewart, M.G.; Ohlemüller, R.; Dunn, C.E.; Nodwell, S.; Dominelli, L.; Holden, R. Climate change and health and social care: Defining future hazard, vulnerability and risk for infrastructure systems supporting older people’s health care in England. Appl. Geogr. 2012, 33, 16–24. [Google Scholar] [CrossRef]
- Keramitsoglou, I.; Kiranoudis, C.T.; Maiheu, B.; Ridder, K.D.; Daglis, I.A.; Manunta, P.; Paganini, M. Heat wave hazard classification and risk assessment using artificial intelligence fuzzy logic. Environ. Monit. Assess. 2013, 185, 8239–8258. [Google Scholar] [CrossRef] [PubMed]
- Norton, B.A.; Coutts, A.M.; Livesley, S.J.; Harris, R.J.; Hunter, A.M.; Williams, N.S.G. Planning for cooler cities: A framework to prioritise green infrastructure to mitigate high temperatures in urban landscapes. Landsc. Urban Plan. 2015, 134, 127–138. [Google Scholar] [CrossRef]
- Houghton, A.; Prudent, N.; Scott, J.E., III; Wade, R.; Luber, G. Climate change-related vulnerabilities and local environmental public health tracking through GEMSS: A web-based visualization tool. Appl. Geogr. 2012, 33, 36–44. [Google Scholar] [CrossRef]
- Hondula, D.M.; Davis, R.E.; Saha, M.V.; Wegner, C.R.; Veazey, L.M. Geographic dimensions of heat-related mortality in seven U.S. cities. Environ. Res. 2015, 138, 439–452. [Google Scholar] [CrossRef] [PubMed]
- Loughnan, M.; Trapper, N.; Thu, P.; Kellie, L.; Judith, M. A Spatial Vulnerability Analyis of Urban Populations during Extreme Heat Events in Australian Capital Cities Final Report; National Climate Change Adaptation Research Facility: Gold Cost, Australia, 2013. [Google Scholar]
- Johnson, D.P.; Wilson, J.S. The socio-spatial dynamics of extreme urban heat events: The case of heat-related deaths in Philadelphia. Appl. Geogr. 2009, 29. [Google Scholar] [CrossRef]
- Schuster, C.; Burkart, K.; Lakes, T. Heat mortality in Berlin—Spatial variability at the neighborhood scale. Urban Clim. 2014, 10, 134–147. [Google Scholar] [CrossRef]
- Kovach, M.M.; Konrad II, C.E.; Fuhrmann, C.M. Area-level risk factors for heat-related illness in rural and urban locations across North Carolina, USA. Appl. Geogr. 2015, 60, 175–183. [Google Scholar] [CrossRef]
- Hattis, D.; Ogneva-Himmelberger, Y.; Ratick, S. The spatial variability of heat-related mortality in Massachusetts. Appl. Geogr. 2012, 33, 45–52. [Google Scholar] [CrossRef]
- Cutter, S.L.; Boruff, B.J.; Shirley, W.L. Social vulnerability to environmental hazards. Soc. Sci. Q. 2003, 84, 242–261. [Google Scholar] [CrossRef]
- Romero-Lankao, P.; Qin, H.; Dickinson, K. Urban vulnerability to temperature-related hazards: A meta-analysis and meta-knowledge approach. Glob. Environ. Chang. 2012, 22, 670–683. [Google Scholar] [CrossRef]
- Hondula, D.; Davis, R. The predictability of high-risk zones for heat-related mortality in seven US cities. Nat. Hazards 2014, 74, 771–788. [Google Scholar] [CrossRef]
- Johnson, D.P.; Webber, J.J.; Urs Beerval Ravichandra, K.; Lulla, V.; Stanforth, A.C. Spatiotemporal variations in heat-related health risk in three Midwestern US cities between 1990 and 2010. Geocarto Int. 2014, 29, 65–84. [Google Scholar] [CrossRef]
- Hoppe, R. Policy analysis, science, and politics: From speaking truth to power “to” making sense together. Sci. Public Policy 1999, 26, 201–210. [Google Scholar] [CrossRef]
- Cash, D.W.; Borck, J.C.; Patt, A.G. Countering the loading-dock approach to linking science and decision making comparative analysis of El Niño/Southern Oscillation (ENSO) Forecasting Systems. Sci. Technol. Hum. Values 2006, 31, 465–494. [Google Scholar] [CrossRef]
- Van Pelt, S.C.; Haasnoot, M.; Arts, B.; Ludwig, F.; Swart, R.; Biesbroek, R. Communicating climate (change) uncertainties: Simulation games as boundary objects. Environ. Sci. Policy 2015, 45, 41–52. [Google Scholar] [CrossRef]
- Knaggård, Å. What do policy-makers do with scientific uncertainty? The incremental character of Swedish climate change policy-making. Policy Stud. 2014, 35, 22–39. [Google Scholar] [CrossRef]
- Asrar, G.R.; Ryabinin, V.; Detemmerman, V. Climate science and services: Providing climate information for adaptation, sustainable development and risk management. Curr. Opin. Environ. Sustain. 2012, 4, 88–100. [Google Scholar] [CrossRef]
- Kirchhoff, C.J.; Carmen Lemos, M.; Dessai, S. Actionable knowledge for environmental decision making: Broadening the usability of climate science. Ann. Rev. Environ. Resour. 2013, 38, 393–414. [Google Scholar] [CrossRef]
- Head, B.W. Evidence, uncertainty, and wicked problems in climate change decision making in Australia. Environ. Plan. C Gov. Policy 2014, 32, 663–679. [Google Scholar] [CrossRef]
- Dany, V.; Bajracharya, B.; Lebel, L.; Regan, M.; Taplin, R. Narrowing gaps between research and policy development in climate change adaptation work in the water resources and agriculture sectors of Cambodia. Clim. Policy 2015. [Google Scholar] [CrossRef]
- Berkhout, F.; Hurk, B.; van den Bessembinder, J.; de Boer, J.; Bregman, B.; van Drunen, M. Framing climate uncertainty: Socio-economic and climate scenarios in vulnerability and adaptation assessments. Reg. Environ. Chang. 2013, 14, 879–893. [Google Scholar] [CrossRef]
- Reed, M.S.; Stringer, L.C.; Fazey, I.; Evely, A.C.; Kruijsen, J.H. J. Five principles for the practice of knowledge exchange in environmental management. J. Environ. Manag. 2014, 146, 337–345. [Google Scholar] [CrossRef] [PubMed]
- Kniveton, D.; Visman, E.; Tall, A.; Diop, M.; Ewbank, R.; Njoroge, E.; Pearson, L. Dealing with uncertainty: Integrating local and scientific knowledge of the climate and weather. Disasters 2015, 39, S35–S53. [Google Scholar] [CrossRef] [PubMed]
- Millner, A.; Calel, R.; Stainforth, D.A.; MacKerron, G. Do probabilistic expert elicitations capture scientists’ uncertainty about climate change? Clim. Chang. 2012, 116, 427–436. [Google Scholar] [CrossRef]
- Klinenberg, E. Denaturalizing disaster: A social Autopsy of the 1995 Chicago heat wave. Theory Soc. 1999, 28, 239–295. [Google Scholar] [CrossRef]
- Duneier, M. Ethnography, the ecological fallacy, and the 1995 Chicago heat wave. Am. Soc. Rev. 2006, 71, 679–688. [Google Scholar] [CrossRef]
© 2015 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/4.0/).