Following a Step by Step Development of a Resilience Action Plan

: According to the United Nations, by 2030, 60% of the world’s population will live in cities, and 70% by 2050. Both consolidated and fast urbanizing areas face diverse acute shocks from natural disasters and long-term stresses, such as the e ﬀ ects of climate change. Therefore, there is a need for cities to implement plans for increasing resilience and improving preparedness to cope with both acute shocks and long-term stresses. Development of resilience action plans (RAP) constitutes an important process for the cities to plan their resilience enhancement in the long, medium, and short terms. These are key tools for the city, considering the associated complexity, uncertainties, data scarcity, interdependencies among urban services provided in the city, as well as involved stakeholders. Herein, a framework is presented to support city resilience action planning related to climate change through a multisector approach. The framework was applied step by step to three cities—Barcelona, Bristol, and Lisbon—and their RAPs to climate change provide roadmaps for resilience, having the urban water cycle as the core. In these plans, urban services are included, given their interactions and contributions to city’s resilience. Addressed services are water supply, wastewater, storm water, electric


Introduction
Integrated urban planning and development processes, involving representatives of core areas, of government (local, regional, national) and of interested parties (businesses, civil society organizations, academia, among others) is understood as essential to support progress towards more sustainable and resilient cities [1]. According to the United Nations, by 2030, 60% of the world's population will live in cities, with estimations of 70% by 2050 [2]. Both consolidated and fast urbanizing areas are facing a variety of acute shocks derived from natural disasters and long-term stresses, such as the effects of climate change (CC) [3]. Projections show that one billion urban residents will be living in low-elevation coastal zones and, consequently at risk of flooding and natural hazards related to climate change [2]. Therefore, there is a need for cities to implement plans for increasing resilience and improving preparedness to cope with both acute shocks and long-term stresses [3].
Planning for resilience in urban areas is an enormous endeavor. Complexity, uncertainties, timescales, spatial scales, and data scarcity are just a few words associated with this subject area.
Having an action plan put it in place and following a process with steps to improve resilience before a hazardous event strikes increases the ability of a city to face and overcome extreme events, future disasters, to recover quickly, and to potentially reduce the impacts in a way that better prepares for future events, bringing stakeholders together and incorporating resilience into their short-and long-term planning [16]. As most of the cities face financial restrictions, implementation of selected resilience strategies or measures must be prioritized. This process will enable cities to improve their resilience over time in a cost effective way, consistent with their development goals, thus strengthening resilience and improving a city's ability to continue or timely restore vital services, building back better after damaging events [16].
The aim of this paper is to approach city resilience with focus on water providing a framework to support city resilience assessment, planning, and management related to climate change through a multisector approach. Resilience with focus on water gains from adopting the scope of management of urban water systems and, in parallel, consider interdependencies with other city functions or sectors. The result of the application of the framework is a resilience action plan (RAP) for the city considering the involvement of the relevant stakeholders.

Planning Process
The planning process, presented in the Figure 1, was defined in this research to provide a roadmap for the development of a city resilience action plan [17]. The most relevant steps are indicated and the methods and tools used need to be clearly identified. The process allows accounting for the work and background already existing in many cities. It is based on the establishment planning scenarios considering climate change, characterization of the city context and hazards, risk and resilience assessments, as well as on the development of strategies that need to be implemented to enhance the resilience of the city to climate change with focus on water.
In Step 0, the RAP needs to recall the work already in place and ongoing in the city and keep the possible alignment, regarding existing background on information and knowledge, strategies, measures or other related plans already implemented, such as City Master Plan or Emergency and Contingency city plans.
It is fundamental to understand each city context, the involved stakeholders, interdependencies between the urban services, and to identify the hazards that threaten the city, focusing on the plan scope, focus, and time horizon. Therefore, Step 1 provides a profile of the city and urban services characterization, including geographical characterization, climate, built and natural environment and infrastructure, existing climate-related hazards in the city, historical relevant events, and the players and stakeholders involved. The characterization of urban services is also detailed.
In Step 2, the hazards to plan for are defined and a characterization of the related climate change scenarios (e.g., RCP4.5, RCP8.5, two Representative Concentration Pathways) for the city is carried out [18][19][20]. Based on this, planning scenarios are established for the hazard variables at the urban spatial and temporal scale, for the city and for the services. A planning scenario corresponds to a hazard condition, described by the characterization of its trigger variables by experts, for comprehensive assessment of the severity, probability of occurrence, and its total impact. As a minimum, cities would ideally define two planning scenarios. The Most Probable relates to a hazardous event that causes disruption, assessed by experts to be the most likely to occur. The Most Severe relates to a hazardous event that causes greater disruption, assessed by experts to be the worst case to plan for (based on [21]).
In Step 3, the risk assessment for the city is addressed, identifying the approach and sectorial models used in the city (2.2). Exposure, vulnerability, and impacts of each urban service are characterized, as are the cascading impacts between different urban services and the effects of multiple hazards in the city, with production of the respective hazard maps. In Step 3, the risk assessment for the city is addressed, identifying the approach and sectorial models used in the city (2.2). Exposure, vulnerability, and impacts of each urban service are characterized, as are the cascading impacts between different urban services and the effects of multiple hazards in the city, with production of the respective hazard maps.
In Step 4, the resilience assessment of the city is carried out through a structured and objectivedriven assessment framework (2.3), both for the current situation and regarding the defined planning scenarios. It is based on the work already existing in the cities and on the previous risk assessment results for the identified hazards and hazardous events, considering the cascading effects. In Step 5, the diagnosis is undertaken including the integration of the resilience assessment results provided by all sources of analysis (2.4). A SWOT analysis (Strengths, Weakness, Opportunities, and Threats) summarizes this information by identifying the city's and the service's internal strengths and weaknesses, as well as the external opportunities and main threats [22].
In Step 6, the identification of strategies (2.5) that reduce the identified city's threats, overcome weaknesses, and exploit strengths and opportunities was supported by a TOWS analysis [10] (TOWS In Step 4, the resilience assessment of the city is carried out through a structured and objective-driven assessment framework (2.3), both for the current situation and regarding the defined planning scenarios. It is based on the work already existing in the cities and on the previous risk assessment results for the identified hazards and hazardous events, considering the cascading effects. In Step 5, the diagnosis is undertaken including the integration of the resilience assessment results provided by all sources of analysis (2.4). A SWOT analysis (Strengths, Weakness, Opportunities, and Threats) summarizes this information by identifying the city's and the service's internal strengths and weaknesses, as well as the external opportunities and main threats [22].
In Step 6, the identification of strategies (2.5) that reduce the identified city's threats, overcome weaknesses, and exploit strengths and opportunities was supported by a TOWS analysis [10] (TOWS identifies the strategies that reduce Threats take advantage of the Opportunities, overcome Weaknesses and exploit Strengths), based on information from Step 5. A decision method is then used to support decisions on the measures to consider in the plan. It is fundamental to describe the strategies including their type (e.g., protective infrastructures, citizens and stakeholders, modelling studies, etc.), hazards and climate variables addressed, responsibilities, players, and services involved, costs, resilience measures included, economic, social and environmental co-benefits, implementation time-line, and other relevant information.
A risk assessment is carried out to evaluate the effect of the strategy's implementation, for the current situation and for planning scenarios, and an identification of the main impacts on the resilience objectives assessed is undertaken. Prioritization of strategies is then established following the prioritization method adopted by the city that needs to be identified in the plan.
Step 7 defines the implementation process resulting from the prioritization of strategies, considering also the available time for their implementation (2.5).
To continuously ensure the city resilience considering the city's dynamics, the RAP monitoring and review is a crucial step. In order to trace the resilience progress from the implementation of resilience strategies and to identify the gaps and early deviations that may require corrective action, the resilience plan of each city will be monitored and reviewed with a given periodicity. In Step 8, the stages for the RAP monitoring and review are acknowledged and scheduled, identifying the periodicity, responsibility, and activities needed (2.5). It is fundamental to be aware that this planning process is to be a continuous process.

Risk Assessment
In the risk assessment step, the exposure and vulnerability of the city to the identified hazards is presented. These may be determined based on historical data, modelling, and on spatial analysis. A thorough characterization of the urban services and of their relations with climate related hazards is required, both for current and future scenarios. Risk-related maps for each urban service (hazard, exposure, vulnerability, and risk maps) may be obtained by detailed GIS (Geographic Information System) analysis and modelling of systems behavior (using a wide range of models and tools e.g., SWMM, EPANET, BASEMENT, SUMO). The effects of multiple hazards and of cascading effects between services are very relevant and should also be studied. The application of sectorial models enables the identification with detail of the areas (of the city or the infrastructure in each service) with major challenges due to climate change.
The knowledge of the behavior of the urban systems during extreme climate events in a detailed scale represents a key step of the whole process of the planning process and of the city resilience assessment. In this context, the use of detailed models and tools is essential to analyze the behavior and the response of critical services and infrastructures with respect to specific pressures and drivers related to climate change. They provide temporal and spatial information. Moreover, the outputs of these sectorial models can be used to assess hazard, vulnerability, and risk levels for current and future scenarios [23]. This process requires information, data, technical background, and learned lessons from past experiences, shared among technicians, utility, and city managers in order to focus and improve the analysis. Additionally, a detailed knowledge of each urban service, interdependencies between them, and cascade effects due to failures or extreme climate events is considered in this assessment stage.

Resilience Assessment
The resilience assessment allows knowing where the city and the urban services stand today, giving support decision on the strategy making, actions, and measures. This will support planning in the long, medium, and short terms, regarding resilience to climate change, and to identify the most critical aspects to be improved, taking into account both the reference situation and the expected impacts of planning scenarios.
It is important to look at the city as a whole and analyze the relations, interdependencies, and cascading effects among critical infrastructures, services, and players during crisis events, with a special focus on the recovery of the normal functioning of the city, services, and infrastructures. For an overall and detailed assessment of the city resilience, the RESCCUE (Resilience to Cope with Climate Change in Urban Areas) resilience assessment framework (RAF) [24,25] is used to provide an objective driven diagnosis of the organizational, spatial, functional, and physical resilience of the city and services.
The objectives considered to assess resilience to climate change in the three cities, including the urban services and their infrastructures are to achieve [24]: city collective engagement and awareness of citizens and communities (O.1), leadership and management (O.2), preparedness for basic conditions, climate change, disaster response and recovery and build back (O.3), for the organizational dimension of the city; spatial risk management (S.1) and provision of protective infrastructure and ecosystems (S.2), for the spatial dimension of the city; services planning and risk management (F.1), autonomy (F.2) and preparedness for climate change, disaster response, and recovery and build back (F.3), for the functional dimension of the city; and safe (P.1), autonomous and flexible (P.2) as well as prepared infrastructures (P.3), for the physical dimension of the city.
The objectives are assessed using metrics. For each RAF metric, the classification is made by associating each answer to a resilience development level classified as incipient (for results that are still non-existent or are at an early stage of development), progressing (for situations where significant steps have already been taken and the city or the service are still developing the specific aspect addressed by the metric), or advanced (for already consolidated results) [24]. The structure used in the RAF allows getting information on the development level for a given objective or, more aggregately, for a given service, resilience dimension, or city.

SWOT Analysis
The SWOT analysis is a widely used technique for strategic evaluation of the internal and external contexts of an organization [22]. This is a tool for diagnosis allowing integrating all the main issues coming from the different assessments and from the analysis of the context.
The clear identification of the Strengths, Weaknesses, Opportunities, and Threats (SWOT) complements the diagnosis provided by the resilience assessment. It also allows to consider aspects that need improvement, additional to those detected in data collection, models development, cascading and interdependencies analysis that may have not be highlighted in the assessment.
The strengths and weaknesses are the internal aspects of the organization/service/city, which have to manage, change, or improve them.
The opportunities and threats are features external to the organization, which has to handle them, adapt to them, take advantage of them, but they cannot be changed by the organization.
It is fundamental that the SWOT analysis effectively identifies the most relevant problems, preventing the accomplishment of the resilience objectives, and the major opportunities. The identification of this aspects will support the identification of the strategies that will then contribute to improve the resilience objectives developed for the city assessment.
The integration of the resilience assessment results provided by all sources of analysis allows the development of a SWOT analysis, supporting the identification of resilience measures and strategies, to be implemented in the city and services [17].

Identification of Strategies
There are several approaches and tools to identify strategies coming from the assessment. Since the SWOT analysis was undertaken to integrate the resilience assessment, it facilitates the use of a TOWS analysis [10]. TOWS analysis supports the identification of ways forward. TOWS matches internal factors to external factors, and identifies the strategies that take advantage of the opportunities, reduce threats, overcome weaknesses, and exploit strengths. It allows to concentrate attention in the areas where action is required, providing some indication of the nature of that action, thus supporting identification, generation, comparison, and selection of strategies.
The actions can be grouped regarding the addressed hazards (e.g., flooding, cold waves), the typology of strategies (e.g., data and information, infrastructure construction) or the addressed resilience objectives (e.g., leadership, flexible water service), among other solutions.
Considering all aspects and actions needed identified, a decision method is then used to support the decision on the measures to adopt in order to define the strategies to develop in the plan. The decision can be supported by resources constraints or by the impact of strategies in city resilience being minor than other strategies. Therefore, it is essential to assess the impact of the identified strategies.
Each strategy needs to be briefly described in order to facilitate communication and involvement, particularly regarding the following aspects [17,26,27]: -Typology: considering groups of strategies of the same type, such as "Citizens and stakeholders or infrastructural construction and rehabilitation"; -TOWS perspective: the combination addressed in the SWOT that supported the strategy definition, e.g., WT strategy, combines identified Weaknesses and Threats; -Implementation: describing whether the strategy is in progress or is still planned for the future; -Timeline: the horizon or period for implementation; -Hazards and climate variables: variables that are addressed in the strategy; -Institution, players and services: all stakeholders involved in the implementation; -Cost: the financial effort needed or cost range for the strategy; -Measures: the set of resilience measures needed to implement the strategy; -Co-benefits: benefits of the strategy that are not directly obtained, regarding diverse aspects within economic, social, and environmental categories. They may have a relevant or slight contribution to these aspects and can be immediate or require additional time for them to be evident. Economic co-benefits include aspects such cost savings, job creation, and property values; social co-benefits include, among others, reduced mortality or health impacts and reduced mortality from diseases; and environmental co-benefits include improved air or water quality, reduced aquifer depletion and water pollution or land contamination; Other resources and relevant information must be included.

Implementation, Monitoring, and Review Processes
The implementation of each strategy involves several types of resources and leads to different benefits. Whenever resources are limited or when different strategies compete for the same resource, they need to be prioritized. Therefore, the city must establish a prioritization procedure and to present the benefits of its implementation. Prioritization may be done for the strategies or for the measures within the strategies.
The prioritization method may include a Cost-Effectiveness Analysis and a Cost-Benefit Analysis. A Multi-Criteria Analysis can be used to rank the social oriented strategies, emphasizing the judgement of the decision-making team, with the ability to prioritize without the provision of monetary values [28].
Planning the chronological order to implement the strategies outlines the pace of the work, to identify overlapping activities and to highlight when resilience improvement is expected. In addition, noting any given milestones and stating dependencies amongst the activities also contributes to a better understanding of the path to follow. The city schedules the strategies to implement and if it decides for a more detailed planning, the schedule can also include the measures.
Monitoring and review of the plan ensure the application of the continuous improvement principle to the resilience process in the city and services. It also provides a periodic reflection on the city and services vision on resilience and the context, as well as progress tracking, and constituting an opportunity to realign the path towards resilience to climate change. It is fundamental to define this process, including responsibilities allocation.
Monitoring is intended to trace the progress both of the resilience strategies implementation and of the resilience changes due to it. Additionally, monitoring allows identifying early deviations to the plan (e.g., occurrences not anticipated in the plan, with impact on its implementation) and that may require corrective action. It is fundamental to define the monitoring periodicity and assign the responsibility to do it.
As the benefit of some strategies may only have effects in a city's resilience after being completed, it is important that monitoring also includes the assessment of the degree of implementation of each strategy. Considering the implementation plan, the city should periodically check whether it is being carried out as scheduled, or if it is delayed or anticipated.
The plan revision consists of analyzing the monitoring results in order to identify unexpected gaps, their causes, and the improvement actions to bridge those gaps. In addition, the strategies identified in previous versions of the plan that had to be postponed, e.g., due to resources constraints, have to be reconsidered. Since cities are dynamic, the external and internal context also needs to be revisited leading to a revised SWOT analysis and respective links with TOWS. Due to its uncertainty, special attention needs to be paid to updated knowledge on climate dynamics, to decide about the need for a revision of climate change scenarios [17].

Background
The RAPs of Barcelona, Bristol, and Lisbon were developed by the respective cities and associated partners. They followed the planning process previously presented (2). Table 1 summarizes the cities' main characteristics, major vulnerabilities, existing background, vision, geographical scope, and planning horizon [17,24,29], corresponding to steps 0 and 1 of the planning process. The following strategic urban services, its interactions, and contributions to city's resilience are considered in the three plans: wastewater drainage and treatment, stormwater drainage, waste collection and treatment, electric energy supply and mobility. Barcelona and Bristol RAPs also included the water supply service.

Climate Change and Planning Scenarios
In step 2, the climate change scenarios are selected and the planning scenarios are defined for the relevant planning hazards [17,18,29].
Several hazards may affect the cities, its services, and infrastructures. In this section, the considered climate change scenarios are presented, with projections developed with high confidence levels, using at least RCP4.5 and RCP8.5 scenarios. From the projections, the planning scenarios (2.1) are identified and characterized, so what it is being addressed in the assessment is clearly identified, i.e., which are the relevant variables (e.g., rainfall, temperature) and magnitudes that trigger the hazards (e.g., flooding, drought, or combined sewer overflows).
In Barcelona, the most critical climate-related hazards are coastal and pluvial flooding, drought, heat waves, storm winds, and combined sewer overflows. Therefore, future climate scenarios were studied for sea level rise, cumulative and extreme precipitation, and extreme temperature. The most critical climate-related hazard for Bristol is flooding, where future climate scenarios were studied for sea level rise, heightened river flows, and extreme precipitation for pluvial, fluvial, and tidal river flooding. In Lisbon, the most critical climate-related hazard is flooding induced by both extreme precipitation and sea level rise.
Planning scenarios for the flooding hazard, common to the three cities, are presented in Table 2. Step 4 (2.1), although a common risk assessment roadmap has been defined (2.2), this process is strongly dependent on the available and provided data and information, as well as its level of detail. For this reason, the three research sites have defined specific risk assessment methodologies based on the available data and models. This step was carried out for the three cities [34][35][36][37][38][39][40][41].
Investigation on detailed cascading effects and quantification of impacts from climate driven hazards may be reported, namely regarding infrastructure or service constraints and failure. In a city where such models are not available, detailed GIS analysis of hazard maps provides valuable information [36,37].

Lisbon Hazard Assessment
In Lisbon, the sectorial models used were based on historical climate data and on projections of future climate scenarios, a thorough characterization of the urban services and of their relations with climate variables, detailed analysis of interdependencies, and production of hazard maps.
The overall methodology proposed to undertake the spatial characterization of the flood related hazards has the following main steps: (i) identification of flood related hazards, risk factors and risks using the selected affected sectors as case studies, namely, electricity supply, urban mobility, and wastes collection; (ii) selection of metrics for hazards characterization and mapping; (iii) selection of representative scenarios to characterize current and future situations; (iv) mapping of hazards and calculation of metrics to support further work on resilience assessment using GIS tools [36].
In terms of urban drainage tools, two types of hydraulic mathematical models were used at different scales: (i) the citywide 1D GIS model, which covers the city as a whole but adopts a simplified hydraulic model and sewer network; (ii) the 1D/2D combined model (SWMM [42] and Basement [43]): applied to the downtown catchments J&L using a more robust hydraulic formulation and including sewerage network as well as overland flow simulation tools [36]. DPlan (Distribution Planning modelling tool) was used in the whole metropolitan area for the energy service. GIS analysis was used for all the other services and city areas.
For different scenarios, considering both the current situation and the future with climate change, flooding exposure, and vulnerability of each urban service were characterized, and the respective hazard maps were produced [44].
The effects of multiple hazards and interdependencies in the city were also studied (Figure 2), namely flooding/mobility, flooding/energy, and flooding/waste [44]. Figure 3 presents the Lisbon flooding hazard maps both for the current situation (and considering climate change for flooding induced by rainfall or estuary tides. Figure 4 presents Lisbon drainage catchments J&L flooding-related hazard maps to pedestrians for flooding induced by rainfall for 2100 and impact on waste sector for flooding induced by sea level rise by 2050 and 2100.
In Lisbon, the sectorial models used were based on historical climate data and on projections of future climate scenarios, a thorough characterization of the urban services and of their relations with climate variables, detailed analysis of interdependencies, and production of hazard maps.
The overall methodology proposed to undertake the spatial characterization of the flood related hazards has the following main steps: (i) identification of flood related hazards, risk factors and risks using the selected affected sectors as case studies, namely, electricity supply, urban mobility, and wastes collection; (ii) selection of metrics for hazards characterization and mapping; (iii) selection of representative scenarios to characterize current and future situations; (iv) mapping of hazards and calculation of metrics to support further work on resilience assessment using GIS tools [36].
In terms of urban drainage tools, two types of hydraulic mathematical models were used at different scales: (i) the citywide 1D GIS model, which covers the city as a whole but adopts a simplified hydraulic model and sewer network; (ii) the 1D/2D combined model (SWMM [42] and Basement [43]): applied to the downtown catchments J&L using a more robust hydraulic formulation and including sewerage network as well as overland flow simulation tools [36]. DPlan (Distribution Planning modelling tool) was used in the whole metropolitan area for the energy service. GIS analysis was used for all the other services and city areas.
For different scenarios, considering both the current situation and the future with climate change, flooding exposure, and vulnerability of each urban service were characterized, and the respective hazard maps were produced [44].
The effects of multiple hazards and interdependencies in the city were also studied ( Figure 2), namely flooding/mobility, flooding/energy, and flooding/waste [44]. Figure 3 presents the Lisbon flooding hazard maps both for the current situation (and considering climate change for flooding induced by rainfall or estuary tides. Figure 4 presents Lisbon drainage catchments J&L floodingrelated hazard maps to pedestrians for flooding induced by rainfall for 2100 and impact on waste sector for flooding induced by sea level rise by 2050 and 2100. In Lisbon, the sectorial models used were based on historical climate data and on projections of future climate scenarios, a thorough characterization of the urban services and of their relations with climate variables, detailed analysis of interdependencies, and production of hazard maps. The overall methodology proposed to undertake the spatial characterization of the flood related hazards has the following main steps: (i) identification of flood related hazards, risk factors and risks using the selected affected sectors as case studies, namely, electricity supply, urban mobility, and wastes collection; (ii) selection of metrics for hazards characterization and mapping; (iii) selection of representative scenarios to characterize current and future situations; (iv) mapping of hazards and calculation of metrics to support further work on resilience assessment using GIS tools [36].
In terms of urban drainage tools, two types of hydraulic mathematical models were used at different scales: (i) the citywide 1D GIS model, which covers the city as a whole but adopts a simplified hydraulic model and sewer network; (ii) the 1D/2D combined model (SWMM [42] and Basement [43]): applied to the downtown catchments J&L using a more robust hydraulic formulation and including sewerage network as well as overland flow simulation tools [36]. DPlan (Distribution Planning modelling tool) was used in the whole metropolitan area for the energy service. GIS analysis was used for all the other services and city areas.
For different scenarios, considering both the current situation and the future with climate change, flooding exposure, and vulnerability of each urban service were characterized, and the respective hazard maps were produced [44].
The effects of multiple hazards and interdependencies in the city were also studied ( Figure 2), namely flooding/mobility, flooding/energy, and flooding/waste [44]. Figure 3 presents the Lisbon flooding hazard maps both for the current situation (and considering climate change for flooding induced by rainfall or estuary tides. Figure 4 presents Lisbon drainage catchments J&L floodingrelated hazard maps to pedestrians for flooding induced by rainfall for 2100 and impact on waste sector for flooding induced by sea level rise by 2050 and 2100.

Resilience Assessment
The Resilience Assessment Framework (RAF) (2.3) was applied by the three cities in this Step 4 [17,24] in order to carry out a structured assessment and support diagnosis and definition of the strategies. Figure

The Resilience Assessment Framework (RAF) (2.3) was applied by the three cities in this
Step 4 [17,24] in order to carry out a structured assessment and support diagnosis and definition of the strategies. Figure

Resilience Assessment
The Resilience Assessment Framework (RAF) (2.3) was applied by the three cities in this Step 4 [17,24] in order to carry out a structured assessment and support diagnosis and definition of the strategies. Figure 5   Considering the overall assessment, the tree cities have a relatively similar development level, being the percentage of advanced level metrics the highest, between 36% and 46%, followed by the progressing level between 14% and 25%, and the incipient around 15%. The percentage of unanswered metrics is also similar, 18-22%. Going deeper in the analysis, it is possible to identify the main opportunities for improvement, as follows for the Lisbon case. In Lisbon, overall resilience development in the city is advanced in more than one third of the aspects assessed. Around a fifth are progressing and the reminder incipient, unanswerable, or not applicable. From Figure 6, it is clear that spatial resilience is overall the most advanced resilience dimension, followed by the organizational dimension.
The physical dimension presents the highest percentage of metrics that were not answered, followed by the functional dimension, what may be due to data that is not easily applicable to the metrics provided in the RAF, in some cases, and to lack of information in other cases [33].
In the SWOT analysis of Barcelona, Bristol, and Lisbon, some aspects regarding Strengths, Weaknesses, Opportunities, and Threats are equal or similar. The significant background on Considering the overall assessment, the tree cities have a relatively similar development level, being the percentage of advanced level metrics the highest, between 36% and 46%, followed by the progressing level between 14% and 25%, and the incipient around 15%. The percentage of unanswered metrics is also similar, 18-22%. Going deeper in the analysis, it is possible to identify the main opportunities for improvement, as follows for the Lisbon case. In Lisbon, overall resilience development in the city is advanced in more than one third of the aspects assessed. Around a fifth are progressing and the reminder incipient, unanswerable, or not applicable. From Figure 6, it is clear that spatial resilience is overall the most advanced resilience dimension, followed by the organizational dimension. Considering the overall assessment, the tree cities have a relatively similar development level, being the percentage of advanced level metrics the highest, between 36% and 46%, followed by the progressing level between 14% and 25%, and the incipient around 15%. The percentage of unanswered metrics is also similar, 18-22%. Going deeper in the analysis, it is possible to identify the main opportunities for improvement, as follows for the Lisbon case. In Lisbon, overall resilience development in the city is advanced in more than one third of the aspects assessed. Around a fifth are progressing and the reminder incipient, unanswerable, or not applicable. From Figure 6, it is clear that spatial resilience is overall the most advanced resilience dimension, followed by the organizational dimension.
The physical dimension presents the highest percentage of metrics that were not answered, followed by the functional dimension, what may be due to data that is not easily applicable to the metrics provided in the RAF, in some cases, and to lack of information in other cases [33].
In the SWOT analysis of Barcelona, Bristol, and Lisbon, some aspects regarding Strengths, Weaknesses, Opportunities, and Threats are equal or similar. The significant background on The physical dimension presents the highest percentage of metrics that were not answered, followed by the functional dimension, what may be due to data that is not easily applicable to the metrics provided in the RAF, in some cases, and to lack of information in other cases [33].
In the SWOT analysis of Barcelona, Bristol, and Lisbon, some aspects regarding Strengths, Weaknesses, Opportunities, and Threats are equal or similar. The significant background on resilience and the leadership and management are some of the strengths on the resilience of these three cities. The existence of coastal areas that may provide conditions for economic development such as tourism and industry development and the financial opportunities in the cities are opportunities that can also be found in the three cities. Some of the similar weaknesses found are in the collective engagement and awareness and data gaps related to the energy infrastructure preparedness.
The coastal area (highly exposed to sea level rise and storm surge, consequences of climate change), the temperature increase by 2050, and sea level rise are examples of threats felt in each city.
In Figure 7, to illustrate the results related to the RAF purpose, an overall assessment for the organizational dimension is presented. Figure 7a presents the main strengths for the organizational dimension (inner circle), identifying the resilience objectives (middle circle) and criteria (outer circle) where are presented the percentage of metrics with an advanced level of development. Lisbon is well developed regarding leadership and management (O.2) and city preparedness (O.3), in this from the points of view of availability and access to basic services, preparedness for climate change and recovery and build back, while also presenting some relevant developments on collective engagement and awareness (O.1). Figure 7b presents the main weaknesses of the organizational dimension, identifying the resilience objectives and criteria with metrics in the incipient level of development. The main opportunities for development are those related to collective engagement and awareness (O.1) as well as city preparedness (O.3) from the points of view of recovery and build back, where there is still a great room for improvement, and disaster response.
Therefore, the SWOT analysis includes the most advanced and incipient objectives and criteria. For Lisbon, some of the identified strengths related with the Organizational dimension are the city preparedness for climate change, the availability and access to basic services, and the coordination and communication with stakeholders. Some weaknesses also identified for this dimension related to the city collective engagement and awareness of citizens and communities and to the city preparedness for disaster response. A complete SWOT analysis for Lisbon from a resilience to climate change perspective is presented in Supplementary Material. resilience and the leadership and management are some of the strengths on the resilience of these three cities. The existence of coastal areas that may provide conditions for economic development such as tourism and industry development and the financial opportunities in the cities are opportunities that can also be found in the three cities. Some of the similar weaknesses found are in the collective engagement and awareness and data gaps related to the energy infrastructure preparedness.
The coastal area (highly exposed to sea level rise and storm surge, consequences of climate change), the temperature increase by 2050, and sea level rise are examples of threats felt in each city.
In Figure 7, to illustrate the results related to the RAF purpose, an overall assessment for the organizational dimension is presented. Figure 7a presents the main strengths for the organizational dimension (inner circle), identifying the resilience objectives (middle circle) and criteria (outer circle) where are presented the percentage of metrics with an advanced level of development. Lisbon is well developed regarding leadership and management (O.2) and city preparedness (O.3), in this from the points of view of availability and access to basic services, preparedness for climate change and recovery and build back, while also presenting some relevant developments on collective engagement and awareness (O.1). Figure 7b presents the main weaknesses of the organizational dimension, identifying the resilience objectives and criteria with metrics in the incipient level of development. The main opportunities for development are those related to collective engagement and awareness (O.1) as well as city preparedness (O.3) from the points of view of recovery and build back, where there is still a great room for improvement, and disaster response.
Therefore, the SWOT analysis includes the most advanced and incipient objectives and criteria. For Lisbon, some of the identified strengths related with the Organizational dimension are the city preparedness for climate change, the availability and access to basic services, and the coordination and communication with stakeholders. Some weaknesses also identified for this dimension related to the city collective engagement and awareness of citizens and communities and to the city preparedness for disaster response. A complete SWOT analysis for Lisbon from a resilience to climate change perspective is presented in Supplementary Material.

Identification of Strategies
The cities intend to achieve the resilience objectives of the assessment, particularly reducing the risk regarding identified hazards, preparing the population and the services for their occurrence, and promoting a better articulation between urban services. To address this, more specifically, each city developed its own set of resilience strategies [27,49]. The planned strategies expected to have greater impact in the three cities and considering the objectives where they may impact are presented in Table 3.
With the planned set of strategies, the cities aim to achieve a significant part of its long-term resilience objectives regarding climate change, with focus on the urban water cycle. Guarantee security of services provision -All objectives of Organizational dimension -Spatial Risk Management (S1) Figure 7. Overall of Lisbon resilience assessment for the Organizational dimension regarding the development level [33].

Identification of Strategies
The cities intend to achieve the resilience objectives of the assessment, particularly reducing the risk regarding identified hazards, preparing the population and the services for their occurrence, and promoting a better articulation between urban services. To address this, more specifically, each city developed its own set of resilience strategies [27,49]. The planned strategies expected to have greater impact in the three cities and considering the objectives where they may impact are presented in Table 3.
With the planned set of strategies, the cities aim to achieve a significant part of its long-term resilience objectives regarding climate change, with focus on the urban water cycle.  The impact of the identified strategies in the RAF resilience objectives for the three cities is highly significant. The identified strategies address all the resilience dimensions and objectives as well as all services considered in each city.
In Lisbon, the impact of the strategy "Promoting urban rehabilitation as a tool to increase resilience: sewer systems" is presented in Figure 8, before (a) and after (b) the strategy implementation, for flooding induced by rainfall for 2100. It is evident the improvement regarding the water depth in the downtown area, within the red circle. It will contribute to improve the organizational resilience, namely regarding the leadership and management and the city preparedness objectives. This strategy will also contribute to improve both spatial resilience objectives and is related to all services of functional and physical dimensions.
In Lisbon, the impact of the strategy "Promoting urban rehabilitation as a tool to increase resilience: sewer systems" is presented in Figure 8, before (a) and after (b) the strategy implementation, for flooding induced by rainfall for 2100. It is evident the improvement regarding the water depth in the downtown area, within the red circle. It will contribute to improve the organizational resilience, namely regarding the leadership and management and the city preparedness objectives. This strategy will also contribute to improve both spatial resilience objectives and is related to all services of functional and physical dimensions.  . Impact on hazard assessment of "Promoting urban rehabilitation as a tool to increase resilience: sewer systems" strategy, before (a) and after (b) strategy implementation [33].

Strategies Prioritization, Implementation Plan, and Monitoring and Review
In this step, in the case of Lisbon, the city strategies were selected and defined as priority in the domain of urban floods due to their alignment with several sectorial, global, and territorial Municipal Master and emergency Plans, with the Municipal Main Planning Options and respective City Axis.
The implementation plan, presented in Figure 9, was defined articulating several official frameworks already approved and other commitments assumed, mainly following a political decision and prioritization, while depending on the financial capacity. Figure 8. Impact on hazard assessment of "Promoting urban rehabilitation as a tool to increase resilience: sewer systems" strategy, before (a) and after (b) strategy implementation [33].

Strategies Prioritization, Implementation Plan, and Monitoring and Review
In this step, in the case of Lisbon, the city strategies were selected and defined as priority in the domain of urban floods due to their alignment with several sectorial, global, and territorial Municipal Master and emergency Plans, with the Municipal Main Planning Options and respective City Axis.
The implementation plan, presented in Figure 9, was defined articulating several official frameworks already approved and other commitments assumed, mainly following a political decision and prioritization, while depending on the financial capacity.
In order to trace the progress of the resilience strategies implementation, of resilience changes, and to identify early deviations that may require corrective action, Table 4 presents the RAP monitoring and review process planned for Barcelona, Bristol, and Lisbon, including the periodicity, responsible body, and activities to undertake. In Lisbon, an additional activity is foreseen in the review process.
In order to trace the progress of the resilience strategies implementation, of resilience changes, and to identify early deviations that may require corrective action, Table 4 presents the RAP monitoring and review process planned for Barcelona, Bristol, and Lisbon, including the periodicity, responsible body, and activities to undertake. In Lisbon, an additional activity is foreseen in the review process. In the Lisbon plan, some of the challenges identified in the SWOT are still to be addressed in the future, namely some threats (windstorms, the socio-economics crises, contribution to new legal diplomas, concepts harmonization, and General Data Protection Regulation obstacles) and weaknesses (related to budget and insurance, data gaps, services resilience planning, wastewater service autonomy, services and infrastructures preparedness for CC, costs of damages in buildings, compatibility between different tools, and structured georeferenced data). Besides, it is fundamental to align digital interactive platforms and establish temporal targets [33].

Discussion
The RAPs are thematic plans that contribute to the city's global planning and are based on the RESCCUE developments as well as on the drivers, opportunities, context and existing background, practices and knowledge of each city. Following the approach developed by the authors [17], each city defined the geographical scope, period, and the relevant critical hazards to plan for, being those associated with urban flooding common to all of them. The development of the RAPs followed an established process common to the three cities, while providing flexibility to accommodate the specificities of each city. For each step of the RAP development, innovative methods and tools were developed to support any city in defining its own resilience enhancement roadmap.
The production of the plan by each city-Barcelona, Bristol, and Lisbon-was based on a template with detailed guidelines, developed as a supporting tool. This application provided opportunities to produce a general template and respective guidelines that can be used by any city to develop its own RAP to climate change, contributing to the city's global planning [17].
The RAP intends to be concise and it is targeted to a broad audience that includes experts and the general public. Therefore, the methods applied are therein referred to or cited, since they make part of the planning process, but they are not detailed in the plans. These tools have proven to be fundamental to undertake the cities' diagnoses and to support the identification of future interventions, based on existing and centralized information.

Conclusions
A resilience planning process was developed in this research and is herein presented [17]. The implementation of the planning process effectively provided the production of the three RAPs, and allowed identification of the main benefits of the process and future challenges to address, from the cities and services point of view. New tools and approaches were developed to allow effective implementation with contributions from the authors [17,[23][24][25][26][27]36,47].
Some of the identified main benefits of the plan implementation are related to deepen the knowledge of city services resilience and their interdependencies, definition of multisectoral goals, indicators and targets, the enhancement of synergies and alignment between local, regional, national, and international strategic plans, frameworks, networks, and instruments and the delivery of public results to citizens, with public participation reinforcement [17].
As future challenges, the plans can be improved and address new data and information to fill data gaps, include other hazards (heat and cold waves, floods, windstorms, mean sea level rise and storm surges, storms, etc.), integrating and updating the knowledge regarding city services climate change related hazards. The plans need to include the collective and individual citizen participation and awareness with respect to a range of hazards and different disruptive events, maintain continuous plan monitoring and review, and continuous engagement and involvement of key stakeholders and decision makers in the technical and scientific process.
In the different phases of the planning process, different roles and contributions from stakeholders emerge. The active engagement throughout the planning process will ensure the success of the strategies development and further implementation. Within this context, communication between stakeholders and public dissemination of results becomes a key factor for a successful implementation process of the adaptation strategies.
Additionally, the lessons learnt from the cities and services' point of view provided identification of recommendations for RAP development in other cities [17]. These recommendations address mainly the best way to begin the development of the plan (using results and knowledge from other cities), the involvement of a mixed/transversal team made up by different entities and coordinated by the municipality and key sectors of the city that are commonly forgotten (e.g., heritage management). It also includes the allocation of specific budgets for resilience, the use of lessons and experiences from extreme events, even if not weather-related (e.g., COVID-19) to improve and prioritize emergency and response procedures and commit budget priorities to sustainable development giving importance to factors and indicators that are not exclusively economic and taking advantage of cost-benefit analysis (include co-benefits).
Supplementary Materials: The following are available online at http://www.mdpi.com/2071-1050/12/21/9017/s1, Table S1: SWOT analysis for Lisbon from a resilience to climate change perspective, Figure S1: Overall of Lisbon resilience assessment for the Organizational dimension regarding the development level, Figure S2: Overall of Lisbon resilience assessment for the Spatial dimension regarding the development level, Figure S3: Overall of Lisbon resilience assessment for the Functional dimension regarding the development level, Figure S4: Overall of Lisbon resilience assessment for the Physical dimension regarding the development level.