Resilience Attributes of Social-Ecological Systems: Framing Metrics for Management
Abstract
:1. Introduction
The Need to Translate Theory into Practice
“Energy resilience metrics should be part of the overall performance metric, and should be considered in requirements development and acquisition processes. This shift in emphasis from assuring supplies to assuring mission preparedness will complement and reinforce the mandate that mission performance takes priority over energy consumption. This new focus will also ensure future planning addresses not just energy supplies, but actual mission performance for the widest range of circumstances.”
“Despite the challenge to transition to an energy strategy that incorporates resilience and adaptability to evolving conditions given planned budget constraints, shifting mission priorities, and a need for flexibility in a changing global energy reality, DoD should consider making resilience a focus for energy security”.[21]
2. Resilience Attributes
2.1. Previous Efforts to Move from Theory to Application
2.2. Stakeholder Analytical Constraints
2.3. The Synthesis of Practical Resilience Attributes
Stability Category | |
---|---|
Single Points of Failure | Singular features or aspects of the system, the absence or failure of which will cause the entire system to fail. |
Pathways for Controlled Reductions in Function | Whether the functionality of a system, operation, or capability can be reduced in a manner that avoids the overwhelming effects of an unconstrained failure. |
Resistance | The insensitivity of the system to stresses of a given size, duration, or character. |
Balance | The degree to which a system is not skewed toward one strength at the expense of others. |
Dispersion | The degree to which the system is distributed over space and time. |
Adaptive Capacity Category | |
Response Diversity | The variety and disparity of steps, measures, and functions by which an operation can carry out a task or achieve a mission. |
Collaborative Capacity | The capacity to act through coordinated engagement. |
Connectivity | How readily resources and information can be exchanged to ensure continued functionality. |
Abundance/Reserves | The on-hand resource stores (capital) upon which a system can rely when responding to stress. |
Learning Capacity | The ability to acquire, through training, experience, or observation, the knowledge, skills, and capabilities needed to ensure system functionality. |
Readiness Category | |
Situational Awareness | How well system, component, and functional capabilities are monitored. How readily emerging stresses or failures can be detected. |
Simplicity/Understandability | How well system functions and capabilities can be understood. |
Preparedness | The level of preparation in plans, procedures, personnel, and equipment for responding to system perturbations. |
False Subsidies | Whether inputs, outputs, or internal processes receive incentives disproportionate or unrelated to their value. |
Autonomy | A system manager’s authority to select and employ alternate actions, configurations, and components in response to stress. |
Enabling Traits | |
Leadership and Initiative | The ability to motivate, mobilize, and provide direction in response to disruptions, as well as the ability to assume responsibility and act. |
Single Points of Failure | Response Diversity | Situational Awareness |
Controllable Degradation | Collaborative Capacity | Simplicity/Understandability |
Resistance | Connectivity | Preparedness |
Balance | Abundance/Reserves | False Subsidies |
Dispersion | Learning Capacity | Autonomy |
Leadership and Initiative | ||
Stability | Adaptive Capacity | Readiness |
2.4. Enabling Traits
3. Descriptions and Targeting Queries
3.1. Stability
3.1.1. Stability Attribute: Single Points of Failure
- Singular features or aspects of the system, the absence or failure of which will cause the entire system to fail (See [22]).
- On what physical (components, resources, linkages), human (manpower, skills, leadership, cultural, psychological, political), and administrative (organizational, legal, regulatory) factors does the system depend?
- Are there other critical system dependencies, including simultaneous or sequential functions, external systems, communications, or controls?
- Do single points of failure emerge only after a certain period of time? How well known are the time delays?
- Do single points of failure emerge without warning, or are there forewarnings or other indices? How well known are the warning signs?
- Are all who are affected by the system aware of the single points of failure?
3.1.2. Stability Attribute: Pathways for Controlled Reductions in Function
- Whether the functionality of a system, operation, or capability can be reduced in a manner that avoids the overwhelming effects of an unconstrained failure. (As derived from Lovins’ concept of stability [22].)
- Is there sufficient information available to assess the emergence of system failure modes and to monitor controlled reductions in function?
- Are there methods for controlling a reduction in system function? Can problems be isolated and constrained to limit decline in system functionality?
- Are personnel trained in how to monitor conditions and adjust system components to control system degradation?
- Can a reduction in function be initiated before the onset of an unconstrained failure?
- Can controlled reductions in function be automated? If they already are automated, are they sufficient to handle all possible scenarios? Can manual controls override the automation if necessary?
3.1.3. Stability Attribute: Resistance
- Does the system have a history of being relatively unaffected by certain types of stresses?
- Can the system endure certain challenges for a known period or with a minimum of additional resources?
- Are there specific conditions under which the system is resistant to challenges and others under which it is more vulnerable or brittle? Can they be determined through analysis?
- Does the system indicate when its inherent resistance will be surpassed and failure will begin?
3.1.4. Stability Attribute: Balance
- Is the system skewed to a particular strength? If so, how is it skewed, and have other system attributes been sacrificed to achieve that strength?
- How well does the system handle a wide variety of missions and challenges?
- Is there a history of system performance faltering when faced with missions or stresses that differ greatly from the norm?
- Is the system subsidized to favor certain features, attributes, or capabilities?
- Can the system be tested to identify imbalances?
3.1.5. Stability Attribute: Dispersion
- The degree to which the system is distributed over space and time (See [22]).
- How is the system distributed (e.g., distance, time, physical barriers, technical separation, administrative or other organizational division, cultural or social separation, etc.)?
- Is separation sufficient to prevent the spread of systemic stresses?
- Are disparate elements free to act autonomously?
- Does the distribution drain resources or slow responses to challenges?
3.2. Adaptive Capacity
3.2.1. Adaptive Capacity Attribute: Response Diversity
- How easily can a mission, task, or function be accomplished in different ways or with different resources? How readily can this be done under stressed conditions?
- How many, how varied, and how well known are the options to accomplish a task?
- Are all aspects, components, features, and functions of the system covered?
- To what degree can substitute or redundant capabilities, components, subsystems, controls, resources, skill sets, or features be combined, modified, or directly employed?
- At what cost to the system—immediately or over time—are substitutes employed?
- What burdens are placed on the system to maintain flexibility through redundancies and alternatives? Does the presence of redundancies foster complacency?
- How easily can response flexibility be incorporated into the system? Can changes in rules foster more creative responses to stressors?
3.2.2. Adaptive Capacity Attribute: Collaborative Capacity
- Do personnel know others within the system with whom they can act, and how to make that coordination happen effectively?
- Can linkages be established and utilized in a timely manner?
- Do personnel recognize when to enlist others in collaboration? Is this personality-specific? Can it be instilled through training?
- Are personnel adequately motivated, and do they have the time, resources, and skills needed to collaborate?
- Can it be discerned when the benefits of collaboration outweigh the costs?
3.2.3. Adaptive Capacity Attribute: Connectivity
- Where, when, and how are information and/or resources exchanged?
- Are the pathways and links for that exchange known? How well maintained are they? How effective are they? How often are they used?
- Are pathways of connectivity personality-dependent, or can they be accessed and employed by anybody when necessary?
- How does connectivity support response flexibility and situational awareness? How is it enabled by situational awareness?
- What resources are allocated to maintain connectivity?
- Can connectivity pathways and links be severed when necessary to prevent the spread of problems?
- Do bureaucratic requirements slow or prevent action?
3.2.4. Adaptive Capacity Attribute: Abundance/Reserves
- What resources does the system maintain for immediate engagement when stressed?
- Are the system’s reserves monitored and their limits known?
- Is the system made brittle, vulnerable, or less stable when it employs its resources?
- Are there conditions under which the system’s resources are rendered unavailable?
- How is a sufficiency of resources determined?
3.2.5. Adaptive Capacity Attribute: Learning Capacity
- Is there an individual and organizational culture of learning?
- Are there active adaptive management and lessons-learned programs in place?
- Have personnel received expected training?
- Is there institutional support for increased education/training?
- Is the system sufficiently manned to allow personnel the time needed for training?
3.3. Readiness
3.3.1. Readiness Attribute: Situational Awareness
- How well system, component, and functional capabilities are monitored.
- Does monitoring take place to detect and identify stresses?
- How timely and understandable is the information provided?
- How comprehensive is the information about the system and its environment? Conversely, how well known are the information gaps?
- Can queries yield additional information?
- How well are personnel trained in knowledge of the overall system; in the use of system monitoring technology; and how to capitalize on advantages designed into the system?
3.3.2. Readiness Attribute: Simplicity/Understandability
- How well system functions and capabilities can be understood. (As derived from Lovins’ concept of accessibility [22].)
- How, and to what degree, is system understanding achieved and maintained?
- Can the complete system be understood by combining partial information from multiple sources?
- How is system understanding shared or transferred? How readily can a newcomer understand the system?
- Can richer information about the system be obtained? How?
3.3.3. Readiness Attribute: Preparedness
- The level of preparation in plans, procedures, personnel, and equipment for responding to system perturbations. (See [34].)
- Do response plans and procedures exist? Are they formal or informal? Are they flexible? How readily can they be modified for unforeseen circumstances?
- How accessible are plans and procedures? Do those affected know how and where to access them? Are they dependent on specific personnel?
- Are the plans well maintained, frequently updated, and tied to training and exercises?
- How readily implemented are plans and procedures?
- Are personnel well prepared and aware of threats?
- Is equipment well maintained?
3.3.4. Readiness Attribute: False Subsidies
- Are any false subsidies known or readily identified?
- How readily can any subsidies be discontinued, either temporarily or permanently?
- Who controls the false subsidies, and how engaged is that controlling entity in the function or purpose of the system?
- Can false subsidies be converted to assets that do not skew the system?
3.3.5. Readiness Attribute: Autonomy
- Is the hierarchy of authority or power structure known? Is it necessary, and under what circumstances can it be bypassed?
- Can autonomy be exercised on a situational basis, e.g., in proportion to the stressor, for specific stresses or system features, or on a time-limited basis?
- Are personnel trained to handle autonomous decision-making?
- Does the right or authorization to act autonomously include the ability to negotiate and coordinate with other parties?
- Do parties within and outside of a system recognize others’ authority to act autonomously?
3.4. Enabling Traits
- Are there actors within the system who fill a leadership role? Are these actors strong leaders?
- Are leaders apparent and agreed upon? Do leaders recognize themselves as such, either on a formal, ad hoc, or implicit basis? Do outside parties, as well as other actors in a system, recognize leaders as well? Do the leaders possess the authority to affect changes and negotiate with governmental agencies and outside actors?
- Do the leaders have enough history within the system to be knowledgeable about system conditions, vulnerabilities, and internal and external threats?
- Do system rules, explicit or implicit, present incentives or obstacles to stakeholder initiative in the face of system challenges?
- Are the leaders comfortable with adaptive management, or do they seek less flexible approaches?
- Do system design parameters and constraints engage and support the performance of leaders when shocks and disturbances challenge initial operating assumptions and change operating conditions?
4. Discussion and Conclusions
4.1. Limitations
4.2. Benefits
- Supports informed decision-making by providing a common basis for comparing and understanding resilience across systems.
- Supports identifying and forecasting potential problems and tipping points, instead of learning from failures or from a system on the edge of failure. The whole-system perspective reveals “least-harm solutions.”
- Provides additional insights about the effects of policies and practices on system function in the face of unforeseen challenges.
- Provides a solid basis for developing baselines against which to measure trends and progress. This may entail formulating scenarios for qualitatively different future trajectories, then setting resilience metrics-based “waypoints” or “guideposts” in each scenario to provide early warning to managers that the system is evolving in a particular direction. It also supports the evaluation of investment and intervention options [45].
- Provides an additional line of evidence for managing facilities and environmental resources, and for making investment decisions by land use and regulatory agencies, federal installations, states and municipalities, and energy and water utilities, for example.
- Ties to Strategic Planning Objectives and Milestones. Generating quality metrics is typically the most challenging part of the strategic planning process. Using these resilience attributes and targeting queries to develop system-specific metrics can greatly improve strategic plans while incorporating resilience principles.
- Supports Adaptive Management. The resilience attributes lend themselves to assessing system thresholds and sensitivities within an active adaptive management program.
4.3. Applications
Category | Application |
---|---|
Permanent Federal and State Installations, Park Lands and Reserves |
|
Temporary Remote Installations |
|
Military Operational Energy and Water |
|
Watershed Management |
|
International Development and Aid Organizations |
|
Communities |
|
Critical Infrastructure Security and Resilience (Presidential Policy Directive-21) |
|
4.4. Future Research
- Are the terms sufficiently comprehensive and understandable? How easily can stakeholders employ them in creating useful metrics for system management? In addition, can they be used consistently by different users over time?
- How do the attributes relate to and support assessment of such concepts as panarchy, thresholds, transformability, latitude, precariousness, and managing slow and fast external variables? How might they be employed beyond a baseline analysis in an iterative approach to resilience assessment?
- Can the attributes alone characterize system resilience (and if so, to what degree)? Do they surpass simple metrics generated to evaluate infrastructure and emergency and backup functions (e.g., the community resilience index [44])? Are the attributes better suited for framing a deeper resilience analysis (e.g., of thresholds or panarchy)? Are deeper analyses any more reliable than the baseline snapshot offered by these resilience attributes? How can that be tested?
- To what applications do the resilience attributes best lend themselves? This may include vulnerability analyses and gap assessments; assessing the implications of system changes; tracking system conditions and trends over time; prioritizing functions for graceful degradation; and planning investments in infrastructure or other system components.
- How are the attributes best employed? This may include scenario analyses; metrics to guide strategic planning, monitoring programs, and adaptive management; and “Dashboard” depictions for routine monitoring.
Acknowledgments
Conflicts of Interest
References
- Holling, C.S. Resilience and stability of ecological systems. Annu. Rev. Ecol. Syst. 1973, 4, 1–23. [Google Scholar]
- Fiksel, J. Sustainability and resilience: Toward a systems approach. Sustain. Sci. Pract. Policy 2006, 2, 14–21. [Google Scholar]
- Walker, B.; Salt, D. Resilience Thinking: Sustaining Ecosystems and People in a Changing World; Island Press: Washington, DC, USA, 2006; pp. 1–151. [Google Scholar]
- Folke, C.; Carpenter, S.; Elmqvist, T.; Gunderson, L.; Holling, C.S.; Walker, B. Resilience and sustainable development: Building adaptive capacity in a world of transformations. Ambio 2002, 31, 437–440. [Google Scholar]
- Walker, B.; Gunderson, L.; Kinzig, A.; Folke, C.; Carpenter, S.; Shultz, L. A handful of hueristics and some propositions for understanding resilience in social-ecological systems. Ecol. Soc. 2006, 11, 1–8. [Google Scholar]
- Walker, B.; Salt, D. Resilience Practice: Building Capacity to Absorb Disturbance and Maintain Function; Island Press: Washington, DC, USA, 2012; pp. 85–100. [Google Scholar]
- National Academy of Sciences (NAS). Disaster Resilience: A National Imperative; National Academy Press: Washington, DC, USA, 2012; pp. 1–31. [Google Scholar]
- The Johnson Foundation at Wingspread. Building Resilient Utilities: How Water and Electric Utilities Can Co-Create Their Futures; The Johnson Foundation at Wingspread: Racine, WI, USA, 2013; pp. 2–3. [Google Scholar]
- Resilience Alliance. Assessing Resilience in Social-Ecological Systems: Workbook for Practitioners (Revised Version 2). Available online: http://www.resalliance.org/workbook (accessed on 30 November 2014).
- Folke, C.; Carpenter, S.; Walker, B.; Scheffer, M.; Elmqvist, T.; Gunderson, L.; Holling, C.S. Regime shifts, resilience, and biodiversity in ecosystem management. Annu. Rev. Ecol. Evol. Syst. 2004, 35, 557–581. [Google Scholar] [CrossRef]
- Walker, B.; Carpenter, S.; Anderies, J.; Abel, N.; Cumming, G.S.; Janssen, M.; Lebel, L.; Norberg, J.; Peterson, G.D.; Pritchard, R. Resilience management in social-ecological systems: A working hypothesis for a participatory approach. Conserv. Ecol. 2002, 6, 14. [Google Scholar]
- Biggs, R.; Schluter, M.; Biggs, D.; Bohensky, E.L.; BurnSilver, S.; Cundill, G.; Dakos, V.; Daw, T.M.; Evans, L.S.; Kotschy, K.; et al. Toward principles for enhancing the resilience of ecosystem services. Annu. Rev. Environ. Resour. 2012, 37, 421–448. [Google Scholar] [CrossRef]
- Thrush, S.F.; Hewitt, J.E.; Dayton, P.K.; Coco, G.; Lohrer, A.M.; Norkko, A.; Norkko, J.; Chiantore, M. Forecasting the limits of resilience: Integrating empirical research with theory. Proc. R. Soc. 2009, 276, 3209–3217. [Google Scholar] [CrossRef]
- Walker, B.; Holling, C.S.; Carpenter, S.R.; Kinzig, A. Resilience, adaptability and transformability in social-ecological systems. Ecol. Soc. 2004, 9, 5. [Google Scholar]
- Holling, C.S.; Gunderson, L.H. Resilience and adaptive cycles. In Panarchy; Gunderson, L.C., Holling, C.S., Eds.; Island Press: Washington, DC, USA, 2002; Chapter 2; pp. 25–62. [Google Scholar]
- Gunderson, L.; Folke, C. Resilience 2011: Leading transformational change. Ecol. Soc. 2011, 16, 30. [Google Scholar]
- Holling, C.S.; Gunderson, L.H.; Peterson, G.D. Sustainability and panarchies. In Panarchy; Gunderson, L.C., Holling, C.S., Eds.; Island Press: Washington, DC, USA, 2002; Chapter 3; pp. 63–102. [Google Scholar]
- Kidd, R. Deputy assistant secretary of the army (energy & sustainability). In Proceedings of the Comments at the Environment, Energy Security & Sustainability (E2S2) Symposium & Exhibition, Panel on Energy Security Resilience. New Orleans, LA, USA, 23 May 2012.
- Mitchell, A. Comments during briefing on “Managing Energy and Water Resilience”. Washington, DC, USA, Unpublished work. 19 February 2014. [Google Scholar]
- Nagel, A.M. Comments during briefing on “Managing Energy and Water Resilience”. Washington, DC, USA, Unpublished work. 19 February 2014. [Google Scholar]
- National Defense Industrial Association (NDIA). Top Issues 2013; NDIA: Arlington, VA, USA, 2013. Available online: http://www.ndia.org/Advocacy/PolicyPublicationsResources/Documents/TopIssues_2013_web.pdf (accessed on 30 November 2014).
- Lovins, A.; Lovins, H. Brittle Power: Energy Strategy for National Security; Brick House Publishing Co., Inc.: Andover, MA, USA, 1982; pp. 1–333. [Google Scholar]
- Lee, K. Compass and Gyroscope: Integrating Science and Politics for the Environment; Island Press: Washington, DC, USA, 1993; pp. 51–86. [Google Scholar]
- Becker, C.D.; Ostrom, E. Human ecology and resource sustainability: The importance of institutional diversity. Annu. Rev. Ecol. Syst. 1995, 26, 113–133. [Google Scholar] [CrossRef]
- Folke, C.; Carpenter, S.R.; Walker, B.; Scheffer, M.; Chapin, T.; Rockström, J. Resilience thinking: Integrating resilience, adaptability and transformability. Ecol. Soc. 2010, 15, 20. [Google Scholar]
- Ostrom, E. Understanding Institutional Diversity; Princeton University Press: Princeton, NJ, USA, 2005; pp. 1–48. [Google Scholar]
- Ostrom, E. A general framework for analyzing sustainability of social-ecological systems. Science 2009, 325, 419–422. [Google Scholar] [CrossRef] [PubMed]
- Berkes, F. Understanding uncertainty and reducing vulnerability: Lessons from resilience thinking. Nat. Hazards 2007, 41, 283–295. [Google Scholar] [CrossRef]
- Olson, P.; Gunderson, L.H.; Carpenter, S.R.; Ryan, P.; Louis, L.; Folke, C.; Holling, C.S. Shooting the rapids: Navigating transitions to adaptive governance of social-ecological systems. Ecol. Soc. 2006, 11, 18. [Google Scholar]
- Thomas, S.; Kerner, D. Defense Energy Resilience: Lessons from Ecology; Letort Paper; Strategic Studies Institute, United States Army War College: Carlisle, PA, USA, 2010; pp. 1–35. [Google Scholar]
- Anderies, J.M.; Folke, C.; Walker, B.; Ostrom, E. Aligning key concepts for global change policy: Robustness, resilience, and sustainability. Ecol. Soc. 2013, 18, 8. [Google Scholar]
- Stokols, D.; Lejano, R.P.; Hipp, J. Enhancing the resilience of human-environment systems: A social-ecological perspective. Ecol. Soc. 2013, 18, 7. [Google Scholar]
- Army Rapid Equipping Force (Army REF). Final Report Energy Resilience Study: Resilience Assessment of Notional Combat Outpost; Contract SP0700-D-0301.16; Army Rapid Equipping Force (Army REF): Alexandria, VA, USA, 2013; pp. 1–76. [Google Scholar]
- Thomas, S.; Kerner, D. Metrics for assessing resilience: A social-ecological systems perspective. In Proceedings of the Presentation to the Challenges of Natural Resource Economics and Policy National Forum on Socioeconomic Research in Coastal Systems, New Orleans, LA, USA, 25 March 2013.
- Resilience Alliance. Adaptive Capacity. Available online: http://www.resalliance.org/index.php/adaptive_capacity (accessed on 30 November 2014).
- Kerner, D.; Thomas, S. Efficiency and conservation not enough to achieve energy security. National Defense Magazine 2012, 1–3. [Google Scholar]
- Kerner, D; Thomas, S. Understanding energy resilience. In Proceedings of the Presentation to the Energy Security Panel, Energy and Environmental Sustainability Symposium, National Defense Industrial Association, New Orleans, LA, USA, 23 May 2012.
- Kerner, D.; Thomas, S. Defense energy resilience: Assessment metrics. In Proceedings of the Presentation to the Energy Security Panel, Energy and Environmental Sustainability Symposium, National Defense Industrial Association, New Orleans, LA, USA, 23 May 2012.
- Carpenter, S.R.; Arrow, K.J.; Barrett, S.; Biggs, R.; Brock, W.A.; Crepin, A.; Engstrom, G.; Folke, C.; Hughes, T.P.; Kautsky, N.; et al. General resilience to cope with extreme events. Sustainability 2012, 4, 3248–3259. [Google Scholar] [CrossRef]
- Park, J.; Seager, T.P.; Rao, P.S.C.; Convertino, M.; Linkov, I. Integrating risk and resilience approaches to catastrophe management in engineering systems. Risk Anal. 2013, 33, 356–367. [Google Scholar] [CrossRef]
- Cumming, G.S.; Barnes, G.; Perez, S.; Schmink, M.; Sieving, K.S.; Southworth, J.; Binford, M.; Holt, R.D.; Stickler, C.; van Holt, T. An exploratory framework for the empirical measurement of resilience. Ecosystems 2005, 8, 975–987. [Google Scholar] [CrossRef]
- Olsson, P.; Folke, C.; Berkes, F. Adaptive comanagement for building resilience in social-ecological systems. Environ. Manag. 2004, 34, 75–90. [Google Scholar] [CrossRef]
- Cutter, S.L.; Burton, C.G.; Emrich, C.T. Disaster resilience indicators for benchmarking baseline conditions. J. Homel. Secur. Emerg. Manag. 2010, 7, 1–22. [Google Scholar]
- Sempier, T.T.; Swann, D.L.; Emmer, R.; Sempier, S.H.; Schneider, M. Coastal Community Resilience Index: A Community Self-Assessment. Available online: http://masgc.org/assets/uploads/publications/364/08-014.pdf (accessed on 30 November 2014).
- Thomas, S; Mouat, D. Alternative futures analysis as a complement to planning processes for the use of military land. Air Space Power J. 2011, 25, 100–109. [Google Scholar]
© 2014 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Kerner, D.A.; Thomas, J.S. Resilience Attributes of Social-Ecological Systems: Framing Metrics for Management. Resources 2014, 3, 672-702. https://doi.org/10.3390/resources3040672
Kerner DA, Thomas JS. Resilience Attributes of Social-Ecological Systems: Framing Metrics for Management. Resources. 2014; 3(4):672-702. https://doi.org/10.3390/resources3040672
Chicago/Turabian StyleKerner, David A., and J. Scott Thomas. 2014. "Resilience Attributes of Social-Ecological Systems: Framing Metrics for Management" Resources 3, no. 4: 672-702. https://doi.org/10.3390/resources3040672
APA StyleKerner, D. A., & Thomas, J. S. (2014). Resilience Attributes of Social-Ecological Systems: Framing Metrics for Management. Resources, 3(4), 672-702. https://doi.org/10.3390/resources3040672