You are currently viewing a new version of our website. To view the old version click .
Mathematics
  • Article
  • Open Access

16 September 2020

Optimising the Preparedness Capacity of Enterprise Resilience Using Mathematical Programming

,
and
1
Research Centre on Production Management and Engineering (CIGIP), Universitat Politècnica de València, Escuela Politécnica Superior de Alcoy, Calle Alarcón, 03801 Alcoy, Spain
2
Área de Ingeniería de Organización, Dpto. de Ingeniería Mecánica, Universidad Carlos III de Madrid, Avda. de la Universidad, 30, 28911 Leganés, Spain
*
Author to whom correspondence should be addressed.
This article belongs to the Special Issue Mathematical Methods and Analysis for the Industrial Management and Business

Abstract

In today’s volatile business arena, companies need to be resilient to deal with the unexpected. One of the main pillars of enterprise resilience is the capacity to anticipate, prevent and prepare in advance for disruptions. From this perspective, the paper proposes a mixed-integer linear programming (MILP) model for optimising preparedness capacity. Based on the proposed reference framework for enterprise resilience enhancement, the MILP optimises the activation of preventive actions to reduce proneness to disruption. To do so, the objective function minimizes the sum of the annual expected cost of disruptive events after implementing preventive actions and the annual cost of such actions. Moreover, the algorithm includes a constraint capping the investment in preventive actions and an attenuation formula to deal with the joint savings produced by the activation of two or more preventive actions on the same disruptive event. The management and business rationale for proposing the MILP approach is to keep it as simple and comprehensible as possible so that it does not require highly mathematically skilled personnel, thus allowing top managers at enterprises of any size to apply it effortlessly. Finally, a real pilot case study was performed to validate the mathematical formulation.

1. Introduction

The frequency and intensity of disasters continue to increase [1], which is why supply chains and enterprises need to be flexible, agile, robust, organised, prepared and active in order to face any crisis in an efficient way.
Some studies and reports say that many organisations go out of business within two or three years after they experience a major disruption [2]. Therefore, companies in today’s volatile business arena need to be designed to incorporate event readiness, provide an efficient and effective response, and be capable of recovering to their original state or even a better post-disaster state. The capacity to do so has been defined as enterprise resilience when it involves the intra-company level or a single company and supply chain resilience when it affects different entities of the supply chain (inter-company level) [3].
Enterprise resilience is the capacity to avoid, absorb, adapt to and recover from disruptions [4]. Woods [5] defined enterprise resilience as the capacity to anticipate unsafe and unexpected events for organisational survival in the face of threats, including preventing or mitigating failures in the system. Along the same line, Gilly et al. [6] understood enterprise resilience as an active capacity of the company to resist an external event, and a more proactive capacity to anticipate events and thus open new development pathways.
From the previous definitions of enterprise resilience, it is observed that one of the main pillars is the capacity of enterprises to anticipate, prevent and prepare in advance for disruptions. Therefore, enterprises should pay attention to their preparedness capacity to bolster resilience. Firms should implement the necessary actions to improve their preparedness capacity, which in turn will enhance their enterprise resilience capacity. The literature reveals that there are two main types of action to face disruptions, depending on the timeline when they are implemented [7]. Mitigation actions are implemented prior to the occurrence of disruptions and are proactive by nature, and contingency policies are reactive, implemented to recover once a disruption has already occurred. This paper is focused on mitigation policies, as they serve to improve the preparedness perspective of enterprise resilience. More concretely, the mitigation actions considered in this research are focused on preventing disruptions by implementing preventive actions that will try to reduce (i) the probability of occurrence, (ii) the severity of disruptive events or (iii) both.
Coutu [8] stated that enterprise resilience is an organisation’s ability to face reality with staunchness, make meaning of hardship and improvise solutions from thin air. It is broadly recognised that in order to be resilient, organisations need to have a certain degree of ability to improvise in stressful situations. However, it is also true that resilient organisations need to be prepared for the expected, but more importantly for the unexpected. Then, there is a need to develop preparedness actions to guarantee enterprise resilience to face disruptions. The complexity that enterprises deal with daily makes decision-making for enhancing enterprise resilience non-trivial, and it is best facilitated with the aid of mathematical models. For this reason, the main objective of this paper is to propose a mixed-integer linear programming (MILP) model that offers valuable information to support enterprises in their decision-making process related to enhancing the preparedness capacity to be more resilient.
The remainder of this paper is organised as follows. In Section 2, we review relevant literature. Section 3 defines the data modelling approach to characterize the preparedness capacity from the AS IS and TO BE model perspectives. Section 4 develops a MILP model to optimise the activation of a set of preventive actions that enhance the preparedness capacity to reduce enterprises’ proneness to disruptions. In Section 5, a piloting case study is performed at a company in the foam sector. An analysis of the results is performed to provide the enterprise with valuable information to facilitate the decision-making process regarding the progress of its readiness to face disruptions. Finally, Section 6 concludes the paper and defines further research lines.

2. Literature Foundations

Dalziell and McManus [9], Paries [10] and Haimes et al. [11] studied the emergent properties of resilience and considered that it cannot be directly measured as an assessment of the AS IS status. Nevertheless, it is necessary to analyse, in a certain instance, how much an enterprise is prepared to face specific disruptive events. In addition to this, having a great understanding of the AS IS state is as important as improving the current status towards an enhanced preparedness capacity status (TO BE) to deal with an unstable environment.
The literature review offers attempts to assess and enhance the resilience capacity of enterprises and supply chains. However, most of them are conceptual approaches, which are highly valuable contributions for the scientific knowledge theoretical building but are not practically useful for real application. Table 1 offers an overview of these approaches, as proposed by various authors; the review is based on the work performed by [12] and highlights the limitations hindering their practical application.
Table 1. Analysis of approaches related to enterprise resilience enhancement.
Apart from the previous attempts, we have only found one contribution that offers a more practical approach, namely the Supply Chain Resilience Assessment and Management (SCRAMTM) tool defined by [25]. By measuring vulnerability factors such as turbulence, deliberate threats, external pressures, and resource limits, among others, and capability factors such as flexibility, efficiency, visibility, and adaptability, among others, the tool provides an evaluation of the resilience in a supply chain. However, the main limitation is related to its industry-specificity or even firm and product-level particularities, which requires the definition of more specialized metrics. Although these tools shed light on assessing resilience, the resilience subject is under-researched and warrants further study.
Based on the analysis performed in Table 1, some limitations regarding published enterprise and supply chain resilience research have been identified. These main limitations, as well as how the present research will deal with them, are presented in Table 2.
Table 2. Advances beyond the state of the art (SoA).
From a mathematical viewpoint, there are also very few approaches related to (i) enterprise resilience enhancement and (ii) the improvement of its constituent capacities: preparedness, adaptive and recovery. Manopiniwes and Irohara [26] developed a stochastic linear mixed-integer programming model for integrated decisions in the preparedness and response stages of pre- and post-disaster operations, taking into account three key areas of emergency logistics: facility and stock prepositioning, evacuation planning and relief vehicle planning. Sanchis and Poler developed a quantitative approach to enhance enterprise resilience by selecting optimal preventive actions using dynamic programming [27].
The use of sourcing strategies to achieve supply chain resilience under disruptions based on the definition of a scenario-based mathematical model including disruption risks and operational risks was developed in [28]. Other studies, such as [29], propose an optimisation model, and its solution determines the rerouting strategy for product flow through the supply chain under disruptions.
Other efforts have been made towards the development of fuzzy mathematical models, such as that defined in [30] for assessment of organisational resilience potential in small to medium-sized enterprises (SMEs) of the process industry. Other studies use fuzzy Delphi techniques such as [2], which defined an integrated Delphi–fuzzy logic framework for measuring SC resilience, and [31] which applied fuzzy Delphi mechanisms and a fuzzy best–worst method to identify and prioritize the relevant disaster resilience indicators for SMEs. A fuzzy linear programming enterprise input–output model was developed in [32] to determine optimal adjustments in production levels of multi-product systems when a crisis is induced by a loss of resource inputs. Another work related to resilience and mathematical modelling is that developed in [33] with the definition of a fuzzy multicriteria decision-making approach (using a fuzzy analytic hierarchical process and the fuzzy Technique for Order Preference by Similarity to Ideal Solution) to evaluate and rank organisational resilience factors with respect to user preference orders.
Tukamuhabwa et al. [34] stated that only limited research has been conducted on choosing and implementing an appropriate set of strategies to improve the capacity of resilience. Moreover, research in enterprise and supply chain resilience covers only specific contexts, such as disaster relief (e.g., [1]) and particular areas such sourcing, routing or production (e.g., [28,29,32], respectively). Based on this, and to the best of our knowledge, there have been only a very few studies addressing the optimisation of the resilient capacity of organisations to face disruptions, and those that are found are specifically focused on specific contexts and particular crises. Shirali et al. [35] also stated that sophisticated safety management systems have contributed to decreasing the number of usual accidents, but these classical approaches may not have been sufficient to prevent the occurrence of extraordinary incidents such as the COVID-19 pandemic that we are currently experiencing. There is no clear answer as to how to overcome such high-impact but low-probability events. However, it seems that some companies cope far better than others when they are resilient [36]. Consequently, there is a need for new approaches to enhance the resilience capacity.
For all these aspects, this paper proposes a mathematical formulation to optimise the implementation of actions that enhance the preparedness capacity to be more resilient. This research is based on the enterprise resilience conceptual reference framework defined by Sanchis et al. [12], shown in Figure 1. The framework is composed of three main sections:
Figure 1. Enterprise resilience conceptual reference framework (based on [12]).
  • Disruption characterisation
    This section, based on the categorisation framework of disruption defined in [37], is in turn composed of the following:
    • Source, divided into (i) the level at which the disruptive event originated and (ii) the origin and suborigin of the disruptive event. More information can be found in [38].
    • Disruptive event per se, considered as a situation that causes a disturbance to a company’s daily operations. The framework contains 71 of the most common disruptive events suffered by companies.
    • Consequences, which are a set of related effects that a specific disruptive event occurrence may cause.
  • Constituent capacity
    In order to deal with the negative effects of disruptions, companies should be as resilient as possible. To accomplish this, the framework is focused on three main capacities of enterprise resilience:
    • Preparedness: the readiness capacity to face disruptions, assessing whether companies have the knowledge, means and resources to be able to anticipate different disruptions [39].
    • Adaptivity: defined as the degree to which the system can modify its circumstances and move towards a condition of stability [40]. Sandanam et al. [41] defined it as the capacity to respond to challenges through learning, managing risk and impacts, developing knowledge, and devising novel solutions. The dynamic nature of adaptive capacity allows companies to be prepared in advance and recover after having been impacted by a disruptive event. Following [42], the dynamism of adaptive capacity is the reason why it is considered in the framework as an intrinsic characteristic of the capacities of preparedness and recovery and not a constituent capacity, per se, of enterprise resilience.
    • Recovery: the ability to respond to and bounce back from a disruptive situation, which is key to bolstering enterprise resilience.
  • Transition elements
    In order to enhance preparedness and recovery capacities, companies need to take different actions. In the first case, the framework proposes preventive actions as proactive mechanisms to face inevitable disruptive events. In the second case, the framework points to knowledge management to guarantee that the necessary knowledge is available to be reused when necessary and facilitate the recovery process.
    • Preventive actions are policies and/or actions that are carried out in an attempt to reduce the probability of the occurrence or severity of a disruptive event or both [20]. They are proactive by nature. In case of inevitable disruptive events, effort should be focused on mitigating the negative consequences.
    • Regarding knowledge registration actions, Dalziell et al. [9] explained that one of the ways in which a system can recover from adverse situations is to apply available responses to deal with disruptive events. To do so, profound knowledge of the available responses to disruptive events that have already occurred is required in order to reuse the knowledge generated in past recovery actions.
In summary, when a disruptive event occurs, a company is pushed from a state of relative equilibrium to another state characterised by instability. The ease with which the enterprise is moved to this new unstable state is a measure of its vulnerability [9], understood as a lack of preparedness capacity to deal with disruptive events, while the ease with which the enterprise responds is a measure of its recovery capacity. In both cases, companies will be more prepared and will recover more efficiently if they adapt more easily to changes. In order to enhance the preparedness and recovery capacities of enterprise resilience, the framework defines as proactive mechanisms the preventive actions to anticipate and be prepared for disruptive events and the knowledge registration actions to ensure that knowledge is available when required for reactive purposes. As mentioned above, this paper is only focused on mitigation policies, as they are the ones that will serve to improve the preparedness perspective of enterprise resilience. Figure 1 shows all the elements of the enterprise resilience conceptual reference framework; only the ones in blue, related to preparedness capacity, are analysed in this study through mathematical programming.

3. Data Modelling Approach

This section defines the data modelling approach to characterize preparedness capacity from the AS IS and TO BE model perspectives. Figure 2 shows a summary of the data-modelling approach, which consists of three main sections: (i) data definition, (ii) nomenclature definition and (iii) transformation of the data into the nomenclature used for application in the mathematical formulation through data processing.
Figure 2. Data-modelling approach.

3.1. Data Definition

The necessary data to quantify the current preparedness capacity status (AS IS) and related to the future ideal situation (TO BE) were gathered through a questionnaire. The study of Munoz and Dunbar [24] utilised disruptions as experimental inputs for their simulation model. Our research also identifies disruptions as the main element to analyse the preparedness capacity of enterprise resilience. A framework for data collection was designed and a questionnaire was developed to facilitate the process of data capture. The current version of the questionnaire contains 71 disruptive events to be analysed.
Tukamuhabwa et al. [34] identified a wide range of strategies for improving resilience, focusing on increasing flexibility, creating redundancy, forming collaborative supply chain relationships and improving supply chain agility. However, such a proposal does not offer concrete actions to be implemented to improve the capacity of resilience. To overcome this, and based on the conceptual framework developed in [12], the present research offers, by defining specific preventive actions per disruptive event, a set of concrete actions to be activated in order to enhance the pre-disruption capacity of enterprise resilience. Tarafdar and Qrunfleh [43] theoretically explained and empirically demonstrated how information systems’ capability for agility also contributes to effecting a positive relationship between agile supply chain strategy and supply chain performance. For this reason, many of the preventive actions defined are related to information systems to build resilient companies. Currently, the framework for data collection offers 403 preventive actions.
The disruptive events included in the framework were identified and selected based on an exhaustive literature review, in which the most worrisome disruptive events were identified. Two types of bibliographical source were used in this identification. Firstly, the scientific literature was reviewed. However, studies focused on identifying the most common risks are scarce [4,20,44,45,46,47,48]. For this reason, alternative information sources were used. This second type of information was obtained from reports published by well-known consulting firms that issue risk-ranking studies annually [49,50,51,52,53,54,55,56,57].
The definitions of the preventive actions were based on two approaches: (i) the conceptual approach, in which for each disruptive event, the most appropriate preventive actions were identified based on the literature review, and (ii) a Delphi study, in which a panel of experts collaborated to assess the set of preventive actions defined in the previous phase. Besides the assessment, the experts also proposed more preventive actions based on their experience and background. This iterative process was repeated in two consecutive rounds until the results obtained were the same and the assessment was finished.

3.1.1. Definition of Input Data Required to Analyse the AS IS State

The necessary input data were divided into two main streams, one related to the AS IS situation and one that covers the TO BE situation. Table 3 offers an overview of the required information of the current status in order to analyse preparedness capacity.
Table 3. Input data required to analyse current (AS IS model) preparedness capacity.

3.1.2. Definition of Input Data Required to Analyse TO BE Situation

Once the current preparedness capacity has been characterised and it is shown how vulnerable an enterprise is, a roadmap should be defined. This roadmap will include a set of optimal preventive actions to be implemented to achieve the ideal future situation in relation to the ability to be prepared in advance to face disruptive events.
The necessary input data to characterise the TO BE situation and define the roadmap are shown in Table 4.
Table 4. Input data required to analyse future (TO BE model) preparedness capacity.

3.2. Nomenclature Definitions

Table 5 shows the nomenclature used to define the MILP model.
Table 5. Nomenclature of mixed-integer linear programming (MILP) model.

3.3. Data Processing

The questionnaire allows users to provide information for only those disruptive events they wish to analyse, which allows enterprises to solely focus on the main worrisome disruptive events. However, as mentioned above, the data provided through the questionnaire by end users need to be processed in order to be used as input data for MILP. Taking into account that companies provide cost information through the questionnaire as a percentage of annual turnover, the expected annual cost of disruptive event i is calculated by (1):
C i = P i H i · P C T i 100 · T .
In the same way, the annual cost of preventive action j is calculated as indicated in (2):
C j = P C T j 100 · T .
The expected annual cost of disruptive event i after implementing preventive action j is shown in (3):
C i j = P i j H i · S i j S i · P C T i 100 · T .
Therefore, if the company implements preventive actions that enhance its preparedness capacity, the cost of the disruptive event is estimated to be lower, which will result in savings according to (4):
A i j = C i C i j .
It is assumed that the probability of occurrence of a disruptive event is equal to or higher than the probability of occurrence of the same event after a preventive action is implemented. In light of this, the same applies to severity, as shown in (5) and (6):
P i P i j ,
S i S i j .
In addition, Rij is a binary parameter that indicates the relationship between disruptive event i and preventive actions j. If the value of Rij is 1, preventive action j has a relationship with disruptive event i, reducing its probability of occurrence and/or severity. If the value of Rij is 0, it means that preventive action j has no influence on disruptive event i, as indicated in (7):
R i j   { 0 , 1 } ,   i = 1 n .

4. Mixed-Integer Linear Programming Model

This section formulates the mathematical programming by defining the MILP model following the nomenclature described in Section 3.2.
The objective function of Model (8) is to minimize the expected annual cost of disruptive events after implementing preventive actions, and the annual cost of preventive actions to be implemented is calculated as:
M i n i m i z e   z =   i = 1 n C D i + j = 1 m C j · E j
Subject to the following:
Constraint (9) ensures that the total cost of preventive actions to be implemented is less than the monetary resources the company is willing to invest to enhance its preparedness capacity, that is, investment in enterprise resilience:
j = 1 m C j · E j   I .
Constraint (10) calculates the expected annual cost of disruptive event i after implementing preventive actions as the difference between the expected annual cost and the annual savings that the disruptive event would generate after one or several preventive actions are activated. This value cannot be less than zero.
C D i   C i   A i                 1 i n
Constraint (11), involving a formula that calculates a measured quantity, indicates the total savings the company would experience in the disruptive event analysed after implementing the preventive actions by Ej = 1.
A i = j = 1 m A i j · R i j · E j ,   1 i n
However, there is an aspect to be considered when a combination of preventive actions that affect the same disruptive event is activated. In this case, improvements in terms of savings are not necessarily the sum of savings provided by all activated preventive actions. This can be illustrated with examples related to the analysis of combined drug effects [69]. The study of dose-effect relationships when multiple drugs are used [70] presents the same casuistry as the analysis of the saving-effect relationship when multiple preventive actions are activated. Following this research stream, we found that Belen’kii et al. [71] defined the antagonistic drug concept (or depotentiation, negative interaction, negative synergy, etc.) as the joint effect of two or more drugs in such a way that the combined effect is less than the sum of the effects produced by each agent separately [72,73]. Based on this pattern, and as suggested in [27], the antagonism related to preparedness capacity is considered as joint savings produced by the activation of two or more preventive actions in such a way that the combined savings is less than the sum of the savings produced by each preventive action separately.
One potential solution to overcome the antagonism effect is to ask enterprises through the questionnaire about the savings generated by different combinations of preventive actions. However, based on their experience, enterprises reported that this solution was not practicable because the estimation process is complex and time-consuming. For this reason, an attenuation formula of savings after activating two or more preventive actions for the same disruptive event was defined. The attenuation formula is based on research by Sanchis and Poler [27] and is expressed in (12):
μ i = α · β k i
where α is a parameter between 0 and 1; β is a parameter between 0 and ki; and k i is the number of preventative actions activated for the same disruptive event i. The values of α and β will depend on the degree to which the end user wishes to attenuate the savings when more than one preventive action is activated.
When the MILP model is computed and the optimal solution is obtained, if two or more preventive actions are activated for the same disruptive event, the attenuation formula is applied, and the model is recalculated successively until there is no further attenuation. The attenuation algorithm iteratively applies MILP to calculate the optimal set of preventive actions j (optimal set of Ej values) based on the previous Aij values. If MILP results in changes to Ej, savings Aij for each disruptive event i is then attenuated by factor μi, which corresponds to the updated Ej value (bar the largest Aij for each event i). MILP is recalculated with the updated Aij values until two equal consecutive solutions are obtained. To validate the MILP model with an exploratory approach, a case study of a company is presented in Section 5.

5. Application to a Foam Company

This application involves an international company that designs, engineers, and provides advanced foam solutions for a wide range of technical applications from insoles for footwear to soundproofing solutions for the building industry. The company operates across Europe, North America and Asia and its headquarters are located in eastern Spain.

5.1. Input Data

The company participating in this case study was interested in analysing four types of disruptive events, those related to supply (S), environment (ET), finances (F) and legislation (L), with a total of 21 disruptive events studied. Moreover, the company chose 83 preventive actions as mitigation actions to improve its preparedness capacity. A summary of the disruptive events related to supply aspects and the preventive actions to be activated is shown in Table 6 [74]. In this case, the enterprise wanted to analyse 7 events and selected 28 preventive actions to prepare in advance to face such events.
Table 6. Summary of disruptive events related to supply aspects and preventive actions (based on [74]).
In the case of environmental and context-related events, the enterprise was also willing to analyse 7 events, for a total of 27 proposed preventive actions, as shown in Table 7.
Table 7. Summary of disruptive events related to environmental and context-related aspects and preventive actions.
With regard to financial issues, the enterprise selected 4 disruptive events as the most worrisome, with 14 preventive actions (Table 8).
Table 8. Summary of disruptive events related to financial aspects and preventive actions.
The last group of disruptive events that the enterprise wanted to analyse is related to legislation issues, with 3 events and 14 preventive actions, as shown in Table 9.
Table 9. Summary of disruptive events related to environmental and context-related aspects and preventive actions.
In Table 6, three preventive actions apply to different disruptive events, e.g., the preventive action “Search for alternative raw materials or components” (S1.1, S5.1 and S6.2) applies to three different events. The same occurs with preventive actions shown in Table 10.
Table 10. Preventive actions that apply to multiple disruptive events.
The Cj of such preventive actions is the same, as they are equal. For this reason, if in the optimal solution one of these preventive actions is activated, the MILP only records Cj once, but the profits of activation, in terms of savings, are applied to all disruptive events to which it is related. From 83 preventive actions selected by the company, only 68 are unique actions.
The data related to the response of the company to the questionnaire is available in Appendix A (Table A1).
In order to compute the company’s responses, the data was processed according to the data of Table 3 and Table 4:
  • Temporal horizon: short (S): 1 year; medium (M): 5 years; long (L): 10 years
  • Probability: very low (VL): 8.1%; low (L): 18%; medium (M): 43.3%; high (H): 64.5%; very high (VH): 80.1% [63]
  • Severity: very low (VL): 2.5%; low (L): 13%; medium (M): 35.5%; high (H): 70.5%; very high (VH): 95.5% [68]
Moreover, if two or more preventive actions are activated for the same disruptive event and attenuation of savings has to be applied, the company defined α as 0.3 and β as 1. It is worth mentioning that the lower α is, the greater the attenuation, and the lower β is, the less the attenuation.

5.2. Implementation and Resolution

The proposed model was developed using Julia for Mathematical Optimisation (JuMP), an algebraic modelling language embedded in Julia, a high-level, high-performance, open-source multi-platform programming language for technical computing. It is dynamically typed, provides multiple dispatch, and is designed for parallelism and distributed computation. It matches the performance of languages such as C and FORTRAN without the hassle of low-level code [75]. In order to select this language, different algebraic modelling languages were analysed, including A Mathematical Programming Language (AMPL), General Algebraic Modeling System (GAMS), Linear, Interactive, and Discrete Optimizer (LINGO) and Mathematical Programming Language (MPL), among others.
JuMP was finally selected, as it is an open-source modelling language that allows users to express a wide range of optimisation problems (linear, mixed-integer, quadratic, conic-quadratic, semidefinite and nonlinear) in a high-level algebraic syntax [76]. Moreover, JuMP takes advantage of advanced features of Julia programming such as user-friendliness, speed, solver independence, access to advanced algorithmic techniques and ease of embedding [75].
The resolution was carried out with Computational Infrastructure for Operations Research (COIN-OR) branch and cut (Cbc) [77], an open-source optimisation solver of mixed-integer programming, programmed in C++.
Finally, it is worth mentioning that the input data and model solution values were processed with MariaDB. The experiment was run on a thin client server with an Intel® Xeon® CPU ES-2620 O @2.00 GHz 2.00 GHz processor and 2.00 GB of RAM. The solving time was less than one minute.

5.3. Evaluation of Results

Based on the values of Ci, disruptive events related to environmental aspects such as accidents and manmade circumstances, among others, are the most critical as they represent more than 77% of the expected annual cost of all disruptive events analysed, followed by supply (more than 9%), financial (more than 7%) and legislative events.
Moreover, it is important to highlight that four disruptive events (ET4, ET5, ET1 and ET3) represent 70% of the total expected annual cost of all disruptive events, which means that preventive measures should be addressed to prepare the company to face such events, as long as such actions are optimal (in monetary terms) to improve the current preparedness capacity. To do so, the company participating in this validation is willing to invest €15,000 annually to enhance its preparedness capacity. Through computation of MILP, in 16 of 21 analysed disruptive events, preventive actions are activated. In addition, in five of the events (S1, S6, ET1, ET5 and ET6), more than one preventive action is activated, and for this reason the attenuation formula is applied in order to attenuate the savings of the joint activation of two preventive actions. In this case, MILP is iterated until two consecutive solutions are equal. In this case, and as shown in Table 11, five iterations are needed. Detailed results are available in Appendix A (Table A2).
Table 11. Input data and results of analysis of preparedness capacity of enterprise resilience (costs are in €).
Table 11 also shows, for each disruptive event and iteration, which preventive actions are activated (Ej = 1) to enhance the preparedness capacity. The CDi column represents the expected annual cost of disruptive events after activating optimal preventive actions. In the first iteration, disruptive events related to supply and context or the environment are those in which more preventive actions are activated. For disruptive events related to financial aspects, only F1 and F4 benefit from the activation of preventive actions. With regard to legislation aspects, in the three analysed events, preventive actions are applied. After the attenuation of savings when more than one preventive action was activated for the same disruptive event, the CDi column of iteration 5 shows the final optimal results. Figure 3 shows these results as the decreased Ci percentage after activating the optimal set of preventive actions.
Figure 3. Ci cost decrease after activating ki preventive actions.
In the case that no preventive actions are activated (e.g., S7, ET2, ET7, F2 and F4), the percentage is null as CDi = Cij. The maximum Ki is related to disruptive event ET4. In this case three preventive actions are activated. In disruptive events S1, S6, ET6, F4, L2 and L3, the optimal solution activates two actions and in S2–S5, ET1, F1 and L1, only one action. The attenuation of savings caused by several preventive actions acting on the same disruptive event reduces their attractiveness; in subsequent iterations they may be replaced by other actions that might act on different events. Therefore, the effect of attenuation is diversification in preventive actions activated, thus mitigating a larger share of disruptive events. Figure 4 shows the AS IS and TO BE model in terms of expected annual cost of disruptive events before (AS IS) and after (TO BE) activating one or several preventive actions. The TO BE model has a smaller area than the AS IS model, which means that the decrease in expected annual cost is worth considering. The smaller the area of the TO BE model, the more prepared the company will be to face unforeseen situations related to supply, environmental, financial and legislative issues. Based on Figure 4, the costliest disruptive events are those related to environmental aspects. However, these are also the events for which the annual savings by implementing preventive actions is the highest of the four types. In this case, annual savings account for almost 75% of expected annual cost, followed by supply events, with an annual savings of 71%. The annual savings for legislation aspects is 58%, and events related to financial aspects have less savings: the preventive actions reduce the expected annual cost by only 39% because there are two events (F2 and F3) with no actions.
Figure 4. AS IS and TO BE models in terms of in terms of expected annual cost (€) for supply (S), environment (ET), financials (F) and legislation (L) aspects.
All in all, Figure 5 shows the results in an aggregated way. The expected annual cost of the TO BE model is reduced by 70%, without considering the cost of implementing the optimal set of preventive actions, and by 67% considering such cost. In light of this, it is important to highlight that the investment to activate the preventive actions of the optimal solution (Cj) represents only 4% of the reduction in expected annual cost (CDiCij), demonstrating that a small investment is required to substantially improve the preparedness capacity.
Figure 5. AS IS and TO BE models in terms of in terms of expected annual cost (€).
Finally, we would like to mention, just out of curiosity, that while performing this study (September 2019), the region where the company is located suffered a cold drop (gota fría in Spanish). This is an archaic meteorological term used popularly in Spain which has commonly come to refer to any high-impact rainfall event occurring in the autumn along the country’s Mediterranean coast [78]. This is related to disruptive event ET4. If the company had implemented preventive actions in advance, the effects of the cold drop would have been less, since it would have been more prepared. More information about strategies for improving flood resilience can be found in [79].

6. Conclusions and Further Research

Based on the conceptual reference framework for enhancing enterprise resilience developed in [12], this paper gathered data from a real company, through an online questionnaire, about which disruptive events kept them up at night and which preventive actions they thought were suitable for implementation to enhance their preparedness capacity. In light of this, the company provided specific data related to the AS IS model, that is, their current situation and at what level they would like to be prepared (TO BE model). All of this information was processed to apply the defined MILP model.
The MILP model minimises the expected annual cost of disruptive events after implementing a set of preventive actions and the annual cost of actions to be implemented. Moreover, it considers that enterprises have limited resources to implement such actions. At this point, it is also important to highlight the ease with which mathematical programming provides the optimal solution with a very modest effort.
The results of the application to the real enterprise show that the reduction in expected annual cost is substantial with an investment that, according to the company, does not represent a great effort. Therefore, and based on the results, it seems that the improvement in resilience capacity by enhancing the preparedness capacity is considerable.
Without practical and easy-to-use mechanisms for enhancing the preparedness capacity of enterprise resilience, enterprises will remain reluctant to invest in potentially resilience-enhancing actions and will thus remain vulnerable to disruptions. For this reason, the mathematical approach defined is not very difficult and does not require highly mathematically skilled personnel. The ease of the proposed MILP allows managers to apply it effortlessly. One of the challenges when defining the MILP was to try to define it as simply as possible, in order to facilitate its adoption not only in large companies, but also small and medium-sized enterprises (SMEs) with limited resources. In this way, SMEs could make decisions based on the results of this model to improve their preparedness capacity in advance to face adverse situations. For example, after the hard months following the first coronavirus outbreak, many companies began to take decisions and actions to be prepared for the possibility of a new outbreak. The comprehensibility of the mathematical formulation proposed in this research could be of utmost utility for enterprises of any size to identify the optimal preparatory actions in anticipation of a second COVID-19 outbreak.
From a scientific point of view, this study gives a reason to define a simple but effective approach, allowing top managers to decide which preventive actions are the optimal ones to implement in order to face up to unexpected disruptive events and to improve the proactive perspective of enterprise resilience capacity. The findings of this research suggest that with a small investment in enterprise resilience, it is possible to considerably enhance the preparedness capacity. This shows that preventive actions can be very efficient (cost-savings ratio), thus validating the appropriateness of the actions defined in the framework developed by [12]. According to the case study results, the cost of implementing the preventive actions contemplated in the MILP solution only represents, in this case, 4% of the reduction in the annual expected cost of disruptions, and the enhancement in the preparedness capacity is around 67%. These enticing results might encourage top managers to use this contribution.
Further research will focus on undertaking a sensitivity analysis considering the effect on the outcome of varying the input data. This might help guide managers in prioritizing mitigation strategies that are more economically attractive.
Moreover, the current mathematical formulation offers highly relevant information about the optimal preventive actions to implement in order to improve preparedness capacity. However, it does not provide information about the optimal sequence of implementation. Further research will be focused on working in optimisation and prioritisation of implementation, considering the enterprise’s resource availability over time.
Another research line will be aimed at optimising the preparedness capacity at the inter-company level, that is, involving the whole supply chain. In this case, the focus of optimisation will evolve from an intra-company to an inter-company perspective, taking into account (i) the specific singularities and difficulties of the inter-company level, and (ii) the relationships among various preventive actions to be implemented by different entities of the supply chain. Moreover, it is planned to study how activating preventive actions by a particular entity of the supply chain influences, in a positive or negative way, other entities of the supply network.

Author Contributions

This work forms part of the research of R.S., supervised by R.P. and A.D.-H. Conceptualisation, R.S.; methodology, A.D.-H.; software, R.S. and R.P.; validation, R.S., A.D.-H. and R.P.; formal analysis, R.S.; investigation, R.S.; resources, A.D.-H. and R.P.; data processing, R.S.; writing—original draft preparation, R.S.; writing—review and editing, R.S., A.D.-H. and R.P.; supervision, R.P.; project administration, R.P. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Spanish State Research Agency (Agencia Estatal de Investigación) under the Reference No. RTI2018-101344-B-I00-AR.

Acknowledgments

The authors would like to acknowledge the predisposition of the company by facilitating all necessary data to be employed in the experimental mathematical application and the support of the researchers participating in the project “Optimización de Tecnologías de Producción Cero-Defectos Habilitadoras para Cadenas de Suministro 4.0” (CADS4.0).

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Data related to the company’s questionnaire responses (temporal horizon: short (S)—1 year; medium (M)—5 years; long (L)—10 years; probability/severity: very high (VH), high (H), medium (M), low (L), and very low (VL).
Table A1. Data related to the company’s questionnaire responses (temporal horizon: short (S)—1 year; medium (M)—5 years; long (L)—10 years; probability/severity: very high (VH), high (H), medium (M), low (L), and very low (VL).
#DTemporal HorizonProbability (AS IS)Severity (AS IS)#AProbability (TO BE)Severity (TO BE)
SMLVLLMHVHVLLMHVHVLLMHVHVLLMHVH
S1X X X S1.1 X X
S1.2 X X
S1.3 X X
S1.4X X
S1.5 X X
S1.6 X X
S2X X XS2.1 X X
S2.2 X X
S2.3 X X
S2.4X X
S3X X XS3.1X X
S3.2 X X
S3.3X X
S4X X X S4.1X X
S4.2 X X
S4.3X X
S4.4X X
S5X X XS5.1 X X
S5.2 X X
S5.3 X X
S5.4 X X
S6 X X X S6.1 X X
S6.2 X X
S6.3 X X
S6.4 X X
S7 X X XS7.1 X X
S7.2 X X
S7.3 X X
ET1X X XET1.1X X
ET1.2 X X
ET1.3 X X
ET1.4X X
ET1.5 X X
ET2 X X X ET2.1 X X
ET2.2 X X
ET2.3 X X
ET3X X X ET3.1 X X
ET3.2 X X
ET3.3 X X
ET4X X X ET4.1 X X
ET4.2 X X
ET4.3 X X
ET4.4 X X
ET4.5 X X
ET5X X X ET5.1 X X
ET5.2 X X
ET5.3 X X
ET5.4 X X
ET6X X X ET6.1X X
ET6.2 X X
ET6.3X X
ET7 X X X ET7.1 X X
ET7.2 X X
ET7.3 X X
ET7.4X X
F1X X X F1.1 X X
F1.2 X X
F1.3 X X
F1.4 X X
F2X X XF2.1 X X
F2.2 X X
F2.3 X X
F3X X X F3.1 X X
F3.2 X X
F3.3 X X
F4X X X F4.1 X X
F4.2 X X
F4.3 X X
F4.4 X X
L1X X X L1.1 X X
L1.2 X X
L1.3 X X
L1.4 X X
L1.5 X X
L2X X X L2.1 X X
L2.2 X X
L2.3 X X
L2.4 X X
L2.6 X X
L3X X X L3.1 X X
L3.2 X X
L3.3 X X
L3.4 X X
Table A2. Detailed results as CDi and Ai of different iterations.
Table A2. Detailed results as CDi and Ai of different iterations.
#DIteration 1Iteration 2Iteration 3Iteration 4Iteration 5
CDiAiCDiAiCDiAiCDiAiCDiAi
1021,989276716,583276716,583276716,583276716,583
2997353997353997353997353997353
345222484522248452224845222484522248
43172312831723128317231283172312831723128
5664415,006664415,006664415,006664415,006664415,006
601055278588278588278588278588
7103201032 103201032010320
8507066,93023,91848,08223,91848,08223,91848,08223,91848,082
91935019350193501935019350
1012,36727,68320,16719,88320,16719,88320,16719,88320,16719,883
111228171,9720187,1860187,1860242,4623860169,340
12768107,482768107,48254,50953,74154,50953,74154,50953,741
1313,50018,975045,375322929,246607526,400322929,246
143031030310303103031030310
152362408864500236240886450023624088
1612,015012,015012,015012,015012,0150
175160051600516005160051600
1815115,974545110,674465611,469545110,674465611,469
191784789117847891178478911784789117847891
2064966404649664049212,8089212,80864966404
21584657645846576458465764013,44958465764

References

  1. Day, J.M. Fostering emergent resilience: The complex adaptive supply network of disaster relief. Int. J. Prod. Res. 2014, 52, 1970–1988. [Google Scholar] [CrossRef]
  2. Kumar, S.; Anbanandam, R. An integrated Delphi—Fuzzy logic approach for measuring supply chain resilience: An illustrative case from manufacturing industry. Meas. Bus. Excell. 2019, 23, 350–375. [Google Scholar] [CrossRef]
  3. Ponomarov, S.Y.; Holcomb, M.C. Understanding the concept of supply chain resilience. Int. J. Logist. Manag. 2009, 20, 124–143. [Google Scholar] [CrossRef]
  4. Madni, A.M.; Jackson, S. Towards a Conceptual Framework for Resilience Engineering. IEEE Syst. J. 2009, 3, 181–191. [Google Scholar] [CrossRef]
  5. Woods, D.D. Essential Characteristics of Resilience. In Resilience Engineering: Concepts and Precepts; Hollnagel, E., Woods, D.D., Leveson, N., Eds.; Ashgate: Hampshire, UK, 2006; pp. 21–34. [Google Scholar]
  6. Gilly, J.; Kechidi, M.; Talbot, D. Resilience of organisations and territories: The role of pivot firms. Eur. Manag. J. 2014, 32, 596–602. [Google Scholar] [CrossRef]
  7. Tomlin, B. On the value of mitigation and contingency strategies for managing supply chain disruption risks. Manag. Sci. 2006, 52, 639–657. [Google Scholar] [CrossRef]
  8. Coutu, D.L. How Resilience works. Harv. Bus. Rev. 2002, 80, 46–56. [Google Scholar]
  9. Dalziell, E.; Mcmanus, S.T. Resilience, Vulnerability, and Adaptive Capacity: Implications for System Performance. Int. Forum Eng. Decis. Mak. 2004, 17. [Google Scholar]
  10. Paries, J. Complexity, Emergence, Resilience. In Resilience Engineering: Concepts and Precepts; Hollnagel, E., Woods, D.D., Leveson, N., Eds.; Ashgate Press: Hampshire, UK, 2006; pp. 43–53. [Google Scholar]
  11. Haimes, Y.Y.; Crowther, K.; Horowitz, B.M. Preparedness: Balancing Protection with Resilience in Emergent Systems. Syst. Eng. 2008, 11, 287–308. [Google Scholar] [CrossRef]
  12. Sanchis, R.; Canetta, L.; Poler, R. A Conceptual Reference Framework for Enterprise Resilience Enhancement. Sustainability 2020, 4, 1464. [Google Scholar] [CrossRef]
  13. Woods, D.; Wreathall, J. Managing Risk Proactively: The Emergence of Resilience Engineering; Ohio University: Columbus, OH, USA, 2003. [Google Scholar]
  14. Mcmanus, S.; Seville, E.; Brunsdon, D.; Vargo, J. Resilience management: A framework for assessing and improving the resilience of organizations. Resilient. Organ. Res. Rep. 2007, 1, 79. [Google Scholar]
  15. Lee, V.; Vargo, J.; Seville, E. Developing a tool to measure and compare organizations’ resilience. Nat. Hazards Rev. 2013, 14, 29–41. [Google Scholar] [CrossRef]
  16. Falasca, M.; Zobel, C.W.; Cook, D. A Decision support framework to assess supply chain resilience. In Proceedings of the 5th International ISCRAM Conference, Washington, DC, USA, 4–7 May 2008; pp. 596–605. [Google Scholar]
  17. Kim, Y.; Chen, Y.S.; Linderman, K. Supply network disruption and resilience: A network structural perspective. J. Oper. Manag. 2015, 33, 43–59. [Google Scholar] [CrossRef]
  18. Stolker, R.; Karydas, D.; Rouvroye, J. A comprehensive approach to assess operational resilience. In Proceedings of the Third Resilience Engineering Symposium 2008, Antibes-Juan-les-Pins, France, 28–30 October 2008; pp. 247–253. [Google Scholar]
  19. Erol, O.; Sauser, B.J.; Mansouri, M. A framework for investigation into extended enterprise resilience. Enterp. Inf. Syst. 2010, 4, 111–136. [Google Scholar] [CrossRef]
  20. Barroso, A.; Machado, V.H.C. Supply Chain Resilience Using the Mapping Approach. Supply Chain Manag. 2011, 161–184. [Google Scholar]
  21. Carvalho, H.; Barroso, A.P.; Machado, V.H.; Azevedo, S.; Cruz-Machado, V. Supply chain redesign for resilience using simulation. Comput. Ind. Eng. 2012, 62, 329–341. [Google Scholar] [CrossRef]
  22. Cabral, I.; Grilo, A.; Cruz-Machado, V. A decision-making model for lean, agile, resilient and green supply chain management. Int. J. Prod. Res. 2012, 50, 4830–4845. [Google Scholar] [CrossRef]
  23. Soni, U.; Jain, V.; Kumar, S. Measuring supply chain resilience using a deterministic modeling approach. Comput. Ind. Eng. 2014, 74, 11–25. [Google Scholar] [CrossRef]
  24. Munoz, A.; Dunbar, M. On the quantification of operational supply chain resilience. Int. J. Prod. Res. 2015, 53, 6736–6751. [Google Scholar] [CrossRef]
  25. Pettit, T.J.; Croxton, K.L.; Fiksel, J. Ensuring supply chain resilience: Development and implementation of an assessment tool. J. Bus. Logist. 2013, 34, 46–76. [Google Scholar] [CrossRef]
  26. Manopiniwes, W.; Irohara, T. Stochastic optimisation model for integrated decisions on relief supply chains: Preparedness for disaster response. Int. J. Prod. Res. 2017, 55, 979–996. [Google Scholar] [CrossRef]
  27. Sanchis, R.; Poler, R. Enterprise Resilience Assessment-A Quantitative Approach. Sustainability 2019, 11, 4327. [Google Scholar] [CrossRef]
  28. Namdar, J.; Li, X.; Sawhney, R.; Pradhan, N. Supply chain resilience for single and multiple sourcing in the presence of disruption risks. Int. J. Prod. Res. 2018, 56, 2339–2360. [Google Scholar] [CrossRef]
  29. Wang, X.; Herty, M.; Zhao, L. Contingent rerouting for enhancing supply chain resilience from supplier behavior perspective. Int. Trans. Oper. Res. 2016, 23, 775–796. [Google Scholar] [CrossRef]
  30. Aleksić, A.; Stefanović, M.; Arsovski, S.; Tadić, D. An assessment of organizational resilience potential in SMEs of the process industry, a fuzzy approach. J. Loss Prev. Process Ind. 2013, 26, 1238–1245. [Google Scholar] [CrossRef]
  31. Fatrias, D.; Hendrawan, D.; Fithri, P.; Rusman, M. An Application of Combined Fuzzy MCDM Techniques in Structuring Disaster Resilience Indicators for Small and Medium Enterprises: A Case Study. In Proceedings of the 2019 IEEE 6th International Conference on Industrial Engineering and Applications, Tokyo, Japan, 12–15 April 2019; pp. 639–643. [Google Scholar]
  32. Tan, R.; Aviso, K.; Cayamanda, C.; Chiu, A. A fuzzy linear programming enterprise input–output model for optimal crisis operations in industrial complexes. Int. J. Prod. Econ. 2016, 181, 410–418. [Google Scholar] [CrossRef]
  33. Tadić, D.; Aleksić, A.; Stefanović, M.; Arsovski, S. Evaluation and ranking of organizational resilience factors by using a two-step fuzzy AHP and fuzzy TOPSIS. Math. Probl. Eng. 2014, 2014. [Google Scholar] [CrossRef]
  34. Tukamuhabwa, B.R.; Stevenson, J.; Busby, J.; Zorzini, M. Supply chain resilience: Definition, review and theoretical foundations for further study. Int. J. Prod. Res. 2015, 53, 5592–5623. [Google Scholar] [CrossRef]
  35. Shirali, G.A.; Shekari, M.; Angali, K.A. Quantitative assessment of resilience safety culture using principal components analysis and numerical taxonomy: A case study in a petrochemical plant. J. Loss Prev. Process Ind. 2016, 43, 277–284. [Google Scholar] [CrossRef]
  36. Tang, C.S. Perspectives in Supply Chain Risk Management. Int. J. Prod. Econ. 2006, 103, 451–488. [Google Scholar] [CrossRef]
  37. Sanchis, R.; Poler, R. Enterprise resilience assessment: A categorisation framework of disruptions. Dir. Organ. 2014, 54, 45–53. [Google Scholar]
  38. Sanchis, R.; Poler, R. Origins of Disruptions Sources Framework to Support the Enterprise Resilience Analysis. IFAC-PapersOnLine 2019, 52, 2062–2067. [Google Scholar] [CrossRef]
  39. Sanchis, R.; Poler, R. Definition of a framework to support strategic decisions to improve Enterprise Resilience. IFAC Proc. Vol. (IFAC-PapersOnline) 2013, 46, 700–705. [Google Scholar] [CrossRef]
  40. Luers, A.L.; Lobell, D.B.; Sklar, L.S.; Addams, C.L.; Matson, A. A method for quantifying vulnerability, applied to the agricultural system of the Yaqui Valley, Mexico. Glob. Environ. Chang. 2003, 13, 255–267. [Google Scholar] [CrossRef]
  41. Sandanam, A.; Diedrich, A.; Gurney, G.G.; Richardson, T.D. Perceptions of cyclone preparedness: Assessing the role of individual adaptive capacity and social capital in the Wet Tropics, Australia. Sustainability 2018, 10, 1165. [Google Scholar] [CrossRef]
  42. Christopher, M. Managing risk in the supply chain. Supply Chain Pract. 2005, 7, 4. [Google Scholar]
  43. Tarafdar, M.; Qrunfleh, S. Agile supply chain strategy and supply chain performance: Complementary roles of supply chain practices and information systems capability for agility. Int. J. Prod. Res. 2017, 55, 925–938. [Google Scholar] [CrossRef]
  44. Svensson, G. A conceptual framework of vulnerability in firms’ inbound and outbound logistics flows Go. Int. J. Phys. Distrib. Logist. Manag. 2002, 32, 110–134. [Google Scholar] [CrossRef]
  45. Peck, H. Creating Resilient Supply Chains: A Practical Guide. Cranfield Univ. 2003, 1–95. [Google Scholar]
  46. Hamel, G.; Valikangas, L. The quest for resilience. Harv. Bus. Rev. 2003, 81, 52–65. [Google Scholar]
  47. Sheffi, Y.; Rice, J.B., Jr. A Supply Chain View of the Resilient Enterprise. MIT Sloan Manag. Rev. 2005, 47, 41–48. [Google Scholar]
  48. Pettit, T.J.; Fiksel, J.; Croxton, K.L. Ensuring Supply Chain Resilience: Development of a Conceptual Framework. J. Bus. Logist. 2010, 31, 1–21. [Google Scholar] [CrossRef]
  49. Binder Dijker Otte. BDO Technology Risk Factor Report. 2017. Available online: https://www.bdo.com/getattachment/d10c417f-beb7-4bb9-8835-2b2ec727ce2b/attachment.aspx?2017-Technology-Riskfactor-ReportBrochure_WEB.pdf (accessed on 30 January 2020).
  50. Economist Group. 2008 Survey. Economist Intelligence Unit. Managing Risk Through Financial Processes: Embedding Governance, Risk, and Compliance; EIU: London, UK, 2008. [Google Scholar]
  51. Deloitte. The Ripple Effect. How Manufacturing and Retail Executives View the Growing Challenge of Supply Chain Risk; Deloitte Development LLC: New York, NY, USA, 2013. [Google Scholar]
  52. World Economic Forum. Insight Report. Global Risks 2014; World Economic Forum: Geneva, Switzerland, 2014. [Google Scholar]
  53. Business Continuity Institute. Supply Chain Resilience Report. 2015. Available online: http://www.bcifiles.com/bci-supply-chain-resilience-2015.pdf (accessed on 20 October 2016).
  54. Ernst & Young. Business Pulse. Exploring dual Perspectives on the Top10 Risks and Opportunities in 2013–2015; EYGM: London, UK, 2015. [Google Scholar]
  55. AON Risk Solutions. Global Risk Management Survey—Executive Summary; Aon plc (NYSE:AON): London, UK, 2017. [Google Scholar]
  56. Business Continuity Institute. BCI Supply Chain Resilience Report 2018; Caversham: Berkshire, UK, 2018. [Google Scholar]
  57. World Economic Forum. The Global Risks Report 2019; World Economic Forum: Geneva, Switzerland, 2019. [Google Scholar]
  58. Lichtenstein, S.; Newman, J.R. Empirical scaling of common verbal phrases associated with numerical probabilities. Psychon. Sci. 1967, 9, 563–564. [Google Scholar] [CrossRef]
  59. Moore, P.G. The Business of Risk; Cambridge University Press: Cambridge, UK, 1983. [Google Scholar]
  60. Boehm, B. Software Risk Management; Springer: Berlin/Heidelberg, Germany, 1989. [Google Scholar]
  61. Hamm, R.M. Selection of Verbal Probabilities: A Solution for Some Problems of Verbal Probability Expression. Organ. Behav. Hum. Decis. Process 1991, 48, 193–223. [Google Scholar] [CrossRef]
  62. Conrow, E.H. Effective Risk Management: Some Keys to Success; Wiley Online Library: Hoboken, NJ, USA, 2003. [Google Scholar]
  63. Hillson, D. Describing Probability: The Limitations of Natural Language; Project Management Institute: Newtown Squarel, PA, USA, 2005. [Google Scholar]
  64. Fine, W.T. Mathematical Evaluations for Controlling Hazards; (No. NOLTR-71-31); Naval Ordnance Lab White OAK: Silver Spring, MD, USA, 1971. [Google Scholar]
  65. Dickson, T.J. Calculating Risks: Fine’s Mathematical Formula 30 Years Later. Aust. J. Outdoor Educ. 2001, 6, 31–39. [Google Scholar] [CrossRef]
  66. Romero, J.C.R.; Rubio Gámez, M. Manual Para la Formación de Nivel Superior en Prevención de Riesgos Laborales; Ediciones Díaz de Santos: Madrid, Spain, 2005. [Google Scholar]
  67. Smith, R.M. How to uncover program cost risks. AACE Int. Trans. 1991, F6-1–F6-6. [Google Scholar]
  68. Patterson, F.; Neailey, K. A risk register database system to aid the management of project risk. Int. J. Proj. Manag. 2002, 205, 365–374. [Google Scholar] [CrossRef]
  69. Chou, T.C.; Talalay, P. Analysis of combined drug effects: A new look at a very old problem. Trends Pharmacol. Sci. 1983, 4, 450–454. [Google Scholar] [CrossRef]
  70. Chou, T.C.; Talalay, P. Quantitative Analysis of Dose-Effect Relationships: The Combined Effects of Multiple Drugs or Enzyme Inhibitors. Adv. Enzym. Regul. 1984, 22, 27–55. [Google Scholar] [CrossRef]
  71. Belen’kii, M.S.; Schinazi, R.F. Multiple drug effect analysis with confidence interval. Antivir. Res. 1994, 25, 1–11. [Google Scholar] [CrossRef]
  72. Berenbaum, M.C. Synergy, additivism and antagonism in immunosuppression. A critical review. Clin. Exp. Immunol. 1977, 28, 1. [Google Scholar]
  73. Pelikan, E.W. Glossary of Terms and Symbols Used in Pharmacology. Pharmacology and Experimental Therapeutics Department at Boston University School of Medicine. 2004. Available online: http://www.bumc.bu.edu/busm-pm/academics/resources/glossary/ (accessed on 20 April 2019).
  74. Sanchis, R.; Poler, R. Mitigation proposal for the enhancement of enterprise resilience against supply disruptions. IFAC-PapersOnLine 2019, 52, 2833–2838. [Google Scholar] [CrossRef]
  75. Dunning, I.; Huchette, J.; Lubin, M. JuMP: A modeling language for mathematical optimization. SIAM Rev. 2017, 59, 295–320. [Google Scholar] [CrossRef]
  76. NumFOCUS. Jump. Available online: https://jumdev/JuMjl/dev (accessed on 3 August 2020).
  77. Forrest, J.; Lougee-Heimer, R. CBC User Guide. Emerg. Theory Methods Appl. 2005, 257–277. [Google Scholar] [CrossRef]
  78. Martín León, F. Agencia Estatal de Meteorología. Las Gotas Frías/DANAs: Ideas y Conceptos Básicos. 2003. Available online: https://www.aemet.es/documentos/es/conocermas/recursos_en_linea/publicaciones_y_estudios/estudios/dana_ext.pdf (accessed on 13 September 2019).
  79. Driessen, P.P.; Hegger, D.L.; Kundzewicz, Z.W.; Van Rijswick, H.F.; Crabbé, A.; Larrue, C.; Matczak, P.; Pettersson, M.; Priest, S.; Suykens, C.; et al. Governance strategies for improving flood resilience in the face of climate change. Water 2018, 10, 1595. [Google Scholar] [CrossRef]

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.