Next Article in Journal
Valorisation of Limestone in Sustainable Cements
Previous Article in Journal
Geological and Petrophysical Properties of Underground Gas Storage Facilities in Ukraine and Their Potential for Hydrogen and CO2 Storage
Previous Article in Special Issue
The Integration of Advanced Mechatronic Systems into Industry 4.0 for Smart Manufacturing
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Study on the Emergence and Resilience of Integrated Management Systems in Organizations with an Industrial Profile in Romania

by
Lucian Ispas
1,
Costel Mironeasa
1,* and
Alessandro Silvestri
2
1
Faculty of Mechanical Engineering, Automotive and Robotics, “Ștefan cel Mare” University of Suceava, 720229 Suceava, Romania
2
Department of Civil and Mechanical Engineering, University of Cassino and Southern Lazio, 03043 Cassino, Italy
*
Author to whom correspondence should be addressed.
Sustainability 2025, 17(6), 2401; https://doi.org/10.3390/su17062401
Submission received: 30 January 2025 / Revised: 3 March 2025 / Accepted: 4 March 2025 / Published: 10 March 2025
(This article belongs to the Special Issue Sustainable, Resilient and Smart Manufacturing Systems)

Abstract

:
This paper aims to highlight the specific elements regarding emergence and resilience in implementing integrated management systems (IMSs) in organizations with an industrial profile in Romania. The purpose of the research was to carry out an extensive study in the industrial field to identify key elements in the implementation of IMSs, considering the identification and analysis of those elements that can generate risks (emerging elements) as well as the identification and analysis of components that can be used to intervene quickly in the event of the manifestation of risks and that may produce unexpected disturbances (resilient management). A quantitative survey distributed to 147 managers of an industrial organization that has a minimum of two integrated management systems was used for data collection. The present study highlights the opinions of the managers from Romanian industrial enterprises regarding the elements that contribute when implementing an integrated management system. For this purpose, the survey focused on the following main topics: the advantages achieved from the integration, the internal and external barriers encountered, the strategies followed for integration, the risks that occurred, some of the internal and external performance indicators (KPIs) that guide the organization, the elements that are not susceptible to integration, the integration model used, the audit typology, the documents that are needed and the main aspects improved after implementing the integrated management system. The information obtained from the study outlined several themes that management should consider in order to obtain a framework for integration guidance.

1. Introduction

An integrated management system (IMS) is a distinct collection of interconnected processes that share a common pool of human, informational, material, infrastructural, and financial resources. This system is designed to accomplish multiple objectives intended to meet the needs of diverse stakeholders [1,2,3,4]. Integration connects all organizational processes into a cohesive system, allowing it to operate as a unified entity [1,5,6,7,8,9,10,11,12].
IMS integration is a concern at both global and national levels, as it impacts numerous organizations worldwide, particularly those operating in dynamic and turbulent contexts. Many of these organizations carry out their activities at national and international levels or collaborate with various international partners.
In addition to challenges, industrial organizations also face turbulent contexts that require additional attention to the emergence of new emerging risks, due to the changes determined by the emergence of Industry 4.0 technologies, and the need for a resilient management approach from the top management to counter these disruptions of the technical–socio-economic environment and to ensure the continuity of the processes and implicitly of the management systems implemented within the organization [13,14].

1.1. Resilience

As defined by Gunderson (2000) [15], and Cumming et al. (2005) [16], the concept of resilience is related to the ability of an element or system to return to a stable state after unforeseen turbulence, as well as to adapt to new risk environments [17,18] or the ability to adapt and strengthen in the face of challenge, trauma or stress [19]. Resilience is described by Ponomarov and Holcomb (2009) [20] as a multi-faceted, multi-dimensional concept with diverse applicability, considering a wide array of issues, from the physical properties of materials to the managerial supply chain in organizations. The term resilience was first used in the field of ecology through the work of Holling (1973, 2001) [21,22], and later through the work of Walker et al. (2002, 2004) [23,24], being then used globally in the academic field [25,26,27,28,29]. Organizational resilience is the capacity of an organization to effectively confront complex and challenging situations while adapting to the necessary changes. Resilience is not a series of processes and an applied methodology is a different approach based on different assumptions and a radically different system model that should consider the fluctuations of the environment in which it operates [30]. Related to resilience, the concept of risk should be taken into account, which, when manifested, can affect business results, and this implies risk-based thinking, knowledge of the company’s internal and external problems, the requirements of stakeholders for the organization’s products, and services, such as the complexity of the processes in the organization [31,32]. Organizational resilience mechanisms are represented by flexibility and redundancy [33], responsiveness, agility, medium and long-term vision of the management chain [27] and collaboration [34].
Burnard and Bhamra (2019) [18] suggest a resilience-to-disruption approach to enable an organization to adapt to new, emerging risk environments. Balugani et al. (2020) [35] consider that sustainability is essential in business and consider it a component of resilience, and studies by Settembre-Blundo et al. (2021) [36] explored the interrelationship between resilience and sustainability.

1.2. Emergence

The term emergence, as written by Lopez-Ruiz et al. (1995) [37], was used by the English philosopher G.H. Lewes more than 100 years ago. Emergence is defined figuratively by Madsen and Servais (1997) [38] as a “birth” of something completely new. In the domain of biology, the term has been defined as the emergence of a new organ or the appearance of new higher-order properties [39,40], and in the industry, it refers to the emergence of new market requirements and product development of intelligence [41].
In the same logic, Moumen and Romero (2017) [42] make an analogy with what happens when a new model of integration of processes and management systems appears to manage all the requirements of the standards subject to integration, and this approach is considered an emerging model. Emergence as stated by Santamaría-Bonfil et al. (2017) [43] has a significant role in the implementation of IMSs, bringing both benefits and challenges in risk management and the prompt identification of emerging risks will yield some benefits to the organization.
To leverage the positive impact of emergence in IMSs, the organization should foster a culture of innovation, embrace a holistic perspective, and encourage communication and collaboration across departments and teams. Xu et al. (2018) [14] conducted a study on innovation and the positive role of emergence. The study was founded on the integration of recently emerging technologies with new disciplines such as cyber–physical systems, the internet of things, cloud computing, industrial integration, enterprise architecture, business process management, industrial information integration, etc.

2. Research Methodology

2.1. Methodology

Research methodology use rules, principles, tools, methods, and techniques for gathering information and know-how that should be followed during the research process to produce emerging and resilient knowledge [44].
The research consisted of the systemic examination and analysis of the specialized literature from a global level on the emergent and resilient factors encountered in the implementation of several management systems and based on the results of the studies, a questionnaire was created to be able to obtain conclusive data from the organizations with an industrial profile from Romania regarding the implementation of IMSs. The research was conducted on organizations operating in the industrial sector that implemented and integrated a minimum of two management systems.
The questionnaire was made with closed [45], mixed [46], and open [45,47] questions to be an attractive questionnaire for the respondents to extract valuable information such as the advantages, disadvantages, barriers, strategies, opportunities, control factors, and risks arising from IMS implementation.
The survey questions were designed with specific objectives and hypotheses, incorporating a list of variables and distinct questions [48]. Additionally, certain technical aspects of the study were considered [49]. The questions in the survey were decided according to the objective of the proposed theme and other studies from other countries of the researchers were taken into account [50,51,52,53,54].
An aspect that was fulfilled in the realization of the questionnaire, supported by [55,56,57,58], was related to the factor of control, i.e., validation of the questionnaire by a group of experts before being tested on a small group of respondents.
All questionnaire validations studied and supported by several researchers were taken into account, such as the face validity of the questionnaire produced by Gobbens and Uchmanowicz (2021) [59], the construct validity of McDowell (2006) [60], the content validity of Taber (2018) [61] and the criteria validity [59,60,61].
To make the collection of qualitative and quantitative information more efficient, with the help of the questionnaire, researchers [62,63,64,65,66] support the use of the mixed method, that is, after the questionnaire was sent, the respondent was contacted for an interview courtesy, activities that increase the chances of receiving a response to the questionnaire sent.
To avoid the problems of non-responses, all the researchers’ studies were thoroughly analyzed [49,51,54,58,62,63,64,65,66] and it was decided that the most effective approach is to first reach out to the respondents to build a rapport, explain the purpose of the study, and outline the time commitment involved. If the respondent (or a subordinate) agrees to participate, they are asked for an email address to receive the survey.
Although several researchers and methods of obtaining information from respondents were consulted, certain limitations (risks) encountered in the present research are not necessarily related to the researcher or the research method used [67,68,69].
The organizations that participated in the study were divided according to size depending on the number of employees, as follows: a number of 30–100 employees was considered a small organization, representing 20.4% of the respondents; a number of 100–500 employees was considered a medium-sized organization, representing 84.57% of the respondents; a number of >500 employees was considered a large organization, representing 22.4% of respondents.

2.2. Data Collection

Researchers Guest et al. (2006) [70], Mason (2010) [71], and Marshall (2013) [72] argue that in a market/country where respondents are relatively homogenous, any sample size greater than 30 respondents requires a thorough justification. Regarding the upper limits of the sample size, Sandelowski (1995) [73] argues that a sample of considerable size does not allow for a deep, case-oriented analysis and this is the rationale of qualitative research.
In the present research, the applications of the questionnaire and the interview are the only methods of gathering information to obtain conclusive results, due to the challenges in gaining access, through other methods, to the information necessary to achieve the proposed goal.
For this research, 837 organizations that implemented a minimum of two integrated management systems (quality—environment and health and safety at work; environment—health, and job security) were considered. These things were verified in the first phase by examining the information found on the organization’s official website, after which the managers responsible for quality were contacted by phone, and in other situations, visits were made to their headquarters. Of the 837 organizations that were contacted, 147 organizations responded to the questionnaire, of which 17 questionnaires were completed at the organizations’ headquarters as a result of a direct interview, and 2 questionnaires were completed as a result of a telephone interview. The use of the telephone interview was reduced due to the complexity of the questionnaire and the required response time of approximately 30–40 min/questionnaire. The data were collected between 23 March 2022 and 25 February 2023.
The response rate was 17.56%, with the low percentage being due to the reluctance of organizations to provide information about IMS implementation and the policies of corporations unwilling to disclose any information at all, as the data are considered confidential.
Comparing the percentage obtained with the research of Lee and Lings (2008) [50], Bell et al. (2022) [53], and De Vaus (2013) [52] where a response rate of 20% was obtained, which was considered a very good rate, and other research by Marshall et al. (2013) [72] having a rate below 10% [50,52,53], it can be considered that the response rate obtained in the present research is good.
After analyzing the recommendations of researchers [50,52,53,70,71,72,73,74,75], it was considered that 147 questionnaires are sufficient for a qualitative and quantitative analysis, which has a level of confidence whose results can be extended to the level of the industrial field. The content of the survey is given in Appendix A.

3. Results

According to the official data of the International Organization for Standardization (ISO), in Romania, the most used standards for the certification of management systems are ISO 9001:2015 [76] with 11,886 certifications, ISO 14001:2015 [77] with 6174 certifications and ISO 45001:2018 [78] with 3481 certifications.
The industrial organizations that participated in the research were classified into three categories according to the number of employees, as shown in Table 1.
The application of the survey elicited answers that were statistically analyzed.

3.1. Indicators of Knowledge of the Standards with Which Romanian Organizations Are Certified

Knowledge indicators of the most important standards highlight the emergence and resilience of organizations to adapt to new global changes, new technologies, and a sustainable future. The implementation of ISO 9001:2015, ISO 14001:2015, and ISO 45001:2018 standards, as well as other combinations, will help the company to develop, thus contributing to the increase in product quality, decrease in environmental pollution and increase in the safety and health of workers.
This question provides important data to identify the most used standards in Romania, and the combination in Figure 1 indicates this and supports Pareto’s 80/20 principle, i.e., the combination of ISO 9001/14001 and ISO 9001/14001/45001 standards, representing 81.5% of the total variants implemented by the studied industrial organizations, which confirms the first research hypothesis. As can be seen from Figure 1, the main integrated standards in Romania are ISO 9001:2015, ISO 14001:2015, and ISO 45001:2018. The question followed the number of ISO standards implemented and integrated. Based on these answers, and the number of ISO standards implemented, the research was focused only on the organizations that fall into the two categories of integrated management systems, ISO 9001 + ISO 14001 and ISO 9001 + ISO 14001 + ISO 45001, respectively. It can be observed that there are integrated with ISO 9001, ISO 14001 and ISO 45001 also, other integrated standards: ISO 22000 [79], ISO/IEC 27001 [80], ISO 13485 [81], ISO 50001 [82], ISO/IEC 20000 [83], ISO 28000 [84], ISO/IEC 17025 [85], ISO 22301 [86], ISO 55001 [87].

3.2. Considerations for IMS Opportunity Indicators

The opportunities generated by updating ISO standards bring some key changes in terms of concepts, terms, and definitions, with the ultimate goal of ensuring stakeholders’ satisfaction. The updating of ISO management standards has led to opportunities and challenges in management theory, both for researchers and top managers who wish to implement IMSs, following the similarities in their requirements. Starting from these considerable updates, it is considered that the organization should have as its essential objective ensuring customer satisfaction, reducing costs, and increasing long-term competitiveness [4,5,88,89,90]. Following the analysis of the answers received from the respondents regarding the indicators of opportunities, we observe the following ranking:
  • Reducing the costs of organizations/common requirements of standards/continuous improvement—representing 32.65% of respondents’ preferences;
  • Increasing customer satisfaction, quality products, product compliance, increasing performance, effectiveness, opportunities for improvement and increasing the company’s image—representing 17.01% of respondents’ preferences;
  • Reducing risks, increasing profit, reducing duplicates, focusing on objectives, improving communication and training staff—representing 16.33% of respondents’ preferences;
  • Decrease in documentation, increase in organizational efficiency and new customers—representing 8.16% of respondents’ preferences;
  • New partnerships with external clients, development of the company/reduction in production costs/increase in the number of clients—being tied at 6.12%, representing the respondents’ preferences.
The top management should make the transition to the circular economy; thus, emerging risks should be treated with resilient management. It should involve employees [91,92], introduce an organizational culture [93], set deadlines for addressing risk, opportunities and threats [94], train employees on the concept of risk management [95,96,97,98] and train employees on the sources of risk [98,99,100,101,102]. This question looked at the opportunities that led to the integration of IMS, with this being a resilient indicator that expresses the stage at which the organization is ready to become resilient.

3.3. The Degree of Knowledge of the Advantages of IMS

The aspect was analyzed through eight elements. The request was to prioritize the advantages of IMS implementation based on their significance. The question provides information to find the most used resilience indicators that organizations have used in their organization and that have given satisfactory results, with the goal of any organization being to make a profit.
As can be seen in Figure 2, the elements considered to determine the firm’s resilience are as follows, in order:
  • Efficiency, which was preferred by over 80% of respondents;
  • Improved operational efficiency, which accounted for over 70% of responses;
  • Cost reduction, which also accounted for more than 70% of the responses;
  • Reduction in duplicates and written documentation, which was preferred by more than 45% of respondents;
  • Simplification of procedures, which was preferred by over 40% of respondents;
  • Reducing the time for audits, which was preferred by just over 10%;
  • External advantages, which were preferred by below 10%;
  • Implementation of management systems in a shorter time, which was preferred by under 5%;
  • Social benefits were preferred by less than 1%.
For a clearer identification of the analyzed factors, the analysis was carried out on principal components, as represented in Figure 3, which included a multidimensional analysis that took into account the size of the organization and the number of implemented standards. To highlight the links between the size of the organization, the following notations were used: A—small organizations (30–100 workers), B—medium organizations (100–500 workers) and C—large organizations (>500 workers). In addition, the number of integrated standard (S2—two standards, S3—three standards, S4—several standards) notations was also used in the following principal component analysis figures.
Through this question, the resilient indicators of the organization regarding the degree of knowledge of the advantages obtained following the implementation of an IMS in the organization were followed.

3.4. Considerations on IMS Internal Barrier Indicators

This aspect was analyzed by establishing the order of importance for the nine indicators that could be the internal barriers encountered when implementing the IMS. The results are shown in Figure 4.
This investigation aimed to identify the indicators that signify internal barriers to IMS implementation and maintenance, which were hypothesized to be determinants of enterprise emergence.

3.5. Elements That Can Be Considered as Representing External Barriers to IMS Implementation

The nine analyzed elements were identified based on insights gathered from the specialized literature. Figure 5 shows the distribution of responses, depending on the percentage obtained.
The first four elements considered the external barriers to total more than 80% of the external issues facing organizations.
A principal component analysis was conducted to clarify the problems faced by the organizations and to establish whether there are differences according to the size of the enterprise. As can be seen in Figure 6, small organizations (A) that have implemented three standards consider the risks of question marks regarding the external view of collaborators on integrated management systems (I1), insufficient benefits following the implementation of integrated management systems (I2), lack of communication with the work team and partners (I8) and different cultures with different personalities that prevent the integration of integrated management systems (I9).
External risks regarding various demands from interested parties (I5), permanent updating of regulations (I6), and the implementation of integrated management systems requiring culture change (I7) are considered by large organizations (C) that have implemented three and four or more standards and by medium-sized organizations (B) who implemented two and three standards.
In analyzing this question, we considered several studies [50,51,52,53,54,103] and observed that the results were similar, with the only variation being the ranking of importance identified by the conducted research.
The results of the study carried out by Salomone (2008) [51] show that the biggest obstacles were the risk of not assigning the correct level of importance to each concept of quality, environment, and safety (48%), staff reluctance, and the risk of confusing the requirements (11%), lack of technical support (16%) and difficulties in organizing an IMS (46%).
Another more recent study by Ikram et al. (2020) [103] shows that the most important external barriers to IMS implementation are lack of promotion from ISO, representing 24%, lack of procedures for implementation, representing 22%, introduction of a culture in the organization, representing 20%, and the lack of culture that prevents the implementation of IMS, representing 18%.
In response to this question, they looked at what the main elements are that constitute the external barriers faced by organizations, with this indicator being an emerging one, which helps organizations to develop and create plans and procedures for the implementation of IMS, helping employees to change the vision of what IMS means (changing the culture), to identify ISO guidelines to ensure successful implementation of IMS.

3.6. Indicator Considerations for IMS Strategies

Figure 7 shows the classification of the most used strategies in organizations. It is evident that while a variety of strategies exist, only two have been intensively used for their application:
  • Courses in the field/continuous training of staff and orientation towards customer satisfaction were used by 31.29% of the organizations;
  • The PDCA method was followed, and used by 29.73% of the responding organizations.
Three more strategies that are not as widely used were found, as shown below:
3.
Establishment of the company’s mission, long-term strategic objectives, resources, and advantages, which was used by 9.52% of the responding organizations;
4.
Studying the standards carefully; integration process planning; integration itself; evaluation; improvement of nonconformities, which were used by 5.41% of the responding organizations;
5.
The brainstorming method, which was used by 4.76% of the responding organizations.
Following the consultation and analysis of the researchers’ studies, the content of the answers was in agreement with the research in the field [9,104,105,106,107,108,109,110,111,112].
Although ISO has not yet developed a standard for IMS implementation, researchers continue to find common elements of integration, benefits, and sustainable strategies, using different integration approaches [113] and the biggest challenges are in motivating and engaging human resources [114]. To address these challenges, the resilient and emergent indicators regarding the strategies most used for the integration of IMS in Romania were followed. As a result, this study focuses on the resilient and emergent indicators related to the most commonly used strategies for IMS integration in Romania.

3.7. Considerations Regarding Risk Indicators When Implementing IMS

Following the integration process, risk assessment should consider all risk factors in all MSs, aiming to identify and assess the risks with the most significant weight and which would have the most important effect [115,116]. The challenges for implementing management systems within any organization represent an opportunity for the organization to become emergent and resilient in a well-structured and comprehensive process system and risk monitoring to be used as an integral part of IMSs [117]. To identify the risks that may arise when implementing IMSs, researchers’ studies were taken into account [6,103,104,115,118,119,120,121]. After processing the data, it was established that the management representative’s lack of experience in IMS implementation represents the main risk, i.e., 42.66%, a risk studied by Selakovic (2016) [121].
The ranking of risks is continued by “more careful integration of a management system compared to the other systems, paying more attention to a certain management system”, representing 34.27% of respondents’ preferences, followed by “underestimation of some requirements from a certain management system management”, representing 18.88%, with these three risks totaling 95.81%.
In Figure 8, a multidimensional analysis was carried out for the main components according to the size of the organization and the number of implemented standards.
Analyzing the two-dimensional map, we noticed that large (C) and small (A) organizations with more than three standards implemented have a different approach to the risks that have manifested compared to the rest of the organizations. These follow the multiplicity of implementation and application requirements in current activities being difficult to manage (I6), the complexity of ISO requirements, the different interpretation of audits (I5), and the more complicated risk management, i.e., the indicators for each of the three components (I7).
The main risks manifested regarding the lack of experience in implementing integrated management systems of the management representative I3 is considered by medium-sized organizations (B) that have implemented four or more standards, with this being the main important indicator. This is followed by large organizations (C) that implemented two standards, where the main indicator is the more careful integration of a management system concerning the other systems (paying more attention to a certain management system (I1)).
In any organization, the risk analysis should be decided by the top management and they should constantly be attentive to changes in the external context and can manage risks sustainably, taking advantage of the opportunity for risk-based thinking [122].
To be resilient, the specific risks of each organization should be identified from the very beginning, in addition to the areas of risk and impact, the events and their causes, and last but not least the potential consequences that the specific risks can generate. At the same time, one must analyze the monitored and measured data, thus managing the effectiveness of the actions taken, and when a risk appears, the organization should update that new specific risk.
Through the question, aspects related to risks that could affect the resilience of the IMS were pursued and resilient indicators were pursued.

3.8. The Study on the Performance Indicators Used

A detailed analysis of the control factors of the performance indicators (KPIs) was carried out by Abisourour et al. (2020) [123] and the degree of integration by Will et al. (2019) [111], which shows that the IMS has three degrees of integration: added integration (objectives and documents); partial integration containing procedures and processes; full integration, which contains, in addition to the two mentioned degrees, the organizational resources, responsibilities and competent authorities to deal with audits and management system. Auditors use KPIs to evaluate the performance of IMS and critical factors associated with the organization’s goals, to track the performance of the IMS, to evaluate the critical factors related to the organization’s goals and the success of the organization and to assess the organization’s ability to fully, partially, or additionally integrate the IMS.
As can be seen in Figure 9, the performance indicators were ranked, based on the answers given by the respondents, as follows:
  • The score obtained from customer audits—representing 51.68% of the responses;
  • The score obtained following the annual audits—representing 24.83% of the responses;
  • The annual profit obtained—representing 18.79% of the responses;
  • The number of complaints received from customers—representing 3.36% of the responses;
  • The semi-annual or annual evaluation (score) received from clients—representing 1.34% of the responses.
A multidimensional analysis for principal components is illustrated in Figure 10 to determine the indicators by which organizations are guided.
The I5 performance indicator is mainly considered by medium and large enterprises and is not an indicator followed by small enterprises that do not consider the I5 indicator on the score obtained from annual audits. Large enterprises offer a broader perspective on indicators, placing greater emphasis on I2 and I3 indicators while focusing less on the assessment of I4 and I1. An important performance indicator for small and medium-sized enterprises is that of the evaluation carried out by customers (I4). It can be seen that the way small businesses value performance indicators differs significantly from large businesses, probably due to a stronger connection between customers and the staff who carried out the assessment and the larger businesses’ orientation towards ensuring profit.
This question examined the internal and external resilient performance indicators (KPIs) used by organizations to guide the establishment of new objectives and planning of strategies for continuous improvement.

3.9. Considerations for Indicators of Elements That Are Not Amenable to Integration

To develop this area of research, we considered the work of the authors of [2,3,12,107,108,124,125] who attempted to address all kinds of issues that would lead to common patterns of integration for the implementation of different types of MSs, and the emerging indicators for IMS integration were considered.
After analyzing the answers, it was observed that 97.28% of the respondents answered that they did not identify elements that cannot be integrated, and only four organizations, i.e., 2.72%, answered that there are some specific elements for which they have not yet succeeded in their integration. The identification of elements susceptible to integration represents an emerging factor that helps in identifying and simultaneously controlling risks.
The challenge in global risk management is to anticipate risks and find constructive solutions to satisfy stakeholders. To respond to such challenges, the implementation of a management system within any organization presents an opportunity for the organization to become emergent and resilient in a well-structured and comprehensive process system, and risk monitoring for quality, environment, safety, and occupational health provides an integral part of continuous improvement [117].

3.10. Considerations Regarding the Indicators of the Integration Model Used for IMS Implementation

An important step in implementing the IMS was the standardization of the structure of the preferential standards used through the elaboration of Annex SL. Annex SL is at the heart of risk-based thinking and underpins the approach to risk [32].
The structure of the new standards reflected by Annex SL facilitates the alignment and integration of the management system, following the PDCA cycle and reducing risks at the organizational level by introducing “risk-based thinking” [126]. Figure 11 shows the resilient indicators regarding the integration model followed for IMS implementation.
To answer this question, researchers’ papers [9,12,107,108,109,110] who have proposed models for IMS implementation were analyzed. This question tracked the resilient indicators regarding the integration model followed for the IMS implementation.

3.11. Considerations Regarding the Indicators and Typology of Conducting IMS Audits

For this study, researchers’ studies were taken into account [1,9,51,54,106,124,127,128]. As can be seen in Figure 12, the audit integration typology was used as follows.
The integration of audits is necessary and timely, bringing many benefits such as reducing duplicates and written documentation [6,127,129,130,131], reducing the time for audits [127] and cost reduction [6,54,107,127,130,131,132,133,134,135,136,137,138,139].
Comparing the results obtained in the study of Bernardo in 2009, we observe an increase in the types of audits carried out and those surveyed answered that only 63% were integrated internal audits and only 22% were external ones. Concerning the performance of audits, the resilient indicators regarding the type of performance of audits used by organizations for the implementation of IMS were followed.

3.12. Information and Documents That an IMS Should Include

To analyze the bureaucracy of the process (Figure 13), researchers’ studies [6,25,140] on the importance of documents that should be integrated to achieve a certain level of integration were taken into account.
A multidimensional analysis of the main components implemented by the organizations was carried out, as shown in Figure 14.
Regarding the important documents that organizations should develop to achieve a certain level of integration, we concluded that medium-sized organizations (B) that have implemented two and three standards and small organizations (A) that have implemented two standards consider integration organization policy I1 and system procedures and work instructions, also considering the integration process I3.
Large organizations (C) that have implemented three and four standards, medium organizations (B) that have implemented four standards, and small organizations (A) that have implemented three standards consider the I3 integrated process and documentation model, instructions for equipment, records, and technical documentation I4.
A different approach is taken by large organizations (C) that have implemented two standards and small organizations (A) that have implemented four or more standards. To analyze this approach, the resilient indicators regarding the typology of conducting audits used by organizations for the implementation of IMS were tracked.

3.13. IMS Implementation Considerations

For sustainable development, the organization should avoid disruptions caused by turbulence originating from their operating environments. Turbulence can threaten both the operation and the survival of the organization in an increasingly emerging and resilient market, also in conjunction with the new changes of Industry 4.0 [13,141].
The specific risks of the quality management system should be considered alongside the technologies and methodologies of Industry 4.0 [141] to streamline risk analysis processes, as there is a lack of integration between quality management and big data to cover specific risk gaps [142].
To achieve the aspects evaluated by the respondents regarding the emerging indicators, the studies of several researchers regarding these aspects were taken into account, including improving efficiency by using resources [6,130,143,144], improving the ability to respond to customer needs [25,54,127,130,131,132,136,145,146,147], higher levels of employee satisfaction; improving motivation [25,54,131,132,136,137], improving the organizational climate [25,54,127,130,131,132,136,145,146,147], improving communication [54,107,127,131,135,137,144,147], improving knowledge sharing [148], improving the systematization of procedures [54,127,131], defining responsibilities [54,107,127,131,135,137,144,147], reducing bureaucracy [51,127], improving the organizational image, a better relationship with stakeholders and improving competitiveness [25,54,127,130,131,132,136,145,146,147].
In recent years, the world economy has undergone important changes, both at the level of macroeconomics and at the level of organizations. These changes according to the claims of Di Noia (2016) [149] include an increase in previously known risks and an increase in the emergence of new risks in particular, due to new technologies, advances in scientific research, and changes in social and public perceptions.
Collaboration between new technologies allows data to be extracted from certain events and operations [150]; thus, there is traceability between processes, products, and organizational systems [151], and can be used to improve IMSs by improving organizational management, compliance, and risk management [152].
The results analyzed and presented in Figure 15 should be thoroughly analyzed by industrial organizations to try to improve all the aspects described and try to fructify the nerve points using methods and methodologies that bring added value to the organization (financial contribution) and the satisfaction of interested parties (quality products that are environmentally friendly and protect the health and safety of workers and end consumers).
A multidimensional principal component analysis was performed, as shown in Figure 16.
By analyzing Figure 16, we notice that after the integration of several management systems, the organizations improved certain aspects. The medium-sized organizations (B) that implemented two and three standards reported that they improved the ability to respond to the needs of customers (I2), improved communication (I6), reduced bureaucracy (I10), improved their organizational image (I11), achieved a better relationship with stakeholders (I12) and reduced difficulties in maintaining certification of management systems (I14), aspects that had a positive influence for large organizations (C) that have implemented four or more standards.
It was observed that medium (B) organizations that have implemented four or more standards consider indicators I9, I1, I4, I3, and I13. Improvements are also considered by medium (B) organizations that have implemented two and three standards, and large organizations (C) that have implemented four standards. A different approach is taken by small organizations (A) that have implemented four or more standards, with knowledge exchange (I7) as the main improvement.
Large (C) and small (A) organizations that implemented two and three standards noted benefits such as improved organizational climate (I5) and improved systematization of procedures (I8), a benefit also considered by organizations (B) with two and three standards and large organizations (C) with four standards.
For IMS implementation considerations, emergent indicators were followed, important indicators for discovering the disruptive risks that organizations faced when implementing IMSs.

4. Discussion

This study enriches the field by explaining how the manager’s opinions contribute to implementing IMSs to determine a resilient organization. A quantitative survey and a complete literature review bolstered the study’s comprehensive nature and, ultimately, its findings.
The updating of the standards has led to opportunities and challenges in management theory, both for researchers and for top managers who want to implement IMSs following the similarities of their requirements. Starting from these considerable updates, it is considered that the organization should have as its essential objective ensuring customer satisfaction, reducing costs, and increasing competitiveness in the long term [4,5,88,89,90] by managing emerging risks and dealing with them with resilient management by top managers. It was observed that the implementation of several standards in the researched organizations was based on risk-based thinking, emergence (sustainability) [153], and resilience [154].
The common objective of any emergent IMS aims to assist the members of the organization in managing the risks associated with the provision of products and services in the context of the requirements of customers and relevant stakeholders [117].
Before starting an integration process, there should first be an information session about what has already been carried out, that is, learning from the experience of those who have already carried out that process. To this end, the emergent organizations should analyze internal barriers [7,54,89,107,124,131,135,155] and external [50,52,53,54,89] encountered when implementing the IMS to be able to create a plan (PDCA) for the implementation. The plan should be carried out according to the strategies that have already been implemented [9,104,105,106,107,108,109,110,111,112] because ISO has not produced a standard for IMS implementation.
The implementation of IMS creates risks, and the integration process should consider all risk factors [6,104,115,116,118,120,121] of all management systems. This is how the biggest risks that bring the biggest damage are evaluated. Risk reduction [4,5,88,89,90] creates new opportunities for top management, thus developing essential objectives to satisfy customers, reduce costs and increase long-term competitiveness, and the implementation of the circular economy in the organization, all of which strengthen the market position and increase the resilience of the organization.
The control factor should be present in any emergent organization [111,123] and it is used to track organizational performance, procedures, and processes and to evaluate critical factors to be able to intervene resiliently in any situation to achieve the proposed objectives. All of these objectives include internal and external indicators [123,156,157], which should be intelligible, useful, standardized, representative, coherent, and sensitive [123].
The identification of elements susceptible to integration represents the emerging element, an element that helps identify risks and, at the same time, control them. The model followed in implementing IMSs [1,12,107,108,124,148] has a key role in aligning top management strategies with risk identification and treatment.
For risk identification and treatment methods to be effective, Chaswa et al. (2020) [158] show that workers’ perception of risk has a significant effect on the methods applied and entrepreneurs should integrate behavior analysis and workers’ risk perception, to identify and treat risks correctly and limit possible events increasing the resilience of the organization.
An important aspect of organizational development is the introduction of a degree of culture [92,95,152,159] involving all employees and top managers to support the continuous improvement of the organizational culture, which will develop the company and strengthen it for new markets [25,127,130,131,132,136,145,146,160,161] and finally achieve the satisfaction of the interested parties [32,121,162,163].
To implement IMsS, organizations have a choice between the internalization factor [148,164] strategies that have advantages and disadvantages that should be evaluated before integration begins.
For the integration of management systems and to achieve a resilient organization, we must analyze the integration indicators achieved [54,106,108,165,166,167,168], the type of audit used [1,9,51,54,106,124,127,128] and the relevant IMS documents [6,25,140]. All this brings benefits to organizations, reducing duplicates and written documentation [6,127,129,130,131], reducing the time for audits [127] and cost reduction [6,54,107,127,130,131,132,133,134,135,136,137,138,139].
Globalization and the new technologies of Industry 4.0 [13,141] create new opportunities for the development of organizations around the world. To be able to remain competitive in today’s booming markets, organizations should adapt to the new trend (sustainability), and introduce risk-based thinking into organizations, thus dealing with emerging risks [153] with resilient management [169].
Organizations should design and implement a lossless process system, that is, a sustainable management system, customized for each organization, thus obtaining ultra-efficient and resilient processes [170]. For this, organizations should integrate as many management systems as possible to achieve a coherent and high-performance system [171], thus facing the emerging risks and enabling the achievement of the organizational purpose and mission.
Organizations that have implemented more than two standards have a different approach to implementing IMSs than those that have implemented only two standards. The multidimensional analysis carried out maps the links between the size of the organization (number of employees) and the number of standards integrated by the organization, thus creating an overview of the important elements that it should integrate. By integrating the key elements, organizations can satisfy stakeholders and therefore meet their requirements. As the number of implemented standards increases and the organization grows, its processes should become more uniform and easier to manage. Consequently, the organization is almost required to integrate its management systems effectively.
This study’s comprehensive approach, theoretical implications, and methodological rigor of the survey and literature review will contribute to obtaining pieces of information based on managers’ experience in the emergent and resilient management of the enterprise. It will be helpful to managers seeking to enhance resilient enterprises. Both the survey and the literature review create a synergy that combines subjective experiences with objective performance data. The survey data offer valuable insights into the professional perceptions of managers from the industry when implementing IMSs. The analysis of the specialized literature accompanying the survey study reinforces the conclusions, which allows for a generalization of the results.

4.1. Empirical and Theoretical Contributions

This work provides insights into the current state of IMS implementation in Romanian industrial organizations. This study showed that the main resilient indicators, used by the managers of industrial organizations, offer key opportunities and benefits, driving the integration of management systems including streamlining operations, improving operational efficiency, reducing costs, reducing duplicates and documentation, and simplifying procedures. In this study, we also sought to discover the main emergent indicators that seem to be focused on cost reduction, improving customer and product quality, reducing risks, increasing profitability, and fostering a culture of continuous improvement and sustainability.
Regarding the indicator that contributes to achieving IMS integration in an emergent industrial organization, exposed to the risks, and that acts as the main reason to increase the resilience, the main internal barriers to IMS implementation are the lack of experience of the top management, more careful integration of one management system compared to others, and underestimation of requirements from certain management systems.
For the main strategies used for IMS implementation, the managers responded that the most common are staff training/orientation towards customer satisfaction, the PDCA method, and this conclusion does not depend on the size of the organization or on the number of standards implemented.
One important process used by the managers to evaluate the integration is the use of audits. The managers are aware that the integration of audits is necessary because it brings information and benefits like reducing duplicates, audit time, and costs. It seems that the top managers of industrial organizations are moving towards more integrated audit approaches.
When the typologies of the industrial organization size were taken into account, it was revealed that small organizations value performance indicators related to customer satisfaction and feedback more than the indicators focused on annual profits or scores from external audits, which are more emphasized by medium and large organizations; medium-sized along with large organizations tend to focus more on the information obtained from annual audits and that the key performance indicators used in large organizations appear to be more focused on financial metrics like annual profits, rather than customer-centric indicators like customer complaints, which are considered more important by small organizations.
The number of standards implemented tends to be a factor that influences the approach to IMSs in industrial organizations. Organizations that implement more standards tend to have a different approach to IMS implementation compared to those with fewer standards. In this context, larger and medium-sized organizations focus more on indicators like customer satisfaction, communication, reducing bureaucracy, and improving organizational image. The industrial organizations that have implemented two and three standards consider external risks related to various demands from interested parties, permanent updating of regulations, and the need for cultural change when implementing IMSs.
In this study, we observed and argued that the conclusions can be extended to worldwide industrial organizations. The literature study, which was carried out to validate our study, confirmed that to implement an emergent and resilient IMS, the manager of the organizations should know the advantages obtained from the implementation [29,54,106,108,114,165,171,172]; internal and external barriers encountered during implementation [7,51,107,135]; the strategies that followed [104,105,106,107,108,109,110,111,112]; the risks that appeared when it was integrated [6,104,115,116,117,118,120,121]; the opportunities that led to the integration [4,5,88,89,90]; the control factors for IMSs [10,111,123,148,156]; KPI performance indicators [123,156,157]; the elements that are not susceptible to integration [2,3,12,107,108,124,125]; integration indicators [1,12,104,107,108,124,133,148]; risk analysis methods [7,51,109,115,116,122,158,169,173,174,175]; the degree of culture in organizations [25,32,92,95,121,127,130,131,132,136,145,146,152,159,161,162,163,176]; integration framework guide [10,106,148,164,177]; the model used for integration [9,32,107,108,109,110,126,155]; indicators of the level of integration achieved [54,106,153,165,166,167]; the typology of conducting audits [1,9,51,54,106,124,127,128,148]; important documents that should include an IMS [6,25,140]; the problems encountered when the implementation was carried out [1,7,9,51,54,107,131,135,137,178,179,180,181,182,183,184,185,186,187].

4.2. Limitations and Future Implications

The survey methodology presents a few limitations but also offers insightful information. Due to the research’s limited scope, the conclusions presented apply only to a few aspects when implementing IMSs to obtain a resilient organization. The results are in line with the trend obtained at the international level but should account for some particularities of the strategies adopted by managers and the external and internal context. Also, perception-based data introduce bias and limitations to generalization. The integrated IMS paradigm should be examined in a global context using other objective performance criteria. The subsequent research should include and ensure more remarkable thoroughness and analyze other aspects. Some of these aspects are presented in Section 4. Future studies will be necessary to develop a more substantive and convincing linkage between the requirements of the standards, sustainability, and resilience in different contexts, keeping in mind the impact of Industry 4.0 and Artificial Intelligence.

5. Conclusions

This research combines theory and practice in implementing IMSs to achieve a resilient enterprise. The survey findings offer empirical data regarding the extent to which managers value key components of IMSs. Statistical analyses include aspects related to the organization’s size in correlation with the number of management standards implemented. To obtain validation of the managers’ opinions, a literature review was conducted and thus improved validation was obtained. Through the information added in Section 4, which expands the studied issue, this paper contributes to the management literature and constitutes an important guide when considering increasing organizational resilience. The survey questions and the gathered opinions facilitated the selection of action strategies tested by managers and yielded positive outcomes.
In industrial organizations, the number of implemented standards and the size of the organization are important discriminant factors that should be taken into account when integrating management systems because the integration shapes a new management model for the organization and the strategy and the indicator adopted by the managers to establish an IMS can determine the organization’s resilience.

Author Contributions

Conceptualization, L.I. and C.M.; methodology, L.I. and C.M.; resources, L.I., C.M. and A.S.; data curation, C.M.; writing—original draft preparation, L.I. and C.M.; writing—review and editing, L.I., C.M. and A.S.; supervision, C.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
IMSIntegrated management system
KPIKey performance indicator

Appendix A

Questioner
1. Which of the following standards does your organization adhere to?
[ ] ISO 9001:2015; [ ] ISO 14001:2015; [ ] ISO 45001:2018; [ ] ISO 27001:2022;
[ ] ISO 50001:2018; [ ] ISO 20000-1:2018; [ ] ISO 22301:2019; [ ] ISO 55001:2014;
[ ] Other (specify) ___________
2. Specify the opportunities that led to the integration of management systems.
_______________________________________________________________
3. Assign numbers, in order of importance, for the advantages obtained from the integration of management systems.
[ ] Reduction in duplicates and written documentation;
[ ] Improved operational efficiency;
[ ] Simplification of procedures;
[ ] Implementation of management systems in a shorter time;
[ ] Reducing time required for audits;
[ ] Cost reduction;
[ ] Efficiency;
[ ] Social benefits;
[ ] External advantages;
[ ] Other (specify) ___________
4. Assign numbers, in order of importance, for the internal barriers encountered when implementing integrated management systems.
[ ] Insufficient financial and human resources;
[ ] Lack of training and information;
[ ] Lack of support from top management;
[ ] Lack of strategic plans for the implementation of integrated management systems;
[ ] Lack of specialists for conducting audits and methodologies for conducting audits;
[ ] Lack of employee motivation for implementation;
[ ] Employees do not accept losing their current positions;
[ ] Employees are not aware of the new changes;
[ ] Lack of perception of what an integrated management system means;
[ ] Other (specify) ___________
5. Assign numbers, in order of importance, for the external barriers encountered in the implementation of integrated management systems.
[ ] Question marks regarding the external vision of collaborators regarding integrated management systems;
[ ] Insufficient benefits from the implementation of integrated management systems;
[ ] Lack of instructions regarding the implementation of integrated management systems;
[ ] Lack of promotion by ISO of integrated management systems;
[ ] Various requests from stakeholders;
[ ] Permanent updating of regulations;
[ ] Implementing integrated management systems requires a change in culture;
[ ] Lack of communication with the work team and partners;
[ ] Different cultures with different personalities that prevent the integration of integrated management systems;
[ ] Other (specify) ___________
6. What were the strategies followed to integrate management systems?
_________________________________________________________
7. Assign numbers, in order of importance, for the risks that occurred when integrating the management systems.
[ ] More careful integration of a management system compared to other systems (paying increased attention to a particular management system);
[ ] Underestimation of some requirements of a particular management system;
[ ] Lack of experience in implementing integrated management systems of the management representative;
[ ] Lack of information about the legislation in force in a certain field, regarding the particularities of integrated management systems.
[ ] Other (specify) ___________
8. What are the internal and external performance indicators (KPIs) that guide the organization?
[ ] The score obtained from annual audits;
[ ] The score obtained from customer audits;
[ ] The number of complaints received from customers;
[ ] The semi-annual or annual evaluation (score) received from customers;
[ ] The annual profit obtained;
[ ] Other (specify) ___________
9. Has the organization identified elements that are not susceptible to integration?
Specify _________________________________
10. Choose the integration model used by the organization to implement the integrated management system.
[ ] PDCA model (Plan, Do, Check, Act);
[ ] Model based on key factors;
[ ] Integration in steps;
[ ] Integration by levels;
[ ] Integration according to the 7 S principle, following 10 steps;
[ ] Integration according to the Kaizen method;
[ ] Other model. Describe the model _____________________________
11. What type of audit does your organization use?
[ ] Integrated; [ ] simultaneous; [ ] overlapping; [ ] sequential.
12. Assign numbers, in order of importance, for the documents that an integrated management system should contain to achieve a certain level of integration.
[ ] Integration of the organization’s policy;
[ ] System procedures and work instructions;
[ ] Integration process;
[ ] Documentation model, including instructions for equipment, records and technical documentation, etc.
13. After the implementation of the integrated management system, which of the following statements best apply?
The Aspect EvaluatedTo a Very Large ExtentVery MuchSomewhatTo a Small ExtentNot at All
Improving efficiency by optimizing the use of resources
Improving the ability to respond to customer needs
Higher level of employee satisfaction
Improving motivation
Improving the organizational climate
Improving communication
Improving knowledge exchange
Improving the systematization of procedures
Defining responsibilities
Reducing bureaucracy
Improving organizational image
Better relationship with stakeholders
Improving competitiveness
Difficulties in maintaining management system certification
Date completed: ______________________
City: _______________________________
Number of employees:
[ ] Between 30 and 100;
[ ] Between 100 and 500;
[ ] More than 500.
Field of activity: ______________________

References

  1. Karapetrovic, S. Musings on integrated management systems. Meas. Bus. Excell. 2003, 7, 4–13. [Google Scholar] [CrossRef]
  2. Williams, J.A. The impact of motivating factors on implementation of ISO 9001:2000 registration process. Manag. Res. News 2004, 27, 74–84. [Google Scholar] [CrossRef]
  3. Bernardo, M.; Casadesus, M.; Karapetrovic, S.; Heras, I. An empirical study on the integration of management system audits. J. Clean. Prod. 2010, 18, 486–495. [Google Scholar] [CrossRef]
  4. Thomé, A.M.T.; Scavarda, L.F.; Scavarda, A.J. Conducting systematic literature review in operations management. Prod. Plan. Control. 2016, 27, 408–420. [Google Scholar] [CrossRef]
  5. Andreasen, L.E.; den Hertog, F.; Coriat, B.; Kaplinsky, R. Europe’s Next Step: Organisational Innovation, Competition and Employment; Psychology Press: East Sussex, UK, 1995; ISBN 071464630X. [Google Scholar]
  6. Jørgensen, T.H.; Remmen, A.; Mellado, M.D. Integrated management systems–three different levels of integration. J. Clean. Prod. 2006, 14, 713–722. [Google Scholar] [CrossRef]
  7. Asif, M.; de Bruijn, E.J.; Fisscher, O.A.M.; Searcy, C.; Steenhuis, H. Process embedded design of integrated management systems. Int. J. Qual. Reliab. Manag. 2009, 26, 261–282. [Google Scholar] [CrossRef]
  8. Cherciu, M.; Popescu, D.; Buzatu, S. Study on the implementation of the integrated management systems in two Romanian companies. Ann. Constantin Brancusi Univ. Targu-Jiu Eng. Ser. 2015, 139–144. [Google Scholar]
  9. Bernardo, M.; Gotzamani, K.; Vouzas, F.; Casadesus, M. A qualitative study on integrated management systems in a non-leading country in certifications. Total Qual. Manag. Bus. Excell. 2018, 29, 453–480. [Google Scholar] [CrossRef]
  10. Cabecinhas, M.; Domingues, P.; Sampaio, P.; Bernardo, M.; Franceschini, F.; Galetto, M.; Gianni, M.; Gotzamani, K.; Mastrogiacomo, L.; Hernandez-Vivanco, A. Integrated management systems diffusion models in South European countries. Int. J. Qual. Reliab. Manag. 2018, 35, 2289–2303. [Google Scholar] [CrossRef]
  11. Kruse, T.; Veltri, A.; Branscum, A. Integrating safety, health and environmental management systems: A conceptual framework for achieving lean enterprise outcomes. J. Saf. Res. 2019, 71, 259–271. [Google Scholar] [CrossRef]
  12. Karapetrovic, S.; Casadesús, M. Implementing environmental with other standardized management systems: Scope, sequence, time and integration. J. Clean. Prod. 2009, 17, 533–540. [Google Scholar] [CrossRef]
  13. Burnard, K.; Bhamra, R. Organisational resilience: Development of a conceptual framework for organisational responses. Int. J. Prod. Res. 2011, 49, 5581–5599. [Google Scholar] [CrossRef]
  14. Xu, L.D.; Xu, E.L.; Li, L. Industry 4.0: State of the art and future trends. Int. J. Prod. Res. 2018, 56, 2941–2962. [Google Scholar] [CrossRef]
  15. Gunderson, L.H. Ecological resilience—In theory and application. Annu. Rev. Ecol. Syst. 2000, 31, 425–439. [Google Scholar] [CrossRef]
  16. Cumming, G.S.; Barnes, G.; Perz, S.; Schmink, M.; Sieving, K.E.; Southworth, J.; Binford, M.; Holt, R.D.; Stickler, C.; Van Holt, T. An exploratory framework for the empirical measurement of resilience. Ecosystems 2005, 8, 975–987. [Google Scholar] [CrossRef]
  17. Starr, R.; Newfrock, J.; Delurey, M. Enterprise resilience: Managing risk in the networked economy. Strategy Bus. 2003, 30, 70–79. [Google Scholar]
  18. Burnard, K.J.; Bhamra, R. Challenges for organisational resilience. Contin. Resil. Rev. 2019, 1, 17–25. [Google Scholar] [CrossRef]
  19. Gallos, J. V Learning from the toxic trenches: The winding road to healthier organizations—And to healthy everyday leaders. J. Manag. Inq. 2008, 17, 354–367. [Google Scholar] [CrossRef]
  20. Ponomarov, S.Y.; Holcomb, M.C. Understanding the concept of supply chain resilience. Int. J. Logist. Manag. 2009, 20, 124–143. [Google Scholar] [CrossRef]
  21. Holling, C.S. Resilience and stability of ecological systems. Annu. Rev. Ecol. Syst. 1973, 4, 1–23. [Google Scholar] [CrossRef]
  22. Holling, C.S. Understanding the complexity of economic, ecological, and social systems. Ecosystems 2001, 4, 390–405. [Google Scholar] [CrossRef]
  23. Walker, B.; Carpenter, S.; Anderies, J.; Abel, N.; Cumming, G.; Janssen, M.; Lebel, L.; Norberg, J.; Peterson, G.D.; Pritchard, R. Resilience management in social-ecological systems: A working hypothesis for a participatory approach. Conserv. Ecol. 2002, 6, 14–35. [Google Scholar] [CrossRef]
  24. Walker, B.; Holling, C.S.; Carpenter, S.R.; Kinzig, A. Resilience, adaptability and transformability in social–ecological systems. Ecol. Soc. 2004, 9, 5. [Google Scholar] [CrossRef]
  25. Hillary, R. Small and Medium-Sized Enterprises and the Environment: Business Imperatives; Routledge: New York, USA, 2020; ISBN 9781874719229. [Google Scholar]
  26. Hamel, G.; Valikangas, L. The quest for resilience. Harv. Bus. Rev. 2003, 81, 52–65. [Google Scholar] [PubMed]
  27. Christopher, M.; Peck, H. Building the resilient supply chain. Int. J. Logist. Manag. 2004, 15, 1–13. [Google Scholar] [CrossRef]
  28. Lengnick-Hall, C.A.; Beck, T.E. Adaptive fit versus robust transformation: How organizations respond to environmental change. J. Manag. 2005, 31, 738–757. [Google Scholar] [CrossRef]
  29. Hollnagel, E.; Woods, D.D.; Leveson, N. Resilience Engineering: Concepts and Precepts; Taylor & Francis Ltd: Oxfordshire, UK, 2006; ISBN 0754649040. [Google Scholar]
  30. Grøtan, T.O.; Størseth, F. Integrated safety management based on organizational resilience. In Advances in Safety, Reliability and Risk Management; CRC Press: Boca Raton, FL, USA, 2012; pp. 1732–1740. [Google Scholar]
  31. Williams, R.; Bertsch, B.; Dale, B.; Van Der Wiele, T.; Van Iwaarden, J.; Smith, M.; Visser, R. Quality and risk management: What are the key issues? TQM Mag. 2006, 18, 67–86. [Google Scholar] [CrossRef]
  32. Ronalter, L.M.; Poltronieri, C.F.; Gerolamo, M.C. ISO management system standards in the light of corporate sustainability: A bibliometric analysis. TQM J. 2023, 35, 256–298. [Google Scholar] [CrossRef]
  33. Rice, J.B.; Caniato, F. Building a secure and resilient supply network. Supply Chain Manag. Rev. 2003, 7, 22–30. [Google Scholar]
  34. Chen, J.; Chen, T.H.Y.; Vertinsky, I.; Yumagulova, L.; Park, C. Public–private partnerships for the development of disaster resilient communities. J. Contingencies Crisis Manag. 2013, 21, 130–143. [Google Scholar] [CrossRef]
  35. Balugani, E.; Butturi, M.A.; Chevers, D.; Parker, D.; Rimini, B. Empirical evaluation of the impact of resilience and sustainability on firms’ performance. Sustainability 2020, 12, 1742. [Google Scholar] [CrossRef]
  36. Settembre-Blundo, D.; González-Sánchez, R.; Medina-Salgado, S.; García-Muiña, F.E. Flexibility and resilience in corporate decision making: A new sustainability-based risk management system in uncertain times. Glob. J. Flex. Syst. Manag. 2021, 22, 107–132. [Google Scholar] [CrossRef]
  37. Lopez-Ruiz, R.; Mancini, H.L.; Calbet, X. A statistical measure of complexity. Phys. Lett. A 1995, 209, 321–326. [Google Scholar] [CrossRef]
  38. Madsen, T.K.; Servais, P. The internationalization of born globals: An evolutionary process? Int. Bus. Rev. 1997, 6, 561–583. [Google Scholar] [CrossRef]
  39. Bar-Yam, Y. Dynamics of Complex Systems; CRC Press: Boca Raton, FL, USA, 2019; ISBN 0429697589. [Google Scholar]
  40. Gutteridge, J.M.C.; Halliwell, B. Free radicals and antioxidants in the year 2000: A historical look to the future. Ann. N. Y. Acad. Sci. 2000, 899, 136–147. [Google Scholar] [CrossRef]
  41. Pereira, A.C.; Romero, F. A review of the meanings and the implications of the Industry 4.0 concept. Procedia Manuf. 2017, 13, 1206–1214. [Google Scholar] [CrossRef]
  42. Moumen, M.; El Aoufir, H. Quality, safety and environment management systems (QSE): Analysis of empirical studies on integrated management systems (IMS). J. Decis. Syst. 2017, 26, 207–228. [Google Scholar] [CrossRef]
  43. Santamaría-Bonfil, G.; Gershenson, C.; Fernández, N. A Package for Measuring emergence, Self-organization, and Complexity Based on Shannon entropy. Front. Robot. AI 2017, 4, 10. [Google Scholar] [CrossRef]
  44. Kazemi, M.; Zafar Allahyari, M. Defining a knowledge management conceptual model by using MADM. J. Knowl. Manag. 2010, 14, 872–890. [Google Scholar] [CrossRef]
  45. Connor Desai, S.; Reimers, S. Comparing the use of open and closed questions for Web-based measures of the continued-influence effect. Behav. Res. Methods 2019, 51, 1426–1440. [Google Scholar] [CrossRef]
  46. Durant, L.E.; Carey, M.P. Self-administered questionnaires versus face-to-face interviews in assessing sexual behavior in young women. Arch. Sex. Behav. 2000, 29, 309–322. [Google Scholar] [CrossRef]
  47. Mellenbergh, G.J. Tests and questionnaires Analysis. In Advising on Research Methods: A Consultant’s Companion; Johannes van Kessel Publishing: Huizen, The Netherlands, 2008; pp. 235–268. [Google Scholar]
  48. Siniscalco, M.T.; Auriat, N. Questionnaire Design: Quantitative Research Methods in Educational Planning; UNESCO International Institute for Educational Planning: Paris, France, 2005; pp. 1–85. [Google Scholar]
  49. Yaddanapudi, S.; Yaddanapudi, L.N. How to design a questionnaire. Indian J. Anaesth. 2019, 63, 335–337. [Google Scholar] [CrossRef]
  50. Lee, N.; Lings, I. Doing Business Research: A Guide to Theory and Practice; Sage Publications Ltd.: New York, NY, USA, 2008; ISBN 978-1-4129-2878-6. [Google Scholar]
  51. Salomone, R. Integrated management systems: Experiences in Italian organizations. J. Clean. Prod. 2008, 16, 1786–1806. [Google Scholar] [CrossRef]
  52. De Vaus, D.; de Vaus, D. Surveys in Social Research; Routledge: London, UK, 2013; ISBN 0203519191. [Google Scholar]
  53. Bell, E.; Bryman, A.; Harley, B. Business Research Methods; Oxford University Press: Oxford, UK, 2022; ISBN 0198869444. [Google Scholar]
  54. Simon, A.; Karapetrovic, S.; Casadesus, M. Evolution of integrated management systems in Spanish firms. J. Clean. Prod. 2012, 23, 8–19. [Google Scholar] [CrossRef]
  55. Rattray, J.; Jones, M.C. Essential elements of questionnaire design and development. J. Clin. Nurs. 2007, 16, 234–243. [Google Scholar] [CrossRef]
  56. Sinha, R.; Van Den Heuvel, W.J.; Arokiasamy, P. Validity and reliability of MOS short form health survey (SF-36) for use in India. Indian J. Community Med. 2013, 38, 22–26. [Google Scholar] [CrossRef] [PubMed]
  57. Tsang, S.; Royse, C.F.; Terkawi, A.S. Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi J. Anesth. 2017, 11, S80–S89. [Google Scholar] [CrossRef]
  58. Dongare, P.A.; Bhaskar, S.B.; Harsoor, S.S.; Kalaivani, M.; Garg, R.; Sudheesh, K.; Goneppanavar, U. Development and validation of a questionnaire for a survey on perioperative fasting practices in India. Indian J. Anaesth. 2019, 63, 394–399. [Google Scholar] [CrossRef]
  59. Gobbens, R.J.; Uchmanowicz, I. Assessing frailty with the Tilburg Frailty Indicator (TFI): A review of reliability and validity. Clin. Interv. Aging 2021, 16, 863–875. [Google Scholar] [CrossRef]
  60. McDowell, I. Measuring Health: A Guide to Rating Scales and Questionnaires; Oxford University Press: Oxford, UK, 2006; ISBN 0195165675. [Google Scholar]
  61. Taber, K.S. The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res. Sci. Educ. 2018, 48, 1273–1296. [Google Scholar] [CrossRef]
  62. Dillman, D.A.; Phelps, G.; Tortora, R.; Swift, K.; Kohrell, J.; Berck, J.; Messer, B.L. Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet. Soc. Sci. Res. 2009, 38, 1–18. [Google Scholar]
  63. Cornicelli, L.; Grund, M.D. Assessing deer hunter attitudes toward regulatory change using self-selected respondents. Hum. Dimens. Wildl. 2011, 16, 174–182. [Google Scholar]
  64. Lesser, V.M.; Yang, D.K.; Newton, L.D. Assessing hunters’ opinions based on a mail and a mixed-mode survey. Hum. Dimens. Wildl. 2011, 16, 164–173. [Google Scholar]
  65. Sexton, N.R.; Miller, H.M.; Dietsch, A.M. Appropriate uses and considerations for online surveying in human dimensions research. Hum. Dimens. Wildl. 2011, 16, 154–163. [Google Scholar]
  66. Graefe, A.; Mowen, A.; Covelli, E.; Trauntvein, N. Recreation participation and conservation attitudes: Differences between mail and online respondents in a mixed-mode survey. Hum. Dimens. Wildl. 2011, 16, 183–199. [Google Scholar]
  67. Bowen, P.W.; Rose, R.; Pilkington, A. Mixed methods-theory and practice. Sequential, explanatory approach. Int. J. Quant. Qual. Res. Methods 2017, 5, 10. [Google Scholar]
  68. Tu, M. An exploratory study of Internet of Things (IoT) adoption intention in logistics and supply chain management: A mixed research approach. Int. J. Logist. Manag. 2018, 29, 131–151. [Google Scholar]
  69. Theofanidis, D.; Fountouki, A. Limitations and delimitations in the research process. Perioper. Nurs.-Q. Sci. Online Off. J. GORNA 2018, 7, 155–163. [Google Scholar]
  70. Guest, G.; Bunce, A.; Johnson, L. How many interviews are enough? An experiment with data saturation and variability. Field Methods 2006, 18, 59–82. [Google Scholar]
  71. Mason, M. Sample Size and Saturation in PhD Studies Using Qualitative Interviews. Forum Qual. Sozialforschung Forum Qual. Soc. Res. 2010, 11, 8. [Google Scholar] [CrossRef]
  72. Marshall, B.; Cardon, P.; Poddar, A.; Fontenot, R. Does sample size matter in qualitative research?: A review of qualitative interviews in IS research. J. Comput. Inf. Syst. 2013, 54, 11–22. [Google Scholar] [CrossRef]
  73. Sandelowski, M. Sample size in qualitative research. Res. Nurs. Health 1995, 18, 179–183. [Google Scholar] [CrossRef] [PubMed]
  74. Boddy, C. A rose by any other name may smell as sweet but “group discussion” is not another name for a “focus group” nor should it be. Qual. Mark. Res. Int. J. 2005, 8, 248–255. [Google Scholar] [CrossRef]
  75. Boddy, C.R. Groups in focus: The distinctive difference between focus group discussions and focus group interviews. Australas. J. Mark. Soc. Res. 2005, 13, 29–38. [Google Scholar]
  76. ISO 9001:2015; Quality Management Systems—Requirements. International Organization for Standardization: Geneva, Switzerland, 2015.
  77. ISO 14001:2015; Environmental Management Systems—Requirements with Guidance for Use. International Organization for Standardization: Geneva, Switzerland, 2015.
  78. ISO 45001:2018; Occupational Health and Safety Management Systems—Requirements with Guidance for Use. International Organization for Standardization: Geneva, Switzerland, 2018.
  79. ISO 22000:2018; Food Safety Management Systems. Requirements for Any Organization in the Food Chain. International Organization for Standardization: Geneva, Switzerland, 2018.
  80. ISO/IEC 27001:2022; Information Security, Cybersecurity and Privacy Protection. Information Security Management Systems. Requirements. International Organization for Standardization: Geneva, Switzerland, 2022.
  81. ISO 13485:2016; Medical Devices. Quality Management Systems. Requirements for Regulatory Purposes. International Organization for Standardization: Geneva, Switzerland, 2016.
  82. ISO 50001:2018; Energy Management Systems. Requirements with Guidance for Use. International Organization for Standardization: Geneva, Switzerland, 2018.
  83. ISO/IEC 20000-1:2018; Information Technology. Service Management—Part 1: Service Management System Requirements. International Organization for Standardization: Geneva, Switzerland, 2018.
  84. ISO 28000:2022; Security and Resilience. Security Management Systems. Requirements. International Organization for Standardization: Geneva, Switzerland, 2022.
  85. ISO/IEC 17025:2017; General Requirements for the Competence of Testing and Calibration Laboratories. International Organization for Standardization: Geneva, Switzerland, 2017.
  86. ISO 22301:2019; Security and Resilience. Business Continuity Management Systems. Requirements. International Organization for Standardization: Geneva, Switzerland, 2019.
  87. ISO 55001:2014; Asset Management. Asset Management System. Requirements. International Organization for Standardization: Geneva, Switzerland, 2014.
  88. Dosi, G. Innovation, Organization and Economic Dynamics: Selected Essays; Edward Elgar Publishing: Cheltenham, UK, 2000; ISBN 1782541853. [Google Scholar]
  89. Barbosa, L.C.F.M.; de Oliveira, O.J.; Machado, M.C.; Morais, A.C.T.; Bozola, P.M.; Santos, M.G.F. Lessons learned from quality management system ISO 9001:2015 certification: Practices and barrier identification from Brazilian industrial companies. Benchmarking Int. J. 2022, 29, 2593–2614. [Google Scholar] [CrossRef]
  90. Bornay-Barrachina, M.; Rodríguez, M.G.; Amores, M.C.F. Modelos de implantación de los sistemas integrados de gestión de la calidad, el medio ambiente y la seguridad. Investig. Eur. Dir. Econ. Empresa 2002, 8, 97–118. [Google Scholar]
  91. Rane, S.B.; Kirkire, M.S. Analysis of barriers to medical device development in India: An interpretive structural modelling approach. Int. J. Syst. Assur. Eng. Manag. 2016, 7, 356–369. [Google Scholar] [CrossRef]
  92. de Sousa Mendes, G.H.; Salgado, E.G.; Ferrari, B.E.M. Prioritization of TQM practices in Brazilian medical device SMEs using Analytical Hierarchy Process (AHP). DYNA Rev. Fac. Minas. Univ. Nac. Colomb. Sede Medellín 2016, 83, 194–202. [Google Scholar]
  93. Rebelo, M.F.; Silva, R.; Santos, G.; Mendes, P. Model based integration of management systems (MSs)–Case study. TQM J. 2016, 6, 907–932. [Google Scholar] [CrossRef]
  94. Caines, P.; Baird, P.; Whanger, K. Eight Common Myths and Misunderstandings About Risk Management. Biomed. Instrum. Technol. 2015, 49, 13–17. [Google Scholar] [CrossRef]
  95. VG, G. Risk Based Approach in Medical Device Quality Management System in COVID-19 Pandemic. Asian J. Res. Bus. Manag. 2021, 3, 112–118. [Google Scholar]
  96. Rivas, T.R.-P.; Martínez, E.M.; Sigler, A.F.; Rubio, J.A.R.; Fuentes, L.C.; Méndez, J.F.; García, T.G.; Portieles, I.J.L.E. Risk Management of Medical Devices in the ICID. In Proceedings of the VI Latin American Congress on Biomedical Engineering CLAIB 2014, Paraná, Argentina, 29–31 October 2014; Springer: Berlin/Heidelberg, Germany, 2015; pp. 718–721. [Google Scholar]
  97. Wang, T.; Moczygemba, J. Risk Management in EHR implementation. J. Am. Health Inf. Manag. Assoc. 2015, 22, 9–12. [Google Scholar]
  98. Kirkire, M.S.; Rane, S.B.; Singh, S.P. Integrated SEM-FTOPSIS framework for modeling and prioritization of risk sources in medical device development process. Benchmarking Int. J. 2018, 25, 178–200. [Google Scholar] [CrossRef]
  99. Michael, S.; Mapunde, T.M.; Elgar, N.; Brown, J. A quality improvement study for medical devices usage in an acute healthcare setting. J. Med. Eng. Technol. 2018, 42, 344–351. [Google Scholar] [CrossRef] [PubMed]
  100. Guerra-Bretaña, R.M.; Flórez-Rendón, A.L. Impact of regulations on innovation in the field of medical devices. Res. Biomed. Eng. 2018, 34, 356–367. [Google Scholar] [CrossRef]
  101. Hale, D.; Fallon, E.F.; FitzGerald, C. An equipment qualification framework for healthcare. IISE Trans. Healthc. Syst. Eng. 2020, 10, 47–59. [Google Scholar] [CrossRef]
  102. Águas, B.; Sobral, J. Development of a risk management tool for healthcare providers. In Proceedings of the 2019 IEEE 6th Portuguese Meeting on Bioengineering (ENBENG), Lisbon, Portugal, 22–23 February 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 1–4. [Google Scholar]
  103. Ikram, M.; Sroufe, R.; Zhang, Q. Prioritizing and overcoming barriers to integrated management system (IMS) implementation using AHP and G-TOPSIS. J. Clean. Prod. 2020, 254, 120121. [Google Scholar] [CrossRef]
  104. Labodová, A. Implementing integrated management systems using a risk analysis based approach. J. Clean. Prod. 2004, 12, 571–580. [Google Scholar] [CrossRef]
  105. Bernardo, M. Integration of management systems as an innovation: A proposal for a new model. J. Clean. Prod. 2014, 82, 132–142. [Google Scholar] [CrossRef]
  106. Bernardo, M.; Simon, A.; Tarí, J.J.; Molina-Azorín, J.F. Benefits of management systems integration: A literature review. J. Clean. Prod. 2015, 94, 260–267. [Google Scholar] [CrossRef]
  107. Zeng, S.X.; Shi, J.J.; Lou, G.X. A synergetic model for implementing an integrated management system: An empirical study in China. J. Clean. Prod. 2007, 15, 1760–1767. [Google Scholar] [CrossRef]
  108. De Oliveira, O.J. Guidelines for the integration of certifiable management systems in industrial companies. J. Clean. Prod. 2013, 57, 124–133. [Google Scholar] [CrossRef]
  109. Rebelo, M.F.; Santos, G.; Silva, R. Integration of management systems: Towards a sustained success and development of organizations. J. Clean. Prod. 2016, 127, 96–111. [Google Scholar] [CrossRef]
  110. Nunhes, T.V.; Motta, L.C.F.; de Oliveira, O.J. Evolution of integrated management systems research on the Journal of Cleaner Production: Identification of contributions and gaps in the literature. J. Clean. Prod. 2016, 139, 1234–1244. [Google Scholar] [CrossRef]
  111. Will, M.; Brauweiler, J.; Zenker-Hoffmann, A.; Delakowitz, B. An inquiry to consider CSR in integrated management systems. In Social Responsibility and Sustainability; Springer: Berlin/Heidelberg, Germany, 2019; pp. 335–356. [Google Scholar]
  112. Chruzik, K. Integration model of management systems in Sea Transport. TransNav Int. J. Mar. Navig. Saf. Sea Transp. 2020, 14, 393–396. [Google Scholar] [CrossRef]
  113. Silvestri, A.; Falcone, D.; Di Bona, G.; Forcina, A.; Gemmiti, M. Global performance index for integrated management system: GPI-IMS. Int. J. Environ. Res. Public Health 2021, 18, 7156. [Google Scholar] [CrossRef]
  114. de Nadae, J.; Carvalho, M.M.; Vieira, D.R. Integrated management systems as a driver of sustainability performance: Exploring evidence from multiple-case studies. Int. J. Qual. Reliab. Manag. 2020, 38, 800–821. [Google Scholar] [CrossRef]
  115. Kymal, C.; Gruska, G.; Reid, R.D. Integrated Management Systems: QMS, EMS, OHSMS, FSMS Including Aerospace, Service, Semiconductor/Electronics, Automotive, and Food; Quality Press: Milwaukee, WI, USA, 2015; ISBN 087389894X. [Google Scholar]
  116. Bugdol, M. Integrated Management Systems; Springer: Berlin/Heidelberg, Germany, 2015; ISBN 3319100289. [Google Scholar]
  117. Domingues, J.P.T.; Sampaio, P.; Arezes, P.M. Analysis of integrated management systems from various perspectives. Total Qual. Manag. Bus. Excell. 2015, 26, 1311–1334. [Google Scholar] [CrossRef]
  118. Wilkinson, G.; Dale, B.G. Integrated management systems: A model based on a total quality approach. Manag. Serv. Qual. Int. J. 2001, 11, 318–330. [Google Scholar] [CrossRef]
  119. Jørgensen, T.H. Towards more sustainable management systems: Through life cycle management and integration. J. Clean. Prod. 2008, 16, 1071–1080. [Google Scholar] [CrossRef]
  120. O’Neil, D.A.; Petty, M.D. Organizational simulation for model based systems engineering. Procedia Comput. Sci. 2013, 16, 323–332. [Google Scholar] [CrossRef]
  121. Selakovic, K. Integration and Auditing of Management Systems and Implementation of Customer Satisfaction Standards in Serbia. Master’s Thesis, University of Alberta, Edmonton, AB, Canada, 2016. [Google Scholar]
  122. Silva, C.; Magano, J.; Moskalenko, A.; Nogueira, T.; Dinis, M.A.P.; Pedrosa e Sousa, H.F. Sustainable management systems standards (SMSS): Structures, roles, and practices in corporate sustainability. Sustainability 2020, 12, 5892. [Google Scholar] [CrossRef]
  123. Abisourour, J.; Hachkar, M.; Mounir, B.; Farchi, A. Methodology for integrated management system improvement: Combining costs deployment and value stream mapping. Int. J. Prod. Res. 2020, 58, 3667–3685. [Google Scholar] [CrossRef]
  124. Karapetrovic, S.; Willborn, W. Generic audit of management systems: Fundamentals. Manag. Audit. J. 2000, 15, 279–294. [Google Scholar] [CrossRef]
  125. Savino, M.M.; Batbaatar, E. Investigating the resources for Integrated Management Systems within resource-based and contingency perspective in manufacturing firms. J. Clean. Prod. 2015, 104, 392–402. [Google Scholar] [CrossRef]
  126. Campailla, C.; Martini, A.; Minini, F.; Sartor, M. ISO 45001. In Quality Management: Tools, Methods, and Standards; Emerald Publishing Limited: Bradford, UK, 2019; ISBN 1787698041. [Google Scholar]
  127. Douglas, A.; Glen, D. Integrated management systems in small and medium enterprises. Total Qual. Manag. 2000, 11, 686–690. [Google Scholar] [CrossRef]
  128. Alfredo, E.I.; Nurcahyo, R. The impact of ISO 9001, ISO 14001, and OHSAS 18001 certification on manufacturing industry operational performance. In Proceedings of the International Conference on Industrial Engineering and Operations Management, Bandung, Indonesia, 6–8 March 2018; pp. 6–8. [Google Scholar]
  129. Griffith, A. Integrated management systems: A single management system solution for project control? Eng. Constr. Archit. Manag. 2000, 7, 232–240. [Google Scholar] [CrossRef]
  130. McDonald, M.; Mors, T.A.; Phillips, A. Management system integration: Can it be done? Qual. Prog. 2003, 36, 67. [Google Scholar]
  131. Zutshi, A.; Sohal, A.S. Integrated management system: The experiences of three Australian organisations. J. Manuf. Technol. Manag. 2005, 16, 211–232. [Google Scholar] [CrossRef]
  132. Wright, T. IMS—Three into one will go!: The advantages of a single integrated quality, health and safety, and environmental management system. Qual. Assur. J. Qual. Assur. J. Pharm. Health Environ. Prof. 2000, 4, 137–142. [Google Scholar]
  133. De Oliveira Matias, J.C.; Coelho, D.A. The integration of the standards systems of quality management, environmental management and occupational health and safety management. Int. J. Prod. Res. 2002, 40, 3857–3866. [Google Scholar] [CrossRef]
  134. Pheng, L.S.; Kwang, G.K. ISO 9001, ISO 14001 and OHSAS 18001 management systems: Integration, costs and benefits for construction companies. Archit. Sci. Rev. 2005, 48, 145–151. [Google Scholar] [CrossRef]
  135. Zeng, S.X.; Tam, V.W.Y.; Le, K.N. Towards effectiveness of integrated management systems for enterprises. Eng. Econ. 2010, 21, 171–179. [Google Scholar]
  136. Shillito, D.E. ‘Grand unification theory’ or Should safety, health, environment and quality be managed together or separately? Process Saf. Environ. Prot. 1995, 73, 194–202. [Google Scholar]
  137. Winder, C. Integrating OHS, environmental, and quality management standards. Qual. Assur. 2000, 8, 105–135. [Google Scholar] [CrossRef]
  138. Bamber, C.J.; Hides, M.T.; Sharp, J.M. Integrated management systems: An agile manufacturing enabler. In Proceedings of the 1st International Conference on Systems Thinking in Management, Geelong, Australia, 8–10 November 2000; pp. 83–88. [Google Scholar]
  139. Renzi, M.F.; Cappelli, L. Integration between ISO 9000 and ISO 14000: Opportunities and limits. Total Qual. Manag. 2000, 11, 849–856. [Google Scholar] [CrossRef]
  140. Palmer, J.; France, C. Informing Smaller Organizations about Environmental Management: An Assessment of Government Schemes. J. Environ. Plan. Manag. 1998, 41, 355–374. [Google Scholar] [CrossRef]
  141. Aichouni, A.B.E.; Silva, C.; Ferreira, L.M.D.F. A systematic literature review of the integration of total quality management and industry 4.0: Enhancing sustainability performance through dynamic capabilities. Sustainability 2024, 16, 9108. [Google Scholar] [CrossRef]
  142. Sordan, J.E.; Oprime, P.C.; Pimenta, M.L.; da Silva, S.L.; González, M.O.A. Contact points between Lean Six Sigma and Industry 4.0: A systematic review and conceptual framework. Int. J. Qual. Reliab. Manag. 2022, 39, 2155–2183. [Google Scholar] [CrossRef]
  143. Holdsworth, R. Practical applications approach to design, development and implementation of an integrated management system. J. Hazard. Mater. 2003, 104, 193–205. [Google Scholar] [CrossRef]
  144. Fresner, J.; Engelhardt, G. Experiences with integrated management systems for two small companies in Austria. J. Clean. Prod. 2004, 12, 623–631. [Google Scholar]
  145. Hillary, R. Great Britain Department of Trade and Industry Environment Directorate. In Evaluation of Study Reports on the Barriers, Opportunities and Drivers for Small and Medium Sized Enterprises in the Adoption of Environmental Management Systems; Network for Environmental Management and Auditing: London, UK, 1999. [Google Scholar]
  146. Simon, A.; Bernardo, M.; Karapetrovic, S.; Casadesús, M. Integration of standardized environmental and quality management systems audits. J. Clean. Prod. 2011, 19, 2057–2065. [Google Scholar] [CrossRef]
  147. Hilton, S.K.; Madilo, W.; Awaah, F.; Arkorful, H. Dimensions of transformational leadership and organizational performance: The mediating effect of job satisfaction. Manag. Res. Rev. 2021, 46, 1–19. [Google Scholar]
  148. Gianni, M.; Gotzamani, K. Extrovert integrated management systems. TQM J. 2024, 36, 1880–1899. [Google Scholar]
  149. Di Noia, A.E.; Nicoletti, G.M. ISO 14001 certification: Benefits, costs and expectations for organization. Stud. Oecon. Posnaniensia 2016, 4, 94–109. [Google Scholar] [CrossRef]
  150. Zairi, M. Total Quality Management: Contributions to Theory and Application; European Centre for Best Practice Management: Bradford, UK, 2020; ISBN 1674379064. [Google Scholar]
  151. Zairi, M. Total Quality Management for Engineers; Elsevier: Amsterdam, The Netherlands, 1991; ISBN 1845698916. [Google Scholar]
  152. Fettermann, D.C.; Cavalcante, C.G.S.; Almeida, T.D.D.; Tortorella, G.L. How does Industry 4.0 contribute to operations management? J. Ind. Prod. Eng. 2018, 35, 255–268. [Google Scholar]
  153. Nunhes, T.V.; Bernardo, M.; Oliveira, O.J. Guiding principles of integrated management systems: Towards unifying a starting point for researchers and practitioners. J. Clean. Prod. 2019, 210, 977–993. [Google Scholar]
  154. Aven, T. What is safety science? Saf. Sci. 2014, 67, 15–20. [Google Scholar]
  155. Bernardo, M.; Casadesus, M.; Karapetrovic, S.; Heras, I. How integrated are environmental, quality and other standardized management systems? An empirical study. J. Clean. Prod. 2009, 17, 742–750. [Google Scholar] [CrossRef]
  156. Parmenter, D. Key Performance Indicators: Developing, Implementing, and Using Winning KPIs; John Wiley & Sons: Hoboken, NJ, USA, 2015; ISBN 1118925106. [Google Scholar]
  157. Ispas, L.; Mironeasa, C. KPI indicators and objectives of integrated management systems in industrial companies in Romania. TEHNOMUS 2023, 30, 54–61. [Google Scholar]
  158. Chaswa, E.N.; Kosamu, I.B.M.; Kumwenda, S.; Utembe, W. Risk perception and its influencing factors among construction workers in Malawi. Safety 2020, 6, 33. [Google Scholar] [CrossRef]
  159. Rodrigues, M.A.; Arezes, P.M.; Leão, C.P. Risk acceptance in the furniture sector: Analysis of acceptance level and relevant influence factors. Hum. Ecol. Risk Assess. Int. J. 2015, 21, 1361–1378. [Google Scholar] [CrossRef]
  160. Simon, A.; Douglas, A. Integrating management systems: Does the location matter? Int. J. Qual. Reliab. Manag. 2013, 30, 675–689. [Google Scholar] [CrossRef]
  161. Ghaffari Sardasht, F.; Jahani Shourab, N.; Jafarnejad, F.; Esmaily, H. The frequency of risk factors associated with pregnancy among women seeking planned pregnancy. J. Midwifery Reprod. Health 2017, 5, 942–949. [Google Scholar]
  162. Santos, G.; Ramos, D.; Almeida, L.; Rebelo, M.; Pereira, M.; Barros, S.; Vale, P. Sistemas Integrados de Gestão-Qualidade. Ph.D. Dissertation, Escola Superior de Ciências Empresariais, Setúbal, Portugal, 2013. [Google Scholar]
  163. Fonseca, L. From quality gurus and TQM to ISO 9001:2015: A review of several quality paths. Int. J. Qual. Res. 2015, 9, 167–180. [Google Scholar]
  164. Testa, F.; Boiral, O.; Iraldo, F. Internalization of environmental practices and institutional complexity: Can stakeholders pressures encourage greenwashing? J. Bus. Ethics 2018, 147, 287–307. [Google Scholar] [CrossRef]
  165. Simon, A.; Karapetrovic, S.; Casadesus, M. Exploring the options for management system standards and integration levels. Environ. Eng. Manag. J. 2017, 16, 394–400. [Google Scholar] [CrossRef]
  166. Domingues, P.; Sampaio, P.; Arezes, P.M. Integrated management systems assessment: A maturity model proposal. J. Clean. Prod. 2016, 124, 164–174. [Google Scholar] [CrossRef]
  167. Nunhes, T.V.; Barbosa, L.C.F.M.; de Oliveira, O.J. Identification and analysis of the elements and functions integrable in integrated management systems. J. Clean. Prod. 2017, 142, 3225–3235. [Google Scholar] [CrossRef]
  168. Nunhes, T.V.; Oliveira, O.J. Analysis of Integrated Management Systems research: Identifying core themes and trends for future studies. Total Qual. Manag. Bus. Excell. 2020, 31, 1243–1265. [Google Scholar] [CrossRef]
  169. Aven, T. Risk assessment and risk management: Review of recent advances on their foundation. Eur. J. Oper. Res. 2016, 253, 1–13. [Google Scholar] [CrossRef]
  170. Schutzbach, M.; Kögel, A.; Kiemel, S.; Miehe, R.; Sauer, A. Principles of Management Systems for Positive Impact Factories. Sustainability 2022, 14, 16709. [Google Scholar] [CrossRef]
  171. Asif, M.; de Bruijn, E.J.; Fisscher, O.A.M.; Searcy, C. Meta-management of integration of management systems. TQM J. 2010, 22, 570–582. [Google Scholar] [CrossRef]
  172. Domingues, J.P.T.; Fonseca, L.; Sampaio, P.; Arezes, P.M. Integrated versus non-integrated perspectives of auditors concerning the new ISO 9001 revision. In Proceedings of the 2016 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), Bali, Indonesia, 4–7 December 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 866–870. [Google Scholar]
  173. Ispas, L.; Mironeasa, C.; Silvestri, A. Risk-based approach in the implementation of integrated management systems: A systematic literature review. Sustainability 2023, 15, 10251. [Google Scholar] [CrossRef]
  174. Etherton, J.R. Industrial machine systems risk assessment: A critical review of concepts and methods. Risk Anal. Int. J. 2007, 27, 71–82. [Google Scholar] [CrossRef]
  175. Anderson, W.E. Risk analysis methodology applied to industrial machine development. IEEE Trans. Ind. Appl. 2005, 41, 180–187. [Google Scholar] [CrossRef]
  176. Davoudi, S.; Porter, L. Applying the resilience perspective to planning: Critical thoughts from theory and practice. Plan. Theory Pract. 2012, 13, 299–333. [Google Scholar] [CrossRef]
  177. Allur, E.; Heras-Saizarbitoria, I.; Casadesus, M. Internalization of ISO 9001: A longitudinal survey. Ind. Manag. Data Syst. 2014, 114, 872–885. [Google Scholar] [CrossRef]
  178. Francisco, F.E.; Costa, A.C.F.; Sampaio, P.A.C.A.; Domingues, P.; de Oliveira, O.J. Implementation and improvement of Integrated Management Systems: Recommendations for their adaptation to the ISO High-Level structure. Clean. Environ. Syst. 2024, 15, 100227. [Google Scholar] [CrossRef]
  179. Khanna, H.K.; Laroiya, S.C.; Sharma, D.D. Integrated management systems in Indian manufacturing organizations: Some key findings from an empirical study. TQM J. 2010, 22, 670–686. [Google Scholar] [CrossRef]
  180. Weick, K.E.; Sutcliffe, K.M. Managing the Unexpected: Resilient Performance in an Age of Uncertainty; John Wiley & Sons: Hoboken, NJ, USA, 2011; Volume 8, ISBN 0470534230. [Google Scholar]
  181. Lundberg, J.; Johansson, B.J.E. Systemic resilience model. Reliab. Eng. Syst. Saf. 2015, 141, 22–32. [Google Scholar] [CrossRef]
  182. Sahebjamnia, N.; Torabi, S.A.; Mansouri, S.A. Integrated business continuity and disaster recovery planning: Towards organizational resilience. Eur. J. Oper. Res. 2015, 242, 261–273. [Google Scholar] [CrossRef]
  183. Patterson, M.D.; Wears, R.L. Resilience and precarious success. Reliab. Eng. Syst. Saf. 2015, 141, 45–53. [Google Scholar] [CrossRef]
  184. Righi, A.W.; Saurin, T.A.; Wachs, P. A systematic literature review of resilience engineering: Research areas and a research agenda proposal. Reliab. Eng. Syst. Saf. 2015, 141, 142–152. [Google Scholar] [CrossRef]
  185. Bergström, J.; Van Winsen, R.; Henriqson, E. On the rationale of resilience in the domain of safety: A literature review. Reliab. Eng. Syst. Saf. 2015, 141, 131–141. [Google Scholar] [CrossRef]
  186. Bernardo, M.; Casadesus, M.; Karapetrovic, S.; Heras, I. Integration of standardized management systems: Does the implementation order matter? Int. J. Oper. Prod. Manag. 2012, 32, 291–307. [Google Scholar] [CrossRef]
  187. Ispas, L.; Mironeasa, C. The Identification of Common Models Applied for the Integration of Management Systems: A Review. Sustainability 2022, 14, 3559. [Google Scholar] [CrossRef]
Figure 1. The use of integrated standards in Romanian organizations.
Figure 1. The use of integrated standards in Romanian organizations.
Sustainability 17 02401 g001
Figure 2. Distribution of percentages.
Figure 2. Distribution of percentages.
Sustainability 17 02401 g002
Figure 3. Multidimensional analysis for the main components according to the size of the organization and implemented standards.
Figure 3. Multidimensional analysis for the main components according to the size of the organization and implemented standards.
Sustainability 17 02401 g003
Figure 4. Percentage distribution of internal barriers.
Figure 4. Percentage distribution of internal barriers.
Sustainability 17 02401 g004
Figure 5. Percentage distribution of external barriers.
Figure 5. Percentage distribution of external barriers.
Sustainability 17 02401 g005
Figure 6. Multidimensional analysis for principal components according to organization size and implemented standards.
Figure 6. Multidimensional analysis for principal components according to organization size and implemented standards.
Sustainability 17 02401 g006
Figure 7. Presentation of the strategies and percentages used by the organizations.
Figure 7. Presentation of the strategies and percentages used by the organizations.
Sustainability 17 02401 g007
Figure 8. Multidimensional analysis for principal components according to implemented standards and organization size.
Figure 8. Multidimensional analysis for principal components according to implemented standards and organization size.
Sustainability 17 02401 g008
Figure 9. Percentages of respondents’ preferences.
Figure 9. Percentages of respondents’ preferences.
Sustainability 17 02401 g009
Figure 10. Multidimensional analysis for principal components according to organization size and implemented standards.
Figure 10. Multidimensional analysis for principal components according to organization size and implemented standards.
Sustainability 17 02401 g010
Figure 11. The model followed for IMS implementation.
Figure 11. The model followed for IMS implementation.
Sustainability 17 02401 g011
Figure 12. Typology used to perform audits.
Figure 12. Typology used to perform audits.
Sustainability 17 02401 g012
Figure 13. The implemented documents that led to a certain degree of integration.
Figure 13. The implemented documents that led to a certain degree of integration.
Sustainability 17 02401 g013
Figure 14. A multidimensional analysis of the main components implemented by the organizations.
Figure 14. A multidimensional analysis of the main components implemented by the organizations.
Sustainability 17 02401 g014
Figure 15. Percentage obtained for scaling responses.
Figure 15. Percentage obtained for scaling responses.
Sustainability 17 02401 g015
Figure 16. Multidimensional analysis for the main components according to the standards implemented and the size of the organization.
Figure 16. Multidimensional analysis for the main components according to the standards implemented and the size of the organization.
Sustainability 17 02401 g016
Table 1. Classification of organizations.
Table 1. Classification of organizations.
Number of Employees
30–100100–500>500
318333
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ispas, L.; Mironeasa, C.; Silvestri, A. A Study on the Emergence and Resilience of Integrated Management Systems in Organizations with an Industrial Profile in Romania. Sustainability 2025, 17, 2401. https://doi.org/10.3390/su17062401

AMA Style

Ispas L, Mironeasa C, Silvestri A. A Study on the Emergence and Resilience of Integrated Management Systems in Organizations with an Industrial Profile in Romania. Sustainability. 2025; 17(6):2401. https://doi.org/10.3390/su17062401

Chicago/Turabian Style

Ispas, Lucian, Costel Mironeasa, and Alessandro Silvestri. 2025. "A Study on the Emergence and Resilience of Integrated Management Systems in Organizations with an Industrial Profile in Romania" Sustainability 17, no. 6: 2401. https://doi.org/10.3390/su17062401

APA Style

Ispas, L., Mironeasa, C., & Silvestri, A. (2025). A Study on the Emergence and Resilience of Integrated Management Systems in Organizations with an Industrial Profile in Romania. Sustainability, 17(6), 2401. https://doi.org/10.3390/su17062401

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop