An Artificial Intelligence (AI) Framework to Predict Operational Excellence: UAE Case Study

: Implementing the European Foundation for Quality Management (EFQM) business excellence model in organizations is time-and cost-consuming. The integration of artificial intelligence (AI) into the EFQM business excellence model is a promising approach to improve the efficiency and effectiveness of excellence in organizations. This research paper’s integrated framework follows the ISO/IEC 23053 standard in addressing some of the concerns related to time and cost associated with the EFQM model, achieving higher EFQM scores, and hence operational excellence. A case study involving a UAE government organization serves as a sample to train the AI framework. Historical EFQM results from different years are used as training data. The AI framework utilizes the unsupervised machine learning technique known as k-means clustering. This technique follows the ISO/IEC 23053 standard to predict EFQM output total scores based on criteria and sub-criteria inputs. This research paper’s main output is a novel AI framework that can predict EFQM scores for organizations at an early stage. If the predicted EFQM score is not high enough, then the AI framework provides feedback to decision makers regarding the criteria that need reconsideration. Continuous use of this integrated framework helps organizations attain operational excellence. This framework is considered valuable for decision makers as it provides early predictions of EFQM total scores and identifies areas that require improvement before officially applying for the EFQM excellence award, hence saving time and cost. This approach can be considered as an innovative contribution and enhancement to knowledge body and organizational practices.


Introduction Theoretical Background
Organizations primarily focused on quality and Total Quality Management (TQM) measures to improve their operations before the emergence of business excellence models like the Malcolm Baldrige model and the European Foundation for Quality Management (EFQM) model [1].These approaches were foundational in promoting a culture of continuous improvement and customer satisfaction.However, business excellence has become a prominent topic in the past few decades, and various models and frameworks have been developed to assess and enhance organizational performance beyond just quality [2].
Figure 1 shows the evolution of quality management concept.Quality inspection (Quality 1.0, 1900s) represented the early days of quality management and inspected finished products to identify defects.Quality was associated with the physical properties of products [3].Quality control (Quality 1.0, 1920s) emphasized product inspection.During the production process, it introduced more systematic methods for defect identification and correction [3].Later, quality assurance (Quality 2.0, 1950s) included both product and process quality.This stage witnessed the emergence of ISO standards, which provided guidelines for ensuring consistent quality in manufacturing and other industries.In the 1980s, Total Quality Management (TQM, Quality 3.0, 1980s) included not only product and process quality but also the entire organization's culture and operations.It focused on customer satisfaction, continuous improvement, and employee involvement.During this era, various ISO standards were developed, and business excellence models like the EFQM gained prominence [3].Beginning in 2017, Quality 4.0 (2017) represents the latest stage in the evolution of quality management, accompanying the fourth industrial revolution (Industry 4.0).It extends the principles of TQM to include not only product, process, and company aspects but also integrate customer and supplier needs.Quality 4.0 leverages technologies such as artificial intelligence (AI) and machine learning (ML) to improve quality management practices [4].
Appl.Sci.2024, 14, x FOR PEER REVIEW 2 of 24 fication and correction [3].Later, quality assurance (Quality 2.0, 1950s) included both product and process quality.This stage witnessed the emergence of ISO standards, which provided guidelines for ensuring consistent quality in manufacturing and other industries.In the 1980s, Total Quality Management (TQM, Quality 3.0, 1980s) included not only product and process quality but also the entire organization's culture and operations.It focused on customer satisfaction, continuous improvement, and employee involvement.During this era, various ISO standards were developed, and business excellence models like the EFQM gained prominence [3].Beginning in 2017, Quality 4.0 (2017) represents the latest stage in the evolution of quality management, accompanying the fourth industrial revolution (Industry 4.0).It extends the principles of TQM to include not only product, process, and company aspects but also integrate customer and supplier needs.Quality 4.0 leverages technologies such as artificial intelligence (AI) and machine learning (ML) to improve quality management practices [4].
Quality management standards (Quality 3.0 and Quality 4.0) are integrated into organizations aiming to enhance not only their products and processes, but also their customers' and suppliers' satisfaction and happiness [3].The EFQM is a business excellence model that supports the preceding goals.Therefore, it is crucial to have outstanding EFQM output scores to ensure that the organizations' targets are achieved.This research paper introduces a novel integrated AI framework following the ISO/IEC 23053 standard to predict these EFQM output scores, hence enhancing operational excellence [5].The AI framework gives decision makers in organizations feedback to improve their weakness points before applying for the EFQM excellence award.Therefore, the purpose of this research's framework is to save time and cost for organizations, and provide them with great implications aiming to improve their processes and overall performance.
In the following sections, the materials and methods used in this research are discussed.This section is divided into EFQM, AI, and ISO/IEC 23053 sub-sections.Later on, the Results and Discussion Section demonstrates all results obtained from the research's AI framework when applied to old and new EFQM score datasets as AI model training inputs.In the final section, conclusions and future work are outlined.Quality management standards (Quality 3.0 and Quality 4.0) are integrated into organizations aiming to enhance not only their products and processes, but also their customers' and suppliers' satisfaction and happiness [3].The EFQM is a business excellence model that supports the preceding goals.Therefore, it is crucial to have outstanding EFQM output scores to ensure that the organizations' targets are achieved.This research paper introduces a novel integrated AI framework following the ISO/IEC 23053 standard to predict these EFQM output scores, hence enhancing operational excellence [5].The AI framework gives decision makers in organizations feedback to improve their weakness points before applying for the EFQM excellence award.Therefore, the purpose of this research's framework is to save time and cost for organizations, and provide them with great implications aiming to improve their processes and overall performance.
In the following sections, the materials and methods used in this research are discussed.This section is divided into EFQM, AI, and ISO/IEC 23053 sub-sections.Later on, the Results and Discussion Section demonstrates all results obtained from the research's AI framework when applied to old and new EFQM score datasets as AI model training inputs.In the final section, conclusions and future work are outlined.

EFQM Overview
After discussing the evolution of quality in the previous section, the European Foundation for Quality Management (EFQM) is introduced.The EFQM has played a vital role in the field of business excellence and quality management [6].The EFQM was established in 1992 in European countries as a business excellence model.It was initially created to enhance and assess quality management practices in organizations [7].Over the years, the EFQM was updated and revised in 1999 and 2003 [8].These updates likely reflected the evolving understanding of quality management principles and practices.
The EFQM continued changing to adapt to different business environments and management paradigms [9].It underwent crucial modifications in 2010 and 2013 [10].The EFQM's influence extends far beyond Europe to be recognized and adopted not only within Europe but also in other regions of the world, including the Middle East, Asia, South America, and South Africa.This global reach is evidence of the model's adaptability and applicability in diverse cultural and industry contexts.
The EFQM's versatility is evident in its applications across various industries, including education [11], information technology [12], healthcare [13], and more.This adaptability reflects its effectiveness as a business excellence model with wide applicability.Applying the EFQM model has a positive effect on the sustainability of stakeholders within organizations [13].This is in addition to the broader objective of business excellence models, which aim to drive overall organizational improvement and long-term success.
The EFQM has been adopted by numerous global organizations as a business model, related to its success and rapid evolution.Furthermore, it is recognized as a valuable framework for achieving excellence and continuous improvement.
The EFQM has evolved over the years to stay relevant and effective in supporting organizations in their excellence journey.Its global acceptance and application across a wide range of industries represent its enduring value in the field of quality management and business excellence [14].The EFQM model has experienced massive evolution, which is summarized in Figure 2.
tablished in 1992 in European countries as a business excellence model.It was initially created to enhance and assess quality management practices in organizations [7].Over the years, the EFQM was updated and revised in 1999 and 2003 [8].These updates likely reflected the evolving understanding of quality management principles and practices.
The EFQM continued changing to adapt to different business environments and management paradigms [9].It underwent crucial modifications in 2010 and 2013 [10].The EFQM's influence extends far beyond Europe to be recognized and adopted not only within Europe but also in other regions of the world, including the Middle East, Asia, South America, and South Africa.This global reach is evidence of the model's adaptability and applicability in diverse cultural and industry contexts.
The EFQM's versatility is evident in its applications across various industries, including education [11], information technology [12], healthcare [13], and more.This adaptability reflects its effectiveness as a business excellence model with wide applicability.Applying the EFQM model has a positive effect on the sustainability of stakeholders within organizations [13].This is in addition to the broader objective of business excellence models, which aim to drive overall organizational improvement and long-term success.
The EFQM has been adopted by numerous global organizations as a business model, related to its success and rapid evolution.Furthermore, it is recognized as a valuable framework for achieving excellence and continuous improvement.
The EFQM has evolved over the years to stay relevant and effective in supporting organizations in their excellence journey.Its global acceptance and application across a wide range of industries represent its enduring value in the field of quality management and business excellence [14].The EFQM model has experienced massive evolution, which is summarized in Figure 2.  The EFQM model appears to have incorporated additional criteria and elements to better address contemporary challenges and organizational needs, as shown in Figure 3 [15].The criteria in this modified EFQM model from 2013 include leadership, people, strategy, partnership and resources, processes, people results, customer results, society results, and key results [16].
The EFQM model appears to have incorporated additional criteria and elements to better address contemporary challenges and organizational needs, as shown in Figure 3 [15].The criteria in this modified EFQM model from 2013 include leadership, people, strategy, partnership and resources, processes, people results, customer results, society results, and key results [16].Learning, creativity, and innovation were added to the EFQM model, highlighting the importance of continuous learning, creativity, and innovation in achieving excellence and competitiveness in today's dynamic business environment [16].The inclusion of "Learning, Creativity, and Innovation" shows the recognition that organizations must adapt and innovate to stay competitive and address evolving customer and market demands.This modification goes along with the broader trends in business management, focusing on the need for organizations to be agile and forward-thinking [18].
This modified EFQM model provides a more comprehensive framework for assessing and enhancing organizational excellence, considering a wider range of factors that contribute to sustained success and innovation [19].The European Foundation for Quality Management (EFQM) is a business excellence model that considers sustainability needs of stakeholders [20].It can be used in different sectors like education [11], information technology [12] healthcare [13,21], nursing [22], aviation [23,24], decision making [25], banking [26], public sectors [14], manufacturing [27], and construction [28].

•
The EFQM framework is made up of the following main principles, as described in [29] To implement these principles, we need three phases: initiation, realization, and maturity [28].The EFQM is divided into 2 categories, which are enablers and results.Enabler criteria are responsible for key activity management.The results criteria are responsible for the way the results of an organization are achieved.These criteria include leadership, strategy, people, alliances, resources, processes, products, and services [13].
Most EFQM papers referred to in this paper originated from Spain, were published in 2015 and 2023, and were mostly applied in the healthcare and education sectors, as shown in Figure 4 [15].Learning, creativity, and innovation were added to the EFQM model, highlighting the importance of continuous learning, creativity, and innovation in achieving excellence and competitiveness in today's dynamic business environment [16].The inclusion of "Learning, Creativity, and Innovation" shows the recognition that organizations must adapt and innovate to stay competitive and address evolving customer and market demands.This modification goes along with the broader trends in business management, focusing on the need for organizations to be agile and forward-thinking [18].
This modified EFQM model provides a more comprehensive framework for assessing and enhancing organizational excellence, considering a wider range of factors that contribute to sustained success and innovation [19].The European Foundation for Quality Management (EFQM) is a business excellence model that considers sustainability needs of stakeholders [20].It can be used in different sectors like education [11], information technology [12] healthcare [13,21], nursing [22], aviation [23,24], decision making [25], banking [26], public sectors [14], manufacturing [27], and construction [28].

•
The EFQM framework is made up of the following main principles, as described in [29] To implement these principles, we need three phases: initiation, realization, and maturity [28].The EFQM is divided into 2 categories, which are enablers and results.Enabler criteria are responsible for key activity management.The results criteria are responsible for the way the results of an organization are achieved.These criteria include leadership, strategy, people, alliances, resources, processes, products, and services [13].
Most EFQM papers referred to in this paper originated from Spain, were published in 2015 and 2023, and were mostly applied in the healthcare and education sectors, as shown in Figure 4 [15].
After the EFQM discussion, it is clear that EFQM has nine criteria (old EFQM) and so many sub-criteria.These sub-criteria require complex calculations that make it a tedious job to calculate the EFQM output.Furthermore, registering for the EFQM award yearly without prior preparation or testing wastes the time and money of organizations.Therefore, AI implementation is suggested.After the EFQM discussion, it is clear that EFQM has nine criteria (old EFQM) and so many sub-criteria.These sub-criteria require complex calculations that make it a tedious job to calculate the EFQM output.Furthermore, registering for the EFQM award yearly without prior preparation or testing wastes the time and money of organizations.Therefore, AI implementation is suggested.

AI Overview
The second major component of this research's framework is artificial intelligence (AI).In this section, an AI overview is covered.AI is a field of computer science and technology that emphasizes creating systems and machines that can perform jobs requiring human intelligence.These tasks include reasoning, problem-solving, learning, perception, understanding language, and decision-making [20].AI research began in the 1950s with the target of creating machines that can mimic human intelligence.Early AI systems were rule-based and relied on explicit programming to simulate human reasoning.However, these systems did not work well in complex real-world problems.Therefore, machine learning-a subset of AI-emerged in the 1970s.It introduced a paradigm shift by emphasizing the ability of machines to learn from data and enhance their performance without being explicitly programmed.Machine learning's fundamental concept is to allow computers to learn and adapt from data.This is achieved through various algorithms that can specify patterns, make predictions, and make decisions relative to the data they are provided [30].Machine learning is achieved through training on large datasets, where the machine learns the underlying patterns and relationships in the data [20].Machine learning is widely applied in terrorism prediction [31], cancer prediction [32], and sports result prediction [33].These applications leverage the ability of machine learning algorithms to find hidden patterns and correlations in data.Machine learning techniques are classified into categories: supervised learning [34], unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, as shown in Figure 5 [30].

AI Overview
The second major component of this research's framework is artificial intelligence (AI).In this section, an AI overview is covered.AI is a field of computer science and technology that emphasizes creating systems and machines that can perform jobs requiring human intelligence.These tasks include reasoning, problem-solving, learning, perception, understanding language, and decision-making [20].AI research began in the 1950s with the target of creating machines that can mimic human intelligence.Early AI systems were rulebased and relied on explicit programming to simulate human reasoning.However, these systems did not work well in complex real-world problems.Therefore, machine learning-a subset of AI-emerged in the 1970s.It introduced a paradigm shift by emphasizing the ability of machines to learn from data and enhance their performance without being explicitly programmed.
Machine learning's fundamental concept is to allow computers to learn and adapt from data.This is achieved through various algorithms that can specify patterns, make predictions, and make decisions relative to the data they are provided [30].Machine learning is achieved through training on large datasets, where the machine learns the underlying patterns and relationships in the data [20].Machine learning is widely applied in terrorism prediction [31], cancer prediction [32], and sports result prediction [33].These applications leverage the ability of machine learning algorithms to find hidden patterns and correlations in data.Machine learning techniques are classified into categories: supervised learning [34], unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, as shown in Figure 5 [30].Recently, machine learning has spread over many applications and industries.It can be found in web searches, siri, big data [35], pricing prediction, weather prediction [36], marine work [37], aviation [38], manufacturing [39], transportation, crime prediction [40], predicting COVID-19 cases [41], and healthcare [42].Unfortunately, few papers have talked about using AI in predicting EFQM scores.Therefore, this paper provides a framework combining AI techniques with the EFQM model.In this framework, the k-means unsupervised machine learning technique is adopted.Recently, machine learning has spread over many applications and industries.It can be found in web searches, siri, big data [35], pricing prediction, weather prediction [36], marine work [37], aviation [38], manufacturing [39], transportation, crime prediction [40], predicting COVID-19 cases [41], and healthcare [42].Unfortunately, few papers have talked about using AI in predicting EFQM scores.Therefore, this paper provides a framework combining AI techniques with the EFQM model.In this framework, the k-means unsupervised machine learning technique is adopted.
Artificial intelligence and machine learning are incorporated in different industries and in different countries, as Table 1 shows.Machine learning continues to advance rapidly and has become a basic tool in various fields, including healthcare [42], finance, natural language processing, computer vision, robotics [44], decision making [25,45], human resources work [46], and autonomous systems.Its potential to extract valuable patterns from data makes it a powerful technology with a wide range of applications [47].
Unsupervised learning works by finding common input points in the data as previously trained.Clustering of inputs is a good description of this process where the inputs are correlated based on their statistical properties.
Unsupervised data learning methods do not need any labeled output to train the algorithm.They are more subjective, since humans will not interfere as in supervised learning [48].The main objective of unsupervised learning is to learn more about data by identifying patterns found in the data.In other words, it learns an input pattern by itself and compares it with the following input patterns as shown in Figure 6.
Machine learning continues to advance rapidly and has become a basic tool in various fields, including healthcare [42], finance, natural language processing, computer vision, robotics [44], decision making [25,45], human resources work [46], and autonomous systems.Its potential to extract valuable patterns from data makes it a powerful technology with a wide range of applications [47].
Unsupervised learning works by finding common input points in the data as previously trained.Clustering of inputs is a good description of this process where the inputs are correlated based on their statistical properties.
Unsupervised data learning methods do not need any labeled output to train the algorithm.They are more subjective, since humans will not interfere as in supervised learning [48].The main objective of unsupervised learning is to learn more about data by identifying patterns found in the data.In other words, it learns an input pattern by itself and compares it with the following input patterns as shown in Figure 6.K-means clustering is a simple and powerful unsupervised machine learning technique that works with most industries [49].It groups similar inputs together to form meaningful clusters.Therefore, clustering is the process of dividing data into groups or clusters sharing the same characteristics and minimizing data distances within the same cluster [49].
In this research, previous old EFQM input criteria were collected and set in a dataset for AI model training.This framework uses K-means clustering (K = 2), which is an unsupervised machine learning algorithm.Output accuracy measures the number of pre- K-means clustering is a simple and powerful unsupervised machine learning technique that works with most industries [49].It groups similar inputs together to form meaningful clusters.Therefore, clustering is the process of dividing data into groups or clusters sharing the same characteristics and minimizing data distances within the same cluster [49].
In this research, previous old EFQM input criteria were collected and set in a dataset for AI model training.This framework uses K-means clustering (K = 2), which is an unsupervised machine learning algorithm.Output accuracy measures the number of predicted outputs matching the actual values to the total number of predicted outputs in the dataset.

accuracy =
predicted outputs matching actual total number o f predictions * 100 The old EFQM final scores are calculated using the following equation: where x is the old EFQM input criteria and i = input index.
After studying output accuracy for different AI models, K-means clustering (k = 2) was selected for use in this research paper.Table 2 shows the output accuracy for different AI models used along with the hyperparameters used for each model.Therefore, K-means clustering gave the best accuracy.In this research paper, K-means clustering (k = 2), which is an unsupervised machine learning technique, is applied, and accuracy values are calculated.Figure 7 shows the elbow chart simulated from Google Colab when the old EFQM model was used.The best number of clusters should be chosen just when the graph starts changing slope.Therefore, the best number of clusters k for this dataset is between 2 and just when the curve starts bending.However, Figure 8 shows the accuracy to be 86.73 The framework of this research paper takes the EFQM results from an organization (196-row dataset) and injects it with k-means unsupervised machine learning to predict operational excellence.The k-value used was 2 due to accuracy problems.To better evaluate K-means clustering performance, the Rand Index adjusted for chance was used.
The Adjusted Rand Index (ARI) is a measure of the similarity between two clustering results, taking into account chance.It adjusts the Rand Index to account for the expected similarity between random clusters by considering all pairs of samples and counting pairs that are assigned in the same or different clusters in the predicted and true clusters.
The Random Index (RI) score is adjusted for chance, resulting in the Adjusted RI (ARI) score which is calculated using the equation below: Figure 7 shows the elbow chart simulated from Google Colab when the old EFQM model was used.The best number of clusters should be chosen just when the graph starts changing slope.Therefore, the best number of clusters k for this dataset is between 2 and just when the curve starts bending.However, Figure 8 shows the accuracy to be 86.73 (k = 2).The framework of this research paper takes the EFQM results from an organization (196-row dataset) and injects it with k-means unsupervised machine learning to predict operational excellence.The k-value used was 2 due to accuracy problems.To better evaluate K-means clustering performance, the Rand Index adjusted for chance was used.
The Adjusted Rand Index (ARI) is a measure of the similarity between two clustering results, taking into account chance.It adjusts the Rand Index to account for the expected similarity between random clusters by considering all pairs of samples and counting pairs that are assigned in the same or different clusters in the predicted and true clusters.Figure 7 shows the elbow chart simulated from Google Colab when the old EFQM model was used.The best number of clusters should be chosen just when the graph starts changing slope.Therefore, the best number of clusters k for this dataset is between 2 and just when the curve starts bending.However, Figure 8 shows the accuracy to be 86.73 (k = 2).The framework of this research paper takes the EFQM results from an organization (196-row dataset) and injects it with k-means unsupervised machine learning to predict operational excellence.The k-value used was 2 due to accuracy problems.To better evaluate K-means clustering performance, the Rand Index adjusted for chance was used.
The Adjusted Rand Index (ARI) is a measure of the similarity between two clustering results, taking into account chance.It adjusts the Rand Index to account for the expected similarity between random clusters by considering all pairs of samples and counting pairs that are assigned in the same or different clusters in the predicted and true clusters.Integrating AI into business excellence models represents a crucial need in academia and the marketplace.This integrated framework has the potential to drive efficiency, cost savings, innovation, and competitive benefits for organizations, making it a valuable area of study and application.Therefore, machine learning solved the basic problems of time and money consumption.

ISO/IEC 23053 Overview
After applying AI in many industries like medicine to predict breast cancer [50], in dental education [51], and its massive use during the COVID-19 pandemic, the crucial need for AI to be ISO-certified arose.
Therefore, the ISO/IEC 23053 standard for AI has emerged to fulfill the necessity of standardization and to regulate and certify AI techniques.This section addresses ISO/IEC 23053 and its application in the research's framework.
The International Organization for Standardization (ISO), an independent, nongovernmental international organization, has begun to develop standards around AI along with the International Electrotechnical Commission (IEC) through Subcommittee 42 of the two organizations' Joint Technical Committee (JTC) 1.The ISO/IEC JTC 1/SC 42 [5] process is in its early stages and has produced a number of drafts currently being developed in committees around AI topics, including ISO/IEC WD 22989 [52]:artificial intelligence concepts and terminology, and ISO/IEC WD 23053: framework for artificial intelligence (AI) systems using machine learning (ML).This ISO framework is built on previous ISO standards such as ISO/IEC 22989.It digs deeper into machine learning.It also reshapes AI-related concepts into a framework and explains how machine learning algorithms are developed.This standard is widely used among experts and non-practitioners.This standard has many advantages:

•
It makes more advanced use of AI [53]; Machine learning features like accuracy and explainability are interpreted and set in an international frame [54]; It gives AI standardization for policing software explored [55].AI has been adopted worldwide and in various industries like health [56], manufacturing [57], and marketing [43].It proved valuable during the COVID-19 pandemic.The emergence of ISO/IEC 23053 is indeed significant, as it provides a standardized framework for AI, which is crucial for ensuring the responsible and effective use of AI technologies.ISO/IEC 23053 also introduces a machine learning framework that includes the AI system life cycle and machine learning pipeline.This framework will likely help decision makers in organizations to structure their AI projects and ensures that they follow a systematic approach from problem definition to deployment.
Figure 9 consists of the AI life cycle and machine learning ML pipeline as described by the new ISO/IEC 23053 standard.This standard adds some properties and regulations to AI concerning risk management, governance, security, privacy, accountability, transparency, explainability, safety, resilience, robustness, and fairness.Figure 9 shows that the AI life cycle is made up of seven stages, which are inception, design and development, verification and validation, deployment, operation and monitoring, re-evaluation, and retirement.These stages are mapped into the ML pipeline cycle in this paper's research framework [58].
Appl.Sci.2024, 14, x FOR PEER REVIEW 10 of 24 decision makers in organizations to structure their AI projects and ensures that they follow a systematic approach from problem definition to deployment. Figure 9 consists of the AI life cycle and machine learning ML pipeline as described by the new ISO/IEC 23053 standard.This standard adds some properties and regulations to AI concerning risk management, governance, security, privacy, accountability, transparency, explainability, safety, resilience, robustness, and fairness.Figure 9 shows that the AI life cycle is made up of seven stages, which are inception, design and development, verification and validation, deployment, operation and monitoring, re-evaluation, and retirement.These stages are mapped into the ML pipeline cycle in this paper's research framework [58].ISO/IEC 23053 includes several important aspects that should be considered throughout the AI life cycle and ML pipeline, like risk management, governance, security, privacy, accountability, transparency, explainability, safety, resilience, robustness, and fairness [50].These aspects are crucial for responsible and ethical AI development and deployment.
ISO/IEC 23053 seeks to promote responsible and ethical AI development and deployment [10].This standardization effort helps establish a common framework for AI development that can be adopted by organizations and industries to ensure the reliability, safety, and fairness of AI systems [60].
After reviewing the literature papers about business excellence models (EFQM), artificial intelligence, and machine learning, gaps are introduced.The main gap lies in in- ISO/IEC 23053 includes several important aspects that should be considered throughout the AI life cycle and ML pipeline, like risk management, governance, security, privacy, accountability, transparency, explainability, safety, resilience, robustness, and fairness [50].These aspects are crucial for responsible and ethical AI development and deployment.
ISO/IEC 23053 seeks to promote responsible and ethical AI development and deployment [10].This standardization effort helps establish a common framework for AI development that can be adopted by organizations and industries to ensure the reliability, safety, and fairness of AI systems [60].
After reviewing the literature papers about business excellence models (EFQM), artificial intelligence, and machine learning, gaps are introduced.The main gap lies in integrating artificial intelligence into the EFQM business excellence model to enhance operational excellence.Few papers were found studying the effect of artificial intelligence on operational excellence.Some papers mentioned the effect of AI on economy and marketing.Dirican C. outlines the effects of artificial intelligence on business and economy.He also mentioned human replacement by robots.The AI invasion will result in a higher rate of unemployment, which will affect the economy [61].So, this research paper's framework has the following advantages:

•
Enriches the knowledge body by injecting AI into a business excellence model (EFQM); • Enhances operational excellence; • Can be applied to any sector worldwide; • Saves time and money before applying for the EFQM excellence award.
After presenting an overview on EFQM, AI, and ISO/IEC 23053, the research methodology adopted in this research is discussed.

Research Methodology
AI is injected into the business excellence model (EFQM) to predict future EFQM results.This integrated framework enhances operational excellence in public and private organizations.
EFQM scores were collected and arranged into datasets.These datasets were used as the input of an AI framework (using k-means clustering where k = 2).The AI model used follows the ISO/IEC 23053 standard.Using this framework contributes to the knowledge body and enhances the operational excellence in any organization.
After preparing the datasets, python was used to train, test, and validate the predicted EFQM score results, and then accuracy scores were calculated for the k-means clustering used.Figure 10 shows the three major components of the research's framework.
Appl.Sci.2024, 14, x FOR PEER REVIEW 11 of 24 After presenting an overview on EFQM, AI, and ISO/IEC 23053, the research methodology adopted in this research is discussed.

Research Methodology
AI is injected into the business excellence model (EFQM) to predict future EFQM results.This integrated framework enhances operational excellence in public and private organizations.
EFQM scores were collected and arranged into datasets.These datasets were used as the input of an AI framework (using k-means clustering where k = 2).The AI model used follows the ISO/IEC 23053 standard.Using this framework contributes to the knowledge body and enhances the operational excellence in any organization.
After preparing the datasets, python was used to train, test, and validate the predicted EFQM score results, and then accuracy scores were calculated for the k-means clustering used.Figure 10 shows the three major components of the research's framework.Design problem research aims to create an artifact that will improve a problem context, taking into account stakeholder goals.Multiple solutions for a specific design research problem are possible and the effectiveness of these solutions is evaluated with respect to stakeholder goals.Knowledge question research attempts to answer an analytical or empirical knowledge question about an artifact without necessarily changing the artifact itself.Knowledge questions can have multiple answers and involve a level of uncertainty.The answers to a knowledge question have to be evaluated by truth, which is independent from the stakeholders' goals [62].Analytical knowledge questions are answered by analyzing concepts, while empirical knowledge questions are answered by collecting and analyzing data [63].
The framework of the design science research methodology is represented in Figure 11 [62].As shown, the design science framework includes a social context, which consists Design problem research aims to create an artifact that will improve a problem context, taking into account stakeholder goals.Multiple solutions for a specific design research problem are possible and the effectiveness of these solutions is evaluated with respect to stakeholder goals.Knowledge question research attempts to answer an analytical or empirical knowledge question about an artifact without necessarily changing the artifact itself.Knowledge questions can have multiple answers and involve a level of uncertainty.The answers to a knowledge question have to be evaluated by truth, which is independent from the stakeholders' goals [62].Analytical knowledge questions are answered by analyzing concepts, while empirical knowledge questions are answered by collecting and analyzing data [63].
The framework of the design science research methodology is represented in Figure 11 [62].As shown, the design science framework includes a social context, which consists of stakeholders such as users and operators.In this paper, the social context is any organization following the EFQM scoring standard.The goals are set based on stakeholder (any government/private entity) requirements and the outcome of the research is consequently used by the stakeholders.The framework also includes the knowledge context consisting of the current knowledge of the design, specifications, and practical experience.This knowledge context is used as an input for the design research on existing designs or existing answers to knowledge questions.An example is the input of operational excellence given by any organization to predict future results using AI techniques.The results of the design may enrich the knowledge context with new answers, new problem-solving knowledge, and new designs.In this research, this is shown in the output of the AI-predicted results.The following Figure 11 shows the design science methodology framework in general and Figure 12 shows the design science methodology as it is applied in this research.Figure 13 shows the research methodology flowchart.
Appl.Sci.2024, 14, x FOR PEER REVIEW 12 of 24 results of the design may enrich the knowledge context with new answers, new problem-solving knowledge, and new designs.In this research, this is shown in the output of the AI-predicted results.The following Figure 11 shows the design science methodology framework in general and Figure 12 shows the design science methodology as it is applied in this research.Figure 13 shows the research methodology flowchart.results of the design may enrich the knowledge context with new answers, new problem-solving knowledge, and new designs.In this research, this is shown in the output of the AI-predicted results.The following Figure 11 shows the design science methodology framework in general and Figure 12 shows the design science methodology as it is applied in this research.Figure 13 shows the research methodology flowchart.

The Integrated AI Framework
Following all previous sections, we present the integrated AI framework of this research.Figure 14 shows the system architecture diagram with a user interface layer, application logic layer, and technical services layer to represent a framework integrating operational excellence following the EFQM model into artificial intelligence following the ISO/IEC 23053 standard.It represents the integration of AI with the EFQM to achieve operational excellence.This framework also follows the ISO/IEC 23053 standard in its stages.It starts with the data acquisition state, data preparation, modelling, verification and validation, operation and monitoring, comparison, feedback, and retirement states.Each of these stages is fully discussed in Figures 15-17

The Integrated AI Framework
Following all previous sections, we present the integrated AI framework of this research.Figure 14 shows the system architecture diagram with a user interface layer, application logic layer, and technical services layer to represent a framework integrating operational excellence following the EFQM model into artificial intelligence following the ISO/IEC 23053 standard.It represents the integration of AI with the EFQM to achieve operational excellence.This framework also follows the ISO/IEC 23053 standard in its stages.It starts with the data acquisition state, data preparation, modelling, verification and validation, operation and monitoring, comparison, feedback, and retirement states.Each of these stages is fully discussed in Figures 15-17

The Integrated AI Framework
Following all previous sections, we present the integrated AI framework of this research.Figure 14 shows the system architecture diagram with a user interface layer, application logic layer, and technical services layer to represent a framework integrating operational excellence following the EFQM model into artificial intelligence following the ISO/IEC 23053 standard.It represents the integration of AI with the EFQM to achieve operational excellence.This framework also follows the ISO/IEC 23053 standard in its stages.It starts with the data acquisition state, data preparation, modelling, verification and validation, operation and monitoring, comparison, feedback, and retirement states.Each of these stages is fully discussed in Figures 15-17    The verification and validation phase of the AI life cycle is applied to test and validate the data.In the model deployment phase, the unsupervised ML k-means clustering is applied where k = 2. Accuracy results are calculated to validate results.K-means clustering follows the ISO/IEC 23053 standard in the model deployment phase.In the operation phase, the accuracy of the AI system is monitored and the final score is returned.Two outputs may result: either "High" or "Low".If the output is "High", then operational excellence is achieved where the AI model is in the retirement phase; otherwise the output will be "Low", and then the AI model is in the re-evaluation phase.When the output is low, the framework searches for the lowest score criteria in the comparison state and returns the inputs with the same lowest score.In the feedback state, the AI framework gives suggestions to improve the organization's weakness points.Now, the framework moves into the termination state.Decision makers can inject input scores again into the framework until the output is high and operational excellence is achieved.The verification and validation phase of the AI life cycle is applied to test and validate the data.In the model deployment phase, the unsupervised ML k-means clustering is applied where k = 2. Accuracy results are calculated to validate results.K-means clustering follows the ISO/IEC 23053 standard in the model deployment phase.In the operation phase, the accuracy of the AI system is monitored and the final score is returned.Two outputs may result: either "High" or "Low".If the output is "High", then operational excellence is achieved where the AI model is in the retirement phase; otherwise the output will be "Low", and then the AI model is in the re-evaluation phase.When the output is low, the framework searches for the lowest score criteria in the comparison state and returns the inputs with the same lowest score.In the feedback state, the AI framework gives suggestions to improve the organization's weakness points.Now, the framework moves into the termination state.Decision makers can inject input scores again into the framework until the output is high and operational excellence is achieved.The verification and validation phase of the AI life cycle is applied to test and validate the data.In the model deployment phase, the unsupervised ML k-means clustering is applied where k = 2. Accuracy results are calculated to validate results.K-means clustering follows the ISO/IEC 23053 standard in the model deployment phase.In the operation phase, the accuracy of the AI system is monitored and the final score is returned.Two outputs may result: either "High" or "Low".If the output is "High", then operational excellence is achieved where the AI model is in the retirement phase; otherwise the output will be "Low", and then the AI model is in the re-evaluation phase.When the output is low, the framework searches for the lowest score criteria in the comparison state and returns the inputs with the same lowest score.In the feedback state, the AI framework gives suggestions to improve the organization's weakness points.Now, the framework moves into the termination state.Decision makers can inject input scores again into the framework until the output is high and operational excellence is achieved.Despite all the benefits of AI, however, it faces certain ethical, moral, social, and security obstacles [64].Therefore, the ISO developed standards to maintain the healthy development of AI [65].AI drawbacks can affect human privacy and development [65].A solution to this problem may be the integration of ISO 26000 [65] at early stages of an AI system.In the above framework, social responsibility is shown when social results are measured and evaluated.Some suggestions are given to improve social results, such as enhancing social perceptions and performance indicators.Furthermore, AI has shown reproducibility, selecting, and reporting biases [66].AI systems can misbehave in cases of unreliable data, making them unsafe and untrustworthy [59].ISO 24028 is also used to ensure AI trustworthiness [66].

Old EFQM Model Results
In this section, the EFQM is embedded in an AI framework to predict future operational excellence final scores.The training database consists of 196 rows containing nine EFQM input dimensions for the framework.This framework takes these EFQM input dimensions from decision makers in an organization and predicts the total EFQM score as either "High" or "Low".Organizations with low outputs will try to enhance their scores by enhancing the lowest EFQM inputs until the organizations reach a "High" final scoring, achieving operational excellence.Previous old EFQM input criteria were collected and set in a database for AI model training.This framework uses K-means clustering (K = 2), which is an unsupervised machine learning algorithm.Output accuracy measures the output given in the prepared dataset with the output predicted by the AI framework.Despite all the benefits of AI, however, it faces certain ethical, moral, social, and security obstacles [64].Therefore, the ISO developed standards to maintain the healthy development of AI [65].AI drawbacks can affect human privacy and development [65].A solution to this problem may be the integration of ISO 26000 [65] at early stages of an AI system.In the above framework, social responsibility is shown when social results are measured and evaluated.Some suggestions are given to improve social results, such as enhancing social perceptions and performance indicators.Furthermore, AI has shown reproducibility, selecting, and reporting biases [66].AI systems can misbehave in cases of unreliable data, making them unsafe and untrustworthy [59].ISO 24028 is also used to ensure AI trustworthiness [66].

Old EFQM Model Results
In this section, the EFQM is embedded in an AI framework to predict future operational excellence final scores.The training database consists of 196 rows containing nine EFQM input dimensions for the framework.This framework takes these EFQM input dimensions from decision makers in an organization and predicts the total EFQM score as either "High" or "Low".Organizations with low outputs will try to enhance their scores by enhancing the lowest EFQM inputs until the organizations reach a "High" final scoring, achieving operational excellence.Previous old EFQM input criteria were collected and set in a database for AI model training.This framework uses K-means clustering (K = 2), which is an unsupervised machine learning algorithm.Output accuracy measures the output given in the prepared dataset with the output predicted by the AI framework.
Figure 18 shows the descriptive statistics generated by SPSS software v27 to calculate the row count, minimum, maximum, mean, and standard deviation of the dataset used.This dataset has 196 rows using the old EFQM.
Figure 18 shows the descriptive statistics generated by SPSS software v27 to calculate the row count, minimum, maximum, mean, and standard deviation of the dataset used.This dataset has 196 rows using the old EFQM. Figure 19 shows the SPSS correlation results of the old EFQM's dimensions and total score.It is noted that the "People Results" and "Society Results" dimensions are the most correlated to the final total score.However, the "Partnership Resources" dimension has the least effect on the final score.Figure 19 shows the SPSS correlation results of the old EFQM's dimensions and total score.It is noted that the "People Results" and "Society Results" dimensions are the most correlated to the final total score.However, the "Partnership Resources" dimension has the least effect on the final score.
Figure 18 shows the descriptive statistics generated by SPSS software v27 to calculate the row count, minimum, maximum, mean, and standard deviation of the dataset used.This dataset has 196 rows using the old EFQM. Figure 19 shows the SPSS correlation results of the old EFQM's dimensions and total score.It is noted that the "People Results" and "Society Results" dimensions are the most correlated to the final total score.However, the "Partnership Resources" dimension has the least effect on the final score.The algorithm is implemented via Google Colab, which is used to design a code to train, test, and predict operational excellence given a dataset.First, libraries are defined.Then, the 196row database is imported and read.After the code is run, a link will appear for decision makers to use which will forward them into a new tab where they will be asked to train and then test the model.The output is classified as "High" if the final score is greater than or equal to 500; otherwise, it is "Low".The algorithm generates a graphical user interface webpage to train and then test the data as shown in Figure 21.
First, data are trained using the imported dataset with k-value = 2 as Figures 21 and 22 show.Then, the decision makers need to test the model by importing the input EFQM dimensions' criteria.Final scores are predicted and a message showing either "High" or "Low" is generated.If the result is "high", the webpage shows a message that you reached operational excellence, as shown in Figure 23; otherwise, it returns the inputs with the lowest score and gives suggestions to decision makers to improve their final score, as shown in Figure 24.The algorithm is implemented via Google Colab, which is used to design a code to train, test, and predict operational excellence given a dataset.First, libraries are defined.Then, the 196row database is imported and read.After the code is run, a link will appear for decision makers to use which will forward them into a new tab where they will be asked to train and then test the model.The output is classified as "High" if the final score is greater than or equal to 500; otherwise, it is "Low".The algorithm generates a graphical user interface webpage to train and then test the data as shown in Figure 21.First, data are trained using the imported dataset with k-value = 2 as Figures 21 and  22 show.Then, the decision makers need to test the model by importing the input EFQM dimensions' criteria.Final scores are predicted and a message showing either "High" or "Low" is generated.If the result is "high", the webpage shows a message that you reached operational excellence, as shown in Figure 23; otherwise, it returns the inputs with the lowest score and gives suggestions to decision makers to improve their final score, as shown in Figure 24.The algorithm is implemented via Google Colab, which is used to design a code to train, test, and predict operational excellence given a dataset.First, libraries are defined.Then, the 196row database is imported and read.After the code is run, a link will appear for decision makers to use which will forward them into a new tab where they will be asked to train and then test the model.The output is classified as "High" if the final score is greater than or equal to 500; otherwise, it is "Low".The algorithm generates a graphical user interface webpage to train and then test the data as shown in Figure 21.First, data are trained using the imported dataset with k-value = 2 as Figures 21 and  22 show.Then, the decision makers need to test the model by importing the input EFQM dimensions' criteria.Final scores are predicted and a message showing either "High" or "Low" is generated.If the result is "high", the webpage shows a message that you reached operational excellence, as shown in Figure 23; otherwise, it returns the inputs with the lowest score and gives suggestions to decision makers to improve their final score, as shown in Figure 24.

New EFQM Model Results
The same AI framework used in the previous section is used when the new EFQM dataset is given for the sake of comparison, knowing that the new EFQM has only seven input criteria rather than nine.Different AI models were used to train the framework with the new EFQM dataset.Table 3 shows the output accuracy for these AI models used with the new EFQM.

New EFQM Model Results
The same AI framework used in the previous section is used when the new EFQM dataset is given for the sake of comparison, knowing that the new EFQM has only seven input criteria rather than nine.Different AI models were used to train the framework with the new EFQM dataset.Table 3 shows the output accuracy for these AI models used with the new EFQM.Figure 27 shows the elbow diagram when the new EFQM is used to choose the suitable k-value for the k-means clustering algorithm, which is where the curve starts to decrease, and before it is steady.In this case, k can be chosen to be between 2 and 5. K = 2 was chosen for accuracy issues.As discussed earlier in the old EFQM section, Random Index adjusted for chance was used to compare similarities between clusters.ARI (NewEFQM) = 0.5913 for K = 2, ARI (new EFQM) = 0.41 for K = 3. decrease, and before it is steady.In this case, k can be chosen to be between 2 and 5. K = 2was chosen for accuracy issues.As discussed earlier in the old EFQM section, Random Index adjusted for chance was used to compare similarities between clusters.Figure 28 shows the correlation between the new EFQM's dimensions.It shows that Figure 28 shows the correlation between the new EFQM's dimensions.It shows that the new EFQM dimensions are more correlated with each other than the old EFQM dimensions.There are many strong correlations (0.9), such as rhose between "Organizational Culture and Leadership" and "Purpose, Vision & Strategy".Figure 29 shows very low accuracy when using the new EFQM model and applying the k-means clustering.This value remained low even when the k-value was changed.

Conclusions
In this research, EFQM input criteria are collected and used as training datasets for AI models.After several simulations with different AI models, it was deduced that K-means unsupervised machine learning is the most suitable for the data collected.After the model is trained, the framework can be tested when organizations' decision makers insert the EFQM input criteria to obtain the framework's expected output.EFQM output accuracy was calculated and it was found that K-means clustering works better with the old EFQM than with the new EFQM.If more new EFQM data are obtained, then the framework maybe modified into a gradient boosting regression model (according to output accuracy).The k-value used for K-means clustering was chosen to be two after various simulations with different k-values.Different k-values result in lower EFQM output accuracy.The EFQM output predicted score is classified as either "High" or "Low".
When testing the framework, if the EFQM output score is "Low", the framework returns the lowest EFQM input criterion with recommendations to decision makers for self-improvement.Using this framework saves time and money before anorganization applies for the EFQM excellence award.

Conclusions
In this research, EFQM input criteria are collected and used as training datasets for AI models.After several simulations with different AI models, it was deduced that K-means unsupervised machine learning is the most suitable for the data collected.After the model is trained, the framework can be tested when organizations' decision makers insert the EFQM input criteria to obtain the framework's expected output.EFQM output accuracy was calculated and it was found that K-means clustering works better with the old EFQM than with the new EFQM.If more new EFQM data are obtained, then the framework maybe modified into a gradient boosting regression model (according to output accuracy).The k-value used for K-means clustering was chosen to be two after various simulations with different k-values.Different k-values result in lower EFQM output accuracy.The EFQM output predicted score is classified as either "High" or "Low".
When testing the framework, if the EFQM output score is "Low", the framework returns the lowest EFQM input criterion with recommendations to decision makers for self-improvement.Using this framework saves time and money before anorganization

Conclusions
In this research, EFQM input criteria are collected and used as training datasets for AI models.After several simulations with different AI models, it was deduced that K-means unsupervised machine learning is the most suitable for the data collected.After the model is trained, the framework can be tested when organizations' decision makers insert the EFQM input criteria to obtain the framework's expected output.EFQM output accuracy was calculated and it was found that K-means clustering works better with the old EFQM than with the new EFQM.If more new EFQM data are obtained, then the framework maybe modified into a gradient boosting regression model (according to output accuracy).The k-value used for K-means clustering was chosen to be two after various simulations with different k-values.Different k-values result in lower EFQM output accuracy.The EFQM output predicted score is classified as either "High" or "Low".
When testing the framework, if the EFQM output score is "Low", the framework returns the lowest EFQM input criterion with recommendations to decision makers for self-improvement.Using this framework saves time and money before anorganization applies for the EFQM excellence award.
The basic significance of this research is to improve the operational excellence in public and private organizations.This research is innovative since it adds to the knowledge body the new concept of injecting AI following the ISO/IEC 23053 standard into the EFQM, leading to operational excellence.This can be of great value for organizations seeking to enhance their performance and attain recognition in the field of quality management.
This research paper guides the way for future studies.Benchmarking between different business excellence models can be studied when using different machine learning techniques.Quality 4.0, or the new EFQM can also be used to predict operational excellence using different AI techniques.The model can be applied to different industries worldwide, and then benchmarking can be performed.

Figure 4 .
Figure 4. EFQM papers classified by countries, publication year, and sector.

Figure 4 .
Figure 4. EFQM papers classified by countries, publication year, and sector.

Figure 7 .
Figure 7. Elbow diagram to determine k-value in old EFQM.

Figure 7 .
Figure 7. Elbow diagram to determine k-value in old EFQM.

Figure 7 .
Figure 7. Elbow diagram to determine k-value in old EFQM.

Figure 8 .
Figure 8. Accuracy of 196-row dataset.When the labeling is independent of the number of clusters and samples, the ARI can still be sensitive to the similarity between the two clusters.If the clusters are completely random or unrelated, the ARI would be close to 0. On the other hand, if the clusters are identical, the ARI would be 1.ARI (old EFQM) = 0.85 for K = 2 ARI = (new EFQM) = 0.62 K = 3 Therefore, ISO/IEC 23053 emerged to provide standardization for machine learning AI.The ISO/IEC 23053 includes the following stages: task (problem definition), model, data, software tools and techniques [52].Moreover, ISO/IEC 23053 designed the machine learning framework consisting of an AI system life cycle and machine learning pipeline as shown in Figure 9.The ISO/IEC 23053 standard adds regulations to the properties of AI like risk management, security, explainability, and fairness [52].

Figure 10 .
Figure 10.Outline for predicting operational excellence.The design science research methodology is the methodology used in this paper research.Wieringa explained design science methodology as the creation and search for artifacts in context.Artifacts communicate with any difficulties found in the context or overall environment to ensure continuous improvement [62].The two types of research problems in design science are design problems and knowledge questions.Design problem research aims to create an artifact that will improve a problem context, taking into account stakeholder goals.Multiple solutions for a specific design research problem are possible and the effectiveness of these solutions is evaluated with respect to stakeholder goals.Knowledge question research attempts to answer an analytical or empirical knowledge question about an artifact without necessarily changing the artifact itself.Knowledge questions can have multiple answers and involve a level of uncertainty.The answers to a knowledge question have to be evaluated by truth, which is independent from the stakeholders' goals[62].Analytical knowledge questions are answered by analyzing concepts, while empirical knowledge questions are answered by collecting and analyzing data[63].The framework of the design science research methodology is represented in Figure11[62].As shown, the design science framework includes a social context, which consists

Figure 10 .
Figure 10.Outline for predicting operational excellence.The design science research methodology is the methodology used in this paper research.Wieringa explained design science methodology as the creation and search for artifacts in context.Artifacts communicate with any difficulties found in the context or overall environment to ensure continuous improvement [62].The two types of research problems in design science are design problems and knowledge questions.Design problem research aims to create an artifact that will improve a problem context, taking into account stakeholder goals.Multiple solutions for a specific design research problem are possible and the effectiveness of these solutions is evaluated with respect to stakeholder goals.Knowledge question research attempts to answer an analytical or empirical knowledge question about an artifact without necessarily changing the artifact itself.Knowledge questions can have multiple answers and involve a level of uncertainty.The answers to a knowledge question have to be evaluated by truth, which is independent

Figure 12 .
Figure 12.Design science framework applied to this paper.

Figure 12 .
Figure 12.Design science framework applied to this paper.

Figure 12 .
Figure 12.Design science framework applied to this paper.

Figure 14 .
Figure 14.System architecture diagram of the AI-integrated framework.Anaconda software 2.5.0 is used to run the python code.The k-means clustering technique used in the framework applies the ISO/IEC 23053 standard as follows: in the data acquisition state, data are collected and cleaned, while the design and development modelling stage in the ML life cycle refers to the modelling phase of the above framework.Data in this stage are trained.

Figure 14 .
Figure 14.System architecture diagram of the AI-integrated framework.Anaconda software 2.5.0 is used to run the python code.The k-means clustering technique used in the framework applies the ISO/IEC 23053 standard as follows: in the data acquisition state, data are collected and cleaned, while the design and development modelling stage in the ML life cycle refers to the modelling phase of the above framework.Data in this stage are trained.

Figure 14 .
Figure 14.System architecture diagram of the AI-integrated framework.Anaconda software 2.5.0 is used to run the python code.The k-means clustering technique used in the framework applies the ISO/IEC 23053 standard as follows: in the data acquisition state, data are collected and cleaned, while the design and development modelling stage in the ML life cycle refers to the modelling phase of the above framework.Data in this stage are trained.

Figure 15 .
Figure 15.Data acquisition, data preparation, and modelling states.

Figure 16 .
Figure 16.Verification and validation, and operation and monitoring states.

Figure 15 .
Figure 15.Data acquisition, data preparation, and modelling states.

Figure 15 .
Figure 15.Data acquisition, data preparation, and modelling states.

Figure 16 .
Figure 16.Verification and validation, and operation and monitoring states.Figure 16.Verification and validation, and operation and monitoring states.

Figure 16 .
Figure 16.Verification and validation, and operation and monitoring states.Figure 16.Verification and validation, and operation and monitoring states.

Figure 19 .
Figure 19.SPSS correlation of EFQM dimensions and the total score.

Figure 20
Figure20is a Google Colab heat map simulation showing the same results.The highest correlation is between the "Society Results" dimension and the "People Results" and "Customer Results" dimensions with values of 0.6 and 0.5, respectively.

Figure 19 .
Figure 19.SPSS correlation of EFQM dimensions and the total score.

Figure 20
Figure20is a Google Colab heat map simulation showing the same results.The highest correlation is between the "Society Results" dimension and the "People Results" and "Customer Results" dimensions with values of 0.6 and 0.5, respectively.

Figure 19 .
Figure 19.SPSS correlation of EFQM dimensions and the total score.

Figure 20
Figure20is a Google Colab heat map simulation showing the same results.The highest correlation is between the "Society Results" dimension and the "People Results" and "Customer Results" dimensions with values of 0.6 and 0.5, respectively.The algorithm is implemented via Google Colab, which is used to design a code to train, test, and predict operational excellence given a dataset.First, libraries are defined.Then, the 196row database is imported and read.After the code is run, a link will appear for decision makers to use which will forward them into a new tab where they will be asked to train and then test the model.The output is classified as "High" if the final score is greater than or equal to 500; otherwise, it is "Low".The algorithm generates a graphical user interface webpage to train and then test the data as shown in Figure21.First, data are trained using the imported dataset with k-value = 2 as Figures21 and 22show.Then, the decision makers need to test the model by importing the input EFQM dimensions' criteria.Final scores are predicted and a message showing either "High" or "Low" is generated.If the result is "high", the webpage shows a message that you reached operational excellence, as shown in Figure23; otherwise, it returns the inputs with the lowest score and gives suggestions to decision makers to improve their final score, as shown in Figure24.

Figure 24 .
Figure 24."Low" output.Next, the case of having more than two dimensions with the same lowest input score is studied, and is shown in Figures25 and 26.Leadership, people results, and society results have the same lowest input score = 10.The output returns the lowest three dimensions with recommendations for each to improve.

Figure 24 .
Figure 24."Low" output.Next, the case of having more than two dimensions with the same lowest input score is studied, and is shown in Figures25 and 26.Leadership, people results, and society results have the same lowest input score = 10.The output returns the lowest three dimensions with recommendations for each to improve.

Figure 24 .
Figure 24."Low" output.Next, the case of having more than two dimensions with the same lowest input score is studied, and is shown in Figures25 and 26.Leadership, people results, and society results have the same lowest input score = 10.The output returns the lowest three dimensions with recommendations for each to improve.

Figure 27
Figure27shows the elbow diagram when the new EFQM is used to choose the suitable k-value for the k-means clustering algorithm, which is where the curve starts to

Figure 27 .
Figure 27.Elbow diagram for determining k-value for new EFQM.

24 Figure 28 .
Figure 28.The heat map for new EFQM dimensional correlation.

Figure 29 .
Figure 29.Accuracy of new EFQM model.

Figure 28 .
Figure 28.The heat map for new EFQM dimensional correlation.

24 Figure 28 .
Figure 28.The heat map for new EFQM dimensional correlation.

Figure 29 .
Figure 29.Accuracy of new EFQM model.

Figure 29 .
Figure 29.Accuracy of new EFQM model.

Table 1 .
AI applications in different industries.

Table 2 .
Output accuracy values using different AI models for old EFQM.

Table 3 .
Output accuracy for different AI models used with new EFQM.

Table 3 .
Output accuracy for different AI models used with new EFQM.