Next Article in Journal
Symmetry-Oriented Dynamic Routing Planning Algorithm for Reliable Map Fusion in Distributed UAV Communication Networks
Previous Article in Journal
Research on Load Forecasting Prediction Model Based on Modified Sand Cat Swarm Optimization and SelfAttention TCN
Previous Article in Special Issue
Route Optimization and Scheduling for Asymmetric Micromobility-Based Logistics
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Computer Simulation Everywhere: Mapping Fifteen Years Evolutionary Expansion of Discrete-Event Simulation and Integration with Digital Twin and Generative Artificial Intelligence

by
Ikpe Justice Akpan
1,* and
Godwin Esukuku Etti
2
1
Department of Information Systems and Business Analytics, Kent State University, 800 E. Summit Street, Kent, OH 44240, USA
2
Faculty of Management Sciences, University of Port Harcourt, Port Harcourt 500272, Rivers State, Nigeria
*
Author to whom correspondence should be addressed.
Symmetry 2025, 17(8), 1272; https://doi.org/10.3390/sym17081272
Submission received: 4 June 2025 / Revised: 20 July 2025 / Accepted: 29 July 2025 / Published: 8 August 2025
(This article belongs to the Special Issue Symmetry/Asymmetry in Operations Research)

Abstract

Discrete-event simulation (DES) as an operations research (OR) technique has continued to evolve since its inception in the 1950s. DES evolution mirrors the advances in computer science (hardware and software, processing speed, and advanced information visualization capabilities). DES overcame the initial usability obstacles and lack of efficacy challenges in the early 2000s to remain a popular OR tool of “last resort.” Using bibliographic data from SCOPUS, this study undertakes a science mapping of the DES literature and evaluates its evolution and expansion in the past fifteen years. The results show asymmetrical but positive yearly literature output; broadened DES adoption in diverse fields; and sustained relevance as a potent OR method for tackling old, new, and emerging operations and production issues. The thematic analysis identifies DES as an essential tool that integrates and enhances digital twin technology in Industry 4.0, playing a central role in enabling digital transformation processes that have swept the industrial space in manufacturing, logistics, healthcare, and other sectors. DES integration with generative/artificial intelligence (GenAI/AI) provides a great potential to revolutionize modeling and simulation activities, tasks, and processes. Future studies will explore more ways to integrate GenAI tools in DES.

1. Introduction

Computer simulation is an operations/operational research (OR) technique often deployed to model complex, dynamic, and non-linear systems with interactions among several stochastic elements and components. Over six and a half decades ago, John Harling [1], while evaluating the launch of simulation in 1957/1958, nicknamed it a tool of “last resort” [1,2], so-called because simulation is often adopted as a problem-solving or decision support system when other OR techniques cannot produce an optimal solution [1,2,3,4]. In those circumstances, mathematical models and other OR techniques cannot model systems behavior accurately, or it is difficult to break down complex systems into simpler, manageable, analytical constructs [1,3]. Another reason for preferring the simulation method occurs when experimenting with the actual system is impossible or unsafe [3,5]. On the other hand, the complexity and costs associated with developing simulation studies can be complicated, making it a tool of “last resort” when other OR methods fail [3,6]. Further, simulation as an analytical tool can be complex, putting the developers/experts and other stakeholders involved in the simulation and modeling project in a puzzling situation [3,5,6,7]. On occasions when simulation experts have little or no background in the application domain, any “aha moments” (moments of insight) become the only means of achieving breakthroughs [3,7,8]. Similarly, the potential users of simulation techniques for decision making (e.g., managers and decision makers) who are familiar with the application domains can also find it difficult to relate to the technical model and need to generate ideas or discover knowledge to enhance their understanding of the model and simulation [6,7,8].
Simulation can be classified as discrete event or continuous based on how the state variables change during model run or experimentation [9,10]. In a continuous simulation, variables change continuously, usually through a function in which time is a variable. Its state changes all the time, not just at the time of some discrete events [3,9]. For example, the water level in a reservoir with given inflows and outflows may change continuously. In such cases, “continuous simulation” is more appropriate, although discrete-event simulation (DES) can serve as an approximation [3,5,10]. Conversely, DES explains the state variables that change instantaneously at distinct points in time. Its events occur at intervals, and the number of events is finite [3,5,11]. Discrete simulation models address what happens to the individual elements in the system and proceed to the succeeding interacting components [3,11]. For instance, in a road traffic problem, car arrivals and departures from traffic points occur at distinct points in time, referred to as events. Nothing happens between two consecutive events, which makes the arrival and departure events discrete [3,11]. The events refer to an occurrence at a time that changes the state of the system, e.g., the arrival of a customer at the service point [12]. The DES process often involves experimentation on a computer-based model that depicts a replica of a real system, with the model acting as a vehicle for experimentation, often in a trial-and-error manner [13,14]. This study focuses on the evolution and expansion of DES.
DES growth has not been without challenges. Starting in the mid-2000s, the simulation community began to raise concerns about the future of DES practice as demonstrated in several studies (e.g., “Simulation modeling is 50, do we need a reality check?” [15], “DES, where to next?” [16], and more). By 2010, a panel discussion entitled “DES is dead, long live agent-based simulation!” (ABS) was held during the annual OR society simulation workshop in Worchester, UK [17]. This concern was re-echoed at a panel presentation during the 2011 Winter Simulation Conference [18]. The general notion from these debates considered DES to have outlived its usefulness while welcoming the “new bride,” ABS [17]. ABS’s key strengths center on the ability to capture the “complexity arising from individual actions and interactions” that mimic the real world [17,19]. However, these ABS features that captured the interests of practitioners and researchers in OR and other disciplines, including mathematics and computer science, sociology, and psychology, are also available in DES [19]. Although few voices rose to defend DES’s continuous relevance [19], the discussion against it appeared louder until a third option arose, proposing a “holy matrimony” between ABS and DES [20,21], or with other methods, such as systems dynamics [22,23], to combine two methods to create a hybrid model [20,21,22,23] as the only survival technique.
In the end, DES survived the obstacles and the scare of having outlived its usefulness to remain a popular OR method used to solve diverse problems in several industries. In the winter of 2017, simulation experts in academia and industry assembled at Red Rock Casino Resort and Spa, Las Vegas, USA, during the Winter Simulation Conference (WSC), entitled “WSC turns 50: Simulation everywhere” [24], pointing to the continuous expansion of the simulation method. In 2020 when the coronavirus disease 2019 (COVID-19) broke out, DES became a potent OR tool in addressing diverse disease infection problems, including making spread forecasts, assigning and optimizing intensive care unit beds, initiating and testing healthcare management control strategies, and making critical decisions regarding COVID-19 vaccination problems [25,26,27,28].
Recently, to further enhance the evolution and expansion of DES and improve model and simulation tasks, activities, and processes, researchers and industry practitioners are integrating artificial intelligence (AI)/generative artificial intelligence (GenAI) into DES processes to enhance simulation and modeling capabilities. Reviewing the transformative capabilities of AI/GenAI and large language models (LLMs) technology to improve productivity and efficiency raises questions about the potential for AI technologies to enhance similar benefits in DES.
This study extends the discourse on the continued evolution, expansion, and recent integration of new technologies over the past decade and a half. Specifically, the study addresses the following five research objectives:
  • RO1. Assess the evolutionary expansion of DES research.
  • RO2. Analyze the research landscape to uncover the thematic structure, applications, and evolution.
  • RO3. Evaluate the intellectual structure to highlight the impacts of documents and sources’ citations and impact.
  • RO4. Analyze the social structures of DES research and identify authors’ and countries’ collaborations.
  • RO5. Examine the recent developments involving DES integration with digital twin (DT) and AI/GenAI technologies.
The rest of the paper is organized as follows: Section 2 presents DES modeling processes, activities, and tasks. Section 3 addresses the materials and methods, including the bibliometric analysis framework, data collection processes and procedures, and analysis techniques. Section 4 presents and discusses the results. The final part, Section 5, concludes the paper and identifies the potential future research areas.

2. Background and Overview of Discrete-Event Simulation and Modeling Processes

2.1. Overview of Discrete-Event Simulation

DES processes involve designing real or imaginary operations models to analyze complex systems and behavior through experimentation. Understanding the systems’ behavior by conducting experiments with a simulation model helps to evaluate strategies for improving operational outcomes and decision making [29]. Assumptions are often made about the systems and transformed into mathematical algorithms and relationships to reveal operational functionality and performance [3,29,30]. This section presents the modeling and simulation processes, activities, and tasks.

2.2. Modeling Activities, Tasks, and Processes

DES as an OR technique is used to solve complex dynamic problems where exact analytic and mathematical methods are problematic or not feasible [3,30,31]. It often involves “experimentation on a computer-based model” of a replica system, the model acting as a “vehicle for experimentation” based on a “what if” scenario and other statistical design techniques [3,5,31]. Figure 1 presents DES modeling activities, tasks, and processes.
The first step in the simulation and modeling process involves problem definition or formulation. It involves analyzing the system layout and requirements, setting the objectives of the simulation study, and defining the process flow [3,5]. Other activities include preparing a list of problems to address, identifying a set of assumptions, and determining the questions the project seeks to answer based on data availability [3,30,32].
In the second step, the analyst creates a conceptual model, which is an abstract or logical representation of a proposed or imaginary operational system based on some problem specifications. The model can be represented by a diagram or pictorial sketches showing the system’s process flow or layout. The analyst can also supplement the conceptual model with text or pictures [5,30,33,34]. When the conceptual modeling process employs a visual display technique, the model elements and the system’s components use graphic symbols, sketches, or block diagrams supplemented by text. Further discussions about conceptual modeling activities in DES are available elsewhere [30].
Model development is the next step in the DES modeling process. This step involves implementing the conceptual model using a computer program or by “drag and drop” of elements utilizing modeling and simulation software [3,35]. Most DES modeling and simulation efforts today use commercial software, making it possible to build models without recourse to extensive programming. Graphical images can employ 2D or 3D graphics. The parameters are also defined by using drop-down menus and command of the DES software. Examples of model-building and simulation applications today include WITNESS/VR, FlexSim, Simul8, Arena, and more [36,37].
The fourth step involves model validation. This is a process of determining whether a simulation model accurately represents the system based on set objectives [38,39,40]. The activities include checking and correcting errors in the model, such as logic, routing, wrong component combinations, or systems errors [12,39,41]. Validation helps to ensure that the simulation model accurately mimics the real-world system. The validation process also includes designing and effecting appropriate correction mechanisms. On the other hand, model verification is concerned with determining whether the model of the system of interest has implemented the conceptual model accurately together with the assumptions [34,40]. Recent studies have emphasized using 3D visualization to validate DES models. Visualizing modeled operations in 3D helps to generate insight and offers substantial help to the analyst in debugging simulation models and verifying that the model accurately represents the modeled system [39]. The visual display also enables all stakeholders to be involved in the validation and verification process, as they can observe the model behavior visually and provide feedback on how well it matches the existing system [42].
Experimentation and analysis are the next steps in the DES process. They involve investigating alternative courses of action to arrive at a preferred solution to improve the system of interest. The simulation analyst can observe the model behavior at runtime and alter parameters to examine alternatives. Other important activities include collecting output statistics, undertaking multiple replications, and undertaking statistical analysis [3,5,43]. Most experimentation and analysis also involve optimizers [5,28,43], which help to obtain optimal solutions. Like the validation process, visualizing the model, preferably using a 3D display, can be beneficial during experimentation and analysis. Proponents posit that using 3D visualization during experimentation enhances ease of analysis and generates ideas about the modeled system. Visualizing the model at runtime and in real-time using 3D/VR during experimentation reveals the entities’ actual and dynamic positions [39]. It provides true-to-scale graphics and animation, making simulation models easy to understand and invaluable for communicating new ideas and alternatives [39,41].
After experimentation comes the presentation of results and communication with clients or project owners. Visual simulation is quite effective for presenting simulation outcomes and communication with clients. Using 3D graphics and VR for these tasks can simplify the presentation and interpretation of simulation results to the users, especially to the managers and other decision makers who typically have little knowledge of statistics and computer simulation. The 3D/VR model can communicate accurate physical details, making simulation models easy to understand [36,44]. Further, using 3D graphics can simplify the presentation of the results for technical and non-technical stakeholders and decision makers. Visualizing the model offers immense benefits in conveying ideas to senior management and the board [36]. Viewing all aspects of an operation in a 3D animated model can improve users’ understanding, increasing the sense of participation and involvement of managers and other stakeholders.

2.3. Limitations of Simulation

DES, like other simulation methods, has several limitations. Sometimes it is challenging to create simulation models that accurately replicate the actual system due to the unavailability of data to describe the system’s behavior. It is common for a model to require input data that is limited or unavailable. This issue must be addressed prior to the design of the model to minimize its impact once the model is completed. Further, computer simulation can prove too expensive and time consuming to implement. A DES model is often implemented as a computer program or as some input into simulator software. Producing an efficient and workable computer program may take surprisingly long and can be complicated to implement [3]. Although general-purpose simulation software can reduce the time to produce simulation models/programs, it can be expensive to obtain.

3. Materials and Methods

3.1. Bibliometric Analysis

This study employs quantitative bibliometric analysis method incorporating performance analysis and science mapping of DES research using bibliographic data. The performance measures incorporate quantitative evaluation of the scientific research relating to productivity or publications output and a citation impact analysis of the published document, authors, institutions, and countries [45]. The science mapping components assess the thematic structure, trends, and co-occurrence of themes over time [45,46]. It also undertakes an assessment of the evolutionary trends in research to reveal theme dynamics over time, demonstrated through text analytics and mapping using keywords as the unit of analysis [47,48,49].
Another aspect the bibliometric analyses highlight relationships, social interactions, and collaborations among publications, authors, institutional affiliations, and countries [48,49]. In this study, the aspect involving recent developments utilizes qualitative analysis to evaluate the potential impact of recent technologies on the DES modeling activities and processes identified in Figure 1 in the previous section.

3.2. Data Collection

The data used in this study came from peer-reviewed journal articles, conference proceedings, and book chapters published between the period of 2010 and 2024 and indexed in the SCOPUS bibliographic database. The rationale for using SCOPUS as the data source is that it indexes a wide coverage of literature from nearly all disciplines from quality sources [50,51,52]. A query string (Table 1) was created using relevant keywords on DES and applications. The use of wildcards (*) ensured that all application documents were retrieved, which were subjected to stringent filtering processes. The database survey and data collection occurred in December 2024.
The bibliographic database interface offers the option to extract as plain text (.txt), Excel (.xlsx), or comma-separated value (.csv) files. The extracted data in the comma-separated file format went through further filtering, screening, and selection processes. During the screening process, non-peer-reviewed publications, duplicate entries, and irrelevant titles were removed, leaving 2077 screened publications. Table 1 shows the query string created using the search keywords and the filtering and selection criteria. Metadata was then extracted from the screened documents and exported as .csv files for processing and analysis.

3.3. Data Analytics Tools and Techniques

Recent advances in big data analytics and the availability of software solutions (including open-source software) offer more effective and efficient ways to carry out data analysis. This study employed VOSviewer_1.6.20 [53,54] and the BIBLIOMETRIX R package 5.1.0, a bibliographic analysis software library embedded in the R-Studio environment [55].
The above two applications help to produce quantitative bibliometric outputs, network analysis, and visualization [53,54,55]. Quantitative data analytics includes statistical evaluation of publications, trends, and performances and mapping the relationships among the published documents [56,57]. Network analysis and visualization can also enrich result presentation from bibliometric analyses [53,54]. The performance measures include publication trends, citation impacts, and collaboration indexes [51]. The science mapping and evaluation offers co-citation analysis and co-occurrence of keywords analysis to identify the research streams and themes. Bibliometric coupling and co-authorship analyses highlight relationships and social interactions among publications, authors, affiliations, and countries [55,56]. These techniques help to analyze the conceptual, intellectual, and social structures of the scientific literature produced on DES.

4. Results

4.1. Sample Description and Preliminary Results

Table 2 presents the summary statistics analyzed using the bibliographic metadata extracted from the 2077 SCPs (journal articles: 885 or 42.6%; conference proceedings: 1132 or 54.5%; book chapters: 60 or 2.9%). The results also highlight 19.3% international cooperation among co-authors across several regions, showing that DES topics attract a global audience among researchers and practitioners and affirm that simulation is everywhere. Also, the published documents appeared in 947 sources authored/co-authored by 5627 researchers from 89 countries. The analysis of results in Section 4 helps answer the research questions (RO1 to RO4) presented earlier in Section 1.

4.2. Scientific Literature Production Trend on DES

This section examines the first research objective (RO1) about the evolutionary expansion of DES research evidenced by scientific literature production (SLP). The analysis of SLP identifies the yearly publications covering the past fifteen years (2010 to 2024), as shown in Figure 2a. The results show an annual average SLP of 138.5. There were more conference proceedings than journal articles by about 12%. However, this is not unusual in the technology fields, where initial innovations are often presented at international conferences before appearing in journals. While the SLP in the first three years was at or slightly below the annual average, the subsequent years recorded above-average annual SLPs. The highest number of publications for any single year occurred in 2020, during the outbreak of COVID-19, when scientists utilized DES as a potent tool to analyze various pandemic-related problems [25,26]. Overall, the analysis using R-Bibliometrics shows an annual productivity trend of 2.03% (Table 2).
Figure 2b presents a scatter plot of the SLP for the same period to visualize the literature productivity trend, which fits a linear trend. While the SLP is at the mean for some years, others are slightly above or below it. The linear model produced the regression equation y = 2.232x + 120.61, where x is the nth year, and y is the total SLP. The coefficient of determination (R2 = 0.40) indicates that time predicts about 40% of the variation in SLP (annual increases). The model is appropriate for this dataset because the trend of the SLP over time exhibits growth.

4.3. Domains of Discrete-Event Simulation Research and Practice

The second research objective (RO2) analyzes the research landscape to uncover the thematic structure of DES, its applications, and evolution. This section evaluates the DES application domains.
DES as an OR technique can be utilized to solve problems in several sectors and fields of endeavor and to support decision making in operations and production activities. The SCOPUS bibliographic data identifies enormous application areas (over 100). However, we collapsed and merged related areas (e.g., computer science theory, applications, and more) into one category named “computer science.” Figure 3 presents the summary of the identified domains, some of which include computer sciences (26%), engineering (21%), mathematics, business management and decision sciences (20), medical and health sciences, computer science and engineering, business and economics, and arts and humanities. Figure 3 shows twelve disciplines where DES plays a significant role in problem solving, especially systems optimization.

4.4. Thematic Structure of DES Research and Evolution

This section analyzes the thematic structure and evolutionary trends through a science mapping of DES research and practice. The preliminary results of the text analytics using R-Bibliometrix identified 4121 unique but unstemmed author keywords with a total word frequency of 7501 extracted from 2077 SLPs.
The basis for using authors’ keywords as an approximation to the thematic structure of research is established in the literature [50,51,52,53,54]. To ensure exhaustive thematic analytics, the sample is stratified into three categories based on word frequency (f), which explains the number of times each keyword re-occurs in the dataset. The categorizations are as follows:
  • Prominent themes, defined by prominent keywords with a frequency (f) of 10 or more, (f ≥ 10);
  • Emerging themes, having keyword frequencies between 4 and 9 (4 ≤ f < 10);
  • Least frequent themes (f < 4) and evolutionary trends during the period (2010–2024).
The classification of keywords as prominent, emerging, and least frequent themes (f ≥ 10; 4–9; f < 4, respectively) is based on convenience and to ensure an exhaustive analysis rather than following any statistical method.

4.4.1. Prominent Themes

The text analytics using R-Bibliometrix highlight the most popular research themes on DES in the past fifteen years (from the period of the threat of DES extinction [discussed in the introduction] to the period of “simulation everywhere”). The results identify 53 unstemmed author keywords with a total word frequency of 1991 (f = 1991) or 26.5%. These terms, which represent the research themes on DES and modeling, went through a “stemming” process. Word “stemming” is a text analytics process involving merging terms with different spellings but the same meaning or synonyms, e.g., “modeling/modelling” [57]. The stemming process reduced the themes from 53 to 44 (Table 3). The three most popular themes other than “DES,” “simulation,” or “modeling” included “optimization,” “healthcare,” and “logistics,” appearing 61, 35, and 31 times, respectively. This result shows that DES continues to tackle problems in core OR/management sciences areas.
Similarly, terms such as “industry 4.0,” “digital twin” (DT), and “COVID-19” being among the prominent themes indicates the continuous relevance of DES in tackling problems in emerging fields and technologies in the fourth industrial revolution and disease outbreak, such as the “SARS coronavirus-2” (SARS-CoV-2) [58].

4.4.2. Emerging Themes

This section analyzes the emerging themes based on author keywords that occurred between four and nine times (4 ≤ f < 10). The text analytics results using the R-Bibliometrix show 160 emerging themes with a total frequency of 869 times (f = 869 or 11.6% of the total word frequencies). Also, using the VOSviewer application, we created a network map and visualization of the thematic structure of DES and applications scientific literature landscape. The text analytics solution offers the functionality to remove nugatory and non-connected nodes and words that do not convey contextual meanings, leaving 148 terms. The text mining algorithm stratified the themes into thirteen (13) color-coded clusters. The nodes with the same color belonged to the same cluster throughout the network (Figure 4).
The cluster categorization contains some random elements. Removing a theme with several connected edges in the network can lead to a reclassification of the clusters. The identified research themes are more significant than the cluster where the terms are listed. The network visualization highlights the thirteen clusters as follows:
Cluster #1: (“discrete-event system,” “design of experiment,” and “experimentation.” Others are “evaluation” and “performance analysis”). These terms point to conducting simulation experiments to analyze designs and systems’ behavior or complex processes through what-if scenarios.
Cluster #2: (“modeling and simulation,” “conceptual modeling,” “validation,” and “model checking”) point to two crucial “modeling and simulation” activities: developing the conceptual model and checking errors in the programmed model, often carried out during experimentation explained above.
Cluster #3: The third cluster deals with “healthcare simulation” for “outpatient clinic” to determine “patient waiting time” and “appointment scheduling,” a vital area of DES applications.
Cluster #4: (“operational research,” “decision support systems,” “artificial intelligence,” “production planning and control”);
Cluster #5: (“cost-effectiveness analysis,” “multi-objective optimization,” “colorectal cancer”). These keywords point to model optimization, systems evaluation, and cancer diagnoses in healthcare.
Cluster #6: The cluster focuses on the use of “hybrid simulation” and “data envelopment analysis” to analyze “hospital” operations, “healthcare management,” and other “healthcare” issues.
Cluster #7: (“production scheduling,” “routing,” “transport”). DES plays key roles in efficient work scheduling, vehicle routing, and product scheduling.
Cluster #8: (“operations management,” “production planning,” “lean manufacturing,” and “manufacturing systems”). These themes show another aspect where DES is utilized to streamline operations.
Cluster #9: (“decision Support system,” “prediction,” “design”). The themes in this cluster relate to DES’s role as a tool for aiding decision making in facility design and making predictions.
Cluster #10: (“energy efficiency,” “sustainable manufacturing,” and “resource management”).
Cluster #11: (“production,” “reverse logistics,” “sustainability”). DES plays an important role as a tool to enhance sustainable and efficient production.
Cluster #12: (“emergency medical services,” “cost,” and “cloud computing”). Modeling and simulation of emergency services in healthcare and operations cost reduction forms a significant area of DES application.
Cluster #13: (“discrete-event system,” “queuing system,” and “Internet of Things”). The thirteenth cluster examines the DES application to evaluate queuing systems and the Internet of Things in Industry 4.0.
Cluster #14: (“discrete simulation” and “forecasting”). The two themes address the use of DES to make forecasts. Figure 4 presents the social network map showing the themes as labeled.

4.4.3. Least Frequent Themes and Trends

The least frequent themes category contains terms with word frequencies less than four (f < 4). The dataset contains 3908 terms, making up 95% (3908/4121) of the themes. In terms of word frequencies, it represents 4641 or 62% of the 7501 total keyword frequencies. The keywords are unstemmed, meaning that in the text analytics algorithm, words with similar meanings that are spelled differently are considered unique (e.g., “AI” and “artificial intelligence” are considered unique terms). The text analytics algorithm categorizes the keywords into color-coded clusters on a network map. The circles (nodes) with the same color belong to the same cluster. Also, in the legend (Figure 5), the node labels represent the research themes under focus in each period segment mapped to the period of occurrence or year of publication (pre-2014, that is, 2010 to 2014; 2014–2016; 2016–2018; 2018–2020; 2020–2024), as explained below.
The network map contains three categories of themes: DES theory, modeling and simulation processes, tasks and activities, and the diverse application areas. The clusters and the themes in each period segment are as follows:
  • Pre-2014: (“testing,” “data integration,” “queuing model,” “healthcare modeling,” “bed management,” “breast cancer,” and more).
  • 2014–2016: (“formal verification,” “work sampling,” “diagnoses,” “car sharing,” and more).
  • 2016–2018: (“layout design,” “artificial intelligence,” “automation,” “object-oriented modeling,” and more).
  • 2018–2020: (“core manufacturing simulation,” “manufacturing planning,” “fast-moving consumer goods,” “traffic congestion,” and more).
  • 2020–2022: (“supply chain planning,” “capacity analysis,” “virtual reality,” “crowd management,” “underground mining,” “artificial neural network”).
  • 2022–2024: (“mass vaccination,” “capacity analysis,” “load sharing,” “ambulance deployment,” and more).
  • post-2024: (“management science,” “sales operations planning,” “decomposition,” “artificial intelligence,” “additive manufacturing,” “collaborative networks,” and more).
The theme dynamics (pre-2014 to 2022–2024 and beyond) highlight the trends and evolution in the application of DES to solve diverse problems in several domains in the different period segments identified above. For example, in pre-2014 (2010–2014), themes such as “testing” point to model testing as one of the stages in the DES processes. Also, “data integration” represents one of the tasks during model experimentation where real-life or imaginary data can be integrated with a simulation model to investigate a “what-if” scenario. Other terms such as “healthcare modeling,” “breast cancer,” and “bed management” point to the application of DES to evaluate cancer diagnoses, hospital bed allocation, and utilization scenarios. Figure 4 shows the complete themes under this category.
The period segments of 2022–2024 and post-2024 identify themes such as “mass vaccination,” “capacity analysis,” and “ambulance deployment,” pointing to the use of DES to model and simulate critical health issues around COVID-19 vaccination. The current period (2024 and beyond) mirrors technological trends using DS methods, such as machine learning methodology and “generative adversarial networks” (Figure 5). The entire period (2010–2024) provides the evolutionary trends that highlight the continuous application of DES in research and problem solving in real-life issues over the years.

4.5. Intellectual Structure of DES Research

This section evaluates the intellectual structure of DES research based on a citation analysis in the era of “simulation everywhere” [24] and focuses on the impact of citations on documents and sources. The results help to address the third research objective (RO3). The preliminary results (Table 2) show an average of 9.5 citations per document (Table 2) and a total of 19,731 from 2010 to 2024 based on SCOPUS bibliographic data. The Google Scholar (scholar.google.com) citation count can be greater than the number of records in SCOPUS.
The citation structure analysis using the R-based Bibliometrix application (Table 4) shows that about 80% of the articles earned at least one or more citations, with the four highest citation impacts occurring in 2013 (95%), 2018 (93%), 2016 (89%), and 2015 (88%). Also, 35% of the current year publications with zero citable years received at least one citation. Table 4 presents the complete citation structure of the publications.

4.5.1. Most Cited Documents

Table 5 presents the top ten most cited publications. The results show that the article examining “DES and system dynamics in the logistics and supply chain context” [58] recorded the highest citation count. Table 5 presents the complete list of research focus, sources, and citations. Fifty percent of the ten most cited articles or conference papers had near maximum citable years. This result implies that citable years accounted for the high citation impacts, among other factors, such as the article title or the sources in which it appears. The most cited article appeared in some of the most popular sources (“Decision Support Systems” and “Journal of Operational Research Society”).

4.5.2. Eminent Sources

The 2077 documents analyzed in this study were published in 947 sources, giving an average of 2.2% publications per source. The analysis of eminent sources shows that the top twenty journals and proceedings published 23.3% of the documents and earned 7635 (38.7%) citations out of 19,731. Most of the journals and conference proceedings were core sources in OR, while others are sources in the application domains. Examples are Proceedings—Winter Simulation Conference, Simulation, and Journal of Simulation. These three sources published 205, 29, and 23 articles and proceeding papers and earned citation counts of 1667, 304, and 430. Others are Simulation Modelling Practice and Theory, European Journal of Operational Research, and Journal of the Operational Research Society. Sources in the application domains include Medical Decision Making, Health Care Management Science (healthcare), and Automation in Construction (engineering and construction). Table 6 presents the complete list of the top most eminent sources.

4.6. Social Structure of Publications

Countries’ Publications and Impact

The final part of the analysis examines the social structure of publications on DES research, which addresses the fourth research objective (RO4). Recently, the simulation community began paying attention to “simulation around the world,” which has become a track at conferences, such as the Winter Simulation Conference [65]. The results help to answer questions regarding collaboration among countries where the authors are domiciled as another measure of the social structure of publications in science mapping studies [50,51,53].
The results show 1968 unique authors from 89 countries that published articles used in this study, with a total frequency of 5429, as some authors published more than one articles. The international collaboration index results show a moderate association of 19.03% among the authors’ affiliated countries and international co-authorship.
Table 7 shows the USA, the UK, China, Germany, and Italy as the five most dominant countries in literature publications on DES and applications. The table shows a complete list of the top ten countries. The analysis also highlights the countries where the corresponding authors are domiciled, which follow a similar pattern as literature publications led by USA, the UK, and Italy. The USA published the highest number of articles (200, including 35 as corresponding authorship) through collaborations, the UK came second with 98 documents through global collaborations but had 22 corresponding authorships. The USA and UK also earned the most citations (2517 and 2315, respectively). Table 6 shows the complete list of the top 10 countries where the authors/co-authors are domiciled.

4.7. DES Integration with Digital Twin in Industry 4.0 and Artificial Intelligence

Since the inception of DES in the 1950s, developments in discrete-event modeling and simulation have often paralleled technological advances in computer science (hardware and software) and other related fields [66,67]. The analysis of the thematic evolution in this study identifies two key technologies that occurred in recent years, namely, “digital twin” (DT) listed in Table 3 and “artificial intelligence” (AI), identified in Figure 5. While DES has contributed towards the advancement or enabling DT technology in Industry 4.0 on the one hand, GenAI possesses demonstrable capability to transform DES and modeling activities, tasks performance, and processes. This section employs descriptive bibliometric analysis to analyze the integration of DES with DT and AI, which addresses the fifth research objective (RO5).

4.7.1. The Role of DES in Enhancing Digital Twin in Industry 4.0

In Table 3, DT is identified as one of the emerging themes in this study. While DT technology is generally considered a groundbreaking development in industry operations and processes, DES has contributed significantly to enhancing the advancement and smooth functioning of this technology since the advent of Industry 4.0 [66,67,68]. By definition, DT is a virtual system that forms a replica of a real physical system or process [69]. The virtual (DT) dynamic system updates in real time with data from its physical replica (twin), allowing for its predictive analysis, monitoring, and maintenance [66,69].
As identified in several studies reviewed in this article, e.g., [70,71], computer simulation, particularly DES and continuous simulation, provides the underlying black box, logical models, and the engine that enables the modeling and simulation of the virtual replica (DT) system that mimics the real physical counterpart. It helps the simulated twin system respond to the real-time data inputs. For example, in a DT of an assembly plant [72], a DES model simulates the flow of components, the operation of machines, the movement of workers, and the impact of breakdowns or delays. Similarly, DES has been utilized to simulate DTs for several other operations and processes (warehouse logistics [71]; production and manufacturing systems [73,74]; critical care delivery and healthcare workflow [75,76]). Integrating DES and using real-time data from the real physical systems (manufacturing, operations, logistics, and healthcare) enhances the predictive and diagnostic power of DT in the context of Industry 4.0 [77,78], particularly in complex, event-driven systems, thereby overcoming disruptions and inaccurate predictions for informed decision making.

4.7.2. DES Integration with Artificial Intelligence/Generative Artificial Intelligence

The attempt to integrate AI in DES to further transform computer modeling and simulation has been ongoing for quite some time. However, recent efforts in this direction are now yielding results, especially as AI applications in industry become increasingly ubiquitous, with AI integration with other systems and platforms to solving problems in operations and production activities and processes now common. Integrating AI (e.g., artificial neural networks [79], machine learning [80,81], and deep learning [82]) with DES offers a hybrid architecture that brings additional intelligence, adaptability, and learning capabilities, reinforcing the predictive capacity, optimization, and intelligent decision making of computer simulation [80,83].
Recently, the emergence of GenAI presents significant potential for rapid transformation in DES. GenAI is a subset of artificial intelligence (AI) that leverages large language models (LLMs), generative adversarial networks (GANs), and multimodal frameworks to create new content, including text, images, audio, code, and video [84,85,86]. For DES, the benefits of GenAI span several aspects of modeling and simulation activities and processes, from idea generation to formulating a simulation project proposal and defining DES project objectives to the actual creation of the simulation model and coding, model optimization, and results presentation. The DES literature also presents the significance of AI integration in solving problems in operations and production activities and processes. Integrating AI technologies (e.g., artificial neural networks [79], machine learning [80,81], and deep learning [82]) with DES offers a hybrid architecture that brings additional intelligence, adaptability, and learning capabilities, reinforcing the predictive capacity, optimization, and intelligent decision making of computer simulation [80,83].
Further, the emergence of GenAI presents significant potential for rapid transformation in DES. GenAI as a subset of AI leverages large language models (LLMs), generative adversarial networks (GANs), and multimodal frameworks to create new content, including text, images, audio, code, and video [84,85,86]. For DES, the benefits of GenAI cut across several aspects of modeling and simulation activities and processes, from idea generation to formulating a simulation project proposal and defining the DES project objectives to the actual creation of the simulation model, model optimization, results presentation, and enhancing the overall model usability [84,85,86,87,88].
Several studies reviewed in this article demonstrate the application of AI and GenAI in DES, highlighting significant promise for problem solving in various domains, as evidenced by real-world use cases. Ortiz-Barrios et al. [89] integrated DES and AI for “shortening bed waiting times” and “capacity management of intensive care units during the COVID-19 pandemic” [90], both in hospital operations. Others [84,85,86,87,91] identified the benefits of GenAI in creating the DES model from text descriptions by issuing prompts (text commands or instructions), which enables the GenAI tool (e.g., ChapGPT or others) to create a conceptual/graphical model. Furthermore, several GenAI tools demonstrate significant capacity to develop computer program codes for the DES model of systems and processes [84,85,86,87,89,91]. This development enables non-simulation experts and managers to write text prompts for the GenAI tool, thereby creating or developing DES models, which increases its efficacy, simulation, and modeling accessibility and improves usability [84,85,86,87,88,90,91]. This will further increase the use of DES as an OR technique, thus making computer simulation and modeling available everywhere.
Despite the above benefits, several limitations and drawbacks exist when using GenAI. Regarding the capacity of GenAI to generate synthetic data for simulation, such data sometimes fails to mimic real-world trends and may also contain false information, otherwise known as hallucinations [88,92,93,94]. Several other studies have also raised concerns about ethical issues, privacy violations, and intellectual property infringement by using data or information from unauthorized sources [85,88,92,93].

5. Conclusions

This study successfully analyzed the evolutionary expansion of DES as an OR technique, highlighting key development trends in simulation and modeling research and practice. Within the past fifteen years (2010–2024), DES scientific literature production has continued to expand, indicating increased usage, not only during the COVID-19 period [25,26] but also beyond. This study, therefore, extends the initial arguments that not only is DES “well and kicking” [19] or “alive and strong” [25] but continues to expand. Thus, DES has outlived the doom prediction of becoming obsolete [15,16,17], instead witnessing extensive expansion and popularity as an OR technique, hence the motif, “simulation everywhere.” Thus, DES enjoys continuous usage to solve diverse problems across several fields of endeavor. For example, DES remained an essential OR tool in tackling COVID-19-related problems [25] and has remained at the center of digital transformation that has swept across the industrial space, from manufacturing to healthcare and the service industry in recent years, therefore providing evidence of its continuous relevance. The DES publications analyzed in this study were published in several high-quality sources and generated citation impacts with high collaboration among institutions and countries, which further provides evidence about “simulation everywhere.”
Another notable highlight in DES evolution is the continuous adoption and integration of new technologies to improve simulation and modeling activities, tasks, and processes. During the period of 2010–2024, the key technologies integrated with DES included DT, AI, and GenAI. DES lends a hand in enhancing DT to realize its purpose of virtually simulating a replica of a real physical asset, monitoring its performance, making predictions, and making decisions about the maintenance and performance improvement of the real physical assets. As the simulated DT (virtual replica system) utilizes real data, it enables continuous feedback loops, predictive diagnostics, and synchronized system optimization.
The third contribution of this study examines the integration of AI in DES, including machine learning, artificial neural networks, and deep learning, which has further transformed the simulation landscape. The integration of AI with DES provides a hybrid architecture that enhances intelligence, adaptability, and learning capabilities. The incorporated intelligent components enable the DES model to adapt, learn from historical and streaming data, and autonomously enhance its predictive analytic capabilities. Similarly, the ongoing integration with GenAI brings the possibility of generating simulation models from text prompts. The development of GenAI adoption is significant as the technology becomes ubiquitous. Several industries, including healthcare, manufacturing, logistics, and smart cities, are increasingly adopting these integrated systems, thereby enhancing modeling and simulation experience and improving accessibility and usability.
Future work will continue to explore the integration of GenAI in every aspect of the DES processes, which is capable of further transforming the simulation and modeling experience and streamlining DES tasks and activities.

Author Contributions

Conceptualization, I.J.A.; methodology, I.J.A.; software, I.J.A. and G.E.E.; validation, I.J.A. and G.E.E.; formal analysis, I.J.A.; investigation, I.J.A.; resources, I.J.A. and G.E.E.; data curation, I.J.A.; writing—original draft preparation, I.J.A.; writing—review and editing, I.J.A. and G.E.E.; visualization, I.J.A. and G.E.E.; supervision, I.J.A.; project administration, I.J.A. and G.E.E. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Proprietary data used; authors are not authorized to share the data.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Harling, J. Simulation techniques in operations research—A review. Oper. Res. 1958, 6, 307–319. [Google Scholar] [CrossRef]
  2. Powers, M.J.; Sanchez, S.M.; Lucas, T.W. The exponential expansion of simulation in research. In Proceedings of the 2012 Winter Simulation Conference (WSC), Berlin, Germany, 9–12 December 2012; IEEE: New York, NY, USA, 2012; pp. 1–12. [Google Scholar]
  3. Pidd, M. Computer Simulation in Management Science, 5th ed.; Wiley: Chichester, West Sussex, UK, 2004; ISBN 0-470-09230-0. [Google Scholar]
  4. Fu, M.C. Optimization via simulation: A review. Ann. Oper. Res. 1994, 53, 199–247. [Google Scholar] [CrossRef]
  5. Brooks, R.J.; Robinson, S.L. Simulation and Inventory Control: Texts in Operational Research; Palgrave Macmillan: Basingstoke, UK, 2001. [Google Scholar]
  6. Akpan, I.J.; Shanker, M.; Razavi, R. Improving the success of simulation projects using 3D visualization and virtual reality. J. Oper. Res. Soc. 2020, 71, 1900–1926. [Google Scholar] [CrossRef]
  7. Akpan, I.J.; Brooks, R.J. Users’ perceptions of the relative costs and benefits of 2D and 3D visual displays in discrete-event simulation. Simulation 2012, 88, 464–480. [Google Scholar] [CrossRef]
  8. Jahangirian, M.; Taylor, S.J.; Young, T.; Robinson, S. Key performance indicators for successful simulation projects. J. Oper. Res. Soc. 2017, 68, 747–765. [Google Scholar] [CrossRef]
  9. Pathiraja, S.; Westra, S.; Sharma, A. Why continuous simulation? The role of antecedent moisture in design flood estimation. Water Resour. Res. 2012, 48. [Google Scholar] [CrossRef]
  10. Özgün, O.; Barlas, Y. Discrete vs. continuous simulation: When does it matter. In Proceedings of the 27th International Conference of The System Dynamics Society, Albuquerque, NM, USA, 26 July 2009; Volume 6, pp. 1–22. [Google Scholar]
  11. Goldsman, D.; Goldsman, P. Discrete-Event Simulation. In Modeling and Simulation in the Systems Engineering Life Cycle; Loper, M., Ed.; Simulation Foundations, Methods and Applications; Springer: London, UK, 2015. [Google Scholar] [CrossRef]
  12. Akpan, I.J.; Brooks, R.J. Experimental evaluation of user performance on two-dimensional and three-dimensional perspective displays in discrete event simulation. Decis. Support Syst. 2014, 64, 14–30. [Google Scholar] [CrossRef]
  13. Hoad, K.; Monks, T.; O’brien, F. The use of search experimentation in discrete-event simulation practice. J. Oper. Res. Soc. 2015, 66, 1155–1168. [Google Scholar] [CrossRef]
  14. Baril, C.; Gascon, V.; Vadeboncoeur, D. Discrete-event simulation and design of experiments to study ambulatory patient waiting time in an emergency department. J. Oper. Res. Soc. 2019, 70, 2019–2038. [Google Scholar] [CrossRef]
  15. Taylor, S.J.; Eldabi, T.; Riley, G.; Paul, R.J.; Pidd, M. Simulation modelling is 50! Do we need a reality check? J. Oper. Res. Soc. 2009, 60, S69–S82. [Google Scholar] [CrossRef]
  16. Taylor, S.J.; Robinson, S. So where to next? A survey of the future for discrete-event simulation. J. Simul. 2006, 1, 1–6. [Google Scholar] [CrossRef]
  17. Siebers, P.O.; Macal, C.M.; Garnett, J.; Buxton, D.; Pidd, M. Discrete-event simulation is dead, long live agent-based simulation! J. Simul. 2010, 4, 204–210. [Google Scholar] [CrossRef]
  18. Heath, S.K.; Brailsford, S.C.; Buss, A.; Macal, C.M. Cross-paradigm simulation modeling: Challenges and successes. In Proceedings of the 2011 Winter Simulation Conference, Phoenix, AZ, USA, 11–14 December 2011; Jain, S., Creasey, R.R., Himmelspach, J., White, K.P., Fu, M., Eds.; IEEE: New York, NY, USA, 2011; pp. 2783–2797. [Google Scholar]
  19. Brailsford, S. Discrete-event simulation is alive and kicking! J. Simul. 2014, 8, 1–8. [Google Scholar] [CrossRef]
  20. Brailsford, S.; Schmidt, B. Towards incorporating human behaviour in models of health care systems: An approach using discrete event simulation. Eur. J. Oper. Res. 2003, 150, 19–31. [Google Scholar] [CrossRef]
  21. Fakhimi, M.; Anagnostou, A.; Stergioulas, L.; Taylor, S.J. A hybrid agent-based and discrete-event simulation approach for sustainable strategic planning and simulation analytics. In Proceedings of the Winter Simulation Conference, Savannah, GA, USA, 7–10 December 2014; IEEE: New York, NY, USA, 2014; pp. 1573–1584. [Google Scholar]
  22. Brailsford, S.C.; Desai, S.M.; Viana, J. Towards the holy grail: Combining system dynamics and discrete-event simulation in healthcare. In Proceedings of the 2010 Winter Simulation Conference, Baltimore, MD, USA, 5–8 December 2010; IEEE: New York, NY, USA, 2010; pp. 2293–2303. [Google Scholar] [CrossRef]
  23. Viana, J.; Brailsford, S.C.; Harindra, V.; Harper, P.R. Combining discrete-event simulation and system dynamics in a healthcare setting: A composite model for Chlamydia infection. Eur. J. Oper. Res. 2014, 237, 196–206. [Google Scholar] [CrossRef]
  24. Page, E.H. WSC turns 50: Simulation everywhere! In Proceedings of the Winter Simulation Conference, Red Rock Resort, LV, USA, 3–6 December 2017. [CrossRef]
  25. Akpan, I.J.; Shanker, M.; Offodile, O.F. Discrete-event simulation is still alive and strong: Evidence from bibliometric performance evaluation of research during COVID-19 global health pandemic. Int. Trans. Oper. Res. 2024, 31, 2069–2092. [Google Scholar] [CrossRef]
  26. Currie, C.S.; Fowler, J.W.; Kotiadis, K.; Monks, T.; Onggo, B.S.; Robertson, D.A.; Tako, A.A. How simulation modelling can help reduce the impact of COVID-19. J. Simul. 2020, 14, 83–97. [Google Scholar] [CrossRef]
  27. Sala, F.; D’Urso, G.; Giardini, C. Discrete-event simulation study of a COVID-19 mass vaccination centre. Int. J. Med. Inform. 2023, 170, 104940. [Google Scholar] [CrossRef]
  28. Zeigler, B.P.; Mittal, S.; Traore, M.K. MBSE with/out Simulation: State of the Art and Way Forward. Systems 2018, 6, 40. [Google Scholar] [CrossRef]
  29. Hollocks, B.W. Discrete-event simulation: An inquiry into user practice. Simul. Pract. Theory 2001, 8, 451–471. [Google Scholar] [CrossRef]
  30. Brooks, R.J.; Wang, W. Conceptual Modelling and the Project Process in Real Simulation Projects: A Survey of Simulation Modellers. J. Oper. Res. Soc. 2015, 66, 1669–1685. [Google Scholar] [CrossRef]
  31. Akpan, I.J.; Shanker, M. A comparative evaluation of the effectiveness of virtual reality, 3D visualization and 2D visual interactive simulation: An exploratory meta-analysis. Simulation 2019, 95, 145–170. [Google Scholar] [CrossRef]
  32. Lu, M. Simplified discrete-event simulation approach for construction simulation. J. Constr. Eng. Manag. 2003, 129, 537–546. [Google Scholar] [CrossRef]
  33. Pereira, T.F.; Montevechi, J.A.B.; Miranda, R.D.C.; Friend, J.D. Integrating soft systems methodology to aid simulation conceptual modeling. Int. Trans. Oper. Res. 2015, 22, 265–285. [Google Scholar] [CrossRef]
  34. Robinson, S.; Brooks, R.; Kotiadis, K.; Van Der Zee, D.J. Conceptual Modeling for Discrete-Event Simulation. Interfaces 2011, 41, 601–603. [Google Scholar]
  35. Robinson, S.; Lee, E.P.; Edwards, J.S. Simulation based knowledge elicitation: Effect of visual representation and model parameters. Expert Syst. Appl. 2012, 39, 8479–8489. [Google Scholar] [CrossRef]
  36. Waller, A.P.; Ladbrook, J. Virtual worlds: Experiencing virtual factories of the future. In Proceedings of the 34th Winter Simulation Conference: Exploring New Frontiers, San Diego, CA, USA, 8 December 2002; IEEE: New York, NY, USA, 2002; pp. 513–517. [Google Scholar]
  37. Akpan, J.I.; Brooks, R.J. Practitioners’ perception of the impacts of virtual reality on discrete-event simulation. In Proceedings of the 2005 Winter Simulation Conference, Orlando, FL, USA, 4 December 2005; IEEE: Piscataway, NJ, USA, 2005; p. 9. [Google Scholar]
  38. Balci, O. Validation, verification, and testing techniques throughout the life cycle of a simulation study. Ann. Oper. Res. 1994, 53, 121–173. [Google Scholar] [CrossRef]
  39. Kamat, V.R.; Martinez, J.C. Validating complex construction simulation models using 3D visualization. Syst. Anal. Model. Simul. 2003, 43, 455–467. [Google Scholar] [CrossRef]
  40. Martinez, J.C. Methodology for conducting discrete-event simulation studies in construction engineering and management. J. Constr. Eng. Manag. 2010, 136, 3–16. [Google Scholar] [CrossRef]
  41. Akpan, J.I.; Brooks, R.J. Experimental investigation of the impacts of virtual reality on discrete-event simulation. In Proceedings of the Winter Simulation Conference, Orlando, FL, USA, 4 December 2005; IEEE: New York, NY, USA, 2005; p. 8. [Google Scholar]
  42. Jain, H.K.; Ramamurthy, K.; Sundaram, S. Effectiveness of visual interactive modeling in the context of multiple-criteria Group decisions. Syst. Man Cybern. Part A 2006, 36, 298–318. [Google Scholar] [CrossRef]
  43. Wan, H.; Ankenman, B.E.; Nelson, B.L. Controlled Sequential Bifurcation: A New Factor-Screening Method for Discrete-Event Simulation. Oper. Res. 2006, 54, 743–755. [Google Scholar] [CrossRef]
  44. Seymour, N.E. VR to OR: A review of the evidence that virtual reality simulation improves operating room performance. World J. Surg. 2018, 32, 182–188. [Google Scholar] [CrossRef] [PubMed]
  45. Donthu, N.; Kumar, S.; Mukherjee, D.; Pandey, N.; Lim, W.M. How to conduct a bibliometric analysis: An overview and guidelines. J. Bus. Res. 2021, 133, 285–296. [Google Scholar] [CrossRef]
  46. Van Leeuwen, T. Descriptive versus evaluative bibliometrics. In Handbook of Quantitative Science and Technology Research; Springer: Dordrecht, The Netherlands, 2004; pp. 373–388. [Google Scholar]
  47. Yu, D.; Xu, Z.; Pedrycz, W.; Wang, W. Information Sciences 1968–2016: A retrospective analysis with text mining and bibliometric. Inf. Sci. 2017, 418, 619–634. [Google Scholar] [CrossRef]
  48. Yan, E.; Ding, Y. Scholarly network similarities: How bibliographic coupling networks, citation networks, co-citation networks, topical networks, co-authorship networks, and co-word networks relate to each other. J. Am. Soc. Inf. Sci. Technol. 2012, 63, 1313–1326. [Google Scholar] [CrossRef]
  49. Kobara, Y.M.; Akpan, I.J. Bibliometric performance and future relevance of virtual manufacturing technology in the fourth industrial revolution. Systems 2023, 11, 524. [Google Scholar] [CrossRef]
  50. Jacso, P. As we may search—Comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation-enhanced databases. Curr. Sci. 2005, 89, 1537–1547. [Google Scholar]
  51. de Moya-Anegón, F.; Chinchilla-Rodríguez, Z.; Vargas-Quesada, B.; Corera-Álvarez, E.; José Muñoz-Fernández, F.; González-Molina, A.; Herrero-Solana, V. Coverage analysis of Scopus: A journal metric approach. Scientometrics 2007, 73, 53–78. [Google Scholar] [CrossRef]
  52. Kobara, Y.M.; Akpan, J.I.; Nam, A.D.; AlMukhthar, F.H.; Peter, M. Artificial Intelligence and Data Science Methods for Automatic Detection of White Blood Cells in Images. J. Imaging Inform. Med. 2025. [Google Scholar] [CrossRef]
  53. Van Eck, N.J.; Waltman, L. Software Survey: VOSviewer, a Computer Program for Bibliometric Mapping. Scientometrics 2010, 84, 523–538. [Google Scholar] [CrossRef]
  54. Van Eck, N.J.; Waltman, L.; Dekker, R.; van den Berg, J. A comparison of two techniques for bibliometric mapping: Multidimensional scaling and VOS. J. Am. Soc. Inf. Sci. Technol. 2010, 61, 2405–2416. [Google Scholar] [CrossRef]
  55. Aria, M.; Cuccurullo, C. Bibliometrix: An R-tool for comprehensive science mapping analysis. J. Informetr. 2017, 11, 959–975. [Google Scholar] [CrossRef]
  56. Cobo, M.J.; López-Herrera, A.G.; Herrera-Viedma, E.; Herrera, F. Science mapping software tools: Review, analysis, and cooperative study among tools. J. Am. Soc. Inf. Sci. Technol. 2011, 62, 1382–1402. [Google Scholar] [CrossRef]
  57. Singh, J.; Gupta, V. A systematic review of text stemming techniques. Artif. Intell. Rev. 2017, 48, 157–217. [Google Scholar] [CrossRef]
  58. Tako, A.A.; Robinson, S. The application of discrete event simulation and system dynamics in the logistics and supply chain context. Decis. Support Syst. 2012, 52, 802–815. [Google Scholar] [CrossRef]
  59. Katsaliaki, K.; Mustafee, N. Applications of simulation within the healthcare context. J. Oper. Res. Soc. 2011, 62, 1431–1451. [Google Scholar] [CrossRef] [PubMed]
  60. Karnon, J.; Stahl, J.; Brennan, A.; Caro, J.J.; Mar, J.; Möller, J. Modeling Using Discrete Event Simulation: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force–4. Med. Decis. Mak. 2012, 32, 701–711. [Google Scholar] [CrossRef]
  61. Robinson, S.; Radnor, Z.J.; Burgess, N.; Worthington, C. SimLean: Utilising simulation in the implementation of lean in healthcare. Eur. J. Oper. Res. 2012, 219, 188–197. [Google Scholar] [CrossRef]
  62. Zhang, X. Application of discrete event simulation in health care: A systematic review. BMC Health Serv. Res. 2018, 18, 687. [Google Scholar] [CrossRef] [PubMed]
  63. Turner, C.J.; Hutabarat, W.; Oyekan, J.; Tiwari, A. Discrete event simulation and virtual reality use in industry: New opportunities and future trends. IEEE Trans. Hum. Mach. Syst. 2016, 46, 882–894. [Google Scholar] [CrossRef]
  64. Chan, W.K.V.; Son, Y.J.; Macal, C.M. Agent-based simulation tutorial-simulation of emergent behavior and differences between agent-based simulation and discrete-event simulation. In Proceedings of the 2010 Winter Simulation Conference, Baltimore, MD, USA, 5–8 December 2010; IEEE: New York, NY, USA, 2010; pp. 135–150. [Google Scholar] [CrossRef]
  65. Zhu, H.; Martin, R.V.; Oxford, C.R.; Liu, W.; Hou, W. Ambient Sulfate Simulation over the Global South: Insights from GEOS-Chem and the SPARTAN Measurement Network. In Proceedings of the AGU Fall Meeting Abstracts 2024, Washington, WA, USA, 9–13 December 2024; Volume 2024, p. GC22C–02. [Google Scholar]
  66. Akpan, I.J.; Offodile, O.F. The role of virtual reality simulation in manufacturing in industry 4.0. Systems 2024, 12, 26. [Google Scholar] [CrossRef]
  67. Tsinarakis, G.; Sarantinoudis, N.; Arampatzis, G. A discrete process modelling and simulation methodology for industrial systems within the concept of digital twins. Appl. Sci. 2022, 12, 870. [Google Scholar] [CrossRef]
  68. Semeraro, C.; Lezoche, M.; Panetto, H.; Dassisti, M. Digital twin paradigm: A systematic literature review. Comput. Ind. 2021, 130, 103469. [Google Scholar] [CrossRef]
  69. Khaled, I.; Bennebach, M.; Vasiukov, D.; Shakoor, M.; Chaki, S. Digital twin for real-time pressure vessels fatigue life prediction. Adv. Mech. Eng. 2025, 17, 16878132251327666. [Google Scholar] [CrossRef]
  70. Onggo, B.S. Symbiotic simulation system (S3) for industry 4.0. In Simulation for Industry 4.0: Past, Present, and Future; Springer International Publishing: Cham, Switzerland, 2019; pp. 153–165. [Google Scholar]
  71. Aretoulaki, E.; Ponis, S.T.; Plakas, G.; Tzanetou, D. Discrete event simulation and Digital Twins in warehouse logistics: A bibliometric and content analysis-based systematic literature review. Int. J. Comput. Integr. Manuf. 2024, 37, 1376–1403. [Google Scholar] [CrossRef]
  72. Polini, W.; Corrado, A. Digital twin of composite assembly manufacturing process. Int. J. Prod. Res. 2020, 58, 5238–5252. [Google Scholar] [CrossRef]
  73. Sakr, A.H.; Aboelhassan, A.; Yacout, S.; Bassetto, S. Building discrete-event simulation for digital twin applications in production systems. In Proceedings of the 2021 26th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Vasteras, Sweden, 7–10 September 2021; IEEE: New York, NY, USA, 2021; pp. 1–8. [Google Scholar]
  74. Agalianos, K.; Ponis, S.T.; Aretoulaki, E.; Plakas, G.; Efthymiou, O. Discrete event simulation and digital twins: Review and challenges for logistics. Procedia Manuf. 2020, 51, 1636–1641. [Google Scholar] [CrossRef]
  75. Zhong, X.; Babaie Sarijaloo, F.; Prakash, A.; Park, J.; Huang, C.; Barwise, A.; Herasevich, V.; Gajic, O.; Pickering, B.; Dong, Y. A multidisciplinary approach to the development of digital twin models of critical care delivery in intensive care units. Int. J. Prod. Res. 2022, 60, 4197–4213. [Google Scholar] [CrossRef]
  76. Basaglia, A.; Spacone, E.; van de Lindt, J.W.; Kirsch, T.D. A discrete-event simulation model of hospital patient flow following major earthquakes. Int. J. Disaster Risk Reduct. 2022, 71, p102825. [Google Scholar] [CrossRef]
  77. de Paula Ferreira, W.; Armellini, F.; De Santa-Eulalia, L.A. Simulation in industry 4.0: A state-of-the-art review. Comput. Ind. Eng. 2020, 149, 106868. [Google Scholar] [CrossRef]
  78. Xu, J.; Huang, E.; Hsieh, L.; Lee, L.H.; Jia, Q.S.; Chen, C.H. Simulation optimization in the era of Industrial 4.0 and the Industrial Internet. J. Simul. 2016, 10, 310–320. [Google Scholar] [CrossRef]
  79. Wilson, R.; Mercier, P.H.; Navarra, A. Integrated artificial neural network and discrete event simulation framework for regional development of refractory gold systems. Mining 2022, 2, 123–154. [Google Scholar] [CrossRef]
  80. Krause, T. AI-based discrete-event simulations for manufacturing schedule optimization. In Proceedings of the 4th International Conference on Algorithms, Computing and Systems, Rabat, Morocco, 6–8 January 2020; ACM: Rabat, Morocco, 2020; pp. 87–91. [Google Scholar]
  81. Atalan, A.; Şahin, H.; Atalan, Y.A. Integration of machine learning algorithms and discrete-event simulation for the cost of healthcare resources. Healthcare 2022, 10, 1920. [Google Scholar] [CrossRef]
  82. Lang, S.; Behrendt, F.; Lanzerath, N.; Reggelin, T.; Müller, M. Integration of deep reinforcement learning and discrete-event simulation for real-time scheduling of a flexible job shop production. In Proceedings of the Winter Simulation Conference (WSC), Orlando, FL, USA, 14–18 December 2020; IEEE: New York, NY, USA, 2020; pp. 3057–3068. [Google Scholar]
  83. Greasley, A.; Edwards, J.S. Enhancing discrete-event simulation with big data analytics: A review. J. Oper. Res. Soc. 2021, 72, 247–267. [Google Scholar] [CrossRef]
  84. Frydenlund, E.; Mart’ınez, J.; Padilla, J.J.; Palacio, K.; Shuttleworth, D. Modeler in a box: How can large language models aid in the simulation modeling process? Simulation 2024, 100, 727–749. [Google Scholar] [CrossRef]
  85. Akpan, I.J.; Kobara, Y.M.; Owolabi, J.; Akpan, A.A.; Offodile, O.F. Conversational and generative artificial intelligence and human–chatbot interaction in education and research. Int. Trans. Oper. Res. 2025, 32, 1251–1281. [Google Scholar] [CrossRef]
  86. Giabbanelli, P.J. Gptbased models meet simulation: How to efficiently use large-scale pre-trained language models across simulation tasks. In Proceedings of the Winter Simulation Conference, San Antonio, TX, USA, 10–13 December 2023; IEEE Press: New York, NY, USA, 2024; pp. 2920–2931. [Google Scholar]
  87. Li, Y.; Gu, T.; Yang, C.; Li, M.; Wang, C.; Yao, L.; Gu, W.; Sun, D. AI-Assisted Hypothesis Generation to Address Challenges in Cardiotoxicity Research: Simulation Study Using ChatGPT With GPT-4o. J. Med. Internet Res. 2025, 27, e66161. [Google Scholar] [CrossRef]
  88. Akpan, J.I.; Razavi, R.; Akpan, A.A. Evolutionary trends in decision sciences education research from simulation and games to big data analytics and generative artificial intelligence. Big Data 2025. [Google Scholar] [CrossRef] [PubMed]
  89. Ortiz-Barrios, M.; Ishizaka, A.; Barbati, M.; Arias-Fonseca, S.; Khan, J.; Gul, M.; Yücesan, M.; Alfaro-Saíz, J.J.; Pérez-Aguilar, A. Integrating discrete-event simulation and artificial intelligence for shortening bed waiting times in hospitalization departments during respiratory disease seasons. Comput. Ind. Eng. 2024, 194, 110405. [Google Scholar] [CrossRef]
  90. Ortiz-Barrios, M.; Arias-Fonseca, S.; Ishizaka, A.; Barbati, M.; Avendaño-Collante, B.; Navarro-Jiménez, E. Artificial intelligence and discrete-event simulation for capacity management of intensive care units during the Covid-19 pandemic: A case study. J. Bus. Res. 2023, 160, 113806. [Google Scholar] [CrossRef] [PubMed]
  91. Haas, P.J. Tutorial: Artificial Neural Networks for Discrete-Event Simulation. In Proceedings of the 2024 Winter Simulation Conference (WSC), Orlando, FL, USA, 15–18 December 2024; IEEE: New York, NY, USA, 2024; pp. 116–130. [Google Scholar] [CrossRef]
  92. Akhavan, A.; Jalali, M.S. Generative AI and simulation modeling: How should you (not) use large language models like ChatGPT. Syst. Dyn. Rev. 2024, 40, e1773. [Google Scholar] [CrossRef]
  93. Nygren, T.; Samuelsson, M.; Hansson, P.O.; Efimova, E.; Bachelder, S. AI Versus Human Feedback in Mixed Reality Simulations: Comparing LLM and Expert Mentoring in Preservice Teacher Education on Controversial Issues. Int. J. Artif. Intell. Educ. 2025. [Google Scholar] [CrossRef]
  94. Jin, L.; Shen, Z.; Alhur, A.A.; Naeem, S.B. Exploring the determinants and effects of artificial intelligence (AI) hallucination exposure on generative AI adoption in healthcare. Inf. Dev. 2025. [Google Scholar] [CrossRef]
Figure 1. Modeling and simulation tasks, activities, and processes.
Figure 1. Modeling and simulation tasks, activities, and processes.
Symmetry 17 01272 g001
Figure 2. (a) Annual scientific publications on discrete-event modeling and simulation. (b) Linear trend of the scientific publications on evolutionary expansion of discrete-event modeling and simulation (2010–2024).
Figure 2. (a) Annual scientific publications on discrete-event modeling and simulation. (b) Linear trend of the scientific publications on evolutionary expansion of discrete-event modeling and simulation (2010–2024).
Symmetry 17 01272 g002
Figure 3. Discrete-event simulation application domains.
Figure 3. Discrete-event simulation application domains.
Symmetry 17 01272 g003
Figure 4. Visualization of emerging research themes and co-occurrence of author keywords.
Figure 4. Visualization of emerging research themes and co-occurrence of author keywords.
Symmetry 17 01272 g004
Figure 5. Visualization of the thematic structure involving the least frequent author keywords of four or less occurrences (f < 4). The text labels are as listed in the bibliographic data on SCOPUS.
Figure 5. Visualization of the thematic structure involving the least frequent author keywords of four or less occurrences (f < 4). The text labels are as listed in the bibliographic data on SCOPUS.
Symmetry 17 01272 g005
Table 1. Literature survey and data collection process: search and retrieval, filtering, screening, and selection criteria of the published documents.
Table 1. Literature survey and data collection process: search and retrieval, filtering, screening, and selection criteria of the published documents.
Activities/FocusCriteria
Data Source(s)SCOPUS Bibliographic Database search.
Search Criteria((“discret*”) AND (“simulat*” OR “model*”)) AND PUBYEAR: 2010–2024. The search generated 187,727 published documents.
Documents Filtering, Screening, and Selection
FilteringRemoved: Books: 409, Erratum: 122, Retracted: 113, Letter: 78, Note: 71; Editorial: 67; Short survey: 38, Data paper: 32 [187,727–930] = 186,797 documents.
Removed through SCOPUS filtering platform: Non ((“Discrete-Event Simulation”) AND (“Artificial Intelligence” OR “digital twin”)): 187,797 − 184,666 = 2131
ScreeningScreened out 9 Irrelevant Documents as follows: Literature not addressing the topic of interest: 2131 − 54 = 2077
Final Documents Selection2077 publications from SCOPUS published between 2010 and 2024 (during COVID-19). Documents retrieved in text formats (.txt and .csv files) for analysis.
Table 2. Descriptive statistics of the sample and preliminary results.
Table 2. Descriptive statistics of the sample and preliminary results.
Variable DescriptionResultsVariable Description Contd.Results
Years of publication2010–2024Documents contents:
Sources (journals, proceedings, book chapters)947Keywords plus (ID)10,575
Documents information: Author’s keywords (DE)4121
  • Articles
885 (42.6%)Authors and collaboration:
  • Book chapters
60 (2.9%)Authors5629
  • Conference papers
1132 (54.5%)Authors of single-authored docs36
Annual publication growth rate:2.03%Single-authored docs124
Average citations per doc9.5Co-authors per doc3.62
References50,886International co-authorships %19.31
Table 3. Analysis of eminent keywords and research themes trends.
Table 3. Analysis of eminent keywords and research themes trends.
KeywordsStemmed Co-WordsLink StrengthKeywords Contd.Stemmed Co-WordsLink Strength
Discrete-Event Simulation973494Waiting Time1418
Simulation213176Productivity1325
Parallel Discrete-Event Simulation (DES)7142Operations Research1320
Optimization6190Digital Twin1315
Modeling5583Performance Evaluation1313
Healthcare3552Time Warp1312
Logistics3137Maintenance1222
Emergency Department2942Patient Flow1218
Industry 4.02733Plant Simulation1218
Devs2413Machine Learning1214
System Dynamics2332Cost-Effectiveness1211
Manufacturing2233Resource Allocation1118
Simulation Modeling2022Supply Chain Management1117
Performance1920Construction Management1113
Arena1829Efficiency1113
Supply Chain1826Discrete Event Systems116
Discrete-Event1821Queuing Theory1016
COVID-191728Process Improvement1012
Scheduling1724Synchronization1011
Computer Simulation1710Discrete Event108
Simulation Optimization1511Process Mining107
Design Of Experiments1421Simulation Model107
Table 4. The citation structure of research publications on DES.
Table 4. The citation structure of research publications on DES.
Year≥300≥200≥100≥50≥30≥10≥1NCTP% Cited
20100047618562011182%
201101011422562612078%
20121035833602713780%
20130003103867612495%
20140025832561712086%
20150004838691613588%
201600151235891816089%
20170004641792515584%
2018001363868912593%
20190002631832614882%
20200006037942616384%
20210003427862714782%
20220000225873014479%
20230000011765414162%
2024000001519514735%
Total Pubs1111588042710774222077
NC: no citation (publications that did not earn any citations as of 31 December 2024), TP: total publications per year.
Table 5. Ten most cited documents on the use of DES to solve COVID-19 problems.
Table 5. Ten most cited documents on the use of DES to solve COVID-19 problems.
RankPaperFocusSourcesTCAC P/YearCitable Years
1[58]DES and system dynamics in the logistics and supply chain contextDecision Support Systems34724.7914
2[59]Applications of simulation within the healthcare contextJournal of the Operational Research Society21117.5812
3[60]The application of DES in a health care settingMedical Decision Making18713.3614
4[61]SimLean: Utilising simulation in the implementation of lean-in healthcareEuropean Journal of Operational Research18414.1513
5[62]A review of DES applications in healthcare.BMC Health Services Research17121.388
6[63]Current and future trends of DES and virtual reality use in industryIEEE Transaction on Human-Machine System16916.910
7[22]Combining system dynamics and discrete-event simulation in healthcareProc. Winter Simulation Conf.1298.615
8[64]Comparing agent-based simulation with DES in modeling emergency behaviorsProc. Winter Simulation Conf.1157.715
9[40]DES method in construction engineering and managementJournalof Construction Engineering Management1107.3315
10[23]Comparing DES and systems dynamics application in healthcareEuropean Journal of Operational Research108912
TC: total citations based on SCOPUS bibliographic data; AC P/Year: average citation per year.
Table 6. The top 20 sources with most eminent sources and citation impacts.
Table 6. The top 20 sources with most eminent sources and citation impacts.
RankSourcesNPTCAVTCPub_Start_Yr.
1Proceedings—Winter Simulation Conference20516678.12010
2Simulation2343018.72010
3Journal of Simulation2930410.52010
4Simulation Modelling Practice and Theory1762136.52011
5European Journal of Operational Research1262251.82010
6Computers and Industrial Engineering1133030.02014
7Journal of the Operational Research Society1438627.62010
8Medical Decision Making1644928.12010
9Procedia CIRP2021710.92014
10Value In Health1342933.02010
11IFAC-Papers Online1616610.42015
12ACM Transactions on Modeling and Comp. Simulation191819.52011
13Automation in Construction934238.02012
14BMC Health Services Research931735.22011
15Health Care Management Science728841.12011
16International Journal of Advanced Manufacturing Technology915517.22011
17Lecture Notes in Comp Science; Subseries Lecture Notes in Artificial Intelligence; Lecture Notes in Bioinformatics281585.62010
18PLOS ONE1118616.92011
19Proceedings of the 2013 Winter Simulation Conference—Simulation: Making Decisions in A Complex World121078.92013
20Journal of Construction Engineering and Management628046.72010
NP: no. of Publications; TC: total citations; AVTC: average TC per document; Pub Yr.: publication start year.
Table 7. Countries with international collaborations on publications in two categories, SCP and MCP, and impact.
Table 7. Countries with international collaborations on publications in two categories, SCP and MCP, and impact.
CountryPublicationsSCPMCPTCATC (Pub)
United States20016535251712.59
United Kingdom987622231523.62
China797097038.9
Germany73601399513.63
Italy62471569311.18
Canada60528121420.23
Brazil4436853012.05
Sweden36231347013.06
France3323101986
Australia30191174624.87
India292541184.07
Korea2422226711.13
Malaysia242041476.13
Turkey2415928511.88
Indonesia22202572.59
SCP: collaboration as non-corresponding author; MCP: contributions as corresponding author; TC: total citations; ATC (Pub): average total citation per publication.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Akpan, I.J.; Etti, G.E. Computer Simulation Everywhere: Mapping Fifteen Years Evolutionary Expansion of Discrete-Event Simulation and Integration with Digital Twin and Generative Artificial Intelligence. Symmetry 2025, 17, 1272. https://doi.org/10.3390/sym17081272

AMA Style

Akpan IJ, Etti GE. Computer Simulation Everywhere: Mapping Fifteen Years Evolutionary Expansion of Discrete-Event Simulation and Integration with Digital Twin and Generative Artificial Intelligence. Symmetry. 2025; 17(8):1272. https://doi.org/10.3390/sym17081272

Chicago/Turabian Style

Akpan, Ikpe Justice, and Godwin Esukuku Etti. 2025. "Computer Simulation Everywhere: Mapping Fifteen Years Evolutionary Expansion of Discrete-Event Simulation and Integration with Digital Twin and Generative Artificial Intelligence" Symmetry 17, no. 8: 1272. https://doi.org/10.3390/sym17081272

APA Style

Akpan, I. J., & Etti, G. E. (2025). Computer Simulation Everywhere: Mapping Fifteen Years Evolutionary Expansion of Discrete-Event Simulation and Integration with Digital Twin and Generative Artificial Intelligence. Symmetry, 17(8), 1272. https://doi.org/10.3390/sym17081272

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop