Skip to Content
You are currently on the new version of our website. Access the old version .
InformaticsInformatics
  • Review
  • Open Access

12 November 2026

30 Pages

Reconstructing Clinical-Trial EDC Workflows from Audit Trails: A Critical Review of Event-Log Design and Interpretation

Independent Researcher, Highland Park, NJ 08904, USA

Abstract

Audit trails in clinical-trial electronic data capture (EDC) systems record who created or changed trial data; when; and, where applicable, why. Process-mining methods could use these time-stamped records to reconstruct data-management workflows. This structured critical narrative review draws on process-mining methodology, healthcare and electronic health record (EHR) audit-log research, and regulatory and industry sources to examine how event-log design constrains what reconstructed EDC workflows can show. Documented PubMed and Crossref searches were run on 28 October 2026. Audit trails are not designed as event logs: event definition, case notion, timestamp semantics, human and system actions, configuration changes, extraction cut-off, and system boundaries all shape the reconstructed process. The searches identified no peer-reviewed study that evaluated process mining of EDC audit trails against independently established quality outcomes, and most transferable evidence is analogical. The review proposes an interpretive framework that separates process observations, process signals, contextual interpretation, independent verification, and verification outcomes; illustrates it with a synthetic event log; and outlines an evaluation design and proposed reporting items. Audit-trail process analysis could support targeted human review within risk-based quality management, but its usefulness remains to be established, and alone it cannot establish data-quality failure, noncompliance, or poor site performance.

1. Introduction

Clinical-trial electronic data capture (EDC) systems are expected to preserve an audit trail for electronic records and changes to them. Regulation and guidance describe an audit trail as a secure, computer-generated, time-stamped record of the actions that create, modify, or delete data, showing what was changed; by whom; when; and, where applicable, why [1,2,3]. The United States Food and Drug Administration (FDA) notes that audit trails allow significant details of trial conduct and source-data collection to be reconstructed [4]. The European Medicines Agency (EMA) expects that the entire audit trail can be exported as a dynamic data file so that systematic patterns across participants and sites can be identified [3], and the International Council for Harmonisation (ICH) good clinical practice guideline E6(R3) asks for review of audit trails and other metadata to be planned and risk-based [2].
An audit trail is also, in effect, a record of work. Aggregate metrics such as query counts, open-query age, or form-completion rates describe volume and status but not the order in which actions occurred, how often work returned to an earlier state, or where waiting accumulated. Those sequential and temporal properties are what process mining was developed to analyse [5,6]. The approach is well established in studies of clinical care [7,8,9,10], and a parallel literature has used EHR audit logs to study clinician activity [11,12,13,14].
The transfer to EDC data is less straightforward than it appears. An audit trail exists to make individual changes traceable for review and inspection, and it becomes an event log only through a transformation. Process-mining research has shown that turning system records into an event log involves consequential choices about extraction, case correlation, and abstraction [15,16,17], and that quality problems in the resulting log distort discovered models [18,19,20]. Healthcare studies add warnings about timestamp meaning, competing case identifiers, and the validation of log-derived measures [14,21,22,23]. Clinical trials introduce a further risk: a reconstructed pattern can easily be read as a finding about data quality, protocol compliance, or site performance when it is, at most, a reason to look more closely.
This review addresses four questions. RQ1: What does the existing literature establish about constructing event logs from system audit records, and how directly does that evidence apply to clinical-trial EDC systems (Section 3 and Section 4)? RQ2: Which EDC-specific design choices condition what a reconstructed workflow can show, and how can their effect be checked (Section 5, Section 6, Section 7 and Section 8)? RQ3: How should process signals be interpreted and verified before they are treated as evidence about data quality, compliance, or site performance (Section 9, Section 10 and Section 11)? RQ4: What should future empirical studies evaluate and report (Section 12, Section 13 and Section 14)?
The contribution is an EDC-specific methodological synthesis rather than a new process-mining method. Existing audit-trail review guidance from industry groups defines use cases and risk scenarios that are mostly implemented with counts, durations, and thresholds [24,25]; event-log quality frameworks and healthcare process-mining methodologies address log construction in general [19,20,21,26,27]; and EHR audit-log research has produced reporting guidance for clinician-activity measures [28]. None of the sources identified addresses the combination that is specific to clinical trials: study-specific and versioned EDC configurations, system-prompted corrections that FDA guidance expects to be recorded, several regulated actor roles writing to one trail, and quality defined relative to critical-to-quality factors and independently documented evidence. The review makes four contributions. It identifies the event-log construction choices that condition what reconstructed EDC workflows can show, and the checks that expose their effect. It proposes an interpretive framework with five levels of inference and explicit criteria for moving from a process signal to a quality outcome. It demonstrates, with a synthetic event log, how two defensible construction choices change the conclusions drawn from identical records. Finally, it outlines an evaluation design and proposed, conditional reporting items for future studies. The final part of Section 3 (Positioning Relative to Existing Guidance and Frameworks) states where the framework overlaps with existing guidance and what it adds. No new process-mining method or empirical data are reported.

2. Review Approach

2.1. Design

This is a structured critical narrative review, not a systematic or scoping review. A narrative approach was used because the relevant evidence spans process-mining methodology, health informatics, clinical data management, and regulatory science, each with its own vocabulary, because direct peer-reviewed evidence on EDC audit-trail process mining is sparse, and because the aim is conceptual and methodological synthesis rather than pooled estimation.

2.2. Information Sources and Searches

Initial searches, completed on 2 October 2026, combined general web searches, searches of PubMed and PubMed Central, and follow-up of reference lists; the number of records they retrieved was not logged. They were supplemented by documented searches on 28 October 2026, whose strings, limits, and record counts are reported in Supplementary Table S2. Six PubMed searches were run on title and abstract fields with no lower date limit. One addressed the central question (process mining combined with clinical trials, EDC, audit trails, or clinical data management). Five addressed supporting topics: audit trails in clinical trials and clinical research; audit logs or audit events combined with process mining, event logs, or workflow; event-log quality, case notion, object-centric logs, and timestamps; validation and reporting of EHR audit-log measures; and central, statistical, or risk-based monitoring. Because much process-mining research appears in computing conference proceedings that PubMed does not index, two Crossref searches were restricted to proceedings articles (process mining with clinical trials; audit trails with event logs and process mining). The first 50 relevance-ranked records of each were screened. Targeted web searches were used to identify grey literature on EDC audit-trail review and process analysis. Scopus, Web of Science, IEEE Xplore, and the ACM Digital Library were not searched directly. Regulatory and standards documents were taken directly from ICH, FDA, the electronic Code of Federal Regulations, EMA, the Clinical Data Interchange Standards Consortium (CDISC), the World Wide Web Consortium, IEEE, the eClinical Forum and the Society for Clinical Data Management (SCDM), and the Association for Clinical Data Management (ACDM); current versions were used. Foundational process-mining methods were included without a date limit; for applied healthcare and clinical-trial sources, work published from 2020 onward was preferred where several sources supported the same point.

2.3. Eligibility, Selection, and Appraisal

Sources were retained if they addressed event-log construction or quality, reported methodological lessons from healthcare process mining or audit-log analysis, set regulatory or standards expectations for audit trails, metadata, or monitoring, or described central or risk-based monitoring as a setting in which operational signals are used. Work on predictive modelling without event-log relevance, descriptions of EDC implementation without reference to audit data, studies of audit data from systems other than EDC or healthcare information systems, conference abstracts and posters without an accessible full text, promotional material, and sources that could not be verified bibliographically were excluded. A source from an adjacent domain was judged relevant when it addressed a mechanism that is also present in EDC audit trails (for example, the meaning of a recorded timestamp, the choice of case identifier, or the effect of a system upgrade on recorded behaviour) and was used only for that mechanism. Where the same work appeared as a conference paper and a later journal article, the later version was cited, and overlapping reviews were cited for distinct claims only. Titles and abstracts were screened, and full texts were read for retained sources, by the single author.
Sources were appraised on four criteria: directness (whether the source concerns clinical-trial EDC audit data, another clinical-trial setting, or an adjacent domain), type of evidence (normative requirement, practice consensus, empirical study, or methodological or conceptual work), peer review, and currency. Their evidential weight was interpreted accordingly. Regulations and guidance set expectations for audit trails and their review but are not evidence that an analytic method performs well. Industry guidance reflects practice consensus but is neither peer-reviewed nor validated. Process-mining methodology establishes properties of techniques, mostly in non-clinical data, and healthcare and EHR studies offer transferable lessons about mechanisms, not evidence about EDC behaviour. Formal risk-of-bias tools were not applied, because most retained sources are methodological, normative, or conceptual. Retained sources were grouped into six evidence bodies (Table 1), and bibliographic details were checked against Crossref, PubMed, or the issuing organisation. Each citation is linked to the statement it supports in Supplementary Table S1.
Table 1. Evidence bodies relevant to EDC audit-trail process mining, their contribution, their limits, and their applicability to EDC audit trails.

2.4. Selection Summary and Framework Derivation

The documented searches returned 500 records (400 from PubMed and 100 from Crossref). Removing duplicates (31 between PubMed searches and 5 between the two Crossref searches; no Crossref record matched a PubMed record by title) left 464 unique records, which were screened on title and abstract. Of these, 433 were excluded and 31 were relevant: 13 were already included from the initial searches and 18 were new (Supplementary Table S2). All 31 were read in full and retained. None of the 31 relevant records applied process mining or another sequence-level analysis to clinical-trial EDC audit trails; the evidence-gap statement in Section 3 is relative to these searches. The 18 new sources were added to the review, and four more came from targeted searches on uncertain timestamps, process-mining project methodology, privacy in process mining, and ICH E8(R1). The 433 excluded records were unrelated (for example, uses of “audit trail” in qualitative research or pharmacology), described audit-trail functionality without analysis of audit data, or provided substantively redundant evidence. Two grey-literature items were also excluded: a conference poster on audit-trail review in REDCap without an accessible full text, and a conference paper on audit trails in a statistical computing environment rather than an EDC system.
The framework (Figure 1), the table of construction choices, and the reporting items were derived in three steps. First, mechanisms by which log construction can distort a reconstructed process were extracted from the process-mining and healthcare literature. Second, each mechanism was mapped to the EDC features that could trigger it, as described in regulatory, standards, and industry sources. Third, each resulting framework component, construction check, and reporting item was classified as directly supported by clinical-trial or EDC sources, transferred from another setting, or the author’s recommendation. The source-to-component mapping is given in Supplementary Table S3.

3. What the Existing Literature Establishes

Table 1 summarises the bodies of evidence drawn on in this review and what each can and cannot contribute.
Regulation establishes the core audit-trail requirement [1], and current ICH, FDA, and EMA guidance adds expectations for interpretable metadata, risk-based review of audit trails, and export for pattern review [2,3,4]; none of these documents addresses analytic methods for sequence-level review. Industry and expert-group guidance sets out audit-trail review use cases and risk scenarios across system access, data changes, data-entry delays, and related categories [24,25]; these documents provide practical recommendations rather than peer-reviewed evidence of the analytical performance of those use cases. Direct peer-reviewed analysis of EDC audit-trail data was rare among the sources identified; a 2011 study of a single multinational, randomised, placebo-controlled dose-finding trial that used one EDC system characterised data-entry errors and audit-trailed data changes [33], but it analysed counts and reasons for change rather than event sequences. Process-mining methodology, by contrast, is mature [5,15,20,35,36], though it grew largely out of business and industrial data. The closest domain analogies come from healthcare process mining and EHR audit-log research [12,14,21,22,28], whose workflows and logs differ from trial data management in purpose, actors, and governance.
In the searches described in Section 2, no peer-reviewed study was identified that applied process mining to clinical-trial EDC audit trails and evaluated the resulting signals against independently established quality outcomes; this is a statement about the performed searches, not evidence that no such study exists. Process mining has been applied to programme data stored in a REDCap database [34], but that study analysed the collected data as a record of programme delivery, not the audit trail as a record of data-management work. The closest technical precedents transform standardised healthcare audit records (Integrating the Healthcare Enterprise audit format or HL7 FHIR AuditEvent resources) into process-mining event logs [43,44,54,55]. They indicate that such transformations need semantic enrichment and can lose events, but they used simulated, synthetic, or no real-world data and did not involve clinical trials (Section 5.3). Central statistical monitoring in trials is better developed, but it analyses data values and their distribution across sites, not the sequence of recorded actions [45,46,47].
Read critically, the literature agrees on three points. Log construction is itself an analytic step whose choices change the resulting models [15,17,20,26]; domain experts are needed to interpret and often to repair what the log shows [23,27,56,57]; and a difference from a reference process does not, in itself, show that something went wrong. Whether such deviations are warranted remains largely unresolved [58]. Several matters remain contested or unresolved. Healthcare studies differ on how far automated discovery can be trusted without expert-guided repair [57]; object-centric representations remove some distortions but are recent and have few clinical applications [40,59,60]; EHR audit-log research has increasingly relied on vendor-derived measures whose validity and comparability across vendors are uncertain [13,61]; and evidence on the value of centralised or triggered monitoring is mixed: a large observational analysis reported improved quality metrics at flagged sites after follow-up [53], whereas a prospective matched-pair study found that monitoring triggers discriminated only modestly between sites [50]. The main limitations of the evidence are that most healthcare process-mining studies are single-site case studies, that audit-log-to-event-log transformations have been demonstrated mainly without real-world data, and that EHR audit-log research has measured clinician time and navigation rather than the correctness of recorded data [12,13].
The EHR analogy has limits that bear directly on interpretation. EHR audit logs are generated by systems built to support clinical care and are often analysed for record access and navigation by clinicians [11,12]. EDC audit trails record data collected for a protocol and, ultimately, for regulatory submission, and they are subject to part 11 and good clinical practice requirements [1,2,4]. The actors differ as well: site staff, monitors, data managers, and automated edit checks and integrations all write to the same trail. EDC configuration is also built separately for each study and may change during conduct through protocol amendments and CRF or edit-check revisions [2], so the meaning of a recorded activity can differ between studies and between periods of the same study. Lessons from EHR research are therefore used below as methodological guidance, not as evidence about EDC behaviour. The features that distinguish EDC audit trails are treated directly rather than by analogy. These are regulatory constraints on what is recorded, several regulated actors and automated processes writing to one trail, and study-specific configurations that change during conduct. They are covered in Section 4 (construction operations), Section 5 (case and object choices), and Section 8 (operational, configuration, and logging change).

Positioning Relative to Existing Guidance and Frameworks

Table 2 compares the proposed framework with the approaches closest to it. The audit-trail review use cases of the eClinical Forum and SCDM are grouped into system access, data changes, data collection, reporting, and device concerns, and are implemented through dashboards, exception reports, and key risk indicators with absolute or relative thresholds [24]. The ACDM risk scenarios add timing, post-milestone, and cross-system comparisons and explicitly note that many flagged patterns are non-issues [25]. Neither describes process mining or the reconstruction of ordered workflows across related objects. The eClinical Forum and SCDM paper does describe confirmation of signals, root-cause analysis, and documented resolution [24], and the ACDM document recommends source verification and follow-up of anomalies [25]; neither sets out levels of inference or what may be claimed at each. Many of their use cases, such as late entry, changes after database lock, or excessive changes to critical data, are well served by counts, status summaries, and durations and do not need process mining. Order and object links matter for a smaller set. The eClinical Forum use case on changes after key timepoints becomes more specific when the timepoint is review of the same form rather than a study-wide milestone, and its use case on entry influenced by edit checks depends on the order of entry, prompt, and change. The ACDM scenarios on query-response cycle times and on verification dates that do not match monitoring records depend on lifecycle and cross-object relations [24,25]. These are the use cases in which sequence information is most likely to add to counts and durations.
Table 2. Overlap and difference between the proposed framework and related guidance and methodological frameworks.
What the process perspective adds is limited but specific. It shows the order of actions relative to one another, for example, whether a change preceded or followed source-data verification of the same form. It represents concurrency and dependency across participants, visits, forms, and queries. It treats loops and reopenings as properties of a lifecycle rather than as counts. And it allows comparison with a version-aware reference model. Some elements reflect a combination of features that is characteristic of clinical-trial EDC systems, though no single feature is unique to them. These are study-specific configurations that change during conduct; system-prompted corrections that FDA guidance expects to be recorded [4]; regulated site, monitor, and data-management roles; quality defined by critical-to-quality factors and errors that matter [2,32]; and verification evidence such as source documents, monitoring reports, and query text. Other elements, including case notion, abstraction, timestamp quality, concept drift, and conformance checking, are adaptations of established process-mining concepts [15,20,35,36,38]. The framework is therefore best read as a reorganisation of existing principles around the EDC setting, with new EDC-specific checks and an explicit gate between signal and outcome, rather than as a new methodological paradigm.

4. Why EDC Audit Trails Require Event-Log Construction

Clinical data management covers case report form (CRF) design, data entry, edit checks, discrepancy (query) management, and database lock [63], and EDC systems record much of this activity. A process-mining event log needs, at minimum, a case identifier, an activity label, and an ordering attribute for each event, usually a timestamp [5,64]; the Process Mining Manifesto stressed that logs differ in maturity and trustworthiness and that extraction is a central challenge [18]. An EDC audit trail is nevertheless not an analysis-ready event log. It records changes to data items, typically at field level, with user, role, date and time, previous and new values, and a reason for change where applicable [3,4]. ICH E6(R3) expects systems to retain workflow actions and relevant metadata [2]; in EDC systems these may include query states, verification or review status, signatures, and other status changes, although their availability and linkage in an export depend on the implementation. Exports may be vendor-specific or follow standards such as the CDISC Operational Data Model (ODM), which carries audit information alongside clinical data and metadata [31].
Several features of these records need deliberate handling. Audit trails are organised around records, not processes, so saving one form can generate many field-level entries with the same timestamp, a situation described in the event-log literature as “form-based event capture” and “collateral events” [20]. FDA guidance states that an audit trail need not capture every keystroke but should capture deliberate actions such as saving or submitting and that when an edit check prompts a correction, the original response, the prompt, and the change should all be recorded [4]. A single episode of data entry can thus legitimately appear as entry, system query, and change, which a count of changes after entry would treat as rework without distinguishing prompted from unprompted corrections. Human and system actions are mixed: the data originator may be a person, a computer system, a digital health technology, or an EHR [4]. Activity labels are specific to systems and configurations, so one activity may carry different labels across studies while different activities share a label [20]. Healthcare audit-log studies reached the same conclusion: audit records are designed for accountability, and they become usable for process analysis only after semantic enrichment that maps technical actions to meaningful activities [43,54,55].
EHR process-mining studies add that missing or imprecise timestamps, competing case identifiers, and uneven granularity must be assessed before process mining can be relied on [21,22,65,66], and general taxonomies of log quality list timestamp problems, granularity, ambiguous activity names, and mashed logging among the common failures [19]. For EDC audit trails, the implication is that building the event log is itself an analytic step and needs to be documented as one. Table 3 sets out that step as a sequence of operations, each with the fields it needs and a check that can expose errors, drawing on data-quality-driven preparation methods [20,26], the data-preparation recommendations of industry audit-trail guidance [24], and process-mining project methodology [27].
Table 3. Transformation of raw EDC audit records into an analysis-ready event log: operations, required inputs, and validation checks.

5. Constructing Event Logs from EDC Audit Trails

5.1. Event Definition and Abstraction

Event-log construction involves extracting relevant records, correlating events to cases, and abstracting from low-level records to activities that mean something for the question at hand [15]. Abstraction is rarely neutral: grouping field changes into “form saved”, or query states into “query open” and “query closed”, determines which behaviour becomes visible [16]. With EDC data, an analyst has to decide whether a change made in response to an edit-check prompt is its own activity, whether system status changes are kept, and whether repeated saves of a form within minutes are one work episode or several. Different answers can yield different models from identical records [15,17], which is why such decisions are best specified in advance and reported. For example, a site user enters three vital-sign values and corrects one after an edit-check prompt. Treated record by record, this gives six events (three entries, a system query, a change, and an automatic query closure), which a count of changes after entry would treat as rework. If entries sharing a save identifier are grouped into a “form saved” episode, and the first human change to the queried item while its edit-check query is open is classified as a prompted correction, the same records yield one save, one prompted correction, and the opening and automatic closure of the query. This temporal rule classifies the change; it does not, by itself, establish that the query caused it. The prompted correction still records an initial error and the work of correcting it; the two constructions classify the same event differently rather than reducing the amount of rework, and a study should state which events its rework measure counts. Section 10.4 works through this contrast with synthetic records.

5.2. Case Definition and Workflow Reconstruction

Classical process mining assumes one case notion per event log [5,36,64]. EDC data involve several interrelated objects: participant; visit; form; field; query; and, in some systems, review or signature records. Treating the participant as the case merges parallel work on different forms and visits into one trace, creating loops and long cycle times that reflect concurrency rather than rework. A query-level case isolates the query lifecycle but loses corrections made without a formal query, and a form-level case can hide dependencies, as when a laboratory value prompts a change on an adverse-event form.
The case notion affects each process-mining task differently. In discovery, a participant- or visit-level case interleaves the activities of several forms, which can increase the number of variants and introduce apparent loops between activities that belong to different objects, depending on the records, activity labels, and discovery method. In conformance checking, the reference model must be written for the same case notion; a visit-level model that expects source-data verification after entry, applied to a log that does not retain form identity, will report a deviation whenever verification of one form precedes entry on another form of the same visit. In performance analysis, cycle times measured on a participant- or visit-level case include waiting on unrelated objects, whereas form- or query-level cases measure the lifecycle of one object but cannot show waiting caused by dependencies between objects.
Process-mining methodology describes this as the problem of flattening multi-object data, which produces convergence, where one event is replicated across several cases, and divergence, where independent instances of an activity are interleaved within one case [36]. Object-centric event logs and event knowledge graphs retain the relations between events and several object types [37,59], and tools for object-centric discovery and conformance checking now exist [60]. In healthcare, object-centric logs have been built from data in the OMOP common data model [40], and the choice between patient, admission, and unit-stay identifiers has been shown to change the level of analysis [22]. None of this work involves EDC data, but it supports a practical rule: state the analytic question, justify the case notion or object model, and, where feasible, check whether conclusions hold under an alternative.

5.3. Practical Requirements and Limits of Object-Centric Analysis

Object-centric analysis of EDC audit trails has four practical requirements. Object types must be identified and keyed consistently across audit components, which requires study-specific knowledge of the CRF, visit, and query model. Event-to-object relations must be recoverable from the export: a field change links to an item, form, visit, and participant, but a query, a source-data verification flag, or a signature may be stored in a separate log with identifiers that must be joined. The relevant components must be available at all; some vendor exports omit review or signature events, and the CDISC ODM can carry audit records for clinical data but does not, by itself, define query or review workflows [31]. Finally, the log must be expressed in a format that tools accept, such as the OCEL 2.0 standard [59]. Healthcare transformations of standardised audit records into object-centric logs, demonstrated on simulated or synthetic data, suggest that these steps are feasible but can lose events that the source format does not record [43,44], and the one healthcare application to a large data model started from a curated common data model rather than from raw audit records [40]. These requirements are harder to meet with proprietary vendor exports than with standardised research data. Export schemas, activity codes, and the meaning of audit fields are often vendor-specific and incompletely documented; query, review, and signature logs may be available only as separate reports or through vendor services; contractual and licensing terms may restrict which components a sponsor can export or analyse; and schemas can change between vendor releases during a study. Each of these can make object relations unrecoverable without vendor documentation or support, and an object-centric analysis may therefore be feasible only for some studies or some audit components. The standard and tools are recent [59,60], so results should be reported with the software version and the object model, and an object-centric analysis should be compared with at least one flattened view to show what the additional complexity changes.

6. Timestamp Semantics and Temporal Interpretation

An EDC record may carry several distinct times: the clinical date of a visit or assessment entered as data; the system time of entry or change; the times a query was raised, answered, and closed; the time of transfer from an external source; and the time of extraction. ICH E6(R3) expects automatically captured dates and times to be unambiguous, citing coordinated universal time as an example [2], and FDA asks sponsors to indicate the time zone of time stamps in systems that span time zones [4]. Industry guidance adds daylight-saving changes and notes that timestamps can lose their time zone after a device is replaced or reset [24]. Table 4 classifies these times by what they record and what they can support.
Table 4. Classes of time information in EDC audit data, their appropriate analytical uses, and the consequence of misuse.
When the interval between a visit date and the first EDC entry is treated as a measure of timeliness, it may also reflect scheduled batch entry, late availability of source documents, legitimate retrospective entry, time-zone handling, or migration from another system. Coarse or identical timestamps also make ordering ambiguous and can change discovered sequences [19,67]. A recorded system time shows when a documented system action occurred, not when the clinical work was done or why an interval arose. Healthcare studies illustrate the gap: in one hospital, documented infusion times in the EHR differed from automatically recorded pump events by more than 10 min in about a fifth to a third of infusions [42].

6.1. Ordering Uncertainty and Sensitivity Analysis

Many field-level records from one save share a timestamp, and events from different components may be recorded at second or day precision. A documented tie-breaking rule, such as ordering by audit record identifier, makes an analysis reproducible but does not establish the true order of events. Order can be supported by additional metadata where it exists, for example, a transaction or sequence identifier, a save identifier that links field changes to one submission, or a causal relation such as a query that references the value it was raised on. Where no such metadata exists, events with the same timestamp should be treated as unordered: grouped into one episode if they belong to one save or analysed as a partial order. Process-mining research offers methods that make this uncertainty explicit, by representing each timestamp as an interval and reporting the best-case and worst-case conformance over all possible orderings [39], by applying a tolerance window informed by domain experts [41], or by detecting and repairing ordering imperfections interactively [67]. A simple sensitivity analysis is to repeat the analysis under at least two defensible orderings and report which conclusions change. Events with a missing timestamp cannot be placed in a sequence; they should be counted and reported, placed by a documented rule only where another time field or a causal link fixes their position, and otherwise excluded from ordering-dependent analyses with a check of whether the exclusions cluster by site, form, or period. Records without a time zone should be counted and, where the site’s time zone is known, converted with that assumption stated; where it is not known, intervals shorter than the possible offset should not be interpreted.

6.2. Incomplete Traces and Right Censoring

An extraction cut-off leaves some queries open and some visits incomplete. Excluding unresolved queries from duration analysis keeps only those that were resolved by the cut-off, which are disproportionately the faster ones, so it underestimates typical resolution time; treating the time observed up to extraction as a completed lifecycle also underestimates it. Both errors are larger for sites or periods with recent activity. For example, if a site opened 20 queries in the month before extraction and 12 were still open, the median resolution time computed from the eight closed queries describes only the queries closed by extraction and is likely to underestimate resolution time. A censoring-aware approach treats open items as right-censored at the extraction time and estimates resolution time with time-to-event methods [68]; reports the number and proportion of open items at cut-off by site and period; and compares sites over windows in which all items had a comparable opportunity to close. These methods assume that censoring is non-informative, that is, that queries censored at the cut-off have the same subsequent resolution rate as queries still open after the same elapsed time within the compared groups; this may not hold if recently opened queries differ systematically, for example, after a configuration change or at newly activated sites. The endpoint must also be defined. Resolution may mean first closure, or each interval from opening or reopening to the next closure may be treated as a separate episode; the choice changes the estimate when reopening is common. Final closure requires a pre-defined terminal condition or follow-up horizon, because an observed closure may later be reopened; uncertainty about whether a closure is final is not the same as right censoring at extraction. When the probability of resolution is estimated, terminal states that preclude resolution, such as cancellation or withdrawal of the query, should be treated as competing events rather than as resolution or censoring, and the cumulative incidence of resolution reported [69]. Where the estimated proportion resolved does not reach 50% during follow-up, the median resolution time cannot be estimated and should be reported as not reached.

7. Discovery, Conformance Checking, and Performance Analysis

Discovery, conformance checking, and enhancement, including performance analysis, are the principal process-mining tasks [5,10], and each has distinct interpretive limits when applied to EDC data. No reference process for EDC data management validated against outcomes was identified in the sources reviewed, so in all three tasks a discovered model or a deviation describes recorded behaviour under stated construction choices.

7.1. Discovery

Discovery summarises recorded behaviour as a model or a set of variants. Where parallel form, visit, and query activities are combined within a trace, many variants can be expected, some of which reflect acceptable ordering choices: for example, one site may enter vital signs before laboratory results simply because the results arrive later. A rare variant is a statement about frequency in the log, not about acceptability. Discovery is suited to descriptive questions, such as which paths queries follow from opening to closure, where loops concentrate, or how the query lifecycle differs before and after a configuration change. It is not suited to establishing that a site works incorrectly.

7.2. Conformance Checking and Reference Models

Conformance checking relates observed behaviour to a process model and locates deviations relative to that model [35,70], so its results are only as meaningful as the reference model. In a trial, that model would have to reflect the protocol version, the CRF and edit-check configuration, and the data-management plan in force when each event occurred. A conformance difference is a difference from a chosen representation, which may or may not correspond to a protocol deviation. A healthcare study that checked FHIR audit events from ten cases against a standard operating procedure found several deviations but had no means of judging which were warranted [71], a limitation that is common across computable adherence studies [58].
A defensible EDC reference model can be built from existing study documents: the schedule of assessments, CRF completion guidelines, edit-check specifications, the query-management procedure, and the data-management and data-review plans. Because many orderings are acceptable, it is better expressed as a small set of constraints than as one required sequence. For example, a query closed manually by a data manager should have a site response unless the procedure permits cancellation or withdrawal, whereas one closed automatically by its edit check needs none; and source-data verification of a form should follow the last change to it unless the change is re-verified. Each constraint should be versioned with the study build, so that events are checked against the rules in force when they occurred, and validated by data managers and monitors who walk through the model and replay it on user-acceptance test data or on a sample of known-good traces. Project methodologies for process mining and healthcare studies both recommend this iterative review by domain experts [27,57].

7.3. Performance Analysis

Performance analysis annotates models with waiting and cycle times [70]. Long query-resolution times may arise from dependence on external reconciliation, the timing of monitoring visits, site staffing, or ambiguous query text, as well as from genuine difficulty. Healthcare process-mining guidance accordingly stresses the involvement of domain experts in interpretation [23,56]. Performance questions, such as where waiting accumulates in the query lifecycle, are suited to EDC data if the time classes in Table 4 are kept apart and censoring is handled as described in Section 6.2.

8. Configuration History and Version-Aware Interpretation

Trials change during conduct. Protocol amendments, CRF revisions, new or modified edit checks, changes to roles and permissions, and revised external transfers or mappings alter which actions are possible, required, or automatically generated. Such changes may alter the workflow itself, its recorded representation, or both. Process-mining research treats changes in process behaviour over time as concept drift and has shown that analysing a log as though the process were stationary can give misleading models and comparisons [38,72]; changes in logging or configuration that leave the underlying work unchanged need to be distinguished from drift in the process. A new edit check introduced mid-study may produce a wave of queries and corrections that looks like increased rework; a revised CRF may make a previously normal path appear nonconforming; and participants enrolled before an amendment may complete a newly added form out of the original visit order. A pattern that appears across sites at the same calendar time warrants comparison with configuration-change dates and other shared operational events.
Three kinds of change should be distinguished. An operational change alters what people do, for example, a new requirement to re-verify data after any change. A configuration change alters what the system requires or generates, such as a new edit check. A logging change alters only how actions are recorded, for example, a vendor release that writes one audit record per field instead of one per save, or that adds automatic status events. An EHR study found that a software upgrade during the observation period changed the discovered process models [22], and sequence models of EHR audit logs lose accuracy over time as recorded behaviour drifts [73]. In an EDC study, a release that doubled the number of audit records per save would produce, on the same date at every site, an apparent rise in rework with no change in the number of data values that actually changed. Comparing the ratio of audit records to changed values, and the timing of the shift with release notes and configuration-change dates, could help distinguish a logging change from an operational one, although this diagnostic has not been tested.
Version-aware analysis therefore links each event, where the information is available, to the protocol, CRF, edit-check, role, and transfer or mapping versions in effect when it occurred. The linkage should be made at the site, participant, or form level at which versions were applied, not by calendar date alone. Version periods can then be analysed separately or version treated as an attribute, and events whose governing version cannot be determined should be reported. ICH E6(R3) expects systems to keep logs of user accounts, roles, and permissions [2], which helps with this linkage, and provenance models offer a general vocabulary for recording how derived records relate to their sources, activities, and agents [74,75].

9. From Process Observation to Quality Outcome

The preceding sections identify risks at two levels: in how the event log is constructed and in how the resulting patterns are interpreted. Table 5 summarises the main construction choices, the distortions each can introduce, and the checks that expose them.
Table 5. EDC logging and modelling choices, potential distortions, construction checks, sensitivity or validation checks, and interpretive limits (based on [2,4,15,20,36,38]).
Figure 1 sets out the proposed interpretive framework, which separates five levels of inference, numbered L1 to L5 in the figure. The seven numbered boxes describe the operational steps; level L1 (process observation) covers steps 1–3, and each of the remaining levels corresponds to one step. Table 6 defines each level, the evidence it typically draws on, the criterion for moving to the next level, and the claim that can be made at that level. Workflow reconstruction refers to the models, variants, conformance results, and performance measures derived from the event log in step 3. A process signal may be a delay, a reopened query, a correction loop, an unusual sequence, inactivity, a bottleneck, a rare variant, or a difference from a reference model. Competing explanations include logging artefacts, automation, permitted exceptions, configuration or protocol changes, dependence on external data, workload, ambiguous instructions, and genuine operational problems. Verification may establish a quality problem, support an alternative explanation, or leave the signal unresolved; a quality outcome, in the sense of a clinically or operationally material problem, is only one of these endpoints.
Table 6. Levels of inference in the interpretive framework: definitions, typical evidence, criteria for moving to the next level, and permissible claims.
Figure 1. Proposed interpretive framework for clinical-trial EDC audit-trail process analysis. EDC audit-trail records are transformed into an event log through explicit choices about event definition, abstraction, case construction, timestamp provenance, actor and source classification, and version provenance. Workflow reconstruction can generate descriptive process signals, including variants, delays, reopening, rework, inactivity, or differences from a selected reference model. These signals require contextual interpretation and independent verification, which may establish a quality problem, support an alternative explanation, or leave the signal unresolved. The numbered boxes 1–7 are operational steps; the labels L1–L5 are levels of inference and are shown separately from the step numbers. Process signal ≠ quality outcome.
The distinction between explanatory and establishing evidence is the core of the framework. Evidence at L3 explains why a pattern arose; evidence at L4 establishes whether an outcome occurred, using criteria that are defined before the review and do not depend on the reconstructed trace. The same document can serve both purposes, as when query text explains a reopening and also shows that a value was wrong, but an outcome should never be inferred from the trace alone. Table 7 distinguishes the outcome categories that a verification step might establish, with their units and adjudication sources. The categories correspond broadly to the risk areas used in industry audit-trail guidance [25] and to the attention that ICH guidance gives to critical-to-quality factors and errors that matter [2,32].
Table 7. Categories of quality outcome that verification may establish, with units of analysis, illustrative criteria, and adjudication sources.
An efficient process is also not necessarily a correct one. FDA guidance on risk-based monitoring describes centralised monitoring as a way to identify missing or inconsistent data, outliers, potential protocol deviations, and delays in reporting data, as prompts for follow-up [29], and expects significant issues to be evaluated through root-cause analysis [30]; ICH E6(R3) describes centralised monitoring as supporting the selection of sites and processes for targeted monitoring [2]. In a retrospective study of central statistical monitoring, the analysis was evaluated against previously confirmed fraud [48], so the statistical signal was judged against an independently established outcome.
The framework overlaps with and differs from three related approaches. Validation in process mining includes model-quality measures, such as fitness and precision, that assess how well a model represents the log [35], and, in project methodologies, verification of findings against source data and systems and validation with stakeholders [27]. The framework adopts these steps; what it adds for EDC is a set of pre-defined trial-quality outcome categories and an explicit statement of what may be claimed at each level. Root-cause analysis begins after an issue has been confirmed and asks why it occurred [30], and industry audit-trail guidance already describes confirmation of signals, root-cause analysis, and documented resolution [24]; the framework makes the steps before confirmation explicit for sequence-based signals. Risk-based and centralised monitoring use signals to select sites and processes for targeted review [2,29]; the framework places process signals in that role and adds explicit criteria for when a signal may be reported as an outcome.
Process signals need operational definitions before they can be studied. Table 8 gives illustrative definitions for common signals, the construction decisions on which each depends, and common benign explanations. The definitions and any thresholds are examples, not validated indicators; appropriate thresholds depend on the study, its configuration, and its data-management plan.
Table 8. Illustrative definitions of process signals (not validated indicators; thresholds are study-specific).

10. Hypothetical Worked Examples

The four examples below were constructed to illustrate the reasoning in Figure 1 and Table 5. They are not drawn from any trial, dataset, or organisation, and the values, intervals, and thresholds in them are illustrative rather than validated.

10.1. Example 1: Query Reopening

A query-level trace reads: query opened, site response entered, query reopened, query closed, where “reopened” is the system’s label for returning a query to the site after a response. The reopening might follow an incomplete first response, a change to the edit check or to query-handling conventions, a pending laboratory reconciliation, an automatic reopening triggered when the underlying value changed, or a substantive data problem. The trace cannot distinguish among these. The query text and responses; the configuration history of the edit check; the system’s reopening rules; and, if a data problem is suspected, the source record are needed before anything more can be said than that the recorded lifecycle included a reopening.

10.2. Example 2: Delayed or Retrospective Entry

The visit date entered for a participant precedes the first EDC entry for that visit by several days. Delayed transcription is one possibility; others include batch entry on scheduled days, waiting for a specialist report, retrospective entry of a form added by amendment, system downtime, and time-zone handling. What the record shows is an interval between a recorded clinical date and a recorded system time. These are different kinds of time (Table 4). The visit date is usually recorded without a time, so the visit may have taken place at any point on that day, whereas the entry time is a precise system timestamp. The interval is therefore uncertain by up to one day. Converting the system time between coordinated universal time and the site’s local time can move it across midnight, which changes a day-level interval by at most one day, because time-zone offsets do not exceed 14 h. Time-zone handling can therefore matter for a requirement such as same-day entry, but it cannot plausibly explain an apparent delay of several days. Whether such a delay reflects a problem with site processes depends on information the audit trail does not hold.

10.3. Example 3: Correction Loops and an Edit-Check Change

A form-level trace shows a value entered, changed, and changed again. If the first change followed an edit-check prompt, the sequence is the expected record of that check [4]; the second change might reflect source-data verification, a late laboratory result, or correction of a transcription error, and the reason for change may say which. Suppose that in the same month a new edit check was deployed and similar loops appear at most sites. Against the pre-change configuration they look like widespread rework; a version-aware model would allow the new check to be considered as an explanation, without establishing the cause of any individual correction. Counting loops without classifying their triggers or without reference to configuration history would merge system-prompted, review-prompted, and spontaneous changes into a single misleading measure.

10.4. Example 4: A Synthetic Event Log Under Two Construction Choices

Table 9 lists 15 synthetic audit records for one participant’s week-4 visit, with a vital-signs form, a local-laboratory form populated by electronic transfer, and two edit-check queries. The visit date was entered as 2 March, without a time, and the extraction was taken on 20 March. The synthetic export is assumed to carry a save identifier shared by records 1–3, and a separate save identifier for record 5, and to link query Q1 to the systolic blood pressure item on the vital-signs form and query Q2 to the potassium item on the laboratory form.
Table 9. Synthetic EDC audit records for one participant visit, with the activity each record becomes under construction B (hypothetical; times in coordinated universal time). Under construction A, each record is one activity labelled by its action.
Construction A treats every audit record as an activity and the participant visit as the case, without retaining form or query identifiers as attributes; it suits a visit-level question, such as the span of recorded activity for a visit. Construction B groups entries that share a save identifier into one “form saved” episode, classifies the first human change to an item while its edit-check query is open as a prompted correction, and classifies each event by originator. It keeps forms and queries as separate, linked objects in an object-centric log, and suits questions about the lifecycle of individual forms and queries. The two constructions differ in abstraction, case notion, and actor classification at once, so Table 10 shows their combined effect rather than isolating each choice.
Table 10. Results of two construction choices applied to the records in Table 9.
Conventional summaries computed directly from the original audit records are the same, regardless of which construction is used afterwards: two queries, two value changes with recorded reasons, one reopening, an interval of two days between the visit date and first entry, and a resolution time of 13 days for Q2. What differs is the interpretation that the sequence supports. Construction A, like the conventional summaries, counts two value changes and one reopening without distinguishing their triggers and shows a change after verification; construction B shows a system-prompted correction completed within 90 s, a laboratory-driven query that waited on an external repeat result, and no change after verification of the same form. Part of this distinction is available without process mining, from reasons for change and query text. The comparison therefore shows how much the interpretation depends on construction rather than demonstrating that process mining is superior to well-designed audit-trail queries: visit-level and object-level durations answer different questions, and the “change after review” result reflects whether object identity is retained, which a well-designed audit-trail query can also do. What the process view contributes is a representation in which the order of actions and their links to objects are kept together for every trace, so that construction choices are explicit and can be varied systematically; whether this improves on programmed audit-trail queries in practice is an empirical question.
The timestamps add a further choice. The two-day interval between visit and first entry compares a date-only clinical value with a precise system time (Table 4). At a site five hours behind coordinated universal time, record 1 was made at 09:02 local time on 4 March, so the elapsed time since the visit lies anywhere between about 1.4 and 2.4 days, depending on the unrecorded time of the visit. An illustrative rule requiring entry within 48 h could therefore be judged met or breached depending on the unrecorded visit time; at the available precision, compliance is indeterminate unless the rule itself is defined in calendar days.
Applying Figure 1 to construction B, the reopening of Q2 is a process signal (L2). Contextual interpretation (L3) supports an alternative explanation, because the query text records a haemolysed sample and a pending repeat. Verification (L4) would examine the laboratory reports for both samples to confirm the values and the haemolysis, but one question cannot be resolved from the trace at all: whether the initial potassium of 6.1 mmol/L required an adverse-event assessment. That question can be answered only by source and medical review, and until it is, the signal remains unresolved with respect to a safety-relevant outcome even though the trace suggests no data error. This example demonstrates the reasoning of the framework; it does not validate the framework, which requires evaluation against adjudicated outcomes (Section 12).

11. System Boundaries and Implications for Risk-Based Quality Management

An EDC audit trail records only actions performed in or transmitted to the EDC system. Monitoring visits; source-document review; site–sponsor communication; safety review; and reconciliation with laboratory, imaging, or electronic patient-reported outcome systems may take place partly or wholly elsewhere. FDA guidance assesses part 11 compliance once data enter the sponsor’s EDC system and treats originating EHR and other real-world data systems differently [4]. An EDC trace is therefore a partial representation of operational work, and an apparent period of inactivity may correspond to work documented in another system.
One plausible use of EDC process signals within risk-based quality management is to help prioritise human review, consistent with the role that ICH and FDA guidance give to centralised monitoring (Section 9) [2,30]. Risk-based monitoring components, including centralised monitoring, have been adopted in industry-sponsored trials [49], and central statistical monitoring already treats cross-site anomalies as prompts for investigation [45,46,47]. Process signals could complement these methods in a specific way. Central statistical monitoring compares the distributions of data values across sites, and the key risk indicators in common use summarise counts and durations; as usually implemented, neither represents the order of actions or the relations between forms, queries, and review events, although custom indicators could be built to do so. A process view could, for example, separate system-prompted from review-prompted corrections or distinguish waiting on external data from waiting on site action, making an existing indicator easier to interpret. These benefits are plausible but have not been demonstrated empirically.
Poorly calibrated signals carry costs. Each flagged pattern consumes reviewer time, may prompt queries or site contacts, and, if presented as a site metric, can be read as a judgement on site performance. Calibration is difficult. One set of fraud-detection risk scores was validated only for its false-positive rate, in a trial without fraud [52]. In a prospective matched-pair study of triggered monitoring, sites prioritised by triggers had only modestly higher rates of important findings than matched untriggered sites [50]. For exploratory or monitoring use, a cautious presentation would give reviewers each signal with its plausible alternative explanations and documented, study-specific escalation thresholds, with their validation status stated; it would also report the reviewer effort each signal generates and would avoid converting signals into site rankings or performance scores.

11.1. Data Privacy, Confidentiality, and Governance

EDC audit trails contain participant identifiers, user identities and roles, timestamps that can be linked to visits, free-text reasons for change, and query text that may include clinical details. Process mining adds further disclosure risk, because a sequence of events can identify a participant or a user even after direct identifiers are removed [76]. Analyses therefore need a defined purpose and legal basis, pseudonymisation of participant and user identifiers, minimisation of free text, and agreement with sponsors and sites on who may see user-level patterns. These constraints limit what can be shared between organisations and make independent replication difficult. Linkage to monitoring records, safety databases, or EHR data for verification adds governance requirements of its own. Synthetic event logs generated by simulation or generative models can support method development and replication without exposing trial data [44,77], although results obtained on synthetic data cannot establish that a method detects real quality problems.

11.2. Differences Between EDC Platforms

EDC platforms differ in how they structure audit trails, which components they export, how they label activities, and whether they record review, signature, and query events in the same log as data changes. The CDISC ODM provides a common structure for clinical data and their audit records [31], and healthcare work on HL7 FHIR AuditEvent resources shows how a standardised audit format can be mapped to process-mining formats [43], but neither standard defines EDC data-management workflows. EHR research shows the consequence of vendor-specific logging: measures of clinician activity offered by different vendors were found to differ in maturity and definition, limiting cross-vendor comparison [61]. The same is likely for EDC platforms. Findings from one platform should therefore not be assumed to generalise to another without mapping its audit structure, and cross-study comparison requires activity mappings that are published with the results.

12. A Feasible Evaluation Design for Future Studies

No study identified in the searches has shown that EDC process signals identify quality problems. An evaluation that could do so would include the following elements, adapted from evaluations of central and triggered monitoring [48,50,51] and from frameworks for validating audit-log measures in EHRs [62].
First, signals, their construction choices, and the outcome categories and criteria (Table 7) should be specified before analysis. Outcome criteria must add information beyond the signal. Where a signal is a timeline exceedance, for example, the outcome cannot be the same exceedance measured on the same timestamps; it must include the checks of applicability, timestamp meaning, and permitted exceptions described for operational delay in Table 7. Where the outcome criterion includes the signal’s exceedance as a necessary condition, every confirmed outcome is flagged, so sensitivity is 100% by construction and the evaluation chiefly estimates positive predictive value. Estimating sensitivity requires a reference review that can identify delays among unflagged units, for example, from source-document dates or from the item-specific timeline that actually applied. Second, verification should cover both flagged and unflagged units. Reviewing only flagged records can estimate how often a signal is correct (positive predictive value) but cannot show how many problems were missed; a stratified random sample of unflagged records, visits, or sites, reviewed with the same procedure, is needed to estimate sensitivity and specificity, with sampling weights applied in the estimates. Because important problems are usually rare, the unflagged sample must be large enough to observe missed problems, and the precision of the sensitivity estimate should be reported. A matched design, in which each flagged site is paired with a comparable unflagged site reviewed at the same time, is a feasible alternative [50]; it estimates the difference in yield between flagged and unflagged sites, but not population-level sensitivity or predictive values. Third, adjudicators should be blinded to whether a unit was flagged. A complementary protection applies to signal generation: analysts should not know the outcomes, as in an evaluation in which statisticians analysed submitted trial data without knowing which applications had failed inspection [51]. The two forms of blinding protect against different biases, and both should be reported. Fourth, signals that remain unresolved after verification should be reported as a separate category rather than counted as negative, and a sensitivity analysis should show how performance estimates change if they are counted as positive or negative. Fifth, the process-based approach should be compared with conventional methods applied to the same records, such as key risk indicators, standard audit-trail review use cases, or central statistical monitoring, in terms of additional confirmed problems, false positives, and reviewer hours per confirmed problem. Finally, the evaluation should span more than one study and, ideally, more than one EDC platform, and should report the effect of construction choices on its results. The illustrative signal definitions, thresholds, and synthetic example in this review are not validated and provide no evidence of predictive performance; establishing such performance is the purpose of the evaluation described here.

13. Proposed Reporting Items for Future Empirical Studies

Reporting guidance has been proposed for analyses of EHR audit-log metadata [28], but none was found for EDC audit-trail process mining. Table 11 proposes reporting items derived from the issues discussed above. Items 1, 2, and 9 adapt elements of the EHR audit-log reporting guidance [28] and process-mining project methodology [27]; items 3–8 and 10–12 are adapted to, or specific to, EDC audit trails and the interpretive framework. The items are conditional on the claim a study makes: essential items (E) apply to every study, whereas conditional items (C) apply when a study makes the corresponding claim, such as a claim to detect quality problems, which additionally needs an independent outcome reference. They have not undergone consensus development, are not a validated reporting guideline, and are offered as a starting point for expert consultation.
Table 11. Proposed reporting items for empirical studies of EDC audit-trail process mining (author-proposed; not validated or consensus-based). E, essential for all studies; C, conditional on the stated claim.
Because audit-trail data can rarely be shared, reproducibility depends on publishing transformation rules, activity mappings, case or object definitions, ordering and censoring rules, software versions, and parameters, ideally with a synthetic log that reproduces the structure of the export (Section 11.1).

14. Discussion

In EDC audit-trail process analysis, event-log construction and signal interpretation require explicit justification alongside the choice of discovery algorithm. Regulators expect audit trails to be interpretable, exportable for pattern review, and reviewed on a risk basis [2,3,4], but none of their documents addresses process-mining methods. Process mining, for its part, supplies the means to construct event logs, check conformance, and handle multiple objects [15,35,36]. In the identified sources, the regulatory texts and the methodological literature rarely refer to each other, yet the questions that connect them (what counts as an event, what counts as a case, and against which model a trace should be judged) are important methodological vulnerabilities in EDC analyses.
Table 12 separates what the reviewed literature supports from what this review infers and from what remains a hypothesis for empirical work. The literature establishes that log construction changes reconstructed processes and indicates that audit records need semantic enrichment before process analysis, that timestamps and case identifiers are frequent sources of error in healthcare logs, and that statistical monitoring signals are prompts rather than findings. That the same mechanisms operate in EDC audit trails is an inference from shared features, not an observed result. That process signals can improve the detection of quality problems, or reduce reviewer effort, is a hypothesis.
Table 12. Synthesis linking identified gaps to the review’s recommendations and to the validation each recommendation requires. Gaps are those identified in the sources reviewed, except where marked as risks inferred by the review.
A prioritised research agenda follows from this synthesis. The first priority is evaluation against independently adjudicated outcomes, using flagged and unflagged samples, because without it, no signal can be recommended for routine use. The second is empirical sensitivity analysis of construction decisions on real audit exports, which would show which choices matter most and should be standardised. The third is comparison of case-centric and object-centric representations on the same data. The fourth is assessment of operational usefulness within risk-based monitoring, including reviewer effort and the burden on sites. The fifth is consensus development of reporting items with data managers, monitors, statisticians, and process-mining researchers.
As EHR audit-log research grew, investigators came to rely increasingly on vendor-derived measures [13], and calls for validation and reporting guidance followed [14,28]. EDC audit-trail analytics could follow a similar path if vendors and sponsors build dashboards over audit data, which argues for explicit definitions of events, cases, and signals before routine use.

15. Limitations

Because this is a narrative review, source identification and appraisal were not exhaustive, and relevant work may have been missed, particularly conference proceedings, non-English publications, and industry reports outside scholarly indexes. The documented searches covered PubMed and the first 50 relevance-ranked proceedings records in each of two Crossref searches; Scopus, Web of Science, IEEE Xplore, and the ACM Digital Library were not searched directly, and screening and appraisal were done by a single author without formal risk-of-bias assessment. Because direct evidence is sparse, the selection of sources may be biased towards literature indexed in the searched resources, towards the most relevance-ranked conference records, and by the judgement of a single screener. Direct EDC and audit-trail sources are used where available, but much of the methodological evidence comes from healthcare process mining and EHR audit-log research and is applied here by analogy; accordingly, direct EDC and regulatory evidence is distinguished from analogical healthcare and EHR evidence in Table 1 and Supplementary Table S1. Industry guidance on audit-trail review is not peer-reviewed. EDC platforms differ in audit-trail structure and export capability, and no specific system was assessed. The framework, interpretation table, and reporting items have not been tested empirically or through formal consensus methods. No real EDC export was analysed, so the predictive performance of the signals the framework organises remains hypothetical until they are evaluated on real exports against independent adjudication, as proposed in Section 12. The five levels are a logical organisation of existing principles rather than an empirically derived model, and the worked examples, including the synthetic event log, are single hand-constructed cases. Their generalisability is uncertain across trial designs (for example, decentralised trials with substantial electronic patient-reported data or trials with direct EHR-to-EDC transfer), across EDC platforms and study configurations, and across organisations with different data-management practices, in which the meaning and frequency of recorded activities may differ.

16. Conclusions

EDC audit trails contain sequential and temporal information that can support reconstruction of the recorded aspects of data-management workflows. Process-mining and healthcare research shows that the meaning of a reconstructed pattern depends on how events and cases were defined, what the timestamps represent, and whether traces were complete. That the same holds for EDC audit trails, with the added effects of human and system actors, configuration versions, and the system boundary, is inferred from shared features rather than observed directly. Delays, reopened queries, correction loops, unusual variants, and conformance differences are process signals; they should not be read as evidence of data-quality failure, noncompliance, or poor site performance without contextual interpretation and independent verification, which may establish a problem, support an alternative explanation, or leave the signal unresolved. The review contributes an EDC-specific set of construction checks, a framework with explicit criteria for moving from signal to outcome, a synthetic demonstration that defensible construction choices change conclusions drawn from identical records, and an evaluation design and proposed reporting items. Whether audit-trail process analysis helps identify clinically or operationally meaningful quality problems within risk-based quality management remains to be established; until its signals are evaluated on real EDC exports against independent adjudication, their predictive performance should be regarded as hypothetical.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/informatics13110193/s1, Table S1: Reference–claim evidence ledger; Table S2: Documented search strategies, limits, and record counts; Table S3: Source-to-component mapping for the framework, construction checks, and reporting items. References [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77] are cited in the Supplementary Materials.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

No new data were created or analyzed in this study. Data sharing is not applicable to this article. The synthetic audit records constructed for Section 10.4 are given in full in Table 9.

Conflicts of Interest

The author is employed by Cytokinetics, Inc., and holds employer-granted restricted stock units and non-qualified stock options. Cytokinetics, Inc., had no role in the conception, preparation, funding, review, approval, or decision to submit this manuscript. The manuscript was prepared independently in the author’s personal capacity. The author declares no other conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
ACDMAssociation for Clinical Data Management
CDISCClinical Data Interchange Standards Consortium
CRFCase report form
EDCElectronic data capture
EHRElectronic health record
EMAEuropean Medicines Agency
FDAU.S. Food and Drug Administration
FHIRFast Healthcare Interoperability Resources
HL7Health Level Seven
ICHInternational Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use
OCELObject-Centric Event Log
ODMOperational Data Model
OMOPObservational Medical Outcomes Partnership
SCDMSociety for Clinical Data Management

References

  1. U.S. Code of Federal Regulations. Title 21, Part 11, Section 11.10: Controls for Closed Systems, Paragraph (e). Available online: https://www.ecfr.gov/current/title-21/chapter-I/subchapter-A/part-11/subpart-B/section-11.10 (accessed on 2 October 2026).
  2. International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH). ICH Harmonised Guideline: Guideline for Good Clinical Practice E6(R3). Final Version: Principles and Annex 1 Adopted 6 January 2025; Consolidated with Annex 2, 16 June 2026. Available online: https://database.ich.org/sites/default/files/ICH%20E6(R3)_Step4_FinalConsolidatedGuideline_2026_0616_.pdf (accessed on 2 October 2026).
  3. European Medicines Agency. Guideline on Computerised Systems and Electronic Data in Clinical Trials; EMA/INS/GCP/112288/2023; European Medicines Agency: Amsterdam, The Netherlands, 2023; Available online: https://www.ema.europa.eu/en/documents/regulatory-procedural-guideline/guideline-computerised-systems-and-electronic-data-clinical-trials_en.pdf (accessed on 2 October 2026).
  4. U.S. Food and Drug Administration. Electronic Systems, Electronic Records, and Electronic Signatures in Clinical Investigations: Questions and Answers. Guidance for Industry (Final, Revision 1); Docket No. FDA-2017-D-1105; U.S. Food and Drug Administration: Silver Spring, MD, USA, 2024. Available online: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/electronic-systems-electronic-records-and-electronic-signatures-clinical-investigations-questions (accessed on 2 October 2026).
  5. van der Aalst, W. Process Mining: Data Science in Action, 2nd ed.; Springer: Berlin/Heidelberg, Germany, 2016. [Google Scholar] [CrossRef] [Scilit]
  6. van der Aalst, W.M.P.; Carmona, J. (Eds.) Process Mining Handbook; Lecture Notes in Business Information Processing; Springer: Cham, Switzerland, 2022; Volume 448. [Google Scholar] [CrossRef] [Scilit]
  7. Rojas, E.; Munoz-Gama, J.; Sepúlveda, M.; Capurro, D. Process mining in healthcare: A literature review. J. Biomed. Inform. 2016, 61, 224–236. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  8. De Roock, E.; Martin, N. Process mining in healthcare—An updated perspective on the state of the art. J. Biomed. Inform. 2022, 127, 103995. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  9. Guzzo, A.; Rullo, A.; Vocaturo, E. Process mining applications in the healthcare domain: A comprehensive review. WIREs Data Min. Knowl. Discov. 2022, 12, e1442. [Google Scholar] [CrossRef] [Scilit]
  10. Aversano, L.; Iammarino, M.; Madau, A.; Pirlo, G.; Semeraro, G. Process mining applications in healthcare: A systematic literature review. PeerJ Comput. Sci. 2025, 11, e2613. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  11. Adler-Milstein, J.; Adelman, J.S.; Tai-Seale, M.; Patel, V.L.; Dymek, C. EHR audit logs: A new goldmine for health services research? J. Biomed. Inform. 2020, 101, 103343. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  12. Rule, A.; Chiang, M.F.; Hribar, M.R. Using electronic health record audit logs to study clinical activity: A systematic review of aims, measures, and methods. J. Am. Med. Inform. Assoc. 2020, 27, 480–490. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  13. Rule, A.; Melnick, E.R.; Apathy, N.C. Using event logs to observe interactions with electronic health records: An updated scoping review shows increasing use of vendor-derived measures. J. Am. Med. Inform. Assoc. 2023, 30, 144–154. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  14. Kannampallil, T.; Adler-Milstein, J. Using electronic health record audit log data for research: Insights from early efforts. J. Am. Med. Inform. Assoc. 2023, 30, 167–171. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  15. Diba, K.; Batoulis, K.; Weidlich, M.; Weske, M. Extraction, correlation, and abstraction of event data for process mining. WIREs Data Min. Knowl. Discov. 2020, 10, e1346. [Google Scholar] [CrossRef] [Scilit]
  16. van Zelst, S.J.; Mannhardt, F.; de Leoni, M.; Koschmider, A. Event abstraction in process mining: Literature review and taxonomy. Granul. Comput. 2021, 6, 719–736. [Google Scholar] [CrossRef] [Scilit]
  17. Andrews, R.; van Dun, C.G.J.; Wynn, M.T.; Kratsch, W.; Röglinger, M.K.E.; ter Hofstede, A.H.M. Quality-informed semi-automated event log generation for process mining. Decis. Support Syst. 2020, 132, 113265. [Google Scholar] [CrossRef] [Scilit]
  18. van der Aalst, W.; Adriansyah, A.; de Medeiros, A.K.A.; Arcieri, F.; Baier, T.; Blickle, T.; Bose, J.C.; van den Brand, P.; Brandtjen, R.; Buijs, J.; et al. Process Mining Manifesto. In Business Process Management Workshops; Lecture Notes in Business Information Processing; Springer: Berlin/Heidelberg, Germany, 2012; Volume 99, pp. 169–194. [Google Scholar] [CrossRef] [Scilit]
  19. Bose, R.P.J.C.; Mans, R.S.; van der Aalst, W.M.P. Wanna improve process mining results? In Proceedings of the 2013 IEEE Symposium on Computational Intelligence and Data Mining (CIDM), Singapore, 16–19 April 2013; pp. 127–134. [Google Scholar] [CrossRef] [Scilit]
  20. Suriadi, S.; Andrews, R.; ter Hofstede, A.H.M.; Wynn, M.T. Event log imperfection patterns for process mining: Towards a systematic approach to cleaning event logs. Inf. Syst. 2017, 64, 132–150. [Google Scholar] [CrossRef] [Scilit]
  21. Fox, F.; Aggarwal, V.R.; Whelton, H.; Johnson, O. A data quality framework for process mining of electronic health record data. In Proceedings of the 2018 IEEE International Conference on Healthcare Informatics (ICHI), New York, NY, USA, 4–7 June 2018; pp. 12–21. [Google Scholar] [CrossRef] [Scilit]
  22. Kurniati, A.P.; Rojas, E.; Hogg, D.; Hall, G.; Johnson, O.A. The assessment of data quality issues for process mining in healthcare using Medical Information Mart for Intensive Care III, a freely available e-health record database. Health Inform. J. 2019, 25, 1878–1893. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  23. Munoz-Gama, J.; Martin, N.; Fernandez-Llatas, C.; Johnson, O.A.; Sepúlveda, M.; Helm, E.; Galvez-Yanjari, V.; Rojas, E.; Martinez-Millana, A.; Aloini, D.; et al. Process mining for healthcare: Characteristics and challenges. J. Biomed. Inform. 2022, 127, 103994. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  24. eClinical Forum; Society for Clinical Data Management. Audit Trail Review: A Key Tool to Ensure Data Integrity. An Industry Position Paper; Version PR1. April 2021. Available online: https://scdm.org/wp-content/uploads/2024/07/2021-eCF_SCDM-ATR-Industry-Position-Paper-Version-PR1-2.pdf (accessed on 2 October 2026).
  25. Davies, R.; Duckett, C.; Langenhoven, L.; Logue Nielsen, J.; Paterson, A. Audit Trail Review: An Exploration of Risk Scenarios and Use Cases; Version 1.0; Association for Clinical Data Management (ACDM): Wantage, UK, 2025; Available online: https://acdmglobal.org/wp-content/uploads/2025/08/ATR-An-Exploration-of-Risk-Scenarios-and-Use-Cases.pdf (accessed on 2 October 2026).
  26. Andrews, R.; Wynn, M.T.; Vallmuur, K.; ter Hofstede, A.H.M.; Bosley, E.; Elcock, M.; Rashford, S. Leveraging data quality to better prepare for process mining: An approach illustrated through analysing road trauma pre-hospital retrieval and transport processes in Queensland. Int. J. Environ. Res. Public Health 2019, 16, 1138. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  27. van Eck, M.L.; Lu, X.; Leemans, S.J.J.; van der Aalst, W.M.P. PM2: A process mining project methodology. In Advanced Information Systems Engineering (CAiSE 2015); Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2015; Volume 9097, pp. 297–313. [Google Scholar] [CrossRef] [Scilit]
  28. Rule, A.; Kannampallil, T.; Hribar, M.R.; Dziorny, A.C.; Thombley, R.; Apathy, N.C.; Adler-Milstein, J. Guidance for reporting analyses of metadata on electronic health record use. J. Am. Med. Inform. Assoc. 2024, 31, 784–789. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  29. U.S. Food and Drug Administration. Oversight of Clinical Investigations—A Risk-Based Approach to Monitoring. Guidance for Industry; Docket FDA-2011-D-0597; U.S. Food and Drug Administration: Silver Spring, MD, USA, 2013. Available online: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/oversight-clinical-investigations-risk-based-approach-monitoring (accessed on 2 October 2026).
  30. U.S. Food and Drug Administration. A Risk-Based Approach to Monitoring of Clinical Investigations: Questions and Answers. Guidance for Industry; U.S. Food and Drug Administration: Silver Spring, MD, USA, 2023. Available online: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/risk-based-approach-monitoring-clinical-investigations-questions-and-answers (accessed on 2 October 2026).
  31. Clinical Data Interchange Standards Consortium (CDISC). Operational Data Model (ODM), Version 2.0; CDISC: Austin, TX, USA, 2023; Available online: https://www.cdisc.org/standards/data-exchange/odm (accessed on 2 October 2026).
  32. International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH). ICH Harmonised Guideline: General Considerations for Clinical Studies E8(R1). Final Version Adopted 6 October 2021. Available online: https://database.ich.org/sites/default/files/ICH_E8-R1_Guideline_Step4_2021_1006.pdf (accessed on 28 October 2026).
  33. Mitchel, J.T.; Kim, Y.J.; Choi, J.; Park, G.; Cappi, S.; Horn, D.; Kist, M.; D’Agostino, R.B., Jr. Evaluation of data entry errors and data changes to an electronic data capture clinical trial database. Drug Inf. J. 2011, 45, 421–430. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  34. Haq, R.R.; Campos, S.; Kapp, J.M.; Schlemper, S.; Simoes, E.J. Using process mining to assess the fidelity of a home visiting program. Front. Public Health Serv. Syst. Res. 2016, 5, 5–11. [Google Scholar] [CrossRef] [Scilit]
  35. Carmona, J.; van Dongen, B.; Solti, A.; Weidlich, M. Conformance Checking: Relating Processes and Models; Springer: Cham, Switzerland, 2018. [Google Scholar] [CrossRef] [Scilit]
  36. van der Aalst, W.M.P. Object-centric process mining: Dealing with divergence and convergence in event data. In Software Engineering and Formal Methods (SEFM 2019); Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2019; Volume 11724, pp. 3–25. [Google Scholar] [CrossRef] [Scilit]
  37. Fahland, D. Process mining over multiple behavioral dimensions with event knowledge graphs. In Process Mining Handbook; van der Aalst, W.M.P., Carmona, J., Eds.; Springer: Cham, Switzerland, 2022; pp. 274–319. [Google Scholar] [CrossRef] [Scilit]
  38. Bose, R.P.J.C.; van der Aalst, W.M.P.; Žliobaitė, I.; Pechenizkiy, M. Dealing with concept drifts in process mining. IEEE Trans. Neural Netw. Learn. Syst. 2014, 25, 154–171. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  39. Pegoraro, M.; Uysal, M.S.; van der Aalst, W.M.P. Conformance checking over uncertain event data. Inf. Syst. 2021, 102, 101810. [Google Scholar] [CrossRef] [Scilit]
  40. Park, G.; Lee, Y.; Cho, M. Enhancing healthcare process analysis through object-centric process mining: Transforming OMOP common data models into object-centric event logs. J. Biomed. Inform. 2024, 156, 104682. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  41. Zhang, S.; Genga, L.; Dekker, L.; Nie, H.; Lu, X.; Duan, H.; Kaymak, U. Re-ordered fuzzy conformance checking for uncertain clinical records. J. Biomed. Inform. 2023, 149, 104566. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  42. Tung, T.-H.; DeLaurentis, P.; Yih, Y. Uncovering discrepancies in IV vancomycin infusion records between pump logs and EHR documentation. Appl. Clin. Inform. 2022, 13, 891–900. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  43. Pointner, A.; Krauss, O.; Erhard, A.; Schuler, A.; Helm, E. Multi-perspective process mining interfaces for HL7 AuditEvent repositories: XES and OCEL. Stud. Health Technol. Inform. 2023, 301, 168–173. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  44. Adlberger, S.; Bauernfeind, S.; van den Broek, M.; Pointner, A.; Arthofer, K.; Krauss, O. Leveraging synthetic patient data for process mining in healthcare. Stud. Health Technol. Inform. 2026, 336, 1634–1638. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  45. Venet, D.; Doffagne, E.; Burzykowski, T.; Beckers, F.; Tellier, Y.; Genevois-Marlin, E.; Becker, U.; Bee, V.; Wilson, V.; Legrand, C.; et al. A statistical approach to central monitoring of data quality in clinical trials. Clin. Trials 2012, 9, 705–713. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  46. Kirkwood, A.A.; Cox, T.; Hackshaw, A. Application of methods for central statistical monitoring in clinical trials. Clin. Trials 2013, 10, 783–806. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  47. Timmermans, C.; Venet, D.; Burzykowski, T. Data-driven risk identification in phase III clinical trials using central statistical monitoring. Int. J. Clin. Oncol. 2016, 21, 38–45. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  48. de Viron, S.; Trotta, L.; Schumacher, H.; Lomp, H.-J.; Höppner, S.; Young, S.; Buyse, M. Detection of fraud in a clinical trial using unsupervised statistical monitoring. Ther. Innov. Regul. Sci. 2022, 56, 130–136. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  49. Adams, A.; Adelfio, A.; Barnes, B.; Berlien, R.; Branco, D.; Coogan, A.; Garson, L.; Ramirez, N.; Stansbury, N.; Stewart, J.; et al. Risk-based monitoring in clinical trials: 2021 update. Ther. Innov. Regul. Sci. 2023, 57, 529–537. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  50. Stenning, S.P.; Cragg, W.J.; Joffe, N.; Diaz-Montana, C.; Choudhury, R.; Sydes, M.R.; Meredith, S. Triggered or routine site monitoring visits for randomised controlled trials: Results of TEMPER, a prospective, matched-pair study. Clin. Trials 2018, 15, 600–609. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  51. Lindblad, A.S.; Manukyan, Z.; Purohit-Sheth, T.; Gensler, G.; Okwesili, P.; Meeker-O’Connell, A.; Ball, L.; Marler, J.R. Central site monitoring: Results from a test of accuracy in identifying trials and sites failing Food and Drug Administration inspection. Clin. Trials 2014, 11, 205–217. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  52. Pogue, J.M.; Devereaux, P.J.; Thorlund, K.; Yusuf, S. Central statistical monitoring: Detecting fraud in clinical trials. Clin. Trials 2013, 10, 225–235. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  53. de Viron, S.; Trotta, L.; Steijn, W.; Young, S.; Buyse, M. Does central statistical monitoring improve data quality? An analysis of 1,111 sites in 159 clinical trials. Ther. Innov. Regul. Sci. 2024, 58, 483–494. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  54. Paster, F.; Helm, E. From IHE audit trails to XES event logs facilitating process mining. Stud. Health Technol. Inform. 2015, 210, 40–44. [Google Scholar] [CrossRef] [Scilit]
  55. Helm, E. Towards process mining in radiology: Utilization of IHE SOLE. Stud. Health Technol. Inform. 2020, 271, 108–109. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  56. Martin, N.; De Weerdt, J.; Fernández-Llatas, C.; Gal, A.; Gatta, R.; Ibáñez, G.; Johnson, O.; Mannhardt, F.; Marco-Ruiz, L.; Mertens, S.; et al. Recommendations for enhancing the usability and understandability of process mining in healthcare. Artif. Intell. Med. 2020, 109, 101962. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  57. Benevento, E.; Aloini, D.; van der Aalst, W.M.P. How can interactive process discovery address data quality issues in real business settings? Evidence from a case study in healthcare. J. Biomed. Inform. 2022, 130, 104083. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  58. Hoang, M.T.; Donnelly, C.; Igasto, C.; Shetty, A.; Pradhan, M.; Shaw, T. Data-driven guideline adherence in data representation and compliance measurement: Scoping review. J. Med. Internet Res. 2026, 28, e79937. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  59. Berti, A.; Koren, I.; Adams, J.N.; Park, G.; Knopp, B.; Graves, N.; Rafiei, M.; Liß, L.; Tacke Genannt Unterberg, L.; Zhang, Y.; et al. OCEL (Object-Centric Event Log) 2.0 Specification. arXiv 2024, arXiv:2403.01975. [Google Scholar] [CrossRef] [Scilit]
  60. Berti, A.; van der Aalst, W.M.P. OC-PM: Analyzing object-centric event logs and process models. Int. J. Softw. Tools Technol. Transf. 2023, 25, 1–17. [Google Scholar] [CrossRef] [Scilit]
  61. Baxter, S.L.; Apathy, N.C.; Cross, D.A.; Sinsky, C.; Hribar, M.R. Measures of electronic health record use in outpatient settings across vendors. J. Am. Med. Inform. Assoc. 2021, 28, 955–959. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  62. Spector, P.R.; Grauer, A.; Kneifati-Hayek, J.Z.; Ranard, B.L.; Applebaum, J.R.; Fernandes, Y.; Salmasian, H.; Southern, W.N.; Schechter, C.B.; Hruby, G.; et al. A framework for developing, validating, and utilizing automated measures of order errors using the retract-and-reorder methodology. JAMIA Open 2026, 9, ooag165. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  63. Krishnankutty, B.; Bellary, S.; Naveen Kumar, B.R.; Moodahadu, L.S. Data management in clinical research: An overview. Indian J. Pharmacol. 2012, 44, 168–172. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  64. IEEE Std 1849-2023; IEEE Standard for eXtensible Event Stream (XES) for Achieving Interoperability in Event Logs and Event Streams. IEEE: New York, NY, USA, 2023. Available online: https://standards.ieee.org/ieee/1849/10907/ (accessed on 2 October 2026).
  65. Martin, N. Data quality in process mining. In Interactive Process Mining in Healthcare; Health Informatics; Fernandez-Llatas, C., Ed.; Springer: Cham, Switzerland, 2021; pp. 53–79. [Google Scholar] [CrossRef] [Scilit]
  66. Mans, R.S.; van der Aalst, W.M.P.; Vanwersch, R.J.B.; Moleman, A.J. Process mining in healthcare: Data challenges when answering frequently posed questions. In Process Support and Knowledge Representation in Health Care; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2013; Volume 7738, pp. 140–153. [Google Scholar] [CrossRef] [Scilit]
  67. Dixit, P.M.; Suriadi, S.; Andrews, R.; Wynn, M.T.; ter Hofstede, A.H.M.; Buijs, J.C.A.M.; van der Aalst, W.M.P. Detection and interactive repair of event ordering imperfection in process logs. In Advanced Information Systems Engineering (CAiSE 2018); Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2018; Volume 10816, pp. 274–290. [Google Scholar] [CrossRef] [Scilit]
  68. Clark, T.G.; Bradburn, M.J.; Love, S.B.; Altman, D.G. Survival analysis part I: Basic concepts and first analyses. Br. J. Cancer 2003, 89, 232–238. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  69. Austin, P.C.; Lee, D.S.; Fine, J.P. Introduction to the analysis of survival data in the presence of competing risks. Circulation 2016, 133, 601–609. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  70. van der Aalst, W.; Adriansyah, A.; van Dongen, B. Replaying history on process models for conformance checking and performance analysis. WIREs Data Min. Knowl. Discov. 2012, 2, 182–192. [Google Scholar] [CrossRef] [Scilit]
  71. Trajkovska, N.; Kastenhofer, S.; Sandler, S.; Bauernfeind, S.; Praschl, C.; Krauss, O.; Hecktor, R.; Herzmanek, D.; Roiss, M.; Haider, M.; et al. Process mining on FHIR AuditEvents: Conformance checking with a standard operating procedure for chest pain. Stud. Health Technol. Inform. 2026, 336, 1358–1359. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  72. Sato, D.M.V.; De Freitas, S.C.; Barddal, J.P.; Scalabrin, E.E. A survey on concept drift in process mining. ACM Comput. Surv. 2022, 54, 189. [Google Scholar] [CrossRef] [Scilit]
  73. Kim, S.; Lou, S.S.; Cobb, A.; Jha, S.; Kannampallil, T. A language model framework for sequence modeling of audit logs to characterize clinician–electronic health record interactions. J. Am. Med. Inform. Assoc. 2026, ocag163. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  74. Moreau, L.; Missier, P. (Eds.) PROV-DM: The PROV Data Model. W3C Recommendation; World Wide Web Consortium: 30 April 2013. Available online: https://www.w3.org/TR/prov-dm/ (accessed on 2 October 2026).
  75. Curcin, V.; Fairweather, E.; Danger, R.; Corrigan, D. Templates as a method for implementing data provenance in decision support systems. J. Biomed. Inform. 2017, 65, 1–21. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  76. Elkoumy, G.; Fahrenkrog-Petersen, S.A.; Sani, M.F.; Koschmider, A.; Mannhardt, F.; von Voigt, S.N.; Rafiei, M.; von Waldthausen, L. Privacy and confidentiality in process mining: Threats and research challenges. ACM Trans. Manag. Inf. Syst. 2022, 13, 11. [Google Scholar] [CrossRef] [Scilit]
  77. Li, K.; Yang, S.; Sullivan, T.M.; Burd, R.S.; Marsic, I. ProcessGAN: Generating privacy-preserving time-aware process data with conditional generative adversarial nets. ACM Trans. Knowl. Discov. Data 2024, 18, 228. [Google Scholar] [CrossRef] [Scilit] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.