1. Introduction
Intensive care units (ICUs) are among the most information-dense environments in healthcare [
1,
2]. An ICU is a hospital unit that provides continuous monitoring and advanced organ support for patients with life-threatening illness or at high risk of rapid deterioration [
3]. Modern ICUs generate repeated physiological measurements, laboratory values, medication records, ventilator parameters, clinical notes, and outcome labels through electronic health records (EHRs), where an EHR is a digital longitudinal record of patient care events. These data streams have created strong interest in artificial intelligence (AI), where AI denotes computational methods that learn patterns from data to support prediction, classification, explanation, or decision-making [
4]. In critical care, AI-based models have been developed for mortality prediction, sepsis detection, readmission risk, respiratory deterioration, acute kidney injury, length of stay, and treatment-response estimation [
3,
5,
6].
Despite this progress, clinical adoption remains constrained by a persistent interpretability gap. A deep neural network (DNN) is a multilayer learning model that transforms input variables through nonlinear hidden representations. DNNs can capture interactions and temporal dependencies in ICU data, but their predictions are often difficult to audit at the bedside [
4]. A clinician may need to understand whether a sepsis alert is driven by lactate, mean arterial pressure, temperature, use of vasopressors, or a combination of temporally ordered physiological changes. In this context, interpretability means more than producing a feature ranking; it requires a clinically meaningful account of how observed variables contribute to a risk estimate and whether the explanation is consistent with medical reasoning [
7]. Recent guidance for clinical prediction models using AI, including TRIPOD+AI and PROBAST+AI, reinforces the need for transparent reporting, appropriate validation, risk-of-bias assessment, and clinically interpretable presentation of model behavior [
8,
9].
Gradient-boosted decision trees (GBDTs) provide one practical route toward interpretable prediction [
10]. A GBDT is an ensemble of decision trees trained sequentially, where each new tree corrects errors made by the previous ensemble. GBDTs are widely used for tabular clinical data because they support feature importance analysis, threshold-based decision rules, partial dependence inspection, and efficient deployment [
10,
11]. However, ICU data are not purely static tabular records. Physiological variables are temporally dependent, irregularly sampled, frequently missing, and affected by interventions. A standalone GBDT may therefore miss delayed effects and nonlinear temporal interactions that a DNN teacher model can learn from time-series data.
Knowledge distillation offers a natural way to combine these strengths. Knowledge distillation (KD) is a training strategy in which a simpler student model learns from the output distribution or intermediate behavior of a more complex teacher model [
12]. In the ICU setting, a DNN teacher can learn high-capacity temporal representations, while a GBDT student can provide a more transparent approximation suitable for clinical review. Conventional distillation, however, mainly transfers predictive information. It does not guarantee that the student model preserves causal pathways or avoids dependence on clinically implausible correlations. This limitation is serious in critical care because association-based explanations may be misleading when treatments, disease severity, monitoring frequency, and missingness mechanisms interact.
Causal discovery provides a complementary foundation. Causal discovery denotes a family of methods that infer possible cause–effect relationships from data, usually under assumptions about conditional independence, acyclicity, temporal ordering, and unmeasured confounding [
13,
14,
15,
16]. A directed acyclic graph (DAG), denoted by
, represents variables as nodes and directed edges as candidate causal relationships. In ICU modeling, a DAG can encode clinically plausible pathways such as infection markers preceding organ dysfunction, hemodynamic instability preceding elevated lactate, or vasopressor administration affecting mean arterial pressure. Although a DAG learned from observational EHR data should not be interpreted as definitive causal truth, it can still act as a structured inductive bias that discourages purely spurious feature use.
This paper proposes a causal-pathway-guided DNN–GBDT distillation framework for interpretable AI in ICUs. The central idea is to use a causal graph not merely as a post hoc visualization but as an organizing structure throughout model development. First, a causal discovery module estimates a DAG from ICU time-series variables. Second, a DNN teacher model incorporates this graph through causal gating, so that hidden representations are shaped by both predictive gradients and plausible physiological dependencies. Third, The GBDT student is trained using soft predictive targets from the DNN teacher and a causal attribution-guided split-selection rule, so that tree construction remains compatible with standard boosting while giving priority to features aligned with teacher-derived causal attributions. The student model therefore aims to preserve the teacher’s predictive behavior while producing tree-based rules whose feature importance patterns remain aligned with discovered causal pathways.
The contributions of this study are the following.
- 1.
The study introduces a causal gating mechanism that incorporates graph-guided information flow into DNN representations for ICU prediction.
- 2.
The study formulates a causal attribution-guided split-selection mechanism that incorporates teacher-derived causal priorities into GBDT construction without requiring gradient propagation through discrete tree structures.
- 3.
The study presents an interpretable rule-mapping process that links GBDT decision paths to causal subgraphs, temporal windows, and clinically meaningful thresholds.
- 4.
The study evaluates the framework for MIMIC-IV ICU prediction tasks using discrimination metrics, precision–recall metrics, causal consistency indicators, and ablation analysis.
The remainder of this paper is organized as follows.
Section 2 reviews related work on interpretable ICU artificial intelligence, causal discovery, and knowledge distillation.
Section 3 presents the background on causal discovery and gradient-boosted decision trees.
Section 4 describes the proposed causal-aware DNN–GBDT distillation framework.
Section 5 explains the experimental setup, dataset, baselines, and evaluation metrics.
Section 6 reports predictive performance, calibration, clinical utility, causal interpretation, and ablation results.
Section 7 discusses implications, limitations, and ethical considerations.
Section 8 concludes the paper.
5. Experimental Setup and Implementation Details
7. Discussion
The results suggest that causal pathway guidance can improve the interpretability of DNN-to-GBDT distillation while preserving strong predictive performance. CAD-GBDT outperformed conventional interpretable baselines on sepsis onset and in-hospital mortality prediction and maintained higher causal consistency than black-box temporal models. This finding is important because ICU decision support requires predictions that can be inspected, questioned, and related to plausible physiological mechanisms.
The comparison between the TFT teacher, Direct GBDT, Standard KD, and CAD-GBDT clarifies the role of distillation. CAD-GBDT outperformed the TFT teacher in the reported test results, which can occur because the student was trained using both observed labels and teacher probabilities, while the tree-based representation also benefits from structured temporal summaries. The improvement over Direct GBDT indicates that the teacher contributed useful predictive information. The improvement over Standard KD indicates that causal split guidance added value beyond prediction-level distillation.
The revised implementation description also clarifies that causal consistency is not optimized by invalid backpropagation through discrete tree structures. Instead, teacher-derived causal priorities are used to modify candidate split selection in the GBDT. This implementation preserves the standard tree-learning objective while encouraging the student to use features that align with teacher causal attributions and the learned graph structure.
The sepsis prediction task requires careful interpretation because Sepsis-3 uses SOFA-related organ dysfunction criteria. The revised sensitivity analysis excluding SOFA, qSOFA, aggregate organ-failure scores, and direct SOFA-derived component scores showed a modest performance decrease, but CAD-GBDT retained higher discrimination and causal consistency than the strongest baselines. This result suggests that the proposed model’s advantage is not explained solely by outcome–feature circularity. Nevertheless, sepsis prediction studies using EHR data should continue to report timing, label definitions, and predictor overlap carefully.
The calibration and decision curve analyses strengthen the clinical relevance of the evaluation. Calibration is necessary because ICU risk models should provide probabilities that correspond to observed event rates rather than only rank patients by risk. Decision curve analysis provides a complementary view by estimating model-based net benefit across threshold probabilities. In the revised manuscript, expected calibration error and net benefit were computed directly from held-out predicted probabilities and observed outcomes. These analyses suggest that CAD-GBDT provides more reliable probability estimates and higher model-based clinical utility than the strongest baseline models across representative threshold probabilities.
The framework also aligns with emerging expectations for trustworthy clinical artificial intelligence. TRIPOD+AI and PROBAST+AI emphasize transparent reporting, appropriate validation, calibration, risk-of-bias assessment, and careful evaluation of applicability [
8,
9]. The revised experimental presentation therefore includes cohort construction, explicit outcome definitions, prevalence reporting, patient-level splitting, calibration analysis, decision curve analysis, ablation testing, causal-variable selection, graph-stability analysis, hyperparameter sensitivity, and paired bootstrap comparison.
Several limitations should be considered. First, causal discovery from observational ICU data is vulnerable to unmeasured confounding. Unmeasured confounding occurs when an unobserved variable influences both a candidate cause and an outcome. Illness severity, clinician judgment, monitoring intensity, and institutional treatment protocols may affect both interventions and outcomes. Therefore, the learned DAG should be interpreted as a causal hypothesis scaffold rather than definitive causal proof. The graph provides a structured inductive bias for prediction and explanation, but it does not establish intervention-level causality.
Second, the current evaluation is based on MIMIC-IV. Although MIMIC-IV supports reproducible method development, models trained and evaluated in a single health-system dataset may not generalize to other institutions, patient populations, monitoring practices, or treatment protocols. External validation using independent multicenter datasets, such as the eICU Collaborative Research Database, is necessary before broader claims of generalizability can be made [
36]. Future studies should also assess subgroup performance across clinically relevant demographic and disease-severity groups to identify potential disparities.
Third, dynamic graph updating, drift detection, and counterfactual rule exploration are presented as deployment-oriented extensions and were not directly validated in the primary retrospective experiments. These components require prospective or temporally staged evaluation with strict model versioning, graph-change logging, and audit trails before they can be used in a clinical setting. The present study therefore limits its empirical claims to the fixed-graph causal distillation pipeline evaluated on held-out MIMIC-IV data.
A further limitation is that clinician-facing validation has not yet been conducted. The present study evaluates interpretability through computational causal consistency, rule-to-subgraph mapping, calibration analysis, and decision curve analysis, but these analyses do not replace direct assessment by ICU clinicians. Future work should include a structured human-centered evaluation in which intensivists assess explanation plausibility, actionability, trust calibration, cognitive burden, and workflow compatibility. Such validation should be conducted prospectively or through a carefully designed retrospective reader study before the framework is considered for clinical deployment. This requirement is consistent with recent multimodal explainable AI evaluation work, which argues that clinical decision-support explanations should be judged through modality-aware evidence, robustness, plausibility, and workflow relevance rather than attribution fidelity alone [
37].
Ethical considerations are central to causal AI in critical care. Causal diagrams can appear persuasive even when causal assumptions are uncertain. The system should therefore communicate uncertainty for each edge and distinguish between data-derived hypotheses, guideline-supported relationships, and clinician-confirmed pathways. Feedback loops also require attention. If clinicians act on model alerts, subsequent data may reflect intervention-modified trajectories rather than natural disease progression. Future versions of the framework should incorporate logged interventions, off-policy evaluation, and explicit counterfactual assumptions to reduce the risk of misleading causal updates.
Privacy and governance are also important. Although the present study uses de-identified data, clinical deployment would require secure data pipelines, access control, audit logs, model versioning, and institutional oversight. Federated causal discovery may provide a future pathway for learning across hospitals without centralizing patient-level data. Such an extension would be valuable for improving generalizability across health systems while preserving privacy.
Overall, the revised findings support the potential of causal-pathway-guided distillation as a bridge between high-capacity temporal prediction and interpretable rule-based clinical reasoning, while also clarifying the methodological boundaries of the present retrospective evaluation.