Next Article in Journal
The Evolving Landscape of Targeted Therapies in Systemic Lupus Erythematosus: A Review of Phase 3 Clinical Trials
Previous Article in Journal
Numerical Investigation of Hydraulic Fracture Propagation in Cemented Naturally Fractured Reservoirs
Previous Article in Special Issue
Derived Feature Engineering and ABC–XYZ Segmentation for Machine Learning-Based Forecasting of Intermittent Spare Parts Demand
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Tipping Point or False Alarm? An Interpretable Machine Learning Framework for Early Warning of Supply Chain Disruptions Under Multi-Source Uncertainty

1
School of Management Engineering, Capital University of Economics and Business, Beijing 100070, China
2
Department of Logistics Support, The Chinese Armed Police Force Command College, Tianjin 300250, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2026, 16(13), 6457; https://doi.org/10.3390/app16136457
Submission received: 22 May 2026 / Revised: 18 June 2026 / Accepted: 22 June 2026 / Published: 29 June 2026
(This article belongs to the Special Issue Data-Driven Supply Chain Management and Logistics Engineering)

Abstract

Global supply chains are increasingly exposed to multi-source uncertainties, ranging from geopolitical tensions to climate extremes, making the accurate and interpretable prediction of disruptions an urgent operational priority. Existing predictive models often rely on either shallow statistical learners, which struggle with high-dimensional interactions, or deep neural networks, which trade off interpretability for marginal performance gains. To address this gap, we propose an interpretable machine learning framework that couples a feature-attention mechanism with a gradient-boosted decision tree ensemble for early warning of shipment-level disruption events. First, a dedicated attention module is trained to assign importance weights to 14 heterogeneous risk factors, generating an interpretable feature ranking that highlights pivotal signals such as lead-time volatility and geopolitical risk. The reweighted features are then fed into a gradient boosting classifier, which effectively captures non-linear patterns and interaction effects. Evaluated on a publicly available dataset of 5000 international freight records available on Kaggle, the proposed framework achieves an AUC of 0.8213 (±0.0002 over three independent runs), matching the best-performing baseline (standard gradient boosting, 0.8212 ± 0.0001) and surpassing logistic regression (0.777), random forest (0.806), and a standalone feature-attention network (0.805). The attention module preserves full predictive accuracy while adding an interpretability layer that conventional black-box implementations lack. Notably, the framework preserves the predictive accuracy of gradient boosting while enhancing interpretability through attention-based feature ranking and dual-perspective importance analysis, achieving a precision of 0.770 and a balanced F1-score of 0.781. The convergence of attention-based interpretability and ensemble learning efficiency provides supply chain managers with a transparent decision-support tool—distinguishing genuine “tipping points” from “false alarms” and enabling targeted risk mitigation under deep uncertainty.

1. Introduction

Global supply chains have evolved into tightly coupled, globe-spanning networks whose uninterrupted operation underpins modern economic stability. Yet this very interconnectedness renders them acutely vulnerable to a spectrum of disruptions originating from geopolitical upheaval, extreme weather events, public health crises, and logistical bottlenecks [1,2]. The cascading effects of a single node failure can propagate rapidly, inflicting substantial financial losses and eroding organizational resilience [3]. In this landscape, the ability to provide early warning—to anticipate whether an unfolding situation is a genuine “tipping point” or merely a “false alarm”—has become a strategic imperative for supply chain managers. However, the multi-source, heterogeneous, and often noisy nature of the data that signal such disruptions poses a formidable modeling challenge, demanding predictive frameworks that are simultaneously accurate, interpretable, and robust to uncertainty.
A substantial body of research has sought to address supply chain disruption prediction through both statistical and machine learning paradigms. Early work predominantly relied on econometric models and traditional time-series forecasting, which, while interpretable, often assume linearity and stationarity and struggle to capture the high-dimensional interactions characteristic of real-world logistics data [4,5]. The advent of ensemble learning methods—most notably random forests and gradient boosting machines—offered improved predictive performance by modeling non-linear relationships and feature interactions, and they have been successfully applied in contexts such as supplier risk scoring and demand volatility forecasting [6,7]. Concurrently, deep learning architectures, particularly long short-term memory (LSTM) networks and convolutional neural networks, have demonstrated state-of-the-art results in extracting complex temporal patterns from operational data [8,9]. Despite these advances, two critical gaps persist. First, the performance gains of purely deep learning approaches over carefully tuned tree-based ensembles are often marginal in tabular data regimes, while the computational cost and opacity of the former can hinder practical deployment [10]. Second, and more importantly, most existing models operate as black-box predictors, offering little insight into why a particular shipment is flagged as high-risk. For decision-makers, actionable intelligence requires not only a disruption probability but also an understanding of the contributing factors, so that targeted mitigation measures can be designed [11].
Recent work has begun to explore the integration of attention mechanisms—originally developed for natural language processing—into predictive models as a means of injecting interpretability. Feature-attention modules, for instance, can learn to assign dynamic importance weights to input variables, thereby making the contribution of each risk factor transparent [12,13]. While such mechanisms have been employed in domains like finance and healthcare, their application to supply chain disruption early warning remains nascent. Moreover, the potential of coupling an attention-based feature reweighting scheme with a high-performance ensemble learner to create a hybrid framework that jointly maximizes predictive accuracy and explainability has not been systematically investigated, particularly in the context of supply chain disruption early warning where both prediction fidelity and decision transparency are simultaneously required.
Prior work has explored combining attention mechanisms with boosting models in various domains. Ying et al. [14] proposed a hybrid boosted attention-based LightGBM framework for credit risk assessment, where attention weights guided feature selection before boosting. He et al. [15] developed an attention-based BiLSTM-XGBoost model for reliability assessment and lifetime prediction of digital microfluidic systems. Cao and Li [16] demonstrated a multi-model attention fusion perceptron for subway passenger flow prediction under pandemic conditions. Han et al. [17] designed a dual-attention convolutional network for early-stage electrical fault identification in traction transformers. Li et al. [18] combined BiGRU-attention with XGBoost for telecom customer churn prediction. Despite these advances, the application of such attention-boosting hybrids to supply chain disruption early warning remains unexplored, and none of the existing studies provide the dual-perspective feature importance analysis (attention weights plus tree-based Gini scores) that we demonstrate here.
This represents a promising direction, especially for operational settings where both the prediction outcome and its rationale must be communicated to non-technical stakeholders.
To bridge this gap, the present study proposes and validates an interpretable machine learning framework for supply chain disruption early warning that combines a feature-attention mechanism with a gradient-boosted decision tree ensemble. The framework is designed to address the dual objectives of high classification performance and managerial interpretability. Concretely, our work makes the following three contributions: (i) We design an end-to-end pipeline in which a dedicated attention network learns to weight 14 heterogeneous risk factors—spanning geopolitical, meteorological, operational, and temporal dimensions—directly from data, producing an interpretable feature importance hierarchy. (ii) We demonstrate that feeding these attention-weighted features into a gradient boosting classifier yields a predictive model that matches the best-performing gradient boosting baseline and outperforms logistic regression, random forest, and the standalone attention network on a publicly available dataset of 5000 international freight records, achieving an AUC of 0.8213 while maintaining a balanced precision–recall profile. (iii) We provide a detailed analysis of the attention weights and feature importance patterns, revealing that factors such as lead-time days, geopolitical risk score, and carrier reliability serve as dominant early-warning signals—insights that can directly inform risk mitigation strategies. By distinguishing “tipping points” from “false alarms,” the proposed framework offers a transparent decision-support tool that bridges the gap between advanced analytics and operational supply chain management.
The remainder of this paper is structured as follows. Section 2 describes the materials and methods, including the dataset, preprocessing steps, feature-attention network architecture, and the experimental setup. Section 3 presents the results of the model evaluation, comparative analysis, and feature importance inspection. Section 4 discusses the implications of the findings, acknowledges the limitations of the current work, and outlines directions for future research. Finally, Section 5 concludes the study.

2. Materials and Methods

2.1. Dataset Description and Preprocessing

The dataset employed in this study, Global Supply Chain Risk & Logistics (2024–2026), is publicly available on Kaggle at https://www.kaggle.com/datasets/nudratabbas/global-supply-chain-risk-and-logistics-2024-2026 (accessed on 20 May 2026) and comprises 5000 records of international freight shipments, each described by 14 heterogeneous attributes and a binary disruption label. The raw variables, summarized in Table 1, encompass categorical identifiers (origin port, destination port, transport mode, product category, weather condition) and numerical measures (distance in kilometers, weight in metric tons, fuel price index, geopolitical risk score, carrier reliability score, and lead time in days). The target variable, Disruption_Occurred, is a binary indicator taking the value 1 if the shipment experienced a disruption event and 0 otherwise. In the original sample, the positive class prevalence is 0.613, indicating a moderately imbalanced but realistic distribution.
To prepare the data for machine learning, a multi-stage preprocessing pipeline was implemented. First, the shipment date was parsed, and three auxiliary temporal features—month, day of month, and day of week—were extracted to capture seasonal and weekly patterns. All five categorical variables were integer-encoded using a standard label encoder. Subsequently, the complete set of 14 predictive features was assembled: the five encoded categorical variables, the six original numerical variables, and the three derived temporal attributes. No missing values were present in the dataset; however, forward-fill and backward-fill procedures were included in the pipeline as safeguards. Finally, each feature was standardized to zero mean and unit variance using a StandardScaler (scikit-learn 1.3.0), ensuring that all variables contributed equally to distance-based computations and that the feature-attention module received data on a consistent scale. The processed dataset was partitioned into a training set (80%, n = 4000) and a held-out test set (20%, n = 1000) using stratified random sampling to preserve the original class ratio in both splits.

2.2. Feature-Attention Mechanism

To endow the predictive framework with interpretability and to amplify the signal of salient risk drivers, a feature-attention module was designed and trained as the first component of the proposed hybrid system. The module is realized as a shallow multi-layer perceptron that receives the standardized feature vector x ∈ ℝ14 and outputs a vector of attention weights α ∈ [0,1]14 of the same dimensionality. Concretely, the architecture employs a squeeze-and-excitation-style bottleneck: the input is first passed through a hidden layer with a reduction factor of four, activated by the ReLU function, and then projected back to the original feature dimension through a sigmoid-activated output layer. This design allows the network to capture feature interdependencies and to produce a set of gating coefficients that indicate the relative importance of each input for the downstream task.
The attention network was trained for 200 epochs in conjunction with a lightweight classifier head—a two-layer fully connected network terminated by a sigmoid unit—on the training split using the binary cross-entropy loss. Early stopping with a patience of 10 was applied, and the model weights achieving the lowest validation loss (at epoch 80) were restored. Crucially, the attention weights were learned end-to-end with the classification objective, ensuring that they are optimized to highlight features that are genuinely discriminative for disruption prediction.
The training procedure follows a two-stage, sequential pipeline:
  • Stage 1—Attention weight learning. The feature-attention module and the lightweight classifier head are jointly trained on the training set. After training, global attention weights α are obtained by averaging the output of the attention module over all 4000 training instances.
  • Stage 2—Gradient boosting with reweighted features. The original standardized features x are reweighted as x′ = x ⊙ α, and a separate Gradient Boosting classifier is trained on these attention-weighted features.
The two components are trained independently; the attention module is frozen after Stage 1, and only the learned weights are passed to Stage 2. These weights are visualized in the Section 3.

2.3. Gradient Boosting Classifier

The core predictive engine of the proposed framework is a gradient boosting decision tree (GBDT) ensemble, specifically implemented using the XGBoost library. GBDT was selected for its well-documented ability to handle heterogeneous, tabular data, capture complex non-linear interactions, and deliver state-of-the-art performance in binary classification tasks with moderate sample sizes. In this two-stage framework, the GBDT classifier does not operate on the raw standardized features but on the attention-weighted features x′ = x ⊙ α, where ⊙ denotes element-wise multiplication. In this way, the discriminative power of the gradient boosting algorithm is synergistically combined with the attention module’s capacity to suppress noise and amplify informative signals.
The hyperparameters of the GBDT classifier were tuned via five-fold stratified cross-validation on the training set. The final configuration employed 100 boosting rounds, a maximum tree depth of 6, a learning rate of 0.1, subsampling of 80% of observations per tree, and column sampling of 80% of features per node. These settings balance model complexity and generalization, and they were held constant across all experiments to ensure a fair comparison.

2.4. Baseline Models and Evaluation Protocol

To rigorously assess the added value of the proposed hybrid framework, five baseline classifiers were implemented under identical training–test conditions: (i) Logistic Regression, serving as a simple linear benchmark; (ii) Random Forest with 100 trees, representing a bagged ensemble; and (iii) Gradient Boosting with 100 trees, representing a standalone boosting model without feature-attention reweighting. All models were tuned using the same five-fold stratified cross-validation on the training set. For LR, default hyperparameters were used due to limited tunable parameters. For RF, the number of trees and maximum depth were tuned. For GB, the learning rate, maximum depth, and subsampling ratios were tuned. All baselines were trained on the original standardized features, while the proposed model (denoted “Feature-Enhanced Gradient Boosting”) was trained on the attention-weighted features.
Model performance was evaluated on the held-out test set using five metrics that jointly capture different facets of predictive quality: accuracy, precision, recall, F1-score, and area under the receiver operating characteristic curve (AUC). Precision and recall are particularly pertinent in the context of disruption early warning, as they respectively quantify the cost of false alarms and the ability to detect true disruptions. AUC provides a threshold-independent measure of discriminative capacity. In addition, confusion matrices and ROC curves were constructed to facilitate visual comparison, and feature importance scores—both from the gradient boosting model and from the attention module—were extracted to support the interpretability analysis.
No class weighting, oversampling, or threshold tuning was applied, as the 61.3% positive class prevalence, while moderately imbalanced, does not severely distort model performance. Stratified random sampling was used during the train–test split to preserve the original class distribution. All models use the default 0.5 classification threshold.
The entire experimental pipeline was implemented in Python 3.12.0 (Python Software Foundation, Wilmington, DE, USA), using scikit-learn 1.3.0, PyTorch 2.1.0, and XGBoost 2.0.0 for the gradient boosting classifier. All experiments were executed on a standard laptop CPU (Intel Corporation, Santa Clara, CA, USA).

3. Results

3.1. Model Performance Comparison

The predictive performance of all evaluated models on the held-out test set is summarized in Table 2. The proposed framework—denoted as Feature-Enhanced Gradient Boosting (FE-GB)—operates on the attention-weighted features and is benchmarked against logistic regression (LR), random forest (RF), standard gradient boosting (GB), the standalone feature-attention deep network (Attn-MLP), and a stacking ensemble that combines all base learners. The redundant bar chart previously shown as Figure 1 has been removed; the complete results are presented in Table 2 and the ROC curves in Figure 1.
Two additional baselines were evaluated in this revision to strengthen the comparative analysis. A simple two-layer MLP without any attention mechanism achieved an AUC of 0.7789, underperforming all tree-based models and confirming that feature-attention reweighting provides meaningful gains over a plain neural network. XGBoost with default hyperparameters achieved an AUC of 0.7956, which is substantially lower than the tuned standard GB (0.8212), underscoring the importance of hyperparameter optimization via cross-validation. Notably, the proposed FE-GB maintains the highest AUC among all evaluated models, demonstrating that the two-stage attention-weighting procedure preserves the full discriminative power of a well-tuned gradient boosting classifier.
Several observations emerge from Table 2. First, all ensemble and deep learning models substantially outperform the linear LR baseline, confirming the presence of non-linear decision boundaries and feature interactions in the data. Second, the standard gradient boosting classifier achieves the highest AUC (0.8212) among all single models, surpassing the more complex Attn-MLP by approximately 0.017 in AUC and the stacking ensemble by 0.001. The stacking ensemble does not outperform standard GB, achieving an AUC of 0.8203 compared to 0.8212, suggesting that the simple logistic regression meta-learner may not fully capture the complementary strengths of the base learners on this dataset. This finding suggests that, for this tabular dataset, a well-tuned tree-based ensemble can match or even exceed the discriminative power of deeper architectures. Third, the proposed FE-GB attains identical performance to standard GB, which is a positive outcome: the attention-weighting procedure preserves the full predictive capability of the gradient boosting algorithm while simultaneously generating an interpretable feature importance hierarchy that is not available in the black-box baseline.
McNemar’s test was conducted between FE-GB and each baseline. The differences between FE-GB and Attn-MLP (p = 0.23) and between FE-GB and standard GB (p = 0.87) are not statistically significant, consistent with the interpretation that FE-GB preserves rather than exceeds the discriminative power of GB while adding interpretability.
The receiver operating characteristic (ROC) curves of the main models are displayed in Figure 1. All five models are individually plotted. The curve for FE-GB is visually indistinguishable from that of standard GB and is therefore represented by a nearly overlapping line. The ROC analysis corroborates the AUC ranking, with the GB-family models clearly separated from LR and RF.

3.2. Feature Importance and Attention Analysis

A central motivation of the proposed hybrid framework is to provide actionable insights into why a shipment is flagged as high-risk. To this end, Figure 2 presents the Gini-based feature importance derived from the gradient boosting classifier, and Figure 3 displays the global attention weights learned by the feature-attention network.
From the gradient boosting Gini importance (Figure 2), Weather_Condition, Lead_Time_Days, and Geopolitical_Risk_Score emerge as the top three contributors. From the attention module (Figure 3), Lead_Time_Days receives the highest weight (0.896), followed by Geopolitical_Risk_Score (0.641) and Product_Category (0.615). While the two rankings are not identical, they exhibit substantial overlap: Lead_Time_Days and Geopolitical_Risk_Score rank among the top three in both analyses. This triangulation strengthens the credibility of the extracted insights and provides a robust foundation for managerial action. The primacy of lead time aligns with established supply chain risk management principles: longer lead times amplify exposure to demand volatility, logistical delays, and stochastic disruptions [19]. Similarly, the prominence of geopolitical risk resonates with recent empirical studies that document a sharp increase in supply chain reconfigurations following trade disputes and regional conflicts [20]. The relatively low importance of temporal features such as month or day of week further suggests that, in the current dataset, disruption patterns are structurally driven rather than seasonally modulated—an observation that may inform the design of risk monitoring dashboards, which can then focus on intrinsic shipment characteristics rather than calendar-based alerts. The stability of these attention weights was further validated through a bootstrap analysis, detailed in Appendix A.

3.3. Ablation Study

To further validate the contribution of the attention module, an ablation study was conducted by training Gradient Boosting under three alternative feature sets: (a) all features equally weighted (i.e., original GB), (b) only the top-5 features identified by the attention module, and (c) random feature weights drawn from a uniform distribution. The results (Table 3) show that FE-GB achieves the highest AUC (0.8213), while random weights degrade performance (AUC = 0.808). The top-5 model (AUC = 0.818) performs slightly below FE-GB, indicating that the full set of attention-weighted features contributes marginal gains. This confirms that the learned attention weights provide meaningful feature prioritization rather than random noise.

3.4. Training Dynamics of the Attention Network

To verify that the attention module was trained to convergence and did not overfit, Figure 4 depicts the evolution of training and validation loss and accuracy over 200 epochs. The training loss decreases steadily and stabilizes after approximately 120 epochs, while the validation loss reaches a minimum around epoch 80 and thereafter exhibits mild fluctuation without a clear upward trend. The validation accuracy plateaus near 0.72, and the gap between training and validation accuracy remains modest throughout training. These patterns indicate that the attention network generalizes reasonably to unseen data and that early stopping was effective in preventing overfitting. The validation loss does not show a significant upward trend, confirming that the model did not overfit.

3.5. Confusion Matrix and Error Analysis

The confusion matrix of the FE-GB classifier on the test set is shown in Figure 5. Out of 387 actual non-disruption cases, 242 are correctly classified (specificity ≈ 62.5%), while among 613 actual disruption cases, 486 are detected (sensitivity ≈ 79.3%). The overall accuracy is 72.8%. The model exhibits a slight tendency toward false positives (145 non-disruptions misclassified as disruptions), which in a practical setting corresponds to a cautious alerting policy: erring on the side of false alarms may be acceptable when the cost of missing a true disruption is high. The balanced F1-score of 0.781 indicates a reasonable trade-off between precision and recall.
Taken together, the results demonstrate that the proposed hybrid framework achieves competitive predictive performance while offering a degree of transparency that purely black-box models lack. The following section discusses the implications of these findings, acknowledges current limitations, and outlines avenues for future work.

4. Discussion

4.1. Interpretation of Key Findings

The experimental results demonstrate that the proposed FE-GB framework achieves highly competitive predictive performance for shipment-level disruption early warning, attaining an AUC of 0.8213 and an accuracy of 0.728 on a publicly available dataset. Notably, the attention-weighted features did not diminish the discriminative power of the gradient boosting algorithm; instead, they preserved its full capability while generating an interpretable layer that is absent in conventional black-box implementations. This finding challenges the implicit assumption that interpretability must come at the expense of accuracy—a trade-off that has been frequently reported in the literature [21,22]. In our case, the attention module acts as a feature-wise preconditioner that reorganizes the input space without distorting the underlying signal, thereby allowing the gradient boosting classifier to operate at its maximal potential.
Our finding that standard GB achieves performance equivalent to the attention-enhanced version aligns with Grinsztajn et al. [10], who demonstrated that tree-based models often match or exceed deep learning on tabular data. Importantly, our work extends this insight by showing that a lightweight attention module can be integrated with GB without degrading performance, thereby providing interpretability—a dimension not addressed by Grinsztajn et al.—while preserving strong predictive capability.
The convergence of the two feature importance analyses—the Gini-based scores from the tree ensemble and the learned attention weights—is particularly instructive. Weather_Condition, Lead_Time_Days, and Geopolitical_Risk_Score are the top three from the tree ensemble, while Lead_Time_Days, Geopolitical_Risk_Score, and Product_Category are highlighted by the attention module. The substantial overlap, particularly for Lead_Time_Days and Geopolitical_Risk_Score, strengthens the credibility of the extracted insights. The primacy of lead time aligns with established supply chain risk management principles, while the prominence of geopolitical risk resonates with recent studies on supply chain reconfigurations following trade disputes. The relatively low importance of temporal features suggests that disruption patterns are structurally driven rather than seasonally modulated.

4.2. Practical Implications

From a practitioner’s standpoint, the FE-GB framework offers three tangible advantages. First, it provides a ranked and weighted checklist of risk factors that can be directly incorporated into existing supplier scorecards or logistics platforms. Rather than treating all 14 input variables as equally relevant, managers can prioritize data collection and monitoring efforts on the top-five features identified by both the attention module and the tree-based importance scores. Second, the hybrid design retains the computational efficiency of gradient boosting—training and inference can be performed on commodity hardware without the need for specialized accelerators—which is a crucial consideration for deployment in small- and medium-sized enterprises or in field offices with limited IT infrastructure. Third, the attention weights can serve as a communication bridge between data scientists and business stakeholders. By visualizing which factors drive a disruption alert, the model transforms a probabilistic prediction into a narrative that can be understood, challenged, and acted upon by non-technical decision-makers.

4.3. Limitations and Future Research Directions

Several limitations of the present study should be acknowledged, each pointing toward avenues for future research. First, the dataset, while diverse in its feature coverage, is limited to 5000 records and a single temporal snapshot. Supply chain dynamics evolve over time, and models trained on historical data may degrade in performance when deployed in a non-stationary environment. Future work should explore online learning or continual adaptation mechanisms. Second, the current framework operates at the level of individual shipments and does not explicitly model network-level dependencies or cascading failure effects. Extending the approach to incorporate graph-structured data could yield richer predictive signals. Third, the study focuses exclusively on disruption prediction and stops short of prescriptive decision support. Embedding the FE-GB predictions within a reinforcement learning or stochastic optimization loop represents a high-impact next step.
Fourth, the dataset was sourced from Kaggle rather than directly from a logistics provider. While the data exhibits realistic distributions across all features, its provenance cannot be definitively verified. Validation on proprietary, real-world logistics datasets is needed to confirm the framework’s practical applicability. Fifth, the current study does not employ class weighting, oversampling, or threshold tuning. Future work could explore cost-sensitive learning strategies to shift the precision–recall trade-off based on the relative cost of false alarms versus missed disruptions. Furthermore, while label encoding was used for categorical variables, alternative strategies such as target encoding or frequency encoding may improve performance and should be investigated. Finally, the generalizability of the findings to other industry sectors, geographical regions, and data modalities remains an open empirical question.

4.4. Connection to the Broader Literature

The present work contributes to a growing body of research at the intersection of interpretable machine learning and operations management. Recent studies have advocated for the integration of attention mechanisms into predictive models for supply chain and manufacturing contexts, arguing that interpretability is not merely a desirable property but a prerequisite for adoption in risk-sensitive environments [23,24]. Our findings extend this line of work by demonstrating that a lightweight attention module can be synergistically paired with a state-of-the-art tree ensemble without any performance penalty, thereby resolving the tension between accuracy and transparency. Furthermore, the identification of lead time and geopolitical risk as dominant predictors aligns with macro-level research on supply chain resilience, which has increasingly emphasized the need for firms to map and monitor geopolitical exposure in their sourcing networks [25]. By providing a micro-level, shipment-specific instantiation of these macro-level insights, the FE-GB framework bridges the gap between strategic risk management and operational execution.

5. Conclusions

This study set out to address a pressing challenge in contemporary supply chain management—the need for accurate, interpretable early warning of shipment-level disruption events under multi-source uncertainty. To this end, we proposed an interpretable machine learning framework that couples a feature-attention mechanism with a gradient-boosted decision tree ensemble. The attention module learns to assign importance weights to 14 heterogeneous risk factors, yielding an interpretable feature ranking that highlights lead-time days, geopolitical risk, and product category as the top-three attention-weighted features, while the Gini importance additionally identifies weather condition as a dominant predictor. The reweighted features are then fed into a gradient boosting classifier, which captures non-linear interactions and delivers competitive predictive performance. Evaluated on a publicly available dataset of 5000 international freight records, the proposed FE-GB framework achieves an AUC of 0.8213 and an accuracy of 0.728, matching the best-performing baseline while adding an explainability layer that conventional black-box models lack.
The principal contributions of this work are threefold. First, we demonstrate that a lightweight feature-attention network can be synergistically integrated with a state-of-the-art tree ensemble without any degradation in predictive accuracy, thereby resolving the oft-cited tension between interpretability and performance. Second, the dual-perspective feature importance analysis—combining tree-based Gini scores with learned attention weights—provides a robust, triangulated view of disruption risk factors. Third, the framework is computationally inexpensive and can be deployed on commodity hardware, making it accessible to a wide range of practitioners.
From a practical standpoint, the FE-GB framework offers supply chain managers a transparent decision-support tool that distinguishes genuine “tipping points” from “false alarms.” The ranked attention weights translate directly into a prioritized risk monitoring checklist. Future work should extend the current approach by incorporating temporal dynamics, modeling network-level dependencies, embedding the predictions within a prescriptive loop, and validating them on larger, multi-industry datasets. In conclusion, the proposed framework demonstrates that high-performance disruption early warning can coexist with the interpretability required for confident, evidence-based supply chain decisions.

Author Contributions

Conceptualization, C.W. and Z.G.; methodology, Z.G.; software, Z.G.; validation, C.W., Z.G. and F.S.; formal analysis, Z.G.; investigation, Z.G. and F.S.; resources, C.W.; data curation, Z.G.; writing—original draft preparation, Z.G.; writing—review and editing, C.W. and F.S.; visualization, Z.G.; supervision, C.W.; project administration, C.W.; funding acquisition, C.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Social Science Fund of China (Military Science Youth Project), grant number 2025-SKJJ-D-074.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The dataset “Global Supply Chain Risk & Logistics (2024–2026)” used in this study is publicly available on Kaggle at https://www.kaggle.com/datasets/nudratabbas/global-supply-chain-risk-and-logistics-2024-2026 (accessed on 20 May 2026). The Python code for reproducing the experiments is available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
AbbreviationFull Name
AUCArea Under the Receiver Operating Characteristic Curve
FE GBFeature Enhanced Gradient Boosting
GBDTGradient Boosting Decision Tree
LRLogistic Regression
MLPMulti Layer Perceptron
RFRandom Forest
ROCReceiver Operating Characteristic

Appendix A. Bootstrap Analysis of Attention Weight Stability

To assess the stability of the global attention weights, a bootstrap analysis was performed by resampling the training set with replacement 1000 times and recomputing the average attention weights. The 95% confidence intervals for the top features (Lead_Time_Days, Geopolitical_Risk_Score, and Transport_Mode) do not overlap with those of lower-ranked features (e.g., Day, DayOfWeek), confirming a stable ranking. The detailed intervals are provided in Table A1.
Table A1. Bootstrap confidence intervals for the top-5 attention weights.
Table A1. Bootstrap confidence intervals for the top-5 attention weights.
FeatureMean Weight95% CI
Lead_Time_Days0.896[0.892, 0.900]
Geopolitical_Risk_Score0.641[0.637, 0.645]
Product_Category0.615[0.611, 0.619]
Weight_MT0.610[0.606, 0.614]
Transport_Mode0.573[0.569, 0.577]

References

  1. Ivanov, D.; Dolgui, A. Viability of intertwined supply networks: Extending the supply chain resilience angles towards survivability. A position paper motivated by COVID-19 outbreak. Int. J. Prod. Res. 2020, 58, 2904–2915. [Google Scholar] [CrossRef]
  2. Queiroz, M.M.; Ivanov, D.; Dolgui, A.; Fosso Wamba, S. Impacts of epidemic outbreaks on supply chains: Mapping a research agenda amid the COVID-19 pandemic through a structured literature review. Ann. Oper. Res. 2022, 319, 1159–1196. [Google Scholar] [CrossRef] [PubMed]
  3. Li, Y.; Zobel, C.W. Exploring supply chain network resilience in the presence of the ripple effect. Int. J. Prod. Econ. 2020, 228, 107693. [Google Scholar] [CrossRef]
  4. Petropoulos, F.; Apiletti, D.; Assimakopoulos, V.; Babai, Z.; Barrow, D.K.; Ben Taieb, S.; Bergmeir, C.; Bessa, R.J.; Bijak, J.; Boylan, J.E.; et al. Forecasting: Theory and practice. Int. J. Forecast. 2022, 38, 705–871. [Google Scholar] [CrossRef]
  5. Nikolopoulos, K.; Punia, S.; Schäfers, A.; Tsinopoulos, C.; Vasilakis, C. Forecasting and planning during a pandemic: COVID-19 growth rates, supply chain disruptions, and governmental decisions. Eur. J. Oper. Res. 2021, 290, 99–115. [Google Scholar] [CrossRef] [PubMed]
  6. Baryannis, G.; Dani, S.; Antoniou, G. Predicting supply chain risks using machine learning: The trade-off between performance and interpretability. Future Gener. Comput. Syst. 2019, 101, 993–1004. [Google Scholar] [CrossRef]
  7. Islam, S.; Amin, S.H.; Wardley, L.J. Machine learning and optimization models for supplier selection and order allocation planning. Int. J. Prod. Econ. 2021, 242, 108315. [Google Scholar] [CrossRef]
  8. Bassiouni, M.M.; Chakrabortty, R.K.; Sallam, K.M.; Hussain, O.K. Deep learning approaches to identify order status in a complex supply chain. Expert Syst. Appl. 2024, 250, 123947. [Google Scholar] [CrossRef]
  9. Ashraf, M.; Eltawil, A.; Ali, I. Disruption Detection for a Cognitive Digital Supply Chain Twin Using Hybrid Deep Learning. Oper. Res. 2024, 24, 23. [Google Scholar] [CrossRef]
  10. Grinsztajn, L.; Oyallon, E.; Varoquaux, G. Why do tree-based models still outperform deep learning on tabular data? arXiv 2022, arXiv:2207.08815. [Google Scholar] [CrossRef]
  11. Senoner, J.; Netland, T.; Feuerriegel, S. Using explainable artificial intelligence to improve process quality: Evidence from semiconductor manufacturing. Manuf. Serv. Oper. Manag. 2022, 68, 5557–6354. [Google Scholar] [CrossRef]
  12. Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention is all you need. arXiv 2017, arXiv:1706.03762. [Google Scholar] [CrossRef]
  13. Chen, P.; Ji, M. Deep learning-based financial risk early warning model for listed companies: A multi-dimensional analysis approach. Expert Syst. Appl. 2025, 283, 127746. [Google Scholar] [CrossRef]
  14. Ying, C.; Shi, A.; Li, X. Hybrid Boosted Attention Based LightGBM Framework for Enhanced Credit Risk Assessment in Digital Finance. Humanit. Soc. Sci. Commun. 2025, 12, 1036. [Google Scholar] [CrossRef]
  15. He, L.; Yang, Q.; Chen, J.; Liu, W.; Luo, Z. Attention based BiLSTM XGBoost Model for Reliability Assessment and Lifetime Prediction of Digital Microfluidic Systems. PeerJ Comput. Sci. 2025, 11, e3037. [Google Scholar] [CrossRef] [PubMed]
  16. Cao, Y.; Li, X. Multi Model Attention Fusion Multilayer Perceptron Prediction Method for Subway OD Passenger Flow under COVID 19. Sustainability 2022, 14, 14420. [Google Scholar] [CrossRef]
  17. Han, S.; Yang, F.; Gao, H.; Zhou, T. Early Stage Electrical Fault Identification for Traction Transformers Using Vibration Signals Based on Dual Attention Convolutional Network. IEEE Trans. Ind. Cyber Phys. Syst. 2024, 2, 471–483. [Google Scholar] [CrossRef]
  18. Hao, M. Telecom Customer Churn Prediction Based on BiGRU-Attention-XGBoost Model. In Proceedings of the 2024 5th International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT), Nanjing, China, 22–24 March 2024; pp. 1050–1054. [Google Scholar] [CrossRef]
  19. Simchi-Levi, D.; Wang, H.; Wei, Y. Increasing supply chain robustness through process flexibility and inventory. Oper. Res. 2018, 27, 1476–1491. [Google Scholar] [CrossRef]
  20. Baldwin, R.; Freeman, R. Risks and global supply chains: What we know and what we need to know. Annu. Rev. Econ. 2022, 14, 153–180. [Google Scholar] [CrossRef]
  21. Rudin, C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat. Mach. Intell. 2019, 1, 206–215. [Google Scholar] [CrossRef] [PubMed]
  22. Baryannis, G.; Dani, S.; Validi, S.; Antoniou, G. Decision support systems and artificial intelligence in supply chain risk management. In Revisiting Supply Chain Risk; Zsidisin, G.A., Henke, M., Eds.; Springer: Cham, Switzerland, 2019; pp. 53–71. [Google Scholar] [CrossRef]
  23. Ahmed, I.; Jeon, G.; Piccialli, F. From artificial intelligence to explainable artificial intelligence in Industry 4.0: A survey on what, how, and where. IEEE Trans. Ind. Inform. 2022, 18, 5031–5042. [Google Scholar] [CrossRef]
  24. Modgil, S.; Singh, R.K.; Hannibal, C. Artificial intelligence for supply chain resilience: Learning from COVID-19. Int. J. Logist. Manag. 2022, 33, 1246–1268. [Google Scholar] [CrossRef]
  25. Nandi, S.; Sarkis, J.; Hervani, A.A.; Helms, M.M. Redesigning supply chains using blockchain-enabled circular economy and COVID-19 experiences. Sustain. Prod. Consum. 2021, 27, 10–22. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Multi-model ROC curves for supply chain disruption prediction. All five evaluated models (LR, RF, GB, Attn-MLP, FE-GB) are shown; the curves for FE-GB, standard GB, and Attn-MLP largely overlap in the upper region of the plot.
Figure 1. Multi-model ROC curves for supply chain disruption prediction. All five evaluated models (LR, RF, GB, Attn-MLP, FE-GB) are shown; the curves for FE-GB, standard GB, and Attn-MLP largely overlap in the upper region of the plot.
Applsci 16 06457 g001
Figure 2. Feature importance scores from the gradient boosting model. Weather_Condition, Lead_Time_Days, and Geopolitical_Risk_Score are the top three influential predictors.
Figure 2. Feature importance scores from the gradient boosting model. Weather_Condition, Lead_Time_Days, and Geopolitical_Risk_Score are the top three influential predictors.
Applsci 16 06457 g002
Figure 3. Global attention weights assigned by the feature-attention module. Lead_Time_Days receives the highest weight (0.896), followed by Geopolitical_Risk_Score (0.641) and Product_Category (0.615).
Figure 3. Global attention weights assigned by the feature-attention module. Lead_Time_Days receives the highest weight (0.896), followed by Geopolitical_Risk_Score (0.641) and Product_Category (0.615).
Applsci 16 06457 g003
Figure 4. Training and validation loss (left) and accuracy (right) of the feature-attention network over 200 epochs.
Figure 4. Training and validation loss (left) and accuracy (right) of the feature-attention network over 200 epochs.
Applsci 16 06457 g004
Figure 5. Confusion matrix of FE-GB on the test set.
Figure 5. Confusion matrix of FE-GB on the test set.
Applsci 16 06457 g005
Table 1. Description of raw dataset variables.
Table 1. Description of raw dataset variables.
Variable NameTypeDescription
Shipment_IDIdentifierUnique shipment identifier (excluded from modeling)
DateTimestampShipping date (used to extract temporal features)
Origin_PortCategoricalPort of origin
Destination_PortCategoricalPort of destination
Transport_ModeCategoricalMode of transport (e.g., sea, air, road)
Product_CategoryCategoricalType of product being shipped
Distance_kmNumericalShipping distance in kilometers
Weight_MTNumericalShipment weight in metric tons
Fuel_Price_IndexNumericalFuel price index at time of shipment
Geopolitical_Risk_ScoreNumericalComposite geopolitical risk score (0–10)
Weather_ConditionCategoricalPrevailing weather condition (e.g., clear, storm)
Carrier_Reliability_ScoreNumericalHistorical reliability score of the carrier (0–1)
Lead_Time_DaysNumericalPlanned lead time in days
Disruption_OccurredBinaryWhether a disruption occurred (1) or not (0)
Table 2. Performance comparison of the proposed FE-GB and baseline models on the test set. Values are reported as mean ± SD over three independent runs (random seeds 42, 123, 456). Where SD < 0.001 it is displayed as 0.000.
Table 2. Performance comparison of the proposed FE-GB and baseline models on the test set. Values are reported as mean ± SD over three independent runs (random seeds 42, 123, 456). Where SD < 0.001 it is displayed as 0.000.
ModelAccuracyPrecisionRecallF1-ScoreAUC
Logistic Regression0.7070 ± 0.0000.7346 ± 0.0000.8173 ± 0.0000.7737 ± 0.0000.7771 ± 0.000
Simple MLP (2-layer, no attention)0.7070 ± 0.00360.7529 ± 0.00290.7771 ± 0.01390.7647 ± 0.00540.7789 ± 0.0043
Random Forest0.7210 ± 0.0000.7577 ± 0.0000.8010 ± 0.0000.7787 ± 0.0000.8062 ± 0.000
XGBoost (default hyperparameters)0.7097 ± 0.00850.7575 ± 0.00950.7743 ± 0.01330.7658 ± 0.00720.7956 ± 0.0104
Feature-Attention MLP (standalone)0.7360 ± 0.0000.7765 ± 0.0000.7993 ± 0.0000.7878 ± 0.0000.8045 ± 0.000
Stacking Ensemble0.7240 ± 0.0000.7573 ± 0.0000.8091 ± 0.0000.7823 ± 0.0000.8203 ± 0.000
Gradient Boosting (standard, tuned)0.7280 ± 0.0000.7702 ± 0.0000.7928 ± 0.0000.7814 ± 0.0000.8212 ± 0.0001
FE-GB (Proposed)0.7280 ± 0.0010.7702 ± 0.0000.7928 ± 0.0000.7814 ± 0.0000.8213 ± 0.0002
Note: FE-GB uses identical GBDT hyperparameters as the standard GB baseline but is trained on attention-weighted features. The Simple MLP and XGBoost (default) are newly added baselines in this revision. All models were evaluated over three independent runs (random seeds 42, 123, 456). Standard deviations are ≤0.014 for all metrics; where SD < 0.001, values are displayed as 0.000.
Table 3. Ablation study results (mean ± SD over three runs).
Table 3. Ablation study results (mean ± SD over three runs).
Feature ConfigurationAUCAccuracy
FE-GB (attention-weighted)0.8213 ± 0.00020.7280 ± 0.001
All features equally weighted (standard GB)0.8212 ± 0.00010.7280 ± 0.001
Top-5 attention features only0.818 ± 0.0010.725 ± 0.001
Random feature weights0.808 ± 0.0020.720 ± 0.002
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, C.; Guo, Z.; Shi, F. Tipping Point or False Alarm? An Interpretable Machine Learning Framework for Early Warning of Supply Chain Disruptions Under Multi-Source Uncertainty. Appl. Sci. 2026, 16, 6457. https://doi.org/10.3390/app16136457

AMA Style

Wang C, Guo Z, Shi F. Tipping Point or False Alarm? An Interpretable Machine Learning Framework for Early Warning of Supply Chain Disruptions Under Multi-Source Uncertainty. Applied Sciences. 2026; 16(13):6457. https://doi.org/10.3390/app16136457

Chicago/Turabian Style

Wang, Chuansheng, Zixian Guo, and Fulei Shi. 2026. "Tipping Point or False Alarm? An Interpretable Machine Learning Framework for Early Warning of Supply Chain Disruptions Under Multi-Source Uncertainty" Applied Sciences 16, no. 13: 6457. https://doi.org/10.3390/app16136457

APA Style

Wang, C., Guo, Z., & Shi, F. (2026). Tipping Point or False Alarm? An Interpretable Machine Learning Framework for Early Warning of Supply Chain Disruptions Under Multi-Source Uncertainty. Applied Sciences, 16(13), 6457. https://doi.org/10.3390/app16136457

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop