5.1. Test Data
The experimental data used in this study come from the operating records of distribution transformers at a power plant in a province of China, encompassing two categories: inherent equipment attributes and operational monitoring data, with a total of 6700 samples. The dataset includes static features (e.g., rated capacity, model type, years in service, cooling method) and dynamic features (e.g., load factor, load growth rate, oil temperature, ambient temperature), jointly providing a comprehensive characterization of each transformer’s inherent carrying capacity and operating stress. The dynamic variables are sensor-derived monitoring quantities collected from transformer sensing and supervisory systems, mainly covering electrical measurements, thermal observations, and equipment-status signals for practical condition monitoring. To ensure methodological rigor and prevent information leakage, the data were strictly partitioned in chronological order into training, validation, and test sets in an 8:1:1 ratio.
Before model training, the heavy-overload label was defined according to the transformer loading rate and thermal operating state. The primary heavy-overload criterion was that the loading rate exceeded 120% for at least 15 consecutive minutes, corresponding to three consecutive 5 min sampling intervals. In addition, to reflect thermal stress and equipment-condition effects, samples with a loading rate above 115% were also labeled as heavy-overload-related high-risk samples when accompanied by high winding temperature, high top-oil temperature, rapid temperature rise, cooling limitation, or high static baseline risk. Otherwise, the sample was labeled as non-heavy-overload.
As shown in
Table 3, heavy-overload samples account for 8.02%, 9.25%, and 9.70% of the training, validation, and test sets, respectively. These results indicate that heavy-overload events are minority-class samples in all three subsets, which is consistent with the practical rarity of severe transformer overload events. To address this class imbalance, weighted binary cross-entropy was adopted in the C-DFRA module, and the class weights were calculated only from the training set.
Although the dataset contains 6700 samples and supports the case-study validation of the proposed framework under chronological train–validation–test splitting, it is still collected from a single power plant. Therefore, the generalization ability across different power plants, transformer types, and operating environments should be further validated using multi-source field datasets in future work.
To improve the clarity of the case-study description, a schematic representation of the studied transformer and the used input features is provided in
Figure 5. Representative physical monitoring points related to top-oil temperature, ambient temperature, and the cooling structure are indicated around the transformer, while all static and dynamic features used in the model, including winding temperature and temporal load statistics, are summarized in the side panels. Static features are used by the E-SFRA module for edge-side static feature risk assessment, whereas dynamic features are used by the C-DFRA module for cloud-side dynamic feature risk assessment.
5.2. Validation Method
To comprehensively evaluate model performance, we employ the following metrics: KS Curve [
34], cumulative gain curve [
35], lift curve [
34], Precision@K [
36], calibration (reliability) curve and ECE [
37], Brier score [
38], log loss [
38].
The evaluation metrics are described as follows:
The KS curve, with threshold τ on the horizontal axis and on the vertical axis, is geometrically equivalent to the maximum vertical spacing between the cumulative distributions of the positive and negative sample scores (CDFs), reflecting the categorical separability. The maximum KS value is the key quantitative metric, where a larger value is better, and its corresponding threshold is often used as a practical decision point when needed.
- 2.
Cumulative Gain Curve:
The samples are included progressively from high to low scores, with a cumulative gain curve giving the “proportion of positive cases captured in the first K per cent of coverage”, and a lift curve giving the multiplier of improvement relative to random selection. The key quantification point is the gain at a number of coverage rates; the higher up the curve to the left (Gain), the more positive cases are captured and the more efficient the strategy is for the same coverage cost.
- 3.
Lift Curve:
At a given coverage, lift measures how many times better the model is than random selection—i.e., the ratio of precision within the top-α% to the overall positive rate. A higher lift (especially at small α) indicates the model brings true faults to the top earlier. This directly reflects operational value when only a small portion of assets can be inspected.
- 4.
Precision@K:
Sort samples in descending order of predicted probability, compute the precision within the top K (or top K%), and plot it against K to measure screening efficiency under limited review resources. For a fixed audit budget, a higher and more slowly decaying curve indicates greater detection efficiency and stability.
- 5.
Calibration (Reliability) Curve and ECE:
The reliability curve bins predicted probabilities and compares, for each bin, the average predicted probability with the observed frequency, assessing whether scores are trustworthy for threshold- or cost-sensitive decisions. The Expected Calibration Error (ECE) summarizes these discrepancies and a lower ECE indicates more reliable probabilities.
- 6.
Brier Score:
The Brier score is the mean squared error between predicted probabilities and binary ground-truth labels, capturing both accuracy and calibration as a proper scoring rule. A lower value indicates higher probabilistic quality. It complements ranking metrics by emphasizing “being confidently correct” rather than merely ranking correctly.
- 7.
Log Loss:
Log loss measures the consistency between predicted probabilities and actual outcomes, penalizing over-confident but wrong predictions more heavily. A lower value indicates better probabilistic consistency. Unlike threshold-dependent metrics, log loss is threshold-agnostic and more sensitive to both the sharpness of probabilities and their correctness.
5.3. Results and Analyses
To verify the effectiveness of the proposed TORA method, we compare it with several classifiers and fusion baselines. Specifically, UAG-NoUQ is used as an ablation variant by removing uncertainty quantification from TORA. To further examine whether the proposed RSF module is more effective than a simpler nonlinear fusion strategy, we introduce TORA-MLP-Fusion, in which the E-SFRA and C-DFRA branches are kept unchanged, while the final RSF module is replaced by a small multilayer perceptron. In addition, LightGBM [
39], LSTM [
40], and XGBoost [
41] are used as representative baseline models for transformer overload prediction.
Figure 6 compares the KS curves of TORA, TORA-MLP-Fusion, UAG-NoUQ, LightGBM, LSTM, and XGBoost. The KS curve reflects the separability between heavy-overload and normal samples under different warning thresholds. As shown in
Figure 6 and
Table 4, TORA achieves the highest KS value and stays above the other models over a wide threshold range, indicating stronger risk discrimination and lower threshold sensitivity. From a physical perspective, this means that TORA can more consistently separate operating states with accumulated thermal-electrical stress from normal load fluctuations. Transformer heavy-overload risk is not determined by loading rate alone, but is related to the joint effect of equipment condition, load level, current, oil temperature, winding temperature, cooling capability, and temperature rise. In TORA, static features describe the long-term risk-bearing capability of the transformer, while dynamic features describe the short-term operating stress and thermal accumulation process. Their fusion through RSF makes the warning score more consistent with the actual overload formation process. TORA-MLP-Fusion remains competitive but is slightly lower than TORA, suggesting that a generic MLP can learn part of the nonlinear interaction, but it lacks the explicit uncertainty-aware fusion mechanism and engineering interpretability of RSF. Therefore, the higher and more stable KS curve of TORA provides more credible support for field warning, load transfer, cooling control, and maintenance prioritization.
Figure 7 compares the cumulative gain curves of TORA, TORA-MLP-Fusion, UAG-NoUQ, LightGBM, LSTM, and XGBoost. The cumulative gain curve reflects how many heavy-overload samples can be captured when only a certain proportion of top-ranked high-risk samples are inspected. As shown in
Figure 7, TORA maintains a higher gain over most coverage ranges, especially in the O&M-relevant low-coverage region, indicating that it can identify more high-risk transformers under a limited inspection budget. This result is physically interpretable because heavy-overload risk is related to both inherent equipment vulnerability and real-time thermal-electrical stress accumulation. By integrating static risk-bearing information and dynamic operating stress through RSF, TORA can rank operating states with higher physical overload potential ahead of normal load fluctuations. TORA-MLP-Fusion also performs competitively but remains slightly lower than TORA, suggesting that a generic MLP can capture part of the nonlinear interaction but lacks the explicit uncertainty-aware fusion and engineering interpretability of RSF. Therefore, the higher cumulative gain of TORA means that field engineers can detect more potential overload risks with the same inspection budget, or achieve the same risk coverage with fewer inspections.
Figure 8 compares the lift curves of TORA, TORA-MLP-Fusion, UAG-NoUQ, LightGBM, LSTM, and XGBoost. The lift curve measures the model’s ability to capture heavy-overload samples more efficiently than random inspection. As shown in
Figure 8, TORA maintains higher lift values over most coverage ranges, especially in the low-coverage region, indicating stronger early risk capture capability. This result is physically interpretable because TORA ranks samples according to both static equipment vulnerability and dynamic thermal-electrical stress. These factors correspond to the actual formation process of transformer heavy overload, involving load level, current, oil temperature, winding temperature, cooling capability, temperature rise, and long-term equipment condition. Through RSF, TORA places physically riskier operating states earlier in the warning list. TORA-MLP-Fusion remains competitive but is slightly lower than TORA, showing that a generic MLP lacks the explicit uncertainty-aware fusion and engineering interpretability of RSF. Therefore, the higher lift curve of TORA can help engineers identify more true high-risk transformers in the first inspection batch and improve O&M efficiency.
Figure 9 compares Precision@K curves for TORA, UAG-NoUQ, LightGBM, LSTM, and XGBoost. TORA remains above all baselines across almost the entire coverage range and shows the flattest segment in the O&M critical region of low to medium coverage, indicating strong early ranking quality and robustness to threshold choice. UAG-NoUQ ranks second but decays more rapidly as coverage increases, while LSTM and XGBoost stay close to each other and clearly below TORA. LightGBM hovers only slightly above the base rate. Overall, static dynamic risk fusion with cloud calibration enhances fault prioritization and inspection efficiency for field crews under limited budgets.
Figure 10 compares the calibration curves of TORA, TORA-MLP-Fusion, UAG-NoUQ, LightGBM, LSTM, and XGBoost. The calibration curve reflects whether the predicted overload probability matches the observed heavy-overload frequency. As shown in
Figure 10 and
Table 5, TORA is closer to the diagonal line, indicating reliable risk probability estimation. This result is physically meaningful because transformer heavy-overload risk is related to thermal-electrical stress accumulation rather than a binary classification result. By combining static equipment vulnerability, dynamic operating stress, and cloud-side calibration, TORA produces probabilities that better match overload occurrence. TORA-MLP-Fusion is competitive but slightly less stable than TORA, suggesting that a generic MLP lacks the explicit uncertainty-aware fusion and calibration mechanism of RSF. Therefore, TORA can provide more credible support for warning threshold setting, risk grading, and maintenance decisions.
Table 6 and
Table 7 report the Brier score and NLL of all models, where lower values indicate better probability quality. TORA achieves the lowest Brier score and NLL, followed by TORA-MLP-Fusion and UAG-NoUQ, indicating that its predicted overload probabilities are closer to the observed outcomes and less affected by overconfident errors. This result is physically meaningful because transformer heavy-overload risk should be evaluated as a probabilistic process related to thermal-electrical stress accumulation, rather than only as a binary label. By combining static equipment vulnerability, dynamic operating stress, and cloud-side calibration, TORA produces sharper but still reliable risk probabilities. TORA-MLP-Fusion also improves probability estimation, but it remains slightly weaker than TORA, suggesting that a generic MLP lacks the explicit uncertainty-aware fusion and calibration mechanism of RSF. Therefore, TORA provides more credible probability support for warning threshold setting, risk grading, and cost-sensitive maintenance decisions.
To assess computational timeliness during online inference, we decompose a single inference into three stages— (pre-processing), (inference), and (post-processing)—and report their p50 and p95 (in ms). Here, denotes the device-side online dynamic pre-processing time. For fairness, normalization and encoding of static features are treated as offline pipeline initialization and are excluded from . is the model forward-pass time, i.e., the pure compute cost from the end of pre-processing to the production of raw scores/probabilities. is the post-processing time and excludes persistence and logging. The p50 (median) characterizes typical latency; the p95 (95th percentile) reflects tail jitter and worst-case service capacity. To avoid conflating communication effects with algorithmic differences, all three stages are reported as compute-only latencies, excluding network transfer, queuing, and scheduling overhead. All reported latency values are per-sample: we time each of the 6700 test samples to obtain a distribution for each stage and then report its p50/p95; therefore, these numbers are not the cumulative time for all 6700 samples.
In the pre-processing stage, TORA, TORA-MLP-Fusion, UAG-NoUQ, and LightGBM exhibit very low latency, clearly outperforming LSTM and XGBoost. This indicates that online dynamic pre-processing imposes negligible overhead for the proposed framework. TORA-MLP-Fusion shows a pre-processing latency close to TORA because it uses the same static and dynamic input pipeline. In the inference stage, LightGBM attains the fastest p50, while TORA remains highly competitive and shows stable tail latency. TORA-MLP-Fusion introduces only a slight additional inference cost compared with TORA, since it replaces the final RSF module with a small MLP while keeping the E-SFRA and C-DFRA branches unchanged. Compared with LSTM and XGBoost, TORA and TORA-MLP-Fusion still maintain much lower inference latency, indicating better suitability for online risk warning. In the post-processing stage, TORA and TORA-MLP-Fusion also maintain very low latency, and the differences among lightweight models are negligible. LSTM and XGBoost show slightly higher post-processing latency, but this stage has limited impact on the total online response time. Overall, the computational bottleneck mainly lies in the inference stage. Under the same measurement protocol, TORA achieves a good balance between physical interpretability, risk prediction performance, and online timeliness. The comparison with TORA-MLP-Fusion further shows that replacing RSF with a generic MLP only slightly increases latency but does not improve the overall risk assessment quality, supporting the efficiency and engineering suitability of the proposed RSF-based TORA framework.
5.4. Risk Distribution Prediction Case
Based on the TORA model, we analyze the area surrounding a selected substation and jointly model the transformers’ static and dynamic features.
Figure 14 presents a regional overload-risk heatmap generated from the calibrated TORA risk scores. Specifically, the static and dynamic features of each transformer are first input into the E-SFRA and C-DFRA modules, respectively. The resulting static and dynamic risk scores are then aligned and fused through the CE-PAA and RSF modules to obtain the calibrated overload-risk probability R for each transformer. The obtained risk probabilities are spatially associated with the corresponding transformer locations and overlaid on a real-world basemap to produce the regional risk distribution shown in
Figure 14.
The risk levels in
Figure 14 are defined according to the calibrated overload-risk probability R, which integrates both static and dynamic feature information. In this study, the probability interval [0,1] is divided into four response levels: low risk for
, medium risk for
, high risk for
, and very high risk for
. Accordingly, the color scale increases monotonically from green to red with the overload-risk probability, where green, yellow, orange, and red correspond to low-, medium-, high-, and very high-risk levels, respectively. These thresholds are used for visual risk interpretation and maintenance prioritization.
For low-risk (green) areas, routine inspections are performed at the normal frequency. For medium-risk (yellow) areas, temperature verification or infrared thermography inspection is recommended within two weeks. For high-risk (orange) areas, a load-shedding or load-transfer plan should be formulated, cooling measures should be activated, and temperature/current tracking should be strengthened. For very-high-risk (red) areas, immediate load reduction or transfer is required, and outage inspection should be scheduled if continuous operation cannot be safely maintained.