Next Article in Journal
Bionic Sensors for Biometric Acquisition and Monitoring: Challenges and Opportunities
Next Article in Special Issue
Cycle-Informed Triaxial Sensor for Smart and Sustainable Manufacturing
Previous Article in Journal
Pupil Detection Algorithm Based on ViM
Previous Article in Special Issue
Comprehensive Diagnostic Assessment of Inverter Failures in a Utility-Scale Solar Power Plant: A Case Study Based on Field and Laboratory Validation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Lag-Specific Transfer Entropy for Root Cause Diagnosis and Delay Estimation in Industrial Sensor Networks

by
Rui Chen
1,
Shu Liang
1,
Jian-Guo Wang
2,*,
Yuan Yao
3,*,
Jing-Ru Su
2 and
Li-Lan Liu
2
1
College of Electronic and Information Engineering, Tongji University, Shanghai 200092, China
2
School of Mechatronical Engineering and Automation, Shanghai University, Shanghai 200072, China
3
Department of Chemical Engineering, National Tsing Hua University, Hsinchu 300044, Taiwan
*
Authors to whom correspondence should be addressed.
Sensors 2025, 25(13), 3980; https://doi.org/10.3390/s25133980
Submission received: 28 April 2025 / Revised: 17 June 2025 / Accepted: 24 June 2025 / Published: 26 June 2025

Abstract

Industrial plants now stream thousands of temperature, pressure, flow rate, and composition measurements at minute-level intervals. These multi-sensor records often contain variable transport or residence time delays that hinder accurate disturbance analysis. This study applies lag-specific transfer entropy (LSTE) to historical sensor logs to identify the instrument that first deviates from normal operation and the time required for that deviation to appear at downstream points. A self-prediction optimization step removes each sensor’s own information storage, after which LSTE is computed at candidate lags and tested against time-shifted surrogates for statistical significance. The method is benchmarked on a nonlinear simulation, the Tennessee Eastman plant, a three-phase separator test rig, and a full-scale blast furnace line. Across all cases, LSTE locates the disturbance origin and reports propagation times that match known process physics, while significantly reducing false links compared to classical transfer entropy.

1. Introduction

The convergence of information technology and traditional manufacturing has turned modern plants into large-scale sensor networks in which thousands of temperature, pressure, flow rate, and composition transmitters report data at minute- or even second-level intervals [1,2]. Because these instruments are distributed across units, pipelines, and utility systems, any local disturbance detected by one sensor can propagate through material, energy, or control flows and appear—often after a time delay—in the readings of many others. Such propagation, if not recognized early, may degrade product quality, raise operating costs, or even threaten personnel safety [3]. Root cause diagnosis (RCD) therefore focuses on locating the first sensor that records an abnormal deviation so that operators can determine whether the problem lies in the instrument itself or in the underlying process [4].
In classical control terminology, a disturbance is defined as “any variable that causes the controlled variable to deviate from set point” [5]. Regardless of whether a disturbance reflects a genuine fault or simply a routine load or feed change, the material, energy, and control links that connect the sensors often remain intact, so the disturbance still propagates through the network along those predefined causal paths. By analyzing those paths, we can trace abnormal signals back to their origin [6].
Early RCD tools—such as adjacency matrices [7] and signed directed graphs (SDGs) [8]—model these links with first-principle knowledge of every unit operation. Such mechanism-based approaches work well for small systems, but become difficult to build and maintain for today’s high-dimensional sensor networks. Data-driven methods avoid detailed process descriptions by extracting the structure directly from archived measurements [9].
Machine-learning versions of those data-driven methods have produced good results, yet they often demand large, well-labeled datasets and complex training procedures [10]. This has renewed interest in statistical causality measures—notably Granger causality (GC) [11,12] and transfer entropy (TE) [13,14]—that work with moderate data volumes and minimal prior information. Nevertheless, no single method is best for every plant, so the choice must match the sensor network and operating regime.
Among these alternatives, TE is valued for capturing nonlinear interactions [15,16]. As an information-theoretic measure [17], it evaluates the conditional mutual information between the future of one sensor and the delayed past of another, given the target sensor’s own history; a positive value implies a directional flow of information from the source sensor to the target sensor [18]. It is important to note that a high transfer entropy (TE) value between two variables does not directly imply a causal relationship. Rather, TE quantifies the information flow or directional influence from one variable to another. Additional statistical significance tests are necessary to determine whether a TE value is meaningful—only statistically significant TE values may be interpreted as indicative of potential causal influence, rather than definitive proof of causality. Researchers have proposed many TE extensions. Symbolic TE (STE) reduces noise sensitivity for non-stationary data [19]; Partial TE (PTE) distinguishes direct from indirect links [20]; and further variants combine the two ideas or examine multiple time scales [13,21]. These versions, however, often require large sample sizes [22], and may perform poorly when strong linear relations co-exist with nonlinear ones [23]. To reduce the cost of nonlinear RCD, a kernel-sample equivalence method using TE was proposed and can identify the root cause sensor with less computation [24]. Papana et al. [16] proposed direct causality measures based on variable selection and dimensionality reduction techniques to reduce computational complexity, and systematically evaluated the performance of several bivariate and multivariate causality measures in the time domain. A multi-block Bayesian network driven by Direct Transfer Entropy (DTE) was built to detect feedback loops and locate the source sensor [25]. More recently, Information Granulation DTE (IGDTE) has grouped data into coarse granules before computing DTE, cutting the runtime while preserving accuracy [26].
Moreover, time lags naturally arise as disturbances propagate through interconnected process units [27], and these delays are crucial for understanding the dynamic behavior of complex sensor networks [28]. Given that industrial process data often exhibit both linear and nonlinear dependencies, and that time delay information is essential for accurate fault diagnosis, we propose a root cause diagnosis approach based on lag-specific transfer entropy (LSTE), originally introduced in [27], and tailor it to industrial process scenarios involving complex time–delay interactions. In this study, the goal is to develop an algorithm capable of analyzing time-delayed causal relationships among the variables in industrial processes, with the aim of achieving accurate root cause identification. This objective is accomplished by quantifying the information gain between variable pairs under varying time lag conditions and applying statistical significance testing. Compared to conventional lag-agnostic methods, the use of LSTE enables a more precise and informative characterization of the dynamic interactions within complex process systems. Specifically, the algorithm first removes each sensor’s self-predictable component with past self-prediction optimization (SPO). It then scans candidate lags and selects the one that maximizes transfer entropy, delivering both the delay and the strength of every causal link. This joint view of lag and causality traces the disturbance path in detail and pinpoints the originating sensor. The feasibility of the proposed method is demonstrated through applications to numerical simulations, the Tennessee Eastman Process (TEP), and the Three-Phase Flow (TPF) process. Additionally, LSTE is used to conduct an in-depth analysis of the time lag causal relationship between the blast furnace molten iron temperature and the related operating variables.

2. Fundamental Concepts

2.1. Foundations of Information Theory

TE originates from the concept of information entropy, which was introduced by Shannon in 1948 [17] to quantify information content. The entropy of a random variable X is defined as follows:
H ( X ) = i = 1 n p ( x i ) l o g 2 p ( x i ) .
where x i denotes the ith measurement value of the random variable X and p ( x i ) denotes the probability observing X = x i . In practice, systems are typically composed of multiple interrelated variables. These interdependencies form a network of interactions. To capture the uncertainty within such systems, the entropy concept can be extended to multivariate settings.
For example, the joint entropy of two random variables X and Y is as follows:
H ( X , Y ) = i = 1 n j = 1 n p ( x i , y j ) l o g 2 p ( x i , y j ) ,
where p ( x i , y j ) denotes the joint probability of X = x i and Y = y j . The conditional entropy H ( Y | X ) represents the residual uncertainty in Y given the knowledge of X , and is defined as follows:
H ( Y | X ) = i = 1 n j = 1 n p ( x i , y j ) l o g 2 p ( y j | x i ) ,
where p ( y j | x i ) is the conditional probability of Y = y j when given X = x i .

2.2. Transfer Entropy

Let X = x 1 , x 2 , , x n and Y = y 1 , y 2 , , y n be two time series. The transfer entropy from X to Y, denoted as T E X Y , is given using the following:
T E X Y = p ( y t + 1 , y t , x t ) log p ( y t + 1 | y t , x t ) p ( y t + 1 | y t ) ,
where p ( y t + 1 , y t , x t ) denotes the joint probability density function, p ( · | · ) denotes the conditional probability density function, and y t + 1 denotes the measurement of Y at a future moment in time. In addition, x t = x t , x t τ , , x t ( d 1 ) τ and y t = [ y t ,   y t τ ,   y t 2 τ , , y t ( l 1 ) τ ] are the state space reconstruction vectors of variables X and Y , respectively, where d and l are the embedded dimension of variables X and Y , respectively. If τ is the embedded delay, then the length of time series reconstruction is n = n m a x d 1 τ , l 1 τ . Since causality and interaction are defined as properties of the system rather than scalar time series, the corresponding state space of the interacting system must be reconstructed from scalar time series before causality detection can be carried out. Generally, we choose d = l or d = 1 . The calculation of TE can also be expressed in terms of entropy as follows:
T E X Y = H y t + 1 y t , x t + H y t + 1 y t = H ( y t + 1 , y t , x t ) + H y t , x t + H y t + 1 , y t H y t
It can be seen from Equation (5) that the calculation of TE indicates whether the information entropy of y t + 1 is affected by x t , which is consistent with Wiener’s causality theory. That is, if variable Y could be predicted more accurately using the past value of variable X , then variable X affects variable Y .
In addition, the TE is directional. If T E X Y > 0 , it means that the information is transferred from variable X to variable Y ; if T E X Y < 0 , the information is passed from variable Y to variable X ; and if T E X Y = 0 , there is no causal relationship between the two variables.

3. Methodology

3.1. Principles of LSTE

There is a natural delay in the transmission of information between variables. The traditional TE method cannot accurately describe the system’s information interaction by using only the amount of information transferred at a future time point. Therefore, the concept of time lag is introduced into TE [29], i.e.,
T E X Y = p ( y t + h , y t , x t ) log p ( y t + h | y t , x t ) p ( y t + h | y t ) ,
where h denotes the time delay over which the influence spreads from X to Y ; the transfer entropy value at this delay quantifies the amount of information transferred from X to Y at lag h . By adjusting the value of h , TE can adapt to different time delays among variables, making it more aligned with real-world dynamics and allowing the maximum TE value to indicate the causal relationship between variables.
However, Equation (6) violates the best self-prediction requirement implied by Wiener’s principle, and thus the value of h obtained may not reflect the true time lag. Wiener’s principle requires that the past of X provides additional information about the future of Y , beyond what is already provided by the past of Y . If the latter is underestimated, the inferred information transfer from X to Y will be exaggerated. Therefore, the past of Y must be optimally estimated—this is referred to as self-prediction optimization (SPO). From an information-theoretic perspective, “self-prediction” corresponds to the information storage of Y . Underestimating this storage leads to the overestimation of the transfer entropy from X to Y .
Assuming that Y satisfies SPO at h 0 , where h 0 is the optimal time delay for the self-prediction of y t using y t h 0 . For X , the time index t is replaced by t h , and Equation (6) can be rewritten as follows:
T E X Y ( h ) = p ( y t , y t h 0 , x t h ) log 2 p ( y t | y t h 0 , x t h ) p ( y t | y t h 0 ) .
As shown in [29], if Equation (7) is used to express causality, then h 0 must be 1. This setting eliminates the information storage of Y ’s past and avoids mistaking it for information transferred from X . Accordingly, the TE that satisfies SPO is as follows:
S P O T E X Y   ( h ) = p ( y t , y t 1 , x t h ) log p ( y t | y t 1 , x t h ) p ( y t | y t 1 ) .
The actual time lag δ at which variable X affects variable Y is defined as follows:
δ = a r g m a x h S P O T E X Y ( h ) .
Thus, the LSTE formulation becomes the following:
L S T E X Y = p ( y t , y t 1 , x t δ ) log 2 p ( y t | y t 1 , x t δ ) p ( y t | y t 1 ) .
When δ = 1 , the LSTE reduces to the traditional TE, and Equation (10) can be rewritten in terms of entropy:
L S T E X Y = H y t y t 1 , x t δ + H ( y t | y t 1 ) = H y t , y t 1 , x t δ + H y t 1 , x t δ          + H y t , y t 1 H y t 1

3.2. Transfer Entropy Estimation

The calculation of transfer entropy (TE) involves numerous joint and conditional probability density estimations. Since the probability distributions of variables are typically unknown in real systems, it becomes necessary to approximate them. Non-parametric probability density estimation is widely adopted because it can handle arbitrary distribution forms without relying on specific assumptions. Common non-parametric methods include histograms, kernel density estimation (KDE) [30], and K-nearest neighbors (KNN) [31]. The histogram method is simple and intuitive, but it exhibits significant bias when applied to high-dimensional data. While KDE offers high accuracy, its computational complexity increases substantially with larger sample sizes and higher dimensions. Therefore, in this study, the KNN method is selected for non-parametric probability density estimation due to its balance between accuracy and efficiency.
According to Equation (11), estimating LSTE is equivalent to computing a combination of joint and marginal entropies. Each entropy term in Equation (11) can be estimated using the KNN method [31]. The pseudocode for LSTE estimation via KNN is shown in Algorithm 1.
Algorithm 1 Estimation of L S T E X Y using KNN
Input: Variable X and Y, embedding dimension d = l , embedding delay τ , number of neighbors k
Output :   L S T E X Y
N = length ( X ) ( d 1 ) ×   *   τ 1
for   i = 1 : d
X _ embed ( : ,   i ) = X ( ( i 1 ) × τ + 1 :   N + ( i 1 ) × τ )
Y _ embed ( : ,   i ) = Y ( ( i 1 ) × τ + 1 :   N + ( i 1 ) × τ )
End
joint_space = [Y_future, X_embed, Y_embed]  % Construct joint space
[nnidx, dists] = Knn_search(joint_space, k + 1);
% Find local neighborhood using KNN
maxdistV = dists(end,:)
% Distance to the (k + 1)-th neighbor defines the hypersphere radius
[nxz, nyz, nz] = point_estimation(Y_future, X_embed, Y_embed);
% Estimate local point counts
L S T E X Y = Digamma(nxz, nyz, nz)
% Compute LSTE using Equation (12)
return   L S T E X Y
For a given number of neighbors k , t different spatial scales may arise across the terms in Equation (11) due to the varying dimensions of the associated variable spaces. Therefore, applying KNN directly to estimate each entropy term in Equation (11) can be problematic [31]. To address this issue, we adopt an improved TE estimation method that directly approximates the conditional mutual information and avoids explicit density estimation. The resulting expression for LSTE is as follows:
L S T E X Y = ψ k + ψ n y t 1 + 1 ψ n y t , y t 1 + 1 ψ n y t 1 , x t δ + 1 t ,
where ψ · denotes the Digamma function and · t indicates averaging over all time steps. This approach improves computational efficiency and avoids the need to explicitly estimate sample probability densities.

3.3. Significance Test

In practice, transfer entropy values are often contaminated by noise or confounding effects, making direct inference unreliable. Therefore, we apply a surrogate-based significance test to determine whether a causal relationship exists between variables X and Y. The statistical significance of TE is assessed using a randomized test based on time-shifted surrogate sequences [32]. This approach disrupts the coupling between the driving and response variables, thereby creating a null distribution for comparison [33]. The pseudocode for the significance test is shown in Algorithm 2.
Algorithm 2 Time-shifted substitution sequences
Input:  Variable   X   and   Y ,   significance   level   α = 0.05 ,   number   of   surrogate   M = 100 , time lag δ , causal flag c, random integer d0
Output :    p   value ,
LSTE _ original ,   δ = calculate_LSTE(X, Y)  % Compute original LSTE
LSTE_surrogates = []  % Initialize surrogate array
for i = 1 to M  % Generate surrogate data
X_surr = shift_time_series(X, d0)  % Time shift X using Equation (13)
LSTE_surr = calculate_LSTE(X_surr, Y)
LSTE_surrogates = LSTE_surr % Store surrogate LSTE
end
Compute p_value according to Equation (14)
if p value < α then
c = 1      %   Causal   relationship   is   statistically   significant
end
return δ, p value
A random integer d 0 (where d 0 < n , and n is the length of the time series) is generated, and the first d 0 samples of the driving variable are cyclically shifted to the end of the time series to construct a surrogate:
x 1 , , x d 0 , x d 0 + 1 , , x n x d 0 + 1 , , x n , x 1 , , x d 0
The null hypothesis H 0 assumes that there is no causal relationship between variables X and Y . The significance test compares the original transfer entropy value q 0 with those obtained from the M time shift surrogate series ( q 1 ,   ,   q M ). In this study, the significance level is set to α = 0.05 . The one-sided p-value is computed as follows:
p = 1 ( i 0.326 ) / ( M + 1 + 0.348 ) ,
where i is the rank position of q 0 in ascending list of all M + 1 values. If p < 0.05 , the null hypothesis is rejected, indicating a statistically significant causal relationship between X and Y .

3.4. Procedure of LSTE for Disturbance RCD

Figure 1 illustrates the flowchart of the LSTE-based RCD framework. A detailed explanation of each step is provided below.
Before performing disturbance RCD, disturbance identification is conducted to filter out the most relevant variables from a large set of industrial process variables. Then, a pair of variables X and Y is selected, where X is the potential cause and Y is the effect. The linear and nonlinear trends contained in the time series are removed using MATLAB’s “detrend” function (MATLAB version: R2022a). The embedding dimension d and l, as well as the embedding delay τ , are selected using the Ragwitz criterion [34], which provides an automatic and statistically principled approach to embedding parameter selection, thereby eliminating the need for manual tuning. The past state of the system is then reconstructed via state space embedding of the scalar time series.
Next, the maximum delay lag h m a x is set and the value of S P O T E X Y under different h is estimated using the KNN algorithm, as shown in Equation (8). The optimal time lag δ and the corresponding lag-specific transfer entropy L S T E X Y are then determined according to Equations (9) and (10). A significance test is performed using the time shift surrogate method (Equation (14)). If p < 0.05 , a statistically significant causal relationship from X and Y is inferred; otherwise, no causal link is assumed.
The above steps are repeated for all variable pairs to comprehensively test causality throughout the system. Finally, the causality diagram is constructed based on the detected causal relationships and the disturbance propagation path is visualized.
When a variable is identified as the root cause of a disturbance in the causality diagram, it suggests that the system state represented by this variable (e.g., valve opening, feed rate) has exhibited abnormal fluctuations, or that a disturbance source exists in its neighboring components. Such diagnostic insight provides engineers with actionable guidance for timely mitigation and control interventions, reducing the impact on the overall system performance.

4. Case Studies

In this section, the numerical simulation, TEP, TPF, and a full-scale blast furnace line are used to illustrate the effectiveness of the proposed method. All experiments in this paper are conducted under the same environment (CPU i5 @ 1.60 GHz, RAM 12 GB).

4.1. Numerical Simulation

A nonlinear simulation system containing five variables is designed in this study, with each variable having a length of n = 1000 . The system equation is as follows:
X 1 , t = 0.95 2 X 1 , t 1 0.9025 X 1 , t 2 + ε 1 , t X 2 , t = 0.6 X 1 , t 2 2 + ε 2 , t X 3 , t = 0.2 2 X 1 , t 3 + 0.5 2 X 4 , t 2 2 + ε 3 , t X 4 , t = 0.5 X 1 , t 2 2 + 0.5 2 X 4 , t 1 + 0.25 2 X 5 , t 1 + ε 4 , t X 5 , t = 0.25 2 X 4 , t 1 + 0.5 X 5 , t 1 + 0.3 X 2 , t 3 2 + ε 5 , t
where ε i , t   ( i = 1 , 5 ) represents independent Gaussian white noise with a mean of zero and unit standard deviation. The time series trajectories are shown in Figure 2.
As shown in Equation (15), X 1 is the root cause of the disturbance. The system contains seven causal paths in total, including linear causality ( X 1 X 3 , X 4 X 5 ) and nonlinear causality ( X 1 X 2 , X 1 X 4 , X 2 X 5 , X 4 X 3 ). In this study, TE [18] and PTE [20] are used as comparison algorithms to verify the effectiveness of the proposed method. A binary classification framework is adopted to evaluate the model’s diagnostic performance on the simulated system. In this context, the presence of a causal relationship is treated as a positive instance, and its absence as a negative instance. Based on the model’s prediction outcomes, we define four types of classification results. A true positive (TP) occurs when the model correctly identifies an existing causal relationship. A false positive (FP) arises when the model incorrectly predicts a causal relationship that does not exist. A true negative (TN) denotes the correct identification of the absence of causality. A false negative (FN) indicates a missed detection of an actual causal link.
Using these four outcomes, we compute four evaluation metrics to comprehensively assess model performance: accuracy, sensitivity (recall), specificity, and F1 score. Accuracy measures the proportion of all correctly classified instances (both TP and TN) among the total. Sensitivity represents the proportion of true causal relationships correctly identified. Specificity measures the proportion of non-causal pairs correctly rejected. The F1 score reflects the harmonic mean of precision and recall, offering a balanced indicator of model performance, particularly under class imbalance. The formulas for these metrics are given in Equations (16)–(19).
A c c u r a c y = T P + T N T P + T N + F P + F N
S e n s i t i v i t y = T P T P + F N
S p e c i f i c i t y = T N T N + F P
F 1 = 2 T P 2 T P + F P + F N
Figure 3 presents the causality diagrams derived from the numerical simulation using TE and PTE, respectively. In these diagrams, the horizontal axis represents cause variables and the vertical axis represents effect variables. A black cell indicates a detected causal relationship between the corresponding variable pair, while a white cell indicates no causal link. If a variable’s entire row is white (no outgoing influence), but its column contains black cells (incoming influence), this suggests that the variable is the root cause of the disturbance.
As shown in Figure 3a, TE successfully identifies the true root cause variable X 1 and all seven true causal paths. However, it also incorrectly detects indirect causal links such as X 1 X 5 ,   X 2 X 4 ,   X 5 X 3 , and X 2 X 3 , which are considered false positives in this benchmark. Figure 3b illustrates the PTE result, which also correctly identifies the root cause variable, but with fewer false causal relationships. As shown in Table 1, PTE achieves a higher accuracy and F1 score than TE, suggesting improved precision in eliminating spurious causal paths.
Following this, the proposed LSTE method is applied to the same simulation system. Unlike TE and PTE, LSTE not only identifies whether a causal relationship exists between variable pairs, but also determines the corresponding time lag and the strength of the causal link. The results are summarized in Table 2 and visualized in Figure 4.
In Table 2, the values represent the estimated causal strengths, while the values in parentheses denote the corresponding p-values calculated using Equation (14). A causal relationship is considered statistically significant if p < 0.05. Values that meet this significance threshold are highlighted in bold.
The data in Table 2 corresponds to Figure 4a. Values in Figure 4a represent the time lag δ , indicating the delay at which the causal strength is highest. A value of 0 means no causal relationship. The corresponding causal strength values at that time lag are shown in Table 2.
As shown in the figure, the LSTE method correctly identifies the root cause X 1 and all true causal paths. Bidirectional causality is marked in red, and unidirectional causality is marked in black. The disturbance propagation path is: X 1 2 X 2 3 X 5 1 X 4 2 X 3 , which is consistent with the true disturbance propagation in the simulation system.
In addition, the robustness of LSTE under different signal-to-noise ratios (SNRs) was evaluated by adjusting the variance of the noise ε i , t in the numerical simulation experiment. The experimental results are summarized in Table 3.
As shown in Table 3, the performance of LSTE decreases as the SNR decreases. However, the root cause variable can still be identified at an SNR of –10 dB, indicating that LSTE possesses a certain degree of robustness.

4.2. Tennessee Eastman Process

4.2.1. Brief Introduction

The TEP dataset used for experimental analysis was developed and made available by prior researchers. It has been described in detail in the literature [35] and is widely used in the process systems engineering community. The dataset can be accessed through the following link: https://web.mit.edu/braatzgroup/links.html (accessed on 23 June 2025). In each simulation run, the total process time is 48 h, with a sampling interval of 3 min, resulting in 960 data points per series. The first 160 data points correspond to steady-state (normal) operation, while the remaining 800 data points capture system behavior after the introduction of a disturbance.
The feed of the TE process consists of four gas reactants (A, C, D, E) and an inert protective gas (B). Three reaction products (G, H, F) are generated through four main chemical reactions. G and H are the desired products, while F is a by-product. The reaction equations are as follows:
A + C + D G Product 1 A + C + E H Product 2 A + E F   By - product 1 3 D 2 F   By - product 2
As described in Appendix A, the TEP system primarily consists of five units: a stirred reactor, stripping tower, product separator, compressor, and condenser. The platform provides 52 diagnostic variables, including 11 control variables and 41 process variables.
TEP includes 21 preset disturbance scenarios, such as step changes, valve-related disturbances, and increases in process variability. For a detailed description of the TEP variables and disturbance scenarios, please refer to references [35,36].

4.2.2. IDV 5

Disturbance IDV5 is a step disturbance caused by a temperature change at the condenser’s cooling water inlet. When the disturbance occurs, it first affects process variables related to the separator, such as the separator temperature ( X 11 ) and the separator cooling water outlet temperature ( X 22 ), due to the direct connection between the condenser and the separator. The disturbance then propagates to other units, affecting variables such as the reactor pressure ( X 7 ), stripper pressure ( X 16 ), and compressor power ( X 20 ). To compensate for the disturbance, the feedback controller adjusts the condenser cooling water flow rate ( X 52 ). After the process reaches a new steady state, variable X 52 does not return to its original value, whereas the other variables return to normal. Based on this behavior, X 52 is identified as the root cause variable of IDV5.
The time series trends of selected variables after the occurrence of IDV5 are shown in Figure 5. It can be observed that each variable exhibits a step change immediately following the disturbance, followed by damped oscillations that eventually stabilize.
Before applying TE, it is necessary to eliminate irrelevant variables and retain only those most associated with the disturbance, i.e., perform disturbance identification [37,38]. This study directly adopts the variable selection results from reference [37], yielding the set X 7 , X 11 , X 16 , X 19 , X 20 , X 22 , X 50 , X 52 .
The second step is data segment selection. In this experiment, the starting point is set to the moment the disturbance occurs, and the segment length is 800, corresponding to time steps 161–960. The embedding dimension is set to d = l = 4 , and the embedding delay is τ = 1 . The TE and PTE are used to conduct RCD of IDV5, and the diagnosis results are shown in Figure 6.
As shown in Figure 6a, variable X 52 is identified as having a causal effect on X 11 , X 22 , and X 50 , and is not influenced by other variables, correctly indicating X 52 as the disturbance root cause of IDV5. However, TE also detects numerous cyclic causal relationships (e.g., X 11 X 22 , X 16 X 22 ), which obscure the true disturbance propagation path. Similarly, while PTE also identifies X52 as the root cause, it still exhibits bidirectional causal links, such as X 16 X 22 .
Next, LSTE is applied to diagnose the root cause of IDV5. The maximum lag is set to h m a x = 10 . The causal strengths among the selected variables, along with their statistical significance, are reported in Table 4, and the corresponding causality diagram is shown X 11 to X 20 occurring after nine sampling intervals.
In Figure 7. Statistically significant values (p < 0.05) are highlighted in bold. In addition, in the causality diagram, the x-axis and y-axis represent the same set of variables (i.e., disturbance variables X 7 , X 11 , X 16 , X 19 , X 20 , X 22 , X 50 , X 52 ), with the x-axis denoting cause variables and the y-axis denoting effect variables. Each color block indicates the presence and strength of information transfer between variable pairs at specific time lags. The red box highlights a detected directional influence from X 11 to X 20 occurring after 9 sampling intervals.
Figure 8 illustrates the disturbance propagation path derived from Figure 7, highlighting the time delays between causally related variables. When the disturbance occurs, variable X 52 affects X 11 and X 22 after one time delay, meaning that the adjustment in the condenser cooling water flow ( X 52 ) influences the separator temperature ( X 11 ) and the separator cooling water outlet temperature ( X 22 ) within 3 min. Subsequently, after 9 min, it influences the reactor pressure ( X 7 ).
The propagation path and time lags obtained from LSTE are consistent with process mechanism analysis. Comparing Figure 6 and Figure 8 reveals that the LSTE-based RCD method not only correctly identifies the disturbance root cause, but also determines the transmission time between variables, demonstrating the advantages of LSTE over traditional methods.

4.2.3. IDV 8

Disturbance IDV8 is caused by random fluctuations in the feed ratios of components A, B, and C in Stream 4. When the disturbance occurs, it directly affects the corresponding measurements in Stream 4. The total feed rate controller ( X 45 ) compensates for the disturbance by adjusting the total feed rate ( X 4 ) in Stream 4 to maintain the setpoint. Since Stream 4 primarily contributes residual reactants to Stream 10, which are then recycled back to the reactor via Stream 5, the feed composition in the reactor changes, disrupting the dynamic balance of the chemical reactions. During this circulation, variables such as the reactor pressure ( X 7 ), separator pressure ( X 13 ), and the feed amount of component A in Stream 1 ( X 1 ) are also affected. Based on this mechanism analysis, X4 and X45 are identified as the root variables of IDV8.
The time series changes in several relevant variables after the disturbance are shown in Figure 9. It can be observed that the values of the variables begin to change after time point 160, indicating the moment at which the disturbance occurs. The resulting fluctuations in the affected variables show stable periodic behavior, suggesting that IDV8 is a stable disturbance.
As with other cases, disturbance identification is necessary prior to performing root cause diagnosis (RCD) for IDV8. Based on the principal component analysis (PCA)-based contribution diagram method, the identified disturbance-related variables are X 1 , X 4 , X 7 , X 13 , X 16 , X 20 , X 21 , X 45 , X 46 . This study uses the 800 data points following the disturbance (i.e., samples 161–960) as the experimental dataset. The embedding dimension is set to d = l = 3 and the embedding delay is τ = 1 .
TE and PTE are applied to diagnose the root cause of IDV8, and the results are shown in Figure 10. As shown in Figure 10a, variables X4 and X45 influence each other, but X45 is only influenced by X4, indicating that X45 is the root cause of IDV8. Both X4 and X45 affect multiple variables such as X7 and X13; however, since those variables also have causal effects on X4, X4 cannot be conclusively identified as a root cause. In Figure 10b, the number of indirect causalities is reduced, yet some bidirectional causalities remain (e.g., X4X7).
Next, LSTE is applied to diagnose the root cause. The causal strengths among IDV8-related variables are listed in Table 5, and the corresponding causality diagram is shown in Figure 11. Statistically significant values (p < 0.05) are highlighted in bold.
As seen in Figure 11, LSTE correctly identifies X45 as the root cause variable. The disturbance propagation path derived from this result is shown in Figure 12, which also reveals the time lag of causal transmission between variables.
Specifically, X45 affects X4 within 3 min. This is expected, since X45 (total feed controller) and X4 (total feed flow) are control and measurement variables of the same stream and are physically linked. Thus, the disturbance can be sensed almost simultaneously. Subsequently, after 6 min, the disturbance propagated to the reactor, disrupting the material balance and affecting the reactor pressure (X7) after 9 min. The impact then extended to the separator pressure (X13) after 12 min and the compressor re-circulation valve opening (X46) after 21 min. Finally, the disturbance reached the stripper, influencing the stripper pressure (X16) after 27 min.
By comparing Figure 10 and Figure 11, it is evident that the LSTE-based RCD method not only accurately identifies the root cause of the disturbance, but also captures the transmission time lags between disturbance-related variables, demonstrating the superiority of LSTE.

4.3. Three-Phase Flow Process

4.3.1. Brief Introduction

The TPF dataset was collected by researchers at Cranfield University using a lab-scale experimental setup. Details of the experimental platform and data acquisition process (sampling frequency: 1 Hz) are provided in [39] and Appendix B. This setup mimics industrial Three-Phase Flow separation systems and simulates real-world disturbance scenarios, such as congestion, operational errors, and unconventional operating conditions. The dataset is publicly available at the following link: https://github.com/ShiningLLH/ThreePhaseFlow_Ag-MRDCVA (accessed on 23 June 2025).
The test area consists of pipes of various apertures and geometries, supplying air, water, and oil—individually and in mixtures—at controlled flow rates. The multiphase mixture is then separated into a horizontal three-phase separator (GS500) with a volume of 11 m3. Air is discharged into the atmosphere, while emulsions of oil and water are separated into their respective condensers (CW500 and CO500, each with a capacity of approximately 1.5 m3) before returning to their designated tanks (T200 for water and T100 for oil). For further details regarding the TPF variables and disturbances, refer to [39].

4.3.2. Disturbance 5

Disturbance 5 (Slugging conditions) is selected as a validation case to evaluate the effectiveness of the proposed method. Slugging is an instantaneous phenomenon [40] that arises in multiphase flow risers when gas–liquid velocities are relatively low. In offshore oil production systems, when multiphase hydrocarbon fluids travel through long seabed pipelines from oil fields to offshore platforms, substantial pressure and flow fluctuations may occur, potentially damaging downstream equipment. Slugging conditions cause significant fluctuations in key process variables—such as pressure, flow rate, and density—at both the top and bottom of risers. Based on this mechanism analysis, the flow rate at the top riser (X10) and density at the top riser (X13) are identified as the root cause variables [41].
After the onset of Disturbance 5, the changing trends in selected variables are shown in Figure 13. The disturbance spans 2541 s, beginning at 686 s and ending at 1172 s. This study adopts the variable selection results from [41], which include X 2 , X 3 , X 6 , X 10 , X 13 . A total of 486 data points (1 Hz sampling) covering the entire disturbance duration are used, starting from the disturbance onset. The embedding dimension is set to d = l = 3, and the embedding delay is τ = 1. Traditional TE is first applied for RCD, and the results are shown in Figure 14a.
As shown in Figure 14a, TE incorrectly identifies X2 as the root cause, which contradicts the mechanism-based analysis, indicating that TE fails to accurately identify the true root cause. Similarly, PTE also identifies incorrect root variables and exhibits several spurious causal relationships. Next, the LSTE method is applied, with the maximum lag delay set to h m a x = 10 . The causal strengths and corresponding statistical significance results are summarized in Table 6 and visualized in Figure 15.
As shown in Figure 15, LSTE correctly identifies X10 as the root cause variable, with causal effects on other variables. Figure 16 illustrates the disturbance propagation path derived from Figure 15 and highlights the time lags associated with causal transmission.
Specifically, X10 affects X13 within 1 s, which is expected given the strong physical coupling between the flow rate and density at the top riser. These two variables reflect the system’s state at the same spatial location. After 2 s, the disturbance propagates to the pressure at the top of the riser (X3). Finally, the disturbance reaches the bottom of the riser, affecting X2 (bottom pressure) and X6 (differential pressure) after 5 s. The longer transmission time is attributed to the physical distance along the riser between X10 and X2.

4.4. Blast Furnace Ironmaking Process

4.4.1. Brief Introduction

The blast furnace ironmaking process is a complex, high-temperature system involving the transfer of matter and energy among four distinct phases: gas (coal gas), solid (ore, coke, and flux), liquid (slag and molten iron), and powder (coal powder, etc.) [42,43]. It represents one of the most intricate reaction mechanisms in the field of chemical metallurgy. Investigating the time-lagged causal relationships between key operating variables and the molten iron temperature (PT) provides critical decision support for on-site operations. In the following experiment, data from two days of blast furnace operation were analyzed separately. With a sampling interval of 5 min, each dataset consists of 288 data points. The ironmaking data used in this study were obtained from an industrial project led by the authors. The dataset is proprietary, and its use has been explicitly approved by the collaborating company for research and publication purposes.

4.4.2. Results Analysis

The causal time lag analysis results between three key operating variables—Blast Temperature (BT), Blast Humidity (BH), and Pulverized Coal Ratio (PCR)—and the Pig iron Temperature (PT) are presented in Figure 17, Figure 18, and Figure 19, respectively. The maximum LSTE values identified in each case pass the statistical significance test (p < 0.05).
As shown in Figure 17, the effect of BH on the PT is most prominent at the 22nd lag point, corresponding to a time lag of 110 min (p = 0.0217). BH represents the moisture content of the gas entering the furnace, and directly affects combustion and heat transfer. As the humidity increases, more heat is required for vaporization, increasing the furnace’s thermal load. Since the moisture must travel through several complex zones—such as the combustion and reduction zones—before affecting the molten iron, a time lag is introduced. Understanding this lag allows operators to anticipate how changes in humidity will impact the furnace temperature, and to prevent sharp fluctuations caused by excessive or insufficient moisture.
In Figure 18, the influence of BT on the PT peaks at the 23rd lag point, approximately 115 min after the change (p = 0.0034). BT is a critical parameter in the combustion and reduction reactions within the furnace. Higher air temperatures improve combustion efficiency, increasing heat generation and thereby raising the PT. The observed delay is reasonable, as the elevated air temperature must pass through multiple reaction and heat transfer zones before impacting the molten iron. Recognizing this lag helps operators to fine-tune BT adjustments more effectively and avoid overcorrections.
As shown in Figure 19, the PCR affects the PT at two distinct lag points. The first effect appears at the 2nd lag (approximately 10 min, p = 0.0072), attributed to the rapid heat absorption and decomposition of hydrocarbons in the injected pulverized coal, which causes short-term fluctuations in the PT. The second, more pronounced effect occurs at the 47th lag (approximately 235 min). This longer-term influence results from the slow ascent and chemical interaction of reducing gases (CO + H2) generated by coal combustion. These gases rise through the furnace, reacting with iron ore and releasing heat, thus producing a delayed impact on the molten iron temperature.
The above causal time lag analysis has been reviewed and validated by blast furnace ironmaking experts. These results highlight the heterogeneous influence of different variables on the PT, reflecting the complexity and temporal dynamics of heat and mass transfer within the blast furnace. Since the effects of process variables on the PT do not occur simultaneously, analyzing their time lag characteristics enables more effective predictive control, helps mitigate sharp temperature fluctuations, and improves system stability and production efficiency. Moreover, understanding these time lag relationships allows for the selection of appropriate historical data as model inputs, ensuring temporal consistency in PT prediction models and enhancing their overall accuracy.

5. Conclusions

Although various TE-based RCD methods have been studied, important limitations remain. This work proposes an LSTE approach that simultaneously estimates both the time delay and causal strength between process variables. The proposed algorithm is applicable to multivariate time delay causal analysis and root cause diagnosis in industrial systems. All computations were performed on a Windows-based system equipped with an Intel i5 processor (1.60 GHz) and 12 GB of RAM. The algorithm was implemented in MATLAB (MATLAB version: R2022a). The method was validated on a numerical simulation and two industrial benchmarks—the TEP and TPF systems. In all cases, LSTE provided meaningful estimates of delay and causal strength, enabling the accurate identification of the root cause variable. The results aligned with known process mechanisms, enhanced understanding of disturbance propagation, and offered actionable insights for plant operators. The framework was further applied to analyze time-lagged causal relationships between the PT and key operating variables in a blast furnace, providing practical guidance for real-time operations.
However, transfer entropy-based methods, including the proposed LSTE approach, are computationally intensive—particularly when applied to medium- or large-scale systems with high-dimensional variable spaces. This creates challenges for real-time implementation. To address scalability, a candidate variable selection step is typically required prior to root cause diagnosis. By identifying a smaller subset of critical variables, the computational burden can be substantially reduced without compromising diagnostic performance. As this study focuses specifically on root cause diagnosis (RCD), the candidate set identification step is not elaborated upon here. Readers interested in this aspect can refer to our prior work [44] for more details on candidate set identification strategies.
It is also worth noting that the proposed algorithm focuses on root cause diagnosis under the assumption of a single disturbance. However, in real-world industrial processes, multiple disturbances may occur simultaneously. Addressing this challenge presents a promising direction for future research, where more sophisticated algorithms capable of handling concurrent disturbances will be investigated. While this study focuses on the development and validation of the LSTE-based RCD method under stationary conditions, we acknowledge that non-stationarity—a prevalent feature in industrial systems—poses significant challenges. Designing RCD algorithms that can adapt to time-varying dynamics will be an important avenue for future work. Furthermore, high-frequency data introduces additional complications, including increased measurement noise and transient fluctuations, which may lead to false positive causal detections in TE-based methods. To partially mitigate this, we evaluated the robustness of LSTE under varying signal-to-noise ratio (SNR) levels. Nonetheless, the computational burden associated with large high-frequency datasets remains a challenge, and future research will also focus on scalable and noise-robust algorithmic improvements.

Author Contributions

Conceptualization, R.C. and J.-G.W.; methodology, R.C. and J.-R.S.; software, R.C.; validation, R.C.; formal analysis, R.C.; investigation, R.C.; resources, J.-G.W.; data curation, R.C.; writing—original draft preparation, R.C. and S.L.; writing—review and editing, J.-R.S., J.-G.W., and Y.Y.; visualization, R.C.; supervision, Shu Liang, J.-G.W., and L.-L.L.; project administration, Y.Y.; funding acquisition, Y.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This work supported in part by Outstanding Academic/Technical Leader Project of Shanghai Science and Technology Innovation Action Plan under Grant No. 23XD1431500 and Natural Science Foundation of Shanghai under Grant No. 24ZR1423500. Yao was supported in part by National Science and Technology Council, ROC under Grant No. NSTC 113-2221-E-007-012-MY2.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data will be made available on request.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A. Tennessee Eastman Process

This section mainly introduces the Tennessee Eastman Process (TEP) used in Section 4.2. The TEP system is a real chemical process simulation model proposed by Downs and Vogel [36] of the Eastman Chemical Company in the United States in 1993. It is widely used in process monitoring and fault diagnosis and is a typical model. The entire TEP has nonlinear and non-stationary characteristics, and the equipment is highly coupled and contains cyclic processes, which makes the fault root cause diagnosis of the TEP extremely challenging. This paper takes the TEP industrial system as an application example for verify the effectiveness of the fault root cause diagnosis method proposed in this paper.
The TEP is a typical chemical production process, including five main pieces of equipment: reactor, condenser, separator, compressor, and stripping tower, as shown in Figure A1.
Figure A1. Tennessee Eastman Process.
Figure A1. Tennessee Eastman Process.
Sensors 25 03980 g0a1
The production process needs to feed four gaseous raw materials, A, C, D, and E, and inert gas B into the reactor, generating two liquid products, G and H, and a by-product F. The reaction equation of the whole chemical production process is as follows: First, four gaseous raw materials are fed into the reactor to produce a chemical reaction under the action of the catalyst. Next, the products in the reactor and the incompletely reacted feeds, including the inert gas B, are sent to the condenser for cooling. Then, the cooled material is sent to the gas/liquid separator for separation, and the separated steam is passed through a compressor to form a recycling flow, which is put into the reactor again for a reaction to improve the single-pass conversion rate of the reactants. At the same time, in order to prevent the accumulation of by-product F and inert gas B, part of the recycling flow needs to be discharged from the top of the separator. The condensed components separated in the gas/liquid separator (flow 10) are sent to the stripping tower from the bottom of the separator. Stream 4 is used to strip the remaining reaction feed in Stream 10. These remaining feeds are combined with the recycling flow through Stream 5 and enter the reactor again. Finally, products G and H flow out from the bottom of the stripping tower.
In the TEP platform, there are a total of 52 diagnostic variables, including 11 control variables and 41 operating variables. Variables X 1 X 22 are the process measurement variables, which are continuous variables such as temperature, pressure, flow, and liquid level. Variables X 23 X 41 are the component measurement variables, which represent the value of each component and are measured from Stream 6, Stream 9, and Stream 11. Variables X 42 X 53 are the control variables, which are related to the opening of the valve.

Appendix B. Three-Phase Flow Process

This section mainly introduces the Three-Phase Flow (TPF) dataset. Researchers at Cranfield University set up the TPF device experimental platform and collected relevant experimental data (sampling frequency: 1 HZ) [39,40,41]. This equipment is comparable to a small-scale industrial multiphase flow separation process. Introducing different disturbances into the TPF system simulates possible disturbance scenarios that may occur in the actual system, such as blockage, system operation errors, or unconventional operations. Figure A2 shows the process flow chart of the equipment.
Figure A2. Equipment process flow chart of TPF process.
Figure A2. Equipment process flow chart of TPF process.
Sensors 25 03980 g0a2
The test area for the TPF process equipment consists of pipes of different apertures and geometries that supply air, water, and oil, as well as mixtures of these fluids, at the required rates. Finally, the fluid mixture is separated in a horizontal three-phase separator (GS500) with a volume of 11 m3 on the ground. Air is returned to the atmosphere, and the emulsions of oil and water are separated into their respective condensers (CW500 and CO500, with a capacity of about 1.5 m 3 ) before returning to their respective tanks (T200 and T100).
A combination of two compressors supplies air and the compressed air is stored in an 83-inch container (R300) to eliminate the effects of air pressure fluctuations. Water and oil are stored in tanks T100 and T200, respectively, and are independently supplied through multi-stage Grundfos CR90-5 pumps (PO1 and PO2), whose speed is controlled by variable frequency inverters. FT104 measures the water flow, FT204 measures the oil flow, and the water and oil flows are controlled by the pneumatic valves VC101 and VC201, respectively.
After mixing, the fluids can flow through a flow circuit that has a 55-inch-long downward sloping pipe leading to a 10.5-inch-high catenary riser (4 INCH RISER), or through a 40-inch-long horizontal riser connected to a 10.5-inch-long vertical riser (2 INCH RISER). Both flow lines are connected to a two-phase separator, but can be isolated via manual valves at both ends of the flow lines.

References

  1. Jia, M.; Hu, J.; Liu, Y. Topology-guided graph learning for process fault diagnosis. Ind. Eng. Chem. Res. 2023, 62, 3238–3248. [Google Scholar] [CrossRef]
  2. Aragonés, R.; Oliver, J.; Ferrer, C. Enhanced Heat-Powered Batteryless IIoT Architecture with NB-IoT for Predictive Maintenance in the Oil and Gas Industry. Sensors 2025, 25, 2590. [Google Scholar] [CrossRef]
  3. Giraudo, L.; Di Maggio, L.G.; Giorio, L.; Delprete, C. Dynamic Multibody Modeling of Spherical Roller Bearings with Localized Defects for Large-Scale Rotating Machinery. Sensors 2025, 25, 2419. [Google Scholar] [CrossRef] [PubMed]
  4. Wang, J.G.; Chen, R.; Ye, X.Y. Data-driven root cause diagnosis of process disturbances by exploring causality change among variables. J. Process Control 2023, 129, 103062. [Google Scholar] [CrossRef]
  5. Smith, C.A.; Corripio, A.B. Principles and Practices of Automatic Process Control; John Wiley & Sons: Hoboken, NJ, USA, 2005. [Google Scholar]
  6. Lucke, M.; Chioua, M.; Thornhill, N.F. From oscillatory to non-oscillatory disturbances: A comparative review of root cause analysis methods. J. Process Control 2022, 113, 42–67. [Google Scholar] [CrossRef]
  7. Jiang, H.; Patwardhan, R.; Shah, S.L. Root cause diagnosis of plant-wide oscillations using the concept of adjacency matrix. J. Process Control 2009, 19, 1347–1354. [Google Scholar] [CrossRef]
  8. Wan, Y.; Yang, F.; Lv, N. Statistical root cause analysis of novel faults based on digraph models. Chem. Eng. Res. Des. 2013, 91, 87–99. [Google Scholar] [CrossRef]
  9. Wang, J.G.; Chen, R.; Su, J.R. Root cause diagnosis of plant-wide oscillations based on fuzzy kernel multivariate Granger causality. J. Taiwan Inst. Chem. Eng. 2023, 149, 104928. [Google Scholar] [CrossRef]
  10. Mirzaei, S.; Kang, J.L.; Chu, K.Y. A comparative study on long short-term memory and gated recurrent unit neural networks in fault diagnosis for chemical processes using visualization. J. Taiwan Inst. Chem. Eng. 2022, 130, 104028. [Google Scholar] [CrossRef]
  11. Liu, Y.; Chen, H.S.; Wu, H. Simplified Granger causality map for data-driven root cause diagnosis of process disturbances. J. Process Control 2020, 95, 45–54. [Google Scholar] [CrossRef]
  12. Grosicki, G.J.; Fielding, F.; Kim, J.; Chapman, C.J.; Olaru, M.; Hippel, W.V.; Holmes, K.E. Wearing WHOOP More Frequently Is Associated with Better Biometrics and Healthier Sleep and Activity Patterns. Sensors 2025, 25, 2437. [Google Scholar] [CrossRef]
  13. Duan, S.; Zhao, C.; Wu, M. Multiscale partial symbolic transfer entropy for time-delay root cause diagnosis in nonstationary industrial processes. IEEE Trans. Ind. Electron. 2022, 70, 2015–2025. [Google Scholar] [CrossRef]
  14. Zope, K.; Singhal, T.; Nistala, S.H. Transfer Entropy-Based Automated Fault Traversal and Root Cause Identification in Complex Nonlinear Industrial Processes. Ind. Eng. Chem. Res. 2023, 62, 4002–4018. [Google Scholar] [CrossRef]
  15. Bossomaier, T.; Barnett, L.; Harré, M. An Introduction to Transfer Entropy: Information Flow in Complex Systems. Springer Publishing Company Incorporated: New York, NY, USA, 2016. [Google Scholar]
  16. Papana, A.; Siggiridou, E.; Kugiumtzis, D. Detecting direct causality in multivariate time series: A comparative study. Commun. Nonlinear Sci. Numer. Simul. 2021, 99, 105797. [Google Scholar] [CrossRef]
  17. Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 3–55. [Google Scholar] [CrossRef]
  18. Schreiber, T. Measuring information transfer. Phys. Rev. Lett. 2000, 85, 461–464. [Google Scholar] [CrossRef]
  19. Matthäus, S.; Klaus, L. Symbolic transfer entropy. Phys. Rev. Lett. 2008, 100, 158101. [Google Scholar]
  20. Vakorin, V.A.; Olga, A. Confounding effects of indirect connections on causality estimation. J. Neurosci. Methods 2009, 184, 152–160. [Google Scholar] [CrossRef] [PubMed]
  21. Papana, A.; Kyrtsou, K.; Kugiumtzis, D.; Diks, C.G.H. Partial Symbolic Transfer Entropy; Universiteit van Amsterdam, Center for Nonlinear Dynamics in Economics and Finance: Amsterdam, The Netherlands, 2013; pp. 13–16. [Google Scholar]
  22. Papana, A.; Kyrtsou, C.; Kugiumtzis, D. Simulation study of direct causality measures in multivariate time series. Entropy 2013, 15, 2635–2661. [Google Scholar] [CrossRef]
  23. Papana, A.; Kyrtsou, C.; Kugiumtzis, D. Detecting causality in non-stationary time series using partial symbolic transfer entropy: Evidence in financial data. Comput. Econ. 2016, 47, 341–365. [Google Scholar] [CrossRef]
  24. Jiao, J.; Zhen, W.; Zhu, W. Quality-related root cause diagnosis based on orthogonal kernel principal component regression and transfer entropy. IEEE Trans. Ind. Inform. 2020, 17, 6347–6356. [Google Scholar] [CrossRef]
  25. Kumari, P.; Wang, Q.; Khan, F. A Direct Transfer Entropy-Based Multiblock Bayesian Network for Root Cause Diagnosis of Process Faults. Ind. Eng. Chem. Res. 2022, 61, 16166–16178. [Google Scholar] [CrossRef]
  26. Zhang, X.; Hu, W.; Yang, F. Detection of cause-effect relations based on information granulation and transfer entropy. Entropy 2022, 24, 212. [Google Scholar] [CrossRef]
  27. Wibral, M.; Pampu, N.; Priesemann, V.; Siebenhühner, F.; Seiwert, H.; Lindner, M.; Lizier, J.T.; Vicente, R.; Hayasaka, S. Measuring information-transfer delays. PLoS ONE 2013, 8, e55809. [Google Scholar] [CrossRef] [PubMed]
  28. Faes, L.; Marinazzo, D.; Montalto, A. Lag-specific transfer entropy as a tool to assess cardiovascular and cardiorespiratory information transfer. IEEE Trans. Biomed. Eng. 2014, 61, 2556–2568. [Google Scholar] [CrossRef] [PubMed]
  29. Bauer, M.; Cox, J.W.; Caveness, M.H. Finding the Direction of Disturbance Propagation in a Chemical Process Using Transfer Entropy. IEEE Trans. Control Syst. Technol. 2007, 15, 12–21. [Google Scholar] [CrossRef]
  30. Silverman, B.W. Density Estimation for Statistics and Data Analysi; Routledge: New York, NY, USA, 2018. [Google Scholar]
  31. Kraskov, A.; Stögbauer, H.; Grassberger, P. Estimating mutual information. Phys. Rev. E 2004, 69, 066138. [Google Scholar] [CrossRef]
  32. Quiroga, R.Q.; Kraskov, A.; Kreuz, T. Performance of different synchronization measures in real data: A case study on electroencephalographic signals. Phys. Rev. E 2002, 65, 041903. [Google Scholar] [CrossRef]
  33. Papana, A.; Papana, D.A.; Siggiridou, E. Shortcomings of transfer entropy and partial transfer entropy: Extending them to escape the curse of dimensionality. Int. J. Bifurc. Chaos 2020, 30, 205–250. [Google Scholar] [CrossRef]
  34. Ragwitz, M.; Kantz, H. Markov models from data by simple nonlinear time series predictors in delay embedding spaces. Phys. Rev. E Stat. Nonlin Soft Matter Phys. 2002, 65, 056201. [Google Scholar] [CrossRef]
  35. Bathelt, A.; Ricker, N.L.; Jelali, M. Revision of the Tennessee Eastman Process Model. IFAC-PapersOnLine 2015, 48, 309–314. [Google Scholar] [CrossRef]
  36. Downs, J.J.; Vogel, F.E. A plant-wide industrial process control problem. Comput. Chem. Eng. 1993, 17, 245–255. [Google Scholar] [CrossRef]
  37. Kuang, T.H.; Yan, Z.; Yao, Y. Multivariate fault isolation via variable selection in discriminant analysis. J. Process Control 2015, 35, 30–40. [Google Scholar] [CrossRef]
  38. Koujok, M.; Ragab, A.; Ghezzaz, H. A multiagent-based methodology for known and novel faults diagnosis in industrial processes. IEEE Trans. Ind. Inform. 2020, 17, 3358–3366. [Google Scholar] [CrossRef]
  39. Ruiz-Cárcel, C.; Cao, Y.; Mba, D. Statistical process monitoring of a multi-phase flow facility. Control. Eng. Pract. 2015, 42, 74–88. [Google Scholar] [CrossRef]
  40. Jansen, F.E.; Shoham, O.; Taitel, Y. The elimination of severe slugging—Experiments and modeling. Int. J. Multi-Phase Flow. 1996, 22, 1055–1072. [Google Scholar] [CrossRef]
  41. Tan, R.M.; Cao, Y. Multi-layer contribution propagation analysis for fault diagnosis. Int. J. Autom. Comput. 2019, 16, 40–51. [Google Scholar] [CrossRef]
  42. Pan, D.; Jiang, Z.; Chen, Z.; Gui, W.; Xie, Y.; Yang, C. Temperature measurement and compensation method of blast furnace molten iron based on infrared computer vision. IEEE Trans. Instrum. Meas. 2018, 68, 3576–3588. [Google Scholar] [CrossRef]
  43. Zhang, S.; Jiang, D.; Wang, Z.; Wang, F.; Zhang, J.; Zong, Y.; Zeng, S. Predictive modeling of the hot metal sulfur content in a blast furnace based on machine learning. Metals 2023, 13, 288. [Google Scholar] [CrossRef]
  44. Yan, Z.; Yao, Y. Variable selection method for fault isolation using least absolute shrinkage and selection operator (LASSO). Chemom. Intell. Lab. Syst. 2015, 146, 136–146. [Google Scholar] [CrossRef]
Figure 1. The flowchart of the LSTE-based RCD procedure.
Figure 1. The flowchart of the LSTE-based RCD procedure.
Sensors 25 03980 g001
Figure 2. Trajectories of the simulated process variables.
Figure 2. Trajectories of the simulated process variables.
Sensors 25 03980 g002
Figure 3. Causality diagrams for disturbance root diagnosis using (a) TE and (b) PTE in the numerical simulation.
Figure 3. Causality diagrams for disturbance root diagnosis using (a) TE and (b) PTE in the numerical simulation.
Sensors 25 03980 g003
Figure 4. Diagnosis results of disturbance root in numerical simulation system (LSTE): (a) causality diagram and (b) propagation path.
Figure 4. Diagnosis results of disturbance root in numerical simulation system (LSTE): (a) causality diagram and (b) propagation path.
Sensors 25 03980 g004
Figure 5. The change track of some variables (IDV5): (a) variable X 11 (temperature), (b) variable X 16 (flow), (c) variable X 20 (temperature), and (d) variable X 52 (flow).
Figure 5. The change track of some variables (IDV5): (a) variable X 11 (temperature), (b) variable X 16 (flow), (c) variable X 20 (temperature), and (d) variable X 52 (flow).
Sensors 25 03980 g005
Figure 6. Diagnosis results of IDV5: (a) TE and (b) PTE.
Figure 6. Diagnosis results of IDV5: (a) TE and (b) PTE.
Sensors 25 03980 g006
Figure 7. Causality diagram of IDV5 (LSTE).
Figure 7. Causality diagram of IDV5 (LSTE).
Sensors 25 03980 g007
Figure 8. Propagation path of IDV5 (LSTE).
Figure 8. Propagation path of IDV5 (LSTE).
Sensors 25 03980 g008
Figure 9. Change track of some variables (IDV8): (a) variable X 1 (feed amount), (b) variable X 4 (feed amount), (c) variable X 7 (pressure), and (d) variable X 45 (feed amount).
Figure 9. Change track of some variables (IDV8): (a) variable X 1 (feed amount), (b) variable X 4 (feed amount), (c) variable X 7 (pressure), and (d) variable X 45 (feed amount).
Sensors 25 03980 g009
Figure 10. Diagnosis results of IDV8: (a) TE and (b) PTE.
Figure 10. Diagnosis results of IDV8: (a) TE and (b) PTE.
Sensors 25 03980 g010
Figure 11. Causality diagram of IDV8 (LSTE).
Figure 11. Causality diagram of IDV8 (LSTE).
Sensors 25 03980 g011
Figure 12. Propagation path of IDV8 (LSTE).
Figure 12. Propagation path of IDV8 (LSTE).
Sensors 25 03980 g012
Figure 13. Trajectories of selected variables under Disturbance 5: (a) X 2 , (b) X 3 , (c) X 6 , (d) X 10 , and (e) X 13 . .
Figure 13. Trajectories of selected variables under Disturbance 5: (a) X 2 , (b) X 3 , (c) X 6 , (d) X 10 , and (e) X 13 . .
Sensors 25 03980 g013
Figure 14. Diagnosis results of Disturbance 5: (a) TE and (b) PTE.
Figure 14. Diagnosis results of Disturbance 5: (a) TE and (b) PTE.
Sensors 25 03980 g014
Figure 15. Causality diagram of Disturbance 5 (LSTE).
Figure 15. Causality diagram of Disturbance 5 (LSTE).
Sensors 25 03980 g015
Figure 16. Propagation path of Disturbance 5 (LSTE).
Figure 16. Propagation path of Disturbance 5 (LSTE).
Sensors 25 03980 g016
Figure 17. Diagnosis results of BH PT.
Figure 17. Diagnosis results of BH PT.
Sensors 25 03980 g017
Figure 18. Diagnosis results of BT PT.
Figure 18. Diagnosis results of BT PT.
Sensors 25 03980 g018
Figure 19. Diagnosis results of PCR PT.
Figure 19. Diagnosis results of PCR PT.
Sensors 25 03980 g019
Table 1. Performance comparison of different algorithms.
Table 1. Performance comparison of different algorithms.
AccuracySensitivitySpecificityF1 ScoreRoot Cause
TE0.840.641.000.78Yes
PTE0.880.701.000.82Yes
LSTE1.001.001.001.00Yes
Table 2. L S T E X i X j values and significance between simulation system variables. (The bold fonts in the table indicate causal values that pass the significance test).
Table 2. L S T E X i X j values and significance between simulation system variables. (The bold fonts in the table indicate causal values that pass the significance test).
To From X 1 X 2 X 3 X 4 X 5
To
X 1 00.0009 (0.213)0.0013 (0.154)0.0021 (0.173)0.0023 (0.324)
X 2 0.407 (0.016)00.001 (0.227)0.007 (0.632)0.002 (0.542)
X 3 0.121 (0.022)0.038 (0.367)00.067 (0.004)0.081(0.617)
X 4 0.107 (0.005)0.152 (0.331)0.003 (0.514)00.321 (0.024)
X 5 0.136 (0.604)0.226 (0.017)0.004 (0.324)0.096 (0.041)0
Table 3. Results of LSTE robustness testing.
Table 3. Results of LSTE robustness testing.
AccuracySensitivitySpecificityF1 ScoreRoot Cause
−10 dB0.680.45450.85710.5556Yes
−5 dB0.600.36360.78570.4444No
5 dB0.640.40.80.4706No
10 dB0.640.41670.84620.5263No
Table 4. Causal strength between IDV5-related variables (LSTE).
Table 4. Causal strength between IDV5-related variables (LSTE).
From X 7 X 11 X 16 X 19 X 20 X 22 X 50 X 52
To
X 7 0
0.061
(0.4832)
0.125
(0.3743)
0.123
(0.5314)
0.135
(0.4251)
0.032
(0.3241)
0.111
(0.2148)
0.007
(0.0081)
X 11 0.161
(0.0032)
00.129
(0.4126)
0.050
(0.6143)
0.106
(0.6214)
0.092
(0.0062)
0.046
(0.4263)
0.017
(0.0072)
X 16 0.171
(0.0067)
0.072
(0.3284)
00.121
(0.3281)
0.139
(0.0071)
0.039
(0.5126)
0.109
(0.6327)
0.006
(0.4237)
X 19 0.150
(0.3625)
0.068
(0.6482)
0.142
(0.3926)
00.134
(0.0852)
0.008
(0.4571)
0.169
(0.0063)
−0.001
(0.3247)
X 20 0.146
(0.6236)
0.092
(0.0041)
0.139
(0.6128)
0.115
(0.2651)
00.041
(0.0071)
0.116
(0.4351)
−0.003
(0.2853)
X 22 0.063
(0.2317)
0.087
(0.5132)
0.077
(0.3625)
0.043
(0.3184)
0.054
(0.4122)
00.043
(0.3418)
0.026
(0.0073)
X 50 0.148
(0.1436)
0.066
(0.1326)
0.153
(0.0036)
0.112
(0.1627)
0.130
(0.3124)
0.008
(0.3589)
00.006
(0.4827)
X 52 0.015
(0.2436)
0.033
(0.2135)
0.017
(0.2953)
0.015
(0.3846)
0.009
(0.5246)
0.021
(0.6251)
0.016
(0.4126)
0
Table 5. Causal strength matrix for IDV8 (LSTE).
Table 5. Causal strength matrix for IDV8 (LSTE).
From X 1 X 4 X 7 X 13 X 16 X 20 X 21 X 45 X 46
To
X 1 00.036
(0.6214)
0.042
(0.8412)
0.039
(7243)
0.042
(0.4813)
0.056
(0.0051)
0.039
(0.3177)
0.007
(0.3625)
0.042
(0.5134)
X 4 0.051
(0.1463)
00.114
(0.3146)
0.111
(0.4381)
0.117
(0.2546)
0.060
(0.3244)
0.067
(0.3242)
0.068
(0.0041)
0.095
(0.4623)
X 7 0.071
(0.2641)
0.151
(0.0072)
00.182
(0.6239)
0.189
(0.3581)
0.099
(0.3471)
0.058
(0.5132)
0.096
(0.6423)
0.116
(0.6231)
X 13 0.074
(0.5162)
0.162
(0.0016)
0.189
(0.2314)
00.194
(0.2163)
0.103
(0.2534)
0.062
(0.4326)
0.094
(0.0072)
0.121
(0.7122)
X 16 0.079
(0.4653)
0.115
(0.0324)
0.131
(0.3812)
0.132
(0.6124)
00.091
(0.3152)
0.056
(0.3421)
0.078
(0.0042)
0.099
(0.3251)
X 20 0.064
(0.6438)
0.070
(0.6312)
0.115
(0.2147)
0.114
(0.4231)
0.122
(0.2731)
00.108
(0.0126)
0.031
(0.4631)
0.118
(0.6211)
X 21 0.039
(0.3512)
0.097
(0.1843)
0.084
(0.1762)
0.083
(0.3621)
0.075
(0.7211)
0.078
(0.6427)
00.045
(0.4352)
0.079
(0.0041)
X 45 0.013
(0.2315)
0.074
(0.0037)
0.061
(0.0832)
0.062
(0.2573)
0.045
(0.2372)
0.015
(0.2144)
0.027
(0.5231)
00.031
(0.3214)
X 46 0.061
(0.3415)
0.094
(0.5236)
0.139
(0.0483)
0.137
(0.0037)
0.142
(0.0041)
0.139
(0.0034)
0.133
(0.4326)
0.056
(0.0034)
0
Table 6. Causal strength matrix for Disturbance 5 (LSTE).
Table 6. Causal strength matrix for Disturbance 5 (LSTE).
From X 1 X 4 X 7 X 13 X 16
To
X 1 00.163
(0.4326)
0.032
(0.3251)
0.037
(0.0023)
0.053
(0.3214)
X 4 0.141
(0.2341)
00.053
(0.4312)
0.113
(0.0041)
0.178
(0.0057)
X 7 0.115
(0.4232)
0.194
(0.3743)
00.183
(0.0062)
0.089
(0.4951)
X 13 0.067
(0.3411)
0.076
(0.6245)
0.076
(0.4823)
00.074
(0.2637)
X 16 0.084
(0.6234)
0.015
(0.4621)
0.085
(0.7231)
0.072
(0.0214)
0
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chen, R.; Liang, S.; Wang, J.-G.; Yao, Y.; Su, J.-R.; Liu, L.-L. Lag-Specific Transfer Entropy for Root Cause Diagnosis and Delay Estimation in Industrial Sensor Networks. Sensors 2025, 25, 3980. https://doi.org/10.3390/s25133980

AMA Style

Chen R, Liang S, Wang J-G, Yao Y, Su J-R, Liu L-L. Lag-Specific Transfer Entropy for Root Cause Diagnosis and Delay Estimation in Industrial Sensor Networks. Sensors. 2025; 25(13):3980. https://doi.org/10.3390/s25133980

Chicago/Turabian Style

Chen, Rui, Shu Liang, Jian-Guo Wang, Yuan Yao, Jing-Ru Su, and Li-Lan Liu. 2025. "Lag-Specific Transfer Entropy for Root Cause Diagnosis and Delay Estimation in Industrial Sensor Networks" Sensors 25, no. 13: 3980. https://doi.org/10.3390/s25133980

APA Style

Chen, R., Liang, S., Wang, J.-G., Yao, Y., Su, J.-R., & Liu, L.-L. (2025). Lag-Specific Transfer Entropy for Root Cause Diagnosis and Delay Estimation in Industrial Sensor Networks. Sensors, 25(13), 3980. https://doi.org/10.3390/s25133980

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop