Next Article in Journal
Recent Developments in Inertial and Centrifugal Microfluidic Systems along with the Involved Forces for Cancer Cell Separation: A Review
Next Article in Special Issue
Condition Monitoring of Wind Turbine Systems by Explainable Artificial Intelligence Techniques
Previous Article in Journal
XRecon: An Explainbale IoT Reconnaissance Attack Detection System Based on Ensemble Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Attention Recurrent Neural Network-Based Severity Estimation Method for Early-Stage Fault Diagnosis in Robot Harness Cable

Department of Electrical Engineering, Pohang University of Science and Technology, Pohang 37673, Republic of Korea
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(11), 5299; https://doi.org/10.3390/s23115299
Submission received: 20 April 2023 / Revised: 26 May 2023 / Accepted: 1 June 2023 / Published: 2 June 2023
(This article belongs to the Special Issue AI-Assisted Condition Monitoring and Fault Diagnosis)

Abstract

:
Cable is crucial to the control and instrumentation of machines and facilities. Therefore, early diagnosis of cable faults is the most effective approach to prevent system downtime and maximize productivity. We focused on a “soft fault state”, which is a transient state that eventually becomes a permanent fault —open-circuit and short-circuit. However, the issue of soft fault diagnosis has not been considered enough in previous research, which could not provide crucial information, such as fault severity, to support maintenance. In this study, we focused on solving soft fault problem by estimating fault severity to diagnose early-stage faults. The proposed diagnosis method comprised a novelty detection and severity estimation network. The novelty detection part is specially designed to deal with varying operating conditions of industrial applications. First, an autoencoder calculates anomaly scores to detect faults using three-phase currents. If a fault is detected, a fault severity estimation network, wherein long short-term memory and attention mechanisms are integrated, estimates the fault severity based on the time-dependent information of the input. Accordingly, no additional equipment, such as voltage sensors and signal generators, is required. The conducted experiments demonstrated that the proposed method successfully distinguishes seven different soft fault degrees.

1. Introduction

Cable is widely utilized because it is a crucial part of control and instrumentation in industrial fields, including power plants [1,2], vehicles [3], ship building [4], and factory automation [5]. To maintain the stability and reliability of the system operations, timely diagnosis of cable fault is vital. In particular, the early diagnosis of faults can ensure the maximization of productivity by reducing unwanted system downtime in fully automated processes. A single fault in an automated process can stop the related processes because the process controllers are interlocked with each other to prevent harmful effects to other facilities and dangerous hazards to workers when a fault is detected.
There are two states of cable faults: transient and permanent. The latter represents a permanent fault that results in the failure of machines and facilities without exception. This fault consists of open and short circuits and is referred to as a hard fault. The former is a transient state, which develops according to the external conditions, thereby resulting in the accumulation of small modifications in the cable. Because of harsh operating environments, the components of the cable, which include insulators, shields, and conductors, may experience partial damage. Therefore, this is referred to as a soft fault [6]. In reality, a soft fault is not an acute fault state and does not cause significant problems to machines and facilities at that moment. However, there is a high probability of it transforming into a hard fault, which deteriorates the operation of machines and facilities, i.e., causes unwanted system outage. In practical cases, the accumulation of damage to a limit close to a hard fault can yield intermittent symptoms or show no symptoms. The case of no symptoms is problematic because the latent faults cannot be detected through system diagnosis or identified by the maintenance staff. Thus, subsequent partial damage can accumulate in the cable if there is no maintenance. Consequently, soft faults often become hard faults. Therefore, early and accurate diagnosis of soft faults before they become uncontrollable is the most effective approach to deal with practical cable problems in the field.
Traditional cable diagnosis methods are largely categorized into electrical methods (partial discharge), chemical methods (oxidation induction time), and mechanical methods (elongation at break). Despite its wide usage in practice, these methods have limited applicability in on-site field applications when the machine is working because the online diagnostic ability is lacking or too sensitive to operating noise [1]. Moreover, access to the installed cable is largely limited in automated factories; thus, applying traditional techniques is not preferred in field conditions.
Recently, machine learning-based methods, including convolutional neural networks (CNN) and recurrent neural networks (RNN), have been studied in relation to fault diagnosis. These methods can automatically extract features from the input signal, which overcomes the problem of manual feature extraction requiring domain knowledge and being time consuming, particularly when a large amount of data are to be processed. Machine learning-based diagnosis methods can be categorized into two types: those that utilize the reference signal, which is to be injected into cables, and those that utilize the output signals from operating cables, such as the current signals flowing through the cable. Many studies have reported remarkable results in diagnosing faults using a reference signal. A regression-based multilayer perceptron method with clustering algorithms was developed to detect and classify hard faults of a multicore cable by analyzing the reflected signal of the reference signal in [7]. In [8], the reflected signals were converted into combined time-frequency images using Wigner–Ville distribution. Subsequently, the images were classified using a convolutional neural network (CNN). A 1D-CNN based diagnosis method was applied to diagnose soft faults in control cables of electric motors [9]. Although methods using reference signals have shown remarkable results, the reflected signal compensation and environment noise cancelation must be conducted prior to the diagnosis of faults. Additionally, there are physical limitations related to the irregular responsibility of propagating reference signals when they encounter fault locations [6]. Furthermore, additional equipment must be prepared to conduct the diagnosis owing to the requirement of a signal-injecting device and a signal generator. Several studies have used signals from operating cables to diagnose faults. In [10], a fast fault-detection method for a power transmission line was developed using the summation of the squared three-phase currents. In [11], a novelty detection-based diagnosis method was introduced using an adversarial autoencoder and an anomaly scoring technique with three-phase current signals. The method is based on the concept that the data samples with high anomaly scores can be considered as faults [12,13,14,15,16,17,18]. The utilization of current signals for diagnosing faults is relatively reliable under environmental noise while also being cost effective, as the need to install additional equipment is eliminated. Although these methods have exhibited high accuracy in diagnosing cables, studies that focus on diagnosing the early stage of a fault—that is, a soft fault—are scarce. Moreover, fault severity estimation has not been studied in this regard. Such estimation results can provide informative guidelines when considering cable maintenance strategies in the field.
In the present study, we propose a soft fault diagnosis method that detects the presence of soft faults and estimates the fault severity in a cable using an autoencoder and an attention-based RNN. To the best of our knowledge, this is the first study to attempt to estimate soft fault severity in practical cable application using only current signals without any special equipment. First, the autoencoder network detects the novelty and calculates the anomaly score of the time-series input from the current signals. Subsequently, we construct an estimation algorithm based on a long short-term memory (LSTM) network to deal with time series data [19]. The estimation network comprises an encoder and a decoder. The decoder focuses on certain hidden states that significantly influence the output by adopting the attention mechanism (AM) [20]. The two networks for novelty detection and fault severity estimation are connected serially. The novelty detection network receives the zero-sequence current (ZSC) and the squared current ratio (SCR) as inputs, and subsequently outputs the anomaly score that directly represents the novelty of the fault, whereas the fault severity estimation network receives ZSC, SCR, and the anomaly score as inputs and generates a fault indicator, which directly indicates the fault severity. Several experiments are conducted to verify the reliability of the proposed method, even at various operating points and fault severities. The major advantages of this study over previous methods are as follows.
  • The method could diagnose an early-stage fault in a cable by estimating the soft fault severity before the fault become permanent state; that is, a hard fault.
  • In contrast with reference signal-based methods, in this method, the need to design a reference signal and consider physical cable parameters is eliminated because only three-phase currents are required to conduct diagnosis.
  • The method is reliable under various operating conditions that may result from irregular machine operation as well as various fault conditions that range from mild to severe.
The remainder of this paper is organized as follows. In Section 2, a soft fault and its effect on cables is described. In Section 3, the novelty detection and severity estimation method is proposed. In Section 4, the proposed method is demonstrated based on various experimental scenarios. Finally, Section 5 summarizes the study.

2. Soft Fault in Cable

Soft faults occur because of sequential stress from harsh environments. Local modifications can be made to parts of cables, such as conductors, insulators, and shields [6]. Among them, modifications or damage to the conductor can directly affect the health state of the cable. A damaged cable is presented in Figure 1. The cross-sectional area of the conductor is reduced because of the damage, as shown in the figure. Here, S o denotes the cross-sectional area of a healthy conductor, and S f denotes the cross-sectional area of a damaged conductor.
To analyze the soft faults in the cable, an equivalent circuit model is presented in Figure 2. It is assumed that a soft fault occurs in phase a wire. As shown in figure, the soft fault is represented as an added resistance to the phase a wire. The resistance R f denotes the induced damage in the conductor because of the fact that R f and S f are inversely correlated. Further, R f , S f , and their relation to the normal condition can be expressed as follows:
S f S o = α
R o = ρ l S o
R f = ρ l S f
R f = ρ l α S o = 1 α R o
where S o is the normal cross-sectional area of the healthy conductor. R o denotes the resistance of the healthy conductor and ρ is the resistivity of the conducting material. The length of the conductor is denoted by l. α indicates the ratio of S f to S o . The reduced area S f can result in a phase imbalance in the current magnitude and negative effects, including heating and energy decrease in the system [21]. Further, an imbalance in the phase impedance could result in asymmetry of the three-phase system. For healthy and soft faulty cables, the value of α is one and less than one, respectively. Mainly soft faults are discussed in this study; therefore, hard fault cases including α = 0 (open-circuit) and α > 1 (short-circuit) were not addressed in the proposed method. According to the relation in (4), α directly provides information on the state of the conductor. Therefore, the fault indicator (FI) can be defined as
FI = 1 α
In Figure 2, Z c is the characteristic impedance of normal wire. C i and R i in parallel denote the insulator, because the insulation layer can be represented by its capacitive and conductive characteristics [22]. i r e s is the leakage current, which is typically smaller than i c a p in healthy wires. In case of the presence of faults in a wire, R f increases and R i decreases because the conductor and insulator are damaged. Consequently, i r e s increases due to the changed values of R f and R i according to the fault. In this case, the vector sum of the three-phase currents ( i a , i b , i c —three sine waves separated by 120 degrees) will have a nonzero value owing to the leakage current. Therefore, the sum—that is, the ZSC—can be used as an input for the proposed network:
i a ( t ) = I m a c o s ( ω t + ϕ a )
i b ( t ) = I m b c o s ( ω t + ϕ b 120 )
i c ( t ) = I m c c o s ( ω t + ϕ c + 120 ) ,
i Z S = i a + i b + i c
where i Z S is the ZSC of the input currents. The amplitudes of each current are represented as I m a , I m b , and I m c . Its corresponding phase angles are represented as ϕ a , ϕ b , and ϕ c . The magnitude of i Z S is approximately zero or stable for healthy wires, whereas it fluctuates significantly when there is asymmetry in the phase wires. In case of a severe fault, the asymmetry worsens. Moreover, the magnitudes of the current of each phase differ from those of the normal condition because of the asymmetry in the three-phase system. Consequently, the ratio of each phase current to the total current immediately indicates an asymmetry in the system, as follows:
SSC = j i j 2
SCR j = i j 2 / SSC
where j denotes the phase a, b, and c. Each phase’s SCR is defined as each squared phase current divided by the sum of squared phase currents (SSC) from all the phases. The SCR can be used for a comparison of the phase current with the total current. Therefore, it reflects a faulty three-phase network with R f and can be used as an input for the proposed network.
The utilization of current signals originating from the operating machine with irregular motion is challenging because the amplitude, frequency, and phase sequence vary according to motion planning, as shown in Figure 3. For instance, an industrial robot installed in the production process can move its arm to perform the given motion commands, which allows the robot joint to rotate in the forward direction after rotating in the reverse direction. Even in this case, SCR and ZSC are not affected by the varying operating conditions because no phase rotation operator is involved, as shown in Figure 4. In the figure, SCRs and ZSC are stable when cable is healthy with the robot moving as mentioned above. Fluctuations appeared when varying degrees of fault were induced to the robot control cable. Still, we could not estimate the fault severity to diagnose a soft fault. The proposed diagnosis system in this paper will calculate an anomaly score of each SCR and ZSC and estimate fault severity to provide a guide for a proper maintenance plan. The analysis thus far assures that soft faults can be directly diagnosed by utilizing the ZSC and SCR.

3. Soft Fault Diagnosis System Structure

RNNs can effectively utilize the time series data because they have the ability to consider the time-dependent information of the time series input. In this section, we propose an attention-based RNN with an autoencoder network. The structure of the proposed network comprises two parts: anomaly detection and severity estimation. In the anomaly detection network, the encoder reduces the dimensions of the input data to generate latent code, and the decoder reconstructs the input as an output to compare the input and output, whereas, in the severity estimation network, an LSTM-based RNN structure was adopted to encode the input into the feature vector and decode the estimated FI as an output. An AM was integrated into the decoder to automatically select the related hidden states through all time steps. Figure 5 presents the graphical presentation of the proposed algorithm.

3.1. Anomaly Scoring with Autoencoder

An autoencoder can be constructed using an encoder and a decoder. The input dimension is reduced by the encoder, whereas the decoder reconstructs the input by using the learned latent code. Therefore, A = f g can be considered for an autoencoder A, where f denotes the decoder and g denotes the encoder. Let n be the number of hidden layers in f and g where g = g n g 2 g 1 and f = f 1 f 2 f n . The partial computations of f and g for 1 i n can be
g : i = g i g 1
f n : i = f i f n
The conventional anomaly scoring method compares the input and reconstructed data to detect a novel sample. Recently, it has been shown that comparing hidden spaces can generate more accurate anomaly scores [23,24]. This approach also compares the activations in the hidden space with the corresponding reconstructions in that hidden space to calculate the anomaly score. However, a hidden reconstruction cannot be directly computed. Instead, the hidden activations of the reconstructed input g : i ( A ( x ) ) can be used because it has been proven that hidden activations of the reconstructed input g : i ( A ( x ) ) are equivalent to the corresponding hidden reconstructions of the original input ( f n : i + 1 g ) ( x ) [23]. This implies that hidden reconstruction values can be obtained by simply projecting the reconstructed input A ( x ) into the hidden spaces. If the input x and its reconstructed input A ( x ) are provided, their hidden activations are computed as
h i ( x ) = g : i ( x )
h ^ i ( x ) = g : i ( x ^ ) = g : i ( A ( x ) )
To obtain the anomaly score, the normalized aggregation along the pathway ( s N A P ) method was adopted in this study as follows:
s N A P ( x ) = ( d ( x ) μ X ) T V Σ 1 1 2 2
where a column vector d ( x ) = h ( x ) h ^ ( x ) , h ( x ) = c o n c a t [ h 0 ( x ) , , h n ( x ) ] , and h ^ ( x ) = c o n c a t [ h ^ 0 ( x ) ; ; h ^ n ( x ) ] ; h 0 ( x ) = x and h ^ 0 ( x ) = x ^ . X denotes the given training set, D denotes a matrix wherein the ith row matches d ( x i ) for x i X , and D ¯ = U Σ V T must be computed for normalization, where D ¯ denotes the column-wise centered matrix of D . μ x denotes the column-wise mean of D. Consequently, this scoring method allows the evaluation of anomalies in the current signal when a soft fault exists.

3.2. Fault Severity Estimation with Attention Mechanism

The fault severity estimation part comprises encoder and decoder LSTMs with an AM. The encoder generates a hidden state h t that summarizes the information up to the current time step t. This can be represented as follows:
h t = f ( h t 1 , x t )
where h t 1 is the output of the previous LSTM unit, x t is the current input, and f denotes the activation function, which is the LSTM [25]. LSTM can handle the time features of time-series data. Further, LSTM has memory cells that store, retrieve, and maintain information. It comprises the input gate i t , output gate o t , and forgot gate f t . The abandoned information is controlled by the forgot gate f t as follows:
f t = σ ( W f c o n c a t [ h t 1 , x t ] + b f )
where σ is a sigmoid function and W f and b f are the weight and bias parameters, respectively. The updating information is controlled by the input gate i t , which can be represented by
i t = σ ( W i c o n c a t [ h t 1 , x t ] + b i )
where W i is the weight parameter of the input gate and b i is the offset term. Further, the long-term state is denoted by s t and o t is the output gate. These can be expressed as follows:.
o t = σ ( W o c o n c a t [ h t 1 , x t ] + b o )
s t = f t s t 1 + i t tanh ( W s c o n c a t [ h t 1 , x t ] + b s )
where W o is the weight parameter of the output gate and b o is the offset term. Further, W s is the weight parameter of the state and b s is the bias parameter. The output h t of the LSTM cell can be represented as
h t = o t tanh ( s t )
where ⊙ denotes the Hadamard product. Hidden states h t are created across all time steps to summarize time-dependent information.
The encoded input information was decoded by the decoder network to generate the estimated output y ^ T . LSTM is integrated into the decoder to estimate the output from time dependencies. Moreover, an AM is also integrated into the network to automatically select the important encoded hidden states through time steps. AM strengthens the influence of important and relevant information by focusing on output variables with a significant impact and ignoring uninterested ones. The attention weight can be computed as follows:
e t k = v d T tanh ( W d c o n c a t [ d t 1 , s t 1 ] + U d h k )
α t k = exp ( e t k ) i = 1 T exp ( e t i ) , 1 k T
where v d and W d are the weighting coefficients and U d denotes the bias coefficient. The attention weights α t k , which are obtained by normalizing the weights e t k using the softmax function, represent the importance of each hidden state from the network. The context vector c t can be denoted by
c t = i = 1 T α t i h i
This is provided to the decoder as input, and the hidden state of the decoder can be written as
d t = f ( d t 1 , c t 1 )
d t denotes the decoder hidden state at time step t, and f is a nonlinear activation function, which is the LSTM. The hidden state d t can be updated as explained previously in the encoder. Thus, the fault severity output y ^ T can be written as
y ^ T = F ( x 1 , x 2 , , x T ) = v y T ( W y c o n c a t [ d T , c T ] + b y ) + b v
where F denotes the approximate function for estimating fault severity from the given input vectors X = ( x 1 , x 2 , , x T ) , and W y and b y are the weight matrix and bias terms, respectively. Consequently, the fault severity can be estimated by a linear function, where v y T and b v are the weight and bias, respectively.

3.3. Training Procedure

A novelty detection and fault severity estimation network was constructed using the Tensoflow framework [26]. The Adam optimizer [27] was used to train the model, and the sizes of the mini-batches were 128 and 20 for the novelty detection and fault severity estimation networks, respectively. Further, the sizes of the hidden states were 30 and 128 for the novelty detection and fault severity estimation networks, respectively. The time length T of the time-series input was 12. In addition, the l 2 loss function was used for the standard back propagation, and the objective functions for the two networks are as follows:
l 2 ( x , x ^ ) = 1 N i = 1 N ( x ^ i x i ) 2
l 2 ( y T , y ^ T ) = 1 M j = 1 M ( y ^ T j y T j ) 2

3.4. Structure of Diagnosis System

The structure of the diagnostic system is shown in Figure 6. It comprises signal processing, anomaly assessing, and fault severity estimation components. The data sample from the time-series input comprises SCR, ZSC, and s N A P , where the size of the input sample was a window of 9000 time steps. When computing SCR, ZSC, and s N A P using (11), (9), and (16), respectively, the raw input data were passed through a low-pass filter to remove unnecessary frequency components. The calculated fault indicator was used as the label of the network.

4. Experimental Results

4.1. Experimental Setup

The experimental setup is illustrated in Figure 7. A HYUNDAI HH7 robot manipulator and its controller were installed to demonstrate the proposed method. The cable harness comprised control and signal cables, with the control cable targeted for conducting the fault diagnosis. The detailed characteristics of the target cable are represented in Table 1. The cable consisted of 32 wires, each of which consisted of an insulator and conductor. Further, each conductor was composed of 30 flexible strands, each measuring 0.25 mm in diameter. Further, a Tektronix DPO 4104 B phosphor oscilloscope was used to measure current signals at a sampling rate of 100 kHz. We simulated various faults and operating conditions in the third joint of the robot manipulator.

4.2. Experimental Scenarios

To simulate the fault conditions, soft faults were created manually in the wire of phase a, as shown in Figure 1. Artificial faults exhibit a range of fault severities, from mild to severe. The fault severity and corresponding scenarios are listed in Table 2. The datasets according to each fault severity were acquired as follows. First, a normal cable was damaged repeatedly according to the damage cases. There are eight cases according to the fault severity in the table. For example, 28 cutting is the most severe fault case, whose α value is small, and 93.4% of S o is damaged. However, the four cuts are mild faults, whose α value is large, and 13.4% of S o is damaged. Moreover, the experiments were conducted under actual operating conditions wherein the manipulator moved up and down according to the motion commands, as shown in Figure 7. In the figure, the robot joint rotated inversely following forward rotation. Consequently, the speed, rotational direction, and amplitude of the three-phase currents varied according to the robot movement, as shown in Figure 3. As mentioned previously, eight scenarios and acquired datasets were prepared to conduct experiments under these varying conditions.

4.3. Result and Analysis

The test results for the scenarios demonstrate that the proposed method can effectively diagnose soft faults. First, the autoencoder successfully detected the abnormal state and calculated anomaly scores, as shown in Figure 8. The results confirmed the suitability of the time-series input—that is, ZSC and SCR—for soft fault diagnosis by reflecting the power network imbalance. Second, the fault severities of the induced damages were correctly estimated by the attention-based RNN architecture, as shown in Figure 9. The result confirms that the RNN inputs—that is, ZSC, SCR, and s N A P —are appropriate for estimating the fault severity of a particular fault. As shown in Figure 9 ( S f = 100.0%), the FI for healthy cable was approximately zero for varying operating conditions, such as speed, amplitude, and phase. The FI increased as the severity increased according to Scenario 7, as shown in Figure 9 ( S f = 6.6%). Further, the faulty cable and healthy cable were clearly distinguished by the FI. Thus, it can be concluded that the FI is independent of the varying operating conditions resulting from the robot manipulator movements. Therefore, the proposed method is applicable to practical online diagnosis when automated machines operate in smart factories. Figure 9 ( S f = 86.6%) shows the test result for Scenario 1. The fault condition was the least severe compared to the other scenarios, implying that diagnosing Scenario 1 was more difficult compared to other scenarios. Four strands of the 30 strands were damaged artificially to simulate very early soft fault conditions, where only 13.4% of the cross-sectional area of the conductor was damaged. In this case (early case even among the soft fault cases), the automated machines can work without any fault symptoms. Compared to the magnitude observed in Figure 9 ( S f = 6.6%), the magnitude of the corresponding FI in Figure 9 ( S f = 86.6%) was much smaller. Nevertheless, the early stages of soft faults can be diagnosed using the estimated FI, even under mild fault conditions. The FI estimation results for all scenarios are shown in Figure 9 ( S f = 6.6%∼100.0%). The estimated FI tended to be more accurate for severe fault cases (Scenarios 4 to 7) because the magnitude of the simulated FI was much smaller in less severe scenarios (Scenario 1 to 3). Table 3 confirms this trend by showing mean square errors (MSE) of each scenario. Consequently, we can assert that the proposed method achieves a soft diagnosis capability under various fault and operating conditions, rendering this method applicable to practical problems.

4.4. Comparison with Other Studies

The proposed method was compared to other methods by considering several aspects, as listed in Table 4. Reflectometry-based methods [28,29,30,31] require additional equipment, such as arbitrary waveform generators, voltage sensors, and signal-coupling devices, to conduct the diagnosis. Thus, an extra budget is required to purchase the equipment. Space and accessibility for installing the equipment are also required. Furthermore, expert and cable parameters are required to analyze the returned reference signal, which must also be designed before conducting a diagnosis for each target cable. Moreover, only sstdr [30] among other reflectometry-based methods is capable of diagnosing cable faults in online conditions. The study by [9] overcame this problem by suggesting a method that is applicable to both online and offline diagnosis using a reference burst signal; however, it still requires a signal generator and a signal-coupling device. Several studies have utilized current signals when diagnosing cable faults [10,11], which are preferred over other methods because they do not require extra equipment. However, the study by [10] could not handle the varying conditions wherein the amplitude and phase angles varied according to the movements of automated machines. The study by [11] overcame this problem by adopting a novelty detection approach, even under varying operating conditions. However, the diagnostic purpose of this study was fast fault detection and isolation when an early-stage fault occurs in the cable; thus, severity estimation needs to be supported. The severity estimation capability is important for maintenance staff because they can assess the fault condition and consequently build a proper maintenance plan, such as cable replacement and overhaul. Thus, the fault severity estimation capability of the proposed method is the most significant difference compared to previous methods. Consequently, the comparison results show that the proposed method is an appropriate approach for addressing cable fault problems in industries.

5. Conclusions

This study proposed a new diagnostic approach for cable faults, which is particularly applicable in the field of industrial automation. The diagnosis method comprised a novelty detection and severity estimation network, wherein an attention-based RNN was integrated into the latter network to consider time-dependent information and overcome the long-term dependence problem. RNN is a type of neural network which utilizes sequential data. In this paper, RNN was adopted because the time series data obtained from the cable are sequential and time dependent. The inputs for the novelty detection network were ZSC and SCR, and an anomaly score was generated. The severity estimation network accepted the anomaly score and estimated the fault indicator, which directly represents fault severity. The proposed method is cost effective and saves space because it does not require additional equipment to conduct the diagnosis. Moreover, cable parameters and expert knowledge are not required. Furthermore, the proposed method can provide maintenance staff with a fault severity estimation capability to assess the fault situation. Experiments on an industrial application proved that the new approach works effectively and accurately under various faults and operating conditions. Future studies will focus on intermittent faults in flexible cables for moving applications using an explainable AI approach with a data fusion algorithm.

Author Contributions

Methodology, H.K.; investigation, H.L.; resources, S.K.; supervision, S.W.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by Technology Development Program to Solve Climate Changes through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT (2021M1A2A2043894).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available because it is company confidential information.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chang, S.J.; Park, J.B. Multiple chirp reflectometry for determination of fault direction and localization in live branched network cables. IEEE Trans. Instrum. Meas. 2017, 66, 2606–2614. [Google Scholar] [CrossRef]
  2. Gu, F.-C.; Chang, H.-C.; Chen, F.-H.; Kuo, C.-C. Partial discharge pattern recognition of power cable joints using extension method with fractal feature enhancement. Expert Syst. Appl. 2012, 39, 2804–2812. [Google Scholar] [CrossRef]
  3. Lee, C.K.; Chang, S.J. A Method of Fault Localization Within the Blind Spot Using the Hybridization Between TDR and Wavelet Transform. IEEE Sens. J. 2021, 21, 5102–5110. [Google Scholar] [CrossRef]
  4. Jacob, R.A.; Senemmar, S.; Zhang, J. Fault Diagnostics in Shipboard Power Systems using Graph Neural Networks. In Proceedings of the 2021 IEEE 13th International Symposium on Diagnostics for Electrical Machines, Power Electronics and Drives (SDEMPED), Dallas, TX, USA, 22–25 August 2021; Volume 1, pp. 316–321. [Google Scholar]
  5. Ip, K.H.; Tang, C.P. Electrical Behavior of Flexible Cables With Intermittent Faults. In Electrical Contacts—2006, Proceedings of the 52nd IEEE Holm Conference on Electrical Contacts, Montreal, QC, Canada, 25–27 September 2006; IEEE: Piscataway, NJ, USA, 2006; pp. 63–68. [Google Scholar]
  6. Cozza, A. Never trust a cable bearing echoes: Understanding ambiguities in time-domain reflectometry applied to soft faults in cables. IEEE Trans. Electromagn. Compat. 2018, 61, 586–589. [Google Scholar] [CrossRef]
  7. Lee, C.-K.; Chang, S.J. Fault detection in multi-core C&I cable via machine learning based time-frequency domain reflectometry. Appl. Sci. 2019, 10, 158. [Google Scholar]
  8. Bang, S.S.; Shin, Y.-J. Classification of faults in multicore cable via time–frequency domain reflectometry. IEEE Trans. Ind. Electron. 2019, 67, 4163–4171. [Google Scholar] [CrossRef]
  9. Kim, H.; Jeong, H.; Lee, H.; Kim, S.W. Online and Offline Diagnosis of Motor Power Cables Based on 1D CNN and Periodic Burst Signal Injection. Sensors 2021, 21, 5936. [Google Scholar] [CrossRef]
  10. Jarrahi, M.A.; Samet, H.; Ghanbari, T. Fast current-only based fault detection method in transmission line. IEEE Syst. J. 2018, 13, 1725–1736. [Google Scholar] [CrossRef]
  11. Kim, H.; Lee, H.; Kim, S.W. Current Only-Based Fault Diagnosis Method for Industrial Robot Control Cables. Sensors 2022, 22, 1917. [Google Scholar] [CrossRef]
  12. Chalapathy, R.; Menon, A.K.; Chawla, S. Anomaly detection using one-class neural networks. arXiv 2019, arXiv:1802.06360. [Google Scholar]
  13. Chandola, V.; Banerjee, A.; Kumar, V. Anomaly Detection: A Survey. ACM Comput. Surv. (CSUR) 2009, 41, 1–58. [Google Scholar] [CrossRef]
  14. Bulusu, S.; Kailkhura, B.; Li, B.; Varshney, P.K.; Song, D. Anomalous Example Detection in Deep Learning: A Survey. IEEE Access 2020, 8, 132330–132347. [Google Scholar] [CrossRef]
  15. Chen, J.; Sathe, S.; Aggarwal, C.; Turaga, D. Outlier detection with autoencoder ensembles. In Proceedings of the 2017 SIAM International Conference on Data Mining, Houston, TX, USA, 27–29 April 2017; pp. 90–98. [Google Scholar]
  16. Liao, W.; Guo, Y.; Chen, X.; Li, P. A unified unsupervised gaussian mixture variational autoencoder for high dimensional outlier detection. In Proceedings of the 2018 IEEE International Conference on Big Data (Big Data), Seattle, WA, USA, 10–13 December 2018; pp. 1208–1217. [Google Scholar]
  17. Zhou, C.; Paffenroth, R.C. Anomaly detection with robust deep autoencoders. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada, 13–17 August 2017; pp. 665–674. [Google Scholar]
  18. Zong, B.; Song, Q.; Min, M.R.; Cheng, W.; Lumezanu, C.; Cho, D.; Chen, H. Deep autoencoding gaussian mixture model for unsupervised anomaly detection. In Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada, 30 April–3 May 2018. [Google Scholar]
  19. Cho, K.; Van Merriënboer, B.; Bahdanau, D.; Bengio, Y. On the properties of neural machine translation: Encoder-decoder approaches. arXiv 2014, arXiv:1409.1259. [Google Scholar]
  20. Bahdanau, D.; Cho, K.; Bengio, Y. Neural machine translation by jointly learning to align and translate. arXiv 2014, arXiv:1409.0473. [Google Scholar]
  21. Montoya-Mira, R.; Diez, J.M.; Blasco, P.A.; Montoya, R. Equivalent circuit and calculation of unbalanced power in three-wire three-phase linear networks. IET Gener. Transm. Distrib. 2018, 12, 1466–1473. [Google Scholar] [CrossRef]
  22. Rahman, M.A.A.; Ghosh, P.S. Diagnosis on MV XLPE power cable by using frequency variance leakage current analysis. In Proceedings of the 2008 International Conference on Condition Monitoring and Diagnosis, Beijing, China, 21–24 April 2008; pp. 1154–1157. [Google Scholar]
  23. Kim, K.H.; Shim, S.; Lim, Y.; Jeon, J.; Choi, J.; Kim, B.; Yoon, A.S. Rapp: Novelty detection with reconstruction along projection pathway. In Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA, 6–9 May 2019. [Google Scholar]
  24. Shin, S.Y.; Kim, H.-j. Extended Autoencoder for Novelty Detection with Reconstruction along Projection Pathway. Appl. Sci. 2020, 10, 4497. [Google Scholar] [CrossRef]
  25. Graves, A.; Schmidhuber, J. Framewise phoneme classification with bidirectional LSTM and other neural network architectures. SAE Int. J. Passeng. Cars-Electron. Electr. Syst. 2005, 18, 602–610. [Google Scholar] [CrossRef]
  26. Abadi, M.; Barham, P.; Chen, J.; Chen, Z.; Davis, A.; Dean, J.; Devin, M.; Ghemawat, S.; Irving, G.; Isard, M. Tensorflow: A system for large-scale machine learning. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), Savannah, GA, USA, 2–4 November 2016; pp. 265–283. [Google Scholar]
  27. Kingma, D.P.; Ba, J. Adam: A method for stochastic optimization. arXiv 2014, arXiv:1412.6980. [Google Scholar]
  28. Ohki, Y.; Hirai, N. Detection of abnormality occurring over the whole cable length by frequency domain reflectometry. IEEE Trans. Dielectr. Electr. Insul. 2018, 25, 2467–2469. [Google Scholar] [CrossRef]
  29. Shi, Q.; Kanoun, O. A new algorithm for wire fault location using time-domain reflectometry. IEEE Sens. J. 2013, 14, 1171–1178. [Google Scholar] [CrossRef]
  30. Shi, X.; Liu, Y.; Xu, X.; Jing, T. Online Detection of Aircraft ARINC Bus Cable Fault Based on SSTDR. IEEE Syst. J. 2021, 15, 2482–2491. [Google Scholar] [CrossRef]
  31. Lee, H.M.; Lee, G.S.; Kwon, G.-Y.; Bang, S.S.; Shin, Y.-J. Industrial Applications of Cable Diagnostics and Monitoring Cables via Time–Frequency Domain Reflectometry. IEEE Sens. J. 2021, 21, 1082–1091. [Google Scholar] [CrossRef]
Figure 1. A cross-sectional view of robot control cable. A wire is composed of a conductor and an insulation layer. Damage can be induced to the wire due to harsh environment, resulting in machinery failure.
Figure 1. A cross-sectional view of robot control cable. A wire is composed of a conductor and an insulation layer. Damage can be induced to the wire due to harsh environment, resulting in machinery failure.
Sensors 23 05299 g001
Figure 2. Equivalent circuit model: a three-phase control cable with a soft fault and a motor of the robot joint. A soft fault is induced in phase a. Z c is the characteristic impedance of the wire. C i and R i in parallel represent the insulator. i r e s and i c a p are the leakage current and the current flowing through the capacitance of the insulator C i , respectively. V n is the neutral voltage of the motor.
Figure 2. Equivalent circuit model: a three-phase control cable with a soft fault and a motor of the robot joint. A soft fault is induced in phase a. Z c is the characteristic impedance of the wire. C i and R i in parallel represent the insulator. i r e s and i c a p are the leakage current and the current flowing through the capacitance of the insulator C i , respectively. V n is the neutral voltage of the motor.
Sensors 23 05299 g002
Figure 3. The plotted line represents the normal variation in instantaneous currents when the robot is moving. Speed, rotational direction, and amplitude varied according to the motion.
Figure 3. The plotted line represents the normal variation in instantaneous currents when the robot is moving. Speed, rotational direction, and amplitude varied according to the motion.
Sensors 23 05299 g003
Figure 4. The calculated SCRs and ZSC under varying robot-moving conditions and fault conditions. SCRs and ZSC started fluctuating when faults were induced to the target cable. ZSC was root-mean-squared prior to being input to the algorithm.
Figure 4. The calculated SCRs and ZSC under varying robot-moving conditions and fault conditions. SCRs and ZSC started fluctuating when faults were induced to the target cable. ZSC was root-mean-squared prior to being input to the algorithm.
Sensors 23 05299 g004
Figure 5. Structure of the proposed network comprising anomaly detection and fault severity estimation. The last LSTM unit of the decoder outputs is y ^ T , which is the fault indicator.
Figure 5. Structure of the proposed network comprising anomaly detection and fault severity estimation. The last LSTM unit of the decoder outputs is y ^ T , which is the fault indicator.
Sensors 23 05299 g005
Figure 6. The industrial robot system with the proposed diagnosis method. It comprises signal processing, anomaly detection, and fault severity estimation components. If the detected fault severity exceeds the threshold limit, a maintenance call is generated for the staff.
Figure 6. The industrial robot system with the proposed diagnosis method. It comprises signal processing, anomaly detection, and fault severity estimation components. If the detected fault severity exceeds the threshold limit, a maintenance call is generated for the staff.
Sensors 23 05299 g006
Figure 7. Experimental setup: The industrial robot test rig with the cable harness and the controller and measure kit. The manipulator moves up and down to vary the operating conditions.
Figure 7. Experimental setup: The industrial robot test rig with the cable harness and the controller and measure kit. The manipulator moves up and down to vary the operating conditions.
Sensors 23 05299 g007
Figure 8. The simulated soft fault severity and the calculated anomaly score for each fault severity. From this anomaly score, we could detect presence of a fault.
Figure 8. The simulated soft fault severity and the calculated anomaly score for each fault severity. From this anomaly score, we could detect presence of a fault.
Sensors 23 05299 g008
Figure 9. The estimated fault severity for each scenario: S f = 100.0%∼6.6% corresponds to scenario 0∼scenario 7, respectively. From this estimated severity, we could diagnose health state of the target cable.
Figure 9. The estimated fault severity for each scenario: S f = 100.0%∼6.6% corresponds to scenario 0∼scenario 7, respectively. From this estimated severity, we could diagnose health state of the target cable.
Sensors 23 05299 g009
Table 1. Specifications of the control cable.
Table 1. Specifications of the control cable.
SubjectsUnitSpecification
Total number of wires in cable-32
Cross-sectional area of a conductormm 2 1.5
Number of strands of a conductor-30
Cross-sectional are of a strandmm 2 0.25
Maximum resistance of a wire Ω /km17.7
Material of insulation layer-PVC
Thickness of insulation layer-0.36
Shield type-Braided
Outer diametermm20.4
Table 2. Experimental scenarios.
Table 2. Experimental scenarios.
ScenariosDamage CasesFI S f in %Number of Dataset
0 (Normal)0 cut0.000100.085,000
14 cut0.13486.685,000
28 cut0.26773.385,000
312 cut0.40060.085,000
416 cut0.53446.685,000
520 cut0.66733.385,000
624 cut0.80020.085,000
728 cut0.9346.685,000
Table 3. MSE of each scenario.
Table 3. MSE of each scenario.
ScenariosDamage CasesFIMSE
0 (Normal)0 cut0.00072.31 × 10 5
14 cut0.13465.66 × 10 5
28 cut0.26742.29 × 10 5
312 cut0.40019.29 × 10 5
416 cut0.5347.17 × 10 5
520 cut0.6671.80 × 10 5
624 cut0.8000.98 × 10 5
728 cut0.9348.85 × 10 5
Table 4. Comparison with other studies.
Table 4. Comparison with other studies.
Utilizing Current Signal
[Proposed Method] [10,11]
Utilizing Injected Reference Signal
[9,28,29,30,31]
Estimation of soft fault severityOXXXXXXO
Online diagnosis under varying conditionsOXOOXXOX
Require reference signal designXXXOOOOO
Require domain knowledge and cable parametersXXXXOOOO
Require waveform generatorXXXOOOOO
For the first two rows, O is better. For the last three rows, X is better.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kim, H.; Lee, H.; Kim, S.; Kim, S.W. Attention Recurrent Neural Network-Based Severity Estimation Method for Early-Stage Fault Diagnosis in Robot Harness Cable. Sensors 2023, 23, 5299. https://doi.org/10.3390/s23115299

AMA Style

Kim H, Lee H, Kim S, Kim SW. Attention Recurrent Neural Network-Based Severity Estimation Method for Early-Stage Fault Diagnosis in Robot Harness Cable. Sensors. 2023; 23(11):5299. https://doi.org/10.3390/s23115299

Chicago/Turabian Style

Kim, Heonkook, Hojin Lee, Seongyun Kim, and Sang Woo Kim. 2023. "Attention Recurrent Neural Network-Based Severity Estimation Method for Early-Stage Fault Diagnosis in Robot Harness Cable" Sensors 23, no. 11: 5299. https://doi.org/10.3390/s23115299

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop