Next Article in Journal
Wearable Sensor-Based Residual Multifeature Fusion Shrinkage Networks for Human Activity Recognition
Next Article in Special Issue
Measurement of Transient Overvoltages by Capacitive Electric Field Sensors
Previous Article in Journal
Electrochemical Sensors Based on Transition Metal Materials for Phenolic Compound Detection
Previous Article in Special Issue
Exploitation Perspective Index as a Support of the Management of the Transformer Fleet
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Voiceprint Fault Diagnosis of Converter Transformer under Load Influence Based on Multi-Strategy Improved Mel-Frequency Spectrum Coefficient and Temporal Convolutional Network

School of Electrical Engineering, Xi’an University of Technology, Xi’an 710048, China
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(3), 757; https://doi.org/10.3390/s24030757
Submission received: 26 December 2023 / Revised: 16 January 2024 / Accepted: 18 January 2024 / Published: 24 January 2024
(This article belongs to the Special Issue Sensors and Fault Diagnostics in Power System)

Abstract

:
In order to address the challenges of low recognition accuracy and the difficulty in effective diagnosis in traditional converter transformer voiceprint fault diagnosis, a novel method is proposed in this article. This approach takes account of the impact of load factors, utilizes a multi-strategy improved Mel-Frequency Spectrum Coefficient (MFCC) for voiceprint signal feature extraction, and combines it with a temporal convolutional network for fault diagnosis. Firstly, it improves the hunter–prey optimizer (HPO) as a parameter optimization algorithm and adopts IHPO combined with variational mode decomposition (VMD) to achieve denoising of voiceprint signals. Secondly, the preprocessed voiceprint signal is combined with Mel filters through the Stockwell transform. To adapt to the stationary characteristics of the voiceprint signal, the processed features undergo further mid-temporal processing, ultimately resulting in the implementation of a multi-strategy improved MFCC for voiceprint signal feature extraction. Simultaneously, load signal segmentation is introduced for the diagnostic intervals, forming a joint feature vector. Finally, by using the Mish activation function to improve the temporal convolutional network, the IHPO-ITCN is proposed to adaptively optimize the size of convolutional kernels and the number of hidden layers and construct a transformer fault diagnosis model. By constructing multiple sets of comparison tests through specific examples and comparing them with the traditional voiceprint diagnostic model, our results show that the model proposed in this paper has a fault recognition accuracy as high as 99%. The recognition accuracy was significantly improved and the training speed also shows superior performance, which can be effectively used in the field of multiple fault diagnosis of converter transformers.

1. Introduction

In order to ensure the secure and reliable operation of converter transformers, which serve as intermediate devices for AC-DC power transmission technology, it is essential to conduct research on fault diagnosis. This research aims to enhance the accuracy and speed of fault identification, helping to promptly detect internal defects and prevent the further escalation of accidents. Unlike regular power transformers, converter transformers operate in a unique AC-DC working environment, which implies a higher level of harmonic currents. Consequently, this complexity in operational characteristics presents challenges in employing conventional fault diagnosis methods designed for traditional power transformers [1,2].
The converter transformer, in the process of operation with the core and windings, produces vibration because of electric power and other factors, and thus mechanical wave propagation through the transformer oil and rigid connection to the box. The resulting vibration and voiceprint signals contain a large amount of state information based on the vibration signal monitoring means that are widely used in the online monitoring of power equipment [3,4]. In the vibration signal acquisition process, the deployment location requirements of sensors are strict. Smaller deviations will interfere with the results. The noise detection method is used as a non-contact measurement; its sensor installation is convenient for solving the problem of high spatial sensitivity. At the same time, the voiceprint signal acquisition device has a wide frequency range to meet the monitoring requirements of different specifications of the transformer [5,6]. Numerous scholars both domestically and internationally have conducted research in this area, achieving promising results. In reference [7], four voiceprint emission feature spectra were constructed, and a lightweight fault diagnosis model was established to diagnose loose winding faults in transformers. Reference [8], based on the no-load operation of transformers, employed MFCC for voiceprint feature extraction, introduced Principal Components Analysis (PCA) to remove redundant features, and ultimately utilized the Vector Quantization (VQ) algorithm for accurate identification of loosened iron core faults. Reference [9] extracted features of on-load tap changers using Mel spectrograms and combined them with convolutional neural networks to recognize mechanical faults. However, the abovementioned voiceprint emission recognition techniques are based on traditional MFCC, which involves a cumbersome process of frame segmentation, windowing, and Fourier transformation to overcome spectral leakage issues. Furthermore, due to the inherent limitations of single-channel signal sources, the practicality of fault diagnosis using voiceprint emission signals is mostly limited to single-fault diagnosis.
To address the issue of the single-fault feature, reference [10] utilized Complete Ensemble Empirical Mode Decomposition (CEEMD) and short-time Fourier transform (STFT) to obtain temporal and spectral information about the signals. Deep fault features were then extracted using a deep fused convolutional neural network (DFCNN). Similarly, reference [11] proposed a mixed algorithm called high-order singular value decomposition (HOSVD)–high-order alternation least square (HOALS) to extract multi-dimensional features for pattern recognition. Furthermore, reference [12] combined the fusion multiscale convolutional neural network (F-MSCNN) to fuse sound and vibration features, leveraging the learning of multi-scale features for subsequent classification. Reference [13] proposed a real-time fault diagnostic method for hydraulic systems using data collected from multiple sensors in order to overcome the lack of information contained in a single sensor. Reference [14] processed signals from multiple sensors, thereby expanding the number of samples to enhance the diagnostic performance. However, most of the existing studies are based on single or homogeneous signals. They focus on extracting multidimensional features from different angles without considering multiple signal sources. The above diagnostic models do not start from different types of signal sources and ignore the correlation between different signals, making it difficult to extract deep information effectively from faults.
Existing approaches on data-driven fault classification mostly rely on artificial intelligence algorithms to analyze historical data and extract fault features, and the selection of parameters during the model training process has a crucial impact on the accuracy and convergence speed of fault classifiers. Reference [15] proposed a novel expectation maximization-unscented particle filter-Wilcoxon rank sum test (EM-UPF-W) method for data-driven techniques, which adaptively estimates noise variables with the help of the EM algorithm. References [16,17] used an artificial intelligence optimization algorithm for the adaptive optimization of machine learning parameters to avoid the human experience of parameter selection, but the existing artificial intelligence optimization is prone to the problem of local optimal stagnation, which has an impact on the final convergence speed and accuracy of the model.
Given this context, this article is focused on the division of current signals into intervals, combining voiceprint signals to achieve fault diagnosis in converter transformers. It overcomes the inherent limitations of single signal sources and conducts research on multi-fault diagnosis. The IHPO method is proposed to effectively address the local optimization problem, serving as a subsequent parameter optimization algorithm. VMD is employed for noise reduction, while the S-transform is utilized as a time-frequency conversion method. The improved MFCC technique based on multiple strategies is employed for feature extraction. ITCN is utilized for accurate fault identification, offering a novel approach for fault diagnosis in converter transformer systems. Furthermore, a specific 800 kV converter station was taken as a case study to validate the effectiveness of this integrated model.
The main contributions of this article are summarized as follows:
  • This paper aims to counteract the problems of the traditional hunter–prey optimization algorithm, which easily falls into the local optimum, and of which the traversal of population initialization is not strong. It is improved via the introduction of SPM chaotic mapping and the Levy flight strategy, which is used for the adaptive selection of parameters in the fault diagnostic model to avoid the interference of the human experience selection.
  • Multi-strategy improved MFCC is proposed for extracting voiceprint signals from converter transformers. Compared with the traditional voiceprint signal feature extraction method, the proposed approach incorporates the characteristics specific to the voiceprint signals of electric power equipment. It overcomes the interference of redundant information and demonstrates enhanced feature extraction capabilities.
  • This paper introduces load signals to segment the operational intervals of converter transformers, realizes fault diagnosis through multiple types of signal sources, and proposes the improved multi-strategy MFCC and IHPO-VMD-ITCN fault diagnostic models. The experimental results demonstrate that the proposed fault diagnostic methods exhibit significant improvements in terms of both accuracy and calculation speed.

2. Analysis of Vibration Mechanism of Converter Transformer

Similarly to traditional power transformers, the vibration of converter transformers is induced by the electromagnetic forces in the windings and the expansion and contraction of the core due to magnetic hysteresis. These vibrations propagate through the transformer oil and rigid connections to the enclosure. However, owing to the complex environment resulting from the dual impact of alternating and direct currents, the vibration excitations are often characterized by multiple harmonic frequencies, leading to intricate vibration patterns in different areas.

2.1. Winding Vibration Mechanism Analysis

In accordance with the principles of high-voltage transmission, the current in converter transformers is accompanied by harmonic currents, including the 6 k + 1 ( k = 1 , 2 , 3 , ) th harmonic current at 50 Hz. This is manifested in Equation (1).
i = I α m cos ( α ω 1 t + Φ α )
where I α m is the amplitude of each harmonic current, Φ α is the phase angle of each harmonic, and ω 1 is the angular frequency of the 50 Hz current.
The interaction between currents of varying frequencies and magnetic fields generates axial and radial electromagnetic forces is expressed in Equation (2). The windings vibrate under the influence of these electromagnetic forces.
F a = k f a ( I α m cos ( α ω 1 t + Φ α ) ) 2 F r = k f r ( I α m cos ( α ω 1 t + Φ α ) ) 2
where k f a and k f r represent the axial and radial electromagnetic force coefficient and F a and F r represent the winding axial and radial electromagnetic force.
Based on the motion differential equation, the acceleration of winding vibration can be represented by Equation (3):
a a = k a a ( p 1 I α m 2 cos ( 2 α ω 1 t + φ 1 ) + 2 p 2 I α 1 m cos ( ( α 1 + α 2 ) ω 1 t + φ 2 ) + 2 p 3 I α 1 m I α 2 m cos ( ( α 1 α 2 ) ω 1 t + φ 3 ) ) a r = k a r ( p 1 I α m 2 cos ( 2 α ω 1 t + φ 1 ) + 2 p 2 I α 1 m cos ( ( α 1 + α 2 ) ω 1 t + φ 2 ) + 2 p 3 I α 1 m I α 2 m cos ( ( α 1 α 2 ) ω 1 t + φ 3 ) )
where 2  is the sum of multiplication of different harmonics, k a a and k a r  are the axial and radial acceleration coefficients, p 1 , p 2 , and p 3 are the calculation parameters, α 1 , α 2 are the number of harmonics, and φ 1 , φ 2 , and φ 3 are the acceleration phase angles.
From Equation (3), it can be observed that under the influence of the 6 k 1 + 1 ( k 1 = 1 , 2 , 3 , ) th harmonic, apart from the 100 Hz component, there is also a significant presence of the 100 k 1 Hz th harmonic in the vibration of the converter transformer. When the natural frequency of the windings is close, resonance can easily occur, leading to a deviation of the dominant vibration frequency from 100 Hz.

2.2. Core Vibration Mechanism Analysis

The vibration of the core is primarily induced by magnetostriction. Furthermore, the excitation voltage of the converter transformer contains numerous harmonic components. Taking the influence of harmonic voltages into account, the vibration of the core can be represented by Equation (4):
a = d 2 ( L ) d t 2 = k a ( 2 U α m 2 cos ( 2 α ω 1 t + φ α ) + 2 q 1 cos ( ( α 1 + α 2 ) ω 1 t + ( φ α 1 + φ α 2 ) ) + 2 q 1 cos ( ( α 1 α 2 ) ω 1 t + ( φ α 1 φ α 2 ) )
Among them:
q 1 = ( α 1 + α 2 ) 2 U α 1 m U α 2 m α 1 α 2 q 2 = ( α 1 α 2 ) 2 U α 1 m U α 2 m α 1 α 2
where U α m is the amplitude of each voltage harmonic, L is the magnetostrictive deformation of the silicon steel sheet, and k a is the saturation flux coefficient.
From Equation (4), it can be observed that the dominant frequency of the core vibration is primarily at 100 Hz. The influence of harmonics introduce a significant presence of the 100 k 1   Hz harmonic components. However, nonlinearities in the core and other factors may lead to deviations in vibration.

2.3. Fault Voiceprint Characterization of Converter Transformers

Similarly to ordinary power transformers, converter transformers are mainly composed of iron core, windings, and rigid connectors. When the iron core ages or experiences transportation and installation before operation, iron core loosening may occur. If the condition of iron core loosening is not promptly addressed, it will continue to accumulate, ultimately leading to iron core loosening failure. Iron core loosening failure results in a decrease in the fastening force between the silicon steel sheets of the iron core, thereby increasing the air gap between the stacked pieces. This causes a significant rise in the amplitude of iron core vibration acceleration, leading to changes in the intrinsic frequency of vibration and altering the voiceprint characteristics of the transformer. Similarly, during operation, the converter transformer is constantly subjected to the impact of electric power. In the event of a short-circuit fault, the intensification of electric power can prompt the occurrence of winding loosening faults. This leads to an aggravation of axial vibration, a significant increase in vibration acceleration amplitude, and changes in the vibration frequency distribution, resulting in alterations to the voiceprint characteristics of the transformer. When the converter transformer is running under bias magnetic conditions, the current signal can be regarded as the superposition of a DC component and Equation (1); according to Section 2.1 and Section 2.2 of the core and winding vibration mechanism analysis, it can be observed that, at this time, the vibration frequency of the converter transformer changes significantly.
In summary, when a fault occurs in the converter transformer, its core and winding vibration change significantly. The fault voiceprint signal generated under these conditions differs from that of normal operation. Therefore, the fault diagnosis of the converter transformer can be realized by adopting a machine learning algorithm for effective feature extraction of the voiceprint signal.

2.4. Characterization of Voiceprint Pattern Changes under Operating Conditions

The voiceprint signal and vibration signal, originating from the same source, exhibit a strong correlation. Based on the analysis in Section 2.1 and Section 2.2, this study delves into the vibration characteristics of converter transformers during operation.
This study focuses on 28 converter transformers in a specific 800 kV converter station. Among them, there are 12 transformers per pole and 4 transformers on standby. The parameters of certain converter transformers are presented in Table 1.
The voiceprint signal acquisition system for the converter transformers is illustrated in Figure 1, and on-site acquisition photos are presented in Figure 2. We employed a combination of HS14401 capacitive sound sensors with a sampling frequency of 16 kHz along with a DHDAS dynamic signal acquisition instrument. Each converter transformer is equipped with three voiceprint acquisition devices, positioned on both sides and at a 45-degree angle, 0.5 m away from the enclosure. The data were collected in the outdoor substation environment under normal operating conditions, which may include noise interference. The voiceprint acquisition system was configured to collect voiceprint signals every 30 min, with each collection lasting for 60 s. Electrical parameters within the converter station were recorded every 30 min to ensure synchronization between the voiceprint signals and electrical parameters.
We selected time-length 0.1 s converter transformer in-operation voiceprint slices as the object of study. The time-domain and frequency-domain characteristics are illustrated in Figure 3. The main frequency of the converter transformer is 400 Hz, accompanied by a significant number of harmonics. This is attributed to the proximity of the winding intrinsic frequency to 400 Hz and the resonance of the converter transformer 100 k 1   Hz component, resulting in a deviation of 100 Hz compared to ordinary power transformers. This deviation corresponds to the theoretical analysis mentioned above.
The vibration characteristics of converter transformers vary under different operating conditions. In a no-load converter transformer, the core winding resonance becomes prominent. Under heavy load, the dominant vibration shifts to winding [18,19,20]. To facilitate a more precise quantitative analysis, this article focuses on the high-end Y/D converter transformer of pole II. The main objective is to analyze the main frequency change pattern of voiceprint characteristics concerning the magnitude of current. The results are depicted in Figure 4. Under no load, the main frequency of the converter transformer is 200 Hz, indicating the core vibration stage. At the rated voltage, when the valve side current is less than 0.2 I N , the main frequency alternates between 200 Hz and 400 Hz. During this period, the core winding dominance alternates. However, when the current exceeds 0.23 I N , the main frequency stabilizes at 400 Hz, signifying the dominance of winding vibration.
Based on the information provided, a strong correlation exists between the electrical signals and voiceprint features of converter transformers. The division of converter transformers into three interval states, as illustrated in Table 2, allows for a phased approach to fault diagnosis. This approach proved effective in overcoming the issue of overlapping between core faults and winding faults, ultimately enhancing the accuracy of fault identification.

3. Description of Fault Diagnosis Algorithms

3.1. Improved Hunter–Prey Optimization Algorithms

The hunter–prey optimization algorithm is a new intelligent optimization algorithm proposed by Naruei et al. in 2021 [21]. In this algorithm, the hunter adjusts its position to obtain the best hunting position, while the prey moves to a safe position to avoid the hunter’s attack, and the safest position of the prey is the optimal solution of the problem to be optimized. This article proposes an improvement of the HPO algorithm by introducing the Levy flight strategy and SPM chaotic mapping. The modifications are briefly described as follows.
(1)
Initialization: The conventional HPO algorithm achieves population initialization using Equation (6), as described below:
x i = r a n d ( 1 , d ) × ( u b , l b ) + l b
wherein x i represents the positions of hunters or prey, d represents the problem dimensionality, and u b , l b represent the upper and lower bounds of the problem.
We chose Strongly Perturbed Mix (SPM) chaotic mapping for initializing the population, as shown in Figure 5. In comparison to circle mapping, the SPM demonstrates enhanced randomness and tergodicity, effectively addressing the issue of local clustering of individual hunters and prey [22]. The expression for SPM chaotic mapping is given by Equation (7).
x i + 1 = { mod ( x ( t ) η ) + μ sin ( π x ( t ) + r , 1 ) , 0 x ( t ) η mod ( x ( t ) / η 0.5 η ) + μ sin ( π x ( t ) + r , 1 ) , η x ( t ) 0.5 mod ( 1 x ( t ) / η 0.5 η ) + μ sin ( π ( 1 x ( t ) ) + r , 1 ) , 0.5 x ( t ) 1 η mod ( 1 x ( t ) 0.5 ) + μ sin ( π ( 1 x ( t ) ) + r , 1 ) , 1 η x ( t ) 1
In Equation (7), the parameter η ( 0 , 1 ) , μ ( 0 , 1 ) is typically chosen within the range of (0.4, 0.3).
(2)
Optimization strategy: Hunters select prey that are far away from the group as their search targets, while the prey continuously move to evade hunter attacks and maximize their chances of survival. The position update for hunters and prey can be described by Equations (8) and (9), respectively.
x i , j ( t + 1 ) = x i , j ( t ) + 0.5 [ ( 2 C Z P p o s ( j ) x i , j ( t ) ) + ( 2 ( 1 C ) Z μ x i , j ( t ) ) ]
wherein x i , j ( t + 1 ) represents the position of the ith hunter in the jth dimension at the (t + 1)th iteration, x i , j ( t ) represents the position of the ith hunter at the tth iteration, P p o s ( j ) represents the position of the prey in the jth dimension, C = 1 0.98 t / T represents the balance parameter between exploration and exploitation, and Z is an adaptive parameter.
x i , j ( t + 1 ) = T p o s ( j ) + C Z cos ( 2 π R 1 ) ( T p o s ( j ) x i , j ( t ) )
wherein T p o s ( j ) represents the global best position and R 1 represents a random number within the range of [−1, 1].
It is challenging to overcome local optima solely by introducing SPM chaotic mapping. However, the utilization of the Levy flight strategy allows for a quick escape from local optima. The implementation approach is depicted in Equation (10).
L e v y ( s ) λ β ( Γ ( λ ) ) sin ( π λ 2 ) π 1 s 1 + λ
wherein Γ ( λ ) = 0 t z 1 e t d t and the value of β is set to 1.5.
In practical applications, the Mantegna method is commonly used to generate random step lengths following a Levy distribution, as described in Equations (11) and (12).
S = μ | v | 1 β
μ N ( 0 , σ 2 ) , v N ( 0 , 1 ) σ = { Γ ( 1 + β ) sin ( π β 2 ) β Γ ( 1 + β 2 ) 2 β 1 2 } 1 β
In the IHPO optimization algorithm, if the change in fitness values is continuously less than 0.001, the Levy flight strategy aids in escaping local optima. This generates the candidate solution for the next iteration, as shown in Equation (13).
x i t + 1 = x i t + θ L e v y ( β )
In the equation,  denotes element-wise multiplication, θ is a random number uniformly distributed in the range [0, 1], and β is equal to 1.5.
The pseudocode used to improve the hunter–prey optimization algorithm is as follows in Algorithm 1:
Algorithm 1 Improve hunter–prey optimization
Input: HPO Parameters
Output: TargetScore, Best pos, Convergence curve
1: Initialize Hppos
2: Evaluate fitness of each HPpos
3: Set Target as the best HPpos, TargetScore as its fitness
4: for t = 2 to Max_iteration do
5:    Update c
6:    Update kbest
7:    for i = 1 to N do
8:       Generate random numbers
9:       if rand < B then
10:        Calculate xi and dist
11:        Set SI as HPpos(idxsortdist(kbest))
12:        Update HPpos(i,:) using formula with levy, l, c, z, SI, xi
13:      else
14:        for j = 1 to dim do
15:           Calculate v and rr
16:           Update HPpos(i,j) using formula with z(j), rr, Target(j), HPpos(i,j)
17:        end for
18:      end if
19:      Clip HPpos(i,:) values to be within bounds of lb and ub
20:      Evaluate fitness of HPpos(i,:)
21:      if HPposFitness(i) < TargetScore then
22:        Update Target and TargetScore
23:      end if
24:    end for
25:    Store TargetScore in Convergence curve(t)
26: end for
To validate the superiority of the IHPO algorithm, this article compares its performance with traditional optimization algorithms using the test function described in Equations (14) and (15). The results are depicted in Figure 6.
f 1 ( x ) = 20 exp ( 0.2 1 n i = 1 n x i 2 ) exp ( 1 n i = 1 n cos ( 2 π x i ) ) + 20 + e
f 2 ( x ) = 1 4000 i = 1 n ( x i 2 ) i = 1 n cos ( x i i ) + 1
According to Figure 6a,b, it can be observed that the IHPO optimization algorithm converges to values of 8.9 × 10 16 and 0, respectively. The convergence speed of the IHPO algorithm is significantly higher than that of other traditional algorithms, achieving superior convergence values with the fewest number of iterations.

3.2. Variational Mode Decomposition

During the process of collecting transformed voiceprint signals, there is often a significant amount of noise interference. In order to ensure the accuracy of fault diagnosis, this article adopts the VMD algorithm for denoising processing, aiming to restore the original voiceprint signal as faithfully as possible.
The VMD algorithm constructs a variational problem and solves it [23,24]. Firstly, the original signal is decomposed into k modal components, denoted as μ k ( t ) . The energy spectrum is obtained through Hilbert transformation. f ( t ) is made equal to each modal component μ k ( t ) as a constraint condition, and the Lagrange multiplier λ ( t ) and penalty factor α are introduced to transform it into a variational problem, as shown in Equation (16).
{ min { μ k } { ω k } { k K t [ ( δ ( t ) + j π t ) * μ k ( t ) ] e j ω k t 2 2 } L μ k , ω k λ = α k K t [ ( δ ( t ) + j π t ) * μ k ( t ) ] e j ω k t 2 2 + f ( t ) k = 1 K μ k ( t ) 2 2 + λ ( t ) , f ( t ) k = 1 K μ k ( t )
In Equation (16), * represents the convolution operation, μ k ( t ) is the k-th modal component, ω t is the central frequency, δ ( t ) is the impulse function, t represents the partial derivative with respect to t, and λ ( t ) , f ( t ) k = 1 K μ k ( t ) denotes the inner product.
The alternating direction multiplier method is used to solve the variational problem to find the optimal values of μ k ( t ) , ω k , which is realized in the following steps.
(1)
Initialize the parameters μ k ( t ) , ω k , λ , set the loop n = n + 1 , and iteratively update the parameters according to Equations (17)–(19).
(2)
Update μ k ( t ) .
μ ^ k n + 1 ( ω ) = f ^ ( ω ) i = 1 k 1 μ ^ n ( ω ) + λ ^ n ( ω ) 2 1 + 2 α ( ω ω k n ) 2
In Equation (17), μ ^ k n + 1 ( ω ) , f ^ ( ω ) , λ ^ n ( ω ) are the Fourier transforms corresponding to μ k n + 1 , f ( t ) , λ n .
(3)
Update ω k .
ω k n + 1 = 0 ω | μ ^ k n + 1 ( ω ) | 2 d ω 0 | μ ^ k n + 1 ( ω ) | 2 d ω
(4)
Update λ .
λ ^ n + 1 = λ ^ n + τ [ f ^ ( ω ) k = 1 K μ ^ k n + 1 ( ω ) ]
(5)
Determine convergence.
k = 1 K μ ^ k n + 1 μ ^ k n 2 2 μ ^ k n + 1 2 2 < ς
by setting ς > 0 .
(6)
Determine whether the iteration condition is satisfied; if not, return to step (2).

3.3. Multi-Strategy Improvement of MFCC for Dimensionality Reduction Extraction of Voiceprint Features

As a common speech feature extraction method, MFCC is widely used in the field of speech recognition [25]. Considering that spectral leakage in the Fourier transform is very likely to occur, the S-transform is used as a time-frequency conversion method, and combined with the characteristics of the stationary energy of the converter voiceprint signal, it undergoes processing in the medium time to obtain the improved MFCC method to realize the voiceprint signal feature extraction.

3.3.1. S-Transform

The S-transform employs the Gaussian window function with adaptive adjustment of time and frequency parameters, replacing the fixed window function of the Fourier transform and the scale parameter window function of the wavelet transform. This approach exhibits higher-frequency characteristics at low frequencies and effectively improves the shortcomings of the Fourier transform [26].
The result of signal x ( t ) after S-transformation is shown in Equation (21).
S ( τ , f ) = + x ( η ) w ( η τ , f ) e j 2 π f η d η
where f is the frequency, η is the time variable of x ( η ) , τ is the time component after S-transformation, and w ( η τ , f ) is the Gaussian window function for adaptive adjustment, as shown in Equation (22):
w ( η τ , f ) = | f | 2 π e ( t η ) 2 f 2 2

3.3.2. Multi-Strategy Improvement MFCC

In the field of audible sound recognition, given that the human ear exhibits varying sensitivities to the perception of each frequency band and the perception of the normal frequency band is nonlinear, Mel filtering is typically employed to transform the spectral information of voiceprint into Mel spectrum under Mel scale. The relationship between the normal frequency scale and the Mel frequency scale is expressed as in Equation (23):
M e l ( k ) = 2595 × lg ( 1 + f / 700 )
where f is the frequency on the regular scale and k is the frequency scale on the Mel scale.
In the domain of power equipment fault diagnosis, low-frequency information within 1000 Hz frequently incorporates numerous fault characteristics. Consequently, the utilization of Mel filters can adjust voiceprint information to varying degrees, enhance low-frequency information, and filter high-frequency information and compress it. The equal-height Mel filter bank function is expressed in Equation (24):
H ( m ) f = { 0 , f < x ( m 1 ) f x ( m 1 ) x ( m ) x ( m 1 ) , x ( m 1 ) f x ( m ) x ( m + 1 ) f x ( m + 1 ) x ( m ) , x ( m ) < f x ( m + 1 ) 0 , f > x ( m + 1 )
where m is the filter bank number and the number of filters in this paper is set to 26; therefore, the range of m is 0 < m < 26 , the center frequency of the Mel filter. The formula for the calculation of x ( m ) is:
x ( m ) = ( N f s ) M e l 1 ( M e l ( f min ) + m M e l ( f max ) M e l ( f min ) M + 1
where f s is the sampling frequency, f max , f min represent the frequency range of the Mel filter bank, N is the number of S-transform samples, and M is the number of Mel filters.
The improved MFCC feature extraction method is distinguished from MFCC by the simpler operations of frame splitting and window adding. The specific steps are as follows:
(1)
Framing: the S-transform has a high time complexity, so in order to save time, the original signal is framed with a fixed frame length.
(2)
S-transform: the S-transform is performed on each frame by Equation (16) to obtain the time-frequency matrix A ( t , f ) .
(3)
The spectral information is sought, as shown in Equation (26).
F ( f ) = i = 1 t | A ( t , f ) | 2 t
where A ( t , f ) is the time-frequency matrix, t is the time corresponding to the S-transform matrix, and f is the frequency.
(4)
Bandpass filtering is performed, as in Equation (27).
M e l ( m ) = ln ( k = 0 N 1 | F ( f ) | H m ( f ) )
where M e l ( m ) is the Mel filter output and H m ( f ) is the filter bank.
(5)
A discrete cosine transform is performed as in Equation (28) to obtain the first set of voiceprint characterization coefficients f e a t 1 .
C ( i ) = j = 1 m M e l ( m ) cos ( π i ( m 0.5 ) 26 )
(6)
We perform first-order and second-order differentiation operations on f e a t 1 to obtain the second and third sets of parameters f e a t 2 , f e a t 3 of the improved MFCC eigenvectors.
(7)
We splice the three sets of parameters to form the feature vector IMFCC = [ f e a t 1 , f e a t 2 , f e a t 3 ] .
Compared with the human speaking voice, power equipment voiceprint signal characteristics tend to be stationary; the feature vector obtained above contains a large amount of redundant information between the frames, so the use of mid-time features as shown in Equation (29) is more in line with the characteristics of stationary power equipment voiceprint features, reducing the interference of the heterogeneous long frames and having a stronger generalization [27], The multi-strategy improvement MFCC flowchart is shown in Figure 7.
M I M F C C = i = 1 N I M F C C i N
where I M F C C i is the ith frame signal feature and N is the number of medium-time signal frames and denotes MIMFCC is the medium-time feature vector.

3.4. Improved Temporal Convolutional Neural Networks

Time convolutional networks have good sequence information processing capabilities. In comparison to traditional architectures such as convolutional neural networks, this network achieves deeper networks by incorporating skip connections of residual blocks, effectively integrating shallow features into the depths for improved accuracy [28,29]. To simplify the network’s complexity, cavity convolution is employed to expand the sensory field, and the causal cavity convolution is calculated as shown in Equation (30):
F ( t ) = i = 0 k 1 f ( i ) x t d i
where d is the void coefficient, k is the convolution kernel size, and f ( i ) is the ith element of the convolution kernel.
The traditional TCN residual module introduces nonlinearity through the Relu activation function. However, when the input is negative, the zero-gradient problem occurs, leading to the offset phenomenon. This, in turn, limits the learning efficiency and effectiveness of the TCN. Setting the output mean of the activation function to zero serves a dual purpose: it reduces the gradient vanishing problem and mitigates the impact of weight initialization. Additionally, the output of the activation function with zero-mean facilitates the propagation of information between the different layers of the network, resulting in better learning dynamics. This helps the network learn complex features and representations more efficiently. To a greater extent, it can enhance the network’s learning performance. Therefore, the Mish activation function is used to replace the traditional Relu function, as in this equation:
F ( x ) = mish ( x ) = x × tanh ( ln ( 1 + e x ) )
As depicted in Figure 8, compared with other activation functions, although the Tanh function has an absolute 0-mean value, it is prone to gradient vanishing due to the range of [−1, 1]. The Mish activation function is a better trade-off between the 0-mean value and the gradient vanishing problem [30].
The improved TCN architecture is illustrated in Figure 9 (k = 2, d = 1, 2, 4), where each residual module contains two causal convolutional layers. The network’s performance is enhanced through the incorporation of the Mish activation function, weight normalization, and dropout.
The improved TCN pseudocode is shown in Algorithm 2:
Algorithm 2 improved Temporal Convolutional Network
Input: Input sequence X with length T, Number of residual blocks K, Stack size S, Number of output channels C, Filter size f, Initial dilation value d0, Learning rate η
Output: Probability distribution over classes
1: Initialize all model parameters
2: Set learning rate to η
3: Set initial dilation value to d0
4: for k = 1 to K do
5:   for s = 1 to S do
6:     for c = 1 to C do
7:       Apply causal convolution to input sequence X with dilation d
8:       Apply activation function (e.g., Mish) to the output
9:       Apply weight normalization to the output
10:      Update output sequence O
11:     end for
12:    end for
13:    Stack the output sequence O with the input sequence X as the new input
14:    Increase the dilation value d exponentially
15: end for
16: Apply a fully connected layer to the final output sequence O
17: Apply softmax function to obtain probability distribution over classes

3.5. Multi-Strategy Improved MFCC-IHPO-VMD-ITCN Combined Fault Diagnosis Modeling

Converter transformer voiceprint signals are mainly concentrated in the low-frequency band. Considering the operating patterns of the converter transformer, a combined voiceprint–electric feature vector is adopted to overcome the problem of interference between core and winding vibrations. The accurate identification of converter transformer faults is achieved through a diagnostic process from denoising through feature extraction to pattern recognition. The diagnostic workflow is illustrated in Figure 10.
The VMD is optimized based on IHPO to obtain the proprioceptive voiceprint signal. The selection of the decomposition number k and the penalty factor α has a significant impact on the decomposition result. It is prone to over-decomposition or loss of band information. Therefore, the minimum envelope entropy shown in Equation (32) is selected as the fitness function. IHPO is utilized to select the optimal [k, α] to overcome the inherent defects of VMD decomposition.
{ F i t n e s s = min ( f ( i ) ) f ( i ) = i = 1 N p ( i ) log 10 ( p ( i ) ) p ( i ) = a ( i ) / i = 1 N a ( i )
where N is the number of Intrinsic Mode Function (IMF) components, f ( i ) is the envelope entropy after Hilbert adjustment, p ( i ) is the normalized form, and a ( i ) is the envelope signal.
Through the normalization of the load signal combined with the construction of multi-strategy improved MFCC for converter voiceprint and electric joint feature vector, multi-channel signal fault diagnosis is achieved.
Optimizing ITCN based on IHPO involves fine-tuning key parameters like kernel size (k) and dilation factor (d) for expansion convolution, which are crucial in determining the receptive field size and training accuracy. Utilizing Equation (33) as the fitness function enables adaptive optimization of ITCN to find optimal values for (k) and (d) that maximize the performance.
F i t n e s s = ( 1 a c c T r a i n ) × 100
where a c c T r a i n is the training set accuracy.

4. Calculus Analysis

4.1. Noise Reduction Processing for Voiceprint Signals

The voiceprint signals collected from outdoor substations are susceptible to significant transient and continuous noise interference, which inevitably affects the accuracy of fault diagnosis. Therefore, performing noise reduction processing is crucial.
Based on the given information, the optimization algorithm has a population size of 25 and a dimension of 2. The upper limit is denoted as u a = [ 25 , 3000 ] , while the lower limit is denoted as u b = [ 1 , 500 ] . Through 20 iterations, the fitness function changes are shown in Figure 11. In comparison to the HPO and HHO algorithms that converge to 3.208 and 3.2141, respectively, the proposed IHPO optimization algorithm in this study demonstrates better convergence performance.
It reaches the optimal solution within five iterations, with a significantly smaller final fitness value of 3.194. The optimal values obtained are k = 16 and α = 1246. The results of the IMF decomposition using IHPO-VMD are shown in Figure 12.
This article compares the results of IHPO-VMD with manually selected values of k and α to validate the superiority of IHPO-VMD. Taking k = 16 and α = 1000 as an example, the first two decomposition results are shown in Figure 13a. When the value of α is too small, it results in a wide bandwidth, causing severe mode mixing between the 400 Hz and 500 Hz components, as well as between the 600 Hz and 1000 Hz components. In contrast, Figure 13b shows that IHPO-VMD avoids the mode mixing problem.
By calculating the correlation coefficients of the 16 IMF components, noise reduction processing can be achieved by setting a threshold using Equation (34). The correlation coefficients of each component are illustrated in Figure 14. Through the establishment of a threshold value, C = 0.212 , the IMF1–IMF4 components can be recombined to derive the voiceprint signal of the converter transformer.
{ C = i = 1 n ( ρ i ρ ¯ ) 2 k ρ k = i = 1 n ( x i , k x ¯ k ) ( y i y ¯ ) i = 1 n ( x i , k x ¯ k ) 2 i = 1 n ( y i y ¯ ) 2
where ρ i is the correlation coefficient of the ith order IMF component, ρ ¯ is the mean value, k is the number of components, x is the IMF component; y is the original signal; and n is the number of sampling points.

4.2. Joint Feature Vector Extraction

Based on the 1 s denoised voiceprint data, a frame length of 25 ms was chosen to generate an enhanced MFCC feature vector with a size of [ 36 × 39 ] . In this representation, 36 denotes the number of frames, and 39 signifies the dimensionality of the feature vector, as depicted in Figure 15a. The voiceprint signal of the converter transformer demonstrates stability, exhibiting high redundancy between frame numbers. To mitigate complexity, a mid-term feature vector of 250 ms was constructed, as depicted in Figure 15b, where the feature vector changes from [ 36 × 39 ] to [ 4 × 39 ] . This leads to a notable reduction in its complexity.
Based on the provided information, feature extraction from the load signal was carried out using per-unit value to construct a joint voiceprint–electric feature vector of size [ 4 × 40 ] . The iron core faults and winding faults in the converter transformer exhibit strong randomness, with distinct characteristic spectra corresponding to different loosening conditions. As analyzed in 2.3 and Table 1, iron core fault diagnosis is accomplished in Stage I, while winding fault diagnosis is achieved in Stage III. Through the separation of voiceprint features of the iron core and winding based on the load signal, a joint voiceprint–electric feature vector is constructed. In Stage II, the fault is defined as either an iron core or winding fault. However, this stage represents an unmonitorable phase, and determining whether a core failure or a winding failure is challenging for maintenance personnel. The fault diagnosis is conducted in stages to precisely identify iron core loosening faults, winding loosening faults, and DC bias faults. This approach effectively overcomes the limitation of existing research focusing on single fault diagnosis, providing a more comprehensive diagnostic capability. The spectral characteristics of typical defects in the converter transformer section are illustrated in Figure 16.

4.3. Description of Experimental Objects and Measurement Points

The converter transformer, operating at a high voltage level and featuring a complex structure, plays a crucial role in high-voltage DC transmission technology. Utilizing the original model for fault diagnosis studies involves significant expenses and requires extensive equipment. Therefore, in this study, we sourced fault data from the signal detection system of an 800 kV converter station mentioned above. This system not only enables real-time storage of fault data but also allows for historical playback. To diversify fault samples, we used the monitoring system to collect fault signals from other converter stations to build a sample library. In this article, we collected fault signals from converter transformers experiencing DC bias, core loosening, winding loosening, and normal states. Both acoustic and current signals were collected through historical playback. The dataset was constructed following the method outlined in Section 4.2, involving division into the training sets and the test sets to ensure the effectiveness of deep learning [31], as shown in Table 3.
The IHPO parameters were set as follows: the number of populations is 30, the maximum number of iterations is 50, the epoch of parameter optimization is 50, the upper limit is u a = [ 16 , 6 ] , and the lower limit is u b = [ 1 , 1 ] . Adaptive optimization of the convolution kernel size k and the expansion factor d was realized, and the change in fitness value is shown in Figure 17, which converged to 0.082 after 21 iterations and gave outputs of k = 16 and d = 3.
The optimized results of IHPO were used as the input for ITCN, configuring the model with an epoch set to 100 and a batch size of 32. As illustrated in Figure 18a, this integrated model demonstrated stable convergence, achieving 100% accuracy after 88 epochs. To validate the training accuracy of the model, it was tested using a validation set, and the prediction results are depicted in Figure 18b, with a test accuracy of 99%. Through this analysis, the combination model, which utilizes current signals and incorporates audio–electric joint features, successfully mitigated interference between faults, affirming the feasibility of this combined model.

4.4. Comparative Analysis of Combined Forecasting Methods

To assess the performance of the combined model, in this article, we conducted a comparison with the IHPO-TCN model utilizing voiceprint–electric joint feature vectors and the IHPO-ITCN model based on audio feature vectors. The results are presented in Figure 19a. Upon comparing a (1) and a (2), it is evident that a (1) exhibits superior convergence, reaching 99.91% accuracy as epoch increases, surpassing a (2) in stability. This validates the superiority of model (a). In contrast, model a (3) achieves lower accuracy, converging to 95.41% after 94 epochs. The test set prediction results for the a (3) model are depicted in Figure 19b, with a test accuracy of 94%. Notably, mixed interference between core loosening and winding loosening faults is observed. In conclusion, the IHPO-ITCN model based on audio-electric joint feature vectors demonstrates significant superiority compared to the other models analyzed.
A comparison of training time and accuracy of different feature signal fault recognition models is shown in Table 4. In the comparison experiments, the number of training sets and test sets are shown in Table 3, and the parameter settings of each model are also equal. Compared with traditional MFCC, MFCC’s multi-dimensional improvement strategy decreased training time by 26 s and increased accuracy by 2.82%. These results validate the superiority of the improved MFCC in feature extraction. Due to changes in feature dimensions, the training time of feature vectors constructed by the voiceprint signals’ combined load is longer. Compared with traditional MFCC features, traditional MFCC combined load features have a longer training time of 5.6 s but an accuracy improvement of 5.95%. Similarly, multi-strategy improvement MFCC combined load features have a training time increase of 1.1 s but an accuracy improvement of 4.33% compared to single multi-strategy improvement MFCC features. This verifies that although load signal intervention prolongs a certain training time, it effectively improves the accuracy of fault classification. For the diagnostic model proposed in this article, the accuracy ultimately converges to 100% and the training time is shorter, thus confirming the superior performance of the model.
In order to further substantiate the superiority of TCN in inverter voiceprint fault diagnosis, in this article, we conducted a comparative analysis with traditional machine learning algorithms, ensuring consistency in dataset determination, epochs, and other parameters used for the comparison method. The hyperparameter settings of the comparison model are provided in Table 5.
The recognition results of different machine learning models are presented in Table 6: Utilizing the load joint multi-strategy to improve MFCC parameters as fault features to construct a dataset, the four machine learning algorithms show good results in training time and test set recognition accuracy, further verifying the effectiveness of the fault diagnosis model in feature extraction. However, when compared with CNN, although TCN has a training time of 1.9 s longer, it excels in capturing deep features, leading to a 3% higher recognition accuracy. In contrast to TCN, the training times of GRU and LSTM are 2.2 s and 2.7 s longer, respectively, with accuracy reductions of 7% and 5%, confirming the superiority of TCN in this diagnostic model.

5. Conclusions

This paper proposes a fault diagnosis method that combines the multidimensional-improvement strategy of MFCC with adaptive VMD-ITCN and incorporates the influence of load signals. This method significantly enhances recognition accuracy and is applicable in the field of fault diagnosis for converter transformers. Our experimental results demonstrate that the application of IHPO for optimizing VMD and ITCN has significant benefits, such as improved convergence and the avoidance of parameter-related impacts on fault diagnosis models. The introduction of load signals divides the entire operational process of the converter transformer into three stages, diagnosing core faults in Stage I and winding faults in Stage III. The effectiveness of the proposed model was verified using a sample dataset from an 800 kV converter station. This model exhibits superior performance in terms of recognition accuracy and training speed, providing a new approach for maintenance personnel to promptly and accurately detect internal defects in converter transformers.
The fault diagnosis model proposed in this article is based on a data-driven background, which achieves fault classification through row analysis of historical data of converter transformers. Therefore, the number of fault categories and samples is relatively small. In future research, we will collect fault data of converter transformers in different scenarios and expand the types of faults. The idea of transfer learning, as described in reference [32,33], can also be introduced to further improve the generalization of diagnostic models. On the other hand, we will consider establishing an accurate mathematical model from a model-driven perspective to simulate fault signals and achieve fault diagnosis.

Author Contributions

Data curation and writing—original draft preparation, Q.Y.; supervision and writing—review and editing, H.L.; validation, X.L. All authors have read and agreed to the published version of the manuscript.

Funding

This work is funded by the Ningxia Natural Science Foundation (No. 2022AAC03631).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data are contained within the article.

Acknowledgments

The authors are very grateful to the reviewers, associate editors, and editors for their valuable comments and time spent.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Dai, H.; Li, N.; Han, W.; Song, Z.; Zhang, Y. Research on Fault Diagnosis and Analysis Method of Converter Transformer. In Proceedings of the 2021 IEEE International Conference on Electrical Engineering and Mechatronics Technology, ICEEMT 2021, Qingdao, China, 2–4 July 2021; pp. 314–317. [Google Scholar]
  2. Sun, W.; Yang, L.; Zare, F.; Xia, Y.; Cheng, L. 3D modeling of an HVDC converter transformer and its application on the electrical field of windings subject to voltage harmonics. Int. J. Electr. Power Energy Syst. 2020, 117, 105581. [Google Scholar] [CrossRef]
  3. Liu, X.; Sun, W.; Li, H.; Hussain, Z.; Liu, A. The Method of Rolling Bearing Fault Diagnosis Based on Multi-Domain Supervised Learning of Convolution Neural Network. Energies 2022, 15, 4614. [Google Scholar] [CrossRef]
  4. Wang, C.; Cai, C.; Du, Y.; Ji, Z.; Liu, Y.; Miao, M. Fault Diagnosis of Transformer Winding Looseness Based on Vibration Signal and GOA-KELM Model. J. Phys. Conf. Ser. 2022, 2290, 012089. [Google Scholar] [CrossRef]
  5. Zhang, P.; Jiang, W.; Zheng, Y.; Zhang, S.; Zhang, S.; Liu, S. Hydraulic-Pump Fault-Diagnosis Method Based on Mean Spectrogram Bar Graph of Voiceprint and ResNet-50 Model Transfer. J. Mar. Sci. Eng. 2023, 11, 1678. [Google Scholar] [CrossRef]
  6. Jiang, W.; Li, Z.; Li, J.; Zhu, Y.; Zhang, P. Study on a Fault Identification Method of the Hydraulic Pump Based on a Combination of Voiceprint Characteristics and Extreme Learning Machine. Processes 2019, 7, 894. [Google Scholar] [CrossRef]
  7. Ma, H.; Li, N.; Yang, Q.; Duan, D.; Zhu, H.; He, P. On-line fault diagnosis method of transformer winding looseness based on multi-characteristic voiceprint maps. Electr. Mach. Control 2023, 27, 76–87. [Google Scholar]
  8. Wang, F.; Wang, S.; Chen, S.; Yuan, G.; Zhang, J. Voiceprint Recognition Model of Power Transformers Based on Improved MFCC and VQ. Proc. Chin. Soc. Electr. Eng. 2017, 37, 1535–1542. [Google Scholar]
  9. Han, S.; Gao, F.; Wang, B.; Liu, Y.; Wang, K.; Wu, D.; Zhang, C. Audible Sound Identification of on Load Tap Changer Based on Mel Spectrum Filtering and CNN. Power Syst. Technol. 2021, 45, 3609–3617. [Google Scholar]
  10. Chen, J.; Lin, C.; Yao, B.; Yang, L.; Ge, H. Intelligent fault diagnosis of rolling bearings with low-quality data: A feature significance and diversity learning method. Reliab. Eng. Syst. Saf. 2023, 237, 109343. [Google Scholar] [CrossRef]
  11. Wang, W.; Li, Y.; Song, Y. Fault diagnosis method of vehicle engine via HOSVD–HOALS hybrid algorithm-based multi-dimensional feature extraction. Appl. Soft Comput. 2022, 16, 108293. [Google Scholar] [CrossRef]
  12. Wan, H.; Gu, X.; Yang, S.; Fu, Y.A. Sound and Vibration Fusion Method for Fault Diagnosis of Rolling Bearings under Speed-Varying Conditions. Sensors 2023, 23, 3130. [Google Scholar] [CrossRef]
  13. Tao, H.; Jia, P.; Wang, X.; Wang, L. Real-Time Fault Diagnosis for Hydraulic System Based on Multi-Sensor Convolutional Neural Network. Sensors 2024, 24, 353. [Google Scholar] [CrossRef] [PubMed]
  14. Deng, C.; Deng, Z.; Lu, S.; He, M.; Miao, J.; Peng, Y. Fault Diagnosis Method for Imbalanced Data Based on Multi-Signal Fusion and Improved Deep Convolution Generative Adversarial Network. Sensors 2023, 23, 2542. [Google Scholar] [CrossRef] [PubMed]
  15. Zhang, J.; Jiang, Y.; Li, X. Remaining Useful Life Prediction of Lithium-Ion Battery with Adaptive Noise Estimation and Capacity Regeneration Detection. IEEE/ASME Trans. Mechatron. 2023, 28, 632–643. [Google Scholar] [CrossRef]
  16. Gao, S.; Xu, L.; Zhang, Y. Rolling bearing fault diagnosis based on SSA optimized self-adaptive DBN. ISA Trans. 2022, 128, 482–502. [Google Scholar] [CrossRef] [PubMed]
  17. Song, Y.; Xie, H.; Zhu, Z. Predicting energy consumption of chiller plant using WOA-BiLSTM hybrid prediction model: A case study for a hospital building. Energy Build. 2023, 300, 113642. [Google Scholar] [CrossRef]
  18. Wu, S.; Ji, S.; Sun, J.; Liang, N.; Zhao, T.; Dai, S. Vibration Monitoring and Variation Law of Converter Transformer in Operation. High Volt. Eng. 2022, 48, 1561–1570. [Google Scholar]
  19. Jiang, P.; Zhang, Z.; Zhang, J.; Deng, B.; Pan, Z. Research on vibration characteristics and Multi-parameter state recognition of ± 500 kV converter transformer under fluctuating conditions. Int. J. Electr. Power Energy Syst. 2022, 136, 107748. [Google Scholar] [CrossRef]
  20. Shi, Y.; Ji, S.; Zhang, F.; Li, J.; Han, S.; Ji, K. Multi-frequency Vibration Mechanism and Characteristics of Transformer Windings. High Volt. Eng. 2021, 47, 2536–2544. [Google Scholar]
  21. Naruei, I.; Keynia, F.; Sabbagh Molahosseini, A. Hunter–prey optimization: Algorithm and applications. Soft Comput. 2022, 26, 1279–1314. [Google Scholar] [CrossRef]
  22. Ban, D.; Lv, X.; Wang, X. Efficient Image Encryption Algorithm Based on 1D Chaotic Map. Comput. Sci. 2020, 47, 278–284. [Google Scholar]
  23. Geng, G.; He, Y.; Zhang, J.; Qin, T.; Yang, B. Short-Term Power Load Forecasting Based on PSO-Optimized VMD-TCN-Attention Mechanism. Energies 2023, 16, 4616. [Google Scholar] [CrossRef]
  24. Ouyang, M.; Shen, P. Prediction of Remaining Useful Life of Lithium Batteries Based on WOA-VMD and LSTM. Energies 2022, 15, 8918. [Google Scholar] [CrossRef]
  25. Wan, S.; Dong, F.; Zhang, X.; Wu, W.; Li, J. Fault Voiceprint Signal Diagnosis Method of Power Transformer Based on Mixup Data Enhancement. Sensors 2023, 23, 3341. [Google Scholar] [CrossRef]
  26. Minh Khoa, N.; Van Dai, L. Detection and Classification of Power Quality Disturbances in Power System Using Modified-Combination between the Stockwell Transform and Decision Tree Methods. Energies 2020, 13, 3623. [Google Scholar] [CrossRef]
  27. Xu, M.; Li, Z.; Sun, H.; Sheng, G.; Jiang, X. Mechanical Fault Diagnosis Method of GIS Based on Improved MFCC. High Volt. Appar. 2020, 56, 122–128. [Google Scholar]
  28. Lea, C.; Vidal, R.; Reiter, A.; Hager, G.D. Temporal convolutional networks: A unified approach to action segmentation. In Computer Vision—ECCV 2016 Workshops, Proceedings of the ECCV 2016, Amsterdam, The Netherlands, 11–14 October 2016; Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Springer: Cham, Switzerland, 2016; Volume 9915 LNCS, pp. 47–54. [Google Scholar]
  29. Gao, Y.; Wang, W.; Lin, Q. Fault Diagnosis for Power Converters Based on Optimized Temporal Convolutional Network. IEEE Trans. Instrum. Meas. 2021, 70, 3501910. [Google Scholar]
  30. Misra, D. Mish: A self regularized non-monotonic neural activation function. In Proceedings of the British Machine Vision Conference, Virtual, 7–10 September 2020; pp. 1–13. [Google Scholar]
  31. Yu, Z.; Zhang, L.; Kim, J. The Performance Analysis of PSO-ResNet for the Fault Diagnosis of Vibration Signals Based on the Pipeline Robot. Sensors 2023, 23, 4289. [Google Scholar] [CrossRef]
  32. Rezaeianjouybari, B.; Shang, Y. A novel deep multi-source domain adaptation framework for bearing fault diagnosis based on feature-level and task-specific distribution alignment. Measurement 2021, 178, 109359. [Google Scholar] [CrossRef]
  33. Yang, B.; Lei, Y.; Li, X.; Li, N. Targeted transfer learning through distribution barycenter medium for intelligent fault diagnosis of machines with data decentralization. Expert Syst. Appl. 2024, 244, 122997. [Google Scholar] [CrossRef]
Figure 1. Voiceprint data acquisition system.
Figure 1. Voiceprint data acquisition system.
Sensors 24 00757 g001
Figure 2. On-site acquisition.
Figure 2. On-site acquisition.
Sensors 24 00757 g002
Figure 3. (a) Time domain characteristics; (b) frequency domain characteristics.
Figure 3. (a) Time domain characteristics; (b) frequency domain characteristics.
Sensors 24 00757 g003
Figure 4. Characteristics of the main frequency of the voiceprint signal of the converter transformer with the variation in current.
Figure 4. Characteristics of the main frequency of the voiceprint signal of the converter transformer with the variation in current.
Sensors 24 00757 g004
Figure 5. (a) SPM chaotic mapping value distribution; (b) circle chaotic mapping value distribution.
Figure 5. (a) SPM chaotic mapping value distribution; (b) circle chaotic mapping value distribution.
Sensors 24 00757 g005aSensors 24 00757 g005b
Figure 6. (a) Comparison of the optimization performance of the measurement function (14); (b) comparison of the optimization performance of the measurement function (15).
Figure 6. (a) Comparison of the optimization performance of the measurement function (14); (b) comparison of the optimization performance of the measurement function (15).
Sensors 24 00757 g006
Figure 7. Multi-strategy improvement of MFCC flowchart.
Figure 7. Multi-strategy improvement of MFCC flowchart.
Sensors 24 00757 g007
Figure 8. Activation function 0-mean comparison.
Figure 8. Activation function 0-mean comparison.
Sensors 24 00757 g008
Figure 9. Improve temporal convolutional neural network architecture.
Figure 9. Improve temporal convolutional neural network architecture.
Sensors 24 00757 g009
Figure 10. Multi-strategy improved MFCC-IHPO-VMD-ITCN fault diagnosis modeling.
Figure 10. Multi-strategy improved MFCC-IHPO-VMD-ITCN fault diagnosis modeling.
Sensors 24 00757 g010
Figure 11. Comparison of fitness function values of different optimization algorithms.
Figure 11. Comparison of fitness function values of different optimization algorithms.
Sensors 24 00757 g011
Figure 12. (ad) Component IMF1–IMF16 after IHPO-VMD decomposition.
Figure 12. (ad) Component IMF1–IMF16 after IHPO-VMD decomposition.
Sensors 24 00757 g012
Figure 13. (a) Empirically selected VMD decomposition results; (b) IHPO-VMD decomposition results.
Figure 13. (a) Empirically selected VMD decomposition results; (b) IHPO-VMD decomposition results.
Sensors 24 00757 g013
Figure 14. Correlation coefficients of components.
Figure 14. Correlation coefficients of components.
Sensors 24 00757 g014
Figure 15. (a) Traditional MFCC features; (b) multi-strategy improved MFCC features.
Figure 15. (a) Traditional MFCC features; (b) multi-strategy improved MFCC features.
Sensors 24 00757 g015
Figure 16. (ac) are the typical defective spectral characteristics of the converter transformer.
Figure 16. (ac) are the typical defective spectral characteristics of the converter transformer.
Sensors 24 00757 g016
Figure 17. Change in fitness function.
Figure 17. Change in fitness function.
Sensors 24 00757 g017
Figure 18. (a) Model identification results; (b) model testing set prediction results.
Figure 18. (a) Model identification results; (b) model testing set prediction results.
Sensors 24 00757 g018
Figure 19. (a) 1 IHPO-ITCN based on joint voiceprint–electric feature vectors, (a) 2 IHPO-TCN based on joint voiceprint–electric feature vectors, (a) 3 IHPO-ITCN based on voiceprint feature vectors; (b) prediction results of the voiceprint feature model testing set.
Figure 19. (a) 1 IHPO-ITCN based on joint voiceprint–electric feature vectors, (a) 2 IHPO-TCN based on joint voiceprint–electric feature vectors, (a) 3 IHPO-ITCN based on voiceprint feature vectors; (b) prediction results of the voiceprint feature model testing set.
Sensors 24 00757 g019
Table 1. Parameters of converter transformer.
Table 1. Parameters of converter transformer.
ParametersNumerical Value
Pole II High-End Y/D ConverterPole I High-End Y/Y Converter
Model numberZZDFPZ-412300/600 kVZZDFPZ-412300/750/800
Rated capacity/MVA412.3412.3
Net side I N / A 933933
Valve side I N / A 23574083
Operating frequency/Hz5050
Cooling methodOFAFOFAF
Table 2. Acousto-electric signal correlation analysis.
Table 2. Acousto-electric signal correlation analysis.
Operational StateNo-Load (I)Load (II)Load (III)
Current and voltage signalsU = 1 I = 0U = 1 I < 0.23U = 1 I > 0.23
Voiceprint signal main frequency/Hz200200/400400
ConclusionIron core vibration dominatedThe core windings alternately dominateWinding vibration dominant
Table 3. Combined model training program.
Table 3. Combined model training program.
Operational StateSerial NumberTraining Sets/EachTest Sets/Each
Normal018020
Iron core loosening118020
Winding loosening218020
DC bias318020
Core or winding fault418020
Table 4. Comparison of training time and accuracy of different feature signal fault recognition models.
Table 4. Comparison of training time and accuracy of different feature signal fault recognition models.
Characteristic Signal TypeTraining Time/sConvergence to Maximum Accuracy/%
Traditional MFCC50.692.85
Multi-strategy improvement MFCC24.695.67
Load + multi-strategy improvement MFCC25.7100
Load + traditional MFCC56.398.8
Table 5. Contrasting model hyperparameter settings.
Table 5. Contrasting model hyperparameter settings.
Contrast ModelActivation FunctionBatch SizeLearning Rate
TCNRelu160.001
CNNRelu160.001
LSTMRelu160.001
GRURelu160.001
Table 6. Comparison model recognition results.
Table 6. Comparison model recognition results.
Contrast ModelTraining Time/STest Set Accuracy/%
TCN25.799
CNN23.896
LSTM27.992
GRU28.494
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Li, H.; Yao, Q.; Li, X. Voiceprint Fault Diagnosis of Converter Transformer under Load Influence Based on Multi-Strategy Improved Mel-Frequency Spectrum Coefficient and Temporal Convolutional Network. Sensors 2024, 24, 757. https://doi.org/10.3390/s24030757

AMA Style

Li H, Yao Q, Li X. Voiceprint Fault Diagnosis of Converter Transformer under Load Influence Based on Multi-Strategy Improved Mel-Frequency Spectrum Coefficient and Temporal Convolutional Network. Sensors. 2024; 24(3):757. https://doi.org/10.3390/s24030757

Chicago/Turabian Style

Li, Hui, Qi Yao, and Xin Li. 2024. "Voiceprint Fault Diagnosis of Converter Transformer under Load Influence Based on Multi-Strategy Improved Mel-Frequency Spectrum Coefficient and Temporal Convolutional Network" Sensors 24, no. 3: 757. https://doi.org/10.3390/s24030757

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop