Next Article in Journal
Constraints on Tsallis Cosmology from Big Bang Nucleosynthesis and the Relic Abundance of Cold Dark Matter Particles
Previous Article in Journal
Quantum Phase Transitions in a Generalized Dicke Model
Previous Article in Special Issue
Variable-Step Multiscale Fuzzy Dispersion Entropy: A Novel Metric for Signal Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Refined Composite Multiscale Fuzzy Dispersion Entropy and Its Applications to Bearing Fault Diagnosis

by
Mostafa Rostaghi
1,
Mohammad Mahdi Khatibi
1,*,
Mohammad Reza Ashory
1 and
Hamed Azami
2
1
Modal Analysis (MA) Research Laboratory, Faculty of Mechanical Engineering, Semnan University, Semnan 35131-19111, Iran
2
Centre for Addiction and Mental Health, University of Toronto, Toronto, ON M6J 1H1, Canada
*
Author to whom correspondence should be addressed.
Entropy 2023, 25(11), 1494; https://doi.org/10.3390/e25111494
Submission received: 23 July 2023 / Revised: 14 October 2023 / Accepted: 24 October 2023 / Published: 29 October 2023
(This article belongs to the Special Issue Dispersion Entropy: Theory and Applications)

Abstract

:
Rotary machines often exhibit nonlinear behavior due to factors such as nonlinear stiffness, damping, friction, coupling effects, and defects. Consequently, their vibration signals display nonlinear characteristics. Entropy techniques prove to be effective in detecting these nonlinear dynamic characteristics. Recently, an approach called fuzzy dispersion entropy (DE–FDE) was introduced to quantify the uncertainty of time series. FDE, rooted in dispersion patterns and fuzzy set theory, addresses the sensitivity of DE to its parameters. However, FDE does not adequately account for the presence of multiple time scales inherent in signals. To address this limitation, the concept of multiscale fuzzy dispersion entropy (MFDE) was developed to capture the dynamical variability of time series across various scales of complexity. Compared to multiscale DE (MDE), MFDE exhibits reduced sensitivity to noise and higher stability. In order to enhance the stability of MFDE, we propose a refined composite MFDE (RCMFDE). In comparison with MFDE, MDE, and RCMDE, RCMFDE’s performance is assessed using synthetic signals and three real bearing datasets. The results consistently demonstrate the superiority of RCMFDE in detecting various patterns within synthetic and real bearing fault data. Importantly, classifiers built upon RCMFDE achieve notably high accuracy values for bearing fault diagnosis applications, outperforming classifiers based on refined composite multiscale dispersion and sample entropy methods.

1. Introduction

Rotating machines, such as gas turbines, industrial fans, aero-engines, gearboxes, and wind turbines, are widely used in different industrial and mechanical applications [1]. Rolling bearings are one of the most crucial and extensively used components in most rotating machines [2]. Because of improper initial assembly, low accuracy in manufacturing, and repetitively applied stress, bearing faults are unavoidable in long-term operations [3]. If bearings are not diagnosed and replaced promptly, it can cause disruptions in the operation of machines. For instance, bearing failures are accountable for around 40–50% of all failures that occur in electrical motors [4]. Thus, early fault detection using vibration data decreases maintenance costs and increases reliability [5,6].
Vibration signals involve the information on the dynamic features of machines and structures. Hence, their analysis is one of the conventional fault detection methods in rotating machines. Vibration signals generally represent nonlinear behavior due to effects associated with coupling, interactions, friction, damping, and nonlinear stiffness [7,8]. Therefore, the capabilities of linear feature extraction techniques have been limited in fault diagnosis [9], and researchers have focused on detecting nonlinear dynamical characteristics to improve fault diagnosis capabilities [10,11].
Due to various faults in ball bearings, including inner race faults, outer race faults, and rolling element faults, impacts with frequencies associated with the faults are generated. These impacts lead to the resonant excitation of the bearing. As a result, in each fault signal, the impacts are modulated by the much higher resonant frequencies of the bearing [12]. As a result, each fault creates different changes in signal complexity at different time scales. Hence, measuring signal complexity by calculating entropy over different scales (multiscale algorithms) is extensively applied to bearing fault diagnoses [13,14,15].
Entropy, as a measure of the irregularity and unpredictability of signal, is a powerful concept employed for evaluating the nonlinear features of a signal [16]. Sample entropy (SE), fuzzy entropy (FE), permutation entropy (PE) and fuzzy entropy (FE) are common entropy methods. Their advantages, disadvantages and some references of biomedical and mechanical applications are presented in Table 1.
Nevertheless, DE is sensitive to its parameters, particularly the number of classes and embedding dimension [19]. To overcome these limitations, we have recently developed fuzzy DE (FDE) based on fuzzy membership functions for signal quantization and DE [19]. However, similarly to SE, FE, PE, and DE, FDE is unable to consider the multiple time scales that are present in data.
In order to overcome this limitation, Costa et al. [36] proposed multiscale SE (MSE) as a method for estimating the complexity of univariate data using the coarse-graining (CG) process. However, MSE inherits the SE limitations. Similarly, multiscale PE [37] and multiscale FE [38] have the shortcoming of PE and FE, respectively.
Apart from that, the CG procedure causes the signal length to be shorter as the scale factor increases. As a result, the higher the scale factor, the lower the accuracy of entropy [39]. To address this problem, Wu et al. [40] proposed composite MSE (CMSE) to improve the accuracy of MSE. Afterwards, proposing refined composite MSE (RCMSE), Wu et al. [41] decreased the probability of the undefined values of SE in the multiscale algorithm in addition to improving the accuracy of MSE. Multiscale algorithm refinement is also conducted in other studies, including refined composite multiscale fuzzy entropy (RCMFE) by Azami et al. [42], refined composite multiscale permutation entropy (RCMPE) by Humeau-Heurtier et al. [43], and refined composite multiscale dispersion entropy (RCMDE) by Azami et al. [33].
Wang et al. [44] used MDE to extract the features of bearing vibration signals, while Congzhi et al. [45], Zhang et al. [46], and Luo et al. [47] employed RCMDE for this purpose. Also, different techniques are applied with RCMDE, including fast ensemble empirical mode decomposition [48], adaptive sparest narrow-band decomposition [49], improved empirical wavelet transform [50,51], variational mode decomposition (VMD) [52], and improved VMD [14].
Nevertheless, all above-mentioned multiscale algorithms have the shortcomings of their corresponding entropy algorithms. To address these shortcomings, based on the advantages of FDE over existing entropy algorithms, multiscale fuzzy dispersion entropy (MFDE) and refined composite MFDE (RCMFDE) are developed in this article. The ability of these methods is evaluated by various synthetic and real datasets.
This paper is structured as follows: In Section 2.1 and Section 2.2, the descriptions of MFDE and RCMFDE are provided, respectively. Section 3 briefly describes the synthetic and real datasets used in this study. In Section 4.1, Section 4.2 and Section 4.3, the ability of RCMFDE to calculate complexities associated with white noise, logistic map series, and chirp signal is compared to MDE, RCMDE, and MFDE. In Section 4.4 and Section 4.5, the sensitivity to the signal length and the computation time of RCMFDE are investigated. Section 4.6 and Section 4.7 present the proposed method’s capability to distinguish between faulty and healthy bearings for simulated signals and the effect of noise on its performance. Section 4.8 evaluates the performance of the proposed method in fault diagnosis using three different datasets. Finally, Section 5 provides a conclusion.

2. Methods

In this paper, FDE is extended to RCMFDE and MFDE. This method is explained as follows.

2.1. Multiscale Fuzzy Dispersion Entropy

2.1.1. Coarse-Graining

The assessment of complexity in univariate signals is often accomplished via the utilization of a multiscale entropy framework, which encompasses two fundamental steps: the process of coarse graining to encompass multiple temporal scales and the evaluation of irregularity for each of these scales using entropy estimators.
x ( τ ) = { x 1 ( τ ) , x 2 ( τ ) , }  at scale  τ  of series  u = { u 1 , u 2 , , u L }  of length L is defined as follows:
x j ( τ ) = 1 τ b = τ ( j 1 ) + 1 τ j u b , 1 j L τ

2.1.2. Multiscale Fuzzy Dispersion Entropy Calculation

MFDE calculates FDE over some consecutive temporal scales. The FDE of each coarse graining signal  x ( τ )  is calculated. What is of note is that the average and standard deviation (SD) of the original signal remain unchanged for all scale factors, in agreement with keeping parameter r constant when calculating MSE [36].

2.1.3. Fuzzy Dispersion Entropy

Fuzzy dispersion entropy (FDE) for time series  x = { x 1 , x 2 , , x N }  of length  N  can be calculated using six steps [19]:
Step (1): First, time series x is normalized between 0 and 1 to obtain  y = { y 1 , y 2 , , y N } . Different linear and non-linear methods can be employed for this normalization [16,18]. However, the utilization of a linear mapping technique may result in an issue where the majority of xi values are assigned to only a few classes, especially when the maximum or minimum values deviate significantly from the signal’s mean/median values [16]. Consequently, DE with linear mapping exhibits poor performance in characterizing signals [16,18]. Many natural processes follow a pattern that starts slowly and accelerates, ultimately approaching a climax over time, similarly to a sigmoid function [7,53,54]. In cases where a detailed description is unavailable, a sigmoid function is commonly used [53,55]. Various sigmoid functions are available [18]. In accordance with the original formulation of DE [16], the normal cumulative distribution function, as a widely recognized sigmoid, was used. Series  y  is obtained from the normal cumulative distribution function of series  x  according to Equation (2):
y i = 1 σ 2 π x i e ( t γ ) 2 2 σ 2 d t
where  σ  and  γ  are the SD and average of time series  x .
Step (2): In this step, time series  y  is mapped onto classified time series  z c  [16]. Each  y i  is multiplied by  c  and summed with 0.5.
z i c = c y i + 0.5
where  z i c  is the ith member of series  z c , and  c  is the class parameter indicating the number of all classes that can belong to  z i c  [16].
Step (3): In DE,  z i c  belongs to the kth class if it is closer to integer k [16]. Since ambiguity in allocating the members of series  z c  occurs in the boundaries of two classes, a fuzzy membership function  M k  is defined for each class, and  μ M k ( z i c )  represents the degree of membership of  z i c  with respect to the kth class. Every  z i c  is assigned to one or two classes (using integer indexes where  k = 1 , , c ).
For designing a fuzzy membership function related to each class, the following conditions must be met:
  • There is no boundary at the starting points of class 1 and end points of class c with other classes. Therefore, if  z i c  is lower than 1 and higher than c, its degree of membership to classes 1 and c is equal to 1.
  • The sum of the membership values of  z i c  in different classes must be equal to 1.
    k = 1 c μ M k ( z i c ) = 1
  • For a series of random numbers, the fuzzy membership functions possess equal relative cardinality.
  • The overlap of the fuzzy membership function of each class with that of the adjoining classes can be 1 at most.
As mentioned above, different membership functions can be applied. This study employs triangular membership functions for classes  k = 2 , , c 1  and trapezoidal membership functions for classes 1 and  c . The applied fuzzy functions are expressed as follows:
μ M 1 ( α ) = { 0                                       α > 2 2 - α                   1 α 2 1                                       α < 1
μ M k ( α ) = { 0                                             α < k + 1 k + 1 α                           k α k + 1 α k + 1                           k 1 α k 0                                               α < k - 1                           k = 2 , , c - 1
μ M c ( α ) = { 1                                               α > c α c + 1               c 1 α c 0                                             α < c 1
Step (4): Time series  z j m , c  with time delay  d  and embedding dimension  m  is constructed according to Equation (8):
z j m , c = { z j c , z j + ( 1 ) d c , , z j + ( m 1 ) d c } , j = 1 , 2 , , N ( m + 1 ) d
Step (5): Dispersion patterns  π v 0 v 1 v m 1  in the context of dispersion entropy refer to the distribution of data points within each embedded time series of length m. These embedded time series are generated by embedding the digitized versions of the original time series data into discrete classes [16,18].
For each time series embedded into the dimensions of m and a given number of classes c, there exists a potential for the occurrence of  c m  dispersion patterns. Figure 1 illustrates all potential dispersion patterns for m = 2 and c = 4.
Each vector  z j m , c  is mapped onto different dispersion patterns  π v 0 v 1 v m 1  based on its membership values so that the following is the case:
z j c   is   class   v 0   and   z j + ( 1 ) d c   is   class   v 1 , ,   and   z j + ( m 1 ) d c   is   class   v m 1   ,   if   and   only   if   z j m , c   is   π v 0 v 1 v m 1 .  When multiple states need to be true simultaneously (i.e., AND operator), t-norm is applied. The algebraic product operator is a t-norm, which is applied in the above fuzzy expression [19]:
μ π v o v 1 v m 1 ( z j m , c ) = i = 0 m 1 μ M v i ( z j + i d c )
According to Equation (9), the degree of membership of  z j m , c  with respect to the pattern  π v 0 v 1 v m 1  is equal to the product of the degree of membership of each  z j + i d c  with respect to class  v i , where  i = 0 , 1 , , m 1  and  j = 1 , 2 , , N ( m 1 ) d .
Step (6): For each  c m  of dispersion pattern  π v 0 v 1 v m 1 , the probability of presence in the time series is calculated. For this purpose, the sum of the membership degrees of dispersion patterns  π v 0 v 1 v m 1 , attributed to all series  z j m , c , must be divided by the total number of embedded signals with embedding dimension m:
p ( π v 0 v 1 v m 1 ) = j = 1 N ( m 1 ) d μ π v 0 v 1 v m 1 ( z j m , c ) N ( m 1 ) d
Step (7): Finally, based on Shannon entropy, FDE is calculated as follows:
F D E ( x , m , c , d ) = π = 1 c m P ( π v 0 v 1 v m 1 ) ln P ( π v 0 v 1 v m 1 )

2.2. Refined Composite Multiscale Fuzzy Dispersion Entropy

In calculating RCMFDE, for scale factor  τ , different  τ  time series are created, corresponding to different starting points of the CG process. The kth coarse-grained time series  x k ( τ ) = { x k , 1 ( τ ) , x k , 2 ( τ ) , }  of the original time series  u = { u 1 , u 2 , , u L }  is obtained as follows:
x k , j ( τ ) = 1 τ b = k + τ ( i 1 ) k + τ j 1 u b , 1 j L , 1 k τ
The relative frequency of the fuzzy dispersion patterns of each of the  τ  time series is calculated.
The Shannon entropy of the average relative frequencies of fuzzy dispersion patterns for the  τ  time series created by different beginning points in the CG process is equal to RCMFDE. Therefore, RCMFDE for each scale factor is defined as follows:
RCMFDE ( x , m , c , d , τ ) = p ¯ ( π v 0 v 1 v m 1 ) . ln ( p ¯ ( π v 0 v 1 v m 1 ) )
In this equation,  p ¯ ( π v 0 v 1 v m 1 ) = 1 τ 1 τ p k ( τ ) ( π v 0 v 1 v m 1 ) ,  where  p k ( τ ) ( π v 0 v 1 v m 1 )  is the relative frequency of fuzzy dispersion pattern  π v 0 v 1 v m 1  in time series  x k ( τ ) .
The number of possible dispersion patterns is recommended to be lower than the signal length  ( c m < L ) . For MFDE, the CG process decreases the signal length to  L τ max . Thus, for MFDE, it is suggested that  c m < L τ max . In RCMFDE, the  τ  coarse-grained time series of length  L τ max  are taken into account. Therefore, the number of all samples calculated in RCMFDE is  τ × L τ max L ,  and RCMFDE with the same length of  c m < L  gives reliable results. This particular feature is a matter of importance in short signals.
This study utilizes parameters m = 2, c = 3, and d = 1 to compute MDE, RCMDE, MFDE, and RCMFDE.

3. Evaluation Signals

To evaluate the effectiveness of RCMFDE to characterize different univariate time series and bearing fault diagnosis, we employ the following synthetic and bearing datasets.

3.1. Synthetic Signals

3.1.1. White Gaussian Noise and  1 f  Noise

White Gaussian noise (WGN) and  1 f  noise (pink noise) have been widely used for evaluating multiscale entropy techniques since WGN is less complex but more irregular than pink noise [33,56,57,58].

3.1.2. Logistic Map

The logistic map is a simple mathematical model that plays a key role in chaos theory since it illustrates the emergence of chaotic behavior from a relatively simple nonlinear equation. It is often used as a prototype example to understand the dynamics of chaotic systems [59]. The logistic map time series  x = { x 1 , x 2 , , x n }  is defined as follows [60,61]:
x i + 1 = r x i ( 1 x i ) , x 1 = 0 . 1 ,   i = 1 , 2 , 3 ,
where  x i  shows the logistic map at time step i, and it symbolizes the population at year i. As a result,  x 0  signifies the initial population at time step 0, specifically set as  x 0 = 0.1 . The parameter r functions as a control factor, representing a positive combined rate that encompasses both reproduction and starvation effects [62]. The first  10 5  iterations of Equation (14) are ignored due to the transient behavior of the solution [63]. Chaotic behaviors occur for  3.57 r 4  [61]. The logistic map was used to evaluate the performance of MFDE and RCMFDE in estimating the complexity of data.

3.1.3. Chirp Signal and Amplitude-Modulated Chirp Signal

To investigate the relationship of the proposed methods with variations in time and frequency domains, two types of signals were synthesized. For the first type of signal, a constant-amplitude chirp signal was selected, with its frequency logarithmically varying within the range of 2 to 15 Hz. For the second type, the same signal as the first type was modulated with a pure sinusoidal wave. These two signals were generated with a sampling frequency of 100 Hz and a duration of 40 s.

3.1.4. Faulty Bearing Simulation

A local fault in a bearing produces a periodic impact signal that leads to the resonant excitation of the bearing; therefore, it is modulated by the significantly higher resonant frequencies of the bearing [12]. The simulated vibration signal for a bearing of a rotating machine with outer ring damage is defined as follows [8]:
x ( t ) = x series   of   impulses + x harmonic   component + n ( t )
where  x s e r i e s o f i m p u l s e s  and  x h a r m o n i c c o m p o n e n t  are the series of impulses and the harmonic component, respectively. Also,  n ( t )  represents noise. Based on previous studies [8,64,65],  x s e r i e s o f i m p u l s e s  is modeled by Equation (14) [8].
x series   of   impulses = k = 1 m n = 1 n A e 2 ξ π f n ( t k f f i = 1 k τ k ) sin ( 2 π f n 1 ξ 2 ( t k f f i = 1 k τ k ) )
τ k  is a representation of a small and random fluctuation in the time interval between two successive impulses. The frequency of the impulse train signal is considered equal to  f f  without taking into account the impact of accidental slipping by the balls and taking into account a constant period. Nevertheless, considering the ball, the slipping effect changes the period randomly to  k f f τ k  [8]. For each k τ k  is assumed to be a random number from a normal distribution of zero average and SD  σ τ = 0.005 × 1 f f  [8].
Equation (17) defines the harmonic component with two sine functions [12,66]:
x harmonic   component = m = 1 2 B m sin ( 2 π m f r t )
This paper assumes the fault characteristic frequency and damping coefficient as  f f = 100 Hz  and  ξ = 0.03 , respectively. Also,  f 1 = 2 k Hz  and  f 2 = 3.5 k Hz  are the resonant frequencies of the bearing. The impulse amplitude magnitude factors are  A 1 = 0.4  and  A 2 = 0.5 , which specifies the damage intensity. The first and second harmonic amplitudes of the rotor are  B 1 = 0.2  and  B 2 = 0.12 , respectively.

3.2. Bearing Datasets

3.2.1. Paderborn University Dataset

Ball bearing data were provided by the KAT datacenter in Paderborn University [67,68]. The experimental setup includes an electric motor, a torque meter, a flywheel, a bearing test module, and motor load. Bearings with different fault conditions are mounted on the test module to produce experimental data.
Datasets used in this paper involve four different bearing fault conditions: (1) healthy condition (H), (2) sharp trench on the outer ring (STO) by electrical discharge machining, (3) drilling on the outer ring (DO), and (4) artificial pitting on the outer ring (PO) by electric engraver. The used datasets are listed in Table 2. The vibration signals of rolling bearings in different operational states were gathered using a sampling frequency of 64,000 Hz, as demonstrated in Table 3.

3.2.2. PHMAP 2021 Data Challenge Dataset

A subset of the PHMAP 2021 data challenge dataset [54] was utilized. The equipment under investigation comprises an oil injection screw compressor featuring a 15 kW motor operating at 3600 rpm and a screw axis rotating at 7200 rpm. The data collected for this study were acquired using an accelerometer installed on the motor, with a sampling frequency of 10,544 Hz.
Datasets used in this paper involve three different fault conditions: (1) high V-belt looseness, (2) defective bearing, and (3) fault-free state.

3.2.3. Case Western Reserve University Dataset

The Case Western Reserve University (CWRU) dataset [69] was also employed to evaluate the proposed method’s performance in the discrimination of bearing faults. The dataset prepared by the bearing data center of CWRU is a standard reference in the field bearing fault diagnosis [70]. The experimental setup used in data acquisition includes a three-phase electric motor of 2 hp power, a dynamometer, and a self-aligning coupling.
In this study, 6205-2RS JEM SKF ball bearings were used. Single-point faults with different diameters were created on bearings via electrical discharge machining. Bearing vibration signals were gathered from an accelerometer mounted on the casing at the drive end of the motor.

4. Results and Discussion

4.1. Analysis of White Gaussian Noise and  1 f  Noise

One hundred independent white Gaussian and one hundred independent pink noise series of 1000 data point length were created. MFDE, MDE, RCMDE, and RCMFDE were then applied to these signals for scale factors 1–20 (Figure 2 and Figure 3).
In all the examined methods, the entropy of the time series of coarse-grained pink noise is kept almost constant, while it is reduced uniformly by increasing the scale for the WGN. Consequently, at low scale factors ( τ 3 ), the entropy of white noise is higher than the pink one. At high scale factors ( τ > 3 ), the entropy of pink noise is higher than that for the white noise. These results confirm the fact that the complexity of pink noises is higher than WGN while the uncertainty of WGN is more than that for the pink noise [56,57,71].
To assess the stability of the MDE, MFDE, RCMDE, and RCMFDE results, we calculated the SD of their results at each scale factor (Figure 4). The SD values suggest that MFDE and RCMDE, respectively, are more stable than MDE and RCMDE, and the lowest SD was obtained based on RCMFDE.

4.2. Analysis of Logistic Map

Three logistic map series  x = { x 10 5 + 1 , x 10 5 + 2 , , x 10 5 + 500 }  of length 500 samples with parameters of  r = { 3.7 ,   3.8 ,   3.9 }  based on Equation (14) are created, as shown in Figure 5. Theoretically, the complexity of four signals increases by increasing r.
RCMFDE, MFDE, MDE, and MFDE are calculated for these three series and one WGN for scales 1–20 (Figure 6). The results show that RCMFDE is the only method that, after scale 5 (6 to 20), exhibits curves that conform with the arrangement of complexity among different r values. The results suggest that RCMFDE is the most appropriate measure of complexity in comparison with MDE, RCMDE, and MFDE.

4.3. Analysis of Chirp signals and Amplitude-Modulated Chirp Signal

One chirp signal and one modulated chirp signal, as described in the section, are used to investigate the impact of domain and frequency variations of sinusoidal signals. These two signals are depicted in Figure 7a,b. A moving window of length of 500 samples slid over the signals with an 80% overlap between windows. For each isolated signal, the values of RCMFDE, MFDE, RCMDE, and MDE were computed.
As depicted in Figure 7c,e,g,i, all methods adeptly capture frequency variations. In the initial segments of the signals where the frequency is lower, smaller scale values exhibit higher entropy. Conversely, as frequency increases, the entropy in higher scales also increases. Furthermore, Figure 7d,f,h,j. demonstrate that all methods exhibit domain variations in the modulated signal. However, in scales smaller than 10 and window sizes ranging from 1 to 150, while both RCMFDE and MFDE are capable of indicating domain changes, RCMDE and MDE are less effective at detecting these domain variations within this segment of the signal and for scales below 10.

4.4. Sensitivity to Signal Length

In this section, we conduct a comparative analysis of RCMFDE, MFDE, RCMDE, and MDE in terms of their sensitivity to signal length. To achieve this objective, we employ WGN and  1 f  noise with varying sample points denoted as N. The signal lengths are systematically varied, spanning from 100 to 5000 samples. For each unique value of N, 100 independent WGN and  1 f  noise signals are generated.
The standard deviation (SD) of the obtained results at scale  τ  = 5, 10, and 15 is computed and presented in Figure 8. The findings underscore several key observations: Firstly, as the values of N increase, the corresponding SDs decrease, yielding more stable outcomes. Secondly, when comparing the SD of outcomes obtained via RCMFDE and MFDE with those of RCMDE and MDE, it becomes evident that the former exhibits lower SDs. Consequently, the outcomes obtained from RCMFDE and MFDE demonstrate greater stability compared to those of MDE and RCMDE.

4.5. Computation Time

To assess the computational efficiency of RCMFDE and RMFDE in comparison to RCMSE, MSE, RCMDE, and MDE, we employ the white Gaussian noise (WGN) sequences of varying lengths, ranging from 500 to 5000 sample points. The outcomes of these evaluations are illustrated in Figure 9. The simulations were executed on an Asus laptop equipped with an Intel(R) Core(TM) i5-8250U processor operating at 1.6 GHz and 8 GB of RAM, utilizing MATLAB R2021a.
As illustrated in Figure 9, although the computation time for RCMFDE is greater than that of RCMDE, and similarly, the computation time for MFDE exceeds that of MDE, the computation time for RCMFDE in comparison to RCMSE, as well as for RMFDE in comparison to RMSE, is significantly lower. These results are in agreement with the fact that the computational complexity of calculating SE is O(N2), while DE approaches have the computational complexity of O(N2) [18,72].

4.6. Simulated Bearing Signal Analysis

According to Section 3.1.3, fifty independent signals of faulty and healthy bearings with a length of 2048 data points and a sampling frequency of 40 kHz are simulated in this section. Also,  n ( t )  is assumed to be a WGN so that the variance of the signal-to-noise ratio (SNR) is 0.257 [73]. By eliminating the fault impulses, the healthy bearing signal is modeled. Figure 10 depicts an instance of simulated signals with and without noise.
The MFDE, RCMFDE, MDE, and RCMDE of the simulated signals are calculated at 20 time scales. Based on the means and SDs of the results, as depicted in Figure 11, only the results of RCMFDE at three specific scales are distinctly separable without overlap, while the results of other methods exhibit overlap across all scales.
For each scale factor, Student’s t-test is used to examine statistical differences. The scale factors with a p-value between 0.05 and 0.01 (significant) and lower than 0.01 (very significant) are indicated with symbols + and ∗ in Figure 11. The RCMDE-based results have very significant difference at 18 scale factors (all scales except scales 9 and 10). However, MFDE, RCMDE, and MDE, respectively, lead to (very) significant differences at only 16, 16, and 14 scale factors. This fact suggests that RCMFDE has a higher capability of discrimination between the simulated signals of faulty and healthy bearings than MFDE, RCMDE, and MDE.
Furthermore, the Hedges’ g effect size [74] was employed to assess the distinguishing capability between simulated signals from faulty and healthy bearings. The results are presented in Table 4. The effect sizes of the RCMFDE and MFDE outcomes, when compared to RCMDE and MDE, consistently exhibit higher values across nearly all scales, except for three specific scales. This observation underscores the superior ability of RCMFDE and MFDE in distinguishing between simulated faulty bearings and healthy bearings. Moreover, the effect size of RCMFDE results consistently exceeds that of MFDE across all scales. Consequently, RCMFDE exhibits a greater capacity, relative to MFDE, in effectively distinguishing between simulated faulty bearings and healthy ones.

4.7. Noise Effect

In order to indicate the effect of adding noise to bearing signals, 50 independent realizations of WGNs were added to faulty bearing signals at different SNRs, and the sensitivities of MFDE, RCMFDE, MDE, and RCMDE to noise are evaluated. According to Section 3.1.3, fifty faulty bearing signals of 2048 data point length and a sampling frequency of 40 kHz are simulated without adding noise.
NrmEntN(i) is the measure of sensitivity to WGN in scale i [18].
NrmEntN ( i ) = entropy   of   a   series   with   noise   in   scale i entropy   of   a   series   without   noise   in   scale i
NrmEntN is calculated for MFDE, RCMFDE, MDE, and RCMDE for five scales by adding the WGN of different SNRs (0, 5, and 40 dB) to simulated signals. Figure 12 shows a simulated signal with/without the noise of different SNRs. Figure 13 and Table 5 present the average and SD of NrmEntN for different entropy methods over five scales.
The NrmEntN values obtained based on MFDE and RCMFDE, compared with MDE and RCMDE, have average values closer to 1 and also have a lower SD values. Therefore, MFDE and RCMFDE have lower sensitivities relative to WGN than MDE and RCMDE, and they are more resistant to noise. In addition, the SD of NrmEntN values in the RCMFDE method is lower than that for MFDE, indicating that RCMFDE is less sensitive to noise than MFDE.

4.8. Experimental Data Analysis

4.8.1. Fault Diagnosis with respect to the Paderborn University Bearing Dataset

There are 60 measured datasets for each fault condition of the bearings. Five samples with a length of 2048 were separated from each measured dataset, thus generating 300 samples for each fault condition. MSE, RCMSE, MDE, RCMDE, MFDE, and RCMFDE were calculated for all signals over 20 scales. The results of each method were classified. From the signals for each fault condition, 480, 120, and 600 samples are utilized as training, validation, and test data, respectively.
A multiclass adaptive neuro-fuzzy inference system with fuzzy c-means clustering (FCM-ANFIS) [8] was used as the classifier in this study. A binary vector was applied as the target vector for each fault condition. Since four fault conditions were examined in this section, the length of each binary vector was 4, and the applied classifier was composed of four FCM-ANFIS; each determines one entry of the target vector.
The classification approach was repeated twenty times. The results are presented in Figure 14 and Table 6, indicating the higher average classification accuracy of features resulting from RCMFDE and MFDE compared to RCMDE and MDE, respectively. This suggests that MFDE and RCMFDE are more appropriate than MDE and RCMDE for pattern detection in bearing fault conditions. The highest average classification accuracy is 98.11%, obtained for features extracted by RCMFDE. This fact indicates that RCMFDE is the most suitable feature extraction method. Details of fault classification with the highest accuracy conducted by RCMFDE are presented in Table 7.

4.8.2. Fault Diagnosis on PHMAP 2021 Data Challenge Dataset

In this section, we utilized three fault conditions from the PHMAP 2021 Data Challenge Dataset, as outlined in Section 2.2. For each of these conditions, we extracted three hundred independent signal samples, each consisting of 1024 data points.
We employed various multiscale entropy-based techniques, specifically MSE (m = 2, r = 0.15 × SD of original signal), RCMSE (m = 2, r = 0.15 × SD of original signal), MDE, RCMDE, MFDE, and RCMFDE, to analyze all signals across 20 different scales. The resulting values from these methods were employed as features for the purpose of fault diagnosis.
For the classification process, we utilized the multiclass FCM-ANFIS classifier [31]. Since we examined three distinct fault conditions, the target binary vector length was set to 3. The classifier was constructed using three FCM-ANFIS models. For each specific condition, we allocated 120 samples for training, 30 samples for validation, and 150 samples for testing. These data were classified 20 times using multiclass FCM-ANFIS.
The accuracies of this classification process are visualized in Figure 15 and summarized in Table 8. The results demonstrate the superior performance of RCMFDE when compared to other multiscale entropy algorithms in extracting relevant bearing features. Detailed information about the fault classification with the highest accuracy achieved using RCMFDE is presented in Table 9.

4.8.3. Fault Diagnosis on the Case Western Reserve University (CWRU) Bearing Dataset

All 16 fault conditions from the CWRU bearing dataset were used when the sampling frequency was 12,000 Hz. The examined fault conditions are demonstrated in Table 10. For each of these conditions, we extracted 220 independent signal samples, each consisting of 2048 data points. In each condition, the motor shaft rotated at 1730, 1750, 1772, and 1797 rpm speeds.
Multiclass FCM-ANFIS was also used as the classifier for this dataset. Since 16 fault conditions were examined in this section, the target binary vector length was assumed to be 16, and the classifier is made from 16 FCM-ANFIS. The training dataset consisted of 80 signals, the validation dataset consisted of 20 signals, and the testing dataset consisted of 120 signals for each bearing fault condition.
MSE (m = 2, r = 0.15×SD of original signal), RCMSE (m = 2, r = 0.15×SD of original signal), MDE, RCMDE, MFDE, and RCMFDE were calculated for all signals, and the values of these methods were employed as features for the fault diagnosis.
These data were classified by multiclass FCM-ANFIS. The results are presented in Figure 16 and Table 11, indicating the higher average classification accuracy based on RCMFDE. It suggests that RCMFDE is more appropriate than the other existing multiscale entropy algorithms for extracting bearing features. The details of fault classification with the highest accuracy using RCMFDE are presented in Table 12.
Considering the satisfactory results achieved with real and synthetic signals, the proposed method can find practical industrial applications. However, in future research endeavors, RCMFDE can be employed to utilize the processed data via other signal processing methods, such as wavelet, VMD, etc., further enhancing its fault detection capabilities in industrial applications.

5. Conclusions

This paper introduced RCMFDE as a measure of signal complexity and recommended using it when extracting the features of bearing vibration signals. RCMFDE, compared with MDE, MFDE, and RCMDE, calculated signal complexity with more reliability and stability, which was confirmed using different synthetic and real datasets. Although the behavior of (RC)MFDE was similar to (RC)MDE for white and pink noise, the former led to lower SDs and consequently was more stable than the latter. In simulated bearing signals, the results of RCMFDE indicated a significant difference between faulty and healthy conditions over the majority of scales. Additionally, (RC)MFDE resulted in higher resistance against noise than (RC)MDE. In fault diagnosis by three empirical datasets, features obtained from RCMFDE resulted in higher classification accuracy than MSE, RCMSE, MDE, RCMDE, and MFDE. Overall, these findings suggest the superiority of RCMFDE over the conventional multiscale entropy methods in bearing feature extraction.

Author Contributions

Conceptualization, M.R.A.; Methodology, H.A.; Software, M.R.; Investigation, M.M.K.; Writing—original draft, M.R.; Writing—review & editing, H.A.; Visualization, M.R.; Supervision, M.M.K.; Project administration, M.R.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

The data that use in this study are openly available in CWRU datasets at https://engineering.case.edu/bearingdatacenter, PHMAP 2021 datasets at http://phmap.org/data-challenge, and KAt datasets at https://mb.uni-paderborn.de/kat/forschung/datacenter/bearing-datacenter/.

Acknowledgments

We express our profound gratitude to the anonymous reviewers whose insightful comments have contributed to the enhancement of our work’s quality.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

CGCoarse graining
CMSEComposite multiscale sample entropy
CWRUCase Western Reserve University
DEDispersion entropy
DODrilling on the outer ring
FDEFuzzy dispersion entropy
FCM-ANFISAdaptive neuro-fuzzy inference system with fuzzy c-means
FEFuzzy entropy
HHealthy condition
M.Multiscale
MDEMultiscale dispersion entropy
MFDEMultiscale fuzzy dispersion entropy
MPEMultiscale permutation entropy
MSEMultiscale sample entropy
PEPermutation entropy
PHMAP 2021Asia Pacific Conference of the Prognostics and Health Management Society 2021
POPitting on the outer ring
RCRefined composite
RCMDERefined composite multiscale dispersion entropy
RCMFDERefined composite multiscale fuzzy dispersion entropy
RCMFERefined composite multiscale fuzzy entropy
RCMPERefined composite multiscale permutation entropy
RCMSERefined composite multiscale sample entropy
SESample entropy
SDStandard deviation
SNRSignal-to-noise ratio
STOSharp trench on the outer ring
VMDVariational mode decomposition
WGNWhite Gaussian noise

References

  1. Yan, X.; Jia, M. Intelligent Fault Diagnosis of Rotating Machinery Using Improved Multiscale Dispersion Entropy and MRMR Feature Selection. Knowl. Based Syst. 2019, 163, 450–471. [Google Scholar] [CrossRef]
  2. Zhang, L.; Xiong, G.; Liu, H.; Zou, H.; Guo, W. Bearing Fault Diagnosis Using Multi-Scale Entropy and Adaptive Neuro-Fuzzy Inference. Expert Syst. Appl. 2010, 37, 6077–6085. [Google Scholar] [CrossRef]
  3. Wu, S.-D.; Wu, C.-W.; Wu, T.-Y.; Wang, C.-C. Multi-Scale Analysis Based Ball Bearing Defect Diagnostics Using Mahalanobis Distance and Support Vector Machine. Entropy 2013, 15, 416–433. [Google Scholar] [CrossRef]
  4. Nandi, S.; Toliyat, H.A.; Li, X. Condition Monitoring and Fault Diagnosis of Electrical Motors—A Review. IEEE Trans. Energy Convers. 2005, 20, 719–729. [Google Scholar] [CrossRef]
  5. Heng, A.; Zhang, S.; Tan, A.C.C.; Mathew, J. Rotating Machinery Prognostics: State of the Art, Challenges and Opportunities. Mech. Syst. Signal Process. 2009, 23, 724–739. [Google Scholar] [CrossRef]
  6. Lei, Y.; Lin, J.; He, Z.; Zuo, M.J. A Review on Empirical Mode Decomposition in Fault Diagnosis of Rotating Machinery. Mech. Syst. Signal Process. 2013, 35, 108–126. [Google Scholar] [CrossRef]
  7. Rostaghi, M.; Reza, M.; Azami, H. Application of Dispersion Entropy to Status Characterization of Rotary Machines. J. Sound Vib. 2019, 438, 291–308. [Google Scholar] [CrossRef]
  8. Rostaghi, M.; Khatibi, M.M.; Ashory, M.R.; Azami, H. Bearing Fault Diagnosis Using Refined Composite Generalized Multiscale Dispersion Entropy-Based Skewness and Variance and Multiclass FCM-ANFIS. Entropy 2021, 23, 1510. [Google Scholar] [CrossRef]
  9. Tian, Y.; Wang, Z.; Lu, C. Self-Adaptive Bearing Fault Diagnosis Based on Permutation Entropy and Manifold-Based Dynamic Time Warping. Mech. Syst. Signal Process. 2019, 114, 658–673. [Google Scholar] [CrossRef]
  10. Li, Y.; Wang, X.; Liu, Z.; Liang, X.; Si, S.; Member, S. The Entropy Algorithm and Its Variants in the Fault Diagnosis of Rotating Machinery: A Review. IEEE Access 2018, 6, 66723–66741. [Google Scholar] [CrossRef]
  11. Singh, A.; Kankar, P.K.; Kumar, N.; Singh, S. Bearing Fault Detection and Recognition Methodology Based on Weighted Multiscale Entropy Approach. Mech. Syst. Signal Process. 2021, 147, 107073. [Google Scholar] [CrossRef]
  12. Kim, S.; An, D.; Choi, J.-H. Diagnostics 101: A Tutorial for Fault Diagnostics of Rolling Element Bearing Using Envelope Analysis in MATLAB. Appl. Sci. 2020, 10, 7302. [Google Scholar] [CrossRef]
  13. Li, Y.; Xu, M.; Wei, Y.; Huang, W. A New Rolling Bearing Fault Diagnosis Method Based on Multiscale Permutation Entropy and Improved Support Vector Machine Based Binary Tree. Measurement 2016, 77, 80–94. [Google Scholar] [CrossRef]
  14. Wang, Q.; Xiao, Y.; Wang, S.; Liu, W.; Liu, X. A Method for Constructing Automatic Rolling Bearing Fault Identification Model Based on Refined Composite Multi-Scale Dispersion Entropy. IEEE Access 2021, 9, 86412–86428. [Google Scholar] [CrossRef]
  15. Zheng, J.; Pan, H.; Cheng, J. Rolling Bearing Fault Detection and Diagnosis Based on Composite Multiscale Fuzzy Entropy and Ensemble Support Vector Machines. Mech. Syst. Signal Process. 2017, 85, 746–759. [Google Scholar] [CrossRef]
  16. Rostaghi, M.; Azami, H. Dispersion Entropy: A Measure for Time-Series Analysis. IEEE Signal Process. Lett. 2016, 23, 610–614. [Google Scholar] [CrossRef]
  17. Richman, J.S.; Moorman, J.R. Physiological Time-Series Analysis Using Approximate Entropy and Sample Entropy. Am. J. Physiol. Circ. Physiol. 2000, 278, H2039–H2049. [Google Scholar] [CrossRef]
  18. Azami, H.; Escudero, J. Amplitude- and Fluctuation-Based Dispersion Entropy. Entropy 2018, 20, 210. [Google Scholar] [CrossRef]
  19. Rostaghi, M.; Khatibi, M.M.; Ashory, M.R.; Azami, H. Fuzzy Dispersion Entropy: A Nonlinear Measure for Signal Analysis. IEEE Trans. Fuzzy Syst. 2021, 30, 3785–3796. [Google Scholar] [CrossRef]
  20. Ni, Q.; Feng, K.; Wang, K.; Yang, B.; Wang, Y. A Case Study of Sample Entropy Analysis to the Fault Detection of Bearing in Wind Turbine. Case Stud. Eng. Fail. Anal. 2017, 9, 99–111. [Google Scholar] [CrossRef]
  21. Alcaraz, R.; Abásolo, D.; Hornero, R.; Rieta, J.J. Optimal Parameters Study for Sample Entropy-Based Atrial Fibrillation Organization Analysis. Comput. Methods Programs Biomed. 2010, 99, 124–132. [Google Scholar] [CrossRef] [PubMed]
  22. Lin, T.-K.; Liang, J.-C. Application of Multi-Scale (Cross-) Sample Entropy for Structural Health Monitoring. Smart Mater. Struct. 2015, 24, 85003. [Google Scholar] [CrossRef]
  23. Chen, W.; Wang, Z.; Xie, H.; Yu, W. Characterization of Surface EMG Signal Based on Fuzzy Entropy. IEEE Trans. Neural Syst. Rehabil. Eng. 2007, 15, 266–272. [Google Scholar] [CrossRef] [PubMed]
  24. Noman, K.; Li, Y.; Wen, G.; Patwari, A.U.; Wang, S. Continuous Monitoring of Rolling Element Bearing Health by Nonlinear Weighted Squared Envelope-Based Fuzzy Entropy. Struct. Health Monit. 2023, 14759217231163090. [Google Scholar] [CrossRef]
  25. Azami, H.; Li, P.; Arnold, S.E.; Escudero, J.; Humeau-Heurtier, A. Fuzzy Entropy Metrics for the Analysis of Biomedical Signals: Assessment and Comparison. IEEE Access 2019, 7, 104833–104847. [Google Scholar] [CrossRef]
  26. Bandt, C.; Pompe, B. Permutation Entropy: A Natural Complexity Measure for Time Series. Phys. Rev. Lett. 2002, 88, 174102. [Google Scholar] [CrossRef] [PubMed]
  27. Zanin, M.; Zunino, L.; Rosso, O.A.; Papo, D. Permutation Entropy and Its Main Biomedical and Econophysics Applications: A Review. Entropy 2012, 14, 1553–1577. [Google Scholar] [CrossRef]
  28. Vashishtha, G.; Chauhan, S.; Singh, M.; Kumar, R. Bearing Defect Identification by Swarm Decomposition Considering Permutation Entropy Measure and Opposition-Based Slime Mould Algorithm. Measurement 2021, 178, 109389. [Google Scholar] [CrossRef]
  29. Şeker, M.; Özbek, Y.; Yener, G.; Özerdem, M.S. Complexity of EEG Dynamics for Early Diagnosis of Alzheimer’s Disease Using Permutation Entropy Neuromarker. Comput. Methods Programs Biomed. 2021, 206, 106116. [Google Scholar] [CrossRef]
  30. Zunino, L.; Zanin, M.; Tabak, B.M.; Pérez, D.G.; Rosso, O.A. Forbidden Patterns, Permutation Entropy and Stock Market Inefficiency. Phys. A Stat. Mech. Its Appl. 2009, 388, 2854–2864. [Google Scholar] [CrossRef]
  31. Consolini, G.; De Michelis, P. Permutation Entropy Analysis of Complex Magnetospheric Dynamics. J. Atmos. Solar-Terr. Phys. 2014, 115, 25–31. [Google Scholar] [CrossRef]
  32. Kang, Y.; Cai, H.; Song, S. Study and Application of Complexity Model for Hydrological System. Shuili Fadian Xuebao (J. Hydroelectr. Eng.) 2013, 32, 5–10. [Google Scholar]
  33. Azami, H.; Rostaghi, M.; Abásolo, D.; Escudero, J. Refined Composite Multiscale Dispersion Entropy and Its Application to Biomedical Signals. IEEE Trans. Biomed. Eng. 2017, 64, 2872–2879. [Google Scholar] [PubMed]
  34. Azami, H.; Rostaghi, M.; Fernandez, A.; Escudero, J. Dispersion Entropy for the Analysis of Resting-State MEG Regularity in Alzheimer’s Disease. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 6417–6420. [Google Scholar] [CrossRef]
  35. Li, S.; Shang, P. Characterizing Nonlinear Time Series via Sliding-Window Amplitude-Based Dispersion Entropy. Fluct. Noise Lett. 2023, 22, 2350023. [Google Scholar] [CrossRef]
  36. Costa, M.; Goldberger, A.L.; Peng, C.-K. Multiscale Entropy Analysis of Complex Physiologic Time Series. Phys. Rev. Lett. 2002, 89, 68102. [Google Scholar] [CrossRef]
  37. Aziz, W.; Arif, M. Multiscale Permutation Entropy of Physiological Time Series. In Proceedings of the 2005 Pakistan Section Multitopic Conference, Karachi, Pakistan, 24–25 December 2005. [Google Scholar] [CrossRef]
  38. Zheng, J.; Cheng, J.; Yang, Y.; Luo, S. A Rolling Bearing Fault Diagnosis Method Based on Multi-Scale Fuzzy Entropy and Variable Predictive Model-Based Class Discrimination. Mech. Mach. Theory 2014, 78, 187–200. [Google Scholar] [CrossRef]
  39. Wu, S.; Wu, C.; Lee, K.; Lin, S. Modified Multiscale Entropy for Short-Term Time Series Analysis. Phys. A 2013, 392, 5865–5873. [Google Scholar] [CrossRef]
  40. Wu, S.-D.; Wu, C.-W.; Lin, S.-G.; Wang, C.-C.; Lee, K.-Y. Time Series Analysis Using Composite Multiscale Entropy. Entropy 2013, 15, 1069–1084. [Google Scholar] [CrossRef]
  41. Wu, S.; Wu, C.; Lin, S.; Lee, K.; Peng, C. Analysis of Complex Time Series Using Refined Composite Multiscale Entropy. Phys. Lett. A 2014, 378, 1369–1374. [Google Scholar] [CrossRef]
  42. Azami, H.; Fernández, A.; Escudero, J. Refined Multiscale Fuzzy Entropy Based on Standard Deviation for Biomedical Signal Analysis. Med. Biol. Eng. Comput. 2017, 55, 2037–2052. [Google Scholar] [CrossRef]
  43. Humeau-Heurtier, A.; Wu, C.-W.; Wu, S.-D. Refined Composite Multiscale Permutation Entropy to Overcome Multiscale Permutation Entropy Length Dependence. IEEE Signal Process. Lett. 2015, 22, 2364–2367. [Google Scholar] [CrossRef]
  44. Wang, Z.; Zheng, L.; Wang, J.; Du, W. Research on Novel Bearing Fault Diagnosis Method Based on Improved Krill Herd Algorithm and Kernel Extreme Learning Machine. Complexity 2019, 2019, 4031795. [Google Scholar] [CrossRef]
  45. Li, C.; Zheng, J.; Pan, H.; Liu, Q. Fault Diagnosis Method of Rolling Bearings Based on Refined Composite Multiscale Dispersion Entropy and Support Vector Machine. China Mech. Eng. 2019, 30, 1713. [Google Scholar]
  46. Zhang, X.; Zhao, J.; Teng, H.; Liu, G. A Novel Faults Detection Method for Rolling Bearing Based on RCMDE and ISVM. J. Vibroengineering 2019, 21, 2148–2158. [Google Scholar] [CrossRef]
  47. Luo, H.; He, C.; Zhou, J.; Zhang, L. Rolling Bearing Sub-Health Recognition via Extreme Learning Machine Based on Deep Belief Network Optimized by Improved Fireworks. IEEE Access 2021, 9, 42013–42026. [Google Scholar] [CrossRef]
  48. Zhang, W.; Zhou, J. A Comprehensive Fault Diagnosis Method for Rolling Bearings Based on Refined Composite Multiscale Dispersion Entropy and Fast Ensemble Empirical Mode Decomposition. Entropy 2019, 21, 680. [Google Scholar] [CrossRef] [PubMed]
  49. Luo, S.; Yang, W.; Luo, Y. Fault Diagnosis of a Rolling Bearing Based on Adaptive Sparest Narrow-Band Decomposition and Refined Composite Multiscale Dispersion Entropy. Entropy 2020, 22, 375. [Google Scholar] [CrossRef] [PubMed]
  50. Zheng, J.; Huang, S.; Pan, H.; Jiang, K. An Improved Empirical Wavelet Transform and Refined Composite Multiscale Dispersion Entropy-Based Fault Diagnosis Method for Rolling Bearing. IEEE Access 2020, 8, 168732–168742. [Google Scholar] [CrossRef]
  51. Cai, J.; Yang, L.; Zeng, C.; Chen, Y. Integrated Approach for Ball Mill Load Forecasting Based on Improved EWT, Refined Composite Multi-Scale Dispersion Entropy and Fireworks Algorithm Optimized SVM. Adv. Mech. Eng. 2021, 13, 1687814021991264. [Google Scholar] [CrossRef]
  52. Lv, J.; Sun, W.; Wang, H.; Zhang, F. Coordinated Approach Fusing RCMDE and Sparrow Search Algorithm-Based SVM for Fault Diagnosis of Rolling Bearings. Sensors 2021, 21, 5297. [Google Scholar] [CrossRef]
  53. Baranwal, G.; Vidyarthi, D.P. Admission Control in Cloud Computing Using Game Theory. J. Supercomput. 2016, 72, 317–346. [Google Scholar] [CrossRef]
  54. Data Challenge at PHMAP 2021. Available online: http://phmap.org/data-challenge/ (accessed on 18 June 2021).
  55. Duch, W. Uncertainty of Data, Fuzzy Membership Functions, and Multilayer Perceptrons. IEEE Trans. Neural Netw. 2005, 16, 10–23. [Google Scholar] [CrossRef] [PubMed]
  56. Costa, M.; Goldberger, A.L.; Peng, C.K. Multiscale Entropy Analysis of Biological Signals. Phys. Rev. E Stat. Nonlinear Soft Matter Phys. 2005, 71, 021906. [Google Scholar] [CrossRef] [PubMed]
  57. Azami, H.; Arnold, S.E.; Sanei, S.; Chang, Z.; Sapiro, G.; Escudero, J.; Gupta, A.S. Multiscale Fluctuation-Based Dispersion Entropy and Its Applications to Neurological Diseases. IEEE Access 2019, 7, 68718–68733. [Google Scholar] [CrossRef]
  58. Humeau-Heurtier, A.; Wu, C.-W.; Wu, S.-D.; Mahé, G.; Abraham, P. Refined Multiscale Hilbert–Huang Spectral Entropy and Its Application to Central and Peripheral Cardiovascular Data. IEEE Trans. Biomed. Eng. 2016, 63, 2405–2415. [Google Scholar] [CrossRef] [PubMed]
  59. Tahmina Akter, M. Observation of Different Behaviors of Logistic Map for Different Control Parameters. Int. J. Appl. Math. Theor. Phys. 2018, 4, 84. [Google Scholar] [CrossRef]
  60. Wu, S.D.; Wu, C.W.; Humeau-Heurtier, A. Refined Scale-Dependent Permutation Entropy to Analyze Systems Complexity. Phys. A Stat. Mech. Its Appl. 2016, 450, 454–461. [Google Scholar] [CrossRef]
  61. Yan, R.; Liu, Y.; Gao, R.X. Permutation Entropy: A Nonlinear Statistical Measure for Status Characterization of Rotary Machines. Mech. Syst. Signal Process. 2012, 29, 474–484. [Google Scholar] [CrossRef]
  62. Rani, M.; Agarwal, R. A New Experimental Approach to Study the Stability of Logistic Map. Chaos Solitons Fractals 2009, 41, 2062–2066. [Google Scholar] [CrossRef]
  63. Traversaro, F.; Legnani, W.; Redelico, F.O. Influence of the Signal to Noise Ratio for the Estimation of Permutation Entropy. Phys. A 2020, 553, 124134. [Google Scholar] [CrossRef]
  64. Tian, X.; Xi, J.; Rehab, I.; Abdalla, G.M.; Gu, F.; Ball, A.D. A Robust Detector for Rolling Element Bearing Condition Monitoring Based on the Modulation Signal Bispectrum and Its Performance Evaluation against the Kurtogram. Mech. Syst. Signal Process. 2018, 100, 167–187. [Google Scholar] [CrossRef]
  65. Zhao, Z.; Qiao, B.; Wang, S.; Shen, Z.; Chen, X. A Weighted Multi-Scale Dictionary Learning Model and Its Applications on Bearing Fault Diagnosis. J. Sound Vib. 2019, 446, 429–452. [Google Scholar] [CrossRef]
  66. Kedadouche, M.; Liu, Z.; Vu, V.-H. A New Approach Based on OMA-Empirical Wavelet Transforms for Bearing Fault Diagnosis. Measurement 2016, 90, 292–308. [Google Scholar] [CrossRef]
  67. Lessmeier, C.; Kimotho, J.K.; Zimmer, D.; Sextro, W.; KAt-Data Center, Chair of Design and Drive Technology. Paderborn University. Available online: https://mb.uni-paderborn.de/kat/forschung/datacenter/bearing-datacenter/ (accessed on 14 January 2021).
  68. Lessmeier, C.; Kimotho, J.K.; Zimmer, D.; Sextro, W. Condition Monitoring of Bearing Damage in Electromechanical Drive Systems by Using Motor Current Signals of Electric Motors: A Benchmark Data Set for Data-Driven Classification. In Proceedings of the PHM Society European Conference, Bilbao, Spain, 5–8 July 2016; Volume 3. [Google Scholar]
  69. Bearings Vibration Data Set. Case Western Reserve University. Available online: https://csegroups.case.edu/bearingdatacenter/pages/download-data-file (accessed on 23 June 2020).
  70. Smith, W.A.; Randall, R.B. Rolling Element Bearing Diagnostics Using the Case Western Reserve University Data: A Benchmark Study. Mech. Syst. Signal Process. 2015, 64–65, 100–131. [Google Scholar] [CrossRef]
  71. Fogedby, H.C. On the Phase Space Approach to Complexity. J. Stat. Phys. 1992, 69, 411–425. [Google Scholar] [CrossRef]
  72. Jiang, Y.; Mao, D.; Xu, Y. A Fast Algorithm for Computing Sample Entropy. Adv. Adapt. Data Anal. 2011, 3, 167–186. [Google Scholar] [CrossRef]
  73. Sheen, Y.T. A Complex Filter for Vibration Signal Demodulation in Bearing Defect Diagnosis. J. Sound Vib. 2004, 276, 105–119. [Google Scholar] [CrossRef]
  74. Rosenthal, R. Parametric Measures of Effect Size in The Handbook of Research Synthesis; Cooper, H., Hedges, L.V., Eds.; Sage: New York, NY, USA, 1994; pp. 231–244. [Google Scholar]
Figure 1. All possible dispersion patterns for m = 2 and c = 4.
Figure 1. All possible dispersion patterns for m = 2 and c = 4.
Entropy 25 01494 g001
Figure 2. RCMDE and MDE at 20 scales for white and pink noise.
Figure 2. RCMDE and MDE at 20 scales for white and pink noise.
Entropy 25 01494 g002
Figure 3. RCMFDE and MFDE at 20 scales for white and pink noises.
Figure 3. RCMFDE and MFDE at 20 scales for white and pink noises.
Entropy 25 01494 g003
Figure 4. SD of MDE, MFDE, RCMDE, and RCMFDE for one-hundred independent (a) white noise and (b) pink noise time series.
Figure 4. SD of MDE, MFDE, RCMDE, and RCMFDE for one-hundred independent (a) white noise and (b) pink noise time series.
Entropy 25 01494 g004
Figure 5. The waveforms resulting from the logistic map change: r = 3.7 (a), 3.8 (b), and 3.9 (c).
Figure 5. The waveforms resulting from the logistic map change: r = 3.7 (a), 3.8 (b), and 3.9 (c).
Entropy 25 01494 g005
Figure 6. The complexity of logistic map signals with different r values and WGN. (a) MDE, (b) RCMDE, (c) MFDE, and (d) RCMFDE.
Figure 6. The complexity of logistic map signals with different r values and WGN. (a) MDE, (b) RCMDE, (c) MFDE, and (d) RCMFDE.
Entropy 25 01494 g006
Figure 7. The results of (c) RCMFDE, (e) MFDE, (g) RCMDE, and (i) MDE on (a) chirp signals in comparison to the results of (d) RCMFDE, (f) MFDE, (h) RCMDE, and (j) MDE on (b) amplitude-modulated chirp signals.
Figure 7. The results of (c) RCMFDE, (e) MFDE, (g) RCMDE, and (i) MDE on (a) chirp signals in comparison to the results of (d) RCMFDE, (f) MFDE, (h) RCMDE, and (j) MDE on (b) amplitude-modulated chirp signals.
Entropy 25 01494 g007
Figure 8. SD of results obtained from RCMDFE, MFDE, RCMDE, and MDE for 100 independent instances of  1 f  noise at scales (a τ  = 5, (b τ  = 10, and (c τ  = 15 and 100 independent instances of WGN at scales (d τ  = 5, (e τ  = 10, and (f τ  = 15.
Figure 8. SD of results obtained from RCMDFE, MFDE, RCMDE, and MDE for 100 independent instances of  1 f  noise at scales (a τ  = 5, (b τ  = 10, and (c τ  = 15 and 100 independent instances of WGN at scales (d τ  = 5, (e τ  = 10, and (f τ  = 15.
Entropy 25 01494 g008
Figure 9. Evaluating the computational times of RCMFDE, RCMDE, RCMSE, MFDE, MDE, and RCMSE for white Gaussian noise (WGN) series of varying lengths.
Figure 9. Evaluating the computational times of RCMFDE, RCMDE, RCMSE, MFDE, MDE, and RCMSE for white Gaussian noise (WGN) series of varying lengths.
Entropy 25 01494 g009
Figure 10. A simulated bearing signal: (a) without noise and (b) with noise.
Figure 10. A simulated bearing signal: (a) without noise and (b) with noise.
Entropy 25 01494 g010
Figure 11. Mean value and SD of results of (a) MFDE, (b) RCMFDE, (c) MDE, and (d) RCMDE computed from healthy and faulty bearing simulated signals. The scale factors with p-values between 0.01 and 0.05, and smaller than 0.01 are respectively shown with + and *.
Figure 11. Mean value and SD of results of (a) MFDE, (b) RCMFDE, (c) MDE, and (d) RCMDE computed from healthy and faulty bearing simulated signals. The scale factors with p-values between 0.01 and 0.05, and smaller than 0.01 are respectively shown with + and *.
Entropy 25 01494 g011
Figure 12. A simulated signal: (a) without noise and with additive WGN with respect to (b) SNR = 40 dB, (c) SNR = 5 dB, and (d) SNR = 0 dB.
Figure 12. A simulated signal: (a) without noise and with additive WGN with respect to (b) SNR = 40 dB, (c) SNR = 5 dB, and (d) SNR = 0 dB.
Entropy 25 01494 g012
Figure 13. Average and SD of NrmEntN obtained via MDE, RCMDE, MFDE, and RCMFDE from 50 simulated faulty bearing signals with 50 independent additive realizations of WGNs relative to different noise power. NrmEntN compares the sensitivity of MDE, RCMDE, MFDE, and RCMFDE to WGN with different SNRs.
Figure 13. Average and SD of NrmEntN obtained via MDE, RCMDE, MFDE, and RCMFDE from 50 simulated faulty bearing signals with 50 independent additive realizations of WGNs relative to different noise power. NrmEntN compares the sensitivity of MDE, RCMDE, MFDE, and RCMFDE to WGN with different SNRs.
Entropy 25 01494 g013
Figure 14. Classification of bearing fault conditions for MDE, RCMDE, MFDE, and RCMFDE using multiclass FCM-ANFIS.
Figure 14. Classification of bearing fault conditions for MDE, RCMDE, MFDE, and RCMFDE using multiclass FCM-ANFIS.
Entropy 25 01494 g014
Figure 15. Accuracies of classifying the three fault conditions using multiclass FCM-ANFIS with different inputs.
Figure 15. Accuracies of classifying the three fault conditions using multiclass FCM-ANFIS with different inputs.
Entropy 25 01494 g015
Figure 16. The classification results of bearing fault diagnosis using multiclass FCM-ANFIS with various inputs.
Figure 16. The classification results of bearing fault diagnosis using multiclass FCM-ANFIS with various inputs.
Entropy 25 01494 g016
Table 1. Advantages, disadvantages and some applications of the most popular conventional entropy methods (SE, FE, PE and DE).
Table 1. Advantages, disadvantages and some applications of the most popular conventional entropy methods (SE, FE, PE and DE).
MethodsAdvantagesDisadvantagesSome of
Applications
SESE deals with the self-matching problem of approximate entropy and eliminates the bias in approximate entropy algorithm [17].(1) SE may result in undefined or unreliable entropy values, especially for short time series [18]; (2) SE has high computational cost [19].Mechanical [20],
biomedical [21],
civil engineering [22]
FEFE, compared with SE, leads to more stable and accurate results [23].(1) FE may result in undefined or unreliable entropy values, especially for short time series [19]. (2) Computational cost of FE is higher than SE [19].Mechanical [24],
biomedical [25],
PE(1) PE is faster than SE and FE [16,26]; (2) PE value is more reliable than that for SE or FE for short signals [19].(1) PE only captures order relations between amplitude values and ignores some signal information [18,27]; (2) PE neglects equal values in a signal; (3) PE is sensitive to a high SNR noise [18,27].Mechanical [28], biomedical [29], economy [30], geophysics [31], hydrology [32]
DE(1) Unlike SE, DE does not lead to undefined results in short signals [33]; (2) DE is less susceptible to the effects of noise [7]; (3) unlike PE, DE considers amplitude values [18]; (4) DE addresses the issue of equal adjacent amplitude values in PE [16]; (5) compared to SE and FE, DE is considerably faster [1,7].DE is sensitive to its parameters, particularly the number of classes and embedding dimension [19].Mechanical [7], biomedical [34], economy [35]
Table 2. Applied datasets for four different bearing fault conditions.
Table 2. Applied datasets for four different bearing fault conditions.
Condition of Bearing
HSTODOPO
Bearing CodeK001KA01KA06KA07
Table 3. Operational conditions.
Table 3. Operational conditions.
No.Rotational Speed (rpm)Load Torque (Nm)Radial Force (N)
115000.71000
215000.11000
315000.7400
Table 4. Differences in results for faulty bearing vs. healthy bearing obtained by RCMFDE, MFDE, RCMDE, and MDE based on Hedges’ g effect size.
Table 4. Differences in results for faulty bearing vs. healthy bearing obtained by RCMFDE, MFDE, RCMDE, and MDE based on Hedges’ g effect size.
Feature
Extractor
Scale
1234567891011121314151617181920
RCMFDE1.211.191.651.961.851.481.060.590.180.190.580.971.361.671.892.052.172.282.372.43
MFDE1.210.820.781.411.090.950.810.210.360.010.410.740.961.411.461.852.041.661.962.05
RCMDE1.060.651.001.341.241.081.060.800.670.580.390.160.110.170.370.460.480.560.640.69
MDE1.060.580.360.770.520.770.740.530.720.290.210.010.180.170.4830.610.370.450.460.45
Table 5. Average and SD of NrmEntN obtained via MDE, RCMDE, MFDE, and RCMFDE from 50 simulated faulty bearing signals.
Table 5. Average and SD of NrmEntN obtained via MDE, RCMDE, MFDE, and RCMFDE from 50 simulated faulty bearing signals.
WGNMethod Scale
12345
SNR = 40 dbMDEmean1.00161.00101.00050.99870.9998
SD0.00260.00190.00280.00280.0023
RCMDEmean1.00161.00101.00000.99970.9997
SD0.00260.00150.00150.00130.0012
MFDEmean1.00031.00011.00011.00011.0000
SD3.2605 × 10−42.9003 × 10−42.5598 × 10−42.4340 × 10−42.1888 × 10−4
RCMFDEmean1.00031.00011.00011.00011.0000
SD3.2605 × 10−42.7657 × 10−42.3455 × 10−42.1962 × 10−41.9927 × 10−4
SNR = 5 dbMDEmean1.42621.21681.12341.07921.056 0
SD0.01150.01380.01660.01790.0215
RCMDEmean1.42621.21421.12431.079 01.0535
SD0.01150.01270.01220.01250.0125
MFDEmean1.20571.11861.07561.05571.0452
SD0.00550.00560.00610.00670.0048
RCMFDEmean1.20571.11761.07671.05571.0441
SD0.00550.00530.00520.00490.0044
SNR = 0 dbMDEmean1.53101.31571.20281.14041.1078
SD0.00670.00930.01420.01910.0183
RCMDEmean1.53101.31651.20381.14121.1069
SD0.00670.00640.00810.01180.0122
MFDEmean1.27411.17671.12071.08771.0709
SD0.00380.00460.00590.00590.0075
RCMFDEmean1.27411.17771.12121.08831.0698
SD0.00380.00300.00350.00420.0048
Table 6. Classification results of bearing fault conditions: H, STO, DO, and PO conditions.
Table 6. Classification results of bearing fault conditions: H, STO, DO, and PO conditions.
Feature ExtractorAccuracy (%)
MinMeanMax
RCMFDE97.1798.1199.17
RCMDE96.0096.9397.83
RCMSE95.6796.3796.83
MFDE95.1796.0296.50
MDE92.3393.1894.17
MSE94.0094.6495.17
Table 7. Confusion matrix of results with the highest classification accuracy using RCMFDE.
Table 7. Confusion matrix of results with the highest classification accuracy using RCMFDE.
True Condition
HSTODOPOSensitivity (%)
Predicted conditionH15001099.34
STO015000100
DO00147298.66
PO00214898.67
Precision (%)1001009898.67A * = 99.17
* A is accuracy.
Table 8. Classification results for different fault conditions (high looseness of the V-belt, faulty bearing, and fault-free condition) using multiclass FCM-ANFIS with different inputs.
Table 8. Classification results for different fault conditions (high looseness of the V-belt, faulty bearing, and fault-free condition) using multiclass FCM-ANFIS with different inputs.
FeaturesAccuracy (%)
MinMeanMax
RCMFDE96.8997.8398.67
MFDE93.5694.6096.22
RCMDE93.5694.44495.33
MDE90.4491.1992.67
RCMSE92.2293.7294.89
MSE88.8990.7491.78
Table 9. Confusion matrix of results with the highest classification accuracy using RCMFDE.
Table 9. Confusion matrix of results with the highest classification accuracy using RCMFDE.
True Condition
Belt Looseness HighBearing FaultNormalSensitivity (%)
Predicted conditionBelt Looseness High1470398
Bearing fault2150098.68
Normal1014799.32
Precision (%)9810098AC * = 98.67
* AC is the accuracy.
Table 10. Description of the bearing dataset.
Table 10. Description of the bearing dataset.
Bearing ConditionFault Diameter
(mm)
Fault Position Relative to Load ZoneLabel of
Classification
Normal0-1
Rolling element0.1778-2
Rolling element0.3556-3
Rolling element0.5334-4
Rolling element0.7112-5
Inner race0.1778-6
Inner race0.3556-7
Inner race0.5334-8
Inner race0.7112-9
Outer race0.1778Centered @ 6:0010
Outer race0.3556Centered @ 6:0011
Outer race0.5334Centered @ 6:0012
Outer race0.1778Orthogonal @ 3:0013
Outer race0.5334Orthogonal @ 3:0014
Outer race0.1778Opposite @ 12:0015
Outer race0.5334Opposite @ 12:0016
Table 11. Classification of different bearing fault conditions.
Table 11. Classification of different bearing fault conditions.
FeaturesAccuracy (%)
MinMeanMax
RCMFDE98.9199.3999.58
RCMDE97.0397.7398.12
RCMSE97.8698.2398.65
MFDE96.2097.1797.66
MDE90.6892.3893.65
MSE93.2394.1395.21
Table 12. Confusion matrix of results with the highest classification accuracy using RCMFDE.
Table 12. Confusion matrix of results with the highest classification accuracy using RCMFDE.
True Condition
Class12345678910111213141516Sensitivity
Predicted condition1120000000000000000100
201200200000000000098.36
3001180000000000000100
400211500000000000098.29
5000012000000000000100
600000120000010000099.17
700010012000000000099.17
8000000012000000000100
9000000001200000000100
10000000000120000000100
11000000000011900000100
12000000000001200000100
13000000000000120000100
14000000000000012000100
1500020000000000120098.36
16000000000000000120100
Precision10010098.3395.8310010010010010010099.17100100100100100A* = 99.58
* A is accuracy.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Rostaghi, M.; Khatibi, M.M.; Ashory, M.R.; Azami, H. Refined Composite Multiscale Fuzzy Dispersion Entropy and Its Applications to Bearing Fault Diagnosis. Entropy 2023, 25, 1494. https://doi.org/10.3390/e25111494

AMA Style

Rostaghi M, Khatibi MM, Ashory MR, Azami H. Refined Composite Multiscale Fuzzy Dispersion Entropy and Its Applications to Bearing Fault Diagnosis. Entropy. 2023; 25(11):1494. https://doi.org/10.3390/e25111494

Chicago/Turabian Style

Rostaghi, Mostafa, Mohammad Mahdi Khatibi, Mohammad Reza Ashory, and Hamed Azami. 2023. "Refined Composite Multiscale Fuzzy Dispersion Entropy and Its Applications to Bearing Fault Diagnosis" Entropy 25, no. 11: 1494. https://doi.org/10.3390/e25111494

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop