Next Article in Journal
A Logarithmic Quantization-Based Image Watermarking Using Information Entropy in the Wavelet Domain
Next Article in Special Issue
Entropy Churn Metrics for Fault Prediction in Software Systems
Previous Article in Journal
Irreversibility Analysis of Dissipative Fluid Flow Over A Curved Surface Stimulated by Variable Thermal Conductivity and Uniform Magnetic Field: Utilization of Generalized Differential Quadrature Method
Previous Article in Special Issue
Rotor Fault Diagnosis Based on Characteristic Frequency Band Energy Entropy and Support Vector Machine
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Bearing Remaining Useful Life Prediction Based on Naive Bayes and Weibull Distributions

1
College of Information Engineering, Capital Normal University, Beijing 100048, China
2
Beijing Key Laboratory of Electronic System Reliability Technology, Capital Normal University, Beijing 100048, China
3
Beijing Key Laboratory of Light Industrial Robot and Safety Verification, Capital Normal University, Beijing 100048, China
4
Beijing Advanced Innovation Center for Imaging Technology, Capital Normal University, Beijing 100048, China
*
Author to whom correspondence should be addressed.
Entropy 2018, 20(12), 944; https://doi.org/10.3390/e20120944
Submission received: 12 November 2018 / Revised: 3 December 2018 / Accepted: 5 December 2018 / Published: 8 December 2018
(This article belongs to the Special Issue Entropy-Based Fault Diagnosis)

Abstract

:
Bearing plays an important role in mechanical equipment, and its remaining useful life (RUL) prediction is an important research topic of mechanical equipment. To accurately predict the RUL of bearing, this paper proposes a data-driven RUL prediction method. First, the statistical method is used to extract the features of the signal, and the root mean square (RMS) is regarded as the main performance degradation index. Second, the correlation coefficient is used to select the statistical characteristics that have high correlation with the RMS. Then, In order to avoid the fluctuation of the statistical feature, the improved Weibull distributions (WD) algorithm is used to fit the fluctuation feature of bearing at different recession stages, which is used as input of Naive Bayes (NB) training stage. During the testing stage, the true fluctuation feature of the bearings are used as the input of NB. After the NB testing, five classes are obtained: health states and four states for bearing degradation. Finally, the exponential smoothing algorithm is used to smooth the five classes, and to predict the RUL of bearing. The experimental results show that the proposed method is effective for RUL prediction of bearing.

1. Introduction

As the key equipment in the production of products, rotating machinery covers many fields, such as agriculture, machinery manufacturing, industry, electric power, aerospace industry and so on, and plays an important role in the process of industrial production. The emergence of rotating machinery improves production efficiency and reduces energy consumption. However, in the actual production process, due to long-term work and improper operation of parts, mechanical equipment is prone to failure and causes unnecessary losses. The rolling bearing, which plays an indispensable role in the healthy operation of rotating machinery, is an important part of mechanical equipment. The malfunction of rotating machinery is mainly caused by the fault of rolling bearing, and its health state determines the running state of the equipment [1,2,3]. Therefore, the detection of bearing status and the evaluation of life expectancy are very important. Recently, Prognostics and Health Management (PHM) is a promising research direction that can improve the safety and performance of mechanical equipment. PHM predicts the life of the equipment based on actual performance analysis of the equipment. Maintenance of equipment before predicted life can greatly improve the reliability and safety of equipment and reduce the maintenance cost of complex systems. PHM mainly involves mechanical fault diagnosis and residual life prediction. The related fault diagnoses are introduced in the literature [4,5,6]. By predicting the RUL of bearing, the failure of bearing can be found in time. Maintenance and replacement of equipment can improve the operation reliability of mechanical equipment, and it also avoids the loss and casuality caused by bearing failure. In practice, the RUL of bearings is difficult to obtain by experience. It is very important to establish a suitable prediction model for bearing RUL prediction. At present, there are two main methods to predict the RUL of bearings: data-driven prediction and model-based RUL prediction [7]. Model-based and data-driven based methods are widely used for RUL [8].
Among them, the model-based approach predicts the behavior of the system by establishing its internal structure and functions. The model-based method is based on the law of physics, which mainly to analyzes and studies the characteristics of the recessionary components, so as to predict decline trend and the RUL [9]. In the early reliability evaluation method, Lacalle [10] proposed that the error between the theoretical value and the actual value of the system is taken as the correction factor of the fault probability to measure and update the life prediction of the system. In [11], the failure rate model is used to predict reliability. At present, this method is widely used in medical, mechanical and other fields. In [12], considering the uncertainty of structural modeling, a modeling method combining Bayesian and probabilistic structure is proposed to improve the robustness of the system. Liao et al. [13] proposed to combine the proportional hazards model and logistic regression model with bearing RUL prediction. Wahyu et al. [14] proposed degradation parameters or deviation parameters as the object of machine prediction to predict the failure time of a single bearing. The validity and rationality of the degradation model are verified by experiments. The model-based method is developed according to the physical characteristics of the system. When the model is built properly, it can accurately predict the real-time life of the bearing. The model-based approach has achieved some results. However, with the increasing complexity of the system, it becomes more and more difficult to construct the failure model.
The data-driven method does not need to construct complex model, but mainly analyzes the data signal to predict the remaining life of bearing. Because of its simple deployment, data-driven method is widely used in current research. The data-driven method mainly analyzes the data signal to predict the remaining usefulness of the bearing. Analysis of signals vibration is widely used because it can reflect the internal state of degraded bearings and failed bearings [15]. Currently, vibration analysis of bearing RUL mainly includes time domain analysis [16,17,18,19], frequency domain analysis [20] and time-frequency domain analysis [21]. In [22], the degradation trend of bearings is modeled by statistical feature, RMS . Due to the sensitivity to bearing’s degradation information, RMS is regarded as an important degradation index to evaluate the RUL of bearings. However, a single degradation index cannot master the internal performance of the bearing in different periods. Therefore, in this paper, RMS is selected as the main performance degradation index. Through correlation analysis, statistical time domain characteristics with high RMS correlation coefficient is selected as the degradation index. Next, an appropriate prediction model needs to be established. Sun et al. [16] use particle swarm optimisization to optimize the parameters of the support vector machine (SVM) and then predict the remaining life of bearing. Due to single variable SVM’s simple structure and insufficient information, this method often leads to inaccuracy when predicting the result of bearing RUL. Chen et al. [23] proposed a multivariable support vector machine (MSVM) for bearing RUL prediction. He [24] proposes a new method using empirical mode decomposition (EEMD), correlation coefficient analysis, and support vector machine (SVM) to fuse multi-sensor information for bearing fault diagnosis. This method is mainly used when the amount of sample data is small. Although SVM does well in predicting bearing’s RUL, therandomness and complexity of parameters selection is not an easy problem. In recent years, with the successful application of neural network in various fields, Abd Kadir Mahamad et al. [25], proposed artificial neural network (ANN) for bearing RUL prediction. Ben Ali et al. [26], proposes a bearing RUL prediction method based on combining Weibull distribution with ANN. However, due to the uncertainty about the number of hidden layers in the neural network, it is difficult to determine the number of layers in constructing the network. The network keeps trying during training, which leads to randomness of training results. In order to avoid the influence of uncertain number of layers on the training results, Huang Guangbin proposed a new learning algorithm called extreme learning machine (ELM) [27]. ELM is a single hidden layer neural network, which is widely used, by virtue of its simple structure and fast training speed. Fang Liu et al. [17] who proposed a two-layer joint approximate diagonalization of eigen matrices (JADE), which can be regarded as a new degradation index from which redundant features have been eliminated. Then extracted degradation index is passed to the ELM to predict bearing RUL. Next, Fang liu et al. [21] proposed joint phase space reconstruction with JADE to jointly extract sensitive features, and then ELM is used to predict RUL of bearing. ELM greatly shortens the training time, but the randomness in the choice of parameters still caused the randomness of training results. In the current study, Lei Ren [28] proposes a method to compress and calculate the features by using the depth self-encoder, and then uses the depth learning framework to predict the real time life of the bearing. Furthermore, the result of the experiment is achieving better efficiency in bearing RUL prediction. The literature [29] proposes real-time prediction using multi-layer perceptron (MLP) and radial basis functions (RBF). The results show that RBF is superior to MLP in experimental accuracy and time, and results in interesting results. Andres Bustillo et al. [30] proposed to use the popular various Artificial Intelligence (AI) techniques processing sample data set to judge the machine residual life under actual industrial conditions. The experimental results show that the AI technology provides a higher precision to predict the residual life. However, the existing data-driven residual life prediction method does not accumulate knowledge to determine the bearing state. Health status determination is based on expert experience [31]. Bayes is a datahl-driven method based on prior knowledge, which effectively avoids the randomness of results. Naci. Z Gebraeel et al. [32] proposed a Bayesian updating method to update the random parameters of the bearing degradation model and then to develop RUL of degraded device. The method proposed in literature [9] is based on parameters and models. The selection of parameters and the construction of models are very complicated. F. D. Maio’s method et al. [33] applied NB to bearing fault prediction which is a non-parametric data-driven method. When the signal fluctuation of the bearing is large and the accurate classification of bearing cannot be provided, the RUL of the bearing cannot be predicted accurately. According to Reference [34], bearing degradation is rising over time. The running process of bearing is generally divided into three stages: normal operation stage, continuous recession stage, and final failure stage. Therefore, the improved WD is mainly used to fit the bearing signals in different stages to predict the RUL.
This paper mainly considers bearing degradation signal. First, the time domain statistical characteristics are extracted from the vibration signal of the bearing. Then, according to the correlation analysis, the sensitive degradation index of bearing is extracted. Then, the improved WD algorithm is used to fit the degradation index of the fluctuation of bearing in different recession stages which is used as input of NB training stage. The actual degradation data of the bearing is used as test samples. Finally, the results of the time series are smoothed by exponential smoothing, thus the RUL of the bearing is obtained.
The presentation of the paper is as follows. Section 2 briefly describes the correlation analysis, WD and NB. The RUL prediction of bearing, the experimental data and results are presented in Section 3. In Section 4, we draw a conclusion based on the experiment listed in Section 3.

2. The Description of the Method

2.1. Correlation Analysis

Correlation analysis is a statistical method for analyzing variables [35]. Correlation analysis aims to measure the degree of correlation between variables. The degree of correlation is mainly denoted by the correlation coefficient between variables. The higher the correlation coefficient is, the higher the degree of correlation between the variables is. The correlation coefficients of two stochastic variables A and B is:
ρ A , B = C o v A , B D ( A ) D ( B )
where C o v ( A , B ) is the covariance of variables A and B, D ( A ) and D ( B ) are the variance of the variables.

2.2. Weibull Distribution

The Weibull Distribution (WD) [36] is widely used in the reliability theory, and the life of most mechanical equipment obeys the WD. WD mainly include two parameters WD and three parameter WD, as shown in Table 1. Where the parameters δ , k and u are proportional parameters, shape parameters and position parameters, respectively. Where t is the input variable.
An improved WD proposed in [26] is called Universal Failure Rate Function (UFRF), and the UFRF formula is defined as:
f ( δ , k , b , c ) = b + c k δ k t k 1
The parameter δ > 0 is the scale parameter, the k > 0 is the shape parameter, the adoption of c makes the WD adapt to any range and the adoption of the parameter b is to adjust the value of the WD at the beginning.

2.3. Naive Bayes

NB is a classification method based on Bayesian rule [37,38]. Bayes and NB are classifiers with prior knowledge. DataSet X = { X 1 , X 2 , , X n } is known. Where X i = < A , Y > , A is a property of the dataset A = { A 1 , A 2 , , A t } , Y is the category of dataset Y = { Y 1 , Y 2 , , Y m } . When there is unknown data C = { C 1 , C 2 , , C m } , the NB classification method is to assign unknown data C to the category Y with the largest probability value, i.e., calculate M a x ( P ( Y i / C ) ) . The calculation method of P ( Y i / C ) is obtained by Bayesian method with prior knowledge:
P ( Y i / C ) = P ( C / Y i ) P ( Y i ) P ( C ) , 1 i m
P ( C ) = i = 1 m P ( C / Y i ) P ( Y i ) , 1 i m
NB is Bayesian method with independent characteristic conditional, so the probability of P ( C ) for each class is a constant, it only needs to be calculate P ( C / Y i ) P ( Y i ) . According to known prior knowledge, it can be obtained:
P ( Y i ) = n i / n , 1 i m
P ( C / Y i ) P ( Y i ) ) = P ( Y i ) j = 1 t P ( A c j / Y i ) , 1 i m
where n i is the number of class i of data set Y, and n is the total number of data set Y. Attribute A c is a continuous property. Usually, the continuous property obeys Gauss distribution A c N ( u c , δ c 2 ) , Therefore, the Equation for P ( A c j / Y i ) is:
P ( A c j / Y i ) = 1 2 π δ j i e x p ( A c j u i j ) 2 2 δ j i 2 , 1 i m
where u c and δ c 2 are the mean and variance of the dataset X, respectively.
u i j = g = 1 n i X g j ( i ) n i
δ i j 2 = g = 1 n i ( X g j ( i ) u i j ) 2 n i 1
The discriminant function of the NB can be obtained as follows:
P ( Y i / C ) = P ( Y i ) j = 1 t 1 2 π δ j i e x p ( A c j u i j ) 2 2 δ j i 2 i = 1 m P ( Y i ) j = 1 t 1 2 π δ j i e x p ( A c j u i j ) 2 2 δ j i 2
Therefore, the category of unknown data C is judged as the category with the maximum value of discriminant function P ( Y i / C ) .

3. Prediction of Bearing RUL

In this paper, the prediction model framework of bearing RUL is divided into three stages as shown in Figure 1.

3.1. Feature Construction

3.1.1. Signal Acquisition

To verify the effectiveness of our method, the full-cycle bearing data used in this paper is from the Intelligent Maintenance Center of the University of Cincinnati [39]. The full cycle data (run-to-failure) acquisition device of the bearing is shown in Figure 2. One is the real figure of the bearing and the other is the sensor placement illustration of the bearing. In addition, sensor placement illustration and real figure are corresponding.
As it is shown in Figure 2, the bearing experimental test platform consists of four Rexnord ZA-2115 double row test bearings (Bearing 1–4) mounted on a rotating shaft. The shaft is driven by AC motor and the bearing is always kept at a constant speed of 2000 revolutions per minute. Furthermore, radial load system of 2724 kg is loaded on the bearing and the drive shaft. In addition, there are two ICP-based Accelerometers(model: PCB 353B33 high sensitivity quartz ICP) produced by PCB USA to measure the vibration data along the x and y of channel signals. The vibration data were collected by NI DAQ card 6062E and recorded every 10 min using 20 kHz sampling frequency. The degradation of bearing s is mainly determined by the debris collected by magnetic plugs. When a certain amount is reached, the test platform ends the test. After 35 days of testing, a total of 3 sets of run-to-failure data were collected. Each set contains 20,480 sampling points. In this experiment, the bearing run-to-failure data of three data sets were adopted, as shown in Table 2. Figure 3 shows the vibration data of the entire cycle of three datasets from normal to fault.
It can be seen from Figure 3 that the signal frequency of bearing 1, bearing 3 and bearing 4 is low at the beginning and the vibration frequency increases gradually over time. However, the amplitude analysis of the signal cannot get the RUL of the bearing. Furthermore, there is a certain noise in these signals. It is very difficult to analyze these signals directly. So the signal is processed preliminarily.

3.1.2. Feature Extraction

The time domain signal is a waveform signal that changes with time and contains the state information of the bearing in the waveform. The state of bearing can be diagnosed by analyzing time-domain waveform. However, in the real working condition, the bearing is mixed with the noise during the operation, so this paper uses the statistical time domain method to extract sensitive features from signals. The health status degradation information of the bearing is extracted by statistical calculation. As shown in Table 3, there are a total of 16 statistical time-domain features.
The 16 original statistical time-domain features (as shown in Table 1) extracted from the vibration signal are selected, and described in Figure 4, Figure 5 and Figure 6. The time-domain features of F 1 F 8 are RMS, the average value, absolute mean, average power, square amplitude, peak, peak-to-peak and variance, respectively. The time-domain hlfeatures of F 9 F 16 are standard deviation, skewness, kurtosis, waveform, Crest index, impluse index, margin index and skewness index, respectively.
It can be seen from Figure 4, Figure 5 and Figure 6 that not all features of bearing degradation data F 1 F 16 are robust in the process of degradation. For example, F 6 in Figure 4 and Figure 5 cannot well present the degradation process of bearing, but the features F 4 forms well is about the degradation process of bearing. So, we need to find the features that can better present the degradation process of the bearing. Therefore, it is necessary to choose a suitable and robust feature for the RUL prediction.

3.1.3. Feature Selection

Before life prediction modeling, the appropriate features are very important for reflecting the bearing degradation process. Therefore, it is necessary to select the characteristics of 16 time-domain features and select the appropriate features to predict the RUL of the bearing. Time domain features of RMS can effectively reflect the overall health status of bearings. Furthermore, with the degradation of the bearing, the degradation trend of RMS gradually increased. So, RMS is often used as the main features for bearing trend analysis and RUL prediction [40,41]. This paper takes RMS as the main feature, and uses correlation coefficients to extract the statistical time domain features consistent with the RMS trend, and then to predict the RUL of bearing.
In this paper, the correlation coefficient is used to extract the high-correlation time domain features with RMS. The flow chart is shown in Figure 7.
First of all, we construct the features matrix M n t = { M 1 , M 2 , , M t } , where M i = { f 1 i , f 2 i , , f n i } . n is the number of samples and t is the number of features attributes. M n t is written as:
M = f 11 f 12 f 1 t f 21 f 22 f 2 t f n 1 f n 2 f n t
Then, the correlation coefficient matrix R1t between RMS and Mnt is calculated.
R = r 11 r 12 r 1 t
Among them, the correlation coefficient r can be calculated according to Equation (1), then r 1 i = ρ ( R M S , F i ) . Finally, the threshold T is set to determine the relationship between correlation coefficient matrix R and T. If r 1 i > T , it shows that the feature F i has a strong correlation with RMS. Otherwise, the correlation between F and RMS is low, then the ith column in the feature matrix is dropped.
In the experiment of this paper, there are 16 feature vectors. Therefore, the correlation coefficients between RMS and 16 feature vectors need to be calculated. In general, the correlation coefficient of the two vectors is greater than 0.9, and we consider that these two vectors are significantly correlated. In this paper, we need to get features of high correlation and RMS. We set the threshold T = 0.9 to filter off the features of low correlation, and the dimension of the features is reduced to 6. The six features are F 1 ,   F 3 ,   F 4 ,   F 5 ,   F 8 and F 9 . Correlation coefficient between bearing features and RMS are as shown in Table 4.

3.2. Classification Model Construction

In this paper, NB is used to train and test the bearing degradation data. The training data mainly use UFRF to fit the bearing data of degradation trend. In the testing process, the real bearing degradation data are used for classification and then for predicting the RUL.
The overall degradation of the bearing is increasing over time. In Figure 4, Figure 5 and Figure 6, it can be seen that the extracted six time-domain features curves of F 1 ,   F 3 ,   F 4 ,   F 5 ,   F 8 and F 9 have a large number of fluctuations, which make it difficult for the structural classification to predict the RUL of the bearing. There are many reasons for these fluctuations, such as noise, speed and so on. In order to avoid the influence of these fluctuations, the UFRF proposed in literature [26] is used to smooth and fit the features smoothing increases with time.
However, the bearing degradation process can be divided into three stages and each stage is different. The first stage is the normal operation stage, and the curve of RMS features of bearings in this stage has no obvious change, and there is no degeneration. The second stage is the continuous recession stage, where the degradation is relatively obvious, but the degradation is a slow and continuous process. Generally there will be no significant degradation. The third stage is the final failure stage. Bearing degradation is severe and its fluctuation will be especially obvious. It can be seen from above that the degradation process of each degradation stage is different. Therefore, in this paper, the UFRF with different parameters is used to fit thefeatures of the degradation process at different stages. However, the overall degradation is increasing over time, consistent with the bearing degradation process. Reference [42] shows that the starting point of bearing 1 and bearing 3 failure is at the 586th point and 1808th, respectively. Then the decline trend of bearing degradation curve shows down in the following time. Furthermore, then the degradation curve of the bearing will change rapidly after reaching the failure threshold (950th and 2120th). Literature [21] shows that the three-stages time ratio of four is 0.5:0.2:0.3. Table 5, Table 6 and Table 7 show the parameters of different stages of bearing 1 feature extraction. The selection of parameters is first randomly generated according to the distribution rules of the WD distribution, and then the optimal parameters are obtained by adjusting the parameters according to the real data.
Through Table 5, Table 6 and Table 7, features according with bearing degradation is fitted. In Figure 8, Figure 9 and Figure 10, the selected features are consistent with the bearing degradation process. After fitting, the fitted features are constructed for the following training. NB is a supervised learning method, so it is necessary to label the training data. Figure 11 shows us adding labels of varying degrees of degradation according to the RMS degradation process. As can be seen from the Figure 11a, there are six types of labels, among which label 1 represents normal bearing data, label 2, 3, 4 and 5 respectively represent 25%, 50%, 90% and complete failure, respectively. In Figure 11b,c, the six type of labels represent 0, 30%, 60%, 90%, 100% and 0, 40%, 80%, 95%, 100%, respectively. After UFRF fitting, the fitted feature is used as the input of NB. In the test phase, the true feature of bearing degradation is as the input.
Through Table 4, features according with bearing degradation is fitted. In Figure 6, the selected features are consistent with the bearing degradation process. After fitting, the fitted features are constructed for the following training. NB is a supervised learning method, so it is necessary to tag the training data. Figure 11 shows us adding labels of varying degrees of degradation according to the RMS degradation process. As can be seen from the Figure 11a, there are six types of labels, among which label 1 represents normal bearing data, label 2, 3, 4 and 5 respectively represent 25%, 50%, 90% and complete failure, respectively. In Figure 11b,c, the six type of labels represent 0, 30%, 60%, 90%, 100% and 0, 40%, 80%, 95%, 100%, respectively. After UFRF fitting, the fitted feature is used as the input of NB. In the test phase, the true feature of bearing degradation is as the input.
Then, according to the classification concept of NB, the bearing data is divided into five categories (label 1–5). The descriptions of bearing data are shown in Table 8, Table 9 and Table 10.
After fitting, the training data set was obtained, and then the NB classification model was trained. The real bearing data is used as the model input, and the test results are obtained, as shown in Table 11, Table 12 and Table 13. Table 14 shows the comparison results of bearing 1. It can be seen from the table that the result of NB classification is better than reference [26].

RUL Construction

After the classification, we have obtained the category. However, the results cannot predict the RUL of bearings directly. Therefore, a new approach is needed to convert the category results of the time series into the degradation trend of the time series, and then to predict the RUL of the bearing.
The exponential smoothing is proposed by Brown, who believes that the time series is stable and regular [43]. So the time series can be reasonably forecasted and exponential smoothing is a common method in prediction. Therefore, this paper proposes that exponential smoothing method is used to obtain the real degradation process of bearings, so as to predict the RUL of bearings. The equation is as follows:
s t = z l t + ( 1 z ) s t 1
where z is the smoothing constant and s t the smoothing value of time t, is the real value of time t. s t 1 the smoothing value of time t 1 . The smoothing constant z is very important for the smoothing level, which determines the gap response speed between the predicted value and the actual result.
The range of the smoothness constant z is from 0 to 1. In general, the closer the smoothing constant is to 0, the stronger the smoothing effect is. The smoothing constant in this paper is a value close to 0. The experimental results show that when the smoothing constants z of bearings 1, 3 and 4 are 0.08, 0.05 and 0.07 respectively, RUL prediction achieve best in this paper, as shown in Figure 12. Figure 12a–c are the predicted results of bearing 1, 3 and 4, respectively. As can be seen from the Figure 12, after smoothing, we can get the RUL of each point.
Error is used as a measurement index to predict bearing precision, and its equation is:
e = 1 n t = 1 n s t l t
where s t is the predicted RUL, and l t is the real RUL of the bearing.
Table 15 is a comparison of the experimental results of the bearing degradation data set. It can be concluded from the experimental results in the table that the algorithm proposed in this paper is more accurate in predicting the RUL of the bearing.

4. Conclusions

RUL prediction is very important in improving the safety, reliability, availability and maintainability of rotating machinery. Through the prediction of residual life, the possible faults can be detected and predicted in time, and the rotating machinery can be repaired so as to prolong the service life of rotation. This paper starts with bearing vibration signal, combined with data drive technology and fault prediction method to predict the residual life of bearing. Firstly, feature extraction and selection of vibration signal are performed. Then, according to the law of bearing degradation, the bearing data are divided into three stages, and the bearing data are divided into different categories. Next, the bearing degradation data were classified using NB. Finally, an exponential distribution is used to predict bearing’s RUL. In order to verify the effectiveness of the experiment, real bearing degradation data were used to perform the experiment. The experimental results show that the NB is effective in predicting the RUL of the bearing. In this paper, the residual life of bearings is predicted based on the classification method, and it is hoped that the remaining life of the bearing can be predicted directly in the future.

Author Contributions

N.Z. and L.W. conceived and designed the experiments; Z.W. performed the experiments; Y.G. analyzed the data; L.W. contributed analysis tools; N.Z. wrote the paper. All authors contributed to discussing and revising the manuscript.

Funding

This work received financial support from the National Natural Science Foundation of China (No. 71601022), the Natural Science Foundation of Beijing (4173074), the Key Project B Class of Beijing Natural Science Fund (KZ201710028028) and it was supported by Capacity Building for Sci-Tech Innovation-Fundamental Scientific Research Funds (025185305000-187) and Youth Innovative Research Team of Capital Normal University.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
RULRemaining useful life
RMSRoot mean square
NBNaive Bayes
PHMPrognostics and Health Management
SVMSupport vector machine
MSVMMultivariable support vector machine
ANNArtificial neural network
ELMExtreme learning machine
JADEJoint approximate diagonalization of eigen matrices
WDWeibull distributions
UFRFUniversal Failure Rata Function

References

  1. Nandi, S.; Toliyat, H.A.; Li, X. Condition monitoring and fault diagnosis of electrical motors—A review. IEEE Trans. Energy Convers. 2005, 20, 719–729. [Google Scholar] [CrossRef]
  2. Hamadache, M.; Lee, D.; Mucchi, E.; Dalpiaz, G. Vibration-Based Bearing Fault Detection and Diagnosis via Image Recognition Technique Under Constant and Variable Speed Conditions. Appl. Sci. 2018, 8, 1392. [Google Scholar] [CrossRef]
  3. Zhang, C.; Li, Z.; Chen, S.; Wang, J.; Zhang, X. Optimised ensemble empirical mode decomposition with optimised noise parameters and its application to rolling element bearing fault diagnosis. Insight 2016, 58, 494–501. [Google Scholar] [CrossRef]
  4. Li, Z.; Jiang, Y.; Guo, Q.; Hu, C.; Peng, Z. Multi-dimensional variational mode decomposition for bearing-crack detection in wind turbines with large driving-speed variations. Renew. Energy 2018, 116, 55–73. [Google Scholar] [CrossRef]
  5. Glowacz, A. Fault diagnosis of single-phase induction motor based on acoustic signals. Mech. Syst. Signal Process. 2019, 117, 65–80. [Google Scholar] [CrossRef]
  6. Zhang, Y.; Wang, P.; Zhang, X.; Wang, C. Synthetic fault factor features under Weibull stochastic interference. Int. J. Electr. Power Energy Syst. 2016, 77, 19–24. [Google Scholar] [CrossRef]
  7. Sikorska, J.Z.; Hodkiewicz, M.; Ma, L. Prognostic modelling options for remaining useful life estimation by industry. Mech. Syst. Signal Process. 2011, 25, 1803–1836. [Google Scholar] [CrossRef]
  8. Loutas, T.H.; Roulias, D.; Georgoulas, G. Remaining Useful Life Estimation in Rolling Bearings Utilizing Data-Driven Probabilistic E-Support Vectors Regression. IEEE Trans. Reliab. 2013, 62, 821–832. [Google Scholar] [CrossRef]
  9. Kan, M.S.; Tan, A.C.C.; Mathew, J. A review on prognostic techniques for non-stationary and non-linear rotating systems. Mech. Syst. Signal Process. 2015, 62–63, 1–20. [Google Scholar] [CrossRef]
  10. Lacalle, L.N.L.D.; Viadero, F.; Hernandez, J.M. Applications of dynamic measurements to structural reliability updating. Probab. Eng. Mech. 1996, 11, 97–105. [Google Scholar] [CrossRef]
  11. Cox, D.R. Regression Models and Life-Tables. J. R. Stat. Soc. 1972, 34, 187–220. [Google Scholar] [CrossRef]
  12. Papadimitriou, C.; Beck, J.L.; Katafygiotis, L.S. Updating robust reliability using structural test data. Probab. Eng. Mech. 2001, 16, 103–113. [Google Scholar] [CrossRef]
  13. Liao, H.; Zhao, W.; Guo, H. Predicting remaining useful life of an individual unit using proportional hazards model and logistic regression model. In Proceedings of the Reliability and Maintainability Symposium (Rams’06), Newport Beach, CA, USA, 23–26 January 2006; pp. 127–132. [Google Scholar]
  14. Caesarendra, W.; Widodo, A.; Yang, B.S. Application of relevance vector machine and logistic regression for machine degradation assessment. Mech. Syst. Signal Process. 2010, 24, 1161–1171. [Google Scholar] [CrossRef]
  15. Shiroishi, J.; Li, Y.; Liang, S.; Kurfess, T.; Danyluk, S. Bearing Condition Diagnostics via Vibration and Acoustic Emission Measurements. Mech. Syst. Signal Process. 1997, 11, 693–705. [Google Scholar] [CrossRef]
  16. He, Z.; Sun, C.; Zhang, Z. Research on bearing life prediction based on support vector machine and its application. J. Phys. 2011, 305, 012028. [Google Scholar] [Green Version]
  17. Liu, F.; Liu, Y.; Chen, F.; He, B. Residual life prediction for ball bearings based on joint approximate diagonalization of eigen matrices and extreme learning machine. Proc. Inst. Mech. Eng. Part C 2015, 231, 1699–1711. [Google Scholar] [CrossRef]
  18. Wu, B.; Li, W.; Qiu, M.Q. Remaining Useful Life Prediction of Bearing with Vibration Signals Based on a Novel Indicator. Shock Vib. 2017, 2017, 8927937. [Google Scholar] [CrossRef]
  19. Peng, Y.; Cheng, J.; Liu, Y.; Li, X.; Peng, Z. An adaptive data-driven method for accurate prediction of remaining useful life of rolling bearings. Front. Mech. Eng. 2018, 13, 301–310. [Google Scholar] [CrossRef]
  20. Ren, L.; Sun, Y.; Wang, H.; Zhang, L. Prediction of Bearing Remaining Useful Life with Deep Convolution Neural Network. IEEE Access 2018, 6, 13041–13049. [Google Scholar] [CrossRef]
  21. Liu, Y.; He, B.; Liu, F.; Lu, S.; Zhao, Y.; Zhao, J. Remaining Useful Life Prediction of Rolling Bearings Using PSR, JADE, and Extreme Learning Machine. Math. Probl. Eng. 2016, 2016, 8623530. [Google Scholar] [CrossRef]
  22. Qiu, H.; Lee, J.; Lin, J.; Yu, G. Robust performance degradation assessment methods for enhanced rolling element bearing prognostics. Adv. Eng. Inform. 2003, 17, 127–140. [Google Scholar] [CrossRef]
  23. Shen, Z. Remaining Life Predictions of Rolling Bearing Based on Relative Features and Multivariable Support Vector Machine. Proc. Inst. Mech. Eng. Part C 2013, 227, 2849–2860. [Google Scholar] [CrossRef]
  24. Jiang, F.; Zhu, Z.; Li, W.; Ren, Y.; Zhou, G.; Chang, Y. A Fusion Feature Extraction Method Using EEMD and Correlation Coefficient Analysis for Bearing Fault Diagnosis. Appl. Sci. 2018, 8, 1621. [Google Scholar] [CrossRef]
  25. Mahamad, A.K.; Saon, S.; Hiyama, T. Predicting remaining useful life of rotating machinery based artificial neural network. Comput. Math. Appl. 2010, 60, 1078–1087. [Google Scholar] [CrossRef]
  26. Ali, J.B.; Chebel-Morello, B.; Saidi, L.; Malinowski, S.; Fnaiech, F. Accurate bearing remaining useful life prediction based on Weibull distribution and artificial neural network. Mech. Syst. Signal Process. 2015, 56–57, 150–172. [Google Scholar]
  27. Huang, G.B. An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels. Cognit. Comput. 2014, 6, 376–390. [Google Scholar] [CrossRef]
  28. Ren, L.; Sun, Y.; Cui, J.; Zhang, L. Bearing remaining useful life prediction based on deep autoencoder and deep neural networks. J. Manuf. Syst. 2018, 48, 71–77. [Google Scholar] [CrossRef]
  29. Arnaiz-Gonzalez, A.; Fernandez-Valdivielso, A.; Bustillo, A.; de Lacalle, L.N.L. Using artificial neural networks for the prediction of dimensional error on inclined surfaces manufactured by ball-end milling. Int. J. Adv. Manuf. Technol. 2016, 83, 847–859. [Google Scholar] [CrossRef]
  30. Bustillo, A.; Urbikain, G.; Perez, J.M.; Pereira, O.M.; de Lacalle, L.N.L. Smart optimization of a friction-drilling process based on boosting ensembles. J. Manuf. Syst. 2018, 48, 108–121. [Google Scholar] [CrossRef]
  31. Lu, C.; Chen, J.; Hong, R.; Feng, Y.; Li, Y. Degradation trend estimation of slewing bearing based on LSSVM model. Mech. Syst. Signal Process. 2016, 76–77, 353–366. [Google Scholar] [CrossRef]
  32. Gebraeel, N.Z.; Lawley, M.A.; Li, R.; Ryan, J.K. Residual-life distributions from component degradation signals: A Bayesian approach. IIE Trans. 2005, 37, 543–557. [Google Scholar] [CrossRef] [Green Version]
  33. Maio, F.D.; Ng, S.S.Y.; Tsui, K.L.; Zio, E. Naive Bayesian Classifier for On-line Remaining Useful Life Prediction of Degrading Bearings, 2011. Available online: https://hal-supelec.archives-ouvertes.fr/hal-00658069/document (accessed on 8 December 2018).
  34. Ratanamahatana, C.A.; Gunopulos, D. Scaling up the Naive Bayesian Classifier: Using Decision Trees for Feature Selection, 2002. Available online: http://alumni.cs.ucr.edu/~ratana/DCAP02.pdf (accessed on 8 December 2018).
  35. Ji, X.J.; Li, S.Z.; Li, T. Application of the Correlation Analysis in Feature Selection. J. Test Meas. Technol. 2001, 15, 15–18. [Google Scholar]
  36. Weibull, W. A Statistical Distribution Function of Wide Applicability. J. Appl. Mech. 1951, 13, 293–297. [Google Scholar]
  37. Zhang, N.; Wu, L.; Yang, J.; Guan, Y. Naive Bayes Bearing Fault Diagnosis Based on Enhanced Independence of Data. Sensors 2018, 18, 463. [Google Scholar] [CrossRef]
  38. Glowacz, A. Diagnostics of Rotor Damages of Three-Phase Induction Motors Using Acoustic Signals and SMOFS-20-EXPANDED. Arch. Acoust. 2016, 41, 507–515. [Google Scholar] [CrossRef]
  39. Bearing Data of Center for Intelligent Maintenance Systems (IMS). University of Cincinnati. Available online: http://ti.arc.nasa.gov/tech/dash/pcoe/prognostic-data-repository/bearing (accessed on 8 December 2018).
  40. Rodriguez-Lujan, I.; Huerta, R.; Elkan, C.; Cruz, C.S. Quadratic Programming Feature Selection. J. Mach. Learn. Res. 2010, 11, 1491–1516. [Google Scholar]
  41. Mu, Y.; Liu, X.; Wang, L. A Pearson’s correlation coefficient based decision tree and its parallel implementation. Inf. Sci. 2018, 435, 40–58. [Google Scholar] [CrossRef]
  42. Qian, Y.; Yan, R.; Gao, R.X. A multi-time scale approach to remaining useful life prediction in rolling bearing. Mech. Syst. Signal Process. 2017, 83, 549–567. [Google Scholar] [CrossRef] [Green Version]
  43. Brown, R.G. Exponential Smoothing. Encycl. Oper. Res. Manag. Sci. 2013, 11, 537–539. [Google Scholar]
Figure 1. Bearing remaining useful life (RUL) prediction model framework.
Figure 1. Bearing remaining useful life (RUL) prediction model framework.
Entropy 20 00944 g001
Figure 2. The bearing experimental device and sensor placement illustration [39].
Figure 2. The bearing experimental device and sensor placement illustration [39].
Entropy 20 00944 g002
Figure 3. Bearing run-to-failure data. (a) Bearing 1 of Set No. 2 is vibration signals ending with an outer race failure; (b) Bearing 3 of Set No. 1 is vibration signals ending with an inner race defect; (c) Bearing 4 of Set No. 1 is vibration signals ending with roller element defect.
Figure 3. Bearing run-to-failure data. (a) Bearing 1 of Set No. 2 is vibration signals ending with an outer race failure; (b) Bearing 3 of Set No. 1 is vibration signals ending with an inner race defect; (c) Bearing 4 of Set No. 1 is vibration signals ending with roller element defect.
Entropy 20 00944 g003
Figure 4. The 16 time-domain features of bearing 1.
Figure 4. The 16 time-domain features of bearing 1.
Entropy 20 00944 g004
Figure 5. The 16 time-domain features of bearing 3.
Figure 5. The 16 time-domain features of bearing 3.
Entropy 20 00944 g005
Figure 6. The 16 time-domain features of bearing 4.
Figure 6. The 16 time-domain features of bearing 4.
Entropy 20 00944 g006
Figure 7. Based on root mean square (RMS) feature selection flow chart.
Figure 7. Based on root mean square (RMS) feature selection flow chart.
Entropy 20 00944 g007
Figure 8. Fitted feature of bearing 1.
Figure 8. Fitted feature of bearing 1.
Entropy 20 00944 g008
Figure 9. Fitted feature of bearing 3.
Figure 9. Fitted feature of bearing 3.
Entropy 20 00944 g009
Figure 10. Fitted feature of bearing 4.
Figure 10. Fitted feature of bearing 4.
Entropy 20 00944 g010
Figure 11. Classification of degradation data for bearing. (a) The class label for bearing 1; (b) The class label for bearing 3; (c) The class label for bearing 4.
Figure 11. Classification of degradation data for bearing. (a) The class label for bearing 1; (b) The class label for bearing 3; (c) The class label for bearing 4.
Entropy 20 00944 g011
Figure 12. Fitted feature of bearing 3.
Figure 12. Fitted feature of bearing 3.
Entropy 20 00944 g012
Table 1. Weibull distribution.
Table 1. Weibull distribution.
Two-Parameter WeibullThree-Parameter Weibull
f ( δ , k ) = k δ ( t δ ) k 1 e ( t δ ) k f ( δ , k ) = k δ ( t u δ ) k 1 e ( t u δ ) k
Table 2. Description of bearing run-to-failure data set.
Table 2. Description of bearing run-to-failure data set.
Bearing DataSpeed (rpm)Number of SamplesType of Fault
Set No. 2 Bearing 12000944Out race
Set No. 1 Bearing 320002156Inner race
Set No. 1 Bearing 420002156Roller
Table 3. Time domain analysis of bearing run-to-failure data.
Table 3. Time domain analysis of bearing run-to-failure data.
NumberCharacteristic EquationNumberCharacteristic Equation
1 F 1 = n = 1 d ( X n ) 2 d 2 F 2 = n = 1 d X n d
3 F 3 = n = 1 d X n d 4 F 4 = n = 1 d ( X n ) 2 d
5 F 5 = ( n = 1 d X n d ) 2 6 F 6 = m a x X ( n )
7 F 7 = m a x ( X ( n ) ) m i n ( X ( n ) ) 8 F 8 = n = 1 d ( X n F 1 ) 2 d 1
9 F 9 = n = 1 d ( X n T 1 ) 2 d 1 10 F 10 = n = 1 d ( X n ) 3 d
11 F 11 = n = 1 d ( X n ) 4 d 12 F 12 = F 3 F 2
13 F 13 = F 6 F 3 14 F 14 = F 6 F 2
15 F 15 = F 6 F 5 16 F 16 = F 10 F 9 3
Table 4. Correlation coefficient between bearing features and RMS.
Table 4. Correlation coefficient between bearing features and RMS.
F 1 F 3 F 4 F 5 F 8 F 9
Set No. 2 Bearing 110.99890.99100.99730.99101
Set No. 1 Bearing 310.99850.98920.99620.99370.9992
Set No. 1 Bearing 410.99830.99870.99620.99550.9959
Table 5. Universal Failure Rate Function (UFRF) parameters of bearing 1 in different degradation stages.
Table 5. Universal Failure Rate Function (UFRF) parameters of bearing 1 in different degradation stages.
FeatureStage δ kbc
Normal stage310.020912.25170.0782 1.48 × 10 4
F 1 Continuous recession stage310.020910.19170.1555 1.48 × 10 4
Final failure stage289.020911.2017−0.8362 1.48 × 10 4
Normal stage310.020912.25170.0782 1.48 × 10 4
F 3 Continuous recession stage310.020910.19170.1555 1.48 × 10 4
Final failure stage289.020911.2017−0.8362 1.48 × 10 4
Normal stage297.020911.52170.0616 1.38 × 10 4
F 4 Continuous recession stage310.02099.89170.0663 1.28 × 10 4
Final failure stage270.020910.8017−0.4843 1.38 × 10 4
Normal stage310.020910.98170.0517 1.48 × 10 4
F 5 Continuous recession stage295.02099.30170.2335 1.48 × 10 4
Final failure stage296.020910.8517−0.3988 1.48 × 10 4
Normal stage310.020910.060.0061 1.48 × 10 4
F 8 Continuous recession stage295.020910.30170.0075 1.28 × 10 5
Final failure stage291.020911.1317−0.8164 1.38 × 10 4
Normal stage310.020912.25170.0782 1.48 × 10 4
F 9 Continuous recession stage295.020910.55170.00755 1.38 × 10 5
Final failure stage288.020911.1617−0.7486 1.38 × 10 4
Table 6. UFRF parameters of bearing 3 in different degradation stages.
Table 6. UFRF parameters of bearing 3 in different degradation stages.
FeatureStage δ kbc
Normal stage783.40.023 3.5 × 10 4
F 1 Continuous recession stage973.79170.0426 3.5 × 10 4
Final failure stage1004.70174.9300 0.13 × 10 2
Normal stage783.40.018 3.55 × 10 4
F 3 Continuous recession stage973.64170.0196 3.55 × 10 4
Final failure stage954.70176.2923 0.13 × 10 2
Normal stage783.40.018 3.55 × 10 4
F 4 Continuous recession stage970.01960.0196 3.55 × 10 4
Final failure stage1004.70176.2923 0.13 × 10 2
Normal stage783.330.018 3.55 × 10 4
F 5 Continuous recession stage1003.54170.0148 3.55 × 10 4
Final failure stage784.60173.9144 0.13 × 10 2
Normal stage783.170.009 3.55 × 10 4
F 8 Continuous recession stage1003.52170.0148 3.55 × 10 4
Final failure stage784.60170.1864 0.13 × 10 2
Normal stage783.030.004 3.55 × 10 4
F 9 Continuous recession stage973.54170.0196 3.55 × 10 4
Final failure stage954.70176.2923 0.13 × 10 2
Table 7. UFRF parameters of bearing 4 in different degradation stages.
Table 7. UFRF parameters of bearing 4 in different degradation stages.
FeatureStage δ kbc
Normal stage963.60.2138 3.55 × 10 4
F 1 Continuous recession stage913.4170.2218 3.5 × 10 4
Final failure stage973.63170.169 0.13 × 10 2
Normal stage963.50.0449 3.55 × 10 4
F 3 Continuous recession stage923.5370.0425 3.55 × 10 4
Final failure stage953.53170.0073 0.13 × 10 2
Normal stage963.50.0449 3.55 × 10 4
F 4 Continuous recession stage923.5370.0425 3.55 × 10 4
Final failure stage953.53170.0073 0.13 × 10 2
Normal stage963.730.2098 3.55 × 10 4
F 5 Continuous recession stage933.54170.213 3.55 × 10 4
Final failure stage953.73170.1352 0.13 × 10 2
Normal stage943.530.1423 3.55 × 10 4
F 8 Continuous recession stage933.7470.133 3.55 × 10 4
Final failure stage953.53170.1109 0.13 × 10 2
Normal stage9530.0494 3.55 × 10 4
F 9 Continuous recession stage913.3170.0469 3.55 × 10 4
Final failure stage923.38170.0192 0.13 × 10 2
Table 8. Description of bearing 1 data set.
Table 8. Description of bearing 1 data set.
Data TypeThe Number of TrainingThe Number of TestingLable
Normal5855851
25% of failure1001002
50% of failure1001003
90% of failure1641644
100% of failure35355
Total9849845
Table 9. Description of bearing 3 data set.
Table 9. Description of bearing 3 data set.
Data TypeThe Number of TrainingThe Number of TestingLable
Normal180818081
30% of failure1041042
60% of failure1051053
90% of failure1021024
100% of failure37375
Total215621565
Table 10. Description of bearing 4 data set.
Table 10. Description of bearing 4 data set.
Data TypeThe Number of TrainingThe Number of TestingLable
Normal107710771
40% of failure1721722
80% of failure1921923
95% of failure46464
100% of failure6686685
Total215621565
Table 11. Class classification accuracy of bearing 1.
Table 11. Class classification accuracy of bearing 1.
Class12345Total
Number of class58510010016435984
Well number of class5311002011728796
Accuracy91.1%100%20%71.3%80%80.9%
Table 12. Class classification accuracy of bearing 3.
Table 12. Class classification accuracy of bearing 3.
Class12345Total
Number of class1808104105102372156
Well number of class1753841752371943
Accuracy97%80.8%16.2%51%100%90.2%
Table 13. Class classification accuracy of bearing 4.
Table 13. Class classification accuracy of bearing 4.
Class12345Total
Number of class1077172192466682156
Well number of class669477105701357
Accuracy62.2%2.32%36.98%0%85.33%62.94%
Table 14. Comparison of bearing test results.
Table 14. Comparison of bearing test results.
Set No. 2—Bearing 1Accurancy
NB80.9%
Reference [26]74.2%
Table 15. Comparison of prediction error by different methods.
Table 15. Comparison of prediction error by different methods.
DataAlgorithme
Set No. 2—Bearing 1NB+UFRF0.1173
Referfece [42]4.61
Set No. 2—Bearing 3NB+UFRF0.0402
Reference [42]0.98
Set No. 2—Bearing 4NB+UFRF0.6345

Share and Cite

MDPI and ACS Style

Zhang, N.; Wu, L.; Wang, Z.; Guan, Y. Bearing Remaining Useful Life Prediction Based on Naive Bayes and Weibull Distributions. Entropy 2018, 20, 944. https://doi.org/10.3390/e20120944

AMA Style

Zhang N, Wu L, Wang Z, Guan Y. Bearing Remaining Useful Life Prediction Based on Naive Bayes and Weibull Distributions. Entropy. 2018; 20(12):944. https://doi.org/10.3390/e20120944

Chicago/Turabian Style

Zhang, Nannan, Lifeng Wu, Zhonghua Wang, and Yong Guan. 2018. "Bearing Remaining Useful Life Prediction Based on Naive Bayes and Weibull Distributions" Entropy 20, no. 12: 944. https://doi.org/10.3390/e20120944

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop