Next Article in Journal
Finite-Time Stability in Nonhomogeneous Delay Differential Equations of Fractional Hilfer Type
Next Article in Special Issue
A New 12-Lead ECG Signals Fusion Method Using Evolutionary CNN Trees for Arrhythmia Detection
Previous Article in Journal
An Algorithm for Numerical Integration of ODE with Sampled Unknown Functional Factors
Previous Article in Special Issue
Siamese Neural Networks for Damage Detection and Diagnosis of Jacket-Type Offshore Wind Turbine Platforms
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multi-Weighted Partial Domain Adaptation for Sucker Rod Pump Fault Diagnosis Using Motor Power Data

College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
*
Author to whom correspondence should be addressed.
Mathematics 2022, 10(9), 1519; https://doi.org/10.3390/math10091519
Submission received: 28 March 2022 / Revised: 21 April 2022 / Accepted: 22 April 2022 / Published: 2 May 2022

Abstract

:
Motor power curves (MPCs) have received great attention for use in diagnosing the working conditions of sucker rod pumping systems (SRPSs) because of their advantages in accessibility and real-time performance. However, existing MPC-based approaches mostly need a rigorous assumption that the MPC instances of different working conditions are sufficient, which does not hold in industrial scenarios. To this end, this paper proposes an unsupervised fault diagnosis methodology to leverage readily available dynamometer cards (DCs) to diagnose collected unlabeled MPCs. Firstly, a mathematical model of the SRPS is presented to convert actual DCs to MPCs. Secondly, a novel diagnostic methodology based on adversarial domain adaptation is proposed for the problem of data distribution discrepancy across the collected and converted MPCs. Specifically, the collected unlabeled MPCs may only cover a subset of the working conditions of the abundant DCs, which will easily cause negative transfer and lead to dramatic performance degradation. This proposed methodology employs class-level and distribution-level weighting strategies so as to guide the network to focus on the instances from shared categories and down-weight the outlier ones. Validation experiments are performed to evaluate the mathematical model and the diagnostic methodology with a set of actual MPCs collected by a self-developed device. The experimental result indicates that the accuracy of the proposed algorithm can reach 99.3 % in diagnosing actual MPCs when only labeled DCs and unlabeled actual MPCs are used.

1. Introduction

The sucker rod pump system (SRPS) is widely employed in the field of oil exploitation [1,2]. Unfortunately, due to continuous operation and harsh working environments, some components risk degradation and inevitable failure, e.g., traveling valve leakage, parting rod, etc. [3]. The common approaches to monitoring SRPSs rely on the dynamometer card (DC), which is measured by the load sensor installed on the “horse head” [4]. These DC-based methods inevitably suffer from high maintenance cost and low detection frequency, resulting in poor performance in terms of the real-time diagnosis of SRPSs.
Since the whole SPRS is driven by an electric motor, motor power curves (MPCs) show advantages in accessibility and real-time performance and have drawn increasing attention for use in the diagnosis of faults in the SPRS. The authors of [5,6] distilled features from MPCs and diagnosed faults with improved hidden conditional random fields. A condition-monitoring system based on motor power was proposed in [7]. Despite the fact that these methods have achieved outstanding performance, their successful application relies on abundant labeled data, which is an assumption that does not always hold due to the fact that MPC-based research is still in its initial stages. Some research seeks to expand MPC data by transforming the readily available DCs [8,9]. However, these approaches assume that the transformed and actual MPCs share an identical distribution, which is an assumption that does not hold due to the inevitable idealization and simplification that occurs in the transformation [10]. The distribution discrepancy, in turn, causes a serious performance degradation in the diagnosis [11]. Therefore, this paper explores how to leverage readily available DCs to achieve MPC-based diagnosis with respect to the distribution discrepancy.
Domain adaptation (DA) is famous as an efficient approach to mitigating domain discrepancy by extracting domain-invariant features [12,13,14]. Traditional DA employs the Maximum Mean Discrepancy (MMD) term as the discrepancy penalty in order to extract the domain-invariant features [15,16,17,18]. Another strand of research explores a domain discriminator to align the distributions in an adversarial manner. The authors of [19,20] used a one-dimensional convolutional neural network (1-D CNN) and a double task-specific classifier to learn domain-invariant features for fault diagnosis. A domain discriminator and MMD were exploited together via ensemble learning for feature extraction in [21,22]; they extended the adversarial network to the joint adaptation network to mitigate the distribution discrepancies in both the label and feature spaces.
In the absence of target labels, the aforementioned approaches have been demonstrated to be very effective in terms of intelligent diagnostics. Nevertheless, these methodologies restrict two domains to sharing an identical label space, which does not always hold in actual industrial applications [23]. A more general scenario is that some of the categories from the source domain do not appear in the target domain; this is referred to as partial domain adaptation (PDA) [24]. Following the objective of the standard DA methodologies, the outlier categories of the source domain are also forced to align with the target domain, which in turn causes negative transfer and misclassification [25]. A promising solution is to assign different weights to the instances that belong to different categories. The authors of [26,27] designed a multi-class adversarial loss to align instances in the shared label space. Two attention matrices were constructed to guide the model to diminish the distribution discrepancy as well as avoid negative transfer in [28]. In [29], a multi-discriminator was presented to pair the instances with the same machine conditions. The authors of [30] designed class-level and instance-level weights to alleviate the domain shift problem.
The aforementioned state-of-the-art PDA methodologies mainly focus on marginal distribution alignment in the shared label space. In this paper, we propose a conditional distribution-level weighting strategy and integrate it with the class-level weighting strategy into an adversarial approach to further mitigate the negative transfer when the categories of actual MPCs do not cover the categories of readily available DCs. The proposed weighting methodology comprehensively evaluates the weights of the samples in the source domain and seeks to further reduce the instance weight of outlier categories and highlights the instances of shared categories. Moreover, a 1-D CNN construct is conducted as the backbone of the feature generator network to extract domain-invariant features from the time-series data. The main contributions of this paper can be summarized as follows:
We construct an MPC dataset containing six categories of working conditions by conversing the DC instances with a mathematical model. The rationality of the converted MPCs is proved by comparison with the actual MPCs.
We propose to incorporate a class-level and conditional distribution-level weighting learning strategy into the adversarial domain adaptation to narrow down the discrepancies between converted and actual MPCs.
Extensive experiments are carried out on the MPCs collected by self-developed portable devices in the practical application scenario. The results demonstrate that the proposed methodology outperforms five other state-of-the-art methods in terms of diagnostic accuracy and distribution alignment.
The remaining parts of this article are organized as follows. The mathematical model for converting the DCs to MPCs is surveyed in Section 2. Section 3 describes the proposed diagnostic methodology. Section 4 shows the effectiveness of the proposed method through experimental verification. Finally, Section 5 concludes this article.

2. Conversion of the Motor Power Curves

There are insufficient fault samples for MPCs due to the fact that MPC-based research on SRPSs is in the initial stage. To address this problem, this section proposes a mechanism model that can covert the widely used DCs from different working conditions into MPCs. A typical structure of an SRPS is shown in Figure 1. When considering DCs, composed of polished load vs. movement, and MPCs, composed of power vs. time, the mathematical model implements the conversion using the following two aspects: (1) converting from movement to time by calculating the movement of the system following the order of the blue arrows in Figure 1; (2) converting from load to power by calculating the torque of the system following the order of the red arrows. A detailed discussion of the mathematical model for the SRPS is presented in this section.

2.1. Movement of the System

With the help of the “four-bar” device in Figure 1, the rotational motion of the crank is converted into an up-and-down reciprocating motion of the polish rod. Based on trigonometrical considerations, the calculation of the crank angle θ , based on the displacement of the polished rod s ( t ) , can be deduced as
χ m a x = arccos l 2 2 + A 2 2 ( C + R ) 2 2 l 2 A 2 , χ m i n = arccos l 2 2 + A 2 2 ( C R ) 2 2 l 2 A 2 , χ = χ m a x s ( t ) s m a x ( χ m a x χ m i n ) , l 3 = 2 A 2 l 2 cos χ l 2 2 A 2 2 , θ 1 = arctan D B G , θ 3 = arccos A 2 2 + l 2 2 l 3 2 2 A 2 l 2 , θ ( t ) = θ 3 + arccos R 2 + l 3 2 C 2 2 R l 3 .
where χ m a x and χ m i n denote the angle of χ when the sucker rod reaches the “bottom dead point” and “top dead point”, respectively. Other variables are marked in Figure 1. By actual observation, the crank angular velocity approaches constant speed in practice. This assumption is more accurate than previous studies that treat the polished rod as a simple harmonic motion. In practical SRPS scenarios, the crank angular velocity ω approaches constant speed in practice. The time vs. crank angle θ can be calculated by
t = θ ( t ) ω = 60 θ ( t ) 2 π n ,
where n denotes the stroke time.

2.2. Torque Transfer of the System

The system, driven by the motor, lifts the oil from the downhole to the overground. The motor rotation torque is transmitted to the crankshaft through the gearbox and acts on the polish rod with the cooperation of the crank counterweight W c b , the crankshaft weight W c k , and the unbalanced weight of the travel beam W u b . The torque of the crankshaft F c can be formulated as follows:
F c = T F ¯ ( F W u b ) η b μ ( W c k R c k + W c b R ) sin θ ( t ) ,
where F denotes the polished rod load, and R c k denotes the weight radius of crankshaft. The torque factor T F ¯ can be obtained from mechanics as in [31]:
T F ¯ = A 1 R A 2 sin φ sin β ,
where φ and β are marked in Figure 1 and expressed as
β = arccos A 2 2 + C 2 l 2 2 R 2 + 2 l 2 R cos ( θ 1 + θ ( t ) ) 2 A 2 C , φ = 2 π β ( θ ( t ) + θ 1 ) χ .
η b denotes the efficiency of the “four-bar” device ( μ = 1 when T F ¯ < 0 and μ = 1 when T F ¯ 0 ).
Considering the energy loss in the gearbox and the motor, the crank toque vs. the motor power is simplified as
P m = F c n m η m σ 9540 , when F c > 0 , σ = 1 , else σ = 1 ,
where n m denotes the motor speed, and η m denotes the transmission efficiency of the gearbox.

2.3. Problems in Practical Application Scenarios

With the help of the conversion mentioned above, MPCs under different working conditions are generated with abundant DCs. Nevertheless, traditional data-driven diagnostic methodologies trained with such converted curves may fail in practical application. A possible reason is that these approaches rely on a rigorous and fundamental assumption that the training and testing datasets are drawn from the same distribution with identical label spaces. This assumption does not hold in this scenario since there are many idealizations and simplifications in the above mechanistic analysis, such as constant gearbox efficiency, constant turndown rate, etc. Although these simplifications do not affect the overall performance of the converted MPCs, there are some changes in the details that result in distribution discrepancies between converted and actual MPCs.
Furthermore, since the collected MPCs are not labeled and probably do not cover all working conditions, the categories of the MPCs are likely to be a subset of the categories of the DCs with a better accumulation of historical monitoring data. An intuitive understanding of the false alignment caused by the outlier categories is shown in Figure 2. This negative effect caused by unrelated samples seriously restricts the successful application of the conventional DA-based diagnosis models.

3. Diagnostic Methodology Based on Converted Motor Power Curves

To address the above dilemma, a novel partial DA-based methodology is proposed in this section to narrow down the distribution discrepancy of the converted and collected MPCs. Overall, the methodology is built upon an adversarial DA architecture. Specifically, it employs conditional distribution-level and class-level weights to prevent the negative adaptation caused by the label space mismatching.

3.1. Problem Formulation

To clearly investigate the fault diagnostic problem, several symbols and concepts are first introduced. The MPCs that are converted by labeled DCs are denoted as the source domain D s = { ( χ i s , y i s ) } i = 1 n s containing n s instances associated with C s categories of working conditions. The collected MPCs are denoted as target domain D t = { ( χ j t ) } j = 1 n t containing n t unlabeled samples with C t categories, where C t C s . D s can be divided into shared label space D s C Y i n = { ( χ , y ) | ( χ , y ) D s , y C t } and outlier label space D s C Y o u t = { ( χ , y ) | ( χ , y ) D s , y C t } .
Due to the distribution discrepancy ( P s ( χ s ) P t ( χ t ) ) caused by mathematical error, the diagnostic model trained on D s is usually not tailored for D y . Typical DA-based methodologies aim at exploring domain-invariant features to bridge the distribution discrepancy. Nevertheless, the negative transfer effect caused by D s C Y o u t seriously degrades performance. The goal of this section is to design a partial DA-based diagnostic methodology to discriminate D s C Y i n and leverage the knowledge learned from D s C Y i n to promote the diagnosis of unlabeled D t .

3.2. Network Architecture

The network architecture of the proposed diagnostic methodology is illustrated in Figure 3. Overall, the methodology consists of a feature generator network f g parameterized by θ g , a label classifier f c parameterized by θ c , a domain classifier f d parameterized by θ d , a class-level attention matric W c , and a conditional distribution-level attention metric W d . To benefit from its excellent nonlinear characterization capabilities for the time-series signal, a 1-D CNN is selected as the backbone of the f g . Concretely, f g is implemented with three 1-D CNNs and one fully connected layer (FC). The f c and f d consist of one and two FCs, respectively. Moreover, batch normalization (BN) and dropout techniques are adopted to improve the generalization ability. The detailed parameters and architecture are given in Figure 4.

3.2.1. Domain Adversarial Learning

Inspired by GAN, DA-based methodologies bridge the gap between two domains so that the classifier trained on the source domain generalizes well to the target domain. In the traditional DA stage, f d is constructed to distinguish the features of the source and target domains, whereas f g is trained in a min-max adversarial training game to make the discriminator wrongly recognize the input of the source and target domains. The instances of D s and D t are fed into f g to extract the domain-invariant features. Then, the features of the source domain are sent to f c to ensure that it contains category information. What is more, the features of the source and target domains are contrasted with the domain classifier f d to avoid retaining the characteristics of domains. Training such a DA-based methodology is equivalent to calculating the following optimization formula
m i n θ g , θ c m a x θ d 1 N s χ i , y i D s L ( f c ( f g ( χ i , θ g ) , θ c ) , y i ) λ N s + N t χ i , y ˙ i D s D t L ( f d ( f g ( χ i , θ g ) , θ d ) , y ˙ i ) ,
where L ( , ) denotes the cross-entropy loss function, y ˙ i denotes the domain label, and λ is a regularization parameter. As demonstrated in the first half of the optimization formula, θ g and θ c are updated to minimize the label loss of source samples to avoid losing label-related information during feature extraction. In the other half, θ d is learned to maximize the domain loss so that the extracted features are as irrelevant as possible to the domain, while θ c is trained to minimize it so that the extracted features contain more information for diagnosing class labels.

3.2.2. Weighting Learning Strategy

Theoretically, the domain shifts can be diminished by optimizing the above-mentioned objective. However, as intuitively illustrated in Figure 2, pure DA-based methods are prone to performance degeneration or even to misdiagnosis due to the outlier classes. The proposed weighting learning strategy aims to modify the above methodologies by incorporating weight metrics to indicate shared and outlier categories; this focuses on instances from D s C Y i n and downweights instances from D s C Y o u t . The proposed weighting strategy is expected to add benefits to pure DA approaches from two perspectives: class-level weighting W c and conditional distribution-level weighting W d . Both represent the weights of source instances.
The output of f c can provide a category probability of the input features. Since the label space of D s C Y o u t is disjoint with D t , the feature values of D t corresponding to the categories of D s C Y o u t are relatively small. Therefore, we calculate the output probabilities of all the instance features of D t as follows:
Y ^ t = Y ^ 1 t Y ^ 2 t Y ^ n t t = y ^ 1 , C 1 t y ^ 1 , C 2 t y ^ 1 , C C s t y ^ 2 , C 1 t y ^ 2 , C 2 t y ^ 2 , C C s t y ^ n t , C 1 t y ^ n t , C 2 t y ^ n t , C C s t ,
where y ^ i , C j t denotes the output probabilities of the ith instance in D t assigned to jth category. To mitigate the influence of randomness and a few mistakes, the average of the label predictions on all target data is used as the class-level weight as follows:
W c = 1 n t i = 1 n t Y ^ i t .
The class-level weight is further normalized as W c W c / m a x ( W c ) to demonstrate the relative importance of the classes. The weights associated with the outlier classes are expected to be much smaller than those of the shared classes, mainly because the target samples are significantly dissimilar to the samples belonging to the outlier classes.
In contrast to W c , W d is a distribution-level weight estimated by the conditional distribution discrepancy. Inspired by the index MMD that has been widely applied in transfer learning attributable to its superior capacity for characterizing distribution similarity, this paper exploits the MMD as the metric to measure the distribution discrepancy of each category as
D c = 1 n s c χ i D s f g ( χ i | y i = c , θ g ) 1 n t c χ j D ^ t f g ( χ j | y ^ j = c , θ g ) H 2 ,
where · H represents the Reproducing Kernel Hilbert Space and c C s . It is reasonable that the D c corresponding to shared categories is likely to be much less than that within outlier categories. Therefore, on the basis of the MMD metrics, W d can be formulated as
W d = [ 1 D 1 , 1 D 2 , , 1 D C s ] .
Similar to W c , W d also needs to be normalized as W d W d / m a x ( W d ) .
Benefiting from W c and W d , more attention is paid to shared conditions, and the negative transfer caused by outliers will be mitigated.

3.3. Overall Objective and Training

In the training process, the proposed diagnostic methodology diminishes the distribution discrepancy of the source and target domains. Meanwhile, in order to avoid the negative transfer caused by the source outlier instances, this methodology applies the trained classifier and conditional MMD index to estimate the weight of the source data. According to Equation (7), the final objective loss function is summarized as
L c = 1 N s χ i , y i D s W c W d L ( f c ( f g ( χ i , θ g ) , θ c ) , y i ) , L d = 1 N s χ i , y ˙ i D s L ( f d ( f g ( χ i , θ g ) , θ d ) , y ˙ i ) 1 N t χ i , y ˙ i D t L ( f d ( f g ( χ i , θ g ) , θ d ) , y ˙ i ) ,
where L c and L d indicate loss functions of the label classifier and domain classifier, respectively. Generally, minimizing L c encourages the classifier to produce vectors with one dominant element denoting the label of the samples. This, in turn, enhances the performance of the feature extractor and helps to learn more transferable features for classification. Moreover, W c and W d are incorporated to highlight the importance of samples belonging to the shared classes. Meanwhile, the domain classifier is trained to minimize the L d to learn domain-invariant feature representations in order to confuse f d . What is more, a gradient reversal layer (GRL) [32] is placed before the domain classifier to receive the gradient of L d by multiplying a negative factor. The network is updated by employing the adaptive moment estimation optimizer (Adam) with the learning rate τ that is set to 0.001. The parameters θ g , θ c , and θ d are updated simultaneously at each step as
θ g θ g τ ( L c θ g λ L d θ g ) , θ c θ c τ L c θ c , θ d θ d τ λ L d θ d .

4. Industrial Experiments

In this section, we validate the performance of the proposed methodology with a set of DCs and MPCs collected from wells with the same mechanical parameters. Firstly, the MPCs converted from the DCs are evaluated by mechanistic analysis in comparison with actual MPCs and some diagnostic experiments. Meanwhile, we compare the diagnostic methodology with several other popular approaches to demonstrate the effectiveness of the improvement in partial transfer scenarios.

4.1. Data Collection

The experimental platform is illustrated in Figure 5. The DCs are collected by the load and displacement sensors installed on the “horse head” over a long period of time. The voltage and current of the inverter are collected and then calculated by the chip ATT7022B to obtain the MPCs. The obtained MPCs are analyzed and stored in the intelligent automatic metrical apparatus, after which the real-time diagnostic results and historical data can be viewed through the cell phone APP.
After long-term practice, 300 groups of MPCs are collected from seven oil wells with the same mechanical parameters, as shown in Table 1. In particular, it should be noted that these 300 instances do not contain the working condition of gas locking. However, some DCs of gas locking are collected for inverting. All simulations are implemented in the MATLAB and Pytorch frameworks and conducted on a workstation with a Core i7-9700K [email protected] GHz and a GTX2080TI GPU with 11 GB memory.

4.2. Validation of the Converted Motor Power Curves

Employing the conversion mathematical model introduced in Section 2, the collected actual DCs, the converted MPCs, and the actual MPCs under six working conditions are listed in Figure 6, Figure 7, Figure 8, Figure 9, Figure 10 and Figure 11.
Combined with the mechanism characteristics, the analysis of the converted and actual MPCs under different working conditions is summarized as follows:
Normal working condition Y 0 : Since the wells are well filled, the loads of the upstroke and downstroke are relatively balanced under the influence of the crank and unbalanced weight, resulting in similar peaks for the upstroke and the downstroke in the MPC.
Traveling valve leakage Y 1 : Due to the leakage, the oil in the sucker rod leaks into the pump during the upstroke, delaying the increase of the pressure and opening the standing valve. Therefore, the power of the upstroke is less than the normal working condition, and the first peak shifts to the left.
Insufficient liquid supply Y 2 : Due to the insufficient supply capacity of the oil layer, the oil cannot fill the chamber during the upstroke. During the downstroke, the oil in the sucker rod falls quickly into the chamber when the traveling valve is opened, which reduces the system load. The load increases rapidly when the plunger hits the oil interface, resulting in double peaks in the power curve. The average value of the MPC is usually lower than normal power.
Gas-affected Y 3 : Similar to condition Y 2 , due to the superabundant dissolving gas, the oil fills the chamber, resulting in lower average power in the downstroke. Departing from the double peaks in Y 2 , the superabundant gas acts as a buffer when the traveling valve is open. Thus the power change is relatively smooth, without a rapid increase.
Gas locking Y 4 : This is a special case of Y 3 . The gas in the chamber makes the pressure insufficient to open the standing and traveling valves, so the oil cannot be adequately discharged. Since no oil is taken to the ground, the motor power curve has negative values during the downstroke due to the gravity of the oil in the sucker rod.
Parting rod Y 5 : The motor load is mainly caused by the crank and the weight of the rod above the breakpoint. During the upstroke, the energy stored in the crank is more than the requirement to uplift the remaining rod, resulting in the apparent negative power in the MPC.
As illustrated in the above figures, the characteristics embodied in the converted MPCs under different working conditions conform to the mechanism analysis, and the converted and actual MPCs have similar trends.
In order to assure a more in-depth validity of the quantitative analysis, we select 100 samples of DCs for each working condition and convert them to the MPCs to diagnose 300 instances of actual MPCs. We conduct experiments with two different diagnostic frameworks based on CNN and 1-D CNN to verify the effectiveness of the converted MPCs from the two perspectives of time-series and image, respectively. The diagnostic results are presented in Figure 12. It can be observed that the diagnostic accuracies achieve 74 % and 78 % . It reveals that both approaches achieve overall satisfactory performance. In particular, the 1-D CNN outperforms the CNN in terms of diagnostic performance, implying that the time-series-based approach is more applicable to the MPCs than analyzing the curves as pictures. Nevertheless, these conventional diagnosis methods do not satisfy industrial demands, owing to distribution discrepancies. What is more, these methods also do not remove the interference of the outlier classes.

4.3. Diagnosis Based on Partial Domain Adaptation

In this section, the proposed PDA-based diagnostic method is employed to minimize the distribution discrepancy across domains in practical application scenarios. Firstly, we investigate the convergence performance of the proposed method to ensure that the improved portions do not undermine its overall stability. Figure 13 plots the loss and accuracy curves with respect to training iterations. From these results, we can observe the classifier loss decreases rapidly and converges to 0. The adversarial loss oscillates reciprocally, which demonstrates that the domain classifier and the label classifier progress together and maintain relative balance. What is more, the accuracy curves ultimately approach 1, which further illustrates that the method can mitigate negative transfer efficiently and stably.
Furthermore, we conduct an ablation study to examine the efficiency of each component of the weighting scheme. By reducing the weighting strategy in the model, we investigate four variants of the proposed method: the DA-based method without the weighting learning strategy, the DA-based method with class-level weighting, the DA-based method with conditional distribution-level weighting, and the proposed method containing both class-level and conditional distribution-level weighting. The results shown in Figure 14 demonstrate: (1) both the class-level weighting and conditional distribution-level weighting are essential for the good performance of the proposed method; (2) despite the fact that the conditional distribution-level weighting is inferior to class-level weighting, it can further enhance the performance of class-level weighting.
For a more comprehensive evaluation, we compare the proposed methodology with representative DA and PDA baselines, including 1-D CNN, DANN [19], CIDA [33], WATN [26], and MWDAN [30]. We show the comparison results in Table 2 and demonstrate visual insights into the distribution discrepancy of distilled features with t-distributed stochastic neighbor embedding (t-SNE) [34] in Figure 15. In particular, the following results are the average of five rounds of experiments with random data splitting in each round. The training data and test data for each algorithm are identical.
From Table 2 and Figure 15, some results can be clearly determined. From Figure 15a, we observe that the source samples under various working conditions are aliased together and, thus, are difficult to distinguish. As shown in Figure 15b, the samples under different working conditions demonstrate a tendency to be gradually separable, but the aliasing phenomenon is still serious. As Figure 15c demonstrates, with the help of domain adaption, the samples from the same category are clustered, while the samples from different categories are separated. Nevertheless, we find that many target data are aligned with the source-only samples, resulting in low overall accuracy. With the help of the class-level weighting strategy in CIDA and the weighting discriminant network in WATN, the distribution alignment is improved significantly, and fewer target samples are close to the outlier category in Figure 15d,e. As shown in Figure 15f, by using both a class-level weighting strategy and a weighting discriminant network, MWDAN further separates the categories and achieves satisfactory classification performance in both the source and target domains. It shows that the superposition of these two weighting strategies can achieve better results. Comparing Figure 15f,g, we observe that the outlier classes can be better identified, and less classification confusion is obtained with the help of the proposed methodology. This reveals that the proposed conditional distribution-level weighting strategy outperforms the weighting discriminant network and can better cooperate with the class-level weighting strategy to inhibit the negative effect of irrelevant instances. Overall, these results illustrate the superior performance of the proposed methodology in handling the practical PDA problems in SRPSs.

5. Conclusions

This article proposes a PDA-based diagnostic methodology to exploit readily available DCs to implement intractable unsupervised MPC-based diagnosis in the SRPS. The proposed methodology constructs a mathematical model to convert DCs to MPCS under six working conditions. Meanwhile, a novel adversarial domain adaptation method is adopted to diminish the distribution discrepancy between converted and actual MPCs as well as to avoid negative transfer. In particular, we superpose the class-level and conditional distribution-level weights to mitigate the negative transfer caused by the inconsistent label space of MPCs and DCs. We conduct several experiments on a set of actual MPCs collected by self-developed devices for fault diagnosis. The MPCs converted by the model proposed in this paper have the same trend as the actual power, and the 1-D CNN model trained with the converted power can achieve an accuracy of 78 % in the actual MPC dataset. When leveraging the labeled converted MPCs to diagnose the actual unlabeled MPCs, the accuracy of the proposed PDA-based methodology can reach 99.3 % and outperform other relevant methods.
Although this diagnostic methodology achieves outstanding progress in the MPC-based diagnosis of SRPSs, there are additional works worth exploring in the future, e.g., the mathematical model of the motor and gearbox needs further refinement, the backbone of the feature generator network can be re-attempted with recurrent designs, such as RNN or LSTMs, etc. Moreover, more experiments need to be conducted on other oil wells to make the model more generalized.

Author Contributions

Conceptualization, D.H.; methodology, D.H.; software, D.H.; validation, D.H. and X.G.; formal analysis, D.H.; investigation, D.H.; resources, X.G.; data curation, D.H.; writing—original draft preparation, D.H.; writing—review and editing, D.H. and X.G.; visualization, D.H.; supervision, D.H.; project administration, X.G.; funding acquisition, X.G. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China (62173073).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Li, K.; Han, Y.; Wang, T. A novel prediction method for down-hole working conditions of the beam pumping unit based on 8-directions chain codes and online sequential extreme learning machine. J. Pet. Sci. Eng. 2018, 160, 285–301. [Google Scholar] [CrossRef]
  2. Han, Y.; Li, K.; Ge, F.; Wang, Y.; Xu, W. Online fault diagnosis for sucker rod pumping well by optimized density peak clustering. ISA Trans. 2021, 120, 222–234. [Google Scholar] [CrossRef] [PubMed]
  3. Lv, X.; Wang, H.; Zhang, X.; Liu, Y.; Jiang, D.; Wei, B. An evolutional SVM method based on incremental algorithm and simulated indicator diagrams for fault diagnosis in sucker rod pumping systems. J. Pet. Sci. Eng. 2021, 203, 108806. [Google Scholar] [CrossRef]
  4. Gibbs, S. Predicting the behavior of sucker-rod pumping systems. J. Pet. Technol. 1963, 15, 769–778. [Google Scholar] [CrossRef]
  5. Takacs, G.; Kis, L. A new model to find optimum counterbalancing of sucker-rod pumping units including a rigorous procedure for gearbox torque calculations. J. Pet. Sci. Eng. 2021, 205, 108792. [Google Scholar] [CrossRef]
  6. Zheng, B.; Gao, X.; Pan, R. Sucker rod pump working state diagnosis using motor data and hidden conditional random fields. IEEE Trans. Ind. Electron. 2019, 67, 7919–7928. [Google Scholar] [CrossRef]
  7. Takacs, G. A critical analysis of power conditions in sucker-rod pumping systems. J. Pet. Sci. Eng. 2022, 210, 110061. [Google Scholar] [CrossRef]
  8. Wei, J.; Gao, X. Fault Diagnosis of Sucker Rod Pump Based on Deep-Broad Learning Using Motor Data. IEEE Access 2020, 8, 222562–222571. [Google Scholar] [CrossRef]
  9. Chen, L.; Gao, X.; Li, X. Using the motor power and XGBoost to diagnose working states of a sucker rod pump. J. Pet. Sci. Eng. 2021, 199, 108329. [Google Scholar] [CrossRef]
  10. Desbordes, J.K.; Zhang, K.; Xue, X.; Ma, X.; Luo, Q.; Huang, Z.; Hai, S.; Jun, Y. Dynamic production optimization based on transfer learning algorithms. J. Pet. Sci. Eng. 2022, 208, 109278. [Google Scholar] [CrossRef]
  11. Sajjad, U.; Hussain, I.; Imran, M.; Sultan, M.; Wang, C.C.; Alsubaie, A.S.; Mahmoud, K.H. Boiling Heat Transfer Evaluation in Nanoporous Surface Coatings. Nanomaterials 2021, 11, 3383. [Google Scholar] [CrossRef] [PubMed]
  12. Zhao, Z.; Zhang, Q.; Yu, X.; Sun, C.; Wang, S.; Yan, R.; Chen, X. Applications of Unsupervised Deep Transfer Learning to Intelligent Fault Diagnosis: A Survey and Comparative Study. IEEE Trans. Instrum. Meas. 2021, 70, 1–28. [Google Scholar] [CrossRef]
  13. Li, X.; Zhang, W. Deep Learning-Based Partial Domain Adaptation Method on Intelligent Machinery Fault Diagnostics. IEEE Trans. Ind. Electron. 2021, 68, 4351–4361. [Google Scholar] [CrossRef]
  14. Zhang, H.; Ren, H.; Mu, Y.; Han, J. Optimal Consensus Control Design for Multiagent Systems With Multiple Time Delay Using Adaptive Dynamic Programming. IEEE Trans. Cybern. 2021. [Google Scholar] [CrossRef] [PubMed]
  15. Wen, L.; Gao, L.; Li, X. A new deep transfer learning based on sparse auto-encoder for fault diagnosis. IEEE Trans. Syst. Man Cybern. Syst. 2017, 49, 136–144. [Google Scholar] [CrossRef]
  16. Li, X.; Zhang, W.; Xu, N.X.; Ding, Q. Deep learning-based machinery fault diagnostics with domain adaptation across sensors at different places. IEEE Trans. Ind. Electron. 2019, 67, 6785–6794. [Google Scholar] [CrossRef]
  17. Ye, Z.; Yu, J.; Mao, L. Multisource Domain Adaption for Health Degradation Monitoring of Lithium-Ion Batteries. IEEE Trans. Transp. Electrif. 2021, 7, 2279–2292. [Google Scholar] [CrossRef]
  18. Zhao, B.; Zhang, X.; Zhan, Z.; Wu, Q. Deep multi-scale separable convolutional network with triple attention mechanism: A novel multi-task domain adaptation method for intelligent fault diagnosis. Expert Syst. Appl. 2021, 182, 115087. [Google Scholar] [CrossRef]
  19. Ganin, Y.; Ustinova, E.; Ajakan, H.; Germain, P.; Larochelle, H.; Laviolette, F.; Marchand, M.; Lempitsky, V. Domain-adversarial training of neural networks. J. Mach. Learn. Res. 2016, 17, 2030–2096. [Google Scholar]
  20. Jiao, J.; Zhao, M.; Lin, J. Unsupervised adversarial adaptation network for intelligent fault diagnosis. IEEE Trans. Ind. Electron. 2019, 67, 9904–9913. [Google Scholar] [CrossRef]
  21. Li, Y.; Song, Y.; Jia, L.; Gao, S.; Li, Q.; Qiu, M. Intelligent fault diagnosis by fusing domain adversarial training and maximum mean discrepancy via ensemble learning. IEEE Trans. Ind. Inform. 2020, 17, 2833–2841. [Google Scholar] [CrossRef]
  22. Liu, Y.; Zhong, L.; Qiu, J.; Lu, J.; Wang, W. Unsupervised Domain Adaptation for Nonintrusive Load Monitoring Via Adversarial and Joint Adaptation Network. IEEE Trans. Ind. Inform. 2022, 18, 266–277. [Google Scholar] [CrossRef]
  23. Huang, T.W.; Bhat, S.A.; Huang, N.F.; Chang, C.Y.; Chan, P.C.; Elepano, A.R. Artificial Intelligence-Based Real-Time Pineapple Quality Classification Using Acoustic Spectroscopy. Agriculture 2022, 12, 129. [Google Scholar] [CrossRef]
  24. Yang, C.; Cheung, Y.M.; Ding, J.; Tan, K.C.; Xue, B.; Zhang, M. Contrastive Learning Assisted-Alignment for Partial Domain Adaptation. IEEE Trans. Neural Netw. Learn. Syst. 2022, 1–14. [Google Scholar] [CrossRef]
  25. Zhang, W.; Li, X.; Ma, H.; Luo, Z.; Li, X. Universal domain adaptation in fault diagnostics with hybrid weighted deep adversarial learning. IEEE Trans. Ind. Inform. 2021, 17, 7957–7967. [Google Scholar] [CrossRef]
  26. Li, W.; Chen, Z.; He, G. A Novel Weighted Adversarial Transfer Network for Partial Domain Fault Diagnosis of Machinery. IEEE Trans. Ind. Inform. 2021, 17, 1753–1762. [Google Scholar] [CrossRef]
  27. Kheirandishfard, M.; Zohrizadeh, F.; Kamangar, F. Class Conditional Alignment for Partial Domain Adaptation. In Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy, 10–15 January 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 811–818. [Google Scholar]
  28. Deng, Y.; Huang, D.; Du, S.; Li, G.; Zhao, C.; Lv, J. A double-layer attention based adversarial network for partial transfer learning in machinery fault diagnosis. Comput. Ind. 2021, 127, 103399. [Google Scholar] [CrossRef]
  29. Han, T.; Liu, C.; Wu, R.; Jiang, D. Deep transfer learning with limited data for machinery fault diagnosis. Appl. Soft Comput. 2021, 103, 107150. [Google Scholar] [CrossRef]
  30. Jiao, J.; Zhao, M.; Lin, J. Multi-Weight Domain Adversarial Network for Partial-Set Transfer Diagnosis. IEEE Trans. Ind. Electron. 2022, 69, 4275–4284. [Google Scholar] [CrossRef]
  31. Zheng, B.; Gao, X.; Li, X. Fault detection for sucker rod pump based on motor power. Control Eng. Pract. 2019, 86, 37–47. [Google Scholar] [CrossRef]
  32. Ganin, Y.; Lempitsky, V. Unsupervised domain adaptation by backpropagation. In Proceedings of the International Conference on Machine Learning (PMLR), Lille, France, 7–9 July 2015; pp. 1180–1189. [Google Scholar]
  33. Jiao, J.; Zhao, M.; Lin, J.; Ding, C. Classifier inconsistency-based domain adaptation network for partial transfer intelligent diagnosis. IEEE Trans. Ind. Inform. 2019, 16, 5965–5974. [Google Scholar] [CrossRef]
  34. Van der Maaten, L.; Hinton, G. Visualizing data using t-SNE. J. Mach. Learn. Res. 2008, 9, 2579–2605. [Google Scholar]
Figure 1. Sucker rod pump system.
Figure 1. Sucker rod pump system.
Mathematics 10 01519 g001
Figure 2. Illustrations of negative transfer.
Figure 2. Illustrations of negative transfer.
Mathematics 10 01519 g002
Figure 3. The framework of the proposed approach.
Figure 3. The framework of the proposed approach.
Mathematics 10 01519 g003
Figure 4. The designed architecture and key parameters.
Figure 4. The designed architecture and key parameters.
Mathematics 10 01519 g004
Figure 5. Self-developed data acquisition and analysis equipment employed in the SRPS.
Figure 5. Self-developed data acquisition and analysis equipment employed in the SRPS.
Mathematics 10 01519 g005
Figure 6. Normal working state.
Figure 6. Normal working state.
Mathematics 10 01519 g006
Figure 7. Traveling valve leakage working state.
Figure 7. Traveling valve leakage working state.
Mathematics 10 01519 g007
Figure 8. Insufficient liquid supply working state.
Figure 8. Insufficient liquid supply working state.
Mathematics 10 01519 g008
Figure 9. Gas-affected working state.
Figure 9. Gas-affected working state.
Mathematics 10 01519 g009
Figure 10. Gas locking working state.
Figure 10. Gas locking working state.
Mathematics 10 01519 g010
Figure 11. Parting rod working state.
Figure 11. Parting rod working state.
Mathematics 10 01519 g011
Figure 12. The confusion matrices of diagnosis results.
Figure 12. The confusion matrices of diagnosis results.
Mathematics 10 01519 g012
Figure 13. The trend of training accuracy and loss for the proposed method.
Figure 13. The trend of training accuracy and loss for the proposed method.
Mathematics 10 01519 g013
Figure 14. Ablation study to the partial domain adaptation task.
Figure 14. Ablation study to the partial domain adaptation task.
Mathematics 10 01519 g014
Figure 15. T-SNE feature visualization.
Figure 15. T-SNE feature visualization.
Mathematics 10 01519 g015
Table 1. The main parameters of the test wells.
Table 1. The main parameters of the test wells.
ParametersValueParametersValue
Pumping unit typeCYJ14-5-73HB
A 1 /mm7000n/min 1 4
A 2 /mm3110R /mm1270
C /mm5790 W c k /kg5374
B /mm7210 W c b /kg5378
G /mm1460 W u b /kg1229
D /mm3110MotorY250M-6
Table 2. Diagnosis results with different methods.
Table 2. Diagnosis results with different methods.
Method1-D CNNDANNCIDAWATNMWDANProposed
Accuracy (%)789597.79898.399.3
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hao, D.; Gao, X. Multi-Weighted Partial Domain Adaptation for Sucker Rod Pump Fault Diagnosis Using Motor Power Data. Mathematics 2022, 10, 1519. https://doi.org/10.3390/math10091519

AMA Style

Hao D, Gao X. Multi-Weighted Partial Domain Adaptation for Sucker Rod Pump Fault Diagnosis Using Motor Power Data. Mathematics. 2022; 10(9):1519. https://doi.org/10.3390/math10091519

Chicago/Turabian Style

Hao, Dezhi, and Xianwen Gao. 2022. "Multi-Weighted Partial Domain Adaptation for Sucker Rod Pump Fault Diagnosis Using Motor Power Data" Mathematics 10, no. 9: 1519. https://doi.org/10.3390/math10091519

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop