Next Article in Journal
Rapid Detection of Total Viable Count in Intact Beef Dishes Based on NIR Hyperspectral Hybrid Model
Previous Article in Journal
Saving Energy Using the Modified Heuristic Algorithm for Energy Saving (MHAES) in Software-Defined Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Research on Rotating Machinery Fault Diagnosis Based on an Improved Eulerian Video Motion Magnification

School of Mechanical Science and Engineering, Northeast Petroleum University, Daqing 163318, China
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(23), 9582; https://doi.org/10.3390/s23239582
Submission received: 15 October 2023 / Revised: 29 November 2023 / Accepted: 30 November 2023 / Published: 3 December 2023
(This article belongs to the Section Fault Diagnosis & Sensors)

Abstract

:
Rotating machinery condition monitoring and fault diagnosis are important bases for maintenance decisions, as the vibrations generated during operation are usually imperceptible to the naked eye. Eulerian video motion magnification (EVMM) can reveal subtle changes and has been widely used in various fields such as medicine, structural analysis, and fault diagnosis, etc. However, the method has a bound relationship among three parameters: spatial wavelength, amplification factor, and displacement function, so it is necessary to adjust the parameters manually in practical applications. In this paper, on the basis of the original method, an automatic solution of spatial cutoff wavelength based on brightness is proposed. First, an input video is decomposed into image sequences, their RGB color spaces are transformed into HSV color spaces, and the Value channel image representing brightness is selected to automatically calculate the spatial cutoff frequency, and then the spatial cutoff wavelength is determined, and the motion magnification video in the specified frequency band is obtained by substituting it into the original method. Then, a publicly available video is taken as an example for simulation analysis. By comparing the time-brightness curves of the three videos (original video, motion magnification video obtained by the original method and the improved method), it is apparent that the proposed method exhibits the most significant brightness variation. Finally, taking an overhung rotor-bearing test device as the object, five conditions are set, respectively: normal, rotor unbalance, loosened anchor bolt of the bearing seat, compound fault, rotor misalignment. The proposed method is adopted to magnify the motion of the characteristic frequency bands including 1X frequency and 2X frequency. The results show that no obvious displacement is found in normal working conditions, and that the rotor unbalance fault has an overall axial shaking, the bearing seat at the loose place has an obvious vertical displacement, while the compound fault combines the both fault characteristics, and the rotor misalignment fault has an obvious axial displacement of the free-end bearing seat. The method proposed in this paper can automatically obtain the space cutoff wavelength, which solves the problem of defects arising from manually adjusting the parameters in the original method, and provides a new method for rotating machinery fault diagnosis and other fields of application.

1. Introduction

Rotary machines such as turbines, pumps, engines and electric machines play an important role in modern industry. When they are operated for a long time in a complex working environment, especially in high-speed rotating machinery such as aircraft engines, even a small failure may lead to serious consequences. How to reduce the downtime of rotating machinery and ensure their long-term, safe and stable operation has always been a research focus, and condition monitoring and fault diagnosis technology is an important basis for maintenance decisions.
Currently, signal processing methods such as empirical mode decomposition (EMD) [1], ensemble empirical mode decomposition (EEMD) [2,3], and wavelet transformation [4] have been well applied in rotating machinery fault diagnosis [5,6]. The traditional vibration analysis technology based on spectrum analysis has been widely used in the fault diagnosis of rotating machinery, and has formed a lot of fault spectrum features with reference values, but it needs experienced personnel to perform the analysis, and there is not a one-to-one mapping relationship between the fault condition and the spectrum characteristics, but rather a one-to-many mapping relationship, which increases the difficulty of fault diagnosis. In this field, the author often encounters the problem that it is difficult to accurately identify rotating machinery faults by using spectrum characteristics. In contrast, the operational deflection shape (ODS) analysis method [7] not only realizes fault-source localization but also visually and intuitively displays structural vibration patterns under specific working conditions (that is, at a specified time or at a specified frequency). It has achieved satisfactory outcomes in fault diagnoses in rotating machinery such as centrifugal pumps [8] and rotor systems [9,10,11]. However, the above methods require conventional vibration sensors, which not only have limited measurement points but are also difficult to install in environments with high temperatures, high pressures, the presence of oil and gas, or corrosion. Furthermore, mass load is generated on lightweight structures, which affects the vibration characteristics of equipment and reduces the accuracy of analysis results. Non-contact fault diagnosis methods offer a new approach to solving these challenges. At present, the non-contact fault diagnosis methods used in rotating machinery fault diagnosis mainly include the optical method [12,13], the three-dimensional digital image correlation (3D-DIC) [14,15,16] method, and the computer vision method [17,18,19,20]. However, the optical method based on a laser vibrometer is still mainly based on local vibration measurements, and the full-field and multi-directional vibration detection is still in the research stage. The 3D-DIC method usually requires at least two high-speed cameras, incurring higher costs and demanding strict operating environments, making practical application inconvenient. The computer vision method needs traditional signal processing technology to extract fault features, but the analysis results are not visual or intuitive, which affects the practicability of this method to a certain extent.
Motion magnification (MM) is a new method of motion detection which processes videos captured by high-speed cameras and magnifies the subtle motions invisible to the naked eye to make them obvious. The MM methods proposed in recent years are based on the Eulerian perspective [21], and the changes of each fixed pixel (or region) of the measured object in the video are observed to achieve pixel-level motion magnification. The method was originally used for medical remote monitoring. Sushma [22] adopted the method of motion magnification to detect motion in perfusion-weighted MRIs, so as to reduce the data destruction caused by patients’ involuntary activities during the wait for blood perfusion. Thomas V. et al. [23] adopted the motion magnification method based on the Riesz Pyramid to make the changes in blood flow, head movement and skin and facial color controlled by the heartbeat’s rhythm more obvious. Dionysius M. Siringoringo et al. [24] used a vision-based motion magnification method to extract the vibration of viaduct light poles, and accurately extracted the multi-modal vibration characteristics of light poles through his analysis. Eitner M. et al. [25] used the broad-band phase-based motion magnification (BPMM) method to measure nozzle vibration under pressurized air excitation and clearly identified the sixth-order mode. The results of the modal parameter estimation were significantly improved. Luo K et al. [26] proposed the measurement method of cable bridge vibration based on the broad-band phase video motion magnification (BPVMM) method. Aral Sarraf et al. [27] used the phase-based motion amplification method to identify the structural motion of wind turbine blades under the condition of damage from the captured image sequence. Liu P et al. [28] proposed an ultrasonic signal enhancement method based on phase-based motion magnification to estimate the residual fatigue life of steel plates. Fioriti V et al. [29] devoted themselves to the application of motion magnification methods in the field of cultural heritage protection and monitoring in Italy. Michał ’Smieja et al. [30] introduced some application cases of the motion magnification method in the fault diagnoses of rotating machinery base bolt loosening, coupling misalignment and shaft end-sealing defects, etc. Although the method has been studied and applied in the fields of medical treatment, structure [31], fault diagnosis, etc., the important parameters affecting the motion-magnification effect (i.e., the spatial cut-off wavelength) in the current literature are still determined by manual adjustment, which limits the practicability of the method.
Based on the analysis of the Eulerian motion magnification method, this paper introduces the concept of brightness, and proposes an automatic calculation method of spatial cutoff wavelength based on brightness, so as to obtain the motion magnification image. Then, the proposed method is used to process a publicly available video in the Ref. [32], and the time-brightness curve is used to compare the brightness changes in the original video and the motion magnification videos obtained by original methods and improved methods to verify the effectiveness of the proposed method (related videos can be found in the Supplementary Materials). Finally, taking an overhung rotor-bearing experimental device as the object, four fault conditions are set, respectively: rotor unbalance, loosened anchor bolt of the bearing seat, compound fault (rotor unbalance and loosened anchor bolt of the bearing seat), and rotor misalignment, and the characteristic frequency band including 1× and 2× frequency is magnified by the method, and the motion-image characteristics of the four fault conditions are revealed by comparing them with the normal working conditions. The proposed method can automatically obtain the spatial cutoff wavelength, solve the drawback of manual parameter adjustments in the original method, improve the efficiency, and provide a new method for rotating machinery fault diagnosis.

2. Methods

2.1. The Eulerian Motion Magnification Method

The Eulerian motion magnification method is an improvement on the traditional optical flow method [33], and its fundamental concept is that the change of brightness in each pixel in the image over time reflects the change of the pixel’s displacement [34]. The detailed derivation process of the method can be found in Ref. [32]. This paper only quotes the main steps to illustrate the three constraint parameters of the method. In this paper, the concept of motion magnification is briefly explained using an example of a one-dimensional signal undergoing translational motion. Let I(x, 0) = f(x) represent the image intensity at position x at time t = 0, and I(x, t) = f(x + δ(t)) represent the image intensity at position x at time t. Here, δ(t) denotes the displacement function of image pixels, signifying the pixel’s displacement from time t = 0 to time t. Perform the first-order Taylor expansion with respect to x on I(x, t) and subtract I(x, 0) to obtain:
B x , t = δ t f x x
B(x, t) represents the displacement variation of image pixels at position x from time 0 to t. According to Equation (1), if the displacement variation of pixels is increased, the displacement function δ(t) needs to be multiplied by the amplification factor α. After a series of derivations, the result can be obtained,
I ˜ x , t f x + 1 + α δ t f x x
Reverting Equation (2) back to its pre-expanded form,
I ^ x , t = f x + 1 + α δ t
In Equation (2), Ĩ(x, t) represents the actual value of the signal after motion magnification, while Equation (3) represents the theoretical value. This indicates that during the motion magnification process, the motion of f(x) at time t is amplified by a factor of (1 + α), while also reflecting the pixel intensity change at that moment. It is worth noting that this analysis process is only illustrated using a single component signal as an example. When analyzing real signals with multiple components, filtering can be performed within the specified frequency band (ωl, ωh), while ωl and ωh denote the lower cutoff frequency and the upper cutoff frequency, respectively.
In order to solve the problem that the first-order Taylor series approximation becomes inaccurate due to the rapid change in image function f(x), so that the actual value expressed by Equation (2) is approximately equal to the theoretical value expressed by Equation (3), the boundary of the amplification factor α should be derived according to the spatial frequency ω [32]. When the spatial frequency is assumed to be ω, it can be derived from the law of cosines and ω = 2π/λ,
1 + α δ t < λ 8
Equation (4) provides the direct constraint relationship among the spatial wavelength λ, the amplification factor α and the displacement function δ(t). However, in practical applications, the motion magnification effect is affected by multiple parameters. Among them, the amplification factor α, the specified frequency band (ωl, ωh), and other parameters can be specified by the user or selected through prior knowledge. However, the spatial cutoff wavelength λc, which affects the output video quality, can violate the approximation limit in order to enhance visual perception [32]. As a result, λc is difficult to be set by experience or prior knowledge and requires manual parameter adjustment, which limits the application of the method. Therefore, it is necessary to study a method that can calculate λc automatically to avoid human interference and improve computational efficiency. It is worth noting that if the current spatial wavelength λ is less than the λc threshold, the amplification factor α will be attenuated to reduce the amplification of noise and improve the quality of the output video.

2.2. The Automatic Calculation Method for Spatial Cutoff Wavelength

All video images were in RGB color space, and each color appeared in its primary spectral components of red, green and blue [35]. There was a problem in the mixing of chrominance and intensity information [36], which resulted in the three color components changing with the brightness. It was difficult to extract the brightness information and it was unsuitable for image processing. Compared with RGB, HSV color space was closer to people’s perception experience of color, and could intuitively express hue, saturation and value [37]. It can be seen from Section 2.1 that the change in brightness reflected the change in the displacement of image pixels. Therefore, according to the concept of brightness, the conversion relationship between RGB color space and HSV color space was introduced to obtain the brightness value, and then the spatial cutoff wavelength was calculated in this paper. For any coordinate point in the image, its corresponding value in the RGB color space was assumed to be R, G, and B, and its conversion relationship is shown as follows [38],
R = R 255 G = G 255 B = B 255
Equation (5) normalizes the corresponding value in the RGB color space between 0 and 255, and then sets
C max = max R , G , B
The compute value,
V = C max
The V component image containing only the brightness value (i.e., Value) in HSV color space was extracted, and the spatial frequency was calculated from the row frequency and column frequency of the image. The RF was assumed to be the row frequency, CF was column frequency, and SF was spatial frequency. For an image F with M × N, where M is the number of rows and N is the number of columns, the RF, CF and SF of the pixel at the point (m, n) were calculated by Equations (8), (9) and (10), respectively [39].
R F = 1 M N m = 0 M 1 n = 1 N 1 F m , n F m , n 1 2
C F = 1 M N m = 0 M 1 n = 1 N 1 F m , n F m 1 , n 2
S F = R F 2 + C F 2
According to ω = 2π/λ,
2 π × S F = 2 π λ c
Therefore, the spatial cutoff wavelength was
λ c = 1 S F
The calculated spatial cutoff wavelength was used as the input parameter of the original Eulerian motion magnification method, and the video of the motion magnification could be obtained for fault diagnosis.

2.3. The Improved Eulerian Video Motion Magnification Method Flow

Based on the traditional Eulerian motion magnification process, combined with the method above in Section 2.2, an improved Eulerian video motion magnification method was proposed, and its process is shown in Figure 1. The blue dashed line box in Figure 1 shows the process in Ref. [32], while the red dashed line box and arrow refer to the calculation process of the proposed spatial cutoff wavelength.
For a given input video, the Eulerian motion magnification method steps are as follows.
Step 1:
Decompose the input video by frames into image sequences;
Step 2:
The image sequences in step (1) are converted from RGB color space to HSV color space, and the spatial cutoff wavelength λc is calculated;
Step 3:
The image sequences in step (1) are decomposed into different spatial frequency bands [40] by Laplace pyramid and filtered by butterworth filter to obtain the image signal of the specified frequency band;
Step 4:
Using the given amplification factor α and the spatial cutoff wavelength λc calculated in step (2), the motion magnification of each image signal obtained in step (3) is carried out, which is added back to the original signal for reconstruction. Then, the motion magnification video is obtained.

2.4. Simulation Analysis

In order to verify the effectiveness of the proposed method, the publicly available video in Ref. [32] was used for motion magnification. The original video frame is shown in Figure 2a, with a resolution of 960 × 544. The video contains several of the baby’s heartbeats, which are difficult to see with the naked eye. Using the method presented in Section 2.2, the spatial cutoff wavelength λc = 40 was calculated. In order to compare it with the motion magnification video provided by MIT, the parameter values of the two methods were set to be the same, that is, the amplification factor α = 20, and the lower cutoff frequency wl and the upper cutoff frequency wh were set to 0.4Hz and 3Hz, respectively.
ImageJ software (v.1.53t) was used to extract the time-brightness curve of the heartbeat region shown by the red rectangle in Figure 2a for the original video and the processed video, respectively, as shown in Figure 2b. Where the horizontal axis was the number of frames, the vertical axis was the brightness value. The yellow represents the time-brightness curve of the unprocessed original video, the green is the time-brightness curve of the motion magnification video given by MIT, and the red is the time-brightness curve of the motion magnification video obtained by the proposed method in the paper. Figure 2c is a comparison diagram of the brightness difference corresponding to the adjacent maximum frame and minimum frame reflecting heartbeat in Figure 2b. Where the horizontal axis was the heartbeat number, the vertical axis was the brightness difference. It can be seen from Figure 2b,c that the brightness fluctuation of the original video was not obvious, the time-brightness curve fluctuation amplitude of the motion video obtained by the proposed method in the paper was significantly higher than that of MIT, and the characteristics of the baby’s heartbeat curve could be clearly represented according to the brightness change. In addition, from the comparison of computing times, under the same computer-operating environment, the running time of the method used in Ref. [32] was 43.34 s, while that of the proposed method was 41.264 s, which was very close. Therefore, the simulation analysis verified the effectiveness of the proposed method.

3. Experiments

3.1. Experimental Setup

To validate the effectiveness of the proposed method for rotating machinery fault diagnosis, an experimental setup shown in Figure 3 was constructed.
It mainly consisted of an overhung rotor-bearing system, a no-strobe light, and a high-speed camera (KEYENCE VW-600C, Keyence, Osaka, Japan). The overhung rotor-bearing system consisted of a variable-frequency inverter, a variable-frequency motor, a drive-end bearing seat, a free-end bearing seat, a fly wheel, and a base. The motor and bearing seats were bolted on the base. A rubber pad was used for vibration isolation between the base and the table. The diameter of the shaft was 25 mm and its length was 400 mm, one end of which was connected to the motor by an elastic coupling, and the other end was installed with the fly wheel (150 mm in diameter and 15 mm thickness). Two bearing seats with built-in 6205 deep-groove ball bearings were installed at both ends of the shaft, with a spacing of 130 mm, where the drive-end was 65 mm away from the shaft end connected with the coupling. The rotational speed of the variable-frequency motor could be adjusted through the variable-frequency inverter. This paper considers five work conditions: normal (condition 1), loosened anchor bolt of the drive-end bearing seat (condition 2), rotor unbalance (condition 3), compound fault (condition 4), and rotor misalignment (condition 5). Detailed descriptions are given in Table 1.

3.2. Test Plan

To compare the differences between the traditional contact fault diagnosis method and the improved Eulerian video motion magnification method, and verify the accuracy of the proposed method, a JDI930 vibrometer was first used to measure the vibration value (mm/s) at 10 measurement points (as shown in Figure 4) under five conditions. During the test, the rotor operating frequency was adjusted to 24.1 Hz, equivalent to 1446 RPM. After the vibration measurement, the captured area of the high-speed camera was adjusted through the video capture terminal, which covered the two bearing seats’ areas. Finally, the capture frame rate was set to 1000 fps, the resolution was set to 640 × 480, and the no-strobe light was turned on for video capture. Where the light source power was 60 W, the color temperature was 8000 K, and the brightness was set to the maximum through the acquisition software when the video was captured.

4. Results and Discussion

4.1. Results and Analysis of Vibration Measurements

According to the vibration test plan in Section 3.2, the JDI930 vibrometer (Jditech, Dalian, China)was used to measure 10 measurement points of the experimental setup under five working conditions, and the measured values are shown in Table 2.
It can be seen from Table 2 that under condition 1, the vibration value of each measuring point of the overhung rotor-bearing system was small, and the vibration values of the axial measuring points of the two bearing seats (measurement points 3 and 8) were larger than those in other directions. Under condition 2, the vibration values at measurement points 1 to 4 of the drive-end bearing seat were significantly larger than those under normal conditions, especially at measurement point 4. In contrast, the vibration values at different measurement points on the free-end bearing seat were relatively similar to those under condition 1. Under condition 3, the axial vibration values of the two bearing seats shown at measurement points 3 and 8 were larger. Under the compound fault reflected in condition 4 in Table 1, not only the axial vibration values of the two bearing seats shown at measurement points 3 and 8 were large, but also the vibration of the loosened anchor bolt of the drive-end bearing seat shown at measurement point 4 was significantly greater than that of the normal free-end bearing seat shown at measurement point 9. Under condition 5, the axial vibration value of the free-end bearing seat shown at measurement point 8 was obviously greater than that of the drive-end bearing seat shown at measurement point 3, while the vibration values of other measurement points were similar to that in condition 1. However, uncertainty existed in the measurement points (such as point 1, point 2 and point 7) under the four fault conditions, and the vibration values under some conditions were relatively large, which did not reveal the cause of the large vibration of the drive-end bearing seat only from the vibration values.

4.2. Results and Analysis of the High-Speed Camera Measurement

The proposed method was used to calculate 1000 frames of the video sequence output by the video capture terminal on a notebook computer with an 8-core CPU and a 32 GB memory, and the motion magnification video was obtained in 69.82 s. The amplification factor α was uniformly set to 200 in the analysis process. Considering that the motor speed had a small fluctuation at the operating frequency in the actual measurement, and the characteristic frequencies of rotating machinery faults are usually concentrated at the 1× frequency (24.1 Hz) and 2× frequency (48.2 Hz), the specified frequency band (wl, wh) was set to 20–28 Hz and 43–53 Hz, respectively. That is, 1× frequency and 2× frequency were covered.
The spatial cutoff wavelength λc under the five working conditions was calculated by the proposed method, respectively, as shown in Table 3. The spatial cutoff wavelength values were similar in each condition; because the video of every condition was captured in the laboratory, the camera angle and the ambient brightness did not change, which shows the robustness of the proposed method in calculating the spatial cutoff wavelength.

4.2.1. Condition 2

For the video obtained by the proposed method, in order to display the features of the normal and the fault conditions in the video in the form of images, ImageJ software was used to extract the time-brightness curve of the first 100 frames of the magnified video, and the 2 frames of images were determined according to the horizontal coordinate (that is, the number of frames) corresponding to the adjacent maximum and minimum brightness values in the time-brightness curve. The same method was used for all subsequent conditions.
The Eulerian motion magnification images of the two frames at 1× frequency under the normal working condition (i.e., condition 1) and condition 2 are shown in Figure 5. As can be seen from Figure 5a,b, even if the amplification factor was 200, there was no obvious displacement change in each direction of the two bearing seats under condition 1. In contrast, the images of adjacent maximum frame (Figure 5c) and minimum frames (Figure 5d) obtained by the traditional method under condition 2 showed that the drive-end bearing seat in the green box had displacement changes only in the vertical direction, and that there was no obvious displacement in the horizontal and axial directions, while the free-end bearing seat in the blue box had no obvious displacement in all directions, as under condition 1. The displacement variation characteristics of Figure 5e,f obtained by the improved method under condition 2 were consistent with those of Figure 5c,d obtained by the traditional method, but the variation amplitude of the former was significantly greater than that of the latter. The Eulerian motion magnification video and the two frames of images reflecting the vibration of the bearing seats captured under the two conditions were consistent with the vibration values of 10 measurement points in the corresponding condition in Table 2, which indicates the accuracy of the proposed method.
The Eulerian motion magnification images of the two frames at 2× frequency under condition 1 and condition 2 are shown in Figure 6. As can be seen from Figure 6, the image features of 2× frequency under condition 1 and 2 are the same as those in Figure 5, respectively.

4.2.2. Condition 3

The Eulerian motion magnification images of the two frames at 1X frequency under condition 1 and condition 3 are shown in Figure 7. As can be seen from Figure 7a,b, even if the amplification factor was 200, there was no obvious displacement change in each direction of the two bearing seats under condition 1. In contrast, the images of the adjacent maximum frame (Figure 7c) and minimum frame (Figure 7d) obtained by the traditional method under condition 3 show that the two bearing seats in the all boxes had displacement changes in the axial direction, which indicates that when the fly wheel of the overhung rotor-bearing system in the paper had an unbalanced rotor fault, the two bearing seats vibrated axially under the action of unbalanced forces. The displacement variation characteristics of Figure 7e,f obtained by the improved method under condition 3 were consistent with those of Figure 7c,d obtained by the traditional method, but the variation amplitude of the former was significantly greater than that of the latter. The Eulerian motion magnification video and the two frames of images reflecting the vibration of the bearing seats captured under the two conditions were consistent with the vibration values of 10 measurement points in the corresponding condition in Table 2, which indicates the accuracy of the proposed method.
The Eulerian motion magnification images of the two frames at 2× frequency under condition 1 and condition 3 are shown in Figure 8. As can be seen from Figure 8, the image features of 2× frequency under condition 1 and 3 were the same as those in Figure 7, respectively.

4.2.3. Condition 4

The Eulerian motion magnification images of the two frames at 1× frequency under condition 1 and condition 4 are shown in Figure 9. As can be seen from Figure 9a,b, even if the amplification factor was 200, there was no obvious displacement change in each direction of the two bearing seats under condition 1. In contrast, the images of adjacent maximum frame (Figure 9c) and minimum frame (Figure 9d) obtained by the traditional method under condition 4 show that the bottom of the drive-end bearing seat in the green box had displacement changes in both vertical and axial directions, while the upper part of the free-end bearing seat in the blue box only had axial displacement, which reflected the fault features of condition 2 in Section 4.2.1 and of condition 3 in Section 4.2.2. The displacement variation characteristics of Figure 9e,f obtained by the improved method under condition 4 were consistent with those of Figure 9c,d obtained by the traditional method, but the variation amplitude of the former was significantly greater than that of the latter. The Eulerian motion magnification video and the two frames of images reflecting the vibration of the bearing seats captured under the two conditions were consistent with the vibration values of 10 measurement points in the corresponding condition in Table 2, which indicates the accuracy of the proposed method.
The Eulerian motion magnification images of the two frames at 2× frequency under condition 1 and condition 4 are shown in Figure 10. As can be seen from Figure 10, the image features of 2× frequency under condition 1 and condition 4 were the same as those in Figure 9, respectively.

4.2.4. Condition 5

The Eulerian motion magnification images of the two frames at 1× frequency under condition 1 and condition 5 are shown in Figure 11. As can be seen from Figure 11a,b, even if the amplification factor was 200, there was no obvious displacement change in each direction of the two bearing seats under condition 1. In contrast, the images of adjacent maximum frame (Figure 11c) and minimum frame (Figure 11d) obtained by the traditional method under condition 5 show that the driving-end bearing seat in the green box had no obvious displacement change, while the free-end bearing seat in the blue box had axial displacement. The displacement variation characteristics of Figure 11e,f obtained by the improved method under condition 5 were consistent with those of Figure 11c,d obtained by the traditional method, but the variation amplitude of the former was significantly greater than that of the latter. The Eulerian motion magnification video and the two frames of images reflecting the vibration of the bearing seats captured under the two conditions were consistent with the vibration values of 10 measurement points in the corresponding condition in Table 2, which indicates the accuracy of the proposed method.
The Eulerian motion magnification images of the two frames at 2× frequency under condition 1 and condition 5 are shown in Figure 12. As can be seen from Figure 12, the image features of 2× frequency under condition 1 and condition 4 were the same as those in Figure 11, respectively.

5. Conclusions

Based on the analysis of the Eulerian motion magnification method, this paper emphasized the importance of spatial cutoff wavelength to the quality of motion magnification image. In view of the defects that can arise when obtaining the parameters manually, combined with the characteristics of HSV color space, an automatic calculation method of spatial cutoff wavelength was proposed. The publicly available video was used for the simulation analysis, and an overhung rotor-bearing experimental device was used for the experimental verification. The main research results are as follows:
(1)
Using a sourced publicly available video for the simulation analysis, the proposed automatic calculation method of spatial cutoff wavelength based on HSV color space had strong robustness, and the obtained motion magnification image could better reflect the small motion, which solved the problem of defects arising from the manual parameter adjustment of the current Euler motion magnification method.
(2)
Using the improved method, the overhung rotor-bearing test device had no obvious displacement change in the passband region covering 1× frequency and 2× frequency under the normal working condition.
(3)
By using the improved method, it can be shown that in the passband region covering 1× frequency and 2× frequency of the overhung rotor-bearing test device, the drive-end bearing seat with the loosened anchor bolt fault had an obvious displacement change in the vertical direction, while the bearing seat without the fault had no obvious displacement in each direction. There were obvious axial displacement changes in both bearing seats under the unbalanced condition. Under the compound fault condition, the motion magnification video comprehensively reflected the single fault characteristics of each condition. Under the misalignment fault condition, axial displacement existed in the free-end bearing seat, but no significant displacement existed in the drive-end bearing seat.
(4)
The improved Eulerian video motion magnification method could not only visually diagnose the common faults of rotating machinery, but could also determine the fault location, which provides a new method for the non-contact fault diagnosis of rotating machinery.
However, the method was still based on the Eulerian motion magnification. If the ambient brightness was insufficient when the video was captured, it was necessary to use a no-strobe light, so as to reduce the influence of ambient brightness changes on the analysis results. The method mainly reflected the translational displacement of the measured object, and the effect of torsional deformation was not good. The cut-off frequency band needed to be selected based on prior knowledge. Since the method could reveal the subtle structural vibration, it has potential applications in deformation monitoring, blade damage detection, machinery fault diagnosis and other fields in future works.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/1424-8220/23/23/9582/s1.

Author Contributions

Conceptualization, methodology, writing—review and editing, H.Z.; methodology, investigation, software, writing—original draft preparation, X.Z.; validation and data curation, D.J. and J.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by National Natural Science Foundation of China (grant no. 11402051), Natural Science Foundation of Heilongjiang (grant no. LH2022A004), Natural Science Foundation of Heilongjiang (grant no. LH2022E016).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Huang, N.E.; Shen, Z.; Long, S.R.; Wu, M.C.; Shih, H.H.; Zheng, Q.; Yen, N.-C.; Tung, C.C.; Liu, H.H. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proc. R. Soc. London Ser. A Math. Phys. Eng. Sci. 1998, 454, 903–995. [Google Scholar] [CrossRef]
  2. Kumar, A.; Kumar, R. Oscillatory behavior-based wavelet decomposition for the monitoring of bearing condition in centrifugal pumps. Proc. Inst. Mech. Eng. Part J J. Eng. Tribol. 2018, 232, 757–772. [Google Scholar] [CrossRef]
  3. Jiang, H.; Li, C.; Li, H. An improved EEMD with multiwavelet packet for rotating machinery multi-fault diagnosis. Mech. Syst. Signal Process. 2013, 36, 225–239. [Google Scholar] [CrossRef]
  4. Bentley, P.M.; McDonnell, J. Wavelet transforms: An introduction. Electron. Commun. Eng. J. 1994, 6, 175–186. [Google Scholar] [CrossRef]
  5. Zhao, X.; Patel, T.H.; Zuo, M.J. Multivariate EMD and full spectrum based condition monitoring for rotating machinery. Mech. Syst. Signal Process. 2012, 27, 712–728. [Google Scholar] [CrossRef]
  6. Bendjama, H.; Bouhouche, S.; Boucherit, M.S. Application of wavelet transform for fault diagnosis in rotating machinery. Int. J. Mach. Learn. Comput. 2012, 2, 82–87. [Google Scholar] [CrossRef]
  7. Dossing, O. Structural stroboscopy-measurement of operational deflection shapes. Sound Vib. Mag. 1988, 1, 18–24. [Google Scholar]
  8. Olson, E.J.; Onari, M.M. Solving Structural Vibration Problems Using Operating Deflection Shape (ODS) Analysis. In Proceedings of the 37th Turbomachinery Symposium, Houston, TX, USA, 8–11 September 2008. [Google Scholar]
  9. Ganeriwala, S.N.; Schwarz, B.; Richardson, M.H. Operating deflection shapes detect unbalance in rotating equipment. Sound Vib. 2009, 43, 11–13. [Google Scholar]
  10. Rao, K.B.; Reddy, D.M. Fault diagnosis in rotors using adaptive neuro-fuzzy inference systems. Proc. Inst. Mech. Eng. Part C J. Mech. Eng. Sci. 2023, 237, 2714–2728. [Google Scholar]
  11. Sperber, C.; Weber, W.; Eberhard, P. Finding useful features in vibration signals for fault diagnosis. Proc. Appl. Math. Mech. 2021, 20, e202000023. [Google Scholar] [CrossRef]
  12. Masrol, S.R.; Madlan, M.; Md Salleh, S.; Ismon, M.B.; Roslan, M.N. Vibration analysis of unbalanced and misaligned rotor system using laser vibrometer. Appl. Mech. Mater. 2013, 315, 681–685. [Google Scholar] [CrossRef]
  13. Ozbek, M.; Rixen, D.J. Optical measurements and operational modal analysis on a large wind turbine: Lessons learned. In Proceedings of the 29th IMAC, A Conference on Structural Dynamics, Jacksonville, FL, USA, 31 January–3 February 2011; Volume 5, pp. 257–276. [Google Scholar]
  14. Lucas, B.D.; Kanade, T. An iterative image registration technique with an application to stereo vision. In Proceedings of the IJCAI’81: 7th International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada, 24–28 August 1981; pp. 674–679. [Google Scholar]
  15. Baker, S.; Matthews, I. Lucas-kanade 20 years on: A unifying framework. Int. J. Comput. Vis. 2004, 56, 221–255. [Google Scholar] [CrossRef]
  16. Bay, H.; Tuytelaars, T.; Van Gool, L. Surf: Speeded up robust features. In Proceedings of the Computer Vision—ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria, 7–13 May 2006; pp. 404–417. [Google Scholar]
  17. Chao, S.; Peng, C. Bearing Fault Diagnosis Method Based on Vision Measurement and Convolutional Neural Network. In Proceedings of the Advances in Guidance, Navigation and Control: Proceedings of 2020 International Conference on Guidance, Navigation and Control, ICGNC 2020, Tianjin, China, 23–25 October 2020; pp. 5429–5437. [Google Scholar]
  18. Zhang, T.; Shi, D.; Wang, Z.; Zhang, P.; Wang, S.; Ding, X. Vibration-based structural damage detection via phase-based motion estimation using convolutional neural networks. Mech. Syst. Signal Process. 2022, 178, 109320. [Google Scholar] [CrossRef]
  19. Peng, C.; Zeng, C.; Wang, Y. Camera-based micro-vibration measurement for lightweight structure using an improved phase-based motion extraction. IEEE Sens. J. 2019, 20, 2590–2599. [Google Scholar] [CrossRef]
  20. Inyang, U.I.; Petrunin, I.; Jennions, I. Diagnosis of multiple faults in rotating machinery using ensemble learning. Sensors 2023, 23, 1005. [Google Scholar] [CrossRef]
  21. Liu, C.; Torralba, A.; Freeman, W.T.; Durand, F.; Adelson, E.H. Motion magnification. ACM Trans. Graph. 2005, 24, 519–526. [Google Scholar] [CrossRef]
  22. Sushma, M. Time Frequency Analysis for Motion Magnification and Detection. Master’s Thesis, International Institute of Information Technology, Hyderabad, India, 2015. [Google Scholar]
  23. Fontanari, T.V.; Oliveira, M.M. Simultaneous magnification of subtle motions and color variations in videos using Riesz pyramids. Comput. Graph. 2021, 101, 35–45. [Google Scholar] [CrossRef]
  24. Siringoringo, D.M.; Wangchuk, S.; Fujino, Y. Noncontact operational modal analysis of light poles by vision-based motion-magnification method. Eng. Struct. 2021, 244, 112728. [Google Scholar] [CrossRef]
  25. Eitner, M.; Miller, B.; Sirohi, J.; Tinney, C. Effect of broad-band phase-based motion magnification on modal parameter estimation. Mech. Syst. Signal Process. 2021, 146, 106995. [Google Scholar] [CrossRef]
  26. Luo, K.; Kong, X.; Wang, X.; Jiang, T.; Frøseth, G.T.; Rønnquist, A. Cable vibration measurement based on broad-band phase-based motion magnification and line tracking algorithm. Mech. Syst. Signal Process. 2023, 200, 110575. [Google Scholar] [CrossRef]
  27. Sarrafi, A.; Mao, Z.; Niezrecki, C.; Poozesh, P. Vibration-based damage detection in wind turbine blades using Phase-based Motion Estimation and motion magnification. J. Sound Vib. 2018, 421, 300–318. [Google Scholar] [CrossRef]
  28. Liu, P.; Ma, Z.; Jang, J.; Sohn, H. Motion magnification-based nonlinear ultrasonic signal enhancement and its application to remaining fatigue life estimation of a steel padeye. Mech. Syst. Signal Process. 2023, 200, 110525. [Google Scholar] [CrossRef]
  29. Fioriti, V.; Roselli, I.; Cataldo, A.; Forliti, S.; Colucci, A.; Baldini, M.; Picca, A. Motion Magnification Applications for the Protection of Italian Cultural Heritage Assets. Sensors 2022, 22, 9988. [Google Scholar] [CrossRef] [PubMed]
  30. Śmieja, M.; Mamala, J.; Prażnowski, K.; Ciepliński, T.; Szumilas, Ł. Motion Magnification of Vibration Image in Estimation of Technical Object Condition-Review. Sensors 2021, 21, 6572. [Google Scholar] [CrossRef] [PubMed]
  31. Cataldo, A.; Roselli, I.; Fioriti, V.; Saitta, F.; Colucci, A.; Tatì, A.; Ponzo, F.C.; Ditommaso, R.; Mennuti, C.; Marzani, A. Advanced Video-Based Processing for Low-Cost Damage Assessment of Buildings under Seismic Loading in Shaking Table Tests. Sensors 2023, 23, 5303. [Google Scholar] [CrossRef] [PubMed]
  32. Wu, H.-Y.; Rubinstein, M.; Shih, E.; Guttag, J.; Durand, F.; Freeman, W. Eulerian video magnification for revealing subtle changes in the world. ACM Trans. Graph. 2012, 31, 1–8. [Google Scholar] [CrossRef]
  33. Horn, B.K.; Schunck, B.G. Determining optical flow. Artif. Intell. 1981, 17, 185–203. [Google Scholar] [CrossRef]
  34. Wadhwa, N.; Wu, H.-Y.; Davis, A.; Rubinstein, M.; Shih, E.; Mysore, G.J.; Chen, J.G.; Buyukozturk, O.; Guttag, J.V.; Freeman, W.T. Eulerian video magnification and analysis. Commun. ACM 2016, 60, 87–95. [Google Scholar] [CrossRef]
  35. Kumar, T.; Verma, K. A Theory Based on Conversion of RGB image to Gray image. Int. J. Comput. Appl. 2010, 7, 7–10. [Google Scholar] [CrossRef]
  36. Shaik, K.B.; Ganesan, P.; Kalist, V.; Sathish, B.; Jenitha, J.M.M. Comparative study of skin color detection and segmentation in HSV and YCbCr color space. Procedia Comput. Sci. 2015, 57, 41–48. [Google Scholar] [CrossRef]
  37. Hassan, M.R.; Ema, R.R.; Islam, T. Color image segmentation using automated K-means clustering with RGB and HSV color spaces. Glob. J. Comput. Sci. Technol. 2017, 17, 25–33. [Google Scholar]
  38. Saravanan, G.; Yamuna, G.; Nandhini, S. Real time implementation of RGB to HSV/HSI/HSL and its reverse color space models. In Proceedings of the 2016 International Conference on Communication and Signal Processing (ICCSP), Melmaruvathur, India, 6–8 April 2016; pp. 0462–0466. [Google Scholar]
  39. Li, S.; Yang, B. Multifocus image fusion using region segmentation and spatial frequency. Image Vis. Comput. 2008, 26, 971–979. [Google Scholar] [CrossRef]
  40. Wu, X.; Yang, X.; Jin, J.; Yang, Z. Amplitude-based filtering for video magnification in presence of large motion. Sensors 2018, 18, 2312. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Improved Eulerian video motion magnification process.
Figure 1. Improved Eulerian video motion magnification process.
Sensors 23 09582 g001
Figure 2. Original video frame and time-brightness curve comparison. (a) Original video frame (in Ref. [32]); (b) time-brightness curve; (c) the amplitude comparison of brightness fluxion.
Figure 2. Original video frame and time-brightness curve comparison. (a) Original video frame (in Ref. [32]); (b) time-brightness curve; (c) the amplitude comparison of brightness fluxion.
Sensors 23 09582 g002
Figure 3. Details of the experimental setup. (a) Experimental setup; (b) condition 2; (c) condition 3; (d) condition 5.
Figure 3. Details of the experimental setup. (a) Experimental setup; (b) condition 2; (c) condition 3; (d) condition 5.
Sensors 23 09582 g003
Figure 4. Diagram of vibration measurement points.
Figure 4. Diagram of vibration measurement points.
Sensors 23 09582 g004
Figure 5. MM images of two frames at 1× frequency under condition 1 and condition 2. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Figure 5. MM images of two frames at 1× frequency under condition 1 and condition 2. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Sensors 23 09582 g005
Figure 6. MM images of two frames at 2× frequency under condition 1 and condition 2. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Figure 6. MM images of two frames at 2× frequency under condition 1 and condition 2. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Sensors 23 09582 g006aSensors 23 09582 g006b
Figure 7. MM images of two frames at 1× frequency under condition 1 and condition 3. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Figure 7. MM images of two frames at 1× frequency under condition 1 and condition 3. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Sensors 23 09582 g007
Figure 8. MM images of two frames at 2× frequency under condition 1 and condition 3. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Figure 8. MM images of two frames at 2× frequency under condition 1 and condition 3. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Sensors 23 09582 g008aSensors 23 09582 g008b
Figure 9. MM images of two frames at 1× frequency under condition 1 and condition 4. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Figure 9. MM images of two frames at 1× frequency under condition 1 and condition 4. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Sensors 23 09582 g009
Figure 10. MM images of two frames at 2× frequency under condition 1 and condition 4. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Figure 10. MM images of two frames at 2× frequency under condition 1 and condition 4. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Sensors 23 09582 g010aSensors 23 09582 g010b
Figure 11. MM images of two frames at 1× frequency under condition 1 and condition 5. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Figure 11. MM images of two frames at 1× frequency under condition 1 and condition 5. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Sensors 23 09582 g011aSensors 23 09582 g011b
Figure 12. MM images of two frames at 2× frequency under condition 1 and condition 5. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Figure 12. MM images of two frames at 2× frequency under condition 1 and condition 5. (a) Normal (maximum frame); (b) normal (minimum frame); (c) fault (maximum frame)—traditional method; (d) fault (minimum frame)—traditional method; (e) fault (maximum frame)—improved method; (f) fault (minimum frame)—improved method.
Sensors 23 09582 g012aSensors 23 09582 g012b
Table 1. Five conditions and descriptions.
Table 1. Five conditions and descriptions.
NameDescriptions
Condition 1Normal.
Condition 2Loosen one of the anchor bolts of the drive-end bearing seat.
Condition 3Fix 13 g bolts at the fly wheel.
Condition 4Set to the compound fault of condition 2 and condition 3.
Condition 5A 0.5 mm thickness gasket is arranged under the drive-end bearing seat.
Table 2. Vibration value of each measurement point under five working conditions. (Unit: mm/s).
Table 2. Vibration value of each measurement point under five working conditions. (Unit: mm/s).
Mesurement PointCondition 1Condition 2Condition 3Condition 4Condition 5
10.242.041.863.230.77
20.351.260.341.120.3
30.701.221.711.501.28
40.223.60.422.480.21
50.270.160.260.230.2
60.350.290.520.480.54
70.230.241.92.00.61
81.040.671.711.122.94
90.260.270.410.50.36
100.290.240.460.40.33
Table 3. Spatial cutoff wavelength values under five conditions.
Table 3. Spatial cutoff wavelength values under five conditions.
Condition12345
λc51.2851.4856.2058.5451.92
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhao, H.; Zhang, X.; Jiang, D.; Gu, J. Research on Rotating Machinery Fault Diagnosis Based on an Improved Eulerian Video Motion Magnification. Sensors 2023, 23, 9582. https://doi.org/10.3390/s23239582

AMA Style

Zhao H, Zhang X, Jiang D, Gu J. Research on Rotating Machinery Fault Diagnosis Based on an Improved Eulerian Video Motion Magnification. Sensors. 2023; 23(23):9582. https://doi.org/10.3390/s23239582

Chicago/Turabian Style

Zhao, Haifeng, Xiaorui Zhang, Dengpan Jiang, and Jin Gu. 2023. "Research on Rotating Machinery Fault Diagnosis Based on an Improved Eulerian Video Motion Magnification" Sensors 23, no. 23: 9582. https://doi.org/10.3390/s23239582

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop