Next Article in Journal
Using Persistent Scatterer Interferometry for Post-Earthquake Landslide Susceptibility Mapping in Jiuzhaigou
Next Article in Special Issue
Review of Flexible Piezoresistive Strain Sensors in Civil Structural Health Monitoring
Previous Article in Journal
Influence of Different Treatments and Conditions on Optical Properties of Monolithic Zirconia: A Systematic Review
Previous Article in Special Issue
Damage Detection and Level Classification of Roof Damage after Typhoon Faxai Based on Aerial Photos and Deep Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Phase Correlation Anti-Noise Displacement Estimation Method Based on PSD Phase Screening

1
School of Geosciences and Info-Physics, Central South University, Changsha 410083, China
2
National Engineering Laboratory for High Speed Railway Construction, Changsha 410075, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2022, 12(18), 9227; https://doi.org/10.3390/app12189227
Submission received: 19 July 2022 / Revised: 4 September 2022 / Accepted: 6 September 2022 / Published: 14 September 2022
(This article belongs to the Special Issue Inspection and Monitoring Techniques for Bridges and Civil Structures)

Abstract

:
When using digital images to obtain the displacement of a structure, noise is always a factor that greatly affects the accuracy of the displacement results. To overcome this problem, a phase-correlation improvement method, based on phase filtering by phase standard deviation (PSD), is proposed. We use PSD to remove the severe noise interference area in the cross-power spectrum matrix, then the singular value decomposition (SVD) is used to convert the two-dimensional phase to one-dimensional to reduce the difficulty of phase unwrapping. Finally, straight-line fitting is used to obtain the high-precision displacement results. Experiments were carried out using both simulated data and real data. For the simulated data, the absolute accuracy of the proposed method is around 0.3 pixels, while, for the real data, the absolute accuracy of the proposed method is 0.018 mm. The experimental results show that the method can effectively resist noise interference and still obtain accurate displacement estimation results in the case of severe noise.

1. Introduction

With the rapid development of the world economy, the demand for transportation is increasing. Therefore, at the beginning of this century, China and other countries has been vigorously building high-speed railways [1,2], and more high-speed railway lines and rail bridges have been constructed. With the extension of operation time, various problems may occur that result in safety problems. The manpower losses and financial losses caused by the damage of railroad tracks and bridges are immeasurable. Therefore, it is necessary to monitor the health condition of these rails and bridges.
Various methods have been proposed to monitor the health of rails and bridges; the first kind of method is based on traditional equipment such as a displacement meter, total station, and level instrument; the second kind of method is based on new technology such as Global Navigation Satellite System (GNSS) technology [3,4], Interferometric Synthetic Aperture Radar (InSAR) technology [5,6] and Light Detection and Ranging (Lidar) technology [7,8]; and the third kind of method is based on visual monitoring [9,10]. Methods based on traditional equipment can demonstrate the best precision, but are unable to monitor automatically; those methods based on newly developed technology can realize automatic monitoring, but the costs are expensive. Thanks to the rapid development of industrial cameras with high temporal and spatial resolution, the cost of visual monitoring has decreased. In addition, this technology is rapidly developing, as more scholars have invested in the research of visual monitoring technology during recent years. For example, Barkhordari et al. [11] used visual-based methods for automatic structural damage identification; Wang et al. [12] proposed a lightweight measurement method based on smartphone images and developed corresponding mobile phone software for this method; Alessandro Galdelli et al. [13] designed a new remote visual inspection system for bridge predictive maintenance based on a visual-based monitoring method.
Using the visual-based method to monitor the deformation of tracks and bridges, the general process is as follows: a camera is used to continuously capture images for the monitoring object, and then the frame and inter-frame displacement information (pixel unit) is obtained according to the image, then the corresponding scale of the image (the real size corresponding to each pixel) is calculated, and, finally, the physical displacement is calculated according to the real scale. There are two commonly used ways to obtain frame and frame displacement. (1) Pasting targets or speckle patterns on bridges and capturing the displacement sequences of rails and bridges by shooting and tracking the targets or speckle patterns [14]; this method needs to paste the targets or digital speckles on the monitoring objects, which may not be applicable in some situations. (2) Depending on the characteristics of bridges and rails, a digital image correlation is used to obtain the target displacement sequence [15,16,17]. In the high-frequency vibration monitoring of tracks and bridges, due to the high shooting frequency of the camera and the long shooting distance [18], the image quality is not ideal, which makes it difficult to directly track the target on the grayscale image. Therefore, the phase correlation method, which is more noise-resistant, is a better choice.
Research into the phase correlation algorithm has a long history. The algorithm uses a Fourier transform to transfer digital image from a space domain to a frequency domain, and then correlation operations are performed on the two images in the frequency domain to obtain the displacement between the two images [19,20]. In 1975, Kuglin and Hines [21] first proposed a digital image phase correlation algorithm and applied it to image registration. Compared with digital image grayscale correlation, it has a certain anti-noise performance and has a certain degree of anti-noise performance. It has advantages such as insensitivity [22], so it is widely used to calculate the displacement between images [23,24,25,26]. The most primitive phase correlation method can only obtain pixel-level displacement. So, there were several scholars working to improve the performance of phase correlation, who proposed phase line fitting [27,28,29], phase plane fitting [30,31,32], tooth signal number estimation [33,34], frequency estimation [35], local up-sampling [36], and other optimization methods [37,38,39] to enable the phase correlation method to obtain subpixel precision displacement.
Although the phase correlation method has better anti-noise performance than the grayscale correlation method, the signal-to-noise ratio would be extremely low in images captured in some scenes, such as high-frequency shooting, insufficient ambient light, etc. In order to further improve the anti-noise performance of phase correlation, some scholars have proposed the use of the SVD decomposition method [40,41] or the random sampling consistency method (RANSAC) [42,43] to further solve the noise problem in phase correlation displacement estimation. These methods are indeed helpful for further improving the anti-noise performance of phase correlation, but there are still some limitations. For example, when the proportion of the noise is much larger than the proportion of the true phase, SVD decomposition cannot accurately restore the true phase; in addition, the RANSAC method may not work when noise interference is particularly severe.
In general, the existing phase correlation methods can achieve higher accuracy when the noise is not particularly severe. However, when the noise interference is particularly severe, the accuracy will decrease to a certain extent. Aiming at the situation of particularly severe noise, this paper proposes a phase correlation improvement method based on PSD [44] phase screening, to accurately estimate the displacement of the scene under severe noise conditions. Firstly, PSD is used to remove the cross-power spectrum matrix area that is severely disturbed by noise, then SVD is used to convert the phase into one dimension, which reduces the difficulty of phase unwrapping, and, finally, a least squares straight-line fitting method is used to obtain the displacement of the subject scene.
The remainder of this paper is organized as follows. Section 2 describes the specific approach of the method in this paper, the experimental validation part of this paper is discussed Section 3, including simulated data experiments and real data validation experiments, and the conclusions and future work are in Section 4.

2. Methods

Based on the traditional phase correlation, this paper introduced the PSD to evaluate the clarity of the cross-power spectrum matrix interference fringe, and prescreens the cross-power spectrum matrix according to the evaluation results, so as to automatically remove the areas with severe disturbances from the cross-power spectrum matrix. The workflow of the proposed method is shown in Figure 1.
The input of the workflow is sequence images that show possible displacement between nearby continuing images. Firstly, the two-dimensional discrete Fourier transform (DFT) is used to convert the two images before (image 1 in Figure 1) and after displacement (image 2 in Figure 1) to the frequency domain. To prevent spectral leakage, the two images were windowed after converting to the frequency domain. In addition, in order to concentrate the areas that are not disturbed by noise, we performed frequency domain centering on the two frequency domain images, and then the two frequency domain images are interfered with to obtain the cross-power spectrum matrix. Secondly, the PSD of the cross-power spectrum matrix is calculated to screen out the clear area of the cross-power spectrum matrix. Then, SVD is used to convert the cross-power spectrum matrix to one dimension, and one-dimensional phase unwrapping is performed. Finally, the displacement is solved by fitting a straight line based on the unwrapping phase. The details are explained as follows.

2.1. Cross-Power Spectrum Matrix Acquisition

According to the classical phase correlation principle, an image f 2 ( x ,   y ) is the image obtained by translating image f 1 ( x ,   y ) with ( x 0 ,   y 0 ) , that is, f 2 ( x ,   y ) = f 1 ( x y 0 ,   y y 0 ) . Let F 1 ( u ,   v ) ,   F 2 ( u ,   v ) be the two-dimensional DFT results of f 1 ( x ,   y ) , f 2 ( x ,   y ) , respectively, and then, according to the Fourier time-shift properties, we can get:
F 2 ( u , v ) = F 1 ( u , v ) × e i ( u x 0 + v y 0 )  
Divide the left side of Equation (1) by the right side to get the cross-power spectrum matrix Q ( u , v ) , per Equation (2):
Q ( u , v ) = F 1 ( u , v ) F 2 * ( u , v ) | F 1 ( u , v ) F 2 * ( u , v ) | = e i ( u x 0 + v y 0 )  
Since the low-frequency part of the cross-power spectrum matrix obtained in Equation (2) is in the upper-left corner of the matrix, frequency domain centering is needed in the actual processing process, so that the low-frequency part of the cross-power spectrum matrix is in the center, while the high-frequency part is around it. As shown in Figure 2, Figure 2a represents the cross-power spectrum matrix’s phase without frequency domain centering, and Figure 2b represents the cross-power spectrum matrix’s phase, where the frequency domain is centralized. It clearly demonstrates that after performing the frequency domain centralization, the areas with clear fringes can be gathered together, which is convenient for subsequent processing.
In addition, the two-dimensional DFT assumes that the input signal is an infinitely long period signal. However, the image actually does not meet this requirement, which will cause the problem of spectrum leakage in the actual processing. Therefore, windowing is required after the Fourier transformation. In this paper, the Hanning window function is used for windowing [45]. The function is defined per Equation (3):
W k ( u , v ) = 1 4 [ 1 + cos ( u H / 2 H π ) ] [ 1 + cos ( v W / 2 W π ) ]
where W is the width of the image, H is the height of the image.

2.2. PSD-Based Phase Screening

The cross-power spectrum matrix obtained in the previous section is a complex matrix with a phase that is a periodic toothed fringe signal. The displacement between the two images can be estimated based on the toothed fringe signal. The fringe is clear under ideal conditions, but there will be a lot of speckle noise in the fringe due to the presence of noise during image acquisition. In some extreme cases, the fringe is not visible at all, which makes it is uncertain to estimate the displacement.
In view of the serious noise interference of the cross-power spectrum matrix, this paper utilizes PSD to evaluate the clarity of the phase fringes and then screen out the cross-power spectrum matrix regions with clear fringes, based on the evaluation results. According to the definition of PSD [40], to calculate every element in the phase of the cross-power spectrum matrix, a neighboring window with w × w has to be considered, per Equation (4). In the equation, φ ¯ ( i , j ) is the phase gradient of each element in the window w × w (the average value of the gradient of the direction x and y ); w is the window size ( w is experimentally set to 7), and φ ( i , j ) is the phase of the current element. The PSD matrix and the phase of its corresponding cross-power spectrum matrix are shown in Figure 3; where Figure 3a is the cross-power spectrum matrix’s phase, Figure 3b is the PSD matrix.
σ φ = S φ w 2 1                     S φ = i = 1 w j = 1 w [ φ ( i , j )   φ ¯ ( i , j ) ]
According to the calculated PSD matrix, the most central element is taken as the seed point, and t percentage of the variance of the PSD matrix is used as the seed growth threshold ( t can be adjusted with different amount of noise; it is experimentally set to 50 in this paper). A region-growing algorithm [46] is performed to obtain the clear stripe area in the cross-power spectrum matrix, and the smallest bounding rectangle of the area is cropped for subsequent processing. The phase matrix is shown in Figure 4.

2.3. Cross-Power Spectrum Matrix Dimensional Reduction

After the screening in the previous section, a clear area of the cross-power spectrum matrix is obtained, which can be used to estimate the displacement well. Since the two-dimensional cross-power spectrum matrix is difficult to do the phase unwrapping, thus, dimensional reduction processing has to be performed.
According to the basic principles of phase correlation, the rank of the cross-power spectrum matrix is one under the ideal conditions [47], so SVD strategy can be used to make a rank-one estimation, and then the dimensionality of cross-power spectrum matrix is reduced from 2 to 1. SVD is performed on the screened cross-power spectrum matrix, its first singular value is taken, and the corresponding left and right singular vectors are used to represent the ideal cross-power matrix. Assuming the area matrix selected in the previous section is A, SVD decomposition on this matrix is performed according to Equation (5):
A = U × diag ( σ 1 , σ 2 , , σ k , 0 , ) × V
where U = [ u 1 , , u k | u k + 1 , , u m ] , σ 1 > σ 2 > , V = [ v 1 , , v k | u k + 1 , , v n ] .
After SVD processing, the phase of corresponding left and right singular vectors u 1 and v 1 is calculated, and one-dimensional phase unwrapping is performed according to Equation (6). In this equation, φ ¯ i is the phase after unwrapping; φ i is the currently processed phase; mod { a , b } means taking the remainder of dividing a by b ; and φ 0 is the first phase in the sequence. The winding phases and unwrapping phases of u 1 and v 1 are shown in Figure 5, where Figure 5a is the winding phase and unwrapping phase of u 1 , and Figure 5b is the winding phase and unwrapping phase of v 1 :
φ ¯ i = φ 0 + j = 0 i 1 mod { ( φ j + 1 φ j ) , 2 π }

2.4. Displacement Estimation Based on Straight-Line Fitting

After the previous section, the phase scatter points used for displacement estimation have been obtained. Now, a straight-line fitting is required for the phase scatter points (as shown in Figure 6, where (a) is the unwrapping phase and straight-line fitting result of left singular u 1 , and (b) is the unwrapping phase and straight-line fitting result of right singular v 1 ). According to the slope of the fitted line and the image size, the displacement is calculated by Equation (7).
X 0 = k v W 2 π               y 0 = k u H 2 π
where k u is the slope of the left singular vector phase fitting straight line; k v is the slope of the right singular vector fitting straight line; W is the image width; and H is the image height.

3. Experiment and Analysis

In order to verify the effectiveness of the proposed method, simulation and real data verification experiments are performed, and the results of the four typical existing phase correlation methods are also compared. The proposed method is implemented with Python. The experiments are performed on a desktop with i7 CPU and 16 G RAM. The camera used in the experiment is a Medvision MVSUA133GMT industrial camera. Some key parameters are shown in Table 1. The lens used in the experiments has a variable focal length and variable aperture, which are convenient for setting different experimental conditions.
The simulation experiment uses images with different texture characteristics, artificially adding noise and simulated displacement; the real data verification experiment is carried out in a high-speed railway laboratory, and the track vibration during the experiment is captured by shooting the digital speckle pattern of the track plate.
In this paper, we compare the performance of the proposed method to four typical phase correlation methods: (1) the local up-sampling based method, (2) the SVD-based method, (3) the RANSAC-based method, and (4) the SVD + RANSAC-based method. For the local up-sampling-based methods, we first obtain the integer pixel displacement by classical phase correlation methods, then up-sample the images locally, finally obtaining subpixel displacement by using the classical phase correlation methods again. For the SVD-based methods, we first acquire the cross-power spectrum matrix, then perform SVD decomposition on it, and, finally, perform straight-line fitting on the left and right unwrapped singular vectors to obtain the displacement. For the RANSAC-based method, we first acquire the cross-power spectrum matrix, and then perform RANSAC-based straight-line fitting on a row and column of it to obtain the displacement. For the SVD + RANSAC-based method, we first acquire the cross-power spectrum matrix, then perform SVD on it, and, finally, perform RANSAC-based straight-line fitting on the left and right unwrapped singular vectors to obtain the displacement.

3.1. Simulation Experiment

3.1.1. Experimental Data

Six sets of panchromatic images with iron texture, cement texture, and soil texture, respectively, were captured, and the distance between the camera and the objects is around 10 m. The subpixel displacement was simulated, and noise was added by the following processing steps (as shown in Figure 7): (1) These images were cropped in the upper-left-corner area and the lower-right-corner area separately, and then two images with integer pixel displacement were obtained. The integer pixel displacement simulated is x 0 = 11   pixels and y 0 = 21   pixels . (2) The two images were down-sampled at the same ratio, the down-sampling ratio was set to 0.5 in this paper, and then two images with subpixel displacement were obtained. The simulated displacement was x 0 = 5.5   pixels and y 0 = 10.5   pixels , and the size of each image after processing was 502 × 634. (3) Gaussian noise was added to each image separately to complete the data production of the simulation experiment. The added Gaussian noise has a mean value of 0 and a variance σ = 255 × 5 % = 12.75   pixels .
The simulated data obtained after these steps are shown in Figure 8, where (a) and (d) are iron textures, (b) and (e) are cement textures, and (c) and (f) are soil textures. It can be seen that the images used for the simulation experiment are seriously disturbed by noise, which makes it indeed challenging to estimate the displacement.

3.1.2. Results and Discussion

The six sets of images used in the simulation experiment were converted to the frequency domain using the two-dimensional discrete Fourier transform, then windowing was performed to prevent the spectrum from leaking, and, finally, two sets of images were converted to the frequency domain. Interferometric processing of the image can obtain the cross-power spectrum matrix. The phase of the cross-power spectrum matrix of the six sets of data are shown in Figure 9, where (a) and (d) are iron textures, (b) and (e) are cement textures, and (c) and (f) are soil textures. It can be seen from the spectrogram that the area with clear fringes in the spectrogram is very small due to severe noise interference, which makes displacement estimation a great challenge. At the same time, when the texture information of the image is not rich enough, such as the experimental data shown in Figure 8d, the frequency domain component brought by the texture information is even smaller than the frequency domain component caused by the noise, resulting in a smaller clear stripe area in the spectrogram. This further increases the difficulty of displacement estimation. Therefore, it is necessary to automatically filter out the regions with clear stripes in the spectrogram, which can improve the accuracy of the displacement estimation and the anti-interference ability of the displacement estimation against noise.
The five kinds of phase correlation methods mentioned above are used to estimate the displacement of the analog data. The absolute accuracy of the displacement results obtained by these five methods is shown in Figure 10 and Table 2. From the results, it can be seen that the proposed method is still able to estimate the displacement with high accuracy, even in the case of severe noise. At the same time, another interesting phenomenon can be seen from the experimental results: the absolute accuracy is about several to a dozen pixels, when using the SVD-based method or the RANSAC-based method alone. However, when combining SVD with RANSAC, the absolute accuracy of the displacement estimation is improved directly to the subpixel level. Of course, this is explainable: (1) When using the RANSAC algorithm for straight-line fitting, there is an important premise that the correct data accounts for the majority of all data; however, in the simulated data used in this paper, due to severe noise interference, the regions with clear stripes in the cross-power spectrum matrix also contain a certain percentage of noise. This leads to a small percentage of the correct data contained in the phase being used for straight-line fitting, which, in turn, makes the RANSAC-based method unable to obtain accurate displacement results. (2) When the SVD is used to process the cross-power spectrum matrix, there is also an important premise that the main component of the matrix is the correct information (stripes); however, due to the serious interference of noise, the main component of the cross-power spectrum matrix is not the correct information. This leads to the fact that SVD cannot fully recover the clear stripes in the whole region, which, in turn, makes the SVD-based method unable to obtain accurate displacement results. (3) When RANSAC is combined with SVD, the noise part is first removed from the clear-stripes region with the SVD strategy, so that the stripes are all correct information in the clear region; then RANSAC is used to fit the straight line, the correct straight line can be obtained, and the correct displacement result can be obtained; this is true even for the experimental data (c), where the noise is not particularly serious in comparison, as the data can acquire a better result than our method. However, when the noise is particularly serious, even if RANSAC is combined with SVD, the accuracy of the displacement results obtained is still inferior to our method.
From the result, it can be seen that among the three texture scenes, the accuracy of the proposed method performed best, especially for the steel-texture scene; the other four phase correlation methods can only obtain the displacement results with integer pixel accuracy, while the method in this paper can obtain subpixel precision displacement results. This is also interpretable. The essence of the phase correlation method is to use the texture changes of the photographed surface to perform correlation analysis. Therefore, the texture of the photographed surface needs to be rich enough to ensure sufficient correlation and obtain accurate displacement results. However, under the condition of a pure iron texture, the texture of the photographed surface is composed of the rust on the photographed surface and the surface itself, causing its texture to be far less rich than the cement texture or the soil texture. The proportion of areas with clear streaks is very small; that is, gross errors account for a large proportion of all the observed data. In this case, even if the RANSAC method against gross errors is used, accurate displacement results cannot be obtained. However, the method in this paper first removes the completely invisible areas of the cross-power spectrum matrix, and then performs subsequent displacement estimation to avoid the interference of the unclear areas of the cross-power spectrum matrix, so that accurate displacement results can be obtained.
In addition, it can also be seen that for the cement and soil scenes with rich-enough textures, the local up-sampling method and the SVD + RANSAC method can also obtain better displacement estimation accuracy, which indicates that in the case of sufficiently rich textures, the displacement estimation method using anti-gross error can also resist noise interference better. However, the accuracy of the proposed method is higher. This shows that it is effective, for a weak texture and a severe noise scene, to screen out the regions with clear fringes in the cross-power spectrum matrix first and then perform subsequent processing.

3.2. Real Data Verification

3.2.1. Experimental Data

In order to further verify the accuracy of the proposed method, experiments were carried out in a high-speed railway multi-functional shaking-table test system. The experimental scene is shown in Figure 11, and one of the experimental images is shown in Figure 12; from the image, we can see that due to the high frequency of shooting, the image has serious noise. In this experiment, a displacement sequence was set to control the vibration of the shaking table to drive the bridge to vibrate. A high-frequency camera was used to obtain time-series images of the bridge vibrations. The above-mentioned five methods were used to calculate the displacement sequences, and then they were compared to the corresponding results with the vibration-table-control input sequence, to verify the accuracy of the proposed method.
The high-speed railway multi-function shaking-table test system consists of a 4 m × 4 m six-degree-of-freedom fixed table and three 4 m × 4 m six-degree-of-freedom mobile tables. The four shaking tables are all built on the same straight line and can be used independently or form a variety of spacing arrays. A single shaking table has the characteristics of three directions and six degrees of freedom, a large stroke, and a wide frequency band. The whole test system is mainly composed of the following parts: four sets of six-degree-of-freedom vibration tables (actuator, servo valve, differential pressure sensor, bearing, and steel platform); the adjustment system for the installation position of the movable table (support system, clamping system, winch system, and pipeline chain); a set of PULSAR double array digital control systems (servo controller, modulator, computer hardware/software, and uninterruptible power supply); hydraulic power source (hydraulic oil source, hydraulic oil source distributor, motors/pumps, accumulators, and oil–water heat exchangers), etc. The main technical parameters of the shaking table of the high-speed railway shaking-table test system are shown in Table 3.
During the experiment, four shaking tables were used to vibrate up and down synchronously, and the vibrations were transmitted to the simulated rail bridge to simulate a rail bridge under an earthquake state; a high-speed train was simulated by the proportional model of the high-speed locomotive. This paper uses a fixed shooting frequency of 200 HZ to shoot the track bridge, obtain the image data, and store it in a notebook connected to the camera. The camera distance was about 3 m from the lens to the monitoring surface. Before the vibrating table started to vibrate, the camera was turned on to shoot for a total of 30 s, and 5579 images were obtained (with a small frame drop phenomenon). The entire vibration process of the vibrating table was completely recorded in the images.

3.2.2. Results and Discussion

In total, 5579 images were processed by the five employed methods to obtain the displacement sequence of pixel units. Then, the real size of each pixel was calculated according to the real size d r e a l of the target in the image and the pixel size d pixel of the target, according to Equation (8). In this paper, d r e a l = 20   mm amd d p i x e l = 142.014   pixels , so we obtain d = 0.141   mm / pixel . According to the calculated scale parameters, the displacement sequence in pixel units is converted into millimeter units, and the displacement sequence is shown in Figure 13b.
d = d r e a l d p i x e l  
In order to evaluate the accuracy of the displacement results obtained by the proposed method, the input displacement sequence used to control the vibration of the shaking table was derived and compared with the displacement sequence calculated by the proposed method. The derived original vibration input sequence of the shaking table is shown in Figure 13a.
Since the input frequency is 1000 HZ, and the image shooting frequency is about 200 HZ, it is necessary to down-sample the displacement sequence of the shaking table to make the sampling frequency of the two sets consistent. At the same time, the collected image contains some non-vibrating parts on the shaking table, so it is necessary to locate the vibrating parts from the displacement sequence calculated by the proposed method, and then the corresponding accuracy can be evaluated. The processed displacement sequences calculated by these five phase correlation methods are shown in Figure 14a, the absolute error of those method is shown in Figure 14b, and the average absolute error is shown in Table 4.
From the comparison chart of the displacement sequence (as shown in Figure 13a), the displacement sequence obtained by the improved phase correlation method proposed in this paper is consistent with the control sequence of the shaking table. From the comparison chart of the absolute error sequence (as shown in Figure 13b), it can be seen that the fluctuation is smaller, and the absolute error of our method is also smaller compared to the others. From the average absolute error (as shown in Table 4), the average absolute error of the displacement sequence calculated by our method is the smallest, and the experimental results show that the proposed PSD-based phase correlation method has the advantages of high precision and strong anti-noise performance.
In addition, from Figure 14 and Table 4, it can be found that: (1) The displacement results obtained by the SVD method have the worst accuracy, which indicates that in the case of severe noise, the use of SVD cannot restore the cross-power spectral matrix to a state of clean stripes, so the SVD method alone cannot obtain accurate displacement results; thus, it is necessary to combine the RANSAC method on this basis to obtain more accurate displacement results. (2) In this experiment, the photographed scene is sprayed with digital speckle, which enriches the texture of the scene. Therefore, even if there is a lot of noise under high-frequency shooting, the five methods in this experiment can obtain satisfactory accuracy. However, the method in this paper is still better, which further reveals that the proposed method is more resistant to noise. (3) In this experiment, the accuracy obtained by the SVD + RANSAC method is worse than that obtained by using the RANSAC method alone, which seems to be contrary to the conclusion obtained in the simulation experiment. This is due to the fact that the displacement that occurs is smaller compared with that of the simulation experiment. In the case of small displacement, the width of the stripes corresponding to the cross-power spectral matrix is larger (even larger than the image width or height), which leads to the clean stripes of the cross-power spectrum matrix restored by SVD being inaccurate (as shown in Figure 15, where (a) is the original cross-power spectrum matrix, and (b) is the cross-power spectrum matrix restored by using SVD); so, when SVD is used, the displacement obtained has less accuracy. This can also explain that the displacement obtained using the SVD method in this experiment has the worst accuracy.

4. Conclusions

The digital correlation method plays an import role in non-contact structure health monitoring. In this paper, a phase correlation method based on PSD phase screening is proposed for displacement estimation under severe noise interference. Through the use of PSD, regions with clear fringes can be effectively screened from the original interference phase, which provides a reliable data source for displacement estimation, using fringes in the subsequent steps. The simulated data experiments and high-speed rail laboratory experiments have validated the robustness of the proposed method.
By comparing with other typical four phase correlation methods, the experimental results show that the proposed method has high resistance to noise and can accurately estimate displacement in the case of serious noise interference, compared to the existing phase correlation methods.
Since the proposed method is a visual-based method, there are certain requirements for the monitoring scene: one is that the scene can be imaged; at the same time, it has to be ensured that the displacement size (pixels) will not exceed the detectable range of the phase correlation method. In general, the proposed method can be inserted as a module to an existing DIC tool, to monitor structures’ displacement that can be clearly imaged, and the imaging resolution can meet the accuracy requirements.
The proposed method can avoid noise affection. However, it is a method based on digital image, thus, if the images are not captured with an optimal light source, the promising results could not be obtained. In such situation, an auxiliary artificial light source is needed to ensure the image quality of the measured surface or targets.
The proposed method still needs to be improved in some aspects. When using PSD for phase screening, the excessive screening phenomenon may occur and generate a too-small screened area. That means the amount of data utilized for displacement estimation would be limited, resulting in unsatisfying estimation results. In addition, because the calculation process of PSD is time-consuming, the efficiency of the proposed method has to be improved in the future.

Author Contributions

Conceptualization, Y.Z.; methodology, Y.Z., J.C. and W.D.; software, Z.Y. and J.C.; validation, Z.Y.; writing—original draft preparation, Y.Z., Z.Y. and J.C.; writing—review and editing, L.X., S.C. and W.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research was partially supported by the National Natural Science Foundation of China under Grant 42171440, scientific research projects supported by the Department of Education of Hunan Province under Grant 19K099, the Hunan Province Key Laboratory of Key Technologies for Water Power Resource Development under Grant PKLHD201805, and the Science and Technology Research and Development Program Project of China Railway Group Limited (Major Special Project, No. 2020-Special-02).

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Li, S. Trends in the development of high-speed railroads in the world. Railw. Qual. Control. 2007, 35, 35–37. [Google Scholar]
  2. Wang, X. The trend of construction and development of high-speed railway in the world. Constr. Mach. 2007, 30–36. [Google Scholar] [CrossRef]
  3. Zhang, C.; Dai, W.; Shi, Q.; Zeng, F.; Kuang, C. Ioonosphere delay correction for single frequency points in a GNSS deformation monitoring system with mixed single and dual frequency mode. J. Geod. Geodyn. 2016, 36, 425–429. [Google Scholar]
  4. Dai, W.; Ding, X.; Zhu, J. Study on multipath effect in structure health monitoring using GPS. J. Geod. Geodyn. 2008, 28, 65–71. [Google Scholar]
  5. Hu, J.; Li, Z.; Zhu, J.; Ding, X.; Wang, C.; Feng, G.; Sun, Q. Measuring three-dimensional surface displacements from combined InSAR and GPS data based on BFGS method. Chin. J. Geophys. 2013, 56, 117–126. [Google Scholar]
  6. Zhu, J.; Xin, M.; Hu, J.; Li, Z. Monitoring of ground surface deformation in mining area with InSAR technique. Chin. J. Nonferrous Met. 2011, 21, 2564–2576. [Google Scholar]
  7. Cha, G.; Sim, S.; Park, S.H.; Oh, T. LiDAR-based bridge displacement estimation using 3D spatial optimization. Sensors 2020, 20, 7117. [Google Scholar] [CrossRef] [PubMed]
  8. Casas, A.; Riaño, D.; Greenberg, J.; Ustin, S. Assessing levee stability with geometric parameters derived from airborne LiDAR. Remote Sens. Environ. 2012, 117, 281–288. [Google Scholar] [CrossRef]
  9. Tian, Y.; Zhang, J.; Yu, S. Rapid impact testing and system identification of footbridges using particle image velocimetry. Comput. -Aided Civ. Infrastruct. Eng. 2019, 34, 130–145. [Google Scholar] [CrossRef]
  10. Ye, X.; Dong, C.; Liu, T. Image-based structural dynamic displacement measurement using different multi-object tracking algorithms. Smart Struct. Syst. 2016, 17, 935–956. [Google Scholar]
  11. Mohammad, S.; Danial, J.; Panagiotis, G. Structural Damage Identification Using Ensemble Deep Convolutional Neural Network Models. Comput. Modeling Eng. Sci. 2023, 134, 835–855. [Google Scholar] [CrossRef]
  12. Wang, Y.; Li, K.; Chen, Y.; Xu, S.; Shou, W. Research on Non-Contact and Non-Fixed Cable Force Measurement Based on Smartphone. Appl. Sci. 2021, 11, 8902. [Google Scholar] [CrossRef]
  13. Galdelli, A.; D’Imperio, M.; Marchello, G.; Mancini, A.; Scaccia, M.; Sasso, M.; Frontoni, E.; Cannella, F. A Novel Remote Visual Inspection System for Bridge Predictive Maintenance. Remote Sens. 2022, 14, 2248. [Google Scholar] [CrossRef]
  14. Jo, H.; Kim, S.; Lee, J.; Sohn, H.; Lim, Y. Sag-based cable tension force evaluation of cable-stayed bridges using multiple digital images. Measurement 2021, 186, 110053. [Google Scholar] [CrossRef]
  15. Zhu, J.; Zhang, C.; Lu, Z.; Li, X. A multi-resolution deep feature framework for dynamic displacement measurement of bridges using vision-based tracking system. Measurement 2021, 183, 109847. [Google Scholar] [CrossRef]
  16. Du, W.; Lei, D.; Bai, P.; Zhu, F.; Huang, Z. Dynamic measurement of stay-cable force using digital image techniques. Measurement 2020, 151, 107211. [Google Scholar] [CrossRef]
  17. Tian, L.; Zhao, J.; Pan, B.; Wang, Z. Full-field bridge deflection monitoring with off-axis digital image correlation. Sensors 2021, 21, 5058. [Google Scholar] [CrossRef]
  18. Hansen, R.; Burn, K.; Rigby, C.; Ashby, E.; Nickerson, E.; Berke, R. Digital image correlation at long working distances: The influence of diffraction limits. Measurement 2022, 189, 10493. [Google Scholar] [CrossRef]
  19. Wang, X.; Liu, Z. A Fast and Robust Motion Estimation Method. Microcomput. Inf. 2010, 222–223. [Google Scholar] [CrossRef]
  20. Zeng, J.; Li, S. Review and prospect of 3-D motion estimate based on image sequences, Journal of Nanchang Hangkong University. Nat. Sci. 2006, 20, 23–28. [Google Scholar]
  21. Kuglin, C. The phase correlation image alignment methed. In Proceedings of the International Conference Cybernetics Society, San Francisco, CA, USA, 23–25 September 1975; pp. 163–165. [Google Scholar]
  22. Brown, L. A survey of image registration techniques. ACM Comput. Surv. (CSUR) 1992, 24, 325–376. [Google Scholar] [CrossRef]
  23. Wang, L.; Bi, S.; Lu, X.; Gu, Y.; Zhai, C. Deformation measurement of high-speed rotating drone blades based on digital image correlation combined with ring projection transform and orientation codes. Measurement 2019, 148, 106899. [Google Scholar] [CrossRef]
  24. Zhu, H.; Hu, L. Displacement measurement using digital speckle multi-frequency harmonic wave correlation method. Measurement 2016, 89, 7–12. [Google Scholar] [CrossRef]
  25. Chen, G.; Liang, Q.; Zhong, W.; Gao, X.; Cui, F. Homography-based measurement of bridge vibration using UAV and DIC method. Measurement 2021, 170, 108683. [Google Scholar] [CrossRef]
  26. Gu, G.; Pan, Y.; Qiu, C.; Zhu, C. Real-time dual-channel speckle interferometry based on an improved dual-observation configuration with spatial phase-shifting. Measurement 2021, 176, 109188. [Google Scholar] [CrossRef]
  27. Hoge, W. A subspace identification extension to the phase correlation method [MRI application]. IEEE Trans. Med. Imaging 2003, 22, 277–280. [Google Scholar] [CrossRef]
  28. Ye, Z.; Tong, X.; Zheng, S.; Guo, C.; Gao, S.; Liu, S.; Xu, X.; Jin, Y.; Xie, H.; Liu, S.; et al. Illumination-Robust Subpixel Fourier-Based Image Correlation Methods Based on Phase Congruency. IEEE Trans. Geosci. Remote 2019, 57, 1995–2008. [Google Scholar] [CrossRef]
  29. Foroosh, H.; Balci, M. Sub-pixel registration and estimation of local shifts directly in the Fourier domain. In Proceedings of the 2004 International Conference on Image Processing, Singapore, 24–27 October 2004; pp. 1915–1918. [Google Scholar]
  30. Stone, H.; Orchard, M.; Chang, E.; Martucci, S. A fast direct Fourier-based algorithm for subpixel registration of images. IEEE Trans. Geosci. Remote 2001, 39, 2235–2243. [Google Scholar] [CrossRef]
  31. He, B.; Wang, G.; Lin, X.; Shi, C.; Liu, C. High-accuracy sub-pixel registration for noisy images based on phase correlation. IEICE Trans. Inf. Syst. 2011, 94, 2541–2544. [Google Scholar] [CrossRef]
  32. Liu, J.; Yan, H. Phase correlation pixel-to-pixel image co-registration based on optical flow and median shift propagation. Int. J. Remote Sens. 2008, 29, 5943–5956. [Google Scholar] [CrossRef]
  33. Zuo, C.; Chen, Q.; Gu, G.; Sui, X. Registration method for infrared images under conditions of fixed-pattern noise. OPT Commun. 2012, 285, 2293–2302. [Google Scholar] [CrossRef]
  34. Balci, M.; Foroosh, H. Subpixel estimation of shifts directly in the Fourier domain. IEEE Trans. Image Process 2006, 15, 1965–1972. [Google Scholar] [CrossRef] [PubMed]
  35. Xu, M.; Varshney, P. A subspace method for Fourier-based image registration. IEEE Geosci. Remote Sens. 2009, 6, 491–494. [Google Scholar]
  36. Zhou, W.; Hu, Y. Sub-pixel image registration algorithm based on phase correlation and image resampling. South China Univ. Technol. 2010, 38. [Google Scholar] [CrossRef]
  37. Ren, J.; Vlachos, T.; Zhang, Y.; Zheng, J.; Jiang, J. Gradient-based subspace phase correlation for fast and effective image alignment. J. Vis. Commun. Image Represent. 2014, 25, 1558–1565. [Google Scholar] [CrossRef]
  38. Tzimiropoulos, G.; Argyriou, V.T. Stathaki, Subpixel registration with gradient correlation. IEEE Trans. Image Process 2011, 20, 1761–1767. [Google Scholar] [CrossRef] [PubMed]
  39. Zhao, C.; Zhu, H.; Liu, W.; Dong, M. Extended phase correlation method based on multi-peak fitting. Comput. Eng. 2011, 37, 228–230. [Google Scholar]
  40. Liu, J.G.; Yan, H. Robust phase correlation methods for sub-pixel feature matching. In Proceedings of the 1st SEAS DTC Technical Conference, Edinburgh, Scotland, 13–14 July 2006. [Google Scholar]
  41. Lu, H.; Liu, T.; You, H. Method of subpixel image registration. Foreign Electron. Meas. Technol. 2012, 31, 45–49. [Google Scholar]
  42. Tong, X.; Ye, Z.; Xu, Y.; Liu, S.; Li, L.; Xie, H.; Li, T. A novel subpixel phase correlation method using singular value decomposition and unified random sample consensus. IEEE Trans. Geosci Remote 2015, 53, 4143–4156. [Google Scholar] [CrossRef]
  43. Kumar, S.; Azartash, H.; Biswas, M.; Nguyen, T. Real-time affine global motion estimation using phase correlation and its application for digital image stabilization. IEEE Trans. Image Process 2011, 20, 3406–3418. [Google Scholar] [CrossRef]
  44. Goldstein, R.; Werner, C. Radar interferogram filtering for geophysical applications. Geophys Res. Lett. 1998, 25, 4035–4038. [Google Scholar] [CrossRef]
  45. Blackman, R.; Tukey, J. The measurement of power spectra from the point of view of communications engineering—Part I. Bell. Syst. Tech. J. 1958, 37, 185–282. [Google Scholar] [CrossRef]
  46. Adams, R.; Bischof, L. Seeded region growing. IEEE Trans. Pattern Anal. 1994, 16, 641–647. [Google Scholar] [CrossRef]
  47. Wright, G. Magnetic resonance imaging. IEEE Signal Proc. Mag. 1997, 14, 56–66. [Google Scholar] [CrossRef]
Figure 1. The workflow of the proposed method.
Figure 1. The workflow of the proposed method.
Applsci 12 09227 g001
Figure 2. Cross-power spectrum and corresponding PSD, where (a) is the cross-power spectrum matrix’s phase where the frequency domain is not centralized, and (b) is the cross-power spectrum matrix’s phase where the frequency domain is centralized.
Figure 2. Cross-power spectrum and corresponding PSD, where (a) is the cross-power spectrum matrix’s phase where the frequency domain is not centralized, and (b) is the cross-power spectrum matrix’s phase where the frequency domain is centralized.
Applsci 12 09227 g002
Figure 3. Cross-power spectrum and corresponding PSD, where (a) is the cross-power spectrum matrix’s phase, and (b) is the PSD matrix.
Figure 3. Cross-power spectrum and corresponding PSD, where (a) is the cross-power spectrum matrix’s phase, and (b) is the PSD matrix.
Applsci 12 09227 g003
Figure 4. Cross-power spectrum matrix based on PSD screening.
Figure 4. Cross-power spectrum matrix based on PSD screening.
Applsci 12 09227 g004
Figure 5. Left and right singular vector phase unwrapping, where (a) is the winding phase and unwrapping phase of u 1 , and (b) is the winding phase and unwrapping phase of v 1 .
Figure 5. Left and right singular vector phase unwrapping, where (a) is the winding phase and unwrapping phase of u 1 , and (b) is the winding phase and unwrapping phase of v 1 .
Applsci 12 09227 g005
Figure 6. Straight-line fitting of left and right singular vectors, where (a) is the unwrapping phase and straight-line fitting result of left singular vector, and (b) is the unwrapping phase and straight-line fitting result of right singular vector.
Figure 6. Straight-line fitting of left and right singular vectors, where (a) is the unwrapping phase and straight-line fitting result of left singular vector, and (b) is the unwrapping phase and straight-line fitting result of right singular vector.
Applsci 12 09227 g006
Figure 7. The workflow of gain simulation experiment data.
Figure 7. The workflow of gain simulation experiment data.
Applsci 12 09227 g007
Figure 8. Simulation data, where (a,d) are iron texture, (b,e) are cement texture, and (c,f) are soil texture.
Figure 8. Simulation data, where (a,d) are iron texture, (b,e) are cement texture, and (c,f) are soil texture.
Applsci 12 09227 g008
Figure 9. The cross-power spectrum corresponding to the simulated data, where (a,d) are iron textures, (b,e) are cement textures, and (c,f) are soil textures.
Figure 9. The cross-power spectrum corresponding to the simulated data, where (a,d) are iron textures, (b,e) are cement textures, and (c,f) are soil textures.
Applsci 12 09227 g009
Figure 10. Comparison of absolute accuracy of simulation experiments.
Figure 10. Comparison of absolute accuracy of simulation experiments.
Applsci 12 09227 g010
Figure 11. The experiment scene of indoor experiment.
Figure 11. The experiment scene of indoor experiment.
Applsci 12 09227 g011
Figure 12. One of the experimental images.
Figure 12. One of the experimental images.
Applsci 12 09227 g012
Figure 13. The original displacement sequence; where (a) is the input displacement sequence used to control the vibration of the shaking table, (b) is the displacement sequence calculated by the improved phase correlation method in this paper.
Figure 13. The original displacement sequence; where (a) is the input displacement sequence used to control the vibration of the shaking table, (b) is the displacement sequence calculated by the improved phase correlation method in this paper.
Applsci 12 09227 g013
Figure 14. The experimental results of the high-speed railway multi-functional shaking-table test system; where (a) is the displacement sequence calculated by each phase correlation method and the input displacement sequence of the shaking table, (b) is the absolute error of the displacement sequence of each phase correlation method.
Figure 14. The experimental results of the high-speed railway multi-functional shaking-table test system; where (a) is the displacement sequence calculated by each phase correlation method and the input displacement sequence of the shaking table, (b) is the absolute error of the displacement sequence of each phase correlation method.
Applsci 12 09227 g014
Figure 15. The cross-power spectrum matrix when the displacement is small; where (a) is the original cross-power spectrum matrix, (b) is the cross-power spectrum matrix restored by using SVD.
Figure 15. The cross-power spectrum matrix when the displacement is small; where (a) is the original cross-power spectrum matrix, (b) is the cross-power spectrum matrix restored by using SVD.
Applsci 12 09227 g015
Table 1. The parameters of the camera.
Table 1. The parameters of the camera.
ParameterValue
Sensor1/2.7″ CMOS
Shutter typeGlobal shutter
Camera typeBlack and white
Pixel size4.0 × 4.0 μm
Effective pixels1.3 million
Resolution at frame rate1280 × 1024 at 245 FPS
Pixel bit depth8 bit
Data interfaceUSB 3.0 Type B
Table 2. Comparison of absolute accuracy of simulation experiments, where the unit is the pixel, and the bold font is the minimum error value among the five methods.
Table 2. Comparison of absolute accuracy of simulation experiments, where the unit is the pixel, and the bold font is the minimum error value among the five methods.
Methods(a)(b)(c)(d)(e)(f)
Local up-sampling0.4360.3830.2791.2730.41.425
SVD7.50210.9736.9144.3722.8111.626
RANSAC14.80916.51411.0517.9126.9743.867
SVD + RANSAC0.7450.1560.0726.0640.4151.704
Ours (PSD + SVD)0.1350.0870.2021.1530.3410.479
Table 3. Main technical parameters of shaking table of high-speed railway shaking-table test system.
Table 3. Main technical parameters of shaking table of high-speed railway shaking-table test system.
ParameterValue
Size (length × width)4 m × 4 m
Number of degrees of freedom3 directions and 6 degrees of freedom
Degree of freedom of two shakers’ linkage12 degrees of freedom
The distance of two shakers6–25 m (adjustable)
Maximum load30 ton
Maximum displacement and maximum acceleration of X250 mm, ±0.8 g (fully loaded)
Maximum displacement and maximum acceleration of Y250 mm, ±0.8 g (fully loaded)
Maximum displacement and maximum acceleration of Z160 mm, ±1.6 g (fully loaded)
Sine wave vibration speed750 mm/s
Operating frequency range0.1–50 HZ
Table 4. Average absolute error of each phase correlation method, where the bold font is the minimum error value among the five methods.
Table 4. Average absolute error of each phase correlation method, where the bold font is the minimum error value among the five methods.
MethodAverage Absolute Error (mm)
Local up-sampling0.041
SVD0.085
RANSAC0.024
SVD + RANSAC0.064
Ours (PSD + SVD)0.018
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zhang, Y.; Yang, Z.; Xing, L.; Chen, S.; Dai, W.; Chai, J. A Phase Correlation Anti-Noise Displacement Estimation Method Based on PSD Phase Screening. Appl. Sci. 2022, 12, 9227. https://doi.org/10.3390/app12189227

AMA Style

Zhang Y, Yang Z, Xing L, Chen S, Dai W, Chai J. A Phase Correlation Anti-Noise Displacement Estimation Method Based on PSD Phase Screening. Applied Sciences. 2022; 12(18):9227. https://doi.org/10.3390/app12189227

Chicago/Turabian Style

Zhang, Yunsheng, Zhen Yang, Lei Xing, Siyang Chen, Wujiao Dai, and Jiaxin Chai. 2022. "A Phase Correlation Anti-Noise Displacement Estimation Method Based on PSD Phase Screening" Applied Sciences 12, no. 18: 9227. https://doi.org/10.3390/app12189227

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop