Open Access
This article is

- freely available
- re-usable

*Sensors*
**2016**,
*16*(12),
2020;
doi:10.3390/s16122020

Article

Three-Dimensional Continuous Displacement Measurement with Temporal Speckle Pattern Interferometry

Key Laboratory of Luminescence and Optical Information of Ministry of Education, Beijing Jiaotong University, Beijing 100044, China

^{*}

Author to whom correspondence should be addressed.

Academic Editor:
Vittorio M. N. Passaro

Received: 18 September 2016 / Accepted: 24 November 2016 / Published: 29 November 2016

## Abstract

**:**

A speckle interferometer which can measure whole field three-dimensional displacements continuously and dynamically has been built. Three different wavelength lasers are used to produce the speckle interferograms of the two in-plane displacements (displacements in the x- and y-direction) and one out-of-plane displacement (displacement in the z-direction), respectively. One color CCD camera is employed to collect these mixed speckle interferograms simultaneously. The mixed interferograms are separated by the Red, Green and Blue channels of the color CCD camera, and then are processed by the wavelet transform technique to extract the phase information of the measured object. The preliminary experiment is carried out to demonstrate the performance of this new device.

Keywords:

displacement sensor; three-dimensional measurement; temporal spackle pattern interferometry; wavelet transform## 1. Introduction

Three-dimensional (3D) displacement, which can be translated further into 3D strain and stress, is the key parameter for design, manufacturing and quality control [1]. Due to rapid development of the manufacturing industry, especially for automobile and aerospace applications, the support of dynamic and high-accuracy 3D displacement measurement is required.

Flynn used five object beams and three colors to measure 3D deformations [2]. Each color was separated through dichroic filtering before being recorded by a separate CCD camera. The Fourier-transform method was used to achieve high displacement sensitivity. However, the application of three CCD cameras means that the calibration [3] and algorithm are complex, and the measuring accuracy is affected. Therefore, a single color CCD camera is used to avoid these problems.

Siegmann used a single color camera and a color fringe projector to obtain the real-time 3D displacement maps for the deformable objects. They used a two-dimensional digital image correlation (DIC) to obtain the displacements in the x- and y-direction and fringe projection to obtain the displacement in the z-direction. However, the algorithm for DIC and template matching is complex [4,5,6,7]. Usually the measured resolution of DIC is more than 1 µm [8]. It is lower than the interferometry method, which is less than half a wavelength.

Yano used a color video camera with three CCDs (red, green and blue) to capture the three isolated speckle images generated by three visible semiconductor lasers with adequately-separated wavelengths [9,10]. However, the method is still essentially 3D DIC and cannot realize real-time measurement due to the complex algorithm.

Gao used the non-cube beam-splitter (NCBS) and the 3D optical setup with a fringe carrier method to determine the three phase components effectively [11]. However, like traditional electronic speckle pattern interferometry (ESPI), temporal and continuous deformation cannot be measured. To achieve dynamic continuous measurement, temporal speckle pattern interferometry (TSPI) was proposed by Joenathan, who obtained the phase information by the Fourier Transformation (FT) method instead of the phase-shifting devices [12].

In this paper, such a TSPI-based system has been built. However, different from typical TSPI for 3D measurement, only one color CCD camera is adopted to collect the mixed speckle interferograms, which simplifies the whole system greatly. Moreover, the wavelet transform, which is believed to be more suitable to process the non-stationary signal than the Fourier transform [13], is used to extract the 3D dynamic displacement information of the object. This device, with a simplified configuration, can measure 3D displacements continuously and dynamically. To the best of our knowledge, there is no such system being presented yet.

## 2. Theory

#### 2.1. Principle of Out-of-Plane Measurement

As shown in Figure 1, the configuration is similar to that of the Michelson interferometer, except that two mirrors are replaced with the rough metal plates [14]. The beam emitted from the laser is expanded by the spatial filter, then gets partially reflected and partially transmitted by the beam splitter. One segment travels to the object and the other travels to the reference. The two beams reflected by the object and the reference are made to interfere. The lens is used to focus the speckle interferograms onto the sensor of the color CCD camera. A series of frames of the speckle interferograms are recorded as the object is being displaced. Each frame is then a record of the speckle interferograms and their intensity at that instant of time. These interferograms are processed by the wavelet transform and the phase unwrapping algorithm to acquire the phase information. Finally, the object displacement is obtained.

Before the displacement of the object, the interference intensity of one point on the object can be expressed as:
where ${I}_{0}$ is the average intensity of the interference field. V is the modulation visibility. ${\Phi}_{0}\left(x,y\right)$ is the initial phase.

$$I\left(x,y,t\right)={I}_{0}\left(1+Vcos\left[{\Phi}_{0}\left(x,y\right)\right]\right)$$

After the motion of the object, the intensity function becomes:
where $\mathrm{\Delta}\phi \left(x,y,t\right)$ is the change of the phase, and $\mathrm{\Delta}z\left(x,y,t\right)$ is the function of the object displacement in the z-direction.

$$I\left(x,y,t\right)={I}_{0}\left(1+Vcos\left[{\Phi}_{0}\left(x,y\right)+\mathrm{\Delta}\phi \left(x,y,t\right)\right]\right)$$

$$\mathrm{\Delta}\phi \left(x,y,t\right)=4\pi \mathrm{\Delta}z\left(x,y,t\right)/\lambda $$

#### 2.2. Principle of In-Plane Measurement

The principle of the in-plane measurement is shown in Figure 2. The beam emitted from the laser is expanded by the spatial filter. Then the beam splitter splits it into two beams. Both of them illuminate on the object surface at the same angle. The scattered back beams from the object form a speckle interferogram and are captured by the color CCD camera.

When the object moves in the x- or z-direction, the change of the two beams’ optical path remains the same. Thus, the speckle interferogram remains unchanged. If the object moves a small distance in the y-direction, the optical path of one beam increases $\mathrm{\Delta}y\left(x,z,t\right)\text{sin}i$, and the other one reduces $\mathrm{\Delta}y\left(x,z,t\right)\text{sin}i$ [15]. Thus, we have:

$$\mathrm{\Delta}\phi =\frac{4\pi}{\lambda}\mathrm{\Delta}y\left(x,z,t\right)\text{sin}i$$

Hence, after the motion of the object, the intensity function of the speckle interferogram is:

$$I\left(x,y,t\right)={I}_{0}\left(x,y\right)\left\{1+V\text{cos}\left[{\Phi}_{0}\left(x,y\right)+4\pi \mathrm{\Delta}y\left(x,z,t\right)\text{sin}i/\lambda \right]\right\}$$

The intensity of the interferograms will change if the object moves in the y-direction. By processing these interferograms with the wavelet transform and the phase unwrapping algorithm, the object displacement can be obtained.

The principle of the measurement in the x-direction is as the same as the above method.

#### 2.3. Principle of 3D Measurement

Based on the principle of the in-plane and the out-of-plane measurement, the three-dimensional measurement system is developed. As shown in Figure 3, the three visible-wavelength lasers are used for the three direction measurements. The blue and green lasers are used to measure the x- and y-direction displacements, respectively. The red laser is used to measure the z-direction displacement. The color CCD camera is used to record the whole process of the object movements.

As shown in Figure 4, the mixed speckle interferograms formed by the three lasers are captured by the color CCD camera with three CCDs. The prisms separate the red, green and blue light, then these interferograms are recorded by the corresponding CCD, and each frame of the color CCD camera is divided into three layers to store the data of the R, G and B channels respectively.

In our built system, the data stored in the first, the second, and the third layer correspond to the displacement information of the z-, y-, and x-direction, respectively. Hence, the matrix with the three layers records entire displacements of the three directions. The sampled speckle interferograms are processed by the wavelet transform and the phase unwrapping algorithm to access the phase information. Finally the dynamic object displacements are obtained.

#### 2.4. Principle of the Wavelet Transform Method and Signal Processing

The wavelet transform, a tool that excels at multi-resolution and localization in the time- or space-frequency domain, has enjoyed tremendous popularity and notable development during the past decades. The continuous wavelet transform (CWT) [16,17] is defined as:
where a is the scale parameter, b is the shift parameter, f(t) is the signal to be analyzed, $\psi \left(t\right)$ is the mother wavelet, and ${\psi}^{*}\left(\frac{t-b}{a}\right)$ is the conjugate function.

$${W}_{f}\left(a,b\right)=\langle f\left(t\right),{\psi}_{a,b}\left(t\right)\rangle =\frac{1}{\sqrt{a}}{{\displaystyle \int}}_{-\infty}^{\infty}f\left(t\right){\psi}^{*}(\frac{t-b}{a})dt$$

The CWT uses inner products to measure the similarity between a signal and an analyzing function. The amplitude of ${W}_{f}\left(a,b\right)$ is positively correlated with the similarity of the mother wavelet and the signal. By continuously varying the values of the scale parameter, a, and the position parameter, b, we can obtain the CWT coefficients ${W}_{f}\left(a,b\right)$. In this paper, ‘cgau8’ is chosen as the mother wavelet. The wavelet ridge is extracted from the maximum of the coefficients ${W}_{f}\left(a,b\right)$ of the CWT.

The amplitudes and phases can be calculated by the following equations:
where ${I}_{m}\left[{W}_{f}\left(a,b\right)\right]$ and ${R}_{e}\left[{W}_{f}\left(a,b\right)\right]$ are the imaginary and real parts of ${W}_{f}\left(a,b\right)$, respectively.

$$A\left(a,b\right)=\sqrt{{\left\{{\left\{{I}_{m}\left[{W}_{f}\left(a,b\right)\right]\right\}}^{2}\right\}}^{2}+{\left\{{R}_{e}\left[{W}_{f}\left(a,b\right)\right]\right\}}^{2}}$$

$$\phi \left(a,b\right)=arctan\left\{{I}_{m}\left[{W}_{f}\left(a,b\right)\right]/{R}_{e}\left[{W}_{f}\left(a,b\right)\right]\right\}$$

## 3. Experiment and Results

#### 3.1. Verification Experiment of One Color CCD Camera Light Separation Capability

The wavelengths and powers of the light source are 632.8 nm and 10 mW for the red laser, 532 nm and 50 mW for the green laser, and 473 nm and 50 mW for the blue laser.

The color CCD camera with 640 × 480 spatial resolution is produced by HITACHI Company (Tokyo, Japan). Compared to a Bayer camera, a one color CCD camera with three CCDs with light separation can obtain more realistic color information.

To test the light separation capability of the color CCD camera, only one laser is allowed to irradiate the object each time, the speckle interferogram of the object is captured by the color CCD camera (these speckle interferograms without subtracting the first frame result in no fringe appearing). As shown in Figure 6, when only the red laser is turned on, the red speckle interferogram of the object and the intensity of one random chosen point on the object are shown on the left-hand side of Figure 6a. The gray-scale maps of the three layers are displayed on the righthand side. Obviously, only the first layer, which is used to record the signal of the R channel, has the gray value signal. The test results of the green and blue lasers are shown in Figure 6b,c, as well. These results prove that the color CCD camera has a very good light separation capability.

#### 3.2. The Experiment of the 3D Displacement Measurement

#### 3.2.1. The Experiment

The experiment setup is shown in Figure 7.

The incident angle of the blue laser for measuring the x-direction displacement is 18 degrees. The incident angle of the green laser for measuring the y-direction displacement is 22 degrees.

As shown in Figure 8, both of the object and the reference are rigid aluminum plates which have rough surfaces with the same size and material.

The object is fixed to a THORLABS three-axis flexure stage, with a minimum increment of 20 nm. After careful adjustment, the object surface remains parallel with the x-direction so that when the object moves in one direction of the stage manually, the optical path difference in the other two directions will not change. The actual displacement values are measured by the three grating rulers. The accuracy of the grating ruler is 0.1 µm. These grating rulers are shown in Figure 9.

As shown in Figure 10, the grey-scale maps of fringes in three directions can be observed by real-time subtraction.

The frame rate of the color CCD camera is 100 frames/s. The whole measuring time is six seconds. Thus, a total of 600 frames are stored. Since the object is a rigid body, an arbitrary point on it is chosen to conduct the measurement.

The x-direction displacement obtained is shown in Figure 11.

The actual displacement in the x-direction measured by the grating ruler is 11.9 µm. The displacement processed by our algorithm is 11.87 µm, therefore, the measured error is 0.03 µm and the relative error is 0.25%.

The y-direction displacement obtained is shown in Figure 12.

The actual displacement in the y-direction measured by the grating ruler is 13.5 µm. The displacement processed by our algorithm is 13.61 µm, hence, the measured error is 0.11 µm and the relative error is 0.81%.

The z-direction displacement obtained by processing is shown in Figure 13.

The actual displacement in the z-direction measured by the grating ruler is 11.8 µm. The displacement processed by our algorithm is 11.58 µm, so, the measured error is 0.22 µm and the relative error is 1.86%.

#### 3.2.2. Multi-Detection Points Processing

The system is designed for full-field measurement; therefore, multi-detection points of the object are measured to verify the accuracy of the system. The region of interest (ROI) which is chosen arbitarily, is shown in Figure 14. Sixteen points inside this area are processed by the algorithm we developed. The measured results are shown in Table 1.

The actual displacements in the x-, y-, and z-directions measured by the grating ruler are 11.9 µm, 13.5 µm, and 11.8 µm, respectively. From the table, the maximum measuring differences between two points in the x-, y-, and z-directions are 0.70 µm, 0.72 µm, 0.69 µm. Meanwhile, the measured errors of almost all processed points are less than half a wavelength.

## 4. Discussion

- The error of the displacement in the x-direction is the minimum in the three directions. As shown in Figure 11b, the peak to peak values and shapes of the waves after the first one are almost the same. Moreover, the intervals between the waves are also identical. These led to the most uniform change of the phase processed by the wavelet transform. Hence, a better phase unwrapping results are acquired.
- The accuracy of the displacement in the z-direction is more than 1%. Unlike the common-path layout in-plane measurement, the object and the reference is located in a different path, which is easier to be disturbed by the environment. To improve the accuracy, heterodyne speckle pattern interferometry (HSPI) is expected to be employed in future work.
- The experiment adopts several points of the metal plate to measure the accuracy of the system which are regarded as measurements of the full-field deformation and displacement. The whole object deformation and displacement will be obtained by processing each point of the object with the same algorithm.
- The wavelet transform is used to analyze the speckle interferograms. Compared with the Fourier transform, it can show more detail to obtain more accurate displacement information.
- The measurement resolution of the system is less than half a wavelength, which is limited by many factors, such as the stability of the laser source, sampling rate of the CCD camera used, the disturbance of the environment, etc. In our case, the main factor is the phase unwrapping algorithm, particularly the selection of the mother wavelet. The monitored distance of the system from the object can be from a few meters to 10 meters away in the laboratory, mainly depending on the coherence length of the laser source. In theory, as long as the speckle interferograms can be recorded, the measurement can be completed successfully. However, it is difficult to do this outdoors due to the rapid change of background light intensity, vibrations, and air disturbance, which are common problems in interfering instruments. On the other hand, the camera vibrations caused by ground motion affect the measuring accuracy as well.

## 5. Conclusions

A 3D displacement measurement system with TSPI is presented in this paper. It can capture and process speckle interferograms during the movement of the object continuously and dynamically. Compared with typical 3D ESPI, it can realize 3D dynamic continuous measurement and has a simplified configuration because only one CCD camera is employed. Compared with DIC, it has a higher accuracy and simpler algorithm. The results of the preliminary experiment demonstrate the feasibility of our developed device.

## Acknowledgments

The authors acknowledge the financial supported from National Natural Science Foundation of China (Grant No. 51675038).

## Author Contributions

All works with ralation to this paper have been accomplished by all authors’ efforts. Zhan Gao and Jie Qin conceived and designed the experiments; Jie Qin and Xu Wang performed the experiments; Jie Qin analyzed the data; Jie Qin and Shanwei Yang wrote the paper.

## Conflicts of Interest

The authors declare no conflict of interest.

## References

- Yang, L.X.; Xie, X.; Zhu, L.Q.; Wu, S.J.; Wang, Y.H. Review of Electronic Speckle Pattern Interferometry (ESPI) for Three Dimensional Displacement Measurement. Chin. J. Mech. Eng.
**2014**, 27, 1–13. [Google Scholar] [CrossRef] - Eric, B.F.; Lori, C.B.; Timothy, P.S.; Zamir, L.; Laurel, H.F.; Tommy, C.L.; Scott, R.G.; Aaron, C.K. Three-wavelength electronic speckle pattern interferometry with the Fourier-transform method for simultaneous measurement of microstructure-scale deformations in three dimensions. Appl. Opt.
**2006**, 45, 3218–3225. [Google Scholar] - Tang, S.J.; Zhu, Q.; Chen, W.; Darwish, W.; Wu, B.; Hu, H.; Chen, M. Enhanced RGB-D Mapping Method for Detailed 3D Indoor and Outdoor Modeling. Sensors
**2016**, 16, 1589. [Google Scholar] [CrossRef] [PubMed] - Huang, J.H.; Xue, Q.; Wang, Z.; Gao, J.M. Analysis and Compensation for Lateral Chromatic Aberration in a Color Coding Structured Light 3D Measurement System. Sensors
**2016**, 16, 1426. [Google Scholar] [CrossRef] [PubMed] - Feng, D.M.; Feng, M.Q. Vision-based multi-point displacement measurement for structural health monitoring. Struct. Control Health Monit.
**2016**, 23, 876–890. [Google Scholar] [CrossRef] - Feng, M.Q.; Fukuda, Y.; Feng, D.M.; Mizuta, M. Nontarget vision sensor for remote measurement of bridge dynamic response. J. Bridge Eng.
**2015**, 20, 04015023. [Google Scholar] [CrossRef] - Feng, D.M.; Feng, M.Q.; Ozer, E.; Fukuda, Y. A vision-based sensor for noncontact structural displacement measurement. Sensors
**2015**, 15, 16557–16575. [Google Scholar] [CrossRef] [PubMed] - Philip, S.; Víctor, Á.; Francisco, D.; Eann, A.P. A simultaneous in- and out-of-plane displacement measurement method. Opt. Lett.
**2011**, 36, 10–12. [Google Scholar] - Yano, Y.; Watanabe, Y.; Ishii, T.; Goka, S.; Sato, T.; Sekimoto, H. Real-Time Three-Dimensional Vibration Mode Visualization System Based on Laser Speckle Interference. In Proceedings of the 2010 IEEE International Frequency Control Symposium, Newport Beach, CA, USA, 1–4 June 2010.
- Tang, Z.Z.; Liang, J.; Xiao, Z.Z.; Guo, C. Large deformation measurement scheme for 3D digital image correlation method. Opt. Lasers Eng.
**2012**, 50, 122–130. [Google Scholar] [CrossRef] - Gao, Y.H.; Sun, P. Three-Dimensional Phase Evaluation in ESPI by Using a Non-Cube Beam-Splitter. Exp. Mech.
**2016**, 56, 507–511. [Google Scholar] [CrossRef] - Joenathan, C.; Franze, B.; Haible, P.; Tiziani, H.J. Speckle interferometry with temporal phase evaluation for measuring large-object deformation. Appl. Opt.
**1998**, 37, 2608–2614. [Google Scholar] [CrossRef] [PubMed] - Adamczak, S.; Makiela, W.; Stepien, K. Investigating advantages and disadvantages of the analysis of a geometrical surface structure with the use of Fourier and wavelet transform. Metrol. Meas. Syst.
**2010**, 17, 233–244. [Google Scholar] [CrossRef] - Hariharan, P. Optical Interferometry: The Post-Michelson Era. Aust. J. Phys.
**1993**, 46, 103–119. [Google Scholar] - Yasuhiko, A. Development of in-plane and out-of-plane deformations simultaneous measurement method for the analysis of buckling. Opt. Eng.
**2015**, 54, 024102. [Google Scholar] - Lionel, R.W. Review of fringe pattern phase recovery using the 1-D and 2-D continuous wavelet transforms. Opt. Lasers Eng.
**2012**, 50, 1015–1022. [Google Scholar] - Liu, H.; Cartwright, A.N.; Basaran, C. Experimental verification of improvement of phase shifting moiré interferometry using wavelet-based image processing. Opt. Eng.
**2004**, 43, 1206–1214. [Google Scholar] [CrossRef] - Zappa, E.; Busca, G. Comparison of eight unwrapping algorithms applied to Fourier-transform profilometry. Opt. Lasers Eng.
**2008**, 46, 106–116. [Google Scholar] [CrossRef]

**Figure 3.**Principle of three-dimensional measurement: 1, 5, and 11 are lasers; 2, 4, 6, 8–10, and 12 are reflectors; 3, 7, and 14 are beam splitters; 13 is the color CCD camera; 15 is reference; 16 is computer; 17 is object.

**Figure 6.**The speckle interferograms and grey-scale maps. (

**a**) The red speckle interferogram; (

**b**) The green speckle interferogram; (

**c**) The blue speckle interferogram.

**Figure 7.**Experiment setup: 1 and 14 are beam lifters; 2, 11, and 18 are the blue, red, and green laser; 3, 13, and 20 are spatial filters; 4, 12, and 26 are beam splitters; 5, 6, and 22 are laser controllers; 7–10, 16, 17, 19, and 21 are reflectors; 15 is an intensity attenuator; 23 is the color CCD camera; 24, 27, and 31 are grating rulers; 25 is the object; 28 is the reference; and 29 and 30 are data displays.

**Figure 10.**The speckle pattern interferometry fringes: (

**a**) the grey-scale map of fringes in the z-direction; (

**b**) the grey-scale map of fringes in the y-direction; and (

**c**) the grey-scale map of fringes in the x-direction.

**Figure 11.**The x-direction displacement: (

**a**) the intensity distribution over time; (

**b**) the intensity after amplification and smoothing processing; (

**c**) the discontinuous phase map obtained by CWT; (

**d**) the measured displacement over time.

**Figure 12.**The y-direction displacement: (

**a**) the intensity distribution over time; (

**b**) the intensity after amplification and smoothing processing; (

**c**) the discontinuous phase map obtained by CWT; and (

**d**) the measured displacement over time.

**Figure 13.**The z-direction displacement: (

**a**) the intensity distribution over time; (

**b**) the intensity after amplification and smoothing processing; (

**c**) the discontinuous phase map obtained by CWT; and (

**d**) the measured displacement over time.

x-Direction | y-Direction | z-Direction | |||||
---|---|---|---|---|---|---|---|

Name | Coordinate | Value/µm | Error/µm | Value/µm | Error/µm | Value/µm | Error/µm |

A1 | (24, 30) | 11.99 | 0.09 | 13.23 | 0.27 | 11.99 | 0.19 |

A2 | (74, 25) | 11.92 | 0.02 | 13.67 | 0.17 | 11.99 | 0.19 |

A3 | (111, 26) | 12.00 | 0.10 | 13.26 | 0.24 | 11.88 | 0.08 |

A4 | (166, 33) | 11.89 | 0.01 | 13.45 | 0.05 | 12.11 | 0.31 |

A5 | (26, 80) | 11.78 | 0.12 | 13.21 | 0.29 | 11.68 | 0.12 |

A6 | (76, 75) | 11.60 | 0.30 | 13.18 | 0.32 | 11.94 | 0.14 |

A7 | (130, 78) | 11.86 | 0.04 | 13.26 | 0.24 | 11.89 | 0.11 |

A8 | (172, 72) | 11.85 | 0.05 | 13.21 | 0.29 | 11.92 | 0.12 |

A9 | (18, 111) | 11.94 | 0.04 | 13.93 | 0.43 | 11.89 | 0.09 |

A10 | (78, 131) | 11.92 | 0.02 | 13.22 | 0.28 | 12.17 | 0.37 |

A11 | (134, 128) | 11.98 | 0.08 | 13.25 | 0.25 | 11.97 | 0.17 |

A12 | (188, 120) | 11.87 | 0.03 | 13.83 | 0.33 | 11.71 | 0.09 |

A13 | (25, 169) | 12.02 | 0.12 | 13.85 | 0.35 | 11.88 | 0.08 |

A14 | (77, 184) | 11.88 | 0.02 | 13.28 | 0.22 | 12.16 | 0.36 |

A15 | (130, 179) | 12.10 | 0.20 | 13.23 | 0.27 | 11.58 | 0.22 |

A16 | (174, 181) | 11.94 | 0.04 | 13.25 | 0.25 | 11.91 | 0.11 |

Average | 11.91 | 0.01 | 13.39 | 0.11 | 11.92 | 0.12 |

© 2016 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC-BY) license (http://creativecommons.org/licenses/by/4.0/).