Next Article in Journal
Recent Developments in Enzyme, DNA and Immuno-Based Biosensors
Previous Article in Journal
Classification of Bitter Orange Essential Oils According to Fruit Ripening Stage by Untargeted Chemical Profiling and Machine Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Online 3D Displacement Measurement Using Speckle Interferometer with a Single Illumination-Detection Path

Institute for Measurement Systems and Sensor Technology, Technical University of Munich, Theresienstraße 90/N5, 80333 Munich, Germany
*
Author to whom correspondence should be addressed.
Sensors 2018, 18(6), 1923; https://doi.org/10.3390/s18061923
Submission received: 15 May 2018 / Revised: 9 June 2018 / Accepted: 11 June 2018 / Published: 13 June 2018
(This article belongs to the Section Physical Sensors)

Abstract

:
Measurement systems for online nondestructive full-field three-dimensional (3D) displacement based on the single-shot and multiplexing techniques attract more and more interest, especially throughout the manufacturing industries. This paper proposes an accurate and easy-to-implement method based on an electronic speckle pattern interferometer (ESPI) with single illumination-detection path to realize the online nondestructive full-field 3D displacement measurement. The simple and compact optical system generates three different sensitivity vectors to enable the evaluation of the three orthogonal displacement components. By applying the spatial carrier phase-shifting technique, the desired information can be obtained in real time. The theoretical analysis and the measurement results have proven the feasibility of this ESPI system and quantified its relative measurement error.

1. Introduction

Due to the increased manufacturing demand for advanced materials and applications, especially in the industries of robotics, automotive, and aerospace, the technology for online measuring nondestructive full-field three-dimensional (3D) displacement is gradually becoming of great interest [1,2]. Since the 1970s, various optical approaches have been proposed. Two of the most common methods are digital image correlation (DIC) or digital speckle photography (DSP) extended through stereovision [3,4,5], and electronic speckle pattern interferometry (ESPI) with different sensitivity vectors [6,7,8,9,10]. The former techniques, which require a multi-camera system, identify the position of each object point in two frames and subsequently the relative displacement by applying a correlation algorithm to stochastic intensity patterns on the object’s surface [11,12]. The vision-based sensors with multiple cameras belong to this technique [13,14,15,16,17]. They use a full projection matrix as the transformation metric to measure the 3D structural displacement. The computer vision-based sensors have various industrial applications—for example, to control and check visual appearance in the production process, to monitor static and dynamic displacements of civil engineering structures, to assess the quantitative structural integrity, to monitor low- and high-frequency vibration of engineering structures, and to measure surface traction fields to represent the magnitude and direction of force applied to the skin’s surface, etc. However, this method can be challenging under the conditions of small depth of field or limited accessibility for detectors, etc. [18,19]. Moreover, the displacements to be measured are photographically resolved [20]. On the other hand, with the help of phase-shifting techniques in ESPI, the measurement results at nanoscale resolution can be obtained by building the relationship between the displacement and the phase change distribution caused by the interference between the object wave and reference wave [21]. To introduce different sensitivity vectors, an interferometric configuration with multiple illuminations and single detector is widely used. In this case, an online measurement can be realized by using spatial phase-shifting technique, together with, for example, the manipulation of the coherency of object and reference beams [22], or the control of the beams’ polarization [23], or the introduction of a multi-wavelength laser [24]. In addition, the ESPI systems with single illumination and multiple detectors for dynamic 3D displacement measurement have also been proposed [25,26], which, however, require a complex and elaborate calibration process. An important extension to ESPI applicability is provided by the single-shot and multiplexing measurement techniques, which, however, require complex calibration processes [27,28,29,30,31,32,33]. In year 2001, Hack et al. presented the process of validating a 3D finite element analysis by speckle interferometry using a wavelength-division multiplexing technique. It was advisable for the calibration procedure to make comparative measurements on the test object itself on selected locations [34]. Three years later, Coggrave et al. proposed a real-time interferometry system to visualize the deformation fields. A calibration process based on the minimization of a function obtained from a sequence of interferometric images was used [35]. In year 2014, Bergström et al. proposed the single-shot dual-wavelength digital holography for shape evaluation [36], whose calibration method was presented by Khodadad et al. [37,38]. In year 2015, Khaleghi et al. introduced the multiplexed holography for a single-shot three-dimensional shape and displacement measurements. A special registration algorithm is developed to minimize the differences between each two sensitivity vectors [39].
This paper proposes a new interferometric measurement system with a single illumination- detection path for online measurement of the full-field 3D displacement. In order to make the system sensible to any arbitrary displacement of the object in free space, three different sensitivity vectors are involved by a reference beam and three object beams, which are diffusely scattered from the test object and observed from different directions. By applying the single-aperture based spatial-carrier phase-shifting technique, the interferograms of the reference beam and the respective object beam in different loading events are spatially modulated and the corresponding phase distributions can be subsequently retrieved dynamically. Afterwards, with the reconstructed phase change maps, the displacement components with interferometric accuracy can be evaluated online. In addition, the performance of online measurement and the optical arrangement of this measurement system is simple, compact, and cost-effective, since neither multiple illuminations nor multiple detectors are required. Moreover, due to the single illumination-detection configuration, the calibration process referring to scaling issues is greatly simplified. Compared with the complex calibration process in the ESPI systems with multiple detectors, there is only one camera in the proposed system and the magnifications of all light paths are the same through the optical path design in advance; therefore, just one camera needs to be calibrated in the image formation process that establishes the mapping between the camera’s coordinates and the image’s coordinates. Additionally, the scales of the desired speckle interferograms generated by the interferences between the reference wave and the respective object waves do not need to be calibrated for the acquisition of the three-dimensional coordinates. Furthermore, no factors such as coherence, polarization, and spectral characteristics of the laser have to be manipulated. In this article, the working principle of this measurement system is introduced, and the experimental results obtained from a rigid-body rotation and deformation by a central load are presented and discussed.

2. Theory

2.1. Optical Arrangement

The optical configuration of the proposed four-beam ESPI system for online measurement of full-field 3D displacement is illustrated in Figure 1. The expanded and collimated laser beam is firstly split into two paths by the beam splitter B S 1 . The reflected one illuminates the test object with optically rough surface perpendicularly, while the transmitted one strikes the reference surface. The light scattered diffusely from the test object, denoted as object beam, is observed from three different directions. Each object beam goes successively through the respective lens ( L 1 , L 2 or L 3 ) and single aperture ( A 1 , A 2 or A 3 ). After that, they are reflected by the plane mirrors ( M 1 , M 2 and M 3 ), reflector R, and beam splitter B S 2 . At the same time, the light scattered from the reference surface, denoted as reference beam, passes through L r e f and A r e f , reflected by M r e f , and meets three object beams at B S 3 . After travelling through the imaging lens, these four beams generate the interferometric speckle patterns at the imaging array of the detector.
It is worth mentioning that, by orienting the plane mirrors ( M 1 , M 2 , M 3 and M r e f ) and the beam splitters ( B S 2 and B S 3 ), not only the lateral displacements among the four beams on the detector, but also the relative positions of the virtual images of the single apertures ( A 1 , A 2 , A 3 and A r e f ) in the imaging plane can be adjusted.
Figure 2 illustrates the experimental setup of the proposed interferometry system for online full-field 3D displacement.

2.2. Working Principle

To describe the four-beam ESPI system clearly, the wave vectors are introduced. As shown in Figure 3, k 0 denotes the wave vector of the incidence beam on the test object, while k 1 , k 2 and k 3 are wave vectors of the respective object beam. k 0 lies parallel to the object’s surface normal and points along the negative z-axis. k 1 and k 2 are located in the x z -plane and are on different sides with respect to the incidence beam at angles of θ 1 and θ 2 . k 3 is in y z -plane with angle θ 3 to the incidence beam.
Mathematically, these four wave vectors can be expressed by:
k 0 = 2 π λ ( w ) , k 1 = 2 π λ ( sin θ 1 · u + cos θ 1 · w ) , k 2 = 2 π λ ( sin θ 2 · u + cos θ 2 · w ) , k 3 = 2 π λ ( sin θ 3 · v + cos θ 3 · w ) .
Herein, λ is the wavelength of the laser; u , v , and w are the unit vectors along the positive x y z -coordinate axes. With these four wave vectors, an orthogonal coordinate system of the sensitivity vector ( k x , k y , k z ) can be constructed to enable the quantitative description of the object’s displacement in three dimensions.
It is to be noted that there are six interferograms generated in total, since interference occurs between each two beams I i and I j with initial phase distribution Δ ϕ i and Δ ϕ j . The subscripts, i.e., i and j, are from 0 to 3, which represent the reference beam and object beams, respectively. Generally, speckle interferometer systems perform measurements by detecting the phase change Δ ϕ i j due to the applied load [40,41]. Thus, the intensity distribution I of these interference speckle patterns at a certain loading event can be expressed by:
I = i = 0 3 j = 0 3 ( I i + I j ) + 2 I i I j cos ( ϕ i ϕ j + Δ ϕ i j ) .
The phase changes Δ ϕ i j can be expressed by the well-known equation:
Δ ϕ i j = ( k i k j ) · d , i = 0 , 1 , 2 , 3 ; j = 0 , 1 , 2 , 3 ,
with
d = l x u + l y v + l z w .
( k i k j ) represents the sensitivity vector, along which the displacement vector d is projected. l x , l y and l z are three orthogonal displacement components along the respective principal axis. By substituting Equations (1) and (4) into Equation (3), the phase change distributions of six interferograms can be represented by the functions of the displacement components and the observation angles, i.e., Δ ϕ i j = f ( l x , l y , l z , θ 1 , θ 2 , θ 3 ) . Since the observation angles are reserved as known quantities, three displacement components can theoretically be determined by solving the system of equations consisting of any three Δ ϕ i j . Because of the geometrical relationship among the observation directions, any one of three phase change distributions of the interferograms caused by the object beams, i.e., Δ ϕ 12 , Δ ϕ 13 , and Δ ϕ 23 , is dependent on the other two. Thus, at most two of them can be selected into the system of equations at the same time.
In this article, the example with three phase change distributions caused by the interferences between the reference beam and the respective object beam, i.e., Δ ϕ 01 , Δ ϕ 02 , and Δ ϕ 03 , is given. By solving the equations below,
Δ ϕ 01 = 2 π λ sin θ 1 · l x + ( cos θ 1 + 1 ) · l z , Δ ϕ 02 = 2 π λ sin θ 2 · l x + ( cos θ 2 + 1 ) · l z , Δ ϕ 03 = 2 π λ sin θ 3 · l y + ( cos θ 3 + 1 ) · l z ,
three unknown displacement components l x , l y and l z can be determined by:
l x = λ 2 π · ( cos θ 2 + 1 ) Δ ϕ 01 ( cos θ 1 + 1 ) Δ ϕ 02 sin ( θ 1 + θ 2 ) + sin θ 1 + sin θ 2 , l y = λ 2 π · 1 sin θ 3 · sin θ 1 Δ ϕ 3 ( cos θ 3 + 1 ) Δ ϕ 2 + sin θ 2 Δ ϕ 3 ( cos θ 3 + 1 ) Δ ϕ 1 + sin ( θ 1 + θ 2 ) Δ ϕ 3 sin ( θ 1 + θ 2 ) + sin θ 1 + sin θ 2 , l z = λ 2 π · ( sin θ 2 ) Δ ϕ 01 + ( sin θ 1 ) Δ ϕ 02 sin ( θ 1 + θ 2 ) + sin θ 1 + sin θ 2 .
In the case of θ 1 = θ 2 = θ 3 = θ , the equations above can be greatly simplified:
l x = λ 4 π · Δ ϕ 01 Δ ϕ 02 sin θ , l y = λ 4 π · 2 Δ ϕ 03 ( Δ ϕ 01 + Δ ϕ 02 ) sin θ , l z = λ 4 π · Δ ϕ 01 + Δ ϕ 02 cos θ + 1 .
Furthermore, the absolute value of the synthetic displacement | d | of the test object can be obtained by the root sum square of these three displacement components by using | d | = l x 2 + l y 2 + l z 2 .

2.3. Phase Retrieval

According to the working principle, and in order to realize the online measurement of three orthogonal deformation components in an optoelectronic measurement system, three phase change distributions Δ ϕ 01 , Δ ϕ 02 and Δ ϕ 03 are to be reconstructed simultaneously and dynamically. For this reason, the spatial carrier phase-shifting technique has attracted attention. By involving four single apertures, i.e., A 1 , A 2 , A 3 , and A r e f from Figure 1, six different adjustable carrier frequencies can be introduced, which are able to transmit different interferograms over separate frequency areas.
This single-aperture based phase modulation technique generates a periodic spatial fringe structure within each speckle grain, as shown in Figure 4a, to introduce a spatial carrier frequency f 0 = D / 2 λ f , where f represents the focus length of the imaging lens; D denotes the relative position and distance between the virtual images of the corresponding apertures in the detector’s plane. It is to be noted that the fringes within the speckle grains are perpendicular to the line joining the centers of two virtual apertures. Thus, by altering the orientation of the aperture pair, one can change the fringe direction over the image, and consequently adjust the direction of the carrier frequency. In addition, the aperture opening size d a is also an important parameter that is proportional to the spatial resolution r s p e c k l e and the cutoff frequency of the speckle image, i.e., r s p e c k l e = f c u t o f f = d a / 2 λ f . Figure 4b shows an arbitrarily relative position of the virtual images of two single apertures in the plane of the detector. They are laterally displaced from each other for D ( D x , D y ) . The carrier fringes within the internally modulated speckle result in the carrier frequency f 0 ( f 0 x , f 0 y ) directing along the joining line, and the carrier frequency components f 0 x and f 0 y are proportional to D x and D y , respectively. The resultant spectrum of the interference speckle pattern on the detector is illustrated in Figure 4c. The spectrum pair contains the information of the interferogram, while the origin-located spectrum represents the low-frequency components of the speckle image, including the background intensity and noise. A more detailed description about this spatial carrier phase-shifting technique is demonstrated in [42].
Besides Equation (1), the interference speckle pattern I on the detector can be alternatively represented by the individual wavefronts [43]:
I = i = 0 3 j = 0 3 u i u j * with u = | u | e i ϕ = ( u 0 + u 1 + u 2 + u 3 ) ( u 0 + u 1 + u 2 + u 3 ) * = ( u 0 u 0 * + u 1 u 1 * + u 2 u 2 * + u 3 u 3 * ) + ( u 0 u 1 * + u 1 u 0 * + u 0 u 2 * + u 2 u 0 * + u 0 u 3 * + u 3 u 0 * ) + ( u 1 u 2 * + u 2 u 1 * + u 1 u 3 * + u 3 u 1 * + u 2 u 3 * + u 3 u 2 * ) ,
where | u | and ϕ are the amplitude’s modulo and the phase distribution of the wave. The u * denotes the complex conjugate of u. The first four items on the right side of the equation are the self-interference components, the next six items present the cross-interference between the reference beam and object beams, while the last six items are the cross-interference components of the object beams. After applying fast Fourier transform, the intensity image is transmitted from the space domain into the frequency domain [44]:
I = F ( I ) = U 0 U 0 * + U 1 U 1 * + U 2 U 2 * + U 3 U 3 * + U 0 U 1 * + U 1 U 0 * + U 0 U 2 * + U 2 U 0 * + U 0 U 3 * + U 3 U 0 * + U 1 U 2 * + U 2 U 1 * + U 1 U 3 * + U 3 U 1 * + U 2 U 3 * + U 3 U 2 * ,
where ⊗ denotes the convolution operation. The first four terms reside at the origin and represent the direct-current component of the image. In order to separate the other six pairs of spectra, six different carrier frequencies out of various possibilities shall be appropriately selected by fulfilling the following requirements: (1) all of the spectra must completely separate from each other; (2) all useful spectra shall be limited under the maximum spatial frequency of the detector; and (3) the cutoff frequencies are to be optimized to reach the best spatial resolution of the retrieved phase maps.
Based on the requirements above, the relative positions among the virtual images of the four single apertures in the system are set, as shown in Figure 5a: the virtual aperture in the reference beam A r e f is located in the middle with coordinate ( 0 , 0 ) ; three virtual apertures A 1 , A 2 and A 3 in the object beams are laterally displaced from A r e f with the same distance D but at different angles of 0 , 120 and 240 with respect to the x-axis, respectively. Thus, their corresponding coordinates are ( D / 2 , 3 D / 2 ) , ( D / 2 , 3 D / 2 ) , and ( D , 0 ) . The centers of these three beams set up an equilateral triangle with side length of 3 D . The resultant spectrum distribution of the internally modulated four-beam speckle interferogram is shown in Figure 5b.
The spectrum at the center represents the low-frequency components, mainly from the background intensity and noise. Supposing that the horizontal spatial carrier frequency between the reference beam and the object beam 3 is f 0 , the centers of the spectra caused by the interference between the reference beam and object beams (gray-filled spectra in Figure 5b) are located on the circumference with origin ( 0 , 0 ) and radius f 0 . On the other hand, the centers of the spectra caused by the interference between each two object beams (blue-filled spectra in Figure 5b) lie on the circumference with origin ( 0 , 0 ) and radius 3 f 0 . All of the spectrums are mutually tangent to each other. Additionally, the boundary of the internal seven spectra is limited directly by the spatial resolution of the detector to ensure the best spatial resolution of the retrieved phase maps because only the internal three pairs of the spectra are required for the displacement evaluation (see Equation (6)). Thereby, the cutoff frequency f c u t o f f is quantitatively half of f 0 , and the spatial resolution of the detector along x- and y-axis are equal to 6 f c u t o f f and 3 3 f c u t o f f , respectively.
After obtaining the spectra of the interferogram, the required three spectra, i.e., | U 1 U 0 * | , | U 2 U 0 * | , and | U 3 U 0 * | are to be filtered out and then presented by an inverse Fourier transform to reconstruct the phase distribution of the corresponding interferogram by [8]:
ϕ 0 i = arctan I m ( u i u 0 * ) R e ( u i u 0 * ) , i = 1 , 2 , 3 .
Analogously, the phase distributions before and after object’s motion ( ϕ b e f o r e and ϕ a f t e r ) can be obtained. Then, the phase change distribution can be calculated by Δ ϕ 0 i = ϕ a f t e r ϕ b e f o r e . Subsequently, the three orthogonal displacement components l x , l y and l z can be evaluated by using Equation (6). Obviously, in the whole data processing procedures, only two interferograms under different loading events are required, which enables online measurement of the 3D displacement.

3. Experimental Results and Disscusion

3.1. Rigid-Body Rotation

In the first experiment, an aluminium plate located on a micrometer-driven rotatory stage has been examined. This stage provides three rotational degrees of freedom with 0 . 0140 of rotation around the z-axis and 0 . 0095 of tilt around x- and y-axis per revolution. The material of the reference surface is the same as the test object. Both of the surfaces are illuminated by a 0 . 8 mW helium-neon laser with a wavelength of 632 . 8 nm. To observe the interferograms, an 8-bit 1280 × 1024 pixels monochromatic camera with pixel pitch of 5 . 2 × 5 . 2 μ m 2 is used. The average size of speckles is approximately 16 . 0 × 16 . 0 μ m 2 that is about three times larger than the pixel pitch of the camera. The number of points for a real-time measurement is quantitatively equivalent to the resolution of the detector in use. Thus, the measurement number of points in our system is 1280 × 1024 = 1,310,720. On the other hand, the maximum number of points for a real-time measurement does not only depend on the resolution of the detector but also is proportional to the storage capacity and the computing capability of the system. By increasing the maximum number of points through improving either the storage capacity or the computing capability, the accuracy remains constant over time theoretically. However, the accuracy can vary by applying the detector with a higher resolution instead of the low-resolution detector because of the introduced systematic errors. The opening sizes, here referring to the diameter, of the apertures can be continuously adjusted within the range between 0.0 mm to 25.0 mm. The magnification of the measurement system is + 0 . 89 . The evaluation area of the measurement system in use is about 6 × 6 mm 2 . The vision area can be enlarged by decreasing the magnification of the overall imaging system, but at the expense of the decrement on the measurement resolution. The distance of the measurement system from the test object to be monitored mainly depends on the power of the laser in use. In our experimental setup (see Figure 2), the distance between the test object and lens L 1 ( L 2 ) is about 135 mm, and a 0.8 mW laser is used. For longer distances, a higher-power laser is required.
The test object carried out an in-plane rotation for 10 grids, equal to 0 . 1400 , around the z-axis in the clockwise direction. The measurement process was as follows: an interferogram before the object’s rotation was firstly recorded and transferred into the frequency domain by fast Fourier transform to obtain the spectrum distribution, which is shown in Figure 6a. Since the relative positions of the single apertures were set as in Figure 5a, the spectra separated from each other completely as expected. Meanwhile, only the internally-located three pairs of the spectra marked with black circles were desired for the further displacements’ evaluation. They were extracted to recover the phase maps by using Equation (10). In the same way, the phase maps after the object’s motion could also be reconstructed. Subsequently, the wrapped phase change maps Δ ϕ 01 , Δ ϕ 02 and Δ ϕ 03 could be obtained, as shown in Figure 6b–d. It can be seen that the fringes from Δ ϕ 03 , which relates to l y and l z , inclines slightly from the vertical direction, whereas the fringes from Δ ϕ 01 and Δ ϕ 02 , which are sensible to l x and l z , are at tiny angles with respect to the horizontal direction. Furthermore, all the fringes are evenly spaced in the case of a rigid-body rotation [45]. Hereafter, the three wrapped phase change maps should be unwrapped and then applied for the evaluation of the three components of the displacements l x , l y , and l z by using Equation (6). The obtained displacements are displayed in Figure 6e–g. In the case of a rigid body rotation, l x ( x , y , z ) shall be the same as l y ( y , x , z ) , and l z equals to 0. From the displacement distributions of this experiment, the ranges of l x , l y , and l z are 14 . 473 μ m, 14 . 347 μ m, and 0 . 267 μ m, respectively. The relative measurement errors of l x and l y are 0 . 7 % and 1 . 4 % . It is evident that the out-of-plane component l z is two orders of magnitude smaller than the in-plane components l x and l y . The reason why l z is not equal to 0, but much smaller than l x and l y , could be the measurement errors introduced by the misaligned optical system, a miscalibrated instrument, etc.
The last step was to calculate the absolute value of the three-dimensional displacement caused by the in-plane rotation. As shown in Figure 7, the contours of the absolute displacement are essentially a set of concentric circles around the rotation center. The synthetic in-plane displacements vectors of l x and l y are shown in Figure 7a. The vectors are parallel to the tangential directions of the corresponding displacement contours and depict the rotation in the clockwise direction. Numerically, the absolute values of the vectors increase linearly along the radial direction.

3.2. Deformation by Central Load

As introduced in the above Section 2.3: “Phase Retrieval”, the single-aperture based spatial carrier phase-shifting technique is used to recover the phase distributions from the recorded speckle interferogram. By involving different adjustable carrier frequencies, three desired phase distributions can be obtained at the same time and the displacement components to be measured can subsequently be evaluated dynamically. For the purpose of verifying the performance of online measurement, an aluminium plate, which was clamped at four corners and could be continuously loaded by a micrometer head from its rear side, served as the object under investigation in the second experiment.
Figure 8 shows the array of the wrapped phase change maps obtained in a continuous loading process with the recording interval of 0.5 s.
The wrapped change maps from top to bottom represent Δ ϕ 01 , Δ ϕ 02 and Δ ϕ 03 in turn, while, from left to right, they are displayed along the time-axis, i.e., in different time frames at 0.5 s, 1.0 s, 1.5 s, and 2.0 s, respectively. It is well known that, in the case of a pure out-of-plane displacement measurement, the resultant wrapped phase change maps are concentric circles around the loading point, generally the same as the measured wrapped phase change maps. This is because the out-of-plane displacement component l z , which is contained in Δ ϕ 01 , Δ ϕ 02 and Δ ϕ 03 , is significantly more dominant than the other two in-plane displacement components l x and l y in this case.
The wrapped phase maps are firstly filtered by a sine-cosine average filter, and then unwrapped by either adding or subtracting the integer multiple of 2 π . After that, three continuous phase change maps at each time frame have been obtained. Subsequently, Equation (6) has been applied to evaluate the corresponding principal components of displacements l x , l y and l z .
The results are shown in Figure 9. With the increase of the loading force, all three of the displacement components increase gradually. Compared to the simulation model of central deformation, the relative measurement error of l z is 0 . 5 % . As discussed above, the out-of-plane component l z depicts mainly the deformed object’s surface. Since the deformation center can be observed, the in-plane components l x and l y are of opposite signs with respect to the lines, which go through the deformation center and are parallel to the y- and x-axis, respectively.

4. Conclusions

In this paper, a novel ESPI system with single illumination-detection path is presented for the online full-field 3D displacement measurement. To reconstruct the three orthogonal displacement components, three different sensitivity vectors are introduced by three object beams and one reference beam. The speckle patterns are internally modulated by applying the single-aperture based spatial carrier phase-shifting technique, so that the desired phase maps can be recovered from a single interferogram. After that, the phase change map and subsequently the displacement components can be reconstructed dynamically. Compared with the existing techniques, the proposed system possesses a competitive advantage: the optical arrangement is considerably simpler, more compact and cost-effective, which additionally eliminates the complicated calibration process of the imaging system and greatly simplifies the measurement operations. Therefore, this technique provides a huge variety of applications as a nondestructive testing tool in the field of aerospace, automotive, marine, and high-tech materials manufacturing.
The spatial carrier phase-shifting method applied in the proposed interferometry system increases the temporal resolution of the measurement results, but decreases the spatial resolution. In addition, the spatial resolution is also limited by the maximum spatial frequency of the camera in use. In our system, the maximum spatial resolution of the measurement results is 3 . 2 × 10 4 m 1 . It is also worth mentioning that the test object and the measurement system in our experiments are located on the same optical breadboard. Therefore, the whole system is susceptible to external disturbances, including the ground motion. However, in the case that the test object and the measurement system are not placed on the same test platform, the measurement results denote the sum of the displacement of the test object and the external disturbances. Thus, it is advised that the test object and the proposed interferometry system shall be installed on the same test platform.
Based on the proposed interferometric approach for 3D displacement measurement, further research could focus on the development of an extended ESPI system to measure the complete six degrees of freedom to describe the object’s movement in 3D space.

Author Contributions

All works with relation to this paper have been accomplished by all authors’ efforts. M.L., X.S., S.W. and L.B. conceived and designed the experiments; M.L. and X.S. performed the experiments and analyzed the data; M.L. wrote the paper; M.J. and A.W.K. contributed materials and analysis tools; all authors discussed results and their implications, and commented on the manuscript at all stages.

Funding

This research was supported by the German Research Foundation (DFG) and Technical University of Munich (TUM) in the framework of the Open Access Publishing Program. The first two authors would also like to express their most sincere appreciation to the China Scholarship Council (CSC) for the financial support (File No. 201408080029 and 201507090066).

Acknowledgments

This work was performed at the Institute for Measurement Systems and Sensor Technology (MST) of the Technical University of Munich (TUM).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sansoni, G.; Trebeschi, M.; Docchio, F. State-of-the-art and applications of 3D imaging sensors in industry, cultural heritage, medicine, and criminal investigation. Sensors 2009, 9, 568–601. [Google Scholar] [CrossRef] [PubMed]
  2. Orteu, J.J.; Bugarin, F.; Harvent, J.; Robert, L.; Velay, V. Multiple-camera instrumentation of a single point incremental forming process pilot for shape and 3D displacement measurements: Methodology and results. Exp. Mech. 2011, 51, 625–639. [Google Scholar] [CrossRef]
  3. Ren, M.; Liang, J.; Li, L.; Wei, B.; Wang, L.; Tang, Z. Accurate three-dimensional shape and deformation measurement at microscale using digital image correlation. Rev. Sci. Instrum. 2015, 86, 075102. [Google Scholar] [CrossRef] [PubMed]
  4. Yamaguchi, I.; Rastogi, P.K.; Hack, E. Digital Holographic Interferometry and Speckle Correlation. In AIP Conference Proceedings; AIP: College Park, MD, USA, 2010; Volume 1236, pp. 46–51. [Google Scholar]
  5. Prentice, H.; Proud, W.; Furnish, M.D.; Elert, M.; Russell, T.P.; White, C.T. Three-Dimensional Dynamic Deformation Measurements Using Stereoscopic Imaging and Digital Speckle Photography. In AIP Conference Proceedings; AIP: College Park, MD, USA, 2006; Volume 845, pp. 1275–1278. [Google Scholar]
  6. Abdelhakim, L.; Simos, T.E.; Psihoyios, G.; Tsitouras, C. Displacement Determination by Digital Holographic Interferometry. In AIP Conference Proceedings; AIP: College Park, MD, USA, 2010; Volume 1281, pp. 2089–2094. [Google Scholar]
  7. Barrientos, B.; Cerca, M.; García-Márquez, J.; Hernández-Bernal, C.; Wetter, N.U.; Frejlich, J. Three-dimensional displacement measurement by fringe projection and speckle photography. In AIP Conference Proceedings; AIP: College Park, MD, USA, 2008; Volume 992, pp. 828–833. [Google Scholar]
  8. Gao, Z.; Deng, Y.; Duan, Y.; Zhang, Z.; Wei, C.; Chen, S.; Cui, J.; Feng, Q. Continual in-plane displacement measurement with temporal wavelet transform speckle pattern interferometry. Rev. Sci. Instrum. 2012, 83, 015107. [Google Scholar] [CrossRef] [PubMed]
  9. Aulbach, L.; Salazar Bloise, F.; Lu, M.; Koch, A.W. Non-Contact Surface Roughness Measurement by Implementation of a Spatial Light Modulator. Sensors 2017, 17, 596. [Google Scholar] [CrossRef] [PubMed]
  10. Preciado, J.S.; Lopez, C.P.; Santoyo, F.M.; Tomasini, E.P. Measurement of dynamic patterns of an elastic membrane at bi-modal vibration using high speed electronic speckle pattern interferometry. In AIP Conference Proceedings; AIP: College Park, MD, USA, 2014; Volume 1600, pp. 196–202. [Google Scholar]
  11. Synnergren, P.; Sjödahl, M. A stereoscopic digital speckle photography system for 3-D displacement field measurements. Opt. Lasers Eng. 1999, 31, 425–443. [Google Scholar] [CrossRef]
  12. Sjödahl, M.; Benckert, L. Electronic speckle photography: analysis of an algorithm giving the displacement with subpixel accuracy. Appl. Opt. 1993, 32, 2278–2284. [Google Scholar] [CrossRef] [PubMed]
  13. Feng, D.; Feng, M.Q.; Ozer, E.; Fukuda, Y. A vision-based sensor for noncontact structural displacement measurement. Sensors 2015, 15, 16557–16575. [Google Scholar] [CrossRef] [PubMed]
  14. Feng, D.; Feng, M.Q. Identification of structural stiffness and excitation forces in time domain using noncontact vision-based displacement measurement. J. Sound Vib. 2017, 406, 15–28. [Google Scholar] [CrossRef]
  15. Lee, J.J.; Shinozuka, M. A vision-based system for remote sensing of bridge displacement. Ndt E Int. 2006, 39, 425–431. [Google Scholar] [CrossRef]
  16. Oh, B.K.; Hwang, J.W.; Kim, Y.; Cho, T.; Park, H.S. Vision-based system identification technique for building structures using a motion capture system. J. Sound Vib. 2015, 356, 72–85. [Google Scholar] [CrossRef]
  17. Feng, D.; Feng, M.Q. Experimental validation of cost-effective vision-based structural health monitoring. Mech. Syst. Signal Process. 2017, 88, 199–211. [Google Scholar] [CrossRef]
  18. Le Flohic, J.; Parpoil, V.; Bouissou, S.; Poncelet, M.; Leclerc, H. A 3D displacement control by digital image correlation for the multiaxial testing of materials with a Stewart platform. Exp. Mech. 2014, 54, 817–828. [Google Scholar] [CrossRef]
  19. Schreier, H.; Orteu, J.J.; Sutton, M.A. Image Correlation for Shape, Motion and Deformation Measurements; Springer: New York, NY, USA, 2009. [Google Scholar]
  20. Jacquot, P.; Fournier, J.M. Interferometry in Speckle Light: Theory and Applications; Springer Science & Business Media: Berlin, Germany, 2012. [Google Scholar]
  21. Khodadad, D.; Singh, A.K.; Pedrini, G.; Sjödahl, M. Full-field 3D deformation measurement: comparison between speckle phase and displacement evaluation. Appl. Opt. 2016, 55, 7735–7743. [Google Scholar] [CrossRef] [PubMed]
  22. Saucedo, A.T.; Santoyo, F.M.; De la Torre-Ibarra, M.; Pedrini, G.; Osten, W. Endoscopic pulsed digital holography for 3D measurements. Opt. Express 2006, 14, 1468–1475. [Google Scholar] [CrossRef] [PubMed]
  23. Takatsuji, T.; Oreb, B.; Farrant, D.; Tyrer, J. Simultaneous measurement of three orthogonal components of displacement by electronic speckle-pattern interferometry and the Fourier transform method. Appl. Opt. 1997, 36, 1438–1445. [Google Scholar] [CrossRef] [PubMed]
  24. Flynn, E.B.; Bassman, L.C.; Smith, T.P.; Lalji, Z.; Fullerton, L.H.; Leung, T.C.; Greenfield, S.R.; Koskelo, A.C. Three-wavelength electronic speckle pattern interferometry with the Fourier-transform method for simultaneous measurement of microstructure-scale deformations in three dimensions. Appl. Opt. 2006, 45, 3218–3225. [Google Scholar] [CrossRef] [PubMed]
  25. Dekiff, M.; Berssenbrügge, P.; Kemper, B.; Denz, C.; Dirksen, D. Simultaneous acquisition of 3D shape and deformation by combination of interferometric and correlation-based laser speckle metrology. Biomed. Opt. Express 2015, 6, 4825–4840. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Gotoa, D.T.; Grovesa, R.M. A combined experimental with simulation approach to calibrated 3D strain measurement using shearography. Proc. SPIE 2010, 7387, 73871J. [Google Scholar]
  27. Takeda, M.; Kitoh, M. Spatiotemporal frequency multiplex heterodyne interferometry. JOSA A 1992, 9, 1607–1614. [Google Scholar] [CrossRef]
  28. Takeda, M.; Gu, Q.; Kinoshita, M.; Takai, H.; Takahashi, Y. Frequency-multiplex Fourier-transform profilometry: A single-shot three-dimensional shape measurement of objects with large height discontinuities and/or surface isolations. Appl. Opt. 1997, 36, 5347–5354. [Google Scholar] [CrossRef] [PubMed]
  29. Ochoa, N.A.; Huntley, J.M. Convenient method for calibrating nonlinear phase modulators for use in phase shifting interferometry. Opt. Eng. 1998, 37, 2501–2506. [Google Scholar]
  30. Colomb, T.; Montfort, F.; Kühn, J.; Aspert, N.; Cuche, E.; Marian, A.; Charrière, F.; Bourquin, S.; Marquet, P.; Depeursinge, C. Numerical parametric lens for shifting, magnification, and complete aberration compensation in digital holographic microscopy. JOSA A 2006, 23, 3177–3190. [Google Scholar] [CrossRef] [PubMed]
  31. Ferraro, P.; Miccio, L.; Grilli, S.; Paturzo, M.; De Nicola, S.; Finizio, A.; Osellame, R.; Laporta, P. Quantitative phase microscopy of microstructures with extended measurement range and correction of chromatic aberrations by multiwavelength digital holography. Opt. Express 2007, 15, 14591–14600. [Google Scholar] [CrossRef] [PubMed]
  32. Tayebi, B.; Jafarfard, M.R.; Sharif, F.; Bae, Y.S.; Shokuh, S.H.H.; Kim, D.Y. Reduced-phase dual-illumination interferometer for measuring large stepped objects. Opt. Lett. 2014, 39, 5740–5743. [Google Scholar] [CrossRef] [PubMed]
  33. Deng, C.; Suo, J.; Wang, Y.; Zhang, Z.; Dai, Q. Single-shot thermal ghost imaging using wavelength-division multiplexing. Appl. Phys. Lett. 2018, 112, 051107. [Google Scholar] [CrossRef] [Green Version]
  34. Hack, E.K.; Riner, M. 3D ESPI and 3D shearography measurements applied to NDT and FEM analysis validation for industrial quality control. In Optical Measurement Systems for Industrial Inspection II: Application in Industrial Design; International Society for Optics and Photonics: Washington, DC, USA, 2001; Volume 4398, pp. 155–168. [Google Scholar]
  35. Coggrave, C.; Huntley, J. Real-time visualisation of deformation fields using speckle interferometry and temporal phase unwrapping. Opt. Lasers Eng. 2004, 41, 601–620. [Google Scholar] [CrossRef]
  36. Bergström, P.; Khodadad, D.; Hällstig, E.; Sjödahl, M. Dual-wavelength digital holography: Single-shot shape evaluation using speckle displacements and regularization. Appl. Opt. 2014, 53, 123–131. [Google Scholar] [CrossRef] [PubMed]
  37. Khodadad, D.; Bergström, P.; Hällstig, E.; Sjödahl, M. Single shot dual-wavelength digital holography: Calibration based on speckle displacements. Int. J. Optomechatron. 2014, 8, 326–339. [Google Scholar] [CrossRef]
  38. Khodadad, D.; Bergström, P.; Hällstig, E.; Sjödahl, M. Fast and robust automatic calibration for single-shot dual-wavelength digital holography based on speckle displacements. Appl. Opt. 2015, 54, 5003–5010. [Google Scholar] [CrossRef] [PubMed]
  39. Khaleghi, M.; Furlong, C.; Guignard, J.; Dobrev, I.; Cheng, J.T.; Rosowski, J.J. Multiplexed Holography for Single-Shot Three-Dimensional Shape and Displacement Measurements. In Advancement of Optical Methods in Experimental Mechanics; Springer: New York, NY, USA, 2015; Volume 3, pp. 103–108. [Google Scholar]
  40. Goodman, J.W. Speckle Phenomena in Optics: Theory and Applications; Roberts and Company Publishers: Englewood, CO, USA, 2007. [Google Scholar]
  41. Koch, A.; Ruprecht, M.; Toedter, O.; Häusler, G. Optische Messtechnik an Technischen Oberflächen; Expert-Verlag: Renningen-Malmsheim, Germany, 1998. [Google Scholar]
  42. Lu, M.; Wang, S.; Aulbach, L.; Koch, A.W. Simultaneous displacement and slope measurement in electronic speckle pattern interferometry using adjustable aperture multiplexing. Appl. Opt. 2016, 55, 5868–5875. [Google Scholar] [CrossRef] [PubMed]
  43. Hung, M.Y.; Shang, H.M.; Yang, L. Unified approach for holography and shearography in surface deformation measurement and nondestructive testing. Opt. Eng. 2003, 42, 1197–1207. [Google Scholar] [CrossRef]
  44. Pedrini, G.; Zou, Y.; Tiziani, H. Quantitative evaluation of digital shearing interferogram using the spatial carrier method. Pure Appl. Opt. J. Eur. Opt. Soc. Part A 1996, 5, 313. [Google Scholar] [CrossRef]
  45. Lu, M.; Wang, S.; Aulbach, L.; Jakobi, M.; Koch, A. Non-phase unwrapping interferometric approach for a real-time in-plane rotation measurement. Opt. Lett. 2017, 42, 1984–1989. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Optical arrangement of a four-beam electronic speckle pattern interferometry (ESPI) system for online 3D displacement measurement (BS: beam splitter; L: lens; A: single aperture; M: plane mirror).
Figure 1. Optical arrangement of a four-beam electronic speckle pattern interferometry (ESPI) system for online 3D displacement measurement (BS: beam splitter; L: lens; A: single aperture; M: plane mirror).
Sensors 18 01923 g001
Figure 2. Experimental setup of online 3D displacement measurement (BS: beam splitter; L: lens; A: single aperture; M: plane mirror; R: reflector).
Figure 2. Experimental setup of online 3D displacement measurement (BS: beam splitter; L: lens; A: single aperture; M: plane mirror; R: reflector).
Sensors 18 01923 g002
Figure 3. Evaluation of the sensitivity vectors (TO: test object; OP: observation point).
Figure 3. Evaluation of the sensitivity vectors (TO: test object; OP: observation point).
Sensors 18 01923 g003
Figure 4. (a) speckle grains with internal spatial fringe structure; (b) relative positions of the virtual images of two single apertures in the detector’s plane; (c) corresponding spectrum distribution of the speckle pattern in the frequency domain.
Figure 4. (a) speckle grains with internal spatial fringe structure; (b) relative positions of the virtual images of two single apertures in the detector’s plane; (c) corresponding spectrum distribution of the speckle pattern in the frequency domain.
Sensors 18 01923 g004
Figure 5. (a) relative positions of the virtual images of the four single apertures in the detector’s plane; (b) spectra distribution of the internally modulated speckle interferogram with respect to (a).
Figure 5. (a) relative positions of the virtual images of the four single apertures in the detector’s plane; (b) spectra distribution of the internally modulated speckle interferogram with respect to (a).
Sensors 18 01923 g005
Figure 6. Experimental results of a rigid-body rotation: (a) is the spectrum of the recorded speckle interferogram; (bd) are the wrapped phase change maps due to in-plane rotation, i.e., ϕ 01 , ϕ 02 and ϕ 03 in rad; (eg) represent the three components of the object’s displacement, i.e., l x , l y and l z in μ m.
Figure 6. Experimental results of a rigid-body rotation: (a) is the spectrum of the recorded speckle interferogram; (bd) are the wrapped phase change maps due to in-plane rotation, i.e., ϕ 01 , ϕ 02 and ϕ 03 in rad; (eg) represent the three components of the object’s displacement, i.e., l x , l y and l z in μ m.
Sensors 18 01923 g006
Figure 7. (a) synthetic in-plane displacements vectors of l x and l y ; (b) absolute value of the displacement | d | in μ m.
Figure 7. (a) synthetic in-plane displacements vectors of l x and l y ; (b) absolute value of the displacement | d | in μ m.
Sensors 18 01923 g007
Figure 8. Wrapped phase change maps Δ ϕ 01 , Δ ϕ 02 and Δ ϕ 03 obtained from a dynamic measurement, in which the test object was under a continuous loading process.
Figure 8. Wrapped phase change maps Δ ϕ 01 , Δ ϕ 02 and Δ ϕ 03 obtained from a dynamic measurement, in which the test object was under a continuous loading process.
Sensors 18 01923 g008
Figure 9. Reconstructed three orthogonal displacement components l x , l y and l z corresponding to the time frames from top to bottom at 0.5 s, 1.0 s, 1.5 s and 2.0 s, respectively.
Figure 9. Reconstructed three orthogonal displacement components l x , l y and l z corresponding to the time frames from top to bottom at 0.5 s, 1.0 s, 1.5 s and 2.0 s, respectively.
Sensors 18 01923 g009

Share and Cite

MDPI and ACS Style

Lu, M.; Wang, S.; Bilgeri, L.; Song, X.; Jakobi, M.; Koch, A.W. Online 3D Displacement Measurement Using Speckle Interferometer with a Single Illumination-Detection Path. Sensors 2018, 18, 1923. https://doi.org/10.3390/s18061923

AMA Style

Lu M, Wang S, Bilgeri L, Song X, Jakobi M, Koch AW. Online 3D Displacement Measurement Using Speckle Interferometer with a Single Illumination-Detection Path. Sensors. 2018; 18(6):1923. https://doi.org/10.3390/s18061923

Chicago/Turabian Style

Lu, Min, Shengjia Wang, Laura Bilgeri, Xian Song, Martin Jakobi, and Alexander W. Koch. 2018. "Online 3D Displacement Measurement Using Speckle Interferometer with a Single Illumination-Detection Path" Sensors 18, no. 6: 1923. https://doi.org/10.3390/s18061923

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop