Next Article in Journal
Nondestructive Detection of Egg Freshness Based on Infrared Thermal Imaging
Next Article in Special Issue
Real-Time Fault Diagnosis for Hydraulic System Based on Multi-Sensor Convolutional Neural Network
Previous Article in Journal
Drone–Robot to Clean Power Line Insulators
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Digital Image Correlation with a Prism Camera and Its Application in Complex Deformation Measurement

1
Qingdao Research Institute, School of Marine Science and Technology, Northwestern Polytechnical University, Xi’an 710072, China
2
School of Mechanical and Precision Instrument Engineering, Xi’an University of Technology, Xi’an 710048, China
3
Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong 999077, China
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(12), 5531; https://doi.org/10.3390/s23125531
Submission received: 18 March 2023 / Revised: 12 May 2023 / Accepted: 23 May 2023 / Published: 13 June 2023

Abstract

:
Given the low accuracy of the traditional digital image correlation (DIC) method in complex deformation measurement, a color DIC method is proposed using a prism camera. Compared to the Bayer camera, the Prism camera can capture color images with three channels of real information. In this paper, a prism camera is used to collect color images. Relying on the rich information of three channels, the classic gray image matching algorithm is improved based on the color speckle image. Considering the change of light intensity of three channels before and after deformation, the matching algorithm merging subsets on three channels of a color image is deduced, including integer-pixel matching, sub-pixel matching, and initial value estimation of light intensity. The advantage of this method in measuring nonlinear deformation is verified by numerical simulation. Finally, it is applied to the cylinder compression experiment. This method can also be combined with stereo vision to measure complex shapes by projecting color speckle patterns.

1. Introduction

As a numerical calculation method based on speckle images, digital image correlation [1] has been widely used to measure the deformation and strain field on the stressed surface. Moreover, in combination with binocular stereo vision, a three-dimensional shape [2] can also be obtained by projecting a speckle pattern on the measured surface. The classic digital image correlation takes gray speckle images as the basic data, and its algorithm mainly includes integer-pixel matching and sub-pixel matching. Sub-pixel matching is the key to obtaining accurate measurement data. Its essence is nonlinear optimization, usually solved iteratively by the Newton method. The mainstream sub-pixel matching algorithms are the forward accumulation Gauss-Newton method (FA-GN) [3] and the reverse combination Gauss-Newton method (IC-GN) [4]. Both have the same accuracy. Compared to the IC-GN algorithm, FA-GN is more flexible in selecting shape function and correlation function.
The digital image correlation method based on gray speckle images aims to improve accuracy and speed. There is much theoretical research on the quality evaluation of speckle images, shape functions, interpolation functions, optimization methods, subset sizes, strain field solutions, computational efficiency, and other technical details. Since the theory is relatively mature [5], the current research direction is mainly the application of underwater, high temperature, high light, high speed, rotation, large field of view, micro-scale, and other complex scenes [6].
Due to the popularity of color cameras, the method of measuring deformation and shape based on color speckle images has received enough attention and has even been applied to high-temperature deformation [7], the topography of a liquid interface [8], and monitoring of painting [9]. In fact, researchers are interested in the rich information contained in the color image. Currently, the measurement methods using color speckle images are divided into three categories. The first is to use a Bayer color camera (also known as Color Filter Array, CFA) to obtain color images. In Bayer color cameras, only one of the color values of red, green, and blue is really from CCD, and the other two values are calculated by interpolation, that is, the estimated value. Therefore, this category mainly studies color image preprocessing and interpolation methods, hoping to improve measurement accuracy [10,11]. The second is to build a complex optical path to obtain more color information through optical principles. This category is mainly carried out in the laboratory and is used for the three-dimensional reconstruction of small object surfaces [12,13,14,15,16,17]. The idea is to separate the red and blue channels of a single-color camera using a light-splitting prism, and then form binocular stereo vision through reflectors [18]. In addition, Luis et al. [19] synthesized the characteristic stripe and speckle pattern into color coding. They improved the measurement accuracy of 3D displacement and in-plane displacement due to the addition of phase information.
The third is to study the matching algorithm of color images, mainly improving the classic DIC algorithm to apply to color images. In 2003, Yonyama et al. [20] used NCC (normalized cross correlation) function as the three-channel correlation function, confirmed that a smaller subset can be used to match, and measured the displacement of rigid body rotation. In 2015, Ghulam et al. [21] used the NSSD (normalized sum of squared differences) function to apply color speckle images to small strain measurements of deformable solids. Subsequently, the different sizes of color speckle particles and different deformation were analyzed in detail, and it was believed that the color DIC had a better effect than the gray DIC [22]. However, the above methods do not specifically discuss the process of the algorithm, nor do they consider the changes in light intensity on different channels before and after deformation. As a result, the algorithm cannot be applied in the situation of complex changes in ambient light. Recently, Wang [23] proposed a correlation function based on hue, which is robust to the scaling and shifting of light intensity. This method can be used to measure the scaling deformation and rotation deformation between large frames, but the implementation is complex. Since the prism camera can provide accurate pixel color values on three channels, it has more advantages than the Bayer color camera in image matching [24]. In this paper, a prism camera is used to collect color speckle images. Based on the classic gray image matching algorithm, the light intensity changes of the three channels before and after deformation are comprehensively considered, and a correlation matching algorithm based on color images is derived. Through numerical simulation and real experiments, its effectiveness in solving complex deformation problems is verified.

2. Algorithm

2.1. Principle

The traditional gray image matching algorithm, on the one hand, can ensure that the subset has enough information, especially when the contrast of the speckle image is not strong, and usually selects a large reference subset. On the other hand, because the second-order shape function contains many unknown coefficients, which will lead to a large standard deviation of the calculation results, the first-order shape function is often used in the matching algorithm. However, when matching complex deformation, the mapping relationship between the large reference subset and the matching subset presents non-linear, and its deformation law is difficult to be described by the first-order shape function. Even the second-order shape function may not be accurately described. In this case, making match calculations will lead to large matching errors and inaccurate measurement results.
Because of the low accuracy of the traditional correlation matching in complex deformation measurement, based on the abundant information of the three channels of the color image, a correlation matching algorithm using the combination of the brightness information of the three channels of a color image is proposed based on the FA-GN algorithm. It includes integer-pixel matching, sub-pixel matching, and initial estimation of light intensity.
The basic principle is shown in Figure 1. With the help of the brightness information of the three channels of the prism camera, select a smaller subset at the same position of each channel. Thus, the three small subsets can jointly provide enough brightness information to implement matching. At the same time, even for complex deformation, the deformation of each small subset can obey the first-order shape function. In the case of measuring complex deformations, it avoids large iteration residuals in the traditional correlation matching method caused by the following two aspects: it is difficult to provide sufficient matching information when using a small subset; the shape function is difficult to describe the deformation law when using a large subset.

2.2. Integer-Pixel Matching

First, the corresponding position of the integer-pixel level on the reference image and the deformed image should be determined. The sum of the grayscale of the reference subset and the deformation subset is abbreviated as follows, and the like:
s = 1 3 i = m m j = m m f s ( x i , y j ) i = 1 3 × ( 2 m + 1 ) 2 f i s f s = 1 3 i = m m j = m m g s ( x i , y j ) i = 1 3 × ( 2 m + 1 ) 2 g i s g
where,  ( x i , y j )  and  ( x i , y j )  are the pixel coordinates in the reference subset and the matching subset, respectively.  f s ( x i , y j )  and  g s ( x i , y j )  are the grayscales of the corresponding positions on the s channel in the color image. m is the half-length of the subset in pixels.
The correlation function used for integer-pixel matching is the ZNSSD (zero-normalized sum of squared differences) function:
C Z N S S D = i = 1 3 × ( 2 m + 1 ) 2 f f μ ( f f μ ) 2 g g μ ( g g μ ) 2 2
where,  f μ  and  g μ  are the gray mean values of the reference subset and the deformation subset on the three channels:
f μ = 1 3 × ( 2 m + 1 ) 2 s = 1 3 i = m m j = m m f s ( x i , y j ) g μ = 1 3 × ( 2 m + 1 ) 2 s = 1 3 i = m m j = m m g s ( x i , y j )
The calculation amount of integer-pixel matching increases exponentially with the increase in subset size. Therefore, a fast Integer-pixel search method is proposed. It is believed that the gray difference of the corresponding position before and after the deformation will not be greater than 50 on the three channels. With this constraint, some impossible positions in the search area can be eliminated. For the remaining effective pixel positions, use the calculation process in Figure 2. First, the similarity is calculated using small areas, and these impossible matching positions whose correlation coefficient is greater than the average of the overall correlation coefficient  C ¯ m  are excluded. Then, increase the size of the subset, calculate the correlation coefficient and its average value for the remaining area, and remove some impossible pixels again. This is repeated until the last pixel position is left. Usually, when half of the length of the subset is less than five pixels, the search is completed.

2.3. Sub-Pixels Matching

After the integer-pixel matching is completed, the corresponding positions of the sub-pixel level of the reference image and the deformed image should be determined. It is considered that the gray level of any point in the subset changes according to the linear model before and after deformation. The minimum distance square sum function including the linear light intensity coefficient is selected to construct goal expression:
F ( p ) = s = 1 3 i = m m j = m m a s × f s ( x i , y j ) + b s g s ( x i , y j ) 2
where,  a s  and  b s  are the coefficients of light intensity in the subset of the s-th channel. Subset’s deformation uses first-order shape function:
x i = x i + u + u x Δ x + u y Δ y y j = y j + v + v x Δ x + v y Δ y
where,  Δ x , Δ y  is the offset of the calculated point in the subset in the horizontal and vertical directions relative to the subset center. Then, the unknown vector including light intensity coefficient  a 1 , b 1 , a 2 , b 2 , a 3 , b 3  and deformation coefficient  u , u x , u y , v , v x , v y  is:
p = u , u x , u y , v , v x , v y , a 1 , b 1 , a 2 , b 2 , a 3 , b 3 T
The calculation of the deformation coefficient in the correlation function is the unconstrained extremum problem of the multivariate function. For the multivariate function  F ( p ) , the iterative format is obtained by the Newton method:
p ( n + 1 ) = p ( n ) ( 2 F ( p ( n ) ) ) 1 F ( p ( n ) )
where,  F ( p )  and  2 F ( p )  are first-order and second-order partial derivative matrix, respectively:
F ( p ) = F p 1 F p 2 F p 12 T
2 F ( p ) = 2 F p 1 2 2 F p 1 p 2 2 F p 1 p 12 2 F p 2 p 1 2 F p 2 2 2 F p 2 p 12 2 F ( p ) p k p l 2 F p 12 p 1 2 F p 12 p 2 2 F p 12 2
In the partial derivative matrix, for six deformation coefficients, when  k , l  = 1, 2, …, 6:
F ( p ) p k = 2 s = 1 3 i = m m j = m m a s × f s ( x i , y j ) + b s g s ( x i , y j ) g s p k 2 F ( p ) p k p l 2 s = 1 3 i = m m j = m m g s p k g s p l
Abbreviation  g ( x i , y j ) x = g x , g ( x i , y j ) y = g y , then
g s p 1 = g x s , g s p 2 = g x s Δ x , g s p 3 = g x s Δ y g s p 4 = g y s , g s p 5 = g y s Δ x , g s p 6 = g y s Δ y
In the partial derivative matrix, for six light intensity coefficients, that is, when k = 7, …, 12:
F ( p ) a s = 2 i = m m j = m m a s × f s ( x i , y j ) + b s g s ( x i , y j ) f s ( x i , y j ) F ( p ) b s = 2 i = m m j = m m a s × f s ( x i , y j ) + b s g s ( x i , y j )
The calculation flow of sub-pixel matching based on Newton’s iteration is shown in Figure 3. Newton iteration needs to determine the exact initial value of the integer-pixel position and unknown coefficient in advance and set the termination condition. It can be set that in the adjacent iteration, the iteration is terminated when the modulus of the unknown coefficients change is less than 0.001.
The initial value of iteration should be as accurate as possible because Newton’s iteration method is easy to fall into the local optimal solution. The initial value of the deformation coefficient is generally zero. In the actual measurement, due to the interference of ambient light, the brightness of the image on the three channels before and after deformation may change. To ensure the stability of sub-pixel matching, the initial values of light intensity changes before and after deformation in each channel are solved before iteration. Take one of the channels as an example to illustrate the solution.

2.4. Initial Value Estimation of Light Intensity Coefficients

After the completion of integer-pixel matching, n × n pixel regions centered on the reference node  f 5  and matching node  g 5  are selected on the reference image and deformed image, as shown in Figure 4 f i  and  g i  are the gray levels of corresponding positions. Then, according to the linear transformation on light intensity, it can be obtained:
f 1 1 f 2 1 f i 1 a b = g 1 g 2 g i   ( Abbreviated   as   f a , b T = g )
Its least squares solution is:
a , b T = f T f 1 f T g
The initial estimation of light intensity is generally selected as a 5 × 5-pixel region.
If the light intensity changes of the three channels before and after deformation are not considered, the sub-pixel matching algorithm in Section 2.3 can also be derived based on IC-GN algorithm. The specific derivation process is shown in Appendix A. In some measurement scenes where ambient lighting is uniform and stable, the sub-pixel matching algorithm in Appendix A has higher computational efficiency.

3. Numerical Simulation

3.1. Generate Speckle Image

The speckle images before and after deformation are generated by computer simulation to verify the effectiveness of this method [25]. The gray image  I ( x , y )  and  I ( x , y )  of each channel of color speckle image before and after deformation are generated according to the following formula:
I ( x , y ) = k = 1 r A k exp ( x x k ) 2 + ( y y k ) 2 D / 2 2 I ( x , y ) = k = 1 r A k exp ( x x k ) 2 + ( y y k ) 2 D / 2 2
where, D is the diameter of speckle particles, and r is the total number of speckle particles. ( x k , y k )  and Ak is the position and strength of the k-th speckled particle.  ( x k , y k )  is the position of the k-th speckle particle after translation. It is described by displacement function before and after translation:
x k = x k + u ( x , y ) y k = y k + v ( x , y )
where,  u ( x , y )  and  v ( x , y )  are displacement functions in horizontal and vertical directions, respectively, which should be continuous. To prove the superiority of this method in dealing with complex deformation, the displacement functions  u ( x , y )  and  v ( x , y )  are defined as sine laws [26] so that the resulting deformation is nonlinear and non-uniform. T is the period and  α  is the amplitude:
u ( x , y ) = α sin ( 2 π x / T ) sin ( 2 π y / T ) v ( x , y ) = α cos ( 2 π x / T ) cos ( 2 π y / T )
In the algorithm test in this paper, the image size is 400 × 400 pixels2, the particle size is 4 pixels, and the particle number is 7000. On the reference image of each channel, a displacement function with a period T of 20 and amplitude  α  of 0.5 pixels is applied first. Then, add the light intensity transformation with (a, b) of (0.95, 8), (0.93, 12), and (0.94, 10) on the three channels, respectively. Finally, color speckle images before and after deformation are synthesized. The color reference image is shown in Figure 5a. To compare with the traditional method, the gray speckle image is obtained by graying the color image before and after deformation. The weighted average factor used for graying is (0.299, 0.578, 0.114). The grayscale reference image is shown in Figure 5b. An improved algorithm (called color FA-GN) is used on color speckle images, and a traditional algorithm (called gray FA-GN) is used on gray speckle images. Both choose bilinear interpolation and first-order shape function. To ensure that the amount of information involved in matching the subset is basically the same in the two algorithms, seven groups of different subset sizes in Table 1 are selected for comparative calculation. Using the Intel Core i7 processor, run the computer with 16G memory to execute the written program.
In Figure 5b, the calculation area (red box) and the distribution of calculation nodes (blue cross) of the two methods are also marked. The horizontal and vertical distance (step length) between adjacent nodes is 15 pixels, the horizontal coordinate is 41:15:341, and the vertical coordinate is 49:15:349. The scale of the nodes is 21 × 21. Each node is calculated independently. The size of the subset shown in the green box is 23 × 23 pixels2.

3.2. Result Analysis

In the DIC algorithm, the size of the subset is closely related to the calculation deviation. In general, the larger the subset, the more information it contains, and the more accurate the corresponding matching result [27]. To ensure fairness, in Table 1, the number of pixels contained in the subset used by the two methods in each group is approximately the same. The calculation results of these two methods are compared from not only the calculation deviation of the U-field and V-field but also the average number and computing time of iterations. The calculated deviation is calculated from two aspects: mean absolute error (MAE) and root mean square error (RMSE):
M A E = 1 n i = 1 n d e v i a t i o n i = 1 n i = 1 n c a l c u l a t e d i i d e a l i R M S E = 1 n i = 1 n d e v i a t i o n i d e v i a t i o n μ 2
where,  c a l c u l a t e d i i d e a l i , and  d e v i a t i o n i  are the calculated value, ideal value, and deviation of the displacement of the i-th node, respectively, and  d e v i a t i o n μ  is the average value of the deviation of all nodes.
Draw the deviations in Table 1 into a curve, as shown in Figure 6. In group (1), the calculation deviation of color DIC is larger than that of gray DIC. When the subset is small, the deformation in the subset is close to a linear deformation. Theoretically, the calculation results should be consistent when dealing with linear deformation. However, due to the more unknowns solved by color DIC compared with gray DIC, resulting in greater displacement deviation. However, this deviation is generally within the acceptable range. Moreover, to ensure the stability of the iteration, the selected subset normally will not be too small. With the increase of the size of the gray subset, the deformation in the subset gradually presents nonlinear. Currently, in gray DIC, the first-order shape function is increasingly difficult to describe the deformation law in the subset, resulting in increasing calculation deviation continuously [28]. However, the size of the color subset does not change much, so the calculation deviation remains low. In terms of time and iteration times, the two are approximate. The color DIC algorithm is slightly higher because it spends more time on frequent image access in three channels. In practical applications, the initial values of the deformation and light intensity coefficients can be transferred to surrounding nodes through the seed node, which can greatly shorten the calculation time [29].
Figure 7a,c show the original displacement field applied on the reference image in the numerical simulation, and Figure 7b,d show the horizontal and vertical displacement fields calculated by group (4) using color FA-GN. Compared with the distribution of the ideal displacement field on the left, it can reflect the correctness of the matching.
Still using data from group (4), compare the displacement deviation of the U-field and V-field under the two calculation methods, and the results are shown in Figure 8. The reference subset selected for the color image is small, and the deformation of each subset is approximately linear, so the displacement deviation at each node is small and consistent. However, due to the large subset selected by the traditional method, the deformation in the subset conflicts with the first-order shape function, resulting in a large matching error. Especially when the node is located at the peak and trough of the deformation function, the conflict is the most severe, so the displacement error at these positions is the largest.

4. Application

The compression characteristics of high elastic polymer materials, such as rubber, are the focus of elastic mechanics and the material industry. In this paper, a simple experimental device is built, and the experimental schematic is shown in Figure 9. The speckle images of the annular specimen under different static loads are taken by the color camera, and the surface deformation of the specimen under each state is measured. The loading device is a small vise, which manually rotates the screw to apply pressure. The deformation of the specimen after compression is complex, which can verify the feasibility of the color digital image correlation method for measuring large nonlinear deformation.
The experimental site is shown in Figure 10. The outer diameter of the annular rubber is 70 mm, the inner diameter is 12 mm, and the thickness is 20 mm. Before the experiment, a thin layer of matte white paint was covered on the rubber ring surface, and then three colors of red, green, and blue were randomly sprayed, respectively. The model of the prism camera is AT-200GE. It uses three ICX274AL CCD imaging sensors, and the resolution of each channel is 1620 × 1236 pixels, with a pixel size of 4.4 μm. Select a fixed-focus lens with a focal length of 12 mm and object distance is 180 mm. By converting the diameter of the marker circle on the reference image, the pixel equivalent is 3.64 × 10−2 mm/pixel.
The deformation of the rubber surface under different stress conditions is measured using the proposed matching method. The subset size is 41 × 41 pixels2 and the step length is 10 pixels. Due to space limitations, four compression states are chosen in Figure 11a. The calculated deformation field in horizontal and vertical directions are shown in Figure 11b–e, respectively. The maximum and minimum displacements in the horizontal and vertical directions in each state are shown in the lower right corner of each figure. It can be clearly seen that the measurement results are smooth, and the distribution trend is correct. This reflects the value of the color image-matching algorithm in practical applications.

5. Conclusions

Relying on the rich information content of three channels of color images with a prism camera, an improved digital image correlation method to measure complex deformation is proposed in this paper. Considering the interference of the linear change of brightness of three channels before and after deformation in practical applications, a specific matching algorithm is given. It uses the information of three channels at the same location to reduce the reference subset. Therefore, using a second-order shape function with many parameters is avoided, and the matching accuracy and stability are improved. Through numerical simulation, the advantages of this method in measuring complex deformation are confirmed. Combined with binocular stereo vision, this method can also measure complex contour profiles by projecting color speckle patterns. In addition, it also provides a reference for measuring complex contour profiles by projecting multiple gray speckle images.

Author Contributions

Conceptualization, H.H.; methodology, H.H. and B.Q.; computer program, B.Q.; validation and investigation, Y.Z. and W.L.; writing, B.Q.; supervision, H.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (NO. 61905194), the Scientific Research Program Funded by Shaanxi Provincial Education Department (Program No.21JK0807), and fundamental Research Funds of the Central Universities (31020190QD034).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

IC-GN Matching Algorithm Based on Color Image

Based on the traditional IC-GN algorithm, the corresponding color speckle image matching algorithm can also be deduced. This algorithm is more suitable for applications where the light intensity of three channels does not change.
If the subset has no brightness change before and after deformation, then for each channel s of the color image, the gray model of the subset before and after deformation can be described as
f s x + ξ = g s x + W ξ ; p ˜
Establish the optimization objective expression (i.e., correlation function) of the reference subset and the target subset:
C Δ p = s = 1 3 ξ g s x + W ξ ; p f s x + W ( ξ ; Δ p ) 2
where, reference subset center  x = x 0 , y 0 , 1 T , subset internal position relative to center offset  ξ = Δ x , Δ y , 1 T , deformation parameter  p = u , u x , u y , v , v x , v y T , deformation correction parameter  Δ p = Δ u , Δ u x , Δ u y , Δ v , Δ v x , Δ v y T , deformation mapping  W ξ ; p = 1 + u x u y u v x 1 + v y v 0 0 1 Δ x Δ y 1 , mapping correction  W ξ ; Δ p = 1 + Δ u x Δ u y Δ u Δ v x 1 + Δ v y Δ v 0 0 1 Δ x Δ y 1 .
This is a nonlinear least square problem, using the Gauss-Newton method.
At  Δ p = 0 , carry out first-order McLaughlin expansion for  f s x + W ( ξ ; Δ p ) , and ignore higher-order terms:
f s ( x + W ( ξ ; Δ p ) ) f s x + ξ + f s W p Δ p
where,
f s = f s x + ξ x , f s x + ξ y
W ( ξ ; Δ p ) Δ p = W ( ξ ; p ) p = 1 Δ x Δ y 0 0 0 0 0 0 1 Δ x Δ y   ( Abbreviated   as W p )
To find the extreme value, Formula (A2) calculates the first derivative of  Δ p  and makes it zero:
C Δ p Δ p = 2 s = 1 3 ξ g s x + W ξ ; p f s x + W ( ξ ; Δ p ) f s W ( ξ ; Δ p ) Δ p = 0 1 × 6
Simplify Formula (A6):
s = 1 3 ξ f s W p T g s x + W ξ ; p f s x + W ( ξ ; Δ p ) = 0 6 × 1
Substitute into Formula (A3) to get:
s = 1 3 ξ f s W p T g s x + W ξ ; p f s x + ξ f s W p Δ p = 0 6 × 1
The abbreviation  J s 1 × 6 = f s W p , called Jacobin, is unchanged in iteration.
Expand Formula (A8) and sort it out:
s = 1 3 ξ J s T J s Δ p = s = 1 3 ξ J s T g s x + W ξ ; p f s x + ξ
An abbreviation  H s 6 × 6 = ξ J s T J s H s  is called the Hessian matrix, which is invariant in iteration.
Sorting out Formula (A9):
Δ p = s = 1 3 H s 1 s = 1 3 ξ J s T g s x + W ξ ; p f s x + ξ
The updated form of the shape function is:
W ξ ; p W ξ ; p W 1 ξ ; Δ p = 1 + u x u y u v x 1 + v y v 0 0 1 1 + Δ u x Δ u y Δ u Δ v x 1 + Δ v y Δ v 0 0 1 1
Iterative convergence condition:
Δ p k + 1 Δ p k 0.001

References

  1. Atkinson, D.; Becker, T.H. Stereo digital image correlation in MATLAB. Appl. Sci. 2021, 11, 4904. [Google Scholar] [CrossRef]
  2. Nguyen, H.; Liang, J.; Wang, Y.; Wang, Z. Accuracy assessment of fringe projection profilometry and digital image correlation techniques for three-dimensional shape measurements. J. Phys. Photonics 2021, 3, 014004. [Google Scholar] [CrossRef]
  3. Pan, B.; Asundi, A.; Xie, H.; Gao, J. Digital image correlation using iterative least squares and pointwise least squares for displacement field and strain field measurements. Opt. Lasers Eng. 2009, 47, 865–874. [Google Scholar] [CrossRef]
  4. Pan, B.; Li, K.; Tong, W. Fast, Robust and Accurate Digital Image Correlation Calculation without Redundant Computations. Exp. Mech. 2013, 53, 1277–1289. [Google Scholar] [CrossRef]
  5. Liu, G.; Li, M.; Zhang, W.; Gu, J. Subpixel Matching Using Double-Precision Gradient-Based Method for Digital Image Correlation. Sensors 2021, 21, 3140. [Google Scholar] [CrossRef]
  6. Zhang, M.; Ge, P.; Fu, Z.; Dan, X.; Li, G. Mechanical Property Test of Grass Carp Skin Material Based on the Digital Image Correlation Method. Sensors 2022, 22, 8364. [Google Scholar] [CrossRef]
  7. Bao, S.; Wang, Y.; Liu, L.; Lu, Y.; Yan, P. An error elimination method for high-temperature digital image correlation using color speckle and camera. Opt. Lasers Eng. 2019, 116, 47–54. [Google Scholar] [CrossRef]
  8. Huang, Y.; Huang, X.; Zhong, M.; Liu, Z. A bilayer color digital image correlation method for the measurement of the topography of a liquid interface. Opt. Lasers Eng. 2023, 160, 107242. [Google Scholar] [CrossRef]
  9. Papanikolaou, A.; Garbat, P.; Kujawinska, M. Metrological Evaluation of the Demosaicking Effect on Colour Digital Image Correlation with Application in Monitoring of Paintings. Sensors 2022, 22, 7359. [Google Scholar] [CrossRef]
  10. Curt, J.; Capaldo, M.; Hild, F.; Roux, S. Optimal digital color image correlation. Opt. Lasers Eng. 2020, 127, 105896. [Google Scholar] [CrossRef] [Green Version]
  11. Forsey, A.; Gungor, S. Demosaicing images from colour cameras for digital image correlation. Opt. Lasers Eng. 2016, 86, 20–28. [Google Scholar] [CrossRef] [Green Version]
  12. Dong, B.; Zeng, F.; Pan, B. A Simple and Practical Single-Camera Stereo-Digital Image Correlation Using a Color Camera and X-Cube Prism. Sensors 2019, 19, 4726. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Li, J.; Dan, X.; Xu, W.; Wang, Y.; Yang, G.; Yang, L. 3D digital image correlation using single color camera pseudo-stereo system. Opt. Laser Technol. 2017, 95, 1–7. [Google Scholar] [CrossRef]
  14. Wang, Y.; Dan, X.; Li, J.; Wu, S.; Yang, L. Multi-perspective digital image correlation method using a single color camera. Sci. China Technol. Sci. 2017, 61, 61–67. [Google Scholar] [CrossRef]
  15. Yu, L.; Pan, B. Full-frame, high-speed 3D shape and deformation measurements using stereo-digital image correlation and a single color high-speed camera. Opt. Lasers Eng. 2017, 95, 17–25. [Google Scholar] [CrossRef]
  16. Yu, L.; Pan, B. Color Stereo-Digital Image Correlation Method Using a Single 3CCD Color Camera. Exp. Mech. 2017, 57, 649–657. [Google Scholar] [CrossRef]
  17. Yu, L.; Pan, B. High-speed stereo-digital image correlation using a single color high-speed camera. Appl. Opt. 2018, 57, 9257–9269. [Google Scholar] [CrossRef]
  18. Zhong, F.; Shao, X.; Quan, C. 3D digital image correlation using a single 3CCD colour camera and dichroic filter. Meas. Sci. Technol. 2018, 29, 045401. [Google Scholar] [CrossRef]
  19. Felipe-Sese, L.; Molina-Viedma, A.J.; Lopez-Alba, E.; Diaz, F.A. RGB Colour Encoding Improvement for Three-Dimensional Shapes and Displacement Measurement Using the Integration of Fringe Projection and Digital Image Correlation. Sensors 2018, 18, 3130. [Google Scholar] [CrossRef] [Green Version]
  20. Yoneyama, S.; Morimoto, Y. Accurate displacement measurement by correlation of colored random patterns. JSME Int. J. Ser. A Solid Mech. Mater. Eng. 2003, 46, 178–184. [Google Scholar] [CrossRef] [Green Version]
  21. Dinh, N.V.; Hassan, G.M.; Dyskin, A.V.; MacNish, C. Digital Image Correlation for Small Strain Measurement in Deformable Solids and Geomechanical Structures. In Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QU, Canada, 27–30 September 2015; IEEE: New York, NY, USA, 2015; pp. 3324–3328. [Google Scholar]
  22. Hang, D.; Hassan, G.M.; MacNish, C.; Dyskin, A. Characteristics of Color Digital Image Correlation for Deformation Measurement in Geomechanical Structures. In Proceedings of the 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA), Gold Coast, QLD, Australia, 30 November–2 December 2016; IEEE: New York, NY, USA, 2016; pp. 1–8. [Google Scholar]
  23. Wang, L. Deformation Measurement of Scaling and Rotation Objects Based on Digital Image Correlation Method with Color Information. Photonics 2022, 9, 237. [Google Scholar] [CrossRef]
  24. Baldi, A. Digital Image Correlation and Color Cameras. Exp. Mech. 2017, 58, 315–333. [Google Scholar] [CrossRef]
  25. Zhou, P. Subpixel displacement and deformation gradient measurement using digital image/speckle correlation (DISC). Opt. Eng. 2001, 40, 1613. [Google Scholar] [CrossRef] [Green Version]
  26. Yuan, Y.; Huang, J.; Peng, X.; Xiong, C.; Fang, J.; Yuan, F. Accurate displacement measurement via a self-adaptive digital image correlation method based on a weighted ZNSSD criterion. Opt. Lasers Eng. 2014, 52, 75–85. [Google Scholar] [CrossRef]
  27. Hassan, G.M.; MacNish, C.; Dyskin, A.; Shufrin, I. Digital image correlation with dynamic subset selection. Opt. Lasers Eng. 2016, 84, 1–9. [Google Scholar] [CrossRef]
  28. Wang, B.; Pan, B. Random errors in digital image correlation due to matched or overmatched shape functions. Exp. Mech. 2015, 55, 1717–1727. [Google Scholar] [CrossRef]
  29. Feng, W.; Jin, Y.; Wei, Y.; Hou, W.; Zhu, C. Technique for two-dimensional displacement field determination using a reliability-guided spatial-gradient-based digital image correlation algorithm. Appl. Opt. 2018, 57, 2780–2789. [Google Scholar] [CrossRef]
Figure 1. Matching principle of color speckle image.
Figure 1. Matching principle of color speckle image.
Sensors 23 05531 g001
Figure 2. Integer-pixel search process.
Figure 2. Integer-pixel search process.
Sensors 23 05531 g002
Figure 3. Sub-pixel search calculation process.
Figure 3. Sub-pixel search calculation process.
Sensors 23 05531 g003
Figure 4. Pixel region of reference image corresponding to deformed image.
Figure 4. Pixel region of reference image corresponding to deformed image.
Sensors 23 05531 g004
Figure 5. Reference image generated by simulation.
Figure 5. Reference image generated by simulation.
Sensors 23 05531 g005
Figure 6. Deviation statistics by biaxial diagram.
Figure 6. Deviation statistics by biaxial diagram.
Sensors 23 05531 g006
Figure 7. Deformation display.
Figure 7. Deformation display.
Sensors 23 05531 g007aSensors 23 05531 g007b
Figure 8. Displacement deviation of nodes by two methods.
Figure 8. Displacement deviation of nodes by two methods.
Sensors 23 05531 g008
Figure 9. Experiment of cylinder radial compression.
Figure 9. Experiment of cylinder radial compression.
Sensors 23 05531 g009
Figure 10. Experimental scene.
Figure 10. Experimental scene.
Sensors 23 05531 g010
Figure 11. Measurement results of cylinder compression.
Figure 11. Measurement results of cylinder compression.
Sensors 23 05531 g011aSensors 23 05531 g011b
Table 1. Results of the two methods under different subset sizes.
Table 1. Results of the two methods under different subset sizes.
Group
Number
Subset
Size
U-Field Displacement Deviation Statistics (×10−3)V-Field Displacement Deviation Statistics
(×10−3)
Average Value
of Iterations
MAERMSEMAERMSETime (×10−4 s)Times
(1)(2 × 9 + 1)26.608.166.988.775.604.92
(2 × 5 + 1)2 × 38.9411.128.1710.499.255.66
(2)(2 × 11 + 1)26.428.376.578.646.514.78
(2 × 6 + 1)2 × 37.709.536.998.669.575.39
(3)(2 × 13 + 1)28.1010.967.5410.327.814.68
(2 × 7 + 1)2 × 36.708.326.147.6410.855.25
(4)(2 × 15 + 1)211.2815.2310.4014.069.364.68
(2 × 8 + 1)2 × 35.867.295.647.0913.835.12
(5)(2 × 16 + 1)213.1717.5912.0216.1410.214.70
(2 × 9 + 1)2 × 35.526.875.226.6915.175.02
(6)(2 × 18 + 1)217.5922.9015.6520.5911.584.64
(2 × 10 + 1)2 × 35.426.954.946.6017.064.98
(7)(2 × 20 + 1)222.8028.8420.1926.1813.904.62
(2 × 11 + 1)2 × 35.707.635.197.1818.574.94
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hu, H.; Qian, B.; Zhang, Y.; Li, W. Digital Image Correlation with a Prism Camera and Its Application in Complex Deformation Measurement. Sensors 2023, 23, 5531. https://doi.org/10.3390/s23125531

AMA Style

Hu H, Qian B, Zhang Y, Li W. Digital Image Correlation with a Prism Camera and Its Application in Complex Deformation Measurement. Sensors. 2023; 23(12):5531. https://doi.org/10.3390/s23125531

Chicago/Turabian Style

Hu, Hao, Boxing Qian, Yongqing Zhang, and Wenpan Li. 2023. "Digital Image Correlation with a Prism Camera and Its Application in Complex Deformation Measurement" Sensors 23, no. 12: 5531. https://doi.org/10.3390/s23125531

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop