Improved Direct Linear Transformation for Parameter Decoupling in Camera Calibration

Zhenqing Zhao 1, Dong Ye 1,*, Xin Zhang 1, Gang Chen 1 and Bin Zhang 2 1 School of Electrical Engineering and Automation, Harbin Institute of Technology, Heilongjiang 150001, China; zzq725@126.com (Z.Z.); zhx_1000@163.com (X.Z.); chenganghit@hit.edu.cn (G.C.) 2 Capital Aerospace Machinery Company, Beijing 100076, China; zb1984115@163.com * Correspondence: yedong@hit.edu.cn; Tel.: +86-186-4603-2603; Fax: +451-8641-7581


Introduction
With the technological developments of digital cameras and microprocessors, computer vision has been widely applied to robot navigation, surveillance, three-dimensional (3D) reconstruction and other fields for its high speed, high accuracy and non-contact nature.To obtain improved 3D information from a two-dimensional (2D) image, it is necessary to calibrate the intrinsic parameters of the camera, such as the focal distance and optical center point, as well its extrinsic parameters, such as rotation and translation, which relate the world coordinate system to the camera coordinate system.Over the last decade, numerous studies have focused on this area.In [1], the authors proposed an efficient approach for the dynamic calibration of multiple cameras.In [2], the authors proposed a calibration algorithm based on line images.In [3], the authors used one-dimensional (1D) information to calibrate the parameters.All of these algorithms make camera calibration faster and more convenient.
To obtain high accuracy parameter results, high accuracy 3D or 2D templates can be used.These algorithms include direct linear transformation (DLT) [4], the Tsai calibration method [5] and the Zhang calibration method [6].In space rendezvous and docking, as well as in visual tracking applications, it is necessary to obtain the specific extrinsic and intrinsic parameters of the camera.At the same time, with the wide application of the coordinate measuring machine (CMM) [7,8], high precision, large range 3D templates have become more readily applied.The DLT algorithm is more suitable for these applications.
The DLT algorithm is based on the perspective projection between 3D space points and 2D image points.It calculates a transformation matrix and obtains the camera's intrinsic and extrinsic parameters according to the parameter decomposition.With this model, only one 3D template in one position is required for calculation; therefore, the template size, number of feature points and relative distance between the template and camera are critical [9][10][11].
Camera calibration with image noise and distortion remains a difficult task.Algorithms typically solve the camera parameters by analysis; then, they solve the model of image noise and distortion by optimization [6,12,13].All traditional optimization algorithms applied to visual systems, such as the modified Newton algorithm, the Levenberg-Marquardt algorithm and the genetic algorithm, require a good initial solution to optimize.Therefore, the analytic solution is not only robust to image noise, but also effective for addressing distortion.
When the calibration data contain noise and distortion, coupling errors exist between the camera's extrinsic and intrinsic parameters.This means that an error in an extrinsic parameter may be compensated by an error in an intrinsic parameter [14][15][16].Existing parameter decoupling methods use calibration models without considering extrinsic parameters.These include vanishing points [15,17,18], straight lines [16,19], and cross ratios [20,21].In the present study, the image re-projection error from the mathematical model and the camera pinhole geometric model were analyzed.The results show that the coupling error causes a small re-projection error variance and a large calibration parameter error variance.At the same time, this variance is related to the template size, number of feature points and relative distance between the template and camera.To improve the calibration accuracy of the camera parameters, a decoupling algorithm of intrinsic and extrinsic parameters is proposed based on DLT.
The remainder of this paper is organized as follows.The relationship between the coupling error, template size and relative distance between the template and camera is described in Section 2. The proposed improved DLT (IDLT) algorithm for camera calibration is proposed in Section 3. The experimental results are presented in Section 4, and the conclusions are given in Section 5.

Camera Model
The camera model is shown in Figure 1.A 3D point is denoted by P i " 2D image point is denoted by p i " . The relationship between 3D point P i and its image projection, p i , is given by: u i " u 0 `ax where a x = f /d x , a y = f /d y and f is the camera focal distance.In addition, d x , d y are pixel sizes in the horizontal and vertical directions; (u 0 , v 0 ) is the optical center point of the image; and R, T are the rotation matrix and translation vector, respectively, which relate the world coordinate system to the camera coordinate system.Furthermore, r ij is the i-th row and j-th column element of R, and t x , t y , t z are the elements of T. For simplicity, the rotation matrix is represented by Euler angles, ψ, θ, φ, which represent the rotation around the respective x, y and z axes.Camera calibration with image noise and distortion remains a difficult task.Algorithms typically solve the camera parameters by analysis; then, they solve the model of image noise and distortion by optimization [6,12,13].All traditional optimization algorithms applied to visual systems, such as the modified Newton algorithm, the Levenberg-Marquardt algorithm and the genetic algorithm, require a good initial solution to optimize.Therefore, the analytic solution is not only robust to image noise, but also effective for addressing distortion.
When the calibration data contain noise and distortion, coupling errors exist between the camera's extrinsic and intrinsic parameters.This means that an error in an extrinsic parameter may be compensated by an error in an intrinsic parameter [14][15][16].Existing parameter decoupling methods use calibration models without considering extrinsic parameters.These include vanishing points [15,17,18], straight lines [16,19], and cross ratios [20,21].In the present study, the image reprojection error from the mathematical model and the camera pinhole geometric model were analyzed.The results show that the coupling error causes a small re-projection error variance and a large calibration parameter error variance.At the same time, this variance is related to the template size, number of feature points and relative distance between the template and camera.To improve the calibration accuracy of the camera parameters, a decoupling algorithm of intrinsic and extrinsic parameters is proposed based on DLT.
The remainder of this paper is organized as follows.The relationship between the coupling error, template size and relative distance between the template and camera is described in Section 2. The proposed improved DLT (IDLT) algorithm for camera calibration is proposed in Section 3. The experimental results are presented in Section 4, and the conclusions are given in Section 5.

Camera Model
The camera model is shown in Figure 1.A 3D point is denoted by [ ] . The relationship between 3D point i P and its image projection, i p , is given by: where ax = f/dx, ay = f/dy and f is the camera focal distance.In addition, dx, dy are pixel sizes in the horizontal and vertical directions; (u0, v0) is the optical center point of the image; and R, T are the rotation matrix and translation vector, respectively, which relate the world coordinate system to the camera coordinate system.Furthermore, rij is the i-th row and j-th column element of R, and tx, ty, tz are the elements of T. For simplicity, the rotation matrix is represented by Euler angles, ψ , θ , φ , which represent the rotation around the respective x, y and z axes.Owing to the influence of image noise and distortion, the calibration parameters, image points and space points do not completely conform to Equation (1).Thus, we have: Equation ( 2) describes the calculation of image re-projection errors.Small re-projection errors are desired, which means that the calibration results satisfy Equation (3).However, the question arises of if a small image re-projection error will lead to the high calibration accuracy of the camera parameters.Analysis of the relationship between the image re-projection error and the calibration accuracy is therefore required.

Error Coupling Analysis
The two equations in Equation ( 2) have the same form.We thus analyze the first equation; all conclusions can apply to the second equation.We assume that u 0 has error u 0 and that t x has error t x .From Equation (2), we have: when ∆t x " ´pr 31 X i `r32 Y i `r33 Z i `tz q{a x ∆u 0 , we have ∆u 1 i " ∆u i .The image re-projection error will not change.However, because the space point coordinate values are different, other image point re-projection errors will be changed.We assume that: ∆u 0 ´r31 dX i `r32 dY i `r33 dZ i a x ∆u 0 (5) where dX i = X 1 ´Xi , dY i = Y 1 ´Yi , dZ i = Z 1 ´Zi , and image re-projection errors are given by: Based on Equation ( 6), if dZ i is very small and t z is very large, the change in image re-projection errors will be very small.This is because coupling u 0 and t x reduces the image re-projection error.In order to reduce the coupling effect, better results can be obtained if the 3D template is large and close to the camera.In fact, the template size is limited, and the calibration distance is limited by the field of view and the lens parameter.
With respect to focal distance and translation vector, we assume a x has error a x and t z has error t z .From Equation (2), we have: where B i " r 31 X i `r32 Y i `r33 Z i and C i " r 11 X i `r12 Y i `r13 Z i .We assume that ∆a x {∆t z " a x {B 1 , and we obtain ∆u 1 1 " ∆u 1 .Other image re-projection errors are: From Equation (1), we have a x C i {B i « pu i ´u0 q.We assume that the Euler angles of the world coordinate system relative to the camera coordinate system are zero.By setting the first space point Z 1 " 1, we have: Based on Equation ( 9), if pu i ´u0 q is small and t z is large, the change in the image re-projection error will be very small.This is because coupling a x and t z reduces the image re-projection error.To reduce the coupling effect, better results can be obtained if the 3D template is closer to the camera.Similar to the distortion, the camera focal distance and translation vector coupling error are related to the image point location.Therefore, under the influence of distortion, the camera focal distance and translation vector coupling error may increase the calibration error.
The coupling error is present in the geometric model.The camera model is also called a pinhole model; that is, the space point, image point and camera origin are located on the same line.Figure 2 shows the coupling between the optical center point of the image and the translation vector.When the optical center point of image O c is offset, the origin of the camera coordinate system shifts.To continue fitting the pinhole model, the space point, P i , under the camera coordinate system will produce an offset.The space point under the world coordinate system is fixed so that the relationship between the world coordinate system and camera coordinate system changes.
Algorithms 2016, 9, 31 4 of 15 ( ) From Equation (1), we have ).We assume that the Euler angles of the world coordinate system relative to the camera coordinate system are zero.By setting the first space point 1 1 Z = , we have: Based on Equation ( 9), if is small and z t is large, the change in the image re-projection error will be very small.This is because coupling △ax and △tz reduces the image re-projection error.
To reduce the coupling effect, better results can be obtained if the 3D template is closer to the camera.Similar to the distortion, the camera focal distance and translation vector coupling error are related to the image point location.Therefore, under the influence of distortion, the camera focal distance and translation vector coupling error may increase the calibration error.
The coupling error is present in the geometric model.The camera model is also called a pinhole model; that is, the space point, image point and camera origin are located on the same line.Figure 2 shows the coupling between the optical center point of the image and the translation vector.When the optical center point of image Oc is offset, the origin of the camera coordinate system shifts.To continue fitting the pinhole model, the space point, Pi, under the camera coordinate system will produce an offset.The space point under the world coordinate system is fixed so that the relationship between the world coordinate system and camera coordinate system changes.Figure 3 shows the coupling between the camera focal distance and the translation vector.The camera focal distance is calibrated based on the relative distance between multiple space points.When the camera focal distance changes, that is the origin of the camera coordinate system, Oc, moves to O'c, the world coordinate system moves along the direction of the optical axis of the camera because the distance is fixed between P1 and P2.When the Euler angles are zero, the value of the optical axis direction is z t .Figure 3 shows the coupling between the camera focal distance and the translation vector.The camera focal distance is calibrated based on the relative distance between multiple space points.When the camera focal distance changes, that is the origin of the camera coordinate system, O c , moves to O' c , the world coordinate system moves along the direction of the optical axis of the camera because the distance is fixed between P 1 and P 2 .When the Euler angles are zero, the value of the optical axis direction is t z .
In summary, under the influence of image noise and distortion, when the size of the templates, number of feature points and relative distance between the template and camera are certain, coupling errors occur in the camera's intrinsic and extrinsic parameters that affect the calibration parameter accuracy.Therefore, to improve the accuracy of the calibration parameters, it is necessary to remove the parameter coupling errors.In summary, under the influence of image noise and distortion, when the size of the templates, number of feature points and relative distance between the template and camera are certain, coupling errors occur in the camera's intrinsic and extrinsic parameters that affect the calibration parameter accuracy.Therefore, to improve the accuracy of the calibration parameters, it is necessary to remove the parameter coupling errors.

Direct Linear Transformation
The DLT algorithm dates to the work of [4] or earlier.In [13,22], the authors analyzed the definition of the world coordinate system and proposed the use of data normalization to reduce the noise impact on the camera calibration parameters.In [10,23], the authors proposed combining the DLT algorithm with an optimization algorithm to address the camera distortion models.
The DLT algorithm consists of two steps: (1) homogeneous equation solving; and (2) parameter factorization.Space point P and its image p are related by homography M: where K is the camera intrinsic matrix.mij is the i-th row and j-th column element of M. The 12 parameters in M3×4 are unknown in the matrix M'12×1.From Equation (10), we have: where C is a constant, and: Because Equation ( 11) is a homogeneous equation, we assume that m34 is equal to one.The M matrix can be solved by singular value decomposition.We can then obtain the intrinsic and extrinsic parameters of the camera through factorization.

Direct Linear Transformation
The DLT algorithm dates to the work of [4] or earlier.In [13,22], the authors analyzed the definition of the world coordinate system and proposed the use of data normalization to reduce the noise impact on the camera calibration parameters.In [10,23], the authors proposed combining the DLT algorithm with an optimization algorithm to address the camera distortion models.
The DLT algorithm consists of two steps: (1) homogeneous equation solving; and (2) parameter factorization.Space point P and its image p are related by homography M: where K is the camera intrinsic matrix.m ij is the i-th row and j-th column element of M. The 12 parameters in M 3ˆ4 are unknown in the matrix M' 12ˆ1 .From Equation (10), we have: where C is a constant, and: A " Because Equation ( 11) is a homogeneous equation, we assume that m 34 is equal to one.The M matrix can be solved by singular value decomposition.We can then obtain the intrinsic and extrinsic parameters of the camera through factorization.
Accordingly, at least six non-coplanar feature points and their corresponding image points-the camera focal distance, optical center point, rotation matrix and translation vector-can be solved according to Equations ( 11)- (20).
However, with the influence of image noise and distortion, m ij contains errors.From Equations ( 18) and ( 19), we have: pt z `∆t z qpm 14 `∆m 14 ´u0 ´∆u 0 q a x `∆a x t y `∆t y " pt z `∆t z qpm 24 ´u0 `∆m 24 ´∆u 0 q a y `∆a y (21) where t x , t z , m 14 , t y and m 24 are errors.When t x « t z pm 14 ´u0 q a x `∆a x , t y « t z pm 24 ´ν0 q a y `∆a y , we have: t z p∆m 14 ´∆u 0 q a x `∆a x `∆t z pm 14 ´u0 q a x `∆a x `∆t z p∆m 14 ´∆u 0 q a x `∆a x ∆t y " t z p∆m 24 ´∆ν 0 q a y `∆a y `∆t z pm 24 ´ν0 q a y `∆a y `∆t z p∆m 24 ´∆ν 0 q a y `∆a y In Equation (22), the third molecule is much smaller than the others and can be ignored.When t z ą t x and ∆u 0 " ∆m 14 , we have: At the same time, when t z ą t y and ∆ν 0 " ∆m 24 , we have: With respect to the coupling error between the focal distance and translation vector, to simplify the analysis model, we assume that the Euler angles of the world coordinate system relative to the camera coordinate system are zero.Then, we have: From Equation (13), we have: From Equations ( 16) and ( 17), we have: Equations ( 23), ( 24) and (30) show that a linear relationship exists between the calibration parameters after ignoring some minor errors.We use a simulation to illustrate the size of some of the ignored minor errors.In the simulation, we have a x = 1454.5, a y = 1454.5,u 0 = 700 pixel and v 0 = 512 pixel; moreover, the size of the pattern is 0.7 m ˆ0.7 m ˆ0.3 m.The relationship of the world coordinate system relative to the camera coordinate system relationship is represented by R = [20,20,20] ( ˝) and T = [´0.25,´0.25, t z ] (mm).Gaussian noise with a zero mean and a 0.1-pixel standard deviation is added to the projected image points.The analysis of Equations ( 23) and ( 24) is shown in Figure 4.The difference between a x , a y and the results of Equations ( 23) and ( 24) is small.The analysis of Equation ( 30) is shown in Figure 5.Because the Euler angles are not equal to 0 ˝, t x , t y and the result of Equation (30) are different.However, the difference is small.
Equations ( 23), ( 24) and (30) show that a linear relationship exists between the calibration parameters after ignoring some minor errors.We use a simulation to illustrate the size of some of the ignored minor errors.In the simulation, we have ax = 1454.5,ay = 1454.5,u0 = 700 pixel and v0 = 512 pixel; moreover, the size of the pattern is 0.7 m × 0.7 m × 0.3 m.The relationship of the world coordinate system relative to the camera coordinate system relationship is represented by R = [20,20,20] (°) and T = [−0.25,−0.25, tz] (mm).Gaussian noise with a zero mean and a 0.1-pixel standard deviation is added to the projected image points.The analysis of Equations ( 23) and ( 24) is shown in Figure 4.The difference between △ax, △ay and the results of Equations ( 23) and ( 24) is small.The analysis of Equation ( 30) is shown in Figure 5.Because the Euler angles are not equal to 0°, △tx, △ty and the result of Equation (30) are different.However, the difference is small.Under the influence of image noise and lens distortion, the M matrix of the DLT algorithm contains errors.These errors further affect the accuracy of the calibration parameters.Through the above analysis, there is a linear coupling relationship between ∆t x and ∆u 0 , ∆t y and ∆ν 0 , ∆a x and ∆t z and ∆a y and ∆t z after ignoring some minor errors.Under the influence of image noise and lens distortion, the M matrix of the DLT algorithm contains errors.These errors further affect the accuracy of the calibration parameters.Through the above analysis, there is a linear coupling relationship between

Improved Direct Linear Transformation
Owing to the linear relationship that exists between the intrinsic and extrinsic parameter errors, all of these errors are unknown, and the specific error value cannot be directly solved.We assume that the 3D template only moves along the z axis. .From Equations ( 31) and (32), we have: From Equation (33), a linear relationship exists between x x t t n ′ ′′ − − .By repeatedly moving the 3D template, 0 u can be solved with a linear least-squares fit.Similarly, 0 v can be solved by Equation (34).

Improved Direct Linear Transformation
to the linear relationship that exists between the intrinsic and extrinsic parameter errors, all of these errors are unknown, and the specific error value cannot be directly solved.We assume that the 3D template only moves along the z axis.a 1 x , a 1 y , u 1 0 , ν 1 0 , t 1 x , t 1 y and t 1 z1 are calibration values of the DLT algorithm before the z axis translation.a 2 x , a 2 y , u 2 0 , ν 2 0 , t 2 x , t 2 y and t 1 z2 are calibration values of the DLT algorithm after the z axis translation.From Equations ( 23) and (24), we have: ∆t 1 y " t 1 y ´ty " ´tz1 pν 1 0 ´ν0 q{a y ∆t 2 y " t 2 y ´ty " ´tz2 pν 2 0 ´ν0 q{a y (32 where a x , a y , u 0 , ν 0 , t x , t y , t z1 and t z2 are true values.Because the translation occurs only along the z axis, we set t z2 " nt z1 .From Equations ( 31) and (32), we have: From Equation (33), a linear relationship exists between pnu 2 0 ´u1 0 q{pn ´1q and pt 1 x ´t2 x q{pn ´1q.By repeatedly moving the 3D template, u 0 can be solved with a linear least-squares fit.Similarly, ν 0 can be solved by Equation (34).
With respect to t z1 , from Equation (37), we have: A linear relationship exists between ∆a 1 x t 1 z 2 ´n∆a 2 x t 1 z 1 and n∆a 1 x ´n∆a 2 x .By repeatedly moving the template, t z1 can be solved with a linear least-squares fit.
For a y , we have: a 2 y ´a1 y dz 1 `a2 y q `ay " 0 (43) ∆a 1 y t 1 z2 ´n∆a 2 y t 1 z1 " t z1 pn∆a 1 y ´n∆a 2 y q (44) A linear relationship exists between t 1 z2 ´t1 z1 ´dz 1 {dz 1 and pa 2 y ´a1 y qt 1 z1 {dz 1 `a2 y and ∆a 1 y t 1 z2 ´n∆a 2 y t 1 z1 and n∆a 1 y ´n∆a 2 y .By repeatedly moving the template, a y , t z1 can be solved with a linear least-squares fit.
In sum, the 3D template along the z axis to the translation performs a DLT algorithm at each location.With the results of the DLT, u 0 , ν 0 , t x , t y , a x , a y and t z1 can again be solved with a linear least-squares fit by Equations ( 33)-( 36), ( 40) and ( 42)-(44).

Experimental Section
The simulation and physical experiment parameters were set as follows.The camera focal length was 12 mm.The image resolution was 1400 ˆ1024.The pixel size was 7.4 µm ˆ7.4 µm.

Simulation Experiment
The size of the 3D template was 0.7 m ˆ0.7 m ˆ0.3 m and contained a pattern of 8 ˆ8 ˆ3 points.The rotation matrix and translation vector were R = [10, 10, 10] ( ˝) and T = [´0.35,´0.35, t z ] (m), t z = 1.2-3.2m.Gaussian noise with a 0 mean and a 0.01-0.5-pixelstandard deviation was added to the projected image points.The 3D template moved 0.1 m at a time.The IDLT algorithm was calculated after 18 times of movement.A total of 100 independent tests was performed for each noise to obtain the parameter error mean and standard deviation.The error mean plus three times the standard deviation was used to represent the calibration error.
Because the calibration error became larger as t z increased, we only analyzed the results at t z " 1.2m.The results of the DLT and IDLT calibration are shown in Figure 6.For u 0 and v 0 , the errors of IDLT are less than 10% of the error of DLT.The errors in t x and t y are less than 0.1 mm.For a x , a y and t z , the errors of IDLT are less than 60% of the error of DLT.
projected image points.The 3D template moved 0.1 m at a time.The IDLT algorithm was calculated after 18 times of movement.A total of 100 independent tests was performed for each noise to obtain the parameter error mean and standard deviation.The error mean plus three times the standard deviation was used to represent the calibration error.
Because the calibration error became larger as tz increased, we only analyzed the results at 1.
The results of the DLT and IDLT calibration are shown in Figure 6.For 0 u and 0 v , the errors of IDLT are less than 10% of the error of DLT.The errors in x t and y t are less than 0.1 mm.
For x a , y a and z t , the errors of IDLT are less than 60% of the error of DLT.
(  Figure 7 shows the calibration result with noise and distortion.Gaussian noise with a 0 mean and a 0.1-pixel standard deviation is added to the projected image points.Image distortion comes from ideal image points ( , ) i i u v and real image points ( , ) Owing to the influence of image distortion, the calibration errors of DLT are relatively large.However, the calibration errors of IDLT are relatively small.In particular, the errors of 0 u and 0 v are less than 0.7 pixels, whereas the maximum error of DLT is 44 pixels.The errors of x a and y a are less than 3.Because the pixels are square, the errors of x a and y a have the same form.The error in z t is larger than that in x t , y t .The main reason is that z t is larger than x t , y t .Figure 7 shows the calibration result with noise and distortion.Gaussian noise with a 0 mean and a 0.1-pixel standard deviation is added to the projected image points.Image distortion comes from ideal image points pu i , ν i q and real image points pu 1 i , ν 1 i q with k = 2.915 ˆ10 ´9 ´2.915 ˆ10 ´8 (the image distortion is 1-10 pixels at (1400, 0) when u 0 " 700).
Owing to the influence of image distortion, the calibration errors of DLT are relatively large.However, the calibration errors of IDLT are relatively small.In particular, the errors of u 0 and v 0 are less than 0.7 pixels, whereas the maximum error of DLT is 44 pixels.The errors of a x and a y are less than 3.Because the pixels are square, the errors of a x and a y have the same form.The error in t z is larger than that in t x , t y .The main reason is that t z is larger than t x , t y .Figure 7 shows the calibration result with noise and distortion.Gaussian noise with a 0 mean and a 0.1-pixel standard deviation is added to the projected image points.Image distortion comes from ideal image points ( , ) Owing to the influence of image distortion, the calibration errors of DLT are relatively large.However, the calibration errors of IDLT are relatively small.In particular, the errors of 0 u and 0 v are less than 0.7 pixels, whereas the maximum error of DLT is 44 pixels.

Physical Experiment
We used a light-emitting diode (LED) as the space point fixed on a coordinate measurement machine, as shown in Figure 8.The size of the plane was 0.7 m × 0.7 m, which contained a pattern of 8 × 8 points.There were 20 planes; the data for three of these planes were used for one DLT calculation.The DLT results are shown in Table 1.The fluctuations in the Euler angle errors are less than 0.06°, and they are not very volatile.The most volatile values are ty and v0.The fluctuation in ty is less than 28.03 mm, and the fluctuation in v0 is less than 2.59 pixels.The results of the IDLT algorithm are shown in Table 2, where the calibration parameter values are different from those of DLT.

Physical Experiment
We used a light-emitting diode (LED) as the space point fixed on a coordinate measurement machine, as shown in Figure 8.The size of the plane was 0.7 m ˆ0.7 m, which contained a pattern of 8 ˆ8 points.There were 20 planes; the data for three of these planes were used for one DLT calculation.The DLT results are shown in Table 1.The fluctuations in the Euler angle errors are less than 0.06 ˝, and they are not very volatile.The most volatile values are t y and v 0 .The fluctuation in t y is less than 28.03 mm, and the fluctuation in v 0 is less than 2.59 pixels.The results of the IDLT algorithm are shown in Table 2, where the calibration parameter values are different from those of DLT.To compare the calibration accuracy of the two algorithms, the results of IDLT and the first set of DLT data were used to calculate the re-projection errors of 20 planes.Each plane image error was described by the mean plus three times the standard deviation of the image point re-projection errors.The results are shown in Figure 9.The calculation errors of DLT increase with the number of planes.This shows that the DLT calibration results are optimal for some planes, but not for all planes.The calibration errors of IDLT decrease with the number of planes.The reason is because the distance between the image point and optical center point of the image is small, and the effect of distortion is small.To compare the calibration accuracy of the two algorithms, the results of IDLT and the first set of DLT data were used to calculate the re-projection errors of 20 planes.Each plane image error was described by the mean plus three times the standard deviation of the image point re-projection errors.The results are shown in Figure 9.The calculation errors of DLT increase with the number of planes.This shows that the DLT calibration results are optimal for some planes, but not for all planes.The calibration errors of IDLT decrease with the number of planes.The reason is because the distance between the image point and optical center point of the image is small, and the effect of distortion is small.

Conclusions
Based on a camera model, the DLT algorithm uses linear equations to calculate the intrinsic and extrinsic camera parameters.Because the camera's intrinsic and extrinsic parameters are simultaneously calibrated, the coupling error of the calibration parameter affects the calibration accuracy.In this paper, we analyzed the principles of intrinsic and extrinsic parameter error coupling, determined a linear coupling relationship between the intrinsic parameter calibration error and the translation vector (extrinsic parameters) calibration error and proposed the IDLT algorithm.The IDLT algorithm uses the linear coupling relationship to calculate the calibration parameters of the camera.The results of simulations and experiments show that there are significantly fewer calibration parameter errors using the IDLT algorithm than there are using DLT with noise and distortion.

Conclusions
Based on a camera model, the DLT algorithm uses linear equations to calculate the intrinsic and extrinsic camera parameters.Because the camera's intrinsic and extrinsic parameters are simultaneously calibrated, the coupling error of the calibration parameter affects the calibration accuracy.In this paper, we analyzed the principles of intrinsic and extrinsic parameter error coupling, determined a linear coupling relationship between the intrinsic parameter calibration error and the translation vector (extrinsic parameters) calibration error and proposed the IDLT algorithm.The IDLT algorithm uses the linear coupling relationship to calculate the calibration parameters of the camera.The results of simulations and experiments show that there are significantly fewer calibration parameter errors using the IDLT algorithm than there are using DLT with noise and distortion.

Figure 2 .
Figure 2. Relationship between the principal point and translation.

Figure 2 .
Figure 2. Relationship between the principal point and translation.

Figure 3 .
Figure 3. Relationship between the focal distance and translation.

Figure 3 .
Figure 3. Relationship between the focal distance and translation.

Figure 4 .
Figure 4. Error approximate analysis: (a) x t error analysis; (b) y t error analysis.

Figure 4 .
Figure 4. Error approximate analysis: (a) t x error analysis; (b) t y error analysis.

Figure 5 .
Figure 5. Error approximate analysis: (a) x a error comparison; (b) y a error comparison.
ignoring some minor errors.

Figure 5 .
Figure 5. Error approximate analysis: (a) a x error comparison; (b) a y error comparison.

Figure 6 .
Figure 6.Calibration error analysis between direct linear translation (DLT) and improved DLT (IDLT) with noise: (a) error of u 0 ; (b) error of v 0 ; (c) error of t x ; (d) error of t y ; (e) error of a x ; (f) error of t z based on a x ; (g) error of a y ; (h) error of t z based on a y .

Figure 7 .
Figure 7. Calibration error analysis between DLT and IDLT with noise and distortion: (a) error of 0 u ; (b) error of 0 v ; (c) error of x t ; (d) error of y t ; (e) error of x a ; (f) error of z t based on x a ;

Figure 7 .
Figure 7. Calibration error analysis between DLT and IDLT with noise and distortion: (a) error of u 0 ; (b) error of v 0 ; (c) error of t x ; (d) error of t y ; (e) error of a x ; (f) error of t z based on a x ; (g) error of a y ; (h) error of t z based on a y .

Figure 8 .
Figure 8. Photograph of the physical experiment.

Figure 8 .
Figure 8. Photograph of the physical experiment.

Figure 9 .
Figure 9. Re-projection errors of 20 planes with DLT and IDLT calibration results: (a) u of projection image errors; (b) v of projection image errors.

Figure 9 .
Figure 9. Re-projection errors of 20 planes with DLT and IDLT calibration results: (a) u of projection image errors; (b) v of projection image errors.
0 " t 2 z pm 21 m 31 `m22 m 32 `m23 m 33 q (15) a x " t 2 z b pm 12 m 33 ´m13 m 32 q 2 `pm 11 m 33 ´m13 m 31 q 2 `pm 11 m 32 ´m12 m 31 q 2 33 ´m23 m 32 q 2 `pm 21 m 33 ´m23 m 31 q 2 `pm 21 m 32 ´m22 m 31 q 2 r 11 " t z pm 11 ´u0 m 31 q{a x r 12 " t z pm 12 ´u0 m 32 q{a x r 13 " t z pm 13 ´u0 m 33 q{a x r 21 " t z pm 21 ´ν0 m 31 q{a x r 22 " t z pm 22 ´ν0 m 32 q{a x r 23 " t z pm 23 ´ν0 m 33 q{a x r 31 " t z m 31 r 32 " t z m 32 r 33 " t z m 33 2 `m33 2 (13) u 0 " t 2 z pm 11 m 31 `m12 m 32 `m13 m 33 q (14) ν t 2 z m 11 m 33 " m 11 t z a y " t 2 z m 22 m 33 " m 22 t z Owing to the influence of image noise and distortion, M contains errors.From Equation (27), we thus have: a x `∆a x " m 11 t z `m11 ∆t z `∆m 11 t z `∆m 11 ∆t z a y `∆a y " m 22 t z `m22 ∆t z `∆m 22 t z `∆m 22 ∆t z (28) where a x , t z , m 11 , a y and m 22 are errors.∆m 11 ∆t z and ∆m 22 ∆t z are much smaller than the others and can be ignored.Then, we have: ∆a x " m 11 ∆t z `∆m 11 t z ∆a y " m 22 ∆t z `∆m 22 t z (29) On account of ∆t z " ∆m 11 and ∆t z " ∆m 22 , we have: ∆a x " m 11 ∆t z ∆a y " m 22 ∆t z Owing to the influence of image noise and distortion, M contains errors.From Equation (27), we thus have:

Table 1 .
DLT results of the physical experiment.

Table 2 .
IDLT results of the physical experiment.

Table 1 .
DLT results of the physical experiment.

Table 2 .
IDLT results of the physical experiment.