Next Article in Journal
A 1.15 μW 200 kS/s 10-b Monotonic SAR ADC Using Dual On-Chip Calibrations and Accuracy Enhancement Techniques
Previous Article in Journal
A Transmission-Based Dielectric Property Probe for Clinical Applications
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Normal Sensor Calibration Method Based on an Extended Kalman Filter for Robotic Drilling

1
School of Mechanical Engineering and Automation, Beihang University, Beijing 100191, China
2
Shanghai Aircraft Manufacturing Co., Ltd., Shanghai 200436, China
*
Author to whom correspondence should be addressed.
Sensors 2018, 18(10), 3485; https://doi.org/10.3390/s18103485
Submission received: 23 August 2018 / Revised: 12 October 2018 / Accepted: 14 October 2018 / Published: 16 October 2018
(This article belongs to the Section Physical Sensors)

Abstract

:
To enhance the perpendicularity accuracy in the robotic drilling system, a normal sensor calibration method is proposed to identify the errors of the zero point and laser beam direction of laser displacement sensors simultaneously. The procedure of normal adjustment of the robotic drilling system is introduced firstly. Next the measurement model of the zero point and laser beam direction on a datum plane is constructed based on the principle of the distance measurement for laser displacement sensors. An extended Kalman filter algorithm is used to identify the sensor errors. Then the surface normal measurement and attitude adjustments are presented to ensure that the axis of the drill bit coincides with the normal at drilling point. Finally, simulations are conducted to study the performance of the proposed calibration method and experiments are carried out on a robotic drilling system. The simulation and experimental results show that the perpendicularity of the hole is within 0.2°. They also demonstrate that the proposed calibration method has high accuracy of parameter identification and lays a basis for high-precision perpendicularity accuracy of drilling in the robotic drilling system.

1. Introduction

In aircraft assembly, mechanical connections are the main type of connection between the components of the aircraft. The connection quality at the drilling hole has significant influence on the quality and lifespan of the aircraft [1,2,3]. With the traditional manual drilling method it has been difficult to meet the high-precision, high-efficiency and low-cost requirements of aircraft [4]. With the continuous development of robotics technology, robotic drilling systems will be the development trend in aircraft assembly [5]. The perpendicularity of the hole is an important factor affecting the quality of the hole, which is mainly determined by the angle between the normal at the drilling point and the axis of the drill bit. If the angle between the axis of the drill bit and the normal at drilling point is larger, the diameter of the hole becomes larger, the cutting force in the drilling process increases, the cutting heat increases, the burr height increases, and the life of the tool decreases [6]. In addition, it will affect the connection quality and fatigue strength of aircraft components [7]. For new fighter aircraft, this has an important effect on the performance at supersonic speeds and stealth. Therefore, it is of great significance to study the normal adjustment technique to improve the perpendicularity accuracy of the hole. The normal adjustment technique mainly includes two aspects: surface normal measurement and attitude adjustment [8]. At present, laser displacement sensors are widely used in the surface normal measurement of robotic drilling systems [9]. Laser displacement sensors are commonly used non-contact measurement sensors, which have many advantages such as high-precision, low power consumption, high reliability and security [10]. Typically, three or four laser displacement sensors are installed on the pressure foot for surface normal measurement [11,12]. Due to the machining error of the pressure foot and the assembly errors, there are always small errors between the nominal and actual zero points and laser beam directions of laser displacement sensors. These errors will lead to a decrease in the surface normal measurement accuracy. Therefore, it is crucial to study the parameter identification of laser ranging sensors to improve the surface normal measurement accuracy.
Yuan et al. proposed a surface normal measurement method with four laser displacement sensors [13,14]. Wang et al. developed a multifunctional automatic drilling end-effector with four laser displacement sensors to measure the surface normal at the drilling point [15]. However, the assembly errors of sensors aren’t considered in these two methods. Lu et al. proposed a method to calibrate the laser beam direction by using a coordinate measuring machine platform and a calibration block, with an adjustable plane. Bi et al. developed some calibration methods based on a coordinate measuring machine platform, in which a parameter substitution method [16] and non-linear least squares algorithm [17] are used to determine the zero point and laser beam direction. Both of the methods mentioned above can meet the accuracy requirement, and both of these methods require high-precision step motion with the same spacing on the coordinate measuring machine platform. However, industrial robots cannot achieve the high-precision requirement of step motion with the same spacing, and the solution process is too complicated. The rotation and translation matrices between the industrial robot and laser can be calculated by using a standard sphere [18]. Yuan et al. used the plane and sphere fitting methods to compute the zero point and laser beam direction on an industrial robot platform [19]. The two methods rely on the theoretical kinematics model of industrial robots, and the actual kinematic models are used in the experiment. However, since machining errors, assembly errors and load, the theoretical and actual kinematic models of industrial robots are different. Cao et al. proposed a calibration method based on math model and the least square method to obtain the zero point and laser beam direction [20]. However, in the calibration step of the method, the axis of drill bit should be adjusted so that it is perpendicular to the datum plane. This step requires a lot of time and the calibration procedure is complex and inefficient.
This paper proposes a normal sensor calibration method based on and Extended Kalman Filter (EKF) to identify the errors of zero points and laser beam direction for robotic drilling. Firstly, the procedure of normal adjustment of the robotic drilling system is introduced. Next, the measurement model of the zero point and laser beam direction on datum plane is constructed based on the principle of the distance measurement for laser displacement sensors. The EKF is used to identify the errors of zero points and laser beam direction of laser displacement sensors. Then the normal adjustment to achieve high-precision normal measurement and attitude adjustment is presented. Finally, simulations and experiments are conducted to demonstrate the correctness and validity of the proposed calibration method. The simulation and experimental results show that the proposed calibration can improve the perpendicularity accuracy of drilling and meet the accuracy requirement of aircraft assembly.
The rest of the paper is organized as follows: Section 2 develops the procedure of normal adjustment for the robotic drilling system. Section 3 derives the measurement model and applies the EKF algorithm to obtain the zero point and laser beam direction errors. Section 4 presents the normal measurement and attitude adjustment. Section 5 proposes the simulation study to verify the proposed method. Section 6 implements a calibration experiment on a robotic drilling system. The conclusions are proposed in the final section.

2. The Procedure of Normal Adjustment

As shown in Figure 1, the robotic drilling system consists of an industrial robot, drilling end-effector, rail, fixture and aircraft panel. The drilling end-effector is attached to the flange of the industrial robot with six joints. The industrial robot can move along the rail for rectilinear motion. The aircraft panel is attached to a fixture to maintain stiffness during the drilling process. The robotic drilling system has various functions such as positional error compensation of robot, visual compensation, surface normal measurement, attitude adjustment, pressure foot clamping, drilling, scraping, micro-lubrication, etc. The robotic drilling system can meet the high-precision and high-efficiency requirements of automatic drilling.
The normal adjustment is one of the crucial key technologies of the robotic drilling system and it has an important influence on the perpendicularity accuracy of holes. The normal adjustment mainly consists of surface normal measurement and attitude adjustment. The flow of surface normal adjustment for the robotic drilling system is depicted in Figure 2. The robot moves the drill bit to the drilling point according to the numerical control (NC) instructions. The distances between the sensor zero points and projection points can be measured by the laser displacement sensors and the coordinates of the projection points can be calculated. The normal at the drilling point can be computed by using surface normal measurement algorithm. If the angular deviation between the surface normal at drilling point and the axis of the drill bit does not meet the accuracy requirement, the robot will be adjusted to the desired attitude until the accuracy requirement is satisfied. After that, the robot starts to drill and countersink.

3. Normal Sensors Calibration

3.1. Measurement Model

Laser displacement sensors are commonly used to measure the surface normal for the robotic drilling system in industrial application. The points of a small area on workpiece surface are measured by three or more laser displacement sensors, and then the small area is approximately regarded as a micro-plane or micro-sphere and is fitted by using the fitting algorithm [13,15]. Finally, the surface normal at drilling point can be computed according to the fitted small area.
As shown in Figure 3, Li (i = 1, 2, 3, 4) are respectively four laser displacement sensors. Four laser displacement sensors are uniformly installed on the pressure foot. The projection points of the laser beams emitted by sensors on the workpiece surface are within a small area to ensure the fitting accuracy of the small area.
The normal sensor calibration process will acquire the zero point and laser beam direction parameters of laser displacement sensors which describe the measurement process. After calibration, the surface normal measurement accuracy can be improved. The contribution of this section is constructing the measurement model and formulating the sensor parameter identification.
As shown in Figure 4, Li (i = 1, 2, 3, 4) are respectively four laser displacement sensors in the tool coordinate system (TCS) which is established by using laser tracker generally. Ei (i = 1, 2, 3, 4) represent the zero points of four laser displacement sensors. The four projection points of the laser beams emitted by the laser displacement sensors on the datum plane are Si (i = 1, 2, 3, 4). di (i = 1, 2, 3, 4) are the distances between the zero points and the corresponding projection points. Denoting the nominal zero point and laser beam directions of four laser displacement sensors in TCS as Ф i nom = [xi, yi, zi, mi, ni, qi]T, i = 1, 2, 3, 4.
Assuming that the equation of the datum plane in TCS is:
A x + B y + C z + D = 0
where A, B, C, D are the parameters of datum plane. The equation of the datum plane can be calculated by fitting point cloud data measured by laser trackers [21].
The lines coinciding with the laser beams in TCS can be expressed as:
x x i m i = y y i n i = z z i q i
Accordingly, the intersection points Si (i = 1, 2, 3, 4) of the lines and the datum plane can be obtained by solving Equations (1) and (2). Let [xsi, ysi, zsi] be the coordinate values of intersection points Si. Then the di between the zero points Ei and the intersection points Si can be expressed as:
d i = ( x i x s i ) 2 + ( y i y s i ) 2 + ( z i z s i ) 2
Equation (3) can also be written as follows:
d i = f ( x i , y i , z i , m i , n i , q i )
Equation (4) shows that the theoretical measurement distances di of the laser displacement sensors in TCS is related to the values of their zero points and laser beam directions. Due to the machining error of the pressure foot and the assembly error, there are small errors between the nominal and actual zero points and laser beam directions of laser displacement sensors. Denoting the errors of zero points and laser beam directions as Δxi, Δyi, Δzi, Δmi, Δni, Δqi. Hence, the actual measurement distances of the laser displacement sensors are:
d i = f ( x i + Δ x i , y i + Δ y i , z i + Δ z i , m i + Δ m i , n i + Δ n i , q i + Δ q i )
The measurement distance errors Δdi can be expressed as:
Δ d i = d i d i
The total differential equation of Equation (6) can be written in the following form:
Δ d i = f x i Δ x i + f y i Δ y i + f z i Δ z i + f m i Δ m i + f n i Δ n i + f q i Δ q i
or simply:
Δ d i = J Δ Φ i
where:
J = [ f x i , f y i , f z i , f m i , f n i , f q i ] , Δ Φ i = [ Δ x i , Δ y i , Δ z i , Δ m i , Δ n i , Δ q i ] T
In Equation (8), six sensor parameter errors ΔФi for each laser displacement sensor Li should be identified.

3.2. Parameter Identification with EKF Algorithm

EKF is an important optimization algorithm to estimate the optimal state [22]. The EKF has the advantage of reliability and fast convergence. It has been applied in many fields, such as simultaneous localization and mapping [23], tracking [24], parameter identification [25,26]. A parameter identification method based on EKF is applied to estimate the kinematic parameter errors of robot [27]. Nguyen et al. presented a calibration method using EKF to estimate the geometric parameters of industrial robot [25,26].
Denoting the vector of sensor parameter errors X = ΔФi as the vector of state variables. Since the sensor parameter errors ΔФi are all constant, the system equation of an EKF for sensor parameter identification can be formatted as:
X k = X k 1 + w k 1
where Xk is a 6-by-1 vector representing the sensor parameter errors at time step tk. wk−1 is a 6-by-1 vector denoting the process noise which is Gaussian white noise with zero mean. Qk is a 6-by-6 covariance matrix of the vector wk−1.
To identify the sensor parameters vector X, EKF algorithm needs measurement from the TCS and datum plane. A laser tracker is used to construct TCS firstly. The point cloud data on the datum plane measured by using laser tracker in TCS are fitted to achieve the equation of the datum plane. The equation of lines coinciding with the laser beams can be computed according to the nominal zero point and laser beam direction. Then the intersection point values can be obtained. The distances between the intersection points and the zero points are the nominal measurement distances d i nom of laser displacement sensors, which are recorded. The laser displacement sensors readings are also recorded simultaneously, which are defined as d i meas . Then the measurement distance errors at time step tk can be calculated by Δdi,k = d i , k meas d i , k nom = JkΔФi (from Equation (8)). The measurement equation of EKF can be expressed as:
Z k = H k X k + v k
where Zk = Δdk is a 1-by-1 vector standing for the measurement distance error at time step tk. H k = J | d ^ i , k | k 1 denotes a 1-by-6 matrix which is calculated according to the Equation (9). vk is a 1-by-1 vector denoting the measurement noise which is Gaussian white noise with zero mean. Rk is a 1-by-1 covariance matrix of the vector vk.
The EKF algorithm consists of two steps: prediction and update. In the prediction step for EKF, predicted state can be expressed as:
X ^ k | k 1 = X ^ k 1 | k 1
Predicted covariance is computed by:
P k | k 1 = P k 1 | k 1 + Q k 1
In the update step for EKF, the optimal Kalman gain is:
K k = P k | k 1 H k T ( H k P k | k 1 H k T + R k ) 1
Updated estimate covariance can be calculated by:
P k | k = ( I K k H k ) P k | k 1
The estimated state is:
X ^ k | k = X ^ k | k 1 + K k ( Z k H k X ^ k | k 1 )
The initial value of the sensor parameter errors is X ^ 0 = 0 . The matrix Q is initialized with 10−10 × I and R is 10−4 × I. The initial value of matrix P0 is I. When EKF algorithm meets the stopping condition X ^ k | k X ^ k 1 | k 1 < δ , the parameter identification process is stopped. δ is 10−4 in this paper.
The solution of EKF algorithm is the sensor parameter errors ΔФi. The modified sensor parameters Ф i mod = [ x i mod , y i mod , z i mod , m i mod , n i mod , q i mod ]T can be calculated by Ф i mod = Ф i nom + ΔФi, where Ф i nom is the nominal sensor parameters.

4. Normal Adjustment

4.1. Surface Normal Measurement

The modified sensor parameters in TCS are computed in Section 3.2. As shown in Figure 5, the distance di between the sensors zero points Ei (i = 1, 2, 3, 4) and the projection points Si (i = 1, 2, 3, 4) on the workpiece surface can be measured by the laser displacement sensors. Then the coordinate value of projection points on the workpiece in TCS can be calculated by:
[ x s i y s i z s i ] = [ x i mod y i mod z i mod ] + d i [ m i mod n i mod q i mod ]
The micro-plane method is one of most used surface normal measurement methods [28]. In this method, the micro workpiece surface near the drilling point is considered to be a micro-plane and the surface normal n at drilling point P can be approximately equal to the normal ni at projection points Si. Hence the normal ni at projection points Si can be expressed as:
{ n 1 = S 1 S 2 × S 1 S 4 S 1 S 2 × S 1 S 4 n 2 = S 1 S 2 × S 2 S 3 S 1 S 2 × S 2 S 3 n 3 = S 2 S 3 × S 3 S 4 S 2 S 3 × S 3 S 4 n 4 = S 1 S 4 × S 3 S 4 S 1 S 4 × S 3 S 4
Then, the surface normal at drilling point P can be expressed as the weighted average of the normal ni at projection points Si, as shown in Equation (19):
n = 1 4 i = 1 4 n i

4.2. Attitude Adjustment

To ensure the perpendicularity accuracy of holes, the axis of the drill bit should be adjusted to coincide with the surface normal at the drilling point, as shown in Figure 6. The feed direction of drill bit is the positive z-axis of the TCS. Denoting the unit vector of drill bit in TCS before adjustment as ez = [0, 0, 1]T. After attitude adjustment, the positive z-axis of the TCS coincides with the surface normal n = [nx, ny, nz]T at drilling point. The attitude adjustment process of the drill bit is essentially the coordinate transformation of the TCS, i.e., the transformation from O X T Y T Z T to O X T Y T Z T shown in Figure 6. Firstly, the drill bit rotates φ degree around the Z-axis of TCS, and then rotates θ degree around the Y-axis of TCS. Finally, the drill bit rotates ϕ degree around the X-axis of TCS. The coordinate transformation can be expressed as:
n = R o t ( Z , φ ) R o t ( Y , θ ) R o t ( X , ϕ ) e z
where:
R o t ( Z , φ ) = [ cos φ sin φ 0 sin φ cos φ 0 0 0 1 ] ,   R o t ( Y , θ ) = [ cos θ 0 sin θ 0 1 0 sin θ 0 cos θ ] ,   R o t ( X , ϕ ) = [ 1 0 0 0 cos ϕ sin ϕ 0 sin ϕ cos ϕ ]
The angular of coordinate transformation can be computed by the geometric relationships in Figure 6. The computed results are:
{ φ = 0 θ = tan 1 ( n x / n z ) ϕ = sin 1 ( n y )
where, θ , ϕ ( π 2 , π 2 ) .
Because of the measurement errors of laser displacement sensors and motion errors of drill bit, a one-time attitude adjustment may not meet the accuracy requirement, hence, the drill bit is adjusted until the angular deviation meets the requirement.

5. Simulation and Results

To verify the correctness and validity of the proposed calibration method, a simulation is designed for normal sensor calibration. The simulation process is depicted as follows:
  • A datum plane is chosen, and its parameters are shown in Table 1. Twenty random points on the datum plane are selected, then the 20 points are added random measurement errors with a normal distribution N (0, ξ), where the standard deviation ξ is 0.02 mm. The equation of fitted planed can be computed by using the method in [21].
  • An appropriate TCS is constructed. The assumptive nominal sensor parameters and corresponding parameter errors in TCS are shown in Table 2.
  • According to the nominal sensor parameter, the theoretical measurement model is established using the method in Section 3.1. Hence the theoretical measurement distance di can be obtained.
  • The sensor parameter errors are added to the nominal sensor parameters. The actual measurement model can be also established by using method in Section 3.1. The actual measurement distance d i is computed and then it is added with a normal distribution N (0, ζ), where the standard deviation ζ is 0.01 mm.
  • The measurement distance errors Δdi can be calculated by Equation (6).
  • Then posture of TCS is changed, and the operation in Step 2–5 is repeated again 99 times.
  • The sensor parameter errors can be identified by using EKF algorithm in Section 3.2. The matrix Q is 10−10 × I and R is 8 × 10−5 × I. The estimated sensor parameter errors are shown in Figure 7. The modified sensor parameters can be calculated.
  • A plane is chosen as the workpiece surface and the normal of the plane is recorded. An appropriate TCS is constructed. Repeat the operation in Step 4 to obtain the actual measurement distance d i .
  • The normal at drilling robot before and after calibration can be computed based on the nominal and modified sensor parameters by using the method in Section 4.1, respectively. Therefore, the angular deviation of surface normal measurement before and after calibration can be obtained.
  • Change the posture of the plane. Repeat the operation of Steps 8~9 again 19 times.
Table 1 presents that the fitted plane mostly coincides with the theoretical plane. Hence, the high fitting precision method provides a guarantee for the calibration accuracy of laser displacement sensors. As shown in Table 3, the numbers of convergence measurement points for each laser displacement sensor are almost same. The calibration results by using proposed method are compared with that by using the method from [19] which is referred to as method 1. In method 1, the position and orientation of laser displacement sensors were identified by using nonlinear least squares method based on the model of plane fitting. The simulation results are shown in Figure 8. Table 4 summarizes the statistics of the simulation results. After calibration, the average angular deviation of normal is improved significantly to 0.0412° from 1.3387°, and the maximum angular deviation of normal is also reduced to 0.0511° from 1.6801°.
The angular deviations of normal after calibration are obviously less than the required accuracy of 0.5° [9,29]. The simulation result shows that the proposed calibration method has higher accuracy than method 1 and can enhance the surface normal measurement accuracy and meet the requirement of robotic drilling. It also demonstrates the correctness and validity of the proposed calibration method.

6. Experiments and Results

To study the performance of the proposed calibration method, experiments are conducted on a robotic drilling system, as shown in Figure 9. The experimental setup for calibration consists of a KUKA KR210 industrial robot, drilling end-effector, Leica laser tracker AT-901, fixture, datum plane, laser tracker displacement sensors, etc. The absolute distance measurement accuracy of the laser tracker is 7.5 μm + 3 μm/m. The datum plane is installed on a fixture with high stiffness. The hard structure of data collect system of used laser displacement sensors is illustrated in Figure 10. The measured distances of laser displacement sensors are collected and converted to digital signals by using a Siemens 315T-2DP controller. The Siemens 315T-2DP controller can realize sensor data acquisition, motion control, data processing and other functions in robotic drilling.
As shown in Figure 9, the datum plane can be calculated by fitting the point cloud data measured by laser trackers. The parameters of the fitted datum plane in the laser tracker frame are shown in Table 5. The TCS is constructed in the laser tracker frame. The industrial robot moves the drilling end-effector to a suitable position so that the laser displacement sensors can measure the datum plane and the measurement distances are within the sensor range. The measured distances of sensors are recorded and the TCS in laser tracker frame is measured. The above action is repeated 99 times and then 100 sets of data are obtained. According to the collected data, the sensor parameter errors can be identified by using EKF algorithm. The matrix Q is 10−12 × I and R is 9 × 10−6 × I. Table 6 and Figure 11 show the estimated sensor parameter errors. The modified sensor parameters can be computed.
As shown in Table 7, the numbers of convergence measurement points for each laser displacement sensor are almost same in the experiment. Normal measurement and attitude adjustment are performed using nominal sensor parameters and modified sensor parameters, respectively. The angles between the normal of the datum plane and the feed direction of spindle can be measured by the laser tracker. The angular deviation after experimental calibration by the methods is shown in Figure 12. Table 8 summarizes the statistics of the angular deviation after experimental calibration by the methods.
The average and maximum angular deviation after calibration are all less than that before calibration. The average angular deviation is 0.1048° with a maximum value of 0.1780°. Table 6 shows that the angular deviations are all less than the required accuracy of 0.5° and the proposed calibration method has higher accuracy than method 1. The calibration and experimental results show that the proposed calibration method can improve the perpendicularity accuracy of drilling and meet the accuracy requirement of aircraft assembly. The experimental results also demonstrate correctness and validity of the proposed calibration method.

7. Conclusions

This paper presented a normal sensor calibration method to improve the perpendicularity accuracy in a robotic drilling system. The measurement model based on the principle of the distance measurement is constructed and the sensor parameter errors are identified by using the EKF algorithm. The simulation results demonstrate the correctness and validity of the proposed calibration method. The calibration experiment is performed on the robotic drilling system. With the proposed calibration method, the average angular deviation is reduced to 0.1048° from 0.5434° and the maximum angular deviation is reduced to 0.1780° from 0.6113°. In addition, the experimental results show that the calibration method can enhance the perpendicularity accuracy of drilling and meet the accuracy requirements of aircraft assembly.

Author Contributions

Writing—Original Draft Preparation, D.C.; Methodology, D.C.; Project Administration, P.J.; Writing—Review & Editing, T.W.; Validation, D.C., Y.C. and H.T.

Funding

This research is partially supported by the National Natural Science Foundation of China (No. 61375085) and the Foundation of Shanghai Aircraft Manufacturing Co., Ltd. (No. 32284001).

Acknowledgments

We greatly appreciate the support of experimental site from Shanghai Aircraft Manufacturing Co., Ltd.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ralph, W.C.; Johnson, W.S.; Makeev, A.; Newman, J.C., Jr. Fatigue performance of production-quality aircraft fastener holes. Int. J. Fatigue 2007, 29, 1319–1327. [Google Scholar] [CrossRef]
  2. Liu, J.; Shao, X.J.; Liu, Y.J.; Liu, Y.S.; Yue, Z.F. The effect of holes quality on fatigue life of open hole. Mater. Sci. Eng. A 2007, 467, 8–14. [Google Scholar] [CrossRef]
  3. Gao, Y.; Wu, D.; Nan, C.; Ma, X.; Dong, Y.; Chen, K. The interlayer gap and non-coaxiality in stack drilling. Int. J. Mach. Tool Manuf. 2015, 99, 68–76. [Google Scholar] [CrossRef]
  4. Bi, S.; Liang, J. Robotic drilling system for titanium structures. Int. J. Adv. Manuf. Technol. 2011, 54, 767–774. [Google Scholar] [CrossRef]
  5. Frommknecht, A.; Kuehnle, J.; Effenberger, I.; Pidan, S. Multi-sensor measurement system for robotic drilling. Robot. Comput. Integr. Manuf. 2017, 47, 4–10. [Google Scholar] [CrossRef]
  6. Shi, Z.; Yuan, P.; Wang, Q.; Chen, D.; Wang, T. New design of a compact aero-robotic drilling end effector: An experimental analysis. Chin. J. Aeronaut. 2016, 29, 1132–1141. [Google Scholar] [CrossRef]
  7. Skorupa, M.; Skorupa, A.; Machniewicz, T.; Korbel, A. Effect of production variables on the fatigue behaviour of riveted lap joints. Int. J. Fatigue 2010, 32, 996–1003. [Google Scholar] [CrossRef]
  8. Gong, M.; Yuan, P.; Wang, T.; Rui, Z. Intelligent verticality-adjustment method of end-effector in aeronautical drilling robot. J. Beijing Univ. Aeronaut. Astronaut. 2012, 38, 1400–1404. [Google Scholar]
  9. Gao, Y.; Wu, D.; Dong, Y.; Ma, X.; Chen, K. The method of aiming towards the normal direction for robotic drilling. Int. J. Precis. Eng. Manuf. 2017, 18, 787–794. [Google Scholar] [CrossRef]
  10. Du, Z.C.; Yao, Y.B. Measurement method for evaluating normal direction of surface for digital drilling and riveting. SAE Tech. Pap. 2012. [Google Scholar] [CrossRef]
  11. Gao, Y.; Wu, D.; Nan, C.; Chen, K. Normal direction measurement in robotic drilling and precision calculation. Int. J. Adv. Manuf. Tech. 2015, 76, 1311–1318. [Google Scholar] [CrossRef]
  12. Gong, M.; Yuan, P.; Wang, T.; Yu, L.; Xing, H.; Huang, W. A novel method of surface-normal measurement in robotic drilling for aircraft fuselage using three laser range sensors. In Proceedings of the 2012 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Kaohsiung, Taiwan, 11–14 July 2012; pp. 450–455. [Google Scholar]
  13. Yuan, P.J.; Wang, Q.S.; Shi, Z.Y.; Wang, T.; Wang, C.; Chen, D.; Shen, L. A micro-adjusting attitude mechanism for autonomous drilling robot end-effector. Sci. China Inf. Sci. 2014, 57, 1–12. [Google Scholar] [CrossRef]
  14. Chen, D.; Yuan, P.; Wang, T.; Wang, Q.; Wang, C.; Wang, F. Intelligent surface normal measurement method of end effector for the aeronautical drilling robot. In Proceedings of the 2014 International Conference on Multi-sensor Fusion and Information Integration for Intelligent Systems, Beijing, China, 28–29 September 2014; pp. 1–6. [Google Scholar]
  15. Wang, Z.; Qin, X.; Bai, J.; Tan, X.; Li, J. Design and Implementation of Multifunctional Automatic Drilling End Effector. In Proceedings of the 2017 IOP Conference Series: Materials Science and Engineering, Dubai, The United Arab Emirate, 13–29 December 2017; IOP: London, UK, 2017; p. 012032. [Google Scholar]
  16. Bi, C.; Liu, Y.; Fang, J.; Guo, X.; Lv, L.; Dong, P. Calibration of laser beam direction for optical coordinate measuring system. Measurement 2015, 73, 191–199. [Google Scholar]
  17. Chao, B.I.; Jianguo, F.A.; Kun, L.I.; Zhijun, G.U. Extrinsic calibration of a laser displacement sensor in a non-contact coordinate measuring machine. Chin. J. Aeronaut. 2017, 30, 1528–1537. [Google Scholar]
  18. Ren, Y.; Yin, S.B.; Zhu, J.G. Calibration technology in application of robot-laser scanning system. Opt. Eng. 2012, 51, 114204. [Google Scholar] [CrossRef]
  19. Yuan, Z.; Zhu, W.; Chen, L.; Xue, L.; Qi, W. Approach for calibrating position of displacement sensor mounted on robot end-effector. J. Zhejiang Univ. Eng. Sci. 2015, 49, 829–834. [Google Scholar]
  20. Cao, S.Q.; Yuan, P.J.; Chen, D.D.; Shi, Z. Calibration method for laser beam direction and zero point of laser displacement sensor. J. Beijing Univ. Aeronaut. Astronaut. 2018, 40, 1321–1327. [Google Scholar]
  21. Guan, Y.; Cheng, X.; Shi, G. A robust method for fitting a plane to point clouds. J. Tongji Univ. Nat. Sci. 2008, 36, 981–984. [Google Scholar]
  22. Valappil, J.; Georgakis, C. Systematic estimation of state noise statistics for extended Kalman filters. AIChE J. 2000, 46, 292–308. [Google Scholar] [CrossRef]
  23. Huang, S.; Dissanayake, G. Convergence and consistency analysis for extended Kalman filter based SLAM. IEEE Trans. Robot. 2007, 23, 1036–1049. [Google Scholar] [CrossRef] [Green Version]
  24. Kulikov, G.Y.; Kulikova, M.V. The accurate continuous-discrete extended Kalman filter for Radar Tracking. IEEE Trans. Signal Process. 2016, 64, 948–958. [Google Scholar] [CrossRef]
  25. Nguyen, H.N.; Zhou, J.; Kang, H.J. A calibration method for enhancing robot accuracy through integration of an extended Kalman filter algorithm and an artificial neural network. Neurocomputing 2015, 151, 996–1005. [Google Scholar] [CrossRef]
  26. Nguyen, H.N.; Zhou, J.; Kang, H.J.; Ro, Y.S. Robot Geometric Parameter Identification with Extended Kalman Filtering Algorithm. In Proceedings of the 2013 International Conference on Intelligent Computing, Nanning, China, 28–31 July 2013; Springer: Berlin, Germany, 2013; pp. 165–170. [Google Scholar]
  27. Du, G.; Zhang, P. Online serial manipulator calibration based on multisensory process via extended Kalman and particle filters. IEEE Trans. Ind. Electron. 2014, 61, 6852–6859. [Google Scholar]
  28. Qin, X.; Wang, W.; Lou, A.; Teng, W. Three-point bracket regulation algorithm for drilling and riveting of aerofoil. Acta Aeronaut Astronaut Sin. 2007, 28, 1455–1460. [Google Scholar]
  29. Song, T.; Xi, F.; Guo, S.; Ming, Z.; Lin, Y. A comparison study of algorithms for surface normal determination based on point cloud data. Precis. Eng. 2015, 39, 47–55. [Google Scholar] [CrossRef]
Figure 1. The robotic drilling system.
Figure 1. The robotic drilling system.
Sensors 18 03485 g001
Figure 2. The flow of normal adjustment of robotic drilling system.
Figure 2. The flow of normal adjustment of robotic drilling system.
Sensors 18 03485 g002
Figure 3. The installation of four laser displacement sensors.
Figure 3. The installation of four laser displacement sensors.
Sensors 18 03485 g003
Figure 4. The measurement model of laser displacement sensors.
Figure 4. The measurement model of laser displacement sensors.
Sensors 18 03485 g004
Figure 5. The surface normal measurement.
Figure 5. The surface normal measurement.
Sensors 18 03485 g005
Figure 6. (a) The diagram of attitude adjustment. (b) Surface normal vector decomposition in TCS.
Figure 6. (a) The diagram of attitude adjustment. (b) Surface normal vector decomposition in TCS.
Sensors 18 03485 g006
Figure 7. Estimated parameter errors of four laser displacement sensors using EKF algorithm.
Figure 7. Estimated parameter errors of four laser displacement sensors using EKF algorithm.
Sensors 18 03485 g007
Figure 8. The angular deviation after calibration of the methods.
Figure 8. The angular deviation after calibration of the methods.
Sensors 18 03485 g008
Figure 9. The experimental setup of the robotic drilling system.
Figure 9. The experimental setup of the robotic drilling system.
Sensors 18 03485 g009
Figure 10. The hard structure of data collect system for laser displacement sensors.
Figure 10. The hard structure of data collect system for laser displacement sensors.
Sensors 18 03485 g010
Figure 11. Estimated parameter errors of sensors using EKF algorithm.
Figure 11. Estimated parameter errors of sensors using EKF algorithm.
Sensors 18 03485 g011
Figure 12. The angular deviation after experimental calibration by the methods.
Figure 12. The angular deviation after experimental calibration by the methods.
Sensors 18 03485 g012
Table 1. The parameters of the simulated plane.
Table 1. The parameters of the simulated plane.
ParametersABCD
Theoretical plane0.0173−0.30710.951534.1218
Fitted plane0.0173−0.30700.951634.1285
Table 2. The assumptive nominal sensor parameters and corresponding parameter errors.
Table 2. The assumptive nominal sensor parameters and corresponding parameter errors.
Lixi + Δxi [mm]yi + Δyi [mm]zi + Δzi [mm]mi + Δmi [rad]ni + Δni [rad]qi + Δqi [rad]
150.0000 + 1.30000.0000 + 0.90000.0000 + 1.1000−0.5000 + 0.04450.0000 + 0.0506−0.8660 − 0.0228
20.0000 + 1.300050.0000 − 1.40000.0000 + 1.60000.0000 − 0.0634−0.5000 + 0.0479−0.8660 − 0.0237
3−50.0000 + 1.30000.0000 − 1.20000.0000 + 1.20000.5000 − 0.05070.0000 − 0.0365−0.8660 − 0.0266
40.0000 + 1.5000−50.0000 + 1.10000.0000 + 1.40000.0000 + 0.03390.5000 − 0.0682−0.8660 − 0.0353
Table 3. The numbers of convergence measurement points for each laser.
Table 3. The numbers of convergence measurement points for each laser.
L1L2L3L4
Number75869181
Table 4. The statistics of the angular deviation after calibration of the methods.
Table 4. The statistics of the angular deviation after calibration of the methods.
Max. [deg]Mean [deg]Std. [deg]
Before1.68011.33870.1841
Method 10.42780.24460.1024
Proposed method0.05110.04120.0057
Table 5. The parameters of fitted datum plane.
Table 5. The parameters of fitted datum plane.
ParametersABCD
Fitted plane0.44970.8932−0.0084−1690.2827
Table 6. The nominal sensor parameters and estimated sensor parameter errors using EKF algorithm.
Table 6. The nominal sensor parameters and estimated sensor parameter errors using EKF algorithm.
Lixi + Δxi [mm]yi + Δyi [mm]zi + Δzi [mm]mi + Δmi [rad]ni + Δni [rad]qi + Δqi [rad]
1−36.4655 + 0.483836.4655 − 0.2460−35.0000 + 0.17230.3536 + 0.0047−0.3536 − 0.00650.8660 − 0.0047
236.4655 − 0.290636.4655 − 0.4338−35.0000 − 0.2393−0.3536 − 0.0048−0.3536 − 0.00120.8660 − 0.0026
336.4655 + 0.9513−36.4655 + 0.5488−35.0000 + 0.1860−0.3536 − 0.02780.3536 − 0.02010.8660 − 0.0039
4−36.4655 + 0.5558−36.4655 − 0.8081−35.0000 + 0.11860.3536 + 0.02290.3536 − 0.01820.8660 − 0.0026
Table 7. The numbers of convergence measurement points for each laser.
Table 7. The numbers of convergence measurement points for each laser.
L1L2L3L4
Number39443444
Table 8. The statistics of the angular deviation after experimental calibration by the methods.
Table 8. The statistics of the angular deviation after experimental calibration by the methods.
Max. [deg]Mean [deg]Std. [deg]
Before0.61130.54340.0432
Method 10.44870.21920.1270
Proposed method0.17800.10480.0443

Share and Cite

MDPI and ACS Style

Chen, D.; Yuan, P.; Wang, T.; Cai, Y.; Tang, H. A Normal Sensor Calibration Method Based on an Extended Kalman Filter for Robotic Drilling. Sensors 2018, 18, 3485. https://doi.org/10.3390/s18103485

AMA Style

Chen D, Yuan P, Wang T, Cai Y, Tang H. A Normal Sensor Calibration Method Based on an Extended Kalman Filter for Robotic Drilling. Sensors. 2018; 18(10):3485. https://doi.org/10.3390/s18103485

Chicago/Turabian Style

Chen, Dongdong, Peijiang Yuan, Tianmiao Wang, Ying Cai, and Haiyang Tang. 2018. "A Normal Sensor Calibration Method Based on an Extended Kalman Filter for Robotic Drilling" Sensors 18, no. 10: 3485. https://doi.org/10.3390/s18103485

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop