Next Article in Journal
Validating and Comparing Highly Resolved Commercial “Off the Shelf” PM Monitoring Sensors with Satellite Based Hybrid Models, for Improved Environmental Exposure Assessment
Previous Article in Journal
Multiple Solutions Starting from Real Shaped Beams in Equispaced Linear Arrays
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Adaptive-Neuro-Fuzzy-Based Information Fusion for the Attitude Prediction of TBMs

State Key Lab of Digital Manufacturing Equipment & Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(1), 61; https://doi.org/10.3390/s21010061
Submission received: 22 November 2020 / Revised: 20 December 2020 / Accepted: 21 December 2020 / Published: 24 December 2020
(This article belongs to the Section Fault Diagnosis & Sensors)

Abstract

:
In a tunneling boring machine (TBM), to obtain the attitude in real time is very important for a driver. However, the current laser targeting system has a large delay before obtaining the attitude. So, an adaptive-neuro-fuzzy-based information fusion method is proposed to predict the attitude of a laser targeting system in real time. In the proposed method, a dual-rate information fusion is used to fuse the information of a laser targeting system and a two-axis inclinometer, and then obtain roll and pitch angles with a higher rate and provide a smoother attitude prediction. Considering that a measurement error exists, the adaptive neuro-fuzzy inference system (ANFIS) is proposed to model the measurement error, and then the ANFIS-based model is combined with the dual-rate information fusion to achieve high performance. Experimental results show the ANFIS-based information fusion can provide higher real-time performance and accuracy of the attitude prediction. Experimental results also verify that the ANFIS-based information fusion can solve the problem of the laser targeting system losing signals.

1. Introduction

Tunnel boring machines (TBMs) have high work efficiency and safety and are widely used to excavate tunnels, especially for subways, railways, and pipelines [1,2,3,4,5]. During the excavation process, accurate attitude acquisition is very important for controlling TBMs [6,7] and micro tunneling boring machines [8,9]. The attitude consists of three angles, that is, yaw(γ), pitch(α), and roll(β) shown in Figure 1, which are detected by sensors installed at limited observation points on a TBM. In the figure, v is the velocity of the TMB. A driver is required to monitor the measured attitude in real time to tune the drive system to ensure the TBM runs in the as-designed tunnel alignment.
The tunnels for subways are more than tens of kilometers long, so the general excavation process is that two TBMs work simultaneously in opposite directions towards one point to improve efficiency. In this situation, the accuracy of the TBM’s guidance system is crucial to steer the TBM to run along the as-designed tunnel alignment and avoid big deviations from the design.
Laser-based targeting systems [9,10,11,12] are widely applied to TBMs as guidance systems. In a laser-based targeting system, a laser theodolite or a laser station needs to be installed in the jacking shaft to detect the position and attitude of the TBM. From the station, the laser beams are projected onto a target board mounted on a TBM, then the attitude angles can be obtained by analyzing the laser spots on the target board. In addition, a two-axis gravity-referenced inclinometer is used to help obtain the pitch and roll angles. The inclinometer can achieve a high sampling rate, which is much higher than that of a laser-based targeting system. However, inclinometers are vulnerable to the strong vibrations resulting from complex geological conditions [13,14,15]. Laser-based targeting systems have high anti-vibration ability but low sampling rate. So, it is feasible to fuse these two measurement methods to predict the attitude accurately with a high sampling rate and anti-vibration ability.
Many methods have been investigated to fuse the information of different sensors [16,17,18,19,20]. D–S evidence theory is a promising and popular approach to data fusion, which can deal with the uncertainty and inconsistency of multi-sensor data, and handle the inevitable ambiguity and instability under noise or possible interference [21]. Similar to the D–S evidence theory, the possibility theory and fuzzy set theory are good methods to deal with imperfect data in the information fusion [22,23].
The Kalman filter [24,25,26,27] is one of the most widely used methods because of its simplicity and effectiveness. A Kalman-based approach [27] could be used to estimate the state and force of a rotating helicopter blade. There are many methods used to improve the performance of the basic Kalman filter. For example, the extended Kalman filter (EKF) [28] can be applied to nonlinear systems while the basic Kalman filter is suitable for linear systems, and the unscented Kalman filter [29] achieved better performance than that of the EKF at a comparative level of complexity. An adaptive cubature Kalman filter [30] was proposed to solve the problem of an initial misalignment angle with uncertain noise covariance matrices for the inertial navigation system. In most cases, the Kalman filter can be used to filter noises during the information fusion, and in some cases, the Kalman filter is used to fuse the information with different sampling rates. For multi-rate cases, dual-rate Kalman filters [31,32] were developed to fuse the sensors with different rates and improve measurement performance.
For some complex situations, adaptive methods [33,34,35] and neural networks [36] can be used in the information fusion to improve the fusion effectiveness. For example, an adaptive federated Kalman filter (FKF) with time-varying information sharing factors [34] was proposed to improve the accuracy, robustness, and fault-tolerance ability of unmanned ground vehicles (UGV). A progressive LiDAR adaptation-aided road detection (PLARD) approach [35] was proposed to adapt LiDAR information into visual image-based road detection. An ensemble convolutional neural network model [36] was proposed to solve the problem of information losses during the information fusion. Hybrid fusion approaches are a comprehensive scheme, which combine different fusion methods such as fuzzy reasoning, D–S evidence theory, and neural networks to complete complex fusion tasks [37,38,39,40]. An adaptive fuzzy extended Kalman filter [41] was developed for attitude estimation with the outputs of strap-down IMU (gyroscopes and accelerometers) and strap-down magnetometer.
This paper proposes an adaptive-neuro-fuzzy-based (ANFIS-based) information fusion system to improve the attitude prediction accuracy of TBMs. Firstly, a dual-rate information fusion is used to reduce the delay of signal sampling and then improve the prediction accuracy of a TBM’s attitude. It is common for one of the fused sensors to have a big error resulting in a bad fusion effect. In our experiments, the roll and pitch angles of a laser targeting system and a two-axis inclinometer were fused, and the two-axis inclinometer had a big measurement error. Secondly, adaptive neuro-fuzzy inference systems are proposed to build the model of the measurement error. Although it can be corrected by tuning the installation attitude, the measurement error cannot be eliminated because of the installation error, the temperature variation, the complex TBM structure, and so on. The measurement error from the two-axis inclinometer will reduce the fusion effect during the information fusion, so the measurement error needs to be predicted and compensated for. The neural networks and fuzzy inference systems are often combined with Kalman filters to optimize the filtering process by building complexing system models [42,43,44]. Adaptive neuro-fuzzy inference systems (ANFIS) [45,46] with the advantages of the neural networks and fuzzy systems can realize both the modeling of the strong nonlinear system and a real-time update of system parameters. Considering the laser targeting system has high accuracy, the pitch angle obtained from the laser targeting system is used as a reference signal to correct the measurement error of the two-axis inclinometer, and an ANFIS is proposed to build the model of the measurement error and update the model according to the real-time data. Finally, the compensated pitch angle is used for information fusion.
The main contribution of the paper is that an adaptive-neuro-fuzzy-based information fusion is proposed to improve the attitude prediction accuracy of TBMs. Compared with the traditional dual-rate information fusion, the ANFIS can be used to build the measurement error model of the pitch angle by the two-axis inclinometer and thus be combined with the traditional dual-rate information fusion to improve the prediction accuracy of the TBM’s pitch angle. Another contribution of the paper is that ANFIS-based information fusion can solve the problem of the laser targeting system losing its signals.
The paper is organized as follows: Section 2 presents the dual-rate information fusion for the attitude prediction; Section 3 describes an ANFIS-based information fusion method. Section 4 and Section 5 give the experimental results and conclusions, respectively.

2. Information Fusion for the Attitude Prediction

2.1. Attitude Measurement of a TBM

Figure 2 shows the schematic diagram of the used laser targeting system, where α , β , and γ are pitch, roll, and yaw angles, respectively. The TBM runs along the direction of the velocity v. A robotic total station projects laser beams onto the laser target, and a camera is used to generate the image of the target board to compute the attitude. When the TBM moves, the robotic total station can track the laser target by tuning its attitude and obtain the distance information according to the feedback laser beam. Computers connect the robotic total station and the two-axis inclinometer to sample the position and attitude information. By analyzing the image from the camera and combining the attitude of the robotic total station, the attitude of the TBM can be obtained (please see Ref. [47] for the details).
Generally, the laser targeting system has high accuracy and anti-vibration ability when it obtains the attitude. However, it is time-consuming to track the laser target, decouple, and correct every attitude angle, so the laser targeting system has a low sampling rate. Sometimes the laser beam is interrupted by some unexpected objects, which will result in the loss of the attitude data. To meet the requirements of high accuracy and a high sampling rate, the information fusion method is proposed in the paper.
The two-axis inclinometer has a very high sampling rate, which is much higher than that of the laser targeting system. However, the two-axis inclinometer is vulnerable to the vibration of the TBM and thus has low accuracy. In this section, the two-axis inclinometer and laser targeting system are fused to take the advantages of the two measurement methods.

2.2. Dual-Rate Information Fusion for the Attitude Prediction

Dual-rate information fusion is often used to fuse information with different rates [32,48]. Figure 3 shows the scheme of the dual-rate sampling. Sensors 1 and 2 in Figure 3a show sampling cases of the attitude angles by the laser targeting system and inclinometer. The attitude angles sensed by the inclinometer (θ1) and the laser targeting system (θ2) are shown in Figure 3b,c, respectively. The sampling period of θ1 is four times that of θ2. The stairs shown in Figure 3c are longer than those in Figure 3c, which implies that the angle needs to wait for a longer time to be updated, which is not beneficial for a driver to achieve the real-time attitude information. The attitude angle by the inclinometer has a high sampling rate and a low delay, but it is vulnerable to noises. By the following dual-rate information fusion, the two angles can be integrated, and a smooth angle prediction can be obtained to guide the driver to maneuver the TBM.
The state equation of every attitude angle is described as shown in Equations (1) and (2)
X ( k + 1 ) = Φ X ( k ) + Γ W ( k )
Y ( k + 1 ) = H X ( k ) + V ( k )
where k is the discrete time, and X ( k ) R is the state at time k. Φ and H are the state transfer matrix and observation matrix, respectively. Γ is the noise matrix. W ( k ) and V ( k ) are the input noises and measurement noises, respectively.
The Kalman filter is used to predict the new state by using Equation (3)
X ^ ( k + 1 | k ) = Φ X ^ ( k | k )
where X ^ ( k + 1 | k ) is the prediction value of X ( k + 1 | k ) .
The prediction value of the covariance is obtained by Equation (4)
P ( k + 1 | k ) = Φ P ( k | k ) Φ T + Γ Q Γ T
where Q is the square error of input noises.
The gain matrix of the Kalman filter is shown in Equation (5)
K ( k + 1 ) = P ( k + 1 | k ) H T [ H P ( k + 1 | k ) H T + R ] 1
where R is the square error of measurement noises.
The state update is shown in Equation (6)
X ^ ( k + 1 | k + 1 ) = X ^ ( k + 1 | k ) + K ( k + 1 ) ε ( k + 1 )
where ε ( k + 1 ) = Y ( k + 1 ) H X ^ ( k + 1 | k ) .
The covariance is updated by Equation (7)
P ( k + 1 | k + 1 ) = [ I n + K ( k + 1 ) H ] P ( k + 1 | k )
α L ( k ) and β L ( k ) are the pitch and roll angles sensed by the laser targeting system, and α I ( k ) and β I ( k ) are the pitch and roll angles, respectively, sensed by the two-axis inclinometer. The four variables can be filtered by the above Kalman filter separately, then the input X ( k ) in Equation (1) is a one-dimensional vector for every variable. Because the TBM moves slowly, Γ , Φ , and H can be set to 1.
Suppose that the input attitude angles are written as follows:
X a ( k ) = [ α L ( k )   α I ( k ) ]
X b ( k ) = [ β L ( k )   β I ( k ) ]
It is noticed that the α L ( k ) and β L ( k ) are updated every n periods, α I ( k ) and β I ( k ) are updated every period T.
By using Equations (1)–(7), every element of X a and X b can be filtered. It is supposed that the filtered angles are α L _ f ( k ) , β L _ f ( k ) α I _ f ( k ) , and β I _ f ( k ) , respectively.
With the following fusion matrices, which are Equations (7) and (8), information fusion can be completed.
K f a = [ k f 1 1 k f 1 ]
K f b = [ k f 2 1 k f 2 ]
where k f 1 [ 0 , 1 ] and k f 2 [ 0 , 1 ] are the fusion gains for pitch and roll angles, respectively.
By using X a K f a and X b K f b , the information fusion of the laser targeting system and the two-axis inclinometer can be conducted and the results are Equations (10) and (11)
α ( k + 1 | k + 1 ) = k f 1 α L _ f ( k + 1 | k + 1 ) + ( 1 k f 1 ) α I _ f ( k + 1 | k + 1 )
β ( k + 1 | k + 1 ) = k f 2 β L _ f ( k + 1 | k + 1 ) + ( 1 k f 2 ) β I _ f ( k + 1 | k + 1 )
α ( k + 1 | k + 1 ) can be rewritten as α ( k + 1 ) . Based on the above information fusion, the one-step prediction values of roll and pitch angles are obtained by the linear prediction Equations (12) and (13)
α ^ ( k + 1 ) = α ( k ) + k p ( α ( k ) α ( k - 1 ) )
β ^ ( k + 1 ) = β ( k ) + k p ( β ( k ) β ( k - 1 ) )
where k p is equal to 1. k p can also be any positive proportional coefficient used to predict the future angles at time (k+ k p ).
Fusion processes in Equations (10) and (11) require the attitude angles by the laser targeting system and the inclinometer to be approach actual values. In fact, α L ( k ) and β L ( k ) are much accurate than α I ( k ) and β I ( k ) at the sampling instants. α I ( k ) and β I ( k ) are not very accurate with the influence of the vibration, the installation error, the temperature change, and so on. So, the following ANFIS-based information fusion method is proposed to improve the fusion effect.

3. ANFIS-Based Information Fusion Method

In TBMs, laser targeting systems have high accuracy and anti-vibration ability and are widely used. So, the attitude obtained by a laser targeting system can be considered to be accurate. The two-axis inclinometer is used to obtain more high-frequency pitch and roll angles. The two-axis inclinometer can act as a master sensor to provide the related angles when the beams of the laser targeting system are not able to be tracked because of sheltering, out of tolerance of roll angle, and so on.
The attitude angles obtained by the two-axis inclinometer need to be corrected. The roll angle has less influence on a TBM running along the as-designed tunnel alignment, so the roll angle obtained by the two-axis inclinometer can be used to act as the master sensor directly after being corrected.
The pitch angle is one of the most important angles to guide a driver to master the TBM. The pitch angle obtained by the two-axis inclinometer is too complicated to be corrected by simply tuning its installation attitude. Its influence factors are so complicated that it is not feasible to model a simple linear model, and the changing influence factors result in model uncertainty. The ANFIS can be used to build a strong nonlinear model and update the model by tuning the system parameters in real time.

3.1. ANFIS-Based Information Fusion Method

Figure 4 shows the scheme of the ANFIS-based information fusion method. The information fusion method includes two main portions: the dual-rate information fusion and ANFIS. The dual-rate information fusion is used to fuse the pitch angles by the laser targeting system and by the two-axis inclinometer, and the ANFIS is used to model the measurement error to compensate for α I ( k ) .
Because the pitch angle obtained by the laser targeting system is more accurate than that obtained by the two-axis inclinometer, the pitch error e a , which is obtained by the difference between α L and α I , can be estimated and used to compensate α I . According to our experimental analysis, the most important source of the pitch error is the installation error, and the pitch error changes with β I and is influenced by the environmental temperature and other factors. So, the idea is to use ANFIS to model the function of e a about β L and use the built model to estimate the pitch error in real time. Because β L can be replaced by β I the built function is suitable to use β L to estimate e a . By using obtained samples, ANFIS is trained to obtain the optimal estimate e ^ a ( k ) . The dataset [ e a ( k )   β I ( k ) ] T is sampled and stored in memory in real time. The new dataset combines the historical datasets to update the parameters of the ANFIS model to adapt to changes of the model.
In the end, the compensated pitch angle α I _ c can be used to fuse with α L . The detailed fusion process is shown as follows.
α L ( j ) and α I ( k ) are obtained from the laser targeting system and the two-axis inclinometer, respectively. The relation between k and j is Equation (14)
k = m × j
where k, j and m are positive integers.
Assume the sampling period of the two-axis inclinometer is T, then that of the laser targeting system is mT. From a driver’s view, the observation value of the laser targeting system will remain within a period of mT and the result is shown in Figure 3. Then, α L ( j ) can extend its values to have the same sampling period as α I ( k ) by Equation (15)
α L ( m × j + i ) = α L ( j )
where i = 1, 2, …, m−1.
By the dual-rate information fusion in Section 2, the pitch angle can be obtained by Equation (10). However, α I ( k ) is not very accurate, so an ANFIS-based information fusion method is proposed as follows.
Taking the pitch angle obtained by the laser targeting system as the reference, the pitch error of α I ( k ) can be obtained by Equation (16)
e a ( j ) = α L ( j ) α I ( m × j )
where e a ( j ) is the pitch error at time j.
By using a dataset E = [ e a ( j )   β L ( j ) ] T , the model of e a about β L is obtained by an ANFIS and e a ( k ) can be predicted by Equation (17)
e ^ a ( k ) = f ( β I ( k ) )
f ( ) is the nonlinear function expressed by the ANFIS. By using the prediction e ^ a ( k ) , α I ( k ) can be corrected by Equation (18)
α I _ c ( k ) = α I ( k ) + e ^ a ( k )
where α I _ c ( k ) is the correction of α I ( k ) .
By the dual-rate information fusion in Section 2, with α I _ c ( k + 1 | k + 1 ) replacing α I ( k + 1 | k + 1 ) , the fused pitch angle in Equation (10) is revised as Equation (19)
α ( k + 1 | k + 1 ) = k f 1 α L _ f ( k + 1 | k + 1 ) + ( 1 k f 1 ) α I _ c _ f ( k + 1 | k + 1 )
where α I _ c _ f ( k + 1 | k + 1 ) is the filtered α I _ f ( k ) .
The final prediction output of the ANFIS-based information fusion can be obtained by Equation (12).

3.2. Angle Correction by ANFIS

A structure of single-input single-output Takagi–Sugeno type fuzzy neural networks shown in Figure 5 is used in the ANFIS. The whole system is divided into two parts: the front networks and back networks.
The front networks are a Takagi–Sugeno type fuzzy inference system and are composed of four layers as follows.
Layer 1 is the input layer. There is only one input used in the front network of the ANFIS, which is the roll angle β I .
Layer 2 has the fuzzy variables that are used to compute the membership function of every fuzzy element.
The fuzzy variables of the fuzzy inference system are {NB NM NS O PS PM PB}. For every variable, the membership of every input is μ i , and the Gaussian membership function shown in Equation (20) is applied in the ANFIS
μ i = e ( x i c i ) σ i
where i = 1 ,   2 ,   ,   m 1 . m 1 is the number of fuzzy variables. c i and σ i are the center and width of the ith membership function, respectively.
Layer 3 is the fuzzy rule layer used to compute the fitness of every rule. The following rule shown in Equation (21) is used to compute the fitness of every rule
ρ i = μ 1 μ 2 μ m 1
where i = 1 ,   2 ,   ,   m , m is the number of the rules, and ρ i is the fitness of every rule.
Layer 4 is the normalization layer used to normalize ρ i . The function is shown in Equation (22)
ρ ¯ i = ρ i i = 1 m ρ i
where ρ ¯ i is the normalization of ρ i .
In the end, ρ ¯ i is used in the back networks to compute the final output.
The back networks are composed of the following three neural network layers.
Layer 1 of the back networks is the input roll angle β I and a constant input ‘1′ is used to generate the fixed bias of the ith note p 10 i at Layer 2.
Layer 2 has m notes corresponding to m rules. The output of the ith note is the function of β I , which is described in Equation (23)
y 1 i = p 10 i + p 11 i β I
where i = 1 , 2 , , m .
Layer 3 is the output of the ANFIS and the output is the estimated pitch error in Equation (24)
e ^ a = j = 1 m ρ j y 1 j
p 1 m i , c i , and σ i need to be learned by the neural networks.
The cost function is Equation (25)
E = 1 2 ( t 1 y 1 ) 2
where t 1 and y 1 are the expected and actual outputs of the ANFIS, respectively. In the applied ANFIS, y 1 is equal to e ^ a .
By using the ANFIS, the model of the measurement error of the pitch angle e a ( k ) about the roll angle β L ( k ) can be built and updated. By using the generalization ability, β L ( k ) can be substituted by β I ( k ) to obtain a higher rate estimation value e ^ a ( k ) .

4. Experimental Results

Experiments were conducted to verify the proposed ANFIS-based information fusion. The laser targeting system is shown in Figure 6. The robotic total station projects beams onto the laser target to obtain the attitude information, and the two-axis inclinometer is used to obtain the roll and pitch angles, the attitude information from the two sensors can be transmitted into the computer. The sampling periods of the laser targeting system and the two-axis inclinometer are 2 min and 0.5 min, respectively.
Figure 7 shows the experimental results of the roll and pitch angles. From a driver’s view, the pitch and roll angles will remain unchanged within sampling periods, which are 2 min and 0.5 min, respectively. From Figure 7, it can be seen that the pitch and roll angles sampled from the laser targeting system have large delays, which will have a big influence on the observation accuracy of the pitch and roll angles.

4.1. Roll Angle Prediction

Figure 8 shows that the laser target system has a low sampling rate to obtain the roll angle labeled as “observation”. The points labeled as “actual” are the values at the sampling instants. Further experiments show that the two-axis inclinometer has a high sampling rate. Because the roll angle does not require very high accuracy and the two-axis inclinometer has a small influence on the roll angle direction, in the dual-rate information fusion k f 2 is set for 0, which implies that the two-axis inclinometer is directly used to obtain the roll angle at a high sampling rate instead of the dual-rate information fusion. A traditional Kalman filter is used to smooth the roll angle and then the prediction method in Equation (12) is used to obtain the roll angle at any next time. The prediction value of the roll angle is labeled as “prediction”. Compared with the actual value, the observation value has a big error when it is close to the next sampling time, but the prediction value is very close to the actual value.

4.2. Pitch Angle Prediction by the ANFIS-Based Information Fusion

The dual-rate information fusion method in Section 2 was used to predict the pitch angle. The pitch angles sampled by the laser targeting system and by two-axis inclinometer are shown in Figure 9. The pitch angle obtained by the laser targeting system has a high accuracy with strong anti-vibration ability but a big delay, that obtained by the two-axis inclinometer has a high sampling rate. However, the figure shows that there is a big error between the two pitch angles, so the measurement error needs to be compensated for first before fusing the two sensors.
According to the experimental analysis, the main influence factor of the measurement error is the installation error, and the measurement error is the nonlinear function of the roll angle. The two-axis inclinometer has a simple structure, which is easy to installed, but its correcting process is complex, and the perfect correct result is very difficult to obtain. So, this paper proposes to use an ANFIS to build the nonlinear model of the measurement error. In the system, single-input single-output Takagi–Sugeno type fuzzy neural networks are built and the curves of the membership function in the ANFIS are shown in Figure 10. There are three fuzzy variables used, which are NM, O, and PM. With one input labeled as “in1”, the corresponding memberships are mf1, mf2, and mf3, respectively.
From the prediction result shown in Figure 11, it can be seen that the prediction error is smaller than 0.01 degree. The predicted measurement error is used to compensate for the inaccuracy of the two-axis inclinometer, which will improve the fusion accuracy of the two sensors.
Finally, the ANFIS-based information fusion method shown in Figure 4 is used to predict the pitch angle. In this method, the dual-rate information fusion is used to improve the real-time performance and prediction accuracy of the pitch angle, and the fusion gain k f 1 is set for 0.02. The ANFIS is updated in real time to adapt the complex variation of the measurement error model. Based on the information fusion of the two sensors, the prediction method in Equation (11) is used to predict the pitch angle in real time and the result is shown in Figure 12. Data 1 and data 2 are the data at different times. The sampled points by the laser targeting system labeled as “measured” are used to verify the prediction effect. The results for data 1 and data 2 show that the observation value has a big delay and then a large error near the next sampling point, but the ANFIS-based information fusion can achieve a high sampling rate and a smooth pitch curve. The prediction value at the sampling instant is close to the measured value near the next sampling point, which is smaller than 0.01 degree and much better than the observed value. From the result, it can be concluded that the proposed fusion method can obtain the pitch angle accurately.

4.3. ANFIS-Based Information Fusion for Solving the Problem of Signal Losses

Sometimes the laser targeting system loses its signals because of sheltering, being out of tolerance of the roll angle, and so on. The ANFIS-based information fusion can be used to solve this problem. The data in Figure 13 were used to verify its ability to solve the problem.
It is supposed that the data from the laser targeting system are lost from 100 min to 112 min. The ANFIS-based information fusion is used to predict the pitch angle, and when the laser targeting system loses its signals, k f 1 is set for 0, which implies that the information from the laser targeting system is neglected. In this case, the parameter updating process of the ANFIS stops, then the ANFIS works with fixed parameters.
The result shows that the prediction value by the proposed information fusion has a maximum error of 0.001 degree compared with the measured value. So, the proposed information fusion can solve the problem that the laser targeting system loses its signals.
In summary, the dual-rate information fusion method can realize the information fusion of the laser targeting system and two-axis inclinometer, which can use the advantages of the two sensors and obtain the accurate roll and pitch angles in real time. ANFIS-based information fusion can obtain the accurate pitch angle based on the compensation of the measurement error of the low accurate sensor and can solve the problem of the laser targeting system losing its signals.

5. Conclusions

It is very important to obtain the attitude of a TBM in real time. However, the laser targeting system takes a long period to sample the attitude. The inclinometer has a high sampling rate, but it is easily influenced by vibration. To combine the advantages of the two sensors, this paper proposes to use dual-rate information fusion to obtain high real-time and high accurate pitch and roll angles.
The pitch angle has a big measurement error because of the installation error, the temperature variation, the complex TBM structure, and so on, and it is very difficult to be fully corrected: An ANFIS-based information fusion is proposed to predict the pitch angle of TBMs. The ANFIS-based information fusion is mainly composed of the dual-rate information fusion and an ANFIS. The dual-rate information fusion is used to improve the sampling rate and measurement accuracy, and the ANFIS is used to compensate for the measurement error of the low-accuracy sensor.
Experiments were performed to verify the performance of the proposed information fusion method. In the experiments, the pitch angle obtained by the two-axis inclinometer had a big error, so the ANFIS was used to model the pitch error and compensate for the pitch angle. The ANFIS realized the real-time update to adapt the environmental variation. After the pitch angle sampled by the two-axis inclinometer was compensated for, the dual-rate information fusion was used to fuse the two pitch angles.
Experimental results show that the dual-rate information fusion can realize the information fusion of the laser targeting system and two-axis inclinometer, which can use the advantages of the two sensors and obtain the accurate roll and pitch angles in real time. The proposed ANFIS-based information fusion method can obtain a higher accuracy of the pitch angle after compensating for the measurement error. The ANFIS-based information fusion can solve the signal loss problem when the laser beams of the laser targeting system are sheltered or the roll angle is out of tolerance.

Author Contributions

Conceptualization, B.H., G.Z. and D.Z.; methodology, B.H. and D.Z.; software, L.H. and D.Z.; validation, B.H., and D.Z.; formal analysis, D.Z.; investigation, B.H.; resources, B.H. and G.Z.; data curation, D.Z.; writing—original draft preparation, D.Z.; writing—review and editing, D.Z., B.H., L.H., and G.Z.; visualization, D.Z.; supervision, G.Z. and D.Z.; project administration, G.Z.; funding acquisition, G.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by the National Key Research and Development Plan of China, grant number 2020YFB1713900, and partly by the Science and Technology Support Project of the National Nature Science Foundation of China, grant number 51775215.

Acknowledgments

We thank the anonymous reviewers for their valuable and constructive suggestions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zare, S.; Bruland, A.; Rostami, J. Evaluating D&B and TBM tunnelling using NTNU prediction models. Tunn. Undergr. Space Technol. 2016, 59, 55–64. [Google Scholar] [CrossRef]
  2. Liao, J.; Zhu, X.; Yao, B. Dynamic modeling of gripper type hard rock tunnel boring machine. Tunn. Undergr. Space Technol. 2018, 71, 166–179. [Google Scholar] [CrossRef]
  3. Zhang, Q.; Liu, Z.; Tan, J. Predicting the Performance of Tunnel Boring Machines using Big Operational Data. In Proceedings of the 2020 IEEE Sixth International Conference on Big Data Computing Service and Applications (BigDataService), Oxford, UK, 3–6 August 2020; pp. 179–182. [Google Scholar]
  4. Naghadehi, M.Z.; Samaei, M.; Ranjbarnia, M.; Nourani, V. Stateof-the-art predictive modeling of TBM performance in changing geological conditions through gene expression programming. Measurement 2018, 126, 46–57. [Google Scholar] [CrossRef]
  5. Shi, M.; Sun, W.; Zhang, T.; Liu, Y.; Wang, S.; Song, X. Geology prediction based on operation data of TBM: Comparison between deep neural network and soft computing methods. In Proceedings of the 2019 1st International Conference on Industrial Artificial Intelligence (IAI), Shenyang, China, 23–27 July 2019; pp. 1–5. [Google Scholar]
  6. Shen, X.; Lu, M.; Chen, W. Tunnel-Boring Machine Positioning during Microtunneling Operations through Integrating Automated Data Collection with Real-Time Computing. J. Constr. Eng. Manag. 2011, 137, 72–85. [Google Scholar] [CrossRef]
  7. Liu, H.; Wang, J.; Zhang, L.; Zhao, G. Trajectory tracking of hard rock tunnel boring machine with cascade control structure. In Proceedings of the 2014 IEEE Chinese Guidance, Navigation and Control Conference, Yantai, China, 8–10 August 2014; pp. 2326–2331. [Google Scholar]
  8. Hegab, M.Y.; Smith, G.R. Delay Time Analysis in Microtunneling Projects. J. Constr. Eng. Manag. 2007, 133, 191–195. [Google Scholar] [CrossRef]
  9. Gallo, J.; Pérez-Acebo, H. Performance model for Micro Tunneling Boring Machines. Informes de la Construcción 2017, 69, e203. [Google Scholar] [CrossRef] [Green Version]
  10. Read, G.F. Sewers Replacement and New Construction; Elsevier Butterworth Heinemann: Oxford, UK, 2004. [Google Scholar]
  11. Zhang, Q.; Hu, W.; Liu, Z.; Tan, J. TBM performance prediction with Bayesian optimization and automated machine learning. Tunn. Undergr. Space Technol. 2020, 103, 103493. [Google Scholar] [CrossRef]
  12. Sun, W.; Ding, X.; Wei, J.; Wang, X.; Zhang, A. Hierarchical modeling method and dynamic characteristics of cutter head driving system in tunneling boring machine. Tunn. Undergr. Space Technol. 2016, 52, 99–110. [Google Scholar] [CrossRef]
  13. Zhang, Q.; Liu, Z.; Tan, J. Prediction of geological conditions for a tunnel boring machine using big operational data. Autom. Constr. 2019, 100, 73–83. [Google Scholar] [CrossRef]
  14. Yang, B.; Chen, S.; Sun, S.; Deng, L.; Li, Z.; Li, W.; Li, H. Vibration suppression of tunnel boring machines using non-resonance approach. Mech. Syst. Signal Process. 2020, 145, 106969. [Google Scholar] [CrossRef]
  15. Salimi, A.; Faradonbeh, R.S.; Monjezi, M.; Moormann, C. TBM performance estimation using a classification and regression tree (CART) technique. Bull. Int. Assoc. Eng. Geol. 2016, 77, 429–440. [Google Scholar] [CrossRef]
  16. Wang, X.; Liu, J.; Liu, Y.; Fu, W.; Zhu, L.; Liu, W.; Fu, Z. Multi-Sensor Fusion and Error Compensation of Attitude Measurement System for Shaft Boring Machine. Sensors 2019, 19, 5007. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Li, C.; Fahmy, A.; Sienz, J. An Augmented Reality Based Human-Robot Interaction Interface Using Kalman Filter Sensor Fusion. Sensors 2019, 19, 4586. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Kim, W.Y.; Ko, S.Y.; Park, J.-O.; Park, S. 6-DOF force feedback control of robot-assisted bone fracture reduction system using double F/T sensors and adjustable admittances to protect bones against damage. Mechatronics 2016, 35, 136–147. [Google Scholar] [CrossRef]
  19. Li, X.; Chen, W.; Chan, C.; Li, B.; Song, X. Multi-sensor fusion methodology for enhanced land vehicle positioning. Inf. Fusion 2019, 46, 51–62. [Google Scholar] [CrossRef]
  20. Xu, Y.; Ahn, C.K.; Shmaliy, Y.S.; Chen, X.; Bu, L. Indoor INS UWB-based human localization with missing data utilizing predictive UFIR filtering. IEEE/CAA J. Autom. Sin. 2019, 6, 952–960. [Google Scholar] [CrossRef]
  21. Ye, F.; Chen, J.; Li, Y. Improvement of DS Evidence Theory for Multi-Sensor Conflicting Information. Symmetry 2017, 9, 69. [Google Scholar] [CrossRef] [Green Version]
  22. Zadeh, L.A. Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets Syst. 1978, 1, 3–28. [Google Scholar] [CrossRef]
  23. Dubois, D.; Prade, H. Possibility Theory, Probability Theory and Multiple-Valued Logics: A Clarification. Ann. Math. Artif. Intell. 2001, 32, 35–66. [Google Scholar] [CrossRef]
  24. Cuenca, Á.; Zhan, W.; Salt, J.; Alcaina, J.; Tang, C.; Tomizuka, M. A Remote Control Strategy for an Autonomous Vehicle with Slow Sensor Using Kalman Filtering and Dual-Rate Control. Sensors 2019, 19, 2983. [Google Scholar] [CrossRef] [Green Version]
  25. Liu, Y.; Li, L.; Yang, X.; Tan, J. Enhanced kalman-filtering iterative learning control with application to a wafer scanner. Inf. Sci. 2020, 541, 152–165. [Google Scholar] [CrossRef]
  26. Fang, H.; Tian, N.; Wang, Y.; Zhou, M.; Haile, M.A. Nonlinear Bayesian estimation: From Kalman filtering to a broader horizon. IEEE/CAA J. Autom. Sin. 2018, 5, 401–417. [Google Scholar] [CrossRef] [Green Version]
  27. Cumbo, R.; Tamarozzi, T.; Jiranek, P.; Desmet, W.; Masarati, P. State and Force Estimation on a Rotating Helicopter Blade through a Kalman-Based Approach. Sensors 2020, 20, 4196. [Google Scholar] [CrossRef]
  28. Sabatini, A.M. Quaternion-Based Extended Kalman Filter for Determining Orientation by Inertial and Magnetic Sensing. IEEE Trans. Biomed. Eng. 2006, 53, 1346–1356. [Google Scholar] [CrossRef]
  29. Wan, E.A.; Van Der Merwe, R. The unscented Kalman filter for nonlinear estimation. In Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373), Lake Louise, AB, Canada, 4 October 2000; pp. 153–158. [Google Scholar]
  30. Zhang, Y.; Xu, G.; Liu, X. An Improved SINS Alignment Method Based on Adaptive Cubature Kalman Filter. Sensors 2019, 19, 5509. [Google Scholar] [CrossRef] [Green Version]
  31. Kuure-Kinsey, M.; Palerm, C.C.; Bequette, B.W. A Dual-Rate Kalman Filter for Continuous Glucose Monitoring. In Proceedings of the 2006 International Conference of the IEEE Engineering in Medicine and Biology Society, New York, NY, USA, 30 August–3 September 2006; pp. 63–66. [Google Scholar]
  32. Steffes, S. Computationally Distributed Real-Time Dual Rate Kalman Filter. J. Guid. Control. Dyn. 2014, 37, 1064–1068. [Google Scholar] [CrossRef] [Green Version]
  33. Loy, G.; Fletcher, L.; Apostoloff, N.; Zelinsky, A. An adaptive fusion architecture for target tracking. In Proceedings of the Fifth IEEE International Conference on Automatic Face Gesture Recognition, Washington, DC, USA, 21–21 May 2002; pp. 261–266. [Google Scholar]
  34. Shen, K.; Wang, M.; Fu, M.; Yang, Y.; Yin, Z. Observability Analysis and Adaptive Information Fusion for Integrated Navigation of Unmanned Ground Vehicles. IEEE Trans. Ind. Electron. 2019, 67, 7659–7668. [Google Scholar] [CrossRef]
  35. Chen, Z.; Zhang, J.; Tao, D. Progressive LiDAR adaptation for road detection. IEEE/CAA J. Autom. Sin. 2019, 6, 693–702. [Google Scholar] [CrossRef] [Green Version]
  36. Liu, Y.; Yan, X.; Zhang, C.; Liu, W. An Ensemble Convolutional Neural Networks for Bearing Fault Diagnosis Using Multi-Sensor Data. Sensors 2019, 19, 5300. [Google Scholar] [CrossRef] [Green Version]
  37. Zhu, H.; Basir, O. A novel fuzzy evidential reasoning paradigm for data fusion with applications in image processing. Soft Comput. 2006, 10, 1169–1180. [Google Scholar] [CrossRef]
  38. Huang, Q.; Li, T.; Yang, X.; Hu, J. Dynamical Information Fusion of Multisource Incomplete Hybrid Information Systems Based on Conditional Entropy. In Proceedings of the 2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE), Dalian, China, 14–16 November 2019; pp. 1–8. [Google Scholar]
  39. Al Bitar, N.; Gavrilov, A.; Khalaf, W. Artificial Intelligence Based Methods for Accuracy Improvement of Integrated Navigation Systems During GNSS Signal Outages: An Analytical Overview. Gyroscopy Navig. 2020, 11, 41–58. [Google Scholar] [CrossRef]
  40. Zhang, D.; Wang, Z.; Masayoshi, T. Neural-Network-Based Iterative Learning Control for Multiple Tasks. IEEE Trans. Neural Networks Learn. Syst. 2020, 1–13. [Google Scholar] [CrossRef]
  41. Assad, A.; Khalaf, W.; Chouaib, I. Novel Adaptive Fuzzy Extended Kalman Filter for Attitude Estimation in Gps-Denied Environment. Gyroscopy Navig. 2019, 10, 131–146. [Google Scholar] [CrossRef]
  42. Zhao, Y.; Yan, G.; Qin, Y.; Fu, Q. A Novel Alignment Method for SINS with Large Misalignment Angles Based on EKF2 and AFIS. Sensors 2020, 20, 5975. [Google Scholar] [CrossRef] [PubMed]
  43. Pop, M.-D.; Proștean, O.; David, T.-M.; Proștean, G. Hybrid Solution Combining Kalman Filtering with Takagi–Sugeno Fuzzy Inference System for Online Car-Following Model Calibration. Sensors 2020, 20, 5539. [Google Scholar] [CrossRef] [PubMed]
  44. Bai, Y.; Wang, X.; Jin, X.-B.; Zhao, Z.; Zhang, B. A Neuron-Based Kalman Filter with Nonlinear Autoregressive Model. Sensors 2020, 20, 299. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Jang, J.-S.R. ANFIS: Adaptive-network-based fuzzy inference system. IEEE Trans. Syst. Man Cybern. 1993, 23, 665–685. [Google Scholar] [CrossRef]
  46. Karaboga, D.; Kaya, E. Adaptive network based fuzzy inference system (ANFIS) training approaches: A comprehensive survey. Artif. Intell. Rev. 2019, 52, 2263–2293. [Google Scholar] [CrossRef]
  47. Huang, J.; Zhang, C.; Zhu, G. Optimization Modeling for Attitude Measurement of a Tunnel Boring Machine. In Proceedings of the International Conference on Mechanical Engineering and Technology (ICMET-London 2011), London, UK, 24–25 November 2011; pp. 227–232. [Google Scholar]
  48. Peng, F.; Shuli, S. Distributed Fusion Estimation for Multisensor Multirate Systems with Stochastic Observation Multiplicative Noises. Math. Probl. Eng. 2014, 2014, 1–8. [Google Scholar] [CrossRef]
Figure 1. The yaw, pitch, and roll angles of a tunnel boring machine (TBM).
Figure 1. The yaw, pitch, and roll angles of a tunnel boring machine (TBM).
Sensors 21 00061 g001
Figure 2. Laser targeting system.
Figure 2. Laser targeting system.
Sensors 21 00061 g002
Figure 3. Dual-rate sampling: (a) sampling case of sensors; (b) attitude angle observed by sensor 1; (c) attitude angle observed by sensor 2.
Figure 3. Dual-rate sampling: (a) sampling case of sensors; (b) attitude angle observed by sensor 1; (c) attitude angle observed by sensor 2.
Sensors 21 00061 g003
Figure 4. Adaptive neuro-fuzzy inference system (ANFIS)-based information fusion method.
Figure 4. Adaptive neuro-fuzzy inference system (ANFIS)-based information fusion method.
Sensors 21 00061 g004
Figure 5. The structure of the single-input single-output Takagi–Sugeno type fuzzy neural networks.
Figure 5. The structure of the single-input single-output Takagi–Sugeno type fuzzy neural networks.
Sensors 21 00061 g005
Figure 6. Laser targeting system used in the experiment.
Figure 6. Laser targeting system used in the experiment.
Sensors 21 00061 g006
Figure 7. Sampled pitch and roll angles: (a) roll, (b) pitch.
Figure 7. Sampled pitch and roll angles: (a) roll, (b) pitch.
Sensors 21 00061 g007aSensors 21 00061 g007b
Figure 8. Observed and filtered roll angles.
Figure 8. Observed and filtered roll angles.
Sensors 21 00061 g008
Figure 9. Observed pitch angles.
Figure 9. Observed pitch angles.
Sensors 21 00061 g009
Figure 10. Membership function of the ANFIS.
Figure 10. Membership function of the ANFIS.
Sensors 21 00061 g010
Figure 11. Measurement error of the pitch angle predicted by ANFIS.
Figure 11. Measurement error of the pitch angle predicted by ANFIS.
Sensors 21 00061 g011
Figure 12. ANFIS-based information fusion for the pitch angle prediction at different times: (a) data 1; (b) data 2.
Figure 12. ANFIS-based information fusion for the pitch angle prediction at different times: (a) data 1; (b) data 2.
Sensors 21 00061 g012
Figure 13. ANFIS-based information fusion when the laser targeting system losses its signals.
Figure 13. ANFIS-based information fusion when the laser targeting system losses its signals.
Sensors 21 00061 g013
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

He, B.; Zhu, G.; Han, L.; Zhang, D. Adaptive-Neuro-Fuzzy-Based Information Fusion for the Attitude Prediction of TBMs. Sensors 2021, 21, 61. https://doi.org/10.3390/s21010061

AMA Style

He B, Zhu G, Han L, Zhang D. Adaptive-Neuro-Fuzzy-Based Information Fusion for the Attitude Prediction of TBMs. Sensors. 2021; 21(1):61. https://doi.org/10.3390/s21010061

Chicago/Turabian Style

He, Boning, Guoli Zhu, Lei Han, and Dailin Zhang. 2021. "Adaptive-Neuro-Fuzzy-Based Information Fusion for the Attitude Prediction of TBMs" Sensors 21, no. 1: 61. https://doi.org/10.3390/s21010061

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop