Next Article in Journal
Visual Sensor Networks and Related Applications
Next Article in Special Issue
Design of a Low-Cost Indoor Navigation System for Food Delivery Robot Based on Multi-Sensor Information Fusion
Previous Article in Journal
Automatic Focus Assessment on Dermoscopic Images Acquired with Smartphones
Previous Article in Special Issue
Low-Cost Real-Time PPP/INS Integration for Automated Land Vehicles
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Multi-Sensor Based Roadheader Positioning Model and Arbitrary Tunnel Cross Section Automatic Cutting

1
Department of Information Engineering, Shandong University of Science and Technology, Tai’an 271000, China
2
College of Computer Science and Engineering, Shandong University of Science and Technology & Research center of smart mine software engineering and technology, Qingdao 266590, China
3
Shandong Province Key Laboratory of Wisdom Mine Information Technology, Shandong University of Science and Technology, Qingdao 266590, China
4
Shandong Province Research Center of Intelligent Mine Software Engineering and Technology, Shandong Lionking Software Co., Ltd., Tai’an 271000, China
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(22), 4955; https://doi.org/10.3390/s19224955
Submission received: 16 October 2019 / Revised: 10 November 2019 / Accepted: 12 November 2019 / Published: 14 November 2019
(This article belongs to the Special Issue Multi-Sensor Systems for Positioning and Navigation)

Abstract

:
Autonomous posture detection and self-localization of roadheaders is the key to automatic tunneling and roadheader robotization. In this paper, a multi-sensor based positioning method, involving an inertial system for altitude angles measurement, total station for coordinate measurement, and sensors for measuring the real-time length of the hydraulic cylinder is presented for roadheader position measurement and posture detection. Based on this method, a positioning model for roadheader and cutter positioning is developed. Additionally, flexible trajectory planning methods are provided for automatic cutting. Based on the positioning model and the trajectory planning methods, an automatic cutting procedure is proposed and applied in practical tunneling. The experimental results verify the high accuracy and efficiency of both the positioning method and the model. Furthermore, it is indicated that arbitrary shapes can be generated automatically and precisely according to the planned trajectory, employing the automatic cutting procedure. Therefore, unmanned tunneling can be realized by employing the proposed automatic cutting process.

1. Introduction

Tunnels are usually constructed for transportation in mountainous areas and for coal mining underground. The tunnel working surface is the most dangerous and labor intensive place, where accidents and fatalities occur at a rather high frequency. Therefore, unmanned work should be realized urgently to protect the lives and health of the miners and improve work efficiency. A boom-type roadheader is the principal device for coal mine tunneling. Its automation, intellectualization, and robotization are of great significance for realizing unmanned tunneling. To realize the automation and robotization of the roadheader, the positioning of the roadheader and the cutter should be addressed. However, due to high dense dust, vibration, low-illumination, complicated background, magnetic disturbance, and electrostatic interference in the underground environment the positioning problem is a very difficult one to solve. Additionally, the unavailability or disability of the signals that can be used on the ground increases the difficulty of underground roadheader positioning.
Over the last decades, significant research has been done on this topic [1,2,3,4,5,6]. With laser targets acting as information sources, a visual measurement system was presented for pose detection by utilizing the cross laser beams received [4]. While this system can be used to obtain a precise result for roadheader pose detection, this method is inevitably subject to accuracy loss due to the dense dust that visual methods may suffer from. A kinetic model was built to determine the pose of the roadheader [5]. Although the error of the model was reported to be 16 mm for practical tunneling, the core issue, how to measure the pose angles, was not clearly stated. An ultra-wide band pose detection system was designed for roadheader pose detection [2], which was shown to be able to meet the accuracy requirement of a fully mechanized excavation face. However, it is generally considered that it is very difficult to achieve an error of less than 10 cm due to the limitations of the ultra-wide band technique itself, as well as its increasing error with increasing distance. Furthermore, the deployment of this method is troublesome, and multiple ultra-wide band stations need to be deployed. A monocular vision and strap down inertial navigation based roadheader pose detection system was presented, and test results with an error of 1 cm could be achieved [6]. However, it is known that the inertial system is subject to accumulated error from double integration as well as drift error for long distance and extensive running time. A pose detection method based on laser cross was proposed [7], in which a fan-shaped laser beam between the transmitter and the receiver was employed to calculate the roadheader pose. Although this method was shown to exhibit good performance, it was subject to complicated deployment as well as error problems when employed in practice. An inertial sensors and a stereo camera system [8] was presented for positioning vehicles with high accuracy. Similar to the ultra-wide band method, there was difficulty with both deployment and with obtaining a high accuracy. An infrared LED based method was proposed to position the roadheader [9], which was reported to achieve an accuracy of less than 3 cm, but the infrared LED based method suffers from a similar problem to the ultra-wide band method, that is, the error increases with the increasing distance. Therefore, while the aforementioned methods are presented, to the best of our knowledge, none of them have wide-spread applications in a practical tunneling project. The reason for this is that these methods are either underdeveloped or are unable to adapt themselves for application in a complex underground environment due to their deficiencies. Dust, humidity, and complicated device deployment and operation for unskilled workers means that the methods mentioned may not be able to function properly on the ground. Further efforts need to be made to tackle the pose detection and localization problems of the roadheader. Generally, the commonly used positioning methods are inertial system based, laser device based, or ultra-wide band based. Of these, the inertial navigation and laser are two prevailing positioning methods. However, neither of them can be employed for high accuracy positioning in harsh underground environments independently. The laser device method, with the requirement of complicated deployment and operation, can be challenging in a complex environment such as underground mining. While the inertial system can be employed for positioning without external signals being required, as mentioned above, it suffers from an accumulated error for long duration and long distance employment. Nevertheless, an inertial system can yield the pose angles with a high precision due to the significantly reduced integration error compared to the error from double integration for the positioning [8]. While the laser based total station, a commonly used electronic/optical instrument for surveying, has the potential to achieve very high accurate positioning, the application of total station underground is very limited due to the requirement that it should be leveled before employment, which would be a rather difficult operation for unskilled workers with no special training in the aforementioned complex environment.
The critical data that need to be acquired for positioning are the posture angles of the roadheader and the coordinates of a fixed point on the roadheader when taking the roadheader as a rigid body [9]. To efficiently solve the positioning problem and realize high accuracy positioning, the inertial system based method and the total station based method should be combined. Although the inertial system should not be employed for precise localization due to the possible inertial accumulated error, it can be employed for generating the pose angles with a high accuracy. In this way, the error can be reduced significantly due to the fact that only single integration is involved compared to the double integration involved for direct localization. With the high accuracy pose angles, the coordinate system of the roadheader can be obtained. Furthermore, if the coordinate system of the total station can be measured, the exact position of the roadheader can be calculated without leveling the total station.
According to this idea, in this manuscript, a positioning method based on the combined total station and inertial navigation and the corresponding position model are presented for roadheader and the cutter positioning. Based on the positioning model and the developed trajectory generation method, an automatic cutting procedure is developed.
The following section details the methods for this research, including the positioning principle of the roadheader and the cutter, the cutter control, the repositioning method caused by the moving of the positioning device itself, as well as trajectory planning and the automatic cutting process. Practical experiments for the roadheader and cutter positioning and for the automatic cutting process are carried out, and the results are given in Section 3. In Section 4, discussions are made, and in Section 5 this paper is concluded.

2. Methods

2.1. Principle of Positioning and Cutter Control

For our positioning solution, multiple sensors or surveying instruments are required, including a north-seeking gyroscope, an inertial system, a total station, a target-ball, and sensors that measure the real-time length of the hydraulic cylinders governing the vertical and horizontal motion of the roadheader cutter. The total station is employed to track and measure the azimuth and inclination angles of the target-ball installed on the roadheader in real-time, from which the coordinates can be calculated. Generally, the total station is required to be leveled before surveying starts, which raises a great challenge for unskilled coal miners in an uneven underground environment. Measures should be found to avoid the need to level the total station. Therefore, a north-seeking gyroscope is employed to measure the pose angles’ yaw and pitch, and the roll of the total station, which will be taken into account for the positioning computing. Consequently, the bottom of the north-seeking gyroscope and the total station should be fitted and fixed on the same plane in an explosion proof box and deployed behind at a distance from the roadheader (Figure 1). The inertial system is used for the roadheader pose angles measurement, and should be installed in a similar way to the north-seeking gyroscope. The inertial system should be equipped with the marked direction in line with the roadheader’s forward direction. The inertial system can measure the precise pose angles in real-time so that the accurate pose angles can be obtained even when the roadheader is moving in a constantly vibrating state. The north-seeking gyroscope cannot measure the dynamically changing pose, so it is used to measure the pose of the total station with little vibration. When the position of the total station is changed, its pose angles should be re-measured. Since a roadheader can be taken as a rigid body [5], any point on the roadheader can be situated with the measured relative position regarding the trackball position and the trackball position from the total station. The cutting head can be positioned with a calculated fix point on the roadheader according to the kinematics of the roadheader, which will be clarified in the following section. According to the positioning principle, the arrangements of the positioning solution can be made in the underground worksite, and the positioning system is illustrated in Figure 1. In Figure 1, the cube with the vertices f1, f2, f3, f4, f5, f6, f7, and f8 represents the tunnel, the cube with the vertices a, b, c, d, a1, b1, c1, and d1 represents the roadheader body, p is the cutter, and t is the target-ball, which receives the laser from the positioning box adjacent to the face f1, f4, f5, f8.

2.1.1. Positioning Workflow

In terms of the multiple sensors based positioning principle (Figure 1), a workflow is developed and is shown in Figure 2.
According to Figure 2, the total station will begin to search the target-ball after launch. Once the target-ball is found, the tracking mode will be started and the distance, azimuth, and inclination angles data will be output in real-time. Meanwhile, the north-seeking gyroscope outputs the yaw, pitch, and roll angles of the total station. The angles will be utilized for the total station coordinate system computing. With the total station coordinate system and the data from the total station, the target-ball coordinates can be calculated. Similarly, with the pose angles from the inertial system, the roadheader coordinate system can be calculated. As mentioned above, for any point on the roadheader, the relative coordinates with respect to the track-ball can be measured. With the relative coordinates and the roadheader coordinate system, any point on the roadheader can be positioned. To further calculate the cutter position, the rotation center on the roadheader should be calculated. Then, according to the kinematics of the roadheader [10], the cutter position relating to the rotation center can be calculated. In a similar way to the point positioning on the roadheader, the cutter position in the global coordinate system can be calculated. The positioning method is further detailed as follows.
To carry out the roadheader and cutter positioning, four coordinate systems are introduced, including the global coordinate system, O e X e Y e Z e , the roadheader coordinate system, O r X r Y r Z r , the tunnel coordinate system, O l X l Y l Z l , and the total station coordinate system, O o X o Y o Z o .
The global coordinate system, O e X e Y e Z e , has its origin at a point whose coordinates are measured with axis X e pointing east, axis Y e pointing north, and axis Z e perpendicular to X e and Y e and pointing upward. The roadheader coordinate system, O r X r Y r Z r , has the origin, O r , located at the horizontal, rot a q and a f are, respectively, the azimuth and inclination angles, and L is the distance from the total station origin to the point to be measured.
The pose angles of the total station, output by the north-seeking gyroscope, are employed to calculate the total station coordinate system. Combining the track-ball coordinates and the coordinate system, the track-ball global coordinates can be calculated according to Equation (1).
( x e b , y e b , z e b ) = ( x o b × o x + y o b × o y + z o b × o z ) + ( x o , y o , z o )
where o x , o y , o z are the normalized axis of the coordinate system, O r X r Y r Z r , ( x o b , y o b , z o b ) are the coordinates of the track-ball with respect to the origin, ( x o , y o , z o ) , and ( x e b , y e b , z e b ) are the coordinates of the track-ball in the global coordinate system.
To position a point on the roadheader, besides the track-ball coordinates already obtained, the relative coordinates of some roadheader points relating to the track-ball coordinates and the roadheader coordinate system are required. The former can be easily measured manually while the latter can be computed as mentioned above from the pose angles from the inertial system. With the target-ball coordinates, the roadheader coordinate system, and the relative coordinates certain points can be positioned in the global coordinate system according to Equation (2). Thus, roadheader positioning can be accomplished.
( x r , y r , z r ) = ( Δ x r × r x + Δ y r × r y + Δ z r × r z ) + ( x e b , y e b , z e b )
where ( r x , r y , r z ) is the normalized vector of the coordinate system, ( Δ x r , Δ y r , Δ z r ) are the relative coordinates with respect to the coordinate system origin under the coordinate system O r X r Y r Z r , and ( x e b , y e b , z e b ) are the coordinates of the target-ball.
Cutter positioning refers to locating the cutter in the global coordinate system. Prior to locating the cutter in the global coordinate system, the relative position of the cutter in the roadheader coordinate system should be calculated. The relative position computing principle is explained in Figure 3 and Figure 4.
Figure 3 illustrates the cutter motion in a horizontal direction. ∠MOE equals ∠NOF, denoted as θ , which remains unchanged and can be measured manually as can the length of OF and OE. M, M′, N, and N′ are on the outer circle, centered at the horizontal rotation center, O, R, and R′ are on the inner circle, and P′ and P denote the cutter position projection on the horizontal plane at different positions. The radius of the outer and inner circles can also be measured manually. The length of RP (RP in Figure 4) can be calculated according to Equation (7). Driven by the hydraulic thrust, N and M move to N′ and M′, respectively, and the cutter moves from P′ to P. The length of EM′ and FN′ can be measured by sensors equipped on the hydraulic cylinder for horizontal motion. Therefore, the angle, β , can be computed in ∆OFN′, according to Equation (3), and the coordinates x and y of the cutter, P, can be calculated following Equation (4).
β = arccos ( O N O N + O F O F F N F N 2 O N O F ) θ
{ x = ( O R + R P ) sin β y = ( O R + R P ) cos β
where x , y , O R , R P , β are showed in Figure 3.
Figure 4 illustrates the cutter motion in the vertical direction. O, R, and P represent the same point as Figure 3. R is the vertical rotation center, A is a fixed point, and the length of RA can be measured manually. ∆RBC″ rotates around R in the vertical direction, and the point C may arrive at different positions to C, C′, and C”, of which C′ is collinear with OR. The angle ∠ARC′, denoted as Ω , can be measured manually. The angles ∠BRC″ and ∠CRC′, and the length of RC″, denoted as a , φ , and l, respectively, can be measured manually. In ∆RBA, the lengths of RA and RB are constant and can be measured manually, and the length of AB is measured by the sensors equipped on the hydraulic cylinder for the vertical motion of the cutter, so the angle ∠BRA can be computed according to Equation (5), and a can be computed according to Equation (6). Therefore, the coordinate, z, can be computed according to Equation (8).
B R A = arccos ( ( R A × R A + R B × R B A B × A B ) / ( 2 × R A × R B ) )
a = B R A Ω + φ
R P = l × cos ( a )
z = l × sin ( a )
where B R A , R A , R B , A B , R P are showed in Figure 4.
With the relative coordinates ( x , y , z ) of the cutter, the origin O ( x r , y r , z r ) , and the coordinate system ( r x , r y , r z ) obtained, the cutter position ( x c , y c , z c ) in the global coordinate system can be calculated in terms of Equation (9).
( x c , y c , z c ) = ( x × r x + y × r y + z × r z ) + ( x r , y r , z r )

2.1.2. Cutter Control Model

To carry out the cutting operation to a certain position, the coordinates of the position should be converted to the length of the hydraulic cylinder to guide the cutter moving. Consequently, the length of the hydraulic cylinder should be computed for the given position.
From Figure 4 and Equations (5)–(8), the formula to compute the length of the hydraulic cylinder for vertical motion can be obtained (Equations (10)–(12)):
a = arcsin ( z / l )
B R A = Ω φ + a
A B = R A × R A + R B × R B × 2 × R A × R B × cos B R A
where B R A , R A , R B , A B , R P are showed in Figure 4.
According to Figure 3 and Equations (3), (4), (7), and (12), the formula to compute the length of the hydraulic cylinder for horizontal cutter motion can be obtained from:
β = arcsin ( x / ( O R + l × cos ( a ) ) )
F N = O N × O N + O F × O F 2 × O N × O F × cos ( β + θ )
where x , y , O R , R P , β are showed in Figure 3. With the calculated hydraulic cylinder length, the roadheader can move the cutter to the target position. It should be noted that the given global coordinates should be converted to the relative coordinates under the roadheader coordinate system as aforementioned, and the hydraulic cylinder length should be a reachable value in a range from the minimum to the maximum value.

2.1.3. Moving the Explosion Proof Positioning Box

After an advancement of about 20 m, the positioning box should move forward. The reason for this is that the total station is subject to occlusion at a too long distance. When moving the positioning box, the total station origin is changed, and it needs to be repositioned. To position the new origin, a point ( x r , y r , z r ) should be measured as a reference point and recorded before it is moved. The new origin ( x o n , y o n , z o n ) can be calculated according to the following equation:
( x o n , y o n , z o n ) = ( x r , y r , z r ) ( x o b × o x + y o b × o y + z o b × o z )
where ( x o b , y o b , z o b ) is the calculated relative coordinates relating to the new origin, and ( o x , o y , o z ) are the normalized axis of the total station coordinate system.

2.2. Arbitrary Cross Section Trajectory Planning and Automatic Cutting

2.2.1. Trajectory Planning

The cutter trajectory planning problem is actually a kind of complete coverage path problem [10], which can be solved by finding a path for the conical shaped cutter to move across the entire area of the cross section. Supposing that the radius of the cutter is r, the distance between any two adjacent points of the path can be chosen as r. The path can be designed using three methods.
The first is an S-shape (Figure 5) based method, which starts at the bottom-left corner (the circle filled with black color), then moves horizontally from left to right, then a distance of 2r vertically. It then moves from right to left, and finally up so that a complete loop is achieved. If such loops are repeated until the entire area is covered, the cutter trajectory is formulated. An array of three-dimensional coordinates is employed for the storage of such a trajectory. Figure 5 depicts this trajectory generation process. Furthermore, in addition to this S-shape path array, another array is required for storage of the path for swiping the border, which is traveled after the S-shape path is finished. The process for swiping borders is described in Figure 6.
The trajectory planning algorithm can be summarized as Algorithm 1.
Algorithm 1 Trajectory planning
1:
R the interval between the scan lines for cutter following
2:
V1 the left vertex of the bottom edge of the section
3:
V2 the right vertex of the bottom edge of the section
4:
for each scan line V1V2 l b o t t o m to l u p
5:
{
6:
V1 V1 + R Δ V l // Δ V l denotes the unit vector of the left directional ledge of the section
7:
V2 V2 + R Δ V r // Δ V r denotes the unit vector of the ridge directional ledge of the section
8:
V V1
9:
 while V V2
10:
  {
11:
   V V + R Δ V 12 // Δ V 12 denotes the unit vector of V1V2
12:
   Store V
13:
  }
14:
 }
15:
 for each e in edges{ }// edges {} refers to the bottom edges set
16:
 {
17:
 Compute the Vb// Vb refers to the border points
18:
   Store Vb
19:
   }
When implementing this algorithm, supposing that the cross section coordinates are in a coordinate system with the origin at the center, the y axis is perpendicular to the cross section and pointing in the advancing direction, the x axis is pointing in the right direction, and the z axis is pointing in the upward direction, the vertexes of the cross section can be easily obtained with the known parameters such as width, height, and so on.
The parametric equation for each edge of the polygon can be obtained according to its vertexes, which can be used to discretize the edge to obtain the arrays of points to act as the end points of each scan line segment. It should be noted that the points of the possible horizontal edge of the polygon can be represented with only the two end points, as Equation (16).
( x c , y c , z c ) = ( x p , y p , z p ) + Δ × ( x d , y d , z d )
where ( x c , y c , z c ) represents the current point, ( x p , y p , z p ) represents the previous point already calculated, and Δ represents the length increment in the direction ( x d , y d , z d ) .
With the generated edge point array, each horizontal scanning line segment can be obtained, which will be taken as one part of the whole trajectory generation. When generating the trajectory, as aforementioned, the bottom up order is followed.
It should be noted that the trajectory point array should be converted to the global coordinate system according to the aforementioned method, which will be further converted to the coordinates under the roadheader coordinate system for guiding the roadheader cutter movement.
The second method is based on a decreasing cross section polygon area size. The algorithm can be described as follows.
This method first discretizes the part of the polygon area that is bound by the original edges of the polygon and their parallel line segments in the inner part of the polygons, the distance between which is set as the diameter of the cutter. Then, taking the parallel inner line segments as the border, a smaller polygon is formulated, which can be discretized in the same way as the original polygon discretization. By repeating this operation until all of the polygon area is discretized, the trajectory can be obtained.
The third method can be employed for arbitrary trajectory generation, which allows the operator to generate the trajectory. This method can be described as follows.
The cross section should be decomposed into a collection of uniform grid cells of n rows and m columns, which is stored as a two-dimensional array of a size n by m.
The area of the screen should be divided into a collection of uniform grid cells in the same way, which should be mapped exactly with the cross section grids.
The position where the mouse is pressed down should be picked and converted into the row and the column of the screen grids, which will be employed to calculate the exact grid of the cross section. Once the trajectory point selections by the mouse are accomplished, the trajectory is generated.

2.2.2. Cutting Process

According to Figure 5 and Figure 6, prior to use for cutting the cross section, the cutter trajectory should be planned. A point array will be generated that stores the position coordinates for guiding the motion of the cutter. Then, the points will be sent one by one, followed by the hydraulic cylinder length computing for the sent points. The length will be delivered to the programming logic control unit (PLC) for guiding the cutting head motion. Meanwhile, the cutter head position will be calculated and compared with the target point. If the target point is reached, the next point will become the new target point. When all the points in the array have been traversed in order, the cutting process is finished. If both the trajectory path and the path for swiping the border are accomplished, the cutting process will be stopped.

3. Experiments and Results

Experiments were carried out underground on an EBZ160 roadheader for coal mining at the Zhaizhen Mine, which is owned by Xinwen Mining Group Co., Ltd. (Tai’an, China). The tests of the experiments can be divided into two steps, of which the former is the target-ball positioning test, that is, the roadheader positioning test, and the latter is the cutter positioning test. To obtain the actual results, another total station, named as the test total station, with the direction labeled strictly in line with the north direction, was employed as the global positioning system to measure the results directly. The total station for the roadheader positioning model was named as the measure total station. The results from the two total stations were compared to test the error. Before the experiments began, the test total station was situated so that the two total stations were under the same coordinate system. The test total station was employed to measure two points, which were utilized for the positioning of the measure total station. With the positioned measure total station, the positioning results of the target-ball were output by the positioning program, which were obtained by combining the outputs of both the positioning total station and the pose measurement of the total station by the north-seeking compass.
These results are shown in Table 1. In Table 1, Tball_mx, Tball_my, and Tball_mz are the coordinates of the target-ball from the measure total station, while Tball_x, Tball_y, and Tball_z are the coordinates from the test total station. Root mean square error (RMSE) provides an accuracy index at a global level, which is expressed as follows:
R M S E = i = 1 n ( m i p i ) 2 n )
where m i , p i , and n denote the ith result by the test total station, the ith positioning result by the measure total station, and the number of the validation points, respectively. RMSE was employed to estimate the error of the positioning results. The errors of each point are showed in Table 2. RMSE for x, y, and z were calculated as 0.049602, 0.02055, and 0.027588, respectively, with meter (m) as the unit.
The origin of the global coordinate system was set at the point (42.991, −11.74, 3.294), the pose angles yaw, pitch, and roll from the gyroscope, denoted as α , β , and γ were, respectively, 292.495, 0.0055, and −1.1044, and the pose angles α , β , and γ from the inertial system were 65.72, −0.093, and 0.083, respectively. With the pose angles from the gyroscope, the target-ball coordinates were computed, and the results were 15.113, −1.648, and 4.08. With the relative coordinates (−0.458, 2.865, and −0.704) and the pose angles from the inertial system, the roadheader center coordinates were computed as 12.69037, −0.0538364, and 3.370688. Supposing these were set before the cutting head starts to work, with different real-time lengths of the hydraulic cylinder, different cutter point coordinates could be computed. To test the error of the cutter positioning, a cross section was built according to the aforementioned cutting process. This cross section was of a size of 5.2 by 4.5 m. According to Figure 7, the cross section was discretized in steps of 0.8 m, and the trajectory was generated and stored in a point array with a size of 120. The cutter moved from the first point at the bottom left position to the center point according to the trajectory, and Figure 8 shows the cutting process for the cross section. After the cutting process was completed, the cross section was formulated, as showed in Figure 8.
The results from the cutter positioning for the whole cross section were calculated, and only the corner points are showed in Table 3, since only the border has an impact on the accuracy of the cross section shape formulation. Table 3 shows the coordinate comparisons, and the errors of each point coordinate are shown in Table 4. RMSE values for x, y, and z were calculated, and the results were 0.059937113, 0.013302904, and 0.01617986, respectively. For the whole cross section, the errors for 120 sampled points were calculated and yielded RMSE value of 0.041254321, 0.012413522, and 0.01306654.
The other two trajectory generation methods were also tested and employed for automatic cutting (Figure 9 and Figure 10). Figure 9 shows the automatic cutting process according to the S-shaped trajectory planning, while Figure 10 shows the automatic cutting process according to the arbitrary trajectory planning.

4. Discussion

Positioning models for the roadheader and the cutter were proposed, and an automatic cutting process based on the positioning models was also proposed. The experiments for the positioning models were carried out and automatic cutting of a practical tunnel was tested according to the automatic cutting method.
According to the experimental results for roadheader positioning, it was verified that the roadheader positioning model could achieve a result with a high accuracy when positioning the roadheader. The maximum error was less than 5 cm, which satisfies the requirements of roadheader positioning and automatic cutting. The reason for this can be attributed to the adoption of high accuracy total station, which provides an accurate result. Furthermore, it should be noted that the most important factor is the adoption of a gyroscope and the positioning computing algorithm fused with the pose angles information of total station, which efficiently and accurately generate the precise positioning result.
As for the cutter positioning, the error that is obtained is also a small value, which results in a high accuracy. This result is achieved from the cutter positioning model, which is impacted by both the cutter relative positioning method and the cutter positioning model. It should also be noted that the parameters of the roadheader determine the cutter relative positioning model. Only with the optimized parameters can the cutter relative positioning obtain a result with a high accuracy. It should be noted that parameter optimization is a non-trivial work that requires great patience. Additionally, the precise pose angles contribute greatly to the accurate positioning of the cutter.
Three trajectory generation methods are provided, which can support the trajectory planner in a very flexible way. With the three methods for trajectory generation, the automatic cutting process can be well carried out, and the shape of the cross section can be well formulated, which lays the foundation for complete automatic cutting with automatic roadheader movement.
Due to the accurate positioning of the roadheader and cutter, the automatic cutting of practical tunnels exhibits a high accuracy, which achieves a result with an error of 5 cm. It should be noted that, although the cross section shape is well formulated, the errors of the corner points and the whole cross section points differ. Furthermore, the corner points have a bigger error than the whole of the cross section points. This may indicate that the quality of the formulated shape is impacted not only by the positioning model but also by the speed change of the cutter, and the latter may have an obvious negative impact on the cutting error, which will be further studied.

5. Conclusions

In this paper, to address the roadheader and the cutter positioning problem in underground environments, by combining multiple sensors, such as the inertial navigation system, total station, and a north-seeking gyroscope, a positioning method is proposed, and a corresponding positioning model is built. The experiment demonstrates that the positioning method can realize the precise positioning of both the roadheader and the cutter. Furthermore, with the flexible trajectory planning methods provided, and based on the positioning method, an automatic cutting process is proposed, and practical automatic tunneling exhibits a well formulated shape and high formulation accuracy. The positioning model and automatic cutting process lays a sound foundation for smart tunneling, and the automatic cutting process requires no intervention from the operators and can be utilized to implement complete autonomous tunneling, which will be the future focus of our work.

Author Contributions

Conceptualization, X.L. and C.Y.; methodology, X.L.; software, C.Y.; validation, X.L.; investigation, X.L.; writing—original draft preparation, C.Y.; writing—review and editing, W.Z. and C.Y.; visualization, X.L.; supervision, X.L.; funding acquisition, X.L.

Funding

This research was funded by Key R&D Programs, grant number 2017YFC0804406. Additionally, it was partly funded by the Fund for Oversea Visitor Scholars from Shandong University of Science and Technology.

Acknowledgments

The authors acknowledge the support from the Xinwen Mining Group Co., Ltd. for their assistance in the experiments.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wang, L.; Yang, X.; Gong, G.; Du, J. Pose and trajectory control of shield tunneling machine in complicated stratum. Autom. Constr. 2018, 93, 192–199. [Google Scholar] [CrossRef]
  2. Fu, S.; Li, Y.; Zong, K.; Liu, C.; Liu, D.; Wu, M. Ultra-wideband pose detection method based on TDOA positioning model for boom-type roadheader. AEU Int. J. Electron. Commun. 2019, 99, 70–80. [Google Scholar] [CrossRef]
  3. Vahdatikhaki, F.; Hammad, A.; Siddiqui, H. Optimization-based excavator pose estimation using real-time location systems. Autom. Constr. 2015, 56, 76–92. [Google Scholar] [CrossRef]
  4. Du, Y.; Tong, M.; Liu, T.; Dong, H. Visual measurement system for roadheaders pose detection in mines. Opt. Eng. 2016, 55, 104–107. [Google Scholar] [CrossRef]
  5. Tian, J.; Wang, S.; Wu, M. Kinematic models and simulations for trajectory planning in the cutting of Spatially-Arbitrary crosssections by a robotic roadheader. Tunn. Undergr. Sp. Tech. 2018, 78, 115–123. [Google Scholar] [CrossRef]
  6. Yang, J.; Zhang, G.; Huang, Z.; Ye, Y.; Ma, B.; Wang, Y. Research on position and orientation measurement method for roadheader based on vision/INS. In Proceedings of the 2017 International Conference on Optical Instruments and Technology: Optoelectronic Measurement Technology and Systems, International Society for Optics and Photonics, Beijing, China, 12 January 2018; p. 1062105. [Google Scholar]
  7. Zong, K.; Jia, W.; Wu, M. Position and Attitude Measurement System Design of Boom-type Roadheader. DEStech Trans. Mater. Sci. Eng. 2016, 167–173. [Google Scholar] [CrossRef]
  8. Barrett, J.M.; Gennert, M.A.; Michalson, W.R.; Audi, M.D.; Center, J.L.; Kirk, J.F.; Welch, B.W. Development of a low-cost, self-contained, combined vision and inertial navigation system. In Proceedings of the 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA), Woburn, MA, USA, 22–23 April 2013; pp. 1–6. [Google Scholar]
  9. Yang, W.J.; Zhang, X.H.; Ma, H.W.; Zhang, G.M. Infrared LEDs-Based Pose Estimation with Underground Camera Model for Boom-Type Roadheader in Coal Mining. IEEE Access 2019, 7, 33698–33712. [Google Scholar] [CrossRef]
  10. Galceran, E.; Carreras, M. A survey on coverage path planning for robotics. Robot. Auton. Syst. 2013, 61, 1258–1276. [Google Scholar] [CrossRef] [Green Version]
Figure 1. The principle of robotic roadheader positioning. The cube with the vertices f1, f2, f3, f4, f5, f6, f7, and f8 represents the tunnel, the cube with the vertices a, b, c, d, a1, b1, c1, and d1 represents the roadheader body, p is the cutter, and t is the target-ball, which receives the laser from the positioning box on the left.
Figure 1. The principle of robotic roadheader positioning. The cube with the vertices f1, f2, f3, f4, f5, f6, f7, and f8 represents the tunnel, the cube with the vertices a, b, c, d, a1, b1, c1, and d1 represents the roadheader body, p is the cutter, and t is the target-ball, which receives the laser from the positioning box on the left.
Sensors 19 04955 g001
Figure 2. Positioning workflow.
Figure 2. Positioning workflow.
Sensors 19 04955 g002
Figure 3. Cutter motion in horizontal direction. M, M′, N, and N′ are on the outer circle, centered at the horizontal rotation center, O, R, and R′ are on the inner circle, and P′ and P denote the cutter position projection on the horizontal plane at different positions.
Figure 3. Cutter motion in horizontal direction. M, M′, N, and N′ are on the outer circle, centered at the horizontal rotation center, O, R, and R′ are on the inner circle, and P′ and P denote the cutter position projection on the horizontal plane at different positions.
Sensors 19 04955 g003
Figure 4. Cutter motion in the vertical direction.
Figure 4. Cutter motion in the vertical direction.
Sensors 19 04955 g004
Figure 5. Trajectory planning for inner cross section.
Figure 5. Trajectory planning for inner cross section.
Sensors 19 04955 g005
Figure 6. Trajectory planning for border swiping.
Figure 6. Trajectory planning for border swiping.
Sensors 19 04955 g006
Figure 7. Workflow for robotic roadheader.
Figure 7. Workflow for robotic roadheader.
Sensors 19 04955 g007
Figure 8. Decreasing polygon size trajectory planning and the automatic cutting process by the robotic roadheader.
Figure 8. Decreasing polygon size trajectory planning and the automatic cutting process by the robotic roadheader.
Sensors 19 04955 g008
Figure 9. S-shaped trajectory planning and cutting.
Figure 9. S-shaped trajectory planning and cutting.
Sensors 19 04955 g009
Figure 10. Arbitrary trajectory planning and cutting.
Figure 10. Arbitrary trajectory planning and cutting.
Sensors 19 04955 g010
Table 1. Comparison between the real coordinates and the positioning coordinates (m). Tball_mx, Tball_my, and Tball_mz are the coordinates of the target-ball from the measure total station, while Tball_x, Tball_y, and Tball_z are the coordinates from the test total station.
Table 1. Comparison between the real coordinates and the positioning coordinates (m). Tball_mx, Tball_my, and Tball_mz are the coordinates of the target-ball from the measure total station, while Tball_x, Tball_y, and Tball_z are the coordinates from the test total station.
Tball_mxTball_myTball_mzTball_xTball_yTball_z
2.551−6.0253.7962.473−6.023.80201
7.261−3.6573.7597.22−3.6783.75789
−2.5496.0593.513−2.6276275.3018033.49537
−2.9586.8646.143−3.017616.2471426.168197
−2.6796.2481.945−2.7246175.5162081.926952
−5.5665.5262.959−5.8020434.9442342.934521
−2.6396.1463.44−2.7132925.4314373.5042
−5.6275.6373.99−5.812264.9428523.99768
Table 2. Roadheader positioning error (m).
Table 2. Roadheader positioning error (m).
Error_xError_yError_z
0.07174−0.00259−0.00601
0.031610.0209110.00111
0.0786270.0041970.01763
0.059610.016858−0.0252
0.0456170.0117920.018048
0.036043−0.018230.024479
0.0142920.014563−0.0642
−0.014740.044148−0.00768
Table 3. Comparison between the real coordinates and the positioning coordinates (m).
Table 3. Comparison between the real coordinates and the positioning coordinates (m).
Cutter_mx Cutter_myCutter_mzCutter_xCutter_yCutter_z
2.1178.1864.5972.1453528.1584424.571989
2.1178.1292.4232.1666048.1061512.392711
1.9298.4685.4421.991268.4858175.47986
−0.2327.5453.521−0.168317.492673.503577
3.3838.8033.5473.3868128.7925613.496827
Table 4. Error table for the cutter positioning (m).
Table 4. Error table for the cutter positioning (m).
Error_xError_yError_z
0.07174−0.00259−0.00601
0.031610.0209110.00111
0.0786270.0041970.01763
0.059610.016858−0.0252
0.0456170.0117920.018048

Share and Cite

MDPI and ACS Style

Yan, C.; Zhao, W.; Lu, X. A Multi-Sensor Based Roadheader Positioning Model and Arbitrary Tunnel Cross Section Automatic Cutting. Sensors 2019, 19, 4955. https://doi.org/10.3390/s19224955

AMA Style

Yan C, Zhao W, Lu X. A Multi-Sensor Based Roadheader Positioning Model and Arbitrary Tunnel Cross Section Automatic Cutting. Sensors. 2019; 19(22):4955. https://doi.org/10.3390/s19224955

Chicago/Turabian Style

Yan, Changqing, Wenxiao Zhao, and Xinming Lu. 2019. "A Multi-Sensor Based Roadheader Positioning Model and Arbitrary Tunnel Cross Section Automatic Cutting" Sensors 19, no. 22: 4955. https://doi.org/10.3390/s19224955

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop