Registration of Terrestrial Laser Scanning Surveys Using Terrain-Invariant Regions for Measuring Exploitative Volumes over Open-Pit Mines

: Terrestrial laser scanning (TLS) techniques have been widely used in open-pit mine applications. It is a crucial task to measure the exploitative volume of open-pit mines, within a speciﬁc time interval. One major challenge is posed, however, when conducting accurate registrations for temporal TLS surveys in continuously changing areas, created by excavation activities. In this paper, we propose a coarse-to-ﬁne registration method, based on terrain-invariant regions (TIR), for temporal TLS surveys. More speciﬁcally, an approximate four-point congruent set (4PCS) of temporal TLS surveys is ﬁrst identiﬁed, based on afﬁne invariant rules. Second, a set of correspondences among temporal TLS surveys were collected by matching multi-scale sparse features of the 3D neighbors, centered at the approximate 4PCS. Third, the correspondences were used to estimate a rigid motion between the overlapping TLS surveys for the coarse registration, according to which the initial TIR from temporal TLS surveys were identiﬁed. Finally, the rigid motion between temporal TLS was iteratively optimized, based on the point clouds, only from the TIR. Based on the ﬁne-level registered TLS surveys, Digital Elevation Models (DEMs) can be generated to calculate the exploitative volume, through a DEM differential. We applied the proposed method to two open-pit mines in China, and also compared our method with ﬁve state-of-the-art methods for registering temporal TLS surveys. Experimental results indicated that the proposed method achieved a higher registration accuracy than the state-of-the-art methods. Based on the registered result, our method achieved a 98.03% overall accuracy for measuring the exploitative volume, compared to in-situ measurement.


Introduction
Measuring the exploitative volume over open-pit mines plays an important role in excavation planning, environment protection, and hazards prevention. Field surveying, photogrammetry, and terrestrial laser scanning (TLS) are common methods for measuring exploitative volume over open-pit mines [1]. Compared with the two former methods, TLS enables the collection of dense 3D data in a straightforward scheme. Good examples of using TLS for measuring exploitative volume over open-pit mines can be found in the literature [2,3]. In these studies, the exploitative volume between time intervals was calculated by means of Difference of Digital Elevation Models (DoD) techniques. This paper is organized as follows. Section 2 describes the experimental sites and data used. Section 3 starts by describing the framework of the proposed method, followed by illustrations of each component of the proposed method and baseline methods used for comparison. The experimental results are presented in Section 4, followed by a discussion in Section 5 and the conclusions of this study in Section 6. This paper is organized as follows. Section 2 describes the experimental sites and data used. Section 3 starts by describing the framework of the proposed method, followed by illustrations of each component of the proposed method and baseline methods used for comparison. The experimental results are presented in Section 4, followed by a discussion in Section 5 and the conclusions of this study in Section 6.

Study Area
We conducted experiments in two open-pit mines in China, labelled as site A and site B ( Figure  1). The site A was an iron open-pit mine, located in the southwest of Anqian City in the Liaoning province ( Figure 1a). It had an area of 0.6 km 2 , with a maximum depth of 170 m, where seven types of minerals, with respect to Fehw, Fepp, Fehp, Feh, Fec, Am, and Cs were found. Site B was a goldcopper mine in the southwest of the Fujian province of China (Figure 1b). Compared with site A, site B had a larger area of 4.5 km 2 , with a maximum depth of 1140 m.

Terrestrial Surveying
We used a long-range terrestrial laser scanner, i.e., Riegl VZ-4000 (Figure 2a), to capture the point clouds over sites A and B. The technical specifications of the scanner are listed in Table 1. We conducted two sequential surveys in site A on 12 September 2017 and 12 October 2017 and site B on 13 March 2013 and 10 July 2013, respectively. For each survey, we obtained three partial scans to cover the whole mine surface of both sites. The maximum distance from the scanner to the ore surface was estimated at 1 km and 1.5 km for sites A and B, leading to point resolution (horizontal × vertical) of 0.8 m × 0.24 m and 1.2 m × 0.36 m, at the corresponding distances, respectively. For fast implementation, the point clouds for each scans were resampled, with a point resolution of 0.8 m and 1.5 m, for site A and site B, respectively. By doing so, the unevenness of point clouds due to scanning range was removed, maintaining a small number of points that was adequate for characterizing the terrain.

Terrestrial Surveying
We used a long-range terrestrial laser scanner, i.e., Riegl VZ-4000 (Figure 2a), to capture the point clouds over sites A and B. The technical specifications of the scanner are listed in Table 1. We  conducted two sequential surveys in site A on 12 September 2017 and 12 October 2017 and site B on  13 March 2013 and 10 July 2013, respectively. For each survey, we obtained three partial scans to cover the whole mine surface of both sites. The maximum distance from the scanner to the ore surface was estimated at 1 km and 1.5 km for sites A and B, leading to point resolution (horizontal × vertical) of 0.8 m × 0.24 m and 1.2 m × 0.36 m, at the corresponding distances, respectively. For fast implementation, the point clouds for each scans were resampled, with a point resolution of 0.8 m and 1.5 m, for site A and site B, respectively. By doing so, the unevenness of point clouds due to scanning range was removed, maintaining a small number of points that was adequate for characterizing the terrain.
In addition, we measured the scanning positions with an external GNSS rover based on the local Continuous Operational Reference System (CORSS), with a maximum positioning error of ± 1 cm. In order to guarantee the accuracy of all surveys, we checked the positions for a permanent control point (Figure 2b), and corrected the system error of GNSS rover, before the surveys.    In addition, we measured the scanning positions with an external GNSS rover based on the local Continuous Operational Reference System (CORSS), with a maximum positioning error of ± 1 cm. In order to guarantee the accuracy of all surveys, we checked the positions for a permanent control point (Figure 2b), and corrected the system error of GNSS rover, before the surveys.  Figure 3 illustrates the workflow of the proposed registration method of using terrain-invariant regions (TIR) for measuring exploitative volumes over open-pit mines from TLS point clouds. It consists of four main components: (a) the identification of approximate congruent sets from temporal TLS surveys, (b) the coarse-level registration of temporal TLS surveys by matching multi-scale sparse features, (c) the fine-level registration of temporal TLS surveys, through ICP optimization on TIR, and (d) the calculation of exploitative volumes from the registered temporal TLS surveys. More specifically, we first identified an approximate congruent set, based on methodical rules, considering affine invariant features and normal constraints. Then, we collected additional correspondences by matching multi-scale sparse features of 3D neighbors, centered at the approximate congruent sets, based on which a global rigid motion could be estimated. Next, the TIRs from the temporal TLS surveys were iteratively identified through a threshold scheme, where the ICP optimization was performed for fine registration. Last, the registered temporal TLS surveys were used for measurement of exploitative volumes, through DoD techniques. The four components of the proposed method are described in details in the following sections.

Methodology
Remote Sens. 2019, 11, x FOR PEER REVIEW 5 of 17 Figure 3 illustrates the workflow of the proposed registration method of using terrain-invariant regions (TIR) for measuring exploitative volumes over open-pit mines from TLS point clouds. It consists of four main components: (a) the identification of approximate congruent sets from temporal TLS surveys, (b) the coarse-level registration of temporal TLS surveys by matching multi-scale sparse features, (c) the fine-level registration of temporal TLS surveys, through ICP optimization on TIR, and (d) the calculation of exploitative volumes from the registered temporal TLS surveys. More specifically, we first identified an approximate congruent set, based on methodical rules, considering affine invariant features and normal constraints. Then, we collected additional correspondences by matching multi-scale sparse features of 3D neighbors, centered at the approximate congruent sets, based on which a global rigid motion could be estimated. Next, the TIRs from the temporal TLS surveys were iteratively identified through a threshold scheme, where the ICP optimization was performed for fine registration. Last, the registered temporal TLS surveys were used for measurement of exploitative volumes, through DoD techniques. The four components of the proposed method are described in details in the following sections.

Identification of Approximate Congruent Sets from Temporal TLS Surveys
We use the 4PCS algorithm to identify the initial congruent sets from temporal TLS surveys. Let J = {p1, p2, p3, p4} and S = {q1, q2, q3, q4} be a pair of approximate 4-point congruent sets in two temporal TLS surveys, respectively, under the following conditions. The corresponding affine invariant ratios are equal, i.e., λ1 = λ3, λ2 = λ4 and The lengths of the corresponding lines are less than an epsilon as The angles of the corresponding lines, as shown in Figure 4, are equivalent to,

Identification of Approximate Congruent Sets from Temporal TLS Surveys
We use the 4PCS algorithm to identify the initial congruent sets from temporal TLS surveys. Let J = {p 1 , p 2 , p 3 , p 4 } and S = {q 1 , q 2 , q 3 , q 4 } be a pair of approximate 4-point congruent sets in two temporal TLS surveys, respectively, under the following conditions.
The corresponding affine invariant ratios are equal, i.e., λ 1 = λ 3 , λ 2 = λ 4 and Remote Sens. 2019, 11, 606 6 of 17 The lengths of the corresponding lines are less than an epsilon ε as The angles of the corresponding lines, as shown in Figure 4, are equivalent to, We adopted normal constraints to remove the redundant 4-point bases that exist in a plane surface, to improve the efficiency and robustness [40].

Coarse Registration of Temporal TLS Surveys by Matching Multi-Scale Sparse Features
Since the point clouds are unordered, with an uneven density, the identified 4-point tuple in one TLS survey did not exactly match the 4-point bases in the other. To solve this issue, we considered the similarity of multi-scale features between the two sets of 3D neighborhood points that centered at the approximate 4PCS, from the different TLS surveys. Following the strategy in [40], we extracted the point features [49][50][51], at three scales, i.e., r, r + r, and r + 2 r, where r is a predefined search radius, and r is a scale interval. This configuration enabled us to handle the problems associated with various point densities and noise. The spherical neighborhood was used at each defined scale. For each point p, we designed a point feature descriptor x, by concatenating the obtained multi-scale geometric features into one vector. Since the extracted features might have different dimensions, we normalized the dimension of each extracted feature in x, before the sparse feature representation. Additionally, a sparse coding phase was performed on the achieved feature vector, in order to remove redundant information from the feature space, producing a set of multi-scale sparse features (MSSF).
Differing from the existing study in [40], which collected the most congruent 4-point sets, we identified all the matches from the 3D neighbor point sets centered at the approximated 4PCS. Let p 1 ∈ J and q 1 ∈ S be a pair of approximate congruent points from two temporal TLS surveys, where Adj(p 1 ) and Adj(q 1 ) are the corresponding 3D neighbors centered at p 1 and q 1 , respectively. For an MSSF vector X ∈ Adj(p 1 ), if there exists a MSSF vector Y ∈ Adj(q 1 ) satisfying Equation (4), the pair of points c(X, Y) encoded X and Y vectors can be considered to be a correspondence. The definition is given by, where T is a predefined threshold, r XY is the correlation coefficient. The coefficient can then be estimated as, where X and Y are the mean values of MSSF vectors.
As the threshold-based models retrieved correspondences contain numerous incorrect matches, we used the random sample consensus method (RANSAC) [52] to eliminate the incorrect matches, where a set of pairwise correspondences C{c 1 , c 2 , · · · , c m } between the two temporal TLS surveys was produced. With that, we estimated a pairwise coarse rigid motion M C Q,P between the two TLS surveys, i.e., P and Q, for the coarse-level registration as Equation (6).
where σ is the sum of the Euclidean distance between the correspondences, after the coarse rigid motion, i.e., M C Q,P , between TLS surveys P and Q, P(i) and Q(i) are the ith correspondence c 1 ∈ C in P and Q TLS surveys, respectively, #C is number of correspondences in C.

Fine Registration of Temporal TLS Surveys through ICP Optimization on Terrain-Invariant Regions
The proposed algorithm aligns Q to P, with an iterative scheme consisting of TIR extraction, ICP optimization, and rigid body transformation.
TIR extraction: After the coarse registration, we estimated the Euclidean distance E(P(i), Q(j)) between the nearest points P(i) and Q(j) from P and Q TLS surveys, respectively. Based on this, the corresponding points, with E(P(i), Q(j)) < τ (τ > 0 referring to a predefined threshold, were collected as the initial pair of TIRs between the two temporal TLS surveys, i.e., P and Q. ICP optimization: With the retrieved TIRs, respectively named as TIR P and TIR Q from the P and Q temporal TLS surveys, we optimized the rigid motion through the least squares registration, as described in Equation (7).
where δ t is the sum of the Euclidean distance between the correspondences after the tth fine rigid motion M tF Q,P , N is the smaller number of points in TIR P and TIR Q , and TIR P (i) and TIR Q (i) are the ith pair of nearest points in the TIRs of the two temporal TLS surveys.
After each iteration of ICP optimization, we updated the TIRs by reducing the preset threshold τ as Equation (8).
where t is the iteration number, and ω is a constraint value. The above phases were repeated, from the TIR extraction to ICP optimization, until they met the following criteria, where b is a preset threshold. Rigid body transformation: Based on the fine rigid motion M F Q,P , we transformed the overall TLS survey Q to the TLS P, accordingly.

Volume Calculation and Method Comparison
After registering the temporal TLS surveys, we obtained the difference map between the temporal DEMs, by subtracting the post-phase DEM from the pre-phase DEM. Then, we filled the difference map into a raster structure and calculated the volume extracted between a specific time interval, by summing up the raster cells volume as, where L i,j is the size of the (i, j)th raster, ∆h i,j is the distance value on the (i, j)th raster, and ω i,j is a weight that satisfies, where > 0 is a pre-defined threshold value. We compared the proposed registration method with five state-of-the-art methods, as follows. First, we used a manual-based method, with a coarse-to-fine configuration, where we manually selected the correspondences for the coarse registration and the main TIRs for the ICP optimization. Then, we compared our approach with the two methods mentioned above, i.e., Super4PCS and MSSF-Super4PCS, respectively. Furthermore, we compared our approach to the aforementioned two methods with ICP optimization, labeled as Super4PCS+ICP and MSSF-Super4PCS+ICP, respectively. We estimated the root-mean-square error (RMSE) of distances between the nearest points from the registered temporal TLS surveys, to quantify the registration accuracy. For each registration, we calculates the RMSE value by, where n is the minimum number of points in the P and Q TLS surveys. P(k) and Q(k) are the kth pair of nearest points between the P and Q TLS surveys, respectively. M F Q,P is the rigid motion of fine estimates from the P to Q TLS surveys.
Moreover, we compared our method with that of in situ counting in site A, for measuring the exploitative volumes. Note that, we cannot obtain the exact volume extracted between the time interval, we instead used the in-situ counting quantity for comparison. Here, the mineral distribution, together with their density were investigated. Following that, we calculated the exploitative quantity by multiplying the achieved exploitative volumes, to the corresponding mineral densities.

Registration of Multi-Station TLS Point Clouds
We used the MSSF-Super4PCS+ICP method to register the TLS point clouds from multiple scans of each survey in sites A and B, respectively. Figure 5 shows the registered results of the TLS surveys, in both sites. From the overlapping areas of local registration (marked in dark boxes), we calculated the RMSE values of distances between the nearest point pairs in Table 2. The RMSE values of the registration were 0.47 m and 0.38 m, for the two TLS surveys in site A, whereas the corresponding values of the registration in site B were 0.84 m and 1.05 m. Additionally, we respectively selected the local regions with respect to A0 and B0 from Figure 5b, c to generate the 2D-meshes with a plane triangulation algorithm. From these local regions, we measured the mesh-to-mesh distances, and demonstrated the maximum distances within ±0.04 m and ±0.15 m for the two sites, respectively. These distance values were comparable to the a priori range precisions of the TLS instrument (see Table 1), i.e., 0.057 m at a 500 m range distance for site A, and 0.117 m at a 1000 m range distance for site B, which demonstrated the accuracy of the registration.

Registration of Temporal TLS Surveys
Based on the registered results of each survey, we performed the registration of temporal TLS surveys. Figure 6 shows the registration results of both sites yielded by different methods. One can see that similar results were obtained for both sites. In detail, the proposed method obtained comparable results to the one achieved, manually, and outperformed the four other methods, i.e., Super4PCS, MSSF-Super4PCS, Super4PCS+ICP, and MSSF-Super4PCS+ICP.
We selected overlapping areas from sites A and B, corresponding to a1 and b1, respectively, to generate the mesh-to-mesh distance maps, as shown in Figures 7 and 8. The distances between the registered two temporal TLS surveys were estimated, as shown in the color bar. Again, both, the proposed method and the manual method performed better than the four other methods. As shown in the neutral zone of the color bar, the maximum mesh-to-mesh distances between the registered temporal TLS surveys were within ±0.1 m and ±0.2 m for sites A and B, respectively.

Registration of Temporal TLS Surveys
Based on the registered results of each survey, we performed the registration of temporal TLS surveys. Figure 6 shows the registration results of both sites yielded by different methods. One can see that similar results were obtained for both sites. In detail, the proposed method obtained comparable results to the one achieved, manually, and outperformed the four other methods, i.e., Super4PCS, MSSF-Super4PCS, Super4PCS+ICP, and MSSF-Super4PCS+ICP.
We selected overlapping areas from sites A and B, corresponding to a1 and b1, respectively, to generate the mesh-to-mesh distance maps, as shown in Figures 7 and 8. The distances between the registered two temporal TLS surveys were estimated, as shown in the color bar. Again, both, the proposed method and the manual method performed better than the four other methods. As shown in the neutral zone of the color bar, the maximum mesh-to-mesh distances between the registered temporal TLS surveys were within ±0.1 m and ±0.2 m for sites A and B, respectively.      Moreover, we respectively selected the local overlapping areas of a1-a4 and b1-b3 from the sites A and site B (see Figure 6) to calculate the RMSE values for each registration. The detailed information of the registration are listed in Table 3. Note that, the ICP implementation decreased the accuracy of registration achieved by Super4PCS and MSSF-Super4PCS, for both sites. Additionally, the registration achieved by our method led to an average RMSE value, about two-thirds of the point resolution of the temporal TLS surveys.  Figure 9 plots the RMSE values of the TIRs over both sites generated by the proposed method, with increasing iterations. This figure shows that the RMSE value exhibits an exponential decrease with the rise of optimization iterations during the registration process. Moreover, the convergence rates of the curves for the registration were independent of the initial RMSE values. As marked by the dotted circles in Figure 9, there were some slight ups and downs along the overall decline curves, for both sites. Figure 10 shows the registration results of the identified TIR in the two sites, yielded by the proposed method. Comparing Figure 10b with Figure 10c, we found that the TIRs were optimized with the increase of ICP iterations, and the registration errors were significantly removed by the proposed method, after 20 optimization iterations. Moreover, we respectively selected the local overlapping areas of a1-a4 and b1-b3 from the sites A and site B (see Figure 6) to calculate the RMSE values for each registration. The detailed information of the registration are listed in Table 3. Note that, the ICP implementation decreased the accuracy of registration achieved by Super4PCS and MSSF-Super4PCS, for both sites. Additionally, the registration achieved by our method led to an average RMSE value, about two-thirds of the point resolution of the temporal TLS surveys. We respectively compared the RMSE values achieved by Super4PCS+ICP and MSSF-Super4PCS+ICP, with those of Super4PCS and MSSF-Super4PCS methods, and listed the differences in the brackets. Figure 9 plots the RMSE values of the TIRs over both sites generated by the proposed method, with increasing iterations. This figure shows that the RMSE value exhibits an exponential decrease with the rise of optimization iterations during the registration process. Moreover, the convergence rates of the curves for the registration were independent of the initial RMSE values. As marked by the dotted circles in Figure 9, there were some slight ups and downs along the overall decline curves, for both sites. Figure 10 shows the registration results of the identified TIR in the two sites, yielded by the proposed method. Comparing Figure 10b with Figure 10c, we found that the TIRs were optimized with the increase of ICP iterations, and the registration errors were significantly removed by the proposed method, after 20 optimization iterations.

Measuring Exploitative Volume from Temporal TLS Survyes
Due to the lack of in-situ measurement data in site B, we only used the dataset from site A to quantify the accuracy of the proposed method, for measuring the exploitative volume. Figure 11

Measuring Exploitative Volume from Temporal TLS Survyes
Due to the lack of in-situ measurement data in site B, we only used the dataset from site A to quantify the accuracy of the proposed method, for measuring the exploitative volume. Figure 11

Measuring Exploitative Volume from Temporal TLS Survyes
Due to the lack of in-situ measurement data in site B, we only used the dataset from site A to quantify the accuracy of the proposed method, for measuring the exploitative volume. Figure 11 shows the distance map of site A, achieved by subtracting the post-phase DEM from the pre-phase DEM of the registered temporal TLS surveys. The boundary between the two ore types, with respect to Fehw-Fec-Fehp-Feh and Fepp-Me-Lph-Chq-Am-Cs was drawn on the distance map. Based on Equations (10) and (11), we estimated the exploitative volume of the distance map, where the rasterization size was set as 1.5 m, by experience. Following this, we calculated the exploitative quantities of different ore types, by multiplying their volumes, with corresponding densities. Finally, we compared our results to in-situ counting data in Table 4. The comparison indicated an overall accuracy of 98.03%, for the proposed method.
Remote Sens. 2019, 11, x FOR PEER REVIEW 13 of 17 shows the distance map of site A, achieved by subtracting the post-phase DEM from the pre-phase DEM of the registered temporal TLS surveys. The boundary between the two ore types, with respect to Fehw-Fec-Fehp-Feh and Fepp-Me-Lph-Chq-Am-Cs was drawn on the distance map. Based on Equations (10) and (11), we estimated the exploitative volume of the distance map, where the rasterization size was set as 1.5 m, by experience. Following this, we calculated the exploitative quantities of different ore types, by multiplying their volumes, with corresponding densities. Finally, we compared our results to in-situ counting data in Table 4. The comparison indicated an overall accuracy of 98.03%, for the proposed method.

Discussion
This study investigated the use of TIR to register temporal TLS surveys for exploitative volume (or quantity) measurement over open-pit mines. Many studies on the registration of TLS surveys for measuring exploitative volume can be found in the literature, particularly in [48], who investigated the use of TIR for temporal point clouds registration for the first time. In their work, the main TIRs from two temporal point clouds were manually collected to do ICP optimization, and then to estimate the volume change of a mine heap with the fine-level registered point clouds. In this paper, the proposed method differs from that of the existing method, from the following aspects. First, a modified MSSF-Super4PCS method was used for coarse registration in an automatic configuration. Second, the proposed method provides an automatic strategy to identify the TIR at each iteration, for rigid motion estimation. Third, the study area was significantly enlarged, where the experiments contained larger-term changes. Finally, a detailed experimental evaluation was provided with the proposed registration method.
The results obtained from this study showed that the proposed method achieved a higher accuracy when registering two temporal TLS surveys, with large-scale changes caused by mining activities. In this study, the TIR extraction was treated as an iterative process. For instance, the TIR can be updated after each ICP iteration, according to a decreasing threshold that measures the surface Figure 11. Distances between Digital Elevation Models (DEMs) of the registered two-temporal TLS surveys in site A calculated using the mesh-to-mesh distances. The boundary between two ore types I and II is overlapped, where type I contains Fehw, Fec, Fehp, Feh minerals and type II contains Fepp, Me, Lph, Chq, Am, Cs. The dotted circles indicate the regions with negative values from the distance map.

Discussion
This study investigated the use of TIR to register temporal TLS surveys for exploitative volume (or quantity) measurement over open-pit mines. Many studies on the registration of TLS surveys for measuring exploitative volume can be found in the literature, particularly in [48], who investigated the use of TIR for temporal point clouds registration for the first time. In their work, the main TIRs from two temporal point clouds were manually collected to do ICP optimization, and then to estimate the volume change of a mine heap with the fine-level registered point clouds. In this paper, the proposed method differs from that of the existing method, from the following aspects. First, a modified MSSF-Super4PCS method was used for coarse registration in an automatic configuration. Second, the proposed method provides an automatic strategy to identify the TIR at each iteration, for rigid motion estimation. Third, the study area was significantly enlarged, where the experiments contained larger-term changes. Finally, a detailed experimental evaluation was provided with the proposed registration method.
The results obtained from this study showed that the proposed method achieved a higher accuracy when registering two temporal TLS surveys, with large-scale changes caused by mining activities. In this study, the TIR extraction was treated as an iterative process. For instance, the TIR can be updated after each ICP iteration, according to a decreasing threshold that measures the surface distance between the registered temporal TLS surfaces. In practice, both the minimum threshold and its decreasing interval are recommended to quarter the point resolution. This recommendation enables the RMSE to achieve its convergence with a suitable number of ICP optimizations. In addition, the computation time of using the proposed method for registration is a few minutes, in which the coarse registration phase takes the majority of duration. Furthermore, our method enables a fully automated configuration, from coarse to fine, to achieve high registration results. The results also showed that the RMSE value of the final registration reached up to the two-thirds of the point resolution of the TLS surveys.
The results from Table 4 showed that the accuracy of measuring the exploitative volume (quantity) for type I was overestimated up to 8.43%. This was due to mining activities, in particular blasting activities that blasted the ore body into rubbles and raised the ore body up to 5 m higher than the surroundings (see Figure 11). Several solutions with respect to identifying the extraction boundary and averaging the blasting regions over temporal TLS surveys would be potentially useful to solve this problem. Our results also confirmed that performing ICP on the dynamic scenes, i.e., open-pit mines, could decrease the registration accuracy, despite having good initial estimates between the temporal TLS surveys (see Table 3). Although the accuracy obtained by the TIR-based registration method was comparable to or higher than the existing methods, the following issues could be considered for further improvements. First, like other coarse-to-fine registration methods, the accuracy of the coarse registration should be guaranteed before the ICP optimization. In our method, the high-level features, i.e., semantic and deep features, are advised for obtaining good estimates of the coarse registration. Second, a patch-based method should be considered rather than the ICP method, for the registration of the temporal TLS surveys, with significant density difference or in case the TLS surveys had different completeness.

Conclusions
Terrestrial laser scanning (TLS) techniques have already demonstrated their capabilities for measuring exploitative volumes in open-pit mines. This paper introduced a coarse-to-fine scheme for the registration of temporal TLS surveys, using terrain-invariant regions. Experimental tests were done in an open-pit mine in China, and the results showed that the proposed registration method obtained good performances, both in registration accuracy and convergence rate, and outperformed the state-of-the-art methods. We concluded that the proposed method could be used to measure the exploitative quantity in open-pit mine applications. Moreover, this study could also inspire some future studies to further improve the accuracy and robustness of the proposed method. For example, deep features could be considered in the coarse registration phase, in order to handle the registration problem in markerless scenarios. Further tests can also be conducted to detect small-scale changes. The registration of multi-source clouds, i.e., TLS, ALS, MLS, and photogrammetric point clouds for change detection also deserves further research.