Next Article in Journal
How Do Underwater Cultural Heritage Sites Affect Coral Assemblages?
Previous Article in Journal
A Random Forest-Based CA-Markov Model to Examine the Dynamics of Land Use/Cover Change Aided with Remote Sensing and GIS
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Centroid Extraction of Laser Spots Captured by Infrared Detectors Combining Laser Footprint Images and Detector Observation Data

1
College of Geodesy and Geomatics, Shandong University of Science and Technology, Qingdao 266590, China
2
Land Satellite Remote Sensing Application Center, Ministry of Natural Resources of China, Beijing 100048, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2023, 15(8), 2129; https://doi.org/10.3390/rs15082129
Submission received: 28 February 2023 / Revised: 5 April 2023 / Accepted: 10 April 2023 / Published: 18 April 2023

Abstract

:
On-orbit geometric calibration of satellite-borne laser based on infrared detectors is the key tool to ensure the elevation measurement accuracy, and the accuracy of on-orbit geometric calibration is directly determined by laser spots captured by detectors. Mathematical methods, such as gray-scale barycenter, are widely applied for centroid extraction of spots captured by infrared detectors and completely depend on the energy values at points measured by detectors, which have low precision and are greatly affected by the consistency of the detectors and other factors at present. Based on the above question, considering the consistency between the real laser footprint shape and spot captured by detectors, a centroid extraction method of laser spots captured by infrared detectors combining laser footprint images and detector observation data is proposed for making up this defect to some extent. First, the self-adaptive “two-step method” is used to denoise footprint images hierarchically to obtain the real shape of footprints for constraining the spots captured by detectors, and then the centroids of spots are extracted by using the energy-weighted barycenter method based on regional blocks. In the experiment, Gaofen-7 (GF-7) satellite is taken as the research object, and the proposed method, as well as the other six methods, are used for the centroid extraction of laser spots captured by detectors, the calculation of calibration parameters based on the single-beam and dual-beam laser calibration models, the positioning of laser footprints, and cross verification. According to the results, the plane accuracy of centroid extraction using the proposed method is as follows: 0.34 grids for Beam 1 and 0.33 grids for Beam 2. In addition, on flat terrain, the elevation accuracy of Beam 1 and Beam 2 in 2021 is 5.2 cm and 5.0 cm, respectively, 0.6 cm and 4.2 cm higher than those in the most accurate one among other methods; the elevation accuracy in 2020 is 23.3 cm and 7.1 cm, respectively, 7.7 cm and 2.7 cm higher than those in the most accurate one among other methods. On slopes and gentle slopes, the method proposed is also superior to other methods. Since the change of pointing angle caused by satellite jitter, atmosphere, etc., between different years, the accuracy drops when laser footprints of 2020 are located using the parameters of 2021. In summary, under different terrains and years, the results fully demonstrate the effectiveness and accuracy of the proposed method, which has more significant advantages than other traditional methods.

1. Introduction

Geometric positioning accuracy is one of the most important indexes to measure the performance of China’s remote sensing satellites [1]. Due to its high accuracy for geometric positioning, the satellite-borne laser altimeter has been widely used in deep space exploration and earth observation [2]. The United States, for example, launched ICESat-1 (Ice, Cloud, and land Elevation Satellite-1) carrying GLAS (Geoscience Laser Altimeter System) linear laser altimeter system [3,4] and ICESat-2 (Ice, Cloud, and land Elevation Satellite-2) carrying ATLAS (Advanced Topographic Laser Altimeter System) single-photon laser altimeter system in 2003 and 2018 successively. On the other hand, with the development of China‘s laser technology, satellite-borne laser altimeters have been increasingly used in earth observation. In May 2016, Ziyuan 3-02 (ZY3-02) satellite was successfully launched, which carried an experimental laser altimeter for the first time [5]. In November 2019, the GF-7 satellite carrying China’s first civilian laser altimeter system for a formal application to earth observation was also sent into orbit successfully [6,7,8].
For the GF-7 satellite, its laser altimeter system comprises four laser devices (including two principal devices powered on by default, hereinafter referred to as “Beam 1” and “Beam 2”, and the other two are placed as auxiliaries that are not powered on by default; each device can work independently), two laser footprint cameras (LFC) and one laser optical axis surveillance camera (LOASC) [9], as shown in Figure 1, mainly used to assist the optical stereo camera in improving the positioning accuracy of uncontrolled mapping [10]. The pointing accuracy of satellite-borne laser is the key factor affecting the laser footprint positioning accuracy, and on-orbit geometric calibration of satellite-borne laser is an important means to ensure the laser pointing accuracy. During the on-orbit geometric calibration of the GF-7 satellite, the centroid of the spots captured by the infrared detectors is taken as the ground control points (GCPs) to complete the calculation of calibration parameters and the positioning of laser footprints [11,12,13]. That is, whether the centroid of the laser spot captured by the infrared detectors can be extracted with high-precision directly affects whether the calibration of the GF-7 satellite has high precision GCPs, and further affects the accuracy of the geometric calibration. Therefore, how to obtain high-precision calibration laser spot centroids becomes fundamental to improving their calibration accuracy.
Van Waerbeke et al. [14] proposed a centroid extraction algorithm based on point light sources which could obtain the spot shape with geometric parameters. However, this method presents relatively low extraction accuracy for large-spot centroids. Zhan et al. [15] put forward a spherical circle fitting algorithm based on the method of spherical fitting by mapping the peripheral points of a solar image into the object space, but its performance is poor when the noise is loud. Wang et al. [16] proposed to position centroids by using Gaussian gray diffusion model, and it shows a relatively good performance in data simulation but has low data reliability under complex circumstances. For laser spot centroid extraction of GF-7, Ren et al. [17] combined the Gaussian fitting method, Canny edge detection, and gray-scale barycenter method, but the accuracy drops when spots are largely affected by background features. Yao et al. [18] proposed the ellipse fitting centroid extraction algorithm with threshold constraints, but this method heavily depends on the experience threshold in the denoising process with relatively low accuracy in the case of low spot amplitude. Song et al. [19] put forward the centroid extraction method of least square ellipse fitting, combining the cumulative matrix and taking problems including “pseudo-spot” and “weak spot” into consideration, but it could result in large calculation errors due to asymmetrical spot intensity and blurred edges.
The above researches mainly aim to extract laser spot centroids in optical remote-sensing images. For the geometric calibration of satellite-borne laser altimeters, calibration based on infrared detectors is one of the most accurate methods [9]. However, researches on centroid extraction based on spots captured by infrared detectors is few. As the centroid of the spot captured by infrared detectors can be used as ground control to realize the geometric calibration of satellite laser, it is very important to improve the accuracy of centroid extraction. On the other hand, traditional mathematical methods, including gray-scale barycenter and Gaussian surface fitting, which are directly applied to centroid extraction of spots captured by infrared detectors, may result in the accuracy being greatly affected by factors such as detector consistency. The so-called “detector consistency” refers to the response of different detectors to the same energy density. When the quantitative results from different detectors for the same energy are identical, it means that the consistency is good, i.e., the good consistency of the detectors ensures that more accurate and real laser footprint data can be obtained. However, in reality, mass-produced detectors are subject to a certain degree of consistency error due to various factors. And the specific performance is that, theoretically, the energy in the laser footprint obeys Gaussian-like distribution. If the consistency is poor, the energy value on the side displayed by the detector will be greater than the value in the middle, leading to a decrease in the accuracy of centroid extraction. In addition, atmospheric turbulence, atmospheric refraction, and detector layout have effects on the accuracy of centroid extraction of spots captured by infrared detectors.
In order to resolve the above-said defects, a centroid extraction method of laser spots captured by infrared detectors combining laser footprint images and detector observation data is proposed. As the laser footprint image and detector observation data have the characteristics of consistency under the same platform, time, and atmospheric conditions, the proposed method can make full use of such characteristics to establish the correlation between the laser footprint and the spot, thus removing the influence of detector consistency and other problems, and improving the accuracy of spot centroid extraction. To be more specific, first, the interference of particle noise and background features on the laser footprint image is removed by hierarchical denoising with the self-adaptive “two-step method”, allowing to obtain the real geometric shape of the laser footprint. Then, the real geometrical shape is mapped to the spot captured by infrared detectors, followed by the spot being constrained. At last, the centroid of the constrained spot is extracted with the help of the energy-weighted barycenter method based on regional blocks.

2. Materials and Methods

2.1. Study Areas and Data Sources

2.1.1. Experimental Data

In this paper, GF-7 satellite-borne laser altimeter is selected as the experimental object, and the experimental data, supplemented by footprint images, are laser spots captured by infrared detectors. After comprehensively considering multiple influential factors, including terrain and weather, on the accuracy of the on-orbit geometric calibration of satellite-borne laser altimeter, the flat area near Sonid Right Banner (equivalent to a county-level administrative division), Inner Mongolia, China was selected as the experimental field. In June 2020 and September 2021, large-scale on-orbit geometric calibrations of GF-7 satellite lasers were completed using infrared detectors. GF-7 satellite-borne laser footprints were successfully captured by detectors during the process. The laser calibration and data distribution of the experimental field is shown in Figure 2, the layout of detectors is shown in Figure 2b, and the discrete values of energy captured are shown in Figure 2c. In addition, the centroids of laser footprints captured by infrared detectors in Figure 2a were extracted using seven methods, including the method proposed. The centroid extraction results of footprints 241743151.00 and 241743151.33 were used as GCPs to complete the on-orbit geometric calibration of Beam 1 by infrared detectors, and both were successfully captured in Track 10119 on 29 August 2021. Footprints 243038830.00 and 243038830.33 were successfully, captured in Track 10412 on 13 September 2021, which were used for the geometric calibration of Beam 2. Subsequently, centroid extraction for all footprints was carried out and completed based on different methods, and the results were then cross-verified with the positioning results obtained after the geometric calibration of infrared detectors.

2.1.2. Verification Data

The laser footprint positioning accuracy is an important index to evaluate the accuracy of spot centroid extraction based on infrared detectors [20]. Therefore, to verify the centroid extraction accuracy using numerous methods, including the one proposed in this paper, based on the extracted centroids of spots captured by infrared detectors, calibration parameters were calculated, and laser footprints were positioned by using single-beam and double-beam laser calibration models. The positioning accuracy of laser footprints was evaluated according to a large amount of data, indirectly verifying the accuracy of seven methods for centroid extraction, including the method proposed. First, based on the spots obtained by the on-orbit geometric calibration in the experimental field of Sonid Right Banner, as shown in Figure 2a, the results of centroid extraction and laser footprint positioning were used for cross-verification. Second, on account of all spots obtained during the periods of on-orbit geometric calibration in 2020 and 2021, respectively, GCPs were collected using real-time kinematic (RTK) technology to form 9 × 9 ground control grids around the spots, as shown in Figure 3a. Then, in terms of the ground control grids, the real surface elevation was interpolated to evaluate the elevation of the laser footprint, indirectly verifying the elevation accuracy of centroid extraction results obtained using multiple methods. At last, the calibration parameters calculated with the centroid extraction results were extrapolated to laser data in other tracks, in which the data of Track 5278 passing Kuqa, Xinjiang Uygur Autonomous Region on 14 October 2020 was selected to complete laser footprint positioning based on calibration parameters. The high-precision airborne light detection and ranging (LiDAR) improved and verified for accuracy by GCPs [21,22], as shown in Figure 3c, was utilized to evaluate the elevation positioning accuracy of laser footprints, indirectly verifying the elevation accuracy of centroid extraction results from multiple methods.
The laser data were screened within the experimental field and then obtained 23 effective laser points of Beam 1 and 24 effective laser points of Beam 2, as shown in Figure 3b.
The experimental and validation data used in this study are shown in Table 1. Among them, the spots captured by the infrared detectors that are not used for on-orbit geometric calibration and the GCPs acquired by RTK are called control points (CPs). CPs are used as verification points to verify accuracy [23].

2.2. Centroid Extraction of Laser Spots Captured by Infrared Detectors Combining Laser Footprint Images and Detector Observation Data

At present, there are few studies on the centroid extraction methods of satellite laser calibration spots based on infrared detectors. Generally, mathematical methods such as gray-scale weighting are applied directly, which completely depend on the energy value at points in the footprints actually measured by detectors, making the accuracy affected by multiple factors such as detector consistency, detector layout spacing, and atmospheric turbulence. Therefore, as the footprint camera is able to form an image of a laser footprint in the laser altimeter system, and the fact that real laser footprints obtained based on the same platform at the same time in an ideal state are consistent with the spots captured by infrared detectors, a method named centroid extraction of laser spots captured by infrared detectors combining laser footprint images and detector observation data is proposed. The basic schematic diagram is shown in Figure 4.
As shown in Figure 4a, the original footprint images of GF-7 satellites are inevitably affected by factors such as the state of laser footprints, background features, etc., which often lead to the deviation of energy from Gaussian-like distribution and unclear boundaries [24]. And to obtain the real geometrical shape of footprints, denoising is necessary. Therefore, in the experiment, the real laser footprint shape was obtained by hierarchical denoising with a self-adaptive “two-step method”, as shown in Figure 4b. Based on the imaging characteristics of the GF-7 footprint camera, the denoised footprint image was rotated about the Z axis. Then ellipse fitting was conducted on the rotated image based on least squares, and the ellipse shown in Figure 4c was abstracted—where a and b are the major and minor semi-axes of the ellipse, and θ is the inclination angle of the ellipse. Based on the consistency between the real laser footprint and the spot captured by infrared detectors, the geometrical shape of the real laser footprint in Figure 4c was mapped to the spot captured by infrared detectors. In view of the close spatial relationship between points with the largest/second largest energy value in the spot and its centroid, the ellipses A and B were drawn by centering on the two points, combined with geometric parameters of the real footprint. Consequently, red, green, and yellow areas were formed by the intersection of two ellipses, as shown in Figure 4d. However, as the detectors were spaced, it could only be assumed that the centroid was positioned between the points with the largest/second largest energy value and was closer to the point with the largest value. And to further improve the centroid extraction accuracy, the relation of the distance and energy between the centroid and detectors was comprehensively considered, allowing the energy values in different areas to be given different weights to extract the spot centroid using the energy-weighted barycenter method based on regional blocks. The basic flow chart of this method is shown in Figure 5.

2.2.1. Hierarchical Denoising for Laser Footprint Images with Self-Adaptive “Two-Step Method”

Hierarchical denoising with a self-adaptive “two-step method” includes coarse denoising for footprint images based on median filtering and self-adaptive threshold and fine denoising for footprint images based on the Gaussian model.
  • Coarse denoising:
There is usually a large amount of granular noise in the satellite-borne laser spot, which needs to be removed [17,25]. And commonly used methods for image denoising include Gaussian filtering, median filtering, etc., among which median filtering performs better in removing granular noise [26].
F x , y = median F x m , y m
where F x , y is the median of pixel gray level in the neighborhood of x , y ; m is the length of the filtering window; m e d i a n [ ] is the median of all pixel gray levels in the neighborhood range. In view of both denoising and image detail protection, m = 3 .
After the granular noise is removed, each pixel can be treated as the overlaying effect of the spot and ground feature. The footprint image section in the place of the spot can be extracted. In the experiment, after actual calibration, the lengths of Beam 1 and Beam 2 did not exceed 25 m, the ratio of the major axis to the minor axis was less than 1.5, and the number of major axis pixels was 10–18 pixels [24]. Therefore, taking the point with the largest brightness as the center, image sections of 18 pixels × 14 pixels and 20 pixels × 16 pixels were selected, respectively. Then, the average brightness in the annular part formed by the two sections was calculated as the self-adaptive threshold for coarse denoising.
2.
Fine denoising:
The beam width of Gaussian beams usually has two definitions, i.e., the width at 1 exp ( 2 ) and 1/2 of the peak intensity [27]. In this paper, the beam width is defined by treating 1 exp ( 2 ) of the peak intensity as the threshold, and the Gaussian function is established for the footprint spot, as shown in Formula (2):
F x , y = A exp x x 0 2 σ x 2 y y 0 2 σ y 2
where A is the amplitude of the laser spot; x 0 , y 0 is the corresponding centroid coordinates of the spot; σ x and σ y are standard deviations at the directions of x and y ; F x , y is the corresponding gray value of the image point with coordinates x , y . The Gaussian peak value is obtained according to Formula (2). Fine denoising for footprint image spot is completed according to Formula (3) by combining the Gaussian peak value and 1 exp ( 2 ) of the peak value.
I x , y = 0 , F x , y < F x 0 , y 0 × 1 exp 2 F x , y , F x , y F x 0 , y 0 × 1 exp 2
where F x 0 , y 0 is the peak value obtained through Gaussian surface fitting for the footprint spot; I x , y is the pixel gray value at x , y of the footprint image after fine denoising. The result after fine denoising is shown in Figure 3b.

2.2.2. Geometric Parameters Extraction for Real Laser Footprints

Real laser footprints obtained by hierarchical denoising with the “two-step method” are combined with least squares for ellipse fitting.
A X 2 + B X Y + C Y 2 + D X + E Y + F = 0
where A , B , C , D , E   a n d   F are parameters of the ellipse; according to ellipse fitting based on least squares, a general equation of the ellipse is derived. Then the coordinates of the center of an ellipse are obtained as the coordinates of the spot centroid [28], and are expressed as:
X 0 = B E 2 C D 4 A C B 2
Y 0 = B D 2 A E 4 A C B 2
a = 2 A X 0 2 + C Y 0 2 + B X 0 Y 0 F A + C ( ( A C ) 2 + B 2 ) 1 / 2
b = 2 A X 0 2 + C Y 0 2 + B X 0 Y 0 F A + C + ( ( A C ) 2 + B 2 ) 1 / 2
θ = 1 / 2 a r c t a n B / A C
where X 0 , Y 0 is the coordinates of the center of an ellipse obtained through a calculation based on ellipse parameters; a and b are the major and minor semi-axes of the ellipse.
As shown in Figure 3c, parameters including the ratio of the major axis to the minor axis of the ellipse and inclination angle obtained according to the above formula were adopted as the constraints for spots captured by infrared detectors.

2.2.3. After Constraining the Spot Captured by Detectors, the Centroid of the Spot Was Extracted by Energy Weighted Barycenter Method Based on Regional Blocks

Taking the points with the largest/second largest energy value in the spot as the centers, the ellipses were drawn by combining the geometric parameters of real laser footprints. Then the red, green, and yellow areas were formed, as shown in Figure 3d. Only detector energy values in the three areas were selected as experimental data for centroid extraction. Based on the energy and space relationship of centroid position and detector energy, different weights were given to the detector energy values in different regions, as shown in Formula (10).
ω i , j = 1 , i , j F a F b F a_max F a_max + F b_max , i , j F a F a F b F b _ max F a _ max + F b _ max , i , j F b F a F b
where ω i , j is the corresponding weight of the detector energy value at i , j ; F a is the set of coordinates contained in the ellipse with the largest energy value as the center; F b is the set of coordinates contained in the ellipse with the second largest energy value as the center; F a _ max is the largest energy value in F a ; F b _ max is the largest energy value in F b .
Based on the above different weights, the centroid of the spot was extracted by using the energy weighted barycenter method based on regional blocks, as shown in Formula (11).
X G C P = i = 1 M j = 1 N i ω I i , j i = 1 M j = 1 N ω I i , j Y G C P = i = 1 M j = 1 N j ω I i , j i = 1 M j = 1 N ω I i , j Z G C P = i = 1 M j = 1 N h ω I i , j i = 1 M j = 1 N ω I i , j
where X G C P , Y G C P , Z G C P is the coordinates of the spot centroid; I i , j is the energy value of the detector in i t h row j t h column; h is the corresponding height; ω is the weight in the corresponding position; M and N are the largest values of the row and column number.

2.3. Verification Based on Laser Footprint Positioning

Based on the spots captured by detectors and laser data of the GF-7 satellite, the control variable method was used to locate the laser footprints under the condition that only the centroid of the spots captured by detectors was changed. The positioning accuracy of the laser data under the centroid of the spot extracted by seven methods, including the method proposed, was then compared. The seven methods are the method proposed in this paper, the Gaussian surface fitting method, the centroid method, the first-order gray-scale weighting method considering the detectors, the second-order gray-scale weighting method considering the detectors, the least squares ellipse fitting method, and the polynomial surface fitting method. The flow chart is shown in Figure 6.

2.3.1. Centroid Extraction of Spots Based on Infrared Detectors

  • Centroid Extraction of Laser Spots Captured by Infrared Detectors Combining Laser Footprint Images and Detector Observation Data:
    The GF-7 satellite laser footprint images were denoised by the “two-step method” to obtain real laser footprints. Then, the geometric parameters, such as the ratio of the major axis to the minor axis and the inclination angle, were obtained by means of the least square ellipse fitting method;
    Based on the obtained geometric parameters, ellipses were drawn in combination with the largest value and the second largest value of the spot energy to complete the division of the spot area;
    The centroid of the spot was extracted using the energy weighted barycenter method based on regional blocks.
  • Other traditional methods for centroid extraction of spots:
    The centroids of spots were extracted using six traditional methods, such as the Gaussian surface fitting method.

2.3.2. Calculation of Laser Pointing Angle and Ranging Parameters Based on the Single-Beam and Double-Beam Laser Calibration Models According to the Centroids Extracted

The laser pointing angle and ranging parameters were calculated by a single-beam laser rough calibration model as well as a double-beam laser fine calibration model based on centroids of spots extracted using multiple methods [9].
  • Single-beam laser rough calibration:
In view of the satellite platform centroid, laser emission position, Global Positioning System (GPS) antenna, and relative position offset and rotational geometric relation of the Earth ellipsoid, the on-orbit geometric calibration model of single-beam laser altimeter was established, as shown in Formula (12):
X G C P 1 Y G C P 1 Z G C P 1 W G S 84 = X Y Z G P S + R J 2000 W G S 84 R b o d y J 2000 d x 1 d y 1 d z 1 + ρ 1 Δ ρ a t m Δ ρ t i d e s Δ ρ 1 cos α 1 + Δ α 1 cos β 1 + Δ β 1 cos β 1 + Δ β 1 sin α 1 + Δ α 1 sin β 1 + Δ β 1
where X G C P 1 Y G C P 1 Z G C P 1 W G S 84 is the ground coordinates for the spot centroid of laser Beam 1 in the coordinate system of World Geodetic System—1984 Coordinate System (WGS 84); X Y Z G P S is the coordinates of the satellite GPS antenna center in the coordinate system of WGS84; d x 1 d y 1 d z 1 is the offset of the laser Beam 1 relative to Global Navigation Satellite System (GNSS) antenna center; R J 2000 W G S 84 is the rotation matrix when a J2000 coordinate system is converted into a WGS84 coordinate system; R b o d y J 2000 is the rotation matrix when a satellite-based system is converted into a J2000 coordinate system; ρ 1 is the ranging value of laser Beam 1; Δ ρ a t m and Δ ρ t i d e s are ranging errors triggered by atmospheric delay and tide; Δ ρ 1 is the ranging system error of Beam 1 to be calculated; α 1 and β 1 are the angles between reference Beam 1 and the X-axis and the Y-axis in the satellite-based system; Δ α 1 and Δ β 1 are the pointing modification values of α 1 and β 1 to be calculated. With the help of GCPs, the modification value of pointing can be iteratively calculated [9].
2.
Double-beam laser fine calibration:
Based on the single-beam laser rough calibration, the relative rotation relation of the double-beam laser was introduced to establish a double-beam joint calibration model, as shown in Formula (13) [9]:
X G C P 2 Y G C P 2 Z G C P 2 W G S 84 = X s Y s Z s W G S 84 + R J 2000 W G S 84 R b o d y J 2000 d x 2 d y 2 d z 2 + ρ 2 Δ ρ a t m Δ ρ t i d e s Δ ρ 2 Δ R r , a , b cos α 2 cos β 2 cos β 2 sin α 2 sin β 2
where X G C P 2 Y G C P 2 Z G C P 2 W G S 84 is the ground coordinates for the spot centroid of laser Beam 2 in the coordinate system of WGS84; X s Y s Z s W G S 84 is the ground coordinates for the footprint spot centroid of laser Beam 1 in the coordinate system of WGS84; d x 2 d y 2 d z 2 is the offset of laser Beam 2 relative to GNSS antenna center; ρ 2 is the ranging value of laser Beam 2; Δ ρ 2 is the ranging system error of Beam 2 to be calculated; Δ R r , a , b = Δ R 1 r , a , b Δ R 2 r , a , b Δ R 3 r , a , b is the pointing rotation matrix of Beam 2 relative to Beam 1.
By taking and following the principle that the ground distance residual from the two laser beams to the ground spot centroids X G C P 1 , Y G C P 1 , Z G C P 1 and X G C P 2 , Y G C P 2 , Z G C P 2 to be minimized, Formula (14) was written into an error Equation [9]:
V = A X L = f 1 ( X ) Δ α 1 f 1 ( X ) Δ β 1 f 1 ( X ) Δ ρ 1 0 0 0 0 f 1 ( Y ) Δ α 1 f 1 ( Y ) Δ β 1 f 1 ( Y ) Δ ρ 1 0 0 0 0 f 1 ( Z ) Δ α 1 f 1 ( Z ) Δ β 1 f 1 ( Z ) Δ ρ 1 0 0 0 0 0 0 0 f 2 ( X ) r f 2 ( X ) a f 2 ( X ) b f 2 ( X ) Δ ρ 2 0 0 0 f 2 ( Y ) r f 2 ( Y ) a f 2 ( Y ) b f 2 ( Y ) Δ ρ 2 0 0 0 f 2 ( Z ) r f 2 ( Z ) a f 2 ( Z ) b f 2 ( Z ) Δ ρ 2 Δ α 1 Δ β 1 Δ ρ 1 r a b Δ ρ 2 X 1 X G C P 1 Y 1 Y G C P 1 Z 1 Z G C P 1 X 2 X G C P 2 Y 2 Y G C P 2 Z 2 Z G C P 2
The rough calibration value of laser pointing obtained from the single-beam laser calibration model was set as the initial value, and the laser pointing angle and ranging parameters of two laser beams were calculated based on the least squares principle by capturing the array data of two laser beams, ensuring that the calibration parameters meet the global optimum.
In practical applications, for the convenience of calculation, the pointing angle is usually projected to the three directions O-XYZ of the coordinate axis to obtain the commonly used three-axis pointing angle parameters (Angle_X, Angle_Y, Angle_Z). Figure 7 shows the relationship between laser angle direction and three-axis angle. Formula (15) is used to express the geometric relationship between the two.
Angle _ X = a r c c o s c o s α c o s β Angle _ Y = a r c c o s s i n α c o s β Angle _ Z = a r c c o s s i n β

2.3.3. Accuracy Evaluation of Spot Centroid Extraction Based on Infrared Detectors

The accuracy of the spot centroid was considered the only variable affecting laser footprint positioning. The laser fine calibration results were extrapolated into laser data of other tracks, and high-precision GCPs, including RTK control points and high-precision LiDAR point clouds, were selected as verification data. According to Formula (16), the calibration parameters were combined with high-precision attitude data [28,29,30] and precise orbit data [31,32] to locate laser footprints. The centroid accuracy of captured spots extracted using different methods was evaluated indirectly through the positioning accuracy and elevation accuracy of laser footprints. Besides, the elevation measurement accuracy of the GF-7 satellite-borne laser was evaluated.
X F o o t p r i n t Y F o o t p r i n t Z F o o t p r i n t W G S 84 = X Y Z G P S + R J 2000 W G S 84 R b o d y J 2000 d x 1 d y 1 d z 1 + ρ 1 Δ ρ a t m Δ ρ t i d e s Δ ρ 1 cos Angle _ X cos Angle _ Y cos Angle _ Z
where X F o o t p r i n t Y F o o t p r i n t Z F o o t p r i n t W G S 84 is the result of locating the laser footprint based on the calibration parameters.

3. Results

According to the experimental process, with the help of using seven methods, including the method proposed in this paper, the centroid extraction experiment was carried out on the laser data obtained by the on-orbit geometric calibration based on infrared detectors in 2021. The results are shown in Figure 8.
The centroid extraction results of laser footprints 241743151.00 (51.00) and 241743151.33 (51.33) in Beam 1 of Track 10119 (as shown in Figure 6a,b) were used to calculate the corresponding pointing and ranging parameters of Beam 1; the centroid extraction results of laser footprints 243038830.00 (30.00) and 243038830.33 (30.33) in Beam 2 of Track 10412 (as shown in Figure 8c,d) were used to calculate the corresponding pointing and ranging parameters of Beam 2. The distribution of centroid extraction results using different methods for getting the above-mentioned laser footprints, as well as the spatial relationship with the spots, are shown in Figure 8. According to Figure 8, it is obvious that the result (the diamond-shaped points) of the method proposed is closer to the center of the spot.
Based on the centroid coordinates obtained, the method proposed in this paper and the other six methods were used to calculate the pointing and ranging parameters of the seven laser groups by single and double-beam laser calibration models. With the help of calibration parameters, the pointing calibration of Beam 1 and Beam 2 of the GF-7 satellite laser based on infrared detectors was completed. The differences before and after parameter calibration using seven methods are shown in Table 2.

4. Discussion

4.1. Verification of Relative Plane Accuracy

If the measurement method for a typical feature is selected to verify the plane accuracy of the laser footprints covering the position of the feature [33], it will be difficult to select the corresponding typical feature due to the large size and spacing of the laser footprints. Even when features are available, the cost of field surveys is enormous. Therefore, due to the limitations of the plane accuracy verification in the experiment, verification of relative plane accuracy was conducted for the calibration results only. However, the plane accuracy and elevation accuracy of GF-7 satellite laser are closely correlated [34,35]. In other words, the elevation accuracy can also reflect the plane accuracy.
The verification of relative plane accuracy of different calibration results mainly included two aspects. On the one hand, the scope of possible truth values of centroid in the spot was determined; the probability that centroids obtained using different methods were distributed in this scope was calculated; the relative centroid accuracy was verified preliminarily. On the other hand, based on the calibration parameters calculated through centroids obtained using different methods, laser data of the same track as well as different tracks in the spots, were positioned. The positioning results and centroid extraction results were compared to indirectly verify the relative plane accuracy of centroids extracted using different methods.
Based on the spatial relationship between the plane position of the centroid extracted by different methods in Figure 9 and the possible scope of the true value of the centroid, the probability that centroids obtained using different methods, which fell in this scope, was obtained, as shown in Figure 10.
As shown in Figure 10, the probability that centroids extracted using the method proposed fall in the truth value scope is 100%, while the probabilities of the other six methods range from 11.1% to 55.6%. Therefore, compared with multiple traditional methods, including the Gaussian surface fitting method, the probability of higher plane accuracy for centroid extraction is relatively greater using the method proposed.
For the second method, through the calibration parameters calculated through centroids extracted with the experimental data of 2021 based on different methods, laser data of the same track as well as different tracks in the spots captured by detectors were positioned, respectively. The positioning results were analyzed in comparison with that of centroid extraction and were then compared, indirectly verifying the relative plane accuracy of centroids extracted using different methods, as shown in Figure 11 and Figure 12.
First, in order to exclude the effect of factors such as satellite jitter, centroid extraction was completed using laser footprint 51.33 of Beam 1 and 30.00 of Beam 2 in 2021 to calculate the calibration pointing and ranging parameters. The results were then used to position laser footprints 51.00 and 30.33 of the same track. Meanwhile, cross-verification of relative plane accuracy was completed with the centroid extraction results obtained using multiple methods and laser footprint positioning results based on calibration parameters, as shown in Figure 11.
In Figure 11, the results of cross-verification obtained using different methods show a significant difference. For Beam 1, the plane accuracy of both first-order gray-scale weighting and second-order gray-scale weighting methods considering detectors is smaller than 0.2 detector grid spacing (hereinafter referred to as “grid”), showing relatively higher stability than other methods. For Beam 2, on the contrary, the plane accuracy of both exceeds 1.3 grids; and the relative plane accuracy difference of both beams under the polynomial surface fitting method exceeds 0.6 grids. Therefore, the above three methods used have relatively lower stability in the calibration plane accuracy for different beams. On the contrary, the relative plane accuracy difference of the two beams using the remaining methods does not exceed 0.3 grids. The difference between the two beams using the method proposed in this paper is only 0.01 grids; the value of Beam 1 is 0.34 grids, and Beam 2 is 0.33 grids. Hence, the method proposed in this paper has relatively higher plane accuracy and shows better stability for different beams.
The calibration parameters of 2021 were extended to the laser data of 2020, and laser footprints of different tracks in 2020 were positioned with the calibration parameters of 2021; the results are shown in Figure 12. In this figure, the plane accuracy of centroids obtained using the method proposed in this paper, the Gaussian surface fitting method, centroid method, and least square ellipse fitting method, is relatively high and stable. Meanwhile, in Figure 10, compared with other methods, the above-mentioned four methods present a relatively higher probability of obtaining centroids with higher plane accuracy. In other words, the results of the two methods to verify the relative plane accuracy are consistent. In Figure 12, however, the average value of the relative plane accuracy of centroids extracted using four better methods, including the method proposed in this paper, is 3 m–4 m, while the layout spacing of corresponding detectors is 3–8 m.
The reason why the plane error exceeds the detector layout spacing is that the laser data of 2020 was processed based on the calibration parameters in 2021. The effect of factors such as satellite jitter between different years leads to changes in pointing angles, which in turn causes differences in the positioning accuracy of laser footprints. Figure 12 is essentially a supplement to Figure 11. Figure 12, on the one hand, is to illustrate that the proposed method has better plane accuracy and stability for the centroid of laser data extraction in 2020. On the other hand, to express that even if there are objective conditions such as satellite jitter between different years, the extrapolation effect of pointing parameters detected by the proposed method is better than that of the other six methods.

4.2. Verification of Elevation Accuracy

GCPs were collected using RTK technology, forming 9 × 9 ground control grids around the spot, as shown in Figure 3a. Then, the real surface elevation was interpolated to evaluate the elevation of laser footprints.
During the period of field calibration, on the flat terrain of the non-calibration area (with a slope of less than 2° and no surface features or vegetation), GCPs of laser elevation were collected using RTK technology. Thirty-six laser footprints were selected, which were within the scope of GCPs in the data of Track 3402 on 14 June 2020, Track 3478 on 19 June, Track 3555 on 24 June, Track 10119 on 29 August 2021, Track 10194 on 3 September, and Track 10412 on 13 September, including 18 footprints for Beam 1 and Beam 2, respectively. Based on the above laser footprints, real surfaces were interpolated within the surrounding ground control grids. The elevation accuracy of laser footprint positioning results and that of corresponding results of ground control grids were compared. Then the elevation accuracy of laser footprints was evaluated, and the centroid accuracy of captured spots extracted by different methods was indirectly evaluated. The comparison results are shown in Figure 13 and Figure 14.
In Figure 13 and Figure 14, there are abnormal values in the laser footprint positioning results of Beam 1 and Beam 2 in 2021, and Beam 2 in 2020, and these are concentrated in the six traditional methods. In other words, the laser footprint positioning results for centroids extracted using the method proposed to confirm its relatively good stability in elevation. According to the width of the boxes, the fluctuation degree of laser footprint positioning results of Beam 1 in 2021 is smaller. However, if comprehensive consideration is given to the fluctuation degree and abnormal values, the method proposed in this paper is superior to the other six methods. According to Figure 14a, all the methods show relatively great fluctuation in the laser footprint positioning results of Beam 1 in 2020. However, if comprehensive consideration is given to the median and mean value, the method proposed in this paper is also superior to others. In addition, according to Figure 14b, the fluctuation degree of laser footprint positioning results obtained using different methods for Beam 2 is smaller than that for Beam 1. However, if comprehensive consideration is given to the mean and median values, the method proposed in this paper is still superior to others. According to Figure 13 and Figure 14, the method proposed in this paper has relatively better uniform variability with lower data fluctuation, which has certain advantages compared with other six traditional methods.
On these grounds, quantitative analysis was made for the elevation results of laser data processed with different methods, as shown in Figure 15 and Figure 16.
According to Figure 15 and Figure 16, either in terms of beams or years, the elevation accuracy of laser footprint positioning results using the method proposed in this paper are superior to those of the other six methods. The mean value of the elevation accuracy of positioning results obtained from Beam 1 in 2021 using the method proposed in this paper is 5.2 cm. The mean values of the elevation accuracy obtained using the Gaussian surface fitting method, centroid method, and least square ellipse fitting method are slightly higher but all less than 8.0 cm. The mean values obtained using the first-order gray-scale weighting method considering detectors, second-order gray-scale weighting method considering detectors, and polynomial surface fitting method, are not less than 10.0 cm. Therefore, the elevation accuracy of laser footprint positioning results using these methods presents a layering effect, and the method proposed in this paper has significant advantages. For Beam 2 in 2021, the mean value of the elevation accuracy of laser footprint positioning results obtained using the method proposed in this paper is 5.0 m, which is significantly better than the other six methods. According to the laser data of 2021, the processing results of this method have higher elevation accuracy and are relatively stable.
For the laser data of 2020, the mean value of the elevation accuracy of laser footprint positioning results obtained using the method proposed is 23.3 cm for Beam 1 and 7.1 cm for Beam 2, better than the other six methods but significantly lower than that of 2021. In the experiment, the pointing and ranging parameters were calculated according to the experimental data of 2021 while being verified with the laser data of 2020 and 2021, respectively. However, as objective factors such as satellite jitter led to changes in calibration parameters between different years, the elevation accuracy of laser footprint positioning results in 2020 is lower than that in 2021.
To fully verify the elevation accuracy of laser footprint positioning results using the method proposed in this paper, the data were extrapolated to laser data of other tracks. High-precision airborne LiDAR point cloud data were used for elevation accuracy verification.
In this paper, the terrain with a slope greater than 6° is defined as a slope; the terrain with a slope greater than 2° but less than 5° is defined as a gentle slope. According to the data of Track 5278 after the screening, there are 12 laser footprints of Beam 1 and 12 of Beam 2 on slopes. There are 12 laser footprints of Beam 1 and 11 of Beam 2 on gentle slopes. In the experiment, the laser footprints were positioned according to the above experimental data through the calibration parameters calculated with centroids extracted using different methods, and the elevation of the positioning results was compared with the elevation of airborne LiDAR data, as shown in Figure 17 and Figure 18.
In Figure 17 and Figure 18, for Beam 1 on slopes, the elevation accuracy of laser footprint positioning results obtained using the method proposed is 57.5 cm; except for the first-order gray-scale weighting method considering detectors (65.6 cm) and the second-order gray-scale weighting method considering detectors (65.5 cm), the elevation accuracy obtained using the method proposed in this paper is 10.0 cm higher than that of other four methods, showing significant advantages. Meanwhile, for Beam 2 on slopes, the elevation accuracy of the method proposed is 30.1 cm, which is 3.0 cm higher than that of the best of other methods. Therefore, the method proposed still has certain advantages in the elevation accuracy on slopes for Beam 2. In addition, according to the laser footprint positioning results from Beam 1 on gentle slopes obtained using different methods in Figure 18, the elevation accuracy of the method proposed is 30.5 cm, which is 10.0 cm higher than that of the other six traditional methods, showing significant advantages of this method. However, the method proposed has relatively small advantages for Beam 2, and the accuracy of elevation is similar in most of the methods; only the polynomial surface fitting method shows poor elevation accuracy.
Due to large terrain fluctuations in the area where the airborne LiDAR point cloud data are obtained by field operation, it is steeper than the area in Sonid Right Banner, where infrared detectors are deployed for on-orbit geometric calibration. Either the slopes or gentle slopes in this paper are steeper than the area in Sonid Right Banner, so the elevation accuracy of laser footprint positioning results in this area is significantly lower than that in the above-mentioned area. However, in the experiment, the increase of the gradient also enlarged the calibration difference between different methods. This highlights the advantages of this method in experimental fields of different gradients.

5. Conclusions

To solve problems including insufficient detector consistency, a small amount of detector data, and the influence of atmospheric turbulences, in the experiment, a centroid extraction method of laser spots captured by infrared detectors combining the laser footprint images and detector observation data is proposed by taking full advantage of the consistency of laser footprints and spots captured by detectors in the same platform, time and atmospheric conditions. First, preprocessing was conducted for the laser footprint images by hierarchical denoising with a self-adaptive “two-step method”, to obtain the real geometrical shape of footprints. Then the real geometric parameters were mapped to the spots captured under the same conditions to realize constraining. Finally, the distance and energy values were fully considered, and the spot captured by infrared detectors was divided into blocks after constraining. The centroid of the spot after constraining was extracted by means of the energy-weighted barycenter method based on regional blocks. After centroid extraction was completed using different methods, laser pointing and ranging parameters were calculated based on single-beam and double-beam laser calibration models to position the laser footprint data and indirectly verify the accuracy of centroids extracted using different methods.
GF-7 satellite laser was adopted as the research object, and cross-verification was conducted with laser data of different tracks, laser data in different terrains, and high-precision airborne LiDAR point cloud data. Contrastive analysis was made on the relative plane accuracy and absolute elevation accuracy of seven centroid extraction methods, including the method proposed in this paper, and the accuracy of different methods was evaluated. According to the analysis of results, the relative plane accuracy of Beam 1 obtained using the method proposed in this paper reached 0.34 grids, and that of Beam 2 reached 0.33 grids. The elevation accuracy was as follows: on flat terrain, the elevation accuracy of Beam 1 and Beam 2 in 2021 was 5.2 cm and 5.0 cm, respectively, 0.6 cm and 4.2 cm higher than those in the most accurate one among other methods; the elevation accuracy in 2020 was 23.3 cm and 7.1 cm, 7.7 cm and 2.7 cm higher than those in the most accurate one among other methods. On slopes, the elevation accuracy of two beams was 57.5 cm and 30.1 cm, respectively, 8.0 cm and 3.0 cm higher than those in the most accurate one among other methods. On gentle slopes, the elevation accuracy of the two beams was 30.5 cm and 15.4 cm, respectively, 10.4 cm and 2.8 cm higher than those in the most accurate one among other methods. Therefore, whether it is the plane or elevation accuracy, the method proposed in this paper has relatively higher accuracy and shows better stability, helping increase the satellite laser positioning accuracy. Thus, the method proposed in this paper is proven to significantly increase the geometric calibration accuracy based on infrared detectors.
In conclusion, the proposed method in this paper, by taking into account the shape of each real laser footprint and the energy information of the laser spot captured by the detectors, improves the spot centroid positioning accuracy of the satellite laser calibration and has been applied to the on-orbit geometric calibration experiments of GF-7 satellite-borne laser.

Author Contributions

Conceptualization, X.Y. and J.X.; formal analysis, X.Y. and R.L.; methodology, X.Y.; software, X.Y. and R.L.; validation, X.Y. and F.M.; data curation, X.Y. and F.M.; writing—original draft preparation, X.Y.; writing—review and editing, J.X.; visualization, F.M. and J.Z.; supervision, J.X. All authors have read and agreed to the published version of the manuscript.

Funding

This work was partly supported by the National Key R&D Program of China(2020YFE0200800), the National Natural Science Foundation of China (41971426), the Multi-beam Laser Terrain Detection Radar and Application Technology (D040105), and the Special Funds for Creative Research (2022C61540).

Data Availability Statement

The GF-7 satellite laser data are available on the Natural Resources Satellite Remote Sensing Cloud Service Platform (http://sasclouds.com/chinese/normal/, accessed on 20 November 2022).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Tang, X.; Xie, J.; Fu, X.; Mo, F.; Li, S.; Dou, X. ZY3-02 Laser Altimeter On-orbit Geometrical Calibration and Test. Acta Geod. Cartogr. Sin. 2017, 46, 714–723. [Google Scholar]
  2. Mattei, S.; Santovito, M.R.; Moccia, A. New rangefinder system for microsatellite. SPIE 2009, 41, 862. [Google Scholar]
  3. Schutz, B.E.; Zwally, H.J.; Shuman, C.A.; Hancock, D.; DiMarzio, J.P. Overview of the ICESat mission. Geophys. Res. Lett. 2005, 32, 97–116. [Google Scholar] [CrossRef]
  4. Abshire, J.B.; Sun, X.; Riris, H.; Sirota, J.M.; McGarry, J.F.; Palm, S.; Yi, D.; Liiva, P. Geoscience laser altimeter system (GLAS) on the ICESat mission: Pre-launch and on-orbit measurement performance. In Proceedings of the 2003 IEEE International Geoscience and Remote Sensing Symposium, Toulouse, France, 21–25 July 2003; pp. 1534–1542. [Google Scholar]
  5. Li, D. China’s First Civilian Three-line-array Stereo Mapping Satellite: ZY-3. Acta Geod. Cartogr. Sin. 2012, 41, 317–322. [Google Scholar]
  6. Tang, X.; Xie, J.; Liu, R.; Huang, G.; Zhao, C.; Zhen, Y.; Tang, H.; Dou, X. Overview of the GF-7 laser altimeter system mission. Earth Space Sci. 2020, 7, 19–29. [Google Scholar] [CrossRef]
  7. Liu, R.; Xie, J.; Xu, C.; Zeng, J.; Mo, F.; Yang, X. A Separate Calibration Method of Laser Pointing and Ranging for the GF-7 Satellite Laser That Does Not Require Field Detectors. Remote Sens. 2022, 14, 5935. [Google Scholar] [CrossRef]
  8. Huang, G.; Ding, Y.; Wu, J.; Shu, R.; Wang, X.; Jiang, Z. Design and implementation of key technology of GF-7 satellite laser altimeter subsystem. Space Eng. 2020, 29, 68–73. [Google Scholar]
  9. Tang, X.; Xie, J.; Mo, F.; Dou, X.; Li, X.; Li, S.; Li, S.; Huang, G.; Fu, X.; Liu, R.; et al. GF-7 dual-beam laser altimeter on-orbit geometric calibration and test verification. Acta Geod. Cartogr. Sin. 2021, 50, 384–395. [Google Scholar]
  10. Xie, J.; Liu, R.; Wang, Z.; Mo, F.; Dou, X. In-orbit geometric calibration and accuracy evaluation of GaoFen-7 spaceborne laser altimeter. Infrared Laser Eng. 2021, 50, 20200396. [Google Scholar]
  11. Magruder, L.A.; Schutz, B.E.; Silverberg, E.C. Laser pointing angle and time of measurement verification of the ICESat laser altimeter using a ground-based electro-optical detection system. J. Geodesy. 2003, 77, 148–154. [Google Scholar] [CrossRef]
  12. Xie, J.; Tang, X.; Mo, F.; Tang, H.; Wang, Z.; Wang, X. In-orbit geometric calibration and experimental verification of the ZY3-02 laser altimeter. Photogramm. Rec. 2018, 33, 341–362. [Google Scholar] [CrossRef]
  13. Magruder, L.A.; Webb, C.E.; Urban, T.J.; Silverberg, E.C.; Schutz, B.E. ICESat Altimetry Data Product Verification at White Sands Space Harbor. IEEE Trans. Geosci. Remote Sens. 2006, 45, 147–155. [Google Scholar] [CrossRef]
  14. Waerbeke, L.V.; Mellier, V.; Erben, T.; Cuillandre, J.C.; Bernardeau, F.; Maoli, R.; Bertin, E.; Mc Cracken, H.G.; Le Fevre, O.; Fort, B.; et al. Detection of correlated galaxy ellipticities on CFHT data: First evidence for gravitational lensing by large-scale structures. arXiv 2000, arXiv:astro-ph/0002500. [Google Scholar]
  15. Zhan, Y.; Zheng, Y.; Zhang, C.; Ma, G.; Luo, Y. Image Centroid Algorithms for Sun Sensors with Super Wide Field of View. Acta Geod. Cartogr. Sin. 2015, 44, 1078–1084. [Google Scholar]
  16. Wang, H.; Zhou, W.; Lin, H.; Wang, X. Parameter estimation of Gaussian gray diffusion model of static image spot. Acta Opt. Sin. 2012, 32, 0323004. [Google Scholar] [CrossRef]
  17. Ren, S.; Tang, X.; Zhu, X.; Li, A.; Qu, D. A High-Precision Extraction Algorithm for Centroid of Laser Footprint Spot of GF-7 Satellite. Acta Opt. Sin. 2021, 41, 1012001. [Google Scholar]
  18. Yao, J.; Li, G.; Chen, J.; Zhou, X.; Guo, A.; Huang, G.; Tang, X.; Ai, B. Analysis on the change of GF-7 satellite laser altimeter spot centroid position. Infrared Laser Eng. 2021, 50, 20210539. [Google Scholar]
  19. Song, J.; Fan, D.; Ji, S.; Li, D.; Chu, G. Laser Spot Centroid Extraction of GF-7 Footprint Images. J. Geomat. Sci. Technol. 2021, 38, 507–513. [Google Scholar]
  20. Xie, J.; Liu, R.; Tang, X.; Yang, X.; Zeng, J.; Mo, F.; Mei, Y. A Geometric Calibration Method Without a Field Site of the GF-7 Satellite Laser Relying on a Surface Mathematical Model. IEEE Trans. Geosci. Remote Sens. 2022, 61, 1–14. [Google Scholar] [CrossRef]
  21. Senkal, E.; Kaplan, G.; Avdan, U. Accuracy assessment of digital surface models from unmanned aerial vehicles’ imagery on archaeological sites. Int. J. Eng. Sci. 2021, 6, 81–89. [Google Scholar] [CrossRef]
  22. Arasan, G.; Yılmaz, A.; Fırat, O.; Avşar, E.; Güner, H.; Ayğan, K.; Yüce, D. Accuracy assessments of Göktürk-1 satellite im agery. Int. J. Eng. Sci. 2020, 5, 160–168. [Google Scholar]
  23. Özcihan, B.; Özlü, L.D.; Karakap, M.İ.; Sürmeli, H.; Algancı, U.; Sertel, E. A comprehensive analysis of different geometric correction methods for the Pleiades -1A and Spot-6 satellite images. Int. J. Eng. Sci. 2023, 8, 146–153. [Google Scholar]
  24. Wu, Y.; Long, X.; Yang, J.; Han, Q.; Li, Q.; Li, S. Variation Law Analysis and Application of GaoFen-7 Laser Pointing. Acta Opt. Sin. 2021, 41, 2328003. [Google Scholar]
  25. Li, K.; Zhang, Y.; Meng, W. Point-Source-Target-Based Method for Space Remote Sensing Geometric Calibration and Positioning Accuracy Improvement. Acta Opt. Sin. 2020, 40, 1828003. [Google Scholar]
  26. Arthur, R.W.; Takis, K.; Brian, K. Adaptive median filter for the removal of periodic interference from an image. Phys. A 1994, 2238, 207–217. [Google Scholar]
  27. Xie, J.; Liu, R. Sliding window Gaussian fitting algorithm for ranging error suppression of full-waveform spaceborne laser. Acta Geod. Cartogr. Sin. 2021, 50, 1240–1250. [Google Scholar]
  28. Ren, S. Research on Laser Footprint Spot Assisted Laser Positioning of Gaofen-7 Satellite. Graduate. Degree Thesis, Lanzhou Jiaotong University, Lanzhou, China, 2021. [Google Scholar]
  29. Tang, X.; Xie, J.; Wang, X.; Jiang, W. High-Precision Attitude Post-Processing and Initial Verification for the ZY-3 Satellite. Remote Sens. 2015, 7, 11–134. [Google Scholar] [CrossRef]
  30. Liang, B.; Zhu, H.; Zhang, T. Research status and development tendency of star tracker technique. Chin. Opt. 2016, 9, 16–29. [Google Scholar] [CrossRef]
  31. Fang, Y.; Jing, G.; Chao, Y. Research on Precise Orbit Determination Time Synchronization and Extended Application of LEO Constellation Based on GNSS. In Proceedings of the China Satellite Navigation Conference (CSNC 2022), Beijing, China, 25–27 May 2022; pp. 89–101. [Google Scholar]
  32. Yousif, H.; El-Rabbany, A. Assessment of several interpolation methods for precise GPS orbit. J. Navigat. 2007, 60, 443–455. [Google Scholar] [CrossRef]
  33. Maraş, E.E.; Nasery, N. Investigating the length, area and volume measurement accuracy of UAV-Based oblique photogrammetry models produced with and without ground control points. Int. J. Eng. Sci. 2023, 8, 32–51. [Google Scholar] [CrossRef]
  34. Liu, R.; Xie, J. Calibration of the laser pointing bias of the GaoFen-7 satellite based on simulation waveform matching. Opt. Express 2021, 29, 21844–21858. [Google Scholar] [CrossRef] [PubMed]
  35. Tang, X.; Xie, J.; Gao, X.; Mo, F.; Feng, W.; Liu, R. The In-Orbit Calibration Method Based on Terrain Matching with Pyramid-Search for the Spaceborne Laser Altimeter. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2019, 12, 1053–1062. [Google Scholar] [CrossRef]
Figure 1. Main diagram of the GF-7 laser altimeter system.
Figure 1. Main diagram of the GF-7 laser altimeter system.
Remotesensing 15 02129 g001
Figure 2. Laser calibration experimental field and data distribution. (a) Calibration experimental field and experimental data. (b) Infrared detectors. (c) Laser spot captured by infrared detectors.
Figure 2. Laser calibration experimental field and data distribution. (a) Calibration experimental field and experimental data. (b) Infrared detectors. (c) Laser spot captured by infrared detectors.
Remotesensing 15 02129 g002
Figure 3. Distribution of different types of verification data. (a) RTK data. (b) Extrapolated laser data distribution. (c) High-precision airborne LiDAR data.
Figure 3. Distribution of different types of verification data. (a) RTK data. (b) Extrapolated laser data distribution. (c) High-precision airborne LiDAR data.
Remotesensing 15 02129 g003
Figure 4. Basic schematic diagram. (a) The original footprint image; (b) The denoised footprint image; (c) The image abstracted from (b) based on the geometric relationship between footprint camera and infrared detectors; (d) The results of applying the geometric parameters in (c) to the spots captured by the detector. Among them, ellipses A and B were obtained by taking the largest and the second largest energy value captured by infrared detectors as the center and combining with the actual geometric parameters of footprints. The intersection of A and B forms green, red and yellow regions, representing the intersection of them, the difference between A and the intersection, and the difference between B and the intersection respectively.
Figure 4. Basic schematic diagram. (a) The original footprint image; (b) The denoised footprint image; (c) The image abstracted from (b) based on the geometric relationship between footprint camera and infrared detectors; (d) The results of applying the geometric parameters in (c) to the spots captured by the detector. Among them, ellipses A and B were obtained by taking the largest and the second largest energy value captured by infrared detectors as the center and combining with the actual geometric parameters of footprints. The intersection of A and B forms green, red and yellow regions, representing the intersection of them, the difference between A and the intersection, and the difference between B and the intersection respectively.
Remotesensing 15 02129 g004
Figure 5. Centroid Extraction of Laser Spots Captured by Infrared Detectors Combining Laser Footprint Images and Detector Observation Data.
Figure 5. Centroid Extraction of Laser Spots Captured by Infrared Detectors Combining Laser Footprint Images and Detector Observation Data.
Remotesensing 15 02129 g005
Figure 6. Experimental flow chart.
Figure 6. Experimental flow chart.
Remotesensing 15 02129 g006
Figure 7. Relationship between laser angle direction and three-axis angle.
Figure 7. Relationship between laser angle direction and three-axis angle.
Remotesensing 15 02129 g007
Figure 8. Schematic diagrams for centroid extraction results of experimental data using different methods; the diamond-shaped points are the centroid results extracted using the method proposed in this paper, the rounded points are the centroid results extracted using the other six methods, and the orange ellipses represent the laser spots.
Figure 8. Schematic diagrams for centroid extraction results of experimental data using different methods; the diamond-shaped points are the centroid results extracted using the method proposed in this paper, the rounded points are the centroid results extracted using the other six methods, and the orange ellipses represent the laser spots.
Remotesensing 15 02129 g008
Figure 9. Spatial relationship of scopes in which centroids positioned using different methods and centroid truth values might appear (the light green ellipse represents the schematic diagram of the spot captured by the infrared detector array; the rectangle is the scope in which the centroid truth values might appear; star represents the centroids positioned with the method proposed in this paper; circular dots represent the centroids positioned by other six methods; points distributed in arrays are detectors). (a) 241,743,151.00, (b) 241,743,151.33, (c) 242,175,041.00, (d) 243,038,830.00, (e) 243,038,830.33, (f) 203,600,254.00, (g) 203,600,253.33, (h) 204,032,177.00, (i) 204,032,175.67.
Figure 9. Spatial relationship of scopes in which centroids positioned using different methods and centroid truth values might appear (the light green ellipse represents the schematic diagram of the spot captured by the infrared detector array; the rectangle is the scope in which the centroid truth values might appear; star represents the centroids positioned with the method proposed in this paper; circular dots represent the centroids positioned by other six methods; points distributed in arrays are detectors). (a) 241,743,151.00, (b) 241,743,151.33, (c) 242,175,041.00, (d) 243,038,830.00, (e) 243,038,830.33, (f) 203,600,254.00, (g) 203,600,253.33, (h) 204,032,177.00, (i) 204,032,175.67.
Remotesensing 15 02129 g009
Figure 10. Probability that centroids obtained with different methods fall in the truth value scope.
Figure 10. Probability that centroids obtained with different methods fall in the truth value scope.
Remotesensing 15 02129 g010
Figure 11. Plane difference between laser point calibration and centroid extraction results by seven methods.
Figure 11. Plane difference between laser point calibration and centroid extraction results by seven methods.
Remotesensing 15 02129 g011
Figure 12. (a) Plane difference between laser footprint positioning results and centroid extraction results obtained with calibration parameters obtained using different methods; (b) partial enlarged drawing of (a); (c) Mean and standard deviation of results obtained using different methods.
Figure 12. (a) Plane difference between laser footprint positioning results and centroid extraction results obtained with calibration parameters obtained using different methods; (b) partial enlarged drawing of (a); (c) Mean and standard deviation of results obtained using different methods.
Remotesensing 15 02129 g012
Figure 13. (a) Elevation accuracy verification results of laser footprints positioned using different methods for Beam 1 in 2021; (b) Elevation accuracy verification results of laser footprints positioned using different methods for Beam 2 (the green dotted line is the mean value of elevation difference, the red dotted line is the corresponding median, and the five-pointed star is the abnormal value).
Figure 13. (a) Elevation accuracy verification results of laser footprints positioned using different methods for Beam 1 in 2021; (b) Elevation accuracy verification results of laser footprints positioned using different methods for Beam 2 (the green dotted line is the mean value of elevation difference, the red dotted line is the corresponding median, and the five-pointed star is the abnormal value).
Remotesensing 15 02129 g013
Figure 14. (a) Elevation accuracy verification results of laser footprints positioned using different methods for Beam 1 in 2020, (b) Elevation accuracy verification results of laser footprints positioned using different methods for Beam 2 (the green dotted line is the mean value of elevation difference, the red dotted line is the corresponding median, and the star is the abnormal value).
Figure 14. (a) Elevation accuracy verification results of laser footprints positioned using different methods for Beam 1 in 2020, (b) Elevation accuracy verification results of laser footprints positioned using different methods for Beam 2 (the green dotted line is the mean value of elevation difference, the red dotted line is the corresponding median, and the star is the abnormal value).
Remotesensing 15 02129 g014
Figure 15. (a) Elevation accuracy verification of laser footprints for Beam 1 in 2021 positioned using different methods; (b) elevation accuracy verification of laser footprints for Beam 2 positioned using different methods.
Figure 15. (a) Elevation accuracy verification of laser footprints for Beam 1 in 2021 positioned using different methods; (b) elevation accuracy verification of laser footprints for Beam 2 positioned using different methods.
Remotesensing 15 02129 g015
Figure 16. (a) Elevation accuracy verification of laser footprints for Beam 1 in 2020 positioned using different methods; (b) elevation accuracy verification of laser footprints for Beam 2 positioned using different methods.
Figure 16. (a) Elevation accuracy verification of laser footprints for Beam 1 in 2020 positioned using different methods; (b) elevation accuracy verification of laser footprints for Beam 2 positioned using different methods.
Remotesensing 15 02129 g016
Figure 17. Elevation accuracy of laser footprints positioned with calibration parameters obtained with different methods for beam 1 (a) and beam 2 (b) on slopes.
Figure 17. Elevation accuracy of laser footprints positioned with calibration parameters obtained with different methods for beam 1 (a) and beam 2 (b) on slopes.
Remotesensing 15 02129 g017
Figure 18. Elevation accuracy of laser footprints positioned with calibration parameters obtained with different methods for beam 1 (a) and beam 2 (b) on gentle slopes.
Figure 18. Elevation accuracy of laser footprints positioned with calibration parameters obtained with different methods for beam 1 (a) and beam 2 (b) on gentle slopes.
Remotesensing 15 02129 g018
Table 1. Experimental and validation data used in this study.
Table 1. Experimental and validation data used in this study.
PurposeDataBeamTimeFilenameTimecode of Laser Footprint (s)
CalibrationGCPsBeam 129 August 2021SYC-GF7-20210830-010119-0000011637_1241,743,151.00,
241,743,151.33
GCPsBeam 213 September 2021MYC-GF7-20210914-010412-000011921_2243,038,830.00,
243,038,830.33
Positioning verification (method one)GCPsBeam 129 August 2021SYC-GF7-20210830-010119-0000011637_1241,743,151.00,
241,743,151.33
GCPsBeam 213 September 2021MYC-GF7-20210914-010412-000011921_2243,038,830.00,
243,038,830.33
Positioning verification (method two)CPsBeam 114 June 2020
19 June 2020
24 June 2020
SYC-GF7-20200614-003402-0000003397_1
SYC-GF7-20200619-003478-0000003529_1
KSC-GF7-20200624-003555-0000003615_1
203,600,254.00,
204,032,177.00,
204,464,095.00
CPsBeam 214 June 2020
19 June 2020
SYC-GF7-20200614-003402-0000003397_1
SYC-GF7-20200619-003478-0000003529_1
203,600,253.33,
204,032,175.67
Elevation verificationRTK(CPs)Beam 114 June 2020
19 June 2020
24 June 2020
29 August 2021
3 September 2021
13 September 2021
SYC-GF7-20200614-003402-0000003397_1
SYC-GF7-20200619-003478-0000003529_1
KSC-GF7-20200624-003555-0000003615_1
SYC-GF7-20210830-010119-0000011637_1
MYC-GF7-20210903-010194-000011739_1
MYC-GF7-20210914-010412-000011921_1
203,600,253.67,
203,600,254.00,
204,032,175.67,
204,032,176.00,
204,032,176.33,
204,464,095.00,
204,464,097.33,
204,464,098.00,
241,743,149.00,
241,743,149.33,
241,743,149.66,
241,743,150.00,
241,743,150.33,
241,743,150.66,
243,038,830.33,
243,038,830.66,
242,175,040.66,
242,175,041.00.
Beam 214 June 2020
19 June 2020
24 June 2020
29 August 2021
13 September 2021
SYC-GF7-20200614-003402-0000003397_2
SYC-GF7-20200619-003478-0000003529_2
KSC-GF7-20200624-003555-0000003615_2
SYC-GF7-20210830-010119-0000011637_2
MYC-GF7-20210914-0104120000011921_2
203,600,253.00,
203,600,253.33,
204,032,175.33
204,032,175.67,
204,032,176.00,
204,464,097.33
204,464,099.33,
204,464,099.67,
241,743,147.33,
241,743,148.00,
241,743,148.33,
241,743,154.00,
241,743,154.33,
243,038,830.67,
243,038,831.00,
243,038,831.67,
243,038,832.00,
243,038,832.33
Laser FootprintsBeam 114 October 2020KRN-GF7-20201014-005278-0000005703_1214,148,011.33,
214,148,011.66,
214,148,012.33,
214,148,012.66,
214,148,013.00,
214,148,013.33,
214,148,013.66,
214,148,014.00,
214,148,014.33,
214,148,014.66,
214,148,015.33,
214,148,015.66,
214,148,016.00,
214,148,016.33,
214,148,016.66,
214,148,017.00,
214,148,017.66,
214,148,018.00,
214,148,018.33,
214,148,018.66,
214,148,019.00,
214,148,019.33,
214,148,020.00.
Beam 214 October 2020KRN-GF7-20201014-005278-0000005703_2214,148,011.00,
214,148,011.33,
214,148,011.67,
214,148,012.00,
214,148,012.33,
214,148,013.33,
214,148,013.67,
214,148,014.00,
214,148,014.33,
214,148,014.67,
214,148,015.33,
214,148,015.67,
214,148,016.00,
214,148,016.33,
214,148,016.67,
214,148,017.00,
214,148,017.33,
214,148,017.67,
214,148,018.00,
214,148,018.33,
214,148,018.67,
214,148,019.00,
214,148,019.33,
214,148,019.67
DSMBeam 1/
Beam 2
10 October 2020High precision airborne LIDAR DSM214,148,011.33,
214,148,011.66,
214,148,012.33,
214,148,012.66,
214,148,013.00,
214,148,013.33,
214,148,013.66,
214,148,014.00,
214,148,014.33,
214,148,014.66,
214,148,015.33,
214,148,015.66,
214,148,016.00,
214,148,016.33,
214,148,016.66,
214,148,017.00,
214,148,017.66,
214,148,018.00,
214,148,018.33,
214,148,018.66,
214,148,019.00,
214,148,019.33,
214,148,020.00,
214,148,011.00,
214,148,011.33,
214,148,011.67,
214,148,012.00,
214,148,012.33,
214,148,013.33,
214,148,013.67,
214,148,014.00,
214,148,014.33,
214,148,014.67,
214,148,015.33,
214,148,015.67,
214,148,016.00,
214,148,016.33,
214,148,016.67,
214,148,017.00,
214,148,017.33,
214,148,017.67,
214,148,018.00,
214,148,018.33,
214,148,018.67,
214,148,019.00,
214,148,019.33,
214,148,019.67
Table 2. Differences before and after elevation parameter calibration with seven different methods.
Table 2. Differences before and after elevation parameter calibration with seven different methods.
Centroid Extraction MethodsBeam 1Beam 2
dα/(°)dβ/(°)dα/(°)dβ/(°)
The proposed method0.0014640.0028620.0002230.001524
Centroid method0.0014650.0026590.0002060.001405
Gaussian surface fitting0.0014880.0026940.0001830.001312
The first-order gray-scale weighting method considering the detectors0.0010480.0026720.0001420.001264
The second-order gray-scale weighting method considering the detectors0.0010520.0026850.0001320.001273
Least Squares Fitting of Ellipses0.001440.0026490.0002030.00131
Polynomial surface fitting0.0014840.002695−0.000950.00104
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yang, X.; Xie, J.; Liu, R.; Mo, F.; Zeng, J. Centroid Extraction of Laser Spots Captured by Infrared Detectors Combining Laser Footprint Images and Detector Observation Data. Remote Sens. 2023, 15, 2129. https://doi.org/10.3390/rs15082129

AMA Style

Yang X, Xie J, Liu R, Mo F, Zeng J. Centroid Extraction of Laser Spots Captured by Infrared Detectors Combining Laser Footprint Images and Detector Observation Data. Remote Sensing. 2023; 15(8):2129. https://doi.org/10.3390/rs15082129

Chicago/Turabian Style

Yang, Xiaomeng, Junfeng Xie, Ren Liu, Fan Mo, and Junze Zeng. 2023. "Centroid Extraction of Laser Spots Captured by Infrared Detectors Combining Laser Footprint Images and Detector Observation Data" Remote Sensing 15, no. 8: 2129. https://doi.org/10.3390/rs15082129

APA Style

Yang, X., Xie, J., Liu, R., Mo, F., & Zeng, J. (2023). Centroid Extraction of Laser Spots Captured by Infrared Detectors Combining Laser Footprint Images and Detector Observation Data. Remote Sensing, 15(8), 2129. https://doi.org/10.3390/rs15082129

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop