Next Article in Journal
Coefficient Inequalities of q-Bi-Univalent Mappings Associated with q-Hyperbolic Tangent Function
Next Article in Special Issue
Energy-Preserving AVF Methods for Riesz Space-Fractional Nonlinear KGZ and KGS Equations
Previous Article in Journal
A New Hybrid Optimal Auxiliary Function Method for Approximate Solutions of Non-Linear Fractional Partial Differential Equations
Previous Article in Special Issue
Eighth-Kind Chebyshev Polynomials Collocation Algorithm for the Nonlinear Time-Fractional Generalized Kawahara Equation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Fractional-Order Total Variation Geiger-Mode Avalanche Photodiode Lidar Range-Image Denoising Algorithm Based on Spatial Kernel Function and Range Kernel Function

1
Xi’an Key Laboratory of Active Photoelectric Imaging Detection Technology, Xi’an Technological University, Xi’an 710021, China
2
School of Electronic and Information Engineering, Changchun University of Science and Technology, Changchun 130022, China
*
Authors to whom correspondence should be addressed.
Fractal Fract. 2023, 7(9), 674; https://doi.org/10.3390/fractalfract7090674
Submission received: 11 June 2023 / Revised: 9 August 2023 / Accepted: 30 August 2023 / Published: 7 September 2023

Abstract

:
A Geiger-mode avalanche photodiode (GM-APD) laser radar range image has much noise when the signal-to-background ratios (SBRs) are low, making it difficult to recover the real target scene. In this paper, based on the GM-APD lidar denoising model of fractional-order total variation (FOTV), the spatial relationship and similarity relationship between pixels are obtained by using a spatial kernel function and range kernel function to optimize the fractional differential operator, and a new FOTV GM-APD lidar range-image denoising algorithm is designed. The lost information and range anomalous noise are suppressed while the target details and contour information are preserved. The Monte Carlo simulation and experimental results show that, under the same SBRs and statistical frame number, the proposed algorithm improves the target restoration degree by at least 5.11% and the peak signal-to-noise ratio (PSNR) by at least 24.6%. The proposed approach can accomplish the denoising of GM-APD lidar range images when SBRs are low.

1. Introduction

Lidar has been widely used in terrain mapping, forestry exploration, autonomous driving, military defense, and other fields due to its high resolution, strong anti-interference ability, and fast response speed [1,2,3,4]. Geiger-mode avalanche photodiode (GM-APD) laser radar can detect single-photon echo signals and remote weak signals [5,6,7,8,9]. However, due to the single-photon detection system of GM-APD, the detection cycle has detection dead time, and the acquired range image loses information. Moreover, under the condition of low SBRs (the ratios of the photon of the target signal received to the photon of the background noise in the gate), the target signal acquired is effortlessly submerged in noise, resulting in a giant variety of range anomalous noise. Therefore, in order to improve these range images to be high quality, it is urgent that an effective range-image denoising algorithm be developed.
The existing GM-APD range-image denoising techniques are mainly divided into local filter denoising and global filter denoising. Local filter denoising is widely used in the denoising of GM-APD lidar range images due to its advantages of having a simple principle, low computation requirements, and low resource consumption. References [10,11] used the extended median filter to filter the noise in a range image. This simple method can effortlessly achieve an appropriate suppression impact on the non-linear noise in a range image; however, it will damage the part of the target and will not maintain the details of the target. Reference [12] proposed an Improved Donut Filter algorithm (IDF), but the algorithm sacrifices a part of its target detail protection ability to improve its noise suppression ability. Reference [13] proposed a 2D dual-threshold denoising algorithm with the advantages of neighborhood smoothing and threshold segmentation. Compared with the global filtering algorithm, this algorithm has a poor smoothing effect on the whole target. The local filtering method only carries out denoising based on the relationship between sub-pixels and adjacent pixels and does not consider the similarity of image texture and details; thus, it often produces a local smoothing effect, resulting in the obvious deviation of the recovered target range information. Global filtering usually uses the spatial relationship between pixels within the whole image and the similarity of pixel values to realize range-image denoising. Compared with local filtering, global filtering can obtain a smoother target range image. Reference [14] proposed a non-local probabilistic statistical filtering algorithm (NLPS) that can maintain the true value of the range for the lidar range image, and a denoising study was carried out. However, the edge-preserving effect of this algorithm needs to be improved when there is a low SBR. Reference [15] proposed an image reconstruction algorithm based on total variation and Discrete Cosine Transform (DCT), and the effective Alternating Direction Method of Multipliers (ADMM) was used to resolve the issue. This method achieves range-image reconstruction from the perspective of global smoothing. Reference [16] proposed a range-image restoration algorithm based on non-local correlation. By constructing an energy equation with a regular term of non-local spatial correlation between pixels, this algorithm uses the ADMM to find a solution iteratively that achieves range-image restoration under sparse photons. This algorithm can suppress noise while preserving the integrity of image edges, but it is easy to over-smooth the noise and destroy target details. Reference [17] proposed an intensity guidance method to estimate range images by using the temporal and spatial correlation of reflected signals. This method utilized the sharp edges and detailed information of intensity images to achieve background noise suppression with higher complexity, but unfortunately, it also has a higher calculation cost.
In recent years, GM-APD lidar range-image denoising algorithms have mostly been used to construct energy variance with a regular term, the denoising problem has been transformed into an optimization problem, and the numerical solution method has been used for finding an iterative solution. The global filtering method has been used to achieve range-image denoising, but with this method, it is difficult to balance range-image noise removal while preserving the target details and edges. The fractional differential operator takes extra neighborhood information into account and can linearly enhance the intermediate frequency signal in the image, non-linearly retain the low-frequency signal, and at the same time, can better retain detailed information while suppressing the noise in the range image. Currently, fractional-order image denoising models can be primarily classified into two categories: fractional-order denoising models based on partial differential equations and fractional-order denoising models based on masks. Most researchers predominantly apply fractional-order denoising models to grayscale image denoising, aiming to enhance the details and edge information of the images [18]. However, there is limited research on the application of these models to range images.
Fractional-order denoising models based on masks are predominantly constructed by deriving eight directionally overlaid mask templates from the G-L definition and combining them with other theories to create improved fractional-order models. Huang et al. [19] explored the feasibility of applying a 3 × 3 fractional-order mask template to denoise range images. The experimental results show that the fractional-order integral denoising operator can successfully manage noise in range images while maintaining features and edge information, demonstrating good denoising performance for range images. However, due to the fact that the photon signals reflected by GM-APD laser radar targets originate from emitted short-pulse lasers and are constrained by technological barriers in the preparation of GM-APD array detectors, the imaging resolution of GM-APD is relatively low. As a result, the obtained signals exhibit strong consistency in both temporal and spatial distributions. When using the fractional-order denoising model based on masks for denoising range images, the lack of additional image neighborhood information leads to limited prior information during range-image denoising, resulting in insufficient availability of high-quality range images. The fractional-order denoising algorithm based on partial differential equations follows a similar process to a physical phenomenon known as heat diffusion. The 3 × 3 mask proposed by Wang et al. [20], which incorporates eight directions, exhibits limited capability in utilizing neighborhood pixel information. To address this limitation, we introduce a 5 × 5 mask extended to include sixteen directions, enabling comprehensive utilization of effective pixel information within the neighborhood. This extension aims to mitigate noise interference and enhance the quality of depth images when statistical frames are scarce. Finally, simulation and imaging experiments are conducted to validate the effectiveness of our algorithm. Xie et al. [21], based on the idea of fractional-order partial differential equation image denoising, first utilized the fractional-order whole version regularization denoising algorithm to denoise range images. However, immediately making use of the fractional-order whole variation regularization denoising mannequin to range images with a massive quantity of noise would excessively set up connections between pixels, thereby increasing the impact of noise on the current pixel. To address this problem, a preprocessing step was designed to identify the noise points by considering adjacent pixels, and only the noise points in the range image are denoised in fractional order. Although this algorithm achieved excellent denoising results for range images, the introduced preprocessing step increased the overall complexity and computation time of the algorithm, making it not an end-to-end range-image denoising algorithm. Therefore, a denoising method suitable for GM-APD lidar range images is proposed in this paper based totally on the fractional-order whole variant denoising method.
In order to achieve the denoising of GM-APD lidar range images with a low SBR, a FOTV-based denoising model of GM-APD lidar was constructed by introducing fractional differential operators. Secondly, the spatial relationship and similarity relationship between pixels were obtained by using a spatial kernel function and a range kernel function. The fractional differential operator was optimized, the FOTV model was improved, and the split Bregman algorithm was used for range-image denoising, which suppressed the noise of lost information and abnormal range values while preserving the target details and contour information. Finally, Monte Carlo simulation experiments were carried out on the algorithms proposed, including a bilateral filtering algorithm (BF), total variation denoising algorithm (TV), and fractional-order total variation denoising algorithm (FOTV), to verify their effectiveness under different SBRs and different statistical frames. Additionally, a GM-APD lidar system was built for outdoor experiments. The experimental outcomes exhibit that the denoising overall performance of the algorithm proposed is better in contrast with that of the different algorithms.

2. Algorithm Principle

A fractional differential operator is a global operator. Using an FOTV model to denoise range images can balance each frequency component in a range image, improve the accuracy of range-image reconstruction, and retain the edge details of the image. However, for the range anomalous noise and lost information generated by GM-APD lidar, it is impossible to calibrate the noise because of the small diffusion coefficient of the fractional-order total variation differential equation at the range mutation point. In this paper, the spatial proximity and pixel value similarity between pixels are introduced to optimize the fractional-order differential operator, reduce the impact of noise on the target echo data, and realize the accurate denoising of a range image with a low SBR. The flow diagram of the algorithm in this paper is shown in Figure 1.

2.1. Range-Image Extraction

In order to extract a GM-APD range image, the maximum likelihood estimation approach is utilized in this research to estimate the range parameters pixel by pixel. The method is divided into three steps. The first step is to build the impulse response function of the GM-APD, the second step is to build the logarithmic likelihood function related to the arrival time of the signal photons, and the third step is to search and solve for the likelihood function within the whole range gate to obtain the target range information.
According to [22], the output model of a pulsed laser is as follows:
f t = t τ 2 e x p t / τ ,
where f t represents the laser pulse waveform, and τ represents the laser pulse width.
Without considering the noise photons caused by background light and the detector dark count rate, the expression of the impulse response function (IRF) of GM-APD is as follows:
f t 0 t = t t 0 τ 2 e x p t t 0 / τ ,  
where f t 0 t is the impulse response function of GM-APD, and t 0 is the flight time of the target photon to be estimated. The relationship between the flight time of the target photon and the target range is:
z = c t 0 2 ,
where z is the target range, and c is the speed of light.
In a single pixel, the logarithmic likelihood function of a depth z i , j related to the photon time of flight t i , j is:
L Z z i , j ; t i , j t i , j U i , j = t i , j U i , j log f t i , j 2 z i , j c ,
where U i , j is the set of flight times within a single pixel gate.
In the range parameter z , which ranges from the time interval at the beginning of the gating to b i n s 1 time interval ( b i n s = T , where T is the gating length, and is the minimum time resolution of the count), the last time interval is discarded because the number of untriggered times accumulates at the last time interval. At this time, the corresponding likelihood function under different parameters can be obtained, and the estimated echo position z p o s can be obtained by determining the parameter value corresponding to the maximum value of the likelihood function.
z p o s = a r g m a x z L Z .
The above process is repeated, and maximum likelihood estimation is carried out pixel by pixel to extract the 3D range image g .

2.2. Definition of Fractional Differential Operator and Its Effect on Image Signals

Let the function f x be defined by the interval [ a , b ] , and n 1 v < n , where n is a positive integer, then [23]
D x v v G L f x = lim h 0 k = 0 x v h 1 k v k f x k h , v > 0 ,
where v k = Γ v + 1 Γ k + 1 Γ v k + 1 , [ · ] represents the integer operation, and h represents the differential step size.
In order to define the discrete derivative, according to the G-L definition, on the interval a , t , use the same partition h = 1   , so m = t a h = t a , and the discrete form is expressed as:
D t v t = f t + 1 1 · v · f t 1 + 1 2 · v v 1 2 · f t 2 + + 1 j · Γ v + 1 Γ j + 1 Γ v j + 1 · f t j .
Extend the above concepts to the functions of the two variables
D x v x , y = lim N j = 0 N 1 ( 1 ) i · Γ v + 1 Γ i + 1 Γ v i + 1 · f ( x i , y ) ,
D y v x , y = lim N j = 0 N 1 ( 1 ) j · Γ v + 1 Γ j + 1 Γ v j + 1 · f ( x , y j ) ,
N is the number of terms of the polynomial. From Equations (3) and (4), the fractional differential coefficient w m v of order v can be written:
w m v = ( 1 ) m · Γ v + 1 Γ m + 1 Γ v m + 1 .
The edge information and detailed information of the range image are generally sub-high-frequency or high-frequency information, and the smooth region is generally low-frequency information. Next, the influence of the frequency response of the fractional differential operator on the range image is analyzed.
Given that the general real number v R + is a derivative of f ( t ) L 2 ( R ) , it can be expressed as:
D v f t = d v f ( t ) d t v .
According to the Fourier formula, the form of D v f t in the Fourier transform domain can be obtained via:
D v f t = R i 2 π w r v F ( w r ) e x p i 2 π w r t d w r .
On the basis of signal processing, the form of the derivative of the signal in the frequency domain is obtained. The Fourier transformation process is defined as follows:
D v F w r = i w r v F w r ,
D v f t F T D ^ v f w r = i w r v f ^ w r = w r v e x p i θ v ( w r ) f ^ w r = w r v e x p v π i 2 s g n ( w r ) f ^ w r ,
where D v represents the differential operator of order v , w r represents the angular frequency, i w r v = w r v e x p v π i 2 s g n ( w r ) is a filter, and s g n ( · ) is a sign function.
Amplitude–frequency characteristic curves of different orders are drawn [24], as shown in Figure 2.
Generally, the region of w > 1 is the edge and detailed part of the image. Figure 2 illustrates how the fractional differential operator contributes to the enhancement of the signal in the high-frequency region, and with the increase in the fractional order, the non-linear enhancement ability of the fractional differential operator is stronger; so, the fractional differential can enhance the edge information of the image. In addition, the region of 0 < w < 1 is generally the smooth region of the image. The fractional order has a weaker weakening effect on the image than the integer order, so the amplitude of the smooth region can be kept unchanged, which indicates that fractional-order differentiation can protect the information of the smooth region from the influence of the filter while denoising.
In the GM-APD lidar range image, the edge and noise manifest as locally discontinuous points, with adjacent pixels corresponding to noise and edge exhibiting significant variations in depth values, representing high-frequency components of the image. The edges possess order and directionality, displaying a strong correlation with neighboring pixels, whereas the noise signal is characterized by randomness and lacks correlation with nearby pixels. Generally, low-frequency regions in the image correspond to smooth areas of the target object. In signal and image processing, leveraging the correlation among adjacent pixels can help mitigate the impact of noise. By constructing a differential operator based on this concept, it becomes possible to effectively handle image noise while preserving edge details. Optimal results can be achieved by adjusting the order of fractional differentiation, thereby enhancing the performance and quality of GM-APD lidar range images.

2.3. FOTV Denoising Model

The FOTV denoising model is [25] represented as:
min u BV D v u 1 + λ 2 u g 2 2 ,
where u is the range image to be denoised, and g is the input range image containing noise
D v u 1 = i , j D v u i , j , D v u i , j = D 1 v u i , j 2 + D 2 v u i , j 2 ,
where D v u 1 is the fractional-order variational regular term (FOTV) and D v u i , j is the fractional-order differential operator.
According to the G-L definition, the discrete fractional differential operator is defined as follows:
D v u i , j = D 1 v u i , j , D 2 v u i , j , i = 1,2 , , N   ,   j = 1,2 , , N ,
Here,
D 1 v x , y = j = 0 N 1 ( 1 ) i · Γ v + 1 Γ i + 1 Γ v i + 1 · f ( x i , y ) ,
D 2 v x , y = j = 0 N 1 ( 1 ) j · Γ v + 1 Γ j + 1 Γ v j + 1 · f x , y j ,
where N 3 is an integer and Γ represents the Gamma function. Operator D can be realized in the following form:
D 1 v u ; , j = B × u ; , j , 1 j N ,
Here, the matrix is
B = w 0 v 0 0 w 1 v w 0 v 0 w m v w m 1 v w 0 v ,
where w k v = ( 1 ) k Γ v + 1 Γ k + 1 Γ v k + 1 , and D 2 v is the same.
When the order v is not an integer, B is a lower triangular matrix. As can be seen from the above equation, the fractional derivative of the k point is calculated by using all of the points preceding k. Obviously, the fractional derivative is regarded as a worldwide operator.

2.4. Solution to the FOTV Denoising Model

The solution to the FOTV denoising model usually optimizes the objective function by using the iterative algorithm, among which the split Bregman algorithm is an effective way to solve for the TV regularization model containing an L1 norm. The convex optimization model with L1 norm regularization makes it difficult to obtain the optimal solution using traditional algorithms. In the calculation process of the split Bregman algorithm, the regularization parameter is fixed as a constant so as to reduce the amount of memory, thus improving the calculation accuracy and convergence speed [26,27,28].
By introducing the auxiliary variable z , the original denoising problem is transformed into:
min u , z z 1 + λ 2 u g 2 2 ,   s . t .   D v u = z ,
z and λ 2 u g 2 2 are convex functions and differentiable. As a result, the constraint problem can be recast as an unconstrained optimization problem.
min u , z z 1 + λ 2 u g 2 2 + γ 2 z D v u 2 2 ,  
where γ is the penalty function. Since there are two variables, an auxiliary variable b is introduced to fix the problem.
u k + 1 , z k + 1 = argmin u , z z 1 + λ 2 u g 2 2 + γ 2 z D v u b k 2 2 ,   b k + 1 = b k + γ λ D v u k + 1 z k + 1 .
Since the sub-problem needs to solve for both u and z at the same time, the calculation is complicated, which can be decomposed into:
u k + 1 = argmin u λ 2 u g 2 2 + γ 2 z k D v u b k 2 2 , z k + 1 = argmin z z 1 + γ 2 z D v u k + 1 b k 2 2 , b k + 1 = b k + γ λ D v u k + 1 z k + 1 .
If u k + 1 u k u k ϵ , the iteration ends, and the range image after denoising is output as u = u k + 1 ; otherwise, the iteration continues until convergence.
The pseudo-code of the range-image denoising algorithm based on FOTV is shown in Algorithm 1.
Algorithm 1 Range-Image Denoising Algorithm Based on G-L Fractional-Order Total Variation
1. Initialize the system: k = 0 , u 0 = g , z 0 = 0 , b 0 = 0
2. The value of the given parameter: γ , λ
3. Calculation D v
4. For k = 0,1 , 2 , :
    u k + 1 argmin u λ 2 u g 2 2 + γ 2 z k D v u b k 2 2
    z k + 1 argmin z z 1 + γ 2 z D v u k + 1 b k 2 2
    b k + 1 = b k + γ λ D v u k + 1 z k + 1
   If u k + 1 u k u k ϵ
     u = u k + 1
    Else
     k = k + 1
     To step 4
    End
  End

2.5. Fractional-Order Total Variational Range-Image Denoising Algorithm Based on Spatial Kernel Function and Range Kernel Function

In this paper, a novel fractional-order range-image denoising algorithm is proposed. This algorithm introduces range kernel functions and spatial kernel functions to capture the relationships between pixel values and the spatial distribution of pixels, optimizing the fractional-order operator and enabling end-to-end range-image denoising.
Due to the fact that the target usually converges at multiple pixels on the detector focal plane, the accuracy of denoising can be improved by leading a fractional-order operator to establish a relationship between the pixels. However, when the target range image contains a large amount of noise, establishing the connection with any other pixel will also quickly boost the current pixel’s susceptibility to noise. By using the variational method, the partial differential Equation (15) is derived as follows:
D v · D v u D v u + λ u g = 0 ,
where D v is the fractional difference operator, and 1 D v u is the diffusion coefficient. As can be seen from the above equation, for noise points with lost information and abnormal range values, the diffusion coefficient is small due to the large value of D v u , and the FOTV denoising algorithm cannot remove the noise at this time. Therefore, in order to suppress the anomalous noise in the range image, this paper introduces a spatial kernel function to obtain the spatial relationship between pixels, introduces a range kernel function to obtain the pixel value similarity relationship between pixels, and reconstructs the fractional differential operator [29].
The inclusion of fractional differential operators expands the penalty term to infinite dimensions. Therefore, it is necessary for the spatial kernel function and range kernel function introduced in this paper to correspond with the dimension of fractional differential operators D 1 v and D 2 v .
The spatial kernel function describes the spatial range between the neighborhood pixel and the current pixel, which is usually an attenuation function for the spatial range. In this paper, a Gaussian function is selected as its attenuation function. The weights of the spatial kernel function at (x, y) are extended to an infinite number of dimensions in both the x and y directions, respectively.
The weight of the spatial kernel function w s 1 x , y at x , y in the x direction is defined as follows:
w s 1 x , y = exp | i x | 2 2 σ s 2 , i = 1,2 , , N ,
The weight of the spatial kernel function w s 2 x , y at x , y in the y direction is defined as follows:
w s 2 x , y = exp | j y | 2 2 σ s 2 , j = 1,2 , , N ,
where σ s is the variance in the spatial kernel function. N is the total number of pixels in the x or y direction of the range image.
The range kernel function describes the degree of correlation between pixel values of other pixels in the image and the current pixel. In this paper, a Gaussian function is selected to represent the similarity relationship between pixel values. The weights of the range kernel function at (x, y) are extended to an infinite number of dimensions in both the x and y directions, respectively.
The weight of the range kernel function w r 1 x , y at x , y in the x direction is defined as follows.
w r 1 x , y = exp g i , y g x , y 2 2 σ r 2 , i = 1,2 , , N ,
The weight of range kernel function w r 2 x , y at x , y in the y direction is defined as follows.
w r 2 x , y = exp g x , j g x , y 2 2 σ r 2 , j = 1,2 , , N ,
where σ r is the variance in the spatial kernel function. N is the total number of pixels in the x or y direction of the range image.
Due to the limited detection field of GM-APD LiDAR systems compared to target size, resulting images exhibit high spatial sampling of targets and contain rich spatial distribution information, enabling the depiction of edge and detail features. This paper introduces a value kernel function to accurately capture correlations between all image pixels for improved target spatial distribution analysis. In addition, as the global total variation filtering method may excessively smooth the range image and overlook its details, a spatial kernel function is introduced to utilize the spatial relationship between pixels and preserve these details. Moreover, for signal points triggered by noise in the range image, the spatial kernel function can restrict the use of surrounding pixels that affect such points to prevent excessive noise signals from affecting them.
The inclusion of fractional differential operators expands the penalty term to infinite dimensions. By combining Equations (18) and (19), the values of Equations (27)–(30) range from 0 to 1, exhibiting a consistent order of magnitude and allowing for multiplication; the new fractional differential operator is:
D 1 v u x , y = i = 0 N 1 1 i C i v u x i , y w s 1 x i , y w r 1 x i , y x = 1 x = M i = 0 N 1 1 i C i v u x i , y w s 1 x i , y w r 1 x i , y , D 2 v u x , y = i = 0 N 1 1 i C i v u x , y i w s 2 x , y i w r 2 x , y i y = 1 y = M i = 0 N 1 1 i C i v u x , y i w s 2 x , y i w r 2 x , y i ,
where M is the number of rows (columns) of the GM-APD focal plane array.
If w i v = ( 1 ) i C i v w s x 1 , y w r x k , y , Equation (31) can be written as follows:
1 v u u · B ,   2 v u B T · u ,
The form of matrix B is as follows:
B = w 0 v 0 0 w 1 v w 0 v 0 w m v w m 1 v w 0 v .
Multiplying the spatial kernel function with the range kernel function is a compromise that combines the spatial proximity and pixel value similarity of an image. It simultaneously considers spatial information and pixel value similarity, achieving the goal of edge-preserving denoising. The optimization method proposed in this paper takes into account the spatial distribution relationship, which allows for better noise filtering in the image.
In the first step, the median filtering algorithm is used for preprocessing; in the second step, the fractional difference operator combined with the spatial kernel function and range kernel function is constructed; in the third step, the fractional-order total variation model is based on the spatial kernel function and range kernel function; and in the fourth step, the split Bregman algorithm is used to solve the problem. The pseudo-code of the range-image denoising algorithm is shown in Algorithm 2.
Algorithm 2 FOTV Based on Spatial Kernel Function and Range Kernel Function
1. Median filtering: g = m e d f i l t ( g , [ 3,3 ] )
2. Initialization: k = 0 , u 0 = g , z 0 = 0 , b 0 = 0
3. The value of the given parameter: γ , μ , σ s , σ r
4. Calculation w s , w r ,   B
5. For k = 0,1 , 2 , :
    u k + 1 argmin u λ 2 u g 2 2 + γ 2 z k B u b k 2 2
    z k + 1 argmin z z 1 + γ 2 z B u k + 1 b k 2 2
      b k + 1 = b k + γ λ B u k + 1 z k + 1
    If u k + 1 u k u k ϵ
     u = u k + 1
    Else
     k = k + 1
     To step 5
    End
  End

3. Evaluation Index and Simulation Verification

3.1. Evaluation Index

K, the target recovering degree, was adopted in this study [30] as an objective evaluation indicator. The PSNR was used to evaluate the denoising performance of the algorithm cited in this paper and the range image of the algorithm proposed. K is shown as follows:
f x = 1 , d d s < d b , 0 , d d s   d b ,
K = m n ,
where d is the target reconstruction range value, d s is the target standard range value, d b is the target allowable error range value, n is the total pixel number of the target, and m is the pixel number of the target acceptable error range value. The K value represents the degree of target restoration.
The peak signal-to-noise ratio is as follows:
P S N R = 10 log 10 255 2 × M × N i , j u i , j f i , j 2 ,
where f is the observation range image, u is the range image after noise removal, and M and N are the number of rows and columns in the image, respectively.

3.2. Simulation Analysis

The Monte Carlo method was adopted to simulate and verify the GM-APD lidar range-image denoising performance of the algorithm proposed. The range image of the simulated target is shown in Figure 3. The laser single-pulse energy was set as 1.25 × 10 9 J, the laser wavelength as 1064 nm, the laser pulse width as 5 ns, the detector array as 64 × 64 , the detector time resolution as 1 ns, the round-trip atmospheric attenuation coefficient as 0.8 × 0.8 , the target diffuse reflection coefficient as 0.3, the receiving transmittance as 90%, and the transmitting transmittance as 80%. The range gate was set as 200 m, and the target was 60 m inside the range gate. The TV, FOTV, and BF algorithms, as well as the method proposed in this research, were utilized to process the simulation range image utilizing various SBRs and various frames. The simulation experiment was performed 1000 times in each example, and the mean value was computed to assess the outcomes using the target reduction degree and peak signal-to-noise ratio [31].

3.2.1. Fractional-Order Selection

To investigate how the fractional order affects the denoising effectiveness of low SBR simulation data, the fractional orders were set to 0.1, 0.3, 0.5, 0.7, 1, 1.2, 1.5, 1.8, and 2, and 20 statistical frames were needed to obtain an SBR equal to 0.3. The Monte Carlo repeated experiments were conducted 1000 times. The range-image quality was assessed using the average values of the target reduction degrees and PSNRs. The valuation indices K and PSNR of different orders are shown in Table 1.
The data in Table 1 indicates that when the fractional order is 0.7 with a low SBR, the values of K and PSNR are the largest, and the denoising effect is the best.

3.2.2. Simulation Analysis of Range Images with Different SBRs under 20 Frames

In order to verify the denoising performance of the algorithm proposed in this paper with the same frame number as that used in Section 3.2.1 but with different SBRs, the SBRs were set to 0.3, 0.4, 0.5, 0.6, and 0.7. The K and PSNR were used to assess the denoising performance. The single Monte Carlo simulation results of 20 frames with different SBRs are shown in Figure 4.
As can be seen in Figure 4, when the SBR is equal to 0.3, there is a large amount of noise at the target position in the range image when processed by the TV, FOTV, and BF algorithms, and the integrity and contour information of the target is poor. The algorithm proposed in this paper filters out most of the noise at the target position and can roughly identify the contour information of the target, but the interior of the target is incomplete. When the SBR is equal to 0.4, the range image processed by the TV, FOTV, and BF algorithms has a complete target that is roughly recovered, but there is still noise, and the smoothness of the range image is poor. This algorithm not only recovers the complete target precisely compared with the others but also shows few differences with the standard image and has a good denoising effect. When the SBR = 0.8, the range image target processed by the TV, FOTV, and BF algorithms is complete and smooth, but there is still a small amount of noise. This algorithm still ensures a good denoising effect.
In order to verify the stability of the denoising performance of the algorithm proposed with the same frame number and different SBRs, Monte Carlo experiments were conducted 1000 times on the TV, FOTV, and BF algorithms alongside the algorithm proposed in this paper. The K, PSNR, and SSIM were used to evaluate the range image processed by each algorithm. The average values of each index are shown in Table 2.
According to the above data, K and PSNR curves under different signal-to-background ratios under 20 frames are drawn, as shown in Figure 5.
As is discernible from Figure 5 and Figure 6, the increase in the SBR, K, and PSNR of each algorithm is improved to varying degrees, and the K and PSNR of the algorithm proposed are superior to those of the comparison algorithms in regard to the SBRs. When the SBR is 0.4, the K value of the TV, FOTV, and BF algorithms is less than 85%, and the PSNR is less than 16, while the target K value of the algorithm in this paper reaches 95.49%, and the PSNR value reaches 20.6488. It is proved that the algorithm proposed has good denoising performance. When the SBR is 0.5, the K value of the algorithm proposed reaches 0.9865, which is at least 5.11% higher than that of the other algorithms, and the PSNR value reaches 26.0541, which is at least 24.6% higher than that of the other algorithms.
The fractional-order derivative is a global operator with long memory, which distinguishes it from integer-order derivatives. When the depth image of a target contains a large amount of noise, establishing connections between pixels can increase the influence of noise on the current pixel. TV’s results are better than FOTV’s results.

3.2.3. Simulation Analysis of Range Image with Different Frame Numbers When SBR Is 0.5

In order to verify the influence of different statistical frames on the denoising performance of the algorithm proposed, the simulation data from when the SBR = 0.5 were selected to discuss the processing results of the TV, FOTV, and BF algorithms and the algorithm proposed in this paper when the frame numbers were 20, 25, 30, 35, 40, 45, and 50. The single Monte Carlo simulation results when the SBR is equal to 0.5 with different frame numbers are shown in Table 3.
From Figure 7 and Figure 8, it can be seen that the K and PSNRs of each algorithm are improved to varying degrees with the increase in the statistical frame number. When the statistical frame number was 25, the K of the TV, FOTV, and BF algorithms did not exceed 70%. In contrast, the K of the algorithm proposed reached 0.8198, which indicates a better denoising of the range image. When the quantity of image frames is 35, compared with the other comparison algorithms, the K and PSNR of the algorithm proposed are improved by at least 13.58% and 24.55%.

4. Experimental Verification

4.1. Experimental System Construction

A 64 × 64 array GM-APD was selected as the detector of the system when building the laser radar system with a separate transmitter and receiver, as shown in Figure 9. The transmit–receive field of view was 0.9 ° × 0.9 ° , and a 1064 nm fiber laser was selected as the laser source, of which the pulse laser output energy was set to 110 uJ with a 10 ns pulse width and 15 kHz repetition frequency.

4.2. Experimental Data Processing and Analysis

Imaging experiments were conducted on residential buildings with a range of 446.1 m to 463.2 m under strong sunlight to verify the denoising performance of the algorithm proposed. The scenario of the target area is shown in Figure 10. In order to obtain the ideal range image, the same target region was detected and imaged by the peak-picking method at night. A total of 5000 frames were used for the multi-frame statistics. The image obtained was taken as the ideal range image of the target, as shown in Figure 11.
In the daytime imaging experiment, the SBR was equal to 0.8. In the case of 100 frames, the TV denoising, FOTV denoising, and BF denoising algorithms, as well as the algorithm proposed in this paper, were used to denoise the range image obtained by the maximum likelihood estimation method. Figure 12, Figure 13, Figure 14 and Figure 15 show the result after denoising.
The denoising algorithm designed in this paper can denoise the target range image better than the contrast method and produce a smoother target region. Various indicators were used to evaluate the reconstructed range image quality, the data results are shown in Table 4.
The denoising method proposed in this paper improves the target restoration degree by at least 4.29%, and the PSNR is 4.6969, both of which are better than those of the comparison algorithms. For GM-APD range images, the method provided in this paper’s denoising performance has been successfully verified as good.
In order to verify the advancement of our algorithm, our algorithm is compared with [21] in the case of 100 frames, and the SBR is 0.8. Figure 16 shows the denoised results. The comparative data between [21] and the algorithm proposed are presented in Table 5.
Both K and PSNR of the proposed algorithm are superior to the comparison algorithm, which can verify the advancement of the proposed algorithm.

5. Discussion

In order to achieve the denoising of GM-APD lidar range images with a low SBR, a fractional-order total variational GM-APD lidar range-image denoising method based on a spatial kernel function and range kernel function was proposed. The simulation results show that when the SBR is equal to 0.4, and the statistical frame number is 20, compared with BF denoising, FOTV denoising, and TV denoising, the K and PSNR of the algorithm proposed here are improved by at least 11.98% and 24.83%, respectively. The experimental results show that when the SBR is 0.8 and the statistical frame number is 100, the K of the algorithm proposed increases by at least 0.2% compared with that obtained via BF denoising, FOTV denoising, and TV denoising. It can be seen that the denoising method proposed in this paper has a good image denoising effect under the condition of a low SBR.

Author Contributions

Conceptualization, X.W. (Xuyang Wei), D.X., Z.W. and K.Y.; methodology, X.W. (Xuyang Wei), D.X., and X.W. (Xinjian Wang); software, X.W. (Xuyang Wei) and Z.W.; formal analysis, X.W. (Xuyang Wei); data curation, K.Y., X.W. (Xuyang Wei), Z.W. and T.H.; writing—original draft preparation, X.W. (Xuyang Wei); writing—review and editing, K.Y., X.W. (Xuyang Wei), X.L., and C.W.; funding acquisition, X.L. and C.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key R&D Program of China, grant number 2022YFC3803700.

Data Availability Statement

No new data were created.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Shi, X.; Lu, W.; Sun, J.; Ge, W.; Zhang, H.; Li, S. Suppressing the influence of GM-APD coherent lidar saturation by signal modulation. Optik 2023, 275, 170619. [Google Scholar] [CrossRef]
  2. Liu, D.; Sun, J.; Lu, W.; Li, S.; Zhou, X. 3D reconstruction of the dynamic scene with high-speed targets for GM-APD LiDAR. Opt. Laser Technol. 2023, 161, 109114. [Google Scholar] [CrossRef]
  3. Wang, M.; Sun, J.; Li, S.; Lu, W.; Zhou, X.; Zhang, H. Research on infrared image guided GM-APD range image recovery algorithm under limited detections. Opt. Lasers Eng. 2023, 166, 107579. [Google Scholar] [CrossRef]
  4. Huang, M.; Zhang, Z.; Cen, L.; Li, J.; Xie, J.; Zhao, Y. Prediction of the Number of Cumulative Pulses Based on the Photon Statistical Entropy Evaluation in Photon-Counting LiDAR. Entropy 2023, 25, 522. [Google Scholar] [CrossRef]
  5. Zhang, Y.; Li, S.; Sun, J.; Zhang, X.; Zhou, X.; He, R.; Zhang, H. Three-dimensional imaging of ships in the foggy environment using a single-photon detector array. Optik 2023, 272, 170310. [Google Scholar] [CrossRef]
  6. Ding, Y.; Qu, Y.; Sun, J.; Du, D.; Jiang, Y.; Zhang, H. Long-distance multi-vehicle detection at night based on Gm-APD lidar. Remote Sens. 2022, 14, 3553. [Google Scholar] [CrossRef]
  7. Zhang, Y.; Li, S.; Sun, J.; Liu, D.; Zhang, X.; Yang, X.; Zhou, X. Dual-parameter estimation algorithm for Gm-APD lidar depth imaging through smoke. Measurement 2022, 196, 111269. [Google Scholar] [CrossRef]
  8. Liu, D.; Sun, J.; Gao, S.; Ma, L.; Jiang, P.; Guo, S.; Zhou, X. Single-parameter estimation construction algorithm for Gm-APD lidar imaging through fog. Opt. Commun. 2021, 482, 126558. [Google Scholar] [CrossRef]
  9. Jiang, Y. Adaptive Suppression Method of LiDAR Background Noise Based on Threshold Detection. Appl. Sci. 2023, 13, 3772. [Google Scholar] [CrossRef]
  10. Green, T.J., Jr.; Shapiro, J.H. Detecting objects in three-dimensional laser radar range images. Opt. Eng. 1994, 33, 865–874. [Google Scholar] [CrossRef]
  11. Saban, I.; Faibish, S. Image processing techniques for laser images. In Proceedings of the 1996 Canadian Conference on Electrical and Computer Engineering, Calgary, AB, Canada, 26–29 May 1996; Volume 1, pp. 462–465. [Google Scholar] [CrossRef]
  12. Yu, J.; Yang, S.; Zhu, B. Noise suppression and the method evaluation for ladar range images. J. Optoelectron. Laser 2015, 26, 1215–1221. [Google Scholar] [CrossRef]
  13. Wang, M.; Sun, J.; Li, S.; Lu, W.; Zhou, X.; Zhang, H. A photon-number-based systematic algorithm for range image recovery of GM-APD lidar under few-frames detection. Infrared Phys. Technol. 2022, 125, 104267. [Google Scholar] [CrossRef]
  14. Xia, Z.W.; Li, Q.; Xiong, Z.P.; Wang, Q. Ladar range image denoising by a nonlocal probability statistics algorithm. Opt. Eng. 2013, 52, 017003. [Google Scholar] [CrossRef]
  15. Halimi, A.; Altmann, Y.; McCarthy, A.; Ren, X.; Tobin, R.; Buller, G.S.; McLaughlin, S. Restoration of intensity and depth images constructed using sparse single-photon data. In Proceedings of the 24th European Signal Processing Conference (EUSIPCO), Budapest, Hungary, 29 August–2 September 2016; pp. 86–90. [Google Scholar] [CrossRef]
  16. Chen, S.; Halimi, A.; Ren, X.; McCarthy, A.; Su, X.; McLaughlin, S.; Buller, G.S. Learning Non-Local Spatial Correlations To Restore Sparse 3D Single-Photon Data. IEEE Trans. Image Process. 2020, 29, 3119–3131. [Google Scholar] [CrossRef] [PubMed]
  17. Wu, M.; Lu, Y.; Li, H.; Mao, T.; Guan, Y.; Zhang, L.; He, W.; Wu, P.; Chen, Q. Intensity-guided depth image estimation in long-range lidar. Opt. Lasers Eng. 2022, 155, 107054. [Google Scholar] [CrossRef]
  18. Li, C.; He, C. Fractional-order diffusion coupled with integer-order diffusion for multiplicative noise removal. Comput. Math. Appl. 2023, 136, 34–43. [Google Scholar] [CrossRef]
  19. Huang, T.; Wang, C.; Liu, X. Depth Image Denoising Algorithm Based on Fractional Calculus. Electronics 2022, 11, 1910. [Google Scholar] [CrossRef]
  20. Wang, X.; Wang, C.; Xie, D.; Wei, X.; Huang, T.; Liu, X. A spatially correlated fractional integral-based method for denoising geiger-mode avalanche photodiode light detection and ranging depth images. Optik 2023, 288, 171244. [Google Scholar] [CrossRef]
  21. Xie, D.; Wang, X.; Wang, C.; Yuan, K.; Wei, X.; Liu, X.; Huang, T. A Fractional-Order Total Variation Regularization-Based Method for Recovering Geiger-Mode Avalanche Photodiode Light Detection and Ranging Depth Images. Fractal Fract. 2023, 7, 445. [Google Scholar] [CrossRef]
  22. Wang, F.; Zhao, Y.; Zhang, Y.; Sun, X. Range accuracy limitation of pulse ranging systems based on Geiger mode single-photon detectors. Appl. Opt. 2010, 49, 5561–5566. [Google Scholar] [CrossRef]
  23. Chen, D.; Chen, Y.; Xue, D. Fractional-order total variation image denoising based on proximity algorithm. Appl. Math. Comput. 2015, 257, 537–545. [Google Scholar] [CrossRef]
  24. Zhou, Y.; Li, Y.; Guo, Z.; Wu, B.; Zhang, D. Multiplicative Noise Removal and Contrast Enhancement for SAR Images Based on a Total Fractional-Order Variation Model. Fractal Fract. 2023, 7, 329. [Google Scholar] [CrossRef]
  25. Parvaz, R. Image restoration with impulse noise based on fractional-order total variation and framelet transform. SIViP 2023, 17, 2455–2463. [Google Scholar] [CrossRef]
  26. Tom, G.; Stanley, O. The split Bregman method for L1-regularized problems. SIAM J. Imaging Sci. 2009, 2, 323–343. [Google Scholar] [CrossRef]
  27. Micchelli, C.; Shen, L.; Xu, Y. Proximity algorithms for image models: Denoising. Inverse Probl. 2011, 27, 045009. [Google Scholar] [CrossRef]
  28. Zhao, M.; Wang, Q.; Ning, J. A region fusion based split Bregman method for TV denoising algorithm. Multimed. Tools Appl. 2021, 80, 15875–15900. [Google Scholar] [CrossRef]
  29. Cheng, S.W.; Lin, Y.T.; Peng, Y.T. A Fast Two-Stage Bilateral Filter Using Constant Time O(1) Histogram Generation. Sensors 2022, 22, 926. [Google Scholar] [CrossRef]
  30. Ma, L.; Sun, J.; Jiang, P.; Liu, D.; Zhou, X.; Wang, Q. Signal extraction algorithm of Gm-APD lidar with low SNR return. Optik 2020, 206, 164340. [Google Scholar] [CrossRef]
  31. Berginc, G.; Jouffroy, M. Simulation of 3D laser imaging. PIERS Online 2010, 6, 415–419. [Google Scholar] [CrossRef]
Figure 1. Algorithm principle diagram.
Figure 1. Algorithm principle diagram.
Fractalfract 07 00674 g001
Figure 2. Fractional differential magnitude–frequency response.
Figure 2. Fractional differential magnitude–frequency response.
Fractalfract 07 00674 g002
Figure 3. Simulated vehicle range image.
Figure 3. Simulated vehicle range image.
Fractalfract 07 00674 g003
Figure 4. Denoising results of different signal-to-background ratio range images in 20 frames.
Figure 4. Denoising results of different signal-to-background ratio range images in 20 frames.
Fractalfract 07 00674 g004
Figure 5. K of different SBRs when the number of frames is 20.
Figure 5. K of different SBRs when the number of frames is 20.
Fractalfract 07 00674 g005
Figure 6. PSNR of different SBRs when the number of frames is 20.
Figure 6. PSNR of different SBRs when the number of frames is 20.
Fractalfract 07 00674 g006
Figure 7. K of different frames when SBR = 0.5.
Figure 7. K of different frames when SBR = 0.5.
Fractalfract 07 00674 g007
Figure 8. PSNR of different frames when SBR = 0.5.
Figure 8. PSNR of different frames when SBR = 0.5.
Fractalfract 07 00674 g008
Figure 9. System diagram.
Figure 9. System diagram.
Fractalfract 07 00674 g009
Figure 10. Target scene.
Figure 10. Target scene.
Fractalfract 07 00674 g010
Figure 11. Ideal target range image.
Figure 11. Ideal target range image.
Fractalfract 07 00674 g011
Figure 12. TV.
Figure 12. TV.
Fractalfract 07 00674 g012
Figure 13. FOTV.
Figure 13. FOTV.
Fractalfract 07 00674 g013
Figure 14. BF.
Figure 14. BF.
Fractalfract 07 00674 g014
Figure 15. Proposed algorithm.
Figure 15. Proposed algorithm.
Fractalfract 07 00674 g015
Figure 16. Algorithm [21].
Figure 16. Algorithm [21].
Fractalfract 07 00674 g016
Table 1. Evaluation indices K and PSNR of different orders.
Table 1. Evaluation indices K and PSNR of different orders.
Order0.10.30.50.70.911.21.51.82
K0.63790.65920.66070.67380.66660.67000.65490.65270.64310.6388
PSNR11.741811.955511.950112.06311.939611.939411.494711.525011.554711.5779
Table 2. Denoising results of different signal-to-background ratios at frame 20.
Table 2. Denoising results of different signal-to-background ratios at frame 20.
SBRSTVFOTVBFProposed
SBR = 0.3K0.5589K0.4757K0.6154K0.6738
PSNR11.3933PSNR11.3409PSNR10.7250PSNR12.0630
SBR = 0.4K0.8342K0.7958K0.8405K0.9549
PSNR15.5224PSNR15.4328PSNR14.5584PSNR20.6488
SBR = 0.5K0.9350K0.9199K0.9361K0.9865
PSNR19.6460PSNR19.5210PSNR18.5497PSNR26.0541
SBR = 0.6K0.9747K0.9651K0.9750K0.9929
PSNR23.8157PSNR23.6289PSNR22.6735PSNR29.0068
SBR = 0.7K0.9900K0.9822K0.9902K0.9947
PSNR28.0463PSNR27.6851PSNR26.8942PSNR30.5839
Table 3. Denoising results of different frames when SBR = 0.5.
Table 3. Denoising results of different frames when SBR = 0.5.
FramesTVFOTVBFProposed
20K0.5589K0.4757K0.6154K0.6738
PSNR11.3933PSNR11.3409PSNR10.7250PSNR12.0630
25K0.6648K0.5867K0.6958K0.8198
PSNR12.5166PSNR12.4527PSNR11.7458PSNR14.6361
30K0.7469K0.6841K0.7634K0.9018
PSNR13.7025PSNR13.6282PSNR12.8409PSNR17.2648
35K0.8067K0.7586K0.8157K0.9439
PSNR14.8628PSNR14.7775PSNR13.9279PSNR19.6990
40K0.8525K0.8179K0.8576K0.9645
PSNR16.0490PSNR15.9514PSNR15.0531PSNR21.6841
45K0.8864K0.8600K0.8897K0.9760
PSNR17.2072PSNR17.1003PSNR16.1692PSNR23.3974
50K0.9126K0.8921K0.9148K0.9827
PSNR18.3680PSNR18.2520PSNR17.2977PSNR24.9162
Table 4. Range image reconstruction results.
Table 4. Range image reconstruction results.
Evaluation MetricTV DenoisingFOTV DenoisingBF DenoisingProposed
K0.82700.78280.88850.9283
PSNR4.68694.68664.68714.6969
Table 5. Range image reconstruction results.
Table 5. Range image reconstruction results.
Evaluation Metric[21]Proposed
K0.89650.9283
PSNR4.44214.6969
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wei, X.; Wang, C.; Xie, D.; Yuan, K.; Liu, X.; Wang, Z.; Wang, X.; Huang, T. Fractional-Order Total Variation Geiger-Mode Avalanche Photodiode Lidar Range-Image Denoising Algorithm Based on Spatial Kernel Function and Range Kernel Function. Fractal Fract. 2023, 7, 674. https://doi.org/10.3390/fractalfract7090674

AMA Style

Wei X, Wang C, Xie D, Yuan K, Liu X, Wang Z, Wang X, Huang T. Fractional-Order Total Variation Geiger-Mode Avalanche Photodiode Lidar Range-Image Denoising Algorithm Based on Spatial Kernel Function and Range Kernel Function. Fractal and Fractional. 2023; 7(9):674. https://doi.org/10.3390/fractalfract7090674

Chicago/Turabian Style

Wei, Xuyang, Chunyang Wang, Da Xie, Kai Yuan, Xuelian Liu, Zihao Wang, Xinjian Wang, and Tingsheng Huang. 2023. "Fractional-Order Total Variation Geiger-Mode Avalanche Photodiode Lidar Range-Image Denoising Algorithm Based on Spatial Kernel Function and Range Kernel Function" Fractal and Fractional 7, no. 9: 674. https://doi.org/10.3390/fractalfract7090674

Article Metrics

Back to TopTop