Abstract
In recent years, the fractional-order derivative has achieved great success in removing Gaussian noise, impulsive noise, multiplicative noise and so on, but few works have been conducted to remove Cauchy noise. In this paper, we propose a novel nonconvex variational model for removing Cauchy noise based on the truncated fractional-order total variation. The new model can effectively reduce the staircase effect and keep small details or textures while removing Cauchy noise. In order to solve the nonconvex truncated fractional-order total variation regularization model, we propose an efficient alternating minimization method under the framework of the alternating direction multiplier method. Experimental results illustrate the effectiveness of the proposed model, compared to some previous models.
Keywords:
Cauchy noise; truncated fractional-order total variation; alternating direction method of multiplier MSC:
65F10; 90C25
1. Introduction
Image denoising is the most typical problem in image processing, which aims to recover a clean image from a degraded image with noise. In this paper, we focus on the problem of Cauchy noise removal in images. This noise is commonly found in wireless communication systems, synthetic aperture radar (SAR) images, and biomedical images [1,2,3,4]. Let f be the observed noisy image. The image observation model with Cauchy noise is mathematically expressed as
where denotes the Cauchy noise. For the Cauchy noise, a different strategy is needed because of its distribution function. A random variable x follows the Cauchy distribution if it has the following probability density function (PDF):
where is the scale parameter, and is a localization parameter which corresponds to the median of the distribution and may be assumed to be 0.
In recent years, the problem of Cauchy noise removal has drawn significant attention. Achim et al. [5] applied -stable PDF to propose a new statistical model for removing Cauchy noise in the complex wavelet domain. In [6], Wan et al. proposed a novel image segmentation technique for the color image corrupted by Cauchy noise. Based on total variation regularization, Sciacchitano et al. [7] first proposed a variational model for restoring degraded images corrupted by Cauchy noise. The model in [7] can be expressed as follows:
where is the regularization parameter, is a penalty parameter, denotes the Frobenius inner product, is an n-by-n matrix of ones, and is the predenoising result of the median filter operation for noisy image f. In [7], it is proved that the objective function in (1) is strictly convex when , and there is a unique solution. However, this model relies greatly on the solution of the last term, namely, the median filter. In order to overcome the shortcomings of Model (1), Mei et al. [8] proposed the following nonconvex variational model:
Due to the nonconvexity and nonsmoothness of Model (2), they proposed a specific alternating direction method of multiplier with convergence guarantees. As is known, although the total variation regularization variational model can preserve sharp edges, it cannot recover the fine details and textures and often produces staircase effects.
In order to overcome of the limitations of total variation regularization, one choice is using high-order total variation as a regularization term, for example, second-order total variation [9,10,11], total generalized variation [12,13,14,15], hybrid high-order total variation [16,17,18], and so on. On the other hand, some fractional-order total variation regularization models [19,20,21] have been proposed for additive and multiplicative noise removal. In all these papers, the fractional-order total variation models can alleviate the staircase effect and preserve sharp edges by choosing the order of derivative properly. Moreover, the fractional-order total variation models can also improve the performance of texture preservation because of “non-local” behavior.
To further improve the performance of the fractional-order variation model in image restoration, recently, Chan and Liang [22,23] proposed a truncated fractional-order total variation model for Gaussian noise removal. Their numerical experiments showed that their proposed truncated fractional-order total variation model performs better for eliminating the staircase effect and preserving textures, compared to the total variation regularization model and fractional-order total variation model. In this paper, we extend the truncated fractional-order total variation regularization to recover Cauchy noise and then propose the following model:
where represents the regularization term, which is introduced in Section 2, u0 denotes the image obtained by applying the median filter to the noisy image f. To our knowledge, the proposed model is the first one that uses the truncated fractional-order total variation regularizer for Cauchy noise removal. Although this seems to be a simple generalization, its optimization is more challenging than Gaussian denoising due to the nonconvexity of the data fidelity term. The main contributions of our work are as follows: (1) We propose a novel minimization model for Cauchy noise removal by adopting the truncated fractional-order total variation regularization. (2) The proposed model can suppress staircasing artifacts better and keep more details. (3) Compared with some previous Cauchy noise models, the restored images obtained by the proposed model not only have higher peak signal-to-noise ratio (PSNR) and structural similarity index measurement (SSIM), but also have better visual effects.
The rest of this paper is organized as follows. In Section 2, we give the definitions of the the truncated fractional-order total variation. In Section 3, under the frame of alternating direction method of multipliers, we develop an efficient alternating minimization algorithm to solve the proposed nonconvex Cauchy noise reduction model. In Section 4, numerical comparisons with existing methods are carried out to confirm the effectiveness of our method. Finally, concluding remarks are given in Section 5.
2. Preliminary
In this section, we briefly review the concept of truncated fractional-order total variation.
Truncated Fractional-Order Total Variation
For an image matrix , its fractional derivative can be expressed as . The discrete fractional-order gradient at pixel is defined as , , where
where K is the number of adjacent pixels used to calculate the fractional-order derivative of each pixel. According to the definition of coefficient , the following recurrence formulas can be obtained:
We use the same truncation strategy as in [22,23] to obtain the new coefficient :
and then, the truncated fractional-order gradient operators can be defined as follows: where the discrete truncated fractional-order gradients at pixel are defined by
Similarly, we also give the divergence operator by
This divergence satisfies the equation
Then, the discrete version of the truncated fractional-order total variation can be defined as follows:
when , and are equivalent.
3. Proposed Method
In this section, we present an efficient alternating minimization algorithm to solve the proposed Model (3). By introducing two auxiliary variables , Model (3) can be transformed into the following constrained problem:
To deal with the above constrained optimization problem, we give the corresponding augmented Lagrangian function of (4) as follows:
where are penalty parameters and are the Lagrangian multipliers. To solve the constrained optimization problem, (4) is equivalent to finding a saddle point of Lagrangian function . According to the alternating direction method of multipliers, the problem (5) can be solved by the following iteration scheme:
In the following, we will provide the details to solve (6a)–(6c).
The u subproblem (6b) can be rewritten as
The optimality condition of (7) can be given by the following equation:
With some simple computation, the above equation can be rewritten as the following equation:
Under the periodic boundary condition of image u, the matrices are block circulant with a circulant block. Therefore, the above equation can be solved efficiently by using fast Fourier transform operation and inverse fast Fourier operation :
The v-subproblems (6a) can be written as:
Let
then we can obtain the following gradient and Hessian matrices of
Then, the solution of the v-subproblems (6b) can be obtained by the following Newton’s method:
where represents the result of the -th Newton iteration in the -th outer iteration.
The z-subproblem (6c) can be written as
It is easy to know that its closed-form solution can be given by the following shrinkage formula:
4. Numerical Experiments
In this section, we present several numerical results to demonstrate the effectiveness of the proposed method. We compare our method with other two well-known methods: the median filter [24] and Mei’s method [8]. All the test images with the size of are shown in Figure 1. All the numerical experiments are implemented under Windows 10 and Matlab R2018a running on a desktop equipped with 2.60 GHz Inter(R) Core(TM) i5-3230M and 4 GB memory. In our experiments, PSNR and SSIM [25] are used to evaluate the image denoising effect. They are defined as follows:
where and represent the mean value of images x and y, and are the standard variance of images x and y, is the covariance of x and y, and and are constants.
Figure 1.
Test images.
In this paper, the degraded image contaminated by Cauchy noise can be obtained by the following equation:
where denotes noise level, and and follow a Gaussian distribution with a mean of 0 and variance of 1. Empirically, we set for good experimental performance. To make it easier to compare with different methods, the stopping criterion used in all the methods is set to be
4.1. Parameter Discussion
Throughout all the experiments, we set to be the same as in [22,23], which is the number of pixels to approximate the fractional derivative. In this subsection, we mainly focus on the selection of parameters and . The images “Lin”, “Lena” and “Starfish” with the noise level are used to study the choice of these parameters.
First, we study the selection of the parameters in Model (3). In order to find out how the parameter impacts the performance of our proposed method, we take the value evenly on the interval , and the step length is set to to test the image recovery quality obtained under different ; the remaining parameters are fixed. We use the same strategy to select parameters and . The curves of PSNR and SSIM with respect to and are shown in Figure 2. It is easy to see that the performance of the proposed method achieves the best results with in nearby for all the different test images. So, we fix in the following experiments. From Figure 2, we can observe that the PSNR and SSIM values are stable when . However, the calculation time increases as the values of increase. Then, in the following experiments, we set . Finally, we discuss the selection of the fractional-order parameter . We carry out experiments to compute the values of PSNR and SSIM with respect to . From Figure 2, we can see that our proposed Cauchy noise denoiser can achieve the highest PSNR and SSIM values when .
Figure 2.
(a–f) The values of PSNR and SSIM with respect to the parameters .
4.2. Image Denoising
From the above parameter selection discussion, we can find that the fractional order parameter has an important effect on the quality of the restoration images. In order to further illustrate that the fractional order parameter we set is reasonable and effective, we fix other parameters and perform numerical experiments, choosing different values of to examine the denoising effect. We consider the images “Monarch”, “Parrot”, and “Pallons” with a Cauchy noise at , “Starfish” and “Monarch” with a Cauchy noise at , respectively. We carry out our proposed method with different to remove the Cauchy noise. Figure 3 shows the denoising results obtained by our proposed method with different fractional . We can clearly see that the quality of the restored image is higher when the fractional order parameter . For these two noise levels, as the fractional parameter increases, some noise remains in the texture area of the restored image. In Table 1, we show the values of PSNR and SSIM for six different images which are obtained by our proposed method against different values of and different noise levels. As can be seen, our proposed model can achieve the highest PSNR and SSIM values when .
Figure 3.
The restored image obtained by our proposed method with different .
Table 1.
The values of PSNR and SSIM by our proposed method with different fractional order parameter and different noise level.
In order to illustrate the performance of our proposed method for Cauchy noise removal, we compare it with the median filter [24] and Mei’s method [8]. In the first experiment, we added Cauchy noise with to the test images. In Figure 4 and Figure 5, we present the restored images by different methods with and , respectively. From Figure 4 and Figure 5, it is easy to see that the median filter can effectively remove Cauchy noise, but it causes the staircase effect and oversmooths the edges. Mei’s method can provide better balance between preserving edges and alleviating the staircase effect; however, the restored images by Mei’s method show residual noise. As a comparison, we can find that our proposed model has better performance in eliminating noise and preserving the edges and details. To quantify performance comparisons, Table 2 and Table 3 list the PSNR and SSIM values of the restored images by different methods at and , respectively. In comparison with the other two methods, our proposed method can obtain the highest PSNR and SSIM values, which are consistent with the visual comparison.
Figure 4.
Denoising results of three methods at .
Figure 5.
Denoising results of three methods at .
Table 2.
PSNR and SSIM values for different algorithms ().
Table 3.
PSNR and SSIM values for different algorithms ().
4.3. Convergence Analysis
In this subsection, we plot the curves of the PSNR and SSIM values versus the iterations number to verify the convergence of our proposed method. In order to carry out this experiment, we use the images “Lin”, “Lena” and “Starfish” degraded by Cauchy noise with and , respectively. The PSNR and SSIM curves of our proposed method are presented in Figure 6. It is easy to see that the curves of PSNR and SSIM are flat when the number of iterations exceeds 60.
Figure 6.
Top row: Curves of PSNR and SSIM versus iterations number at . Bottom row: Curves of PSNR and SSIM versus iterations number at .
5. Conclusions
Based on the truncated fractional-order total variation regularization, we propose a new variational model for Cauchy noise removal. Under the framework of alternating direction of the multiplier method, we propose an alternating minimization method to solve the proposed model. Extensive experiments demonstrate the superiority of our proposed model and method over some existing methods.
Author Contributions
J.Z. and H.L. proposed the algorithm and designed the experiments; J.W. and H.L. performed the experiments; H.L. and J.W. wrote original draft, J.Z. and B.H. reviewed and edited the paper. All authors have read and agreed to the published version of the manuscript.
Funding
This work was supported by the Major Program of the National Natural Science Foundation of China under Grant 11991024, by National Science Foundation of China under Grant 61976126, by Qindao Postdoctoral Science Foundation, China (2016114), by a Project of Shandong Province Higher Educational Science and Technology Program, China (J17KA166).
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Data supporting are located in this paper.
Acknowledgments
The authors are grateful to the anonymous referees for their valuable constructive comments and suggestions, which improved the quality of this paper in the present form. The authors would also like to thank Jinjin Mei for sending us the code in [8].
Conflicts of Interest
The authors declare no conflict of interest.
References
- Idan, M.; Speyer, J.L. Cauchy estimation for linear scalar systems. IEEE Trans. Autom. Control 2010, 55, 1329–1342. [Google Scholar] [CrossRef]
- Kuruoglu, E.E.; Fitzgerald, W.J.; Rayner, P.J. Near optimal detection of signals in impulsive noise modeled with a symmetric alpha-stable distribution. IEEE Commun. Lett. 1998, 2, 282–284. [Google Scholar] [CrossRef]
- Peng, Y.; Chen, J.; Xu, X.; Pu, F. Sar images statistical modeling and classification based on the mixture of alpha-stable distributions. Remote Sens. 2013, 5, 2145–2163. [Google Scholar] [CrossRef] [Green Version]
- John, P.N. Numerical calculation of stable densities and distribution functions. Commun. Stat. Stoch. Model. 1997, 13, 759–774. [Google Scholar]
- Achim, A.; Kuruolu, E.E. Image denoising using bivariate α-stable distributions in the complex wavelet domain. IEEE Signal Process. Lett. 2005, 12, 17–20. [Google Scholar] [CrossRef]
- Wan, T.; Canagarajah, N.; Achim, A. Segmentation of noisy colour images using Cauchy distribution in the complex wavelet domain. IET Image Process. 2011, 5, 159–170. [Google Scholar] [CrossRef]
- Sciacchitano, F.; Dong, Y.; Zeng, T. Variational approach for restoring blurred images with cauchy noise. SIAM J. Imaging Sci. 2015, 8, 1894–1922. [Google Scholar] [CrossRef] [Green Version]
- Mei, J.; Dong, Y.; Huang, T.; Yin, W. Cauchy noise removal by nonconvex admm with convergence guarantees. J. Sci. Comput. 2018, 74, 743–766. [Google Scholar] [CrossRef] [Green Version]
- Liu, P.F.; Xiao, L. Efficient multiplicative noise removal method using isotropic second order total variation. Comput. Math. Appl. 2015, 70, 2029–2048. [Google Scholar] [CrossRef]
- Chen, Y.; Huang, T.Z.; Zhao, X.L.; Deng, L.J. Speckle noise removal in ultrasound images by first- and second-order total variation. Numer. Algorithms 2018, 78, 513–533. [Google Scholar]
- Tarmizi, A.; Raveendran, P. Hybrid non-convex second-order total variation with applications to non-blind image deblurring. Signal Image Video Process. 2020, 14, 115–123. [Google Scholar]
- Liu, X.W. Augmented Lagrangian method for total generalized variation based Poissonian image restoration. Comput. Math. Appl. 2016, 71, 1694–1705. [Google Scholar] [CrossRef]
- Gao, Y.; Liu, F.; Xiaoping, Y. Total generalized variation restoration with non-quadratic fidelity. Multidimens. Syst. Signal Process. 2018, 29, 1459–1484. [Google Scholar] [CrossRef]
- Shao, W.Z.; Wang, F.; Huang, L.L. Adapting total generalized variation for blind image restoration. Multidimens. Syst. Signal Process. 2019, 30, 857–883. [Google Scholar] [CrossRef]
- Jiang, L.; Yin, H. Total generalized variation and wavelet transform for impulsive image restoration. Signal Image Video Process. 2021. [Google Scholar] [CrossRef]
- Liang, J.W.; Zhang, X.Q. Retinex by Higher Order Total Variation L1 Decomposition. J. Math. Imaging Vis. 2015, 52, 345–355. [Google Scholar] [CrossRef]
- Liu, P. Hybrid higher-order total variation model for multiplicative noise removal. IET Image Process. 2020, 14, 862–873. [Google Scholar] [CrossRef]
- Sun, Y.; Lei, L.; Guan, D.; Li, X.; Kuang, G. SAR Image Speckle Reduction Based on Nonconvex Hybrid Total Variation Model. IEEE Trans. Geosci. Remote Sens. 2021, 59, 1231–1249. [Google Scholar] [CrossRef]
- Chowdhury, M.R.; Qin, J.; Lou, Y. Non-blind and Blind Deconvolution Under Poisson Noise Using Fractional-Order Total Variation. J. Math. Imaging Vis. 2020, 62, 1238–1255. [Google Scholar] [CrossRef]
- Chen, G.; Li, G.; Liu, Y.; Zhang, X.; Zhang, L. SAR Image Despeckling Based on Combination of Fractional-Order Total Variation and Nonlocal Low Rank Regularization. IEEE Trans. Geosci. Remote Sens. 2020, 58, 2056–2070. [Google Scholar] [CrossRef]
- Yang, X.; Zhang, J.; Liu, Y.; Zheng, X.; Liu, K. Super-resolution image reconstruction using fractional-order total variation and adaptive regularization parameters. Vis. Comput. 2019, 35, 1755–1768. [Google Scholar] [CrossRef]
- Chan, R.H.; Liang, H. Truncated fractional-order total variation model for image restoration. J. Oper. Res. Soc. China 2019, 7, 561–578. [Google Scholar] [CrossRef]
- Liang, H.; Zhang, J. Dual algorithm for truncated fractional variation based image denoising. Int. J. Comput. Math. 2019, 97, 1–13. [Google Scholar] [CrossRef]
- Frieden, B. A new restoring algorithm for the preferential enhancement of edge gradients. J. Opt. Soc. Am. 1976, 66, 116–123. [Google Scholar] [CrossRef]
- Wang, Z.; Bovik, A.; Sheikh, H.; Simoncelli, E. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).