Level Sets Guided by SoDEF-Fitting Energy for River Channel Detection in SAR Images
Abstract
:1. Introduction
- (1)
- A function called the SoDEF (Sum of Dual Exponential Functions) was designed and used to construct the data-fitting energy, guiding the level set evolution.
- (2)
- The adaptive AFCs were computed using two kinds of grayscale characteristics, which are more accurate and more stable.
- (3)
- An edge indicator function was incorporated to displace the Dirac function in gradient descent flow, which can encourage the evolving level sets to stop at the target edges.
2. Background
2.1. The CV Model
2.2. The RSF Model
3. Proposed Method
3.1. The SoDEF Fitting Energy Term
3.2. The Adaptive AFCs
3.3. The Improved Gradient Descent Flow
3.4. Advantages and Algorithm Implementation of the SoDEF Model
- (1)
- The SoDEF model can achieve better segmentation competence.
- (2)
- The SoDEF model can obtain high executive efficiency.
4. Experimental Results and Analysis
4.1. Detected River Channels from Real SAR Images of Different Methods
4.2. Comparison with State-of-the-Art Methods and Related Quantitative Evaluation
- (1)
- The CV model [21] is guided by the quadratic-fitting energies, and when the input image pixel grayscales are close to their AFCs, its guiding energies are small; this leads to trouble in processing areas with close grayscales. Thus, many non-target areas whose grayscales are similar to river channels are mistaken for the target areas.
- (2)
- The CVGCO model [22] computes the global coefficient of variation inside and outside the level sets as global statistics, and the local patch coefficient of variation inside and outside the level sets as local statistics. Then, it compares the differences between the global and local statistics to segment the images. However, those statistics cannot describe SAR river images well, which results in bad detection performance.
- (3)
- The RSFACI model [29] combines the region-scalable fitting term with the atlas fitting term to guide the level sets. Actually, it is mainly guided by the local quadratic-fitting energies, which extract many local details. In addition, edge leakage happens in the detected results. Therefore, the RSFACI model produced the worst detection effect.
- (4)
- The JDF model [34] exploits both local and global Jeffreys divergence-fitting energies to drive the level sets, and designs the adaptive coefficients for automatically adjusting the global and local energies. Hence, it achieved relatively better detection results than the former three LSBMs. Unfortunately, this improvement is far from satisfactory.
- (5)
- The RDE model [42] draws upon two kinds of energies, namely the reaction and diffusion energies, to guide the level sets. The reaction energy is constructed using gamma statistical distribution and area–boundary features, which inhibits interference noise to some extent. Moreover, its diffusion energy can refrain from re-initializing the level sets. Therefore, the RDE achieved some good detection results.
- (6)
- The WABSPF model [43] first utilizes the normalized ICVs of pixel grayscales inside and outside the level sets to build the WABSPF function, which can dominate the level set evolution better. Then, the adaptive coefficients are introduced into the calculation of its AFCs, which weakens the interference of noise. Consequently, it is capable of achieving better detection results than the RDE model. However, the detection accuracies of both the RDE and WABSPF models are still undesired, and still need further enhancement.
- (7)
- The FCAHS method [44] exploits the fuzzy clustering algorithm to process the obtained thumbnails, and detects the targets in SAR images based on hierarchical segmentation. Actually, this method depends on grayscale characteristics to detect river channels; therefore, many of the non-river regions were wrongly detected.
- (8)
- The AUMLSBM method [46] firstly utilizes the attention U-net to roughly segment SAR images, in order to generate the initial level sets for the subsequent detection of river channels. Then, the multi-scale LSBM is used to refine the regions of river channels. However, it only optimizes the initial conditions of the method, which cannot obviously improve the detection performance.
- (9)
- The developed LSBM is guided by the SoDEF-fitting energies substituting for the quadratic-fitting energies. It can provide much stronger energies to guide the level set evolution, which leads to higher executive efficiency, and makes the model achieve the competence to process areas with close grayscales. Moreover, the adaptive AFCs were designed with two kinds of grayscale characteristics, which can repress the effect of interference pixels. Thus, they are more accurate and stable than common mean AFCs, which creates a better detection ability. Additionally, the Dirac function in the GDF is displaced by a LoG-based edge indicator to help the evolving level sets stop at the target edges. Consequently, the SoDEF model was capable of detecting river channels in the SAR images most accurately, and produced the best detection performance.
4.3. Analysis of Robustness to Input Level Sets of the SoDEF Model
5. Discussion
5.1. About Design and Contributions of the Proposed Model
- (1)
- The defined SoDEF function was used to replace the quadratic function for constructing the data fitting energy, which provided much stronger energies and allowed the model to achieve the competence required to handle areas with close grayscales.
- (2)
- The adaptive AFCs were designed using two kinds of grayscale characteristics, and they were able to describe the region grayscale features more accurately and with better stability during the level set evolution, which created better detection performance.
- (3)
- We computed a LoG-based edge indicator, and used it to replace the Dirac function in the GDF, which encouraged the evolving level sets to stop at target edges. Thus, the efficiency of the proposed model was improved.
5.2. About Future Potential Impact and Weaknesses of the Proposed Model
6. Conclusions
- (1)
- This model was implemented through level set evolution, which is not efficient enough. Its solving method needs to be optimized to reduce its implementation complexity.
- (2)
- The local image features can be added to the model’s data-fitting energy to further improve its river channel detection accuracy.
- (3)
- The multiple level sets were introduced to extend the proposed model to multiple dimensions, in order for it to be applied to image multi-classification.
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Abbreviations
SAR | synthetic aperture radar |
LSBM | level-set-based model |
SoDEF | sum of dual exponential functions |
AFCs | adaptive area-fitting centers |
LCLSBMs | local characteristic-based LSBMs |
GCLSBMs | global characteristic-based LSBMs |
HCLSBMs | hybrid characteristic-LSBMs |
ICV | inter-class variance |
CV | Chan–Vese |
CVGCO | coefficient of variation and graph-cut optimization |
RSFACI | region-scalable fitting and atlas correcting information |
AFT | atlas fitting term |
MLRF | modified local region fitting |
DWP | double-well potential |
LGDF | local Gaussian distribution fitting |
JDF | Jeffreys divergence fitting |
RDE | reaction-diffusion energy |
FCAHS | fuzzy clustering algorithm and hierarchical segmentation |
OROEWA | optimized ratio of exponentially weighted averages |
AUMLSBM | attention U-net and multi-scale LSBM |
GDM | gradient descent method |
GDF | gradient descent flow |
DFE | data fitting energy |
References
- Dong, B.; Weng, G.; Jin, R. Active contour model driven by self organizing maps for image segmentation. Expert Syst. Appl. 2021, 177, 114948. [Google Scholar] [CrossRef]
- Bowden, A.; Sirakov, N.M. Active contour directed by the Poisson gradient vector field and edge tracking. J. Math. Imaging Vis. 2021, 63, 665–680. [Google Scholar] [CrossRef]
- Xu, H.; Lin, G. Incorporating global multiplicative decomposition and local statistical information for brain tissue segmentation and bias field estimation. Knowl. Based Syst. 2021, 223, 107070. [Google Scholar] [CrossRef]
- Fang, J.; Liu, H.; Zhang, L.; Liu, J.; Liu, H. Region-edge-based active contours driven by hybrid and local fuzzy region-based energy for image segmentation. Inf. Sci. 2021, 546, 397–419. [Google Scholar] [CrossRef]
- Liu, H.; Fang, J.; Zhang, Z.; Lin, Y. Localised edge-region-based active contour for medical image segmentation. IET Image Process. 2021, 15, 1567–1582. [Google Scholar] [CrossRef]
- Saman, S.; Narayanan, S.J. Active contour model driven by optimized energy functionals for MR brain tumor segmentation with intensity inhomogeneity correction. Multimed. Tools Appl. 2021, 80, 21925–21954. [Google Scholar] [CrossRef]
- Li, Y.; Cao, G.; Yu, Q.; Li, X. Active contours driven by non-local Gaussian distribution fitting energy for image segmentation. Appl. Intell. 2018, 48, 4855–4870. [Google Scholar] [CrossRef]
- Ali, H.; Rada, L.; Badshah, N. Image segmentation for intensity inhomogeneity in presence of high noise. IEEE Trans. Image Process. 2018, 27, 3729–3738. [Google Scholar] [CrossRef]
- Ren, S.; Wang, Y.; Dong, F. Piecewise constant level-set enhanced active shape reconstruction for electrical impedance tomography. Measurement 2021, 177, 109335. [Google Scholar] [CrossRef]
- Li, D.; Bei, L.; Bao, J.; Yuan, S.; Huang, K. Image contour detection based on improved level set in complex environment. Wirel. Netw. 2021, 27, 4389–4402. [Google Scholar] [CrossRef]
- Wang, G.; Dong, B. A new active contour model driven by pre-fitting bias field estimation and clustering technique for image segmentation. Eng. Appl. Artif. Intell. 2021, 104, 104299. [Google Scholar] [CrossRef]
- Rodtook, A.; Kirimasthong, K.; Lohitvisate, W.; Makhanov, S.S. Automatic initialization of active contours and level set method in ultrasound images of breast abnormalities. Pattern Recognit. 2018, 79, 172–182. [Google Scholar] [CrossRef]
- Sun, L.; Meng, X.; Xu, J.; Tian, Y. An image segmentation method using an active contour model based on improved SPF and LIF. Appl. Sci. 2018, 8, 2576. [Google Scholar] [CrossRef] [Green Version]
- Mahshid, F.; Kamran, K.; Sadegh, H.M.; Alireza, S. Morphological active contour driven by local and global intensity fitting for spinal cord segmentation from MR images. J. Neurosci. Methods 2018, 308, 116–128. [Google Scholar]
- Wan, M.; Gu, G.; Sun, J.; Qian, W.; Kan, R.; Qian, C.; Xavier, M. A level set method for infrared image segmentation using global and local information. Remote Sens. 2018, 10, 1039. [Google Scholar] [CrossRef] [Green Version]
- Han, B.; Wu, Y. Active contours driven by harmonic mean based KL divergence fitting energies for image segmentation. Electron. Lett. 2018, 54, 817–819. [Google Scholar] [CrossRef]
- Liu, S.; Peng, Y. A local region-based Chan-Vese model for image segmentation. Pattern Recognit. 2012, 45, 2769–2779. [Google Scholar] [CrossRef]
- Ali, H.; Badshah, N.; Chen, K.; Khan, G.A. A variational model with hybrid images data fitting energies for segmentation of images with intensity inhomogeneity. Pattern Recognit. 2016, 51, 27–42. [Google Scholar] [CrossRef]
- Birane, A.; Hamami, L. A fast level set image segmentation driven by a new region descriptor. IET Image Process. 2021, 15, 615–623. [Google Scholar] [CrossRef]
- Nithila, E.E.; Kumar, S.S. Segmentation of lung from CT using various active contour models. Biomed. Signal Process. Control 2019, 47, 57–62. [Google Scholar]
- Chan, T.F.; Vese, L.A. Active contours without edges. IEEE Trans. Image Process. 2001, 10, 266–277. [Google Scholar] [CrossRef] [Green Version]
- Subudhi, P.; Mukhopadhyay, S. A statistical active contour model for interactive clutter image segmentation using graph cut optimization. Signal Process. 2021, 184, 108056. [Google Scholar] [CrossRef]
- Ghosh, A.; Bandyopadhyay, S. Image co-segmentation using dual active contours. Appl. Soft. Comput. 2018, 66, 413–427. [Google Scholar] [CrossRef]
- Hussain, S.; Chun, Q.; Asif, M.R.; Khan, M.S. Active contours for image segmentation using complex domain-based approach. IET Image Process. 2016, 10, 121–129. [Google Scholar] [CrossRef]
- Lv, H.; Wang, Z.; Fu, S.; Zhang, C.; Liu, X. A robust active contour segmentation based on fractional-order differentiation and fuzzy energy. IEEE Access 2017, 5, 7753–7761. [Google Scholar] [CrossRef]
- Li, C.; Kao, C.; Gore, J.C.; Ding, Z. Minimization of region-scalable fitting energy for image segmentation. IEEE Trans. Image Process. 2008, 17, 1940–1949. [Google Scholar] [PubMed] [Green Version]
- Miao, J.; Huang, T.; Zhou, X.; Wang, Y.; Liu, J. Image segmentation based on an active contour model of partial image restoration with local cosine fitting energy. Inf. Sci. 2018, 447, 52–71. [Google Scholar] [CrossRef]
- Hai, M.; Wei, J.; Yang, Z.; Zuo, W.; Ling, H.; Luo, Y. LATE: A level-set method based on local approximation of Taylor expansion for segmenting intensity inhomogeneous images. IEEE Trans. Image Process. 2018, 27, 5016–5031. [Google Scholar]
- Yang, Y.; Wang, R.; Ren, H. Active contour model based on local intensity fitting and atlas correcting information for medical image segmentation. Multimed. Tools Appl. 2021, 80, 26493–26509. [Google Scholar] [CrossRef]
- Biswas, S.; Hazra, R. A level set model by regularizing local fitting energy and penalty energy term for image segmentation. Signal Process. 2021, 183, 108043. [Google Scholar] [CrossRef]
- Guo, B.; Cui, J.; Gao, B. Robust active contours based on local threshold preprocessing fitting energies for fast segmentation of inhomogenous images. Electron. Lett. 2021, 57, 576–578. [Google Scholar] [CrossRef]
- Mylona, E.A.; Savelonas, M.A.; Maroulis, D. Automated adjustment of region-based active contour parameters using local image geometry. IEEE Trans. Cybern. 2014, 44, 2757–2770. [Google Scholar] [CrossRef] [PubMed]
- Ozturk, N.; Ozturk, S. A new effective hybrid segmentation method based on C-V and LGDF. Signal Image Video Process. 2021, 15, 1313–1321. [Google Scholar] [CrossRef]
- Han, B.; Wu, Y. Active contour model for inhomogenous image segmentation based on Jeffreys divergence. Pattern Recognit. 2020, 107, 107520. [Google Scholar] [CrossRef]
- Zhang, L.; Peng, X.; Li, G.; Li, H. A novel active contour model for image segmentation using local and global region-based information. Mach. Vis. Appl. 2017, 28, 75–89. [Google Scholar] [CrossRef]
- Zhi, X.; Shen, H. Saliency driven region-edge-based top down level set evolution reveals the asynchronous focus in image segmentation. Pattern Recognit. 2018, 80, 241–255. [Google Scholar] [CrossRef]
- Safaie, A.H.; Rastiveis, H.; Shams, A.; Sarasua, W.A.; Li, J. Automated street tree inventory using mobile LiDAR point clouds based on Hough transform and active contours. ISPRS-J. Photogramm. Remote Sens. 2021, 174, 19–34. [Google Scholar]
- Wei, X.; Zheng, W.; Xi, C.; Shang, S. Shoreline extraction in SAR image based on advanced geometric active contour model. Remote Sens. 2021, 13, 642. [Google Scholar] [CrossRef]
- Li, Z.; Shi, W.; Myint, S.W.; Lu, P.; Wang, Q. Semi-automated landslide inventory mapping from bitemporal aerial photographs using change detection and level set method. Remote Sens. Environ. 2016, 175, 215–230. [Google Scholar] [CrossRef]
- Luo, S.; Sarabandi, K.; Tong, L.; Guo, S. An improved fuzzy region competition-based framework for the multiphase segmentation of SAR images. IEEE Trans. Geosci. Remote Sens. 2019, 58, 2457–2470. [Google Scholar] [CrossRef]
- Modava, M.; Akbarizadeh, G.; Soroosh, M. Integration of spectral histogram and level set for coastline detection in SAR Images. IEEE Trans. Aerosp. Electron. Syst. 2018, 55, 810–819. [Google Scholar] [CrossRef]
- Liu, J.; Wen, X.; Meng, Q.; Xu, H.; Yuan, L. Synthetic aperture radar image segmentation with reaction diffusion level set evolution equation in an active contour model. Remote Sens. 2018, 10, 906. [Google Scholar] [CrossRef] [Green Version]
- Han, B.; Wu, Y.; Basu, A. Adaptive active contour model based on weighted RBPF for SAR image segmentation. IEEE Access 2019, 7, 54522–54532. [Google Scholar] [CrossRef]
- Shang, R.; Chen, C.; Wang, G.; Jiao, L.; Okoth, M.A.; Stolkin, R. A thumbnail-based hierarchical fuzzy clustering algorithm for SAR image segmentation. Signal Process. 2020, 171, 107518. [Google Scholar] [CrossRef]
- Luo, R.; An, D.; Wang, W.; Huang, X. Improved ROEWA SAR image edge detector based on curvilinear structures extraction. IEEE Geosci. Remote Sens. Lett. 2020, 17, 631–635. [Google Scholar] [CrossRef]
- Xu, C.; Zhang, S.; Zhao, B.; Liu, C.; Sui, H.; Yang, W.; Mei, L. SAR image water extraction using the attention U-net and multi-scale level set method: Flood monitoring in South China in 2020 as a test case. Geo-Spat. Inf. Sci. 2022, 25, 209–223. [Google Scholar] [CrossRef]
- Wang, Y.; Huang, T.; Wang, H. Region-based active contours with cosine fitting energy for image segmentation. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 2015, 32, 2237–2246. [Google Scholar] [CrossRef]
- Abdelsamea, M.M.; Tsaftaris, S.A. Active contour model driven by globally signed region pressure force. In Proceedings of the 18th International Conference on Digital Signal Processing, Fira, Greece, 5–7 July 2016; pp. 1–6. [Google Scholar]
Related Coefficients | |
---|---|
CV | , |
CVGCO | , , |
RSFACI | , , , |
JDF | , , , |
RDE | , , |
WABSPF | , , |
FCAHS | , , , |
AUMLSBM | , |
SoDEF | , , |
CV | CVGCO | RSFACI | JDF | RDE | WABSPF | FCAHS | AUMLSBM | SoDEF | |
---|---|---|---|---|---|---|---|---|---|
Figure 3 | 77.4 | 87.4 | 54.5 | 88.2 | 93.0 | 97.1 | 91.6 | 95.3 | 98.4 |
Figure 4 | 80.3 | 89.6 | 53.4 | 90.3 | 95.1 | 97.4 | 94.2 | 97.1 | 99.1 |
Figure 5 | 95.6 | 95.3 | 69.8 | 96.2 | 97.8 | 99.3 | 96.7 | 99.5 | 99.9 |
Figure 6 | 80.9 | 79.0 | 63.6 | 79.7 | 97.1 | 99.0 | 81.3 | 98.2 | 99.5 |
Figure 7 | 54.1 | 56.0 | 50.4 | 57.1 | 92.5 | 97.7 | 66.2 | 95.7 | 99.2 |
Figure 8 | 52.5 | 57.2 | 49.3 | 50.3 | 87.9 | 85.9 | 61.4 | 91.6 | 98.9 |
Figure 9 | 84.7 | 84.6 | 65.4 | 83.3 | 92.3 | 93.8 | 85.8 | 92.7 | 97.2 |
Figure 10 | 82.2 | 83.1 | 56.8 | 83.7 | 91.9 | 92.6 | 86.3 | 92.3 | 98.1 |
CV | CVGCO | RSFACI | JDF | RDE | WABSPF | FCAHS | AUMLSBM | SoDEF | |
---|---|---|---|---|---|---|---|---|---|
Figure 3 | 72.3 | 56.2 | 86.6 | 54.7 | 40.8 | 14.5 | 48.1 | 25.8 | 3.8 |
Figure 4 | 68.8 | 49.4 | 88.1 | 47.2 | 30.7 | 13.8 | 35.2 | 14.5 | 3.2 |
Figure 5 | 7.9 | 6.8 | 35.2 | 6.4 | 4.2 | 1.5 | 5.3 | 1.2 | 1 |
Figure 6 | 39.7 | 42.1 | 56.4 | 41.2 | 8.8 | 3.1 | 39.7 | 5.3 | 1.6 |
Figure 7 | 92.0 | 91.7 | 95.4 | 90.6 | 62.5 | 36.8 | 87.5 | 38.4 | 1.4 |
Figure 8 | 91.8 | 91.0 | 94.5 | 92.2 | 72.4 | 77.0 | 90.3 | 58.7 | 2.5 |
Figure 9 | 24.1 | 24.2 | 39.4 | 25.7 | 10.9 | 9.6 | 22.6 | 10.1 | 6.3 |
Figure 10 | 25.3 | 23.7 | 44.9 | 22.5 | 12.0 | 11.3 | 18.4 | 11.6 | 5.1 |
CV | CVGCO | RSFACI | JDF | RDE | WABSPF | FCAHS | AUMLSBM | SoDEF | |
---|---|---|---|---|---|---|---|---|---|
Figure 3 | 4.22 | 6.34 | 13.82 | 4.31 | 5.64 | 3.24 | 1.21 | 7.12 | 1.93 |
Figure 4 | 4.59 | 6.61 | 12.43 | 4.64 | 5.82 | 3.56 | 1.32 | 7.53 | 2.02 |
Figure 5 | 3.17 | 5.26 | 12.29 | 3.26 | 4.39 | 2.13 | 1.13 | 6.15 | 1.78 |
Figure 6 | 3.86 | 5.73 | 13.67 | 3.92 | 4.85 | 2.67 | 1.18 | 6.48 | 1.84 |
Figure 7 | 4.83 | 6.77 | 14.36 | 4.93 | 6.17 | 3.88 | 1.34 | 7.81 | 2.29 |
Figure 8 | 4.94 | 6.82 | 14.54 | 5.15 | 6.33 | 4.02 | 1.42 | 7.94 | 2.51 |
Figure 9 | 5.68 | 7.19 | 15.28 | 6.57 | 7.06 | 4.39 | 1.36 | 8.13 | 2.26 |
Figure 10 | 5.35 | 7.08 | 14.85 | 6.48 | 6.91 | 4.21 | 1.25 | 8.06 | 2.18 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Han, B.; Basu, A. Level Sets Guided by SoDEF-Fitting Energy for River Channel Detection in SAR Images. Remote Sens. 2023, 15, 3251. https://doi.org/10.3390/rs15133251
Han B, Basu A. Level Sets Guided by SoDEF-Fitting Energy for River Channel Detection in SAR Images. Remote Sensing. 2023; 15(13):3251. https://doi.org/10.3390/rs15133251
Chicago/Turabian StyleHan, Bin, and Anup Basu. 2023. "Level Sets Guided by SoDEF-Fitting Energy for River Channel Detection in SAR Images" Remote Sensing 15, no. 13: 3251. https://doi.org/10.3390/rs15133251
APA StyleHan, B., & Basu, A. (2023). Level Sets Guided by SoDEF-Fitting Energy for River Channel Detection in SAR Images. Remote Sensing, 15(13), 3251. https://doi.org/10.3390/rs15133251