Next Article in Journal
Hotspot Information Network and Domain Knowledge Graph Aggregation in Heterogeneous Network for Literature Recommendation
Next Article in Special Issue
Retinex-Based Relighting for Night Photography
Previous Article in Journal
Blockchain Integrated IoT for Food Supply Chain: A Grey Based Delphi-DEMATEL Approach
Previous Article in Special Issue
Efficient Edge Detection Method for Focused Images
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Interval Iterative Multi-Thresholding Algorithm Based on Hybrid Spatial Filter and Region Growing for Medical Brain MR Images

1
College of Computer Science and Engineering, Changchun University of Technology, Changchun 130012, China
2
Artificial Intelligence Research Institute, Changchun University of Technology, Changchun 130012, China
3
Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China
4
College of Computer Science and Technology, Jilin University, Changchun 130012, China
*
Authors to whom correspondence should be addressed.
Appl. Sci. 2023, 13(2), 1087; https://doi.org/10.3390/app13021087
Submission received: 4 December 2022 / Revised: 7 January 2023 / Accepted: 11 January 2023 / Published: 13 January 2023
(This article belongs to the Special Issue Advances in Digital Image Processing)

Abstract

:
Medical image segmentation is widely used in clinical medicine, and the accuracy of the segmentation algorithm will affect the diagnosis results and treatment plans. However, manual segmentation of medical images requires extensive experience and knowledge, and it is both time-consuming and labor-intensive. To overcome the problems above, we propose a novel interval iterative multi-thresholding segmentation algorithm based on hybrid spatial filter and region growing for medical brain MR images. First, a hybrid spatial filter is designed to perform on the original image, which can make full use of the spatial information while denoising. Second, the interval iterative Otsu method based on region growing is proposed to segment the original image and its filtering layer. The initial thresholds can be quickly obtained by region growing algorithm, which can reduce the time complexity. The interval iterative algorithm is used to optimize the thresholds. Finally, a weighted strategy is used to refine the segmentation results. The segmentation results of our proposed algorithm outperform other comparison algorithms in both subjective and objective evaluations. Subjectively, the obtained segmentation results have clear edges, complete and consistent regions. We use the uniformity measure (U) for objective evaluation, and the U value is significantly higher than other comparison algorithms. The proposed algorithm achieved an average U value of 0.9854 across all test images. The proposed algorithm can segment medical images well and expand the doctor’s ability to utilize medical images.

1. Introduction

Image segmentation is one of the most critical image processing techniques. Image segmentation is to divide the target pixels with the same features into the same area and divide the target pixels with different characteristics into different areas [1,2]. Image segmentation performs an important role in medical image processing, and it is widely used in various aspects of the medical field [3], such as lesion localization, quantitative analysis of tissue volume, study of anatomical tissue, and subsequent treatment planning [4,5]. As the cornerstone of image processing, image segmentation has received extensive research and attention from scholars.
In recent years, researchers have conducted a lot of study on image segmentation. Many image segmentation methods have been proposed, including threshold segmentation methods [6], cluster segmentation methods [7], edge detection methods [8], region segmentation methods [9], graph cutting methods [10], methods based on artificial neural network [11,12,13,14,15,16], etc. The threshold segmentation method has the characteristics of simplicity and efficiency, and the most classic algorithms include the Otsu method [17], the maximum entropy method [18], and the minimum error method [19]. The Otsu’s thresholding method is a well-known method for medical images segmentation [20]. The key to the threshold segmentation method is the selection of the threshold, which directly determines the quality of image segmentation.
The threshold segmentation method is divided into single threshold segmentation and multi-threshold segmentation. Single threshold segmentation is to divide the image into two regions: foreground and background [21]. However, a single threshold segmentation can no longer meet clinical medical needs because of the complexity of medical images. For example, an MR (magnetic resonance) brain image can be divided into five regions in general, including gray matter, white matter, cerebrospinal fluid, skull, and background. Therefore, it is necessary to expand single threshold segmentation to multi-threshold segmentation [22]. When single threshold segmentation is extended to multi-threshold segmentation, it often causes a huge increase in time complexity and a decrease in segmentation accuracy. Therefore, how to propose a fast image segmentation method with high segmentation quality and accuracy is still a challenging task.
To solve the problem of high time complexity, Siyan Liu proposed a method of merging histogram regions to find the thresholds [23]. The optimal solution can be obtained by reducing the histogram region number in iterations. This method reduces the time complexity, but the segmentation accuracy is not high enough. Swarm intelligence algorithms can find optimal solutions in the solution space [24,25]. These methods can overcome the shortcomings of the exhaustive work. Therefore, combining image segmentation algorithms with swarm intelligence algorithms has become a research hotspot. The swarm intelligence algorithms include genetic algorithm (GA), ant colony algorithm (ACA), particle swarm algorithm (PSO), sparrow search algorithm (SSA), wolf swarm algorithm (WSA), Bacterial Foraging Algorithm (BF), adaptive bacterial foraging algorithm (ABF), Real coded Genetic Algorithm (RCGA), nelder–mead simplex method (NMS), etc. [26,27,28]. These algorithms are classic optimization algorithms. Due to its strong robustness and excellent solving ability, the Otsu method based on the above optimization algorithm has been expanded [29,30,31,32,33].
Accurate segmentation of medical images is a very difficult work problem due to the weaknesses of strong noise, complex tissue structure, blurred area boundaries, etc. To overcome this problem, Liu et al. extended Otsu to become two-dimensional, which fully considers the spatial information of image pixels and their neighborhoods [34]. It can achieve ideal segmentation results even when the original images with low contrast and low signal-to-noise ratio. Wang et al. proposed a 3D Otsu algorithm which comprehensively considers the original image, the neighborhood median and neighborhood mean information of the original image [35]. This method has stronger anti-noise performance and achieves better performance than 2D Otsu. Suhas S et al. proposed a method which combines image neighborhood mean and neighborhood median to suppress noise. It can reduce the noise well in MR images and preserve the structure of medical images detail [36]. Cai et al. proposed an iterative threshold segmentation method, which can segment weak objects and fine details well [37]. Inspired by this method, our team proposed a new interval iteration method and extended it to multiple thresholds [38]. However, the time complexity is too high. At present, there is no algorithm that can adapt to all images and achieve good segmentation results with low time complexity. For medical images, the structure is complex, the shape is irregular, and a lot of noise is easily generated during the acquisition process. In recent years, many scholars have proposed various methods to overcome these shortcomings, but medical image segmentation is still a challenging task [39,40].
To improve the segmentation accuracy of medical images and reduce the time complexity, we propose a novel interval iterative multi-thresholding algorithm based on hybrid spatial filter and region growing. The proposed method fully considers the neighborhood information in original image. It reduces the impact of noise on the quality of image segmentation, and significantly reduces the time complexity. The contributions of this paper can be summarized as follows:
(1)
A hybrid spatial filter is proposed to achieve image multi-scale decomposition which denoising while preserving more details. The proposed filter makes full use of the spatial information in the original image. It can improve the accuracy of image segmentation and make the algorithm more powerful and robust.
(2)
We proposed an interval iterative Otsu method based on region growing (RGIIM). It quickly obtains the growth threshold through the region growing method (RGM) and uses the idea of interval iteration to optimize the thresholds. This method achieves satisfactory segmentation results with minimal time cost.
(3)
A weighted strategy is used to fuse the segmentation result of the original image and its hybrid layers to make the final segmentation result more accurate.
The rest of the paper is organized as follows: Section 2 details the interval iterative Otsu method based on region growing. Section 3 describes our proposed algorithm. Section 4 depicts segmentation results and analysis on MR brain images. Conclusions and future work are presented and discussed in Section 5.

2. Interval Iterative Otsu Method Based on Region Growing

2.1. Otsu Method

The Otsu method refers to a criterion function which uses the maximum inter-class variance as the threshold selection. Assuming that the size of an image is M × N, the value range of gray level is [0, 255]. The number of thresholds is K, t i ( 0 t i 255 , i = 1, …, K) represent the thresholds and it is a variable. The image will be divided into K + 1 categories, c i (i = 1, …, K + 1) represent each category. The between-class variance is calculated as follows:
σ 2 ( t 1 , , t K ) = i = 1 k + 1 ω i ( μ i μ T ) 2
where μ i represents the average gray level of each type of pixels, and μ T represents the average gray level of the entire image. ω i represents the class probability of the i-th class ( 1 i K + 1 ) .
We define n i ( 1 i K + 1 ) as the number of pixels whose intensity in the interval of [ti−1, ti−1], and p i as the probability of pixels in category c i , and i = 0 255 p i = 1 . p i , μ i , μ T and ω i can be calculated as follows:
p i = n i M N μ i = j c i j p j μ T = j = 0 255 j p j ω i = j c i p j
The Otsu threshold segmentation method is to find the optimal thresholds t 1 , , t K by traversing the entire gray level to maximize the inter-class variance. It can be defined as follows:
t 1 * , , t K * = argmax 0 t 1 < < t K 255 { σ 2 ( t 1 , , t K ) }
where t 1 * , , t K * are the optimal thresholds.

2.2. Interval Iterative Otsu Method Based on Region Growing

The region growing method (RGM) is to treat each gray level in the image as a small area. By comparing each small area, useless areas are selected to merge with adjacent areas. By continually merging small regions, it stops growing until the number of remaining areas meet our preset conditions. Figure 1 shows the grayscale histogram of an original image and the process of region growing. Figure 1a displays the initial grayscale histogram of image I. Figure 1b–d depict the process of region growing. For image I, each gray level is regarded as an area. We can divide the image into 256 areas according to the histogram and calculate the information entropy H ( i ) of the initial 256 areas. It can be defined as follows:
H ( i ) = p ( i ) × lg ( p ( i ) ) i = 0 , 1 , 2 , , 255
where p ( i ) denotes the probability of gray i.

2.2.1. The First Stage

In the first stage, the area with the smallest information entropy, H ( i ) , is selected as the main area, which is merged with its adjacent areas. As shown in Figure 1b, the red area is the main area. The yellow areas are to merge into the red one, and the green areas are unselected.
The maximum inter-class variance W of the main area and the area to be merged with are computed separately, and we will select the area with smaller W for merging. The amount of information D k is taken as the information entropy of the new area, and it will participate in the next main area selection. The calculation of the amount of information D k as follows:
ω k = i = t k + 1 t k + 1 P i μ k = i = t k + 1 t k + 1 i P i ω k σ k 2 = i = t k + 1 t k + 1 i μ k 2 P i ω k D k = ω k σ k 2
where P i is probability of the gray level i, ω k is the probability of each area, μ k is the average gray level of each area, t k is the threshold, and σ k 2 is the variance of each area. The definition of the maximum inter-class variance W as follows:
P 0 = i = k m p ( i ) P 1 = i = m n p ( i ) m < n u 0 = i = k m i × p ( i ) u 1 = i = m n i × p ( i ) m < n u = P 0 × u 0 + P 1 × u 1 W = P 0 × u 0 u 2 + P 1 × u 1 u 2
where p ( i ) is the probability of gray level i u is the average value of the area, and W is the maximum inter-class variance of the new area.
We take Figure 1c,d as an example to illustrate the process of region growing in the first stage. In Figure 1c, it can be seen that the main area selected for the first time is merged with the area on the right to form a new area. Then, the area with the smallest information entropy H ( i ) is selected as the main area, which is marked in red. Its two adjacent areas are marked in yellow. The results of the last region growing are shown in Figure 1d. The newly generated area is selected as the main area. The area adjacent to the main area is selected as the area to be merged with. If the main area is an edge area, that is, the main area has only one adjacent area, then it is directly merged with the adjacent area without calculating W.
The above operations are repeated. The number of thresholds gradually decreases with region growing, and region growing will stop until it meets our pre-set threshold number. The final thresholds obtained by region growing are shown in Figure 2.

2.2.2. The Final Stage

According to the final thresholds (T1, T2, …, Tk−1, Tk) obtained by region growing methods, the pixels of the original image are divided into K + 1 categories, and the mean of each category is recorded as μ1,I (i = 1, …, K + 1). Pixels whose gray value p i μ 1 , 1 are divided into class C1, while pixels whose gray value p i μ 1 , K + 1 are divided into class CK+1. The remaining pixels are divided into K intervals [μ1,1, μ1,2], [μ1,2, μ1,3], …, [μ1,K−1, μ1,K], and [μ1,K, μ1,K+1]. Figure 3 depicts an example of interval iteration. Figure 3a shows the grayscale interval, and Figure 3b shows the updated grayscale interval after the first interval iteration. In Figure 3a, the intervals filled with different colors are to be iterated continuously next.
Next, Otsu single-threshold segmentation is performed in intervals [μ1,1, μ1,2], [μ1,2, μ1,3], …, [μ1,K−1, μ1,K], and [μ1,K, μ1,K+1], respectively, to obtain the thresholds T2,i (i = 1, …, K) and the corresponding class means μ2,2i−1, μ2,2i (i = 1, …, K). Pixels whose gray value is located in the interval [μ2,i, μ2,i+1] (i = 2, …, 2K − 2) are divided into Cj(j = 2, …, K), as shown in Figure 3b.
Repeat the above process in class Cj (j = 2, …, K) to obtain the threshold and class mean, and re-divide Cj (j = 2, …, K) until the threshold is satisfied T h , r T h 1 , r < δ , (where δ > 0). The final obtained T h , r (r = 1, …, K) is the optimal threshold T r (r = 1, …, K). Figure 4 shows all the optimal thresholds obtained by RGIIM.

3. The Proposed Algorithm

3.1. The Framework

The framework of the proposed algorithm is shown in Figure 5. It can be described as follows:
(1)
The original image is processed with the proposed hybrid spatial filter to obtain the hybrid layer.
(2)
The proposed RGIIM is executed on the original image and the hybrid layer separately to obtain different sets of segmentation thresholds.
(3)
The weighted strategy is performed on the segmentation thresholds to obtained the optimized segmentation thresholds.

3.2. Hybrid Spatial Filter

In our algorithm, we designed a hybrid spatial filter to improve the accuracy and robustness of image segmentation. The proposed hybrid spatial filter integrates four filters, including Gaussian filter, median filter, mean filter, and mean-median filter. These four filters have been proved by time and experiments, can remove the noise in the image very well, and retain the edge information in the image. It also can make full use of the spatial information of the original image while eliminating noise [30,41]. The common Gaussian filtering, median filter and mean filter are not repeated here. The mean-median filter is defined as follows:
m e a n - m e d i a n ( x , y ) = i = 1 a b average ( u , v ) S x y g i ( u , v ) ,   median   a b
where S x y represents the set of pixels in the rectangular sliding window with size a∗b, “median” represents the median gray value of pixels in the window centered on the point ( x , y ) , and g i ( u , v ) represents the gray value of the i-th pixel (u, v) in the window.
We sum up and find the average for the above four filters to form our proposed hybrid spatial filter. Hybrid spatial filter is defined as follows:
H ( x , y ) = ε G ( x , y ) + ϕ m e d i a n ( x , y ) + γ m e a n ( x , y ) + η m e a n - m e d i a n ( x , y )
where H(x, y) represents the hybrid spatial filter; G(x, y) denotes the Gaussian filter; median(x, y) represents the median filter; mean(x, y) represents the mean filter; mean-median(x, y) represents the mean-median filter; ε , ϕ , γ and η are four weights to balance G(x, y), median(x, y), mean(x, y), mean-median(x, y); and ε + ϕ + γ + η = 1 . Here, we set ε = ϕ = γ = η = 1 / 4 empirically.
Figure 6 shows the results of two test images processed by the proposed hybrid spatial filter. It can be seen that the images after hybrid spatial filtering are smoother. The noise has been removed, and the details and structural information in original images are well preserved.

3.3. Weighted Strategy

A weighted strategy is proposed to obtain the final segmentation thresholds for further refinement of segmentation results. The weighted strategy is simple and effective. It is defined as follows:
T f i = α T o i + β T h i ( i = 1 ,   , K )
where T f i (i = 1, …, K) denotes the final optimized segmentation thresholds, T o i and T h i refer to thresholds of the original image and its hybrid filtering layer, respectively, and α and β are two weights to balance T o i and T h i , α + β = 1 . Here, we set α = β = 1 / 2 empirically.

4. Experimental Results and Analysis

4.1. Experimental Protocols

The test images we used in the experiments are from “The Whole Brain Atlas” of Harvard Medical School Image Library (http://www.med.harvard.edu/aanlib/home.html (accessed on 20 September 2021)). Due to limited space, we chose ten brain slices #022~#112 to demonstrate the performance of our proposed algorithm. These ten brain slices are shown in Figure 7. All the experiments in this paper are run on Intel(R) Core (TM) i7-7700HQ CPU @ 2.80 GHz 2.80 GHz, 16 GB RAM, windows 10 and programming language is Python3.6. The parameter settings of the proposed algorithm and the number of thresholds are shown in Table 1.

4.2. Evaluation Measure

We use the uniformity measure as the objective evaluation index in the experiments [42]. The uniformity measure is used to quantitatively evaluate the degree of similarity in different classes divided by the segmentation algorithm. It is defined as follows:
U = 1 2 n j = 1 K i R j I i μ R j 2 N u m I max I min
where n represents the number of thresholds; N u m represents the number of all pixels in the original image I; Imax and Imin, separately, represent the maximum gray value and minimum gray value of the pixels in the image I; Rj denotes the jth segmented area; Ii represents the gray value of pixel i; and μ R j represents the grayscale mean of the pixels in the segmented region Rj. The value range of U is [0, 1]. The larger the U value, the better the regional uniformity in the segmentation results, and the better the segmentation effect and vice versa.

4.3. Comparison between the Proposed Method and Other Methods

To verify the performance of the proposed algorithm, five representative multi-threshold segmentation algorithms are selected for comparative experiments. The five comparative experimental algorithms are: (1) image threshold segmentation algorithm based on particle swarm optimization (PSO), (2) image threshold segmentation algorithm based on bacterial foraging (BF), (3) image threshold segmentation algorithm based on adaptive bacterial foraging (ABF), (4) image threshold segmentation algorithm based on Nelder-Mead simplex (NMS), (5) image multi-threshold segmentation algorithm based on real coded genetic algorithm (RCGA) [43]. The number of thresholds is set to K = 2, 3, 4, and 5, respectively. Due to the limited space, we only show the segmentation results of the proposed algorithm in this paper. Figure 8 shows the segmentation results of Slice#022~#112 when the threshold K = 2, 3, 4, 5. Intuitively, the proposed algorithm can better segment each region of the experimental image, and the continuity of different regions is well guaranteed. At the same time, the visual effects are satisfactory.
The uniformity measures (U) values of the proposed algorithm and other comparison algorithms with K = 2, 3, 4, 5, respectively, are shown in Table 2. The highest U values are marked in bold. In general, our proposed algorithm achieves the best or better evaluation results on all test images. For #042, #052, #062, #082, #112, the proposed algorithm achieves suboptimal results when K = 5. The difference of the objective evaluation U value is small and acceptable. Overall, our proposed algorithm achieves the best segmentation results in test images, outperforming five different contrasting algorithms.
Table 3 shows optimal threshold values obtained by different segmentation algorithms on the test images. Additionally, the final thresholds selected by different algorithms are different from each other.

4.4. Ablation Experiment

To verify the necessity of each step of the proposed algorithm, we conduct ablation experiments. Non-F-RGM means that the image is segmented directly by RGM and without being processed by the hybrid spatial filter. F-RGM means that RGM is only performed on the original image and the filtering layer. Non-F-RGIIM means that the original image is directly segmented using the RGIIM. Proposed represents our proposed complete algorithm. We perform ablation experiments on the 10 test images described in Figure 7. The number of thresholds is set to K = 2, 3, 4, 5, respectively.
Table 4 shows the results of the ablation experiments. The best results are marked in bold. Comparing with Non-F-RGM, the average U value of F-RGM is larger. It means that our proposed hybrid spatial filter has significantly influence on the improvement of segmentation results. Comparing with Non-F-RGM, the average U value of Non-F-RGIIM is improved more significantly. It indicates that the proposed RGIIM is equally important for the improvement of segmentation results, and the idea of optimizing the threshold with interval iteration is effective. Unsurprisingly, the proposed algorithm has achieved the highest average U value. Compared with Non-F-RGIIM, the improvement brought by the hybrid spatial filter is significant especially when K = 2, 5. The improvement is not obvious when K = 3, 4, but the result is also acceptable. In summary, every step of our proposed algorithm is indispensable for medical image segmentation.

4.5. Time Complexity Analysis

4.5.1. Proposed Method Time Complexity Analysis

The time consumption of our proposed algorithm includes three parts: first, the original image is processed by the hybrid spatial filter, and the time complexity is O(L2∗W) level (W is the filter window size). Second, the multi-thresholding based on region growing is performed, and the time complexity is O(L) level. Finally, the time complexity of multi-threshold segmentation based on interval iteration is O(L) level. In sum, the time complexity of this algorithm is O(L2∗W) level. When the number of thresholds K = 2, 3, 4, 5, respectively, the average running time of the algorithm on 10 test images is shown in Figure 9.
In Figure 9, it can be noted that the running time of the proposed algorithm gradually decreases with the increase in the number of thresholds. The overall running time of the algorithm is about 0.6 s, which can be fully applied in real-time systems.

4.5.2. Computation Time Comparison

In this section, we compare the computation time of the proposed method with other methods (PSO, BF, ABF, NMS, and RCGA). In Table 5, the time computation of our proposed method for 1 K (1024) pixels is overwhelming compared to other methods. For the comparison methods, PSO takes the least time, which is 0.1057 S. However, our proposed method only took 0.008 s, which is a huge gap. It fully proves that the time cost of our proposed method is tiny.

5. Conclusions

In this paper, we proposed a novel interval iterative multi-thresholding segmentation algorithm based on hybrid spatial filter and region growing for medical brain MR images. Experiments show that the hybrid spatial filter can eliminate the noise in the image well while preserve the edge information of the image. It makes the segmentation effect more accurate. The algorithm makes full use of the spatial information in the original image. It quickly obtains initial thresholds by region growing, then the idea of interval iteration is adopted to optimize the thresholds. Finally, a weighting strategy is used to achieve medical image segmentation. Compared with other similar algorithms, our algorithm achieves satisfactory results. Subjectively, good visual effects are achieved, and the segmentation results have good consistency. Objectively speaking, the evaluation metric of our algorithm achieves the best results among all the test images and has a strong anti-noise performance. The time complexity of the algorithm is O(L2∗W) level. Compared with the comparative algorithm PSO with the least time consumption, for processing 1 K (1024) pixels, the time consumption is about 1/10 of it. This significantly improved the running speed, which can be applied in the real-time system of clinical medicine. We achieve excellent segmentation accuracy with minimal time cost.

Author Contributions

Conceptualization, Y.F. and Y.L.; form analysis, Y.F. and Y.L.; methodology, Y.F. and Y.L.; software, Y.L. and Y.F.; visualization, Y.F.; writing—original draft, Y.F. and Y.L.; investigation, Y.F. and X.Z.; validation, Y.F., Z.L. and W.L.; writing—review and editing, Y.F., X.Z. and Q.Y.; data curation, Y.L., Z.L. and W.L.; supervision, Y.F., X.Z. and Q.Y.; project administration, Y.F. and X.Z.; funding acquisition, Y.F. All authors have read and agreed to the published version of the manuscript.

Funding

The work was supported by Natural Science Foundation of Jilin Province (NO.YDZJ202201ZYTS422), Youth Growth Science and Technology Plan Project of Jilin Provincial Department of Science and Technology (NO.20210508039RQ), “Thirteenth Five-Year Plan” Scientific Research Planning Project of Education Department of Jilin Province (NO.JJKH20210752KJ, NO.JJKH20200677KJ), Fundamental Research Funds for the Central Universities JLU (NO.93K172020K05), and National Natural Science Foundation of China (NO.61806024).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data described in this article can be freely and openly accessed at “The Whole Brain Atlas” of Harvard Medical School Image Library (http://www.med.harvard.edu/aanlib/home.html (accessed on 20 September 2021)).

Acknowledgments

The authors would like to thank http://www.med.harvard.edu/aanlib/home.html (accessed on 20 September 2021) for providing source medical images.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Mărginean, R.; Andreica, A.; Dioşan, L.; Bálint, Z. Butterfly effect in chaotic image segmentation. Entropy 2020, 22, 1028. [Google Scholar] [CrossRef] [PubMed]
  2. Oktay, O.; Ferrante, E.; Kamnitsas, K.; Heinrich, M.; Bai, W.; Caballero, J.; Cook, S.A.; De Marvao, A.; Dawes, T.; O‘Regan, D.P.; et al. Anatomically constrained neural networks (ACNNs): Application to cardiac image enhancement and segmentation. IEEE Trans. Med. Imaging 2017, 37, 384–395. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Zou, L.; Song, L.T.; Weise, T.; Wang, X.F.; Huang, Q.J.; Deng, R.; Wu, Z.Z. A survey on regional level set image segmentation models based on the energy functional similarity measure. Neurocomputing 2021, 452, 606–622. [Google Scholar] [CrossRef]
  4. Rakić, M.; Cabezas, M.; Kushibar, K.; Oliver, A.; Lladó, X. Improving the detection of autism spectrum disorder by combining structural and functional MRI information. NeuroImage Clin. 2020, 25, 102181. [Google Scholar] [CrossRef] [PubMed]
  5. Zheng, G.Y.; Liu, X.B.; Han, G.H. Survey on medical image computer aided detection and diagnosis systems. Ruan Jian Xue Bao J. Softw. 2018, 29, 1471–1514. [Google Scholar]
  6. Al-Amri, S.S.; Kalyankar, N.V. Image segmentation by using threshold techniques. arXiv 2010, arXiv:1005.4020. [Google Scholar]
  7. Aruna Kumar, S.V.; Yaghoubi, E.; Proença, H. A Fuzzy Consensus Clustering Algorithm for MRI Brain Tissue Segmentation. Appl. Sci. 2022, 12, 7385. [Google Scholar] [CrossRef]
  8. Yu, S.; Zhang, R.; Wu, S.; Hu, J.; Xie, Y. An edge-directed interpolation method for fetal spine MR images. Biomed. Eng. Online 2013, 12, 102. [Google Scholar] [CrossRef] [Green Version]
  9. Luo, S.; Tong, L.; Chen, Y. A multi-region segmentation method for SAR images based on the multi-texture model with level sets. IEEE Trans. Image Process. 2018, 27, 2560–2574. [Google Scholar] [CrossRef]
  10. Ananth, C.; Singh, S. Graph Cutting Tumor Images. Int. J. Adv. Res. Comput. Sci. Softw. Eng. (IJARCSSE) 2014, 4, 309–314. [Google Scholar] [CrossRef]
  11. Ronneberger, O.; Fischer, P.; Brox, T. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer: Cham, Switzerland, 2015; pp. 234–241. [Google Scholar]
  12. Zhou, Z.; Rahman Siddiquee, M.M.; Tajbakhs, N.; Liang, J. Unet++: A nested u-net architecture for medical image segmentation. In Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support; Springer: Cham, Switzerland, 2018; pp. 3–11. [Google Scholar]
  13. Du, G.; Cao, X.; Liang, J.; Chen, X.; Zhan, Y. Medical image segmentation based on u-net: A review. J. Imaging Sci. Technol. 2020, 64, art00009. [Google Scholar] [CrossRef]
  14. Valanarasu, J.M.J.; Patel, V.M. UNeXt: MLP-based Rapid Medical Image Segmentation Network. arXiv 2022, arXiv:2203.04967. [Google Scholar]
  15. Chen, J.; Lu, Y.; Yu, Q.; Luo, X.; Adeli, E.; Wang, Y.; Lu, L.; Yuille, A.L.; Zhou, Y. Transunet: Transformers make strong encoders for medical image segmentation. arXiv 2021, arXiv:2102.04306. [Google Scholar]
  16. Sabir, M.W.; Khan, Z.; Saad, N.M.; Khan, D.M.; Al-Khasawneh, M.A.; Perveen, K.; Qayyum, A.; Azhar Ali, S.S. Segmentation of Liver Tumor in CT Scan Using ResU-Net. Appl. Sci. 2022, 12, 8650. [Google Scholar] [CrossRef]
  17. Otsu, N. A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 1979, 9, 62–66. [Google Scholar] [CrossRef] [Green Version]
  18. Gull, S.F.; Skilling, J. Maximum entropy method in image processing. In IEEE Proceedings F (Communications, Radar and Signal Processing); IET Digital Library: London, UK, 1984; Volume 131, pp. 646–659. [Google Scholar]
  19. Kittler, J.; Illingworth, J. Minimum error thresholding. Pattern Recognit. 1986, 19, 41–47. [Google Scholar] [CrossRef]
  20. Nyo, M.T.; Mebarek-Oudina, F.; Hlaing, S.S.; Khan, N.A. Otsu’s thresholding technique for MRI image brain tumor segmentation. Multimed. Tools Appl. 2022, 81, 43837–43849. [Google Scholar] [CrossRef]
  21. He, L.; Huang, S. An efficient krill herd algorithm for color image multilevel thresholding segmentation problem. Appl. Soft Comput. 2020, 89, 106063. [Google Scholar] [CrossRef]
  22. Abd Elaziz, M.; Lu, S. Many-objectives multilevel thresholding image segmentation using knee evolutionary algorithm. Expert Syst. Appl. 2019, 125, 305–316. [Google Scholar] [CrossRef]
  23. Liu, S.; Shen, X.; Feng, Y.; Chen, H. A novel histogram region merging based multithreshold segmentation algorithm for MR brain images. Int. J. Biomed. Imaging 2017, 2017, 9759414. [Google Scholar] [CrossRef] [Green Version]
  24. Mirjalili, S. Genetic algorithm. In Evolutionary Algorithms and Neural Networks; Springer: Cham, Switzerland, 2019; pp. 43–55. [Google Scholar]
  25. Di Caprio, D.; Ebrahimnejad, A.; Alrezaamiri, H.; Santos-Arteaga, F.J. A novel ant colony algorithm for solving shortest path problems with fuzzy arc weights. Alex. Eng. J. 2022, 61, 3403–3415. [Google Scholar] [CrossRef]
  26. Ibrahim, R.A.; Ewees, A.A.; Oliva, D.; Abd Elaziz, M.; Lu, S. Improved salp swarm algorithm based on particle swarm optimization for feature selection. J. Ambient. Intell. Humaniz. Comput. 2019, 10, 3155–3169. [Google Scholar] [CrossRef]
  27. Xue, J.; Shen, B. A novel swarm intelligence optimization approach: Sparrow search algorithm. Syst. Sci. Control Eng. 2020, 8, 22–34. [Google Scholar] [CrossRef]
  28. Guo, K.; Cui, L.; Mao, M.; Zhou, L.; Zhang, Q. An improved gray wolf optimizer MPPT algorithm for PV system with BFBIC converter under partial shading. IEEE Access 2020, 8, 103476–103490. [Google Scholar] [CrossRef]
  29. Sathya, P.D.; Kayalvizhi, R. Optimal segmentation of brain MRI based on adaptive bacterial foraging algorithm. Neurocomputing 2011, 74, 2299–2313. [Google Scholar] [CrossRef]
  30. Passino, K.M. Biomimicry of bacterial foraging for distributed optimization and control. IEEE Control Syst. Mag. 2002, 22, 52–67. [Google Scholar]
  31. Lagarias, J.C.; Reeds, J.A.; Wright, M.H.; Wright, P.E. Convergence properties of the Nelder--Mead simplex method in low dimensions. SIAM J. Optim. 1998, 9, 112–147. [Google Scholar] [CrossRef] [Green Version]
  32. Maitra, M.; Chatterjee, A. A hybrid cooperative–comprehensive learning based PSO algorithm for image segmentation using multilevel thresholding. Expert Syst. Appl. 2008, 34, 1341–1350. [Google Scholar] [CrossRef]
  33. Manikandan, S.; Ramar, K.; Iruthayarajan, M.W.; Srinivasagan, K.G. Multilevel thresholding for segmentation of medical brain images using real coded genetic algorithm. Measurement 2014, 47, 558–568. [Google Scholar] [CrossRef]
  34. Liu, J.; Li, W.; Tian, Y. Automatic thresholding of gray-level pictures using two-dimension Otsu method. In Proceedings of the 1991 International Conference on Circuits and Systems, Shenzhen, China, 16–17 June 1991; pp. 325–327. [Google Scholar]
  35. Wang, L.; Duan, H.; Wang, J. A fast algorithm for three-dimensional otsu’s thresholding method. In Proceedings of the 2008 IEEE International Symposium on IT in Medicine and Education, Xiamen, China, 12–14 December 2008; pp. 136–140. [Google Scholar]
  36. Suhas, S.; Venugopal, C.R. MRI image preprocessing and noise removal technique using linear and nonlinear filters. In Proceedings of the 2017 International Conference on Electrical, Electronics, Communication, Computer, and Optimization Techniques (ICEECCOT), Mysuru, India, 15–16 December 2017; pp. 1–4. [Google Scholar]
  37. Cai, H.; Yang, Z.; Cao, X.; Xia, W.; Xu, X. A new iterative triclass thresholding technique in image segmentation. IEEE Trans. Image Process. 2014, 23, 1038–1046. [Google Scholar] [CrossRef]
  38. Feng, Y.; Liu, W.; Zhang, X.; Liu, Z.; Liu, Y.; Wang, G. An Interval Iteration Based Multilevel Thresholding Algorithm for Brain MR Image Segmentation. Entropy 2021, 23, 1429. [Google Scholar] [CrossRef]
  39. Zuo, Q.; Geng, Y.; Shen, C.; Tan, J.; Liu, S.; Liu, Z. Accurate angle estimation based on moment for multirotation computation imaging. Appl. Opt. 2020, 59, 492–499. [Google Scholar] [CrossRef] [PubMed]
  40. Shi, Z.; Zhou, X. Spatio-Temporal Dynamic Fields Estimating and Modeling of Missing Points in Data Sets Using a Flexible State-Space Model. Appl. Sci. 2021, 11, 9050. [Google Scholar] [CrossRef]
  41. Castleman, K.R. Digital Image Processing; Prentice Hall Press: Hoboken, NJ, USA, 1996. [Google Scholar]
  42. Liew, S.L.; Anglin, J.M.; Banks, N.W.; Sondag, M.; Ito, K.L.; Kim, H.; Chan, J.; Ito, J.; Jung, C.; Khoshab, N.; et al. A large, open source dataset of stroke anatomical brain images and manual lesion segmentations. Sci. Data 2018, 5, 180011. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Feng, Y.; Shen, X.; Chen, H.; Zhang, X. Segmentation fusion based on neighboring information for MR brain images. Multimed. Tools Appl. 2017, 76, 23139–23161. [Google Scholar] [CrossRef]
Figure 1. The grayscale histogram of the original image and the process of region growing. (a) Image grayscale histogram, (b) area selection for first region growing, (c) results of the first area growth and selection of the main area for the second region growing, and (d) the second region growing results and main area selection for the next.
Figure 1. The grayscale histogram of the original image and the process of region growing. (a) Image grayscale histogram, (b) area selection for first region growing, (c) results of the first area growth and selection of the main area for the second region growing, and (d) the second region growing results and main area selection for the next.
Applsci 13 01087 g001
Figure 2. Final thresholds obtained by region growing.
Figure 2. Final thresholds obtained by region growing.
Applsci 13 01087 g002
Figure 3. An example of interval iteration at different stages. (a) Grayscale interval, and (b) Updated grayscale interval after interval iteration.
Figure 3. An example of interval iteration at different stages. (a) Grayscale interval, and (b) Updated grayscale interval after interval iteration.
Applsci 13 01087 g003
Figure 4. The optimal thresholds obtained by interval iterative Otsu algorithm based on region growing.
Figure 4. The optimal thresholds obtained by interval iterative Otsu algorithm based on region growing.
Applsci 13 01087 g004
Figure 5. Framework of the proposed algorithm.
Figure 5. Framework of the proposed algorithm.
Applsci 13 01087 g005
Figure 6. An example of hybrid spatial filter. (a) Original images, (b) Part of the enlarged original images (c) The results obtained by hybrid spatial filter, (d) Part of the enlarged results images.
Figure 6. An example of hybrid spatial filter. (a) Original images, (b) Part of the enlarged original images (c) The results obtained by hybrid spatial filter, (d) Part of the enlarged results images.
Applsci 13 01087 g006
Figure 7. Ten brain slices (a) slice #022, (b) slice #032, (c) slice #042, (d) slice #052, (e) slice #062, (f) slice #072, (g) slice #082, (h) slice #092, (i) slice #102, (j) slice #112.
Figure 7. Ten brain slices (a) slice #022, (b) slice #032, (c) slice #042, (d) slice #052, (e) slice #062, (f) slice #072, (g) slice #082, (h) slice #092, (i) slice #102, (j) slice #112.
Applsci 13 01087 g007
Figure 8. Segmentation results obtained by the proposed algorithm for brain slices #022~#112; (a1j1) display the results of 2-thresholding; (a2j2) display the results of 3-thresholding; and (a3j3) display the results of 4-thresholding; (a4j4) display the results of 5-thresholding.
Figure 8. Segmentation results obtained by the proposed algorithm for brain slices #022~#112; (a1j1) display the results of 2-thresholding; (a2j2) display the results of 3-thresholding; and (a3j3) display the results of 4-thresholding; (a4j4) display the results of 5-thresholding.
Applsci 13 01087 g008aApplsci 13 01087 g008bApplsci 13 01087 g008c
Figure 9. The average running time of the proposed algorithm under different thresholds.
Figure 9. The average running time of the proposed algorithm under different thresholds.
Applsci 13 01087 g009
Table 1. Parameter settings of the proposed algorithm.
Table 1. Parameter settings of the proposed algorithm.
Parameter SettingsDescription
δ = 0.01Value that stops the iteration for RGIIM
W = 3filter window size
K = 2, 3, 4, 5Number of the thresholds
Table 2. Comparison of the uniformity measure for different segmentation algorithms.
Table 2. Comparison of the uniformity measure for different segmentation algorithms.
Test ImagesNumber of Thresholds (K)Uniformity Measure (U)
ProposedPSOBFABFNMSRCGA
#02220.98700.95520.95690.95690.95690.9569
30.98940.96720.97080.96960.97690.9769
40.99040.94200.97650.96980.98240.9824
50.99170.94350.97860.97850.97520.9788
#03220.98450.93680.93420.93420.93420.9342
30.98860.96190.97160.96000.97960.9801
40.98910.91440.96970.97660.98480.9848
50.99050.94220.96680.97670.98510.9843
#04220.98270.92710.92460.92460.92460.9246
30.98120.95850.97210.96890.95480.9548
40.98680.94650.97520.98210.98650.9865
50.98710.93480.97240.97660.98450.9877
#05220.98370.91580.91280.91280.90680.9128
30.98600.95230.97130.96730.88000.9467
40.98540.93720.97640.98340.89820.9856
50.98800.92400.97350.97820.98420.9868
#06220.97590.91920.90470.90490.90150.9015
30.97990.87770.91350.90290.90300.9030
40.98490.92360.88560.89880.89890.8989
50.98510.85050.95270.93250.98350.9855
#07220.97230.90680.90410.90410.90410.9041
30.97880.90340.90840.89850.89920.8992
40.98300.88090.88760.88040.86660.8666
50.98780.95310.88810.88760.98180.9825
#08220.97820.91200.90910.90910.90910.9091
30.97340.88520.86210.86610.88490.8849
40.98160.86190.84790.86220.86950.8695
50.98470.93720.91880.91050.98540.9857
#09220.98700.91310.91560.91310.91310.9131
30.98770.86070.87510.88270.87860.8786
40.98630.94900.85830.85140.82400.8641
50.98870.86840.89230.84010.98800.9876
#10220.98640.93830.92500.92500.92500.9250
30.98510.87680.89770.90970.91790.9179
40.98880.92560.94100.90500.98710.9871
50.99210.84460.91800.91810.99070.9895
#1122
3
4
5
0.98750.93560.94030.94040.94040.9404
0.99060.91470.96660.97690.98630.9890
0.98990.97510.98240.98250.98850.9896
0.98870.97350.98220.98300.99150.9914
Table 3. Comparison of optimal threshold values obtained by applying different segmentation algorithms to the test images.
Table 3. Comparison of optimal threshold values obtained by applying different segmentation algorithms to the test images.
Test ImagesNumber of Thresholds (K)Optimal Threshold Values
ProposedPSOBFABFNMSRCGA
#022233, 9297, 18496, 18495, 18496, 18496, 184
317, 56, 11069, 138, 20765, 131, 18669, 114, 18558, 116, 18558, 115, 185
413, 37, 74, 11683, 116, 175, 20752, 99, 148, 18658, 113, 174, 20843, 87, 132, 18544, 87, 131, 186
513, 37, 74, 108, 13476, 119, 154, 184, 21444, 90, 127, 170, 20843, 88, 130, 176, 20844, 104, 140, 176, 21444, 86, 127, 174, 208
#032232,90107, 185110, 185110, 185110, 185109, 185
324, 70, 11674, 157, 19272, 120, 19881, 134, 18756, 115, 18653, 116, 185
413, 43, 87, 12795, 125, 164, 19463, 119, 173, 20858, 102, 142, 19039, 83, 132, 18939, 84, 131, 189
511, 37, 67, 94, 12580, 112, 139, 186, 21363, 101, 140, 175, 20752, 87, 128, 167, 19829, 75, 124, 173, 20734, 78, 123, 174, 207
#042246, 107111, 183114, 184114, 184113, 184114, 183
318, 60, 10780, 148, 17870, 136, 18874, 130, 18584, 132, 18884, 132, 187
418, 58, 100, 14081, 125, 164, 19762, 112, 156, 19450, 100, 143, 19029, 76, 128, 18730, 75, 127, 188
518, 55, 86, 112, 14282, 115, 142, 184, 21458, 114, 151, 188, 21853, 97, 144, 184, 21831, 76, 126, 178, 21725, 69, 114, 156, 194
#052248, 97119, 186117, 186117, 186118, 185118, 185
344, 87, 12289, 113, 187102, 156, 206107, 158, 204109, 166, 207109, 165, 203
442, 80, 105, 13079, 111, 141, 20893, 124, 171, 21090, 129, 173, 21094, 132, 175, 21091, 131, 174, 209
526, 55, 80, 105, 13065, 85, 131, 162, 20356, 112, 144, 175, 20956, 95, 133, 167, 20320, 67, 120, 167, 20724, 67, 118, 166, 203
#062266, 109109, 186119, 190119, 186121, 187121, 187
353, 89, 125112, 167, 18797, 133, 183102, 147, 199101, 148, 195101, 147, 196
433, 76, 108, 14985, 134, 180, 20398, 140, 182, 21893, 135, 175, 21294, 134, 176, 21194, 134, 175, 211
533, 76, 98, 125, 15699, 119, 157, 181, 20373, 104, 139, 184, 21379, 111, 145, 179, 21228, 68, 120, 168, 20820, 65, 113, 158, 200
#072247, 91116, 177117, 179117, 179118, 179117, 179
347, 89, 12396, 178, 20795, 147, 20299, 150, 190100, 142, 18899, 141, 187
425, 73, 106, 14596, 124, 161, 18794, 129, 173, 21495, 134, 174, 214100, 140, 179, 21499, 140, 179, 213
525, 72, 99, 129, 17472, 112, 151, 178, 19787, 109, 139, 178, 21087, 119, 150, 180, 21410, 64, 120, 172, 21114, 64, 119, 171, 211
#082248, 96110, 170112, 169111, 170112, 169111, 169
320, 72, 100103, 136, 198114, 155, 210111, 155, 201103, 146, 189103, 146, 190
420, 72, 98, 134100, 129, 167, 188103, 139, 175, 21499, 135, 170, 21098, 134, 169, 21098, 133, 169, 210
520, 72, 94, 116, 15278, 105, 151, 180, 20181, 122, 150, 182, 21284, 113, 146, 178, 21414, 62, 115, 168, 21010, 62, 107, 148, 190
#092258, 98109, 175108, 174109, 174109, 173109, 174
335, 79, 107115, 134, 178107, 144, 209104, 158, 207106, 158, 206105, 158, 206
424, 63, 83, 10777, 107, 149, 194100, 129, 164, 208102, 138, 171, 212112, 152, 186, 22097, 136, 211, 173
524, 63, 82, 101, 12190, 113, 165, 185, 20685, 114, 147, 175, 21296, 128, 158, 186, 21610, 64, 110, 160, 2055, 62, 109, 159, 205
#102255, 9798, 166108, 174108, 174108, 173107, 174
325, 64, 97113, 145, 180103, 148, 18998, 146, 18994, 142, 18994, 142, 190
425, 62, 86, 11884, 124, 165, 18979, 122, 164, 20090, 127, 164, 1982, 64, 119, 1731, 63, 120, 174
525, 62, 86, 112, 14099, 128, 147, 194, 21881, 113, 147, 187, 22082, 114, 148, 184, 2189, 62, 106, 147, 1901, 62, 104, 145, 189
#112254, 100109, 162105, 165105, 164106, 163106, 163
329, 76, 111104, 163, 21679, 134, 18071, 123, 1753, 49, 1451, 70, 142
425, 61, 90, 11163, 130, 153, 20654, 117, 156, 19258, 105, 146, 1824, 63, 132, 1781, 65, 123, 172
518, 49, 76, 94, 11158, 128, 155, 187, 21348, 112, 137, 161, 20047, 108, 142, 171, 1972, 44, 79, 131, 1751, 49, 95, 139, 183
Table 4. Ablation experimental results.
Table 4. Ablation experimental results.
Number of Thresholds (K)Average Uniformity Measure (U)
Non-F-RGMF-RGMNon-F-RGIIMProposed
20.96960.97290.97950.9825
30.97230.97750.98380.9840
40.96770.98200.98640.9866
50.97910.98500.98770.9884
Table 5. Computation time compare with other methods.
Table 5. Computation time compare with other methods.
MethodsProposedPSOBFABFNMSRCGA
1 K pixel/s0.0080.10570.27720.32540.35480.2815
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Feng, Y.; Liu, Y.; Liu, Z.; Liu, W.; Yao, Q.; Zhang, X. A Novel Interval Iterative Multi-Thresholding Algorithm Based on Hybrid Spatial Filter and Region Growing for Medical Brain MR Images. Appl. Sci. 2023, 13, 1087. https://doi.org/10.3390/app13021087

AMA Style

Feng Y, Liu Y, Liu Z, Liu W, Yao Q, Zhang X. A Novel Interval Iterative Multi-Thresholding Algorithm Based on Hybrid Spatial Filter and Region Growing for Medical Brain MR Images. Applied Sciences. 2023; 13(2):1087. https://doi.org/10.3390/app13021087

Chicago/Turabian Style

Feng, Yuncong, Yunfei Liu, Zhicheng Liu, Wanru Liu, Qingan Yao, and Xiaoli Zhang. 2023. "A Novel Interval Iterative Multi-Thresholding Algorithm Based on Hybrid Spatial Filter and Region Growing for Medical Brain MR Images" Applied Sciences 13, no. 2: 1087. https://doi.org/10.3390/app13021087

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop