4.2. Image Segmentation Results and Analysis
This paper tested the convergence speed and segmentation accuracy of the improved algorithm by using different types of images from the Standardized Test Image Dataset, Berkeley Segmentation Dataset, and UCI Dataset for the experiments. Firstly, the algorithm proposed in this paper (FMFO-Otsu) was compared with the original MFO optimized two-dimensional Otsu image segmentation algorithm (MFO-Otsu), Fractional Order Cuckoo Search Otsu algorithm (FCS-Otsu) [
21], Fractional Order Particle Swarm Otsu algorithm (FPSO-Otsu) [
20], and Fractional Order Firefly Otsu algorithm (FFA-Otsu) [
22]. Then, in order to further verify the performance of the improved algorithm and the superiority of fractional order, the FMFO-Otsu algorithm was compared with the two-dimensional Otsu image segmentation algorithm based on Other group intelligence algorithms, including the two-dimensional Otsu based on the Cuckoo Search algorithm (CS-Otsu) [
21], the two-dimensional Otsu based on the Particle Swarm algorithm (PSO-Otsu) [
20], the two-dimensional Otsu based on the Wolf Pack algorithm (WPA-Otsu) [
8], and the two-dimensional Otsu based on the Sparrow Search algorithm (SSA-Otsu) [
23].
In this paper, the algorithm’s convergence speed is evaluated according to the number of iterations required to reach convergence in the fitness curve. Evaluation metrics for image segmentation accuracy include the fitness value, peak signal-to-noise ratio (PSNR), structural similarity (SSIM), and mean square error (MSE). The larger the fitness value, the greater the spacing between the background class and the target class, which indicates a more pronounced segmentation effect. The larger the PSNR value, the less noise information is required and the more the algorithm’s noise immunity is improved. The greater the SSIM value, the smaller the difference between the image before and after segmentation, and the better the image segmentation quality. And the MSE reflects the error of image segmentation that the accuracy of image segmentation increases with the smaller the MSE.
There were different types of images selected for the segmentation experiment. Some of these images were analyzed in detail, such as showing the image segmentation effect, the fitness curve, and the evaluation metrics. Some other images were averaged for each metric in addition to showing the image segmentation effect. Six types of images were used for image segmentation: character images, architectural images, animal images, plant images, scenery images, and object images.
In the first part, the following four images were presented: the Couple image, the Cablecar image, the Boats image, and the Building image. The image segmentation results are shown in
Figure 3. In subjective vision, for the segmentation of the Couple image, FCS-Otsu, FPSO-Otsu, and FFA-Otsu over-segmented some regions like the face of a person and part of the background. The edges of the image were not segmented precisely enough with MFO-Otsu. In comparison, FMFO-Otsu generated more detailed segmentation results in the corner and character. In the Cablecar image segmentation results, FMFO-Otsu was better able to preserve the Cablecar details and segments, such as the detailed parts around the lawn in the red frame area, than other algorithms. For the segmentation of the Boats image, the other four algorithms did not segment the vessel contour completely. For example, there is a slight lack of details in the MFO-Otsu algorithm. But FMFO-Otsu retained more details and accurately segmented the edges of the image. In the Building image segmentation results, FMFO-Otsu generated more detailed segmentation results in the bridge and lake areas. Therefore, the FMFO-Otsu algorithm performed better in the segmentation of these images.
The objective evaluation index of the Couple image, the Cablecar image, the Boats image, and the Building image segmentation results are shown in
Table 2, and
Figure 4 indicates the fitness curve of them. For the segmentation results of the Couple image, MFO-Otsu finds the segmentation threshold in 31 iterations, FCS-Otsu reaches convergence at 14 iterations, FPSO-Otsu and FFA-Otsu both converge after 9 iterations, and FMFO-Otsu converges at 7 times. Therefore, FMFO-Otsu achieves maximum class spacing first, which means that FMFO-Otsu converges faster than other algorithms. In addition, FMFO-Otsu had the highest fitness value. The PSNR of FMFO-Otsu is higher than the other four algorithms. This shows that FMFO-Otsu is capable of enhancing the segmentation details of the image and ensuring noise immunity. Furthermore, FMFO-Otsu has a lower MSE than the other four algorithms, which suggests that its accuracy is more advantageous compared to the other algorithms.
For the Cablecar image, MFO-Otsu falls into local optimum after about 30 iterations, FCS-Otsu converges around 22, FPSO-Otsu finishes converging around 11, FFA-Otsu converges after 13 iterations, and FMFO-Otsu discovers the best segmentation threshold in 6 iterations. And the PSNR, SSIM, and fitness values of FMFO-Otsu are improved when compared to the other four algorithms. As the value of fitness increases, the value of the discretization matrix in the Otsu segmentation algorithm increases, i.e., the target and background class segmentation becomes more pronounced. It is evident that FMFO-Otsu not only improves the convergence speed but also enhances the accuracy of the image segmentation results. The MSE of FMFO-Otsu is lower than the other four algorithms, which indicates that FMFO-Otsu has a lower error rate before and after segmentation.
For the Boats image, MFO-Otsu reaches convergence after 29 iterations, FCS-Otsu converges around 11 times, FPSO-Otsu converges at 17 times, FFA-Otsu converges after 6 iterations, and FMFO-Otsu has the fastest speed that finishes converging around 4 times. Furthermore, the PSNR of FMFO-Otsu is greater than the other four algorithms, while the SSIM is slightly inferior. And there was a significant increase in the fitness value of FMFO-Otsu. Despite this, FMFO-Otsu is more noise-resistant and has superior segmentation details overall. The MSE of FMFO-Otsu is lower than others, which means that the segmentation effect of FMFO-Otsu is superior to that of the other algorithms.
For the Building image, the convergence of the FMFO-Otsu algorithm, compared with MFO-Otsu, FCS-Otsu, FPSO-Otsu, and FFA-Otsu, is accelerated by 83.33%, 93.58%, 92.85%, and 28.57%, respectively. As for other objective evaluation indicators, FMFO-Otsu performs better than the other algorithms. This indicates that the performance of the FMFO-Otsu algorithm has been significantly improved compared to the original algorithm.
To confirm the segmentation effect of FMFO-Otsu on various images in this paper, 28 images of characters, 32 images of architectures, 24 images of animals, and 15 images of plants were selected from other datasets and segmented using MFO-Otsu, FCS-Otsu, FPSO-Otsu, FFA-Otsu, and FMFO-Otsu. Then, we calculated the average value of objective evaluation indexes. The average experimental values are presented in
Table 3,
Table 4,
Table 5 and
Table 6, and some corresponding experimental segmentation images can be found in
Figure 5,
Figure 6,
Figure 7 and
Figure 8. The disparities in image segmentation outcomes among the various algorithms are emphasized by the red squares.
Figure 5 shows the original character images and the segmented images, and the average objective evaluation index values for the character images are indicated in
Table 3. Based on the resultant segmentation, it can be seen that FMFO-Otsu not only preserves the image contours better, but also segments the edge parts better. For example, in the first row of images, FMFO-Otsu preserves the details well in the wall part. For the second image, FMFO-Otsu generates more details in the grass and construction areas. Based on objective metrics, the iterations of FMFO-Otsu were decreased by 75%, 73%, 72%, and 46% compared to MFO-Otsu, FCS-Otsu, FPSO-Otsu, and FFA-Otsu, respectively. PSNR values improved by 0.4%, 3%, 2.7%, and 50%, respectively. SSIM values improved by 2.4%, 8.6%, 10%, and 99%, respectively. MSE values declined by 0.84%, 6.9%, 6.2%, and 66.1%, respectively. The fitness values improved by 0.08%, 15.8%, 15.7%, and 16%, respectively. These experimental results demonstrate that FMFO-Otsu yields superior segmentation outcomes.
Figure 6 shows the original building image and the image segmented by the five algorithms. The evaluations after calculating the averages of the architectural images are shown in
Table 4. In the first row of images, FMFO-Otsu is more detailed in the yard and roof sections. In the second row of images, all five algorithms roughly retained the outline of the original image, but FMFO-Otsu divided the first floor more clearly. For the third image, FMFO-Otsu better preserved the details of the top of the building and the bridge. For the fourth image, FMFO-Otsu produced a more complete outline. On the basis of objective data, FMFO-Otsu achieves higher accuracy in segmenting architectural images, especially in terms of the PSNR value, MSE value, and fitness value, showing significant improvements.
Figure 7 shows the original animal images and the segmented results.
Table 5 lists the average values for the animal images after segmentation. In the image of the first line, the segmentation effect of FCS-Otsu, FPSO-Otsu, and FFA-Otsu is poor, while the segmentation effect of FMFO-Otsu is more accurate. Image 2 preserves the outline of the original image completely. In the third image, FMFO-Otsu’s division of the stone is much clearer. In the fourth image segmentation result, compared with the other algorithms, FMFO-Otsu can segment the edge of the image better on the basis of preserving the image contour. In the objective data on the animal images, FMFO-Otsu performed better overall. Compared with MFO-Otsu, the PSNR, SSIM, fitness value, and convergence speed increased by 0.39%, 4.87%, 0.09%, and 61.9%, respectively, and the MSE decreased by 0.75%.
Figure 8 shows the original images of the plants and the segmented details. The average indicators after the segmentation of plant images are shown in
Table 6. Due to the nature of the plant image in the first row of these images, FMFO-Otsu segmented out more details in the leaf section. In the second image, FMFO-Otsu not only better preserved the details of the middle flowers, but also better divided the flowers at the edges. In
Figure 3 and
Figure 4, the segmentation effect of FMFO-Otsu is more obvious. From the objective data, compared with MFO-Otsu and FPSO-Otsu, the PSNR value increased by 2.62% and 3.63%; the SSIM value increased by 1.4% and 21.92%; the MSE value decreased by 5.41% and 7.05%; and the fitness value increased by 0.55% and 19.16%. The convergence rate was improved by 72.73% and 78.05%. Therefore, compared with the other four algorithms, FMFO-Otsu has a faster segmentation rate and higher accuracy.
In the second part, to more effectively illustrate the segmentation effect of the proposed algorithm and the advantages of fractional order, the FMFO-Otsu algorithm was compared with the CS-Otsu algorithm, the PSO-Otsu algorithm, the WPA-Otsu algorithm, and the SSA-Otsu algorithm.
The four images that were presented are as follows: the Cat image, the Girl image, the Cemetery image, and the Lawn image. The segmentation results for these images are shown in
Figure 9. In the subjective visual perspective, for the segmentation of the Cat image, the segmentation results of the other algorithms were comparatively rough, whereas FMFO-Otsu exhibited clearer segmentation in the cat’s ears and forehead area. In the case of the Girl image, although all five algorithms successfully segmented the silhouette of the girl, FMFO-Otsu outperformed others in terms of capturing the finer details. Regarding the Cemetery image, PSO-Otsu, CS-Otsu, and SSA-Otsu demonstrated imprecise segmentation. However, FMFO-Otsu preserved better delineation in the road area. Unlike other algorithms that failed to fully segment the Lawn image, FMFO-Otsu generated more comprehensive contours. Consequently, it can be concluded that FMFO-Otsu achieves the superior segmentation performance.
The objective evaluation indexes of the Cat image, the Girl image, the Cemetery image, and the Lawn image segmentation results are shown in
Table 7, and
Figure 10 indicates the fitness curves of these results. For the segmentation results of the Cat image, the CS-Otsu algorithm converges after 29 iterations, and the SSA-Otsu and PSO-Otsu algorithms converge after 68 and 66 iterations, respectively. The WPA algorithm achieves convergence at approximately 99 iterations, whereas the FMFO-Otsu algorithm converges much faster, at around 11 iterations. Hence, it can be concluded that the FMFO-Otsu algorithm exhibits a superior convergence rate compared to the other algorithms. Based on objective data from the Cat images, compared to CS-Otsu, SSA-Otsu, PSO-Otsu, and WPA-Otsu, FMFO-Otsu improved the PSNR by 0.94%, 1.27%, 122.31%, and 1.10%, respectively. The SSIM increased by 7.78%, 8.78%, 11285.19%, and 8.35%, respectively. The fitness value added by 14.26%, 14.10%, 14.13%, and 14.12%, respectively. The MSE decreased by 2.35%, 3.17%, 75.61%, and 2.74%, respectively. The iteration rate was accelerated by 62.07%, 83.82%, 83.33%, and 88.89%, respectively.
For the segmentation of the Girl image, CS-Otsu and PSO-Otsu converge after 58 and 59 iterations, respectively. PSO-Otsu falls into local optimality after 95 iterations, WPA-Otsu converges after 83 iterations, and FMFO-Otsu converges around 8 iterations. Compared to the other four algorithms, the iteration rate of FMFO-Otsu is improved by 86.21%, 86.44%, 91.58%, and 90.36%, respectively. From the objective evaluation index of the Girl image, it can be seen that the PSNR value, SSIM value, and adaptation value of FMFO-Otsu are higher than the other four algorithms, which indicates that the image details of FMFO-Otsu’s segmentation are better and the noise resistance is stronger. The MSE values of FMFO-Otsu are all lower than those of the other four algorithms, indicating that the accuracy of FMFO-Otsu’s segmentation is more favorable than the other algorithms.
In the Cemetery image segmentation, CS-Otsu converges at about 33 iterations, SSA-Otsu converges at about 54 iterations, PSO-Otsu and WPA-Otsu converge after 91 and 90 iterations, respectively, and FMFO-Otsu approximately converges at 4 iterations. In addition, the objective metrics of FMFO-Otsu are dramatically enhanced compared to all four methods, demonstrating that the fractional order enhances the performance of the original MFO algorithm significantly.
The fitness curve of the Lawn image shows that FMFO-Otsu has a faster iteration speed than other algorithms. Consequently, FMFO-Otsu increases the algorithm’s rate of convergence and fixes the issue with the previous algorithm’s susceptibility to local optimization. Furthermore, a higher degree of resemblance is indicated by FMFO-Otsu’s highest SSIM value. The MSE values of FMFO-Otsu are all lower than those of the other algorithms, indicating that the errors before and after image segmentation are smaller and the segmentation accuracy is improved. Therefore, FMFO-Otsu has a greater segmentation accuracy as a result.
There are 12 scenery images and 9 object images that were selected and segmented using the above five algorithms, and the results are averaged. The partial segmentation results are shown in
Figure 11 and
Figure 12, and the average segmentation results are shown in
Table 8 and
Table 9.
The original and segmented scenery images are shown in
Figure 11.
Table 8 describes the average data for the plant image segmentation. Subjectively, for the images in the first and second rows, FMFO-Otsu can segment some details more clearly than other algorithms. In the images on the third and fourth rows, some edge regions of the CS-Otsu, PSO-Otsu, and SSA-Otsu results were not clearly divided, but FMFO-Otsu’s result was better divided in the window and branch areas. According to the objective index, the performance of the FMFO-Otsu algorithm is better. For example, compared with CS-Otsu, SSA-Otsu, and WPA-Otsu, the iterations of FMFO-Otsu were decreased by 82.93%, 90%, and 90.41%, respectively; the PSNR values improved by 2.05%, 2.46%, and 2.19%, respectively; the SSIM values improved by 1.07%, 1.48%, and 1.24%, respectively; the MSE values declined by 5.7%, 6.71%, and 5.98%, respectively; and the fitness values improved by 9.32%, 9.32%, and 9.28%, respectively.
Figure 12 shows the original object images and the segmented images after five algorithms. The evaluation indicators after the object image averaging are shown in
Table 9. In
Figure 1, FMFO-Otsu splits a clear outline of the car. In the second row of images, CS-Otsu, SSA-Otsu, and PSO-Otsu exhibit the phenomenon of over-segmentation. For the third and fourth lines of images, the contours after FMFO-Otsu segmentation are clearer. According to the objective data, the SSIM value is slightly poor, but other indicators are effectively improved. FMFO-Otsu has a higher PSNR value and fitness value, and a lower MSE value and number of iterations. Through the above experimental results of different types of image segmentation, it can be seen that FMFO-Otsu performs better in subjective vision and several objective evaluation indexes. The algorithm convergence speed has also been improved.