Next Article in Journal
YAG Ceramic Nanocrystals Implementation into MCVD Technology of Active Optical Fibers
Next Article in Special Issue
Synchronization of Chemical Synaptic Coupling of the Chay Neuron System under Time Delay
Previous Article in Journal
Electrospun Porous PDLLA Fiber Membrane Coated with nHA
Previous Article in Special Issue
TRSDL: Tag-Aware Recommender System Based on Deep Learning–Intelligent Computing Systems
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Automated Segmentation Method for Lung Parenchyma Image Sequences Based on Fractal Geometry and Convex Hull Algorithm

1
College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan 030000, China
2
College of Information Sciences and Technology, Pennsylvania State University, State College, PA 16802, USA
3
Department of Informatics, University of Leicester, Leicester LE1 7RH, UK
*
Authors to whom correspondence should be addressed.
Appl. Sci. 2018, 8(5), 832; https://doi.org/10.3390/app8050832
Submission received: 26 March 2018 / Revised: 17 May 2018 / Accepted: 18 May 2018 / Published: 21 May 2018
(This article belongs to the Special Issue Fractal Based Information Processing and Recognition)

Abstract

:
Statistically solitary pulmonary nodules are about 6% to 17% of juxtapleural nodules. The accurate segmentation of lung parenchyma sequences of juxtapleural nodules is the basis of subsequent pulmonary nodule segmentation and detection. In order to solve the problem of incomplete segmentation of the juxtapleural nodules and segmentation inefficiency, this paper proposes an automated framework to combine the threshold iteration method to segment the lung parenchyma images and the fractal geometry method to detect the depression boundary. The framework includes an improved convex hull repair to complete the accurate segmentation of the lung parenchyma. The evaluation results confirm that the proposed method can segment juxtapleural lung parenchymal images accurately and efficiently.

1. Introduction

Lung cancer is a type of tumor with a very high morbidity and mortality in the clinical practice. Lung cancer at an early stage has a higher curable possibility than late-stage tumors, thus early diagnosis and treatment are significantly important to improve the patients’ clinical situation [1]. Statistically, early lung cancers usually present as a solitary pulmonary nodule (SPN). Clinically, it is crucial to segment the sequence of lung parenchymal images rapidly without compromising accuracy in order to subsequently achieve pulmonary nodule segmentation and diagnose benign and malignant features [2]. Lung parenchyma segmentation refers to the division of the lung parenchyma in a number of areas of interest with specific properties. In terms of image processing, the use of computer-aided diagnosis of pulmonary diseases allows the identification of suspected pulmonary nodules. Pulmonary nodules appear as spheroidal abnormal tissue located in a complex juxtapleural structure in lungs’ Computed Tomography (CT) images. The surrounding tissues, such as chest wall and blood vessels, may be attached to the pulmonary nodules, thus preventing their detection or segmentation.
Statistically solitary pulmonary nodules are about 6% to 17% of juxtapleural nodules [3]. Because these nodules are attached to the pleura and their grayness and density are similar to those of the pleura, most of the existing segmentation methods are based on gray-level thresholding. When segmenting, juxtapleural nodules often appear associated with a depression area in the lung parenchyma, termed juxtapleural nodular depression. This type of pulmonary nodule is the most difficult to segment, but the segmentation results have a significant impact on the accuracy of image analysis, auxiliary processing, and other post-processing steps. In addition, most of the existing methods of lung parenchyma segmentation are subject to either under-segmentation or edge leakage when applied to complex structures of lung parenchyma. Consequently, we cannot obtain the required area of interest, while retaining a good edge and the details of the outline of the lungs. In order to be able to remove a complete lung parenchyma containing the juxtapleural nodules and to improve the effectiveness of ancillary diagnosis, the depressed area must be repaired.
The aim of this paper is the automated sequencing of CT images of juxtapleural nodules. To achieve this goal, this paper proposes an automated segmentation sequencing algorithm of CT images. The proposed algorithm is based on the fractal geometry and the improved convex hull algorithm. On completion of juxtapleural nodule segmentation, the proposed algorithm uses the fractal geometry method to detect the concave boundary for the concave area under study and, thereafter, it uses the improved convex hull algorithm to repair it, aiming at producing an accurate segmentation of the lung parenchyma. In addition, the proposed algorithm makes full use of the correlation between the sequence of CT images and the automated threshold segmentation sequence of CT images. To verify the effectiveness of the algorithm, 97 cases were chosen from 5800 sequential CT images for the segmentation test. The evaluation results confirmed that the proposed segmentation method significantly improved the segmentation speed reaching a satisfactory 92.45% Pixel Accuracy (PA) and 95.9% Intersection over Union (IoU) of lung parenchyma segmentation of juxtapleural nodules.

2. Related Work

There are a number of existing models and algorithms in the area of lung parenchyma segmentation and related to the work of this paper. The existing work can be mainly classified according to the methods used, which are the threshold [4,5,6,7,8], clustering [9], region-growing [10], graph theory-based [11], and active contour model [12,13] methods. Sudha and Jayasheree [14] proposed a method of partial lung cutting based on the combination of the threshold method and the opening operation in morphology in order to extract pulmonary nodules. However, when there are pulmonary nodules presenting lung adhesion, these nodular areas are excluded by the method of threshold segmentation and the region growing. The reason for this is the similar gray level of the pulmonary nodules and the surrounding lung parenchyma. In addition, the lung boundary appears concave, making difficult the extraction and identification of the tumor, blood vessels, and trachea. Therefore, it is necessary to analyze and repair the concave and depressed lung parenchyma boundary.
Retico et al. [15] demonstrated that the rolling sphere CT image processing method of pulmonary nodules can effectively reduce false positives when analyzing juxtapleural stretch-type pulmonary nodules. Bian and Yan [16] combined the methods of threshold and regional growth to segment the lung parenchyma. They used the ball method to repair the extracted lung boundary. Messay et al. [17] used morphological methods to detect and segment the pulmonary nodules. Their computer-aided diagnostic system was sensitive in 82.66% of cases. In Zhou et al. [18] method of image segmentation for lung CT images with juxtapleural nodules, the iterative adaptive averaging algorithm and adaptive curvature threshold method was used to reinsert the missing juxtapleural nodules. Gong et al. [19] proposed a lung parenchyma segmentation algorithm, which was based on gray integral projection and fuzzy C means clustering combined with the rolling sphere method to repair the boundary area. However, the selection of the sphere radius was a critical problem. If the radius was too large, the lung parenchyma would be over-segmented. If the radius was too small, it would be under-segmentated, and the repaired lung boundary would be incomplete. Wei et al. [20] proposed a method to repair lung parenchyma boundary by combining an improved chain code algorithm and the Bresenham algorithm. Li et al. [21] presented a lung parenchyma segmentation algorithm combining the regional growth and the morphology methods. They also proposed a two-dimensional convex hull algorithm to repair the profile of the lung parenchyma. Compared to the previous work, this algorithm had a higher accuracy, and the depression of the juxtapleural nodules could be accurately repaired. However, similar to the previous convex hull algorithm, the proposed one was still unable to repair vascular depression.
On the basis of the above review, the rolling-ball method and morphology-based method are the most commonly used methods of boundary restoration, characterized by simple and fast implementation. However, because of the randomness of the shape and size of pulmonary nodules, it is difficult to find morphological templates of appropriate size. Small-size templates cannot include all lung nodules, whereas oversizing can include a too large non-lung area and other border areas. The curvature-based method [22,23,24] is also a commonly used method, which considers the sudden change of the boundary curvature corresponding to the defective boundary region. However, this assumption is not suitable in case of sudden changes in noise and local curvature. The boundary repair of by this method is not satisfactory when these sudden changes are present in the pulmonary boundary.
An observation regarding the existing lung parenchymal segmentation algorithms is that the majority of the images are segmented as single-slice CT images, ignoring the correlation between adjacent images in a sequence. In recent years, a large number of scholars have studied the segmentation methods of sequences of lung parenchymal images.
Geng et al. [25] used the grayscale threshold iteration method to rapidly and automatically select seed points for the region growth and to extract each lung real image in the sequence of CT images. However, the algorithm is sensitive to the background noise. Liming et al. [26] proposed a new framework of lung parenchyma segmentation. The optimized thresholding method and boundary tracking algorithm were used to segment the lung parenchyma. The method could effectively eliminate the influence of background noise, but at the same time it could also eliminate some of the lung parenchyma during processing. Yan-hua et al. [27] proposed a method of 3D connectivity growth. The method used the adaptive thresholds to select seed points, the 3D connectivity markers to identify the lung parenchyma, and the morphological method to remove tracheal noise. In the final output, the lung parenchyma mask was generated, and the lung parenchymal images were removed. The produced segmentation results were satisfactory, but the image processing of the juxtapleural traction characteristics of the lung parenchyma was not effective. Luo et al. [28] used an improved active contour model algorithm. They needed to manually circle the initial contour and semi-automatically segment the edges of lung real images in the serial CT images. Their segmentation results were satisfactory, but the method was not time-efficient.

3. The Method

This section proposes an algorithm to perform an accurate segmentation of lung parenchyma presenting juxtapleural traction nodules. On the basis of fractal geometry and the improved convex hull repair of pleura-type depressions, this algorithm includes an initial segmentation of CT images with automated threshold iteration, removal of bronchial tissue, and detection of pulmonary border. The lung parenchyma algorithm flow is shown in Figure 1.

3.1. The Construction of the Initial Contour

Among the existing algorithms of lung parenchyma segmentation, the threshold segmentation algorithm has the advantage of high calculation speed and accuracy. Considering the high correlation between adjacent slices of sequential CT images, we chose the threshold segmentation method to pre-process the original images to obtain the initial contour of sequential plural traction images. The initial outline presented some noise derived from the trachea, bronchus, and other tissues. In order not to miss any important information of the lung parenchyma segmentation, such noise was tolerated. In this section, the open and close operations were used to smooth and fill the edge and interior of the lung parenchyma.

3.1.1. The Automated Threshold Iterative Segmentation of Sequential CT Image

It is difficult to choose a suitable global threshold to obtain the ideal initial contour because of the differences in the gray levels of lung nodules. Taking into account the high correlation between adjacent slices of sequential CT images, the automated threshold iteration method was chosen to construct the initial contour of the lung parenchyma of sequential CT images, the algorithm is shown in Algorithm 1. In Figure 2, using (a–d) to display a sequence of images, the first line shows the original of sequential CT image and the second line results of the automated threshold iterative segmentation of lung parenchyma.
1.
Get the initial contour of the first CT image
Algorithm 1. The automated threshold iteration sequence segmentation algorithm.
Input: the first image of CT sequential images
Output: initial outline of the parenchyma
1: Traversing CT images to get the maximum Gmax value and the minimum Gmin value of grays in the region
2: According to formula (1), calculate the initial threshold T
T = ( G max + G min ) 2
3: Segmenting image, firstly
    if the pixel of I ( x , y ) number is greater than the threshold T,
      the set of pixel N (nodule region) is expanded;
    else
      the dataset B (background region) is expanded
4: μ b = (B1 + B2+…+ Bn)/n, μ n = (N1 + N2+…+ Nn)/n,
5: According to formula (2), calculate the threshold T again
T = μ b + μ n 2
With | T n T n 1 | λ
6: Getting global optimal threshold
2.
Because of the high correlation between sequential CT images, an optimal threshold of i image as the initial threshold of i + 1 image is necessary. This can decrease the number of iterations and significantly improve the speed of segmentation.

3.1.2. The Removal of Bronchus and Trachea Noise

On completion of the initial segmentation, a lung parenchyma image could be obtained by the automated threshold iteration method. The corresponding globally optimal threshold T could be obtained simultaneously. Image I ( x , y ) can be converted to a binary image I b i n ( x , y ) through formula (3)
I b i n ( x , y ) = { 1 , I ( x , y ) T 0 , I ( x , y ) < T
On completion of the above series of operations, it is possible to obtain the contours of some interfering objects and determine the noise. In our previous work [29], we improved the region growth method and the open and close operations to obtain final lung parenchyma images by smoothing and filling the edges and the interior of the pulmonary nodules. The process of trachea and bronchus removal and lung contour refining is shown in Figure 3.

3.2. Fractal Geometry-Based Pulmonary Boundary Detection

Because of the similarity of the gray values between the juxtapleural nodules and the chest, some nodules overlap with the juxtapleural blood vessels. Therefore, in the extracted lung region, the pulmonary nodule region, attached to the lung wall is often excluded. However, if this part of the region is excluded, the accuracy of the computer-aided diagnosis system will be greatly affected. Thus, it is essentially necessary to repair the area attached to the lung wall.

3.2.1. Adaptive Meshing

Although the existing patching methods are effective, all requires human intervention and do not have good adaptability to different samples. These repair methods only take into account the local properties without considering the other boundary properties. In order to improve the efficiency of the segmentation, we meshed only the smallest circumscribed rectangle (a × b) containing lung parenchyma. Since the two-dimensional contour of the lung varied greatly from top to bottom in the entire CT sequence of images, this section presents an adaptive network for the CT images, as shown in formula (4).
Grid m × m = { 2 × 2   N 1 = 1 ( a / 20 ) × ( b / 20 )   N 1 = 2 , A 1 / A r < 0.3 13 × 13   N 1 = 2 , A 1 / A r < 0.3  
In formula (4), N1 is the number of connected regions in the image, A1 is the area of all lung regions, and Ar is the area of the smallest circumscribed rectangle.

3.2.2. Fractal Geometry-Based Pulmonary Boundary Detection

The lung border that is produced by the segregation shows a curve varying according to a certain rule. The fractal theory can investigate, describe, and analyze complex, random, disordered, incomprehensible, or difficult-to-quantify objects to a deeper level. In particular, the use of the fractal dimension is an effective way to investigate and describe the degree of a fractal to space filling [30]. To do that, the entire image is abstracted as a set F in two-dimensional space. The analysis of the fractal features of its boundary is equivalent to calculating the fractal dimension of the two-dimensional figure. The box dimension is a simple and automated method, which can work with or without self-similarity [31]. This method is used to calculate the fractal dimension and detect the points to be repaired and is fast and suitable for the juxtapleural traction nodules of our work in this paper.
According to the Graham method, CT images are searched to obtain the boundary points, and the grids containing the boundary points are stored as a grid set Grid = { Grid i | i = 1 , 2 , 3 n }.
The number of squares N (s) represents each network intersecting with the image, and the length s represents the sides of all the squares [32]. The curvature of the line defined by ln ( N ( s ) ) and ln ( 1 / s ) is the fractal dimension, and the linear regression equation that was used to estimate the fractal dimension is as formula (5):
ln ( N ( s ) ) = ln k + γ   ln ( 1 / s )
The fractal dimension of the statistical histogram for the area block is shown in Figure 4.
From Figure 4 it is evident that all the fractal dimensions show a trend of polarization. The fractal dimension is small because of the smooth pulmonary border and the complex boundary of the lung. The boundary of the lung has high randomness and complexity due to the irregularities caused by pulmonary nodules. The fractal value is larger.

3.2.3. Adaptive Threshold-Based Defect Boundary Selection

Because the proportion of defective boundaries caused by adhesive pulmonary nodules was small, the number of small regions containing this part of the border was small as well. In order to select the boundary of defect accurately, an adaptive threshold was proposed as formula (6) for sequencing CT images.
T f = γ ¯ + n s d
Among them, the i-th network represents the fractal dimension, which is the average value of the fractal dimension of the grid, representing the variance. The mean square error (MSE) was calculated by using formula (7) [33]:
MSE ( n ) = 1 100 i = 1 100 [ T f i ( n ) u ] 2
On the basis of the results of a number of experiments, the mean square error is small when n is 1. However, fewer nodules could be identified by setting n = 1. This is because the extent of the pulmonary border affected by pulmonary nodules was relatively small. Therefore, the final adaptive threshold was determined by formula (8).
T f = γ ¯ + s d
For a grid block in a grid, if the fractal dimension of internal boundary is larger than the threshold, the lung boundaries in the block need to be repaired and stored in the grid. If the fractal dimension of the internal boundary is less than the threshold T f , the lung boundaries within the region block need not be patched.
Through the fractal geometry method, the defect boundary was obtained, and the repair rate and accuracy were improved.

3.3. The Improved Convex Hull Repair Algorithm

On the basis of the review of existing work, this paper proposes a lenticular edge repair algorithm. This algorithm can repair well not only the juxtapleural nodular depression, but also the depression between the two lungs, adjacent to the heart and mediastinum. According to the convex hull principle, the algorithm avoids over-repair and under-repair, which exist in the rolling-ball method or morphological method. The detailed steps of the proposed algorithm are shown in Algorithm 2.
Algorithm 2. The improved convex hull repair algorithm.
Input: Grid block to be patched
Output: Patched parenchyma edge set
1: The boundaries within the grid block to be modified are stored in the point set Q = {}.
2: Update P i with convex hull theory.
  for:   p 0 to p n
    Select p 0 , p 1 , and p 2 from P i
r = ( p 2 p 0 ) × ( p 1 p 0 )
  if r < 0 p 1 concave point
  else
  if r > 0 p 1 bump point delete p 1 point
  else
   | p 1 p 0 | > | p 2 p 0 | preserve p 1 point, delete p 2 point
  update Q.
3: for: for:   p 0 to p n
D = | p 0 p n |
if D < T To be repaired between two points removed from the P i
The final result is the set of edge points of the lungs in Grid r , to be combined with the unpatched grid blocks and representing the repaired lung parenchyma images.

4. Analysis of the Results

4.1. The Dataset

In order to verify the effectiveness and the real-time characteristics of the proposed feature extraction method, we have applied it to the Lung Image Database Consortium image collection (LIDC–IDRI) dataset. The LIDC–IDRI database is the largest open lung nodule database in the world, which contains 1080 cases. For each of the images in the samples, four experienced chest radiologists performed a two-stage diagnosis. In the first stage, each radiologist independently diagnosed and marked the location of the patient. In the subsequent second stage, a radiologist independently reviewed the other three radiologists’ marks and gave his/her own final diagnosis. Such a two-stage process can verify all results as completely as possible without the interference of other radiologists. Therefore, the diagnosis results can be used as a gold standard reference. According to the diagnostic results of corresponding lesions, XML files were marked, and the CT images of 50 cases of sequential juxtapleural nodules were selected. At the same time, some of the image datasets used in the experiment were collected from the positron emission tomography/computed tomography (PET/CT) detection center of a collaborating hospital. In the experiment, the imaging data of 47 patients in the hospital were selected. For each patient there were 299 serial lung CT images, and the sequential images of juxtapleural-drawn pulmonary nodules were selected for the experiment.

4.2. Analysis of the Experimental Results

In the experiment, 50 CT images were selected for training and 47 images were used to test the accuracy and time complexity of the algorithm. In order to verify the accuracy of the segmentation algorithm, we used the proposed method, region-growing, watershed, and rolling-ball methods to segment the CT images of juxtapleural nodules. Considering the interference of multiple factors, the accuracy of segmentation was not judged in the experimental process. Therefore, the results of various segmentation algorithms were compared with the comprehensive lung parenchyma area manually segmented by four experienced radiologists. In the course of the experiment, the manually segmented images in the medical records were the ultimate gold standard.

4.2.1. Qualitative Assessment

The CT sequence contained a large number of images. In this section, the segmentation of the same sequence of juxtapleural nodules by four kinds of algorithms was performed, as shown in Figure 5. The images were classified in the following groups: (a) original CT image; (b) manual segmentation results obtained by a doctor; (c) improved segmentation algorithm; (d) segmentation results of the improved region growth (RG) algorithm; (e) regional growth and rolling-ball method repair algorithm segmentation results; (f) algorithm segmentation results.
For the CT images with intact lung parenchyma, as shown in the first row and the third row of Figure 5, the segmentation by all the algorithms could ensure the integrity of the segmentation. However, on the basis of the automated threshold segmentation CT sequence images, seed points could be selected manually, and the threshold could be passed, greatly improving the efficiency of segmentation. For the sequence images of lung parenchyma having juxtapleural nodules, as shown in the second row of Figure 5, the RG and Watershed algorithm lost the juxtapleural nodules, and the repair results of ball-rolling method lost some parts of the juxtapleural nodules. Promisingly, our method could ensure the integrity of lung parenchyma segmentation (f). For the not connective area of lung parenchyma, the regional growth algorithm lost some parts of the lung parenchyma, while the other algorithms’ segmentation results were more complete.
The sample, could contain multiple nodules in the same CT slice at the same time. We chose the same methods as in Figure 5 for an experimental comparison, and the results are shown in Figure 6.
The results showed that the regional growth algorithm still lost some parts of the lung parenchyma for the not connected areas. The comparison between column (e) and column (f) showed that the rolling-ball method provided better repair results for a single large juxtapleural nodule. The method described in this paper could repair multiple juxtapleural nodules at the same time and provided better results.
In order to verify the repair ability of our method for juxtapleural concave areas, we compared the proposed algorithm and the “ball-and-roll” method for the same sequence of slices, as shown Figure 7. In the ball-rolling method, the radius of repair had an important effect on the result.
For the concave area caused by the juxtapleural nodules, if the radius of the ball-rolling method was too small, it caused under-segmentation. Because of the uncertainty of the size of a juxtapleural nodule, setting the threshold manually was useless and the segmentation results were unsatisfactory. In contrast, Figure 7 shows the effectiveness of the algorithm proposed in this paper.

4.2.2. Quantitative Analysis

In this paper, the pixel accuracy, cross-ratio, and time complexity were used as the quantitative metric for the evaluation of segmentation results. In the following analysis, we assumed that the actual segmented image was P and the reference segmented image was G.
1.
Pixel accuracy
Pixel Accuracy (PA) is expressed as the ratio of correctly labeled pixels to total pixels. Assume that P i = { p i 1 , p i 2 , , p i m } is the number of pixels with the correct marks, and G j = { g j 1 , g j 2 , , g j m } is the gold standard number of pixels. The higher the pixel accuracy, the better the image segmentation; the formula is as follows:
PA = i = 0 p i 1 i = 0 j = 0 g j 1
According to formula (9), the higher the value of PA, the more overlapped the results and the gold standard. The PA curve for lung parenchymal image segmentation with juxtapleural nodules is shown in Figure 8.
It is clearly shown that either RG or Watershed had a lower curve than the other methods. Thus, both methods lost some juxtapleural nodules, resulting in a P i with less pixels. However, the overall trend of the PA of the rolling-ball method was toward higher values than that of other algorithms. In a number of previous experiments, r = 65 was usually used. When comparing with the algorithm described in this paper, the repair result of the juxtapleural indentation was still deficient. The PA curve values obtained with the method described in this paper represent the most accurate segmentation results.
2.
Intersection over Union
Intersection over Union (IoU) is a probability value used to compare the similarity and dispersion between sample sets and reflect the degree of coincidence between two segmented images. The higher the cross ratio, the better the image segmentation results. Assuming that the gold standard of the nodules in the image is G and the segmentation result of an automated method is P, the calculation of IoU is represented by formula (10).
IoU = A r e a ( G P ) A r e a ( G P )
From Figure 9, it is evident that the IoU curve of the proposed algorithm and that of the rolling method were significantly higher than those of the RG and Watershed methods. Furthermore, the IoU curve of the algorithm described in this paper was slightly higher than that of the ball-rolling method. At the same time, the segmentation results of the algorithm proposed in this paper were the most similar to the gold standard results.
3.
Time complexity
The algorithm was also evaluated for time complexity. In this paper, taking i of the correlation of sequential images into account, we compared the shortest time, the longest time, and the average time that was consumed for segmenting the sequence of CT images. The results are shown in Figure 10.
As shown in Figure 10, the proposed method had the shortest processing time. The watershed algorithm had the longest processing time and the region-growing algorithm had a processing time between the previous two, to some extent. The average time for processing leaflets was 0.75 s in Figure 10a and 0.63 s in Figure 10b. These average times were significantly shorter than those of the other two methods. Moreover, the average processing time decreased with the increase of the number of sequence images. This feature demonstrated that the automated threshold transfer took the correlation of the adjacent images into consideration and was able to find the threshold to adapt all the images and speed up the sequence image segmentation.
In summary, this article compares the evaluation results of the four methods of segmentation results, as shown in Table 1.
The experimental results demonstrated that for the segmentation of juxtapleural nodules, both the method of this paper and the rolling-ball method were more efficient than the regional growth and watershed methods. In addition, the segmentation time of the method proposed in this paper was much lower than that of the other three methods.

5. Conclusions

Juxtapleural nodules have a very high probability of being malignant. Sequence image segmentation of the lung parenchyma with juxtapleural nodules is the basis for the subsequent pulmonary nodule segmentation and detection [36,37,38]. On the basis of fractal geometry and the improved convex hull algorithm, an automated segmentation algorithm of sequential CT images is proposed in this paper with the goal of identifying juxtapleural nodules. To verify the validity of the algorithm, 97 cases were selected from 5800 sequential CT images. The evaluation results were compared with the results of manual segmentation by professional radiologists, regional-growth and watershed segmentation, and ball-rolling repair algorithm. Through both a qualitative analysis and a quantitative analysis of the results from the comparisons, we can confirm that the method for lung parenchyma segmentation and repair proposed in this paper produced a more complete set of juxtapleural nodules and was faster than the other automated methods. The results of sequence segmentation of our method are more accurate and, therefore, can be used as a strong reference by physicians for the diagnosis of lung cancer in the clinical practice.
Nonetheless, there are some open issues requiring future work. This work only used the traditional quantitative analysis to evaluate the experimental results and did not actually evaluate them in the Computer Aided Design (CAD) system. In future work, the method of sequential segmentation of images will be applied to a CAD system, and the possibility of applying it to segment other types of nodules will be explored.

Supplementary Materials

This paper uses LIDC data set. The LIDC–IDRI database is the largest open lung nodule database in the world, which contains 1080 cases. https://wiki.cancerimagingarchive.net/display/Public/LIDC-IDRI.

Author Contributions

J.Z., Y.Q., and Y.X. conceived and designed the experiments; X.X. and H.W. performed the experiments; X.Z. analyzed the data; Y.Z. wrote the paper.

Funding

This work was supported in part by the National Natural Science Foundation of China (61572344), in part by the open funding project of State Key Laboratory of Virtual Reality Technology and Systems, Beihang University (Grant No. BUAA-VR-17KF-14; BUAA-VR-17KF-15), in part by Research Project Supported by Shanxi Scholarship Council of China (2016-038).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. ReferencesArmato, S.G., III; Giger, M.L.; Moran, C.J.; Doi, K.; MacMahon, H. Computerized detection of pulmonary nodules on CT scans. Radiographics 1999, 19, 1303–1311. [Google Scholar]
  2. Zhang, J.; Xia, Y.; Xie, Y.; Fulham, M.; Feng, D. Classification of Medical Images in the Biomedical Literature by Jointly Using Deep and Handcrafted Visual Features. IEEE J. Biomed. Health Inform. 2017. [Google Scholar] [CrossRef]
  3. Zhao, J.; Ma, R.; Qiang, Y.; Cui, Z. Solitary Pulmonary Nodule Segmentation Based on the Rolling Ball Method. J. Comput. Theor. Nanosci. 2015, 12. [Google Scholar] [CrossRef]
  4. Qi, C. Improved Two-Dimensional Otsu Image Segmentation Method and Fast Recursive Realization. J. Electron. Inf. Technol. 2010, 32, 1100–1104. [Google Scholar]
  5. Tong, J.; Lu, M.; Zhao, D.Z.; Wang, X. Automatic Lung Parenchyma Segmentation on CT Image. J. Northeast. Univ. 2008, 29, 965–975. [Google Scholar]
  6. Hu, S.; Hoffman, E.A.; Reinhardt, J.M. Automatic Lung Segmentation for Accurate Quantitation of Volumetric X-Ray CT Images. IEEE Trans. Med. Imaging 2001, 20, 490–498. [Google Scholar] [CrossRef] [PubMed]
  7. Dehmeshki, J.; Ye, X.; Lin, X.; Valdivieso, M.; Amin, H. Automated detection of lung nodules in CT images using shape-based genetic algorithm. Comput. Med. Imaging Graph. 2007, 31, 408–417. [Google Scholar] [CrossRef] [PubMed]
  8. Suárez-Cuenca, J.J.; Tahoces, P.G.; Souto, M.; Lado, M.J.; Remy-Jardin, M.; Remy, J.; Vidal, J.J. Application of the iris filter for automatic detection of pulmonary nodules on computed tomography images. Comput. Biol. Med. 2009, 39, 921–933. [Google Scholar] [CrossRef] [PubMed]
  9. Yang, J.; Zhao, J.; Qiang, Y.; Wang, Q. Lung CT Image segmentation combined multi-scale watershed method and region growing method. Comput. Eng. Des. 2014, 35, 213–217. [Google Scholar] [CrossRef]
  10. Qian, Y.; Weng, G. Lung Nodule Segmentation Using EM Algorithm. In Proceedings of the Sixth International Conference on Intelligent Human-Machine Systems and Cybernetics, Hangzhou, China, 26–27 August 2014; pp. 20–23. [Google Scholar]
  11. Dai, S.; Lu, K.; Dong, J.; Zhang, Y.; Chen, Y. A novel approach of lung segmentation on chest CT images using graph cuts. Neurocomputing 2015, 168, 799–807. [Google Scholar] [CrossRef]
  12. Chen, Q.; Quan, F.; Xu, J.; Rubin, D.L. Snake model-based lymphoma segmentation for sequential CT images. Comput. Methods Programs Biomed. 2013, 111, 366–375. [Google Scholar] [CrossRef] [PubMed]
  13. Sun, G.; Chen, T.; Su, Y.; Li, C. Internet traffic classification based on incremental support vector machines. Mob. Netw. Appl. 2018, 1–8. [Google Scholar] [CrossRef]
  14. Sudha, V.; Jayashree, P. Lung nodule detection in CT images using thresholding and morphological operations. Int. J. Emerg. Sci. Eng. 2012, 1, 17–21. [Google Scholar]
  15. Retico, A.; Delogu, P.; Fantacci, M.E.; Gori, I.; Preite Martinez, A. Lung nodule detection in low-dose and thin-slice computed tomography. Comput. Biol. Med. 2008, 38, 525–534. [Google Scholar] [CrossRef] [PubMed]
  16. Bian, X.; Wu, Y. A method of careful lung segmentation based on CT images. J. Chongqing Univ. Posts Telecommun. 2010, 22, 665–668. [Google Scholar] [CrossRef]
  17. Messay, T.; Hardie, R.C.; Rogers, S.K. A new computationally efficient CAD system for pulmonary nodule detection in CT imagery. Med. Image Anal. 2010, 14, 390–406. [Google Scholar] [CrossRef] [PubMed]
  18. Zhou, S.; Cheng, Y.; Tamura, S. Automated lung segmentation and smoothing techniques for inclusion of juxtajuxtapleural nodules and pulmonary vessels on chest CT images. Biomed. Signal Process. Control 2014, 13, 62–70. [Google Scholar] [CrossRef]
  19. Gong, J.; Wang, L.; Wang, Y. Segmentation of lung parenchyma based on gray-level integrated projection and fuzzy C-Means clustering algorithm. Chin. J. Biomed. Eng. 2015, 34, 109–113. [Google Scholar] [CrossRef]
  20. Wei, Y.; Shen, G.; Li, J.J. A Fully Automatic Method for Lung Parenchyma Segmentation and Repairing. J. Digit. Imaging 2013, 26, 483–495. [Google Scholar] [CrossRef] [PubMed]
  21. Li, J.; Zheng, B.; Liang, H.; DENG, Y.-L. Segmentation research of pulmonary parenchyma based on improved convex hull algorithm. Chin. J. Biomed. Eng. 2013, 32, 484–490. [Google Scholar] [CrossRef]
  22. Pastor, L.; Pousse, A.; Manzoni, P.; Kastler, B. A pulmonary nodule modeling tool as a diagnostic aid for lung HRCT images. Comput. Med. Imaging Graph. 2005, 29, 631–637. [Google Scholar] [CrossRef] [PubMed]
  23. Ko, J.P.; Betke, M. Chest CT: Automated nodule detection and assessment of change over time—Preliminary experience. Radiology 2001, 218, 267–273. [Google Scholar] [CrossRef] [PubMed]
  24. Liu, S.; Fu, W.; He, L.; Zhou, J.; Ma, M. Distribution of primary additional errors in fractal encoding method. Multimedia Tools Appl. 2017, 76, 5787–5802. [Google Scholar] [CrossRef]
  25. Geng, H.; Bian, Z.; Yang, J.; Tan, W.; Zhao, D. Fully automatic extraction of lung parenchyma from CT scans. In Proceedings of the 2014 11th World Congress on Intelligent Control and Automation (WCICA), Shenyang, China, 29 June–4 July 2014; pp. 5626–5630. [Google Scholar]
  26. Liming, D.; Caiming, Z.; Shanshan, G. A new algorithm of automatic lung parenchyma segmentation based on CT images. In Proceedings of the 2011 International Conference on Consumer Electronics, Communications and Networks (CECNet), Xianning, China, 16–18 April 2011; pp. 976–979. [Google Scholar]
  27. Ren, Y.-H.; Sun, X.-W.; Nie, S.-D. A 3D segmentation method of lung parenchyma based on CT image sequences. In Proceedings of the 2010 International Conference on Information Networking and Automation (ICINA), Kunming, China, 18–19 October 2010. [Google Scholar]
  28. Luo, X.; Tian, J.; Lin, Y. An algorithm for segmentation of medical image series based on active contour model. J. Softw. 2002, 13, 1050–1059. [Google Scholar]
  29. Liao, X.; Zhao, J.; Jiao, C.; Lei, L.; Qiang, Y.; Cui, Q. A Segmentation Method for Lung Parenchyma Image Sequences Based on Superpixels and a Self-Generating Neural Forest. PLoS ONE 2016. [Google Scholar] [CrossRef] [PubMed]
  30. Peng, R.; Xie, H.; Ju, Y. Computation method of fractal dimension for 2D digital image. J. China Univ. Min. Technol. 2004, 33, 19–24. (In Chinese) [Google Scholar]
  31. Foroutan-Pour, K.; Dutilleul, P.; Smith, D.L. Advances in the implementation of the box-counting method of fractal dimension estimation. Appl. Math. Comput. 1999, 105, 195–210. [Google Scholar] [CrossRef]
  32. Liu, S.; Pan, Z.; Fu, W.; Cheng, X. Fractal generation method based on asymptote family of generalized Mandelbrot set and its application. J. Nonlinear Sci. Appl. 2017, 10, 1148–1161. [Google Scholar] [CrossRef]
  33. Liu, S.; Pan, Z.; Cheng, X. A Novel Fast Fractal Image Compression Method Based on Distance Clustering in High Dimensional Sphere Surface. Fractals-Complex Geom. Patterns Scaling Nat. Soc. 2017, 25, 1740004. [Google Scholar] [CrossRef]
  34. Zhao, J.; Ji, G.; Han, X.; Qiang, Y.; Liao, X. An automated pulmonary parenchyma segmentation method based on an improved region growing algorithmin PET-CT imaging. Front. Comput. Sci. 2016, 10, 189–200. [Google Scholar] [CrossRef]
  35. Zhao, J.; Ji, G.; Qiang, Y.; Han, X.; Pei, B.; Shi, Z. A New Method of Detecting Pulmonary Nodules with PET/CT Based on an Improved Watershed Algorithm. PLoS ONE 2015, 10, e0123694. [Google Scholar] [CrossRef] [PubMed]
  36. Liu, S.; Lu, M.; Liu, G. A Novel Distance Metric: Generalized Relative Entropy. Entropy 2017, 19. [Google Scholar] [CrossRef]
  37. Wang, S.; Lv, Y.; Sui, Y.; Liu, S.; Wang, S.J.; Zhang, Y.D. Alcoholism Detection by Data Augmentation and Convolutional Neural Network with Stochastic Pooling. J. Med. Syst. 2018, 42. [Google Scholar] [CrossRef] [PubMed]
  38. Liu, S.; Pan, Z.; Song, H. Digital image watermarking method based on DCT and fractal encoding. IET Image Process. 2017, 11, 815–821. [Google Scholar] [CrossRef]
Figure 1. Flow diagram of the lung parenchyma segmentation algorithm.
Figure 1. Flow diagram of the lung parenchyma segmentation algorithm.
Applsci 08 00832 g001
Figure 2. Results of the automated threshold iterative segmentation of lung parenchyma.
Figure 2. Results of the automated threshold iterative segmentation of lung parenchyma.
Applsci 08 00832 g002
Figure 3. Process of trachea and bronchus removal and lung contour refining. (a) Binarization of the coarse lung image; (b) Extraction of minimum bounding rectangle; (c) Selection of seed points with the left and right scanning algorithm; (d) Final lung mask.
Figure 3. Process of trachea and bronchus removal and lung contour refining. (a) Binarization of the coarse lung image; (b) Extraction of minimum bounding rectangle; (c) Selection of seed points with the left and right scanning algorithm; (d) Final lung mask.
Applsci 08 00832 g003
Figure 4. Fractal dimension of the statistical histogram.
Figure 4. Fractal dimension of the statistical histogram.
Applsci 08 00832 g004
Figure 5. Segmentation of the same sequence of juxtapleural nodules by four kinds of algorithms.
Figure 5. Segmentation of the same sequence of juxtapleural nodules by four kinds of algorithms.
Applsci 08 00832 g005
Figure 6. Segmentation of images containing two juxtapleural nodules using the four algorithms.
Figure 6. Segmentation of images containing two juxtapleural nodules using the four algorithms.
Applsci 08 00832 g006
Figure 7. Comparison between the proposed algorithm and the rolling-ball method to repair the same sequence: (a) Six consecutive CT images; (b) The gold standard; (c) r = 35 patch results; (d) r = 65 patch results; (e) patch results of our method.
Figure 7. Comparison between the proposed algorithm and the rolling-ball method to repair the same sequence: (a) Six consecutive CT images; (b) The gold standard; (c) r = 35 patch results; (d) r = 65 patch results; (e) patch results of our method.
Applsci 08 00832 g007
Figure 8. Comparison of the curves of pixel accuracy for the four methods.
Figure 8. Comparison of the curves of pixel accuracy for the four methods.
Applsci 08 00832 g008
Figure 9. Comparison of the curves of Intersection over Union (IoU) for the four methods.
Figure 9. Comparison of the curves of Intersection over Union (IoU) for the four methods.
Applsci 08 00832 g009
Figure 10. Processing time of three methods. (a) Average processing time for each set of 40 images; (b) Average processing time for each set of 60 images.
Figure 10. Processing time of three methods. (a) Average processing time for each set of 40 images; (b) Average processing time for each set of 60 images.
Applsci 08 00832 g010
Table 1. The segmentation results of the four methods.
Table 1. The segmentation results of the four methods.
MethodPA (%)IoU (%)Time (s)
RG [34]89.2689.122.55
Watershed [35]90.7387.291.58
Rolling-Ball method [4]91.9293.11.58
Our method92.4595.90.75

Share and Cite

MDPI and ACS Style

Xiao, X.; Zhao, J.; Qiang, Y.; Wang, H.; Xiao, Y.; Zhang, X.; Zhang, Y. An Automated Segmentation Method for Lung Parenchyma Image Sequences Based on Fractal Geometry and Convex Hull Algorithm. Appl. Sci. 2018, 8, 832. https://doi.org/10.3390/app8050832

AMA Style

Xiao X, Zhao J, Qiang Y, Wang H, Xiao Y, Zhang X, Zhang Y. An Automated Segmentation Method for Lung Parenchyma Image Sequences Based on Fractal Geometry and Convex Hull Algorithm. Applied Sciences. 2018; 8(5):832. https://doi.org/10.3390/app8050832

Chicago/Turabian Style

Xiao, Xiaojiao, Juanjuan Zhao, Yan Qiang, Hua Wang, Yingze Xiao, Xiaolong Zhang, and Yudong Zhang. 2018. "An Automated Segmentation Method for Lung Parenchyma Image Sequences Based on Fractal Geometry and Convex Hull Algorithm" Applied Sciences 8, no. 5: 832. https://doi.org/10.3390/app8050832

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop