Next Article in Journal
Assessment of Anthropometric and Body Composition Risk Factors in Patients with both Hypertension and Stroke in the Korean Population
Next Article in Special Issue
Cyst Detection and Motion Artifact Elimination in Enface Optical Coherence Tomography Angiograms
Previous Article in Journal
Effort Estimation Approach through Extracting Use Cases via Informal Requirement Specifications
Previous Article in Special Issue
Computer Aided Detection of Pulmonary Embolism Using Multi-Slice Multi-Axial Segmentation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Skin Lesion Segmentation Using Image Bit-Plane Multilayer Approach

Politecnico di Bari, Dipartimento di Ingegneria Elettrica e dell’Informazione (DEI), 70125 Bari, Italy
*
Author to whom correspondence should be addressed.
Appl. Sci. 2020, 10(9), 3045; https://doi.org/10.3390/app10093045
Submission received: 9 April 2020 / Revised: 24 April 2020 / Accepted: 25 April 2020 / Published: 27 April 2020
(This article belongs to the Special Issue Computer-aided Biomedical Imaging 2020: Advances and Prospects)

Abstract

:
The establishment of automatic diagnostic systems able to detect and classify skin lesions at the initial stage are getting really relevant and effective in providing support for medical personnel during clinical assessment. Image segmentation has a determinant part in computer-aided skin lesion diagnosis pipeline because it makes possible to extract and highlight information on lesion contour texture as, for example, skewness and area unevenness. However, artifacts, low contrast, indistinct boundaries, and different shapes and areas contribute to make skin lesion segmentation a challenging task. In this paper, a fully automatic computer-aided system for skin lesion segmentation in dermoscopic images is indicated. Adopting this method, noise and artifacts are initially reduced by the singular value decomposition; afterward lesion decomposition into a frame of bit-plane layers is performed. A specific procedure is implemented for redundant data reduction using simple Boolean operators. Since lesion and background are rarely homogeneous regions, the obtained segmentation region could contain some disjointed areas classified as lesion. To obtain a single zone classified as lesion avoiding spurious pixels or holes inside the image under test, mathematical morphological techniques are implemented. The performance obtained highlights the method validity.

1. Introduction

The adoption of digital technology in the healthcare environment is growing steadily each year with forecasts of further increments in the near future. Healthcare information management systems, electronic medical records, mobile health services, video-consulting, and remote patient monitoring systems are some of the information technology-generated products [1,2]. As a consequence, the overall health of people continues to improve in many ways as a consequence of advances in medical technology, research, and resources set aside to public health and education [3]. Devices, such as sensors, communication systems, and computers, allow the implementation and diffusion of proper and suitable technologies for acquiring, processing, analyzing, and transmitting health-related data [4,5]. The produced systems support medical teams and specialists for detecting, localizing, and screening of abnormalities in such a way that an early risk assessment and an accurate diagnosis is made [6,7,8]. Many improvements are expected in different medical environments, such as the oncological sector since cancer is one of the leading causes of mortality. Among cancerous pathologies, skin melanoma incidence has grown about 15% over the last 10 years compared with the previous decade [9]. It is considered the deadliest type of skin cancer with a high death rate if diagnosed too late: Melanoma accounts for approximately 75% of deaths associated with skin cancer [10]. Therefore, early detection of melanoma is crucial for prognosis improvement.
New approaches have been developed for an early and accurate diagnosis of melanoma, such as biophysics analysis [11], imaging techniques (i.e., dermoscopy), diagnostic algorithms, and image analysis-based criteria [12,13]. Nevertheless, clinical diagnosis is still challenging since it depends on human vision and physician experience and expertise. For these reasons, computer-aided detection and diagnosis (CADe and CADx) systems are becoming effective means to help specialists in detecting and preventing neoplastic pathologies [14]. Image segmentation is a fundamental phase of CADe systems and it is a difficult task in the specific case of dermoscopic image analysis for skin lesion classification. In fact, low contrast between lesion and skin area around lesion, irregular lesion border, artifacts (such as bubbles or body hairs), blood vessels, lack of color uniformity inside nevi, and depigmentation make the segmentation a challenging task. An accurate segmentation is crucial for a correct diagnosis because it makes it possible to extract highlight information on border structure such as asymmetry and lesion area irregularity [15,16].
In this paper the lesion segmentation problem is addressed: An automatic and real-time method for dermoscopic images able to segment skin lesions and identify/highlight border also in the presence of imperfections (such as hairs, bubbles) is presented. In the proposed method, a preprocessing phase aimed at reducing the image noise and at preserving all the spatially correlated information was first performed using the singular value decomposition (SVD) technique. The preprocessed Red Green and Blue (RGB) image under test was afterwards decomposed into a frame of bit-plane layers. In order to extract all the coherent information, thus preserving the contour transitions, a bit-plane binary orthogonalization-like was then implemented and the image segmentation was achieved by appropriately summing up the mostly correlated singular vectors. Morphologic techniques were conveniently used to reduce spurious pixels in segmented regions.
Adopting the publicly available PH2 database [17] as test bench, experimental results showed good performance and easy hardware development.
In Section 2, a brief review of the most recent and popular segmentation methods indicated in literature is given. Section 3 deals with the techniques used for the procedure development, while in Section 4 the conceived method is described in details, and in Section 5 the database used to test the algorithm is presented. Experimental results and discussions are highlighted in the last section of the paper.

2. Prior Research

In recent years, several studies have been presented in computer-aided melanoma detection and diagnosis areas [18]. Pigmented skin lesion detection and diagnosis is a crucial and challenging task in dermoscopic images because some elements/factors could alter and corrupt the image, impairing the development of high-performance CADe systems. An accurate segmentation phase enabling the partition of the image into distinct and non-overlapping regions is a fundamental step for a computer-based automatic diagnosis [19].
Various methods have been indicated in literature for the segmentation phase [20,21,22]: Some of them are based on easy and fast computational procedures needing post-processing steps (thresholding, region- and edge-based approaches); other methods combine simple segmentation techniques or perform high-level procedures to avoid post-processing and to reach good performance in presence of low contrast lesion boundaries, too (soft computing methods, deformable models, and so on).
Benefits and robustness of thresholding, and edge-based and region-based methods for the segmentation of dermoscopic images are exploited in [23]. Using active contours, the proposed method adopted adaptive thresholding to select an initial contour and then maximized the Kullback–Leibler divergence of the gray level distribution between lesion and skin to fit a curve to the lesion boundaries. As post-processing phase, lesion periphery was extracted to detect melanoma using image features that were based on local binary patterns. The region-based active contour was, also, the key technique for lesion outline delineation phase in [24]. This procedure, after a preprocessing step for hair and shading effect attenuation, convert the RGB image into gray level image by applying the particle swarm optimization algorithm for the selection of best coefficients. The obtained gray level image was then used as input for the multi-Otsu method, which provides initial contour for border detection using active contour. Also, in [25] a geometric deformable model was adopted to effectively differentiate a skin lesion from surrounding tissue. The preprocessing phase of the procedure in [25] detected hairs, taking into account the dermoscopic knowledge of hair shafts. A 2D-Gabor filter was used, whose parameters were tuned by considering the hair properties: The filter band-pass and orientation take into account the width and the direction of hair shafts, respectively. In the next phase, the implemented deformable model used a speed function which considered the lesion chrominance properties to stop the evolution at the lesion boundary. Automatic initialization of the initial contour and chrominance-based speed function made a robust and flexible segmentation possible. In contrast with a full automatic approach, the manual initialization was adopted in [26] both to reduce the preprocessing phase and to avoid a lowering of the algorithm performance when contiguous area of the initial curve included regions with very different colors from normal skin. The RGB color space was converted for the purpose of using the image color information to distinguish normal skin from lesions. Moreover, the differences in color channels were combined together for deformable model speed function and stopping criterion definition.
With the aim of maximizing the discrimination between lesion and background skin pixels, color channels from various color spaces were analyzed in [27] for the development of an automatic border detection system. The procedure, after the identification of the most efficient color channels, proposed a two stages thresholding to identify firstly the core lesion adopting the Otsu thresholding method and then the edge lesion area by the implementation of a clustering-based histogram thresholding method on the optimal color channels previously determined.
The combination of multiple color spaces was used in [28] for the identification of pixels belonging to skin after an equalization phase for the image contrast enhancement. A triangular tessellation of the edge of the detected skin lesion image was computed using Delaunay triangulation. The triangle area was in compliance with the extracted edge and, in fact, homogeneous and heterogeneous regions produced large and small triangles, respectively. A threshold was used for merging the regions by means of a normalized boundary cost.
A level set-based segmentation method, which integrated texture features and distinguished the feature importance in response to different inner textures, was implemented in [29]. After a preprocessing step aimed at hair/black frame removing and potential lesion area detecting, the prior color probably distribution in the localized area and the Gabor wavelet-based features were extracted and integrated in the definition of the energy functional. For global optimization achieving, a Markov chain Monte Carlo sampling approach guided by the combined energy was adopted.
Aiming to improve the algorithm performance, Khan et al. [30] implemented two different segmentations on the image under test, adopting a probabilistic approach. After a lesion contrast enhancement by a stretching technique, which used low and high threshold values, the mean of the uniform distribution and the mean deviation of the normal distribution were evaluated on the enhanced image and their values were inserted in an activation function to perform two different segmentations. A fusion of segmented images was implemented by utilizing additive law of probability.
To avoid sophisticated pre- and post-processing procedures, convolutional neural network was adopted in [31] for the development of a method able to handle dermoscopic images under various acquisition conditions. By exploiting 19-layer deep convolutional neural network (DFCN) with a little over 290,000 trainable parameters, the indicated system used a limited training dataset for an efficient learning. The DFCN architecture consisted of a convolutional path, in which contextual information was aggregated via convolution and pooling, and a deconvolution pathway in which the full image resolution was recovered by deconvolution and upsampling. To eliminate the need of sample reweighting, a novel loss function based on Jaccard distance, was adopted instead of the widely used cross entropy between predicted values and targets.
The same loss function was used in [32] to implement an efficient segmentation procedure under limited computational resources. The method was based on fully convolutional neural network and consisted of an encoder–decoder structure. The encoder was composed of four dense blocks with each block having four layers, while the decoder had four blocks, with each block having three layers. High-resolution features from early layers as well as high-semantic features of deeper layers were processed by the network because multiple skip connections were arranged between encoder and decoder. Also, in [33] the fully convolutional neural network approach was adopted with multiple key improvements. In fact, the adoption of multistage fully convolution networks refined the skin lesion segmentation results across multiple stages. The complementary multistage segmentations were then integrated in parallel to obtain the final results.
To ensure visual consistency in the segmented region boundaries for skin lesions characterized by fuzzy boundaries and/or low contrast to the background, Bi et al. [34] adopted a deep class-specific learning and a probability-based stepwise integration of the derived class-specific segmentation maps. Based on the image classification probability, complementary segmentation results produced by different deep class-specific learning models were integrated to iteratively maximize label agreement between neighboring pixels. In [35], the deep learning approach was exploited to develop a resolution-independent segmentation method in dermoscopic images. A deep convolutional neural network named as You Only Look Once (YOLO) [36] and the GrabCut algorithm [37] combined in a pipeline architecture was proposed [35]. After a preprocessing phase aimed to remove hairs on lesion, skin lesion localization was performed adopting the YOLO network, which makes the transformation of a detection matter into a regression issue possible. Adopting the GrabCut algorithm and morphological image processing operators for removing artifacts, promising results were obtained by the implemented procedure which was image dimension-independent.
The over-segmentation of skin lesion image into several super-pixels was the key idea to develop a method which is able to deal with the presence of hair in the original image without any additional steps [38]. The Simple Linear Iterative Clustering algorithm was adopted to over-segment the RGB dermoscopic image and then a binary search was performed to find the suitable threshold for merging all the super-pixels into the class of lesion area and healthy skin region. The mean color intensity of each super-pixel was used as merging criterion.
With the aim of developing an accurate procedure which is characterized by a simple, fast, and flexible approach, Aljanabi et al. used a 2D median filter and morphological filtering based on Gaussian kernel for hair removing and image smoothing against noise [39]. The detection of skin lesion boundaries was performed by adopting the artificial bee colony algorithm, which makes possible the definition of an optimal thresholding value based on the histogram of the enhanced image.

3. Adopted Techniques

In the conceived method, the singular value decomposition (SVD) method was used for dermoscopic image preprocessing stage aimed at reducing the noise inherently present on skin lesion image. The recourse to SVD, instead of a standard low pass filtering technique, was explained by its capability of preserving patterns and correlated information and discarding spatially uncorrelated terms (such as noise and quantization) without affecting significantly the global image quality. Therefore, the proposed procedure was data adaptive.
The SVD technique performed the factorization of a matrix into three components as follows [40,41].
A = U × S × V T
where A is the original data, U and V orthonormal matrices, and S a diagonal matrix, respectively.
Matrix A can be decomposed into three matrices, as indicated in Equation (1). V is the matrix of coefficients able to orthogonalize A into the product of U and S, the matrix of “singular values”.
The columns of U and V are indicated as the left and right singular vector matrices of A, respectively, while the values along the diagonal of S are arranged in descending order. Such values represent the “importance” of each singular vector in U in describing the entire image.
The SVD aim is to store the most correlated information present in the image in the first singular vectors; the lower singular values associated to singular vectors can be related to uncorrelated information and noise.
The SVD capacity of pulling out the correlated components of an image and exploiting the image information into mutually uncorrelated components, sorted by their specific energy, has been exploited for noise reduction in dermoscopic images.

4. Implemented Method

The aim of the implemented segmentation procedure was the generation of a mask, which provides an accurate separation between lesion area and surrounding healthy skin. In this way, useful information about the lesion border can be extracted by analyzing the obtained mask.
For this purpose, the image bit plane inherent information is exploited to extract a detailed and noise-free image segmentation. Lesion segmentation problem was addressed with the search of locally correlated color components. Deepening the observation on the spatially correlated information, also low terms were considered, thus making possible the detection of even low-energy patterns on the image.
To pursue this task, the information of bit planes in the digital image was exploited to highlight the principal areas in the image under test which show a strong spatial correlation.
The following phases have been implemented:
Input
Skin lesion image acquisition
Pre-processing phase
SVD-based image denoising
Segmentation phase
Image decomposition in bit plane layers
Binary orthogonalization-like procedure
Construction of the segmented image
Post-processing phase
Morphological filtering
Output
Skin Lesion area highlighting

4.1. Preprocessing Phase

To reduce artifacts and noise generated during the image acquisition phase, the SVD decomposition was carried out for each plane of the RGB image under test.
The image subspace and the noise subspace can be identified by implementing the thresholding technique on the singular values as most of the image energy was confined in the highest singular values (Figure 1).
Neglecting the lowest singular values in the image decomposition allows reconstructing a data-adaptive low pass filter, not affecting significatively the pattern structures in the image. To have a denoised image, the reconstruction of the matrix from its SVD decomposition technique was carried out, setting to zero only a given (low) percentage of the lowest singular values in expression (1).
Depending on the specific image to analyze, a variable threshold was adopted for singular value splitting. Therefore, an image-based selection was performed, tuning the chosen singular values for each acquired image. Consequently, the implemented data adaptive preprocessing phase performed differently on each image while preserving the largest part of image energy and neglecting orthogonal components with lowest energy.

4.2. Segmentation Phase

The RGB dermoscopic images adopted as test bench used 8 bit planes for each color component, so that 24 bit planes were extracted from each image under test and used for the skin lesion segmentation aim. A three-dimensional binary data set was achieved by stacking the afore mentioned bit planes on each other. This stack of bit planes, named BPS, represents the raw data of this segmentation procedure. Every bit plane of BPS contained local specific information about a distinctive pattern occurring at a certain reflectance level on the image.
Since BPS provides a lot of redundant data, a redundancy reduction was carried out using a specific procedure to obtain a sort of bit plane orthogonalization. The proposed procedure aimed to detect a partition of the image into areas containing pixel levels which were both mutually strongly correlated and uncorrelated/lowly correlated with pixels in different areas.
To enhance the inherent bit planes’ correlation, the gray encoding was used. Because each bit plane of BPS was in a binary form, simple Boolean operators were used. In particular, the proposed binary orthogonalization was implemented by logical AND (&), OR ( | ), and NOT (1-U) operators adopting the proposed pseudo code in which U(i) is the ith bit plane in BPS:
  • for (i, j), with (i ≠ j)
  • // definitions
  • AND = U(j) & U(k);
  • AnotB = (1-U(j)) & U(k);
  • notAB = (1-U(k)) & U(j);
  • // operations
  • U(j) = AND | AnotB;
  • U(k) = (AND | notAB);
  • end
Several new transformations of bit planes containing mainly color plane coherent areas were consequently generated. Because many of such areas were overlapping and duplicated, a procedure to reduce the number of segmented areas was carried out. Sorting the segmented areas in accordance with their dimensions, a multilevel image description of coherent color areas was performed by selecting a number of slices. Figure 2 shows an example of the segmentation phase output: On the Cartesian axes, pixel number of the tested image is reported and yellow areas show the segmented regions obtained by the proposed binary approach.

4.3. Post-Processing Phase

Since in dermoscopic images illumination is maximized at the center of the image and decreases drastically towards borders enough to produce a significant gradient that could heavily affect the segmentation results, a region of interest (ROI) was chosen centered within the image to address the segmentation problem.
Output of the segmentation phase (Figure 2) was refined using mathematical morphology. By employing a small circular structuring element, with radius R = 1 pixel, spurious pixels inside color coherent areas were avoided using the erosion operation while holes in coherent areas were filled through the dilation. In order to better preserve the fine details of the border, a slightly bigger circular structuring element of radius equal to 3 pixels was used for the dilation.
As the resulting segmented regions might contain more than one connected area, the segmentation of bit planes (each containing a connected area) into a new stack was carried out by means of a common splitting procedure. The obtained regions were candidates to be the starting point for the image segmentation into coherent areas.
To achieve coherent areas characterized by a common image color, the weighted sum of the images present in the final BPS was evaluated by employing a simple algorithm. Denoting with BP(k) the kth bit plane of the reduced dimension BPS, which was obtained at the output of the bit-plane orthogonalization phase, the segmented image (I) was:
I = k = 1 N k · B P k
where N is the number of bit planes composing the reduced BPS.
In Figure 3, the output obtained by adopting the image processing detailed in the aforementioned procedure is shown: The original image and the binary orthogonal segmentation are shown on the left and on the right, respectively.
Once the image segmented into color coherent areas is available, the detection of the skin lesion area is obtained following a two-step procedure. Firstly, segmented areas are sorted in descending order according to their extension and the smallest areas are neglected. In such a way, the segmented area which mostly covers the entire image is identified. In the second step the mean color of each area is computed and the lesion is selected as the darkest area among the available ones.

5. Adopted Database

The method was validated using the publically available PH2 database composed of 200 dermoscopic images acquired under the same conditions at the Dermatology Service of Hospital Pedro Hispano, Matosinhos, Portugal [17,42]. All images are 8-bit RGB images with 768 × 560 pixels resolution and were captured by a lens with a 20 × magnification.
The PH2 database, which contains 80 atypical nevi, 80 common nevi, and 40 melanoma, includes manual segmentation and clinical and histological diagnosis of skin lesion as well as the identification of other important dermoscopic criteria such as the assessment of the lesion asymmetry, the identification of colors, pigment network, dots, globules, streaks, regression areas, and blue-whitish veil. All the included dermoscopic images are either from the skin type II or III, according to the Fitzpatrick skin-type classification scale [43]. Therefore, the skin colors in the PH2 database range from white to cream white.
In this database, manual segmentation of skin lesion provided by expert dermatologists is available as a binary mask in which pixels with intensity value of 1 correspond to the segmented lesion while pixels with value 0 correspond to the background.

6. Experimental Results

6.1. Evaluation Metrics

The performance of the implemented procedure was assessed by comparing the CADe outputs with the ground truths indicated by expert clinicians, which are collected inside the used database.
The metrics suggested in the International Skin Imaging Collaboration (ISIC) challenges are evaluated for benchmarking [44,45,46]. The sensitivity represents the method ability to correctly identify the lesion pixels in the image, while the specificity is the method ability to correctly identify the non-lesion pixels. The Jaccard index and the Dice coefficient measure the similarity between the obtained segmentation result and the ground-truth mask. Finally, the accuracy was defined as the observed agreement between the procedure results and the physician opinion about the lesion under test and the balanced accuracy was the arithmetic mean of class-specific accuracies.
The aforementioned metrics are computed adopting the following expressions:
S e n s i t i v i t y   S e = T P T P + F N
S p e c i f i c i t y   S p = T N T N + F P
A c c u r a c y   A C = T P + T N T P + F P + T N + F N
D i c e   c o e f f i c i e n t D I = 2 T P 2 T P + F N + F P
J a c c a r d   i n d e x   J A = T P T P + F N + F P
where:
  • TP (number of true positives) is the number of lesion pixels correctly classified as lesion inside the image under test.
  • FN (the number of false negatives) is the number of lesion pixels incorrectly identified as non-lesion.
  • FP (the number of false positives) is the number of non-lesion pixels incorrectly identified as lesion.
  • TN (the number of true negatives) is the number of non-lesion pixels correctly identified as non-lesion.
Usually, metrics with the highest values are recommended for computer-aided systems but a trade-off shall be achieved according to their relative importance [47,48].

6.2. Results

For the experimental validation of the implemented method, a publicly available database of skin lesion dermoscopic images was used. Therefore, the system performance could be quantitatively compared with other segmentation procedures indicated in literature.
The collection of skin lesion dermoscopic images of the PH2 database was processed to assess the procedure performance. For comparative purpose, the results were analyzed in two different ways. The first one considered the whole dataset of images, and the next one two subsets of images, melanoma and benign lesions separated.
Comparisons of the obtained performance with other methods indicated in literature which adopted the PH2 database as test bench showed the procedure validity. In particular, in Table 1 results obtained adopting the whole PH2 dataset are indicated while Table 2 contains the performance obtained differentiating the images with and without melanoma.
In Figure 4, the performance of the proposed method is indicated through the violin plots for (1) melanoma, (2) atypical nevi, and (3) normal nevi. TP, TN, FP, FN are plotted in the graph.
In Figure 5, an example of segmentation obtained adopting the proposed procedure is presented which shows the performance in terms of FP (green area), FN (red area), and TP (yellow area).

7. Discussions and Conclusions

The adoption of CADe in the medical environment for the detection and classification of abnormalities as soon as they occur can be a valid support for specialists, especially during the screening phase when both a large amount of diagnostic examinations have to be referred and when diagnostic images are challenging to analyze. In this paper, a method to perform an automatic and accurate segmentation of pigmented skin lesion in dermoscopic images was presented.
For benchmarking purpose, the conceived method was tested, adopting the publicly available PH2 database.
The possibility of adopting a variety of databases as test bench and the existence of several metrics for the procedure performance evaluation made the comparison among the several methods indicated in literature a hard task. The training phase of a computer method (i.e., feature selection and classifier training) as well as the reached results heavily depended on the characteristics of images composing the selected dataset in terms of resolution, contrast, lightness, sharpness, noise, and so on. Moreover, the provided public databases, show images differently: In the same instance, regions of interest comprised the lesion with its proximity, while others contained the single lesion or only part of the lesion crossing its margin.
For these reasons, it was difficult to develop an “optimal algorithm”, which is able to achieve the same results independently from the database adopted to test the conceived procedure.
The PH2 database used to test the proposed segmentation algorithm is very challenging. In fact, several images are heavily affected by poor illumination and by the presence of hair artifacts, some others contain multiple lesions, various lesions are connected to the boundary edge of the provided image, and a number of skin lesions occupy more than half of the image area, making the matrix computation inconsistent. For these reasons, many studies indicated in literature discard up to 40 images of the database to avoid images having the issues stated above [26,29,35,49,50]. Of course, the removal of the most critical database images during the test phase contributes to increase the procedure performance.
Segmentation performance of the implemented, fully automatic method was quantitatively assessed by likening the results obtained to the ground truth provided by the PH2 database. The ground truth was obtained by a manual segmentation of skin lesion provided by several experts. Since visual inspection of a lesion area by dermatologists depends on human vision and physician experience and expertise, manual segmentation is subjective and nonreproducible [5]. In fact, different specialists produce distinct segmentations when delineating the same lesion and sometimes the segmentation is performed in a “surgically oriented” mode, that is, the segmented area is normally slightly enlarged with respect to the lesion area and the lesion contour is smoother than the pigmented lesion itself might appear.
The implemented method is a versatile system which allows making changes in each section in an independent way. The presented method is designed to be sensitive even with images characterized by irregular borders.
The method validation was limited to the only PH2 database that, in any case, is a challenging dataset for the characteristics of images composing it. Future development will include the implementation of the feature extraction phase for lesion classification taking into account one among the adopted criteria for melanoma detection, such as the “ABCDE rule”.
In terms of the whole database images, the method achieved good overall performance, and in details the best specificity. Dice index and Jaccard coefficient were reached among the methods considered for the comparison. Therefore, the conceived procedure could help the interpretation of specialists, especially in the case of equivocal lesions because it allows a reproducible diagnosis by eliminating the inter-observer and intra-observer variabilities.

Author Contributions

Conceptualization, M.R. and C.G.; methodology, C.G.; software, M.R. and C.G.; validation, M.R. and C.G.; formal analysis, M.R. and C.G.; investigation, M.R.; resources, M.R.; data curation, M.R.; writing—original draft preparation, M.R.; writing—review and editing, M.R. and C.G.; visualization, M.R. and C.G.; supervision, C.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Campbell, B.; Dobson, L.; Higgins, J.; Dillon, B.; Marlow, M.; Pomfrett, C. A new health technology assessment system for devices: The first five years. Int. J. Technol. Assess. Health Care 2017, 33, 19–24. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Rizzi, M.; D’aloia, M.; Cice, G. Computer aided evaluation (CAE) of morphologic changes in pigmented skin lesions. Lect. Notes Comput. Sci. 2015, 9281, 250–257. [Google Scholar] [CrossRef]
  3. Velázquez, J.S.; Cavas, F.; Bolarín, J.M.; Alió, J.L. 3D Printed Personalized Corneal Models as a Tool for Improving Patient’s Knowledge of an Asymmetric Disease. Symmetry 2020, 12, 151. [Google Scholar] [CrossRef] [Green Version]
  4. Giorgio, A.; Rizzi, M.; Guaragnella, C. Efficient Detection of Ventricular Late Potentials on ECG Signals Based on Wavelet Denoising and SVM Classification. Information 2019, 10, 328. [Google Scholar] [CrossRef] [Green Version]
  5. Bolarín, J.M.; Cava, F.; Velázquez, J.; Alió, J. A Machine-Learning Model Based on Morphogeometric Parameters for RETICS Disease Classification and GUI Development. Appl. Sci. 2020, 10, 1874. [Google Scholar] [CrossRef] [Green Version]
  6. Rizzi, M.; D’Aloia, M. Computer aided system for breast cancer diagnosis. Biomed. Eng. Appl. Basis Commun. 2014, 26, 3–11. [Google Scholar] [CrossRef]
  7. Abdel-Nasser, M.; Moreno, A.; Puig, D. Breast Cancer Detection in Thermal Infrared Images Using Representation Learning and Texture Analysis Methods. Electronics 2019, 8, 100. [Google Scholar] [CrossRef] [Green Version]
  8. D’Aloia, M.; Rizzi, M. Noisy ECG signal analysis for automatic peak detection. Information 2019, 10, 35. [Google Scholar] [CrossRef]
  9. Melanoma. Available online: https://www.epicentro.iss.it/melanoma/ (accessed on 8 January 2020).
  10. Melanoma: Incidenza e Mortalità. Available online: https://www.infomedics.it/therapeutic-areas/melanoma/epidemiologia.html (accessed on 8 January 2020).
  11. Petruk, V.G.; Ivanov, A.P.; Kvaternyuk, S.M.; Barunb, V.V. Spectrophotometric Method for Differentiation of Human Skin Melanoma. II. Diagnostic Characteristics. J. Appl. Spectrosc. 2016, 83, 261–270. [Google Scholar] [CrossRef]
  12. Argenziano, G.; Soyer, H.P.; Chimenti, S.; Talamini, R.; Corona, R.; Sera, F.; Binder, M.; Cerroni, L.; De Rosa, G.; Ferrara, G.; et al. Dermoscopy of pigmented skin lesions: Results of a consensus meeting via the Internet. J. Am. Acad. Dermatol. 2003, 48, 679–693. [Google Scholar] [CrossRef] [Green Version]
  13. Carrera, C.; Marchetti, M.A.; Dusza, S.W.; Argenziano, G.; Braun, R.P.; Halpern, A.C.; Jaimes, N.; Kittler, H.J.; Malvehy, J.; Menzies, S.W.; et al. Validity and Reliability of Dermoscopic Criteria Used to Differentiate Nevi from Melanoma A Web-Based International Dermoscopy Society Study. JAMA Dermatol. 2016, 52, 798–806. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Suzuki, K.; Chen, Y. Artificial Intelligence in Decision Support Systems for Diagnosis in Medical Imaging; Springer Publishing Company: Cham, Switzerland, 2018; ISBN 978-3-319-68842-8. [Google Scholar]
  15. Okur, E.; Turkan, M. A survey on automated melanoma detection. Eng. Appl. Artif. Intell. 2018, 73, 50–67. [Google Scholar] [CrossRef]
  16. Revathi, V.L.; Chithra, A.S. Review on Segmentation Techniques in Skin Lesion Images. Int. Res. J. Eng. Technol. 2015, 2, 2598–2603. [Google Scholar]
  17. Mendonc, T.; Ferreira, M.P.; Marques, J.S.; Marcal, A.R.S. PH 2-A dermoscopic image database for research and benchmarking. In Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan, 3–7 July 2013; pp. 5437–5440. [Google Scholar] [CrossRef]
  18. Pathana, S.; Gopalakrishna Prabhub, K.; Siddalingaswamya, P.C. Techniques and algorithms for computer aided diagnosis of pigmented skin lesions—A review. Biomed. Signal Process. Control 2018, 39, 237–262. [Google Scholar] [CrossRef]
  19. Vesal, S.; Malakarjun Patil, S.; Ravikumar, N.; Maier, A.K. A Multi-task Framework for Skin Lesion Detection and Segmentation. In OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis; Stoyanov, D., Taylor, Z., Sarikaya, D., McLeod, J., Ballester, M.A., Codella, N.C., Martel, A., Maier-Hein, L., Malpani, A., Zenati, M.A., et al., Eds.; CARE 2018, CLIP 2018, OR 2.0 2018, ISIC 2018; Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2018; Volume 11041. [Google Scholar] [CrossRef] [Green Version]
  20. Celebi, M.E.; Wen, Q.; Iyatomi, H.; Shimizu, K.; Zhou, H.; Schaefer, G. A State-of-the-Art Survey on Lesion Border Detection in Dermoscopy Images. In Dermoscopy Image Analysis; CRC Press: Boca Raton, FL, USA, 2015; pp. 97–129. [Google Scholar]
  21. Olugbara, O.O.; Taiwo, T.B.; Heukelman, D. Segmentation of Melanoma Skin Lesion Using Perceptual Color Difference Saliency with Morphological Analysis. Math. Probl. Eng. 2018, 2018, 1524286. [Google Scholar] [CrossRef]
  22. Peng, Y.; Wang, N.; Wang, Y.; Wang, M. Segmentation of dermoscopy image using adversarial networks. Multimed. Tools Appl. 2019, 78, 10965–10981. [Google Scholar] [CrossRef]
  23. Riaz, F.; Naeem, S.; Nawaz, R.; Coimbra, M. Active Contours Based Segmentation and Lesion Periphery Analysis for Characterization of Skin Lesions in Dermoscopy Images. IEEE J. Biomed. Health Inform. 2019, 23, 489–500. [Google Scholar] [CrossRef]
  24. Meskini, E.; Helfroush, M.S.; Kazemi, K.; Sepaskhah, M. A New Algorithm for Skin Lesion Border Detection in Dermoscopy Images. J. Biomed. Phys. Eng. 2018, 8, 117–126. [Google Scholar] [CrossRef]
  25. Pathana, S.; Gopalakrishna Prabhub, K.; Siddalingaswamya, P.C. Hair detection and lesion segmentation in dermoscopic images using domain knowledge. Med. Biol. Eng. Comput. 2018, 56, 2051–2065. [Google Scholar] [CrossRef]
  26. Ma, Z.; Tavares, J.M.R.S. A novel approach to segment skin lesions in dermoscopic images based on a deformable model. IEEE J. Biomed. Health Inform. 2016, 20, 615–623. [Google Scholar] [CrossRef] [Green Version]
  27. Garnavia, R.; Aldeena, M.; Celebi, M.E.; Varigosc, G.; Finch, S. Border detection in dermoscopy images using hybrid thresholding on optimized color channels. Comput. Med. Imaging Graph. 2011, 35, 105–115. [Google Scholar] [CrossRef]
  28. Pennisi, A.; Bloisi, D.; Nardi, D.; Giampetruzzi, A.R.; Mondino, C.; Facchiano, A. Skin lesion image segmentation using Delaunay Triangulation for melanoma detection. Comput. Med. Imaging Graph. 2016, 52, 89–103. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Yang, T.; Chen, Y.; Lu, J.; Fan, Z. Sampling with level set for pigmented skin lesion segmentation. Signal Image Video Process. 2019, 13, 813–821. [Google Scholar] [CrossRef]
  30. Khan, M.A.; Akram, T.; Sharif, M.; Shahzad, A.; Aurangzeb, K.; Alhussein, M.; Haider, S.; Altamrah, A. An implementation of normal distribution based segmentation and entropy controlled features selection for skin lesion detection and classification. BMC Cancer 2018, 18, 638. [Google Scholar] [CrossRef] [PubMed]
  31. Yuan, Y.; Chao, M.; Lo, Y. Automatic Skin Lesion Segmentation Using Deep Fully Convolutional Networks With Jaccard Distance. IEEE Trans. Med. Imaging 2017, 36, 1876–1886. [Google Scholar] [CrossRef] [PubMed]
  32. Baghersalimi, S.; Bozorgtabar, B.; Schmid-Saugeo, P.; Ekenel, H.K.; Thiran, J.P. DermoNet: Densely linked convolutional neural network for efficient skin lesion segmentation. Eurasip J. Image Video Process. 2019, 2019, 71. [Google Scholar] [CrossRef] [Green Version]
  33. Bi, L.; Kim, J.; Ahn, E.; Kumar, A.; Fulham, M.; Feng, D. Dermoscopic Image Segmentation via Multistage Fully Convolutional Networks. IEEE Trans. Biomed. Eng. 2017, 64, 2065–2074. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Bi, L.; Kim, J.; Ahn, E.; Kumar, A.; Feng, D.; Fulham, M. Step-wise integration of deep class-specific learning for dermoscopic image segmentation. Pattern Recognit. 2019, 85, 78–89. [Google Scholar] [CrossRef] [Green Version]
  35. Ünver, H.M.; Ayan, E. Skin Lesion Segmentation in Dermoscopic Images with Combination of YOLO and GrabCut Algorithm. Diagnostics 2019, 9, 72. [Google Scholar] [CrossRef] [Green Version]
  36. Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016. [Google Scholar] [CrossRef] [Green Version]
  37. Rother, C.; Kolmogorov, V.; Blake, A. Grabcut: Interactive foreground extraction using iterated graph cuts. In Proceedings of the SIGGRAPH04: Special Interest Group on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA, 8–12 August 2004; pp. 309–314. [Google Scholar] [CrossRef]
  38. Patino, D.; Avendano, J.; Branc, J.W. Automatic Skin Lesion Segmentation on Dermoscopic Images by the Means of Superpixel Merging. In Medical Image Computing and Computer Assisted Intervention—MICCAI 2018; Frangi, A., Schnabel, J., Davatzikos, C., Alberola-López, C., Fichtinger, G., Eds.; Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2018; Volume 11073. [Google Scholar] [CrossRef] [Green Version]
  39. Aljanabi, M.; Özok, Y.E.; Rahebi, J.; Abdullah, A.S. Skin Lesion Segmentation Method for Dermoscopy Images Using Artificial Bee Colony Algorithm. Symmetry 2018, 10, 347. [Google Scholar] [CrossRef] [Green Version]
  40. Golub, G.H.; Reinsch, C. Singular value decomposition and least squares solutions. Numer. Math. 1970, 14, 403–420. [Google Scholar] [CrossRef]
  41. Guaragnella, C.; Giorgio, A.; Rizzi, M. Marginal component analysis of ECG signals for beat-to-beat detection of ventricular late potentials. Electronics 2019, 8, 1000. [Google Scholar] [CrossRef] [Green Version]
  42. PH2 Database. Available online: https://www.fc.up.pt/addi/ph2%20database.html (accessed on 10 March 2020).
  43. Sachdeva, S. Fitzpatrick skin typing: Applications in dermatology. Indian J. Dermatol. Venereol. Leprol. 2009, 75, 93–96. [Google Scholar] [CrossRef]
  44. ISIC 2017: Skin Lesion Analysis Towards Melanoma Detection. Available online: https://challenge2017.isic-archive.com/ (accessed on 20 March 2020).
  45. ISIC 2018: Skin Lesion Analysis Towards Melanoma Detection. Available online: https://challenge2018.isic-archive.com/ (accessed on 20 March 2020).
  46. ISIC 2019: Skin Lesion Analysis Towards Melanoma Detection. Available online: https://challenge2019.isic-archive.com/ (accessed on 20 March 2020).
  47. Rizz, M.; D’Aloia, M.; Castagnolo, B. A supervised method for microcalcification cluster diagnosis. Integr. Comput. Aided Eng. 2013, 20, 157–167. [Google Scholar] [CrossRef]
  48. Gogtay, N.J.; Thatte, U.M. Statistical Evaluation of Diagnostic Tests (Part 1): Sensitivity, Specificity, Positive and Negative Predictive Values. J. Assoc. Physicians India 2017, 65, 80–84. [Google Scholar] [PubMed]
  49. Ahn, E.; Kim, J.; Bi, L.; Kumar, A.; Li, C.; Fulham, M.; Feng, D.D. Saliency-Based Lesion Segmentation Via Background Detection in Dermoscopic Images. IEEE J. Biomed. Health Inform. 2017, 21, 1685–1693. [Google Scholar] [CrossRef] [PubMed]
  50. Bi, L.; Kim, J.; Ahn, E.; Feng, D.; Fulham, M. Automated skin lesion segmentation via image-wise supervised learning and multi-scale superpixel based cellular automata. In Proceedings of the 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI 2016), Prague, Czech Republic, 13–16 April 2016; pp. 1059–1062. [Google Scholar] [CrossRef]
Figure 1. Singular values of a generic skin lesion image under test. The three curves refer to Red, Green, and Blue color component in the image.
Figure 1. Singular values of a generic skin lesion image under test. The three curves refer to Red, Green, and Blue color component in the image.
Applsci 10 03045 g001
Figure 2. The segmented regions obtained by binary orthogonalization of BPS. The last image is the original image of the skin lesion.
Figure 2. The segmented regions obtained by binary orthogonalization of BPS. The last image is the original image of the skin lesion.
Applsci 10 03045 g002
Figure 3. Image segmentation into color coherent areas by the proposed approach. The outer circular area is the selected ROI.
Figure 3. Image segmentation into color coherent areas by the proposed approach. The outer circular area is the selected ROI.
Applsci 10 03045 g003
Figure 4. The violin plots of TN, TP, FN, and FP statistics for melanoma, atypical, and normal skin lesions.
Figure 4. The violin plots of TN, TP, FN, and FP statistics for melanoma, atypical, and normal skin lesions.
Applsci 10 03045 g004
Figure 5. Original lesion with contours of the detected areas, segmented lesion adopting the implemented procedure, ground truth provided by the PH2 database.
Figure 5. Original lesion with contours of the detected areas, segmented lesion adopting the implemented procedure, ground truth provided by the PH2 database.
Applsci 10 03045 g005aApplsci 10 03045 g005b
Table 1. Performance comparison among some most recent segmentation procedures indicated in literature which adopted the PH2 database.
Table 1. Performance comparison among some most recent segmentation procedures indicated in literature which adopted the PH2 database.
PaperPerformance [%]
SeSpAcDIJA
Vesal S et al. ref. n. [19]95.292.596.494.689.9
Olugbara O.O. et al. ref. n. [21]95.86-98.4795.22-
Peng Y., et al. ref. n. [22]8797939085
Riaz F. et al. ref. n. [23]---86.54-
Pathana S. et al., ref. n. [25]87.695.393.4--
Pennisi A et al., ref. n. [28]80.2497.2289.66--
Khan MA et al. ref n. [30]96.6798.7497.5--
Baghersalimi S et al., ref. n. [32]---91.585.3
Bi L. et al. ref. n. [33]94.8993.9894.2490.6683.99
Bi L. et al. ref. n. [34]96.2394.5295.3092.1085.90
Ünver H.M et al. ref. n. [35]83.6394.0292.9988.1379.54
Patino D. et al. ref. n. [38]91.0489.7390.3989.18-
Aljanabi M. et al. ref. n. [39]95.5098.4096.0292.2485.25
Proposed method 93.6098.7795.3795.3291.05
Table 2. Performance comparison for melanoma (a) and no-melanoma (b) PH2 database images.
Table 2. Performance comparison for melanoma (a) and no-melanoma (b) PH2 database images.
a
PaperPerformance [%]
SeSpAcDIJA
Pennisi A et al. ref. n. [28]54.0495.9766.15--
Bi L. et al. ref. n. [33]91.8889.4288.7890.2583.35
Bi L. et al. ref. n. [34]92.7089.1990.0591.4485.33
Patino D. et al. ref n. [38]86.4568.7075.1977.79-
proposed method94.0694.4786.3884.9073.77
b
PaperPerformance [%]
SeSpAcDIJA
Pennisi A et al. ref. n. [28]86.7897.4693.74--
Bi L. et al. ref. n. [33]95.6495.1295.6190.7784.15
Bi L. et al. ref. n. [34]97.1195.8596.6192.2686.05
Patino D. et al. ref n. [38]92.1894.9894.1992.02-
Proposed method93.0198.7795.3795.3091.03

Share and Cite

MDPI and ACS Style

Rizzi, M.; Guaragnella, C. Skin Lesion Segmentation Using Image Bit-Plane Multilayer Approach. Appl. Sci. 2020, 10, 3045. https://doi.org/10.3390/app10093045

AMA Style

Rizzi M, Guaragnella C. Skin Lesion Segmentation Using Image Bit-Plane Multilayer Approach. Applied Sciences. 2020; 10(9):3045. https://doi.org/10.3390/app10093045

Chicago/Turabian Style

Rizzi, Maria, and Cataldo Guaragnella. 2020. "Skin Lesion Segmentation Using Image Bit-Plane Multilayer Approach" Applied Sciences 10, no. 9: 3045. https://doi.org/10.3390/app10093045

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop