Next Article in Journal
Using Direct Acyclic Graphs to Enhance Skeleton-Based Action Recognition with a Linear-Map Convolution Neural Network
Next Article in Special Issue
Non-Invasive Optical Coherence Tomography Data-Based Quantitative Algorithm for the Assessment of Residual Adhesive on Bracket-Removed Dental Surface
Previous Article in Journal
Localization of Immersed Sources by Modified Convolutional Neural Network: Application to a Deep-Sea Experiment
Previous Article in Special Issue
Do Radiographic Assessments of Periodontal Bone Loss Improve with Deep Learning Methods for Enhanced Image Resolution?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Communication

Panoramic Dental Radiography Image Enhancement Using Multiscale Mathematical Morphology

by
Julio César Mello Román
1,
Vicente R. Fretes
2,3,
Carlos G. Adorno
2,
Ricardo Gariba Silva
3,
José Luis Vázquez Noguera
1,*,
Horacio Legal-Ayala
1,
Jorge Daniel Mello-Román
4,
Ricardo Daniel Escobar Torres
4 and
Jacques Facon
5
1
Facultad Politécnica, Universidad Nacional de Asunción, San Lorenzo 111421, Paraguay
2
Facultad de Odontología, Universidad Nacional de Asunción, Asunción 001218, Paraguay
3
Departamento de Odontologia Restauradora, Faculdade de Odontologia de Ribeirão Preto, Universidade de São Paulo, Ribeirão Preto 14040-904, SP, Brazil
4
Facultad de Ciencias Exactas y Tecnológicas, Universidad Nacional de Conepción, Concepción 010123, Paraguay
5
Department of Computer and Electronics, Universidade Federal do Espírito Santo, São Mateus 29932-540, ES, Brazil
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(9), 3110; https://doi.org/10.3390/s21093110
Submission received: 18 February 2021 / Revised: 26 April 2021 / Accepted: 27 April 2021 / Published: 29 April 2021
(This article belongs to the Special Issue Sensing and Imaging Technology in Dentistry)

Abstract

:
Panoramic dental radiography is one of the most used images of the different dental specialties. This radiography provides information about the anatomical structures of the teeth. The correct evaluation of these radiographs is associated with a good quality of the image obtained. In this study, 598 patients were consecutively selected to undergo dental panoramic radiography at the Department of Radiology of the Faculty of Dentistry, Universidad Nacional de Asunción. Contrast enhancement techniques are used to enhance the visual quality of panoramic dental radiographs. Specifically, this article presents a new algorithm for contrast, detail and edge enhancement of panoramic dental radiographs. The proposed algorithm is called Multi-Scale Top-Hat transform powered by Geodesic Reconstruction for panoramic dental radiography enhancement (MSTHGR). This algorithm is based on multi-scale mathematical morphology techniques. The proposal extracts multiple features of brightness and darkness, through the reconstruction of the marker (obtained by the Top-Hat transformation by reconstruction) starting from the mask (obtained by the classic Top-Hat transformation). The maximum characteristics of brightness and darkness are added to the dental panoramic radiography. In this way, the contrast, details and edges of the panoramic radiographs of teeth are improved. For the tests, MSTHGR was compared with the following algorithms: Geodesic Reconstruction Multiscale Morphology Contrast Enhancement (GRMMCE), Histogram Equalization (HE), Brightness Preserving Bi-Histogram Equalization (BBHE), Dual Sub-Image Histogram Equalization (DSIHE), Minimum Mean Brightness Error Bi-Histogram Equalization (MMBEBHE), Quadri-Histogram Equalization with Limited Contrast (QHELC), Contrast-Limited Adaptive Histogram Equalization (CLAHE) and Gamma Correction (GC). Experimentally, the numerical results show that the MSTHGR obtained the best results with respect to the Contrast Improvement Ratio (CIR), Entropy (E) and Spatial Frequency (SF) metrics. This indicates that the algorithm performs better local enhancements on panoramic radiographs, improving their details and edges.

1. Introduction

Panoramic dental radiography is one of the most widely used medical imaging techniques, both by the general practitioner and in the various dental specialties [1,2,3]. A good quality of the image obtained is essential to its correct interpretation. This can be affected by various factors such as the device used, the acquisition technique and the subsequent processing of the acquired images [4,5]. One of the limitations of this type of images is that it is a two-dimensional representation of a three-dimensional object, so the different anatomical structures are superposed in the images obtained.
Contrast enhancement techniques not only help the dentist make a better assessment of the radiographs, but they are also used as a preprocessing of other more advanced automatic identification schemes based on deep learning [6]. Many contrasts, brightness, detail and edge enhancement algorithms have been proposed. Histogram-based algorithms are very popular for improving image contrast, brightness and detail. Among the most popular are Histogram Equalization (HE) and Contrast-Limited Adaptive Histogram Equalization (CLAHE) [7]. There are many variants of the histogram-based algorithms, and they have been used to make improvements in different types of images [5,8,9,10,11,12,13,14,15]. Ahmad et al. [16] compared contrast enhancement techniques based on histograms. These techniques help to improve the visual quality of the images. This allows specialists to better identify pathologies within the images. In addition, Rahmi-Fajrin et al. [12] studied how contrast enhancement results affect the dentist’s evaluation. A relatively new contrast enhancement technique is based on mathematical morphology. This uses top-hat operations to extract bright and dark features from the image. These features are finally added to the original image. In this way, the contrast of the images is enhanced [17,18]. In [19], a method for improving chest radiographs that use Top-Hat transformations to iteratively extract useful image features is presented. The selection of the optimal scale is made taking into account the measurement of the contrast enhancement ratio. Other algorithms based on multi-scale mathematical morphology have been proposed more recently to improve the performance of Top-Hat transformations [20,21,22]. These schemes proved to be effective at improving contrast, detail and edges of images, and they have been applied to different types of images satisfactorily [20,21,22,23,24,25,26,27]. In [27], an algorithm using the Top-Hat transformations by reconstruction at multiple scales is presented. This makes it possible to improve the contrast of medical images without distorting them. There are also techniques with hybrid approaches, which consist of the strategic combination of two or more image enhancement techniques [4,28,29,30]. In [29], a hybrid contrast enhancement scheme based on CLAHE and morphological operations is presented. With this approach, it is possible to enhance contrast and reduce noise in dental X-ray images.
This article presents a novel contrast and detail enhancement algorithm for panoramic dental radiography images. The proposed enhancement approach uses multi-scale mathematical morphology. First, in each iteration, the classic top-hat transform (mask) of the image and the top-hat transform by image reconstruction (marker) are calculated. Then, the marker is reconstructed starting from the mask. Here, only the most important bright and dark anatomical structures that may be present in panoramic dental radiographs are taken into account. Next, the extracted features are fused together by calculating the maxima between all the iterations of the bright and dark scales. Finally, the most important bright and dark areas are added to the original image.
Experimental results were evaluated using metrics that quantify global contrast, local contrast and detail and edge enhancement. Then, dental specialists performed an objective evaluation of the results obtained by the algorithms in a blind way.
The most important contributions of the work are:
1.
A novel algorithm for contrast, detail and edge enhancement of panoramic dental radiographs based on multi-scale mathematical morphology is proposed.
2.
Objective clinical evaluation of the results, obtained by the algorithms, was performed by specialists.
The organization of the article is as follows. Section 2 presents the set of panoramic radiographs and the proposed algorithm. Section 3 presents the experiments, discussions and clinical evaluation of the results. Finally, Section 4 presents the conclusions of the work.

2. Materials and Methods

This section presents the dataset on which the tests are performed and the proposed algorithm.

2.1. Dataset

In total, 598 patients (361 female and 237 male) were selected from consecutive patients undergoing dental panoramic radiography at the Department of Radiology of the Faculty of Dentistry, Universidad Nacional de Asunción. Of these images, 107 images have the following characteristics: complete dentition, without restorations and without radiographically detectable pathologies. Images of this type were then used to make a clinical validation of the results obtained by the different algorithms to be compared in Section 3.4. The mean age was 36.7 years. Written informed consent was obtained from each patient following the school’s protocol. The digital radiograph images were stored in jpeg format with a resolution set to 2041 × 1024 pixels. The radiographs were taken between March 2015 and February 2020 using a panoramic radiograph (I-Max touch, Owandy Radiology, France) with a tube voltage of 80 kV, tube current of 9 mA and an acquisition time of 14.4 s. The dataset is available online https://doi.org/10.5281/zenodo.4457648, accessed on 26 January 2021.
The dataset contains mixed and permanent dentition images, with all teeth and missing teeth, no restorations and with different types of restorations. Example panoramic radiographs contained in the database are shown in Figure 1.

2.2. Proposed Algorithm

The proposed algorithm, described in this section, is called Multi-Scale Top-Hat transform powered by Geodesic Reconstruction for panoramic dental radiography enhancement (MSTHGR). The proposed algorithm (MSTHGR) is a variation of the method described by Roman et al. [27]. The main variation is in Equations (14) and (15). These equations seek to highlight the differences between the light and dark areas of the image (contrast) without altering too much the naturalness of the image. The results show images with greater detail and sharper edges.
Let I be the original image and H a flat structuring element. The dilation δ H ( I ) and erosion ε H ( I ) are defined as follows [31]:
δ H ( I ) ( u , v ) = m a x ( x , y ) H ( I ( u x , v y ) ) ,
ε H ( I ) ( u , v ) = m i n ( x , y ) H ( I ( u + x , v + y ) ) ,
where ( u , v ) and ( x , y ) are the pixel coordinates of I and H, respectively. The opening and closing operations can be defined from the dilation and erosion operations.
Morphological opening [17] is obtained by dilating the image that is first eroded using the same structuring element. Morphological opening of I for a H structuring element is denoted by γ ( I , H ) and defined as:
γ ( I , H ) = δ H ˇ ( ε H ( I ) ) ,
where H ˇ is the reflection of H.
Morphological closing [17] is obtained by eroding the image that is first dilated using the same structuring element. Morphological closing of I for a H structuring element is denoted by ϕ ( I , H ) and defined as:
ϕ ( I , H ) = ε H ˇ ( δ H ( I ) ) .
If a structuring element is symmetrical, then it is equal to its reflection, i.e., H = H ˇ .
Top-hat transform by opening (WTH) [17] is obtained by subtracting from image I its morphological opening γ ( I , H ) , and it is defined as follows:
W T H ( I , H ) = I γ ( I , H ) .
Top-hat transform by closing (BTH) [17] is obtained by subtracting from the morphological closing ϕ ( I , H ) the image I, and it is defined as follows:
B T H ( I , H ) = ϕ ( I , H ) I .
In geodesic transformations, two input images are used. The first image is modified by a morphological transformation and restricted above or below the second image. The morphological transformations allowed are erosion and dilation [32].
Let g be the marker image and I be the mask image and both have the same domain ( D g = D I and g I ). The geodesic dilation of size 1 or δ I ( 1 ) ( g ) is defined as the minimum point to point between I and the dilation of g, i.e., δ I ( 1 ) ( g ) = min ( δ H ( g ) , I ) . If we perform m times the geodesic dilation of g with respect to I, we have to δ I ( m ) ( g ) = δ I ( 1 ) ( g ) [ δ I ( m 1 ) ( g ) ] . Geodesic dilation of g from I iterated to stability is called dilation by reconstruction [32] and is defined as:
R I δ ( g ) = δ I ( s ) ( g ) ,
where s is such that δ I ( s ) ( g ) = δ I ( s + 1 ) ( g ) .
Let g be the marker image and I be the mask image and both have the same domain ( D g = D I and g I ).
The geodesic erosion of size 1 or ε I ( 1 ) ( g ) is defined as the maximum point to point between I and the erosion of g, i.e., ε I ( 1 ) ( g ) = max ( ε H ( g ) , I ) . If we perform m times the geodesic erosion of g with respect to I we have to ε I ( m ) ( g ) = ε I ( 1 ) ( g ) [ ε I ( m 1 ) ( g ) ] .
Geodesic erosion of g from I iterated to stability is called erosion by reconstruction [32] and is defined as:
R I ε ( g ) = ε I ( s ) ( g ) ,
where s is such that ε I ( s ) ( g ) = ε I ( s + 1 ) ( g ) .
Opening by reconstruction [32] of an I image is defined as the reconstruction of I from the m size erosion of I:
γ R ( m ) ( I ) = R I δ ( ε H m ( I ) ) ,
where I is the mask image, ε H m ( I ) is the marker image and m is a scale factor of the structuring element. If H m is convex, then it is obtained as follows:
H m = H 1 H 1 H 1 dilation m 1 times ,
where ⊕ is the operator of binary dilation. Binary dilation is the sum (vector) of all possible pairs of coordinate points of the H 1 set. That is, let p and q be the spatial coordinates of H 1 , then H 1 H 1 = { ( p + q ) | for all p , q H 1 } .
Closing by reconstruction [32] of an I image is defined as the reconstruction of I from the m size dilation of I:
ϕ R ( m ) ( I ) = R I ε ( δ H m ( I ) ) ,
where I is the mask image and δ H m ( I ) is the marker image.
Structures removed by the opening by reconstruction can be recovered by the white top-hat transform by Reconstruction (RWTH) [32]:
R W T H ( I ) = I γ R ( I ) .
Similarly, structures removed by the closing by reconstruction can be recovered by the dark top-hat Transformation by Reconstruction (RBTH) [32]:
R B T H ( I ) = ϕ R ( I ) I .
The multiple features of the bright areas are obtained, which are extracted by R T H [33] as follows:
R T H i = R W T i δ ( R W i ) ,
where W T i = W T H i ( I , H i ) is the mask image obtained by Equation (5), H i = H 1 H 1 H 1 dilation i 1 times (⊕ is the operator of binary dilation) and 1 i n , R W i = R W T H i ( I ) = I γ R ( i ) ( I ) is the marker image obtained by Equation (12), R T H i are the i-scales of brightness that are extracted from the image and i = { 1 , 2 , 3 , . . . , n } .
Similarly, the multiple features of the dark areas of the image are extracted using R B H [33] as follows:
R B H i = R B T i δ ( R B i ) ,
where B T i = B T H i ( I , H i ) is the mask image obtained by Equation (6), R B i = R B T H i ( I ) = ϕ R ( i ) ( I ) I is the marker image obtained by Equation (13) and R B H i are the i scales of darkness extracted from the image.
The subtractions between the multiple scales of the bright regions of the image are obtained as follows [27]:
S W i 1 = R T H i R T H i 1 .
Similarly, the subtractions between the multiple scales of the dark regions of the image are obtained as follows [27]:
S B i 1 = R B H i R B H i 1 .
The maximum is obtained from all the multiple scales obtained in the different stages. The maximum bright and dark scales, extracted from the image, are calculated as follows:
S R T H = max 1 i n { R T H i } ,
S R B H = max 1 i n { R B H i } .
Figure 2 shows the bright and dark areas (maximum) extracted at the multiple scales. The pixels in Figure 2a,b were multiplied by a constant equal to 10, and then their complement was calculated. This is to better highlight the contour of the teeth. These operations were made for better visualization by the reader and they are not real operations applied to the algorithm.
All maximum bright and dark scales, extracted from the image by subtraction, are obtained as follows:
S S W = max 2 i n { S W i 1 } ,
S S B = max 2 i n { S B i 1 } .
Figure 3 shows the maximum of the differences in the bright and dark areas. The pixels in Figure 3a,b were multiplied by a constant equal to 10, and then their complement was calculated. This is to better highlight the contour of the teeth. These operations were made for better visualization by the reader and they are not real operations applied to the algorithm.
Finally, image enhancement is carried out as follows:
I E = I + ( S R T H + S S W ) ( S R B H + S S B ) ,
where I E is the panoramic dental radiography with contrast enhancement.
Figure 4 shows the final process of enhancing panoramic radiographs. The pixels in Figure 4a,b were multiplied by a constant equal to 10, and then their complement was calculated. This is to better highlight the contour of the teeth. These operations were made for better visualization by the reader and they are not real operations applied to the algorithm.

2.3. Edge Detection or Segmentation Application

Image enhancement algorithms are commonly used to adjust images, either for visual interpretation or as preprocessing for other algorithms such as edge detection or segmentation. The image features extracted by segmentation or edge detection algorithms are then used by classifiers to determine to which group the observed object belongs. An application that consists of first applying an edge detection (for example Sobel’s algorithm) to the panoramic radiograph and then a thresholding algorithm to decompose it into its most representative parts can be seen in Figure 5. The Sobel algorithm performed better edge detection in the enhanced image and its thresholding (algorithm based on maximum entropy [34]) shows more representative parts of the image, as can be seen in Figure 5d,f.
Another potential utility of enhanced panoramic radiographs could be their use in a learning environment, for example teaching and practicing interpretation of normal anatomical structures in panoramic radiographs.

3. Results and Discussion

This section presents the experimental results carried out to validate the proposed algorithm. To successfully validate the proposed algorithm, two objectives were set:
  • To quantify the performance of the proposed algorithm in terms of improving panoramic dental radiography. For this purpose, comparisons were made against other state-of-the-art algorithms and evaluation metrics were used to quantify the numerical results obtained by the algorithms.
  • Analyze clinically in an objective way how contrast enhancement algorithms affect panoramic radiographs. For this purpose, dentists performed a visual evaluation and objectively assess a sample of the results obtained.

3.1. Assessment Metrics

The results were evaluated with the following metrics:
  • Relative Enhancement in Contrast (REC) [35,36] quantifies the contrast of the enhanced panoramic radiography. The greater the REC is, the better contrast the dental image will have. REC is defined as,
    R E C = C ( I E ) C ( I ) ,
    where I is panoramic dental radiography, I E is dental imaging with contrast enhancement and C is image contrast. C is defined as,
    C ( I ) = 20 × log 1 M N u = 1 M v = 1 N ( I ( u , v ) ) 2 ( 1 M N u = 1 M v = 1 N I ( u , v ) ) 2 ,
    where M × N are the dimensions of the dental image and ( u , v ) are the spatial coordinates.
  • Contrast Improvement Ratio (CIR) [37] quantifies the local contrast of the enhanced medical image. The greater the CIR is, the better local contrast the medical image will have. CIR is defined as,
    C I R ( I , I E ) = ( u , v ) D | ω ( u , v ) ω ˜ ( u , v ) | 2 ( u , v ) D ω ( u , v ) 2 ,
    where ω is local contrast of original dental imaging, ω ˜ is local contrast of enhanced dental imaging and D is the domain of values. ω is defined as,
    ω ( u , v ) = | ρ ι | | ρ + ι | ,
    where ρ is center pixel and ι is the average of the neighboring values in a window of 3 × 3 .
  • Entropy (E) [11,24,36], in digital image processing, is used to quantify the details or features of the image. The greater is the E, the better is the detail. E is defined as,
    E ( I ) = k = 0 L 1 P ( k ) l o g 2 ( P ( k ) ) ,
    where k is intensity of the pixel in the image, P ( k ) is probability of occurrence of the k-value in the image, b is number of bits of the image and L is equal to 2 b and b = 8 for grayscale images.
  • Spatial Frequency (SF) [38], in digital image processing, is the metric that quantifies the spatial information contained in the image. If S F has a large value, the enhanced panoramic radiograph is considered to have more spatial information. S F is defined as follows:
    S F = R F 2 + C F 2 ,
    where
    R F = 1 M × N u = 1 M v = 1 N [ I ( u , v ) I ( u 1 , v ) ] 2 ,
    C F = 1 M × N u = 1 M v = 1 N [ I ( u , v ) I ( u , v 1 ) ] 2 .
  • Peak signal-to-noise ratio (PSNR) [22,27], in digital image processing, is the metric adopted to quantify the distortion introduced in the image enhancement process. If P S N R has a large value, the enhanced panoramic radiograph is considered to have less distortion. P S N R is defined as follows:
    P S N R ( I , I E ) = 10 × l o g 10 ( L 1 ) 2 M S E ( I , I E ) .
    The Mean Squared Error (MSE) is defined as:
    M S E ( I , I E ) = 1 M × N u = 0 M 1 v = 0 N 1 ( I ( u , v ) I E N ( u , v ) ) 2 .
  • Absolute Mean Brightness Error (AMBE) [22], in digital image processing, is the metric that quantifies the average brightness preservation of enhanced panoramic radiographs. If A M B E has a small value, the enhanced panoramic radiograph is considered to have preserved its average brightness. The A M B E is defined as follows:
    A M B E ( I , I E ) = | A ( I ) A ( I E ) | ,
    where A ( I ) is the average brightness of the panoramic radiographs and A ( I E ) is the average brightness of the panoramic radiographs with contrast enhancement.

3.2. Comparator Algorithms

MSTHGR was compared with the following algorithms: Geodesic Reconstruction Multiscale Morphology Contrast Enhancement (GRMMCE) [27], Histogram Equalization (HE), Brightness Preserving Bi-Histogram Equalization (BBHE) [8], Dual Sub-Image Histogram Equalization (DSIHE) [9], Minimun Mean Brightness Error Bi-Histogram Equalization (MMBEBHE) [10], Quadri-Histogram Equalization with Limited Contrast (QHELC) [13], Contrast-Limited Adaptive Histogram Equalization (CLAHE) [7] and Gamma Correction (GC) [39].
The MSTHGR, GRMMCE, HE, BBHE, DSIHE, MMBEBHE and QHELC algorithms were implemented using the ImageJ library [40]; for MSTHGR and GRMMCE, based on mathematical morphology, an extra library called MorphoLibJ [41] was used.
The MSTHGR and GRMMCE algorithms have the following parameters: original image I, number of iterations n = 7 and a disk shape structuring element with initial radius r = 1 , where the radius increases in each iteration in a range r = { 1 , 2 , 3 , , n } . Bai [42] used a small number of iterations, because the best details that can be extracted from the image are at small scales. Therefore, in this experiment, we used the number of iterations n = 7 .
The CLAHE and GC algorithms were implemented in MATLAB 2014b. The parameters used were the default ones.

3.3. Numerical and Visual Results

The algorithms were tested on the 598 panoramic radiographs. Table 1 shows the average numerical results obtained by the algorithms. The two best average results are highlighted in bold. The MSTHGR algorithm obtained high average results in the CIR, E and SF metrics. However, it is also competitive in the other metrics.
The proposed MSTHGR method is slightly better than GRMMCE (REC) in terms of contrast, but it is worse in terms of noise (PSNR) and Absolute Mean Brightness Error (AMBE). This is because the contrast enhancement is in trade-off relation to noise and average brightness. The better is the contrast values (REC), the worse are the PSNR and AMBE values. This can be seen in Figure 6. However, the improvement obtained by the MSTHGR method achieves better clinical assessments by dentists (this can be seen in Section 3.4).
Figure 6 shows the results of each metric in box plots. It can be observed that MSTHGR obtained less dispersed numerical values for the E and AMBE metrics. The values obtained by MSTHGR in the E, PSNR and SF metrics had a similar dispersion to the set of algorithms that integrate this study. It is also possible to observe that MSTHGR obtained values for the CIR metric with a similar dispersion to GC, but relatively higher than that obtained by the other algorithms.
The statistical analysis was carried out by means of non-parametric tests considering the amount of data in the database. Paired observations were made through the Wilcoxon Signed Rank Test [43], taking as pairs the results of each algorithm with respect to the proposed algorithm. The results of the Wilcoxon Signed Rank Test are presented in Table 2.
With respect to the evaluated database and at a statistical significance level of α = 0.01, the following can be observed:
  • For the REC metric, MSTHGR was numerically superior to the GRMMCE, QHELC and GC algorithms.
  • For the CIR metric, MSTHGR was numerically superior to the GRMMCE, HE, BBHE, DSIHE, MMBEBHE, QHELC and CLAHE algorithms.
  • For the E metric, MSTHGR was numerically superior to the GRMMCE, HE, BBHE, DSIHE, MMBEBHE, QHELC and GC algorithms.
  • For the SF metric, MSTHGR was numerically superior to all compared algorithms.
  • For the PSNR metric, MSTHGR was numerically superior to the HE, BBHE, DSIHE, MMBEBHE and CLAHE algorithms.
  • For the AMBE metric, MSTHGR was numerically superior to the HE, BBHE, DSIHE, MMBEBHE, CLAHE and GC algorithms.
The p-value close to zero (≈0) in the Wilcoxon signed-rank test for most of the paired observations leads to the conclusion that there are statistically significant differences between the medians obtained by the proposed MSTHGR algorithm and the other algorithms.
Figure 7 shows that the panoramic dental radiographs, enhanced with the MSTHGR algorithm, presented a greater definition at the edges of the teeth in general, as well as a better visualization of the different structures, such as enamel, dentin and pulp chamber, which compose them. In addition, they allowed a visualization of the restorations at the coronary level in the cases where they were present. At the root level, the light of the root canals could be observed with greater definition. At the level of the mandibular condyle, a better definition of the edges could be observed as well as a better observation of the bone trabeculae. In the regions of the maxillary sinuses and inferior dental canal, no great variations were found in comparison with the original images.

3.4. Clinical Validation and Prospects

The objective of the clinical validation is to quantify how the enhancement algorithms affect panoramic radiographs from the perspective of the dentists. In other words, the aim is to check whether the results obtained in the previous experiment are related to those observed by the dentists. For this purpose, 20 sample images were first taken from a total of 107 images with the following characteristics: complete dentition, without restorations and without radiographically detectable pathologies. This represents a sample with a 22% error rate and a 99% confidence rate. Next, these 20 images were processed with the MSTHGR, GRMMCE, HE, BBHE, DSIHE, MMBEBHE and QHELC algorithms and presented to a group of three dental specialists for qualitative evaluation. The algorithms were anonymized by a numerical code as follows: BBHE (1); DSIHE (2); HE (3); MMBEBHE (4); MSTHGR (5); GRMMCE (6); QHELC (7); CLAHE (8); and GC (9). The dentists performed an evaluation of the improved radiographs with respect to the original image. The observation was made in seven different anatomical regions: maxillary anterior teeth, maxillary posterior teeth, maxillary sinuses, mandibular anterior teeth, mandibular posterior teeth, mandibular condyles and mandibular canals. For each region, the scores were: 0 (worse than the original), 1 (no variation) and 2 (better than the original). Therefore, 9 algorithms × 20 images × 7 regions were analyzed, making a total of 1260 regions analyzed.

3.4.1. Statistical Analysis

The sum of scores obtained in the seven anatomical regions for each enhancement/algorithm was the dependent variable treated as numerical data. Interobserver agreement was determined by the intraclass correlation coefficient (ICC). The criteria for strength of agreement proposed by Koo and Lee [44] were used for ICC interpretation: 0.00–<0.50, poor agreement; 0.5–0.75, moderate agreement; >0.75–0.90, good agreement; and >0.90, excellent agreement. Normality (Shapiro–Wilk) and Homogeneity of Variance (Levene) tests were statistically significant (p < 0.05). Therefore, a Kruskal–Wallis test was run to determine if there were differences in median sum of scores according to enhancement/algorithm. Statistical analysis and graphical representation of data were performed with R version 3.6.0 at a 5% significance level.

3.4.2. Descriptive Statistics

Interobserver agreement was good (ICC = 0.835, 95% CI: 0.779–0.877). The Kruskall–Wallis test was statistically significant (p < 0.001 ). The results of the multiple comparisons using the Dunn test with Benjamini–Hochberg adjustment are shown in Table 3 (first column).
In the box and whisker plot (Figure 8), the medians are marked with a horizontal line in the box. The lower and upper limits of the box are the first (Q 1 ) and third (Q 3 ) quartiles, respectively. Values below Q 1 and over Q 3 are located in the whiskers. Outliers are represented by open dots.
In general, we can conclude that the algorithm MSTHGR improves the visual quality of the images with respect to the compared algorithms.

3.5. Usefulness for Diagnosis in Clinical Settings

The proposed algorithm allowed a clear observation of the teeth as well as the other anatomical regions analyzed in the selected images. Moreover, the different dental hard tissues (enamel–dentin junction), root canals and periodontal ligament were clearly visible.

4. Conclusions

Contrast and detail enhancement of panoramic radiographs helps dentists better evaluate the anatomical structures of the teeth present in the image. For this reason, an algorithm for contrast and detail improvement of panoramic dental radiographs is presented in this work. In addition, the help of dental specialists in the quantification of the results obtained by the algorithms is highlighted. They objectively evaluated the real impact of the improvements and how they affected the panoramic dental radiographs.
Experimentally, the numerical results show that the MSTHGR obtained the best results with respect to the CIR, E and SF metrics. This indicates that the proposal makes local improvements to the panoramic radiographs, enhancing their details and edges. With respect to the REC, PSNR and AMBE metrics, the proposal improves the global contrast of the radiographs, introduces less distortion to the image and preserves the average brightness. Even though its numerical results are inferior to some algorithms, the proposed method proved to be competitive.
The visual results obtained by the algorithms were clinically evaluated by specialist dentists. In general, according to the evaluations, the MSTHGR algorithm was better at enhancing the visual quality of panoramic dental radiographs.
As future work, quantitative evaluations of the improvements made to the images by areas of interest can be performed. In addition, this algorithm can be used as a preprocessing of other applications for automatic detection of pathologies affecting bone (cysts and tumors) or teeth (resorptions and caries).

Author Contributions

Conceptualization, J.C.M.R.; methodology, J.C.M.R.; software, J.C.M.R. and R.D.E.T.; validation, V.R.F., C.G.A., R.G.S., J.L.V.N. and J.F.; formal analysis, J.C.M.R., C.G.A. and J.D.M.-R.; investigation, J.C.M.R. and V.R.F.; resources, H.L.-A., C.G.A. and J.D.M.-R.; data curation, J.C.M.R., V.R.F. and R.D.E.T.; writing—original draft preparation, J.C.M.R., V.R.F. and C.G.A.; writing—review and editing, J.C.M.R., V.R.F., C.G.A., R.G.S., J.L.V.N., H.L.-A., J.D.M.-R. and J.F.; visualization, J.C.M.R., V.R.F. and C.G.A.; supervision, J.L.V.N.; project administration, J.L.V.N. and H.L.-A.; and funding acquisition, H.L.-A. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by CONACYT, Paraguay, grant number POSG17-53.

Institutional Review Board Statement

Ethical review and approval for this study were waived due to it being retrospective and the images were taken for reasons unrelated to this study. All procedures performed in studies involving human participants were under the 1964 Helsinki declaration.

Informed Consent Statement

Informed consent was obtained from all individual participants included in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Perschbacher, S. Interpretation of panoramic radiographs. Aust. Dent. J. 2012, 57, 40–45. [Google Scholar] [CrossRef] [PubMed]
  2. de Oliveira Capote, T.S.; de Almeida Gonçalves, M.; Gonçalves, A.; Gonçalves, M. Panoramic Radiography—Diagnosis of Relevant Structures That Might Compromise Oral and General Health of the Patient. In Emerging Trends in Oral Health Sciences and Dentistry; InTech: London, UK, 2015. [Google Scholar] [CrossRef] [Green Version]
  3. Resnik, R.R.; Misch, C.E. Radiographic Imaging in Implant Dentistry. In Dental Implant Prosthetics; Elsevier: Amsterdam, The Netherlands, 2015; pp. 126–158. [Google Scholar] [CrossRef]
  4. Nomir, O.; Abdel-Mottaleb, M. Dental X-Ray Radiographs Enhancement by Combining Morphological Operator and Retinex Theory. In Advances in Computer Science and Engineering; ACTA Press: Calgary, AB, Canada, 2010. [Google Scholar] [CrossRef]
  5. Jain, K.R.; Chauhan, N.C. Enhancement and Segmentation of Dental Radiographs Using Morphological Operations. In Dental Image Analysis for Disease Diagnosis; Springer International Publishing: Berlin/Heidelberg, Germany, 2019; pp. 39–58. [Google Scholar] [CrossRef]
  6. Singh, P.; Sehgal, P. Numbering and Classification of Panoramic Dental Images Using 6-Layer Convolutional Neural Network. Pattern Recognit. Image Anal. 2020, 30, 125–133. [Google Scholar] [CrossRef]
  7. Zuiderveld, K. Contrast Limited Adaptive Histogram Equalization. In Graphic Gems IV; Elsevier: Amsterdam, The Netherlands, 1994; pp. 474–485. [Google Scholar] [CrossRef]
  8. Kim, Y.T. Contrast enhancement using brightness preserving bi-histogram equalization. IEEE Trans. Consum. Electron. 1997, 43, 1–8. [Google Scholar] [CrossRef]
  9. Wang, Y.; Chen, Q.; Zhang, B. Image enhancement based on equal area dualistic sub-image histogram equalization method. IEEE Trans. Consum. Electron. 1999, 45, 68–75. [Google Scholar] [CrossRef]
  10. Chen, S.D.; Ramli, A. Minimum mean brightness error bi-histogram equalization in contrast enhancement. IEEE Trans. Consum. Electron. 2003, 49, 1310–1319. [Google Scholar] [CrossRef]
  11. Khan, M.F.; Khan, E.; Abbasi, Z. Segment dependent dynamic multi-histogram equalization for image contrast enhancement. Digit. Signal Process. 2014, 25, 198–223. [Google Scholar] [CrossRef]
  12. Rahmi-Fajrin, H.; Puspita, S.; Riyadi, S.; Sofiani, E. Dental radiography image enhancement for treatment evaluation through digital image processing. J. Clin. Exp. Dent. 2018. [Google Scholar] [CrossRef]
  13. Pineda, I.A.B.; Caballero, R.D.M.; Silva, J.J.C.; Román, J.C.M.; Noguera, J.L.V. Quadri-histogram equalization using cutoff limits based on the size of each histogram with preservation of average brightness. Signal Image Video Process. 2019, 13, 843–851. [Google Scholar] [CrossRef]
  14. Vijayalakshmi, D.; Nath, M.K.; Acharya, O.P. A Comprehensive Survey on Image Contrast Enhancement Techniques in Spatial Domain. Sens. Imaging 2020, 21. [Google Scholar] [CrossRef]
  15. Vijayalakshmi, D.; Nath, M.K. A Compendious Analysis of Advances in HE Methods for Contrast Enhancement. In Lecture Notes in Electrical Engineering; Springer: Singapore, 2020; pp. 325–346. [Google Scholar] [CrossRef]
  16. Ahmad, S.A.; Taib, M.N.; Khalid, N.E.A.; Taib, H. An Analysis of Image Enhancement Techniques for Dental X-ray Image Interpretation. Int. J. Mach. Learn. Comput. 2012, 292–297. [Google Scholar] [CrossRef] [Green Version]
  17. Soille, P. Opening and Closing. In Morphological Image Analysis; Springer: Berlin/Heidelberg, Germany, 2004; pp. 105–137. [Google Scholar] [CrossRef]
  18. Gonzalez, R.; Woods, R. Digital Image Processing, 2nd ed.; Prentice Hall: Hoboken, NJ, USA, 2002; Volume 793. [Google Scholar]
  19. Hassanpour, H.; Samadiani, N.; Salehi, S.M. Using morphological transforms to enhance the contrast of medical images. Egypt. J. Radiol. Nucl. Med. 2015, 46, 481–489. [Google Scholar] [CrossRef]
  20. Mukhopadhyay, S.; Chanda, B. A multiscale morphological approach to local contrast enhancement. Signal Process. 2000, 80, 685–696. [Google Scholar] [CrossRef] [Green Version]
  21. Bai, X.; Zhou, F.; Xue, B. Image enhancement using multi scale image features extracted by top-hat transform. Opt. Laser Technol. 2012, 44, 328–336. [Google Scholar] [CrossRef]
  22. Román, J.C.M.; Noguera, J.L.V.; Legal-Ayala, H.; Pinto-Roa, D.; Gomez-Guerrero, S.; García-Torres, M. Entropy and Contrast Enhancement of Infrared Thermal Images Using the Multiscale Top-Hat Transform. Entropy 2019, 21, 244. [Google Scholar] [CrossRef] [Green Version]
  23. Bai, X. Image enhancement through contrast enlargement using the image regions extracted by multiscale top-hat by reconstruction. Optik 2013, 124, 4421–4424. [Google Scholar] [CrossRef]
  24. Wang, G.; Wang, J.; Li, M.; Zheng, Y.; Wang, K. Hand Vein Image Enhancement Based on Multi-Scale Top-Hat Transform. Cybern. Inf. Technol. 2016, 16, 125–134. [Google Scholar] [CrossRef] [Green Version]
  25. Pillai, A.; Rajkumar, S.; Marimuthu, K.; Rajasekaran, G. Adaptive new top-hat transform and multi-scale sequential toggle operator based infrared image enhancement. In Proceedings of the 2017 Innovations in Power and Advanced Computing Technologies (i-PACT), Vellore, India, 21–22 April 2017. [Google Scholar] [CrossRef]
  26. Arya, A.; Bhateja, V.; Nigam, M.; Bhadauria, A.S. Enhancement of Brain MR-T1/T2 Images Using Mathematical Morphology. In Information and Communication Technology for Sustainable Development; Springer: Singapore, 2019; pp. 833–840. [Google Scholar] [CrossRef]
  27. Román, J.C.M.; Escobar, R.; Martínez, F.; Noguera, J.L.V.; Legal-Ayala, H.; Pinto-Roa, D.P. Medical Image Enhancement with Brightness and Detail Preserving Using Multiscale Top-hat Transform by Reconstruction. Electron. Notes Theor. Comput. Sci. 2020, 349, 69–80. [Google Scholar] [CrossRef]
  28. Liao, M.; qian Zhao, Y.; hong Wang, X.; shan Dai, P. Retinal vessel enhancement based on multi-scale top-hat transformation and histogram fitting stretching. Opt. Laser Technol. 2014, 58, 56–62. [Google Scholar] [CrossRef]
  29. Georgieva, V.M.; Mihaylova, A.D.; Petrov, P.P. An application of dental X-ray image enhancement. In Proceedings of the 2017 13th International Conference on Advanced Technologies, Systems and Services in Telecommunications (TELSIKS), Nis, Serbia, 18–20 October 2017. [Google Scholar] [CrossRef]
  30. Li, D.; Zhang, L.; Sun, C.; Yin, T.; Liu, C.; Yang, J. Robust Retinal Image Enhancement via Dual-Tree Complex Wavelet Transform and Morphology-Based Method. IEEE Access 2019, 7, 47303–47316. [Google Scholar] [CrossRef]
  31. Soille, P. Erosion and Dilation. In Morphological Image Analysis; Springer: Berlin/Heidelberg, Germany, 2004; pp. 63–103. [Google Scholar] [CrossRef]
  32. Soille, P. Geodesic Transformations. In Morphological Image Analysis; Springer: Berlin/Heidelberg, Germany, 2004; pp. 183–218. [Google Scholar] [CrossRef]
  33. Jochems, T. Morphologie Mathématique Appliquée au Contrôle Industriel de Pièces Coulées. Ph.D. Thesis, ENMP, Paris, France, 1994. [Google Scholar]
  34. Sahoo, P.; Soltani, S.; Wong, A. A survey of thresholding techniques. Comput. Vis. Graph. Image Process. 1988, 41, 233–260. [Google Scholar] [CrossRef]
  35. Joseph, J.; Periyasamy, R. A fully customized enhancement scheme for controlling brightness error and contrast in magnetic resonance images. Biomed. Signal Process. Control 2018, 39, 271–283. [Google Scholar] [CrossRef]
  36. Zhao, C.; Wang, Z.; Li, H.; Wu, X.; Qiao, S.; Sun, J. A new approach for medical image enhancement based on luminance-level modulation and gradient modulation. Biomed. Signal Process. Control 2019, 48, 189–196. [Google Scholar] [CrossRef]
  37. Wang, Y.P.; Wu, Q.; Castleman, K.; Xiong, Z. Chromosome image enhancement using multiscale differential operators. IEEE Trans. Med. Imaging 2003, 22, 685–693. [Google Scholar] [CrossRef]
  38. Shapley, R.; Lennie, P. Spatial Frequency Analysis in the Visual System. Annu. Rev. Neurosci. 1985, 8, 547–581. [Google Scholar] [CrossRef]
  39. Gonzalez, R.C.; Woods, R.E.; Masters, B.R. Digital Image Processing, Third Edition. J. Biomed. Opt. 2009, 14, 029901. [Google Scholar] [CrossRef]
  40. Schneider, C.A.; Rasband, W.S.; Eliceiri, K.W. NIH Image to ImageJ: 25 years of image analysis. Nat. Methods 2012, 9, 671–675. [Google Scholar] [CrossRef]
  41. Legland, D.; Arganda-Carreras, I.; Andrey, P. MorphoLibJ: Integrated library and plugins for mathematical morphology with ImageJ. Bioinformatics 2016. [Google Scholar] [CrossRef] [Green Version]
  42. Bai, X. Morphological feature extraction for detail maintained image enhancement by using two types of alternating filters and threshold constrained strategy. Optik 2015, 126, 5038–5043. [Google Scholar] [CrossRef]
  43. Wilcoxon, F. Breakthroughs in Statistics. Individ. Comp. Rank. Methods 1992, 196–202. [Google Scholar] [CrossRef]
  44. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Example panoramic radiographs: (a) mixed dentition; (b) partially edentulous permanent dentition; and (c) complete permanent dentition.
Figure 1. Example panoramic radiographs: (a) mixed dentition; (b) partially edentulous permanent dentition; and (c) complete permanent dentition.
Sensors 21 03110 g001
Figure 2. Bright and dark areas (maximum).
Figure 2. Bright and dark areas (maximum).
Sensors 21 03110 g002
Figure 3. Differences in the bright and dark areas (maximum).
Figure 3. Differences in the bright and dark areas (maximum).
Sensors 21 03110 g003
Figure 4. Enhancement of panoramic radiograph 34.jpg.
Figure 4. Enhancement of panoramic radiograph 34.jpg.
Sensors 21 03110 g004
Figure 5. Application of an edge detection algorithm on an image preprocessed with MSTHGR.
Figure 5. Application of an edge detection algorithm on an image preprocessed with MSTHGR.
Sensors 21 03110 g005
Figure 6. Box plots of the results obtained by the algorithms.
Figure 6. Box plots of the results obtained by the algorithms.
Sensors 21 03110 g006
Figure 7. Visual results.
Figure 7. Visual results.
Sensors 21 03110 g007aSensors 21 03110 g007bSensors 21 03110 g007c
Figure 8. Box and whiskers diagram. Distribution of the sum of scores according to the enhancement algorithm used.
Figure 8. Box and whiskers diagram. Distribution of the sum of scores according to the enhancement algorithm used.
Sensors 21 03110 g008
Table 1. Average results obtained by the algorithms.
Table 1. Average results obtained by the algorithms.
AlgorithmsRECCIRESFPSNRAMBE
I--7.20917.681--
MSTHGR1.0070.7737.46220.01931.2420.548
GRMMCE1.0030.2457.36919.05135.7000.103
HE1.0690.2206.98917.80214.43742.027
BBHE1.0740.1976.94318.31418.14719.601
DSIHE1.0750.1976.94218.32717.80120.741
MMBEBHE1.0190.1946.97517.58827.7873.081
QHELC1.0040.0297.16917.74544.5360.529
CLAHE1.0420.3357.82018.59016.85722.288
GC1.0101.1517.45817.70538.6901.508
Table 2. The Wilcoxon Signed Rank Test for paired observations.
Table 2. The Wilcoxon Signed Rank Test for paired observations.
AlgorithmsMetrics
RECCIRESFPSNRAMBE
MSTHGR—GRMMCENegative ranks00405984
Positive ranks5985985945980594
Z−21.187−21.187−21.184−24.413−24.413−24.086
Sig. asymptotic (bilateral)≈0≈0≈0≈0≈0≈0
MSTHGR—HENegative ranks59520000598
Positive ranks35785985985980
Z−21.171−20.85−21.187−24.413−24.413−24.413
Sig. asymptotic (bilateral)≈0≈0≈0≈0≈0≈0
MSTHGR—BBHENegative ranks59520010597
Positive ranks35785985975981
Z−21.171−20.924−21.187−24.331−24.413−24.331
Sig. asymptotic (bilateral)≈0≈0≈0≈0≈0≈0
MSTHGR—DSIHENegative ranks59520010598
Positive ranks35785985975980
Z−21.178−20.935−21.187−24.331−24.413−24.413
Sig. asymptotic (bilateral)≈0≈0≈0≈0≈0≈0
MSTHGR—MMBEBHENegative ranks499210032595
Positive ranks995775985985663
Z−17.355−20.922−21.187−24.413−21.796−24.168
Sig. asymptotic (bilateral)≈0≈0≈0≈0≈0≈0
MSTHGR—QHELCNegative ranks351100598268
Positive ranks5635875985980330
Z−19.734−21.159−21.187−24.413−24.413−2.494
Sig. asymptotic (bilateral)≈0≈0≈0≈0≈00.013
MSTHGR—CLAHENegative ranks5892659800596
Positive ranks957205985982
Z−23.677−22.287−24.413−24.413−24.413−24.250
Sig. asymptotic (bilateral)≈0≈0≈0≈0≈0≈0
MSTHGR—GCNegative ranks4165661674580408
Positive ranks1823243159418190
Z−9.528−21.796−10.755−24.086−22.941−8.874
Sig. asymptotic (bilateral)≈0≈0≈0≈0≈0≈0
Table 3. Descriptive statistics of the sum of scores according to the enhancement algorithm applied.
Table 3. Descriptive statistics of the sum of scores according to the enhancement algorithm applied.
AlgorithmSampleAverageStandard DeviationMinimum Q 1 Median Q 3 Maximum
BBHE a 203.601.789123.54.507
DSIHE a 203.851.843124.06.007
HE a 204.251.713134.06.007
MMBEBHE a 203.002.200112.04.257
MSTHGR c 2010.002.0776910.012.0014
GRMMCE b 206.800.616577.07.007
QHELC b 206.900.308677.07.007
CLAHE b 207.000.000777.07.007
GC b c 207.550.826678.08.009
Note: Different superscript letters in the first column indicate statistically significant differences (p < 0.05 ) according to Dunn test with Benjamini–Hochberg adjustment.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Román, J.C.M.; Fretes, V.R.; Adorno, C.G.; Silva, R.G.; Noguera, J.L.V.; Legal-Ayala, H.; Mello-Román, J.D.; Torres, R.D.E.; Facon, J. Panoramic Dental Radiography Image Enhancement Using Multiscale Mathematical Morphology. Sensors 2021, 21, 3110. https://doi.org/10.3390/s21093110

AMA Style

Román JCM, Fretes VR, Adorno CG, Silva RG, Noguera JLV, Legal-Ayala H, Mello-Román JD, Torres RDE, Facon J. Panoramic Dental Radiography Image Enhancement Using Multiscale Mathematical Morphology. Sensors. 2021; 21(9):3110. https://doi.org/10.3390/s21093110

Chicago/Turabian Style

Román, Julio César Mello, Vicente R. Fretes, Carlos G. Adorno, Ricardo Gariba Silva, José Luis Vázquez Noguera, Horacio Legal-Ayala, Jorge Daniel Mello-Román, Ricardo Daniel Escobar Torres, and Jacques Facon. 2021. "Panoramic Dental Radiography Image Enhancement Using Multiscale Mathematical Morphology" Sensors 21, no. 9: 3110. https://doi.org/10.3390/s21093110

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop