Next Article in Journal
Upgrading of Biobased Glycerol to Glycerol Carbonate as a Tool to Reduce the CO2 Emissions of the Biodiesel Fuel Life Cycle
Next Article in Special Issue
Artificial Hummingbird Algorithm with Transfer-Learning-Based Mitotic Nuclei Classification on Histopathologic Breast Cancer Images
Previous Article in Journal
Anti-Tumor Secondary Metabolites Originating from Fungi in the South China Sea’s Mangrove Ecosystem
Previous Article in Special Issue
Accurate Image Reconstruction in Dual-Energy CT with Limited-Angular-Range Data Using a Two-Step Method
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A High-Accuracy Detection System: Based on Transfer Learning for Apical Lesions on Periapical Radiograph

1
Department of General Dentistry, Chang Gung Memorial Hospital, Taoyuan City 33305, Taiwan
2
Department of Electronic Engineering, Chung Yuan Christian University, Taoyuan City 32023, Taiwan
3
School of Physical Educational College, Jiaying University, Meizhou City 514000, China
4
Department of Electrical Engineering and Computer Science, Chung Yuan Christian University, Chungli City 32023, Taiwan
5
Department of Electrical Engineering, Ming Chi University of Technology, New Taipei City 243303, Taiwan
6
Department of Information Systems and Computer Science, Ateneo de Manila University, Quezon City 1108, Philippines
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Bioengineering 2022, 9(12), 777; https://doi.org/10.3390/bioengineering9120777
Submission received: 3 October 2022 / Revised: 23 November 2022 / Accepted: 23 November 2022 / Published: 6 December 2022
(This article belongs to the Special Issue Artificial Intelligence in Medical Image Processing and Segmentation)

Abstract

:
Apical Lesions, one of the most common oral diseases, can be effectively detected in daily dental examinations by a periapical radiograph (PA). In the current popular endodontic treatment, most dentists spend a lot of time manually marking the lesion area. In order to reduce the burden on dentists, this paper proposes a convolutional neural network (CNN)-based regional analysis model for spical lesions for periapical radiographs. In this study, the database was provided by dentists with more than three years of practical experience, meeting the criteria for clinical practical application. The contributions of this work are (1) an advanced adaptive threshold preprocessing technique for image segmentation, which can achieve an accuracy rate of more than 96%; (2) a better and more intuitive apical lesions symptom enhancement technique; and (3) a model for apical lesions detection with an accuracy as high as 96.21%. Compared with existing state-of-the-art technology, the proposed model has improved the accuracy by more than 5%. The proposed model has successfully improved the automatic diagnosis of apical lesions. With the help of automation, dentists can focus more on technical and medical diagnoses, such as treatment, tooth cleaning, or medical communication. This proposal has been certified by the Institutional Review Board (IRB) with the certification number 202002030B0.

Graphical Abstract

1. Introduction

X-rays have been used in medical images since 1896, and they also help doctors determine whether a patient is healthy. X-rays are widely used in dental treatments [1], such as periapical radiographs (PA), bitewing radiographs (BW), and panoramic radiographs (PANO). The PA film is important in routine dental X-ray examinations because it requires lower radiation dose exposure and could identify periapical pathology efficiently. Periapical radiographs are commonly the result of trauma, caries, or tooth wear. These conditions will bring out root canal infection if the dental treatment has no intervention, and pulp necrosis may occur [2,3]. Numerous studies have confirmed that this oral problem requires prompt and thorough treatment. Otherwise, it may lead to tooth loss and repeated inflammation [4,5,6]. Detection of the peri-apical lesion and opportune endodontic procedure intervention can treat root canal infection caused by these problems. The PA film can capture local teeth, which can effectively and quickly enable dental professionals to find local details of tooth lesions [7,8] and undertake the treatment [9]. Despite advances in treatment and access to extensive care, the prevalence of apical lesions remains high [10]. Dentists use PA to find diseased areas, but it is very time-consuming to find lesions that do not contrast well with normal areas. In addition, the dentist may become tired after long working hours, thereby ignoring subtle differences. In a day, a dentist must review hundreds of X-rays of a patient and diagnose and document the patient. However, the current method for detecting periapical noise still needs to be judged by the dentist. Dentists may inevitably make mistakes as the length and number of consultations increase.
With the continuous advancement of technology, artificial intelligence has shined in many industries, such as vehicle image recognition [11], smart city [12], product recommendation systems [13], and emotion recognition [14]. The development of medical imaging is also changing with each passing day. More and more cases have shown that the combination of artificial intelligence and medical imaging has good results, such as breast cancer (BC) [15], arrhythmia [16], and lung function prediction [17]. There are also related studies in dentistry, for example, adding machine learning to the color recognition of dentures [18] or adding deep learning to the detection of tooth decay [19]. Artificial intelligence was used to improve the apical lesion detection accuracy rate of the dental Panoramic Radiograph Identification System to about 75.53% in [20], while the accuracy rate of CT image identification is about 82% [21]. For clinical use, there is still a lot of room for improvement. Therefore, in order to reduce the workload of dentists and provide more objective data, this study proposes an automatic detection system for periapical radiographs using CNN transfer learning. The purpose is to improve the symptom enhancement technology in the existing technology and to analyze and compare the final research results. In [22], a system combining PA and CNN was proposed. The authors improved the classification accuracy of batch normalization by adjusting the parameters such as the layers of convolutional blocks in the CNN. The accuracy rate obtained was as high as 92.75%. This article will use this as the main reference. However, its image enhancement improvements are not outstanding. Therefore, in this proposal, the focus is on improving image segmentation and image enhancement. In order to increase the reference value of the data obtained from the Alexnet classification model, three different CNN models are constructed, namely Googlenet, Resnet50, and Resnet101 which are trained, tested, and verified through the same database. During this period, the parameters of each model were kept consistent by the control variable method which was convenient for subsequent comparison. The research in this paper also utilizes CNN technology for dentists to diagnose symptoms and ultimately provide patients with more effective and better adjuvant treatment. The innovations of this method are as follows:
  • In the image cropping preprocessing part, this study adds the adaptive threshold and angle rotation technology. Compared with the existing methods, this method significantly improves the image clarity and accuracy of a single tooth image.
  • This study proposes an advanced image enhancement technique for apical lesions. It adds raw grayscale images and Gaussian high-pass filtered images to highlight the possible lesion areas and changes the color of the possible lesion area to green. Experiments show that the accuracy of the model is improved by more than 10% which proves that the proposed method is intuitive and effective.
  • The innovation of this work is to realize the classification of various diseases. It can simultaneously judge a variety of different types of dental diseases (such as apical lesions, fillings, etc.), and the obtained final accuracy of the model proposed in this paper is as high as 93%. AlexNet even improves the accuracy up to 96.21% which is 4% higher than the state-of-the-art in [23].
The presentation structure of this proposal is as follows: Section 2 introduces the materials and methods for apical lesion detection on periapical radiographs based on transfer learning. Section 3 mainly describes and analyzes the evaluation method of the model and the experimental results. The results of the study are discussed in Section 4. Finally, the conclusions and future prospects are given in Section 5. The purpose of this paper is to predict root apical lesions located at the base of a tooth by means of a convolutional neural network (CNN).

2. Materials and Methods

This study is divided into three parts: image cropping, image preprocessing and CNN training. The image cropping part extracts a single tooth which helps model training more efficiently. In addition, through a series of image preprocessing techniques, possible lesion areas can be highlighted, resulting in more accurate detection. The output of these image preprocessing steps is saved in the CNN database. The clinical images used in this research were collected by attending physicians with more than three years of experience in hospital dentistry. All clinical images utilized in this research had been approved by the Institutional Review Board Statement (permission number 202002030B0). For enhancement, the most challenging problem is that after image segmentation, there is too much noise in the original apical slice and the resected part of the lesion area. Therefore, the angle of cutting or image noise reduction became the challenge of this project. This proposal uses the same Gaussian high-pass filter as that of [23] to achieve the best noise reduction result. The flow chart of this study is shown in Figure 1.

2.1. Image Segmentation and Retouching

In order to build a high-precision model and conform to the judgment of dentists, this research uses a single tooth image to build a clinical image database. However, since the original image is a PA composed of about three to four separate vertical teeth, segmentation of individual teeth must be performed on the original image. In [24], the vertical cutting method of dividing the image is a very good idea. However, its target image is a BW film; there would be some flaws in the process of cutting the PA film. Therefore, the segmentation method that this proposal focuses on is improved on the basis of [24] to make the segmentation more accurate. The next step is to retouch the segmented photo by adding a technique to block non-target areas on the segmented image.

2.1.1. Vertical Cutting

The core concept of vertical cutting is to calculate the sum of the horizontal pixels of the image and find the point with the smallest sum making that point the segmentation point. Before performing the calculation, the image is first converted from an RGB image to a grayscale image for easier calculation. In this research, the method of iterative thresholding in [23] is improved and adaptive thresholding is used for transformation. The feature of adaptive threshold processing is that each image behaves differently from RGB to grayscale which means that each image has its own most suitable adaptive threshold. In this proposal, the most appropriate adaptive threshold is selected for each image and image transformation is performed. Figure 2 is the image result applying the conversion method using [23], and Figure 2b is the image result of the improved adaptive threshold. From a data point of view, this method can effectively improve the accuracy of image segmentation.
This proposal summarizes the range of the sum of pixels where the appropriate threshold is located by calculating the sum of the pixels of each grayscale image. However, the calculation cannot be performed immediately after converting the image because not every interdental gap is vertical. Therefore, rotating the image is a necessary step before calculation. Additionally, image rotation is performed by rotating the image 12 degrees clockwise and 12 degrees counterclockwise [24]. After rotating the image, the 24 positions and value of the minimum pixel sum for each angle can be computed. The 24 values are then compared with the smallest value being the most suitable position and angle for segmentation. Since the number of PA image teeth in the database is at most four teeth, a maximum of four cutting lines are required. This means that the above steps need to be repeated four times. However, the number of teeth in the PA images is not always four and some images have only three. In this case, the redundant dividing line needs to be removed. Therefore, this study designed two methods to address this problem. The first method is based on the relative position of the fourth cutting line to the other cutting lines. Assuming that the distance between the fourth cutting line and the other cutting lines is less than the width of one tooth, the fourth cutting line should be removed. The second method is that if the value of the fourth row is greater than the average, it means that the fourth row is very likely not on the tooth. Thus, the fourth row can be removed by this feature. Figure 3a shows the result of finding all the dividing lines. Figure 3b is the result of removing the redundant dividing lines. When the cutting line is inclined, the image segmented by the cutting line is not rectangular. However, for the subsequent training of CNN when normalized, the target in this step is a rectangular one. Therefore, this proposal adds a green vertical line to the far right and a blue vertical line to the far left of each cutting line. Moreover, it segments the first segmented image with the leftmost position of the original image and the first green vertical line as the boundary. The second segmented image is bounded by the first blue vertical line and the second green vertical line. The third and fourth cut images are similarly divided.

2.1.2. Image Masks

The inclination of the cutting line is designed to match the inclination of the teeth. However, most of the cutting lines have oblique angles which means that most segmented images will contain a small fraction of adjacent teeth as shown in Figure 4a. This leads to disturbances in the accuracy of the CNN model. In view of this, this study retouches the segmented images according to the cutting line (red line in Figure 3). It sets the mask template according to the clipping line and the mask template will be superimposed with the original clipping image. This can effectively mask the non-target area as shown in Figure 4b. The modified image will be the final output and result. The retouched image will optimally preserve the desired feature areas.

2.2. Enhancing Lesion

In the collected original images, the root apical lesions will be affected by factors such as shooting angle, dose, and operator, thus, the lesions are sometimes inconspicuous. In this regard, this research proposes an advanced and intuitive enhancement method that can highlight the lesions. The first work is converting the RGB image to a grayscale image using a conversion formula. It then uses the Gaussian high-pass filter to filter out the noise. In order to make the lesion more obvious, the result of the Gaussian high-pass filter is used to superimpose it back to a grayscale image. Finally, the simple enhancement technique is used to change the color of the possible lesion area to green. In this way, clinical images for efficient training of CNN models can be obtained.

2.2.1. Grayscale Image

The original apical section is an RGB image. However, this is not very friendly to the subsequent image processing step. To make image processing easier and accelerate the subsequent CNN training, the first step in lesion enhancement is to convert the image from an RGB three-channel image to a grayscale single-channel image. This step generates all the points needed for the subsequent steps described by the x- and y-axes of the grayscale image and at the same time achieves a more efficient process.

2.2.2. Gaussian High Pass Filter

The biggest challenge in judging symptoms is the noisy points in the image. Therefore, attribute filters that reduce these noisy points are crucial. In the existing technology, there are many different filters. How to choose the most suitable filter is the key. Gaussian filters are used in two different ways. The Gaussian low-pass filter on the other hand is used to reduce certain noise points while the Gaussian high-pass filter is used to enhance dark areas. For the purpose of preprocessing to make possible apical lesions as evident as possible, the Gaussian high-pass filter is clearly the most suitable filter. This filter is able to pass high-frequency pixels and block low-frequency terms. Marginal and possibly apical lesion areas belong to high frequencies in the frequency domain. Hence, these pixels will remain in the resulting image as shown in Figure 5. The Gaussian high-pass filter [25] can be represented by Equation (1).
Figure 5. The results of the Gaussian high-pass filter. (a) original apical lesion image, (b) image after Gaussian filtering.
Figure 5. The results of the Gaussian high-pass filter. (a) original apical lesion image, (b) image after Gaussian filtering.
Bioengineering 09 00777 g005
H u ,   v = 1 e D 2 u , v / 2 D 0 2
Although the image lesions after applying Gaussian high-pass filtering are obvious, the results are not as expected after model training. Therefore, other methods must be explored to enhance the lesions. In [23], in order to obtain better edges, the image preprocessing is performed by taking the grayscale image array minus the Gaussian high-pass filtered films array. The reason is that the filtered image will preserve the noisy areas and the result may not be significantly different from the input image. Therefore, by subtracting the filtered film from the input array, a clear tooth outline image can be obtained. Based on the above method, this study attempts to improve it by adding a film array to the grayscale image array after passing through a Gaussian high-pass filter to increase the likelihood of the lesion area. After applying a Gaussian high-pass filter, the filtered image retains the high-frequency pixels thus including the noise points, edges and possible lesion pixels. After superimposing this filtered image, the contrast between the light and dark areas of the grayscale original image and the filtered image becomes evident as shown in Figure 6.

2.2.3. Lesion Heightened

The last step of feature enhancement is to adjust the color of the suspected lesion area where the color of the root tip is darkened. The biggest challenge for this step is how to lock the dark area of the suspected lesion. The filtered film makes it easier to find dark areas than the original image because bright areas have much larger pixel values than dark areas. However, directly using the threshold to adjust the whole block will cause other non-lesion areas in the image to be adjusted at the same time. Hence, this proposal calculates the pixel average and selects the threshold range. It can be simply reserved for possible lesions and excluded for bright areas as shown in Figure 7a. Moreover, this research used the method of calculating the pixel value difference between each pixel and its upper and lower pixels to ensure that possible lesion areas were determined. If the pixel value difference between the pixel and the pixel above or below is higher than the standard pixel value, it means that the pixel may be a point in the lesion area or just a noise point. At this time, a standard pixel value is selected. Figure 7b shows the experimental results. After using the above method of calculating the mean and calculating the difference in pixels, an AND operator is performed on the processed film to keep the points where the result is true after the AND operator. MATLAB programming provides a function to find several large regions in an image which this project uses to get the three regions that are larger than the others. Figure 7c presents the superimposed image. Finally, comparing these regions with their position in the film and their distance from the center pixel of the film, the regions that meet the above conditions will be changed into a green color and overlap with the original image. The final result is shown in Figure 7d.

2.3. Image Identification

In order to obtain a more scientific and reliable experimental model, the project first divides the original tooth images into a training set and a validation set according to the ratio of 4:1, as shown in Table 1. According to the transfer learning theory, the separated tooth images are cut and preprocessed according to symptoms and are then classified into the database. After that, the number of diseased teeth in the training set was expanded using horizontal and vertical mirror flips to increase the number of datasets and make it consistent with the number of normal teeth in the training set as listed in Table 2. The expanded dataset is only used to train various classification network models of CNN. It would not be used in the validation set data.

2.3.1. CNN Model

In terms of deep learning, this proposal uses the tools in Matlab that support transfer learning for software development. The software environments and the hardware environments used in the proposal are listed in Table 3. To speed up the training efficiency of the CNN model, this study uses AMD R7-5800H CPU, Nvidia GeForce RTX 3070 GPU and DDR4 3200 16GB DRAM in terms of hardware performance. The architecture of each layer of the model takes AlexNet as the example of this research, as shown in Table 4. In the input stage of the model, the real training set and test set are put into the ratio of 4:1. The CNN model is trained through the classified dataset. Then, the purpose of adding a test set is to check whether the training effect deviates from the subsequent validation accuracy, thus making the experimental results more rigorous.
After deep learning, images from the validation set are randomly imported into the model. The model classifies the images according to the feature results obtained from the previous training and creates a confusion matrix by calculation to get the classification results and the accuracy of the model.

2.3.2. Adjust Hyperparameter

In the training phase, the setting of hyperparameters determines the success of the model. Each parameter represents a different meaning such as the number of layers of the neural network, the loss function, the size of the convolution kernel and the learning rate. This study describes the three modified parameters, including Initial Learning Rate, Max Epoch and Mini Batch Size. In addition, the detailed information of each parameter is listed in Table 5.
A. 
Initial Learning Rate
In machine deep learning, the learning rate is a tuning parameter in the optimization algorithm. This means that the model needs an appropriate parameter which is the learning rate to get the best point of convergence. If the model has difficulty converging, it is most likely caused by the use of a too large learning rate. On the contrary, the convergence rate is too slow, which makes the model easy to overfit. Therefore, it is very important to choose an appropriate learning rate. After multiple tests on tooth images, the ideal learning rate is 0.0001.
B. 
Max Epoch
When an integrated database has passed through the CNN and has returned once, the whole process is referred to as an Epoch. However, if the Epoch is too large, it needs to be broken up into smaller pieces. With the increase of Epoch, the number of weight updates in the neural networks is also increased. The curve changed from under-fitting to over-fitting in the process of training. In general, if a CNN model has an appropriate increase in Epoch, it will lead to a better accuracy and in turn will also add training time. After repeated testing, choosing 50 as the Epoch value in each CNN model was determined by the control variable method.
C. 
Mini Batch Size
Mini Batch Size is a subset of the training set. Usually, the weights are updated and the gradient which is from the loss function is evaluated. In general, it affects the convergence of the optimization algorithm and how much memory is used in the calculation. Within a reasonable range, when the Batch Size is larger, the descending direction is more accurate and the oscillation is smaller. However, if it exceeds this range, the Batch Size is too large and local optimization or memory overflow may occur. Mini Batch Size introduces larger randomness making it difficult to achieve convergence. In this research, adjusting the approximate Mini Batch Size value to 64 can produce an ideal training result.

3. Results

This chapter presents the performance results of the proposed CNN model algorithm and compares it with the methods proposed in [20,23]. The proposed method for advanced symptom enhancement is also analyzed. The comparison of the image processing effect of the dataset with the results of the three CNN networks is presented for further discussion of the results.
One significant goal of this research is to enable the system to be employed in therapeutic settings. Figure 8 depicts the most common clinical workflow nowadays. Manual identification by doctors and the establishment of cumbersome medical records is a time-consuming process. The purpose of the system in this proposal is to obtain objective data for physicians prior to diagnosis and therapy after the patient takes the PA film, as shown in Figure 9.
In terms of model accuracy, this study uses the network input validation set for evaluation. The predictions obtained from the monitoring model are compared with the correct answers from the images to obtain the accuracy of the CNN. Table 6 presents the detailed training process of AlexNet and this is illustrated in Figure 10 and Figure 11. The confusion matrix and truth table according to the network model are shown in Table 7.
Figure 12 shows the training process of this paper using the symptom enhancement technique at different stages. From the results, it can be seen that when the number of iterations increases, the three curves representing different preprocessing methods all show an upward trend in accuracy. The blue line is using the Gaussian high-pass filter and discoloration at the suspected lesion, the gray line is only discoloring the lesion without using the filter, and the orange line is the no enhancement technique. The experimental results show that although all three curves show an upward trend, the results of the enhanced two curves, the blue line and the gray line, are significantly higher than the unprocessed curves. This means that preprocessing has a significant impact on the verification accuracy. In addition, the model accuracy of the technique combining the Gaussian high-pass filter with discoloration at the lesion is about 1% and 5% higher than the other two methods. These results show that the method proposed in this paper can improve the final accuracy of the model.
The technology proposed in this study is applied to clinical image judgment. Figure 13 shows the image used as the target image for clinical image judgment of symptoms. Figure 13 shows the two tooth X-rays in the red frame. The left side is the normal healthy tooth while the one on the right side is the apical diseased tooth. After implementing this technology, the classification accuracy results obtained according to the model are listed in Table 8. The accuracy of the image classification results after enhancement in this work is higher than that before disease enhancement. In clinical medicine, excellent medical quality requires high-precision judgment. The image recognition ability of CNN is exceptional. The results show that the recognition using the proposed method in this study are all above 90%.
From the research results listed in Table 9, the diagnostic accuracy of AlexNet for apical lesions can reach 96.21% which is higher than the other three models in the literature. This presents a significant improvement of more than 3% compared with 92.91% in [23] which also uses the same AlexNet architecture. Furthermore, the results of the apical lesion detection technique proposed in this paper are in stark contrast to the 75.53% accuracy reported in the tooth identification study in [20]. The research results show that the method proposed in this work is very effective and successful for apical lesions. Furthermore, it can be shown that enhancing symptoms through image preprocessing improves classification accuracy.

4. Discussion

In this proposal, the apical slices of multiple teeth are cut into pictures of a single tooth before training to improve the accuracy of these models. However, in the process of image cropping, this study discovered that the cutting accuracy obtained for the image by adaptive thresholding is higher than the one obtained by simple binary processing which reduces the possibility that many images contain non-target areas. The improvement of the cutting accuracy can make the effect of symptom enhancement more and thus improve the accuracy of the model. In addition, this paper uses a different method in the preprocessing of image symptoms to increase the dark area of the possible lesion area which actually helps the model accuracy to increase to more than 96%. Compared to other papers, the Gaussian high-pass filter is a tool for residual noise area to reduce noise in other projects. Changing the color of the lesion area is a different approach, and learning the features in the movie is instinctive and easy in the machine learning step. In addition, this paper proposes a hypothesis, that is the enhancement of apical lesions. The lesion area was preprocessed before importing the images into training. It can be found that the preprocessed images can further improve the recognition accuracy of CNN which is based on the premise of the quantity and quality of models and databases. The accuracy of the AlexNet model used in this research can reach up to 96.21%. Furthermore, the system’s sensitivity and specificity on clinical apical radiographs were 98.5% and 93.9%, respectively.

5. Conclusions

The main purpose of this study is to achieve automatic and accurate diagnosis of apical teeth, and to help dentists improve treatment efficiency. The final experimental results show that the accuracy of AlexNet can reach 96.21% which provides confidence for this project to expand the research scope, improve the accuracy and realize the clinical medical application. In the future, the research team has formulated three objectives. Firstly, the project will continue to explore the possibility of identifying multiple symptoms and achieving the classification of different symptoms. Secondly, it will try to make the model more comprehensive and improve its accuracy. Thirdly, it will develop a GUI interface integrating the functions of picture cutting, disease strengthening and disease detection which can simplify the operation process and enhance the practicability of the plan at the same time.

Author Contributions

Conceptualization, Y.C. and W.-M.L.; Data curation, Y.C., W.-M.L.; Formal analysis, M.-L.C.; Funding acquisition, S.-L.C. and C.-A.C.; Methodology, T.-Y.C. and M.-L.C.; Resources, C.-A.C., S.-L.C. and P.A.R.A.; Software, S.-L.C., Y.-H.S., Y.-S.C., Y.-J.L. and Y.-R.L.; Supervision, C.-A.C. and S.-L.C.; Validation, Y.-H.S., Y.-S.C. and Y.-J.L.; Visualization, Y.-R.L. and P.A.R.A.; Writing—original draft, T.-Y.C.; Writing—review & editing, M.-L.C., C.-A.C. and P.A.R.A. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Ministry of Science and Technology (MOST), Taiwan, under grant numbers of MOST-111-2221-E-033-041, MOST-111-2823-8-033-001, MOST-111-2622-E-131-001, MOST-110-2223-8-033-002, MOST-110-2221-E-027-044-MY3, MOST-110-2218-E-035-007, MOST-110-2622-E-131-002, MOST-109-2622-E-131-001-CC3, MOST-109-2221-E-131-025, MOST-109-2410-H-197-002-MY3, and the National Chip Implementation Center, Taiwan.

Institutional Review Board Statement

Institutional Review Board Statement: Chang Gung Medical Foundation Institutional Review Board; IRB number: 202002030B0; Date of Approval: 2020/12/01; Protocol Title: A Convolutional Neural Network Approach for Dental Bite-Wing, Panoramic and Periapical Radiographs Classification; Executing Institution: Chang-Geng Medical Foundation Taoyuan Chang-Geng Memorial Hospital of Taoyuan; Duration of Approval: From 2020/12/1 To 2021/11/30; The IRB reviewed and determined that it is expedited review according to case research or cases treated or diagnosed by clinical routines. However, this does not include HIV-positive cases.

Informed Consent Statement

The IRB approves the waiver of the participants’ consent.

Data Availability Statement

Data sharing not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Panetta, K.; Rajendran, R.; Ramesh, A.; Rao, S.P.; Agaian, S. Tufts Dental Database: A Multimodal Panoramic X-Ray Dataset for Benchmarking Diagnostic Systems. IEEE J. Biomed. Health Inform. 2022, 26, 1650–1659. [Google Scholar] [CrossRef] [PubMed]
  2. Karamifar, K.; Tondari, A.; Saghiri, M.A. Endodontic Periapical Lesion: An Overview on the Etiology, Diagnosis and Current Treatment Modalities. Eur. Endod. J. 2020, 5, 54–67. [Google Scholar] [CrossRef] [PubMed]
  3. Luongo, R.; Faustini, F.; Vantaggiato, A.; Bianco, G.; Traini, T.; Scarano, A.; Pedullà, E.; Bugea, C. Implant Periapical Lesion: Clinical and Histological Analysis of Two Case Reports Carried Out with Two Different Approaches. Bioengineering 2022, 9, 145. [Google Scholar] [CrossRef] [PubMed]
  4. Jiménez-Sánchez, M.C.; Cabanillas-Balsera, D.; Areal-Quecuty, V.; Velasco-Ortega, E.; Martín-González, J.; Segura-Egea, J.J. Cardiovascular Diseases and Apical Periodontitis: Association Not Always Implies Causality. Med. Oral Patol. Oral Cir. Bucal 2020, 25, e652–e659. [Google Scholar] [CrossRef] [PubMed]
  5. Kamberi, B.; Hoxha, V.; Stavileci, M.; Dragusha, E.; Kuçi, A.; Kqiku, L. Prevalence of Apical Periodontitis and Endodontic Treatment in a Kosovar Adult Population. BMC Oral Health 2011, 11, 32. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Nair, P.N.R. On the Causes of Persistent Apical Periodontitis: A Review. Int. Endod. J. 2006, 39, 249–281. [Google Scholar] [CrossRef]
  7. Ridao-Sacie, C.; Segura-Egea, J.J.; Fernández-Palacín, A.; Bullón-Fernández, P.; Ríos-Santos, J.V. Radiological Assessment of Periapical Sta-tus Using the Periapical Index: Comparison of Periapical Radiography and Digital Panoramic Radiography. Int. Endod. J. 2007, 40, 433–440. [Google Scholar] [CrossRef]
  8. De Paula-Silva, F.W.G.; Wu, M.-K.; Leonardo, M.R.; da Silva, L.A.B.; Wesselink, P.R. Accuracy of Periapical Radiography and Cone-Beam Computed Tomography Scans in Diagnosing Apical Periodontitis Using Histopathological Findings as a Gold Standard. J. Endod. 2009, 35, 1009–1012. [Google Scholar] [CrossRef]
  9. Wallace, J.A.; Nair, M.K.; Colaco, M.F.; Kapa, S.F. A Comparative Evaluation of the Diagnostic Efficacy of Film and Digital Sensors for Detection of Simulated Periapical Lesions. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. Endod. 2001, 92, 93–97. [Google Scholar] [CrossRef]
  10. Chazel, J.-C.; Mafart, B. Apical Lesions. Br. Dent. J. 2004, 196, 2. [Google Scholar] [CrossRef]
  11. Chen, S.-L.; Chang, C.E.; Chen, C.A.; Abu, P.A.R.; Lin, T.L.; Lin, S.Y.; Chiang, W.Y.; Tu, W.C. Real-Time Image Contrast Enhancement VLSI Design for Intelligent Autonomous Vehicles. J. Imaging Sci. Technol. 2020, 64, 10504-1–10504-11. [Google Scholar] [CrossRef]
  12. Chi, T.-K.; Chen, H.-C.; Chen, S.-L.; Abu, P.A.R. A High-Accuracy and Power-Efficient Self-Optimizing Wireless Water Level Monitoring IoT Device for Smart City. Sensors 2021, 21, 1936. [Google Scholar] [CrossRef]
  13. Hsia, C.-H.; Lin, T.-Y.; Lin, J.-L.; Prasetyo, H.; Chen, S.-L.; Tseng, H.-W. System for Recommending Facial Skincare Products. Sens. Mater. 2020, 32, 3235. [Google Scholar] [CrossRef]
  14. Lin, S.-Y.; Wu, C.-M.; Chen, S.-L.; Lin, T.-L.; Tseng, Y.-W. Continuous Facial Emotion Recognition Method Based on Deep Learning of Academic Emotions. Sens. Mater. 2020, 32, 3243. [Google Scholar] [CrossRef]
  15. Adedigba, A.P.; Adeshina, S.A.; Aibinu, A.M. Performance Evaluation of Deep Learning Models on Mammogram Classification Using Small Dataset. Bioengineering 2022, 9, 161. [Google Scholar] [CrossRef]
  16. Madan, P.; Singh, V.; Singh, D.P.; Diwakar, M.; Pant, B.; Kishor, A. A Hybrid Deep Learning Approach for ECG-Based Arrhythmia Classification. Bioengineering 2022, 9, 152. [Google Scholar] [CrossRef]
  17. Zhou, R.; Wang, P.; Li, Y.; Mou, X.; Zhao, Z.; Chen, X.; Du, L.; Yang, T.; Zhan, Q.; Fang, Z. Prediction of Pulmonary Function Parameters Based on a Combination Algorithm. Bioengineering 2022, 9, 136. [Google Scholar] [CrossRef]
  18. Chen, S.-L.; Zhou, H.-S.; Chen, T.-Y.; Lee, T.-H.; Chen, C.-A.; Lin, T.-L.; Lin, N.-H.; Wang, L.-H.; Lin, S.-Y.; Chiang, W.-Y.; et al. Dental Shade Matching Method Based on Hue, Saturation, Value Color Model with Machine Learning and Fuzzy Decision. Sens. Mater. 2020, 32, 3185–3207. [Google Scholar] [CrossRef]
  19. Lakshmi, M.M.; Chitra, P. Tooth Decay Prediction and Classification from X-Ray Images Using Deep CNN. In Proceedings of the 2020 International Conference on Communication and Signal Processing (ICCSP), Chennai, India, 28–30 July 2020; pp. 1349–1355. [Google Scholar]
  20. Lin, N.-H.; Lin, T.-L.; Wang, X.; Kao, W.-T.; Tseng, H.-W.; Chen, S.-L.; Chiou, Y.-S.; Lin, S.-Y.; Villaverde, J.; Kuo, Y.-F. Teeth Detection Algorithm and Teeth Condition Classification Based on Convolutional Neural Networks for Dental Panoramic Radiographs. J. Med. Imaging Health Inform. 2018, 8, 507–515. [Google Scholar] [CrossRef]
  21. Yilmaz, E.; Kayikçioğlu, T.; Kayipmaz, S. Semi-Automatic Segmentation of Apical Lesions in Cone Beam Computed Tomography Images. In Proceedings of the 2017 25th Signal Processing and Communications Applications Conference (SIU), Antalya, Turkey, 15–18 May 2017; pp. 1–4. [Google Scholar]
  22. Jayalakshmi, G.S.; Kumar, V.S. Performance Analysis of Convolutional Neural Network (CNN) Based Cancerous Skin Lesion Detection System. In Proceedings of the 2019 International Conference on Computational Intelligence in Data Science (ICCIDS), Chennai, India, 21–23 February 2019; pp. 1–6. [Google Scholar]
  23. Li, C.-W.; Lin, S.-Y.; Chou, H.-S.; Chen, T.-Y.; Chen, Y.-A.; Liu, S.-Y.; Liu, Y.-L.; Chen, C.-A.; Huang, Y.-C.; Chen, S.-L.; et al. Detection of Dental Apical Lesions Using CNNs on Periapical Radiograph. Sensors 2021, 21, 7049. [Google Scholar] [CrossRef]
  24. Mao, Y.-C.; Chen, T.-Y.; Chou, H.-S.; Lin, S.-Y.; Liu, S.-Y.; Chen, Y.-A.; Liu, Y.-L.; Chen, C.-A.; Huang, Y.-C.; Chen, S.-L.; et al. Caries and Restoration Detection Using Bitewing Film Based on Transfer Learning with CNNs. Sensors 2021, 21, 4613. [Google Scholar] [CrossRef] [PubMed]
  25. Chen, S.-L.; Tsai, H.-J. A Novel Adaptive Local Dimming Backlight Control Chip Design Based on Gaussian Distribution for Liquid Crystal Displays. J. Disp. Technol. 2016, 12, 1494–1505. [Google Scholar] [CrossRef]
Figure 1. The flow chart of this research.
Figure 1. The flow chart of this research.
Bioengineering 09 00777 g001
Figure 2. The result of the images. (a) image binarization, (b) adaptive threshold processing.
Figure 2. The result of the images. (a) image binarization, (b) adaptive threshold processing.
Bioengineering 09 00777 g002
Figure 3. The result of cutting lines. (a) all cutting lines, (b) removed unnecessary cutting lines.
Figure 3. The result of cutting lines. (a) all cutting lines, (b) removed unnecessary cutting lines.
Bioengineering 09 00777 g003
Figure 4. The results of the masking image. (a) original segmented, (b) retouched segmented.
Figure 4. The results of the masking image. (a) original segmented, (b) retouched segmented.
Bioengineering 09 00777 g004
Figure 6. The image after adding the result of the Gaussian high-pass filter. (a) before, (b) after.
Figure 6. The image after adding the result of the Gaussian high-pass filter. (a) before, (b) after.
Bioengineering 09 00777 g006
Figure 7. The image in different computing methods. (a) computed average image, (b) calculated pixel value difference for every pixel to the upper pixels and to the lower pixels, (c) superimposed image after going through the previous methods, (d) the final preprocessed image.
Figure 7. The image in different computing methods. (a) computed average image, (b) calculated pixel value difference for every pixel to the upper pixels and to the lower pixels, (c) superimposed image after going through the previous methods, (d) the final preprocessed image.
Bioengineering 09 00777 g007
Figure 8. The original flow chart of clinical medicine.
Figure 8. The original flow chart of clinical medicine.
Bioengineering 09 00777 g008
Figure 9. The flow chart of using this system.
Figure 9. The flow chart of using this system.
Bioengineering 09 00777 g009
Figure 10. The accuracy of Alexnet model in test set which is black line and training set which is blue line during training process.
Figure 10. The accuracy of Alexnet model in test set which is black line and training set which is blue line during training process.
Bioengineering 09 00777 g010
Figure 11. The accuracy of Alexnet model in test set (black line) and training set (orange line) during loss training process.
Figure 11. The accuracy of Alexnet model in test set (black line) and training set (orange line) during loss training process.
Bioengineering 09 00777 g011
Figure 12. Comparison of the accuracy of AlexNet’s training process for the unprocessed image, applied Gaussian high pass filter and without filter.
Figure 12. Comparison of the accuracy of AlexNet’s training process for the unprocessed image, applied Gaussian high pass filter and without filter.
Bioengineering 09 00777 g012
Figure 13. The example for validation with cropping image.
Figure 13. The example for validation with cropping image.
Bioengineering 09 00777 g013
Table 1. Data Classification of the periapical image after preprocessing.
Table 1. Data Classification of the periapical image after preprocessing.
The Number of Periapical Images after Classification
Training SetValidation SetTotal
Normal33283415
Lesion330 (Expanded)15345
Table 2. Data distribution of the original periapical image from clinical.
Table 2. Data distribution of the original periapical image from clinical.
The Number of Original Periapical Images
NormalLesionTotal
Quantity41575490
Table 3. The hardware and software platform.
Table 3. The hardware and software platform.
Hardware PlatformVersion
CPUAMD R7-5800H
GPUGeForce RTX 3070
DRAMDDR4 3200 16GB
Software platformVersion
MATLABR2021a
Deep Network designer14.2
Table 4. The input and output of AlexNet model.
Table 4. The input and output of AlexNet model.
TypeActivations
1Image Input227 × 227 × 3
2Convolution55 × 55 × 96
3ReLU55 × 55 × 96
4Cross Channel Normalization50 × 55 × 96
5Max pooling27 × 27 × 96
6Grouped Convolution27 × 27 × 256
7ReLU27 × 27 × 256
8Cross Channel Normalization27 × 27 × 256
9Max pooling13 × 13 × 256
10Convolution13 × 13 × 384
11ReLU13 × 13 × 384
12Grouped Convolution13 × 13 × 384
13ReLU13 × 13 × 384
14Grouped Convolution13 × 13 × 256
15ReLU13 × 13 × 256
16Max pooling6 × 6 × 256
17Fully-Connected1 × 1 × 4096
18ReLU1 × 1 × 4096
19Dropout1 × 1 × 4096
20Fully-Connected1 × 1 × 4096
21ReLU1 × 1 × 4096
22Dropout1 × 1 × 4096
23Fully-Connected1 × 1 × 2
24Softmax1 × 1 × 2
25Classification Output1 × 1 × 2
Table 5. Hyperparameters in CNN model.
Table 5. Hyperparameters in CNN model.
HyperparametersValue
Initial Learning Rate0.0001
Max Epoch50
Mini Batch Size64
Validation Frequency10
Learning Drop Period3
Learning Rate Drop Factor0.02
Table 6. AlexNet training process.
Table 6. AlexNet training process.
EpochIterationTime ElapsedMini-Batch
Accuracy
Validation AccuracyMini-Batch LossValidation Loss
1100:00:0248.44%53.03%1.47160.7940
54000:00:1570.31%81.82%0.51140.4379
108000:00:2790.62%85.61%0.27260.3277
1512000:00:3990.62%88.64%0.26680.2648
2016000:00:4289.06%90.91%0.27760.2422
2520000:01:0387.50%91.67%0.37220.2230
3024000:01:1690.62%93.94%0.19550.1787
3528000:01:2895.31%95.31%0.13130.1883
4032000:01:4190.62%95.45%0.27680.1585
4536000:01:5396.88%95.45%0.08960.1424
5040000:02:0593.72%96.21%0.15200.1201
Table 7. The confusion matrix of AlexNet training result.
Table 7. The confusion matrix of AlexNet training result.
Target Class
Category NameLesionNormalSubtotal
Output ClassLesion49.2%3.0%94.2%
Normal0.8%47.0%98.4%
subtotal98.5%93.9%96.2%
Table 8. Comparison of the clinical data and the resulting image.
Table 8. Comparison of the clinical data and the resulting image.
Tooth Position in Figure 13LeftRight
Clinical DataNormalLesion
This Work Before Enhancement90.91% Normal94.70% Lesion
This Work After Enhancement93.93% Normal97.35% Lesion
Table 9. Image recognition accuracy obtained from a different CNN model.
Table 9. Image recognition accuracy obtained from a different CNN model.
Method in [20] Method in [23] This Work
AlexNetResNet101ResNet
50
Google
Net
Accuracy75.53%92.91%96.21%94.70%93.94%87.88%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Chuo, Y.; Lin, W.-M.; Chen, T.-Y.; Chan, M.-L.; Chang, Y.-S.; Lin, Y.-R.; Lin, Y.-J.; Shao, Y.-H.; Chen, C.-A.; Chen, S.-L.; et al. A High-Accuracy Detection System: Based on Transfer Learning for Apical Lesions on Periapical Radiograph. Bioengineering 2022, 9, 777. https://doi.org/10.3390/bioengineering9120777

AMA Style

Chuo Y, Lin W-M, Chen T-Y, Chan M-L, Chang Y-S, Lin Y-R, Lin Y-J, Shao Y-H, Chen C-A, Chen S-L, et al. A High-Accuracy Detection System: Based on Transfer Learning for Apical Lesions on Periapical Radiograph. Bioengineering. 2022; 9(12):777. https://doi.org/10.3390/bioengineering9120777

Chicago/Turabian Style

Chuo, Yueh, Wen-Ming Lin, Tsung-Yi Chen, Mei-Ling Chan, Yu-Sung Chang, Yan-Ru Lin, Yuan-Jin Lin, Yu-Han Shao, Chiung-An Chen, Shih-Lun Chen, and et al. 2022. "A High-Accuracy Detection System: Based on Transfer Learning for Apical Lesions on Periapical Radiograph" Bioengineering 9, no. 12: 777. https://doi.org/10.3390/bioengineering9120777

APA Style

Chuo, Y., Lin, W. -M., Chen, T. -Y., Chan, M. -L., Chang, Y. -S., Lin, Y. -R., Lin, Y. -J., Shao, Y. -H., Chen, C. -A., Chen, S. -L., & Abu, P. A. R. (2022). A High-Accuracy Detection System: Based on Transfer Learning for Apical Lesions on Periapical Radiograph. Bioengineering, 9(12), 777. https://doi.org/10.3390/bioengineering9120777

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop