Next Article in Journal
Immunohistochemical TTF-1 and Napsin a Expression in Gastrointestinal Adenocarcinomas—Low Frequency but an Important Pitfall
Previous Article in Journal
Pupillary Responses and Vital Signs in Hypoglycemic Patients with Impaired Consciousness During Prehospital Care: A Retrospective Observational Study
Previous Article in Special Issue
Diabetic Foot Ulcers Detection Model Using a Hybrid Convolutional Neural Networks–Vision Transformers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Validation of an Artificial Intelligence-Based Software for the Detection and Numbering of Primary Teeth on Panoramic Radiographs

1
Department of Preventive Dental Sciences, College of Dentistry, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
2
Department of Basic Dental Sciences, College of Dentistry, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
3
Research and Graduate Studies Department, Mohammed Bin Rashid University of Medicine and Health Sciences, Dubai P.O. Box 505055, United Arab Emirates
*
Author to whom correspondence should be addressed.
Diagnostics 2025, 15(12), 1489; https://doi.org/10.3390/diagnostics15121489
Submission received: 21 April 2025 / Revised: 4 June 2025 / Accepted: 9 June 2025 / Published: 11 June 2025

Abstract

:
Background: Dental radiographs play a crucial role in diagnosis and treatment planning. With the rise in digital imaging, there is growing interest in leveraging artificial intelligence (AI) to support clinical decision-making. AI technologies can enhance diagnostic accuracy by automating tasks like identifying and locating dental structures. The aim of the current study was to assess and validate the accuracy of an AI-powered application in the detection and numbering of primary teeth on panoramic radiographs. Methods: This study examined 598 archived panoramic radiographs of subjects aged 4–14 years old. Images with poor diagnostic quality were excluded. Three experienced clinicians independently assessed each image to establish the ground truth for primary teeth identification. The same radiographs were then evaluated using EM2AI, an AI-based diagnostic software for the automatic detection and numbering of primary teeth. The AI’s performance was assessed by comparing its output to the ground truth using sensitivity, specificity, predictive values, accuracy, and the Kappa coefficient. Results: EM2AI demonstrated high overall performance in detecting and numbering primary teeth in mixed dentition, with an accuracy of 0.98, a sensitivity of 0.97, a specificity of 0.99, and a Kappa coefficient of 0.96. Detection accuracy for individual teeth ranged from 0.96 to 0.99. The highest sensitivity (0.99) was observed in detecting upper right canines and primary molars, while the lowest sensitivity (0.79–0.85) occurred in detecting lower incisors and the upper left first molar. Conclusions: The AI module demonstrated high accuracy in the automatic detection of primary teeth presence and numbering in panoramic images, with performance metrics exceeding 90%. With further validation, such systems could support automated dental charting, improve electronic dental records, and aid clinical decision-making.

1. Introduction

The term artificial intelligence (AI) describes a machine’s capacity to carry out intellectual and cognitive tasks that humans can [1]. To accomplish a particular goal, like identifying objects on images or radiographs, most AI applications use machine learning, which continually analyses a training dataset to find and learn innate patterns or predict measures from numerical data. The performance of an AI application is ideally evaluated on unseen test datasets [2,3,4].
The recent literature suggests that AI can improve patient outcomes, increase diagnosis accuracy, and expedite workflows in healthcare settings. In dentistry, many AI applications have been developed, investigated, implemented, and clinically integrated. Dental image analysis using AI has been particularly described as convenient and practical, with diagnostic accuracies similar or superior to those of expert practitioners in certain applications such as detecting oral mucosal lesions, dental implant types, and locations; predicting dental caries; and locating cephalometric landmarks [5,6,7,8].
In pediatric dentistry, AI was proposed for diagnosing conditions such as supernumerary and submerged teeth, early dental caries, and dental plaque. It was also a helpful aid in assessing bone age and developing preventive oral healthcare strategies. AI’s ability to predict outcomes accurately was comparable to experienced pediatric dentists, making it a potential valuable tool in this specialty [9,10]. From patients’ perspective, patients generally had a positive attitude towards AI in dentistry, recognizing its usefulness in diagnostics. The literature reported that AI-supported diagnostics improved the communication of radiographic findings and enhanced patients’ ability to recognize dental issues. However, AI-based communication did not significantly affect patients’ trust in dentists’ diagnoses [11,12,13].
AI currently offers some benefits in pediatric and orthodontic dentistry by facilitating clinical decision-making as well as practice efficiency. Clinically, AI supports the diagnosis and treatment planning process through advanced applications including radiograph interpretation, growth prediction, eruption pattern monitoring, and caries risk assessments. One of the key advantages in pediatric orthodontics is the early detection of dental anomalies such as hypodontia and supernumerary teeth, particularly during the mixed dentition stage [14]. The timely identification of these anomalies is critical for optimal treatment planning, allowing early interventions such as extraction of supernumerary teeth or the strategic preservation of primary teeth to guide eruption and reduce the complexity of future orthodontic procedures. In high-volume pediatric practices, less experienced clinicians may overlook such anomalies on panoramic radiographs. Deep learning models have demonstrated superior speed and accuracy compared to practitioners in detecting mesiodens, as reported by Ahn et al., highlighting AI’s potential to significantly aid clinicians with limited experience and ultimately contribute to more personalized and timely dental care [15,16].
A recently issued policy statement adopted by the FDI World General Federation General Assembly stated that dental AI needs to be useful, true, and built on data of high quality to prevent bias and performance attrition due to limited generalizability. To access high-quality data, a balance needs to be developed between data protection and accessibility for wide utilization. Ensuring that AI adoption will help reduce inequity is closely linked to the underlying training data reflecting diverse populations, as well as the accessibility of such AI to all population groups [2]. The policy also stressed on the significant potential risk of automation bias, which is defined as the over-reliance of practitioners on AI use. Despite all the efforts and developments, attempts to measure the newly introduced AI application’s performance based on standardized datasets using comparable metrics are currently lacking.
Detecting primary teeth on panoramic X-rays is crucial for assessing dental development stages and identifying eruption anomalies. Identifying abnormalities in mixed dentition, such as delayed root resorption, ectopic eruption, and tooth impactions, is essential for the accurate diagnosis and planning of pediatric dentistry and orthodontic interventions that support optimal arch development and facial growth [17]. The aim of the current study was to assess and validate the accuracy of the EM2AI application in the detection and numbering of primary teeth on panoramic radiographs.

2. Materials and Methods

Panoramic radiographs originally utilized for several diagnostic purposes were collected from multiple governmental dental outpatient facilities in Riyadh, Saudi Arabia. A total of 630 anonymized digital panoramic radiographs taken for subjects aged 4 to 14 years old were initially obtained. Image acquisition was mostly performed using the Planmeca ProMax 2D imaging unit (Planmeca Oy, Helsinki, Finland) in panoramic mode with pediatric settings. Images with severe distortion or poor quality that rendered individual tooth identification impossible were excluded (n = 32). Consequently, 598 diagnostically acceptable images were included for the analysis. The study was approved by the Institutional Review Board (IRB) at Princess Nourah bint Abdulrahman University (IRB number: 21-0164).
To establish the “ground truth”, three calibrated orthodontists, each with over 10 years of experience, independently reviewed the included radiographs to determine the presence or absence of primary teeth in each image using an electronic form. The same images were then processed using EM2AI (EM2AI Version 3.2.0, Clementi, Singapore), a commercially available software as a service (SaaS) platform designed for AI-based dental diagnostics. The EM2AI platform offers web-based support for detecting, annotating, and numbering teeth, including both pathological and non-pathological features. It can also generate automated dental charting and treatment plan suggestions based on AI analysis (Figure 1).
For the specific purpose of this study, the primary teeth detection and numbering function of the EM2AI software was evaluated. The software utilizes an instance segmentation model, specifically the Mask R-CNN architecture. Mask R-CNN is a flexible and advanced convolutional neural network (CNN)-based framework that extends the Faster R-CNN model by incorporating a parallel branch that predicts a segmentation mask for each detected object, in addition to the bounding box. This enables the model to detect both the presence and location of objects in an image, as well as generate segmentation masks outlining each object. This capability makes it particularly suitable for segmenting individual teeth in dental radiographs.

Statistical Analysis

For the interexaminer reliability assessment of the orthodontic specialists, 40 radiographs were randomly selected from the whole sample and independently evaluated by three investigators by comparing 800 records of primary teeth. Interexaminer reliability was determined using the intraclass correlation coefficient (ICC), which demonstrated a high degree of agreement among the evaluators (ICC = 0.89 and 95% CI: 0.82–0.94).
Data was tabulated and subjected to statistical analysis using IBM SPSS Statistics version 26 (SPSS, Chicago, IL, USA). The performance and accuracy of the AI-based automatic detection for teeth presence and numbering in primary dentition was evaluated relative to the ground truth based on the reporting sensitivity (S), specificity (E), positive predictive value (PPV), negative predictive value (NPV), test accuracy, and Kappa coefficient of agreement (Table 1). AI detection accuracy was calculated based on the following equation:
Accuracy (A) = TP + TN/TP + TN + FP + FN.

3. Results

3.1. Upper Primary Anterior Teeth

The accuracy of EM2AI in the detection of upper anterior primary teeth was 0.98 for all teeth, except for the upper right lateral incisor, and for the upper left canine, it was 0.97. The highest (0.99) EM2AI sensitivity was in the detection of the upper right canine, and the lowest sensitivity (0.89) was in the detection of the upper right central incisor (Table 2).

3.2. Upper Primary Molars

The highest accuracy of EM2AI was reported for the detection of the upper right second primary molar (0.99) followed by 0.98 for the detection of the remaining primary molars. The highest (0.99) EM2AI sensitivity was in the detection of the upper right second primary molar, and the lowest sensitivity (0.97) was in the detection of the upper left first primary molar (Table 3).

3.3. Lower Primary Anterior Teeth

The highest accuracy of EM2AI was reported for the detection of lower right and left primary central incisors (0.99), while the least accurate was 0.96 for lower right lateral incisor detection. The highest (0.97) EM2AI sensitivity was in the detection of the lower right and left primary canines, and the lowest sensitivity (0.83) was in the detection of the lower left central incisor and lower right lateral incisor (Table 4).

3.4. Lower Primary Molars

The highest accuracy of EM2AI was reported for the detection of the lower right second primary molar (0.99), while the lowest accuracy was 0.97 for lower left first primary molar detection. The highest (0.99) EM2AI sensitivity was in the detection of the lower right first and second primary molars, and the lowest sensitivity (0.97) was in the detection of the lower left first primary molar (Table 5).

3.5. Overall Evaluation of Primary Teeth Detection

The overall accuracy of EM2AI for the detection of all primary teeth in mixed dentition compared to the ground truth was 0.98, with a sensitivity of 0.97, a specificity of 0.99, a PPV of 0.99, and an NPV of 0.97. The EM2AI showed high specificity (0.99), indicating a strong ability to accurately identify missing primary teeth, and high sensitivity (0.97), indicating a strong ability to accurately identify present primary teeth. The highest sensitivity of EM2AI (0.98) was in the detection of upper primary canines and upper and lower primary molars. While the lowest sensitivity (0.85) was in the detection of lower primary incisors. The average accuracy of EM2AI was 0.98 in the detection of all primary teeth except for lower primary canines (0.97) (Table 6).
A random sample of 54 panoramic images, covering all primary teeth across the four quadrants, was selected based on detection errors identified between the AI analysis and the ground truth. An orthodontist and a radiologist reviewed these images to investigate the causes of these discrepancies. Further investigation revealed that 5 of the 54 randomly selected errors were due to inaccuracies in the ground truth. The remaining 49 AI errors in primary teeth identification and numbering were primarily caused by poor image quality (including dark images from excessive exposure, blurring, and magnification due to patient positioning errors, tongue interference, and improper image size selection), overlap between the crowns of permanent and primary teeth, and the missed detection of residual roots of primary teeth. Less common causes included retained primary teeth, altered eruption sequences, the presence of appliances such as space maintainers, unusual tooth positions and angulations, and dental crowding (Figure 2, Figure 3 and Figure 4).

4. Discussion

Radiography plays a crucial role in diagnostics and treatment planning in modern dentistry. It is considered the main resource available for clinicians to examine dental anatomy, pathological conditions, and assess treatment outcomes. Dental panoramic radiography is one of the most commonly utilized techniques among the various imaging modalities. For general oral examinations, panoramic radiography is appropriate given with minimal irradiation doses and amount of information provided. As an extraoral imaging method, it provides a comprehensive view of the dental arches, dentition, temporomandibular joints, and maxillary sinuses, making it invaluable across multiple dental specialties. In pediatric dentistry and orthodontics, it has several applications, including the detection of dental anomalies, the assessment of tooth position and development, and the monitoring of treatment progress [18,19,20]. The aim of the current study was to assess and validate the accuracy of a new AI application in the detection and numbering of primary teeth on panoramic radiographs.
AI is increasingly being integrated into dentistry, offering transformative potential in diagnosis, treatment planning, and patient management. This integration aims to enhance the accuracy and efficiency of dental care, providing significant benefits across various dental specialties. AI technologies are currently being utilized across multiple dental specialties, including dental public health, endodontics, oral and maxillofacial surgery, orthodontics, pediatric dentistry, periodontics, and prosthodontics. These technologies assist in diagnosis, clinical decision-making, treatment planning, and prognosis prediction, offering some appreciated insights that enhance the decision-making processes of dental professionals [21,22,23].
AI also plays a crucial role in dental imaging. Studies indicated usefulness in the detection of oral features such different types of fillings, caries, and implants. Its ability to analyze large volumes of data quickly enhances its diagnostic capabilities and efficiency with expected benefits leading to better patient outcomes [24,25]. AI application helped predict failures in clinical scenarios and offered reliable solutions according to recent reports. The dental community expects these applications to make dental care more efficient and economical in the future [26,27].
Although most of the previous reports highlight the promising potential of AI applications in dentistry, particularly in diagnostics, for enhancing patient management and improving the quality of care through increased diagnostic precision and treatment accuracy, several challenges persist. These challenges include data availability, data uniformity, and computational power, especially for handling 3D data. Additionally, the need for considerably high-quality data, potential algorithmic bias, a lack of contextual understanding, and ethical concerns are considered serious limitations. Therefore, AI continues to be regarded as a complementary tool that has the potential to support clinical decision-making, enhance diagnostic accuracy, and improve workflow efficiency rather than a replacement for the expertise, critical thinking, and patient-centered judgment of trained dental practitioners [28,29,30].
The results of the current study indicated that the overall accuracy of the tested AI application for the detection of all primary teeth in mixed dentition compared to the ground truth was 98%, in addition to high specificity (99%), indicating a strong ability to accurately identify missing primary teeth and high sensitivity (97%) and indicating a strong ability to accurately identify present primary teeth. The highest sensitivity was in the detection of upper primary canines, followed by upper and lower primary molars, while the lowest sensitivity was in the detection of lower primary incisors. In agreement with these findings, a recent study assessed a similar AI-driven tool and reported high accuracy and excellent performance in tooth detection (98.9% sensitivity and 99.6% precision) and segmentation [31]. It was also reported that the method utilized significantly reduced the manual segmentation time by 67%, highlighting its efficiency [31].
According to the study by Turosz et al., another AI-driven software demonstrated high accuracy (>90%) in detecting missing teeth, root canal fillings, and implant abutment crowns from dental panoramic radiographs, while its sensitivity and precision were moderate for endodontic lesions [32]. Likewise, a study by Gunec et al. reported that AI applications generated more accurate diagnoses compared to those of junior practitioners in detecting periapical lesions on panoramic radiographs [33]. It was therefore suggested that this form of applications is a convenient and cost-effective screening tool that could potentially reduce the likelihood of introducing human errors due to examiner fatigue. It is, however, important to exemplify that while AI shows promise as a diagnostic aid, clinician verification remains essential, particularly in more complex cases.
In the current study, as the data was being collected, the investigators had several procedural observations. AI exhibited several matching errors including the inability to identify primary teeth in some radiographs due to overlapping between the crowns of permanent and primary teeth. AI struggled to detect primary teeth in poor-quality panoramic radiographs due to either dark images, blurring, magnification, tongue spaces, or poor image size selection. AI missed the detection of the remaining roots of primary teeth. AI had difficulty in recognizing retained primary teeth. The altered sequence of teeth eruption, the presence of appliances like a space maintainer, the unusual position and angulation of the teeth, and crowding led to misidentification by AI.
It is essential that the research community supports clinicians with data and evidence to allow them to test and fully trust the proposed AI-driven models for a number of key applications including the classification of primary teeth from pediatric panoramic radiographs. By leveraging convolutional neural network (CNN)-based architectures, it will be possible to highlight AI’s potential in enhancing diagnostic efficiency while reducing clinician workload. This information is also required to reinforce the role of AI in dentistry, offering promising advancements in automated classification and decision support. In a study by Jaiswal et al., a newly introduced AI application outperformed other CNN-based models in classifying primary teeth, achieving 98% accuracy, precision, recall, and F1 scores. The study utilized a dataset of 620 panoramic radiographs with a 70:15:15 split for training, validation, and testing [34]. These observations, together with the current study findings, suggest that AI-driven classification can enhance diagnostic accuracy, streamline decision-making, and reduce clinician workload in orthodontics and pediatric dentistry applications.
This study has several limitations that should be acknowledged. The age range of the included subjects was broad, which may have introduced uncontrolled variability. This could affect the generalizability of the findings to specific age groups. The dataset was also limited to a specific population and geographic location, and the performance of the EM2AI application may vary in different demographic or clinical settings. Finally, the retrospective nature of the study and reliance on existing panoramic radiographs may have limited control over image quality and standardization. Future studies should consider prospective designs, age-specific subgroup analyses, and multi-center data to enhance the robustness and generalizability of AI-based dental diagnostics.

5. Conclusions

In conclusion, the AI module demonstrated high accuracy in the automatic detection of primary teeth presence and numbering in panoramic images, with performance metrics exceeding 90%. Once validated through more extensive research and reporting, it could provide an innovation that enables the automatic preparation of dental charts and electronic dental records and supports clinical decision-making. Critical appraisal of the evidence supporting the use of the different AI applications requires further validation, including the assessment of its relevance and usefulness in various target contexts. Further studies are recommended to allow for the testing of the AI model in identifying and numbering permanent teeth and in diagnosing developmental and dental anomalies such as submerged primary teeth, supernumerary teeth, ectopic eruption, and impactions.

Author Contributions

S.M.E. and H.H.B.: Conception, design, analysis, methodology, and interpretation of the data. E.A. and D.A. drafted the paper and revised it critically for intellectual content. A.U.A. and N.A.A.: Investigation and visualization; all authors participated in the final approval of the version to be published and agree to be accountable for all aspects of the work. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2025R427), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and was approved by the Institutional Review Board at Princess Nourah bint Abdulrahman University (PNU) (21-0164, 23 September 2021).

Informed Consent Statement

Patient consent was waived due to the retrospective nature of the study.

Data Availability Statement

The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding author.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Shan, T.; Tay, F.R.; Gu, L. Application of Artificial Intelligence in Dentistry. J. Dent. Res. 2021, 100, 232–244. [Google Scholar] [CrossRef]
  2. FDI World Dental Federation. Artificial intelligence in dentistry. Int. Dent. J. 2025, 75, 3–4. [Google Scholar] [CrossRef] [PubMed]
  3. Schwendicke, F.; Chaurasia, A.; Wiegand, T.; Uribe, S.E.; Fontana, M.; Akota, I.; Tryfonos, O.; Krois, J. Artificial intelligence for oral and dental healthcare: Core education curriculum. J. Dent. 2023, 128, 104363. [Google Scholar] [CrossRef] [PubMed]
  4. Schwendicke, F.; Samek, W.; Krois, J. Artificial Intelligence in Dentistry: Chances and Challenges. J. Dent. Res. 2020, 99, 769–774. [Google Scholar] [CrossRef] [PubMed]
  5. Evangelista, K.; de Freitas Silva, B.S.; Yamamoto-Silva, F.P.; Valladares-Neto, J.; Silva, M.A.G.; Soares Cevidanes, L.H.; de Luca Canto, G.; Massignan, C. Accuracy of artificial intelligence for tooth extraction decision-making in orthodontics: A systematic review and meta-analysis. Clin. Oral Investig. 2022, 26, 6893–6905. [Google Scholar] [CrossRef]
  6. Hwang, J.J.; Jung, Y.H.; Cho, B.H.; Heo, M.S. An overview of deep learning in the field of dentistry. Imaging Sci. Dent. 2019, 49, 1–7. [Google Scholar] [CrossRef]
  7. Krishna, A.B.; Tanveer, A.; Bhagirath, P.V.; Gannepalli, A. Role of artificial intelligence in diagnostic oral pathology—A modern approach. J. Oral Maxillofac. Pathol. 2020, 24, 152–156. [Google Scholar] [CrossRef]
  8. Revilla-León, M.; Gómez-Polo, M.; Vyas, S.; Barmak, B.A.; Galluci, G.O.; Att, W.; Krishnamurthy, V.R. Artificial intelligence applications in implant dentistry: A systematic review. J. Prosthet. Dent. 2023, 129, 293–300. [Google Scholar] [CrossRef]
  9. Rajinikanth, S.; Rajkumar, D.; Rajinikanth, A.; Anandhapandian, P. An overview of artificial intelligence based automated di-agnosis in paediatric dentistry. Front. Oral Health 2024, 5, 1482334. [Google Scholar] [CrossRef]
  10. Vishwanathaiah, S.; Fageeh, H.N.; Khanagar, S.B.; Maganur, P.C. Artificial Intelligence Its Uses and Application in Pediatric Dentistry: A Review. Biomedicines 2023, 11, 788. [Google Scholar] [CrossRef]
  11. Kosan, E.; Krois, J.; Wingenfeld, K.; Deuter, C.E.; Gaudin, R.; Schwendicke, F. Patients’ Perspectives on Artificial Intelligence in Dentistry: A Controlled Study. J. Clin. Med. 2022, 11, 2143. [Google Scholar] [CrossRef] [PubMed]
  12. Bahadir, H.S.; Keskin, N.B.; Çakmak, E.Ş.K.; Güneç, G.; Cesur Aydin, K.; Peker, F. Patients’ attitudes toward artificial intelli-gence in dentistry and their trust in dentists. Oral Radiol. 2025, 41, 52–59. [Google Scholar] [CrossRef] [PubMed]
  13. Patil, S.; Albogami, S.; Hosmani, J.; Mujoo, S.; Kamil, M.A.; Mansour, M.A.; Abdul, H.N.; Bhandi, S.; Ahmed, S.S.S.J. Artificial Intelligence in the Diagnosis of Oral Diseases: Applications and Pitfalls. Diagnostics 2022, 12, 1029. [Google Scholar] [CrossRef] [PubMed]
  14. Alessa, N. Application of Artificial Intelligence in Pediatric Dentistry: A Literature Review. J. Pharm. Bioallied Sci. 2024, 16 (Suppl. S3), S1938–S1940. [Google Scholar] [CrossRef]
  15. Anthonappa, R.P.; King, N.M.; Rabie, A.B.; Mallineni, S.K. Reliability of panoramic radiographs for identifying supernumerary teeth in children. Int. J. Paediatr. Dent. 2012, 22, 37–43. [Google Scholar] [CrossRef]
  16. Ahn, Y.; Hwang, J.J.; Jung, Y.H.; Jeong, T.; Shin, J. Automated Mesiodens Classification System Using Deep Learning on Pan-oramic Radiographs of Children. Diagnostics 2021, 11, 1477. [Google Scholar] [CrossRef]
  17. Reis, J.C.; Fraga, M.A.A.; DeAzevedo-Vaz, S.L.; Miotto, M.H.M.B.; Perreira, T.C.R. Alterations in Panoramic Radiographies in Children. RGO, Rev. Gaúch. Odontol. 2020, 68, e20200073. [Google Scholar] [CrossRef]
  18. Choi, J.W. Assessment of panoramic radiography as a national oral examination tool: Review of the literature. Imaging Sci. Dent. 2011, 41, 1–6. [Google Scholar] [CrossRef]
  19. Rozyło-Kalinowska, I. Panoramic radiography in dentistry. Clin. Dent. Rev. 2021, 5, 26. [Google Scholar] [CrossRef]
  20. Cohnen, M.; Kemper, J.; Möbes, O.; Pawelzik, J.; Mödder, U. Radiation dose in dental radiology. Eur. Radiol. 2002, 12, 634–637. [Google Scholar] [CrossRef]
  21. Bonny, T.; Al Nassan, W.; Obaideen, K.; Al Mallahi, M.N.; Mohammad, Y.; El-Damanhoury, H.M. Contemporary Role and Applications of Artificial Intelligence in Dentistry. F1000Research 2023, 12, 1179. [Google Scholar] [CrossRef] [PubMed]
  22. Ahmed, N.; Abbasi, M.S.; Zuberi, F.; Qamar, W.; Halim, M.S.B.; Maqsood, A.; Alam, M.K. Artificial Intelligence Techniques: Analysis, Application, and Outcome in Dentistry—A Systematic Review. Biomed. Res. Int. 2021, 2021, 9751564. [Google Scholar] [CrossRef] [PubMed]
  23. Revilla-León, M.; Gómez-Polo, M.; Vyas, S.; Barmak, A.B.; Özcan, M.; Att, W.; Krishnamurthy, V.R. Artificial intelligence applications in restorative dentistry: A systematic review. J. Prosthet. Dent. 2022, 128, 867–875. [Google Scholar] [CrossRef] [PubMed]
  24. Alharbi, S.S.; Alhasson, H.F. Exploring the Applications of Artificial Intelligence in Dental Image Detection: A Systematic Review. Diagnostics 2024, 14, 2442. [Google Scholar] [CrossRef]
  25. Ding, H.; Wu, J.; Zhao, W.; Matinlinna, J.P.; Burrow, M.F.; Tsoi, J.K.H. Artificial intelligence in dentistry—A review. Front. Dent. Med. 2023, 4, 1085251. [Google Scholar] [CrossRef]
  26. Mallineni, S.K.; Sethi, M.; Punugoti, D.; Kotha, S.B.; Alkhayal, Z.; Mubaraki, S.; Almotawah, F.N.; Kotha, S.L.; Sajja, R.; Nettam, V. Artificial Intelligence in Dentistry: A Descriptive Review. Bioengineering 2024, 11, 1267. [Google Scholar] [CrossRef]
  27. Alam, M.K.; Alftaikhah, S.A.A.; Issrani, R.; Ronsivalle, V.; Giudice, A.L.; Cicciù, M.; Minervini, G. Applications of artificial intelligence in the utilisation of imaging modalities in dentistry: A systematic review and meta-analysis of in-vitro studies. Heliyon 2024, 10, e24221. [Google Scholar] [CrossRef]
  28. Morch, C.M.; Atsu, S.; Cai, W.; Madathil, C.A.; Liu, X.; Mai, V.; Tamimi, F.; Dilhac, M.A.; Ducret, M. Artificial Intelligence and Ethics in Dentistry: A Scoping Review. J. Dent. Res. 2021, 100, 1452–1460. [Google Scholar] [CrossRef]
  29. Thorat, V.; Rao, P.; Joshi, N.; Talreja, P.; Shetty, A.R. Role of Artificial Intelligence (AI) in Patient Education and Communication in Dentistry. Cureus 2024, 16, e59799. [Google Scholar] [CrossRef]
  30. Jeyaraman, M.; Balaji, S.; Jeyaraman, N.; Yadav, S. Unraveling the Ethical Enigma: Artificial Intelligence in Healthcare. Cureus 2023, 15, e43262. [Google Scholar] [CrossRef]
  31. Leite, A.F.; Gerven, A.V.; Willems, H. Artificial intelligence-driven novel tool for tooth detection and segmentation on pano-ramic radiographs. Clin. Oral Investig. 2021, 25, 2257–2267. [Google Scholar] [CrossRef] [PubMed]
  32. Turosz, N.; Chęcińska, K.; Chęciński, M.; Sielski, M.; Sikora, M. Evaluation of Dental Panoramic Radiographs by Artificial Intelligence Compared to Human Reference: A Diagnostic Accuracy Study. J. Clin. Med. 2024, 13, 6859. [Google Scholar] [CrossRef] [PubMed]
  33. Güneç, H.G.; Ürkmez, E.Ş.; Danaci, A.; Dilmaç, E.; Onay, H.H.; Cesur Aydin, K. Comparison of artificial intelligence vs. junior dentists’ diagnostic performance based on caries and periapical infection detection on panoramic images. Quant. Imaging Med. Surg. 2023, 13, 7494–7503. [Google Scholar] [CrossRef] [PubMed]
  34. Jaiswal, M.; Sharma, M.; Khandnor, P. Deep learning models for classification of deciduous and permanent teeth from digital panoramic images. Cureus 2023, 15, e49937. [Google Scholar] [CrossRef]
Figure 1. Panoramic radiograph of a 6-year-old subject showing mixed dentition analyzed using EM2AI for primary teeth detection.
Figure 1. Panoramic radiograph of a 6-year-old subject showing mixed dentition analyzed using EM2AI for primary teeth detection.
Diagnostics 15 01489 g001
Figure 2. Percentage of reasons for AI detection errors in primary teeth identification among the representative sample.
Figure 2. Percentage of reasons for AI detection errors in primary teeth identification among the representative sample.
Diagnostics 15 01489 g002
Figure 3. Poor quality image affecting AI performance in the detection of maxillary primary teeth.
Figure 3. Poor quality image affecting AI performance in the detection of maxillary primary teeth.
Diagnostics 15 01489 g003
Figure 4. Overlap between the lower left primary and permanent canines affecting the performance of AI in detecting the lower left primary canine.
Figure 4. Overlap between the lower left primary and permanent canines affecting the performance of AI in detecting the lower left primary canine.
Diagnostics 15 01489 g004
Table 1. Definitions of the AI performance metrics.
Table 1. Definitions of the AI performance metrics.
SensitivityThe proportion of the testing method’s true positive results to the reference method’s all positive results.
SpecificityThe proportion of the testing method’s true negative results to the reference method’s all negative results.
Positive Predictive Value (PPV)The proportion of positive test results that are actually positive according to the reference method to total test positive results.
Negative Predictive Value (NPV)The proportion of negative test results that are actually negative according to the reference method to total test negative results.
Test accuracyThe proportion of the number of true test results to all test results.
Kappa coefficient of agreementMeasures the degree of agreement accounting for the fact that the two methods may happen to agree on some cases by pure chance.
The 95% confidence intervals of all variables were calculated and reported.
Table 2. AI performance against the ground truth in the detection of upper primary anterior teeth in mixed dentition.
Table 2. AI performance against the ground truth in the detection of upper primary anterior teeth in mixed dentition.
Tooth NumberSensitivitySpecificityPPVNPVAccuracy
530.990.970.990.950.98
520.910.990.980.970.97
510.890.990.940.980.98
610.930.990.950.990.98
620.930.990.970.980.98
630.970.980.990.900.97
AI: artificial intelligence, PPV: positive predictive value, NPV: negative predictive value.
Table 3. AI performance against the ground truth in the detection of upper primary molars in mixed dentition.
Table 3. AI performance against the ground truth in the detection of upper primary molars in mixed dentition.
Tooth NumberSensitivitySpecificityPPVNPVAccuracy
550.990.981.000.960.99
540.980.970.980.970.98
640.970.990.990.960.98
650.980.980.990.940.98
AI: artificial intelligence, PPV: positive predictive value, NPV: negative predictive value.
Table 4. AI performance against the ground truth in the detection of lower primary anterior teeth in mixed dentition.
Table 4. AI performance against the ground truth in the detection of lower primary anterior teeth in mixed dentition.
Tooth NumberSensitivitySpecificityPPVNPVAccuracy
730.970.980.990.940.97
720.880.990.970.980.98
710.831.000.910.990.99
810.870.990.870.990.99
820.830.990.940.970.96
830.970.960.980.950.97
AI: artificial intelligence, PPV: positive predictive value, NPV: negative predictive value.
Table 5. AI performance against the ground truth in the detection of lower primary molars in mixed dentition.
Table 5. AI performance against the ground truth in the detection of lower primary molars in mixed dentition.
Tooth NumberSensitivitySpecificityPPVNPVAccuracy
750.980.980.990.960.98
740.970.980.990.950.97
840.990.980.990.980.98
850.991.001.000.960.99
AI: artificial intelligence, PPV: positive predictive value, NPV: negative predictive value.
Table 6. AI performance against the ground truth in the detection of primary teeth in mixed dentition (overall evaluation).
Table 6. AI performance against the ground truth in the detection of primary teeth in mixed dentition (overall evaluation).
Tooth NumberSensitivitySpecificityPPVNPVAccuracy
Upper primary incisors0.920.990.970.980.98
Upper primary canines0.980.970.990.920.98
Upper primary molars0.980.980.990.960.98
Lower primary incisors0.850.990.940.980.98
Lower primary canines0.970.980.990.940.97
Lower primary molars0.980.980.990.960.98
All primary teeth0.970.990.990.970.98
AI: artificial intelligence, PPV: positive predictive value, NPV: negative predictive value.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Bakhsh, H.H.; Alomair, D.; AlShehri, N.A.; Alturki, A.U.; Allam, E.; ElKhateeb, S.M. The Validation of an Artificial Intelligence-Based Software for the Detection and Numbering of Primary Teeth on Panoramic Radiographs. Diagnostics 2025, 15, 1489. https://doi.org/10.3390/diagnostics15121489

AMA Style

Bakhsh HH, Alomair D, AlShehri NA, Alturki AU, Allam E, ElKhateeb SM. The Validation of an Artificial Intelligence-Based Software for the Detection and Numbering of Primary Teeth on Panoramic Radiographs. Diagnostics. 2025; 15(12):1489. https://doi.org/10.3390/diagnostics15121489

Chicago/Turabian Style

Bakhsh, Heba H., Dur Alomair, Nada Ahmed AlShehri, Alia U. Alturki, Eman Allam, and Sara M. ElKhateeb. 2025. "The Validation of an Artificial Intelligence-Based Software for the Detection and Numbering of Primary Teeth on Panoramic Radiographs" Diagnostics 15, no. 12: 1489. https://doi.org/10.3390/diagnostics15121489

APA Style

Bakhsh, H. H., Alomair, D., AlShehri, N. A., Alturki, A. U., Allam, E., & ElKhateeb, S. M. (2025). The Validation of an Artificial Intelligence-Based Software for the Detection and Numbering of Primary Teeth on Panoramic Radiographs. Diagnostics, 15(12), 1489. https://doi.org/10.3390/diagnostics15121489

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop