Next Article in Journal
Sexual Dysfunction in People with Multiple Sclerosis: The Role of Disease Severity, Illness Perception, and Depression
Next Article in Special Issue
Effect of the Adhesive Strategy on Clinical Performance and Marginal Integrity of a Universal Adhesive in Non-Carious Cervical Lesions in a Randomized 36-Month Study
Previous Article in Journal
Correction: Yamamoto et al. Trends in Open vs. Endoscopic Carpal Tunnel Release: A Comprehensive Survey in Japan. J. Clin. Med. 2022, 11, 4966
Previous Article in Special Issue
Caries Management—The Role of Surface Interactions in De- and Remineralization-Processes
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JCM
Volume 12
Issue 6
10.3390/jcm12062224
jcm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Detection of Dental Pathologies on Periapical Radiographs—Results from a Reliability Study

by
Theresa Meusburger
,
Annika Wülk
,
Andreas Kessler
,
Katrin Heck
,
Reinhard Hickel
,
Helena Dujic
and
Jan Kühnisch
*
Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians-University of Munich, 80336 Munich, Germany
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2023, 12(6), 2224; https://doi.org/10.3390/jcm12062224
Submission received: 6 February 2023 / Revised: 5 March 2023 / Accepted: 11 March 2023 / Published: 13 March 2023
(This article belongs to the Special Issue Recent Advances in the Management of Dental Caries)
Browse Figure
Versions Notes

Abstract

:
(1) Background: Caries, periapical lesions, periodontal bone loss (PBL), and endo-perio lesions are common dental findings that require an accurate diagnostic assessment to allow appropriate disease management. The purpose of this reliability study was to compare the inter- and intra-rater reliability for the detection of the above-mentioned pathologies on periapical radiographs. (2) Methods: Fourteen dentists (three with more than two years and eleven with less than two years of work experience) participated in a training workshop prior to data acquisition. A total of 150 radiographs were assessed by all raters in two rounds. Cohen’s Kappa (CK) values and a binary logistic regression were calculated. (3) Results: The reliability was found in a moderate and substantial range of agreement: caries (mean inter-rater CK value/first round 0.704/mean inter-rater CK value/second round 0.659/mean intra-rater CK value 0.778), periapical lesions (0.643/0.611/0.768), PBL (0.454/0.482/0.739) and endo-perio lesion (0.702/0.689/0.840). The regression model revealed a significant influence of the clinical experience, and furthermore, periapical pathologies and PBL were identified less reliably in comparison to caries and endo-perio lesions. (4) Conclusions: The dentist’s ability to detect the chosen pathologies was linked with significant differences. Periapical lesions and PBL were identified less reliably than caries and endo-perio lesions.

1. Introduction

Dental caries and periodontitis affect the majority of the world’s population, and the available epidemiological data demonstrated the widespread prevalence of the diseases [1,2,3,4]. Periapical periodontitis is also among frequent dental findings, as indicated by the fact that half of the global population has at least one tooth with a periapical inflammation [5]. Therefore, an accurate detection and assessment of the mentioned dental pathologies is essential to indicate appropriate disease management [6]. Aiming at reliably detecting and evaluating the existing range of dental pathologies, dental radiography seems to be the adjunct method of choice following the clinical examination [3,7,8].
When analysing the available literature regarding inter- and intra-rater reliability among dental professionals, it appeared that several author groups investigated this issue [9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30]. Interestingly, the overwhelming majority of scientific reports studied most commonly applied radiographic projection techniques for each pathology and their diagnostic accuracy without considering the inter- and intra-rater reliability. For example, bitewing radiographs are the method of choice for caries detection [6,9,10,11,12,13], periapical and panoramic radiographs for detecting and classifying periapical lesions or PBL [14,15,16,17,18,19,20,21,22,23,24,25,26,27]. In contrast, little is known about the inter- and intra-rater reliability for detecting caries [28] and periapical lesions [14,15,16] on periapical radiographs which are also among the routines in daily dental practice on this image type. In addition, there is limited data available on how reliable dentists detect PBL and endo-perio lesions on periapical radiographs. Furthermore, as known to us, no investigation has analysed the inter- and intra-rater reliability of the previously mentioned dental pathologies on periapical radiographs in one trial to achieve comparable data. Independently from this, it needs to be pointed out that each radiograph has to be viewed for prevalent or rare findings aiming at providing a full assessment of the captured radiographic anatomy. When considering that caries, periapical inflammation, PBL and endo-perio lesions can be easily detected on periapical radiographs, it further justifies the scientific investigation.
Therefore, this diagnostic study aimed to assess the reliability of detecting caries, periapical lesions, PBL and endo-perio lesions on periapical radiographs. The null hypothesis was that there is no difference between the four diagnostic categories and participating dentists.

2. Materials and Methods

This reliability study on the diagnosis of pathologies on periapical radiographs was conducted in the context of the research “Detection and diagnosis of dental disorders with artificial intelligence” at the Ludwig-Maximilians University (LMU) of Munich’s Department of Conservative Dentistry and Periodontology. The LMU Medical Faculty’s Ethics Committee gave its approval to this project (project number 20-0798). The current research was presented in accordance with the GRRAS guidelines [31].

2.1. Study Participants

A group of 14 dentists with different levels of clinical experience took part in this investigation. Three dentists who were employed at the dental clinic based in Munich had more than two years of work experience; eleven dentists were young professionals and had not worked clinically for longer than two years. Prior to the data collection, the entire study group participated in a 2-day training workshop under the guidance of Prof. Dr. Kühnisch (JK). During the workshop, the study protocol was explained, all pathologies and their detection and classification were described and numerous X-rays were assessed by the study group and each participant individually. After the workshop, the set of periapical radiographs was evaluated twice by all participants. There had to be at least four weeks in between the two assessments to reduce memory bias as best as possible [32]. All dentists were urged to complete the evaluation without assistance and independently.

2.2. Set of Periapical Radiographs

A set of completely anonymised periapical radiographs was chosen. All images were recorded at the dental school of the LMU Munich, utilising dental X-ray machines with a 203 mm tube (Heliodent DS, Sirona, Bensheim, Germany) counting an X-ray field restriction (30 × 40 mm) and charge-coupled device (CCD) sensor (Intraoral II, sensor measure 30.7 × 40.7 mm, Sirona, Bensheim, Germany). The exposure time was set at 0.06–0.08 s using a cathode voltage of 60 kV and an amperage of 7 mA. A sensor-holding device (XPP-DS Advanced Sensor Holders for Sirona, Dentsply Rinn, Elgin, IL, USA) was accessible and utilised in the event that it was applicable.
The following diagnostic criteria were chosen for the inclusion of a radiographic image: (1) Periapical radiographs from lower and upper incisors, canines and molars were selected. (2) An image showing the full extent of the main teeth was needed. (3) All X-rays required correct levels relating to exposure, contrast and brightness. Images of teeth with quality defects such as distortions, prominent superimposing effects or others were not selected. (4) At least one radiographic finding—dentin caries, periapical pathology, PBL or endo-perio lesion—should be shown on each image. Finally, 150 periapical radiographs that met the inclusion criteria were identified, and each was assigned a unique identification number.

2.3. Diagnostic Standards

Typical examples for caries (Figure 1a), periapical lesions (Figure 1b), PBL (Figure 1c) and endo-perio lesions (Figure 1d) are shown in Figure 1. All diagnostic standards were defined prior to the data collection as following. The criterion dentin caries was diagnosed according to international accepted recommendations [33,34,35]. When proximal or occlusal caries lesions were registered beyond the enamel-dentin junction or even up to the inner dentin and pulp area, they were registered as dentin caries (Figure 1a). Proximal caries lesions limited to the enamel were not considered. Furthermore, no distinction between different grades of progression was made.
Periapical lesions (Figure 1b) were recorded when a radiolucency around the tooth apex was present. Here, the periapical index by Orstavik et al. [36] classifies periapical pathologies into five different lesion stages. In the present study, periapical inflammation was detected when a radiolucency located in the area around the apex of at least one tooth with twice the width of the periodontal ligament was visible [37,38]. A differentiation between lesion stages was not performed.
To assess the PBL (Figure 1c), the cemento-enamel junction, limbus alveolaris and apex were considered. In detail, the radiographic PBL (cemento-enamel junction—limbus alveolaris) was estimated in relation to the root length (cemento-enamel junction—root apex). If the vertical or horizontal radiographic PBL reached at least the second half of the coronal third of the root length (15–33%), then periodontitis was assumed to be established [39,40,41]. A detailed differentiation under consideration of the exact extent of the radiographic PBL, e.g., into coronal, middle or apical root third [39,40,41] was not made.
Endo-perio lesions (Figure 1d) were detected when the periapical inflammation on a tooth included pulpal and periodontal structures. The classification of endo-perio lesions by Simon et al. [42] served as a reference for this project. Essential radiographic findings included the existence of an inflammation (or radiolucency) that involves the periodontal ligament from the periapical region to the sulcus gingivae.

2.4. Consensus Decision (Reference Standard)

Following the two screening assessments, the entire working group re-evaluated all radiographs in an additional meeting to reach a consensus agreement on each X-ray. Again, a yes/no decision (0 or 1) was taken for the four selected criteria. Once one participant presented a deviating result, the team members re-evaluated the concerned radiograph and discussed until agreement was achieved. This decision was set as a reference.

2.5. Data Management and Statistical Analysis

An Excel spreadsheet (Excel 2019, Microsoft, Redmond, WA, USA) was used to collect the outcome from the 14 dentists, the 2 assessments (N = 2), and the reference standard. Before analysis, the spreadsheet was checked for plausibility. Using Excel and SPSS, descriptive and exploratory data analysis was performed (SPSS Statistics 27, 2020, IBM Corporation, Armonk, NY, USA). Analysing the inter- and intra-rater reliability of all examiners and the reference standard was part of the statistical study. Cohen’s Kappa (CK), a measure of exploratory analysis, was determined. To obtain a total value, the arithmetic mean of these estimates was computed. The following interpretation must be used for CK values occurring between the ranges listed below: 0.0 to 0.2—slight agreement, 0.21 to 0.40—fair agreement, 0.41 to 0.60—moderate agreement, 0.61 to 0.80—substantial agreement, and 0.81 to 1.00—(almost) perfect agreement [43,44,45]. Additionally, a backward elimination model-based binary logistic regression analysis was carried out for the data (correct/incorrect diagnostic choice with regard to the reference standard and independent variable). The analysis considered the diagnostic decision (caries, periapical lesion, PBL, endo-perio lesion, dependent variable), evaluation round (first vs. second course, dependent variable), and dentists’ experience (</> 2 years of dental work experience, dependent variable) as potential confounding variables.

3. Results

The following tables contain the detailed inter- and intra-rater reliability CK values for all participating dentists for the identification of dentin caries (Table 1), periapical pathology (Table 2), PBL (Table 3), and endo-perio lesion (Table 4). Table 5 provides a summary of the mean CK values. In particular, the lowest CK values were found in the first evaluation round of inter-rater reliability for PBL, which was in a moderate agreement range (0.454), followed by the inter CK for periapical pathology (0.643). The mean CK values for caries (0.704) and endo-perio lesion (0.702) were nearly identical. The mean inter-rater CK values for both rounds were discovered in the same value range (Table 5). All diagnostic categories of intra-rater reliability demonstrated a substantial to excellent agreement (0.739 to 0.840; Table 5). The reliability results were found in moderate to substantial agreement for the selected categories in both evaluation rounds, in relation to the reference standard (Table 5). The lowest values were documented for periapical lesions (0.435), followed by PBL (0.575). Both numbers represent a moderate level of agreement.
A binary logistic regression model was applied to further explore the data set (Table 6). The results demonstrated that the variable “evaluation round” had no significant impact on reliability (aOR 0.99, p-value < 0.711). On the contrary, the detection of the investigated dental pathologies was documented with significant odds ratios when setting caries as the reference value in the model. Here, the detection of periapical inflammation (aOR 0.34, p-value < 0.001) and PBL (aOR 0.57, p-value < 0.001) on the selected X-rays was found to be associated with low reliability. In contrast, endo-perio lesions (aOR 1.54, p-value < 0.001) were diagnosed with higher reliability. Furthermore, dentists with longer clinical experience (>2 years) evaluated the set of periapical radiographs more consistently (aOR 1.98, p-value < 0.001).

4. Discussion

This diagnostic study evaluated the inter- and intra-rater reliability on periapical radiographs for the detection of caries, periodontitis in terms of PBL, periapical inflammations and endo-perio lesions. Generally, the observed CK values were found to be in moderate to substantial agreement (Table 1, Table 2, Table 3, Table 4 and Table 5). The binary logistic regression model (Table 6) showed significant deviations for the detection of the chosen dental pathologies. Additionally, the rater’s clinical experience had a significant impact in the present investigation. Therefore, the initially formulated hypothesis that there is no difference between the diagnostic categories and participating dentists must be rejected.
When discussing the results in detail, caries data should be considered first. Here, we found substantial inter-rater agreement for the first and second evaluation rounds between all raters (mean CK value of 0.704 and 0.659, Table 5) and for the first and second evaluations when the individual decision was related to the reference standard (mean CK value of 0.748 and 0.724, Table 5). The same order of magnitude was registered for the intra-rater reliability (mean CK of 0.778; Table 5). The comparison of our reliability results to other studies with the same methodology [28] indicated basically similar outcomes on periapical radiographs. However, it should be noted that detailed inter- and intra-rater agreement data cannot be taken from this article [28], which hinders further thorough comparisons. Therefore, diagnostic reliability studies for caries detection on bitewing radiographs should be mentioned. Here, numerous studies were published that mostly registered similar CK values for inter- and intra-rater reliability [12,13,29,30]. This conclusion is also supported by recently published data from two systematic reviews and meta-analysis on occlusal and proximal caries detection [9,10].
The reliability results for periapical pathologies in the present study registered substantial inter-rater agreement for both evaluation rounds between all raters (mean CK value of 0.643 and 0.611, Table 5) and moderate agreement for the first and second evaluations when comparing the individual data to the reference standard (mean CK value of 0.435 and 0.442, Table 5). Substantial agreement was recorded for the intra-rater reliability (mean CK of 0.768; Table 5). Due to the fact that periapical radiographs are the projection technique of choice for detecting periapical lesions, there are few publications available that allow comparisons [14,15,16,17]. A study by Patel et al. [14] aimed at detecting periapical pathologies under different viewing conditions by 50 observers. An interesting methodological detail was the feature of obscure tooth crowns on all periapical radiographs aiming at excluding potential diagnostic bias from the rater’s decision, which was not considered in our investigation. As a result, the author group documented fair inter-rater agreement (CK 0.26) among the participating dental students and dentists [14]. This finding is in line with data published by Saunders et al. [17], who found fair to moderate Kappa values for the detection of periapical lesions. A similar observation was drawn by Sebring et al. [18], who documented the greatest variability of diagnostic decisions among teeth with periapical pathologies, which also resulted in fair to moderate agreement; it should be noted that this study was carried out on panoramic X-rays. In contrast to these less-encouraging findings, Patel and co-workers [15] documented an almost perfect agreement for periapical lesion detection (CK 0.878) for two trained endodontists who assessed 30 periapical radiographs. However, the documented reliability data from this study for the detection of periapical inflammation indicate mostly a moderate level of agreement. With respect to the data from logistic regression analysis (Table 6), it needs to be pointed out that in the present study, the detection of periapical pathologies was found to be less reliable in comparison to all other included variables.
When viewing the data in the category PBL, the inter-rater CK values in the two assessments amounted to 0.454 and 0.482 (Table 5), respectively, which represent moderate agreement between raters. In contrast, the inter-rater reliability data in relation to the reference standard showed a substantial agreement for the first and second evaluation rounds (mean CK value of 0.575 and 0.598, Table 5). Additionally, the intra-rater CK value was found to be substantial (0.739, Table 5). In principle, the same reliability data were also documented for endo-perio lesions (Table 5). Surprisingly, we found no comparable investigation that evaluated the ability of dental professionals to detect PBL or endo-perio lesions on periapical radiographs; this limits the discussion and indicates future research needs. However, several publications have assessed the reliability of PBL detection between different radiographic projection techniques or under inclusion of mainly clinical parameters [22,23,24,25,26,40,46,47,48]. When viewing the data from the logistic regression analysis (Table 6), contrary data were observed for the detection of PBL and endo-perio lesions. While PBL was found to be associated with significantly less-reliable readings (OR 0.57, Table 6), endo-perio lesions were detected with a significantly higher detection probability (OR 1.54, Table 6). This becomes explainable by the simple fact that the latter pathology is representing a major finding on periapical radiographs, which is also easy to identify by less-experienced observers.
This research has strengths and limitations that should be discussed. The comprehensive study design, which included 4 diagnostic criteria, 14 raters, and 150 periapical radiographs, must be highlighted as a strength of a reliable study. The four selected criteria represent common dental pathologies that a dentist needs to be routinely diagnose in daily practice on this type of image. Here, it can be further argued that the simultaneous detection of different pathologies is close to the setting in dental practice, where multiple possibilities on X-rays need to be screened and identified correctly if present. In addition, the radiographs and dental structures were fully screened. This may have especially simplified the detection of periapical inflammations, which is frequently associated with profound caries or extensive restorations. This may explain the better CK values in this investigation compared to Patel et al. [14], where the crowns of the teeth on periapical radiographs were obscured to exclude any detection bias. There are also several limitations that must be mentioned. Under daily dental routines, many different factors can be considered, leading to the correct diagnostic decision on radiographic images [8,14,40]. In this study, however, periapical radiographs were evaluated without having access to the clinical background data and the indications that justified their prescription. This may have negatively influenced especially the reference standard. Interestingly, no significant difference was observed between the first and second evaluation round (Table 6). This finding could be addressed mainly to the extensive training before measuring the reliability. In consequence, learning effects during the study were potentially reduced. Furthermore, all included pathologies were rated by all raters as yes or no decision, which was exclusively attributed to the study extent and the workload for each participant. This simplified recording led most likely to more favourable results in comparison to a study design with multiple scores in each diagnostic category. Besides this, other—probably less frequent—pathologies have to be noted and should be known by the dentists, e.g., resorptions, cysts, trauma-induced findings or radio-opacities/radiolucencies. Such pathologies were not considered in the present study project. A similar report was published recently that analysed dentists’ reliability in identifying restorations on periapical radiographs [32] and, interestingly, the CK values for detecting different restorative procedures were found to be better. This finding indicates that different radiographic findings are linked to varying reliability data. In this context, it has to also be mentioned that the dentist’s clinical experience had a significant influence on the outcome in the present study. Here, experienced dentists detected more reliable pathologies on periapical radiographs which simply underlines the need for under- and post-graduate training. With respect to the imbalance in the group of participating dentists (3 experienced vs. 11 inexperienced dentists) and the varying level of clinical experiences, this finding might potentially be biased and, therefore, should not be overrated. Nevertheless, future teaching or training programs should consequently address categories with less reliable findings, e.g., periapical inflammation and PBL. Another limitation might be the fact that different viewing conditions were used by all participants, which were non-standardized and might potentially cause variations during decision making. Here, different computer displays with varying sizes, brightness and contrast settings may have influenced the visibility and detection ability of the participating dentists. However, this is a well-known influencing factor [14,49] which remained uncontrolled in this investigation.

5. Conclusions

It can be concluded that this reliability study for detecting caries, periapical pathologies, PBL and endo-perio lesions on periapical radiographs documented moderate to substantial reliability data in terms of Cohen’s Kappa values. Interestingly, the dentist’s ability to detect the chosen pathologies was linked with significant differences. Periapical lesions and PBL were identified less reliably than caries and endo-perio lesions. Further, more experienced dentists made more reliable decisions.

Author Contributions

Conceptualization and project administration, J.K.; study design, J.K.; investigations, T.M., A.W., H.D., A.K. and J.K.; data management and statistical analysis, K.H.; writing—original draft preparation, T.M., A.W., H.D. and J.K.; writing—review and editing: all authors. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study project was approved by the local Ethics Committee at the medical faculty of the LMU (project No. 20-0798).

Informed Consent Statement

Not applicable.

Data Availability Statement

The datasets generated and analysed during the current study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. GBD 2017 Oral Disorders Collaborators; Bernabe, E.; Marcenes, W.; Hernandez, C.R.; Bailey, J.; Abreu, L.G.; Kassebaum, N.J. Global, Regional, and National Levels and Trends in Burden of Oral Conditions from 1990 to 2017: A Systematic Analysis for the Global Burden of Disease 2017 Study. J. Dent. Res. 2020, 99, 362–373. [Google Scholar]
  2. Kassebaum, N.J.; Smith, A.G.; Bernabé, E.; Fleming, T.D.; Reynolds, A.E.; Vos, T.; GBD 2015 Oral Health Collaborators. Global, Regional, and National Prevalence, Incidence, and Disability-Adjusted Life Years for Oral Conditions for 195 Countries, 1990–2015: A Systematic Analysis for the Global Burden of Diseases, Injuries, and Risk Factors. J. Dent. Res. 2017, 96, 380–387. [Google Scholar] [CrossRef]
  3. Foros, P.; Oikonomou, E.; Koletsi, D.; Rahiotis, C. Detection Methods for Early Caries Diagnosis: A Systematic Review and Meta-Analysis. Caries Res. 2021, 55, 247–259. [Google Scholar] [CrossRef]
  4. Pihlstrom, B.L.; Michalowicz, B.S.; Johnson, N.W. Periodontal diseases. Lancet 2005, 366, 1809–1820. [Google Scholar] [CrossRef] [Green Version]
  5. Tibúrcio-Machado, C.S.; Michelon, C.; Zanatta, F.B.; Gomes, M.S.; Marin, J.A.; Bier, C.A. The global prevalence of apical periodontitis: A systematic review and meta-analysis. Int. Endod. J. 2021, 54, 712–735. [Google Scholar] [CrossRef]
  6. Şeker, O.; Kamburoğlu, K.; Şahin, C.; Eratam, N.; Çakmak, E.E.; Sönmez, G.; Özen, D. In vitro comparison of high-definition US, CBCT and periapical radiography in the diagnosis of proximal and recurrent caries. Dentomaxillofac. Radiol. 2021, 50, 20210026. [Google Scholar] [CrossRef]
  7. Kühnisch, J.; Anttonen, V.; Duggal, M.S.; Spyridonos, M.L.; Rajasekharan, S.; Sobczak, M.; Tsiklakis, K. Best clinical practice guidance for prescribing dental radiographs in children and adolescents: An EAPD policy document. Eur. Arch. Paediatr. Dent. 2020, 21, 375–386. [Google Scholar] [CrossRef]
  8. Wenzel, A. Bitewing and digital bitewing radiography for detection of caries lesions. J. Dent. Res. 2004, 83, C72–C75. [Google Scholar] [CrossRef]
  9. Janjic Rankovic, M.; Kapor, S.; Khazaei, Y.; Crispin, A.; Schüler, I.; Krause, F.; Ekstrand, K.; Michou, S.; Eggmann, F.; Lussi, A.; et al. Systematic review and meta-analysis of diagnostic studies of proximal surface caries. Clin. Oral Investig. 2021, 25, 6069–6079. [Google Scholar] [CrossRef]
  10. Kapor, S.; Rankovic, M.J.; Khazaei, Y.; Crispin, A.; Schüler, I.; Krause, F.; Lussi, A.; Neuhaus, K.; Eggmann, F.; Michou, S.; et al. Systematic review and meta-analysis of diagnostic methods for occlusal surface caries. Clin. Oral Investig. 2021, 25, 4801–4815. [Google Scholar] [CrossRef]
  11. Akarslan, Z.Z.; Akdevelioğlu, M.; Güngör, K.; Erten, H. A comparison of the diagnostic accuracy of bitewing, periapical, unfiltered and filtered digital panoramic images for approximal caries detection in posterior teeth. Dentomaxillofac. Radiol. 2008, 37, 458–463. [Google Scholar] [CrossRef]
  12. Litzenburger, F.; Heck, K.; Pitchika, V.; Neuhaus, K.W.; Jost, F.N.; Hickel, R.; Jablonski-Momeni, A.; Welk, A.; Lederer, A.; Kühnisch, J. Inter- and intraexaminer reliability of bitewing radiography and near-infrared light transillumination for proximal caries detection and assessment. Dentomaxillofac. Radiol. 2018, 47, 20170292. [Google Scholar] [CrossRef] [Green Version]
  13. Newman, B.; Seow, W.K.; Kazoullis, S.; Ford, D.; Holcombe, T. Clinical detection of caries in the primary dentition with and without bitewing radiography. Aust. Dent. J. 2009, 54, 23–30. [Google Scholar] [CrossRef]
  14. Patel, N.; Rushton, V.E.; Macfarlane, T.V.; Horner, K. The influence of viewing conditions on radiological diagnosis of periapical inflammation. Br. Dent. J. 2000, 189, 40–42. [Google Scholar] [CrossRef]
  15. Patel, S.; Wilson, R.; Dawood, A.; Mannocci, F. The detection of periapical pathosis using periapical radiography and cone beam computed tomography—Part 1: Pre-operative status. Int. Endod. J. 2012, 45, 702–710. [Google Scholar] [CrossRef]
  16. Patel, S.; Wilson, R.; Dawood, A.; Foschi, F.; Mannocci, F. The detection of periapical pathosis using digital periapical radiography and cone beam computed tomography—Part 2: A 1-year post-treatment follow-up. Int. Endod. J. 2012, 45, 711–723. [Google Scholar] [CrossRef]
  17. Saunders, M.B.; Gulabivala, K.; Holt, R.; Kahan, R.S. Reliability of radiographic observations recorded on a proforma measured using inter- and intra-observer variation: A preliminary study. Int. Endod. J. 2000, 33, 272–278. [Google Scholar] [CrossRef]
  18. Sebring, D.; Kvist, T.; Buhlin, K.; Jonasson, P.; EndoReCo Lund, H.L. Calibration improves observer reliability in detecting periapical pathology on panoramic radiographs. Acta. Odontol. Scand. 2021, 79, 554–561. [Google Scholar] [CrossRef]
  19. Molander, B.; Ahlqwist, M.; Gröndahl, H.G.; Hollender, L. Comparison of panoramic and intraoral radiography for the diagnosis of caries and periapical pathology. Dentomaxillofac. Radiol. 1993, 22, 28–32. [Google Scholar] [CrossRef]
  20. Rohlin, M.; Kullendorff, B.; Ahlqwist, M.; Stenström, B. Observer performance in the assessment of periapical pathology: A comparison of panoramic with periapical radiography. Dentomaxillofac. Radiol. 1991, 20, 127–131. [Google Scholar] [CrossRef]
  21. Bangar, B.R.; Rampati, S.R.; Gajare, S.M.; Vanama, Y.; Tummala, S.S.; Vemulapalli, C.C.; Suresh, B.J.; Swarnalatha, C.; Nayyar, A.S. Radiomorphometric Indices and their Relation to Alveolar Bone Loss: A Panoramic Radiographic Study. Int. J. Prev. Med. 2022, 13, 25. [Google Scholar]
  22. Ziebolz, D.; Szabadi, I.; Rinke, S.; Hornecker, E.; Mausberg, R.F. Initial periodontal screening and radiographic findings--a comparison of two methods to evaluate the periodontal situation. BMC Oral Health 2011, 11, 3. [Google Scholar] [CrossRef] [Green Version]
  23. Kim, T.S.; Obst, C.; Zehaczek, S.; Geenen, C. Detection of bone loss with different X-ray techniques in periodontal patients. J. Periodontol. 2008, 79, 1141–1149. [Google Scholar] [CrossRef]
  24. Persson, R.E.; Tzannetou, S.; Feloutzis, A.G.; Brägger, U.; Persson, G.R.; Lang, N.P. Comparison between panoramic and intra-oral radiographs for the assessment of alveolar bone levels in a periodontal maintenance population. J. Clin. Periodontol. 2003, 30, 833–839. [Google Scholar] [CrossRef]
  25. Semenoff, L.; Semenoff, T.A.D.; Pedro, F.L.M.; Volpato, E.R.; Machado, M.A.D.A.M.; Borges, A.H.; Semenoff-Segundo, A. Are panoramic radiographs reliable to diagnose mild alveolar bone resorption? ISRN Dent. 2011, 2011, 363578. [Google Scholar] [CrossRef] [Green Version]
  26. Molander, B.; Ahlqwist, M.; Gröndahl, H.G.; Hollender, L. Agreement between panoramic and intra-oral radiography in the assessment of marginal bone height. Dentomaxillofac. Radiol. 1991, 20, 155–160. [Google Scholar] [CrossRef]
  27. Tugnait, A.; Clerehugh, D.V.; Hirschmann, P.N. Survey of radiographic practices for periodontal disease in UK and Irish dental teaching hospitals. Dentomaxillofac. Radiol. 2000, 29, 376–381. [Google Scholar] [CrossRef]
  28. Freire, R.T.; Prata-Júnior, A.R.; Pinho, J.N.A.; Takeshita, W.M. Diagnostic Accuracy of Caries and Periapical Lesions on a Monitor with and without DICOM-GSDF Calibration under Different Ambient Light Conditions. J. Digit. Imaging 2022, 35, 654–659. [Google Scholar] [CrossRef]
  29. Senneby, A.; Elfvin, M.; Stebring-Franzon, C.; Rohlin, M. A novel classification system for assessment of approximal caries lesion progression in bitewing radiographs. Dentomaxillofac. Radiol. 2016, 45, 20160039. [Google Scholar] [CrossRef] [Green Version]
  30. Blumer, S.; Kharouba, J.; Kats, L.; Schachter, D.; Azem, H. Visual Examination, Fluorescence-Aided Caries Excavation (FACE) Technology, Bitewing X-Ray Radiography in the Detection of Occlusal Caries in First Permanent Molars in Children. J. Clin. Pediatr. Dent. 2021, 45, 152–157. [Google Scholar] [CrossRef]
  31. Kottner, J.; Audige, L.; Brorson, S.; Donner, A.; Gajewski, B.J.; Hróbjartsson, A.; Roberts, C.; Shoukri, M.; Streiner, D.L. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. Int. J. Nurs. Stud. 2011, 48, 661–671. [Google Scholar] [CrossRef]
  32. Wülk, A.; Meusburger, M.; Dujic, H.; Hickel, R.; Kessler, A.; Heck, K.; Kühnisch, J. The Dentist’s Ability to Detect Different Restorative Procedures on Periapical Radiographs-Results from a Reliability Study. Int. J. Environ. Res. Public. Health 2023, 20, 2619. [Google Scholar] [CrossRef]
  33. Marthaler, T.M. A standardized system of recording dental conditions. Helv. Odontol. Acta. 1966, 10, 1–18. [Google Scholar]
  34. Ekstrand, K.R.; Ricketts, D.N.J.; Kidd, E.A.M. Reproducibility and accuracy of three methods for assessment of demineralization depth of the occlusal surface: An in vitro examination. Caries Res. 1997, 31, 224–231. [Google Scholar] [CrossRef]
  35. Pitts, N.B. How the detection, assessment, diagnosis and monitoring of caries integrate with personalized caries management. Monogr. Oral Sci. 2009, 21, 1–14. [Google Scholar]
  36. Orstavik, D.; Kerekes, K.; Eriksen, H.M. The periapical index: A scoring system for radiographic assessment of apical periodontitis. Endod. Dent. Traumatol. 1986, 2, 20–34. [Google Scholar] [CrossRef]
  37. Low, K.M.; Dula, K.; Bürgin, W.; von Arx, T. Comparison of periapical radiography and limited cone-beam tomography in posterior maxillary teeth referred for apical surgery. J. Endod. 2008, 34, 557–562. [Google Scholar] [CrossRef]
  38. Bornstein, M.M.; Lauber, R.; Sendi, P.; von Arx, T. Comparison of periapical radiography and limited cone-beam computed tomography in mandibular molars for analysis of anatomical landmarks before apical surgery. J. Endod. 2011, 37, 151–157. [Google Scholar] [CrossRef]
  39. Papapanou, P.N.; Sanz, M.; Buduneli, N.; Dietrich, T.; Feres, M.; Fine, D.H.; Tonetti, M.S. Periodontitis: Consensus report of workgroup 2 of the 2017 World Workshop on the Classification of Periodontal and Peri-Implant Diseases and Conditions. J. Clin. Periodontol. 2018, 45, S162–S170. [Google Scholar] [CrossRef]
  40. Shaker, Z.M.H.; Parsa, A.; Moharamzadeh, K. Development of a Radiographic Index for Periodontal bone loss. Dent. J. 2021, 9, 19. [Google Scholar] [CrossRef]
  41. Fiorellini, J.P.; Sourvanos, D.; Sarimento, H.; Karimbux, N.; Luan, K.W. Periodontal and Implant Radiology. Dent. Clin. North Am. 2021, 65, 447–473. [Google Scholar] [CrossRef]
  42. Simon, J.H.; Glick, D.H.; Frank, A.L. The relationship of endodontic-periodontic lesions. J. Periodontol. 1972, 43, 202–208. [Google Scholar] [CrossRef]
  43. Cohen, J.A. A Coefficient of Agreement for Nominal Scales. Educ. Psychol. Meas. 1960, 20, 37–46. [Google Scholar] [CrossRef]
  44. Fleiss, J.L.; Cohen, J. The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability. Educ. Psychol. Meas. 1973, 33, 613–619. [Google Scholar] [CrossRef]
  45. Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef] [Green Version]
  46. Abrahamian, L.; Pascual-LaRocca, A.; Barallat, L.; Valles, C.; Herrera, D.; Sanz, M.; Nart, J.; Figuero, E. Intra- and inter-examiner reliability in classifying periodontal bone loss according to the 2018 classification of periodontal diseases. J. Clin. Periodontol. 2022, 49, 732–739. [Google Scholar] [CrossRef]
  47. Marini, L.; Tonetti, M.S.; Nibali, L.; Rojas, M.A.; Aimetti, M.; Cairo, F.; Cavalcanti, R.; Crea, A.; Ferrarotti, F.; Graziani, F.; et al. The staging and grading system in defining periodontal bone loss cases: Consistency and accuracy amongst periodontal experts, general dentists and undergraduate students. J. Clin. Periodontol. 2021, 48, 205–215. [Google Scholar] [CrossRef]
  48. Hellén-Halme, K.; Lith, A.; Shi, X.Q. Reliability of marginal bone level measurements on digital panoramic and digital intraoral radiographs. Oral Radiol. 2020, 36, 135–140. [Google Scholar] [CrossRef] [Green Version]
  49. Lima, C.A.S.; Nascimento, E.H.L.; Gaêta-Araujo, H.; Oliveira-Santos, C.; Freitas, D.Q.; Haiter-Neto, F.; Oliveira, M.L. Is the digital radiographic detection of approximal caries lesions influenced by viewing conditions? Oral Surg. Oral Med. Oral Pathol. Oral Radiol. 2020, 129, 165–170. [Google Scholar] [CrossRef]
Jcm 12 02224 g001 550
Figure 1. Examples of periapical radiographs for the four criteria: different stages of (a) caries, (b) periapical lesions (c) periodontal bone loss (PBL) and (d) endo-perio lesions.
Figure 1. Examples of periapical radiographs for the four criteria: different stages of (a) caries, (b) periapical lesions (c) periodontal bone loss (PBL) and (d) endo-perio lesions.
Jcm 12 02224 g001
Table
Table 1. Values of inter- and intra-rater reliability for caries detection which was calculated among all dentists (N = 14) and in relation to the reference standard (green coloured boxes). Grey coloured boxes illustrate inter-rater CK values of the first assessment and blue coloured boxes for the second assessment. White fields indicate intra-rater CK values.
Table 1. Values of inter- and intra-rater reliability for caries detection which was calculated among all dentists (N = 14) and in relation to the reference standard (green coloured boxes). Grey coloured boxes illustrate inter-rater CK values of the first assessment and blue coloured boxes for the second assessment. White fields indicate intra-rater CK values.
Cohen’s Kappa
Caries		 1st Evaluation Round
Ref.Stand.1 *234567 *891011121314 *Mean
Ref.Stand.1.0000.8040.7590.8080.5870.7140.7940.8040.6550.7480.7590.6480.7160.8080.8650.748
2nd evaluation round1 *0.7760.9100.6490.7710.5600.6790.7580.7900.6670.8200.6490.5060.6540.7710.6970.690
20.8080.7430.7040.7310.6930.6920.7450.7030.6370.6221.0000.6690.7460.7310.7320.719
30.8360.6640.8080.8630.6400.7120.7650.8000.6780.6860.7310.6250.7141.0000.7550.739
40.6920.5830.7450.7190.7870.6800.6270.6400.6530.6130.6930.6800.7330.6400.6670.655
50.6110.5290.6050.6380.6370.8480.7540.7350.6690.7070.6920.5820.9460.7120.7160.714
60.7720.6610.7710.7720.6260.6070.8380.8150.6650.7580.7450.5340.7820.7650.7150.725
7 *0.8790.6850.7150.7710.6790.5770.7050.7120.7540.8800.7030.5320.7370.8000.7250.740
80.5580.6290.6110.6150.5840.4920.5820.6610.7900.7250.6370.5890.6990.6780.6860.672
90.7600.7220.7840.7040.6230.5980.6730.6980.6690.8630.6220.4810.7100.6860.6970.693
100.6990.6320.7790.6720.6920.5520.6640.7160.5860.7580.6510.6690.7460.7310.7320.719
110.6570.5570.5790.6570.7200.5290.5620.6680.5260.5710.5780.6360.6330.6250.6980.602
120.7310.6450.7570.7310.7730.7830.7460.7450.5950.6860.7300.6550.9600.7140.7440.735
130.5630.4370.6170.6960.6800.5660.6540.5750.5120.5290.6700.5880.6680.5650.7550.739
14 *0.7900.8060.7580.7620.6230.6340.6740.7540.7290.8490.6750.5690.7140.5020.7660.717
Mean0.7240.6380.7130.7080.6680.5960.6690.6880.5990.6820.6700.5970.7100.5920.6960.778
* Skilled study members with more than two years of experience in dental practice.
Table
Table 2. Values of inter- and intra-rater reliability for the detection of periapical lesions which was calculated among all dentists (N = 14) and in relation to the reference standard (green coloured boxes). Grey coloured boxes illustrate inter-rater CK values of the first assessment and blue coloured boxes for the second assessment. White fields indicate intra-rater CK values.
Table 2. Values of inter- and intra-rater reliability for the detection of periapical lesions which was calculated among all dentists (N = 14) and in relation to the reference standard (green coloured boxes). Grey coloured boxes illustrate inter-rater CK values of the first assessment and blue coloured boxes for the second assessment. White fields indicate intra-rater CK values.
Cohen’s Kappa
Periapical Lesion		 1st Evaluation Round
Ref.Stand.1 *234567 *891011121314 *Mean
Ref.Stand.1.0000.6640.3610.3540.3370.3890.4730.4100.3230.3750.3610.4150.3890.3400.9010.435
2nd evaluation round1 *0.6780.9600.4770.4610.4620.5150.6180.5670.4110.4750.4770.4740.5410.4740.6760.510
20.3330.4860.7920.7590.6510.7800.7660.8170.6680.7991.0000.6170.8140.7450.3210.709
30.3780.5390.7320.8270.6280.7500.7920.7520.6480.7040.7590.5030.7810.9850.3320.681
40.3570.4860.6590.6310.6890.6780.6680.6830.5710.7280.6510.5540.7110.6460.2930.610
50.3890.5250.8170.7870.6841.0000.7560.7750.6980.7570.7800.6110.9670.7670.3450.706
60.4870.6160.7200.8150.6580.7390.8970.8790.5970.7720.7660.6310.7870.7780.4700.714
7 *0.9010.6910.3160.3590.3160.3450.4600.3880.6370.8240.8170.6460.8070.7380.3880.718
80.2750.3830.7820.7150.6000.7000.6440.2650.7610.6510.6680.6030.6980.6350.3070.599
90.3680.4990.7800.8170.6790.8020.7680.3260.7300.9180.7990.6290.7900.7220.3550.693
100.3260.4470.7030.7770.5980.6940.7320.3110.6430.7580.8040.6170.8140.7450.3210.709
110.5090.5630.5400.5740.5090.5310.5920.4560.4920.5270.4870.7650.6420.4900.3900.570
120.3860.5510.8200.8220.6890.9040.7420.3410.7060.8370.7320.5050.9360.7980.3450.730
130.2650.3700.6510.6590.6140.5730.6260.2560.6990.6730.6960.4740.5820.5190.3170.680
14 *0.5320.5630.6670.7300.6070.6860.7980.5020.5940.7440.6480.4830.7180.5770.5020.374
Mean0.4420.5170.6670.6890.5950.6760.6850.3800.6120.6880.6330.5180.6880.5730.6400.768
* Skilled study members with more than two years of experience in dental practice.
Table
Table 3. Values of inter- and intra-rater reliability for the detection of PBL which was calculated among all dentists (N = 14) and in relation to the reference standard (green coloured boxes). Grey coloured boxes illustrate inter-rater CK values of the first assessment and blue coloured boxes for the second assessment. White fields indicate intra-rater CK values.
Table 3. Values of inter- and intra-rater reliability for the detection of PBL which was calculated among all dentists (N = 14) and in relation to the reference standard (green coloured boxes). Grey coloured boxes illustrate inter-rater CK values of the first assessment and blue coloured boxes for the second assessment. White fields indicate intra-rater CK values.
Cohen’s Kappa
Periodontal Bone Loss		 1st Evaluation Round
Ref.Stand.1 *234567 *891011121314 *Mean
Ref.Stand.1.0000.6100.5160.7620.4280.5890.5340.7480.3750.5880.5160.4730.6010.6580.6580.575
2nd evaluation round1 *0.6580.8920.6360.4530.3510.6950.2630.6380.2180.4790.6360.4090.6820.3730.3760.478
20.5020.5770.8110.4010.3130.6840.2160.6090.1930.4781.0000.3770.7000.3080.3130.479
30.7960.5910.5360.7790.4020.4660.6010.6580.4220.5490.4010.4390.4760.8630.5860.517
40.5690.5160.4020.4500.5960.3230.2750.4360.2670.2710.3130.3760.3310.4530.3810.346
50.4720.6150.5680.5020.3540.8540.2910.7170.2330.5590.6840.4450.9580.3920.3710.524
60.5290.3380.2330.4980.4520.2120.7670.4390.3680.4310.2160.2660.2980.6950.5170.375
7 *0.7060.4400.3610.5850.3930.3660.4630.5790.3660.6530.6090.4060.7310.5670.4890.563
80.5120.4450.2880.6080.3560.4100.4030.4350.5750.5220.1930.2760.2690.4510.2670.311
90.6200.4710.4430.7430.3830.4360.4310.4350.5950.8000.4780.3220.5720.5090.4030.479
100.5650.6730.7550.5480.4630.7040.2390.4450.3780.4550.7970.3770.7000.3080.3130.479
110.4730.5030.3380.4730.4750.3640.2860.3520.3430.3980.4241.0000.4560.3810.4360.382
120.6500.6890.6640.6340.4380.7290.3100.4940.4630.6200.7060.4240.8890.4010.3800.535
130.6200.4160.3660.6390.3010.3240.4860.5540.4060.5990.4000.3190.4450.5540.5500.481
14 *0.6990.6630.6960.7370.4050.5950.3400.5370.4870.6450.6560.4430.7550.5130.4550.414
Mean0.5980.5340.4790.5800.4140.4750.3610.4510.4320.5120.5270.3960.5670.4440.5750.739
* Skilled study members with more than two years of experience in dental practice.
Table
Table 4. Values of inter- and intra-rater reliability for the detection of endo-perio lesions which was calculated among all dentists (N = 14) and in relation to the reference standard (green coloured boxes). Grey coloured boxes illustrate inter-rater CK values of the first assessment and blue coloured boxes for the second assessment. White fields indicate intra-rater CK values.
Table 4. Values of inter- and intra-rater reliability for the detection of endo-perio lesions which was calculated among all dentists (N = 14) and in relation to the reference standard (green coloured boxes). Grey coloured boxes illustrate inter-rater CK values of the first assessment and blue coloured boxes for the second assessment. White fields indicate intra-rater CK values.
Cohen’s Kappa
Endo-Perio Lesion		 1st Evaluation Round
Ref.Stand.1 *234567 *891011121314 *Mean
Ref.Stand.1.0000.8460.7360.9360.6810.9180.7360.7930.5890.7520.7360.3970.9000.9360.9680.780
2nd evaluation round1 *0.8120.9630.7670.8460.7060.8240.8450.8680.5640.8240.7670.3790.8730.8460.8150.763
20.7960.7600.9040.7710.6500.7090.8370.9020.6670.8971.0000.2030.7560.7710.7070.741
30.8870.8270.8120.9510.6450.8520.7710.8280.5530.7520.7710.3970.8331.0000.9050.763
40.7620.7970.7810.7430.7670.6520.6910.7720.4730.7500.6500.2130.6970.6450.6530.631
50.8300.7230.7080.7770.6710.9130.7460.7700.6310.7620.7090.4310.9480.8520.8870.752
60.7550.7890.8860.8060.8100.6580.9000.9410.6250.8560.8370.2940.7940.7710.7070.747
7 *0.9680.7820.7760.8560.7330.8000.7260.7630.5790.9210.9020.2610.8170.8280.7630.781
80.6510.7120.7720.6650.6960.6960.7620.6230.6920.6410.6670.2230.6370.5530.5630.567
90.6760.7400.8420.7270.7230.6040.8340.6480.7920.9150.8970.2590.8110.7520.7220.757
100.5980.6520.7580.6490.6770.5960.7870.5720.7440.8190.8490.2030.7560.7710.7070.741
110.3600.3790.2410.4080.4100.3680.2830.3400.2830.2340.2570.6270.3860.3970.3760.309
120.8660.9100.8210.8820.8210.7850.8140.8350.7030.7680.6850.3860.9300.8330.8680.770
130.7130.7080.7280.7280.6920.6200.7180.6850.6810.7070.6610.2730.7330.7130.9050.763
14 *0.9010.8400.8590.8500.8240.7180.8540.8700.7090.7740.6930.2840.8270.7730.8700.737
Mean0.7550.7400.7500.7480.7210.6710.7480.7110.6800.7090.6580.3190.7670.6700.7600.840
* Skilled study members with more than two years of experience in dental practice.
Table
Table 5. CK means of the inter- and intra-rater reliability for the four dental pathologies.
Table 5. CK means of the inter- and intra-rater reliability for the four dental pathologies.
VariableInter-Rater
Reliability		Inter-Rater
Reliability		Intra-Rater
Reliability		Inter-Rater
Reliability		Inter-Rater
Reliability
1st Round2nd Round-1st Round/
Reference Stand.		2nd Round/
Reference Stand.
Caries0.704
(0.602–0.740)		0.659
(0.592–0.713)		0.778
(0.565–0.960)		0.748
(0.587–0.865)		0.724
(0.563–0.879)
Periapical lesion0.643
(0.374–0.718)		0.611
(0.380–0.688)		0.768
(0.388–1.000)		0.435
(0.323–0.901		0.442
(0.265–0.901)
Periodontal bone loss0.454
(0.311–0.563)		0.482
(0.361–0.580)		0.739
(0.455–1.000)		0.575
(0.375–0.762)		0.598
(0.361–0.580)
Endo-perio lesion0.702
(0.309–0.781)		0.689
(0.319–0.760)		0.840
(0.627–0.930)		0.780
(0.397–0.968)		0.755
(0.319–0.767)
Table
Table 6. Adjusted odds ratio with corresponding 95% CI and p-values were calculated according to the logistic regression model using backwards elimination. Bold numbers represent a significant influence.
Table 6. Adjusted odds ratio with corresponding 95% CI and p-values were calculated according to the logistic regression model using backwards elimination. Bold numbers represent a significant influence.
VariablesGroupsOdds Ratio95% CIp-Value
CategoriesCaries1--
Periapical pathology0.340.30–0.37<0.001
Periodontal bone loss0.570.51–0.64<0.001
Endo-perio lesion1.541.34–1.77<0.001
Evaluation round1st1--
2nd0.990.91–1.070.711
Clinical experience≤2 years1--
>2 years1.981.77–2.22<0.001
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Meusburger, T.; Wülk, A.; Kessler, A.; Heck, K.; Hickel, R.; Dujic, H.; Kühnisch, J. The Detection of Dental Pathologies on Periapical Radiographs—Results from a Reliability Study. J. Clin. Med. 2023, 12, 2224. https://doi.org/10.3390/jcm12062224

AMA Style

Meusburger T, Wülk A, Kessler A, Heck K, Hickel R, Dujic H, Kühnisch J. The Detection of Dental Pathologies on Periapical Radiographs—Results from a Reliability Study. Journal of Clinical Medicine. 2023; 12(6):2224. https://doi.org/10.3390/jcm12062224

Chicago/Turabian Style

Meusburger, Theresa, Annika Wülk, Andreas Kessler, Katrin Heck, Reinhard Hickel, Helena Dujic, and Jan Kühnisch. 2023. "The Detection of Dental Pathologies on Periapical Radiographs—Results from a Reliability Study" Journal of Clinical Medicine 12, no. 6: 2224. https://doi.org/10.3390/jcm12062224

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop