Intra- and Interobserver Reliability of the CT-Based Glenoid Arc-Angle Method Using Injured-Side and Contralateral Reference Circles: A Diagnostic Reliability Study
Abstract
1. Introduction
2. Materials and Methods
2.1. Study Design, Relationship to Previous Work, and Sample Size Considerations
2.2. Cohort and Inclusion Criteria
2.3. Exclusion Criteria
2.4. Data Collection Methods
2.4.1. Diagnostic Imaging
2.4.2. Anatomical Measurements
Contralateral-Reference Method (CRM)
Calculation of Area-Based Glenoid Bone Loss
Injured-Side Method (ISM)
2.5. Statistical Analysis
3. Results
3.1. Demographics
3.2. Glenoid Measurements
3.3. Intraobserver Reliability
3.4. Interobserver Reliability of Observer-Specific Two-Session Mean Estimates
3.5. Absolute Agreement and Measurement Error
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| CT | Computed tomography |
| CRM | Contralateral-reference method |
| ISM | Injured-side method |
| ICC | Intraclass correlation coefficient |
| SD | Standard deviation |
| CI | Confidence interval |
| SPSS | Statistical Package for the Social Sciences |
References
- Zacchilli, M.A.; Owens, B.D. Epidemiology of shoulder dislocations presenting to emergency departments in the United States. J. Bone Jt. Surg. Am. 2010, 92, 542–549. [Google Scholar] [CrossRef] [PubMed]
- Bois, A.J.; Fening, S.D.; Polster, J.; Jones, M.H.; Miniaci, A. Quantifying glenoid bone loss in anterior shoulder instability: Reliability and accuracy of 2-dimensional and 3-dimensional computed tomography measurement techniques. Am. J. Sports Med. 2012, 40, 2569–2577. [Google Scholar] [CrossRef] [PubMed]
- Grumet, R.C.; Bach, B.R., Jr.; Provencher, M.T. Arthroscopic stabilization for first-time versus recurrent shoulder instability. Arthroscopy 2010, 26, 239–248. [Google Scholar] [CrossRef] [PubMed]
- Provencher, M.T.; Bhatia, S.; Ghodadra, N.S.; Grumet, R.C.; Bach, B.R., Jr.; Dewing, C.B.; LeClere, L.; Romeo, A.A. Recurrent shoulder instability: Current concepts for evaluation and management of glenoid bone loss. J. Bone Jt. Surg. Am. 2010, 92, 133–151. [Google Scholar] [CrossRef] [PubMed]
- Shin, S.J.; Kim, R.G.; Jeon, Y.S.; Kwon, T.H. Critical Value of Anterior Glenoid Bone Loss That Leads to Recurrent Glenohumeral Instability After Arthroscopic Bankart Repair. Am. J. Sports Med. 2017, 45, 1975–1981. [Google Scholar] [CrossRef] [PubMed]
- Shaha, J.S.; Cook, J.B.; Song, D.J.; Rowles, D.J.; Bottoni, C.R.; Shaha, S.H.; Tokish, J.M. Redefining “Critical” Bone Loss in Shoulder Instability: Functional Outcomes Worsen with “Subcritical” Bone Loss. Am. J. Sports Med. 2015, 43, 1719–1725. [Google Scholar] [CrossRef] [PubMed]
- Piasecki, D.P.; Verma, N.N.; Romeo, A.A.; Levine, W.N.; Bach, B.R., Jr.; Provencher, M.T. Glenoid bone deficiency in recurrent anterior shoulder instability: Diagnosis and management. J. Am. Acad. Orthop. Surg. 2009, 17, 482–493. [Google Scholar] [CrossRef] [PubMed]
- Rowe, C.R.; Zarins, B.; Ciullo, J.V. Recurrent anterior dislocation of the shoulder after surgical repair. Apparent causes of failure and treatment. J. Bone Jt. Surg. Am. 1984, 66, 159–168. [Google Scholar] [CrossRef]
- Chuang, T.Y.; Adams, C.R.; Burkhart, S.S. Use of preoperative three-dimensional computed tomography to quantify glenoid bone loss in shoulder instability. Arthroscopy 2008, 24, 376–382. [Google Scholar] [CrossRef] [PubMed]
- Garth, W.P., Jr.; Slappey, C.E.; Ochs, C.W. Roentgenographic demonstration of instability of the shoulder: The apical oblique projection. A technical note. J. Bone Jt. Surg. Am. 1984, 66, 1450–1453. [Google Scholar] [CrossRef]
- Huysmans, P.E.; Haen, P.S.; Kidd, M.; Dhert, W.J.; Willems, J.W. The shape of the inferior part of the glenoid: A cadaveric study. J. Shoulder Elb. Surg. 2006, 15, 759–763. [Google Scholar] [CrossRef] [PubMed]
- Pavlov, H.; Warren, R.F.; Weiss, C.B., Jr.; Dines, D.M. The roentgenographic evaluation of anterior shoulder instability. Clin. Orthop. Relat. Res. 1985, 194, 153–158. [Google Scholar] [CrossRef]
- Rokous, J.R.; Feagin, J.A.; Abbott, H.G. Modified axillary roentgenogram. A useful adjunct in the diagnosis of recurrent instability of the shoulder. Clin. Orthop. Relat. Res. 1972, 82, 84–86. [Google Scholar] [CrossRef]
- Wambacher, M.O.J.; Rieger, M. Schulterchirugie; Habermeyer, P.L.S., Magosch, P., Eds.; Urban & Fischer Verlag: Munich, Germany, 2010; pp. 112–131. [Google Scholar]
- Baudi, P.; Campochiaro, G.; Rebuzzi, M.; Matino, G.; Catani, F. Assessment of bone defects in anterior shoulder instability. Joints 2013, 1, 40–48. [Google Scholar] [PubMed]
- Kuberakani, K.; Aizawa, K.; Yamamoto, N.; Shinagawa, K.; Suzuki, T.; Hatta, T.; Kawakami, J.; Itoi, E. Comparison of best-fit circle versus contralateral comparison methods to quantify glenoid bone defect. J. Shoulder Elb. Surg. 2020, 29, 502–507. [Google Scholar] [CrossRef] [PubMed]
- Milano, G.; Saccomanno, M.F.; Magarelli, N.; Bonomo, L. Analysis of Agreement Between Computed Tomography Measurements of Glenoid Bone Defects in Anterior Shoulder Instability With and Without Comparison with the Contralateral Shoulder. Am. J. Sports Med. 2015, 43, 2918–2926. [Google Scholar] [CrossRef] [PubMed]
- Dumont, G.D.; Russell, R.D.; Browne, M.G.; Robertson, W.J. Area-based determination of bone loss using the glenoid arc angle. Arthroscopy 2012, 28, 1030–1035. [Google Scholar] [CrossRef] [PubMed]
- Hengg, C.; Blauth, M.; Wambacher, M.; Kralinger, F. Area-based determination of bone loss using the glenoid arc angle. Arthroscopy 2014, 30, 283. [Google Scholar] [CrossRef] [PubMed]
- Kottner, J.; Audigé, L.; Brorson, S.; Donner, A.; Gajewski, B.J.; Hróbjartsson, A.; Roberts, C.; Shoukri, M.; Streiner, D.L. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J. Clin. Epidemiol. 2011, 64, 96–106. [Google Scholar] [CrossRef] [PubMed]
- Walter, S.D.; Eliasziw, M.; Donner, A. Sample size and optimal designs for reliability studies. Stat. Med. 1998, 17, 101–110. [Google Scholar] [CrossRef]
- Bonett, D.G. Sample size requirements for estimating intraclass correlations with desired precision. Stat. Med. 2002, 21, 1331–1335. [Google Scholar] [CrossRef] [PubMed]
- Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef]
- Qin, S.; Nelson, L.; McLeod, L.; Eremenco, S.; Coons, S.J. Assessing test-retest reliability of patient-reported outcome measures using intraclass correlation coefficients: Recommendations for selecting and documenting the analytical formula. Qual. Life Res. 2019, 28, 1029–1033. [Google Scholar] [CrossRef] [PubMed]
- Ten Hove, D.; Jorgensen, T.D.; van der Ark, L.A. Updated guidelines on selecting an intraclass correlation coefficient for interrater reliability, with applications to incomplete observational designs. Psychol. Methods 2024, 29, 967–979. [Google Scholar] [CrossRef] [PubMed]
- Fleiss, J.L.; Cohen, J. The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability. Educ. Psychol. Meas. 1973, 33, 613–619. [Google Scholar] [CrossRef]
- Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef]
- Magarelli, N.; Milano, G.; Sergio, P.; Santagada, D.; Fabbriciani, C.; Bonomo, L. Intra-observer and interobserver reliability of the ‘Pico’ computed tomography method for quantification of glenoid bone defect in anterior shoulder instability. Skelet. Radiol. 2009, 38, 1071–1075. [Google Scholar] [CrossRef] [PubMed]
- Min, K.S.; Sy, J.W.; Mannino, B.J. Area Measurement Percentile of 3-Dimensional Computed Tomography Has the Highest Interobserver Reliability When Measuring Anterior Glenoid Bone Loss. Arthroscopy 2023, 39, 1394–1402. [Google Scholar] [CrossRef] [PubMed]
- Tennent, D.; Antonios, T.; Arnander, M.; Ejindu, V.; Papadakos, N.; Rastogi, A.; Pearse, Y. CT methods for measuring glenoid bone loss are inaccurate, and not reproducible or interchangeable. Bone Jt. Open 2023, 4, 478–489. [Google Scholar] [CrossRef] [PubMed]
- Zhao, Q.; Feng, Q.; Zhang, J.; Xu, J.; Wu, Z.; Huang, C.; Yuan, H. Glenoid segmentation from computed tomography scans based on a 2-stage deep learning model for glenoid bone loss evaluation. J. Shoulder Elb. Surg. 2023, 32, e624–e635. [Google Scholar] [CrossRef] [PubMed]
- Haimi, A.; Beyth, S.; Gross, M.; Safran, O.; Joskowicz, L. Automated quantification of glenoid bone loss in CT scans for shoulder dislocation surgery planning. Int. J. Comput. Assist. Radiol. Surg. 2024, 19, 129–137. [Google Scholar] [CrossRef] [PubMed]
- Satir, O.B.; Eghbali, P.; Becce, F.; Goetti, P.; Meylan, A.; Rothenbühler, K.; Diot, R.; Terrier, A.; Büchler, P. Automatic quantification of scapular and glenoid morphology from CT scans using deep learning. Eur. J. Radiol. 2024, 177, 111588. [Google Scholar] [CrossRef] [PubMed]
- Di Giacomo, G.; Itoi, E.; Burkhart, S.S. Evolving Concept of Bipolar Bone Loss and the Hill-Sachs Lesion: From “Engaging/Non-Engaging” Lesion to “On-Track/Off-Track” Lesion. Arthroscopy 2014, 30, 90–98. [Google Scholar] [CrossRef] [PubMed]
- Lu, Z.; Li, X.; Sun, D.; Song, Y.; Fekete, G.; Kovács, A.; András, K.; Gu, Y. Parametric cushioning lattice insole based on finite element method and machine learning: A preliminary computational analysis. J. Biomech. 2025, 184, 112674. [Google Scholar] [CrossRef] [PubMed]
- Lu, Z.; Li, X.; Sun, D.; Song, Y.; Fekete, G.; Kovács, A.; Gao, Z.; Zheng, J.; Xiang, L.; Gu, Y. Computationally tuned dual-layer lattice pads adapted to gait-induced pressure distribution. npj Adv. Manuf. 2025, 2, 43. [Google Scholar] [CrossRef]


| Variable | Value |
|---|---|
| Age, years, mean ± SD | 29.0 ± 9.9 |
| Male sex, n (%) | 26 (83.9) |
| Female sex, n (%) | 5 (16.1) |
| Right shoulder affected, n (%) | 18 (58.1) |
| Left shoulder affected, n (%) | 13 (41.9) |
| J-bone graft procedure, n (%) | 21 (67.7) |
| Screw fixation of an osseous glenoid fragment, n (%) | 10 (32.3) |
| Parameter | Method | Observer | T1, Mean ± SD | T2, Mean ± SD |
|---|---|---|---|---|
| Defect angle, ° | CRM | 1 | 104.3 ± 13.2 | 103.7 ± 13.9 |
| CRM | 2 | 102.2 ± 13.0 | 101.9 ± 15.7 | |
| CRM | 3 | 104.2 ± 12.6 | 102.9 ± 13.5 | |
| ISM | 1 | 109.2 ± 14.3 | 117.2 ± 10.6 | |
| ISM | 2 | 109.1 ± 16.0 | 107.5 ± 14.6 | |
| ISM | 3 | 114.9 ± 12.7 | 110.0 ± 15.4 | |
| Glenoid diameter, mm | CRM | 1 | 27.6 ± 2.2 | 27.3 ± 2.2 |
| CRM | 2 | 28.0 ± 2.0 | 28.4 ± 2.1 | |
| CRM | 3 | 28.3 ± 2.3 | 27.9 ± 2.0 | |
| ISM | 1 | 27.8 ± 2.5 | 28.9 ± 2.9 | |
| ISM | 2 | 28.9 ± 2.7 | 28.7 ± 2.4 | |
| ISM | 3 | 29.8 ± 2.7 | 28.5 ± 2.6 | |
| Glenoid bone loss, % | CRM | 1 | 13.9 ± 4.6 | 13.8 ± 4.9 |
| CRM | 2 | 13.2 ± 4.4 | 13.3 ± 5.3 | |
| CRM | 3 | 13.9 ± 4.5 | 13.5 ± 4.6 | |
| ISM | 1 | 15.7 ± 5.5 | 18.6 ± 4.4 | |
| ISM | 2 | 15.8 ± 6.0 | 15.2 ± 5.5 | |
| ISM | 3 | 17.8 ± 5.1 | 16.1 ± 5.7 |
| Parameter | Reliability | Observer | ISM ICC (95% CI) | Classification | CRM ICC (95% CI) | Classification |
|---|---|---|---|---|---|---|
| Glenoid diameter | Intraobserver | 1 | 0.735 (0.445–0.874) | Moderate | 0.964 (0.910–0.984) | Excellent |
| 2 | 0.906 (0.816–0.953) | Excellent | 0.953 (0.813–0.982) | Excellent | ||
| 3 | 0.761 (0.232–0.910) | Good | 0.900 (0.758–0.955) | Good | ||
| Defect angle | Intraobserver | 1 | 0.466 (0.086–0.715) | Poor | 0.874 (0.756–0.937) | Good |
| 2 | 0.850 (0.714–0.924) | Good | 0.870 (0.748–0.935) | Good | ||
| 3 | 0.661 (0.385–0.825) | Moderate | 0.826 (0.672–0.912) | Good | ||
| Glenoid diameter | Interobserver | All | 0.812 (0.672–0.900) | Good | 0.900 (0.660–0.961) | Good |
| Defect angle | Interobserver | All | 0.603 (0.399–0.767) | Moderate | 0.890 (0.811–0.942) | Good |
| Parameter | Method | Observer | Mean Bias, T2 − T1 (95% CI) | 95% Limits of Agreement | SEM | MDC95 |
|---|---|---|---|---|---|---|
| Defect angle, ° | CRM | 1 | −0.66 (−3.18 to 1.87) | −14.14 to 12.83 | 4.86 | 13.48 |
| Defect angle, ° | CRM | 2 | −0.38 (−3.11 to 2.35) | −14.97 to 14.22 | 5.26 | 14.59 |
| Defect angle, ° | CRM | 3 | −1.27 (−4.11 to 1.56) | −16.43 to 13.88 | 5.47 | 15.15 |
| Defect angle, ° | ISM | 1 | 8.05 (3.68 to 12.42) | −15.30 to 31.40 | 8.42 | 23.35 |
| Defect angle, ° | ISM | 2 | −1.55 (−4.62 to 1.53) | −17.97 to 14.88 | 5.93 | 16.42 |
| Defect angle, ° | ISM | 3 | −4.97 (−9.01 to −0.92) | −26.58 to 16.64 | 7.80 | 21.61 |
| Glenoid diameter, mm | CRM | 1 | −0.27 (−0.46 to −0.07) | −1.30 to 0.77 | 0.37 | 1.03 |
| Glenoid diameter, mm | CRM | 2 | 0.39 (0.20 to 0.58) | −0.63 to 1.40 | 0.37 | 1.01 |
| Glenoid diameter, mm | CRM | 3 | −0.46 (−0.78 to −0.15) | −2.17 to 1.24 | 0.62 | 1.71 |
| Glenoid diameter, mm | ISM | 1 | 1.02 (0.36 to 1.68) | −2.52 to 4.56 | 1.28 | 3.54 |
| Glenoid diameter, mm | ISM | 2 | −0.21 (−0.62 to 0.21) | −2.41 to 2.00 | 0.80 | 2.20 |
| Glenoid diameter, mm | ISM | 3 | −1.32 (−1.84 to −0.79) | −4.13 to 1.50 | 1.02 | 2.82 |
| Glenoid bone loss, % | CRM | 1 | −0.19 (−1.05 to 0.68) | −4.82 to 4.44 | 1.67 | 4.63 |
| Glenoid bone loss, % | CRM | 2 | 0.05 (−0.82 to 0.92) | −4.62 to 4.71 | 1.68 | 4.66 |
| Glenoid bone loss, % | CRM | 3 | −0.38 (−1.31 to 0.55) | −5.33 to 4.57 | 1.78 | 4.95 |
| Glenoid bone loss, % | ISM | 1 | 2.91 (1.33 to 4.49) | −5.56 to 11.37 | 3.05 | 8.47 |
| Glenoid bone loss, % | ISM | 2 | −0.66 (−1.72 to 0.40) | −6.31 to 4.99 | 2.04 | 5.65 |
| Glenoid bone loss, % | ISM | 3 | −1.73 (−3.17 to −0.29) | −9.43 to 5.97 | 2.78 | 7.70 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Strasser, S.; Pallua, J.D.; Aschaber, A.; Kralinger, F.; Dammerer, D.; Krappinger, D.; Arora, R.; Hengg, C. Intra- and Interobserver Reliability of the CT-Based Glenoid Arc-Angle Method Using Injured-Side and Contralateral Reference Circles: A Diagnostic Reliability Study. Diagnostics 2026, 16, 2477. https://doi.org/10.3390/diagnostics16152477
Strasser S, Pallua JD, Aschaber A, Kralinger F, Dammerer D, Krappinger D, Arora R, Hengg C. Intra- and Interobserver Reliability of the CT-Based Glenoid Arc-Angle Method Using Injured-Side and Contralateral Reference Circles: A Diagnostic Reliability Study. Diagnostics. 2026; 16(15):2477. https://doi.org/10.3390/diagnostics16152477
Chicago/Turabian StyleStrasser, Susanne, Johannes Dominikus Pallua, Anton Aschaber, Franz Kralinger, Dietmar Dammerer, Dietmar Krappinger, Rohit Arora, and Clemens Hengg. 2026. "Intra- and Interobserver Reliability of the CT-Based Glenoid Arc-Angle Method Using Injured-Side and Contralateral Reference Circles: A Diagnostic Reliability Study" Diagnostics 16, no. 15: 2477. https://doi.org/10.3390/diagnostics16152477
APA StyleStrasser, S., Pallua, J. D., Aschaber, A., Kralinger, F., Dammerer, D., Krappinger, D., Arora, R., & Hengg, C. (2026). Intra- and Interobserver Reliability of the CT-Based Glenoid Arc-Angle Method Using Injured-Side and Contralateral Reference Circles: A Diagnostic Reliability Study. Diagnostics, 16(15), 2477. https://doi.org/10.3390/diagnostics16152477

