Explainable Multimodal Machine Learning Predicts 90-Day Treatment Failure in Older Patients with Fragility Fractures of the Pelvis
Abstract
1. Introduction
2. Materials and Methods
2.1. Study Design, Setting and Ethics
2.2. Data Sources, Case Identification and Eligibility
2.3. Prediction Landmark and Prevention of Information Leakage
2.4. Outcome Definitions and Ascertainment
2.5. Imaging Assessment, PRI and Frailty
2.6. Clinical, Laboratory and Skeletal Health Predictors
2.7. Cohort Partitioning and Validation Framework
2.8. Missing Data and Preprocessing
2.9. Model Development, Sample Size and Hyperparameter Tuning
2.10. Recalibration, Operating Threshold and Risk Strata
2.11. Model-Performance, Decision and Interpretability Analyses
2.12. Statistical Analysis
3. Results
3.1. Cohort Assembly, Temporal Patterns and TF90 Burden
3.2. Admission Characteristics Associated with TF90
3.3. Predictive Performance, Calibration and Incremental Model Value
3.4. Model Interpretation and Development-Derived Risk Stratification
3.5. Event Timing, Treatment-Stratified Patterns and Threshold Trade-Offs
3.6. Internal–External Transportability, Calibration Heterogeneity and Sensitivity Analyses
4. Discussion
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| 25(OH)D | 25-hydroxyvitamin D |
| β-CTX | β-isomerised C-terminal telopeptide of type I collagen |
| ASA | American Society of Anesthesiologists |
| AUPRC | area under the precision–recall curve |
| AUROC | area under the receiver operating characteristic curve |
| CCI | Charlson Comorbidity Index |
| CFS | Clinical Frailty Scale |
| CI | confidence interval |
| CRP | C-reactive protein |
| CT | computed tomography |
| DCA | decision curve analysis |
| DXA | dual-energy X-ray absorptiometry |
| eGFR | estimated glomerular filtration rate |
| ESR | erythrocyte sedimentation rate |
| FFP | fragility fractures of the pelvis |
| ICC | intraclass correlation coefficient |
| IECV | internal–external cross-validation |
| IQR | interquartile range |
| NLR | neutrophil-to-lymphocyte ratio |
| NPV | negative predictive value |
| NRS | Numerical Rating Scale |
| O:E | observed-to-expected ratio |
| OOF | out-of-fold |
| PINP | procollagen type I N-terminal propeptide |
| PLR | platelet-to-lymphocyte ratio |
| PPV | positive predictive value |
| PRI | Pelvic Ring Instability score |
| PTH | parathyroid hormone |
| RF | random forest |
| SI | sacroiliac |
| SMD | standardised mean difference |
| STROBE | Strengthening the Reporting of Observational Studies in Epidemiology |
| TF90 | 90-day treatment failure |
References
- Ando, J.; Takahashi, T.; Ae, R.; Matsumura, T.; Sasao, W.; Abe, M.; Takeshita, K. Epidemiology of fragility fracture of the pelvic ring: A regional population-based study in Northern Japan. Arch. Osteoporos. 2023, 18, 131. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Heiman, E.; Gencarelli, P.; Tang, A.; Yingling, J.M.; Liporace, F.A.; Yoon, R.S. Fragility Fractures of the Pelvis and Sacrum: Current Trends in Literature. Hip Pelvis 2022, 34, 69–78. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rommens, P.M.; Wagner, D.; Hofmann, A. Fragility Fractures of the Pelvis. JBJS Rev. 2017, 5, e3. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Papakostidis, K.C.G.; Giannoudis, P.V. Evolution of treatment of fragility fractures of the pelvic ring. An update. Injury 2025, 56, 112145. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rommens, P.M.; Arand, C.; Hofmann, A.; Wagner, D. When and How to Operate Fragility Fractures of the Pelvis? Indian J. Orthop. 2019, 53, 128–137. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rommens, P.M.; Hofmann, A. Comprehensive classification of fragility fractures of the pelvic ring: Recommendations for surgical treatment. Injury 2013, 44, 1733–1744. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Mennen, A.H.M.; Blokland, A.S.; Maas, M.; van Embden, D. Imaging of pelvic ring fractures in older adults and its clinical implications-a systematic review. Osteoporos. Int. 2023, 34, 1549–1559. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Nuber, S.; Ritter, B.; Fenwick, A.; Förch, S.; Wanzl, M.; Nuber, M.; Mayr, E. Midterm follow-up of elderly patients with fragility fractures of the pelvis: A prospective cohort-study comparing operative and non-operative treatment according to a therapeutic algorithm. Injury 2021, 53, 496–505. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rommens, P.M.; Hopf, J.C.; Arand, C.; Handrich, K.; Boudissa, M.; Wagner, D. Prospective assessment of key factors influencing treatment strategy and outcome of fragility fractures of the pelvis (FFP). Eur. J. Trauma Emerg. Surg. 2022, 48, 3243–3256. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Ueda, Y.; Inui, T.; Kurata, Y.; Tsuji, H.; Saito, J.; Shitan, Y. Prolonged pain in patients with fragility fractures of the pelvis may be due to fracture progression. Eur. J. Trauma Emerg. Surg. 2019, 47, 507–513. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rommens, P.M.; Hofmann, A. The FFP-classification: From eminence to evidence. Injury 2021, 54, S10–S19. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rommens, P.M.; Ossendorf, C.; Pairon, P.; Dietz, S.-O.; Wagner, D.; Hofmann, A. Clinical pathways for fragility fractures of the pelvic ring: Personal experience and review of the literature. J. Orthop. Sci. 2014, 20, 1–11. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Höch, A.; Pieroh, P.; Gras, F.; Hohmann, T.; Märdian, S.; Holmenschlager, F.; Keil, H.; Palm, H.-G.; Herath, S.C.; Josten, C.; et al. Age and “general health”-beside fracture classification-affect the therapeutic decision for geriatric pelvic ring fractures: A German pelvic injury register study. Int. Orthop. 2019, 43, 2629–2636. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Oberkircher, L.; Lenz, J.; Bücking, B.; Eschbach, D.; Aigner, R.; Bliemel, C.; Schoeneberg, C.; Ruchholtz, S.; Hack, J. Which factors influence treatment decision in fragility fractures of the pelvis?—Results of a prospective study. BMC Musculoskelet. Disord. 2021, 22, 690. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Mair, O.; Neumann, J.; Rittstieg, P.; Müller, M.; Biberthaler, P.; Hanschen, M. The role of sarcopenia in fragility fractures of the pelvis—Is sarcopenia an underestimated risk factor? BMC Geriatr. 2024, 24, 461. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Takegami, Y.; Osawa, Y.; Funahashi, H.; Ido, H.; Asamoto, T.; Tanaka, S.; Otaka, K.; Imagama, S. Functional outcomes and survival rates of patients with fragility fractures of the pelvis: A multicenter retrospective analysis of 588 patients. J. Orthop. Sci. 2026, 31, 889–894. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Forssten, M.P.; Sarani, B.; Mohammad Ismail, A.; Cao, Y.; Ribeiro, M.A.F.; Hildebrand, F.; Mohseni, S. Adverse outcomes following pelvic fracture: The critical role of frailty. Eur. J. Trauma Emerg. Surg. 2023, 49, 2623–2631. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Lo, Y.-C.; Chen, C.-H.; Shih, C.Y.; Toma, O. Clinical frailty and short-term outcomes after low-energy pelvic fracture in the geriatric population: Nationwide inpatient sample 2016-2018 analysis. Bone 2024, 188, 117225. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kay, R.S.; Hughes, M.; Williamson, T.R.; Hall, A.J.; Duckworth, A.D.; Clement, N.D. The Clinical Frailty Scale can be used retrospectively to assess the frailty of patients with hip fracture: A validation study. Eur. Geriatr. Med. 2022, 13, 1101–1107. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Long, A.; Yang, D.; Jin, L.; Zhao, F.; Wang, X.; Zhang, Y.; Liu, L. Admission Inflammation Markers Influence Long-term Mortality in Elderly Patients Undergoing Hip Fracture Surgery: A Retrospective Cohort Study. Orthop. Surg. 2023, 16, 38–46. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rockwood, K.; Song, X.; MacKnight, C.; Bergman, H.; Hogan, D.B.; McDowell, I.; Mitnitski, A. A global clinical measure of fitness and frailty in elderly people. Can. Med. Assoc. J. 2005, 173, 489–495. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Lee, J.; Kim, J.; Jeong, C.; Ha, J.; Lim, Y.; Baek, K.-H. Predicting fragility fractures based on frailty and bone mineral density among rural community-dwelling older adults. Eur. J. Endocrinol. 2024, 191, 75–86. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Liu, L.-K.; Lee, W.-J.; Chen, L.-Y.; Hwang, A.-C.; Lin, M.-H.; Peng, L.-N.; Chen, L.-K. Association between Frailty, Osteoporosis, Falls and Hip Fractures among Community-Dwelling People Aged 50 Years and Older in Taiwan: Results from I-Lan Longitudinal Aging Study. PLoS ONE 2015, 10, e0136968. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Montori, V.M.; Permanyer-Miralda, G.; Ferreira-González, I.; Busse, J.W.; Pacheco-Huergo, V.; Bryant, D.; Alonso, J.; Akl, E.A.; Domingo-Salvany, A.; Mills, E.; et al. Validity of composite end points in clinical trials. BMJ 2005, 330, 594–596. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Moons, K.G.M.; Wolff, R.F.; Riley, R.D.; Whiting, P.F.; Westwood, M.; Collins, G.S.; Reitsma, J.B.; Kleijnen, J.; Mallett, S. PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies: Explanation and Elaboration. Ann. Intern. Med. 2019, 170, W1–W33. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Davis, S.E.; Matheny, M.E.; Balu, S.; Sendak, M.P. A framework for understanding label leakage in machine learning for health care. J. Am. Med. Inform. Assoc. 2023, 31, 274–280. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Moons, K.G.M.; Damen, J.A.A.; Kaul, T.; Hooft, L.; Andaur Navarro, C.; Dhiman, P.; Beam, A.L.; Van Calster, B.; Celi, L.A.; Denaxas, S.; et al. PROBAST+AI: An updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods. BMJ 2025, 388, e082505. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Riley, R.D.; Archer, L.; Snell, K.I.E.; Ensor, J.; Dhiman, P.; Martin, G.P.; Bonnett, L.J.; Collins, G.S. Evaluation of clinical prediction models (part 2): How to undertake an external validation study. BMJ 2024, 384, e074820. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Saito, T.; Rehmsmeier, M. The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PLoS ONE 2015, 10, e0118432. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Collins, G.S.; Dhiman, P.; Ma, J.; Schlussel, M.M.; Archer, L.; Van Calster, B.; Harrell, F.E.; Martin, G.P.; Moons, K.G.M.; van Smeden, M.; et al. Evaluation of clinical prediction models (part 1): From development to external validation. BMJ 2024, 384, e074819. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Endo, K.; Yamamoto, N.; Taito, S.; Tsuge, T.; Nakashima, Y.; Suzuki, K.; Kaneko, T.; Okoshi, K. Classifications and treatment management of fragility fracture of the pelvis: A scoping review. Injury 2025, 56, 112206. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Zhang, J.; Zhang, L.; Li, C.; Chai, W.; Zhang, L.; Chen, H.; Zhang, W.; Hou, Z.; Chen, B.; Sun, T.; et al. Clinical Guidelines for the Diagnosis and Treatment of Fragility Fractures of the Pelvis. Orthop. Surg. 2023, 15, 2195–2212. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- LeBoff, M.S.; Greenspan, S.L.; Insogna, K.L.; Lewiecki, E.M.; Saag, K.G.; Singer, A.J.; Siris, E.S. The clinician’s guide to prevention and treatment of osteoporosis. Osteoporos. Int. 2022, 33, 2049–2102. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hillier, T.A.; Cauley, J.A.; Rizzo, J.H.; Pedula, K.L.; Ensrud, K.E.; Bauer, D.C.; Lui, L.-Y.; Vesco, K.K.; Black, D.M.; Donaldson, M.G.; et al. WHO absolute fracture risk models (FRAX): Do clinical risk factors improve fracture prediction in older women without osteoporosis? J. Bone Miner. Res. 2011, 26, 1774–1782. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- van der Ploeg, T.; Austin, P.C.; Steyerberg, E.W. Modern modelling techniques are data hungry: A simulation study for predicting dichotomous endpoints. BMC Med. Res. Methodol. 2014, 14, 137. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Christodoulou, E.; Ma, J.; Collins, G.S.; Steyerberg, E.W.; Verbakel, J.Y.; Van Calster, B. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J. Clin. Epidemiol. 2019, 110, 12–22. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- von Elm, E.; Altman, D.G.; Egger, M.; Pocock, S.J.; Gøtzsche, P.C.; Vandenbroucke, J.P. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. Lancet 2007, 370, 1453–1457. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Efthimiou, O.; Seo, M.; Chalkou, K.; Debray, T.; Egger, M.; Salanti, G. Developing clinical prediction models: A step-by-step guide. BMJ 2024, 386, e078276. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Sterne, J.A.C.; White, I.R.; Carlin, J.B.; Spratt, M.; Royston, P.; Kenward, M.G.; Wood, A.M.; Carpenter, J.R. Multiple imputation for missing data in epidemiological and clinical research: Potential and pitfalls. BMJ 2009, 338, b2393. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kleeblad, L.J.; Loggers, S.A.I.; Zuidema, W.P.; van Embden, D.; Miclau, T.; Ponsen, K.-J. Current consensus and clinical approach to fragility fractures of the pelvis: An international survey of expert opinion. OTA Int. 2023, 6, e293. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rommens, P.M.; Arand, C.; Hopf, J.C.; Mehling, I.; Dietz, S.O.; Wagner, D. Progress of instability in fragility fractures of the pelvis: An observational study. Injury 2019, 50, 1966–1973. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Thomas, S.; Korrapati, A.; O’Leary, B.; Haaland, C.; Schwartz, A.K.; Kent, W.T. Risk Factors for Readmission Following Elderly Low Energy Pelvis Fractures. Geriatr. Orthop. Surg. Rehabil. 2025, 16, 21514593251350498. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rommens, P.M.; Hofmann, A.; Kraemer, S.; Kisilak, M.; Boudissa, M.; Wagner, D. Operative treatment of fragility fractures of the pelvis: A critical analysis of 140 patients. Eur. J. Trauma Emerg. Surg. 2021, 48, 2881–2896. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Reito, A.; Kuoppala, M.; Pajulammi, H.; Hokkinen, L.; Kyrölä, K.; Paloneva, J. Mortality and comorbidity after non-operatively managed, low-energy pelvic fracture in patients over age 70: A comparison with an age-matched femoral neck fracture cohort and general population. BMC Geriatr. 2019, 19, 315. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Oka, S.; Inoue, N.; Takefuji, Y. Beyond predictive accuracy: Statistical validation of feature importance in biomedical machine learning. Comput. Methods Programs Biomed. 2025, 272, 109085. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Strobl, C.; Boulesteix, A.-L.; Kneib, T.; Augustin, T.; Zeileis, A. Conditional variable importance for random forests. BMC Bioinform. 2008, 9, 307. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Vasikaran, S.; Eastell, R.; Bruyère, O.; Foldes, A.J.; Garnero, P.; Griesmacher, A.; McClung, M.; Morris, H.A.; Silverman, S.; Trenti, T.; et al. Markers of bone turnover for the prediction of fracture risk and monitoring of osteoporosis treatment: A need for international reference standards. Osteoporos. Int. 2010, 22, 391–420. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kappen, T.H.; van Klei, W.A.; van Wolfswinkel, L.; Kalkman, C.J.; Vergouwe, Y.; Moons, K.G.M. Evaluating the impact of prediction models: Lessons learned, challenges, and recommendations. Diagn. Progn. Res. 2018, 2, 11. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Vickers, A.J.; Van Calster, B.; Steyerberg, E.W. Net benefit approaches to the evaluation of prediction models, molecular markers, and diagnostic tests. BMJ 2016, 352, i6. [Google Scholar] [CrossRef] [Scilit] [PubMed]






| Characteristic | Overall (n = 1684) | No TF90 (n = 1377) | TF90 (n = 307) | |SMD| | p |
|---|---|---|---|---|---|
| Age, years | 80.9 (7.3) | 80.1 (7.1) | 84.5 (6.9) | 0.63 | <0.001 |
| Female sex | 1235 (73.3) | 1011 (73.4) | 224 (73.0) | 0.01 | 0.870 |
| Body mass index, kg m−2 | 23.2 (3.3) | 23.2 (3.2) | 23.5 (3.4) | 0.08 | 0.235 |
| Charlson Comorbidity Index | 2.0 [1.0–4.0] | 2.0 [1.0–3.0] | 3.0 [2.0–4.0] | 0.46 | <0.001 |
| Clinical Frailty Scale | 5.0 [4.0–6.0] | 4.0 [4.0–5.0] | 5.0 [5.0–6.0] | 0.70 | <0.001 |
| ASA class III–V | 1236 (73.4) | 991 (72.0) | 245 (79.8) | 0.18 | 0.005 |
| Assisted living or nursing home | 1006 (59.7) | 800 (58.1) | 206 (67.1) | 0.19 | 0.004 |
| Cane/walker or wheelchair/bed-to-chair before injury | 790 (46.9) | 616 (44.7) | 174 (56.7) | 0.24 | <0.001 |
| Admission pain NRS | 7.1 (1.4) | 7.2 (1.4) | 7.1 (1.4) | 0.05 | 0.606 |
| Haemoglobin, g L−1 | 119.7 (15.9) | 120.2 (15.8) | 117.5 (16.0) | 0.17 | 0.008 |
| C-reactive protein, mg L−1 | 20.8 [12.4–33.8] | 19.4 [11.5–32.2] | 25.4 [16.6–39.8] | 0.38 | <0.001 |
| Albumin, g L−1 | 36.1 (3.8) | 36.4 (3.8) | 34.9 (3.6) | 0.38 | <0.001 |
| eGFR, mL min−1 1.73 m−2 | 68.7 (15.7) | 70.1 (15.6) | 62.3 (14.8) | 0.51 | <0.001 |
| Known osteoporosis | 923 (54.8) | 742 (53.9) | 181 (59.0) | 0.10 | 0.106 |
| Pre-injury anti-osteoporosis pharmacotherapy | 245 (14.5) | 192 (13.9) | 53 (17.3) | 0.09 | 0.136 |
| DXA lumbar or hip T-score | −3.0 (0.7) | −3.0 (0.7) | −3.0 (0.7) | 0.08 | 0.322 |
| 25-hydroxyvitamin D, ng mL−1 | 20.5 (7.2) | 20.9 (7.1) | 18.7 (7.4) | 0.29 | <0.001 |
| β-CTX, ng mL−1 | 0.5 [0.4–0.7] | 0.5 [0.4–0.7] | 0.5 [0.4–0.7] | 0.03 | 0.520 |
| Characteristic | Overall (n = 1684) | No TF90 (n = 1377) | TF90 (n = 307) | |SMD| | p |
|---|---|---|---|---|---|
| Maximum fracture displacement, mm | 5.0 (3.2) | 4.7 (3.1) | 6.3 (3.5) | 0.47 | <0.001 |
| Pelvic Ring Instability score (0–10) | 5.0 (2.8) | 4.7 (2.7) | 6.3 (2.6) | 0.61 | <0.001 |
| FFP category | 0.44 | <0.001 | |||
| I | 297 (17.6) | 273 (19.8) | 24 (7.8) | ||
| II | 808 (48.0) | 702 (51.0) | 106 (34.5) | ||
| III | 355 (21.1) | 261 (19.0) | 94 (30.6) | ||
| IV | 224 (13.3) | 141 (10.2) | 83 (27.0) | ||
| Posterior ring involvement | 1387 (82.4) | 1104 (80.2) | 283 (92.2) | 0.35 | <0.001 |
| Bilateral posterior ring involvement | 597 (35.5) | 430 (31.2) | 167 (54.4) | 0.48 | <0.001 |
| H- or U-shaped sacral fracture | 110 (6.5) | 73 (5.3) | 37 (12.1) | 0.24 | <0.001 |
| Any pubic ramus fracture | 1610 (95.6) | 1308 (95.0) | 302 (98.4) | 0.19 | 0.009 |
| Bilateral pubic ramus fracture | 765 (45.4) | 586 (42.6) | 179 (58.3) | 0.32 | <0.001 |
| Any sacral ala fracture | 1387 (82.4) | 1104 (80.2) | 283 (92.2) | 0.35 | <0.001 |
| Bilateral sacral ala fracture | 661 (39.3) | 501 (36.4) | 160 (52.1) | 0.32 | <0.001 |
| Acetabular involvement | 117 (6.9) | 84 (6.1) | 33 (10.7) | 0.17 | 0.004 |
| L5 transverse-process fracture | 231 (13.7) | 186 (13.5) | 45 (14.7) | 0.03 | 0.596 |
| Initial operative treatment | 776 (46.1) | 639 (46.4) | 137 (44.6) | 0.04 | 0.572 |
| Initial treatment strategy | 0.12 | 0.252 | |||
| Conservative | 908 (53.9) | 738 (53.6) | 170 (55.4) | ||
| Percutaneous SI screw | 249 (14.8) | 214 (15.5) | 35 (11.4) | ||
| Sacroplasty | 149 (8.8) | 125 (9.1) | 24 (7.8) | ||
| Anterior ring fixation | 148 (8.8) | 122 (8.9) | 26 (8.5) | ||
| Combined anterior-posterior fixation | 160 (9.5) | 123 (8.9) | 37 (12.1) | ||
| Lumbopelvic fixation | 70 (4.2) | 55 (4.0) | 15 (4.9) |
| Model | Cohort | N | Events, n (%) | AUROC (95% CI) | AUPRC (95% CI) | Brier Score (95% CI) | Calibration Intercept (95% CI) | Calibration Slope (95% CI) |
|---|---|---|---|---|---|---|---|---|
| Simple logistic | Development OOF | 985 | 191 (19.4) | 0.739 (0.703–0.782) | 0.381 (0.328–0.456) | 0.139 (0.126–0.153) | 0.00 (−0.30–0.35) | 1.00 (0.80–1.23) |
| Simple logistic | Temporal validation | 520 | 80 (15.4) | 0.732 (0.674–0.790) | 0.342 (0.260–0.444) | 0.119 (0.104–0.137) | −0.20 (−0.68–0.29) | 1.04 (0.76–1.41) |
| Simple logistic | Internal–external | 179 | 36 (20.1) | 0.731 (0.639–0.816) | 0.378 (0.259–0.558) | 0.149 (0.110–0.187) | 0.36 (−0.57–1.54) | 1.03 (0.54–1.68) |
| Core logistic | Development OOF | 985 | 191 (19.4) | 0.734 (0.693–0.768) | 0.381 (0.324–0.455) | 0.140 (0.127–0.155) | 0.00 (−0.28–0.34) | 1.00 (0.81–1.21) |
| Core logistic | Temporal validation | 520 | 80 (15.4) | 0.763 (0.709–0.819) | 0.398 (0.304–0.521) | 0.114 (0.095–0.129) | −0.07 (−0.46–0.41) | 1.17 (0.89–1.53) |
| Core logistic | Internal–external | 179 | 36 (20.1) | 0.720 (0.635–0.804) | 0.338 (0.243–0.502) | 0.153 (0.115–0.190) | 0.18 (−0.57–1.19) | 0.92 (0.50–1.48) |
| Core RF | Development OOF | 985 | 191 (19.4) | 0.716 (0.675–0.757) | 0.370 (0.310–0.440) | 0.141 (0.127–0.154) | 0.00 (−0.33–0.31) | 1.00 (0.79–1.24) |
| Core RF | Temporal validation | 520 | 80 (15.4) | 0.759 (0.695–0.814) | 0.395 (0.288–0.508) | 0.115 (0.099–0.132) | 0.00 (−0.51–0.48) | 1.27 (0.90–1.64) |
| Core RF | Internal–external | 179 | 36 (20.1) | 0.745 (0.648–0.830) | 0.375 (0.251–0.535) | 0.145 (0.105–0.183) | 0.37 (−0.63–1.32) | 1.14 (0.62–1.80) |
| Extended RF | Development OOF | 985 | 191 (19.4) | 0.724 (0.686–0.762) | 0.369 (0.306–0.446) | 0.141 (0.127–0.155) | 0.00 (−0.31–0.33) | 1.00 (0.81–1.24) |
| Extended RF | Temporal validation | 520 | 80 (15.4) | 0.755 (0.697–0.811) | 0.402 (0.308–0.506) | 0.116 (0.099–0.131) | −0.05 (−0.51–0.45) | 1.22 (0.89–1.65) |
| Extended RF | Internal–external | 179 | 36 (20.1) | 0.751 (0.666–0.826) | 0.379 (0.278–0.562) | 0.145 (0.114–0.180) | 0.33 (−0.44–1.40) | 1.12 (0.66–1.74) |
| Cohort | Comparison | ΔAUROC (95% CI) | p | ΔAUPRC (95% CI) | p | ΔBrier (95% CI) | p |
|---|---|---|---|---|---|---|---|
| Temporal validation | Core logistic vs. Simple logistic | +0.032 (+0.001 to +0.061) | 0.047 | +0.056 (−0.002 to +0.112) | 0.077 | −0.005 (−0.009 to −0.000) | 0.033 |
| Temporal validation | Core RF vs. Simple logistic | +0.027 (−0.001 to +0.052) | 0.060 | +0.053 (−0.001 to +0.115) | 0.060 | −0.004 (−0.008 to +0.000) | 0.070 |
| Temporal validation | Extended RF vs. Core RF | −0.004 (−0.020 to +0.011) | 0.636 | +0.007 (−0.048 to +0.045) | 0.885 | +0.001 (−0.001 to +0.003) | 0.369 |
| Internal–external | Core logistic vs. Simple logistic | −0.011 (−0.057 to +0.032) | 0.639 | −0.040 (−0.110 to +0.012) | 0.136 | +0.004 (−0.002 to +0.011) | 0.246 |
| Internal–external | Core RF vs. Simple logistic | +0.014 (−0.029 to +0.063) | 0.552 | −0.003 (−0.070 to +0.052) | 0.895 | −0.004 (−0.011 to +0.003) | 0.270 |
| Internal–external | Extended RF vs. Core RF | +0.006 (−0.017 to +0.033) | 0.566 | +0.003 (−0.026 to +0.033) | 0.855 | +0.000 (−0.003 to +0.003) | 0.968 |
| Held-Out Centre | N | Events, n (%) | AUROC (95% CI) | AUPRC (95% CI) | Brier Score (95% CI) | Calibration Intercept (95% CI) | Calibration Slope (95% CI) |
|---|---|---|---|---|---|---|---|
| Centre A | 497 | 88 (17.7) | 0.758 (0.700–0.815) | 0.416 (0.336–0.530) | 0.126 (0.108–0.144) | 0.22 (−0.32–0.68) | 1.34 (0.99–1.78) |
| Centre B | 405 | 71 (17.5) | 0.728 (0.671–0.789) | 0.349 (0.270–0.452) | 0.132 (0.111–0.151) | −0.09 (−0.51–0.38) | 1.01 (0.75–1.38) |
| Centre C | 335 | 62 (18.5) | 0.714 (0.645–0.768) | 0.379 (0.281–0.503) | 0.138 (0.116–0.165) | −0.21 (−0.70–0.31) | 0.85 (0.57–1.13) |
| Centre D | 268 | 50 (18.7) | 0.739 (0.645–0.801) | 0.418 (0.313–0.599) | 0.132 (0.106–0.159) | 0.17 (−0.55–0.82) | 1.13 (0.69–1.58) |
| Centre E | 179 | 36 (20.1) | 0.727 (0.642–0.799) | 0.373 (0.261–0.526) | 0.148 (0.108–0.183) | 0.26 (−0.50–1.02) | 0.98 (0.57–1.40) |
| Endpoint | Cohort | N | Events, n (%) | AUROC (95% CI) | AUPRC (95% CI) | Brier Score (95% CI) | Calibration Slope (95% CI) |
|---|---|---|---|---|---|---|---|
| Primary TF90 (any of six) | Development OOF | 985 | 191 (19.4) | 0.716 (0.675–0.757) | 0.370 (0.310–0.440) | 0.141 (0.127–0.154) | 1.00 (0.79–1.24) |
| Primary TF90 (any of six) | Temporal validation | 520 | 80 (15.4) | 0.759 (0.695–0.814) | 0.395 (0.288–0.508) | 0.115 (0.099–0.132) | 1.27 (0.90–1.64) |
| Primary TF90 (any of six) | Internal–external | 179 | 36 (20.1) | 0.745 (0.648–0.830) | 0.375 (0.251–0.535) | 0.145 (0.105–0.183) | 1.14 (0.62–1.80) |
| Objective composite | Development OOF | 985 | 156 (15.8) | 0.702 (0.657–0.741) | 0.268 (0.220–0.331) | 0.125 (0.112–0.142) | 1.00 (0.74–1.26) |
| Objective composite | Temporal validation | 520 | 71 (13.7) | 0.735 (0.667–0.791) | 0.332 (0.243–0.444) | 0.108 (0.095–0.125) | 1.26 (0.85–1.70) |
| Objective composite | Internal–external | 179 | 26 (14.5) | 0.739 (0.657–0.810) | 0.273 (0.180–0.408) | 0.115 (0.088–0.147) | 1.25 (0.74–1.84) |
| Major clinical event | Development OOF | 985 | 138 (14.0) | 0.682 (0.631–0.726) | 0.230 (0.193–0.288) | 0.115 (0.100–0.131) | 1.00 (0.71–1.29) |
| Major clinical event | Temporal validation | 520 | 56 (10.8) | 0.742 (0.679–0.801) | 0.271 (0.192–0.392) | 0.090 (0.075–0.108) | 1.48 (1.01–2.01) |
| Major clinical event | Internal–external | 179 | 17 (9.5) | 0.699 (0.589–0.822) | 0.184 (0.101–0.369) | 0.085 (0.059–0.117) | 1.16 (0.55–2.31) |
| Hard procedural/death endpoint | Development OOF | 985 | 104 (10.6) | 0.683 (0.637–0.727) | 0.170 (0.135–0.221) | 0.091 (0.077–0.103) | 1.00 (0.71–1.28) |
| Hard procedural/death endpoint | Temporal validation | 520 | 47 (9.0) | 0.772 (0.700–0.836) | 0.277 (0.184–0.401) | 0.076 (0.061–0.095) | 1.73 (1.13–2.46) |
| Hard procedural/death endpoint | Internal–external | 179 | 13 (7.3) | 0.711 (0.570–0.850) | 0.162 (0.080–0.358) | 0.066 (0.039–0.092) | 1.25 (0.49–2.80) |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Wang, K.; Cao, Y.; Gao, N.; Ma, C.; Wang, J.; Xia, Z.; Gui, A.; Liu, Y.; Weng, Y. Explainable Multimodal Machine Learning Predicts 90-Day Treatment Failure in Older Patients with Fragility Fractures of the Pelvis. J. Clin. Med. 2026, 15, 6487. https://doi.org/10.3390/jcm15166487
Wang K, Cao Y, Gao N, Ma C, Wang J, Xia Z, Gui A, Liu Y, Weng Y. Explainable Multimodal Machine Learning Predicts 90-Day Treatment Failure in Older Patients with Fragility Fractures of the Pelvis. Journal of Clinical Medicine. 2026; 15(16):6487. https://doi.org/10.3390/jcm15166487
Chicago/Turabian StyleWang, Kangwei, Yulin Cao, Nan Gao, Cong Ma, Jianwen Wang, Zishen Xia, Aiwen Gui, Yong Liu, and Yuxiong Weng. 2026. "Explainable Multimodal Machine Learning Predicts 90-Day Treatment Failure in Older Patients with Fragility Fractures of the Pelvis" Journal of Clinical Medicine 15, no. 16: 6487. https://doi.org/10.3390/jcm15166487
APA StyleWang, K., Cao, Y., Gao, N., Ma, C., Wang, J., Xia, Z., Gui, A., Liu, Y., & Weng, Y. (2026). Explainable Multimodal Machine Learning Predicts 90-Day Treatment Failure in Older Patients with Fragility Fractures of the Pelvis. Journal of Clinical Medicine, 15(16), 6487. https://doi.org/10.3390/jcm15166487
