CT Radiomics Models Did Not Outperform Experts in Predicting [68Ga]Ga-PSMA-PET Positivity in Prostate Cancer Lymph Node Staging
Simple Summary
Abstract
1. Introduction
2. Materials and Methods
2.1. Study Design and Population
2.2. [68Ga]Ga-PSMA PET/CT Imaging Protocol
2.3. Patient Cohort and Segmentation
2.4. Data Curation and Annotation
2.5. Data Extraction and Partitioning
- 0—very likely benign LN
- 1—probably benign LN
- 2—probably malignant LN
- 3—very likely malignant LN
- 1—very likely benign and probably benign LN
- 2—very likely malignant and probably malignant LN
2.6. Statistical Analysis
3. Results
3.1. Feature Selection Results
3.2. Single Parameter Performance: Median Hu Value
3.3. Calibration and Brier Scores
3.4. Confusion Matrix Analysis
3.5. Model Robustness and Performance
3.5.1. Model Performance on the Independent Test Set
- LDA: ACC = 0.83–0.85, Sensitivity = 0.87–0.90, Specificity = 0.82–0.85.
- LR: ACC = 0.82–0.83, Sensitivity = 0.87–0.91, Specificity = 0.80–0.82.
- SVM: ACC = 0.82–0.84, Sensitivity = 0.87, Specificity = 0.81–0.83.
- MLP: ACC = 0.77–0.80, Sensitivity = 0.85–0.91, Specificity = 0.74–0.79.
- RPART: ACC = 0.77–0.80, Sensitivity = 0.87–0.91, Specificity = 0.74.
3.5.2. Comparison with Expert Radiologists
4. Discussion
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| ACC | accuracy |
| CT | computed tomography |
| HU | Hounsfield unit |
| LDA | linear discriminant analysis |
| LN | lymph node |
| LR | logistic regression |
| MI | mutual information |
| MLP | multilayer perceptron |
| MRMI | maximum relevance minimum redundancy |
| NPV | negative predictive value |
| PCa | prostate cancer |
| PET | positron emission tomography |
| PLS | partial least squares |
| RPART | recursive partition |
| PPV | positive predictive value |
| PSMA | prostate-specific membrane antigen |
| ROC | receiver-operating characteristic curves |
| SVM | support vector machines |
| WLCX | Wilcoxon |
References
- Ferlay, J.; Steliarova-Foucher, E.; Lortet-Tieulent, J.; Rosso, S.; Coebergh, J.W.; Comber, H.; Forman, D.; Bray, F. Cancer incidence and mortality patterns in Europe: Estimates for 40 countries in 2012. Eur. J. Cancer 2013, 49, 1374–1403. [Google Scholar] [CrossRef] [PubMed]
- Pfister, D.; Porres, D.; Heidenreich, A.; Heidegger, I.; Knuechel, R.; Steib, F.; Behrendt, F.F.; Verburg, F.A. Detection of recurrent prostate cancer lesions before salvage lymphadenectomy is more accurate with (68)Ga-PSMA-HBED-CC than with (18)F-Fluoroethylcholine PET/CT. Eur. J. Nucl. Med. Mol. Imaging 2016, 43, 1410–1417. [Google Scholar] [CrossRef] [PubMed]
- Hofman, M.S.; Lawrentschuk, N.; Francis, R.J.; Tang, C.; Vela, I.; Thomas, P.; Rutherford, N.; Martin, J.M.; Frydenberg, M.; Shakher, R.; et al. Prostate-specific membrane antigen PET-CT in patients with high-risk prostate cancer before curative-intent surgery or radiotherapy (proPSMA): A prospective, randomised, multicentre study. Lancet 2020, 395, 1208–1216. [Google Scholar] [CrossRef] [PubMed]
- Sprute, K.; Kramer, V.; Koerber, S.A.; Meneses, M.; Fernandez, R.; Soza-Ried, C.; Eiber, M.; Weber, W.A.; Rauscher, I.; Rahbar, K.; et al. Diagnostic Accuracy of (18)F-PSMA-1007 PET/CT Imaging for Lymph Node Staging of Prostate Carcinoma in Primary and Biochemical Recurrence. J. Nucl. Med. 2021, 62, 208–213. [Google Scholar] [CrossRef]
- Giesel, F.L.; Schneider, F.; Kratochwil, C.; Rath, D.; Moltz, J.; Holland-Letz, T.; Kauczor, H.-U.; Schwartz, L.H.; Haberkorn, U.; Flechsig, P. Correlation Between SUVmax and CT Radiomic Analysis Using Lymph Node Density in PET/CT-Based Lymph Node Staging. J. Nucl. Med. 2017, 58, 282–287. [Google Scholar] [CrossRef]
- Hope, T.A.; Eiber, M.; Armstrong, W.R.; Juarez, R.; Murthy, V.; Lawhn-Heath, C.; Behr, S.C.; Zhang, L.; Barbato, F.; Ceci, F.; et al. Diagnostic Accuracy of 68Ga-PSMA-11 PET for Pelvic Nodal Metastasis Detection Prior to Radical Prostatectomy and Pelvic Lymph Node Dissection: A Multicenter Prospective Phase 3 Imaging Trial. JAMA Oncol. 2021, 7, 1635–1642. [Google Scholar] [CrossRef]
- International Atomic Energy Agency. PET Scanners (per 1 mil); IAEA—International Atomic Energy Agency: Vienna, Austria, 2024. [Google Scholar]
- World Health Organization. Global Atlas of Medical Devices 2022; World Health Organization: Genève, Switzerland, 2022. [Google Scholar]
- Holzgreve, A.; Unterrainer, M.; Calais, J.; Adams, T.; Oprea-Lager, D.E.; Goffin, K.; Lopci, E.; Unterrainer, L.M.; Kramer, K.K.M.; Schmidt-Hegemann, N.-S.; et al. Is PSMA PET/CT cost-effective for the primary staging in prostate cancer? First results for European countries and the USA based on the proPSMA trial. Eur. J. Nucl. Med. Mol. Imaging 2023, 50, 3750–3754. [Google Scholar] [CrossRef]
- Fusco, R.; Granata, V.; Grazzini, G.; Pradella, S.; Borgheresi, A.; Bruno, A.; Palumbo, P.; Bruno, F.; Grassi, R.; Giovagnoni, A.; et al. Radiomics in medical imaging: Pitfalls and challenges in clinical management. Jpn. J. Radiol. 2022, 40, 919–929. [Google Scholar] [CrossRef]
- Aerts, H.J.W.L.; Velazquez, E.R.; Leijenaar, R.T.H.; Parmar, C.; Grossmann, P.; Carvalho, S.; Bussink, J.; Monshouwer, R.; Haibe-Kains, B.; Rietveld, D.; et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat. Commun. 2014, 5, 4006. [Google Scholar] [CrossRef]
- Peeken, J.C.; Shouman, M.A.; Kroenke, M.; Rauscher, I.; Maurer, T.; Gschwend, J.E.; Eiber, M.; Combs, S.E. A CT-based radiomics model to detect prostate cancer lymph node metastases in PSMA radioguided surgery patients. Eur. J. Nucl. Med. Mol. Imaging 2020, 47, 2968–2977. [Google Scholar] [CrossRef]
- Kendrick, J.; Francis, R.; Hassan, G.M.; Rowshanfarzad, P.; Jeraj, R.; Kasisi, C.; Rusanov, B.; Ebert, M. Radiomics for Identification and Prediction in Metastatic Prostate Cancer: A Review of Studies. Front. Oncol. 2021, 11, 771787. [Google Scholar] [CrossRef] [PubMed]
- van Leeuwen, P.J.; Emmett, L.; Ho, B.; Delprado, W.; Ting, F.; Nguyen, Q.; Stricker, P.D. Prospective evaluation of 68Gallium-prostate-specific membrane antigen positron emission tomography/computed tomography for preoperative lymph node staging in prostate cancer. BJU Int. 2017, 119, 209–215. [Google Scholar] [CrossRef] [PubMed]
- Vinsensia, M.; Chyoke, P.L.; Hadaschik, B.; Holland-Letz, T.; Moltz, J.; Kopka, K.; Rauscher, I.; Mier, W.; Schwaiger, M.; Haberkorn, U.; et al. (68)Ga-PSMA PET/CT and Volumetric Morphology of PET-Positive Lymph Nodes Stratified by Tumor Differentiation of Prostate Cancer. J. Nucl. Med. 2017, 58, 1949–1955. [Google Scholar] [CrossRef] [PubMed]
- van Griethuysen, J.J.M.; Fedorov, A.; Parmar, C.; Hosny, A.; Aucoin, N.; Narayan, V.; Beets-Tan, R.G.; Fillion-Robin, J.C.; Pieper, S.; Aerts, H.J. Computational Radiomics System to Decode the Radiographic Phenotype. Cancer Res. 2017, 77, e104–e107. [Google Scholar] [CrossRef]
- Lowekamp, B.C.; Chen, D.T.; Ibanez, L.; Blezek, D. The Design of SimpleITK. Front. Neuroinform. 2013, 7, 45. [Google Scholar] [CrossRef]
- R-Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2017. [Google Scholar]
- Flechsig, P.; Frank, P.; Kratochwil, C.; Antoch, G.; Rath, D.; Moltz, J.; Rieser, M.; Warth, A.; Kauczor, H.-U.; Schwartz, L.H.; et al. Radiomic Analysis using Density Threshold for FDG-PET/CT-Based N-Staging in Lung Cancer Patients. Mol. Imaging Biol. 2017, 19, 315–322. [Google Scholar] [CrossRef]
- Puesken, M.; Buerke, B.; Gerss, J.; Frisch, B.; Beyer, F.; Weckesser, M.; Seifarth, H.; Heindel, W.; Wessling, J. Prediction of lymph node manifestations in malignant lymphoma: Significant role of volumetric compared with established metric lymph node analysis in multislice computed tomography. J. Comput. Assist. Tomogr. 2010, 34, 564–569. [Google Scholar] [CrossRef]
- Sugai, K.; Sekine, Y.; Kawamura, T.; Yanagihara, T.; Saeki, Y.; Kitazawa, S.; Kobayashi, N.; Kikuchi, S.; Goto, Y.; Ichimura, H.; et al. Sphericity of lymph nodes using 3D-CT predicts metastasis in lung cancer patients. Cancer Imaging 2023, 23, 124. [Google Scholar] [CrossRef]
- Hovels, A.M.; Heesakkers, R.A.; Adang, E.M.; Jager, G.J.; Strum, S.; Hoogeveen, Y.L.; Severens, J.; Barentsz, J. The diagnostic accuracy of CT and MRI in the staging of pelvic lymph nodes in patients with prostate cancer: A meta-analysis. Clin. Radiol. 2008, 63, 387–395. [Google Scholar] [CrossRef]
- Heesakkers, R.A.; Hovels, A.M.; Jager, G.J.; van den Bosch, H.C.; Witjes, J.A.; Raat, H.P.; Severens, J.L.; Adang, E.M.; van der Kaa, C.H.; Fütterer, J.J.; et al. MRI with a lymph-node-specific contrast agent as an alternative to CT scan and lymph-node dissection in patients with prostate cancer: A prospective multicohort study. Lancet Oncol. 2008, 9, 850–856. [Google Scholar] [CrossRef]
- Daouacher, G.; Carlsson, J.; Voulgarakis, N.; Papageorgiou, S.; Dahlman, P.; Sundqvist, P.; Waldén, M. Diagnostic performance of conventional MRI using T1W and T2W for primary lymph node staging in intermediate- and high-risk prostate cancer patients prior to pelvic lymph node dissection. Abdom. Radiol. 2026, 51, 206–213. [Google Scholar] [CrossRef] [PubMed]
- Lennartz, S.; Tager, P.; Zopfs, D.; Iuga, A.I.; Reimer, R.P.; Zaske, C.; Hokamp, N.G.; Maintz, D.; Heidenreich, A.; Drzezga, A.; et al. Lymph Node Assessment in Prostate Cancer: Evaluation of Iodine Quantification With Spectral Detector CT in Correlation to PSMA PET/CT. Clin. Nucl. Med. 2021, 46, 303–309. [Google Scholar] [CrossRef] [PubMed]
- Henderson, M. Radiology Facing a Global Shortage—Speciality affected by COVID-19, aging population and demand for imaging. RSNA News, 10 May 2022. [Google Scholar]
- Demircioglu, A. Reproducibility and interpretability in radiomics: A critical assessment. Diagn. Interv. Radiol. 2025, 31, 321–328. [Google Scholar] [CrossRef]
- Liao, W.; Luo, X.; Li, L.; Xu, J.; He, Y.; Huang, H.; Zhang, S. Automatic cervical lymph nodes detection and segmentation in heterogeneous computed tomography images using deep transfer learning. Sci. Rep. 2025, 15, 4250. [Google Scholar] [CrossRef]
- Sun, Z.; Wu, P.; Zhao, T.; Gao, G.; Wang, H.; Zhang, X.; Wang, X. Deep learning-based fully automated detection and segmentation of pelvic lymph nodes on diffusion-weighted images for prostate cancer: A multicenter study. Cancer Imaging 2025, 25, 37. [Google Scholar] [CrossRef]
- Mofid, B.; Modarres Mosalla, S.M.; Goodarzi, M.; Tavakoli, H. Deep CNN-based Fully Automated Segmentation of Pelvic Multi-Organ on CT Images for Prostate Cancer Radiotherapy. J. Biomed. Phys. Eng. 2025, 15, 575–588. [Google Scholar]
- Hartenstein, A.; Lubbe, F.; Baur, A.D.J.; Rudolph, M.M.; Furth, C.; Brenner, W.; Amthauer, H.; Hamm, B.; Makowski, M.; Penzkofer, T. Prostate Cancer Nodal Staging: Using Deep Learning to Predict (68)Ga-PSMA-Positivity from CT Imaging Alone. Sci. Rep. 2020, 10, 3398. [Google Scholar] [CrossRef]
- Demircioglu, A. Are deep models in radiomics performing better than generic models? A systematic review. Eur. Radiol. Exp. 2023, 7, 11. [Google Scholar] [CrossRef]




| Classifier | FSM | Accuracy | Sensitivity | Specificity | PPV | NPV |
|---|---|---|---|---|---|---|
| LDA | WLCX | 0.84 | 0.88 | 0.84 | 0.51 | 0.97 |
| LDA | AUC | 0.83 | 0.88 | 0.82 | 0.49 | 0.97 |
| LDA | MI | 0.83 | 0.9 | 0.82 | 0.49 | 0.98 |
| LDA | MRMI | 0.83 | 0.87 | 0.82 | 0.48 | 0.97 |
| LR | WLCX | 0.82 | 0.87 | 0.81 | 0.47 | 0.97 |
| LR | AUC | 0.82 | 0.91 | 0.8 | 0.47 | 0.98 |
| LR | MI | 0.82 | 0.91 | 0.8 | 0.47 | 0.98 |
| LR | MRMI | 0.83 | 0.88 | 0.82 | 0.49 | 0.97 |
| PLS | WLCX | 0.85 | 0.87 | 0.85 | 0.53 | 0.97 |
| PLS | AUC | 0.82 | 0.87 | 0.81 | 0.47 | 0.97 |
| PLS | MI | 0.82 | 0.87 | 0.81 | 0.47 | 0.97 |
| PLS | MRMI | 0.83 | 0.87 | 0.82 | 0.48 | 0.97 |
| SVM | WLCX | 0.85 | 0.87 | 0.85 | 0.52 | 0.97 |
| SVM | AUC | 0.82 | 0.87 | 0.81 | 0.47 | 0.97 |
| SVM | MI | 0.82 | 0.87 | 0.81 | 0.47 | 0.97 |
| SVM | MRMI | 0.84 | 0.87 | 0.83 | 0.5 | 0.97 |
| MLP | WLCX | 0.78 | 0.87 | 0.76 | 0.41 | 0.97 |
| MLP | AUC | 0.82 | 0.85 | 0.81 | 0.47 | 0.97 |
| MLP | MI | 0.78 | 0.9 | 0.75 | 0.41 | 0.97 |
| MLP | MRMI | 0.8 | 0.9 | 0.79 | 0.45 | 0.98 |
| RPART | WLCX | 0.8 | 0.9 | 0.78 | 0.44 | 0.98 |
| RPART | AUC | 0.77 | 0.91 | 0.74 | 0.41 | 0.98 |
| RPART | MI | 0.77 | 0.91 | 0.74 | 0.41 | 0.98 |
| RPART | MRMI | 0.77 | 0.91 | 0.74 | 0.41 | 0.98 |
| Accuracy | Sensitivity | Specificity | PPV | NPV | |
|---|---|---|---|---|---|
| Reader 1 | 0.95 | 0.76 | 0.98 | 0.88 | 0.96 |
| Reader 2 | 0.95 | 0.76 | 0.97 | 0.84 | 0.96 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Walter-Rittel, T.C.; Gorodetski, B.; Hartenstein, A.; Rogasch, J.; Schatka, I.; Amthauer, H.; Makowski, M.; Hamm, C.A.; Penzkofer, T. CT Radiomics Models Did Not Outperform Experts in Predicting [68Ga]Ga-PSMA-PET Positivity in Prostate Cancer Lymph Node Staging. Curr. Oncol. 2026, 33, 146. https://doi.org/10.3390/curroncol33030146
Walter-Rittel TC, Gorodetski B, Hartenstein A, Rogasch J, Schatka I, Amthauer H, Makowski M, Hamm CA, Penzkofer T. CT Radiomics Models Did Not Outperform Experts in Predicting [68Ga]Ga-PSMA-PET Positivity in Prostate Cancer Lymph Node Staging. Current Oncology. 2026; 33(3):146. https://doi.org/10.3390/curroncol33030146
Chicago/Turabian StyleWalter-Rittel, Thula Cannon, Boris Gorodetski, Alexander Hartenstein, Julian Rogasch, Imke Schatka, Holger Amthauer, Marcus Makowski, Charlie Alexander Hamm, and Tobias Penzkofer. 2026. "CT Radiomics Models Did Not Outperform Experts in Predicting [68Ga]Ga-PSMA-PET Positivity in Prostate Cancer Lymph Node Staging" Current Oncology 33, no. 3: 146. https://doi.org/10.3390/curroncol33030146
APA StyleWalter-Rittel, T. C., Gorodetski, B., Hartenstein, A., Rogasch, J., Schatka, I., Amthauer, H., Makowski, M., Hamm, C. A., & Penzkofer, T. (2026). CT Radiomics Models Did Not Outperform Experts in Predicting [68Ga]Ga-PSMA-PET Positivity in Prostate Cancer Lymph Node Staging. Current Oncology, 33(3), 146. https://doi.org/10.3390/curroncol33030146

