Classification of Pancreatic Cancer and Normal Tissue in 2D and 3D Optical Coherence Tomography Images Using Convolutional Neural Networks: A Comparative Study
Simple Summary
Abstract
1. Introduction
2. Materials and Methods
2.1. Patient Cohort and Inclusion Criteria
2.2. Specimen Collection and Scanning
2.3. OCT Imaging System and Scan Settings
2.4. Sample Generation
2.5. Neural Network Analysis
3. Results
3.1. Specimen Statistics
3.2. Cross-Validation and Known-Data Test Results
3.3. Unknown Data/Test Set Results
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
| 2D | Two-dimensional |
| 3D | Three-dimensional |
| AI | Artificial Intelligence |
| CNR | Contrast-to-Noise Ratio |
| CNN | Convolutional Neural Network |
| CV | Cross-Validation |
| DL | Deep Learning |
| H&E | Hematoxylin and Eosin |
| ML | Machine Learning |
| OCT | Optical Coherence Tomography |
| PDAC | Pancreatic ductal adenocarcinoma |
References
- Bray, F.; Ferlay, J.; Soerjomataram, I.; Siegel, R.L.; Torre, L.A.; Jemal, A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA A Cancer J. Clin. 2018, 68, 394–424. [Google Scholar] [CrossRef]
- Carrato, A.; Falcone, A.; Ducreux, M.; Valle, J.W.; Parnaby, A.; Djazouli, K.; Alnwick-Allu, K.; Hutchings, A.; Palaska, C.; Parthenaki, I. A Systematic Review of the Burden of Pancreatic Cancer in Europe: Real-World Impact on Survival, Quality of Life and Costs. J. Gastrointest. Cancer 2015, 46, 201–211. [Google Scholar] [CrossRef]
- Luchini, C.; Capelli, P.; Scarpa, A. Pancreatic Ductal Adenocarcinoma and Its Variants. Surg. Pathol. Clin. 2016, 9, 547–560. [Google Scholar] [CrossRef] [PubMed]
- Conroy, T.; Pfeiffer, P.; Vilgrain, V.; Lamarca, A.; Seufferlein, T.; O’reilly, E.; Hackert, T.; Golan, T.; Prager, G.; Haustermans, K.; et al. Pancreatic cancer: ESMO Clinical Practice Guideline for diagnosis, treatment and follow-up. Ann. Oncol. 2023, 34, 987–1002. [Google Scholar] [CrossRef]
- Williams, M.D.; Bhama, A.R.; Naffouje, S.; Kamarajah, S.K.; Becerra, A.Z.; Zhang, Y.; Pappas, S.G.; Dahdaleh, F.S. Effect of Operative Time on Outcomes of Minimally Invasive Versus Open Pancreatoduodenectomy. J. Gastrointest. Surg. 2022, 27, 93–104. [Google Scholar] [CrossRef]
- Rau, B.M.; Moritz, K.; Schuschan, S.; Alsfasser, G.; Prall, F.; Klar, E. R1 resection in pancreatic cancer has significant impact on long-term outcome in standardized pathology modified for routine use. Surgery 2012, 152, S103–S111. [Google Scholar] [CrossRef]
- Garcia-Allende, P.B.; Amygdalos, I.; Dhanapala, H.; Goldin, R.D.; Hanna, G.B.; Elson, D.S. Morphological analysis of optical coherence tomography images for automated classification of gastrointestinal tissues. Biomed. Opt. Express 2011, 2, 2821–2836. [Google Scholar] [CrossRef] [PubMed]
- Wolff, L.I.; Hachgenei, E.; Goßmann, P.; Druzenko, M.; Frye, M.; König, N.; Schmitt, R.H.; Chrysos, A.; Jöchle, K.; Truhn, D.; et al. Optical coherence tomography combined with convolutional neural networks can differentiate between intrahepatic cholangiocarcinoma and liver parenchyma ex vivo. J. Cancer Res. Clin. Oncol. 2023, 149, 7877–7885. [Google Scholar] [CrossRef]
- Amygdalos, I.; Hachgenei, E.; Burkl, L.; Vargas, D.; Goßmann, P.; Wolff, L.I.; Druzenko, M.; Frye, M.; König, N.; Schmitt, R.H.; et al. Optical coherence tomography and convolutional neural networks can differentiate colorectal liver metastases from liver parenchyma ex vivo. J. Cancer Res. Clin. Oncol. 2022, 149, 3575–3586. [Google Scholar] [CrossRef]
- Gora, M.J.; Suter, M.J.; Tearney, G.J.; Li, X. Endoscopic optical coherence tomography: Technologies and clinical applications [Invited]. Biomed. Opt. Express 2017, 8, 2405–2444. [Google Scholar] [CrossRef]
- Alikarami, M.; Faraj, T.A.; Hama, N.H.; Hosseini, A.S.; Habibi, P.; Mosleh, I.S.; Alavi, M.; Kashani, M.; Aminnezhad, S. Artificial intelligence in advancing optical coherence tomography for disease detection and cancer diagnosis: A scoping review. Eur. J. Surg. Oncol. (EJSO) 2025, 51, 110188. [Google Scholar] [CrossRef]
- Weaver, H.L.; Fontes, G.S.; Shen, Y.; Jennings, R.; Lapsley, J.M.; Selmic, L.E. Polarisation Sensitive Optical Coherence Tomography Image Characteristics for Gastrointestinal Tumours and Normal Tissues at Surgical Margins in Dogs. Vet. Comp. Oncol. 2025, 23, 486–492. [Google Scholar] [CrossRef]
- van Manen, L.; Stegehuis, P.L.; Fariña-Sarasqueta, A.; de Haan, L.M.; Eggermont, J.; Bonsing, B.A.; Morreau, H.; Lelieveldt, B.P.F.; van de Velde, C.J.H.; Vahrmeijer, A.L.; et al. Validation of full-field optical coherence tomography in distinguishing malignant and benign tissue in resected pancreatic cancer specimens. PLoS ONE 2017, 12, e0175862. [Google Scholar] [CrossRef]
- Kist, M.; Strenge, P.; Keck, T.; Weber, A.; Bronsert, P.; Abdalla, T.S.A.; Wellner, U.F.; Thomaschewski, M. Intraoperative differentiation of pancreatic neoplastic lesions using optical coherence tomography (OCT). Langenbeck’s Arch. Surg. 2025, 410, 227. [Google Scholar] [CrossRef]
- Hwang, J.H.; Cobb, M.J.; Kimmey, M.B.; Li, X. Optical Coherence Tomography Imaging of the Pancreas: A Needle-Based Approach. Clin. Gastroenterol. Hepatol. 2005, 3, S49–S52. [Google Scholar] [CrossRef] [PubMed]
- Cizginer, S.; Deshpande, V.; Pitman, M.; Tatli, S.; Iftimia, N.-A.; Hammer, D.X.; Mujat, M.; Ustun, T.; Ferguson, R.D.; Brugge, W.R. Differentiation of pancreatic cysts with optical coherence tomography (OCT) imaging: An ex vivo pilot study. Biomed. Opt. Express 2011, 2, 2372–2382. [Google Scholar] [CrossRef] [PubMed]
- Mahmud, M.S.; May, G.R.; Kamal, M.M.; Khwaja, A.S.; Sun, C.; Vitkin, A.; Yang, V.X. Imaging pancreatobiliary ductal system with optical coherence tomography: A review. World J. Gastrointest. Endosc. 2013, 5, 540–550. [Google Scholar] [CrossRef]
- Tyberg, A.; Xu, M.-M.; Gaidhane, M.; Kahaleh, M. Second generation optical coherence tomography: Preliminary experience in pancreatic and biliary strictures. Dig. Liver Dis. 2018, 50, 1214–1217. [Google Scholar] [CrossRef]
- Movassagh, A.A.; Jajroudi, M.; Jafari, A.H.; Pour, E.K.; Farrokhpour, H.; Faghihi, H.; Riazi, H.; ArabAlibeik, H. Quantifying the Characteristics of Diabetic Retinopathy in Macular Optical Coherence Tomography Angiography Images: A Few-Shot Learning and Explainable Artificial Intelligence Approach. Cureus 2025, 17, e76746. [Google Scholar] [CrossRef] [PubMed]
- Wang, Y.; Chen, C.; Wang, Z.; Wu, Y.; Lu, H.; Xiong, J.; Sugisawa, K.; Kamoi, K.; Ohno-Matsui, K. Development of Deep Learning Models to Screen Posterior Staphylomas in Highly Myopic Eyes Using UWF-OCT Images. Transl. Vis. Sci. Technol. 2025, 14, 25. [Google Scholar] [CrossRef]
- Yao, H.; Wang, X.; Suo, Y.; He, J.; Chu, C.; Yang, Z.; Xu, Q.; Zhou, J.; Zhu, M.; Sun, X.; et al. Primary angle-closed diseases recognition through artificial intelligence-based anterior segment-optical coherence tomography imaging. Graefe’s Arch. Clin. Exp. Ophthalmol. 2024, 263, 1081–1087. [Google Scholar] [CrossRef]
- Mogler, C.; Flechtenmacher, C.; Schirmacher, P.; Bergmann, F. Schnellschnittdiagnostik in der Viszeralchirurgie: Leber, Gallenwege und Pankreas [Frozen section diagnostics in visceral surgery: Liver, bile ducts and pancreas]. Der Pathologe. 2012, 33, 413–423. (In German) [Google Scholar] [CrossRef]
- Singh, P.; Chak, A.; Willis, J.E.; Rollins, A.; Sivak, M.V. In vivo optical coherence tomography imaging of the pancreatic and biliary ductal system. Gastrointest. Endosc. 2005, 62, 970–974. [Google Scholar] [CrossRef]
- Yu, X.; Ding, Q.; Hu, C.; Mu, G.; Deng, Y.; Luo, Y.; Yuan, Z.; Yu, H.; Liu, L. Evaluating Micro-Optical Coherence Tomography as a Feasible Imaging Tool for Pancreatic Disease Diagnosis. IEEE J. Sel. Top. Quantum Electron. 2018, 25, 6800108. [Google Scholar] [CrossRef]
- Testoni, P.; Mariani, A.; Mangiavillano, B.; Albarello, L.; Arcidiacono, P.; Masci, E.; Doglioni, C. Main pancreatic duct, common bile duct and sphincter of Oddi structure visualized by optical coherence tomography: An ex vivo study compared with histology. Dig. Liver Dis. 2006, 38, 409–414. [Google Scholar] [CrossRef]
- Tabibian, J.H.; Visrodia, K.H.; Levy, M.J.; Gostout, C.J. Advanced endoscopic imaging of indeterminate biliary strictures. World J. Gastrointest. Endosc. 2015, 7, 1268–1278. [Google Scholar] [CrossRef]
- Joshi, V.; Patel, S.N.; Vanderveldt, H.; Oliva, I.; Raijman, I.; Molina, C.; Carr-Locke, D.L. Mo1963 A Pilot Study of Safety and Efficacy of Directed Cannulation With a Low Profile Catheter (LP) and Imaging Characteristics of Bile Duct Wall Using Optical Coherance Tomography (OCT) for Indeterminate Biliary Strictures Initial Report on In-Vivo Evaluation During ERCP. Gastrointest. Endosc. 2017, 85, AB496–AB497. [Google Scholar] [CrossRef]
- Luo, H.; Li, S.; Zeng, Y.; Cheema, H.; Otegbeye, E.; Ahmed, S.; Chapman, W.C.; Mutch, M.; Zhou, C.; Zhu, Q. Human colorectal cancer tissue assessment using optical coherence tomography catheter and deep learning. J. Biophotonics 2022, 15, e202100349. [Google Scholar] [CrossRef]
- Scholler, J.; Mandache, D.; Mathieu, M.C.; Ben Lakhdar, A.; Darche, M.; Monfort, T.; Boccara, C.; Olivo-Marin, J.-C.; Grieve, K.; Meas-Yedid, V.; et al. Automatic diagnosis and classification of breast surgical samples with dynamic full-field OCT and machine learning. J. Med. Imaging 2023, 10, 034504. [Google Scholar] [CrossRef] [PubMed]
- Rasel, R.K.; Wu, F.; Chiariglione, M.; Choi, S.S.; Doble, N.; Gao, X.R. Assessing the efficacy of 2D and 3D CNN algorithms in OCT-based glaucoma detection. Sci. Rep. 2024, 14, 11758. [Google Scholar] [CrossRef]
- Tampu, I.E.; Eklund, A.; Johansson, K.; Gimm, O.; Haj-Hosseini, N. Diseased thyroid tissue classification inOCTimages using deep learning: Towards surgical decision support. J. Biophotonics 2022, 16, e202200227. [Google Scholar] [CrossRef] [PubMed]
- Ly, S.; Badré, A.; Brandt, P.; Wang, C.; Calle, P.; Reynolds, J.; Zhang, Q.; Fung, K.; Cui, H.; Yu, Z.; et al. Deep Learning for Autonomous Surgical Guidance Using 3-Dimensional Images From Forward-Viewing Endoscopic Optical Coherence Tomography. J. Biophotonics 2025, 18, e202500181. [Google Scholar] [CrossRef] [PubMed]


| CNN, CV | Sensitivity/Recall | Specificity | PPV/Precision | NPV | Accuracy | F1-Score |
|---|---|---|---|---|---|---|
| DenseNet 2D CV1 | 0.55 | 0.92 | 0.88 | 0.65 | 0.73 | 0.68 |
| DenseNet 2D CV2 | 0.81 | 0.62 | 0.66 | 0.78 | 0.71 | 0.73 |
| DenseNet 2D CV3 | 0.95 | 0.83 | 0.83 | 0.95 | 0.89 | 0.89 |
| DenseNet 2D CV4 | 0.92 | 0.95 | 0.96 | 0.92 | 0.94 | 0.94 |
| DenseNet 2D CV5 | 0.61 | 0.75 | 0.64 | 0.72 | 0.69 | 0.62 |
| DenseNet 2D mean | 0.77 | 0.81 | 0.80 | 0.80 | 0.79 | 0.77 |
| DenseNet 3D CV1 | 0.62 | 0.97 | 0.96 | 0.70 | 0.79 | 0.76 |
| DenseNet 3D CV2 | 0.92 | 0.69 | 0.73 | 0.91 | 0.80 | 0.82 |
| DenseNet 3D CV3 | 0.99 | 0.89 | 0.89 | 0.99 | 0.94 | 0.94 |
| DenseNet 3D CV4 | 0.92 | 0.95 | 0.95 | 0.91 | 0.93 | 0.94 |
| DenseNet 3D CV5 | 0.65 | 0.86 | 0.79 | 0.80 | 0.80 | 0.71 |
| DenseNet 3D mean | 0.82 | 0.87 | 0.86 | 0.86 | 0.85 | 0.83 |
| ResNet 2D CV1 | 0.51 | 0.90 | 0.85 | 0.63 | 0.70 | 0.64 |
| ResNet 2D CV2 | 0.80 | 0.56 | 0.63 | 0.75 | 0.68 | 0.70 |
| ResNet 2D CV3 | 0.96 | 0.80 | 0.81 | 0.95 | 0.88 | 0.88 |
| ResNet 2D CV4 | 0.85 | 0.97 | 0.97 | 0.85 | 0.91 | 0.91 |
| ResNet 2D CV5 | 0.65 | 0.61 | 0.55 | 0.70 | 0.63 | 0.60 |
| ResNet 2D mean | 0.75 | 0.77 | 0.76 | 0.78 | 0.76 | 0.75 |
| ResNet3D CV1 | 0.54 | 0.92 | 0.88 | 0.64 | 0.72 | 0.67 |
| ResNet3D CV2 | 0.96 | 0.66 | 0.72 | 0.95 | 0.80 | 0.82 |
| ResNet3D CV3 | 0.98 | 0.92 | 0.91 | 0.98 | 0.95 | 0.95 |
| ResNet3D CV4 | 0.71 | 0.96 | 0.95 | 0.73 | 0.82 | 0.81 |
| ResNet3D CV5 | 0.59 | 0.75 | 0.64 | 0.71 | 0.68 | 0.61 |
| ResNet 3D mean | 0.76 | 0.84 | 0.82 | 0.80 | 0.79 | 0.77 |
| MobileNet 2D CV1 | 0.54 | 0.91 | 0.87 | 0.64 | 0.71 | 0.66 |
| MobileNet 2D CV2 | 0.73 | 0.65 | 0.66 | 0.73 | 0.69 | 0.69 |
| MobileNet 2D CV3 | 0.96 | 0.79 | 0.80 | 0.96 | 0.87 | 0.88 |
| MobileNet 2D CV4 | 0.90 | 0.95 | 0.95 | 0.89 | 0.92 | 0.93 |
| MobileNet 2D CV5 | 0.53 | 0.77 | 0.63 | 0.69 | 0.67 | 0.58 |
| MobileNet 2D mean | 0.73 | 0.81 | 0.78 | 0.78 | 0.77 | 0.75 |
| MobileNet 3D CV1 | 0.62 | 0.96 | 0.94 | 0.69 | 0.78 | 0.75 |
| MobileNet 3D CV2 | 0.93 | 0.77 | 0.78 | 0.92 | 0.84 | 0.85 |
| MobileNet 3D CV3 | 1.00 | 0.93 | 0.93 | 1.00 | 0.96 | 0.96 |
| MobileNet 3D CV4 | 0.91 | 0.93 | 0.94 | 0.90 | 0.92 | 0.93 |
| MobileNet 3D CV5 | 0.74 | 0.74 | 0.68 | 0.79 | 0.74 | 0.71 |
| MobileNet 3D mean | 0.84 | 0.87 | 0.86 | 0.86 | 0.85 | 0.84 |
| CNN | Metric | Mean Δ (3D vs. 2D) | 95% CI of Δ | p-Value | Cohen’s d | CNN |
|---|---|---|---|---|---|---|
| DenseNet121 | F1 | 0.061 | [0.012–0.111] | 0.026 | 1.547 | DenseNet121 |
| DenseNet121 | Accuracy | 0.040 | [0.009–0.115] | 0.032 | 1.442 | DenseNet121 |
| ResNet50 | F1 | 0.028 | [−0.072–0.128] | 0.482 | 0.346 | ResNet50 |
| ResNet50 | Accuracy | 0.026 | [−0.060–0.136] | 0.344 | 0.480 | ResNet50 |
| MobileNetV2 | F1 | 1.547 | [0.018–0.168] | 0.026 | 1.541 | MobileNetV2 |
| MobileNetV2 | Accuracy | 0.077 | [0.007–0.147] | 0.038 | 1.360 | MobileNetV2 |
| CNN | Sensitivity | Specificity | Accuracy | F1-Score |
|---|---|---|---|---|
| Densenet121 | 0.71 | 0.68 | 0.69 | 0.68 |
| Densenet121 3D | 0.72 | 0.81 | 0.77 | 0.74 |
| Mobilenet_v2 | 0.72 | 0.70 | 0.71 | 0.69 |
| Mobilenet_v2 3D | 0.60 | 0.86 | 0.74 | 0.67 |
| ResNet50 | 0.69 | 0.70 | 0.70 | 0.68 |
| ResNet50 3D | 0.69 | 0.83 | 0.79 | 0.73 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Druzenko, M.; Westerheide, B.; Girmen, C.; König, N.; Schmitt, R.; Warkentin, S.; Jöchle, K.; Cammann, S.; Wiltberger, G.; von Websky, M.W.; et al. Classification of Pancreatic Cancer and Normal Tissue in 2D and 3D Optical Coherence Tomography Images Using Convolutional Neural Networks: A Comparative Study. Cancers 2026, 18, 732. https://doi.org/10.3390/cancers18050732
Druzenko M, Westerheide B, Girmen C, König N, Schmitt R, Warkentin S, Jöchle K, Cammann S, Wiltberger G, von Websky MW, et al. Classification of Pancreatic Cancer and Normal Tissue in 2D and 3D Optical Coherence Tomography Images Using Convolutional Neural Networks: A Comparative Study. Cancers. 2026; 18(5):732. https://doi.org/10.3390/cancers18050732
Chicago/Turabian StyleDruzenko, Maria, Bastian Westerheide, Caroline Girmen, Niels König, Robert Schmitt, Svetlana Warkentin, Katharina Jöchle, Sebastian Cammann, Georg Wiltberger, Martin W. von Websky, and et al. 2026. "Classification of Pancreatic Cancer and Normal Tissue in 2D and 3D Optical Coherence Tomography Images Using Convolutional Neural Networks: A Comparative Study" Cancers 18, no. 5: 732. https://doi.org/10.3390/cancers18050732
APA StyleDruzenko, M., Westerheide, B., Girmen, C., König, N., Schmitt, R., Warkentin, S., Jöchle, K., Cammann, S., Wiltberger, G., von Websky, M. W., Vogel, T., Vondran, F. W. R., & Amygdalos, I. (2026). Classification of Pancreatic Cancer and Normal Tissue in 2D and 3D Optical Coherence Tomography Images Using Convolutional Neural Networks: A Comparative Study. Cancers, 18(5), 732. https://doi.org/10.3390/cancers18050732

