Pediatric Brain Tissue Segmentation Using a Snapshot Hyperspectral Imaging (sHSI) Camera and Machine Learning Classifier
Abstract
:1. Introduction
- We developed a compact sHSI camera designed for seamless integration with an existing surgical microscope, enabling remote control for the simultaneous acquisition of both color and hyperspectral data.
- Our study harnessed sHSI technology to capture real-time images extending beyond the visible spectrum, effectively distinguishing healthy brain tissues from lesions in surgical scenarios.
- We conducted machine learning model training by utilizing data from pediatric patients and assessed the resulting performance outcomes.
2. Materials and Methods
2.1. Data Collection
2.2. Data Preprocessing
2.3. Machine Learning
2.4. Evaluation
2.5. Bench Top Testing
3. Results
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Hwang, E.I.; Sayour, E.J.; Flores, C.T.; Grant, G.; Wechsler-Reya, R.; Hoang-Minh, L.B.; Kieran, M.W.; Salcido, J.; Prins, R.M.; Figg, J.W.; et al. The current landscape of immunotherapy for pediatric brain tumors. Nat. Cancer 2022, 3, 11–24. [Google Scholar] [CrossRef] [PubMed]
- Iqbal, S.; Khan, M.U.G.; Saba, T.; Rehman, A. Computer-assisted brain tumor type discrimination using magnetic resonance imaging features. Biomed. Eng. Lett. 2018, 8, 5–28. [Google Scholar] [CrossRef] [PubMed]
- Biratu, E.S.; Schwenker, F.; Ayano, Y.M.; Debelee, T.G. A Survey of Brain Tumor Segmentation and Classification Algorithms. J. Imaging 2021, 7, 179. [Google Scholar] [CrossRef] [PubMed]
- Pertzborn, D.; Nguyen, H.N.; Huttmann, K.; Prengel, J.; Ernst, G.; Guntinas-Lichius, O.; von Eggeling, F.; Hoffmann, F. Intraoperative Assessment of Tumor Margins in Tissue Sections with Hyperspectral Imaging and Machine Learning. Cancers 2022, 15, 213. [Google Scholar] [CrossRef] [PubMed]
- Yoon, J. Hyperspectral Imaging for Clinical Applications. BioChip J. 2022, 16, 1–12. [Google Scholar] [CrossRef]
- Zhang, Y.; Wu, X.; He, L.; Meng, C.; Du, S.; Bao, J.; Zheng, Y. Applications of hyperspectral imaging in the detection and diagnosis of solid tumors. Transl. Cancer Res. 2020, 9, 1265–1277. [Google Scholar] [CrossRef]
- Ortega, S.; Fabelo, H.; Camacho, R.; de la Luz Plaza, M.; Callico, G.M.; Sarmiento, R. Detecting brain tumor in pathological slides using hyperspectral imaging. Biomed. Opt. Express 2018, 9, 818–831. [Google Scholar] [CrossRef]
- Halicek, M.; Fabelo, H.; Ortega, S.; Callico, G.M.; Fei, B. In-Vivo and Ex-Vivo Tissue Analysis through Hyperspectral Imaging Techniques: Revealing the Invisible Features of Cancer. Cancers 2019, 11, 756. [Google Scholar] [CrossRef]
- Bioucas-Dias, J.M.; Plaza, A.; Camps-Valls, G.; Scheunders, P.; Nasrabadi, N.; Chanussot, J. Hyperspectral Remote Sensing Data Analysis and Future Challenges. IEEE Geosci. Remote Sens. Mag. 2013, 1, 6–36. [Google Scholar] [CrossRef]
- Plaza, A.; Benediktsson, J.A.; Boardman, J.W.; Brazile, J.; Bruzzone, L.; Camps-Valls, G.; Chanussot, J.; Fauvel, M.; Gamba, P.; Gualtieri, A.; et al. Recent advances in techniques for hyperspectral image processing. Remote Sens. Environ. 2009, 113, S110–S122. [Google Scholar] [CrossRef]
- Ogihara, H.; Hamamoto, Y.; Fujita, Y.; Goto, A.; Nishikawa, J.; Sakaida, I. Development of a Gastric Cancer Diagnostic Support System with a Pattern Recognition Method Using a Hyperspectral Camera. J. Sens. 2016, 2016, 1803501. [Google Scholar] [CrossRef]
- Liu, Z.; Wang, H.; Li, Q. Tongue tumor detection in medical hyperspectral images. Sensors 2012, 12, 162–174. [Google Scholar] [CrossRef] [PubMed]
- Akbari, H.; Halig, L.V.; Schuster, D.M.; Osunkoya, A.; Master, V.; Nieh, P.T.; Chen, G.Z.; Fei, B. Hyperspectral imaging and quantitative analysis for prostate cancer detection. J. Biomed. Opt. 2012, 17, 076005. [Google Scholar] [CrossRef] [PubMed]
- Lu, G.; Fei, B. Medical hyperspectral imaging: A review. J. Biomed. Opt. 2014, 19, 10901. [Google Scholar] [CrossRef]
- Shokouhifar, A.; Shokouhifar, M.; Sabbaghian, M.; Soltanian-Zadeh, H. Swarm intelligence empowered three-stage ensemble deep learning for arm volume measurement in patients with lymphedema. Biomed. Signal Process. Control 2023, 85, 105027. [Google Scholar] [CrossRef]
- Veeraiah, N.; Alotaibi, Y.; Subahi, A.-F. MayGAN: Mayfly Optimization with Generative Adversarial Network-Based Deep Learning Method to Classify Leukemia Form Blood Smear Images. Comput. Syst. Sci. Eng. 2023, 46, 2039–2058. [Google Scholar] [CrossRef]
- Klimont, M.; Oronowicz-Jaskowiak, A.; Flieger, M.; Rzeszutek, J.; Juszkat, R.; Jonczyk-Potoczna, K. Deep Learning-Based Segmentation and Volume Calculation of Pediatric Lymphoma on Contrast-Enhanced Computed Tomographies. J. Pers. Med. 2023, 13, 184. [Google Scholar] [CrossRef]
- Rahman, H.; Bukht, T.F.N.; Imran, A.; Tariq, J.; Tu, S.; Alzahrani, A. A Deep Learning Approach for Liver and Tumor Segmentation in CT Images Using ResUNet. Bioengineering 2022, 9, 368. [Google Scholar] [CrossRef]
- Malathi, M.; Sinthia, P. Brain Tumour Segmentation Using Convolutional Neural Network with Tensor Flow. Asian Pac. J. Cancer Prev. 2019, 20, 2095–2101. [Google Scholar] [CrossRef]
- Xiao, Z.; Huang, R.; Ding, Y.; Lan, T.; Dong, R.; Qin, Z.; Zhang, X.; Wang, W. A deep learning-based segmentation method for brain tumor in MR images. In Proceedings of the 2016 IEEE 6th International Conference on Computational Advances in Bio and Medical Sciences (ICCABS), Atlanta, GA, USA, 13–15 October 2016; pp. 1–6. [Google Scholar]
- Selvakumar, J.; Lakshmi, A.; Arivoli, T. Brain tumor segmentation and its area calculation in brain MR images using K-mean clustering and Fuzzy C-mean algorithm. In Proceedings of the IEEE-International Conference On Advances In Engineering, Science And Management (ICAESM-2012), Nagapattinam, India, 30–31 March 2012; pp. 186–190. [Google Scholar]
- Ahmed, M.; Mohamad, D. Segmentation of Brain MR Images for Tumor Extraction by Combining Kmeans Clustering and Perona-Malik Anisotropic Diffusion Model. Int. J. Image Process. 2008, 2, 27–34. [Google Scholar]
- Kalaivani, I.; Oliver, A.S.; Pugalenthi, R.; Jeipratha, P.N.; Jeena, A.A.S.; Saranya, G. Brain Tumor Segmentation Using Machine Learning Classifier. In Proceedings of the 2019 Fifth International Conference on Science Technology Engineering and Mathematics (ICONSTEM), Chennai, India, 14–15 March 2019; pp. 85–90. [Google Scholar]
- Eder, M.; Moser, E.; Holzinger, A.; Jean-Quartier, C.; Jeanquartier, F. Interpretable Machine Learning with Brain Image and Survival Data. BioMedInformatics 2022, 2, 492–510. [Google Scholar] [CrossRef]
- Ruiz, L.; Martín-Pérez, A.; Urbanos, G.; Villanueva, M.; Sancho, J.; Rosa, G.; Villa, M.; Chavarrías, M.; Perez, A.; Juarez, E.; et al. Multiclass Brain Tumor Classification Using Hyperspectral Imaging and Supervised Machine Learning. In Proceedings of the 2020 XXXV Conference on Design of Circuits and Integrated Systems (DCIS), Segovia, Spain, 18–20 November 2020. [Google Scholar]
- Ma, L.; Little, J.V.; Chen, A.Y.; Myers, L.; Sumer, B.D.; Fei, B. Automatic detection of head and neck squamous cell carcinoma on histologic slides using hyperspectral microscopic imaging. J. Biomed. Opt. 2022, 27, 046501. [Google Scholar] [CrossRef]
- Goetz, A.F.; Vane, G.; Solomon, J.E.; Rock, B.N. Imaging spectrometry for Earth remote sensing. Science 1985, 228, 1147–1153. [Google Scholar] [CrossRef] [PubMed]
- Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef]
- Chan, J.C.-W.; Paelinckx, D. Evaluation of Random Forest and Adaboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery. Remote Sens. Environ. 2008, 112, 2999–3011. [Google Scholar] [CrossRef]
- Leon, R.; Fabelo, H.; Ortega, S.; Pineiro, J.F.; Szolna, A.; Hernandez, M.; Espino, C.; O’Shanahan, A.J.; Carrera, D.; Bisshopp, S.; et al. VNIR-NIR hyperspectral imaging fusion targeting intraoperative brain cancer detection. Sci. Rep. 2021, 11, 19696. [Google Scholar] [CrossRef]
Average IoU | Standard Deviation | |
---|---|---|
Test 1 | 0.54 | 0.1 |
Test 2 | 0.71 | 0.01 |
Average Accuracy | |
---|---|
Random forest | 0.84 |
SVM | 0.77 |
Number of Estimators | Average Accuracy |
---|---|
2 | 0.834 |
5 | 0.844 |
10 | 0.854 |
15 | 0.854 |
Average IoU | Standard Deviation | |
---|---|---|
Tissue—RGB images | 0.76 | 0.10 |
Tissue—Visible HSI | 0.57 | 0.16 |
Tissue—Infrared HSI | 0.59 | 0.20 |
Tumor—Visible HSI | 0.10 | 0.09 |
Specificity | Sensitivity | |
---|---|---|
Tissue—RGB images | 0.72 | 0.81 |
Tissue—Visible HSI | 0.91 | 0.50 |
Tissue—Infrared HSI | 0.93 | 0.45 |
Tumor—Visible HSI | 0.996 | 0.09 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Kifle, N.; Teti, S.; Ning, B.; Donoho, D.A.; Katz, I.; Keating, R.; Cha, R.J. Pediatric Brain Tissue Segmentation Using a Snapshot Hyperspectral Imaging (sHSI) Camera and Machine Learning Classifier. Bioengineering 2023, 10, 1190. https://doi.org/10.3390/bioengineering10101190
Kifle N, Teti S, Ning B, Donoho DA, Katz I, Keating R, Cha RJ. Pediatric Brain Tissue Segmentation Using a Snapshot Hyperspectral Imaging (sHSI) Camera and Machine Learning Classifier. Bioengineering. 2023; 10(10):1190. https://doi.org/10.3390/bioengineering10101190
Chicago/Turabian StyleKifle, Naomi, Saige Teti, Bo Ning, Daniel A. Donoho, Itai Katz, Robert Keating, and Richard Jaepyeong Cha. 2023. "Pediatric Brain Tissue Segmentation Using a Snapshot Hyperspectral Imaging (sHSI) Camera and Machine Learning Classifier" Bioengineering 10, no. 10: 1190. https://doi.org/10.3390/bioengineering10101190