Automated Segmentation of Diffuse and Multifocal Nerve Enlargement in Immune-Mediated Neuropathy Using Temporal Deep Learning on Continuous Ultrasound Scans
Abstract
1. Introduction
2. Materials and Methods
2.1. Study Participants and Nerve Ultrasound Protocol
2.2. Data Construction and Preprocessing
2.3. Data Augmentation
2.4. Model Architectures
2.4.1. DeepLabV3+ (Image)
2.4.2. DeepLabV3+ with Convolutional Long Short-Term Memory
2.4.3. DeepLabV3+ with Temporal Mamba
2.5. Training Settings
2.6. Evaluation Metrics
2.7. Additional Analyses
3. Results
3.1. Model Comparison
3.2. Additional Analyses
3.2.1. Temporal Models with Boundary Loss
3.2.2. Normal Anatomical Variants and Multiclass Segmentation
4. Discussion
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Declaration of Generative AI and AI-assisted Technologies in the Writing Process
References
- Goedee, H.S.; Brekelmans, G.J.F.; van Asseldonk, J.T.H.; Beekman, R.; Mess, W.H.; Visser, L.H. High resolution sonography in the evaluation of the peripheral nervous system in polyneuropathy: A review of the literature. Eur. J. Neurol. 2013, 20, 1342–1351. [Google Scholar] [CrossRef] [PubMed]
- Zaidman, C.M.; Harms, M.B.; Pestronk, A. Ultrasound of inherited vs. acquired demyelinating polyneuropathies. J. Neurol. 2013, 260, 3115–3121. [Google Scholar] [CrossRef] [PubMed]
- Van den Bergh, P.Y.K.; van Doorn, P.A.; Hadden, R.D.M.; Avau, B.; Vankrunkelsven, P.; Allen, J.A.; Attarian, S.; Blomkwist-Markens, P.H.; Cornblath, D.R.; Eftimov, F.; et al. European Academy of Neurology/Peripheral Nerve Society guideline on diagnosis and treatment of chronic inflammatory demyelinating polyradiculoneuropathy: Report of a joint Task Force—Second revision. J. Peripher. Nerv. Syst. 2021, 26, 242–268. [Google Scholar] [CrossRef] [PubMed]
- Grimm, A.; Vittore, D.; Schubert, V.; Lipski, C.; Heiling, B.; Decard, B.F.; Axer, H. Ultrasound pattern sum score, homogeneity score and regional nerve enlargement index for differentiation of demyelinating inflammatory and hereditary neuropathies. Clin. Neurophysiol. 2016, 127, 2618–2624. [Google Scholar] [CrossRef] [PubMed]
- Fowler, J.R.; Hirsch, D.; Kruse, K. The reliability of ultrasound measurements of the median nerve at the carpal tunnel inlet. J. Hand Surg. Am. 2015, 40, 1992–1995. [Google Scholar] [CrossRef] [PubMed]
- Gonzalez-Suarez, C.B.; Buenavente, L.D.; Cua, R.C.A.; Fidel, M.B.C.; Cabrera, J.T.C.; Regala, C.F.G. Inter-rater and intra-rater reliability of sonographic median nerve and wrist measurements. J. Med. Ultrasound 2018, 26, 14–23. [Google Scholar] [CrossRef] [PubMed]
- Van Doesburg, M.H.; Yoshii, Y.; Villarraga, H.R.; Henderson, J.; Cha, S.S.; An, K.N.; Amadio, P.C. Median nerve deformation and displacement in the carpal tunnel during index finger and thumb motion. J. Orthop. Res. 2010, 28, 1387–1390. [Google Scholar] [CrossRef] [PubMed]
- Schrier, V.J.; Evers, S.; Geske, J.R.; Kremers, W.K.; Villarraga, H.R.; Kakar, S.; Selles, R.W.; Hovius, S.E.; Gelfman, R.; Amadio, P.C. Median nerve transverse mobility and outcome after carpal tunnel release. Ultrasound Med. Biol. 2019, 45, 2887–2897. [Google Scholar] [CrossRef] [PubMed]
- Padua, L.; Granata, G.; Sabatelli, M.; Inghilleri, M.; Lucchetta, M.; Luigetti, M.; Caliandro, P.; Martinoli, C.; Briani, C. Heterogeneity of root and nerve ultrasound pattern in CIDP patients. Clin. Neurophysiol. 2014, 125, 160–165. [Google Scholar] [CrossRef] [PubMed]
- Cartwright, M.S.; Demar, S.; Griffin, L.P.; Balakrishnan, N.; Harris, J.M.; Walker, F.O. Validity and reliability of nerve and muscle ultrasound. Muscle Nerve 2013, 47, 515–521. [Google Scholar] [CrossRef] [PubMed]
- Huang, C.; Zhou, Y.; Tan, W.; Qiu, Z.; Zhou, H.; Song, Y.; Zhao, Y.; Gao, S. Applying deep learning in recognizing the femoral nerve block region on ultrasound images. Ann. Transl. Med. 2019, 7, 453. [Google Scholar] [CrossRef] [PubMed]
- Smistad, E.; Johansen, K.F.; Iversen, D.H.; Reinertsen, I. Highlighting nerves and blood vessels for ultrasound-guided axillary nerve block procedures using neural networks. J. Med. Imaging 2018, 5, 044004. [Google Scholar] [CrossRef] [PubMed]
- Horng, M.H.; Yang, C.W.; Sun, Y.N.; Yang, T.H. DeepNerve: A new convolutional neural network for the localization and segmentation of the median nerve in ultrasound image sequences. Ultrasound Med. Biol. 2020, 46, 2439–2452. [Google Scholar] [CrossRef] [PubMed]
- Festen, R.T.; Schrier, V.J.M.M.; Amadio, P.C. Automated segmentation of the median nerve in the carpal tunnel using U-Net. Ultrasound Med. Biol. 2021, 47, 1964–1969. [Google Scholar] [CrossRef] [PubMed]
- Wu, C.H.; Syu, W.T.; Lin, M.T.; Yeh, C.L.; Boudier-Revéret, M.; Hsiao, M.Y.; Kuo, P.L. Automated segmentation of median nerve in dynamic sonography using deep learning: Evaluation of model performance. Diagnostics 2021, 11, 1893. [Google Scholar] [CrossRef] [PubMed]
- Di Cosmo, M.; Fiorentino, M.C.; Villani, F.P.; Frontoni, E.; Smerilli, G.; Filippucci, E.; Moccia, S. A deep learning approach to median nerve evaluation in ultrasound images of carpal tunnel inlet. Med. Biol. Eng. Comput. 2022, 60, 3255–3264. [Google Scholar] [CrossRef] [PubMed]
- Yeh, C.L.; Wu, C.H.; Hsiao, M.Y.; Kuo, P.L. Real-time automated segmentation of median nerve in dynamic ultrasonography using deep learning. Ultrasound Med. Biol. 2023, 49, 1129–1136. [Google Scholar] [CrossRef] [PubMed]
- Waki, T.; Sato, Y.; Tsukamoto, K.; Yamada, E.; Yamamoto, A.; Ibara, T.; Sasaki, T.; Kuroiwa, T.; Nimura, A.; Sugiura, Y.; et al. Effectiveness of comprehensive video datasets: Toward the development of an artificial intelligence model for ultrasonography-based severity diagnosis of carpal tunnel syndrome. J. Ultrasound Med. 2025, 44, 557–566. [Google Scholar] [CrossRef] [PubMed]
- Webster, M.B.; Kim, K.E.; Na, Y.J.; Lee, J.; Kim, B.S. Deep learning-based segmentation of the ulnar nerve in ultrasound images. Medicina 2026, 62, 113. [Google Scholar] [CrossRef] [PubMed]
- Zhou, Y.; Xiang, W.; Guo, R.; Zhu, X.; Cao, W. UltraMN: Advancing real-time median nerve ultrasound monitoring with a multitask deep learning framework. Ultrasound Med. Biol. 2026, 52, 789–794. [Google Scholar] [PubMed]
- El Miedany, Y.; El Gaafary, M.; Youssef, S.; Ahmed, I.; Nasr, A. Ultrasound assessment of the median nerve: A biomarker that can help in setting a treat-to-target approach tailored for carpal tunnel syndrome patients. SpringerPlus 2015, 4, 13. [Google Scholar] [CrossRef] [PubMed]
- Huang, A.; Jiang, L.; Zhang, J.; Wang, Q. Attention-VGG16-UNet: A novel deep learning approach for automatic segmentation of the median nerve in ultrasound images. Quant. Imaging Med. Surg. 2022, 12, 3138–3150. [Google Scholar] [CrossRef] [PubMed]
- Gujarati, K.R.; Bathala, L.; Venkatesh, V.; Mathew, R.S.; Yalavarthy, P.K. Transformer-based automated segmentation of the median nerve in ultrasound videos of wrist-to-elbow region. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 2024, 71, 56–69. [Google Scholar] [CrossRef] [PubMed]
- Sugimoto, T.; Ochi, K.; Hosomi, N.; Mukai, T.; Ueno, H.; Takahashi, T.; Ohtsuki, T.; Kohriyama, T.; Matsumoto, M. Ultrasonographic reference sizes of the median and ulnar nerves and the cervical nerve roots in healthy Japanese adults. Ultrasound Med. Biol. 2013, 39, 1560–1570. [Google Scholar] [CrossRef] [PubMed]
- Chen, L.C.; Zhu, Y.; Papandreou, G.; Schroff, F.; Adam, H. Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018; Springer: Berlin/Heidelberg, Germany, 2018; pp. 833–851. [Google Scholar] [CrossRef]
- Iakubovskii, P. Segmentation Models PyTorch; GitHub Repository, GitHub: San Francisco, CA, USA, 2019; Available online: https://github.com/qubvel/segmentation_models.pytorch (accessed on 17 June 2026).
- He, K.; Zhang, X.; Ren, S.; Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27–30 June 2016; Springer: Berlin/Heidelberg, Germany, 2016; pp. 770–778. [Google Scholar]
- Shi, X.; Chen, Z.; Wang, H.; Yeung, D.Y.; Wong, W.K.; Woo, W.C. Convolutional LSTM network: A machine learning approach for precipitation nowcasting. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Montreal, QC, Canada, 7–12 December 2015; Springer: Berlin/Heidelberg, Germany, 2015; pp. 802–810. [Google Scholar]
- Gu, A.; Dao, T. Mamba: Linear-time sequence modeling with selective state spaces. In Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria, 7–11 May 2024; Available online: https://openreview.net/forum?id=AL1fq05o7H (accessed on 17 June 2026).
- Yang, Y.; Xing, Z.; Yu, L.; Huang, C.; Fu, H.; Zhu, L. Vivim: A video vision Mamba for medical video object segmentation. arXiv 2024, arXiv:2401.14168. [Google Scholar] [CrossRef]
- Cardoso, M.J.; Li, W.; Brown, R.; Ma, N.; Kerfoot, E.; Wang, Y.; Murrey, B.; Myronenko, A.; Zhao, C.; Yang, D.; et al. MONAI: An open-source framework for deep learning in healthcare. arXiv 2022, arXiv:2211.02701. [Google Scholar] [CrossRef]
- Paszke, A.; Gross, S.; Massa, F.; Lerer, A.; Bradbury, J.; Chanan, G.; Killeen, T.; Lin, Z.; Gimelshein, N.; Antiga, L.; et al. PyTorch: An imperative style, high-performance deep learning library. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Vancouver, BC, Canada, 8–14 December 2019; Springer: Berlin/Heidelberg, Germany, 2019; pp. 8024–8035. [Google Scholar]
- Kervadec, H.; Bouchtiba, J.; Desrosiers, C.; Granger, E.; Dolz, J.; Ayed, I.B. Boundary loss for highly unbalanced segmentation. In Proceedings of the International Conference on Medical Imaging with Deep Learning (MIDL), London, UK, 8–10 July 2019; Springer: Berlin/Heidelberg, Germany, 2019; pp. 285–296. [Google Scholar]
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention is all you need. In Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA, 4–9 December 2017; Springer: Berlin/Heidelberg, Germany, 2017; pp. 5998–6008. [Google Scholar]
- Yang, G.; Zhang, Y.; Yang, H. Breast ultrasound image segmentation integrating Mamba-CNN and feature interaction. Sensors 2026, 26, 105. [Google Scholar] [CrossRef] [PubMed]
- Ma, J.; Li, F.; Wang, B. U-Mamba: Enhancing long-range dependency for biomedical image segmentation. arXiv 2024, arXiv:2401.04722. [Google Scholar] [CrossRef]
- Wang, J.C.; Shu, Y.C.; Lin, C.Y.; Wu, W.T.; Chen, L.R.; Lo, Y.C.; Chiu, H.C.; Özçakar, L.; Chang, K.V. Application of deep learning algorithms in automatic sonographic localization and segmentation of the median nerve: A systematic review and meta-analysis. Artif. Intell. Med. 2023, 137, 102496. [Google Scholar] [CrossRef] [PubMed]
- Aotsuka, Y.; Misawa, S.; Suichi, T.; Shibuya, K.; Nakamura, K.; Kano, H.; Otani, R.; Morooka, M.; Ogushi, M.; Nagashima, K.; et al. Prevalence, clinical profiles, and prognosis of chronic inflammatory demyelinating polyradiculoneuropathy in a Japanese nationwide survey: Analyses of 1,257 diagnosis-confirmed patients. Neurology 2024, 102, e209130. [Google Scholar] [CrossRef] [PubMed]





| ID | Age/Sex | Clinical Diagnosis | Distribution of Nerve Enlargement |
|---|---|---|---|
| PT1 | 20 M | Nodopathy (anti-NF155 antibody positive) | Diffuse (proximal dominant) |
| PT2 | 40 F | Typical CIDP | Diffuse (proximal dominant) |
| PT3 | 20 F | Multifocal CIDP | Rt ulnar at middle of forearm and below elbow |
| PT4 | 30 F | Possible multifocal CIDP | Lt ulnar below and above elbow |
| PT5 | 60 M | Possible focal CIDP | Rt ulnar at middle of forearm |
| Participant | Nerve | DeepLabV3+ (Image) | DeepLabV3+ with ConvLSTM | DeepLabV3+ with Temporal Mamba | |
|---|---|---|---|---|---|
| Healthy participants (n = 5; 10 nerves) | Median | 0.877 ± 0.041 | 0.884 ± 0.032 | 0.873 ± 0.046 | |
| Ulnar | 0.859 ± 0.027 | 0.872 ± 0.012 | 0.869 ± 0.017 | ||
| PT1 | Right | Median | 0.816 ± 0.181 | 0.914 ± 0.030 | 0.894 ± 0.059 |
| Ulnar | 0.813 ± 0.181 | 0.893 ± 0.066 | 0.815 ± 0.173 | ||
| Left | Median | 0.812 ± 0.221 | 0.917 ± 0.042 | 0.895 ± 0.069 | |
| Ulnar | 0.785 ± 0.215 | 0.871 ± 0.090 | 0.841 ± 0.114 | ||
| PT3 | Right | Ulnar | 0.872 ± 0.076 | 0.879 ± 0.064 | 0.866 ± 0.091 |
| Participant | Nerve | DeepLabV3+ (Image) | DeepLabV3+ with ConvLSTM | DeepLabV3+ with Temporal Mamba | |
|---|---|---|---|---|---|
| Healthy participants (n = 5; 10 nerves) | Median | 0.792 ± 0.056 | 0.797 ± 0.049 | 0.786 ± 0.060 | |
| Ulnar | 0.762 ± 0.032 | 0.779 ± 0.017 | 0.770 ± 0.025 | ||
| PT1 | Right | Median | 0.721 ± 0.208 | 0.843 ± 0.050 | 0.813 ± 0.088 |
| Ulnar | 0.718 ± 0.214 | 0.813 ± 0.099 | 0.718 ± 0.210 | ||
| Left | Median | 0.725 ± 0.232 | 0.849 ± 0.069 | 0.816 ± 0.103 | |
| Ulnar | 0.686 ± 0.233 | 0.781 ± 0.124 | 0.740 ± 0.152 | ||
| PT3 | Right | Ulnar | 0.781 ± 0.105 | 0.789 ± 0.095 | 0.773 ± 0.123 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Akaza, M.; Maeda, R.; Otani, T.; Natsui, H.; Kanouchi, T.; Sumi, Y. Automated Segmentation of Diffuse and Multifocal Nerve Enlargement in Immune-Mediated Neuropathy Using Temporal Deep Learning on Continuous Ultrasound Scans. Diagnostics 2026, 16, 1934. https://doi.org/10.3390/diagnostics16121934
Akaza M, Maeda R, Otani T, Natsui H, Kanouchi T, Sumi Y. Automated Segmentation of Diffuse and Multifocal Nerve Enlargement in Immune-Mediated Neuropathy Using Temporal Deep Learning on Continuous Ultrasound Scans. Diagnostics. 2026; 16(12):1934. https://doi.org/10.3390/diagnostics16121934
Chicago/Turabian StyleAkaza, Miho, Ryo Maeda, Tai Otani, Hirokazu Natsui, Tadashi Kanouchi, and Yuki Sumi. 2026. "Automated Segmentation of Diffuse and Multifocal Nerve Enlargement in Immune-Mediated Neuropathy Using Temporal Deep Learning on Continuous Ultrasound Scans" Diagnostics 16, no. 12: 1934. https://doi.org/10.3390/diagnostics16121934
APA StyleAkaza, M., Maeda, R., Otani, T., Natsui, H., Kanouchi, T., & Sumi, Y. (2026). Automated Segmentation of Diffuse and Multifocal Nerve Enlargement in Immune-Mediated Neuropathy Using Temporal Deep Learning on Continuous Ultrasound Scans. Diagnostics, 16(12), 1934. https://doi.org/10.3390/diagnostics16121934
