Teledermoscopy in the Diagnosis of Melanocytic and Non-Melanocytic Skin Lesions: NurugoTM Derma Smartphone Microscope as a Possible New Tool in Daily Clinical Practice
Abstract
:1. Introduction
2. Materials and Methods
2.1. Images Collection
2.2. Images Pre-Processing
2.3. Images Classification
- -
- Instrument F (dermatoscopic images): ordered from 1 to 144;
- -
- Instrument N (NurugoTM images): ordered from 144 to 1;
- -
- Instrument V (NurugoTM images in epiluminescence): ordered from 72 to 144 and from 1 to 71.
2.4. Statistical Analysis
3. Results
3.1. Primary Outcome: Agreement between Dermatologists and Real Clinical Condition
3.2. Secondary Outcomes: Agreement between Dermatologists and Serious Diagnostic Error
4. Discussion
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Tognetti, L.; Fiorani, D.; Russo, F.; Lazzeri, L.; Trovato, E.; Flori, M.L.; Moscarella, E.; Cinotti, E.; Rubegni, P. Teledermatology in 2020: Past, present and future perspectives. Ital. J. Dermatol. Venerol. 2021, 156, 198–212. [Google Scholar] [CrossRef] [PubMed]
- Perednia, D.A.; Brown, N.A. Teledermatology: One application of telemedicine. Bull. Med. Libr. Assoc. 1995, 83, 42–47. [Google Scholar] [PubMed]
- Moscarella, E.; Pasquali, P.; Cinotti, E.; Tognetti, L.; Argenziano, G.; Rubegni, P. A survey on teledermatology use and doctors’ perception in times of COVID-19. J. Eur. Acad. Dermatol. Venereol. 2020, 34, e772–e773. [Google Scholar] [CrossRef] [PubMed]
- Laggis, C.W.; Williams, V.L.; Yang, X.; Kovarik, C.L. Research Techniques Made Simple:Teledermatology in Clinical Trials. J. Investig. Dermatol. 2019, 139, 1626–1633.e1. [Google Scholar] [CrossRef] [PubMed]
- Beer, J.; Hadeler, E.; Calume, A.; Gitlow, H.; Nouri, K. Teledermatology: Current indications and considerations for future use. Arch. Dermatol. Res. 2021, 313, 11–15. [Google Scholar] [CrossRef]
- Tognetti, L.; Cevenini, G.; Moscarella, E.; Cinotti, E.; Farnetani, F.; Lallas, A.; Tiodorovic, D.; Carrera, C.; Puig, S.; Perrot, J.; et al. Validation of an integrated dermoscopic scoring method in an European teledermoscopy web platform: The iDScore project for early detection of melanoma. J. Eur. Acad. Dermatol. Venereol. 2020, 34, 640–647. [Google Scholar] [CrossRef]
- Chuchvara, N.; Patel, R.; Srivastava, R.; Reilly, C.; Rao, B.K. The growth of teledermatology: Expanding to reach the underserved. J. Am. Acad. Dermatol. 2020, 82, 1025–1033. [Google Scholar] [CrossRef]
- Esteva, A.; Kuprel, B.; Novoa, R.A.; Ko, J.; Swetter, S.M.; Blau, H.M.; Thrun, S. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017, 542, 115–118. [Google Scholar] [CrossRef]
- Han, S.S.; Kim, M.S.; Lim, W.; Park, G.H.; Park, I.; Chang, S.E. Classification of the Clinical Images for Benign and Malignant Cutaneous Tumors Using a Deep Learning Algorithm. J. Investig. Dermatol. 2018, 138, 1529–1538. [Google Scholar] [CrossRef] [Green Version]
- Fujisawa, Y.; Otomo, Y.; Ogata, Y.; Nakamura, Y.; Fujita, R.; Ishitsuka, Y.; Watanabe, R.; Okiyama, N.; Ohara, K.; Fujimoto, M. Deep-learning-based, computer-aided classifier developed with a small dataset of clinical images surpasses board-certified dermatologists in skin tumour diagnosis. Br. J. Dermatol. 2019, 180, 373–381. [Google Scholar] [CrossRef]
- Phillips, M.; Marsden, H.; Jaffe, W.; Matin, R.N.; Wali, G.N.; Greenhalgh, J.; McGrath, E.; James, R.; Ladoyanni, E.; Bewley, A.; et al. Assessment of Accuracy of an Artificial Intelligence Algorithm to Detect Melanoma in Images of Skin Lesions. JAMA Netw. Open 2019, 2, e1913436. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Veronese, F.; Branciforti, F.; Zavattaro, E.; Tarantino, V.; Romano, V.; Meiburger, K.; Salvi, M.; Seoni, S.; Savoia, P. The Role in Teledermoscopy of an Inexpensive and Easy-to-Use Smartphone Device for the Classification of Three Types of Skin Lesions Using Convolutional Neural Networks. Diagnostics 2021, 11, 451. [Google Scholar] [CrossRef] [PubMed]
- Börve, A.; Terstappen, K.; Sandberg, C.; Paoli, J. Mobile teledermoscopy-there’s an app for that! Dermatol. Pract. Concept. 2013, 3, 41–48. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Fleiss, J.L. Measuring nominal scale agreement among many raters. Psychol. Bull. 1971, 76, 378–382. [Google Scholar] [CrossRef]
- Keller, J.J.; Johnson, J.P.; Latour, E. Inpatient teledermatology: Diagnostic and therapeutic concordance among a hospitalist, dermatologist, and teledermatologist using store-and-forward teledermatology. J. Am. Acad. Dermatol. 2020, 82, 1262–1267. [Google Scholar] [CrossRef]
- Kroemer, S.; Frühauf, J.; Campbell, T.M.; Massone, C.; Schwantzer, G.; Soyer, H.P.; Hofmann-Wellenhof, R. Mobile teledermatology for skin tumour screening: Diagnostic accuracy of clinical and dermoscopic image tele-evaluation using cellular phones. Br. J. Dermatol. 2011, 164, 973–979. [Google Scholar] [CrossRef]
- Nami, N.; Massone, C.; Rubegni, P.; Cevenini, G.; Fimiani, M.; Hofmann-Wellenhof, R. Concordance and time estimation of store-and-forward mobile teledermatology compared to classical face-to-face consultation. Acta Derm. Venereol. 2015, 95, 35–39. [Google Scholar] [CrossRef]
- Rizvi, S.M.H.; Schopf, T.; Sangha, A.; Ulvin, K.; Gjersvik, P. Teledermatology in Norway using a mobile phone app. PLoS ONE 2020, 15, e0232131. [Google Scholar] [CrossRef]
- Tschandl, P.; Codella, N.; Akay, B.N.; Argenziano, G.; Braun, R.P.; Cabo, H.; Gutman, D.; Halpern, A.; Helba, B.; Hofmann-Wellenhof, R.; et al. Comparison of the accuracy of human readers versus machine-learning algorithms for pigmented skin lesion classification: An open, web-based, international, diagnostic study. Lancet Oncol. 2019, 20, 938–947. [Google Scholar] [CrossRef]
- Blum, A.; Bosch, S.; Haenssle, H.A.; Fink, C.; Hofmann-Wellenhof, R.; Zalaudek, I.; Kittler, H.; Tschandl, P. Artificial intelligence and smartphone program applications (Apps): Relevance for dermatological practice. Der. Hautarzt. 2020, 71, 691–698. [Google Scholar] [CrossRef] [PubMed]
Dermatologist 1 | Dermatologist 2 | Dermatologist 3 | Dermatologist 4 | Real Clinical Diagnosis C | |
---|---|---|---|---|---|
LESION TYPE | |||||
Instrument F | |||||
Nevus | 85 (59.03%) | 64 (44.44%) | 73 (50.69%) | 72 (50%) | 75 (52.08%) |
Melanoma | 10 (6.94%) | 18 (12.5%) | 9 (6.25%) | 3 (2.08%) | 6 (4.17%) |
Seborrheic keratoses | 29 (20.14%) | 39 (27.08%) | 44 (30.56%) | 41 (28.47%) | 36 (25.00%) |
Basal cell carcinoma | 20 (13.89%) | 23 (15.97%) | 18 (12.5%) | 28 (19.44%) | 27 (18.75%) |
Instrument N | |||||
Nevus | 72 (50%) | 68 (47.22%) | 61 (42.36%) | 46 (31.94%) | |
Melanoma | 7 (4.86%) | 16 (11.11%) | 24 (16.67%) | 3 (2.08%) | |
Seborrheic keratoses | 36 (25%) | 35 (24.31%) | 36 (25%) | 57 (39.58%) | |
Basal cell carcinoma | 29 (20.14%) | 25 (17.36%) | 23 (15.97%) | 38 (26.39%) | |
Instrument V | |||||
Nevus | 76 (52.78%) | 52 (36.11%) | 70 (48.61%) | 37 (25.69%) | |
Melanoma | 17 (11.81%) | 29 (20.14%) | 20 (13.89%) | 9 (6.25%) | |
Seborrheic keratoses | 23 (15.97%) | 44 (30.56%) | 29 (20.14%) | 64 (44.44%) | |
Basal cell carcinoma | 28 (19.44%) | 19 (13.19%) | 25 (17.36%) | 34 (23.61%) | |
TREATMENT | |||||
Instrument F | |||||
SI | 30 (20.83%) | 56 (38.89%) | 31 (21.53%) | 44 (30.56%) | 48 (33.33%) |
Instrument N | |||||
SI | 36 (25.00%) | 84 (58.33%) | 75 (52.08%) | 57 (39.58%) | |
Instrument V | |||||
SI | 50 (34.72%) | 99 (68.75%) | 79 (54.86%) | 48 (33.33%) |
Dermatologist 1 | Dermatologist 2 | Dermatologist 3 | Dermatologist 4 | |
---|---|---|---|---|
LESION TYPE | ||||
F vs. C | 0.64 [0.53–0.75] | 0.80 [0.72–0.88] | 0.70 [0.60–0.80] | 0.85 [0.77–0.92] |
N vs. C | 0.75 [0.66–0.84] | 0.78 [0.69–0.86] | 0.62 [0.51–0.71] | 0.59 [0.49–0.69] |
V vs. C | 0.65 [0.55–0.75] | 0.60 [0.51–0.70] | 0.66 [0.56–0.76] | 0.53 [0.42–0.64] |
TREATMENT | ||||
F vs. C | 0.69 [0.56–0.82] | 0.79 [0.69–0.89] | 0.67 [0.54–0.80] | 0.87 [0.79–0.96] |
N vs. C | 0.63 [0.50–0.77] | 0.42 [0.29–0.55] | 0.38 [0.24–0.52] | 0.57 [0.43–0.71] |
V vs. C | 0.60 [0.46–0.74] | 0.37 [0.26–0.48] | 0.50 [0.38–0.63] | 0.63 [0.49–0.76] |
Part A | Dermatologist 1 | Dermatologist 2 | Dermatologist 3 | Dermatologist 4 |
---|---|---|---|---|
LESION TYPE | ||||
F vs. C | 77.78% | 86.81% | 81.25% | 90.28% |
N vs. C | 84.03% | 85.42% | 73.61% | 72.22% |
V vs. C | 77.78% | 72.22% | 77.78% | 67.36% |
TREATMENT | ||||
F vs. C | 87.50% | 90.28% | 86.81% | 94.44% |
N vs. C | 84.72% | 69.44% | 68.75% | 79.86% |
V vs. C | 81.94% | 64.58% | 74.31% | 83.33% |
Part B | Dermatologist 1 | Dermatologist 2 | Dermatologist 3 | Dermatologist 4 |
LESION TYPE | ||||
F vs. C | 8 (24.24%) | 3 (9.09%) | 9 (27.27%) | 4 (12.12%) |
N vs. C | 6 (18.28%) | 3 (9.09%) | 5 (15.15%) | 8 (24.24%) |
V vs. C | 2 (6.06%) | 4 (12.12%) | 2 (6.06%) | 3 (9.09%) |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Veronese, F.; Tarantino, V.; Zavattaro, E.; Biacchi, F.; Airoldi, C.; Salvi, M.; Seoni, S.; Branciforti, F.; Meiburger, K.M.; Savoia, P. Teledermoscopy in the Diagnosis of Melanocytic and Non-Melanocytic Skin Lesions: NurugoTM Derma Smartphone Microscope as a Possible New Tool in Daily Clinical Practice. Diagnostics 2022, 12, 1371. https://doi.org/10.3390/diagnostics12061371
Veronese F, Tarantino V, Zavattaro E, Biacchi F, Airoldi C, Salvi M, Seoni S, Branciforti F, Meiburger KM, Savoia P. Teledermoscopy in the Diagnosis of Melanocytic and Non-Melanocytic Skin Lesions: NurugoTM Derma Smartphone Microscope as a Possible New Tool in Daily Clinical Practice. Diagnostics. 2022; 12(6):1371. https://doi.org/10.3390/diagnostics12061371
Chicago/Turabian StyleVeronese, Federica, Vanessa Tarantino, Elisa Zavattaro, Francesca Biacchi, Chiara Airoldi, Massimo Salvi, Silvia Seoni, Francesco Branciforti, Kristen M. Meiburger, and Paola Savoia. 2022. "Teledermoscopy in the Diagnosis of Melanocytic and Non-Melanocytic Skin Lesions: NurugoTM Derma Smartphone Microscope as a Possible New Tool in Daily Clinical Practice" Diagnostics 12, no. 6: 1371. https://doi.org/10.3390/diagnostics12061371