The Role of ChatGPT in Dermatology Diagnostics
Abstract
:1. Introduction
Background and Current State of AI in Dermatology
2. Image Analysis Using ChatGPT and Its Integration with Diagnostic Tools
3. Natural Language Processing (NLP) Capabilities of ChatGPT in Dermatology
4. Machine Learning and Programming Applications in Dermatology Diagnostics
5. Summary of the Literature Findings on Machine Learning and Programming Applications in Dermatology Diagnostics
Type | Focus Area | Paper Title/Details | Authors | Year | Summary of Findings | Version of GPT | Image Dataset Source | Diagnosis Compared to | Study Type | Diagnosis Made Based on Images Alone or Metadata | Image no. | Types of Images |
---|---|---|---|---|---|---|---|---|---|---|---|---|
Diagnostics | Image Processing | Evaluating the Diagnostic and Treatment Recommendation Capabilities of GPT-4 Vision in Dermatology [52] | Pillai et al. | 2024 | GPT-4V demonstrated strong diagnostic accuracy for dermatological conditions, especially in text-based scenarios, with 89% accuracy in both text and multimodal setups. However, its image-based diagnosis showed lower performance, highlighting the need for further model development. | GPT-4.0 | Publicly available sources: dermnet.nz and dermatlas.org. | Two board-certified dermatologists | N/A | A combination of both images and metadata | 54 images. | Images depicting 9 common dermatological conditions, showcasing classic manifestations of these conditions. |
Argentine dermatology and ChatGPT: infrequent use and intermediate stance [57] | Ko et al. | 2024 | A survey of 257 Argentine dermatologists showed 83.7% were familiar with ChatGPT, but 65.4% had never used it. While 74.9% expressed interest in future use, only 5.4% used it frequently. Most were ‘early majority’ adopters. | N/A | N/A | N/A | Prospective | N/A | N/A | N/A | ||
Claude 3 Opus and ChatGPT With GPT-4 in Dermoscopic Image Analysis for Melanoma Diagnosis: Comparative Performance Analysis [48] | Liu et al. | 2024 | This study compared the diagnostic performance of Claude 3 Opus and ChatGPT for melanoma detection, finding no significant difference in primary diagnosis accuracy but superior malignancy discrimination by Claude 3 Opus. Both models showed potential, but their limitations highlight the need for further development in AI-driven dermatology tools. | GPT-4.0 | The International Skin Imaging Collaboration (ISIC) archive. | N/A | N/A | Image | 100 | Dermoscopic images of melanocytic lesions. | ||
ChatGPT versus clinician: challenging the diagnostic capabilities of artificial intelligence in dermatology [58] | Stoneham et al. | 2024 | ChatGPT correctly diagnosed 56% of cases with expert data and 39% with non-specialist data, lower than dermatologists (83%). It always provided a differential diagnosis but did not significantly improve diagnostic accuracy in primary or secondary care. | GPT-4.0 | N/A | The diagnosis made by ChatGPT was compared to those made by dermatologists (experts) and nonspecialists.ective | Retrospective | Metadata | N/A | N/A | ||
NLP | A Qualitative Analysis of Provider Notes of Atopic Dermatitis-Related Visits Using Natural Language Processing Methods [8] | Pierce et al. | 2021 | This study analyzed provider notes for 133,025 patients with atopic dermatitis (AD), revealing a focus on symptoms (primarily itch) and treatment, but limited documentation of AD’s impact on patients’ work or lifestyle. The findings highlight a care gap that requires further investigation. | N/A | N/A | N/A | Retrospective | N/A | N/A | N/A | |
Application of a natural language processing artificial intelligence tool in psoriasis: A cross-sectional comparative study on identifying affected areas in patients’ data [6] | Shapiro et al. | 2024 | ChatGPT-4 accurately analyzed unstructured EMR data from psoriasis patients, identifying affected body areas with 92.8% accuracy. It demonstrated high performance in detecting nail and joint involvement, though errors were more common in complex cases. | GPT-4.0 | The study does not involve images; it uses unstructured text data from EMRs. | Senior dermatologist | Retrospective | Metadata | N/A | N/A | ||
Comparing Meta-Analyses with ChatGPT in the Evaluation of the Effectiveness and Tolerance of Systemic Therapies in Moderate-to-Severe Plaque Psoriasis [7] | Lam Hoai et al. | 2023 | ChatGPT-4 accurately analyzed psoriasis patient data, identifying affected areas with 92.8% accuracy. It performed well in detecting nail and joint involvement, though errors occurred in complex cases. | N/A | The study does not mention the use of an image dataset; it focuses on evaluating textual data and conclusions from meta-analyses. | Experts | Retrospective | The study did not involve image-based diagnosis; it focused on evaluating textual conclusions from meta-analyses and ChatGPT outputs | N/A | N/A | ||
Patient Interaction | Use of ChatGPT for Query Handling | Trends in Accuracy and Appropriateness of Alopecia Areata Information Obtained from a Popular Online Large Language Model, ChatGPT [59] | O’Hagan et al. | 2023 | ChatGPT 4.0 demonstrated higher accuracy (4.53/5) than ChatGPT 3.5 (4.29/5) in addressing patient questions about alopecia areata. Responses were rated highly appropriate for general information and moderately suitable for EHR drafts, indicating potential for patient education and clinical use. | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
Comparing the quality of ChatGPT- and physician-generated responses to patients’ dermatology questions in the electronic medical record [9] | Reynolds et al. | 2024 | This study was evaluating responses to patient questions, physician-generated responses were preferred over ChatGPT’s, especially for readability and empathy. However, ChatGPT was seen as useful for drafting initial responses and providing educational information. | GPT-3.5 | N/A | The diagnosis was compared to responses from dermatology physicians, as well as nonphysicians (blinded reviewers). | Retrospective | N/A | N/A | N/A | ||
Generates learning materials | Assessing the Application of Large Language Models in Generating Dermatologic Patient Education Materials According to Reading Level: Qualitative Study [56] | Lambert et al. | 2024 | LLMs like GPT-4 generate dermatologic patient education materials (PEMs) at specified reading levels, with GPT-4 performing best at the fifth-grade level for both common and rare conditions. PEMs produced by LLMs are generally accurate, easy to read, and understandable for patients, with variable results at the seventh-grade level. | ChatGPT-3.5, GPT-4.0. | N/A | The diagnosis was compared to 2 blinded dermatology resident trainees. | N/A | N/A | N/A | N/A | |
Others | Performing exams | ChatGPT-3.5 and ChatGPT-4 dermatological knowledge level based on the Specialty Certificate Examination in Dermatology [60] | Lewandowski et al. | 2024 | ChatGPT-4 outperformed ChatGPT-3.5 in dermatology exams, achieving 80–93% accuracy in English and 70–84% in Polish. While effective in clinical decision support, it struggles with high-difficulty questions. Recommended for aiding but not replacing physicians. | ChatGPT-3.5, GPT-4.0. | N/A | The study compared the performance of ChatGPT to that of a dermatologist with 25 years of experience, who reviewed the questions for compliance with current knowledge. | Retrospective | N/A | N/A | N/A |
Performance of ChatGPT on Specialty Certificate Examination in Dermatology multiple-choice questions [55] | Passby et al. | 2024 | ChatGPT-4 scored 90% on 84 multiple-choice dermatology questions, outperforming ChatGPT-3.5 (63%). This highlights AI’s potential in clinical decision-making, with caution regarding complex cases and patient safety. | ChatGPT-3.5 and ChatGPT-4. | N/A | N/A | N/A | N/A | N/A | N/A | ||
OpenAI’s GPT-4 performs to a high degree on board-style dermatology questions [54] | Elias et al. | 2024 | GPT-4 achieved 75% accuracy on dermatology board-style questions, showing potential as an educational tool but requiring improvements in response depth and completeness for unsupervised learning. Its performance was consistent across subspecialties and question difficulty. | GPT-4.0 | N/A | The diagnosis was compared to the correct answers evaluated by two physicians. | Cross-sectional study | N/A | N/A | N/A | ||
Pediatric dermatologists versus AI bots: Evaluating the medical knowledge and diagnostic capabilities of ChatGPT [61] | Huang et al. | 2024 | This study compares OpenAI’s ChatGPT (versions 3.5 and 4.0) to pediatric dermatologists in answering multiple-choice and case-based questions. Results show that while human clinicians outperformed both AI versions, ChatGPT-4.0 performed comparably in some areas, highlighting AI’s potential with clinician oversight. | GPT-3.5 and GPT-4.0 | The image dataset was not used. For cases with accompanying images, only text descriptions were included | The diagnosis was compared to pediatric dermatologists | prospective | text descriptions alone | N/A | N/A | ||
management | An evaluation of ChatGPT compared with dermatological surgeons’ choices of reconstruction for surgical defects after Mohs surgery [62] | Cuellar-Barboza et al. | 2024 | This study found that while ChatGPT-4 showed slight concordance with dermatologists in reconstructive decision-making for skin cancer surgery, the agreement was lower than that between dermatologists themselves. The findings highlight the variability in AI-driven medical decisions and the importance of certified expertise. | ChatGPT-4.0 | N/A | The diagnosis was compared to dermatological surgeons’ choices. | Retrospective | N/A | N/A | N/A | |
Evaluation of ChatGPT’s acne advice [63] | Li et al. | 2024 | This study assessed ChatGPT’s responses to acne-related queries, evaluating accuracy, completeness, and relevance. Dermatologists rated the responses as satisfactory, limited, or problematic, revealing variable quality in the answers. | ChatGPT-3.5 | N/A | The diagnosis was compared to two board-certified dermatologists | Retrospective | N/A | N/A | N/A | ||
Machine Learning | Diagnostics | Pre-trained multimodal large language model enhances dermatological diagnosis using SkinGPT-4 [64] | Zhou et al. | 2024 | SkinGPT-4 is an interactive dermatology diagnostic system that combines a vision transformer and Llama-2-13b-chat, trained on 52,929 skin disease images. It autonomously diagnoses skin conditions, analyzes characteristics, and offers treatment recommendations based on real-life evaluations with dermatologists. | |||||||
Treatment | Can large language models provide secondary reliable opinion on treatment options for dermatological diseases? [53] | Iqbal et al. | 2024 | Proven potential to provide accurate second opinions on dermatological medication recommendations (98.87% approval rate by dermatologists). However, limitations include occasional coding inaccuracies and incomplete data, suggesting the need for domain-specific knowledge integration. | ||||||||
Exams | Assessing large language models’ accuracy in providing patient support for choroidal melanoma [65] | Anguita et al. | 2024 | ChatGPT provided the most accurate answers (92%) for medical advice questions about choroidal melanoma compared to Bing AI and DocsGPT. However, inconsistencies highlight the need for fine-tuning and oversight before clinical use. | Assessing large language models’ accuracy in providing patient support for choroidal melanoma [65] | Anguita et al. | 2024 | |||||
Performance of Three Large Language Models on Dermatology Board Examinations [66] | Mirza et al. | 2024 | GPT-4 outperformed GPT-3.5 and Google Bard in dermatology board-style questions, achieving 81.7% accuracy and passing CORE and APPLIED exams. Challenges included difficulty with higher-order and complex questions. | Performance of Three Large Language Models on Dermatology Board Examinations [66] | Mirza et al. | 2024 | ||||||
[53,64] Reviews | Review—diagnostics | Assessing the Impact of ChatGPT in Dermatology: A Comprehensive Rapid Review. [67] | Goktas et al. | 2024 | ChatGPT shows promise in patient education and teledermatology but faces challenges in diagnosing complex cases and raises ethical concerns regarding data privacy and algorithmic bias. Future research should focus on improving its diagnostic accuracy and addressing these issues. | |||||||
General review on the potential | ChatGPT and dermatology [68] | D’AGOSTINO et al. | 2024 | This review explores the potential applications of ChatGPT in dermatology, highlighting its role in clinical practice and patient support. It emphasizes the synergy between AI and dermatology, driving innovation in healthcare delivery. | ||||||||
Potential applications of ChatGPT in dermatology [69] | Kluger | 2023 | Supports clinical decision-making and treatment planning with high accuracy for common conditions. Facilitates patient education, simplifies medical writing, and integrates into teledermatology platforms for consultations and triage. Limitations include challenges in multilingual settings, image interpretation, and ethical concerns. | |||||||||
Ethical considerations for artificial intelligence in dermatology: a scoping review [70] | Gordon et al. | 2024 | AI applications span mobile apps for skin cancer detection, clinical image analysis, and large language models for diagnostic queries. Ethical concerns include biases, misdiagnosis risks, data privacy, and exacerbation of health disparities in teledermatology. Benefits include improved access, decision-making, and efficiency in clinical practice, but safeguards are necessary for ethical use. | |||||||||
Analyzing potential | ChatGPT for healthcare providers and patients: Practical implications within dermatology [71] | Jin et al. | 2023 | Identified five domains of use in dermatology, including automating administrative tasks, enhancing patient education, supporting medical education, aiding clinical research, and improving health literacy. Ethical challenges include risks of “artificial hallucinations,” biases, and outdated datasets, necessitating systematic validation and usage guidelines. | ||||||||
The Arrival of Artificial Intelligence Large Language Models and Vision-Language Models: A Potential to Possible Change in the Paradigm of Healthcare Delivery in Dermatology [19] | Gupta et al. | 2024 | The study explores the potential of large language models (LLMs) and vision-language models (VLMs) in dermatology, addressing how AI can improve patient care amidst challenges like workload and staffing shortages. AI technologies, such as ChatGPT and Google Bard, could transform dermatology by integrating text and image inputs. |
6. Limitations of Using Large Language Models (LLMs) Like ChatGPT in Dermatology Diagnostics
7. Future Perspectives
- Better Integration with Diagnostic Tools:
- Multimodal Models:
- Personalized Treatment Recommendations:
- AI-Assisted Diagnostic Frameworks:
- Future Research Directions:
8. Conclusions
Author Contributions
Funding
Conflicts of Interest
References
- Alowais, S.A.; Alghamdi, S.S.; Alsuhebany, N.; Alqahtani, T.; Alshaya, A.I.; Almohareb, S.N.; Aldairem, A.; Alrashed, M.; Saleh, K.B.; Badreldin, H.A.; et al. Revolutionizing healthcare: The role of artificial intelligence in clinical practice. BMC Med. Educ. 2023, 23, 689. Available online: https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-023-04698-z (accessed on 12 November 2024). [CrossRef] [PubMed]
- Alqahtani, T.; Badreldin, H.A.; Alrashed, M.; Alshaya, A.I.; Alghamdi, S.S.; bin Saleh, K.; Alowais, S.A.; Alshaya, O.A.; Rahman, I.; Al Yami, M.S.; et al. The emergent role of artificial intelligence, natural learning processing, and large language models in higher education and research. Res. Soc. Adm. Pharm. 2023, 19, 1236–1242. [Google Scholar] [CrossRef] [PubMed]
- De Angelis, L.; Baglivo, F.; Arzilli, G.; Privitera, G.P.; Ferragina, P.; Tozzi, A.E.; Rizzo, C. ChatGPT and the rise of large language models: The new AI-driven infodemic threat in public health. Front. Public Health 2023, 11, 1166120. Available online: https://pubmed.ncbi.nlm.nih.gov/37181697/ (accessed on 12 November 2024).
- Du-Harpur, X.; Watt, F.M.; Luscombe, N.M.; Lynch, M.D. What is AI? Applications of artificial intelligence to dermatology. Br. J. Dermatol. 2020, 183, 423–430. Available online: https://pubmed.ncbi.nlm.nih.gov/31960407/ (accessed on 12 November 2024). [CrossRef]
- Khalifa, M.; Albadawy, M. AI in diagnostic imaging: Revolutionising accuracy and efficiency. Comput. Methods Programs Biomed. Update 2024, 5, 100146. [Google Scholar] [CrossRef]
- Shapiro, J.; Baum, S.; Pavlotzky, F.; Mordehai, Y.B.; Barzilai, A.; Freud, T.; Gershon, R. Application of a natural language processing artificial intelligence tool in psoriasis: A cross-sectional comparative study on identifying affected areas in patients’ data. Clin. Dermatol. 2024, 42, 480–486. [Google Scholar] [CrossRef]
- Lam Hoai, X.L.; Simonart, T. Comparing Meta-Analyses with ChatGPT in the Evaluation of the Effectiveness and Tolerance of Systemic Therapies in Moderate-to-Severe Plaque Psoriasis. J. Clin. Med. 2023, 12, 5410. Available online: https://www.mdpi.com/2077-0383/12/16/5410/htm (accessed on 15 November 2024). [CrossRef] [PubMed]
- Pierce, E.J.; Boytsov, N.N.; Vasey, J.J.; Sudaria, T.C.; Liu, X.; Lavelle, K.W.; Bogdanov, A.N.; Goldblum, O.M. A Qualitative Analysis of Provider Notes of Atopic Dermatitis-Related Visits Using Natural Language Processing Methods. Dermatol. Ther. 2021, 11, 1305–1318. Available online: https://link.springer.com/article/10.1007/s13555-021-00553-5 (accessed on 15 November 2024). [CrossRef]
- Reynolds, K.; Nadelman, D.; Durgin, J.; Ansah-Addo, S.; Cole, D.; Fayne, R.; Harrell, J.; Ratycz, M.; Runge, M.; Shepard-Hayes, A.; et al. Comparing the Quality of ChatGPT-and Physician-Generated Responses to Patients’ Dermatologic Questions in the Electronic Medical Record. Available online: https://academic.oup.com/ced/advance-article-abstract/doi/10.1093/ced/llad456/7511330 (accessed on 15 November 2024).
- Fliorent, R.; Fardman, B.; Podwojniak, A.; Javaid, K.; Tan, I.J.; Ghani, H.; Truong, T.M.; Rao, B.; Heath, C. Artificial intelligence in dermatology: Advancements and challenges in skin of color. Int. J. Dermatol. 2024, 63, 455–461. Available online: https://onlinelibrary.wiley.com/doi/full/10.1111/ijd.17076 (accessed on 13 November 2024). [CrossRef]
- Soori, M.; Arezoo, B.; Dastres, R. Artificial intelligence, machine learning and deep learning in advanced robotics, a review. Cogn. Robot. 2023, 3, 54–70. [Google Scholar] [CrossRef]
- Abhishek, K.; Kawahara, J.; Hamarneh, G. Predicting the clinical management of skin lesions using deep learning. Sci. Rep. 2021, 11, 7769. Available online: https://www.nature.com/articles/s41598-021-87064-7 (accessed on 13 November 2024).
- Esteva, A.; Kuprel, B.; Novoa, R.A.; Ko, J.; Swetter, S.M.; Blau, H.M.; Thrun, S. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017, 542, 115–118. Available online: https://www.nature.com/articles/nature21056 (accessed on 13 November 2024). [CrossRef]
- Voon, W.; Hum, Y.C.; Tee, Y.K.; Yap, W.S.; Salim, M.I.M.; Tan, T.S.; Mokayed, H.; Lai, K.W. Performance analysis of seven Convolutional Neural Networks (CNNs) with transfer learning for Invasive Ductal Carcinoma (IDC) grading in breast histopathological images. Sci. Rep. 2022, 12, 19200. Available online: https://www.nature.com/articles/s41598-022-21848-3 (accessed on 13 November 2024). [CrossRef] [PubMed]
- Venkatesh, K.P.; Raza, M.M.; Nickel, G.; Wang, S.; Kvedar, J.C. Deep learning models across the range of skin disease. NPJ Digit. Med. 2024, 7, 32. Available online: https://www.nature.com/articles/s41746-024-01033-8 (accessed on 13 November 2024). [CrossRef] [PubMed]
- Ozmen Garibay, O.; Winslow, B.; Andolina, S.; Antona, M.; Bodenschatz, A.; Coursaris, C.; Falco, G.; Fiore, S.M.; Garibay, I.; Grieman, K.; et al. Six Human-Centered Artificial Intelligence Grand Challenges. Int. J. Hum. Comput. Interact. 2023, 39, 391–437. Available online: https://www.tandfonline.com/doi/abs/10.1080/10447318.2022.2153320 (accessed on 13 November 2024). [CrossRef]
- Hubert, K.F.; Awa, K.N.; Zabelina, D.L. The current state of artificial intelligence generative language models is more creative than humans on divergent thinking tasks. Sci. Rep. 2024, 14, 3440. Available online: https://www.nature.com/articles/s41598-024-53303-w (accessed on 13 November 2024). [CrossRef]
- Liu, J.; Wang, C.; Liu, S. Utility of ChatGPT in Clinical Practice. J. Med. Internet Res. 2023, 25, e48568. Available online: https://pmc.ncbi.nlm.nih.gov/articles/PMC10365580/ (accessed on 13 November 2024). [CrossRef]
- Gupta, A.K.; Talukder, M.; Wang, T.; Daneshjou, R.; Piguet, V. The Arrival of Artificial Intelligence Large Language Models and Vision-Language Models: A Potential to Possible Change in the Paradigm of Healthcare Delivery in Dermatology. J. Investig. Dermatol. 2024, 144, 1186–1188. Available online: https://www.jidonline.org/article/S0022-202X(24)00004-6/fulltext (accessed on 13 November 2024). [CrossRef]
- Mu, Y.; He, D. The Potential Applications and Challenges of ChatGPT in the Medical Field. Int. J. Gen. Med. 2024, 17, 817–826. [Google Scholar] [CrossRef]
- Chen, J.; Liu, L.; Ruan, S.; Li, M.; Yin, C. Are Different Versions of ChatGPT’s Ability Comparable to the Clinical Diagnosis Presented in Case Reports? A Descriptive Study. J. Multidiscip. Healthc. 2023, 16, 3825–3831. [Google Scholar] [CrossRef]
- Clusmann, J.; Kolbinger, F.R.; Muti, H.S.; Carrero, Z.I.; Eckardt, J.N.; Laleh, N.G.; Löffler, C.M.L.; Schwarzkopf, S.-C.; Unger, M.; Veldhuizen, G.P.; et al. The future landscape of large language models in medicine. Commun. Med. 2023, 3, 141. Available online: https://www.nature.com/articles/s43856-023-00370-1 (accessed on 13 November 2024). [CrossRef]
- Sonthalia, S.; Yumeen, S.; Kaliyadan, F. Dermoscopy Overview and Extradiagnostic Applications. Available online: https://www.ncbi.nlm.nih.gov/books/NBK537131/ (accessed on 14 November 2024).
- Wang, Z.; Wang, C.; Peng, L.; Lin, K.; Xue, Y.; Chen, X.; Bao, L.; Liu, C.; Zhang, J.; Xie, Y. Radiomic and deep learning analysis of dermoscopic images for skin lesion pattern decoding. Sci. Rep. 2024, 14, 19781. Available online: https://www.nature.com/articles/s41598-024-70231-x (accessed on 14 November 2024). [CrossRef]
- Omar, M.; Ullanat, V.; Loda, M.; Marchionni, L.; Umeton, R. ChatGPT for digital pathology research. Lancet Digit. Health 2024, 6, e595–e600. Available online: http://www.thelancet.com/article/S2589750024001146/fulltext (accessed on 14 November 2024). [CrossRef] [PubMed]
- Goktas, P.; Grzybowski, A. Assessing the Impact of ChatGPT in Dermatology: A Comprehensive Rapid Review. J. Clin. Med. 2024, 13, 5909. Available online: https://pmc.ncbi.nlm.nih.gov/articles/PMC11477344/ (accessed on 14 November 2024). [CrossRef] [PubMed]
- Gabashvili, I.S. ChatGPT in Dermatology: A Comprehensive Systematic Review. 2023. Available online: http://medrxiv.org/lookup/doi/10.1101/2023.06.11.23291252 (accessed on 14 November 2024).
- Nazir, A.; Wang, Z. A comprehensive survey of ChatGPT: Advancements, applications, prospects, and challenges. Meta-Radiology 2023, 1, 100022. [Google Scholar] [CrossRef]
- Alzubaidi, L.; Zhang, J.; Humaidi, A.J.; Al-Dujaili, A.; Duan, Y.; Al-Shamma, O.; Santamaría, J.; Fadhel, M.A.; Al-Amidie, M.; Farhan, L. Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions. J. Big Data 2021, 8, 53. Available online: https://journalofbigdata.springeropen.com/articles/10.1186/s40537-021-00444-8 (accessed on 14 November 2024). [CrossRef]
- Ray, P.P. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet Things Cyber-Phys. Syst. 2023, 3, 121–154. [Google Scholar] [CrossRef]
- Roumeliotis, K.I.; Tselikas, N.D. ChatGPT and Open-AI Models: A Preliminary Review. Future Internet 2023, 15, 192. Available online: https://www.mdpi.com/1999-5903/15/6/192/htm (accessed on 15 November 2024). [CrossRef]
- Shapiro, J.; Lyakhovitsky, A. Revolutionizing teledermatology: Exploring the integration of artificial intelligence, including Generative Pre-trained Transformer chatbots for artificial intelligence-driven anamnesis, diagnosis, and treatment plans. Clin. Dermatol. 2024, 42, 492–497. Available online: http://www.cidjournal.com/article/S0738081X24001044/fulltext (accessed on 15 November 2024). [CrossRef]
- McKoy, K.; Halpern, S.; Mutyambizi, K. International Teledermatology Review. Curr. Dermatol. Rep. 2021, 10, 55. Available online: https://pmc.ncbi.nlm.nih.gov/articles/PMC8317676/ (accessed on 15 November 2024). [CrossRef]
- Campagna, M.; Naka, F.; Lu, J. Teledermatology: An updated overview of clinical applications and reimbursement policies. Int. J. Womens Dermatol. 2017, 3, 176–179. [Google Scholar] [CrossRef]
- Alomari, E.A. Unlocking the Potential: A Comprehensive Systematic Review of ChatGPT in Natural Language Processing Tasks. Comput. Model. Eng. Sci. 2024, 141, 43–85. [Google Scholar] [CrossRef]
- Bansal, G.; Chamola, V.; Hussain, A.; Guizani, M.; Niyato, D. Transforming Conversations with AI—A Comprehensive Study of ChatGPT. Cognit. Comput. 2024, 16, 2487–2510. Available online: https://link.springer.com/article/10.1007/s12559-023-10236-2 (accessed on 15 November 2024). [CrossRef]
- Ferreira, A.L.; Chu, B.; Grant-Kels, J.M.; Ogunleye, T.; Lipoff, J.B. Evaluation of ChatGPT Dermatology Responses to Common Patient Queries. JMIR Dermatol. 2023, 6, e49280. Available online: https://pmc.ncbi.nlm.nih.gov/articles/PMC10692871/ (accessed on 15 November 2024). [CrossRef] [PubMed]
- Jerfy, A.; Selden, O.; Balkrishnan, R. The Growing Impact of Natural Language Processing in Healthcare and Public Health. Inq. J. Health Care Organ. Provis. Financ. 2024, 61, 00469580241290095. Available online: https://journals.sagepub.com/doi/full/10.1177/00469580241290095 (accessed on 15 November 2024). [CrossRef] [PubMed]
- Thirunavukarasu, A.J.; Ting, D.S.J.; Elangovan, K.; Gutierrez, L.; Tan, T.F.; Ting, D.S.W. Large language models in medicine. Nat. Med. 2023, 29, 1930–1940. Available online: https://www.nature.com/articles/s41591-023-02448-8 (accessed on 15 November 2024). [CrossRef] [PubMed]
- Haltaufderheide, J.; Ranisch, R. The ethics of ChatGPT in medicine and healthcare: A systematic review on Large Language Models (LLMs). NPJ Digit. Med. 2024, 7, 183. Available online: https://www.nature.com/articles/s41746-024-01157-x (accessed on 15 November 2024). [CrossRef]
- Hariri, W. Unlocking the Potential of ChatGPT: A Comprehensive Exploration of Its Applications, Advantages, Limitations, and Future Directions in Natural Language Processing. Available online: http://arxiv.org/abs/2304.02017 (accessed on 16 November 2024).
- OpenAI. ChatGPT (Version GPT-4) [Large Language Model]. OpenAI. 2024. Available online: https://openai.com/chatgpt (accessed on 14 June 2024).
- Nayak, I.; Kanagaraj, K.; Shrimali, M.; Kumar, D.; Ghamande, M.V.; Kumar, C.S. Improved Convolutional Neural Network based Approach for Analyzing the ChatGPT and Different Fields Impact. In Proceedings of the 2023 2nd International Conference on Automation, Computing and Renewable Systems (ICACRS), Pudukkottai, India, 11–13 December 2023; pp. 629–635. [Google Scholar]
- Gao, Y.; Zhang, L.; Xu, Y. CKG: Improving ABSA with text augmentation using ChatGPT and knowledge-enhanced gated attention graph convolutional networks. PLoS ONE 2024, 19, e0301508. Available online: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0301508 (accessed on 16 November 2024). [CrossRef]
- Ahmed, W.; Afzal, M.S.; Khan, M.N. ChatGPT in Dermatology: Evaluating Its Diagnostic Accuracy and Potential Role in Clinical Practice. Clin. Cosmet. Investig. Dermatol. 2023, 16, 1795–1802. [Google Scholar]
- DePalma, K.; Miminoshvili, I.; Henselder, C.; Moss, K.; AlOmar, E.A. Exploring ChatGPT’s code refactoring capabilities: An empirical study. Expert Syst. Appl. 2024, 249, 123602. [Google Scholar] [CrossRef]
- Using ChatGPT for Coding Challenges|by Mustakim Masum|Medium. Available online: https://medium.com/@m.m.kiron/using-chatgpt-for-coding-challenges-4cab6ca3bdc7 (accessed on 16 November 2024).
- Liu, X.; Duan, C.; Kim, M.K.; Zhang, L.; Jee, E.; Maharjan, B.; Huang, Y.; Du, D.; Jiang, X. Claude 3 Opus and ChatGPT With GPT-4 in Dermoscopic Image Analysis for Melanoma Diagnosis: Comparative Performance Analysis. JMIR Med. Inform. 2024, 12, e59273. Available online: https://pubmed.ncbi.nlm.nih.gov/39106482/ (accessed on 17 November 2024). [CrossRef]
- Lakdawala, N.; Channa, L.; Gronbeck, C.; Lakdawala, N.; Weston, G.; Sloan, B.; Feng, H. Assessing the Accuracy and Comprehensiveness of ChatGPT in Offering Clinical Guidance for Atopic Dermatitis and Acne Vulgaris. JMIR Dermatol. 2023, 6, e50409. Available online: https://pmc.ncbi.nlm.nih.gov/articles/PMC10685272/ (accessed on 17 November 2024). [CrossRef]
- Alanezi, F. Factors influencing patients’ engagement with ChatGPT for accessing health-related information. Crit. Public. Health 2024, 34, 1–20. Available online: https://www.tandfonline.com/doi/abs/10.1080/09581596.2024.2348164 (accessed on 17 November 2024). [CrossRef]
- Zhang, D.; Zhao, X. Understanding adoption intention of virtual medical consultation systems: Perceptions of ChatGPT and satisfaction with doctors. Comput. Human Behav. 2024, 159, 108359. [Google Scholar] [CrossRef]
- Pillai, A.; Parappally Joseph, S.; Hardin, J. Evaluating the Diagnostic and Treatment Recommendation Capabilities of GPT-4 Vision in Dermatology. medRxiv 2024. [Google Scholar] [CrossRef]
- Iqbal, U.; Lee, L.T.J.; Rahmanti, A.R.; Celi, L.A.; Li, Y.C.J. Can large language models provide secondary reliable opinion on treatment options for dermatological diseases? J. Am. Med. Inform. Assoc. 2024, 31, 1341–1347. Available online: https://pubmed.ncbi.nlm.nih.gov/38578616/ (accessed on 20 November 2024). [CrossRef] [PubMed]
- Elias, M.L.; Burshtein, J.; Sharon, V.R. OpenAI’s GPT-4 performs to a high degree on board-style dermatology questions. Int. J. Dermatol. 2024, 63, 73–78. Available online: https://pubmed.ncbi.nlm.nih.gov/38131454/ (accessed on 20 November 2024). [CrossRef] [PubMed]
- Passby, L.; Jenko, N.; Wernham, A. Performance of ChatGPT on Specialty Certificate Examination in Dermatology multiple-choice questions. Clin. Exp. Dermatol. 2024, 49, 722–727. Available online: https://pubmed.ncbi.nlm.nih.gov/37264670/ (accessed on 20 November 2024). [CrossRef]
- Lambert, R.; Choo, Z.Y.; Gradwohl, K.; Schroedl, L.; De Luzuriaga, A.R. Assessing the Application of Large Language Models in Generating Dermatologic Patient Education Materials According to Reading Level: Qualitative Study. JMIR Dermatol. 2024, 7, e55898. Available online: https://pubmed.ncbi.nlm.nih.gov/38754096/ (accessed on 20 November 2024). [CrossRef]
- Ko, E.A.; Torre, A.C.; Hernandez, B.; Bibiloni, N.; Covián, E.; Salerni, G.; Alonso, C.; Ochoa, A.K.; Mazzuoccolo, L.D. Argentine dermatology and ChatGPT: Infrequent use and intermediate stance. Clin. Exp. Dermatol. 2024, 49, 734–736. [Google Scholar] [CrossRef]
- Stoneham, S.; Livesey, A.; Cooper, H.; Mitchell, C. ChatGPT versus clinician: Challenging the diagnostic capabilities of artificial intelligence in dermatology. Clin. Exp. Dermatol. 2024, 49, 707–710. Available online: https://pubmed.ncbi.nlm.nih.gov/37979201/ (accessed on 20 November 2024). [CrossRef]
- O’Hagan, R.; Kim, R.H.; Abittan, B.J.; Caldas, S.; Ungar, J.; Ungar, B. Trends in Accuracy and Appropriateness of Alopecia Areata Information Obtained from a Popular Online Large Language Model, ChatGPT. Dermatology 2023, 239, 952–957. Available online: https://pubmed.ncbi.nlm.nih.gov/37722370/ (accessed on 20 November 2024). [CrossRef]
- Lewandowski, M.; Łukowicz, P.; Świetlik, D.; Barańska-Rybak, W. ChatGPT-3.5 and ChatGPT-4 dermatological knowledge level based on the Specialty Certificate Examination in Dermatology. Clin. Exp. Dermatol. 2024, 49, 686–691. Available online: https://pubmed.ncbi.nlm.nih.gov/37540015/ (accessed on 20 November 2024). [CrossRef] [PubMed]
- Huang, C.Y.; Zhang, E.; Caussade, M.C.; Brown, T.; Stockton Hogrogian, G.; Yan, A.C. Pediatric dermatologists versus AI bots: Evaluating the medical knowledge and diagnostic capabilities of ChatGPT. Pediatr. Dermatol. 2024, 41, 831–834. Available online: https://pubmed.ncbi.nlm.nih.gov/38721744/ (accessed on 20 November 2024). [CrossRef] [PubMed]
- Cuellar-Barboza, A.; Brussolo-Marroquín, E.; Cordero-Martinez, F.C.; Aguilar-Calderon, P.E.; Vazquez-Martinez, O.; Ocampo-Candiani, J. An evaluation of ChatGPT compared with dermatological surgeons’ choices of reconstruction for surgical defects after Mohs surgery. Clin. Exp. Dermatol. 2024, 49, 1367–1371. Available online: https://pubmed.ncbi.nlm.nih.gov/38738492/ (accessed on 20 November 2024). [CrossRef]
- Li, K.; Hsu, J.T.S.; Li, M.K. Evaluation of ChatGPT’s acne advice. Clin. Exp. Dermatol. 2024, 49, 746–749. [Google Scholar] [CrossRef] [PubMed]
- Zhou, J.; He, X.; Sun, L.; Xu, J.; Chen, X.; Chu, Y.; Zhou, L.; Liao, X.; Zhang, B.; Afvari, S.; et al. Pre-trained multimodal large language model enhances dermatological diagnosis using SkinGPT-4. Nat. Commun. 2024, 15, 5649. Available online: https://www.nature.com/articles/s41467-024-50043-3 (accessed on 19 November 2024). [CrossRef]
- Anguita, R.; Downie, C.; Ferro Desideri, L.; Sagoo, M.S. Assessing large language models’ accuracy in providing patient support for choroidal melanoma. Eye 2024, 38, 3113–3117. Available online: https://pubmed.ncbi.nlm.nih.gov/39003430/ (accessed on 20 November 2024). [CrossRef]
- Mirza, F.N.; Lim, R.K.; Yumeen, S.; Wahood, S.; Zaidat, B.; Shah, A.; Tang, O.Y.; Kawaoka, J.; Seo, S.-J.; DiMarco, C.; et al. Performance of Three Large Language Models on Dermatology Board Examinations. J. Investig. Darmatol. 2024, 144, 398–400. Available online: https://pubmed.ncbi.nlm.nih.gov/37541614/ (accessed on 20 November 2024). [CrossRef]
- Diazo, J.M.; Ngo, D.Q.; Wetter, D.A.; Davis, D.M.R.; Tollefson, M.M. Performance of ChatGPT in Dermatology: A Systematic Review. JAAD Int. 2024, 14, 100137. [Google Scholar]
- D’Agostino, M.; Feo, F.; Martora, F.; Genco, L.; Megna, M.; Cacciapuoti, S.; Villani, A.; Potestio, L. ChatGPT and dermatology. Ital. J. Dermatol. Venereol. 2024, 159, 566–571. Available online: https://pubmed.ncbi.nlm.nih.gov/39039954/ (accessed on 19 November 2024). [CrossRef]
- Kluger, N. Potential applications of ChatGPT in dermatology. J. Eur. Acad. Dermatol. Venereol. 2023, 37, e941–e942. Available online: https://onlinelibrary.wiley.com/doi/full/10.1111/jdv.19152 (accessed on 20 November 2024). [CrossRef]
- Gordon, E.R.; Trager, M.H.; Kontos, D.; Weng, C.; Geskin, L.J.; Dugdale, L.S.; Samie, F.H. Ethical considerations for artificial intelligence in dermatology: A scoping review. Br. J. Dermatol. 2024, 190, 789–797. Available online: https://pubmed.ncbi.nlm.nih.gov/38330217/ (accessed on 20 November 2024). [CrossRef]
- Jin, J.Q.; Dobry, A.S. ChatGPT for healthcare providers and patients: Practical implications within dermatology. J. Am. Acad. Dermatol. 2023, 89, 870–871. Available online: https://pubmed.ncbi.nlm.nih.gov/37315798/ (accessed on 20 November 2024). [CrossRef]
- Jabour, T.B.F.; Ribeiro, J.P.; Fernandes, A.C.; Honorato, C.M.A.; Queiroz Mdo, C.A.P. ChatGPT: Performance of artificial intelligence in the dermatology specialty certificate examination. An. Bras. Dermatol. 2023, 99, 277. Available online: https://pmc.ncbi.nlm.nih.gov/articles/PMC10943280/ (accessed on 19 November 2024). [CrossRef]
- Ullah, E.; Parwani, A.; Baig, M.M.; Singh, R. Challenges and barriers of using large language models (LLM) such as ChatGPT for diagnostic medicine with a focus on digital pathology—A recent scoping review. Diagn. Pathol. 2024, 19, 43. Available online: https://diagnosticpathology.biomedcentral.com/articles/10.1186/s13000-024-01464-7 (accessed on 19 November 2024). [CrossRef]
- OpenAI. GPT-4 Technical Report. arXiv 2023, arXiv:2303.08774. [Google Scholar]
- Bender, E.M.; Gebru, T.; McMillan-Major, A.; Shmitchell, S. On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, Toronto, ON, Canada, 3–10 March 2021; pp. 610–623. Available online: https://dl.acm.org/doi/10.1145/3442188.3445922 (accessed on 19 November 2024).
- Kololgi, S.P.; Lahari, C. Harnessing the Power of Artificial Intelligence in Dermatology: A Comprehensive Commentary. Indian J. Dermatol. 2024, 68, 678. Available online: https://pmc.ncbi.nlm.nih.gov/articles/PMC10868991/ (accessed on 19 November 2024). [CrossRef]
- Jeong, H.K.; Park, C.; Henao, R.; Kheterpal, M. Deep Learning in Dermatology: A Systematic Review of Current Approaches, Outcomes, and Limitations. JID Innov. 2023, 3, 100150. [Google Scholar] [CrossRef]
- Busik, V. How artificial intelligence and large language models are revolutionizing dermatology. Dermatologie 2024, 75, 743–746. Available online: https://pubmed.ncbi.nlm.nih.gov/38900290/ (accessed on 19 November 2024). [CrossRef]
- Porter, E.; Murphy, M.; O’Connor, C. Chat GPT in dermatology: Progressive or problematic? J. Eur. Acad. Dermatol. Venereol. 2023, 37, e943–e944. Available online: https://pubmed.ncbi.nlm.nih.gov/37150950/ (accessed on 19 November 2024). [CrossRef]
Model | Volume of Articles | Applications in Dermatology |
---|---|---|
ChatGPT (OpenAI) | High (50+ articles) | Used for diagnostic support, clinical note analysis, and patient interaction. Achieves 88% accuracy in handling common queries. |
Google Bard (PaLM) | Low (2–5 articles) | No specific dermatology focus found; primarily applied to general conversational AI and integration with Google systems. |
Claude by Anthropic | Low (1–2 articles) | Limited mentions in healthcare; prioritized for safe, ethical applications in sensitive tasks. |
Microsoft Copilot (Powered by GPT-4) | Moderate (5–10 articles) | Integrated in teledermatology workflows via Office Suite for clinical reporting and diagnostic data organization |
LLaMA (Meta) | Low (<5 articles) | Primarily used in researchno specific dermatology-related applications identified. |
Mistral | None Found | No known dermatology-related applications. |
Cohere | None Found | Primarily enterprise knowledge management; no dermatology-specific use cases identified. |
Amazon Bedrock | None Found | Focus on general enterprise flexibility; no dermatol no dermatology-specific use cases identified. |
xAI (Grok) | None found | Still emerging; no dermatology-specific use cases identified. |
IBM Watson Assistant | Low (1–2 articles) | Some use cases in patient engagement and healthcare support, but minimal focus on dermatology. |
Jasper AI | None Found | No known applications in dermatology; focused on content creation. |
Character.ai | None Found | Used for entertainment; no healthcare or dermatology use cases. |
DeepMind Gemini | Emerging | Promising capabilities in diagnostics, but still in development with no dermatology applications yet. |
Perplexity.ai | None Found | Focused on information retrieval with no dermatology-specific applications. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Khamaysi, Z.; Awwad, M.; Jiryis, B.; Bathish, N.; Shapiro, J. The Role of ChatGPT in Dermatology Diagnostics. Diagnostics 2025, 15, 1529. https://doi.org/10.3390/diagnostics15121529
Khamaysi Z, Awwad M, Jiryis B, Bathish N, Shapiro J. The Role of ChatGPT in Dermatology Diagnostics. Diagnostics. 2025; 15(12):1529. https://doi.org/10.3390/diagnostics15121529
Chicago/Turabian StyleKhamaysi, Ziad, Mahdi Awwad, Badea Jiryis, Naji Bathish, and Jonathan Shapiro. 2025. "The Role of ChatGPT in Dermatology Diagnostics" Diagnostics 15, no. 12: 1529. https://doi.org/10.3390/diagnostics15121529
APA StyleKhamaysi, Z., Awwad, M., Jiryis, B., Bathish, N., & Shapiro, J. (2025). The Role of ChatGPT in Dermatology Diagnostics. Diagnostics, 15(12), 1529. https://doi.org/10.3390/diagnostics15121529