Simple Summary
General practitioners are often the first to assess suspicious skin lesions, yet many lack specific training in melanoma detection. This narrative review analyzes 54 studies (1995–2024), comparing in-person and e-learning educational interventions in terms of structure, content, duration, interactivity, and diagnostic outcomes. A key finding is that programs incorporating dermoscopy and interactive elements—particularly asynchronous online formats—can enhance sensitivity, specificity, and diagnostic accuracy. However, few studies evaluated long-term clinical impact. Our review provides novel insights into the strengths and limitations of different training approaches and highlights the potential of hybrid models to improve early melanoma recognition in primary care. Structured and accessible training for general practitioners is essential to ensure timely diagnosis, better patient outcomes, and integration into dermatological care pathways.
Abstract
General practitioners play a crucial role in the early detection and prevention of cutaneous melanoma. However, structured training on skin cancer diagnosis and management is often lacking. This narrative review aims to map the current educational interventions for general practitioners focused on melanoma, assess their methodological approaches and outcomes, and explore the contribution of e-learning and telemedicine in medical education. A comprehensive literature search identified 54 relevant studies published between 1 January 1995 and 31 December 2024. Data were extracted and categorized by topics covered, training methodology, interactivity, and clinical outcomes. Training programs varied widely in duration, delivery, and content. Interventions that integrated dermoscopy and interactive methodologies demonstrated improved diagnostic accuracy and clinical impact. E-learning, particularly asynchronous models, emerged as a flexible and effective modality, although few studies evaluated long-term retention or clinical practice changes. Educational programs tailored to general practitioners and enriched with dermoscopy and telemedicine tools show promise in improving melanoma detection and care. Structured, interactive, and blended/hybrid learning models should be prioritized to support effective primary and secondary prevention.
1. Introduction
Proper triage of skin lesions and knowledge of the diagnostic–therapeutic pathway for melanoma enable effective collaboration between general practitioners (GPs) and specialized facilities. Training GPs and pediatricians is a strategic approach for first triage and for promoting both primary and secondary prevention. Primary prevention reduces the incidence of malignant skin tumors by addressing risk factors, while secondary prevention ensures timely diagnosis [1].
Public awareness initiatives for skin self-surveillance have been implemented in many countries and, despite being fragmented, have improved time to diagnosis and survival rates for cutaneous melanoma [1]. However, many GPs still lack adequate training in diagnostics, referral, and management of melanoma.
Recent systematic reviews identified numerous educational interventions for GPs, ranging from brief online modules to extended courses [2,3]. While several improved melanoma-related knowledge and competence—especially when dermoscopy was incorporated—few evaluated effects on clinical practice through audits or referral analysis [2,3]. This gap highlights the need for more effective and practice-oriented training strategies. This review evaluates the effectiveness of educational interventions for GPs in diagnosing pigmented lesions and melanoma, with particular attention to the pedagogical models applied. It compares traditional in-person formats with synchronous and asynchronous e-learning, analyzing content delivery, learner engagement, assessment methods, and clinical outcomes. By integrating findings from systematic reviews and original studies, it aims to clarify how digital and hybrid education can enhance early melanoma detection and inform future dermatology training programs.
2. Materials and Methods
We began our literature search with two systematic reviews conducted by Brown [2] and Gonna [3], which included 51 studies published between 1 January 1995 and 31 December 2020 and 21 studies published between 1 January 2000 and 31 December 2021, respectively. Both reviews focused on skin cancer education programs for primary care physicians. From these, we extracted all relevant studies that specifically addressed melanoma and the early diagnosis of skin cancer in general practitioners (GPs).
Inclusion criteria encompassed studies describing educational interventions specifically targeting GPs or GP residents, with a focus on melanoma and the early diagnosis of skin cancer. Eligible studies included training programs delivered through face-to-face sessions, literature-based formats, e-learning modules, or blended and interactive methods, including, but not limited to, the use of dermoscopy and telemedicine tools.
We excluded studies that did not involve GPs or GP trainees (e.g., those focused on dermatologists or medical students), as well as those that failed to describe the content of the training or did not include any form of outcome measurement or statistical analysis.
Duplicates were removed using reference management software, and ten additional articles were excluded after full-text review because they did not focus exclusively on primary care settings or did not address early skin cancer diagnosis.
To expand and update the evidence base, we conducted a supplementary systematic search of major medical databases: PubMed/MEDLINE, Scopus, Web of Science, and Embase. The search covered publications between 1 January 2020 and 31 December 2024, using the following combination of MeSH terms and free-text keywords: “primary care physicians,” “primary care providers,” “general practitioners,” “family medicine,” “general provider”, “family doctor”, “family physician”, “skin cancer,” “melanoma,” “skin cancer,” “early diagnosis,” “education,” “training,” “educational training,” “e-learning,” “teledermatology,” “dermoscopy,” and “systematic literature review”.
The same inclusion and exclusion criteria applied in the initial selection were adopted for this extended search, and all potentially eligible articles were re-read in full to confirm their suitability.
In addition, five further articles were identified through citation tracking.
In total, 54 studies met the final eligibility criteria and were included in this narrative synthesis (Figure 1). Of these, 32 used face-to-face formats and 22 adopted e-learning approaches.
Figure 1.
Flowchart. A comprehensive literature search was conducted using two previously published systematic reviews as a starting point, identifying a total of 72 studies [2,3]. After removing duplicates and screening titles and abstracts, 10 articles were excluded for not meeting the inclusion criteria (i.e., lacking focus on general practitioners or early skin cancer diagnosis). An updated search of major medical databases (2020–2024) yielded four additional studies. Reference list screening identified five more articles. Inclusion criteria comprised studies describing educational interventions for general practitioners (GPs) or GP residents, with an emphasis on melanoma or early skin cancer detection, using face-to-face, e-learning, literature-based, or interactive formats. Studies were excluded if they did not involve GPs, lacked description of educational content, or did not report outcomes. In total, 54 studies were included in the review. Data were extracted and organized into thematic domains, including training modality, content, duration, and educational outcomes.
Data were extracted and systematically organized into thematic tables summarizing key findings in the following areas:
- Educational interventions and topics addressed;
- Training methodologies (e.g., delivery format, in-person, e-learning, literature-based feedback strategies, patient interaction, interactivity and course duration);
- Outcomes of face-to-face training programs;
- Outcomes of e-learning-based training programs.
3. Results
The intervention studies consistently included training on the clinical principles of dermatological diagnosis of melanoma—particularly concerning the ABCDE rule and the “ugly duckling” sign—occasionally supplemented by dermoscopic training. The following table illustrates the key areas addressed in the training courses (Table 1).
Table 1.
Topics of training courses.
3.1. Educational Interventions and Topics Addressed
Most of the analyzed studies focused their training programs on selected thematic areas of melanocytic pathology, often without comprehensively addressing the full scope of the integrated care pathway—knowledge that is essential for effective and optimal melanoma management (Table 2). However, a subset of studies [4,5,6,7,8,9,10,11,12,13,14] stand out for offering broader and more integrated curricula. These programs included not only diagnostic criteria for benign and malignant melanocytic lesions but also in-depth training in epidemiology and melanoma care management.
Table 2.
Articles present in the global literature: topics included in the training intervention.
Among the most comprehensive and complex educational initiatives, few studies [13,14,26,55] covered all core components of melanoma training, including: epidemiology, diagnosis of pigmented and non-pigmented skin lesions, management strategies, patient counseling, fundamentals of dermoscopy, and the implementation of diagnostic algorithms.
Within the context of these numerous studies and their heterogeneous scope, a subset included training interventions featuring sessions on basic dermoscopy concepts [5,7,15,16,28,32,36,38,42,50]. The introduction of dermoscopy into primary care practice has shown substantial advantages, including:
- A reduction in the number of benign lesions unnecessarily referred to dermatologists;
- An improved benign-to-malignant ratio among excised lesions;
- Measurable improvements in the diagnostic accuracy and clinical decision-making of trained GPs;
- Demonstrated effectiveness even among practitioners with limited prior experience, especially when reinforced by refresher courses;
- A favorable cost-effectiveness profile, with positive implications for both healthcare systems and patient mobility.
3.2. Training Delivery Methods and Implementation Strategies
Over the past thirty years, numerous training initiatives have been developed for GPs, employing a wide range of delivery formats. Table 3 summarizes the key characteristics of these interventions, including the type of delivery (synchronous or asynchronous), presence of feedback mechanisms, level of interactivity, integration of supporting literature, opportunities for patient interaction, and overall course duration.
Table 3.
Articles in the global literature: methodology.
An analysis of the methodologies employed in the selected studies, as shown in Table 3, reveals that live (synchronous) sessions represent the most adopted training modality, featured in 32 studies. This preference likely reflects the accessibility of live sessions, particularly for practitioners with limited familiarity or confidence in using newer digital technologies. A significant number of studies employ more than one approach to complete their training programs, and in some cases, they include direct references to the relevant scientific literature [8,10,11,12,16,17,19,22,25,28,29,30,32,39,40,41,45,50,56].
Moreover, e-learning has been adopted in 22 of the studies examined, emerging as a training modality increasingly used in recent years thanks to the rapid spread of new digital technologies and the undeniable advantages of interactivity and personalization in the learning experience [10,11,13,14,21,24,26,28,29,30,32,33,38,39,41,45,46,47,51,53,55,60].
The use of interactivity, enabled by specific content such as quizzes, multiple- or single-choice questions, tests, and simulations—thereby stimulating and promoting an active learning process—has been employed in several training programs [5,6,7,10,11,24,26,32,33,35,39,40,41,45,46,47,51,53,54,55].
Feedback strategies designed for participants were incorporated into several training interventions [5,7,29,30,32,43,44,45,46,47,57]. Given that feedback can confirm and restructure previously acquired information, thereby reinforcing and consolidating the learning process, its use constitutes a powerful strategy for enhancing participants’ knowledge and skills. However, it should be noted that only a limited number of studies [11,26,28,33] included feedback questions providing information on user satisfaction with the platform as well as suggestions for its improvement.
Only five studies incorporated direct patient interaction during the training intervention, specifically through sessions focused on evaluating pigmented or non-pigmented skin lesions, with or without the aid of dermoscopy [4,20,31,32,45].
The duration of the training programs varied considerably, ranging from a single day (with a variable number of instructional hours) to multiple days of participation in several training sessions.
3.2.1. Frontal Learning Courses: Comparison of Results
Frontal learning, a traditional face-to-face educational approach, was employed in several studies included in this analysis to train GPs in the clinical diagnosis of dermatological conditions. Table 4 provides a structured summary of the included studies, detailing the study design number of participants, types of interventions, and key diagnostic outcomes (sensitivity, specificity, accuracy, and positive and negative predictive values). It focuses on face-to-face training interventions and includes only those studies that reported data on the number of participants before and after the training, along with measures of intervention effectiveness.
Table 4.
Summary of face-to-face training programs: study design, number of GPs, intervention characteristics, and diagnostic outcomes.
Out of a total of 5903 GPs contacted, 2020 completed the pre-training questionnaire, while 1442 completed the post-training questionnaire. Among the groups of GPs who participated in both assessments, varying proportions were trained using frontal education modalities, depending on the study. The effectiveness of these training programs was evaluated by monitoring indicators reflecting participants’ diagnostic performance before and after the intervention.
Across all the studies that assessed it, a consistent increase in diagnostic sensitivity was observed following the training, although this improvement was not statistically significant in every case. Regarding specificity and overall diagnostic accuracy, values remained stable in four out of the eight studies for which data were available, while three studies reported improvements in both parameters.
Several studies provided clear evidence of effectiveness. For instance, Bedlow et al. reported increases in sensitivity from 63% to 76% and specificity from 55% to 62%, and accuracy remained stable [17]. Brochez et al. demonstrated a broad improvement across all diagnostic parameters, including sensitivity (72% to 84%), specificity (71% to 70%), accuracy (49% to 56%), positive predictive value (61–63%), and negative predictive value (80–87%) [8]. Similar improvements were noted by Argenziano et al., who observed a significant increase in sensitivity (from 54.1% to 79.2%) and a slight gain in specificity (from 71.3% to 71.8%), with a high negative predictive value of 95.8% [15]. Meanwhile, Seiverling et al. reported sensitivity gains from 62,5% to 88,1%, specificity from 90.3% to 87.8%, and accuracy from 59.7% to 78.3% [51].
Some studies [36,44,56] reported only partial outcomes or focused on knowledge-based assessments without fully presenting diagnostic metrics. Others [12,25,27] lacked post-test results or key performance indicators, limiting the ability to evaluate impact. The studies by Harkemanne et al. [34,61] introduced simulated scenarios and longitudinal follow-up but did not include complete statistical data.
3.2.2. E-Learning Courses: Comparison of Results
E-learning, a digital and remote educational approach, was utilized in several of the studies included in this analysis to train GPs in the clinical diagnosis of dermatological conditions. We can distinguish three main e-learning training modalities based on the degree of synchronism and flexibility for participants (Table 5):
Table 5.
Comparison of synchronous, asynchronous and blended training.
- Synchronous Training: This modality involves real-time interaction between participants and instructors through platforms like webinars and virtual classrooms. It enables immediate feedback but requires precise scheduling and coordination.
- Asynchronous Training: Participants learn independently at their own pace, accessing materials on demand. This flexible format promotes self-directed learning but lacks real-time interaction and immediate instructor feedback.
- Blended Learning: Combining synchronous and asynchronous elements, this approach balances flexibility with engagement. It requires careful planning to allocate content appropriately between self-paced and live sessions, optimizing interaction and knowledge transfer.
In this review, we distinguish between two related but distinct educational modalities:
- Blended learning: refers to a combination of synchronous and asynchronous e-learning activities conducted entirely online.
- Hybrid learning models: combine digital (online) components with in-person (face-to-face) sessions, such as workshops or clinical case discussions.
While both approaches aim to enhance flexibility and engagement, hybrid models allow for direct interpersonal interaction, which may support the development of practical skills in clinical settings. The effectiveness of these training programs was evaluated by monitoring indicators reflecting participants’ diagnostic performance before and after the intervention.
Across all the studies that assessed it, a consistent increase in diagnostic sensitivity was observed following the training, although this improvement was not statistically significant in every case. Regarding specificity, values improved after training in all the records where this data was available. Overall diagnostic accuracy improved in five out of five studies in which data were available. These findings indicate that e-learning interventions tend to improve sensitivity, specificity, and overall diagnostic accuracy. Moreover, this modality can reach a very large audience, making it an excellent training approach.
Table 6 provides a structured summary of the included studies, outlining the study design, sample size, types of interventions, and key diagnostic outcomes (sensitivity, specificity, accuracy, positive and negative predictive values). It focuses on e-learning formats and presents a comparative overview of 16 studies evaluating the effectiveness of e-learning interventions in improving general practitioners’ diagnostic performance for skin cancer.
Table 6.
Summary of e-learning training programs: study design, number of GPs, intervention characteristics, and diagnostic outcomes.
Out of a total of 12,284 general practitioners (GPs) contacted, 2579 participants completed the pre-training questionnaire, while 2185 completed the post-training questionnaire.
The included studies varied considerably in sample size, geographic origin, methodology, and outcome reporting. Most studies demonstrated improvements in diagnostic knowledge or accuracy following the intervention. For instance, Gerbert et al. reported an increase in diagnostic accuracy from 43% to 56% [30], while Harris et al. documented improvements in sensitivity (from 91% to 95%), specificity (from 72% to 92%), and overall accuracy (from 52% to 85%) [11]. Eide et al. showed modest gains in sensitivity, specificity, and accuracy, sustained up to six months post-intervention [26]. Nervil et al. also reported improvements in sensitivity (from 67.1% to 73.7%) and diagnostic accuracy (from 42.5% to 53%) [43]. Only a limited number of studies provided complete diagnostic metrics, including sensitivity (Se), specificity (Sp), accuracy, positive predictive value (PPV), and negative predictive value (NPV). Menzies et al. was the only study to report all five parameters, showing significant improvements: sensitivity increased from 23.1% to 69.2%, specificity from 90.6% to 92.8%, PPV from 18.8% to 47.4%, and NPV from 93.3% to 97.9% [39].
Some studies, such as Dolianitis et al. and Pagnanelli et al., focused on comparisons between diagnostic algorithms or dermoscopic criteria rather than using pre- and post-test designs [24,59]. Others, like Secker et al. and Robinson et al., assessed diagnostic ability across specific lesion categories [46,50]. Notably, large-scale interventions by Markova et al. and Weinstock et al. involved thousands of patients, highlighting the potential for broad clinical implementation [37,55].
Among the studies analyzed, four employed a hybrid educational model combining both live (face-to-face) and e-learning components: Gerbert et al., Menzies et al., Secker et al., and Marra et al. [30,38,39,50] These hybrid studies illustrate the flexibility of combined learning approaches in GPs education. Menzies et al. reported the most comprehensive diagnostic outcome set, with substantial improvements across all metrics [39]. Marra et al. found a post-training diagnostic accuracy of 70.3%, despite not reporting sensitivity or specificity values [38]. Gerbert et al. documented modest gains in diagnostic accuracy (from 43% to 56%) [30], while Secker et al. provided data stratified by lesion type [50]. However, the lack of standardized and complete outcome reporting in several of these studies limits direct comparability.
4. Discussion
Training is essential to maintain high-quality patient care, as medical education must evolve with emerging evidence and advancing clinical practices. Literature shows that various training programs have been developed to improve GPs’ skills in diagnosing skin cancers, especially melanoma. However, only a small number of these interventions have led to positive changes in clinical practice (i.e., statistically significant improvements) [32,38].
Due to the lack of standardization in how these training activities are organized, it is difficult to compare the outcomes obtained. Indeed, multiple parameters can be considered when assessing the effectiveness of a training program, such as increased theoretical knowledge, greater confidence in previously acquired information, and expanded skill sets. Other crucial aspects include enhanced self-efficacy and, more specifically, the training’s impact on diagnostic skills in terms of sensitivity, specificity, and negative and positive predictive values.
Our review showed that over the past thirty years only a few studies have methodically focused on a detailed analysis of these parameters. Although most studies report improvements in at least one key outcome parameter (knowledge, skills, self-efficacy, or diagnostic performance), some studies demonstrate limited gains in knowledge and/or clinical practice [20,21,23,27,44]. It has been hypothesized that training interventions lacking active interaction and of short duration are unlikely to produce clear and lasting changes in clinical practice. By contrast, courses on dermoscopy designed for GPs have proven effective at increasing the ability to detect cutaneous melanomas, outperforming traditional naked-eye examinations [62]. Supporting this premise, several cited studies that included a dermoscopy component showed a statistically significant increase in participants’ skills [24,47,56]. In the study by Menzies et al. [39], improvements were observed in self-efficacy and diagnostic performance, as well as positive changes in clinical practice. Furthermore, our review highlights substantial variability in the content of training programs on skin cancer in primary care. There is no standardized training framework across studies; the choice of topics is highly variable. Only a few programs provide a holistic educational approach, combining clinical content with practical tools and communication skills. More recent interventions tend to be more comprehensive, possibly due to advances in dermoscopic techniques and a better understanding of educational needs in primary care. A few studies offered comprehensive, integrated curricula. In contrast, other programs focused narrowly on lesion recognition [13,14,37,41,53,55].
Recent reviews [61,63,64,65,66,67] provide foundational insights into the role of educational interventions—particularly e-learning—in improving GPs’ ability to diagnose skin cancers. However, when compared with the broader dataset captured in the tables of this review, some important differences and innovations emerge.
E-learning, as highlighted in both reviews, offers clear advantages in terms of flexibility, asynchronous learning, and the ability to scale across large groups of practitioners. Posada et al. emphasize the use of interactive online modules, often incorporating dermoscopy, and report improved diagnostic performance in knowledge, accuracy, and confidence [67]. Harkemanne et al., while confirming the presence of e-learning components, did not quantify their prevalence and reported a high degree of heterogeneity in methods and content [61].
Table 4 and Table 6 analyzed in this narrative review significantly expand upon these findings, identifying 16 e-learning studies and 20 frontal learning studies, many of which were not included in the previous reviews. This allowed for a more granular comparison of effectiveness based on pre-/post-test outcomes, sensitivity, specificity, and long-term retention (e.g., Eide et al. with 6-month follow-up [26]). The additional studies also revealed a wider variety of formats, including hybrid models, which blend online modules with face-to-face dermoscopy workshops or clinical case discussions.
In contrast, frontal (in-person) learning programs demonstrated strengths in practical skill development, especially in the application of dermoscopy and diagnostic algorithms. Several of these interventions [8,15,51] showed substantial gains in diagnostic accuracy, often supported by structured evaluation tools and simulated clinical scenarios, highlighting the unique value of hands-on instruction in fostering clinical decision-making and confidence. These findings suggest that hybrid models may offer effective alternatives to purely digital or purely in-person formats, but further research with standardized evaluation frameworks is needed to validate their impact.
Moreover, the extended dataset allowed the identification of new thematic trends not captured in the original reviews. Recent studies [13,14] incorporated fully integrated curricula that addressed not only lesion recognition but also epidemiology, management, counseling, and the use of algorithms, offering a more holistic approach to primary care training in skin cancer. This contrasts with the more limited thematic scope of many earlier interventions, which focused primarily on lesion identification.
In the new digital era, embedding AI into telemedicine education represents a forward-looking strategy to enhance primary care capacity for melanoma detection and management. Artificial intelligence (AI) and mobile health applications in medical education can provide future practitioners with practical experience in combining decision-support algorithms with clinical judgment. Two recent systematic reviews have comprehensively evaluated the current state of AI in dermatology. A meta-analysis by Salinas et al. [68] reported that AI achieved a sensitivity of 87.0% and a specificity of 77.1%, comparable or superior to clinicians (79.8% and 73.6%, respectively) and similar to experienced dermatologists. These findings suggest that AI could serve as a valuable second-opinion tool, particularly for non-specialists or in areas with limited access to dermatology services.
Similarly, a recent systematic review by Zararsis et al. [60] confirmed these promising findings but highlighted the lack of real-world validation and the limited integration of AI tools into primary care workflows. Despite the rapid evolution of this field, both reviews emphasized that AI systems remain largely confined to research and proof-of-concept phases. Real-world validation, regulatory approval, and practical integration into existing educational and diagnostic pathways are still limited. Further studies are required to assess their impact in everyday clinical practice.
This narrative review has several limitations. The high methodological heterogeneity among studies—in design, training methods, and outcome measures—precluded meta-analysis and limited direct comparisons. Most studies were observational or pilot programs, with few randomized controlled trials, weakening overall evidence quality. Outcome reporting was inconsistent, reducing comparability. While the search was broad and up to date, no formal risk of bias assessment was conducted, and selection bias cannot be ruled out. Language and database restrictions may have excluded relevant studies despite multi-database searching and citation tracking. Nevertheless, this review offers a timely synthesis of educational strategies for melanoma detection in general practice, identifying key strengths and areas for future improvement.
5. Conclusions
Studies in the literature indicate that a wide range of educational initiatives have been developed to train GPs in the primary and secondary prevention of cutaneous melanoma. The greatest challenge highlighted in most of these studies is converting gains in knowledge and self-efficacy into meaningful changes in clinical practice and, ultimately, patient care. An effective training program focused on skin cancers—particularly melanoma—and designed for primary care physicians can help reduce morbidity and mortality, especially where access to dermatological services is limited. Both e-learning and in-person educational programs have demonstrated effectiveness in improving GPs’ diagnostic skills in skin cancer. However, the absence of standardized outcome measures and limited long-term follow-up continue to limit comparability across studies.
Notably, the interventions that achieved tangible improvements in clinical practice were predominantly e-learning courses incorporating interactive methodologies that foster an active, dynamic learning process and enable broad dissemination of content. In contrast, short-term, passive training interventions without interactivity have proven ineffective. Courses that include a dermoscopy component have shown especially strong outcomes, significantly enhancing diagnostic performance. Dermoscopy training is becoming increasingly prevalent in skin cancer education, given its higher diagnostic sensitivity compared to traditional naked-eye examination and its applicability in primary care settings. AI in dermatology shows promising accuracy comparable to dermatologists and could support melanoma detection in primary care. However, its role remains experimental, requiring real-world validation and integration into clinical practice.
Taken together, these findings from the literature are particularly valuable in shaping the structure and key features of GP-oriented training interventions, making them more likely to yield sustained benefits in clinical practice [3,67,69,70]. While e-learning ensures accessibility, consistency, and scalability, frontal learning remains essential for developing hands-on diagnostic competence. The combination of both, particularly in hybrid models, may represent the most effective strategy. Broader literature reveals a trend toward more comprehensive, multidisciplinary training programs, emphasizing the need for standardized content, validated evaluation metrics, and long-term follow-up in future educational research.
Author Contributions
Conceptualization, I.S.; methodology, I.S., D.C. and E.M.; formal analysis, I.S., D.C., E.M. and G.R.; data curation, I.S., D.C., E.M., G.R. and G.L.T.; writing—original draft preparation, D.C., E.M., G.R. and S.S.; writing—review and editing, I.S., G.R., S.S. and G.L.T.; visualization, S.M., L.M., M.M., C.M., D.M., F.Z., I.Z., G.P., S.C., S.A., V.D.G., P.Q. and M.A.P.; supervision, I.S., S.C., D.M., C.M. and G.L.T.; All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors on request.
Acknowledgments
We thank the Istituto Oncologico Romagnolo (IOR) and Italian Melanoma Intergroup (IMI) for the continuing educational programme on melanoma prevention.
Conflicts of Interest
The authors declare no conflict of interest.
Abbreviations
The following abbreviations are used in this manuscript:
| GPs | General Practitioners |
| PPV | Positive Predictive Value |
| NPV | Negative Predictive Value |
References
- Perez, M.; Abisaad, J.A.; Rojas, K.D.; Marchetti, M.A.; Jaimes, N. Skin cancer: Primary, secondary, and tertiary prevention. Part I. J. Am. Acad. Dermatol. 2022, 87, 255–268. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Brown, A.E.; Najmi, M.; Duke, T.; Grabell, D.A.; Koshelev, M.V.; Nelson, K.C. Skin Cancer Education Interventions for Primary Care Providers: A Scoping Review. J. Gen. Intern. Med. 2022, 37, 2267–2279. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Gonna, N.; Tran, T.; Bassett, R.L.; Farris, D.P.; Nelson, K.C. Sensitivity and Specificity for Skin Cancer Diagnosis in Primary Care Providers: A Systematic Literature Review and Meta-analysis of Educational Interventions and Diagnostic Algorithms. J. Cancer Educ. 2022, 37, 1563–1572. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Anders, M.P.; Fengler, S.; Volkmer, B.; Greinert, R.; Breitbart, E.W. Nationwide skin cancer screening in Germany: Evaluation of the training program. Int. J. Dermatol. 2017, 56, 1046–1051. [Google Scholar] [CrossRef] [Scilit]
- Badertscher, N.; Rosemann, T.; Tandjung, R.; Braun, R.P. minSKIN does a multifaceted intervention improve the competence in the diagnosis of skin cancer by general practitioners? Study protocol for a randomised controlled trial. Trials 2011, 12, 165. [Google Scholar] [CrossRef] [Scilit]
- Badertscher, N.; Braun, R.P.; Held, U.; Kofmehl, R.; Senn, O.; Hofbauer, G.F.; O Rossi, P.; Wensing, M.J.; Rosemann, T.; Tandjung, R. Diagnostic competence of Swiss general practitioners in skin cancer. Swiss Med. Wkly. 2013, 143, w13834. [Google Scholar] [CrossRef] [Scilit]
- Badertscher, N.; Tandjung, R.; Senn, O.; Kofmehl, R.; Held, U.; Rosemann, T.; Hofbauer, G.; Wensing, M.; Rossi, P.; Braun, R. A multifaceted intervention: No increase in general practitioners’ competence to diagnose skin cancer (minSKIN)—randomized controlled trial. J. Eur. Acad. Dermatol. Venereol. 2014, 29, 1493–1499. [Google Scholar] [CrossRef] [Scilit]
- Brochez, L.; Verhaeghe, E.; Bleyen, L.; Naeyaert, J.-M. Diagnostic ability of general practitioners and dermatologists in discriminating pigmented skin lesions. J. Am. Acad. Dermatol. 2001, 44, 979–986. [Google Scholar] [CrossRef] [Scilit]
- Carli, P.; De Giorgi, V.; Crocetti, E.; Caldini, L.; Ressel, C.; Giannotti, B. Diagnostic and referral accuracy of family doctors in melanoma screening: Effect of a short formal training. Eur. J. Cancer Prev. 2005, 14, 51–55. [Google Scholar] [CrossRef] [Scilit]
- Grange, F.; Woronoff, A.; Bera, R.; Colomb, M.; Lavole, B.; Fournier, E.; Arnold, F.; Barbe, C. Efficacy of a general practitioner training campaign for early detection of melanoma in France. Br. J. Dermatol. 2014, 170, 123–129. [Google Scholar] [CrossRef] [Scilit]
- Harris, J.M., Jr.; Salasche, S.J.; Harris, R.B. Using the Internet to teach melanoma management guidelines to primary care physicians. J. Eval. Clin. Pract. 1999, 5, 199–211. [Google Scholar] [CrossRef] [Scilit]
- Peuvrel, L.; Quereux, G.; Jumbou, O.; Sassolas, B.; Lequeux, Y.; Dreno, B. Impact of a campaign to train general practitioners in screening for melanoma. Eur. J. Cancer Prev. 2009, 18, 225–229. [Google Scholar] [CrossRef] [Scilit]
- Stanganelli, I.; Magi, S.; Bucchi, L.; Crocetti, E.; Mancini, S.; Vattiato, R.; Falcinelli, S.; Re, P.; Melandri, D.; Brusasco, M.; et al. Evaluation of a training course for general practitioners within the melanoma multimedia education program of the Italian melanoma intergroup: Study protocol. Dermatol. Rep. 2024, 16, 9919. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Zamagni, F.; Falcini, F.; Magi, S.; Bucchi, L.; Mancini, S.; Vattiato, R.; Crocetti, E.; Falcinelli, S.; Feliciani, C.; Lombardo, M.; et al. Preliminary analysis of the melanoma multimedia educational program for general practitioners on behalf of the Italian melanoma intergroup. Dermatol. Rep. 2024, 16, 9920. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Argenziano, G.; Puig, S.; Zalaudek, I.; Sera, F.; Corona, R.; Alsina, M.; Barbato, F.; Carrera, C.; Ferrara, G.; Guilabert, A.; et al. Dermoscopy Improves Accuracy of Primary Care Physicians to Triage Lesions Suggestive of Skin Cancer. J. Clin. Oncol. 2006, 24, 1877–1882. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Augustsson, A.; Paoli, J. Effects of a 1-Day Training Course in Dermoscopy Among General Practitioners. Dermatol. Pract. Concept. 2019, 9, 195–199. [Google Scholar] [CrossRef] [Scilit]
- Bedlow, A.J.; Cliff, S.; Melia, J.; Moss, S.M.; Seyan, R.; Harland, C.C. Impact of skin cancer education on general practitioners’ diagnostic skills. Clin. Exp. Dermatol. 2000, 25, 115–118. [Google Scholar] [CrossRef] [Scilit]
- Beecher, S.M.; Keogh, C.; Healy, C. Dedicated general practitioner education sessions can improve diagnostic capabilities and may have a positive effect on referral patterns for common skin lesions. Ir. J. Med Sci. 2018, 187, 959–963. [Google Scholar] [CrossRef] [Scilit]
- Bourne, P.; Rosendahl, C.; Keir, J.; Cameron, A. BLINCK—A diagnostic algorithm for skin cancer diagnosis combining clinical features with dermatoscopy findings. Dermatol. Pract. Concept. 2012, 2, 55–61. [Google Scholar] [CrossRef] [Scilit]
- Burton, R.C.; Howe, C.; Adamson, L.; Reid, A.L.; Hersey, P.; Watson, A.; Watt, G.; Relic, J.; Holt, D.; Thursfield, V.; et al. General practitioner screening for melanoma: Sensitivity, specificity, and effect of training. J. Med. Screen. 1998, 5, 156–161. [Google Scholar] [CrossRef] [Scilit]
- De Gannes, G.C.; Ip, J.L.; Martinka, M.; Crawford, R.I.; Rivers, J.K. Early detection of skin cancer by family physicians: A pilot project. J. Cutan. Med. Surg. 2004, 8, 103–109. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Del Mar, C.B.; Green, A.C. Aid to diagnosis of melanoma in primary medical care. BMJ 1995, 310, 492–495. [Google Scholar] [CrossRef] [Scilit]
- Dolan, N.C.; Ng, J.S.; Martin, G.J.; Robinson, J.K.; Rademaker, A.W. Effectiveness of a skin cancer control educational intervention for internal medicine housestaff and attending physicians. J. Gen. Intern. Med. 1997, 12, 531–536. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Dolianitis, C.; Kelly, J.; Wolfe, R.; Simpson, P. Comparative Performance of 4 Dermoscopic Algorithms by Nonexperts for the Diagnosis of Melanocytic Lesions. Arch. Dermatol. 2005, 141, 1008–1014. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Duarte, A.F.; da Costa-Pereira, A.; Del-Marmol, V.; Correia, O. Are General Physicians Prepared for Struggling Skin Cancer?—Cross-Sectional Study. J. Cancer Educ. 2016, 33, 321–324. [Google Scholar] [CrossRef] [Scilit]
- Eide, M.J.; Asgari, M.M.; Fletcher, S.W.; Geller, A.C.; Halpern, A.C.; Shaikh, W.R.; Li, L.; Alexander, G.L.; Altschuler, A.; Dusza, S.W.; et al. Effects on Skills and Practice from a Web-Based Skin Cancer Course for Primary Care Providers. J. Am. Board Fam. Med. 2013, 26, 648–657. [Google Scholar] [CrossRef] [Scilit]
- English, D.R.; Burton, R.C.; del Mar, C.B.; Donovan, R.J.; Ireland, P.D.; Emery, G. Evaluation of aid to diagnosis of pigmented skin lesions in general practice: Controlled trial randomised by practice. BMJ 2003, 327, 375. [Google Scholar] [CrossRef] [Scilit]
- Friche, P.; Moulis, L.; Du Thanh, A.; Dereure, O.; Duflos, C.; Carbonnel, F. Training Family Medicine Residents in Dermoscopy Using an e-Learning Course: Pilot Interventional Study. JMIR Form. Res. 2024, 8, e56005. [Google Scholar] [CrossRef] [Scilit]
- Gerbert, B.; Bronstone, A.; Wolff, M.; Maurer, T.; Berger, T.; Pantilat, S.; McPhee, S.J. Improving primary care residents’ proficiency in the diagnosis of skin cancer. J. Gen. Intern. Med. 1998, 13, 91–97. [Google Scholar] [CrossRef] [Scilit]
- Gerbert, B.; Bronstone, A.; Maurer, T.; Berger, T.; McPhee, S.J.; Caspers, N. The effectiveness of an Internet-based tutorial in improving primary care physicians’ skin cancer triage skills. J. Cancer Educ. 2002, 17, 7–11. [Google Scholar] [CrossRef] [Scilit]
- Girgis, A.; Sanson-Fisher, R.W.; Howe, C.; Raffan, B. A skin cancer training programme: Evaluation of a postgraduate training for family doctors. Med. Educ. 1995, 29, 364–371. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Grimaldi, L.; Silvestri, A.; Brandi, C.; Nisi, G.; Brafa, A.; Calabrò, M.; Campa, A.; D’Aniello, C. Digital epiluminescence dermoscopy for pigmented cutaneous lesions, primary care physicians, and telediagnosis: A useful tool? J. Plast. Reconstr. Aesthetic Surg. 2009, 62, 1054–1058. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Gulati, A.; Harwood, C.; Rolph, J.; Pottinger, E.; Mcgregor, J.; Goad, N.; Proby, C. Is an online skin cancer toolkit an effective way to educate primary care physicians about skin cancer diagnosis and referral? J. Eur. Acad. Dermatol. Venereol. 2015, 29, 2152–2159. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Harkemanne, E.; Goublomme, N.; Sawadogo, K.; Tromme, I. Early Melanoma Detection in Primary Care: Clinical Recognition of Melanoma is Not Enough, One Must Also Learn the Basics. J. Cancer Educ. 2020, 37, 898–904. [Google Scholar] [CrossRef] [Scilit]
- Harris, J.M., Jr.; Salasche, S.J.; Harris, R.B. Can Internet-based continuing medical education improve physicians’ skin cancer knowledge and skills? J. Gen. Intern. Med. 2001, 16, 50–56. [Google Scholar] [CrossRef] [Scilit]
- Koelink, C.; Vermeulen, K.; Kollen, B.; de Bock, G.; Dekker, J.; Jonkman, M.; van der Heide, W. Diagnostic accuracy and cost-effectiveness of dermoscopy in primary care: A cluster randomized clinical trial. J. Eur. Acad. Dermatol. Venereol. 2013, 28, 1442–1449. [Google Scholar] [CrossRef] [Scilit]
- Markova, A.; Weinstock, M.A.; Risica, P.; Kirtania, U.; Shaikh, W.R.; Ombao, H.; Chambers, C.V.; Kabongo, M.L.; Kallail, K.J.; Post, D. Effect of a Web-Based Curriculum on Primary Care Practice: Basic Skin Cancer Triage Trial. Fam. Med. 2013, 45, 558–568. [Google Scholar]
- Marra, E.; van Rijsingen, M.; Alkemade, J.; Groenewoud, J.; Hueskes, K.; Bijvank, C.N.; van de Laar, F.; Lubeek, S. The effect of a dermato-oncological training programme on the diagnostic skills and quality of referrals for suspicious skin lesions by general practitioners*. Br. J. Dermatol. 2020, 184, 538–544. [Google Scholar] [CrossRef] [Scilit]
- Menzies, S.; Emery, J.; Staples, M.; Davies, S.; McAvoy, B.; Fletcher, J.; Shahid, K.; Reid, G.; Avramidis, M.; Ward, A.; et al. Impact of dermoscopy and short-term sequential digital dermoscopy imaging for the management of pigmented lesions in primary care: A sequential intervention trial. Br. J. Dermatol. 2009, 161, 1270–1277. [Google Scholar] [CrossRef] [Scilit]
- Mikkilineni, R.; Weinstock, M.A.; Goldstein, M.G.; Dube, C.E.; Rossi, J.S. Impact of the basic skin cancer triage curriculum on providers’ skin cancer control practices. J. Gen. Intern. Med. 2001, 16, 302–307. [Google Scholar] [CrossRef] [Scilit]
- Mikkilineni, R.; Weinstock, M.A.; Goldstein, M.G.; Dube, C.E.; Rossi, J.S. The Impact of the Basic Skin Cancer Triage Curriculum on Providers’ Skills, Confidence, and Knowledge in Skin Cancer Control. Prev. Med. 2002, 34, 144–152. [Google Scholar] [CrossRef] [Scilit]
- Moscarella, E.; Lallas, A.; Longo, C.; Alfano, R.; Argenziano, G. Five-point checklist for skin cancer detection in primary care. Ital. J. Dermatol. Venereol. 2019, 154, 523–528. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Nervil, G.G.; Ternov, N.K.; Vestergaard, T.; Sølvsten, H.; Chakera, A.H.; Tolsgaard, M.G.; Hölmich, L.R. Improving Skin Cancer Diagnostics Through a Mobile App With a Large Interactive Image Repository: Randomized Controlled Trial. JMIR Dermatol. 2023, 6, e48357. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Raasch, B.A.; Hays, R.; Buettner, P.G. An educational intervention to improve diagnosis and management of suspicious skin lesions. J. Contin. Educ. Health Prof. 2000, 20, 39–51. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rivet, C.; Motamedi, F.; Burns, J.; Archibald, D. A structured curriculum and procedure clinic to help family medicine residents diagnose and treat skin cancer. Can. Med. Educ. J. 2021, 12, 108–111. [Google Scholar] [CrossRef] [Scilit]
- Robinson, J.K.; MacLean, M.; Reavy, R.; Turrisi, R.; Mallett, K.; Martin, G.J. Dermoscopy of Concerning Pigmented Lesions and Primary Care Providers’ Referrals at Intervals After Randomized Trial of Mastery Learning. J. Gen. Intern. Med. 2018, 33, 799–800. [Google Scholar] [CrossRef] [Scilit]
- Robinson, J.K.; Jain, N.; Marghoob, A.A.; McGaghie, W.; MacLean, M.; Gerami, P.; Hultgren, B.; Turrisi, R.; Mallett, K.; Martin, G.J. A Randomized Trial on the Efficacy of Mastery Learning for Primary Care Provider Melanoma Opportunistic Screening Skills and Practice. J. Gen. Intern. Med. 2018, 33, 855–862. [Google Scholar] [CrossRef] [Scilit]
- Rogers, T.; Marino, M.L.; Dusza, S.W.; Bajaj, S.; Usatine, R.P.; Marchetti, M.A.; Marghoob, A.A. A Clinical Aid for Detecting Skin Cancer: The Triage Amalgamated Dermoscopic Algorithm (TADA). J. Am. Board Fam. Med. 2016, 29, 694–701. [Google Scholar] [CrossRef] [Scilit]
- Sawyers, E.A.; Wigle, D.T.; Marghoob, A.A.; Blum, A. Dermoscopy Training Effect on Diagnostic Accuracy of Skin Lesions in Canadian Family Medicine Physicians Using the Triage Amalgamated Dermoscopic Algorithm. Dermatol. Pract. Concept. 2020, 10, e2020035. [Google Scholar] [CrossRef] [Scilit]
- Secker, L.; Buis, P.; Bergman, W.; Kukutsch, N. Effect of a Dermoscopy Training Course on the Accuracy of Primary Care Physicians in Diagnosing Pigmented Lesions. Acta Derm. Venereol. 2017, 97, 263–265. [Google Scholar] [CrossRef] [Scilit]
- Seiverling, E.V.; Ahrns, H.T.; Greene, A.; Butt, M.; Yélamos, O.; Dusza, S.W.; Marghoob, A.A. Teaching Benign Skin Lesions as a Strategy to Improve the Triage Amalgamated Dermoscopic Algorithm (TADA). J. Am. Board Fam. Med. 2019, 32, 96–102. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Shariff, Z.; Roshan, A.; Williams, A.; Platt, A. 2-Week wait referrals in suspected skin cancer: Does an instructional module for general practitioners improve diagnostic accuracy? Surgeon 2010, 8, 247–251. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Swetter, S.M.; Chang, J.; Shaub, A.R.; Weinstock, M.A.; Lewis, E.T.; Asch, S.M. Primary Care–Based Skin Cancer Screening in a Veterans Affairs Health Care System. JAMA Dermatol. 2017, 153, 797–801. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Ward, J.; Boyle, C. Evaluation of skin cancer seminar for general practitioners: Changes in knowledge, diagnostic and procedural skills, beliefs, and self-reported practices. J. Contin. Educ. Health Prof. 1995, 15, 217–226. [Google Scholar] [CrossRef] [Scilit]
- Weinstock, M.A.; Ferris, L.K.; Saul, M.I.; Geller, A.C.; Risica, P.M.; Siegel, J.A.; Solano, F.X.; Kirkwood, J.M. Downstream consequences of melanoma screening in a community practice setting: First results. Cancer 2016, 122, 3152–3156. [Google Scholar] [CrossRef] [Scilit]
- Westerhoff, K.; Mccarthy, W.; Menzies, S. Increase in the sensitivity for melanoma diagnosis by primary care physicians using skin surface microscopy. Br. J. Dermatol. 2000, 143, 1016–1020. [Google Scholar] [CrossRef] [Scilit]
- Youl, P.H.; Raasch, B.A.; Janda, M.; Aitken, J.F. The effect of an educational programme to improve the skills of general practitioners in diagnosing melanocytic/pigmented lesions. Clin. Exp. Dermatol. 2007, 32, 365–370. [Google Scholar] [CrossRef] [Scilit]
- De Bedout, V.; Williams, N.; Muñoz, A.; Londoño, A.; Munera, M.; Naranjo, N.; Rodriguez, L.; Toro, A.; Miao, F.; Koru-Sengul, T.; et al. Skin Cancer and Dermoscopy Training for Primary Care Physicians: A Pilot Study. Dermatol. Pract. Concept. 2021, 11, e2021145. [Google Scholar] [CrossRef] [Scilit]
- Pagnanelli, G.; Soyer, H.; Argenziano, G.; Talamini, R.; Barbati, R.; Bianchi, L.; Campione, E.; Carboni, I.; Carrozzo, A.; Chimenti, M.; et al. Diagnosis of pigmented skin lesions by dermoscopy: Web-based training improves diagnostic performance of non-experts. Br. J. Dermatol. 2003, 148, 698–702. [Google Scholar] [CrossRef] [Scilit]
- Zararsız, G.E.; Taştan, S.I.Y.; Gürbulak, E.Ç.; Erakcaoğlu, A.; Işıkhan, S.Y.; Demirbaş, A.; Ertaş, R.; Eroğlu, İ.; Korkmaz, S.; Elmas, Ö.F. Diagnosis melanoma with artificial intelligence systems: A meta-analysis study and systematic review. J. Eur. Acad. Dermatol. Venereol. 2025. [Google Scholar] [CrossRef] [Scilit]
- Harkemanne, E.; Baeck, M.; Tromme, I. Training general practitioners in melanoma diagnosis: A scoping review of the literature. BMJ Open 2021, 11, e043926. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Herschorn, A. Dermoscopy for melanoma detection in family practice. Can. Fam. Physician 2012, 58, 740–745. [Google Scholar] [PubMed]
- Delungahawatta, T.; Dunne, S.S.; Hyde, S.; Halpenny, L.; McGrath, D.; O’rEgan, A.; Dunne, C.P. Advances in e-learning in undergraduate clinical medicine: A systematic review. BMC Med Educ. 2022, 22, 711. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Han, H.; Nelson, E.; Wetter, N. Medical students’ online learning technology needs. Clin. Teach. 2014, 11, 15–19. [Google Scholar] [CrossRef] [Scilit]
- Feng, J.; Chang, Y.; Chang, H.; Erdley, W.S.; Lin, C.; Chang, Y. Systematic Review of Effectiveness of Situated E-Learning on Medical and Nursing Education. Worldviews Evid. Based Nurs. 2013, 10, 174–183. [Google Scholar] [CrossRef] [Scilit]
- Vaona, A.; Banzi, R.; Kwag, K.H.; Rigon, G.; Cereda, D.; Pecoraro, V.; Tramacere, I.; Moja, L. E-learning for health professionals. Cochrane Database Syst. Rev. 2018, 1, CD011736. [Google Scholar] [CrossRef] [Scilit]
- Posada, E.L.; Lauck, K.C.; Tran, T.; Krause, K.J.; Nelson, K.C. Educational Interventions to Support Primary Care Provider Performance of Diagnostic Skin Cancer Examinations: A Systematic Literature Review. J. Cancer Educ. 2022, 37, 1579–1588. [Google Scholar] [CrossRef] [Scilit]
- Salinas, M.P.; Sepúlveda, J.; Hidalgo, L.; Peirano, D.; Morel, M.; Uribe, P.; Rotemberg, V.; Briones, J.; Mery, D.; Navarrete-Dechent, C. A systematic review and meta-analysis of artificial intelligence versus clinicians for skin cancer diagnosis. npj Digit. Med. 2024, 7, 125. [Google Scholar] [CrossRef] [Scilit]
- Sinclair, P.; Kable, A.; Levett-Jones, T. The effectiveness of internet-based e-learning on clinician behavior and patient outcomes: A systematic review protocol. JBI Evid. Synth. 2015, 13, 52–64. [Google Scholar] [CrossRef] [Scilit]
- Harrington, E.; Clyne, B.; Wesseling, N.; Sandhu, H.; Armstrong, L.; Bennett, H.; Fahey, T. Diagnosing malignant melanoma in ambulatory care: A systematic review of clinical prediction rules. BMJ Open 2017, 7, e014096. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
