Skip to Content
MathematicsMathematics
  • Article
  • Open Access

19 November 2026

23 Pages

Evaluation Boundaries in Multimodal Skin Lesion Classification: Data Leakage, Patient Reuse, and Cross-Release Overlap

,
and
1
Department of Computer Science and Engineering, Keimyung University, Daegu 42601, Republic of Korea
2
Department of Biomedical Engineering, Keimyung University, Daegu 42601, Republic of Korea
*
Author to whom correspondence should be addressed.

Abstract

Multimodal skin-lesion classifiers combine dermoscopic images with clinical metadata, but reported gains may depend on how related images, lesions, patients, and dataset releases are separated between model development and testing. This study evaluates how these boundaries affect classification performance and the measured benefit of metadata fusion. HAM10000, PAD-UFES-20, and International Skin Imaging Collaboration (ISIC) releases are assessed using image-level, lesion-level, patient-level, content-based, and cross-release protocols. Image-only, metadata-only, late-fusion, metadata-gated, and cross-attention models are compared under matched settings with repeated seeds and confidence intervals. In HAM10000, with a fine-tuned ConvNeXt-Small encoder, random image-level splitting increased the macro-averaged F1 score (macro-F1) by 9.48 percentage points relative to lesion-disjoint evaluation, whereas cross-attention changed macro-F1 by only −0.34, −0.86, and +1.11 points across the tested protocols. On PAD-UFES-20, 32.22–40.46% of test patients under lesion-disjoint evaluation were also represented in training through different lesions, and cross-attention macro-F1 was 0.8085 under lesion-disjoint and 0.7124 under patient-disjoint evaluation. Retaining shared HAM10000 identities, and thereby their acquisition source, in the ISIC 2019 model-development pool was associated with an 18.2-point macro-F1 difference. For the datasets and models tested, evaluation boundaries produced larger macro-F1 changes than the fusion methods, highlighting the need to align the separation unit with the intended generalization target.

Article Metrics

Citations

Article Access Statistics

Article metric data becomes available approximately 24 hours after publication online.