Abstract
Background: Machine learning-based Artificial Intelligence (AI) models have shown significant potential in the biomedical field, offering promising advances in diagnostics, personalized medicine, and patient care. However, to build these models, we have to deal with important challenges, including (1) the scarcity and low quality of available datasets in many important applications and (2) privacy concerns associated with sensitive patient data. Synthetic data (SD) generation has emerged as a promising strategy to address these challenges, yet many existing approaches struggle to simultaneously preserve privacy and accurately model tabular data, the predominant format in healthcare. Methods: We propose Kernel Density Estimation–K-Nearest Neighbors (KDE-KNN), a privacy-aware tabular data generation method, and evaluate its performance against state-of-the-art techniques. Using sepsis detection as a real-world case study, we assess both data utility and privacy protection. Results: Models trained on KDE-KNN-generated SD outperformed those trained on real data across both internal testing and external validation. In particular, a support vector machine achieved superior performance when trained on SD relative to real data. This gain is likely driven by the balanced class distribution of the synthetic dataset, underscoring KDE-KNN’s utility as an effective data balancing strategy. Consistent performance in external validation further supports the robustness and generalizability of the proposed approach. Privacy evaluation indicated a lower re-identification risk, with a mean distance to closest record of 4.971 between synthetic and real samples, compared with 2.715 among real samples. Conclusions: KDE-KNN effectively captures underlying population distributions while generating high-quality SD that preserve statistical fidelity and protect sensitive information. By balancing the trade-off between utility and privacy, the method produces representative datasets without exposing individual records. These findings position KDE-KNN as a valuable tool for data-scarce and privacy-sensitive applications, with broad potential across healthcare and other data-driven domains.
1. Introduction
The U.S. Food and Drug Administration (FDA) approved 1016 Artificial Intelligence (AI)/Machine Learning (ML) Enabled Medical devices [1] between 1995 and 2024 (https://www.fda.gov/medical-devices/software-medical-device-samd/artificial-intelligence-and-machine-learning-aiml-enabled-medical-devices (accessed on 15 November 2025)), with a significant increase in the last few years. This trend highlights the potential of AI models as a promising technology in the healthcare sector [2,3]. The ability of AI to process large volumes of data efficiently and accurately has changed medical research, improved early diagnostics, and improved treatments [4,5]. As a result, AI-driven approaches have shown remarkable performance in the detection of a wide variety of diseases, including cancer [6,7], cardiovascular disease [8], Parkinson’s disease [9,10], liver cirrhosis [11], and other conditions such as fatigue [12]. Since Google’s paper Attention Is All You Need was published [13], the field has undergone a paradigm shift toward generative AI and foundation models. One of the advantages of foundation models is the ability to perform tasks for which they were not explicitly trained, demonstrating strong generalizability. However, the development of predictive or generative AI models in the medical domain faces significant challenges. One of the primary obstacles is the difficulty in accessing large-scale and diverse datasets [14].
In addition, many governments are introducing strict regulations for personal data processing and AI applications such as the new AI Act of the European Union (https://artificialintelligenceact.eu/ (accessed on 20 November 2025)), CCPA (https://oag.ca.gov/privacy/ccpa (accessed on 21 November 2025)) (Unitated States) and LGPD (https://www.gov.br/anpd/pt-br/centrais-de-conteudo/brazilian-data-protection-law.pdf (accessed on 28 November 2025)) (Brazil), which enforce data protection measures. A significant development in the regulatory landscape of AI has occurred with the enactment of the AI Act within the European Union. This legislative framework is designed to oversee and govern the application of AI models. In the domain of biomedical research, caution must be exercised when employing patient data for the training of AI models. Patient data, characterized by its sensitive nature [15,16], is subject to strict protection under data protection laws, requiring the preservation of privacy [17,18].
Related research in privacy-aware and privacy-preserving methods can be found in the literature on biometric person recognition [18,19,20], and we can also see increasing efforts in dealing with privacy elements in large AI models, including visual models [21], Large Language Models (LLMs) [22,23], and Vision Language Models [24]. In addition, recent work such as Robust Health [25] has proposed non-interactive privacy-preserving systems for heterogeneous mobile health diagnosis, highlighting the feasibility of secure and scalable AI deployment in clinical environments.
A solution that can potentially overcome these limitations involves the generation of fully SD as an alternative to real data [26]. SD are artificial data generated by a trained model and built to replicate real data taking into account its distribution (mean, variance) and structure (e.g., correlation between attributes) [27]. The use of SD generation emerges as a versatile methodology in AI, allowing the augmentation of datasets to improve model training [28,29] and safeguarding the privacy of sensitive information [30]. Indeed, Gartner predicts the dominance of SD over real data in AI models by 2030 (https://www.gartner.com/en/newsroom/press-releases/2022-06-22-is-synthetic-data-the-future-of-ai (accessed on 10 December 2025)).
Privacy-preserving methods for generating synthetic tabular data are of critical importance in biomedical research, where data sensitivity and regulatory constraints often limit data sharing and reuse [31,32]. A central challenge in privacy-preserving SD generation is achieving an optimal trade-off between data utility and privacy. High levels of privacy protection, such as those enforced through strict differential privacy parameters, can significantly degrade the statistical fidelity and predictive value of synthetic datasets, limiting their usefulness for downstream biomedical analyzes. In contrast, prioritizing utility without adequate privacy safeguards can lead to the leakage of sensitive patient information. In biomedical applications, where both the integrity of data and the protection of individual privacy are paramount, careful balance of this trade-off is essential. The goal is to generate SD that are sufficiently representative to support meaningful research and clinical insights, while ensuring that the risk of re-identification or inference of personal information remains acceptably low. Figure 1 illustrates the compromise between privacy-preserving generation and the realism of synthetic samples.
Figure 1.
Compromise between privacy and realism of synthetic samples. The graphs illustrate the distance between real and synthetic samples in a conceptual 2-dimensional space. The top row shows different regimes based on the relationship between real–real and real–synthetic distances. The bottom row presents the corresponding distributions of the Distance to Closest Record (DCR), where blue represents real data and orange represents synthetic data. P denotes the probability density, providing a quantitative interpretation of how shifts in distance reflect changes in similarity between real and synthetic data.
This work extends our previous study [31], where the Kernel Density Estimation–K-Nearest Neighbor (KDE-KNN) method was initially introduced. In the present paper, we provide a more comprehensive evaluation, including enhanced privacy mechanisms, comparison with additional state-of-the-art methods, and validation on an external dataset. In more detail, the main contributions of this work are the following:
- We improved and analyzed the performance of the KDE-KNN SD generation method to train and evaluate supervised learning algorithms.
- We extensively evaluated state-of-the-art SD generation methods in terms of utility and privacy in the context of sepsis detection. Our results show that the privacy-aware method KDE-KNN, outperforms existing approaches in generating synthetic tabular data for sepsis detection.
- Using two real databases with more than 2000 patients, we evaluated the generalizability of SD generation methods. Our results suggest that KDE-KNN has certain advantages in terms of generalization over other methods.
The remainder of the paper is organized as follows. Section 2 reviews previous research on synthetic tabular data generation methods and ML models for the prediction of sepsis. Section 3 describes the databases, supervised ML models, and data generation approaches used in this study. Section 4 details the experimental protocol and presents the results. Section 5 provides a discussion of the findings, including limitations and future research directions. Finally, Section 6 summarizes the main conclusions of the work.
2. Related Works
We have divided this section into two parts: (i) Synthetic Tabular Data generation approaches in Healthcare, and (ii) ML models for predicting sepsis.
2.1. Synthetic Tabular Data Generation Approaches in Healthcare
In 1993, Rubin [33] and Little [34] proposed a statistical method to generate synthetic value records instead of using real data to avoid privacy concerns. Today, the concept of SD has evolved to include artificial data generated by trained models. This SD is designed to replicate real-world datasets by accurately capturing their distributional properties (such as mean and variance) as well as their structural characteristics (such as correlations between different attributes) [27]. SD generation stands out as a highly promising yet largely underexploited technology for fulfilling privacy-preserving laws or augmenting datasets to enhance model performance.
The present study focuses on the generation of synthetic tabular data from electronic health records (EHR). The tabular healthcare-related data stored in the EHR contain vast and diverse amounts of patient data. Typically, each row in a healthcare tabular dataset represents a single data record that contains descriptive patient details such as date of birth, gender, and demographic information, along with sensitive attributes primarily consisting of longitudinal data. These longitudinal data comprise a series of medical events that occur at various time points, encompassing diagnoses, laboratory test results, and prescription information [35]. Tabular data are inherently heterogeneous, often comprising continuous, discrete, and categorical features that each adhere to distinct statistical distributions. This complexity introduces significant challenges in the accurate synthesis of such data.
In the healthcare context, numerous approaches to generating SD can be found in the literature. Among these, one widely utilized algorithm is the Synthetic Minority Oversampling Technique (SMOTE). This algorithm operates by synthesizing new data by interpolating existing samples. An extension of this algorithm is SMOTE–TOMEK [36], which incorporates Tomek Links, an under-sampling technique to remove synthetic noise samples. Another statistical approach to generate SD involves KDE based models. Our framework for SD generation in the healthcare context is based on KDE, chosen for its non-parametric nature and demonstrated efficacy, particularly in small datasets, which are prevalent in the biomedical field [37].
Additional methodologies used for SD generation involve generative models, which include Generative Adversarial Networks (GANs), Diffusion Models (DMs), and LLMs.
Since their inception in 2014 [38], GANs have demonstrated exceptional capability in the production of synthetic image data [39]. For this reason, the application of GANs to other data types, such as tabular data, is a popular topic in the AI research community [40]. One of the most widely used GAN-based synthetic tabular data generation approaches is CT-GAN, a Conditional Tabular Generative Adversarial Network [41], which introduces a mode-specific normalization to handle columns with complicated distributions.
On the other hand, DMs represent another class of generative models which have been widely used in the computer vision field. In particular, recent advances have led to the development of architectures tailored to exploit DMs for tabular data, such as TabDDPM [42], which has demonstrated significant potential and promising results in this regard. Furthermore, with the emergence of LLMs, capable of performing tasks beyond their explicit training, we have analyzed whether models such as GPT-4 can generate accurate SD derived from the information on which they were trained. Although the potential for SD is huge, there are important considerations regarding the quality, reliability, and ethical implications of using SD. Ensuring that the generated data are representative, unbiased, and compliant with relevant legal and ethical standards is a critical challenge. For these reasons, in this study we have evaluated the quality and privacy consideration of SD generated by generative models based on SMOTE–TOMEK, TabDDPM, CT-GAN, CHAT-GPT, and KDE.
2.2. Machine Learning Models for Sepsis Prediction
Sepsis is defined as a life-threatening organ dysfunction caused by a dysregulated host response to infection [43]. Each year, sepsis is responsible for an estimated 11 million deaths (https://www.who.int/news-room/events/detail/2024/09/13/default-calendar/launch-of-2030-global-agenda-for-sepsis-and-world-sepsis-day-2024 (accessed on 20 January 2026)). The importance of detecting sepsis early is crucial, as it is a time-sensitive clinical process. There is a direct relationship between early diagnosis and improved results, measured by lower mortality, better patient prognosis, and reduced use of hospital resources [44], but early and accurate detection of sepsis is still a challenging clinical problem [45]. For this reason, several ML algorithms have been designed to predict sepsis using retrospective data [46,47,48,49,50,51]. In addition, clinically interpretable approaches such as the LIP score [52] have been proposed as screening tools based on biomarkers including lymphocyte count, international normalized ratio and procalcitonin, highlighting the importance of combining predictive performance with clinical interpretability.
In our study, we try to predict whether a patient will have or not sepsis. We frame the task of sepsis detection as a classification problem, with the aim of addressing the question: Will patient A develop sepsis in the future? We substantiate our findings through validation in an external cohort for robustness and generalization.
3. Materials and Methods
In this study, we have used 2 databases: (i) the Mannheim database (MaDB) used for training our models and building synthetic datasets; (ii) the Son Llàtzer hospital database (SLDB) used as an external validation dataset to evaluate the generalization capacity of the trained models.
3.1. Mannheim Database
We used the University Medical Centre Mannheim database (MaDB) of patients admitted to Intensive Care Unit (ICU) [53]. This database contains a total of 1275 patients, 979 with non-sepsis and 296 with sepsis. Initially, the MaDB comprised 42 timelines of features and the diagnosis of sepsis at each time step. However, for comparative analysis with the SLDB, it was necessary to align the feature sets. Consequently, only 27 features were found to be common between both databases. These features include both patient demographics (e.g., age, sex) and laboratory results (Table 1).
Table 1.
Description of the 27 variables included in the databases. Differences in distributions between cohorts were assessed using the non-parametric Mann–Whitney U test. p-values were adjusted for multiple comparisons using the Bonferroni correction.
The MaDB contains temporal data that allow a precise tracking of the times of onset of sepsis in patients, as evidenced in Table 2. The notable variability in the timing of sepsis manifestation within this dataset underscores its inherent heterogeneity. However, we do not use this temporal information, because we treat the detection of sepsis as a binary classification problem. Instead, we set a cut-off value at 9 h as we estimated that in this time period all clinical tests could be performed and laboratory results could be collected. If a test has been performed several times during this period, the last value is used. In this way, we constructed a dataset in which our predictor variables were collected in that time interval and the objective was to predict whether or not a patient will develop sepsis in the future (classification problem). The MaDB has been used to train and test models and generate SD.
Table 2.
Main characteristics of the databases, including the number of features and patients, as well as the mean, minimum and maximum time of sepsis onset (in hours) and the service where the data were collected.
3.2. Son Llátzer Hospital Database
We used a database from Son Llàtzer Hospital of patients admitted to the emergency department and the ICU. The Son Llàtzer database (SLDB) contains 2028 patients in total, 1014 with non-sepsis and 1014 with sepsis. In this database, we also selected the 27 common features with MaDB. However, within the SLDB, the precise mean time to the onset of sepsis remains unknown. According to insights from the medical team, the mean time to onset of sepsis is estimated to range between 24 and 48 h. We used this database for external validation, acknowledging significant disparities in the onset times of sepsis compared to our primary dataset. In particular, there are substantial variations in the data distribution between the two databases. Thus, we perceived this as an opportunity to assess the generalizability of our models across diverse demographic populations.
3.3. Dataset Shift
To quantify distributional differences between cohorts and assess dataset shift, we performed the Mann–Whitney U test for each feature, as it is a non-parametric test suitable for comparing variables with potentially non-Gaussian distributions. To account for multiple comparisons across the 27 variables, p-values were adjusted using the Bonferroni correction.
3.4. Data Preprocessing
Prior to model training, a preprocessing pipeline was applied to ensure data quality and consistency across both datasets. Missing values were imputed using the median of each feature, as this approach is robust to skewed distributions and reduces the influence of extreme values. Subsequently, all variables were standardized using z-score normalization to ensure comparability across features and to improve the stability and performance of the ML models.
3.5. Sepsis Prediction Models
Early detection of sepsis is critical as it is a time-sensitive clinical process. There is a direct relationship between early identification and better patient outcomes. However, traditional methods have significant limitations for the early detection of sepsis. Consequently, the integration of AI and ML techniques capable of processing large volumes of data efficiently and accurately is transforming early medical diagnosis. Our study evaluates three distinct ML models and assesses their performance based on the Area Under the Curve (AUC) score.
- Random Forest (RF). It is a widely used ML algorithm that belongs to the ensemble learning family, characterized by the construction of multiple decision trees during training. For classification tasks, the RF outputs the predicted class, which in the context of sepsis prediction means whether a patient is likely to develop sepsis or not.
- Support Vector Machine (SVM). Unlike traditional classifiers that aim to find a decision boundary that separates classes, SVM seeks to find the hyperplane that best divides the classes while maximizing the margin between them. In our experiments, we have used two SVM changing the type of kernel: (i) SVM with a linear kernel; (ii) SVM with a radial basis function (rbf) kernel.
- Gradient Boosting Algorithm. Such as XGboost or Catboost that combines multiple learners, usually decision trees to form an ensemble. Each tree is constructed in a sequence, where subsequent trees focus on the errors made by previous trees.
The hyperparameters of the models were tuned using the Optuna library [61]. Specifically, we used a TPE (Tree-structured Parzen Estimator) sampler with 40 trials to maximize AUC. The hyperparameter grid and the optimal hyperparameters for each model have been included in Appendix A.
To improve the interpretability of the ML models, we employed Shapley Additive Explanations (SHAP), a widely used explainable artificial intelligence (XAI) method [62,63,64]. SHAP values are based on cooperative game theory and quantify the contribution of each feature to the model’s prediction.
3.6. Data Modeling Approaches
In this paper, we have analyzed 5 SD generation methods:
SMOTE–TOMEK [65]: SMOTE–TOMEK is a method that combines oversampling and under-sampling techniques to generate synthetic samples. Initially, this method was used to generate observations exclusively from the minority class, but we expanded this approach to incorporate the majority class as well, resulting in the creation of a fully synthetic dataset.
TabDDPM [42]: TabDDPM is a design of probabilistic diffusion denoising models for tabular data. To tackle mixed-type characteristics of tabular data, this architecture integrates gaussian diffusion to capture the characteristics of continuous features and multinomial diffusion to effectively model categorical attributes.
KDE: KDE is a method used to estimate probability density functions. By constructing this distribution, we gain the ability to generate SD samples by sampling. This capability allows for the creation of synthetic datasets representative of the underlying probability distribution. We conducted experiments using multivariate KDE, taking into account the interdependencies between features. This allows us to capture complex relationships and dependencies across multiple variables simultaneously.
CHAT-GPT [66]: LLMs are known for their ability to perform tasks for which they were not explicitly trained. For this reason, we analyzed whether CHAT-GPT would generate truthful synthetic samples. To do so, we used 3 versions of CHAT-GPT (o1, o3-high, and 4o).
CT-GAN [41]: It is a Conditional Tabular Generative Adversarial Network which implements a mode-specific normalization to overcome the non-gaussian and multimodal distribution, one of the main challenges when modeling continuous distributions. In addition, they implement a training-by-sampling method to handle underrepresented categories in the categorical columns.
3.7. Synthetic Data Evaluation
We evaluated the SD generated by each method considering both quality and privacy. To evaluate quality, we trained several ML algorithms and analyzed their performance on real data. To evaluate privacy preservation, the Distance to Closest Record (DCR) metric was used. The DCR calculates the average distance between the synthetic samples and their closest real data points.
Additionally, we assessed the fidelity and diversity of the generated data using the density and coverage metrics [67]. Both metrics are computed in a feature space using KNN with . Density measures the fidelity of synthetic samples by quantifying how densely they populate the neighborhoods of real data points in a feature space. Density is not upper bounded by 1. Coverage measures the diversity of the SD by computing the proportion of real samples that are within the neighborhood of at least one synthetic sample. Coverage is bounded between 0 and 1.
3.8. KDE-KNN: Privacy-Aware Synthetic Clinical Data
Our proposed methodology is based on the integration of the KDE and the KNN ML algorithm. The core idea is to use a multivariate gaussian KDE to approximate the probability density function of the original dataset features and then sample it to generate synthetic datasets. However, because the feature space can be very large, we trained a KNN to validate the synthetic samples. Let and be the training and test real dataset, where . The procedural steps to construct our synthetic dataset are the following:
- 1.
- Step 1—Training a KNN model (M): A KNN model was trained using the real training dataset .
- 2.
- Step 2—Data preparation for KDE: The training dataset was partitioned into two distinct groups, patients with sepsis ( of users) and without sepsis ( of users).
- 3.
- Step 3—Multivariate KDE construction (): two statistically independent multivariate KDE distributions () and () were trained for and .where denotes a Gaussian kernel, h is the bandwidth parameter controlling the smoothness of the distribution, and L is the number of samples. In this study, the bandwidth h is selected using Scott’s rule [68].
- 4.
- Step 4—SD generation: Sampling was performed from each multivariate KDE model, generating 540 synthetic patients with sepsis ( using ) and 540 synthetic patients without sepsis ( using ) and a random seed x.
- 5.
- Step 5—Utility Validation: Validation of the synthetic samples was conducted for the 1080 synthetic sample () using the KNN model M learned during the Step 1. Any misclassified sample was discarded as a non-usable.
- 6.
- Step 6—Privacy Validation ( parameter): The average DCR for the real dataset was first computed and used as a reference .Then, the DCR for each synthetic sample was calculated as:The DCR was calculated for all the synthetic samples and . Synthetic samples that were too close to real data () were subsequently discarded. parameter defines the minimum acceptable distance, measured in standard deviations, that a synthetic sample must maintain from the real data, thereby ensuring compliance with the required privacy-aware constraints. The default value is set to 1, which means that the synthetic samples must be at least one standard deviation from any real data point. While the bandwidth parameter controls the smoothness of the estimated probability density, the parameter enforces a minimum distance between real and synthetic samples. Together, these parameters regulate the trade-off between distributional fidelity and sample-level similarity. It is important to note that this mechanism provides an empirical privacy control rather than relying on differential privacy frameworks [69]. The DCR constraint acts as a proxy for disclosure risk by limiting the similarity between synthetic and real samples.
- 7.
- Step 7—The process (Steps 4–6) was executed iteratively until we reached a total of 540 synthetic usable samples were obtained for both sepsis and without sepsis classes. This process ensures the creation of a balanced synthetic dataset representative of both septic and non-septic patient populations while preserving the utility of the data and reducing the risk of re-identification.
For clarification, we close this section by visualizing our proposed synthetic method as a flow chart, illustrated in Figure 2.
Figure 2.
Block diagram of our proposed KDE-KNN method for SD generation including the generation modules based on two Kernel Density Estimators (Sepsis and Non-Sepsis) and KNN sampling.
3.9. Computational Complexity
From a computational perspective, different SD generation methods exhibit varying complexity profiles depending on their underlying mechanisms:
- KDE-KNN: The cost is driven by density estimation, sample generation, and validation. The iterative sample-generation and validation stage scales approximately as , where N is the number of real samples, d the number of features, and T the number of generated candidates. The rejection-based sampling mechanism increases T depending on the acceptance rate.
- SMOTE–Tomek: The computational cost is dominated by nearest-neighbor searches and scales as in the naive case, where N is the number of samples and G the number of generated synthetic instances.
- TabDDPM: The generation phase is dominated by the reverse diffusion process and scales as , where G is the number of generated samples, S is the number of diffusion steps, and is the cost of one forward pass of the denoising network. Assuming linear scaling with the feature dimension, this becomes .
- CTGAN: The generation phase is dominated by the forward pass of the generator network and scales as , where is the cost of a single generator pass. Under linear scaling with d, this simplifies to .
4. Experiments and Results
In this section, we evaluate several SD generation methods and the influence that synthetic samples had on the performance of ML models to detect sepsis.
4.1. Experimental Protocol
Initially, our study was based on two distinct sepsis databases: the MaDB and the SLDB. The MaDB served as the primary dataset for model training/testing and SD generation, while the SLDB was used exclusively for external validation purposes.
Our first experimental phase involved evaluating the model performance using real data exclusively. To do this, we used MaDB and partitioned the data into training sets (85%) and testing sets (15%), repeating the experiment three times while changing the seed. Additionally, each partition underwent an external validation using the SLDB. In particular, our analysis revealed that the performance of the ML models remained consistent across different partitions, suggesting a minimal impact of partitioning during model training.
Experiment 2 focused on optimizing the integration of KDE with ML models. Specifically, we evaluated three approaches: KDE-Random Forest (KDE-RF), KDE-Support Vector Machine (KDE-SVM) and KDE-K-Nearest Neighbors (KDE-KNN) in terms of their utility. Among these, KDE-KNN demonstrated the best performance. To conclude this phase of experimentation, we assessed how incorporating real and SD into the training set affected model performance.
Experiment 3 focused on an in-depth analysis of the statistical properties, utility, and privacy of the synthetic samples generated by all methods. We generated a fully synthetic balanced dataset comprising 540 samples with sepsis and 540 samples without sepsis, mirroring the size of our original imbalanced training set. To achieve this, one of the Train-Test partitions from the real data used in Experiment 1 was randomly selected, as that experiment demonstrated stable ML model performance across the three partitions. The training set from the selected partition was then used as the seed for the SD generation methods detailed in Section 3.4. Subsequently, the utility of the SD was assessed by evaluating the performance of the ML models on the reserved test set (real data). The last phase of our experimentation aimed to assess the preservation of the privacy of SD. To do so, we computed the proximity of SD to real data using the Mean Distance to Closest Record (DCR) metric [70]. The mean DCR calculates the average distance between the synthetic samples and their closest real data points.
4.2. Experiment 1: Real Data Results (Baseline)
The set of 27 predictive features, along with the statistical differences in their distributions between cohorts, is summarized in Table 2. The results of the Mann–Whitney U test, adjusted using the Bonferroni correction, indicate that the majority of variables exhibit statistically significant differences between the MaDB and SLDB cohorts (p-value ). Only a small number of variables, such as creatinine and age, do not show significant differences, indicating a notable distribution shift between the datasets. Table 3 presents the results of Experiment 1, which evaluated the performance of various ML models using only real data in terms of AUC. Among the algorithms evaluated, the Random Forest (RF) model achieved the best overall performance, with a mean AUC of on MaDB, on SLDB reflecting consistent predictive performance across datasets. The SVM with an rbf kernel showed competitive performance, particularly in SLDB (), slightly outperforming RF in that dataset, suggesting good generalization capabilities in this context. In contrast, the SVM with a linear kernel demonstrated lower performance across both datasets, indicating limited capacity to model non-linear relationships between features. XGBoost performed well on MaDB (), although its performance decreased on SLDB (), possibly reflecting a degree of overfitting or reduced generalizability. Finally, CatBoost achieved the lowest performance among the models tested, with AUC scores of and on MaDB and SLDB, respectively.
Table 3.
Results of Experiment 1 using real data. The result is shown in terms of AUC ± variance as each model was trained and evaluated with 3 partitions.
Additionally, SHAP analysis (Figure 3) was conducted to include the interpretability of the predictions of the RF model, revealing that features such as F9_Fi_O2, F12_Lactate, and F14_C_reactive_Protein are among the most influential in sepsis detection, a finding that aligns with the existing literature [44,71,72].
Figure 3.
Shap summary plot illustrating the impact of each feature on the RF model output.
4.3. Experiment 2: Integrating Synthetic Data with ML Models (Utility)
In Experiment 2, we analyzed the integration of the KDE generation method with 3 supervised classification models evaluating the utility of the SD generated (Table 4). The purpose of the ML model was to validate the quality of the synthetic samples, discarding those of lower quality. To ensure a comprehensive evaluation, we selected ML models from different families: Random Forest (RF), Support Vector Machine (SVM), and KNN; analyzing them in three configurations: KDE-RF, KDE-SVM, and KDE-KNN. From each configuration, we generated SD, trained 5 ML models, and tested these ML models with real data, analyzing their performance in terms of AUC. Across all generation methods, the integration of KDE with downstream ML models led to performance improvements compared to baseline models without augmentation. Among generation strategies, KDE-KNN (Figure 2) achieved the highest overall AUC scores, with the best results observed for SVM (linear) and SVM (rbf) classifiers ( and on MaDB, and and on SLDB, respectively). This shows that even a relatively simple algorithm like KNN can effectively eliminate noisy synthetic samples.
Table 4.
Results of Experiment 2 integrating KDE and ML models. The result is shown in terms of AUC ± variance.
In addition, we wanted to analyze how the combination of real and SD during training affects model performance. We selected the best configuration, KDE-KNN, and trained an SVM model (the algorithm that demonstrated the highest generalization capabilities in Experiment 1) using varying proportions of real and SD. The experiment was carried out 3 times using different seeds and the findings are presented in Table 5. The findings indicate that increasing the percentage of SD in the training set improved the performance of the model, with AUC values increasing from 0.6194 to 0.7160 in MaDB and from 0.6952 to 0.7682 in SLDB. This shows that balancing the training set using SD generated with KDE-KNN enhances the performance of the model.
Table 5.
Results of Experiment 2, combining real and SD in the training set using the SVM model. The results are shown in terms of AUC ± variance.
4.4. Experiment 3: Ablation Study
In this section, we conduct an in-depth evaluation of the KDE-KNN method and compare its performance with the SD generation methods mentioned in Section 3.4. First, we compared the dimensions-wise means and variances between the synthetic and real distributions generated by each synthetic method (Figure 4). The results showed that KDE-KNN captured the complexity of the univariant distributions, only outperformed by SMOTE–TOMEK as it is an interpolation method. As we will see in further experiments, privacy is compromised when methods such as SMOTE–TOMEK are used because the statistical distributions of the real and SD remain too close. Additionally, we performed pairwise Kolmogorov–Smirnov tests to determine whether synthetic one-dimensional distributions differ significantly from the real ones. The statistical results demonstrated that all synthetic methods learned univariate distributions that do not differ significantly from the real ones (Table 6).
Figure 4.
Dimensional means (95% confidence intervals) between synthetic and real data for different synthetic generation models using the MaDB. The orange diagonal line represents the line of perfect agreement between synthetic and real data distributions.
Table 6.
Kolmogorov–Smirnov (KS) tests were conducted to assess whether one-dimensional synthetic distributions differ significantly from the corresponding real distributions.
To further assess the impact of SD on model generalization, we trained multiple ML classifiers using balanced synthetic datasets and evaluated their performance on real-world test data. A detailed comparison of these approaches is provided in Appendix B, where the results are reported for all evaluated methods under a consistent experimental setup, analogous to Experiments 1 and 2. The results indicate that the use of SD significantly improved the discriminative performance of most classifiers, as reflected by higher AUC values compared to those obtained with real unbalanced data. Among the evaluated data generation methods, KDE-KNN consistently achieved the best performance on both datasets. In particular, the SVM with an rbf kernel attained the highest AUC (0.7128 on MaDB and 0.7682 on SLDB), demonstrating the robustness of this method for generating high-quality synthetic samples that preserve the statistical properties of the original data distribution while effectively balancing class representation. In contrast, the SD produced by the CHAT-GPT-based models (o1, o3-high, and 4o) exhibited poor utility for model training, leading to substantially lower AUC scores in all classifiers. This suggests that text-based generative models, although powerful in natural language contexts, may struggle to accurately capture the multivariate dependencies inherent to structured clinical tabular data. Interestingly, most models trained on SD showed improved performance on the external validation dataset (SLDB), which is not intuitively expected. This observation may be attributed to differences in sepsis onset characteristics, with patients in the SLDB dataset exhibiting an earlier onset of sepsis compared to those in MaDB. Therefore, the performance of the model increases when the appearance of sepsis occurs within a 24–48 h prediction window.
4.5. Experiment 4: Privacy Analysis
Furthermore, we evaluated the privacy-preserving characteristics of the best synthetic methods using the Distance to Closest Record (DCR) metric. The DCR is calculated as the Euclidean distance between a real sample and the closest synthetic sample. Low DCR values suggest that synthetic samples closely resemble real data points, which could compromise privacy requirements. In contrast, higher DCR values indicate that the generative model is capable of producing new records rather than replicating existing data. It is important to note that out-of-distribution data, such as random noise, can also yield high DCR values. Therefore, DCR must be evaluated alongside ML efficiency considerations [42]. Figure 5 presents the probability distributions of DCR for real samples () and the best generation approaches evaluated in previous experiments (). The real data distribution is concentrated at low DCR values (approximately between 1 and 3), reflecting the expected proximity of real points to their nearest neighbors in the feature space. This distribution serves as a baseline for assessing the privacy-preserving properties of SD. A distribution shifted to the left of the real curve (lower DCR) indicates that the synthetic samples are very close to the real samples, suggesting lower privacy. In contrast, a distribution shifted to the right (higher DCR) indicates that synthetic samples are farther away from real data, implying a lower risk of re-identification. For SMOTE–TOMEK, the mean DCR value is 0.83, while for KDE-KNN, TabDDPM and CT-GAN, the values are 4.971, 7.463 and 3.9, respectively. Comparing these results with the mean distance between the real data, which is 2.715, we observe that TabDDPM, CT-GAN, and KDE-KNN demonstrate efficacy in generating SD that preserve privacy, exhibiting superior performance compared to SMOTE–TOMEK.
Figure 5.
Probability distribution of the Distance to Closest Record (DCR) for real samples and synthetic samples generated with the 3 generation approaches evaluated in our experiments.
A critical parameter in KDE that affects privacy is bandwidth. The bandwidth in KDE determines the width of the kernel function applied to each data point. A smaller bandwidth produces a narrow kernel, leading to a distribution that closely follows the original data, with sharp peaks and low smoothing. In contrast, a larger bandwidth spreads the influence of each point more broadly, resulting in a smoother and more generalized distribution. For this reason, higher bandwidth values are generated in synthetic samples that are more distant from the original data, thus enhancing privacy-preserving properties, as shown in Figure 6. However, this introduces a trade-off between privacy and utility, meaning that the bandwidth must be carefully chosen to ensure both sufficient distance between real and synthetic samples and a high level of realism.
Figure 6.
Probability distribution of the Distance to Closest Record (DCR) for real samples and synthetic samples generated with KDE-KNN adjusting the bandwith parameter.
Additionally, Appendix B provides a detailed analysis of the SD distributions. KDE-KNN and TabDDPM achieve the highest density and coverage scores, indicating a strong ability to approximate the real data distribution while preserving sample diversity. CT-GAN demonstrates moderate performance, whereas SMOTE–TOMEK exhibits lower coverage.
5. Discussion and Limitations
AI models have demonstrated significant potential to advance the biomedical field by improving patient outcomes, enabling personalized medicine, and facilitating early diagnosis. Developing these models requires datasets with enough data to capture the complexity of the diseases. However, in the biomedical domain, there is a lack of high-quality datasets, and patient data is under strong regulation. To address these challenges, SD generation has emerged as a promising solution. In healthcare, tabular data are a primary source of patient information, characterized by its inherent heterogeneity, including discrete and continuous features with diverse distributions. In this context, recent work has explored robust data-driven approaches for handling noisy medical datasets, such as outlier detection using iterative adaptive mini-minimum spanning tree generation, highlighting the importance of effective data quality control in biomedical applications [73]. For these reasons, it is paramount to carefully assess the synthetic samples generated in terms of quality and privacy concerns. In this study, we present an enhanced version of our method, KDE-KNN, which synergistically combines a model-driven approach KDE with a data-driven algorithm KNN to serve as a robust quality sample validator. This integrated framework not only ensures that the SD accurately reflects the underlying distribution of the original dataset but also incorporates a privacy validation mechanism using the DCR metric. The dual validation strategy is a key strength of our approach, as it has adjustable parameters to balance data quality and privacy according to specific application requirements. Moreover, KDE, a non-parametric statistical method, has consistently demonstrated its effectiveness in modeling small datasets. By combining KDE with KNN, our method improves the reliability of SD generation, making it particularly well-suited for biomedical applications where both data scarcity and stringent privacy regulations are common challenges.
When training ML models for sepsis detection using a balanced synthetic dataset, we observed improved performance on both the test set and the external validation cohort. In particular, the SVM classifier achieved the highest performance in the sepsis detection task. This improvement can be attributed to the correction of class imbalance, as the original real dataset was highly imbalanced, whereas the synthetic dataset provided a balanced representation of both classes. Although AUC was used as the primary evaluation metric in this study due to its threshold-independent nature, additional metrics such as sensitivity, specificity, and calibration are essential for clinical deployment. In this context, recent work conducted at Son Llàtzer Hospital has focused on clinically oriented sepsis detection systems evaluated on large-scale clinical data [74].
The comparative analysis of SD generation methods also provides relevant insights. KDE-KNN showed competitive performance compared to alternative approaches in terms of downstream predictive utility, while maintaining a favorable privacy profile. In contrast, the SD produced by the CHAT-GPT-based models (o1, o3-high, and 4o) exhibited poor utility for model training, leading to substantially lower AUC scores across all evaluated classifiers. The underperformance of LLM-based approaches may be explained by their original design objective, which is natural language modeling rather than the accurate generation of structured clinical tabular data. Unlike methods specifically designed for tabular synthesis, LLMs may not reliably capture complex multivariate dependencies, numerical precision, and class-conditional distributions, all of which are critical for preserving downstream predictive utility in biomedical applications.
In addition to utility, we evaluated the statistical similarity between real and synthetic data using distribution-based metrics such as the KS test. Low KS values indicate that the synthetic data closely match the real data distribution, reflecting high fidelity at the distribution level. However, this similarity may also suggest potential overfitting if synthetic samples replicate real instances too closely, which could increase the risk of privacy leakage. To mitigate this, we complement distribution-based metrics with distance-based measures such as the DCR, which explicitly capture sample-level similarity. By jointly analyzing both distributional and distance-based metrics, we provide a more comprehensive assessment of the trade-off between data fidelity and empirical disclosure risk. Lower DCR values indicate that synthetic samples lie very close to real data points, increasing the risk of re-identification or information leakage, while higher values suggest that synthetic samples are more distinct and therefore less likely to expose sensitive information. In particular, SMOTE–TOMEK produces a mean DCR value (0.83) that is significantly lower than the mean real-to-real distance (2.715). This indicates that synthetic samples generated by SMOTE–TOMEK are, on average, closer to real data points than real samples are to each other, suggesting a higher risk of privacy leakage. This behavior is expected, as SMOTE generates samples through interpolation between existing data points, which can lead to synthetic instances that closely resemble real individuals. In contrast, the evaluated generative approaches produce higher DCR values (4.971 for KDE-KNN, 3.9 for CT-GAN, and 7.463 for TabDDPM), indicating that these methods generate samples that are more distant from the original records.
Although the proposed approach incorporates a distance-based constraint to reduce similarity between real and synthetic samples, it is important to note that this mechanism provides an empirical notion of privacy rather than differential privacy [69]. In this context, the DCR metric is used as an empirical proxy for disclosure risk, capturing sample-level similarity between real and synthetic data. Future work will further extend this analysis by incorporating complementary privacy evaluation methods, including adversarial attacks and differential privacy-based approaches [75,76].
A limitation of our algorithm is scalability. Since each phenotype requires its own adjusted KDE, the approach is inherently best suited for scenarios involving a small number of phenotypes. Moreover, KDE itself presents challenges, such as convergence issues and sensitivity to bandwidth selection. Future research may explore more efficient parameter tuning strategies or approximate methods to overcome these limitations while maintaining data fidelity. Additionally, the results underscore the need for future investigations to include diverse diseases and datasets, due to the difficulty of obtaining compatible datasets for training and external validation purposes.
Finally, although this study formulates sepsis detection as a binary classification task using static features, future work will explore the extension of the proposed framework to time-series data, leveraging temporal modeling approaches such as recurrent neural networks or survival analysis methods to better capture the progression of sepsis over time.
5.1. Legal and Regulatory Framework Governing Synthetic Health Data
The development of AI models in the biomedical domain involves the processing of sensitive personal data, particularly health-related data, which are subject to strict legal safeguards. SD generation emerges as a promising strategy to reconcile the advancement of ML with the fundamental rights to privacy and data protection, especially in contexts governed by the European Union’s General Data Protection Regulation (GDPR) and the forthcoming AI Act. (a) GDPR and processing sensitive health data Under Regulation 2016/679 (GDPR), health data fall within the scope of special categories of personal data (Art. 4(15) and Art. 9 GDPR), the processing of which is, in principle, prohibited unless specific legal bases apply. Among these exceptions is the use of data for scientific research purposes, provided that appropriate safeguards are in place, including pseudonymization or anonymization techniques (Art. 9(2)(j) and Art. 89 GDPR).
SD, when properly generated and validated, can qualify as anonymous data that fall outside the scope of the GDPR. This interpretation is consistent with the Article 29 Working Party’s Opinion 05/2014 on Anonymization Techniques, which emphasized that once data are truly anonymous, they cease to be considered “personal data” under EU law. The European data-protection law sets a very high threshold for anonymization [77,78]. Whether that threshold can be met in practice depends on the deployment of rigorous privacy-enhancing techniques, including advanced statistical distance metrics and generative controls such as KDE-KNN.
5.2. The Emerging Regulation Landscape: The EU AI Act
The recently adopted AI Act (Regulation (EU) 2024/1689) by the European Union introduces a risk-based framework for AI applications. Healthcare-related systems, including diagnostic and decision-support tools, are classified as high-risk under this regulation. Compliance with the AI Act will require not only technical robustness, but also demonstrable respect for fundamental rights and data protection principles.
In this context, SD play a dual role: first, by reducing dependence on real personal data, it can lower the systemic risk of privacy breaches; and second, by enabling more equitable and reproducible datasets, it may help mitigate algorithmic bias [79,80,81] and improve model generalizability. The KDE-KNN method, as presented in this study, follows a privacy-aware design by incorporating statistical controls that regulate the similarity between real and synthetic samples (via the DCR metric), while preserving the utility of the synthetic dataset for training ML models.
Therefore, the use of SD generation techniques such as KDE-KNN aligns not only with technical excellence, but also with the evolving legal obligations imposed by the GDPR and AI Act. It reflects a legally sound and ethically defensible strategy for the deployment of AI in sensitive biomedical contexts, in line with the broader scholarly consensus that legal compliance must be integrated into the design and validation phases of AI development.
6. Conclusions
We proposed and evaluated KDE-KNN as a statistical method for generating synthetic tabular data. Without loss of generality, we assessed this method in terms of both utility and privacy protection through an extensive evaluation in the context of sepsis detection. Remarkably, when we trained ML models for sepsis detection with a balanced synthetic dataset, we obtained better results on both the test set and the external validation. In particular, an SVM classifier demonstrated the highest performance in the sepsis detection task, achieving 0.7128 in the test set and 0.7682 in external validation when trained with SD generated via KDE-KNN. In contrast, when trained on real data, its performance was 0.6194 and 0.6952, respectively. We attributed this improvement to the fact that the real dataset was highly imbalanced, while the synthetic dataset was balanced. Thus, KDE-KNN would also represent a promising approach for balancing data sets. In addition, our findings have been corroborated by validation in an external database, reinforcing the generalizability potential of our synthesis approach. Additionally, the results demonstrated that KDE-KNN reduces the risk of re-identification, with a mean DCR of 4.971 between synthetic and real data points, compared to 2.715 between real data points.
These findings indicate that KDE-KNN effectively captures the underlying population distributions of real data while generating high-quality synthetic samples that maintain statistical fidelity and controlled similarity to the original data. By balancing the trade-off between data utility and sample-level similarity, KDE-KNN produces representative synthetic datasets while reducing the likelihood of re-identification of individual records, making it a valuable tool for data-driven applications.
In our future work, we will extend our synthetic data generation methods to simultaneously consider multiple variables to create comprehensive digital phenotypes [82]. We will also consider synthetic signal generation, keeping in mind the privacy elements [83,84], and will combine privacy-preserving tabular and signal generation to generate comprehensive and realistic digital twins and avatars [85].
Author Contributions
Conceptualization, E.M.-F. and A.M.; methodology, E.M.-F. and A.M.; software, E.M.-F.; validation, E.M.-F., A.M., C.P., J.F. and C.E.; formal analysis, E.M.-F.; investigation, E.M.-F. and C.E.; resources, A.M., C.P. and J.F.; data curation, E.M.-F.; writing—original draft preparation, E.M.-F., A.M., C.P., J.F. and C.E.; writing—review and editing, E.M.-F., A.M., C.P., J.F. and C.E.; visualization, E.M.-F.; supervision, A.M., C.P. and J.F.; funding acquisition, A.M., C.P. and J.F. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by INSPIRA-CM (P2022/BMD-7224) and M2RAI (PID2024-160053OB-I00).
Institutional Review Board Statement
The Ethics and Health Research Committee of the Balearic Community (CEIC-Ib) ID 463721 approved the study on 28 June 2021. The study was conducted in accordance with European and Spanish data protection regulations, as well as in compliance with the Declaration of Helsinki. Given the retrospective nature of the data and the use of anonymised patient records, the requirement for individual patient consent was waived. The hospital and patients retain ownership of the dataset under current legislation, making it inaccessible externally.
Informed Consent Statement
Patient consent was waived due to the retrospective nature of the data analysis.
Data Availability Statement
The data supporting this study’s findings are available upon reasonable request to the corresponding author. However, owing to privacy restrictions, the data are not publicly available. E.M.-F. (corresponding author) has full access to all study data and serves as the guarantor of the data integrity and accuracy of the data analysis.
Acknowledgments
During the preparation of this manuscript, the authors used CHAT-GPT solely to improve grammar, clarity, and sentence structure. After using this tool, all authors carefully reviewed and edited the content and take full responsibility for the final version of the manuscript.
Conflicts of Interest
The authors declare no conflicts of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.
Abbreviations
The following abbreviations are used in this manuscript:
| AI | Artificial Intelligence |
| AUC | Area Under the Curve |
| DCR | Distance to Closest Record |
| DMs | Diffusion Models |
| EHR | Electronic Health Records |
| GANs | Generative Adversarial Networks |
| ICU | Intensive Care Unit |
| KDE | Kernel Density Estimation |
| KNN | K-Nearest Neighbors |
| LLMs | Large Language Models |
| MaDB | Mannheim Database |
| ML | Machine Learning |
| rbf | Radial Basis Function |
| RF | Random Forest |
| SD | Synthetic Data |
| SLDB | Son Llàtzer Hospital Database |
| SMOTE | Synthetic Minority Oversampling Technique |
| SVM | Support Vector Machine |
| TPE | Tree-Structured Parzen Estimator |
Appendix A. Hyperparameter Grid Search
Table A1.
Hyperparameter search space and optimal values for the SVM model.
Table A2.
Hyperparameter search space and optimal values for the KNN model.
Table A3.
Hyperparameter search space and optimal values for the Random Forest model.
Table A4.
Hyperparameter search space and optimal values for the CatBoost model.
Table A5.
Hyperparameter search space and optimal values for the XGBoost model.
Table A6.
Hyperparameter search space and optimal values for the TabDDPM model.
Table A7.
Hyperparameter search space and optimal values for the CT-GAN model.
Table A8.
Hyperparameter search space and optimal values for the SMOTE–Tomek method.
Table A9.
Large Language Models and generation setup used for synthetic patient creation.
Appendix B. Experimental Results
Table A10.
Results of the experiment using SD, reported as AUC ± variance across three independently generated synthetic datasets. Each ML classifier was trained on synthetic samples derived from a subset of the MaDB dataset.
Table A11.
Evaluation of SD generation methods using DCR for privacy, and coverage and density metrics for diversity and fidelity, respectively.
References
- Nobbs, D.; Piwko, W.; Bull, C.; Cormack, F.; Ahmaniemi, T.; Holst, S.C.; Chatterjee, M.; Maetzler, W.; Avey, S.; Ng, W.F.; et al. Regulatory Qualification of a Cross-Disease Digital Measure: Benefits and Challenges from the Perspective of IMI Consortium IDEA-FAST. Digit. Biomark. 2023, 7, 132–138. [Google Scholar] [CrossRef] [Scilit]
- Faundez-Zanuy, M.; Fierrez, J.; Ferrer, M.A.; Diaz, M.; Tolosana, R.; Plamondon, R. Handwriting Biometrics: Applications and Future Trends in e-Security and e-Health. Cogn. Comput. 2020, 12, 940–953. [Google Scholar] [CrossRef] [Scilit]
- Romero-Tapiador, S.; Tolosana, R.; Morales, A.; Lacruz-Pleguezuelos, B.; Pastor, S.B.; Marcos Zambrano, L.J.; Bazán, G.X.; Freixer, G.; Vera-Rodriguez, R.; Fierrez, J.; et al. Personalized Weight Loss Management through Wearable Devices and Artificial Intelligence. arXiv 2024, arXiv:2409.08700. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Lacruz-Pleguezuelos, B.; Bazán, G.X.; Romero-Tapiador, S.; Freixer, G.; Tolosana, R.; Daza, R.; Fernández-Díaz, C.M.; Molina, S.; Crespo, M.C.; Laguna, T.; et al. AI4Food, a feasibility study for the implementation of automated devices in the nutritional advice and follow up within a weight loss intervention. Clin. Nutr. 2025, 48, 80–89. [Google Scholar] [CrossRef] [Scilit]
- Romero-Tapiador, S.; Tolosana, R.; Morales, A.; Fierrez, J.; Vera-Rodriguez, R.; Espinosa-Salinas, I.; Freixer, G.; de Santa Pau, E.C.; de Molina, A.R.; Ortega-Garcia, J. Leveraging automatic personalised nutrition: Food image recognition benchmark and dataset based on nutrition taxonomy. Multimed. Tools Appl. 2025, 84, 1945–1966. [Google Scholar] [CrossRef] [Scilit]
- Sharma, A.; Rani, R. A systematic review of applications of machine learning in cancer prediction and diagnosis. Arch. Comput. Methods Eng. 2021, 28, 4875–4896. [Google Scholar] [CrossRef] [Scilit]
- Savaş, S.; Güler, O. Ensemble learning based lung and colon cancer classification with pre-trained deep neural networks. Health Technol. 2025, 15, 105–117. [Google Scholar] [CrossRef] [Scilit]
- Crespí, L.S.; Madroñal, L.G.; Sarubbo, M.F.; Borges-Sa, M.; García, A.S.; Ramos, D.L.; Garcia-Hinojosa, C.P.; Garijo, E.M. Application of a machine learning model for early prediction of in-hospital cardiac arrests: Retrospective observational cohort study. Med. Intensiv. (Engl. Ed.) 2024, 49, 88–95. [Google Scholar] [CrossRef] [Scilit]
- Gomez, L.F.; Morales, A.; Orozco-Arroyave, J.R.; Daza, R.; Fierrez, J. Improving Parkinson Detection using Dynamic Features from Evoked Expressions in Video. In Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Nashville, TN, USA, 19–25 June 2021; IEEE: New York, NY, USA, 2021; pp. 1562–1570. [Google Scholar]
- Gomez, L.F.; Morales, A.; Fierrez, J.; Orozco-Arroyave, J.R. Exploring facial expressions and action unit domains for Parkinson detection. PLoS ONE 2023, 18, e0281248. [Google Scholar] [CrossRef] [Scilit]
- Savaş, S. Explainable artificial intelligence for diagnosis and staging of liver cirrhosis using stacked ensemble and multi-task learning. Diagnostics 2025, 15, 1177. [Google Scholar] [CrossRef] [Scilit]
- Acien, A.; Morales, A.; Vera-Rodriguez, R.; Fierrez, J.; Mondesire-Crump, I.; Arroyo-Gallego, T. Detection of mental fatigue in the general population: Feasibility study of keystroke dynamics as a real-world biomarker. JMIR Biomed. Eng. 2022, 7, e41003. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention is all you need. In Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, 4–9 December 2017. [Google Scholar]
- Moor, M.; Banerjee, O.; Abad, Z.S.H.; Krumholz, H.M.; Leskovec, J.; Topol, E.J.; Rajpurkar, P. Foundation models for generalist medical artificial intelligence. Nature 2023, 616, 259–265. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Morales, A.; Fierrez, J.; Vera-Rodriguez, R.; Tolosana, R. SensitiveNets: Learning agnostic representations with application to face images. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 43, 2158–2164. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Serna, I.; Morales, A.; Fierrez, J.; Obradovich, N. Sensitive Loss: Improving Accuracy and Fairness of Face Representations with Discrimination-Aware Deep Learning. Artif. Intell. 2022, 305, 103682. [Google Scholar] [CrossRef] [Scilit]
- Hassanpour, A.; Moradikia, M.; Yang, B.; Abdelhadi, A.; Busch, C.; Fierrez, J. Differential Privacy Preservation in Robust Continual Learning. IEEE Access 2022, 10, 24273–24287. [Google Scholar] [CrossRef] [Scilit]
- Veldhuis, R. Privacy and Security Matters in Biometric Technologies; Springer: Berlin/Heidelberg, Germany, 2025. [Google Scholar]
- Gomez-Barrero, M.; Galbally, J.; Morales, A.; Fierrez, J. Privacy-Preserving Comparison of Variable-Length Data with Application to Biometric Template Protection. IEEE Access 2017, 5, 8606–8619. [Google Scholar] [CrossRef] [Scilit]
- Melzi, P.; Shahreza, H.O.; Rathgeb, C.; Tolosana, R.; Vera-Rodriguez, R.; Fierrez, J.; Marcel, S.; Busch, C. Cancelable Face Biometrics With Soft-Biometric Privacy Enhancement. IEEE Access 2025, 13, 128420–128431. [Google Scholar] [CrossRef] [Scilit]
- Muñoz-Haro, J.; Tolosana, R.; Fierrez, J.; Vera-Rodriguez, R.; Morales, A. Privacy-aware detection of fake identity documents: Methodology, benchmark, and improved algorithms (FakeIDet2). Inf. Fusion 2026, 128, 103969. [Google Scholar] [CrossRef] [Scilit]
- Mancera, G.; Morales, A.; Fierrez, J.; Tolosana, R.; Peña, A.; Lopez-Duran, M.; Jurado, F.; Ortigosa, A. PBa-LLM: Privacy- and Bias-Aware NLP Using Named-Entity Recognition (NER). In Proceedings of the IAPR International Conference on Document Analysis and Recognition Workshops (ICDAR 2025), also Presented at AAAI Workshop on Privacy-Preserving Artificial Intelligence (PPAI 2025); Springer Nature Switzerland: Cham, Switzerland, 2026; pp. 3–20. [Google Scholar]
- Mancera, G.; DeAlcala, D.; Fierrez, J.; Tolosana, R.; Morales, A. Is My Text in Your AI Model? Gradient-based Membership Inference Test applied to LLMs. In Proceedings of the IEEE Conference on Artificial Intelligence Workshops (CAI), Granada, Spain, 8–10 May 2026. [Google Scholar]
- Romero-Tapiador, S.; Tolosana, R.; Lacruz-Pleguezuelos, B.; Marcos Zambrano, L.J.; Bazán, G.X.; Espinosa-Salinas, I.; Fierrez, J.; Ortega-Garcia, J.; Carrillo de Santa Pau, E.; Morales, A. Are Vision-Language Models Ready for Dietary Assessment? Exploring the Next Frontier in AI-Powered Food Image Recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPR), Nashville, TN, USA, 10–17 June 2025; pp. 430–439. [Google Scholar]
- Jiang, H.; Jiang, Z.; Tang, W.; Xie, Y.; Wang, M.; Huang, W.; Ye, T. RobustHealth: Non-Interactive Privacy-Preserving System for Heterogeneous Mobile Health Diagnosis. IEEE Trans. Mob. Comput. 2025, 25, 5953–5968. [Google Scholar] [CrossRef] [Scilit]
- Fang, M.; Huber, M.; Fierrez, J.; Ramachandra, R.; Damer, N.; Alkhaddour, A.; Kasantcev, M.; Pryadchenko, V.; Yang, Z.; Huangfu, H.; et al. SynFacePAD 2023: Competition on Face Presentation Attack Detection Based on Privacy-aware Synthetic Training Data. In Proceedings of the 2023 IEEE International Joint Conference on Biometrics (IJCB), Ljubljana, Slovenia, 25–28 September 2023. [Google Scholar]
- El Emam, K.; Hoptroff, R. The synthetic data paradigm for using and sharing data. Cut. Exec. Update 2019, 19, 1–12. [Google Scholar]
- Shafique, R.; Rustam, F.; Choi, G.S.; Díez, I.d.l.T.; Mahmood, A.; Lipari, V.; Velasco, C.L.R.; Ashraf, I. Breast cancer prediction using fine needle aspiration features and upsampling with supervised machine learning. Cancers 2023, 15, 681. [Google Scholar] [CrossRef] [Scilit]
- Boutros, F.; Struc, V.; Fierrez, J.; Damer, N. Synthetic Data for Face Recognition: Current State and Future Prospects. Image Vis. Comput. 2023, 135, 104688. [Google Scholar] [CrossRef] [Scilit]
- Rankin, D.; Black, M.; Bond, R.; Wallace, J.; Mulvenna, M.; Epelde, G. Reliability of supervised machine learning using synthetic data in health care: Model to preserve privacy for data sharing. Med. Inform. 2020, 8, e18910. [Google Scholar] [CrossRef] [Scilit]
- Macias-Fassio, E.; Morales, A.; Pruenza, C.; Fierrez, J. Privacy-Preserving Tabular Data Generation: Application to Sepsis Detection. In Proceedings of the IAPR International Conference on Pattern Recognition, ICPR, Kolkata, India, 1–5 December 2024; Springer: Berlin/Heidelberg, Germany, 2025; pp. 75–89. [Google Scholar]
- Hernandez, M.; Epelde, G.; Alberdi, A.; Cilla, R.; Rankin, D. Synthetic data generation for tabular health records: A systematic review. Neurocomputing 2022, 493, 28–45. [Google Scholar] [CrossRef] [Scilit]
- Rubin, D.B. Statistical disclosure limitation. J. Off. Stat. 1993, 9, 461–468. [Google Scholar]
- Little, R.J. Statistical analysis of masked data. J. Off. Stat. 1993, 9, 407. [Google Scholar]
- Chong, K.M. Privacy-preserving healthcare informatics: A review. Itm Web Conf. 2021, 36, 04005. [Google Scholar] [CrossRef] [Scilit]
- Batista, G.E.; Prati, R.C.; Monard, M.C. A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD Explor. Newsl. 2004, 6, 20–29. [Google Scholar] [CrossRef] [Scilit]
- Plesovskaya, E.; Ivanov, S. An empirical analysis of KDE-based generative models on small datasets. Procedia Comput. Sci. 2021, 193, 442–452. [Google Scholar] [CrossRef] [Scilit]
- Goodfellow, I.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative Adversarial Nets. In Proceedings of the 28th International Conference on Neural Information Processing Systems, Montreal, QC, Canada, 8–13 December 2014; Volume 27. [Google Scholar]
- Neves, J.C.; Tolosana, R.; Vera-Rodriguez, R.; Lopes, V.; Proenca, H.; Fierrez, J. GAN Fingerprints in Face Image Synthesis. In Multimedia Forensics; ACVPR; Springer: Berlin/Heidelberg, Germany, 2022; pp. 175–204. [Google Scholar]
- Hazra, D.; Byun, Y.C. SynSigGAN: Generative Adversarial Networks for synthetic biomedical signal generation. Biology 2020, 9, 441. [Google Scholar] [CrossRef] [Scilit]
- Xu, L.; Skoularidou, M.; Cuesta-Infante, A.; Veeramachaneni, K. Modeling tabular data using conditional gan. Adv. Neural Inf. Process. Syst. 2019, 32, 7335–7345. [Google Scholar]
- Kotelnikov, A.; Baranchuk, D.; Rubachev, I.; Babenko, A. TabDDPM: Modelling tabular data with diffusion models. In Proceedings of the International Conference on Machine Learning, Honolulu, HI, USA, 23–29 July 2023; pp. 17564–17579. [Google Scholar]
- Singer, M.; Deutschman, C.S.; Seymour, C.W.; Shankar-Hari, M.; Annane, D.; Bauer, M.; Bellomo, R.; Bernard, G.R.; Chiche, J.D.; Coopersmith, C.M.; et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA 2016, 315, 801–810. [Google Scholar] [CrossRef] [Scilit]
- Weber, B.; Henrich, D.; Hildebrand, F.; Marzi, I.; Leppik, L. The roles of extracellular vesicles in sepsis and systemic inflammatory response syndrome. Shock 2023, 59, 161. [Google Scholar] [PubMed]
- Alanazi, A.; Aldakhil, L.; Aldhoayan, M.; Aldosari, B. Machine Learning for Early Prediction of Sepsis in Intensive Care Unit (ICU) Patients. Medicina 2023, 59, 1276. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Camacho-Cogollo, J.E.; Bonet, I.; Gil, B.; Iadanza, E. Machine Learning Models for Early Prediction of Sepsis on Large Healthcare Datasets. Electronics 2022, 11, 1507. [Google Scholar] [CrossRef] [Scilit]
- Giannini, H.M.; Ginestra, J.C.; Chivers, C.; Draugelis, M.; Hanish, A.; Schweickert, W.D.; Fuchs, B.D.; Meadows, L.; Lynch, M.; Donnelly, P.J.; et al. A machine learning algorithm to predict severe sepsis and septic shock: Development, implementation and impact on clinical practice. Crit. Care Med. 2019, 47, 1485. [Google Scholar] [CrossRef] [Scilit]
- Horng, S.; Sontag, D.A.; Halpern, Y.; Jernite, Y.; Shapiro, N.I.; Nathanson, L.A. Creating an automated trigger for sepsis clinical decision support at emergency department triage using machine learning. PLoS ONE 2017, 12, e0174708. [Google Scholar] [CrossRef] [Scilit]
- Islam, M.M.; Nasrin, T.; Walther, B.A.; Wu, C.C.; Yang, H.C.; Li, Y.C. Prediction of sepsis patients using machine learning approach: A meta-analysis. Comput. Methods Programs Biomed. 2019, 170, 1–9. [Google Scholar] [CrossRef] [Scilit]
- Kausch, S.L.; Moorman, J.R.; Lake, D.E.; Keim-Malpass, J. Physiological machine learning models for prediction of sepsis in hospitalized adults: An integrative review. Intensive Crit. Care Nurs. 2021, 65, 103035. [Google Scholar] [CrossRef] [Scilit]
- Nemati, S.; Holder, A.; Razmi, F.; Stanley, M.D.; Clifford, G.D.; Buchman, T.G. An interpretable machine learning model for accurate prediction of sepsis in the ICU. Crit. Care Med. 2018, 46, 547–553. [Google Scholar] [CrossRef] [Scilit]
- Liu, B.; Du, H.; Zhang, J.; Jiang, J.; Zhang, X.; He, F.; Niu, B. Developing a new sepsis screening tool based on lymphocyte count, international normalized ratio and procalcitonin (LIP score). Sci. Rep. 2022, 12, 20002. [Google Scholar] [CrossRef] [Scilit]
- Schamoni, S.; Hagmann, M.; Riezler, S. Ensembling Neural Networks for Improved Prediction and Privacy in Early Diagnosis of Sepsis. In Proceedings of the Machine Learning for Healthcare Conference, Durham, NC, USA, 5–6 August 2022; pp. 123–145. [Google Scholar]
- Vítek, L.; Tiribelli, C. Bilirubin: The yellow hormone? J. Hepatol. 2021, 75, 1485–1490. [Google Scholar] [CrossRef] [Scilit]
- Kashani, K.; Rosner, M.H.; Ostermann, M. Creatinine: From physiology to clinical application. Eur. J. Intern. Med. 2020, 72, 9–14. [Google Scholar] [CrossRef] [Scilit]
- Shrimanker, I.; Bhattarai, S. Electrolytes; StatPearls Publishing: Treasure Island, FL, USA, 2019. [Google Scholar]
- Du Clos, T.W. Function of C-reactive protein. Ann. Med. 2000, 32, 274–278. [Google Scholar] [CrossRef] [Scilit]
- Lowe, M.E. Structure and function of pancreatic lipase and colipase. Annu. Rev. Nutr. 1997, 17, 141–158. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hafen, B.B.; Sharma, S. Oxygen Saturation; StatPearls Publishing: Treasure Island, FL, USA, 2018. [Google Scholar]
- Sookoian, S.; Pirola, C.J. Alanine and aspartate aminotransferase and glutamine-cycling pathway: Their roles in pathogenesis of metabolic syndrome. World J. Gastroenterol. 2012, 18, 3775. [Google Scholar] [CrossRef] [Scilit]
- Akiba, T.; Sano, S.; Yanase, T.; Ohta, T.; Koyama, M. Optuna: A Next-generation Hyperparameter Optimization Framework. In Proceedings of the International Conference on Knowledge Discovery and Data Mining, Anchorage, AK, USA, 4–8 August 2019. [Google Scholar]
- Lundberg, S.M.; Lee, S.I. A unified approach to interpreting model predictions. Neural Inf. Process. Syst. 2017, 30, 4768–4777. [Google Scholar]
- Ortega, A.; Fierrez, J.; Morales, A.; Wang, Z.; Cruz, M.; Alonso, C.L.; Ribeiro, T. Symbolic AI for XAI: Evaluating LFIT Inductive Programming for Explaining Biases in Machine Learning. Computers 2021, 10, 154. [Google Scholar] [CrossRef] [Scilit]
- Tello, J.; de la Cruz, M.; Ribeiro, T.; Fierrez, J.; Morales, A.; Tolosana, R.; Alonso González, C.; Ortega, A. Symbolic AI (LFIT) for XAI to Handle Biases. In Proceedings of the European Conference on Artificial Intelligence Workshops (ECAI), Kraków, Poland, 30 September–4 October 2023; CEUR-WS; Volume 3523. [Google Scholar]
- Chawla, N.V.; Bowyer, K.W.; Hall, L.O.; Kegelmeyer, W.P. SMOTE: Synthetic minority over-sampling technique. J. Artif. Intell. Res. 2002, 16, 321–357. [Google Scholar] [CrossRef] [Scilit]
- Achiam, J.; Adler, S.; Agarwal, S.; Ahmad, L.; Akkaya, I.; Aleman, F.L.; Almeida, D.; Altenschmidt, J.; Altman, S.; Anadkat, S.; et al. Gpt-4 technical report. arXiv 2023, arXiv:2303.08774. [Google Scholar] [CrossRef] [Scilit]
- Naeem, M.F.; Oh, S.J.; Uh, Y.; Choi, Y.; Yoo, J. Reliable fidelity and diversity metrics for generative models. In Proceedings of the International Conference on Machine Learning, PMLR, Virtual, 13–18 July 2020; pp. 7176–7185. [Google Scholar]
- Scott, D.W. Multivariate Density Estimation; Wiley: Hoboken, NJ, USA, 2015. [Google Scholar]
- Dwork, C. Differential privacy. In Encyclopedia of Cryptography, Security and Privacy; Springer: Berlin/Heidelberg, Germany, 2025; pp. 649–652. [Google Scholar]
- Zhao, Z.; Kunar, A.; Birke, R.; Chen, L.Y. CTAB-GAN: Effective table data synthesizing. In Proceedings of the Asian Conference on Machine Learning, Virtual, 17–19 November 2021; pp. 97–112. [Google Scholar]
- Santana, A.R.; de Sousa, J.L.; Amorim, F.F.; Menezes, B.M.; Araújo, F.V.B.; Soares, F.B.; Santos, L.C.d.C.; de Araújo, M.P.B.; Rocha, P.H.G.; Júnior, P.N.F.; et al. SaO2/FiO2 ratio as risk stratification for patients with sepsis. Crit. Care 2013, 17, P51. [Google Scholar] [CrossRef] [Scilit]
- Póvoa, P. C-reactive protein: A valuable marker of sepsis. Intensive Care Med. 2002, 28, 235–243. [Google Scholar] [CrossRef] [Scilit]
- Li, J.; Li, J.; Wang, C.; Verbeek, F.J.; Schultz, T.; Liu, H. Outlier detection using iterative adaptive mini-minimum spanning tree generation with applications on medical data. Front. Physiol. 2023, 14, 1233341. [Google Scholar] [CrossRef] [Scilit]
- Borges-Sa, M.; Giglio, A.; Aranda, M.; Socias, A.; Del Castillo, A.; Pruenza, C.; Hernández, G.; Cerdá, S.; Socias, L.; Estrada, V.; et al. Hospital-Wide Sepsis Detection: A Machine Learning Model Based on Prospectively Expert-Validated Cohort. J. Clin. Med. 2026, 15, 855. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Yazdinejad, A.; Dehghantanha, A.; Karimipour, H.; Srivastava, G.; Parizi, R.M. A robust privacy-preserving federated learning model against model poisoning attacks. IEEE Trans. Inf. Forensics Secur. 2024, 19, 6693–6708. [Google Scholar] [CrossRef] [Scilit]
- Wang, Y.; Guo, S.; Deng, Y.; Zhang, H.; Fang, Y. Privacy-preserving task-oriented semantic communications against model inversion attacks. IEEE Trans. Wirel. Commun. 2024, 23, 10150–10165. [Google Scholar]
- Bygrave, L.A. Data Privacy Law: An International Perspective; Oxford University Press: Oxford, UK, 2014. [Google Scholar]
- Purtova, N. The law of everything. Broad concept of personal data and future of EU data protection law. Law Innov. Technol. 2018, 10, 40–81. [Google Scholar] [CrossRef] [Scilit]
- Acien, A.; Morales, A.; Vera-Rodriguez, R.; Bartolome, I.; Fierrez, J. Measuring the Gender and Ethnicity Bias in Deep Models for Face Recognition. In LNCS, Proceedings of the IAPR Iberoamerican Congress on Pattern Recognition (CIARP), Madrid, Spain, 19–22 November 2018; Springer: Berlin/Heidelberg, Germany, 2018; Volume 11401, pp. 584–593. [Google Scholar]
- Peña, A.; Fierrez, J.; Morales, A.; Mancera, G.; Lopez-Duran, M.; Tolosana, R. Addressing bias in LLMs: Strategies and application to fair AI-based recruitment. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, Madrid, Spain, 20–22 October 2025; Volume 8, pp. 1976–1987. [Google Scholar]
- Solano, I.; Fierrez, J.; Morales, A.; Peña, A.; Tolosana, R.; Zamora-Martinez, F.; San Agustin, J. Balancing tails when comparing distributions: Comprehensive equity index (CEI) with application to bias evaluation in operational face biometrics. Pattern Recognit. 2026, 179, 113616. [Google Scholar] [CrossRef] [Scilit]
- Acien, A.; Morales, A.; Giancardo, L.; Vera-Rodriguez, R.; Holmes, A.A.; Fierrez, J.; Arroyo-Gallego, T. KeyGAN: Synthetic keystroke data generation in the context of digital phenotyping. Comput. Biol. Med. 2025, 184, 109460. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Stragapede, G.; Vera-Rodriguez, R.; Tolosana, R.; Morales, A.; Fierrez, J.; Ortega-Garcia, J.; Rasnayaka, S.; Seneviratne, S.; Dissanayake, V.; Liebers, J.; et al. IJCB 2022 Mobile Behavioral Biometrics Competition (MobileB2C). In Proceedings of the IEEE/IAPR International Joint Conference on Biometrics (IJCB), Abu Dhabi, United Arab Emirates, 10–13 October 2022. [Google Scholar]
- Robledo-Moreno, M.; Vera-Rodriguez, R.; Tolosana, R.; Ortega-Garcia, J.; Huergo, A.; Fierrez, J. AirSignatureDB: Exploring In-Air Signature Biometrics in the Wild and its Privacy Concerns. In Proceedings of the IEEE/IAPR International Joint Conference on Biometrics (IJCB), Osaka, Japan, 8–11 September 2025. [Google Scholar]
- Pedrouzo-Rodriguez, L.; Gomez, L.F.; Tolosana, R.; Vera-Rodriguez, R.; Daza, R.; Morales, A.; Fierrez, J. Leveraging Avatar Fingerprinting: A Multi-Generator Photorealistic Talking-Head Public Database and Benchmark. arXiv 2026, arXiv:2603.26934. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.





