Next Article in Journal
Targeted Detection of 76 Carnitine Indicators Combined with a Machine Learning Algorithm Based on HPLC-MS/MS in the Diagnosis of Rheumatoid Arthritis
Previous Article in Journal
Pyruvate Kinase M1/2 Proteoformics for Accurate Insights into Energy Metabolism Abnormity to Promote the Overall Management of Ovarian Cancer Towards Predictive, Preventive, and Personalized Medicine Approaches
Previous Article in Special Issue
The Current Applications of Metabolomics in Understanding Endometriosis: A Systematic Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Cytokine-Based Insights into Bloodstream Infections and Bacterial Gram Typing in ICU COVID-19 Patients

by
Rúben Araújo
1,2,3,
Luís Ramalhete
1,4,5,
Cristiana P. Von Rekowski
1,2,3,
Tiago A. H. Fonseca
1,2,3,
Cecília R. C. Calado
3,6 and
Luís Bento
1,2,7,8,*
1
NMS—NOVA Medical School, FCM—Faculdade de Ciências Médicas, Universidade NOVA de Lisboa, Campo dos Mártires da Pátria 130, 1169-056 Lisbon, Portugal
2
CHRC—Comprehensive Health Research Centre, Universidade NOVA de Lisboa, 1150-082 Lisbon, Portugal
3
ISEL—Instituto Superior de Engenharia de Lisboa, Instituto Politécnico de Lisboa, Rua Conselheiro Emídio Navarro 1, 1959-007 Lisbon, Portugal
4
IPST—Instituto Português do Sangue e da Transplantação, Alameda das Linhas de Torres 117, 1769-001 Lisbon, Portugal
5
iNOVA4Health—Advancing Precision Medicine, RG11: Reno-Vascular Diseases Group, NMS—NOVA Medical School, FCM—Faculdade de Ciências Médicas, Universidade NOVA de Lisboa, 1169-056 Lisbon, Portugal
6
Institute for Bioengineering and Biosciences (iBB), The Associate Laboratory Institute for Health and Bioeconomy-i4HB, Instituto Superior Técnico (IST), Universidade de Lisboa (UL), Av. Rovisco Pais, 1049-001 Lisbon, Portugal
7
Intensive Care Department, ULSSJ—Unidade Local de Saúde São José, Rua José António Serrano, 1150-199 Lisbon, Portugal
8
Integrated Pathophysiological Mechanisms, CHRC—Comprehensive Health Research Centre, NMS—NOVA Medical School, FCM—Faculdade de Ciências Médicas, Universidade NOVA de Lisboa, Campo Mártires da Pátria 130, 1169-056 Lisbon, Portugal
*
Author to whom correspondence should be addressed.
Metabolites 2025, 15(3), 204; https://doi.org/10.3390/metabo15030204
Submission received: 17 February 2025 / Revised: 3 March 2025 / Accepted: 14 March 2025 / Published: 16 March 2025
(This article belongs to the Special Issue Towards Clinical Interpretation of Metabolomic Data)

Abstract

:
Background: Timely and accurate identification of bloodstream infections (BSIs) in intensive care unit (ICU) patients remains a key challenge, particularly in COVID-19 settings, where immune dysregulation can obscure early clinical signs. Methods: Cytokine profiling was evaluated to discriminate between ICU patients with and without BSIs, and, among those with confirmed BSIs, to further stratify bacterial infections by Gram type. Serum samples from 45 ICU COVID-19 patients were analyzed using a 21-cytokine panel, with feature selection applied to identify candidate markers. Results: A machine learning workflow identified key features, achieving robust performance metrics with AUC values up to 0.97 for BSI classification and 0.98 for Gram typing. Conclusions: In contrast to traditional approaches that focus on individual cytokines or simple ratios, the present analysis employed programmatically generated ratios between pro-inflammatory and anti-inflammatory cytokines, refined through feature selection. Although further validation in larger and more diverse cohorts is warranted, these findings underscore the potential of advanced cytokine-based diagnostics to enhance precision medicine in infection management.

1. Introduction

Infections in intensive care units (ICUs) represent a significant challenge due to their high morbidity and mortality rates [1]. Early identification of bloodstream infections (BSIs) is critical, as delayed diagnosis can lead to severe complications, including septic shock, organ failure, and fatalities [2]. The Coronavirus Disease 2019 (COVID-19) pandemic, caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has further exacerbated these challenges, with infection-related deaths rising due to both direct viral complications and secondary infections. Studies have highlighted that healthcare-associated infections (HAI) in ICU settings have often been overlooked amidst the pandemic’s demands, potentially contributing to misdiagnoses and delayed treatments [3]. Moreover, the overlap between inflammatory responses in COVID-19 and other critical infections [4] complicates traditional diagnostic approaches, emphasizing the need for more reliable biomarkers and predictive tools that are not used in isolation but rather in conjunction with thorough clinical evaluations and a comprehensive understanding of their biology, interferences, strengths, and limitations [5].
Traditional biomarkers, such as C-reactive protein (CRP), procalcitonin (PCT), and white blood cell (WBC) count, are widely employed in clinical practice to diagnose infections and assess their severity [6]. While these biomarkers are considered standard diagnostic tools, they are not without significant limitations. Culture-based techniques, which often accompany these markers, require extended timeframes to yield results and are influenced by the quality and quantity of the specimen, leading to potential delays in treatment decisions for critically ill patients [7]. Similarly, molecular assays, such as polymerase chain reaction (PCR)-based tests, offer faster results but are prone to false positives, which can result in unnecessary treatments and increased antibiotic resistance [8]. Furthermore, biomarkers like CRP and PCT often lack sensitivity and specificity in differentiating complex conditions, such as sepsis versus systemic inflammatory response syndrome (SIRS), or between ventilator-associated tracheobronchitis and pneumonia [9,10,11]. These limitations underscore the urgent need for more precise, rapid, and minimally invasive biomarkers to improve diagnostic accuracy in critical care settings [12]. Additionally, these diagnostic methods require significant time and specialized personnel, which can be costly in both financial and human resource terms.
Cytokines, small signaling proteins involved in immune responses, have emerged as potential biomarkers due to their ability to reflect the body’s inflammatory and immune status. Key cytokines such as interleukin-6 (IL-6) [13], interleukin-8 (IL-8) [14], and interleukin-10 (IL-10) [15] are frequently studied for their roles in inflammation and infection.
The balance between pro-inflammatory and anti-inflammatory cytokines is a critical determinant of clinical outcomes in ICU patients, including those with COVID-19. Pro-inflammatory cytokines, such as IL-6, Interleukin-1 beta (IL-1β), Tumor Necrosis Factor-alpha (TNF-α), and Interferon-gamma (IFN-γ), are vital for immune defense but, when dysregulated, can trigger a cytokine storm, exacerbating tissue damage, acute respiratory distress syndrome (ARDS), and multi-organ failure [16]. Conversely, anti-inflammatory cytokines like IL-10 and interleukin-13 (IL-13) mitigate excessive immune activation, yet their imbalance often worsens disease severity [17]. In severe COVID-19 infections, elevated IL-10 levels may reflect a compensatory but inadequate response to hyperinflammation, dominated by IL-6, TNF-α, and IL-1β. These dynamics highlight the need for therapies that balance immune modulation to prevent hyperinflammation without compromising pathogen-specific responses, particularly in ICU settings where precision interventions can improve outcomes [18,19].
Despite their potential, cytokines as biomarkers face limitations that constrain their clinical utility. Many studies report widely varying diagnostic performance metrics, with AUC values ranging from 0.71 to 0.83 when using IL-6 alone [20]. Research often focuses on elevated cytokine levels to differentiate between types of infections, rather than solely relying on diagnostic accuracy [21]. Furthermore, research tends to prioritize a limited subset of inflammation-related cytokines, such as IL-6, IL-8, and TNF-α, which are associated with generalized immune responses rather than specific infection states [22,23]. This narrow scope neglects the complexity of cytokine interactions and their capacity to reflect dynamic physiological conditions. While cytokine ratios have shown potential for enhancing diagnostic precision, their application remains underexplored [24].
Researchers have explored the utility of cytokines and their ratios for diagnosing BSIs and discriminating between bacterial Gram types. Several studies have focused on cytokine profiles for detecting bacteremia. For instance, a high IL-10/TNF-α ratio measured on Day 1 was found to be predictive of persistent bacteremia, while values recorded on Day 4 could predict 30-day mortality [25]. Elevated levels of IL-6, IL-8, and Interferon gamma-induced protein 10 (IP-10, also known as CXCL10) were associated with bacterial infections in febrile patients, irrespective of culture positivity, highlighting their potential as robust biomarkers [26]. In BSIs caused by Klebsiella pneumoniae, persistent IL-6 and IL-10 elevation correlated with increased mortality, while high arginase levels were linked to carbapenem-resistant strains, with AUCs of 0.726 for arginase and 0.805 for its combination with TNF-α and Interleukin-4 (IL-4) [27]. Additionally, cytokines such as Interleukin-2 (IL-2), IL-6, IL-10, and Interleukin-17A (IL-17A) were significantly elevated in patients with bloodstream Candida infections compared to bacterial BSIs, demonstrating their capacity to differentiate between fungal and bacterial pathogens [28].
In addition to bacteremia, cytokines and their ratios have been investigated for use in stratifying bacterial Gram types. In one study, it was highlighted that IL-6 and IL-10 levels appeared elevated while IL-2 levels were decreased in Gram-negative infections, with AUCs for IL-2 and IL-10 of 0.581 and 0.661, respectively, whereas a combined logistic regression model for IL-2 and IL-10 achieved an AUC of 0.735 for distinguishing Gram-negative from Gram-positive infections [29]. Others reported a promising IL-6/IL-10 ratio (AUC = 0.822) as a rapid diagnostic tool for Gram-negative and Gram-positive bacteremia [30]. Despite extensive research efforts in this field, most studies still rely on conventional cytokines or predefined ratios, limiting the scope for discovering novel biomarkers or combinations that could significantly enhance diagnostic accuracy [31].
Selecting an appropriate biofluid is critical for ensuring reproducibility and reliability in cytokine biomarker studies. In this study, serum was chosen for its stability and suitability for long-term storage. Derived from whole blood, serum lacks the clotting factors that could introduce variability, providing a consistent medium for analyzing immune responses [32,33]. Its utility has been demonstrated in studies on inflammation [34], sepsis [35], and BSIs [28].
This study addresses the diagnostic challenges of BSIs in ICU COVID-19 patients by leveraging cytokine profiling and machine learning methodologies. Using serum samples from 45 ICU patients, we investigated the potential of a 21-cytokine assay to differentiate between patients without BSIs (23 patients) and those with confirmed BSIs (22 patients), where bacterial infections were further stratified by Gram type. In addition to evaluating the traditional cytokine levels and ratios reported in the literature, this study aimed to identify potentially more effective ratios for improving diagnostic precision. These findings underscore the potential of cytokine profiling to improve clinical decision-making in critical care.

2. Materials and Methods

2.1. Workflow Overview

Figure 1 provides a schematic representation of the study workflow, detailing the key steps from patient selection to model evaluation. The process begins with the recruitment of ICU patients diagnosed with COVID-19, followed by standard blood collection and serum extraction. Serum samples are then preserved at −80 °C to maintain stability for cytokine profiling. A high-sensitivity multiplex assay is utilized to quantify a panel of 21 cytokines, with the data subsequently processed through extraction, transformation, and cleaning pipelines. Statistical analyses and computational methods, including univariate and multivariate assessments, guide the selection of cytokine ratios. Feature selection algorithms then identify the most relevant potential biomarkers, which are then used to train machine learning models for distinguishing bloodstream infections and Gram typing.

2.2. Study Population

Forty-five patients who were admitted to the ICU of Hospital São José in Lisbon, a tertiary hospital, were included in this study, part of the Predictive Models of COVID-19 Outcomes for Higher-risk Patients Towards a Precision Medicine (PREMO) project and approved by the hospital’s Ethics Committee. Informed consent was obtained from all patients or from their immediate family members for data collection. All demographic, clinical, and laboratory data were collected from the hospital’s electronic medical records system and anonymized.
All patients included in this study were critically ill COVID-19 patients, with infection confirmed via real-time polymerase chain reaction tests (RT-PCR). Biological samples were collected from patients admitted to the ICU between 12 November 2020, and 24 September 2021. The final dataset comprises samples from patients without bloodstream infections (no BSIs, n = 23) and patients with confirmed bloodstream infections (presence of BSIs, n = 22), of which 7 were Gram-negative and 15 were Gram-positive. BSIs were identified using standard microbiology techniques, with hemoculture testing performed on blood samples collected directly from a peripheral vein and analyzed by the hospital laboratory. Gram type was determined from bacterial isolates using routine microbiological identification tests. The biological samples used for cytokine profiling were collected on the same day, ensuring that only patients with confirmed BSIs concurrent with serum collection were included in the study.

2.3. Collection of Biological Samples

Peripheral blood was collected in VACUETTE® tubes (Greiner Bio-One GmbH, Kremsmünster, Austria) without anticoagulant, using standard blood collection procedures. Serum was obtained by centrifuging the samples at 3500 rpm for 10 min (Mikro 220T, Andreas Hettich GmbH & Co. KG, Tuttlingen, Germany) and stored at −80 °C until cytokine profiling.

2.4. Cytokine Profiling

Serum cytokines were analyzed, using a MILLIPLEX MAP 384-well Human High-sensitivity T Cell Panel immunology multiplex assay, to profile a comprehensive set of 21 cytokines (HSTC384-28K, Millipore, Merck, Germany): Interferon-inducible T cell alpha chemoattractant (ITAC), granulocyte-macrophage colony-stimulating factor (GM-CSF), Fractalkine (also known as CX3CL1), IFN-γ, IL-10, macrophage inflammatory protein-3 alpha (MIP-3α), Interleukin-12p70 (IL-12p70), IL-13, IL-17A, IL-1β, IL-2, Interleukin-21 (IL-21), IL-4, Interleukin-23 (IL-23), Interleukin-5 (IL-5), IL-6, Interleukin-7 (IL-7), IL-8, macrophage inflammatory protein-1 alpha (MIP-1α), macrophage inflammatory protein-1 beta (MIP-1β), and TNF-α. The assay was performed according to the manufacturer’s protocol, using a FLEXMAP® 3D system with xPONENT® software version 4.3 for data acquisition and analysis (Luminex Corporation, Austin, TX, USA).

2.5. Data and Statistical Analysis

The demographic variables in this study included age and gender [36,37], while clinical characteristics comprised body mass index (BMI) [38] and the presence of comorbidities [39]. The types of respiratory support provided, specifically, invasive mechanical ventilation (IMV) [40] and extracorporeal membrane oxygenation (ECMO) [41], were also considered. These variables were selected for their clinical relevance in COVID-19 patients, as they are significant prognostic factors for ICU outcomes. It was assessed whether these variables exhibited statistically significant differences between the two main patient groups: patients with confirmed BSIs and those without BSIs, as this allows the effect of confounding variables to be minimized. Statistical significance for this particular set of variables was defined as a two-sided p-value of less than 0.01.
Statistical analysis of the patients’ demographic and clinical characteristics was conducted using Student’s t-test for continuous variables with a normal distribution and the Mann–Whitney U test for non-normally distributed continuous variables. For categorical data, chi-square (χ2) and Fisher’s exact tests were applied, with Fisher’s test specifically used for smaller sample sizes. Continuous variables were represented as medians and interquartile ranges (25th to 75th percentiles), while categorical data were presented as absolute frequencies and percentages. All statistical analyses were performed using IBM SPSS Statistics software, version 27 (IBM Corp., Armonk, NY, USA).
The t-distributed stochastic neighbor embedding (SNE) technique, an unsupervised classification method, was conducted to visualize patient groupings. t-SNE is a dimensionality reduction technique that projects high-dimensional data into two or three dimensions while preserving relative distances between the data points, revealing clusters or groupings in complex datasets [42]. All t-SNE visualizations were pre-processed, with the ‘Normalize data’ option enabled to reduce potential bias from differences in feature scales. The perplexity setting was adjusted to ‘preserve global structure’, which aims to retain the relative positioning of groups within the dataset, ensuring that larger patterns in the data are better represented in the low-dimensional space. Additionally, supervised classification models—k-nearest neighbors (kNN), naïve Bayes, random forest, support vector machine (SVM), and decision tree—were developed. Five-fold cross-validation was implemented, in which the dataset was divided into five equal parts, with the model trained on four parts and tested on the remaining part in each iteration. This ensured that each sample was tested once. This approach provides a more robust estimate of model performance and mitigates the risk of overfitting by ensuring that no single subset of data disproportionately influences the results. By averaging model performance across all folds, cross-validation reduces model dependency on specific data distributions, helping to ensure that the reported performance metrics reflect the true predictive capability within a specific dataset.
Feature selection for cytokines and their ratios was performed using a fast correlation-based filter (FCBF), an entropy-based algorithm that ranks variables by their importance in discriminating target groups (e.g., patients with BSIs from those without BSIs, or Gram-negative from Gram-positive). FCBF assigns values to each feature within a range of [0,1], where 1 indicates a feature whose value completely predicts the target class, while 0 represents no predictive value [43]. Only features with a score greater than 0 were retained for further analysis, ensuring that only the most informative cytokine ratios were considered. Given the extensive number of cytokine-derived ratios generated in this study, FCBF was chosen for its ability to efficiently filter out redundant features, a challenge that alternative scoring methods may struggle with when applied to such high-dimensional datasets. Feature selection was applied to the entire dataset before cross-validation, as the primary goal was to identify biologically relevant cytokine ratios rather than solely optimize predictive performance [44]. While this approach may potentially carry a risk of data leakage—where information from the test set could inadvertently influence feature selection, leading to overly optimistic model performance—it ensures that selected features reflect global discriminative power rather than being dependent on a specific fold of the dataset. This does not invalidate the need for future studies that should strive to incorporate larger datasets with distinct subsets for training, testing, and validation to further enhance model stability and generalizability [45].
The analyses mentioned above were conducted using the Orange: Data Mining Toolbox, version 3.36.2 (Bioinformatics Lab, University of Ljubljana, Ljubljana, Slovenia) [46].
Nomograms [47] were applied to the datasets after FCBF for both target classes in this study. A nomogram is a graphical tool that illustrates the contribution of each feature to a predictive model, allowing for an intuitive interpretation of their impact on the target outcome. The log odds ratio scale was used to quantify the influence of each feature, as it is widely understood and preferred in clinical contexts for comparing the relative effects of variables. Features were displayed in ranked order, reflecting their importance as determined by the FCBF method, ensuring that the most relevant features appeared prominently for interpretation. The blue markers on the nomogram serve as reference points for how the different ranges contribute to classification.
To complement the cytokine assay of 21 cytokines from the MILLIPLEX MAP 384-well Human High-sensitivity T Cell Panel, all possible ratio combinations were programmatically calculated [48] using a maximum of three cytokines (as a sum) in both the numerator and denominator. Pro-inflammatory cytokines (ITAC, GM-CSF, Fractalkine, IFN-γ, IL-17a, IL-1β, IL-2, IL-12p70, IL-23, IL-6, IL-8, MIP-1α, MIP-1β, and TNF-α) were assigned to the numerator, while anti-inflammatory cytokines (IL-10, IL-4, IL-13, IL-5, IL-7, and IL-21) were assigned to the denominator.
It is acknowledged, however, that classifying certain cytokines as strictly pro- or anti-inflammatory remains a subject of debate in the literature. For instance, IL-5, IL-7, and IL-21 are sometimes cited as predominantly pro-inflammatory [49,50,51], whereas other studies highlight immunomodulatory or anti-inflammatory roles for these same cytokines [52,53,54]. Similarly, IL-2 is widely regarded as a pro-inflammatory T cell growth factor [55], yet emerging evidence highlights its critical role in supporting regulatory T cell homeostasis and mediating anti-inflammatory effects [56]. Despite these nuances, the above categorization was adopted for the ratio-based analyses in the present study. Following this classification approach, the total number of theoretical ratios was reduced from over 1.5 million to 19,229 biologically relevant combinations. These ratios, along with the 21 original cytokine concentrations (for a total of 19,250 features), were then fed to FCBF, an entropy-based scoring method, to streamline the dataset and identify the features most strongly contributing to the discrimination of the target classes: the presence of BSIs and Gram type.
The analysis was further expanded to evaluate cytokine distributions and compare their levels across the patient groups (e.g., patients with BSIs vs. those without BSIs). Only outliers up to 1.5 times the interquartile range (IQR) were included in the displayed boxplots to avoid compression of the visualization scale. Depending on the normality of each group’s data, assessed via the Shapiro–Wilk test, either Student’s t-test (for normally distributed data) or the Mann–Whitney U test (for non-normal distributions) was used for statistical comparison, with univariate analysis allowing for individual comparisons of cytokines. Boxplots were generated to visualize group distributions, with the median, interquartile ranges, and potential outliers highlighted. Statistical significance was annotated directly on the plots, with p-values displayed.

3. Results and Discussion

3.1. Study Population Characteristics

The current study included 45 ICU patients from a tertiary hospital in Lisbon, of whom 22 had a confirmed BSI based on positive hemoculture results. The remaining patients had no detected BSI, as indicated by negative hemoculture results. The two patient groups (BSIs and No BSIs) did not differ statistically (p > 0.01) in terms of demographic characteristics (age, gender) or clinical variables such as ECMO, IMV, the presence of comorbidities, and BMI (Table 1). This minimizes the potential effects of confounding variables [48].

3.2. Commonly Reported Cytokines and Ratios

Cytokines, simple ratios, and traditional laboratory markers such as PCT and CRP have been widely explored as biomarkers. However, their application is often limited to specific contexts, with individual studies focusing on bloodstream discrimination, bacterial Gram typing, sepsis, disease severity, or mortality in isolation. Many of these studies examine the same limited cytokines and ratios in relatively small and specific populations. To establish a foundation for our analysis, we summarize these commonly reported variables in the following section, linking them to Table 2, where their behavior in our cohort is analyzed and compared to findings in the literature.
For hemoculture discrimination, multiple features have been explored as biomarkers. Studies have reported elevated CRP, PCT, IL-6, IL-10, WBC, neutrophil percentage (NE%), and erythrocyte sedimentation rates in BSI patients compared to those with local bacterial infections [57]. Cytokines such as IL-6, IL-8, and IP-10 were found to be significantly elevated in bacterial infections, regardless of culture positivity [26]. Furthermore, in a cohort of 51 patients with bloodstream Candida infections, compared to 20 with bacterial bloodstream infections, elevated IL-2, IL-17A, IL-6, and IL-10 levels were reported as potential discriminatory biomarkers [28]. However, the patient population was highly imbalanced and included a diverse set of ICU, oncology, and surgical patients, with no clear normalization for severity or comorbidities. Cytokine ratios have also been explored, with a high IL-10/TNF-α ratio on Day 1 predicting persistent bacteremia and correlating with 30-day mortality when measured on Day 4 [25]. However, most of these studies either combine BSI detection with mortality prediction, lack focus on bacteremia alone or are limited to highly specific cohorts such as extremely low birth weight infants, where elevated Th1 cytokines (e.g., IFN-γ) and IL-10 were linked to increased infection risk [58].
For Gram typing, elevated IL-6 and IL-10 levels have been associated with Gram-negative infections, with the IL-6/IL-10 ratio achieving an AUC of 0.822 for distinguishing Gram-negative from Gram-positive bacterial infections [30]. The IL-2/IL-10 ratio also demonstrated a capacity to differentiate Gram-negative from Gram-positive infections with an AUC of 0.735 in a study on sepsis and intracranial infections [29].
Cytokines have also been investigated for other clinical applications beyond hemoculture and Gram typing. Some studies have explored their use as biomarkers for defining clinical cutoff values, with cytokines such as IL-2, IL-6, IL-10, and TNF-α being proposed as reference points for inflammatory conditions [59]. Additionally, cytokines like IL-6 and IL-10 have been evaluated for their association with infection severity, including severe adenovirus infections where elevated levels of these cytokines correlated with more severe cases [60]. In sepsis, cytokine modulation has also been explored as a therapeutic strategy, with IL-6, IL-10, and TNF-α serving as targets for managing hypercytokinemia in both sepsis and COVID-19 patients [61].
To provide a comprehensive overview, Table 2 compiles all the cytokines, simple ratios, and traditional laboratory or clinical markers commonly found in the relevant literature (or the closest equivalent in our cohort data, e.g., lymphocyte count in place of white blood cell count), using values recorded from our own cohort. These values will be used to determine whether the levels, ratios, or markers were elevated or decreased per group, with their statistical significance being reported accordingly. This approach aims to ensure transparency and thoroughness by replicating previously reported biomarkers while expanding the scope of the analysis.
The results obtained in the present cohort (Table 2) demonstrate both convergence and divergence when compared with previously reported biomarkers for BSI discrimination and Gram typing, as outlined at the beginning of this section. The specific areas of agreement and divergence are detailed below.
  • BSIs: Presence vs. Absence
Several cytokines and traditional laboratory markers that were previously reported as biomarkers for BSI discrimination, such as CRP, PCT, IL-6, and IL-10, were included in the present analysis. Significant elevation of IL-6 (p = 0.020) and the IL-6/IL-10 ratio (p < 0.001) was observed in patients with BSIs, aligning with the literature indicating IL-6’s role as a marker of systemic inflammation and BSI presence [26,57]. However, CRP and PCT, commonly cited as elevated in BSI [57], were not statistically different between patients with and without BSIs (p > 0.05).
Cytokines IL-10, IL-8, and TNF-α showed no significant differences between BSI and non-BSI patients, despite being reported as elevated in BSIs in prior studies [26,28]. This divergence may be partly explained by the substantial proportion of missing values for traditional laboratory markers in the dataset (12.5% for BSI and 82.6% for non-BSI), which could be influenced by the characteristics of the cohort, including the presence of COVID-19 cases.
Non-significant differences were also observed for IL-2 and IL-17A, despite previous research highlighting their elevation in BSIs caused by Candida species [28]. However, differences in patient populations (the present cohort did not include Candida infections), along with the small group sizes, may have influenced these findings.
  • Gram-Positive vs. Gram-Negative
The analysis revealed statistically significant differences in CRP (p = 0.006) and lymphocytes (p = 0.014) between Gram-positive and Gram-negative infections. IL-17A levels were observed to be higher in Gram-positive infections, although the difference did not reach statistical significance (p = 0.056). Consistent with the previous literature, higher IL-6 and IL-10 values and a higher IL-6/IL-10 ratio were observed in Gram-positive infections compared to Gram-negative cases, supporting reports where the IL-6/IL-10 ratio has been shown to distinguish Gram typing with an AUC of 0.822 [30]. However, the IL-2/IL-10 ratio did not reach statistical significance in the present cohort (p = 0.758), contrasting with its previously reported discriminatory capacity [29].
Interestingly, while both CRP and IL-6 were significantly higher in Gram-positive infections (CRP: 224.85 vs. 118.40 mg/dL; IL-6: 21.55 vs. 3.97 pg/mL), PCT did not show a statistically significant difference (PCT: 0.35 vs. 0.66 ng/mL; p = 0.953), diverging from prior reports that emphasized its elevation in Gram-negative infections [30]. This divergence may be influenced by the lower number of Gram-negative cases and the proportion of missing data in this subgroup (28.6% for Gram-negative and 5% for Gram-positive).
  • Convergence With and Divergence From the Literature
The findings support previously established results, particularly the elevation of IL-6 and IL-6/IL-10 ratios in both patients with BSI and Gram-positive infections. However, the lack of statistically significant differences for other markers, such as PCT and IL-10, contrasts with earlier reports, emphasizing the variability that may arise due to cohort size, infection type diversity, missing data, and the presence of COVID-19 infection. The limited number of BSI and non-BSI cases in the present cohort may have influenced the statistical power to detect differences. Therefore, while the data confirms the relevance of IL-6 and IL-6/IL-10 ratios as key markers for both BSI detection and Gram typing, further studies with larger, more balanced cohorts are needed to clarify the roles of other cytokines such as PCT, IL-10, and the IL-2/IL-10 ratios.
Additionally, the reported missing values regarding the traditional laboratory markers must be considered when interpreting these results (Table 2). While some studies may choose to apply statistical imputation methods to estimate missing values (e.g., mean, median, or multiple imputation), the present dataset was retained in its original structure to ensure transparency and prevent the introduction of artificial bias. While this limitation is inherent in real-world research, even more so when focused on ICU environments, future studies with expanded datasets and more comprehensive biomarker collection could potentially mitigate this issue.
In the next section, a univariate cytokine analysis for the complete multiplex assay is presented regarding both target classes: BSI presence and Gram typing.

3.3. Univariate Cytokines Analysis

In this section, the median and IQR values for all 21 cytokines are presented for BSI versus non-BSI patients and for Gram-negative versus Gram-positive patients. Additionally, absolute differences, percentage differences (% difference), and fold changes were calculated to highlight disparities between the groups. To ensure clinical relevance, BSI patients are used as the reference for BSI analysis, and Gram-negative patients are used as the reference for Gram typing. The absolute difference reflects the raw magnitude of change between groups, while the % difference incorporates directionality, indicating whether cytokine levels are relatively higher or lower in the reference group. Fold changes further complement these analyses by showing proportional differences; values of greater than 1 suggest elevated cytokine levels in the reference group, while values of less than 1 indicate lower levels. These metrics, alongside p-values for statistical significance, provide a comprehensive view of cytokine behavior in the context of BSIs and Gram typing in the present cohort.

3.3.1. Bloodstream Infections

The analysis of cytokine levels between BSI and non-BSI patients revealed notable differences in cytokine expression. Among the 21 cytokines analyzed, statistically significant differences were observed for 2 cytokines (ITAC and IL-6), with p-values of 0.003 and 0.020, respectively (Figure 2, Table 3). ITAC levels were significantly lower in the BSI group compared to the non-BSI group (median: 60 vs. 106), with an absolute difference of 47, a percentage difference of −79%, and a fold change of 0.56.
Similarly, IL-6 levels were higher in the BSI group (median: 21.50 vs. 2.78), with an absolute difference of 18.71, a percentage difference of 672.65%, and a fold change of 7.73.
IL-6’s elevation in BSI patients aligns with its well-documented role as a biomarker of systemic inflammation. Studies have highlighted IL-6 as a critical mediator in both bacterial and viral infections, particularly for its involvement in driving acute-phase responses and as a marker of disease severity [62,63]. Elevated IL-6 levels have been reported in febrile infections and bacteremia, reflecting the severity of systemic inflammation and aiding in the differentiation of infection types. In critically ill patients, IL-6 concentrations correlate with worse 90-day survival, organ dysfunction, and the need for organ support therapies such as vasopressors or renal replacement therapy [64]. Additionally, IL-6 has been proposed as a valuable indicator for early prognosis and follow-up in septic shock patients [65] and has demonstrated utility in conjunction with clinical scoring systems like SOFA for predicting 28-day mortality [66].
Conversely, the pronounced reduction in ITAC levels in the BSI group may reflect differences in immune responses to bloodstream infections. ITAC plays a role in the chemotaxis of T cells and NK cells, and its decreased levels in BSI patients might be linked to pathogen-specific immune suppression or systemic depletion during bacterial infections. This is supported by studies indicating distinct cytokine profiles in bacterial and viral infections, where ITAC levels are more prominently elevated in viral infections [67]. The reduction in ITAC in BSI patients could reflect a bacterial-specific immune signature or the modulation of chemokine production during bacteremia [68].
While most other cytokines did not show statistical significance, several trends were observed. For instance, MIP-1α and IL-8 exhibited percentage differences of 25.91% and 73.52%, respectively, with fold changes of 1.26 and 1.74, suggesting higher levels in the BSI group. IL-8, in particular, has been associated with neutrophil activation and inflammatory responses during bacterial infections. Its increased levels in BSI patients (median: 16.74 in BSI vs. 9.65 pg/mL in non-BSI patients; % difference: 73.52%) further support its role in neutrophil-driven inflammation and systemic cascades in bloodstream infections [69].
The near-equilibrium seen in the patient distribution between BSI (n = 22) and non-BSI (n = 23) minimizes the likelihood of sample size bias influencing the observed differences. However, variations in treatment regimens or baseline comorbidities may still account for some discrepancies. Overall, these results highlight the potential of IL-6 and ITAC as biomarkers for systemic inflammation and immune dysregulation in BSIs, aligning with existing evidence while providing new insights specific to critically ill ICU COVID-19 patients.

3.3.2. Gram Typing

The comparison of cytokine levels (Table 4) between Gram-positive and Gram-negative groups revealed no statistically significant differences among the 21 cytokines analyzed (Table 5). Nevertheless, ITAC (p = 0.058) and IL-17A (p = 0.056) had p-values close to the threshold for statistical significance, potentially indicating trends worth further exploration.
ITAC levels were notably higher in the Gram-positive group compared to Gram-negative (median: 90.97 vs. 33.73), with an absolute difference of 57.24, a percentage difference of −169.72%, and a fold change of 0.37. Elevated ITAC levels, typically associated with T-cell and NK-cell recruitment, have been linked to severe inflammatory states, including Gram-positive infections [70]. Although ITAC has been proposed as a potential marker for COVID-19 severity, in this study, it was primarily analyzed for its discriminatory capacity in Gram typing, as all patients were ICU COVID-19 cases [67].
Similarly, IL-17A exhibited higher levels in Gram-positive patients (median: 26.60 vs. 23.93) with a fold change of 0.90. IL-17A, associated with immune defense against Gram-positive pathogens, has been shown to influence susceptibility to Gram-positive infections and severe sepsis outcomes through genetic variations [71]. The trends observed in this cohort suggest IL-17A’s specific role in shaping immune responses to Gram-positive infections, even though the differences here did not reach statistical significance.
IL-8 levels, in contrast, were elevated in the Gram-positive group (median: 30.58 vs. 13.45 pg/mL in Gram-negative), showing the largest fold change among cytokines (2.27). Elevated IL-8 levels have been linked to neutrophil activation and heightened inflammatory responses in Gram-negative infections [72], which may reflect distinct inflammatory pathways during such infections [73].
It is important to note that the Gram-positive group had more than twice the number of patients (n = 15) compared to the Gram-negative group (n = 7), which may limit the statistical power to detect significant differences. Additionally, demographic differences, comorbidities, or variations in treatment regimens may have influenced cytokine levels. Gram-negative infections are generally associated with lipopolysaccharide-driven cytokine release, inducing higher levels of IL-6, IL-8, and IL-10, while Gram-positive infections are linked to cytokines such as IL-17A and ITAC, due to exotoxin-driven inflammatory responses [70,74].

3.4. Multivariate Cytokines Analysis

Despite the increasing interest in cytokine profiling for diagnostic purposes [75], the current literature focuses predominantly on traditional laboratory markers, leaving multivariate or machine learning frameworks underexplored. This section explores the potential of cytokine-based profiling for distinguishing between BSI and Gram type groups in ICU COVID-19 patients. The analysis incorporates supervised machine learning models and advanced feature selection to evaluate individual cytokines and programmatically generated cytokine ratios. Section 3.4.1 focuses on the performance metrics derived from 21 cytokines, while 3.4.2 assesses the diagnostic power of 19,250 features, including the original cytokines and 19,229 biologically relevant complex ratios. The findings emphasize the added value of feature selection and the inclusion of computationally generated ratios in improving classification accuracy and data clustering.

3.4.1. Individual Cytokine Analysis

In this analysis, 21 cytokines were evaluated as features for distinguishing BSI from non-BSI patients and Gram-negative from Gram-positive infections. Supervised machine learning models were applied, and their performance was assessed using AUC, sensitivity, and specificity metrics. Sensitivity was prioritized as the most critical metric, followed by specificity and then AUC. The results are summarized in Table 6.
For BSI classification, the naïve Bayes model achieved the best overall performance on the FCBF-ranked dataset, with a sensitivity of 68.2%, specificity of 52.2%, and AUC of 0.575. This represented a modest improvement compared to the unfiltered dataset, where a random forest model achieved the highest sensitivity (59.1%) but with slightly lower specificity (52.2%) and AUC (0.505). These relatively poor results are aligned with the commonly reported results of other studies, in which, by using IL-2, IL-4, and IL-17A, AUC metrics of 0.576, 0.513, and 0.561 were obtained [76].
The sensitivity value increase from the unranked to the ranked workflow for naïve Bayes was approximately 15.4%, highlighting the contribution of feature selection in refining the dataset. FCBF ranking identified TNF-α and GM-CSF as the most relevant cytokines for BSI classification (Figure 3a), aligning with their roles in inflammatory responses during bloodstream infections. This increase, however, did fall short of a comparable result in the study, where, when used in conjunction with IL-2, IL-4, and IL-17A, the AUC jumped to a respectable 0.804 [76].
For Gram type classification, the decision tree model provided the best results for both unfiltered and FCBF-ranked workflows. On the unfiltered dataset, the model achieved a sensitivity of 71.4%, a specificity of 86.7%, and an AUC of 0.733. The FCBF-ranked workflow slightly improved the specificity (80.0%) while maintaining the same sensitivity, resulting in a marginally higher AUC of 0.750. The differences in metrics between ranked and unranked workflows were minimal, suggesting that the original cytokine dataset already captured the key discriminative information for this target group. FCBF ranking identified Fractalkine and IL-23 (Figure 3b) as the top-ranked cytokines, which is consistent with their known biological roles in inflammatory events [77,78].
These results suggest that Gram typing may be inherently easier to discriminate between than bloodstream infections, as reflected in other studies. For example, one study demonstrates that while certain cytokines, such as IFN-γ and IL-12, showed limited discriminative power (AUCs of 0.528 and 0.632, respectively), others, such as IL-8 and TNF-α, achieved highly promising results, specifically for Gram-negative bacteremia, with AUCs of 0.999 and 0.912, a sensitivity of 97.6% and 90.2%, and specificity of 100% and 87.5%, respectively [79]. Notably, the cytokines that were identified as most relevant in that study differ from those identified in the present analysis, namely, Fractalkine and IL-23, which showed strong performance for Gram typing, including Gram-negative infections. This variation may be attributed to differences in demographics and study populations; although both studies focus on ICU patients, the current study does not specifically address sepsis or mortality, in contrast to the other study. Such contextual differences likely contribute to variations in cytokine profiles and their diagnostic performance.
Regarding the t-SNE visualizations for the FCBF-ranked datasets, shown in Figure 3, these revealed moderate clustering, particularly for Gram-negative samples. This indicates that the selected features retained by the ranking process contributed to improved discrimination, although the separation between groups remained somewhat limited.

3.4.2. Computationally Generated Cytokine Ratios

For this section, the dataset was expanded to include 19,229 programmatically generated cytokine ratios alongside the original 21 cytokines, for a total of 19,250 features. These ratios were derived from biologically relevant combinations of up to a sum of three pro-inflammatory cytokines in the numerator and up to a sum of three anti-inflammatory cytokines in the denominator. The same machine learning models and evaluation metrics (AUC, sensitivity, and specificity) were applied, with FCBF ranking used to refine the datasets. The results are summarized in Table 7.
The improvement in metrics seen in Table 7, particularly for the ranked features from BSI and Gram typing, is reflected in the t-SNE visualizations shown in Figure 4. These visualizations display distinct clusters for both BSI and Gram-negative groups, demonstrating the effectiveness of feature selection and the integration of cytokine ratios in enhancing classification and cluster separation. The specific cytokine ratios contributing to these classifications are detailed in Figure 5.
For BSI classification, the naïve Bayes model applied to the FCBF-ranked dataset achieved the highest overall performance, with a sensitivity of 90.9%, a specificity of 91.3%, and an AUC of 0.970. Compared to the unranked dataset for the same model, this represented a substantial improvement of 66.8% in sensitivity and 40.0% in specificity. The ranked workflow identified six ratios, which are visualized in the BSI nomogram (Figure 5a). Among these, the most discriminative ratio was (GM-CSF + IL-17A + IL-1β)/(IL-4 + IL-7 + IL-21), highlighting the dynamic interaction between pro-inflammatory and anti-inflammatory cytokines in identifying bloodstream infections.
These findings demonstrate superior performance metrics compared to other machine learning approaches for predicting BSI. For example, a random forest model applied to a pediatric cohort with osteoarticular infections achieved an AUC of 0.947, with a sensitivity of 84.7% and specificity of 91.7% [80]. Similarly, a multivariate logistic regression model trained on hospitalized adults with suspected BSI reported an AUC of 0.74 [81]. While these studies provide valuable insights into the application of machine learning for BSI detection, they rely on traditional laboratory parameters such as procalcitonin, neutrophil count, leukocyte count, and fever days, rather than cytokine profiling.
For Gram type classification, the naïve Bayes model again provided the best results on the FCBF-ranked dataset, with a sensitivity of 100.0%, a specificity of 80.0%, and an AUC of 0.983. This corresponds to a 40.1% increase in sensitivity and a significant improvement in specificity compared to the unranked dataset for the same model. The ranked workflow identified five ratios, visualized in the Gram-negative nomogram (Figure 5b). The most discriminative ratio was (IFN-γ + IL-23 + MIP-1α)/(IL-4 + IL-13), underscoring the relevance of these cytokines in distinguishing Gram-negative from Gram-positive infections.
The results of this analysis demonstrate higher predictive performance compared to machine learning approaches based on routine laboratory parameters, as reported in a recent study [82]. In that study, a random forest model achieved an AUC of 0.768, with a sensitivity of 75.2% and specificity of 63.79%, for distinguishing Gram-positive from Gram-negative bacteremia. Similarly, their decision tree model demonstrated an AUC of 0.679, with a sensitivity of 66% and specificity of 67.82%. These differences in performance metrics may reflect the added value of incorporating cytokine profiling into machine learning workflows, as cytokine ratios capture dynamic immune responses that are not reflected in routine laboratory parameters.
The nomograms for the ranked features of both target classes (BSI and Gram type) are shown in Figure 5. These nomograms use log odds ratios to quantify the contribution of each ranked cytokine ratio to the likelihood of correctly predicting the target class, with default positions reflecting the baseline values determined by the underlying classifier [46].
For the BSI target class, six ranked ratios were included. When the first ratio falls within the interval of 0.715–0.879, the probability of correctly identifying BSI samples is 92%, contributing 2.53 log odds ratio points. Incorporating the second ratio within the interval of 3.276–4.546 marginally increases the probability to 95%, with a total contribution of 3 log odds ratio points. The remaining four ratios, positioned at their default levels, contributed minimally to further classification probability. To the best of our knowledge, no studies to date have explored nomogram-based predictions for BSIs using complex cytokine ratios. However, in other contexts, simpler ratios or individual cytokines have been utilized. For example, a model predicting viral versus Mycoplasma pneumoniae infection based on the TNF-α/IL-10 ratio and other factors achieved an AUC of 0.878 [83]. Similarly, a prognostic nomogram for multiple myeloma, incorporating cytokines such as IL-6 and MIP-1α, reached a concordance index of 0.80 for survival prediction [84].
In the Gram-negative nomogram, five ranked ratios are presented. When the first ratio falls within the interval of 17.974–26.560, the probability of correct classification is 88%, contributing 2.64 log odds ratio points. Incorporating the second ratio, within the interval of 1.919–3.105, significantly increases the probability to 96%, with a total contribution of 4 log odds ratio points. This greater gain, compared to BSI classification, highlights the importance of the top-ranked ratios in Gram-negative discrimination. Existing studies have explored nomogram-based predictions for Gram-negative infections. For example, Zhang et al. [85] developed a model based on plasma IL-6 and clinical variables such as procalcitonin and C-reactive protein, achieving an AUC of 0.761, with sensitivities and specificities of 69.2% and 75.6%, respectively. Chen et al. [86] constructed a nomogram for predicting Gram-negative infections in peritoneal dialysis-associated peritonitis patients, achieving an AUC of 0.821. While these models demonstrate strong performance, they rely on routine laboratory parameters or specific clinical settings, rather than on cytokine profiling.
Overall, these nomograms provide an intuitive visualization of these differences, emphasizing the varying dependencies on key features for accurate classification. By simplifying the interpretation of complex data into clear graphical outputs, these nomograms may enable clinicians to monitor changes in cytokine ratios and adapt therapeutic strategies without engaging with the underlying mathematical or statistical principles.

3.5. Key Considerations and Future Directions

  • Data Quality versus Quantity
A common misconception in machine learning applications is that larger sample sizes inherently lead to better predictive accuracy. However, research has demonstrated that increasing the data volume without addressing biases and inconsistencies can amplify errors rather than improve model performance [87]. In clinical research, particularly in ICU settings, sample sizes are inherently smaller due to the nature of critically ill patient populations. This study prioritized methodological rigor and biologically meaningful feature selection to maximize the reliability of findings despite these constraints. While future studies should focus on expanding cohorts, data quality should also and always remain the primary concern.
  • Importance of Data Cleaning and Normalization
The preprocessing of medical data plays a fundamental role in model accuracy and reliability. Studies emphasize that rigorous data cleaning, normalization, and feature scaling are often more impactful in model performance than raw sample size expansion [88]. Ensuring that the cytokine data is well-curated and normalized prevents artificial variability from dominating the learning process. In this study, feature selection via FCBF was applied to reduce redundancy and improve the detection of relevant features, reinforcing the importance of preprocessing in medical-oriented applications.
  • Selecting the Right Evaluation Metrics
Another critical factor influencing the reliability of machine learning models is the selection of appropriate evaluation metrics. Relying solely on data volume without considering metric suitability can obscure underlying biases. Metrics such as accuracy can be misleading, particularly in class-imbalanced biomedical datasets, where high overall accuracy may mask poor performance in underrepresented groups. Instead, studies emphasize the importance of comprehensive evaluation using AUROC, sensitivity/specificity, and calibration curves to ensure robust model assessment [89]. Neglecting these considerations can lead to biased predictions, undermining the reliability of machine learning in medical diagnosis and therapeutic decision-making. Ensuring rigorous evaluation across all stages of model development is essential to prevent disparities and support equitable patient outcomes [90,91].
  • No Sample Size is Big Enough for Universal Generalization
Even with the most extensive multi-center datasets, true global generalization remains unattainable. Studies have shown that even large-scale machine-learning models trained on hundreds of thousands of ICU cases can experience significant performance drops when tested on external hospital datasets [92]. Similarly, an artificial intelligence-based pneumonia classifier, trained on over 158,000 chest radiographs, exhibited a substantial decrease in performance when tested on a new hospital’s population [93]. These findings reinforce that no dataset—regardless of size—can fully generalize across different demographics, hospital settings, or geographic regions. Instead of pursuing unattainable global models, future efforts should focus on developing adaptable and reproducible methodologies.
  • The Path Forward: Reproducibility, Scalability, and Economic Considerations
Machine learning-driven biomarker research should prioritize methodological validation, reproducibility, and scalability before considering economic feasibility. Demonstrating stable and reproducible results is the first step toward attracting industry collaboration and reducing costs. Cytokine assays, for instance, are traditionally costly, but by validating specific cytokine ratios as reliable biomarkers, future research can streamline testing to a select few key markers, significantly lowering costs. More importantly, the long-term objective, and a reflection of this study and its research group, is to develop a workflow that enables institutions to generate hospital or region-specific models tailored to their own patient populations. This approach circumvents the challenge of achieving universal generalization by empowering local researchers to apply the same methodology in different clinical settings, whether ICU-based or broader infirmary-level patient cohorts.

4. Conclusions

This study highlights the potential of cytokine profiling, complemented by machine learning, to address diagnostic challenges in ICU COVID-19 patients. By leveraging serum cytokine ratios, this study demonstrated high levels of accuracy in distinguishing BSI presence and Gram type stratification, underscoring the utility of this approach in critical care diagnostics. These findings validate cytokine ratios as meaningful biomarkers and advocate for their integration into routine diagnostic workflows. However, this study is not without its limitations. It is constrained by its sample size and reliance on a single cohort from a hospital ICU—a reflection of the inherent challenges of conducting research in critically ill populations. Additionally, the complexity and cost of comprehensive cytokine assays impose further constraints on large-scale data collection. Despite these limitations, the study, designed as a proof-of-concept approach, has showcased promising results that warrant further investigation. Future research should focus on expanding the cohort through multi-center collaborations incorporating larger, independent datasets, and integrating longitudinal analyses to improve model generalizability and external validation. Equally important is the need to ensure that predictive models remain interpretable and practical for real-world application in clinical settings, reinforcing the role of continued collaboration between research teams and healthcare professionals. These efforts aim to refine the predictive models further, enhance their clinical applicability, and ultimately optimize ICU diagnostics and patient outcomes.

Author Contributions

Conceptualization, R.A. and C.R.C.C.; methodology, R.A., L.R., C.R.C.C. and L.B.; software, R.A. and L.R.; validation, C.R.C.C. and L.B.; formal analysis, R.A., L.R., C.R.C.C., C.P.V.R. and T.A.H.F.; investigation, R.A., C.R.C.C. and L.B.; resources, C.P.V.R. and L.B.; data curation, R.A. and C.P.V.R.; writing—original draft preparation, R.A. and C.R.C.C.; writing—review and editing, C.R.C.C. and L.B.; visualization, R.A., L.R. and T.A.H.F.; supervision, C.R.C.C. and L.B.; project administration, L.B.; funding acquisition, C.R.C.C. and L.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by project grant DSAIPA/DS/0117/2020, supported by Fundação para a Ciência e a Tecnologia, Portugal, and IPL/IDI&CA2024/R-DICIP_ISEL by Instituto Politécnico de Lisboa, Portugal. The present work was conducted in Instituto Politécnico de Lisboa and in the Engineering & Health Laboratory, resulting from a collaboration protocol established between Universidade Católica Portuguesa and Instituto Politécnico de Lisboa. Additionally, R. Araújo, T. Fonseca, and C. Rekowski acknowledge their PhD grants from FCT (references: 2021.05553.BD, 2024.02043.BD, and 2023.01951.BD, respectively).

Institutional Review Board Statement

Approval was obtained before collecting data. The present study is inserted in the Predictive Models of COVID-19 Outcomes for Higher-Risk Patients Towards a Precision Medicine (PREMO) project, approved by the Institutional CHULC Ethics Committee (1043/2021, 20 May 2020).

Informed Consent Statement

Volunteers provided signed written informed consent before enrolment in the study, with all the inherent ethical principles properly safeguarded.

Data Availability Statement

The data presented in this study are not publicly available, due to privacy or ethical restrictions, and due to the ongoing nature of the study.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Vincent, J.-L.; Sakr, Y.; Singer, M.; Martin-Loeches, I.; Machado, F.R.; Marshall, J.C.; Finfer, S.; Pelosi, P.; Brazzi, L.; Aditianingsih, D.; et al. Prevalence and Outcomes of Infection Among Patients in Intensive Care Units in 2017. JAMA 2020, 323, 1478. [Google Scholar] [CrossRef] [PubMed]
  2. Bharadwaj, R.; Bal, A.; Kapila, K.; Mave, V.; Gupta, A. Blood Stream Infections. BioMed Res. Int. 2014, 2014, 515273. [Google Scholar] [CrossRef] [PubMed]
  3. Bloch, N.; Rüfenacht, S.; Ludwinek, M.; Frick, W.; Kleger, G.-R.; Schneider, F.; Albrich, W.C.; Flury, D.; Kuster, S.P.; Schlegel, M.; et al. Healthcare-associated Infections in Intensive Care Unit Patients with and without COVID-19: A Single Center Pro-spective Surveillance Study. Antimicrob. Resist. Infect. Control 2023, 12, 147. [Google Scholar] [CrossRef] [PubMed]
  4. Grasselli, G.; Cattaneo, E.; Florio, G. Secondary Infections in Critically Ill Patients with COVID-19. Crit. Care 2021, 25, 317. [Google Scholar] [CrossRef]
  5. Póvoa, P.; Coelho, L.; Dal-Pizzol, F.; Ferrer, R.; Huttner, A.; Conway Morris, A.; Nobre, V.; Ramirez, P.; Rouze, A.; Salluh, J.; et al. How to Use Biomarkers of Infection or Sepsis at the Bedside: Guide to Clinicians. Intensive Care Med. 2023, 49, 142–153. [Google Scholar] [CrossRef]
  6. Magrini, L.; Gagliano, G.; Travaglino, F.; Vetrone, F.; Marino, R.; Cardelli, P.; Salerno, G.; Di Somma, S. Comparison between White Blood Cell Count, Procalcitonin and C Reactive Protein as Diagnostic and Prognostic Biomarkers of Infection or Sepsis in Patients Presenting to Emergency Department. Clin. Chem. Lab. Med. 2014, 52, 1465–1472. [Google Scholar] [CrossRef]
  7. Losser, M.-R.; Damoisel, C.; Payen, D. Bench-to-Bedside Review: Glucose and Stress Conditions in the Intensive Care Unit. Crit. Care 2010, 14, 231. [Google Scholar] [CrossRef]
  8. Tsalik, E.L.; Jones, D.; Nicholson, B.; Waring, L.; Liesenfeld, O.; Park, L.P.; Glickman, S.W.; Caram, L.B.; Langley, R.J.; Van Velkinburgh, J.C.; et al. Multiplex PCR To Diagnose Bloodstream Infections in Patients Admitted from the Emergency De-partment with Sepsis. J. Clin. Microbiol. 2010, 48, 26–33. [Google Scholar] [CrossRef]
  9. Coelho, L.; Rabello, L.; Salluh, J.; Martin-Loeches, I.; Rodriguez, A.; Nseir, S.; Gomes, J.A.; Povoa, P. C-Reactive Protein and Procalcitonin Profile in Ventilator-Associated Lower Respiratory Infections. J. Crit. Care 2018, 48, 385–389. [Google Scholar] [CrossRef]
  10. Russell, C.D.; Parajuli, A.; Gale, H.J.; Bulteel, N.S.; Schuetz, P.; De Jager, C.P.C.; Loonen, A.J.M.; Merekoulias, G.I.; Baillie, J.K. The Utility of Peripheral Blood Leucocyte Ratios as Biomarkers in Infectious Diseases: A Systematic Review and Meta-Analysis. J. Infect. 2019, 78, 339–348. [Google Scholar] [CrossRef]
  11. Maves, R.C.; Enwezor, C.H. Uses of Procalcitonin as a Biomarker in Critical Care Medicine. Infect. Dis. Clin. N. Am. 2022, 36, 897–909. [Google Scholar] [CrossRef] [PubMed]
  12. Ward, R.A.; Aghaeepour, N.; Bhattacharyya, R.P.; Clish, C.B.; Gaudillière, B.; Hacohen, N.; Mansour, M.K.; Mudd, P.A.; Pasupneti, S.; Presti, R.M.; et al. Harnessing the Potential of Multiomics Studies for Precision Medicine in Infectious Disease. Open Forum Infect. Dis. 2021, 8, ofab483. [Google Scholar] [CrossRef] [PubMed]
  13. Tanaka, T.; Narazaki, M.; Kishimoto, T. IL-6 in Inflammation, Immunity, and Disease. Cold Spring Harb. Perspect. Biol. 2014, 6, a016295. [Google Scholar] [CrossRef]
  14. Kraft, R.; Herndon, D.N.; Finnerty, C.C.; Cox, R.A.; Song, J.; Jeschke, M.G. Predictive Value of IL-8 for Sepsis and Severe In-fections After Burn Injury: A Clinical Study. Shock 2015, 43, 222–227. [Google Scholar] [CrossRef] [PubMed]
  15. Carlini, V.; Noonan, D.M.; Abdalalem, E.; Goletti, D.; Sansone, C.; Calabrone, L.; Albini, A. The Multifaceted Nature of IL-10: Regulation, Role in Immunological Homeostasis and Its Relevance to Cancer, COVID-19 and Post-COVID Conditions. Front. Immunol. 2023, 14, 1161067. [Google Scholar] [CrossRef]
  16. Dharra, R.; Kumar Sharma, A.; Datta, S. Emerging Aspects of Cytokine Storm in COVID-19: The Role of Proinflammatory Cytokines and Therapeutic Prospects. Cytokine 2023, 169, 156287. [Google Scholar] [CrossRef]
  17. Majeed, A.Y.; Zulkafli, N.E.S.; Ad’hiah, A.H. Serum Profiles of Pro-Inflammatory and Anti-Inflammatory Cytokines in Non-Hospitalized Patients with Mild/Moderate COVID-19 Infection. Immunol. Lett. 2023, 260, 24–34. [Google Scholar] [CrossRef]
  18. Montazersaheb, S.; Hosseiniyan Khatibi, S.M.; Hejazi, M.S.; Tarhriz, V.; Farjami, A.; Ghasemian Sorbeni, F.; Farahzadi, R.; Ghasemnejad, T. COVID-19 Infection: An Overview on Cytokine Storm and Related Interventions. Virol. J. 2022, 19, 92. [Google Scholar] [CrossRef]
  19. Tang, Y.; Liu, J.; Zhang, D.; Xu, Z.; Ji, J.; Wen, C. Cytokine Storm in COVID-19: The Current Evidence and Treatment Strategies. Front. Immunol. 2020, 11, 1708. [Google Scholar] [CrossRef]
  20. Song, J.; Park, D.W.; Moon, S.; Cho, H.-J.; Park, J.H.; Seok, H.; Choi, W.S. Diagnostic and Prognostic Value of Interleukin-6, Pentraxin 3, and Procalcitonin Levels among Sepsis and Septic Shock Patients: A Prospective Controlled Study According to the Sepsis-3 Definitions. BMC Infect. Dis. 2019, 19, 968. [Google Scholar] [CrossRef]
  21. Zhu, S.; Zeng, C.; Zou, Y.; Hu, Y.; Tang, C.; Liu, C. The Clinical Diagnostic Values of SAA, PCT, CRP, and IL-6 in Children with Bacterial, Viral, or Co-Infections. Int. J. Gen. Med. 2021, 14, 7107–7113. [Google Scholar] [CrossRef] [PubMed]
  22. Lacy, P.; Stow, J.L. Cytokine Release from Innate Immune Cells: Association with Diverse Membrane Trafficking Pathways. Blood 2011, 118, 9–18. [Google Scholar] [CrossRef] [PubMed]
  23. Dinarello, C.A. Historical Insights into Cytokines. Eur. J. Immunol. 2007, 37, S34–S45. [Google Scholar] [CrossRef]
  24. Qin, Y.; Feng, M.; Wu, Y.; Wang, Y.; Zhao, X.; Liu, G.; Gao, C.; Luo, J.; Guo, H. Comprehensive Analysis of Multiple Cytokines and Blood Parameters for the Diagnosis of Bacterial Infections in Rheumatoid Arthritis. Cytokine 2020, 136, 155251. [Google Scholar] [CrossRef]
  25. Tan, K.; Minejima, E.; Lou, M.; Mack, W.J.; Nieberg, P.; Wong-Beringer, A. Cytokine Measurements Add Value to Clinical Variables in Predicting Outcomes for Staphylococcus aureus Bacteremia. BMC Infect. Dis. 2021, 21, 317. [Google Scholar] [CrossRef] [PubMed]
  26. Liu, K.-T.; Liu, Y.-H.; Lin, C.-Y.; Kuo, P.-L.; Yen, M.-C. Inflammatory Molecules Expression Pattern for Identifying Pathogen Species in Febrile Patient Serum. Exp. Ther. Med. 2016, 12, 312–318. [Google Scholar] [CrossRef]
  27. Yu, W.; Zeng, L.; Lian, X.; Jiang, L.; Xu, H.; Guo, W.; Zheng, B.; Xiao, Y. Dynamic Cytokine Profiles of Bloodstream Infection Caused by Klebsiella pneumoniae in China. Ann. Clin. Microbiol. Antimicrob. 2024, 23, 79. [Google Scholar] [CrossRef]
  28. Taj-Aldeen, S.J.; Mir, F.A.; Sivaraman, S.K.; AbdulWahab, A. Serum Cytokine Profile in Patients with Candidemia versus Bacteremia. Pathogens 2021, 10, 1349. [Google Scholar] [CrossRef]
  29. Ye, Q.; Shao, W.-X.; Xu, X.-J.; Yang, Y. The Clinical Application Value of Cytokines in Treating Infectious Diseases. PLoS ONE 2014, 9, e98745. [Google Scholar] [CrossRef]
  30. Zhu, Q.; Li, H.; Zheng, S.; Wang, B.; Li, M.; Zeng, W.; Zhou, L.; Guan, Z.; Wang, H.; Liu, Y.; et al. IL-6 and IL-10 Are Associated With Gram-Negative and Gram-Positive Bacteria Infection in Lymphoma. Front. Immunol. 2022, 13, 856039. [Google Scholar] [CrossRef]
  31. Araújo, R.; Bento, L.F.N.; Fonseca, T.A.H.; Von Rekowski, C.P.; da Cunha, B.R.; Calado, C.R.C. Infection Biomarkers Based on Metabolomics. Metabolites 2022, 12, 92. [Google Scholar] [CrossRef] [PubMed]
  32. Grankvist, K.; Gomez, R.; Nybo, M.; Lima-Oliveira, G.; Von Meyer, A. Preanalytical Aspects on Short- and Long-Term Storage of Serum and Plasma. Diagnosis 2019, 6, 51–56. [Google Scholar] [CrossRef]
  33. Valo, E.; Colombo, M.; Sandholm, N.; McGurnaghan, S.J.; Blackbourn, L.A.K.; Dunger, D.B.; McKeigue, P.M.; Forsblom, C.; Groop, P.-H.; Colhoun, H.M.; et al. Effect of Serum Sample Storage Temperature on Metabolomic and Proteomic Biomarkers. Sci. Rep. 2022, 12, 4571. [Google Scholar] [CrossRef]
  34. Vendrame, E.; Hussain, S.K.; Breen, E.C.; Magpantay, L.I.; Widney, D.P.; Jacobson, L.P.; Variakojis, D.; Knowlton, E.R.; Bream, J.H.; Ambinder, R.F.; et al. Serum Levels of Cytokines and Biomarkers for Inflammation and Immune Activation, and HIV-Associated Non-Hodgkin B-Cell Lymphoma Risk. Cancer Epidemiol. Biomark. Prev. 2014, 23, 343–349. [Google Scholar] [CrossRef]
  35. Gogos, C.A.; Drosou, E.; Bassaris, H.P.; Skoutelis, A. Pro- versus Anti-inflammatory Cytokine Profile in Patients with Severe Sepsis: A Marker for Prognosis and Future Therapeutic Options. J. Infect. Dis. 2000, 181, 176–180. [Google Scholar] [CrossRef] [PubMed]
  36. Blanc, E.; Chaize, G.; Fievez, S.; Féger, C.; Herquelot, E.; Vainchtock, A.; Timsit, J.F.; Gaillat, J. The Impact of Comorbidities and Their Stacking on Short- and Long-Term Prognosis of Patients over 50 with Community-Acquired Pneumonia. BMC Infect. Dis. 2021, 21, 949. [Google Scholar] [CrossRef] [PubMed]
  37. Hockham, C.; Linschoten, M.; Asselbergs, F.W.; Ghossein, C.; Woodward, M.; Peters, S.A.E. Sex Differences in Cardiovascular Complications and Mortality in Hospital Patients with Covid-19: Registry Based Observational Study. BMJ Med. 2023, 2, e000245. [Google Scholar] [CrossRef]
  38. Perez, A.V.; Viana, M.V.; Dall’Orto Thomazini, L.; Loss, S.H.; De Machado, F.C.R.; Do Nascimento, A.G.; Kropidlofscky, A.P.; Gerchman, F.; Leitão, C.B.; Rech, T.H.; et al. BMI and Mortality in Critically Ill Patients with COVID-19: Another Brick in the Wall of the Obesity Paradox. Obesity 2024, 32, 1474–1482. [Google Scholar] [CrossRef]
  39. Simpson, A.; Puxty, K.; McLoone, P.; Quasim, T.; Sloan, B.; Morrison, D.S. Comorbidity and Survival after Admission to the Intensive Care Unit: A Population-Based Study of 41,230 Patients. J. Intensive Care Soc. 2021, 22, 143–151. [Google Scholar] [CrossRef]
  40. Chang, R.; Elhusseiny, K.M.; Yeh, Y.-C.; Sun, W.-Z. COVID-19 ICU and Mechanical Ventilation Patient Characteristics and Outcomes—A Systematic Review and Meta-Analysis. PLoS ONE 2021, 16, e0246318. [Google Scholar] [CrossRef]
  41. Ling, R.R.; Ramanathan, K.; Sim, J.J.L.; Wong, S.N.; Chen, Y.; Amin, F.; Fernando, S.M.; Rochwerg, B.; Fan, E.; Barbaro, R.P.; et al. Evolving Outcomes of Extracorporeal Membrane Oxygenation during the First 2 Years of the COVID-19 Pandemic: A Systematic Review and Meta-Analysis. Crit. Care 2022, 26, 147. [Google Scholar] [CrossRef] [PubMed]
  42. van der Maaten, L.; Hinton, G. Visualizing Data Using T-SNE. J. Mach. Learn. Res. 2008, 9, 2579–2605. [Google Scholar]
  43. Yu, L.; Liu, H. Feature Selection for High-Dimensional Data: A Fast Correlation-Based Filter Solution. In Proceedings of the Machine Learning, Proceedings of the Twentieth International Conference (ICML 2003), Washington, DC, USA, 21–24 August 2003. [Google Scholar]
  44. Guyon, I.; Elisseeff, A. An Introduction to Variable and Feature Selection. J. Mach. Learn. Res. 2003, 3, 1157–1182. [Google Scholar]
  45. Lustgarten, J.L.; Gopalakrishnan, V.; Visweswaran, S. Measuring Stability of Feature Selection in Biomedical Datasets. AMIA Annu. Symp. Proc. 2009, 2009, 406–410. [Google Scholar]
  46. Demšar, J.; Curk, T.; Erjavec, A.; Gorup, Č.; Hočevar, T.; Milutinovič, M.; Možina, M.; Polajnar, M.; Toplak, M.; Starič, A.; et al. Orange: Data Mining Toolbox in Python. J. Mach. Learn. Res. 2013, 14, 2349–2353. [Google Scholar]
  47. Lyle, P. The Construction of Nomograms for Use in Statistics: Part I. True and Empirical Nomograms. Appl. Stat. 1954, 3, 116. [Google Scholar] [CrossRef]
  48. Araújo, R.; Ramalhete, L.; Viegas, A.; Von Rekowski, C.P.; Fonseca, T.A.H.; Calado, C.R.C.; Bento, L. Simplifying Data Analysis in Biomedical Research: An Automated, User-Friendly Tool. Methods Protoc. 2024, 7, 36. [Google Scholar] [CrossRef]
  49. Pelaia, C.; Paoletti, G.; Puggioni, F.; Racca, F.; Pelaia, G.; Canonica, G.W.; Heffler, E. Interleukin-5 in the Pathophysiology of Severe Asthma. Front. Physiol. 2019, 10, 1514. [Google Scholar] [CrossRef]
  50. Bikker, A.; Erik Hack, C.; Lafeber, F.P.J.G.; Van Roon, J.A.G. Interleukin-7: A Key Mediator in T Cell-Driven Autoimmunity, Inflammation, and Tissue Destruction. Curr. Pharm. Des. 2012, 18, 2347–2356. [Google Scholar] [CrossRef]
  51. Yang, S.; Zeng, J.; Hao, W.; Sun, R.; Tuo, Y.; Tan, L.; Zhang, H.; Liu, R.; Bai, H. IL-21/IL-21R Promotes the Pro-Inflammatory Effects of Macrophages during C. muridarum Respiratory Infection. Int. J. Mol. Sci. 2023, 24, 12557. [Google Scholar] [CrossRef]
  52. Ye, D.; Wang, Z.; Ye, J.; Wang, M.; Liu, J.; Xu, Y.; Jiang, H.; Chen, J.; Wan, J. Interleukin-5 Levels Are Decreased in the Plasma of Coronary Artery Disease Patients and Inhibit Th1 and Th17 Differentiation in Vitro. Rev. Española De Cardiol. (Engl. Ed.) 2020, 73, 393–402. [Google Scholar] [CrossRef]
  53. Kim, H.K.; Waickman, A.T.; Castro, E.; Flomerfelt, F.A.; Hawk, N.V.; Kapoor, V.; Telford, W.G.; Gress, R.E. Distinct IL-7 Signaling in Recent Thymic Emigrants versus Mature Naïve T Cells Controls T-cell Homeostasis. Eur. J. Immunol. 2016, 46, 1669–1680. [Google Scholar] [CrossRef] [PubMed]
  54. Jian, L.; Li, C.; Wang, X.; Sun, L.; Ma, Z.; Zhao, J. IL-21 Impairs pro-Inflammatory Activity of M1-like Macrophages Exerting Anti-Inflammatory Effects on Rheumatoid Arthritis. Autoimmunity 2022, 55, 75–85. [Google Scholar] [CrossRef] [PubMed]
  55. Sehgal, A.N.A.; Tauber, P.A.; Stieger, R.B.; Kratzer, B.; Pickl, W.F. The T-Cell Growth Factor Interleukin-2, Which Is Occa-sionally Targeted by Autoantibodies, Qualifies as Drug for the Treatment of Allergy, Autoimmunity, and Cancer: Collegium Internationale Allergologicum (CIA) Update 2024. Int. Arch. Allergy Immunol. 2024, 185, 286–300. [Google Scholar] [CrossRef]
  56. Klatzmann, D.; Abbas, A.K. The Promise of Low-Dose Interleukin-2 Therapy for Autoimmune and Inflammatory Diseases. Nat. Rev. Immunol. 2015, 15, 283–294. [Google Scholar] [CrossRef] [PubMed]
  57. Yang, X.; Zeng, J.; Yu, X.; Wang, Z.; Wang, D.; Zhou, Q.; Bai, T.; Xu, Y. PCT, IL-6, and IL-10 Facilitate Early Diagnosis and Pathogen Classifications in Bloodstream Infection. Ann. Clin. Microbiol. Antimicrob. 2023, 22, 103. [Google Scholar] [CrossRef]
  58. Schelonka, R.L.; Maheshwari, A.; Carlo, W.A.; Taylor, S.; Hansen, N.I.; Schendel, D.E.; Thorsen, P.; Skogstrand, K.; Hougaard, D.M.; Higgins, R.D. T Cell Cytokines and the Risk of Blood Stream Infection in Extremely Low Birth Weight Infants. Cytokine 2011, 53, 249–255. [Google Scholar] [CrossRef]
  59. Monastero, R.N.; Pentyala, S. Cytokines as Biomarkers and Their Respective Clinical Cutoff Levels. Int. J. Inflamm. 2017, 2017, 4309485. [Google Scholar] [CrossRef]
  60. Sun, J.; Ma, X.; Zhang, M.; Xie, M.; Zhang, X.; Han, X.; Li, X.; Zhou, E.; Wang, J.; Wang, J. Comparisons of Lymphocytes Profiles and Inflammatory Cytokines Levels in Blood of Patients with Differed Severity of Infection by Human Adenovirus Type 7. BMC Infect. Dis. 2023, 23, 174. [Google Scholar] [CrossRef]
  61. Ruiz-Rodríguez, J.C.; Plata-Menchaca, E.P.; Chiscano-Camón, L.; Ruiz-Sanmartin, A.; Ferrer, R. Blood Purification in Sepsis and COVID-19: What’s New in Cytokine and Endotoxin Hemoadsorption. J. Anesth. Analg. Crit. Care 2022, 2, 15. [Google Scholar] [CrossRef]
  62. Otto, G.; Braconier, J.; Andreasson, A.; Svanborg, C. Interleukin-6 and Disease Severity in Patients with Bacteremic and Nonbacteremic Febrile Urinary Tract Infection. J. Infect. Dis. 1999, 179, 172–179. [Google Scholar] [CrossRef] [PubMed]
  63. Slaats, J.; Ten Oever, J.; Van De Veerdonk, F.L.; Netea, M.G. IL-1β/IL-6/CRP and IL-18/Ferritin: Distinct Inflammatory Programs in Infections. PLoS Pathog. 2016, 12, e1005973. [Google Scholar] [CrossRef] [PubMed]
  64. Picod, A.; Morisson, L.; De Roquetaillade, C.; Sadoune, M.; Mebazaa, A.; Gayat, E.; Davison, B.A.; Cotter, G.; Chousterman, B.G. Systemic Inflammation Evaluated by Interleukin-6 or C-Reactive Protein in Critically Ill Patients: Results From the FROG-ICU Study. Front. Immunol. 2022, 13, 868348. [Google Scholar] [CrossRef] [PubMed]
  65. Gamarra-Morales, Y.; Molina-López, J.; Santiago-Ruiz, F.-C.; Herrera-Quintana, L.; Vázquez-Lorente, H.; Gascón-Luna, F.; Planells, E. Efficiency of IL-6 in Early Prognosis and Follow-Up in Critically Ill Patients with Septic Shock. Diseases 2024, 12, 298. [Google Scholar] [CrossRef]
  66. Yamamoto, R.; Sasaki, J.; Shibusawa, T.; Nakada, T.; Mayumi, T.; Takasu, O.; Matsuda, K.; Shimazui, T.; Otsubo, H.; Teshima, Y.; et al. Accuracy for Mortality Prediction With Additive Biomarkers Including Interleukin-6 in Critically Ill Patients: A Mul-ticenter Prospective Observational Study. Crit. Care Explor. 2021, 3, e0387. [Google Scholar] [CrossRef]
  67. Zhang, Y.; Xu, C.; Agudelo Higuita, N.I.; Bhattacharya, R.; Chakrabarty, J.H.; Mukherjee, P. Evaluation of I-TAC as a Potential Early Plasma Marker to Differentiate between Critical and Non-Critical COVID-19. Cell Stress 2021, 6, 6–16. [Google Scholar] [CrossRef]
  68. Bi, Q.; Zhu, J.; Zheng, J.; Xu, Q.; Chen, J.; Zhang, L.; Mu, X. Blood Inflammatory Markers and Cytokines in COVID-19 Patients With Bacterial Coinfections. Immun. Inflam. Amp. Dis. 2024, 12, e70105. [Google Scholar] [CrossRef]
  69. Craig, A.; Mai, J.; Cai, S.; Jeyaseelan, S. Neutrophil Recruitment to the Lungs during Bacterial Pneumonia. Infect. Immun. 2009, 77, 568–575. [Google Scholar] [CrossRef]
  70. Skovbjerg, S.; Martner, A.; Hynsjö, L.; Hessle, C.; Olsen, I.; Dewhirst, F.E.; Tham, W.; Wold, A.E. Gram-Positive and Gram-Negative Bacteria Induce Different Patterns of Cytokine Production in Human Mononuclear Cells Irrespective of Tax-onomic Relatedness. J. Interferon Cytokine Res. 2010, 30, 23–32. [Google Scholar] [CrossRef]
  71. Nakada, T.; Russell, J.A.; Boyd, J.H.; Walley, K.R. IL17A Genetic Variation Is Associated with Altered Susceptibility to Gram-Positive Infection and Mortality of Severe Sepsis. Crit. Care 2011, 15, R254. [Google Scholar] [CrossRef]
  72. Kern, W.V.; Heiss, M.; Steinbach, G. Prediction of Gram-Negative Bacteremia in Patients with Cancer and Febrile Neutropenia by Means of Interleukin-8 Levels in Serum: Targeting Empirical Monotherapy versus Combination Therapy. Clin. Infect. Dis. 2001, 32, 832–835. [Google Scholar] [CrossRef] [PubMed]
  73. Larsson, B.M.; Larsson, K.; Malmberg, P.; Palmberg, L. Gram Positive Bacteria Induce IL-6 and IL-8 Production in Human Alveolar Macrophages and Epithelial Cells. Cell. Mol. Neurobiol. 1999, 23, 217–230. [Google Scholar] [CrossRef]
  74. Sorrentino, R.; De Souza, P.M.; Sriskandan, S.; Duffin, C.; Paul-Clark, M.J.; Mitchell, J.A. Pattern Recognition Receptors and Interleukin-8 Mediate Effects of Gram-positive and Gram-negative Bacteria on Lung Epithelial Cell Function. Br. J. Pharmacol. 2008, 154, 864–871. [Google Scholar] [CrossRef] [PubMed]
  75. Chetaille Nézondet, A.-L.; Poubelle, P.E.; Pelletier, M. The Evaluation of Cytokines to Help Establish Diagnosis and Guide Treatment of Autoinflammatory and Autoimmune Diseases. J. Leukoc. Biol. 2020, 108, 647–657. [Google Scholar] [CrossRef]
  76. Guo, W.; Lian, X.; Li, H.; Jiang, L.; Chen, Y.; Shen, P.; Yu, W. Characteristics of Immunocytes and Cytokines in Patients with Bloodstream Infections Caused by Carbapenem-Resistant Klebsiella pneumoniae in China. Infect. Drug Resist. 2024, 17, 719–725. [Google Scholar] [CrossRef]
  77. Ru, Y.; Ding, X.; Luo, Y.; Li, H.; Sun, X.; Zhou, M.; Zhou, Y.; Kuai, L.; Xing, M.; Liu, L.; et al. Adverse Events Associated With Anti-IL-23 Agents: Clinical Evidence and Possible Mechanisms. Front. Immunol. 2021, 12, 670398. [Google Scholar] [CrossRef]
  78. Jones, B.A.; Beamer, M.; Ahmed, S. Fractalkine/CX3CL1: A Potential New Target for Inflammatory Diseases. Mol. Interv. 2010, 10, 263–270. [Google Scholar] [CrossRef]
  79. Surbatovic, M.; Popovic, N.; Vojvodic, D.; Milosevic, I.; Acimovic, G.; Stojicic, M.; Veljovic, M.; Jevdjic, J.; Djordjevic, D.; Radakovic, S. Cytokine Profile in Severe Gram-Positive and Gram-Negative Abdominal Sepsis. Sci. Rep. 2015, 5, 11355. [Google Scholar] [CrossRef]
  80. Liu, Y.; Wu, Y.; Zhang, T.; Chen, J.; Hu, W.; Sun, G.; Zheng, P. Machine Learning Algorithms for the Early Detection of Bloodstream Infection in Children with Osteoarticular Infections. Front. Pediatr. 2024, 12, 1398713. [Google Scholar] [CrossRef]
  81. Murri, R.; De Angelis, G.; Antenucci, L.; Fiori, B.; Rinaldi, R.; Fantoni, M.; Damiani, A.; Patarnello, S.; Sanguinetti, M.; Valentini, V.; et al. A Machine Learning Predictive Model of Bloodstream Infection in Hospitalized Patients. Diagnostics 2024, 14, 445. [Google Scholar] [CrossRef]
  82. Zhang, F.; Wang, H.; Liu, L.; Su, T.; Ji, B. Machine Learning Model for the Prediction of Gram-Positive and Gram-Negative Bacterial Bloodstream Infection Based on Routine Laboratory Parameters. BMC Infect. Dis. 2023, 23, 675. [Google Scholar] [CrossRef] [PubMed]
  83. Lin, X.; Xu, E.; Zhang, T.; Zhu, Q.; Liu, Y.; Tian, Q. Cytokine-Based Nomogram for Discriminating Viral Pneumonia from Mycoplasma pneumoniae Pneumonia in Children. Diagn. Microbiol. Infect. Dis. 2025, 111, 116611. [Google Scholar] [CrossRef]
  84. Cheng, Q.; Zhao, F.; Zhang, B.; Zhang, Y.; Cai, L.; Qiao, B.; Hu, Y.; Sun, C. Prognostic Nomogram Incorporating Cytokines for Overall Survival in Patients with Newly Diagnosed Multiple Myeloma. Int. Immunopharmacol. 2021, 99, 108016. [Google Scholar] [CrossRef] [PubMed]
  85. Zhang, W.; Chen, T.; Chen, H.-J.; Chen, N.; Xing, Z.-X.; Fu, X.-Y. Risk Prediction Model for Distinguishing Gram-Positive from Gram-Negative Bacteremia Based on Age and Cytokine Levels: A Retrospective Study. World J. Clin. Cases 2023, 11, 4833–4842. [Google Scholar] [CrossRef]
  86. Liu, G.; Li, X.; Zhao, W.; Shi, R.; Zhu, Y.; Wang, Z.; Pan, H.; Wang, D. Development and Validation of a Nomogram for Pre-dicting Gram-Negative Bacterial Infections in Patients with Peritoneal Dialysis-Associated Peritonitis. Heliyon 2023, 9, e18551. [Google Scholar] [CrossRef] [PubMed]
  87. Kaplan, R.M.; Chambers, D.A.; Glasgow, R.E. Big Data and Large Sample Size: A Cautionary Note on the Potential for Bias. Clin. Transl. Sci. 2014, 7, 342–346. [Google Scholar] [CrossRef]
  88. Zhan, X.; Xu, Q.; Zheng, Y.; Lu, G.; Gevaert, O. Reliability-Enhanced Data Cleaning in Biomedical Machine Learning Using Inductiveconformal Prediction. PLoS Comput. Biol. 2025, 21, e1012803. [Google Scholar] [CrossRef]
  89. Van Steenkiste, T.; Ruyssinck, J.; De Baets, L.; Decruyenaere, J.; De Turck, F.; Ongenae, F.; Dhaene, T. Accurate Prediction of Blood Culture Outcome in the Intensive Care Unit Using Long Short-Term Memory Neural Networks. Artif. Intell. Med. 2019, 97, 38–43. [Google Scholar] [CrossRef]
  90. Cross, J.L.; Choma, M.A.; Onofrey, J.A. Bias in Medical AI: Implications for Clinical Decision-Making. PLOS Digit. Health 2024, 3, e0000651. [Google Scholar] [CrossRef]
  91. Miller, C.; Portlock, T.; Nyaga, D.M.; O’Sullivan, J.M. A Review of Model Evaluation Metrics for Machine Learning in Genetics and Genomics. Front. Bioinform. 2024, 4, 1457619. [Google Scholar] [CrossRef]
  92. Rockenschaub, P.; Hilbert, A.; Kossen, T.; Elbers, P.; Von Dincklage, F.; Madai, V.I.; Frey, D. The Impact of Multi-Institution Datasets on the Generalizability of Machine Learning Prediction Models in the ICU. Crit. Care Med. 2024, 52, 1710–1721. [Google Scholar] [CrossRef] [PubMed]
  93. Zech, J.R.; Badgeley, M.A.; Liu, M.; Costa, A.B.; Titano, J.J.; Oermann, E.K. Variable Generalization Performance of a Deep Learning Model to Detect Pneumonia in Chest Radiographs: A Cross-Sectional Study. PLoS Med. 2018, 15, e1002683. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Overview of the study. The workflow consists of: (1) ICU COVID-19 patient selection, (2) blood collection, (3) serum extraction, (4) storage at −80 °C, (5) cytokine profiling via a multiplex assay, (6) data processing and cleaning, (7) statistical analysis, (8) univariate and multivariate cytokine analysis, (9) computational generation of cytokine ratios, (10) feature selection using FCBF, (11) machine learning modeling for biomarker discovery, and (12) clinical interpretability assessment.
Figure 1. Overview of the study. The workflow consists of: (1) ICU COVID-19 patient selection, (2) blood collection, (3) serum extraction, (4) storage at −80 °C, (5) cytokine profiling via a multiplex assay, (6) data processing and cleaning, (7) statistical analysis, (8) univariate and multivariate cytokine analysis, (9) computational generation of cytokine ratios, (10) feature selection using FCBF, (11) machine learning modeling for biomarker discovery, and (12) clinical interpretability assessment.
Metabolites 15 00204 g001
Figure 2. Boxplots displaying cytokine levels for the two cytokines with statistically significant differences between BSI and non-BSI groups in ICU COVID-19 patients. All the other cytokines analyzed were non-significant, with their respective p-values listed in the right panel for reference (ns = non-significant; *: p < 0.05; **: p < 0.01).
Figure 2. Boxplots displaying cytokine levels for the two cytokines with statistically significant differences between BSI and non-BSI groups in ICU COVID-19 patients. All the other cytokines analyzed were non-significant, with their respective p-values listed in the right panel for reference (ns = non-significant; *: p < 0.05; **: p < 0.01).
Metabolites 15 00204 g002
Figure 3. t-SNE of (a) 2 ranked cytokines for BSI classification (BSI: red, non-BSI: blue) and (b) 2 ranked cytokines for Gram typing (negative: red, positive: blue). Features were selected using the FCBF scoring method.
Figure 3. t-SNE of (a) 2 ranked cytokines for BSI classification (BSI: red, non-BSI: blue) and (b) 2 ranked cytokines for Gram typing (negative: red, positive: blue). Features were selected using the FCBF scoring method.
Metabolites 15 00204 g003
Figure 4. t-SNE of (a) six ranked cytokine ratios for BSI classification (BSI: red, non-BSI: blue) and (b) five ranked cytokine ratios for Gram typing (negative: red, positive: blue). Features were selected using the FCBF scoring method.
Figure 4. t-SNE of (a) six ranked cytokine ratios for BSI classification (BSI: red, non-BSI: blue) and (b) five ranked cytokine ratios for Gram typing (negative: red, positive: blue). Features were selected using the FCBF scoring method.
Metabolites 15 00204 g004
Figure 5. Nomograms for the ranked cytokine ratios for (a) BSI presence and (b) Gram-negative classifications.
Figure 5. Nomograms for the ranked cytokine ratios for (a) BSI presence and (b) Gram-negative classifications.
Metabolites 15 00204 g005
Table 1. Demographic and clinical characteristics of 45 ICU patients, 22 of whom had bloodstream infections confirmed by a positive hemoculture. The significance level for statistical analysis comparing the two groups was set to α = 0.01 (1%).
Table 1. Demographic and clinical characteristics of 45 ICU patients, 22 of whom had bloodstream infections confirmed by a positive hemoculture. The significance level for statistical analysis comparing the two groups was set to α = 0.01 (1%).
No Bloodstream Infections
(n = 23)
Bloodstream Infections
(n = 22)
p-Value
Age (years), median (IQR)58 (12)62 (22)0.641 #
Gender, n (%)Female5 (0.22)3 (0.14)0.699 +
Male18 (0.78)19 (0.86)
ECMO, n (%)No17 (0.74)16 (0.73)1.000 *
Yes6 (0.26)6 (0.27)
IMV, n (%)No6 (0.26)0 (0.00)0.022 +
Yes17 (0.74)22 (1.00)
Presence of comorbidities, n (%)No2 (0.09)1 (0.05)1.000 +
Yes21 (0.91)21 (0.95)
BMI, median (IQR)29 (8)27 (6)0.716 #
Statistical tests used: # Mann–Whitney U, * Chi-square (χ2), + Fisher’s exact test.
Table 2. Comparison of traditional laboratory markers, cytokines, and simple ratios for bloodstream infections and Gram typing. Each feature is represented by its p-value and the group in which the elevated levels were observed (considering the median).
Table 2. Comparison of traditional laboratory markers, cytokines, and simple ratios for bloodstream infections and Gram typing. Each feature is represented by its p-value and the group in which the elevated levels were observed (considering the median).
FeatureBSIs:
Presence vs. Absence 1
Gram:
Negative vs. Positive 1
p-ValueElevated in 2p-ValueElevated in 2
Traditional Laboratory Markers 3
CRP (mg/dL)0.799 (ns) 4BSIs0.006 (**)Gram+
PCT (ng/mL)0.508 (ns)No BSIs0.953 (ns)Gram−
Lymphocytes (×109/L)0.839 (ns)No BSIs0.014 (*)Gram−
Neutrophil % (NE%)0.383 (ns)No BSIs0.179 (ns)Gram+
Cytokines
IFN-γ0.895 (ns)BSIs0.987 (ns)Gram+
IL-100.764 (ns)No BSIs0.579 (ns)Gram+
IL-17A0.860 (ns)No BSIs0.056 (ns)Gram+
IL-1β0.900 (ns)BSIs0.235 (ns)Gram+
IL-20.209 (ns)No BSIs0.943 (ns)Gram−
IL-60.020 (*)BSIs0.553 (ns)Gram+
IL-80.173 (ns)BSIs0.391 (ns)Gram−
TNF-α0.375 (ns)BSIs1.000 (ns)Gram−
Simple Ratios
IL-2/IL-100.920 (ns)None 50.758 (ns)Gram−
IL-6/IL-100.000 (***)BSIs0.888 (ns)Gram+
IL-10/TNF-α0.244 (ns)No BSIs0.564 (ns)Gram+
1 No BSIs: 23 patients; BSIs: 22 patients; Gram-negative: 7 patients; Gram-positive: 15 patients. 2 when comparing median values between groups (with 2 decimal points). 3 Percentage of missing values for the traditional laboratory markers: BSIs = 12.5%; No BSIs = 82.6%; Gram-negative = 28.6%; Gram-positive = 5%). 4 ns: non-significant (p ≥ 0.05); *: p < 0.05; **: p < 0.01; ***: p < 0.001. 5 When rounding up to 2 decimal places: BSIs = 0.11 (0.110); No BSIs = 0.11 (0.108).
Table 3. Comparison of cytokine levels between BSI and non-BSI ICU COVID-19 patients. The table reports median values with interquartile ranges (IQR), absolute differences, percentage differences, and fold changes to highlight key disparities.
Table 3. Comparison of cytokine levels between BSI and non-BSI ICU COVID-19 patients. The table reports median values with interquartile ranges (IQR), absolute differences, percentage differences, and fold changes to highlight key disparities.
CytokineBSI
Median (IQR)
Non-BSI
Median (IQR)
Abs. Diff.% Diff.Fold Change
ITAC59.42 (76.78)106.36 (121.28)46.93−78.980.56
GM-CSF7.42 (3.91)8.62 (6.49)1.21−13.990.86
Fractalkine15.52 (8.71)16.30 (6.82)0.77−4.750.95
IFN-γ31.01 (16.41)28.77 (21.94)2.247.791.08
IL-1024.92 (59.17)32.99 (18.45)8.06−24.450.76
MIP-3α14.34 (10.69)13.19 (8.04)1.158.721.09
IL-12p705.64 (3.60)4.76 (3.04)0.8818.561.19
IL-132.44 (1.50)3.05 (3.17)0.61−19.900.80
IL-17A25.50 (15.71)29.71 (20.33)4.20−14.150.86
IL-1β1.22 (0.52)1.08 (0.67)0.1412.641.13
IL-23.31 (1.40)3.40 (2.87)0.09−2.640.97
IL-2110.55 (6.43)10.29 (6.71)0.262.491.02
IL-48.31 (7.53)12.75 (7.90)4.44−34.810.65
IL-23232.51 (125.91)211.53 (134.44)20.989.921.10
IL-56.16 (4.01)6.16 (6.44)0.000.021.00
IL-621.50 (192.18)2.78 (10.84)18.71672.657.73
IL-717.41 (5.57)17.60 (7.41)0.19−1.100.99
IL-816.74 (36.74)9.65 (12.54)7.0973.521.74
MIP-1α19.00 (11.97)15.09 (11.92)3.9125.911.26
MIP-1β9.49 (22.53)16.58 (15.05)7.09−42.750.57
TNF-α9.19 (11.55)9.03 (4.26)0.161.831.02
Table 4. Comparison of cytokine levels between Gram-negative and Gram-positive ICU COVID-19 patients. The table reports median values with interquartile ranges (IQR), absolute differences, percentage differences, and fold changes to highlight key disparities.
Table 4. Comparison of cytokine levels between Gram-negative and Gram-positive ICU COVID-19 patients. The table reports median values with interquartile ranges (IQR), absolute differences, percentage differences, and fold changes to highlight key disparities.
CytokineGram−
Median (IQR)
Gram+
Median (IQR)
Abs. Diff.% Diff.Fold Change
ITAC33.73 (39.99)90.97 (75.69)57.24−169.720.37
GM-CSF7.32 (2.37)7.51 (4.01)0.19−2.580.97
Fractalkine23.25 (19.38)13.38 (4.80)9.8642.431.74
IFN-γ28.98 (22.68)33.03 (15.15)4.05−13.960.88
IL-1021.88 (245.68)25.87 (53.37)3.99−18.210.85
MIP-3α9.60 (34.20)14.84 (9.90)5.24−54.510.65
IL-12p704.74 (2.86)5.85 (3.25)1.11−23.440.81
IL-132.29 (1.11)3.33 (1.57)1.05−45.730.69
IL-17A23.93 (8.84)26.60 (15.79)2.67−11.160.90
IL-1β1.05 (0.51)1.27 (0.49)0.21−20.230.83
IL-23.48 (1.66)3.22 (1.25)0.257.281.08
IL-2111.68 (4.47)9.48 (6.21)2.2118.891.23
IL-411.60 (8.22)6.35 (7.46)5.2545.241.83
IL-23223.29 (110.93)249.41 (186.69)26.12−11.700.90
IL-55.59 (4.07)7.21 (6.65)1.62−28.910.78
IL-63.97 (12207.22)21.55 (157.65)17.58−442.750.18
IL-714.47 (4.08)18.26 (6.09)3.79−26.190.79
IL-830.58 (642.58)13.45 (27.51)17.1256.002.27
MIP-1α17.22 (5.03)19.99 (20.05)2.76−16.050.86
MIP-1β8.24 (12.85)10.74 (27.35)2.51−30.450.77
TNF-α13.60 (16.65)8.72 (10.74)4.8935.921.56
Table 5. p-values for the comparison between Gram-negative and Gram-positive ICU COVID-19 patients for the 21 cytokines analyzed.
Table 5. p-values for the comparison between Gram-negative and Gram-positive ICU COVID-19 patients for the 21 cytokines analyzed.
Cytokinep-Value
ITAC0.058 (ns) 1
GM-CSF0.704 (ns)
Fractalkine0.147 (ns)
IFN-γ0.987 (ns)
IL-100.579 (ns)
MIP-3α0.433 (ns)
IL-12p700.182 (ns)
IL-130.797 (ns)
IL-17A0.056 (ns)
IL-1β0.235 (ns)
IL-20.943 (ns)
IL-210.665 (ns)
IL-40.782 (ns)
IL-230.159 (ns)
IL-50.485 (ns)
IL-60.553 (ns)
IL-70.119 (ns)
IL-80.391 (ns)
MIP-1α0.633 (ns)
MIP-1β0.430 (ns)
TNF-α1.000 (ns)
1 ns: non-significant.
Table 6. Performance of five-fold cross-validation for distinguishing between BSI and gram type in ICU COVID-19 patients, using 21 cytokines. The metrics presented correspond to BSI presence and Gram-negative cases, obtained using various machine learning models, before and after applying FCBF for feature selection.
Table 6. Performance of five-fold cross-validation for distinguishing between BSI and gram type in ICU COVID-19 patients, using 21 cytokines. The metrics presented correspond to BSI presence and Gram-negative cases, obtained using various machine learning models, before and after applying FCBF for feature selection.
Target GroupModelAUCSensitivitySpecificity
BSIkNN0.6250.4090.739
Naïve Bayes0.6200.4550.652
Random Forest0.5050.5910.522
SVM0.6900.2730.478
Decision Tree0.5200.5000.565
BSI
Ranked: FCBF
kNN0.5250.4090.739
Naïve Bayes0.5750.6820.522
Random Forest0.6100.5450.522
SVM0.5100.2270.652
Decision Tree0.4300.4090.478
GramkNN0.5170.1430.667
Naïve Bayes0.5330.5710.533
Random Forest0.5670.2860.667
SVM0.6330.0001.000
Decision Tree0.7330.7140.867
Gram
Ranked: FCBF
kNN0.4830.1430.933
Naïve Bayes0.7000.5710.667
Random Forest0.7330.2860.867
SVM0.3000.0001.000
Decision Tree0.7500.7140.800
Table 7. Performance of five-fold cross-validation for distinguishing BSI and Gram type in ICU COVID-19 patients, using 21 cytokines and 19,229 ratios. The metrics presented correspond to BSI presence and Gram-negative cases, obtained using various machine learning models before and after applying FCBF for feature selection.
Table 7. Performance of five-fold cross-validation for distinguishing BSI and Gram type in ICU COVID-19 patients, using 21 cytokines and 19,229 ratios. The metrics presented correspond to BSI presence and Gram-negative cases, obtained using various machine learning models before and after applying FCBF for feature selection.
Target GroupModelAUCSensitivitySpecificity
BSIkNN0.6350.4550.783
Naïve Bayesn.a. 10.5450.652
Random Forest0.6250.5000.696
SVM0.5300.4550.739
Decision Tree0.6750.7270.565
BSI
Ranked: FCBF
kNN0.6650.6360.652
Naïve Bayes0.9700.9090.913
Random Forest0.8950.6820.870
SVM0.5200.5000.652
Decision Tree0.8300.7270.870
GramkNN0.5170.1430.800
Naïve Bayesn.a. 10.7140.133
Random Forest0.6000.2860.800
SVM0.5330.0001.000
Decision Tree0.5670.4290.733
Gram
Ranked: FCBF
kNN0.8000.7140.667
Naïve Bayes0.9831.0000.800
Random Forest0.9000.8570.867
SVM0.6670.0000.867
Decision Tree0.8000.7140.867
1 Some scores could not be computed (n.a.—not available)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Araújo, R.; Ramalhete, L.; Von Rekowski, C.P.; Fonseca, T.A.H.; Calado, C.R.C.; Bento, L. Cytokine-Based Insights into Bloodstream Infections and Bacterial Gram Typing in ICU COVID-19 Patients. Metabolites 2025, 15, 204. https://doi.org/10.3390/metabo15030204

AMA Style

Araújo R, Ramalhete L, Von Rekowski CP, Fonseca TAH, Calado CRC, Bento L. Cytokine-Based Insights into Bloodstream Infections and Bacterial Gram Typing in ICU COVID-19 Patients. Metabolites. 2025; 15(3):204. https://doi.org/10.3390/metabo15030204

Chicago/Turabian Style

Araújo, Rúben, Luís Ramalhete, Cristiana P. Von Rekowski, Tiago A. H. Fonseca, Cecília R. C. Calado, and Luís Bento. 2025. "Cytokine-Based Insights into Bloodstream Infections and Bacterial Gram Typing in ICU COVID-19 Patients" Metabolites 15, no. 3: 204. https://doi.org/10.3390/metabo15030204

APA Style

Araújo, R., Ramalhete, L., Von Rekowski, C. P., Fonseca, T. A. H., Calado, C. R. C., & Bento, L. (2025). Cytokine-Based Insights into Bloodstream Infections and Bacterial Gram Typing in ICU COVID-19 Patients. Metabolites, 15(3), 204. https://doi.org/10.3390/metabo15030204

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop