Next Article in Journal
Macrolides at Clinically-Relevant Concentrations May Induce Biofilm Formation in Macrolide-Resistant Staphylococcus aureus
Next Article in Special Issue
Effects of Perinatal Antibiotic Exposure and Neonatal Gut Microbiota
Previous Article in Journal
Topical Antibiotic Treatment in Dermatology
Previous Article in Special Issue
Epidemiological Analysis of Extended-Spectrum β-Lactamase-Producing Klebsiella pneumoniae Outbreak in a Neonatal Clinic in Poland
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluating the Use of Neonatal Colonization Screening for Empiric Antibiotic Therapy of Sepsis and Pneumonia

1
Division of Neonatology and Pediatric Intensive Care, Department of Pediatrics and Adolescent Medicine, Friedrich-Alexander-University of Erlangen-Nuernberg, Loschgestraße 15, 91054 Erlangen, Germany
2
Division of Allergology, Pulmonology and Mucoviscidosis, Department of Pediatrics and Adolescent Medicine, Friedrich-Alexander University of Erlangen-Nuernberg, Loschgestraße 15, 91054 Erlangen, Germany
3
Institute of Clinical Microbiology, Immunology and Hygiene, University Clinic Erlangen, Wasserturmstraße 3/5, 91054 Erlangen, Germany
4
Institute of Human Genetics University Clinic Erlangen, Friedrich-Alexander University of Erlangen-Nuernberg, 91054 Erlangen, Germany
5
Institute for Medical Informatics, Biometry and Epidemiology (IMBE), Friedrich-Alexander-University Erlangen-Nuernberg, Waldstr. 6, 91054 Erlangen, Germany
*
Author to whom correspondence should be addressed.
Antibiotics 2023, 12(2), 189; https://doi.org/10.3390/antibiotics12020189
Submission received: 25 December 2022 / Revised: 13 January 2023 / Accepted: 14 January 2023 / Published: 17 January 2023
(This article belongs to the Special Issue Tackling Antimicrobial Resistance in Neonatal Infections)

Abstract

:
(1) Background: Since 2013, weekly screening for multidrug-resistant Gram-negative (MDRGN) bacteria has been performed in German neonatal intensive care units (NICU). National guidelines recommend considering these colonization analyses for antibiotic treatment regimens. Our retrospective single center study provides insight into the clinical dichotomy of bacterial colonization and infection rates in neonates. (2) Methods: We analyzed microbiological data of neonates admitted to our tertiary level NICU over nine years. Colonization with MDRGN/Serratia marcescens (SERMA) was compared to microbiological findings in sepsis and pneumonia. (3) Results: We analyzed 917 blood and 1799 tracheal aspirate samples. After applying criteria from the Nosocomial Infection Surveillance for Neonates (NEO-KISS), we included 52 and 55 cases of sepsis and pneumonia, respectively; 19.2% of sepsis patients and 34.5% of pneumonia patients had a prior colonization with MDRGN bacteria or SERMA. In these patients, sepsis was not attributable to MDRGN bacteria yet one SERMA, while in pneumonias, ten MDRGN bacteria and one SERMA were identified. We identified late-onset pneumonia and cesarean section as risk factors for MDRGN/SERMA acquisition. (4) Conclusions: Colonization screening is a useful tool for hygiene surveillance. However, our data suggest that consideration of colonization with MDRGN/SERMA might promote extensive use of last resort antibiotics in neonates.

1. Introduction

Newborns admitted to the neonatal intensive care unit (NICU) are at high risk of nosocomial infections [1]. Previous studies suggested two major reasons for the increased susceptibility to bacterial infection especially in preterm infants with low birth weight, namely the immaturity of the neonatal immune system [2] and the prolonged bacterial exposure associated with long hospitalization, including repeated execution of invasive procedures [3]. Although development of cell-mediated immunity is taking place in the first trimester of pregnancy, neonatal humoral immunity is reliant on transplacental passage of IgG, which starts at gestational week 32. Subsequently, especially preterm neonates below this gestational age show significantly reduced levels of circulating IgG antibodies [4]. In 2013, the German commission for hospital hygiene and prevention of infection (KRINKO) released a recommendation for the protection of neonates, underscoring the severe vulnerability of these patients for colonization and infection by multidrug-resistant Gram-negative (MDRGN) bacteria. Against the background of increasing nosocomial bacterial infection rates [5,6,7,8], it is recommended to consider the implementation of a colonization screening in terms of an anal and pharyngeal swab for all neonates upon admission and weekly thereafter for inpatients on German NICUs depending on their structure and patient volume. The KRINKO screening follows two objectives: First, the early detection of nosocomial transmissions and the consequential implementation of preventive hygiene policies. Second, guidance of medical decision-making regarding empirical or calculated therapy of infections based on prior bacterial colonization in the context of suspected infection (i.e., antibiotic stewardship) [7,9]. However, the role of active surveillance for multidrug-resistant (MDR) bacterial colonization in antibiotic stewardship (ABS) programs awaits final evaluation, with controversial discussion of the potential correlation between colonization with resistant bacteria and infection caused by the very same germs in the literature [10,11,12]. While on the one hand, validation of such coherence might have major implications for ABS in the treatment of infectious diseases [13,14], a lack of correlation on the other hand might imply overtreatment with last resort antibiotics for all colonized neonates [15,16]. We therefore aimed to clarify this dichotomy using retrospective microbiological and medical data from our tertiary NICU located in the Department of Pediatrics and Adolescent Medicine of the Friedrich-Alexander-University of Erlangen-Nuernberg, Germany. In addition, we investigated possible risk factors for acquiring colonization with MDR bacteria and MDR-caused infections. We collected data from all neonatal patients from the introduction of the screening in 2013 until the end of 2021 to answer the following research questions:
RQ1: Is colonization with MDR bacteria a risk factor for MDR sepsis and MDR pneumonia in neonates?
RQ2: What risk factors lead to higher likelihood of acquiring colonization with MDR bacteria and MDR-caused infections?

2. Methods

2.1. Definitions

The KRINKO definition of MDRGN distinguishes bacteria by their in vitro sensitivity against four main classes of antibiotics: (1) acylureidopenicillins, (2) third/fourth generation cephalosporins, (3) carbapenems, and (4) fluoroquinolones. Bacteria which show resistance against three out of the four (four out of the four) antibiotic groups are classified as 3MRGN (4MRGN). Both 3- and 4MRGN are considered as MDR in adults. Due to the restricted applicability of Fluoroquinolones in children, KRINKO introduced the category 2MRGN NeoPaed which consists of bacteria that possess resistance against acylureidopenicillins and third/fourth generation cephalosporins [9]. The weekly colonization screening in our clinic covers bacteria with multidrug resistances such as 2MRGN NeoPaed, 3MRGN, and 4MRGN. Additionally, following the KRINKO recommendation, our screening includes Serratia marcescens (SERMA) which possesses a high risk for nosocomial spread and outbreaks especially in the neonatological field. [9,16,17]. Since we also test high-risk patients for methicillin-resistant Staphylococcus aureus (MRSA) and vancomycin-resistant enterococcus (VRE), we also included these species in our analysis. In the following analysis, we summarized MRSA, VRE, 2MRGN NeoPaed, 3MRGN, and 4MRGN in the category MDR. As infections, we defined sepsis and pneumonia according to the German Neonatal Hospital Infection Surveillance System NEO-KISS criteria (National Reference Center for Nosocomial Infection Surveillance at the Institute for Hygiene and Environmental Medicine Charité—University Medicine Berlin; www.nrz-hygiene.de), as described below.
For a microbiologically confirmed diagnosis of sepsis, a pathogen that is not a coagulase-negative Staphylococcus (CoNS) must be detected in the blood or cerebrospinal fluid and two of the following criteria must be met: fever (>38 °C) or temperature instability or hypothermia (<36.5 °C); tachycardia (>200/min) or new/increased bradycardia (<80/min); prolonged recapillarization time (>2 s); new or increased apneas (>20 s); unexplained metabolic acidosis (BE ≤ 10 mval/L); new onset hyperglycemia (>140 mg/dL); other signs of sepsis. If CoNS was the only pathogen isolated from the blood, two of the criteria just mentioned plus one of the following laboratory parameters must be met: CRP > 2.0 mg/dL or IL6-8 pathologically elevated; platelets < 100/nL; I/T ratio > 0.2; leukocytes < 5/nL. Pneumonia was defined as radiologic finding of new or progressive infiltrates, shadowing, or fluid in the interlobar or pleural space plus worsening of gas exchange with a decrease in oxygen saturation and four of the following criteria: new/increased bradycardia (<80/min) or new/increased tachycardia (>200/min); new/increased tachypnea (>60/min) or new/increased apnea (>20 s); purulent tracheal aspirate; germ from tracheal aspirate; new/increased dyspnea (retractions, nostrils, moans); temperature instability/fever/hypothermia; increased respiratory secretions; CRP > 2.0 mg/dL or interleukin 6–8 pathologically elevated; I/T ratio > 0.2 [18,19].
In our study period from 2013 until 2021, we treated 5988 neonates in our neonatology of which 485 had a very low birth weight (VLBW). We started our analysis by scanning over 26,000 microbiologic culture results from these patients. Whenever a blood culture analysis was performed during that period, it was regarded as a marker for suspected sepsis. Subsequently, the above sepsis criteria were applied to all patients with positive blood cultures (BC). Accordingly, we approached tracheal aspirate (TA) in patients meeting the pneumonia criteria (illustrated in Figure 1 and Figure 2).

2.2. Patients and Setting

In this retrospective analysis, we included data from all neonatal patients treated in our division from 1 January 2013 until 31 December 2021. The following data were recorded for each patient: clinical manifestation of sepsis or pneumonia, date of diagnosis, gestational age, adjusted gestational age, sex, mode of delivery, and results of microbiological examinations. Our clinic is a level 3 perinatal center. The division of neonatology comprises three neonatological wards: A NICU with 14 treatment beds for ventilation, a 16-bed neonatal intermediate care unit for non-ventilated newborns, and a 6-bed neonatal surveillance unit located in vicinity to the delivery room in the obstetrical center of the Department of Gynecology and obstetrics of our University hospital.

2.3. Hygienic Management

Following the KRINKO guideline of 2013, our clinic decided to introduce a colonization screening which includes every neonatal intensive care patient on all of our three neonatal wards. We test all neonates with an estimated stay of at least 12 h upon admission and then weekly by anal and pharyngeal swabs irrespective of their gestational age and birth weight. In addition, all neonates are tested on inpatient admission. In suspicion of an infection or nosocomial transmissions, shortened screening intervals apply. Additionally, a bacteriological screening is taken from tracheal aspirate from all neonatal patients on ventilation after intubation or admission and continued twice weekly. A parents’ questionnaire supports the identification of high-risk patients for MRSA colonization. Whenever there is a positive medical history indicating a high prevalence background such as contact to farm animals, necessity of dialysis, chronic skin lesions, or hospitalization in the past 12 months, we perform a pharyngeal swab test for MRSA. VRE screening is solely performed for neonates with VRE history and for all neonates in case of an infection on the ward. A colour coded alert system assures sufficient hygienic management on the ward: At the time of admission, neonates remain isolated by bed location and are treated as potentially colonized. After receipt of the microbiological screening results (up to 48 h), patients are either isolated in a single room (red category) in case of 3- or 4MRGN or MRSA, remain isolated by bedside in case of 2MRGN NeoPaed (yellow category) or isolation is set aside (green category, negative test results).

2.4. Microbiological Diagnostics

After collection, blood cultures (BC), tracheal aspirates (TA), and pharyngeal and anal swabs were stored at room temperature and transported to the Microbiology Institute six times a day. Specimens taken at night were stored at 4 °C and blood cultures were stored at room temperature until transport the next day.
For MRGN screening, rectal and pharyngeal samples were placed on C3GR agar (Mast Diagnostica GmbH, Reinfeld, Germany) with a ceftriaxone disk and incubated at 37 °C for a minimum of 24 h. For detection of SERMA, samples were applied to an endo agar with a cefazoline disk and incubated at 37 °C for a minimum of 24 h. Blood and tracheal samples underwent standard bacteriological examination, i.e., blood samples were streaked out on sheep blood agar, chocolate agar, and tryptic soy broth (TSB) followed by incubation for five days at 37 °C with 5% CO2. TAs were incubated on sheep blood agar, chocolate agar, and endo agar for at least 48 h at 37 °C with 5% CO2 and tested for all potential pneumonia pathogens. Identification of isolates was performed using the Bruker MALDI Biotyper® (MBT) smart (Bruker Daltonik GmbH, Bremen, Germany). Antimicrobial susceptibility testing was carried out with a VITEK® 2 (bioMérieux GmbH, Bruchsal, Germany).

2.5. Statistical Analysis

The statistical analysis was carried out by the Institute for Medical Informatics, Biometry and Epidemiology (IMBE) of Friedrich-Alexander-University Erlangen-Nürnberg, Germany. The correlation between MDR bacteria and SERMA in anal/pharyngeal swabs and BCs/TAs was determined by using McNemar Test for paired samples corrected by Chi2 continuity correction. We calculated the sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) for MDR bacteria and SERMA for all rectal and pharyngeal swabs and BC/TA pairs in all neonates with sepsis/pneumonia. In case of PPV, for example, we calculated the relation of true positives (MDR bacteria/SERMA isolate found in screening and BC/TA) amongst all MDR bacteria/SERMA isolates in anal and pharyngeal screening. We discriminated between late- and early-onset sepsis/pneumonia (LOS/EOS, LOP/EOP), gestational age at birth, adjusted gestational age, delivery mode, and sex to identify other variables in correlation with MDR bacteria/SERMA in screening and as infectious agents in terms of infection. For significance test we calculated Chi2, or Fisher’s exact test depending on the expected frequencies. We assessed the contingency coefficient, odds ratio, and 95%-confidence interval to describe the strength of correlation. All p-values < 0.05 were considered statistically significant.

3. Results

3.1. Study Selection and Description

The analysis of BCs and sepsis included 917 blood samples of 546 patients (Figure 1). These contained 136 samples (14.8%) with positive results from 117 (21.4%) independent individuals. We excluded specimens of patients that missed a screening (29) or were not from neonates/premature infants (older than 28 days at admission) (9). A total of 59 samples (6.4%) of 52 (9.5%) neonates met the NEO-KISS criteria of sepsis. Seven cases were further excluded because of multiple positive BCs, leading to 52 (5.7%) blood samples of 51 (9.3%) neonates with clinically manifested sepsis. Our study selection for the sepsis study arm is illustrated in Figure 1.
The analysis of TAs and pneumonia included 1799 samples of TA from 610 neonates (Figure 2). These contained 744 (41.4%) with positive results from 318 (52.1%) independent individuals. Analogously to the sepsis arm of our study the following patients were omitted: neonates without performed screening (135), patients older than 28 days of life (87), or with missing data (1). Of the remaining 521 samples, 375 did not fulfil NEO-KISS criteria of pneumonia. We rejected multiple TAs per neonates in line with the treatment information leading to 55 (3.1%) samples of positive TA from 54 (8.9%) neonates. A flowchart of the study selection for the pneumonia study arm is illustrated in Figure 2.

3.2. Correlation between Colonizing and Infecting Bacteria

Of the 52 samples with positive BC and sepsis, 19.2% (n = 10) showed positive microbiological screening results (Figure 3). Of those, 60% (n = 6) were MDR bacteria, while 40% (n = 4) showed SERMA. Of the 6 MDR bacteria positive screening samples, 83.3% (n = 5) were solely found in anal swab and in only one case, there were MDR bacteria also in the pharyngeal swab. All SERMA positive neonates showed both anal and pharyngeal colonization. There was one case of 3MRGN, but no cases of MRSA and VRE in the colonization surveillance. There was not a single case of MDR bacteria positive BC, but one SERMA positive BC. Based on the available numbers, we executed the McNemar Test corrected by continuity correction (p = 0.008). This significant result suggests that bacterial screening has not been useful in predicting sepsis caused by MDR bacteria or SERMA. We calculated the overall sensitivity, specificity, PPV, and NPV of detecting bacteria with special resistances and multidrug resistances in rectal and pharyngeal swab samples compared to those in BC samples. The results were 100% for the overall sensitivity, 82.3% for the specificity, 10% for PPV, and 100% for NPV.
Of the 55 samples of positive TA and pneumonia, 34.5% (n = 19) showed at least one relevant bacterium in colonization screening (Figure 4). In 57.9% (n = 11) of the colonized neonates, we found resistant bacteria in TA. We detected one case of SERMA in TA. We observed 14 cases of 2MRGN NeoPaed, two cases of 3MRGN, one case of MRSA, two cases of SERMA, and no VRE in the colonization surveillance. We isolated six different species of 2MRGN NeoPaed and two of 3 MRGN. Of the 11 cases where MDR bacteria or SERMA were found both in the colonization screening and TA concomitantly, there was only one case with exclusively positive anal swab, two cases with solely positive pharyngeal swab, and eight cases with positive findings in both swabs.
The McNemar test corrected by continuity correction (p = 0.013) showed a significant result. In line with the findings regarding sepsis (see above), these results suggest that colonization screening was not suited to predict pneumonia by MDR bacteria or SERMA. We calculated an overall sensitivity, specificity, PPV, and NPV of detecting MDR bacteria and SERMA in rectal and pharyngeal swab samples compared to TA samples. The results were of 100% for the overall sensitivity, 81.8% for the specificity, 57.8% for PPV, and 100% for NPV.

3.3. Infectious Agents of Sepsis and Pneumonia

Because two different bacteria were identified concomitantly in one BC, we detected 53 different bacterial species in our 52 samples of BCs in total. On this account, percentages given do not add up to 100 percent. In 52 cases of blood culture proven sepsis, we detected in 65.4% (n = 34) of the samples coagulase-negative Staphylococci (CoNS), in 7.7% (n = 4) Enterococcus spp., in 5.8% (n = 3) Escherichia coli, Staphylococcus aureus, and Klebsiella spp., respectively; in 3.9% (n = 2) Streptococcus agalactiae and in 1.9% (n = 1) Bacillus cereus, SERMA, and Enterobacter cloacae. We did not detect cases of sepsis with MRGN, VRE, or MRSA. Among our 52 cases of sepsis there was solely one patient with early-onset sepsis (<72 h after birth) caused by group B Streptococcus.
Because of multiple species in one sample, we found 77 different bacterial species in our 55 samples of TA. In analogy to our sepsis findings, percentages do not subsequently add up to 100 percent. In 25.5% (n = 14) of the patients’ TA, we detected CoNS, in 20.0% (n = 11) saprophytic germs, in 16.4% (n = 9) 2- or 3MRGN, in 14.6% (n = 8) Enterococcus spp. and Klebsiella spp., respectively; and in 9.1% (n = 5) Escherichia coli. As well as the 9 cases of 2/3MRGN, there was one case of MRSA and one case of SERMA detected. In total, MDR bacterial- or SERMA-associated pneumonia accounted for 20.0% (n = 11) of all pneumonia cases. An overview of the bacteria identified in BC and TA is given in Table 1.

3.4. Identification of Risk Factors for Acquiring MDR and SERMA for Patients with Pneumonia

Based on our results so far, we investigated potential risk factors for colonization or infection with MDR bacteria or SERMA. Based on our data in the sepsis study arm, our investigated possible risk factors do not seem to play an important role for acquiring MDR bacteria or SERMA colonization or infection. Hence, we solely listed potential risk factors for neonates with pneumonia in Table 2. We could not detect a significant correlation between gestational age at birth and the acquisition of relevant bacteria (p = 0.501). Likewise, the time of infection adjusted gestational age had no significant correlation (p = 0.296) either.
In contrast, the type of pneumonia in terms of time of infection showed significant influence (p = 0.043). Neonates with late-onset pneumonia (LOP) after the first seven days of life showed an increased susceptibility to MDR bacteria/SERMA compared to patients with early-onset pneumonia (EOP) (OR = 4.80, 95% CI 0.955–24.2). The contingency coefficient (CC = 0.264) displayed a moderate correlation between these two factors. Newborns that were delivered via vaginal birth possessed significantly less colonization with MDR bacteria or SERMA compared to neonates delivered via caesarean section (p = 0.027, OR = 0.181, 95% CI 0.0357–0.917). There is a moderate strength of correlation between delivery mode and colonization (CC = 0.293). In contrast, the patients’ sex showed no statistically significant influence (p = 0.992).

4. Discussion

In this study, we showed that MDR bacteria and SERMA are prevalent nosocomial colonizers in neonates. Among the 52 cases with sepsis, 11.5% (n = 6) showed prior colonization with MDR bacteria and 7.7% (n = 4) with SERMA. Our analysis (McNemar test) shows that positive neonatal microbiological screening results are ineffective in predicting sepsis and pneumonia caused by MDR bacteria or SERMA.
In neonatal sepsis, SERMA was responsible for only a single patient colonized with the bacteria, while no such relation was observed for 2- or 3MRGN colonization. In opposition, neonatal pneumonia seemed to show a more cohesive bacterial pattern of colonization (swabs) and infection (TA), i.e., of the 34.5% colonized patients (30.9% MDR, 3.6% SERMA), concordant TA isolates were found in 57.9% of the cases. Nevertheless, our significant result in McNemar test (similarly to the sepsis study arm) showed that colonization screening is not adequate in predicting pneumonia with MDR or SERMA, although we detected MDR and SERMA in tracheal aspirate in 20.00% of the pneumonia cases and the PPV (57.9%) was higher than in the sepsis arm.
Previous studies in neonates also indicated that MDR bacterial screenings are limited in predicting infections in terms of sepsis. A study from Halle in Germany from 2014 detected a MDR bacterial colonization rate of 4.9%, of which only 3.2% developed into sepsis [20]. Another study from Germany with comparable colonization rates (i.e., 12.7% of 584 screened neonates) showed similar results to our study with 2 of 23 episodes of sepsis caused by 2MRGN and MRSA, respectively, and a total infection frequency of 1.9% (one case of SERMA) [21]. A study from Taiwan found that 35.5% of the analyzed bloodstream infections were caused by gram-negative bacteria (GNB). Of those, 18.6% were MDR bacterial strains [22]. Several studies showed a low overall concordance of colonization germs and invasive infectious agents. A retrospective study of neonates with suspected sepsis in Haiti found 20.6% matching bacteria between rectal and blood isolates and similarly to our study a low PPV and high NPV [23]. A systematic review published in 2018 analyzing the results of 27 studies examined the concordance of rectal/skin swabs and bloodstream infections with respect to GNB. They found 7.9% concordant bloodstream infections with GNB in colonized infants. As a consequence, authors were not able to derive recommendations for general GNB screening [10]. Given low concordance of the colonizing pathogens and infectious agents on the one side and the high colonization rates versus the low numbers of infections with MDR bacteria on the other, it is necessary to question the merit of current screening practice for decision making in antibiotic stewardship and the use of last resort antibiotics. Härtel et. al. (2020) found that weekly colonization screening had no impact on sepsis-related mortality, despite decreasing sepsis rates. Instead, the colonization screening lead to a decline in the use of cefotaxime and increasead application rate of meropenem—a third line antibiotic [24]. Schmeh et al. (2019) confirmed the unnecessary use of last resort antibiotics as a major risk for development of antibiotic resistances, since it cannot be determined with certainty which pathogen was causative when multiple germs occur and the frequency of MDR bacterial infections is generally low [16]. In addition to its undisputed role for clinical hygiene, our data suggest that colonization screening may additionally have some relevance for the choice of antibiotic regimens in neonatal pneumonia. At the latest, if the patient deteriorates after 48 h on initial antibiotic therapy, the germ found in the colonization screening should be included in the antibiotic choice.
As most studies have focused on the association between screening and sepsis, available studies for comparison with our pneumonia study arm is limited. Other researchers examined clusters of infections categorized as healthcare-associated infections (HAI) including respiratory infections, blood stream infections, infections of the urinary tract, meningitis, endocarditis, and many more, which leads to less differentiated information.
A recent study from 2020 examined MDR bacteria as infectious agents of ventilator-associated pneumonia (VAP). They found that 39.2% of VAP episodes were caused by MDR pathogens, which is a rate twice as high compared to ours. The higher resistance rate in this Taiwanese study could be explained by a different susceptibility situation in Taiwan compared to Germany. Additionally, the authors discovered that neonates with MDR bacterial VAP indeed had a higher likelihood in receiving insufficient first line antibiotic therapy, while outcomes were equal to non-MDR bacteria-associated VAPs [25]. This suggests that secondary adjusted antibiotic therapy had no disadvantage in VAPs in this population.
In addition to the concordance of colonization and infectious agents, many studies are primarily concerned with the identification of risk factors for the acquisition of MDR bacteria. We found a significant association between the acquisition of MDR bacteria/SERMA and the two variables late-onset pneumonia (LOP, pneumonia later than 7 days after birth) and cesarean section. Newborns with a LOP showed a significantly higher risk of acquiring colonization with MDR bacteria or SERMA. The odds were increased by a factor of 4.8. This finding fits well with the existing literature. Several studies showed a significant correlation with prolonged hospital stay as a result of prolonged exposure to antimicrobial agents [26,27,28]. In addition to being related to the timing of infection, we found that infants born by cesarean section were significantly more likely to acquire colonization with MDR bacteria or SERMA than newborns delivered vaginally. This might be caused by the exposure to different microbiota during birth. Various studies showed possible reasons for the higher resistance of vaginally delivered infants to pathogens. Vaginally delivered infants adopt bacteria from the maternal vaginal microbiome [29] have higher levels of immune mediators such as cytokines [30], and higher microbial diversity of Actinobacteria as well as Bacteroides and lower abundance of Firmicutes. One explanation for this difference might be the higher likelihood of antibiotic use for mothers that undergo cesarean section [31]. However other studies did not show this correlation [20,28,32]. However, Smith et al. (2010) reported an association between vaginal delivery and bloodstream infection with GNB [14]. In contrast to the results of other studies, we did not find any association of the maturity level of the newborns and the risk of acquiring MDR bacterial colonization or infection [3,20,26,27,28,32]. Haase et al. (2014) detected low gestational age and need for mechanical ventilation as risk factors for colonization with MDR bacteria [20], Sakai et al. (2020) found an association with prematurity, extremely low birth weight, and non-exclusive breastfeeding [32]. Auriti et al. (2003) found a higher risk of contracting hospital acquired infections for infants with a very low birth weight, low gestational age and intravascular catheters [3]. Similar to previous studies by others, we could not find a significant difference of colonization rates between sexes [20,27,28].
Our study was based on a representative neonatal cohort that showed similar distribution of infectious agents as published for late-onset sepsis by the German guidelines for bacterial infections in newborns [19]. The frequencies of pneumonia pathogens were also in a comparable range found in similar studies [25,33,34].
Our study has the following limitations: (1) The study is based on retrospective clinical and microbiological data. The data collection was not established with the intention of conducting this study, thus patient information was partly incomlete, and the sample size was small, although the initial evaluation started with over 26,000 microbiological findings. (2) Single-center study results might not be transferable to other institutions. However, the results point to a direction that has implications for evaluating the utility of colonization screening with respect to antibiotic stewardship. (3) The evaluation of transmission dynamics is limited to the weekly screening. It has not been proven if a shorter screening interval would have led to different results. (4) Only blood culture positive sepsis and tracheal aspirate positive pneumonia were considered as markers for infections. This might have led to an underestimation of the true numbers of sepsis and pneumonia. (5) Due to the physical condition of neonates, blood culture volumes are limited (often just one milliliter of blood). This might have led to a higher probability of false negative results. Moreover, the bacterium found might not have been automatically causative for infection. (6) We used deep tracheal aspirate as an accessible and non-invasive technique to identify germs in case of pneumonia. However, the use of TA can lead to overdiagnosis, and a consequently increased use of antibiotics compared to the more invasive bronchioalveolar lavage (BAL) [35,36]. Due to multiple species in one sample, it cannot be determined with certainty which bacterial strain was causative.

5. Conclusions

Retrospectively, MDR bacteria and SERMA rarely played a role in neonatal sepsis but were found more frequently as infectious agents of pneumonia. Colonization screening as a predictor of infection (sepsis, pneumonia) with MDR bacteria or SERMA had limited relevance for clinical practice because of the low positive predictive value although the PPV for pneumonia patients of 57.9% is significantly higher than a PPV of 10.0% for sepsis patients. However, due to the high negative predictive value, infections with MDR bacteria/SERMA are highly unlikely to occur in the absence of these colonizers. Late-onset pneumonia and cesarean section are independent risk factors for developing a colonization with MDR bacteria/SERMA, while neonatal colonization surveillance supports the implementation of infection control measures and aids the choice of antibiotic treatment regimens in case of infection in these patients. When the colonization screening is negative, there is no need for last resort antibiotics. On the other hand, clinical misinterpretation of microbiological screening data might rather increase the risk for overtreatment with last resort antibiotics. Therefore, neonatal antibiotic stewardship should consider that in our setting, MDR bacteria rarely cause sepsis and that the colonization with MDR bacteria/SERMA might not be an adequate predictor of pneumonia with these colonizers.

Author Contributions

Conceptualization, P.M. and J.L.; methodology, J.H.; validation, S.S.-G., H.R. and P.M.; local antibiotic stewardship/hygiene officer: F.B.F.; formal analysis, T.H. and A.B.; investigation, A.B., A.v.d.D., M.S. and P.M.; resources, H.R. and J.W.; data curation, S.S.-G., J.W. and H.R.; writing—original draft preparation, A.B.; writing—review and editing, F.B.F., H.R., J.H., J.W., G.H. and P.M.; visualization, G.H.; supervision, H.R. and J.W. All authors have read and agreed to the published version of the manuscript.

Funding

We acknowledge financial support by “Deutsche Forschungsgemeinschaft” and Frie-drich-Alexander-University of Erlangen-Nuernberg within the funding programs “Open Access Publication Funding”.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of Friedrich-Alexander-University Erlangen-Nuernberg (application number 22-420 Br).

Informed Consent Statement

Patient consent was waived due to anonymization of all patient records and data prior to analysis.

Data Availability Statement

The datasets analyzed in this study are available from the corresponding author on request. Data acquisition and interpretation were performed by Alisa Bär in partial fulfillment of the requirements for obtaining the degree “Dr. med.” at the Friedrich-Alexander-Universität Erlangen-Nuernberg, Department of Pediatrics and Adolescent Medicine, Germany.

Acknowledgments

The authors thank our neonatal intensive care unit staff for maintaining the database and detailed patient record keeping, which contributed substantially to the accomplishment of this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Goldmann, D.A.; Durbin, W.A.; Freeman, J. Nosocomial infections in a neonatal intensive care unit. J. Infect. Dis. 1981, 144, 449–459. [Google Scholar] [CrossRef] [PubMed]
  2. Friese, K.; Mylonas, I.; Schulze, A. Infektionserkrankungen der Schwangeren und des Neugeborenen; Springer: Berlin/Heidelberg, Germany, 2013; ISBN 978-3-540-78324-4. [Google Scholar]
  3. Auriti, C.; Maccallini, A.; Di Liso, G.; Di Ciommo, V.; Ronchetti, M.P.; Orzalesi, M. Risk factors for nosocomial infections in a neonatal intensive-care unit. J. Hosp. Infect. 2003, 53, 25–30. [Google Scholar] [CrossRef] [PubMed]
  4. Maier, R.F.; Obladen, M. Neugeborenenintensivmedizin; Springer: Berlin/Heidelberg, Germany, 2017; ISBN 978-3-662-53575-2. [Google Scholar]
  5. Mammina, C.; Di Carlo, P.; Cipolla, D.; Giuffrè, M.; Casuccio, A.; Di Gaetano, V.; Plano, M.R.A.; D’Angelo, E.; Titone, L.; Corsello, G. Surveillance of multidrug-resistant gram-negative bacilli in a neonatal intensive care unit: Prominent role of cross transmission. Am. J. Infect. Control 2007, 35, 222–230. [Google Scholar] [CrossRef] [PubMed]
  6. Bizzarro, M.J.; Gallagher, P.G. Antibiotic-resistant organisms in the neonatal intensive care unit. Semin. Perinatol. 2007, 31, 26–32. [Google Scholar] [CrossRef]
  7. Robert-Koch-Institut. Mitteilung der Kommission für Krankenhaushygiene und Infektionsprävention: Ergänzende Empfehlung (2011) zur „Prävention nosokomialer Infektionen bei neonatologischen Intensivpflegepatienten mit einem Geburtsgewicht unter 1.500 g“ (2007). Epidemiol. Bull. 2012, 2, 13–18. [Google Scholar]
  8. Zafar, N.; Wallace, C.M.; Kieffer, P.; Schroeder, P.; Schootman, M.; Hamvas, A. Improving survival of vulnerable infants increases neonatal intensive care unit nosocomial infection rate. Arch. Pediatr. Adolesc. Med. 2001, 155, 1098–1104. [Google Scholar] [CrossRef] [Green Version]
  9. Robert-Koch-Institut. Mitteilung der Kommission für Krankenhaushygiene und Infek tions prävention (KRINKO): Praktische Umsetzung sowie krankenhaushygienische und infektionspräventive Konsequenzen des mikrobiellen Kolonisationsscreenings bei intensivmedizinisch behandelten Früh- und Neugeborenen. Epidemiol. Bull. 2013, 42, 421–436. [Google Scholar]
  10. Folgori, L.; Tersigni, C.; Hsia, Y.; Kortsalioudaki, C.; Heath, P.; Sharland, M.; Bielicki, J. The relationship between Gram-negative colonization and bloodstream infections in neonates: A systematic review and meta-analysis. Clin. Microbiol. Infect. 2018, 24, 251–257. [Google Scholar] [CrossRef] [Green Version]
  11. Seidel, J.; Haller, S.; Eckmanns, T.; Harder, T. Routine screening for colonization by Gram-negative bacteria in neonates at intensive care units for the prediction of sepsis: Systematic review and meta-analysis. J. Hosp. Infect. 2018, 99, 367–380. [Google Scholar] [CrossRef]
  12. Simon, A.; Tenenbaum, T. Surveillance of multidrug-resistant Gram-negative pathogens in high-risk neonates—Does it make a difference? Pediatr. Infect. Dis. J. 2013, 32, 407–409. [Google Scholar] [CrossRef]
  13. Patel, S.J.; Green, N.; Clock, S.A.; Paul, D.A.; Perlman, J.M.; Zaoutis, T.; Ferng, Y.-H.; Alba, L.; Jia, H.; Larson, E.L.; et al. Gram-Negative Bacilli in Infants Hospitalized in The Neonatal Intensive Care Unit. J. Pediatr. Infect. Dis. Soc. 2017, 6, 227–230. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Smith, A.; Saiman, L.; Zhou, J.; Della-Latta, P.; Jia, H.; Graham, P.L. Concordance of Gastrointestinal Tract Colonization and Subsequent Bloodstream Infections With Gram-negative Bacilli in Very Low Birth Weight Infants in the Neonatal Intensive Care Unit. Pediatr. Infect. Dis. J. 2010, 29, 831–835. [Google Scholar] [CrossRef] [PubMed]
  15. Härtel, C.; Hartz, A.; Bahr, L.; Gille, C.; Gortner, L.; Simon, A.; Orlikowsky, T.; Müller, A.; Körner, T.; Henneke, P.; et al. Media Stories on NICU Outbreaks Lead to an Increased Prescription Rate of Third-Line Antibiotics in the Community of Neonatal Care. Infect. Control Hosp. Epidemiol. 2016, 37, 924–930. [Google Scholar] [CrossRef] [PubMed]
  16. Schmeh, I.; Kidszun, A.; Welk, A.; Schwanz, T.; Jansen, B.; Mildenberger, E. Evaluation of microbiological screening in a neonatal intensive care unit to optimize empiric antibiotic use. J. Hosp. Infect. 2019, 101, 362–364. [Google Scholar] [CrossRef]
  17. Hejazi, A.; Falkiner, F.R. Serratia marcescens. J. Med. Microbiol. 1997, 46, 903–912. [Google Scholar] [CrossRef] [Green Version]
  18. Nationales Referenzzentrum (NRZ) für Surveillance von Nosokomialen Infektionen am Institut für Hygiene und Umweltmedizin Charité—Universitätsmedizin Berlin. Protokoll Surveillance von Nosokomialen Infektionen, Multiresistenten Erregern und Antibiotika-Anwendungen bei Frühgeborenen mit Einem Geburtsgewicht unter 1.500g 2020. [Online]. Available online: https://www.nrz-hygiene.de/files/Protokolle/NEO%20Protokolle/NEOKISS_Protokoll_Jun_2020.pdf (accessed on 1 June 2020).
  19. Zemlin, M.; Berger, A.; Franz, A.; Gille, C.; Härtel, C.; Küster, H.; Müller, A.; Pohlandt, F.; Simon, A.; Merz, W. Bakterielle Infektionen bei Neugeborenen. Arb. Der Wiss. Med. Fachgesellschaften E. V. 2021, 223, 130–144. [Google Scholar] [CrossRef]
  20. Haase, R.; Worlitzsch, D.; Schmidt, F.; Kulka, R.; Kekulé, A.S.; Körholz, D. Colonization and infection due to multi-resistant bacteria in neonates: A single center analysis. Klin. Padiatr. 2014, 226, 8–12. [Google Scholar] [CrossRef]
  21. Baier, C.; Pirr, S.; Ziesing, S.; Ebadi, E.; Hansen, G.; Bohnhorst, B.; Bange, F.-C. Prospective surveillance of bacterial colonization and primary sepsis: Findings of a tertiary neonatal intensive and intermediate care unit. J. Hosp. Infect. 2019, 102, 325–331. [Google Scholar] [CrossRef]
  22. Tsai, M.-H.; Chu, S.-M.; Hsu, J.-F.; Lien, R.; Huang, H.-R.; Chiang, M.-C.; Fu, R.-H.; Lee, C.-W.; Huang, Y.-C. Risk factors and outcomes for multidrug-resistant Gram-negative bacteremia in the NICU. Pediatrics 2014, 133, e322–e329. [Google Scholar] [CrossRef] [Green Version]
  23. Lenglet, A.; Schuurmans, J.; Ariti, C.; Borgundvaag, E.; Charles, K.; Badjo, C.; Clezy, K.; Evens, E.; Senat-Delva, R.; Berthet, M.; et al. Rectal screening displays high negative predictive value for bloodstream infection with (ESBL-producing) Gram-negative bacteria in neonates with suspected sepsis in a low-resource setting neonatal care unit. J. Glob. Antimicrob. Resist. 2020, 23, 102–107. [Google Scholar] [CrossRef]
  24. Härtel, C.; Faust, K.; Fortmann, I.; Humberg, A.; Pagel, J.; Haug, C.; Kühl, R.; Bohnhorst, B.; Pirr, S.; Viemann, D.; et al. Sepsis related mortality of extremely low gestational age newborns after the introduction of colonization screening for multi-drug resistant organisms. Antimicrob. Resist. Infect. Control 2020, 9, 144. [Google Scholar] [CrossRef] [PubMed]
  25. Wang, H.-C.; Liao, C.-C.; Chu, S.-M.; Lai, M.-Y.; Huang, H.-R.; Chiang, M.-C.; Fu, R.-H.; Hsu, J.-F.; Tsai, M.-H. Impacts of Multidrug-Resistant Pathogens and Inappropriate Initial Antibiotic Therapy on the Outcomes of Neonates with Ventilator-Associated Pneumonia. Antibiotics 2020, 9, 760. [Google Scholar] [CrossRef] [PubMed]
  26. Pragosa, H.; Marçal, M.; Gonçalves, E.; Martins, F.; Lopo-Tuna, M. Multi-drug-resistant Enterobacteriaceae in a Portuguese neonatal intensive care unit. J. Hosp. Infect. 2017, 96, 130–131. [Google Scholar] [CrossRef] [PubMed]
  27. Singh, N.; Patel, K.M.; Léger, M.-M.; Short, B.; Sprague, B.M.; Kalu, N.; Campos, J.M. Risk of resistant infections with Enterobacteriaceae in hospitalized neonates. Pediatr. Infect. Dis. J. 2002, 21, 1029–1033. [Google Scholar] [CrossRef] [PubMed]
  28. Vijayakanthi, N.; Bahl, D.; Kaur, N.; Maria, A.; Dubey, N.K. Frequency and characteristics of infections caused by extended-spectrum beta-lactamase-producing organisms in neonates: A prospective cohort study. BioMed Res. Int. 2013, 2013, 756209. [Google Scholar] [CrossRef] [Green Version]
  29. Dominguez-Bello, M.G.; Costello, E.K.; Contreras, M.; Magris, M.; Hidalgo, G.; Fierer, N.; Knight, R. Delivery mode shapes the acquisition and structure of the initial microbiota across multiple body habitats in newborns. Proc. Natl. Acad. Sci. USA 2010, 107, 11971–11975. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Malamitsi-Puchner, A.; Protonotariou, E.; Boutsikou, T.; Makrakis, E.; Sarandakou, A.; Creatsas, G. The influence of the mode of delivery on circulating cytokine concentrations in the perinatal period. Early Hum. Dev. 2005, 81, 387–392. [Google Scholar] [CrossRef]
  31. Rutayisire, E.; Huang, K.; Liu, Y.; Tao, F. The mode of delivery affects the diversity and colonization pattern of the gut microbiota during the first year of infants’ life: A systematic review. BMC Gastroenterol. 2016, 16, 86. [Google Scholar] [CrossRef] [Green Version]
  32. Sakai, A.M.; Iensue, T.N.A.N.; Pereira, K.O.; de Souza, N.A.A.; Silva, C.M.; Salvador, M.S.D.A.; Rodrigues, R.; Capobiango, J.D.; Pelisson, M.; Vespero, E.C.; et al. Colonization by multidrug-resistant microorganisms of hospitalized newborns and their mothers in the neonatal unit context. J. Infect. Dev. Ctries. 2020, 14, 765–771. [Google Scholar] [CrossRef]
  33. Hocevar, S.N.; Edwards, J.R.; Horan, T.C.; Morrell, G.C.; Iwamoto, M.; Lessa, F.C. Device-associated infections among neonatal intensive care unit patients: Incidence and associated pathogens reported to the National Healthcare Safety Network, 2006–2008. Infect. Control Hosp. Epidemiol. 2012, 33, 1200–1206. [Google Scholar] [CrossRef]
  34. Tan, B.; Xian-Yang, X.; Zhang, X.; Peng-Zhou, X.; Wang, P.; Xue, J.; Ling-Huang, Y.; Li-Li, Y.; Fu-Qiu, J. Epidemiology of pathogens and drug resistance of ventilator-associated pneumonia in Chinese neonatal intensive care units: A meta-analysis. Am. J. Infect. Control 2014, 42, 902–910. [Google Scholar] [CrossRef] [PubMed]
  35. Cernada, M.; Brugada, M.; Golombek, S.; Vento, M. Ventilator-associated pneumonia in neonatal patients: An update. Neonatology 2014, 105, 98–107. [Google Scholar] [CrossRef] [PubMed]
  36. Morris, A.C.; Kefala, K.; Simpson, A.J.; Wilkinson, T.S.; Everingham, K.; Kerslake, D.; Raby, S.; Laurenson, I.F.; Swann, D.G.; Walsh, T.S. Evaluation of the effect of diagnostic methodology on the reported incidence of ventilator-associated pneumonia. Thorax 2009, 64, 516–522. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Flowchart and study selection of sepsis patients study arm. Legend: BC = blood culture.
Figure 1. Flowchart and study selection of sepsis patients study arm. Legend: BC = blood culture.
Antibiotics 12 00189 g001
Figure 2. Flowchart and study selection of pneumonia patients study arm. Legend: TA = tracheal aspirate.
Figure 2. Flowchart and study selection of pneumonia patients study arm. Legend: TA = tracheal aspirate.
Antibiotics 12 00189 g002
Figure 3. Contingency table with number of patients with MDR bacteria or SERMA in screening and in BC.
Figure 3. Contingency table with number of patients with MDR bacteria or SERMA in screening and in BC.
Antibiotics 12 00189 g003
Figure 4. Contingency table with number of patients with MDR bacteria or SERMA in screening and in TA.
Figure 4. Contingency table with number of patients with MDR bacteria or SERMA in screening and in TA.
Antibiotics 12 00189 g004
Table 1. Bacteriological results of blood cultures in patients with sepsis and tracheal aspirates in pneumonia patients.
Table 1. Bacteriological results of blood cultures in patients with sepsis and tracheal aspirates in pneumonia patients.
SpeciesBlood CultureTracheal Aspirate
n%n%
Gram-negative bacteria
Acinetobacter sp.0011.82
Citrobacter sp.0011.82
Enterobacter cloacae11.9235.45
Escherichia coli35.7759.09
Klebsiella spp.35.77814.55
Pseudomonas spp.0035.45
Serratia marcescens11.9211.82
Serratia liquefaciens0011.82
Stenotrophomonas maltophilia0035.45
Gram-positive bacteria
Saprophytic germs001120.00
CoNS3465.381425.45
Streptococcus agalactiae23.8535.45
Streptococcus pyogenes0011.82
Staphylococcus aureus35.7735.45
Enterococcus spp.47.69814.55
Bacillus cereus11.9200
MDR
2MRGN NeoPäd00712.73
3MRGN0023.64
VRE0000
MRSA0011.82
Other11.9211.82
Total53 77
Legend: Multiple species in one sample resulted in more bacterial species than samples of tracheal aspirate/blood cultures. On this account, percentages do not add up to 100 percent. CoNS = coagulase-negative Staphylococcus; MDR = multidrug-resistant bacteria; VRE = vancomycin-resistant Enterococcus; MRSA = methicillin-resistant Staphylococcus aureus; MRGN = multi-resistant Gram-negative bacteria.
Table 2. Correlation between neonatal risk factors and colonization or infection with MDR bacteria /SERMA in neonates affected by pneumonia.
Table 2. Correlation between neonatal risk factors and colonization or infection with MDR bacteria /SERMA in neonates affected by pneumonia.
Patient GroupnMDR Bacteria or SERMAΧ2pFisher’s Exact TestCCOR95% CI
LowerUpper
Gestational age at birth5519--0.5010.173---
Full-term (≥37 + 0)185
Middle to late preterm (32 + 0 to 36 + 6)126
Early preterm (<32 + 0)258
Adjusted gestational age5519--0.2960.209---
Full-term (≥37 + 0)2510
Middle to late preterm (32 + 0 to 36 + 6)146
Early preterm (< 32 + 0)163
Type of pneumonia55194.100.043 *-0.2644.800.95524.2
EOP ≤ 7 days (ref.)152
LOP > 7 days4017
Delivery mode52194.900.027 *-0.2930.1810.03570.917
Cesarean (ref.) 3717
Vaginal152
Sex55190.020.992-0.00141.010.3303.06
Male2910
Female269
Legend: CC = contingency coefficient; OR = odds ratio; CI = confidence interval; * Result significant on a 95%-confidence interval.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Bär, A.; Schmitt-Grohé, S.; Held, J.; Lubig, J.; Hanslik, G.; Fahlbusch, F.B.; Reutter, H.; Woelfle, J.; van der Donk, A.; Schleier, M.; et al. Evaluating the Use of Neonatal Colonization Screening for Empiric Antibiotic Therapy of Sepsis and Pneumonia. Antibiotics 2023, 12, 189. https://doi.org/10.3390/antibiotics12020189

AMA Style

Bär A, Schmitt-Grohé S, Held J, Lubig J, Hanslik G, Fahlbusch FB, Reutter H, Woelfle J, van der Donk A, Schleier M, et al. Evaluating the Use of Neonatal Colonization Screening for Empiric Antibiotic Therapy of Sepsis and Pneumonia. Antibiotics. 2023; 12(2):189. https://doi.org/10.3390/antibiotics12020189

Chicago/Turabian Style

Bär, Alisa, Sabina Schmitt-Grohé, Jürgen Held, Julia Lubig, Gregor Hanslik, Fabian B. Fahlbusch, Heiko Reutter, Joachim Woelfle, Adriana van der Donk, Maria Schleier, and et al. 2023. "Evaluating the Use of Neonatal Colonization Screening for Empiric Antibiotic Therapy of Sepsis and Pneumonia" Antibiotics 12, no. 2: 189. https://doi.org/10.3390/antibiotics12020189

APA Style

Bär, A., Schmitt-Grohé, S., Held, J., Lubig, J., Hanslik, G., Fahlbusch, F. B., Reutter, H., Woelfle, J., van der Donk, A., Schleier, M., Hepp, T., & Morhart, P. (2023). Evaluating the Use of Neonatal Colonization Screening for Empiric Antibiotic Therapy of Sepsis and Pneumonia. Antibiotics, 12(2), 189. https://doi.org/10.3390/antibiotics12020189

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop