Next Article in Journal
Enzyme-Linked Immunosorbent Assay: An Adaptable Methodology to Study SARS-CoV-2 Humoral and Cellular Immune Responses
Next Article in Special Issue
Risk Factors for Mortality in Cardiac Implantable Electronic Device (CIED) Infections: A Systematic Review and Meta-Analysis
Previous Article in Journal
Comprehensive Characterization of Human Lung Large Cell Carcinoma Identifies Transcriptomic Signatures with Potential Implications in Response to Immunotherapy
Previous Article in Special Issue
Impact of an In-Hospital Endocarditis Team and a State-Wide Endocarditis Network on Perioperative Outcomes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Unreliability of Clinical Prediction Rules to Exclude without Echocardiography Infective Endocarditis in Staphylococcus aureus Bacteremia

by
Jorge Calderón-Parra
1,2,*,
Itziar Diego-Yagüe
1,
Beatriz Santamarina-Alcantud
3,
Susana Mingo-Santos
4,
Alberto Mora-Vargas
1,
José Manuel Vázquez-Comendador
1,
Ana Fernández-Cruz
1,2,
Elena Muñez-Rubio
1,2,
Andrea Gutiérrez-Villanueva
1,
Isabel Sánchez-Romero
3 and
Antonio Ramos-Martínez
1,2
1
Infectious Diseases Unit, Service of Internal Medicine, Hospital Universitario Puerta de Hierro, 28222 Majadahonda, Spain
2
Investigational Institute Puerta de Hierro-Segovia de Arana (IDIPHSA), 28222 Majadahonda, Spain
3
Microbiology Service, Hospital Universitario Puerta de Hierro, 28222 Majadahonda, Spain
4
Cardiology Department, Hospital Universitario Puerta de Hierro, 28222 Majadahonda, Spain
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2022, 11(6), 1502; https://doi.org/10.3390/jcm11061502
Submission received: 15 January 2022 / Revised: 6 March 2022 / Accepted: 7 March 2022 / Published: 9 March 2022
(This article belongs to the Special Issue Infections, Complications and Management of Endocarditis)

Abstract

:
Background: It is unclear whether the use of clinical prediction rules is sufficient to rule out infective endocarditis (IE) in patients with Staphylococcus aureus bacteremia (SAB) without an echocardiogram evaluation, either transthoracic (TTE) and/or transesophageal (TEE). Our primary purpose was to test the usefulness of PREDICT, POSITIVE, and VIRSTA scores to rule out IE without echocardiography. Our secondary purpose was to evaluate whether not performing an echocardiogram evaluation is associated with higher mortality. Methods: We conducted a unicentric retrospective cohort including all patients with a first SAB episode from January 2015 to December 2020. IE was defined according to modified Duke criteria. We predefined threshold cutoff points to consider that IE was ruled out by means of the mentioned scores. To assess 30-day mortality, we used a multivariable regression model considering performing an echocardiogram as covariate. Results: Out of 404 patients, IE was diagnosed in 50 (12.4%). Prevalence of IE within patients with negative PREDICT, POSITIVE, and VIRSTA scores was: 3.6% (95% CI 0.1–6.9%), 4.9% (95% CI 2.2–7.7%), and 2.2% (95% CI 0.2–4.3%), respectively. Patients with negative VIRSTA and negative TTE had an IE prevalence of 0.9% (95% CI 0–2.8%). Performing an echocardiogram was independently associated with lower 30-day mortality (OR 0.24 95% CI 0.10–0.54, p = 0.001). Conclusion: PREDICT and POSITIVE scores were not sufficient to rule out IE without TEE. In patients with negative VIRSTA score, it was doubtful if IE could be discarded with a negative TTE. Not performing an echocardiogram was associated with worse outcomes, which might be related to presence of occult IE. Further studies are needed to assess the usefulness of clinical prediction rules in avoiding echocardiographic evaluation in SAB patients.

1. Introduction

Staphylococcus aureus (SA) bacteremia (SAB) is one of the most frequent causes of positive blood cultures (BC) and has a high mortality [1,2]. One of the most serious complications in patients with SAB is the development of infective endocarditis (IE), which worsens the prognosis [2,3]. IE in patients with SAB can occur in the absence of risk factors and with structurally normal heart valves [4].
The diagnosis of IE in patients with SAB is of vital importance because it modifies patient management. In comparison with what is recommended in other forms of SAB [5,6,7], both European [8] and American [9] IE guidelines recommend higher antibiotic doses (i.e., 12 gr/day of cloxacillin in IE versus 6 gr/day in other SAB) and longer courses (4–6 weeks for native valve IE and 6 or more weeks for prosthetic valve IE versus 2–4 weeks in other SAB). Furthermore, the addition of rifampicin and gentamicin in prosthetic valve IE is recommended by both European and American guidelines [8,9] and not recommended in other SAB. Finally, both sets of guidelines recommend cardiac surgery in case of persistent bacteremia and other complications. European guidelines even consider surgery for all SA prosthetic valve IE [8]. It has been demonstrated that approximately half of SA IE has surgical indication [3,10,11], the majority of whom have an urgent or early surgery indication. Implementation of these measures has a positive impact on prognosis of patients with IE, and this is only possible if the correct and early diagnosis is reached. Accordingly, some authors have estimated that not reaching a diagnosis of IE in patients with SAB conveys a 15–20% increase in mortality [12]. Therefore, systematic echocardiography has been classically recommended, with transesophageal echocardiography (TEE) being preferred to transthoracic echocardiography (TTE). This recommendation appears in the current guidelines [7] with a grade of evidence A-II.
This increased mortality should be weighed against the risks induced by routine TEE. Some studies have shown that serious complications of the performance of TEE is around 0.1% [13,14,15]. However, these studies are old and generally limited to special risk situation, such as esophageal varices [15] or thrombocytopenia [16]. The rate of serious complications in other scenarios is probably lower. Therefore, the estimated IE risk should be low to exclude the use of TEE [12,17].
Consequently, there have been several attempts to define subsets of patients with SAB at low risk for IE, who could be safely managed omitting the performance of TEE. Recently, three clinical prediction scores have been published, PREDICT [18], VIRSTA [19], and POSITIVE [20]. These scores can identify patients at low risk of IE in which TEE could be deferred. To date, the scarce validation studies available have yielded controversial results regarding their usefulness to exclude IE without TEE performance [21,22,23]. Moreover, all these studies have an important limitation: the low rate of echocardiography assessment, especially TEE, in groups classified as low-risk. It has been shown that the proportion of IE diagnosed increases with the number of patients with SAB who receive echocardiographic assessment [24,25,26]. Hence, given that in the development and validation studies of the scores, the majority of low-risk patients did not undergo TEE, it is likely that some patients had occult IE. This underdiagnosis could have influenced the score accuracy and, as stated above, the prognosis of SAB in mentioned studies.
Despite these controversial results and limitations, some authors recommend forgoing echocardiographic evaluation (even TTE) in patients with no identifiable risk factor [27,28]. Furthermore, a recent scenario-based survey showed that approximately 15–20% of experts would recommend not performing TTE in patients with negative VIRSTA score [29].
Therefore, our primary objective was to evaluate the PREDICT, VIRSTA, and POSITIVE scores, and to test their usefulness in safely ruling out IE without the need for TEE or TTE. The secondary objective was to determine, in patients without IE, the effect of withholding echocardiographic assessment on SAB mortality, in particular in those identified as low risk for IE, considering that missing an IE diagnosis could potentially cause an excess mortality.

2. Materials and Methods

We conducted a retrospective single-center study from January 2015 to December 2020. Our center is a third-level university hospital with 613 beds in Madrid and a target population of 550,000 inhabitants. At our setting, we attend approximately 60 IE episodes per year, more frequently causes by Streptococcus spp. and SA, followed by coagulase-negative staphylococci, Enterococcus spp., and Gram-negative bacilli [30].
Through a microbiology database, we identified all patients older than 18 years with a first (index) BC positive for SA during the study period. Patients with previous episodes of SAB were excluded. Index and follow-up BCs were obtained at discretion of the attending physician. BC were processed using the BD BACTEC FX system (Becton Dickinson, Sparks, MD, USA). When BC were positive, the strain was identified by MALDI-TOF (Bruker DaltonicTM). All systems were applied according to the manufacturer’s instructions.
Data were collected retrospectively from the electronic medical record, including demographic, comorbidities, clinical, microbiological, echocardiographic, and outcome data.
The study was approved by the hospital ethics committee. Since this was a retrospective, noninterventional study and only required collection of previously generated and anonymized data, informed consent was not required.

2.1. Definitions

IE was defined according to modified Duke criteria for definite IE [8]. Bacteremia was considered persistent when follow-up BC were positive at least 48 h after the extraction of the index BC despite appropriate antibiotic therapy, accordingly to the scores development studies definition [18,19,20]. Complicated bacteremia was defined according to current guidelines [7]. Primary bacteremia was defined as that in which the original source could not be determined. Sepsis and septic shock were defined according to current guidelines [31]. Relapse was defined as the appearance of a new SAB at least 15 days after negative follow-up BC or 30 days after the extraction of the index BCs and initial clinical resolution in the absence of follow-up BCs. PREDICT, POSITIVE, and VIRSTA evaluated items and cutoff point are defined previously [18,19,20] and summarized in Supplementary Table S1.

2.2. Predefined Ruling Out IE Thresholds

IE was considered ruled out when the risk of IE was low enough for the patient not to benefit from echocardiographic assessment. In defining cutoff points for this low IE risk, we considered recent publications that estimate the risk of IE beyond which a patient does benefit from such assessment [12,17]. We also considered the usefulness of the negative likelihood ratio (NLR) to predict this risk, as previously reported [32]. In accordance with the aforementioned studies, we predefined the following cutoff points: 1—If the risk of IE was less than 1% and the NLR was less than 0.05, IE would be considered ruled out without the need for any echocardiographic assessment; 2—If the risk of IE was between 1–2% and the NLR was less than 0.10, IE would be considered ruled out with the use of TTE without TEE. 3—If the risk of IE was between 2–5% and the NLR was less than 0.20, it would be considered uncertain if IE may possibly be ruled out with a negative TTE without performing TEE. 4—If the risk of IE was greater than 5% or the NLR was greater than 0.20, TEE would be considered necessary to rule out IE. Additionally, we considered that if the prevalence of endocarditis in low-risk patients with negative TTE was higher than 1.0%, these patients would benefit from TEE, in accordance with other authors [8].

2.3. Primary and Secondary Objectives

Our primary purpose was to assess the prevalence of IE in patients identified as low risk by means of PREDICT, VIRSTA, and POSITIVE score, as well as determine the NLR of these scores. Our secondary objective was to evaluate the association between not performing an echocardiogram and 30-day mortality.

2.4. Statistical Analysis

Quantitative variables are presented as median and interquartile range (IQR) and qualitative variables are presented as percentages and absolute values.
For the primary objective, the PREDICT, VIRSTA, and POSITIVE scores were validated by calculating their sensitivity, specificity, likelihood ratios, predictive values, and their area under the receiving operating curve (AUC). The percentage of patients identified as low-risk by these scores and who finally had IE is provided, including its 95% confidence interval (CI). Sensitivity analyses were performed including different populations according to whether different echocardiogram modalities were performed. A score was considered valid to rule out IE, with or without ETT, when the percentage of IE in patients identified as low-risk and the score’s NLR were below the mentioned cutoff points.
For the secondary objective, patients with IE diagnosed were excluded. In order to mitigate survivor bias, we excluded those patients who died within 48 h of index BC extraction. Univariate analysis of 30-day mortality was performed using chi-square for qualitative variables (or Fisher exact test) and Mann–Whitney U for quantitative variables. Multivariate logistic regression models were developed, including echocardiography assessment (TTE, TEE, or either) and those clinically relevant variables identified as statistically significant in the univariate analysis. Bilateral p-values of less than 0.05 were considered statistically significant. All statistical analyses were performed using SPSS version 25 statistical software (SPSS Inc., IBM, Chicago, IL, USA).

3. Results

During the study period, 404 patients with first episodes of SAB were identified. TTE was performed in 62.3% (250) and TEE in 32.2% (128). Fifty (50) patients (12.4%) met modified Duke criteria for definite IE. Fourteen (14) fulfilled pathological Duke criteria. All 50 patients fulfilled clinical Duke criteria for definite IE. All IE cases fulfilled the microbiological major criteria (isolation of SA in two or more blood cultures), and 46 (92.0%) fulfilled cardiac image major criteria; 33 of them with vegetation visualized in TEE, 9 with vegetation visualized in TTE and TEE not performed, and 4 of them with a positive positron emission tomography–computed tomography (3 with negative TEE and 1 with no TEE performed). Of the 4 patients who did not meet the cardiac image criteria, 2 had pathologic definite IE after cardiac surgery and the other 2 met clinical Duke criteria because they had 3 minor criteria and did not undergo cardiac surgery. None of the non-IE case fulfilled the cardiac image criteria. Accordingly, sensitivity and specificity of fulfilling the two major Duke criteria were 92.0% and 100%, respectively, with an AUC of 0.971 (95% CI 0.94–1.00) (Figure 1).
Baseline characteristics, clinical, microbiological, imaging, and outcome are summarized in Table 1.

3.1. PREDICT Score (Day 5 Model) Evaluation

Using the PREDICT score, 33.7% of patients (137/404) were identified as low risk. Of these, 3.6% had IE (Table 2), with a 95% CI exceeding 5% (0.1–6.9%). The validation of the score is shown in Table 3 and Figure 1. PREDICT score had a NLR of 0.27. According to the predefined cutoff points, employing this score would not be sufficient to safely rule out IE without TEE.
Table 4 shows sensitivity analyses with the percentage of IE in patients with negative PREDICT score in different population according to echocardiogram evaluation. Of the low-risk patients with a negative TTE, 3.4% (3/89) were eventually diagnosed with IE. No alternative cutoff point substantially improved the accuracy of PREDICT score (Supplementary Table S2).

3.2. POSITIVE Score Evaluation

Using the POSITIVE score, 60.3% of patients (245/404) were identified as low-risk. Of these, 4.9% had IE (Table 2), with a 95% CI exceeding 5% (2.2–7.7%). The validation of the score is shown in Table 3 and Figure 1. POSITIVE score had a NLR of 0.37. According to the predefined cutoff points, using the POSITIVE score would not be sufficient to rule out IE without a TEE.
Table 4 shows sensitivity analyses with the percentage of IE in patients with negative POSITIVE score in different population according to echocardiogram evaluation. Of the low-risk patients with a negative TTE, 2.8% (4/141) were diagnosed with IE. No alternative cutoff point substantially improved the accuracy of the POSITIVE score (Supplementary Table S2).

3.3. VIRSTA Score Evaluation

Using the VIRSTA score, 45.6% of patients (185/404) were identified as low-risk. Of these, 2.2% had IE (Table 2), with a 95% CI not exceeding 5% (2.2–4.3%). The validation of the score is shown in Table 3 and Figure 1. VIRSTA score had a NLR of 0.16. According to the predefined cutoff points, it would be uncertain if using the VIRSTA score in conjunction with a negative TTE would allow IE to be safely ruled out without a TEE.
Table 4 shows sensitivity analyses with the percentage of IE in patients with negative VIRSTA score in different population according to echocardiogram evaluation. Of the low-risk patients with a negative TTE, 0.9% (1/103) were diagnosed with IE. No alternative cutoff point substantially improved the accuracy of VIRSA score (Supplementary Table S2).
Supplementary Table S3 shows the patient-level data for SAB episodes identified as low-risk by the VIRSTA score and finally diagnosed as IE. Only one patient had an identifiable risk factor (community-acquired bacteremia).

3.4. Echocardiographic Assessment and 30-Day Mortality

After excluding patients diagnosed with IE and those who died within 48 h after index BC extraction, performing an echocardiographic assessment was independently associated with lower 30-day mortality in a multivariate logistic regression model, including adjustment for VIRSTA score (OR 0.24 95% CI 0.10–0.54). The model is shown in Table 5. Univariate analysis for the selection of variables included is shown in Supplementary Table S4.
Thirty-day mortality in patients classified as low-risk by VIRSTA score was lower if they had undergone echocardiographic evaluation (5.1% vs. 15.7%, p = 0.031).

4. Discussion

In our study, we evaluated whether the application of different scores for predicting IE risk in patients with SAB, with or without TTE, could safely rule out IE without TEE. Our main conclusion is that neither the PREDICT nor the POSITIVE scores would be sufficient to rule out IE without TEE, even with negative TTE. It was uncertain whether a negative VIRSTA score together with a negative TTE could allow to rule out IE without the need for TEE.
The PREDICT score was the first to be published [18]. Its high negative predictive value was ratified in a validation study performed by the same group [33]. However, other authors have found that this score does not identify low-risk patients with sufficient accuracy [20,22,23]. These results are in line with ours. It should be noted that PREDICT score does not include among its variables an important set of risk factors for IE (such as prosthetic heart valve), which could reduce its sensitivity [34]. In summary, the application of the PREDICT score to avoid performance of TEE in SAB should not be recommended.
The POSITIVE score [20] is largely based on the shorter time to positivity of BC in the case of IE. In our study, as well as in other previous work [35], despite being a risk factor for IE, the association of time to positivity with IE was not as strong as that presented by the POSITIVE score authors. In line with our findings, a recent study [23] also failed to validate this score. In summary, this score does not identify patients at low-risk with enough precision to avoid performing a TEE, so that it should not be recommended for this purpose.
The VIRSTA score [19] incorporates the largest number of variables as compared to the previous score. Consequently, some studies have shown a higher sensitivity [22,23]. Hence, a recent survey showed that 15–20% of experts would recommend not performing TTE, nor TEE, evaluation in patients identified as low-risk with this score. Yet, in our data, the VIRSTA score was not sufficient to rule out IE without performing an echocardiogram evaluation (incidence of IE in low-risk patients 2.2%, with NLR 0.16), and it was doubtful if a negative VIRSTA score plus a good-quality negative TTE would be able to rule out IE without performing a TEE. It should be noted that most of the patients eventually diagnosed with IE that had been identified as low-risk by the VIRSTA score did not have any identifiable risk factors that would have raised IE suspicion. Ruling out IE in patients with negative VIRSTA and a negative TTE would allow to avoid TEE in approximately half of patients with SAB [19,22,23]. However, well-designed studies are needed to confirm the usefulness of this approach.
A potential restriction when applying these scores is that both their development and validation studies have been performed in cohorts without universal echocardiographic assessment, and only a small proportion of patients have undergone TEE. Several authors have demonstrated that carrying out an echocardiogram in a larger proportion of patients implies a higher rate of IE diagnoses [24,25,26,36,37]. It has even been proposed that performing an echocardiogram in these patients may be associated with lower mortality [38]. In our study, we observed an increased 30-day mortality among patients with SAB who did not undergo an echocardiogram. We even found a higher mortality among patients identified as low-risk for IE who had not undergo echocardiographic evaluation. The fact that the association persists after adjusting for multiple variables, including comorbidity and severity of the bacteremia, supports the likelihood that this worse outcome was caused by the presence of undiagnosed occult IE, at least partially. Therefore, we decidedly believe that prospective studies validating these scores in a SAB cohort with systematic TTE and TEE is mandatory before assuming that they allow to avoid unnecessary echocardiography in low-risk patients.
Our study has some limitations. First, as a single-center retrospective study, it presents the limitations of external validity that this entails. However, our population is comparable to that described in recent cohorts [39]. Second, our predefined cutoff points are not prospectively validated and are based on scarce evidence. Nevertheless, both the IE risk percentages selected and the use of NLR have previously been proposed and accepted by several authors [12,17,21,29,32,37]. Third, we cannot exclude that the higher 30-day mortality found in patients with no echocardiogram is caused to uncontrolled confounding variables. However, the fact that this association persist after adjusting for several factors increases the likelihood that this worse outcome is ascribable, at least partially, to an undiagnosed IE. Finally, as mentioned, not all patients underwent echocardiography, and the percentage of patients lacking an echocardiogram was higher in low-risk patients. Of note, the majority of patients without IE did not undergo TTE or TEE. This absence of an echocardiogram, common in other studies as well, prevents the exclusion of occult IE in some of these patients, a fact that may limit the accuracy of the scores. Nevertheless, our paper adds valuable information to existing literature and provides a base for future research.

5. Conclusions

According to our data, none of the evaluated clinical prediction scores can replace echocardiographic evaluation, as part of the major Duke criteria, for ruling out IE. Neither the PREDICT nor the POSITIVE score were sufficient to exclude IE without concurrent TEE. In patients with negative VIRSTA score, it was uncertain whether IE could be discarded only with a good-quality negative TTE. Moreover, we found an association between not performing echocardiographic assessment and an increased 30-day mortality, even in patients at low risk for IE, which could be related to the presence of occult IE. Hence, prospective well-designed studies with systematic performance of TTE and TEE are needed to verify whether these tests can be safely avoided in any subgroup of patients.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm11061502/s1, Table S1: Items evaluated by PREDICT (5-day model), POSITIVE and VIRSTA scores. Table S2: Evaluation of alternative cut-off points of different clinical prediction rules to identify IE among SAB patients. Table S3: Individual characteristics of patients identified as low risk of IE by means of VIRSTA score but who finally were diagnosed of IE. Table S4: Univariate analysis of 30-day mortality in patients with no diagnosed with infective endocarditis and who survived the first 48 hours after the index blood culture extraction.

Author Contributions

Conceptualization, J.C.-P. and A.R.-M.; data curation, J.C.-P., I.D.-Y., B.S.-A., A.M.-V. and J.M.V.-C.; formal analysis, J.C.-P. and I.D.-Y.; investigation, J.C.-P., B.S.-A., A.M.-V. and J.M.V.-C.; methodology, J.C.-P.; project administration, J.C.-P. and A.R.-M.; software, J.C.-P.; supervision, S.M.-S., A.F.-C., E.M.-R. and A.R.-M.; validation, J.C.-P., A.F.-C. and A.R.-M.; writing—original draft, J.C.-P. and I.D.-Y.; writing—review and editing, J.C.-P., I.D.-Y., S.M.-S., A.F.-C., E.M.-R., A.G.-V., I.S.-R. and A.R.-M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board (or Ethics Committee) of Hospital Puerta de Hierro (protocol code PI 191/21).

Informed Consent Statement

Since this was a retrospective, noninterventional study and only required collection of previously generated and anonymized data, informed consent was not waived.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kuehl, R.; Morata, L.; Boeing, C.; Subirana, I.; Seifert, H.; Rieg, S.; Kern, W.V.; Kim, H.B.; Kim, E.S.; Liao, C.H.; et al. Defining persistent Staphylococcus aureus bacteraemia: Secondary analysis of a prospective cohort study. Lancet Infect. Dis. 2020, 20, 1409–1417. [Google Scholar] [CrossRef]
  2. Le Moing, V.; Alla, F.; Doco-Lecompte, T.; Delahaye, F.; Piroth, L.; Chirouze, C.; Tattevin, P.; Lavigne, J.-P.; Erpelding, M.-L.; Hoen, B.; et al. Staphylococcus aureus Bloodstream Infection and Endocarditis—A Prospective Cohort Study. PLoS ONE 2015, 10, e0127385. [Google Scholar]
  3. Hidalgo-Tenorio, C.; Gálvez, J.; Martínez-Marcos, F.J.; Plata-Ciezar, A.; De La Torre-Lima, J.; López-Cortés, L.E.; Noureddine, M.; Reguera, J.M.; Vinuesa, D.; García, M.V.; et al. Clinical and prognostic differences between methicillin-resistant and methicillin-susceptible Staphylococcus aureus infective endocarditis. BMC Infect. Dis. 2020, 20, 160. [Google Scholar] [CrossRef]
  4. Hsu, R.-B. Risk Factors for Nosocomial Infective Endocarditis in Patients with Methicillin-Resistant Staphylococcus Aureus Bacteremia. Infect. Control Hosp. Epidemiol. 2005, 26, 654–657. Available online: https://www.cambridge.org/core/product/identifier/S0899823X00198605/type/journal_article (accessed on 13 October 2021). [CrossRef]
  5. Mensa, J.; Soriano, A.; Llinares, P.; Barberán, J.; Montejo, M.; Salavert, M.; Alvarez-Rocha, L.; Maseda, E.; Moreno, A.; Pasquau, J.; et al. Guía de tratamiento antimicrobiano de la infección por Staphylococcus aureus. Rev. Esp. Quim. Publ. Soc. Esp. Quim. 2013, 26 (Suppl. 1), 1–84. [Google Scholar]
  6. Gudiol, F.; Aguado, J.M.; Almirante, B.; Bouza, E.; Cercenado, E.; Domínguez, M.Á.; Gasch, O.; Lora-Tamayo, J.; Miró, J.M.; Palomar, M.; et al. Diagnosis and treatment of bacteremia and endocarditis due to Staphylococcus aureus. A clinical guideline from the Spanish Society of Clinical Microbiology and Infectious Diseases (SEIMC). Enferm. Infecc. Microbiol. Clin. 2015, 33, 625.e1–625.e23. [Google Scholar] [CrossRef]
  7. Liu, C.; Bayer, A.; Cosgrove, S.E.; Daum, R.S.; Fridkin, S.K.; Gorwitz, R.J.; Kaplan, S.L.; Karchmer, A.W.; Levine, D.P.; Murray, B.E.; et al. Clinical Practice Guidelines by the Infectious Diseases Society of America for the Treatment of Methicillin-Resistant Staphylococcus aureus Infections in Adults and Children. Clin. Infect. Dis. 2011, 52, e18–e55. Available online: https://academic.oup.com/cid/article/52/3/e18/306145 (accessed on 13 October 2021). [CrossRef]
  8. Habib, G.; Lancellotti, P.; Antunes, M.J.; Bongiorni, M.G.; Casalta, J.P.; Del Zotti, F.; Dulgheru, R.; El Khoury, G.; Erba, P.A.; Iung, B.; et al. 2015 ESC Guidelines for the management of infective endocarditis: The Task Force for the Management of Infective Endocarditis of the European Society of Cardiology (ESC)Endorsed by: European Association for Cardio-Thoracic Surgery (EACTS), the European Association of Nuclear Medicine (EANM). Eur. Heart J. 2015, 36, 3075–3128. Available online: https://academic.oup.com/eurheartj/article-lookup/doi/10.1093/eurheartj/ehv319 (accessed on 20 September 2021).
  9. Baddour, L.M.; Wilson, W.R.; Bayer, A.S.; Fowler Jr, V.G.; Tleyjeh, I.M.; Rybak, M.J.; Barsic, B.; Lockhart, P.B.; Gewitz, M.H.; Levison, M.E.; et al. Infective Endocarditis in Adults: Diagnosis, Antimicrobial Therapy, and Management of Complications: A Scientific Statement for Healthcare Professionals From the American Heart Association. Circulation 2015, 132, 1435–1486. Available online: https://www.ahajournals.org/doi/10.1161/CIR.0000000000000296 (accessed on 20 September 2021). [CrossRef]
  10. Schoenfeld, M.; Machhar, R.; Maw, A. Diagnosing Endocarditis in Patients With Staphylococcus aureus Bacteremia. JAMA 2015, 313, 420. Available online: http://jama.jamanetwork.com/article.aspx?doi=10.1001/jama.2014.16951 (accessed on 13 October 2021). [CrossRef]
  11. Ramos-Martínez, A.; Calderón-Parra, J.; Miró, J.M.; Muñoz, P.; Rodríguez-Abella, H.; Valerio, M.; de Alarcón, A.; Luque, R.; Ambrosioni, J.; Fariñas, M.C.; et al. Effect of the type of surgical indication on mortality in patients with infective endocarditis who are rejected for surgical intervention. Int. J. Cardiol. 2019, 282, 24–30. [Google Scholar] [CrossRef] [PubMed]
  12. Heriot, G.S.; Tong, S.Y.C.; Cheng, A.C.; Liew, D. What risk of endocarditis is low enough to justify the omission of transoesophageal echocardiography in Staphylococcus aureus bacteraemia? A narrative review. Clin. Microbiol. Infect. 2018, 24, 1251–1256. [Google Scholar] [CrossRef] [PubMed]
  13. Hilberath, J.N.; Oakes, D.A.; Shernan, S.K.; Bulwer, B.E.; D’Ambra, M.N.; Eltzschig, H.K. Safety of transesophageal echocardiography. J. Am. Soc. Echocardiogr. 2010, 23, 1115–1127. [Google Scholar] [CrossRef] [PubMed]
  14. Min, J.K.; Spencer, K.T.; Furlong, K.T.; DeCara, J.M.; Sugeng, L.; Ward, R.P.; Lang, R.M. Clinical features of complications from transesophageal echocardiography: A single-center case series of 10,000 consecutive examinations. J. Am. Soc. Echocardiogr. 2005, 18, 925–929. [Google Scholar] [CrossRef]
  15. Liu, E.; Guha, A.; Dunleavy, M.; Obarski, T. Safety of Transesophageal Echocardiography in Patients with Esophageal Varices. J. Am. Soc. Echocardiogr. 2019, 32, 676–677. [Google Scholar] [CrossRef]
  16. Kitkungvan, D.; Kalluru, D.; Lunagariya, A.; Sanchez, L.; Yusuf, S.W.; Hassan, S.; Palaskas, N.; Mouhayar, E.; Banchs, J. Safety of Transesophageal Echocardiography in Patients with Thrombocytopenia. J. Am. Soc. Echocardiogr. 2019, 32, 1010–1015. [Google Scholar] [CrossRef]
  17. Heriot, G.S.; Tong, S.Y.C.; Cheng, A.C.; Liew, D. Benefit of Echocardiography in Patients With Staphylococcus aureus Bacteremia at Low Risk of Endocarditis. Open Forum. Infect. Dis. 2018, 5, ofy303. Available online: https://academic.oup.com/ofid/article/doi/10.1093/ofid/ofy303/5238173 (accessed on 13 October 2021). [CrossRef]
  18. Palraj, B.R.; Baddour, L.M.; Hess, E.P.; Steckelberg, J.M.; Wilson, W.R.; Lahr, B.D.; Sohail, M.R. Predicting Risk of Endocarditis Using a Clinical Tool (PREDICT): Scoring System to Guide Use of Echocardiography in the Management of Staphylococcus aureus Bacteremia. Clin. Infect. Dis. 2015, 61, 18–28. Available online: https://academic.oup.com/cid/article-lookup/doi/10.1093/cid/civ235 (accessed on 13 October 2021). [CrossRef]
  19. Tubiana, S.; Duval, X.; Alla, F.; Selton-Suty, C.; Tattevin, P.; Delahaye, F.; Piroth, L.; Chirouze, C.; Lavigne, J.P.; Erpelding, M.L.; et al. The VIRSTA score, a prediction score to estimate risk of infective endocarditis and determine priority for echocardiography in patients with Staphylococcus aureus bacteremia. J. Infect. 2016, 72, 544–553. Available online: https://linkinghub.elsevier.com/retrieve/pii/S0163445316000517 (accessed on 13 October 2021). [CrossRef]
  20. Kahn, F.; Resman, F.; Bergmark, S.; Filiptsev, P.; Nilson, B.; Gilje, P.; Rasmussen, M. Time to blood culture positivity in Staphylococcus aureus bacteraemia to determine risk of infective endocarditis. Clin. Microbiol. Infect. 2021, 27, e7–e1345. Available online: https://linkinghub.elsevier.com/retrieve/pii/S1198743X2030700X (accessed on 13 October 2021). [CrossRef]
  21. Bai, A.D.; Agarwal, A.; Steinberg, M.; Showler, A.; Burry, L.; Tomlinson, G.A.; Bell, C.M.; Morris, A.M. Clinical predictors and clinical prediction rules to estimate initial patient risk for infective endocarditis in Staphylococcus aureus bacteraemia: A systematic review and meta-analysis. Clin. Microbiol. Infect. 2017, 23, 900–906. Available online: https://linkinghub.elsevier.com/retrieve/pii/S1198743X17302367 (accessed on 13 October 2021). [CrossRef] [PubMed]
  22. Peinado-Acevedo, J.S.; Hurtado-Guerra, J.J.; Hincapié-Osorno, C.; Mesa-Abad, J.; Uribe-Delgado, J.R.; Giraldo-Ramírez, S.; Lengerke-Diaz, P.A.; Jaimes, F. Validation of VIRSTA and PREDICT scores to determine the priority of echocardiography in patients with Staphylococcus aureus bacteremia. Clin. Infect. Dis. 2021, 73, e1151–e1157. [Google Scholar] [CrossRef] [PubMed]
  23. van der Vaart, T.W.; Prins, J.M.; Soetekouw, R.; van Twillert, G.; Veenstra, J.; Herpers, B.L.; Rozemeijer, W.; Jansen, R.R.; Bonten, M.J.; van der Meer, J. Prediction rules for ruling out endocarditis in patients with Staphylococcus aureus bacteremia. Clin. Infect. Dis. 2021. online ahead of print ciab632. [Google Scholar] [CrossRef] [PubMed]
  24. Bolhuis, K.; Bakker, L.J.; Keijer, J.T.; de Vries, P.J. Implementing a hospital-wide protocol for Staphylococcus aureus bacteremia. Eur. J. Clin. Microbiol Infect. Dis. 2018, 37, 1553–1562. Available online: http://link.springer.com/10.1007/s10096-018-3284-9 (accessed on 13 October 2021). [CrossRef] [PubMed]
  25. Holden, E.; Bashir, A.; Das, I.; Morton, H.; Steadman, C.D.; Nightingale, P.; Steeds, R.P.; David, M.D. Staphylococcus aureus bacteraemia in a UK tertiary referral centre: A “transoesophageal echocardiogram for all” policy. J. Antimicrob. Chemother. 2014, 69, 1960–1965. Available online: https://academic.oup.com/jac/article-lookup/doi/10.1093/jac/dku082 (accessed on 13 October 2021). [CrossRef]
  26. Heriot, G.S.; Cheng, A.C.; Tong, S.Y.C.; Liew, D. Clinical predictors and prediction rules to estimate initial patient risk for infective endocarditis in Staphylococcus aureus bacteraemia: Attention must be paid to the reference standard. Clin. Microbiol. Infect. 2018, 24, 314–316. Available online: https://www.clinicalmicrobiologyandinfection.com/article/S1198-743X(17)30536-0/fulltext#relatedArticles (accessed on 20 February 2022). [CrossRef]
  27. Joseph, J.P.; Meddows, T.R.; Webster, D.P.; Newton, J.D.; Myerson, S.G.; Prendergast, B.; Scarborough, M.; Herring, N. Prioritizing echocardiography in Staphylococcus aureus bacteraemia. J. Antimicrob. Chemother. 2013, 68, 444–449. [Google Scholar] [CrossRef]
  28. Mun, S.J.; Kim, S.H.; Huh, K.; Cho, S.Y.; Kang, C.I.; Chung, D.R.; Peck, K.R. Role of echocardiography in uncomplicated Staphylococcus aureus catheter-related bloodstream infections. Medicine 2021, 100, e25679. [Google Scholar] [CrossRef]
  29. Heriot, G.S.; Tong, S.Y.C.; Cheng, A.C.; Liew, D. A Scenario-Based Survey of Expert Echocardiography Recommendations for Patients With Staphylococcus aureus Bacteremia at Varying Risk for Endocarditis. JAMA Netw. Open 2020, 3, e202401. [Google Scholar] [CrossRef]
  30. Parra, J.C.; De Castro-Campos, D.; García, P.M.; Samperio, M.O.; Arriaza, M.M.; De Alarcón, A.; Gutierrez-Carretero, E.; Alvarez, M.C.; Meda, J.M.; Sanchez, M.Á.; et al. Non-HACEK gram negative bacilli endocarditis: Analysis of a national prospective cohort. Eur. J. Intern. Med. 2021, 92, 71–78. Available online: https://www.ejinme.com/article/S0953-6205(21)00144-8/fulltext#relatedArticles (accessed on 11 September 2021). [CrossRef]
  31. Shankar-Hari, M.; Phillips, G.S.; Levy, M.L.; Seymour, C.W.; Liu, V.X.; Deutschman, C.S.; Angus, D.C.; Rubenfeld, G.D.; Singer, M. Developing a New Definition and Assessing New Clinical Criteria for Septic Shock: For the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA 2016, 315, 775–787. [Google Scholar] [CrossRef] [PubMed]
  32. Bai, A.D.; Showler, A.; Burry, L.; Steinberg, M.; Tomlinson, G.A.; Bell, C.M.; Morris, A.M. Clinical prediction rules in Staphylococcus aureus bacteremia demonstrate the usefulness of reporting likelihood ratios in infectious diseases. Eur. J. Clin. Microbiol. Infect. Dis. 2016, 35, 1393–1398. Available online: http://link.springer.com/10.1007/s10096-016-2711-z (accessed on 13 October 2021). [CrossRef] [PubMed]
  33. Abu Saleh, O.; Fida, M.; Asbury, K.; Narichania, A.; Sotello, D.; Bosch, W.; Vikram, H.R.; Palraj, R.; Lahr, B.; Baddour, L.M.; et al. Prospective Validation of PREDICT and Its Impact on the Transesophageal Echocardiography Use in Management of Staphylococcus aureus Bacteremia. Clin. Infect. Dis. 2021, 73, e1745–e1753. Available online: https://academic.oup.com/cid/article/73/7/e1745/5860918 (accessed on 13 October 2021). [CrossRef] [PubMed]
  34. Heriot, G.S.; Cronin, K.; Tong, S.Y.C.; Cheng, A.C.; Liew, D. Criteria for Identifying Patients With Staphylococcus aureus Bacteremia Who Are at Low Risk of Endocarditis: A Systematic Review. Open Forum. Infect. Dis. 2017, 4, ofx261. Available online: https://academic.oup.com/ofid/article/doi/10.1093/ofid/ofx261/4657117 (accessed on 13 October 2021). [CrossRef]
  35. Simeon, S.; Le Moing, V.; Tubiana, S.; Duval, X.; Fournier, D.; Lavigne, J.P.; Erpelding, M.L.; Gustave, C.A.; Desage, S.; Chirouze, C.; et al. Time to blood culture positivity: An independent predictor of infective endocarditis and mortality in patients with Staphylococcus aureus bacteraemia. Clin. Microbiol. Infect. 2019, 25, 481–488. [Google Scholar] [CrossRef]
  36. Vos, F.J.; Bleeker-Rovers, C.P.; Sturm, P.D.; Krabbe, P.F.M.; Kullberg, B.J. Endocarditis: Effects of routine echocardiography during Gram-positive bacteraemia. Neth. J. Med. 2011, 69, 335–340. [Google Scholar]
  37. Lau, L.; Wiens, E.J.; Karlowsky, J.A.; Keynan, Y.; Jassal, D.S. Clinical utility of echocardiography for the diagnosis of native valve infective endocarditis in Staphylococcus aureus bacteremia. Echocardiography 2019, 36, 1852–1858. Available online: https://onlinelibrary.wiley.com/doi/10.1111/echo.14480 (accessed on 13 October 2021). [CrossRef]
  38. Urja, P.; Walters, R.W.; Vivekanandan, R.; Kumar, M.; Abdulghani, S.; Hari Belbase, R.; Zook, N.; Mahesh Alla, V. Trends in the use of echocardiography in patients with Staphylococcus aureus bacteremia: An analysis using the Nationwide Inpatient Sample data. Echocardiography 2019, 36, 1625–1632. Available online: https://onlinelibrary.wiley.com/doi/10.1111/echo.14473 (accessed on 13 October 2021). [CrossRef]
  39. Thorlacius-Ussing, L.; Sandholdt, H.; Nissen, J.; Rasmussen, J.; Skov, R.; Frimodt-Møller, N.; Dahl Knudsen, J.; Østergaard, C.; Benfield, T. Comparable Outcomes of Short-Course and Prolonged-Course Therapy in Selected Cases of Methicillin-Susceptible Staphylococcus aureus Bacteremia: A Pooled Cohort Study. Clin. Infect. Dis. 2021, 73, 866–872. [Google Scholar] [CrossRef]
Figure 1. Receiving operator curve of different clinical prediction rules. AUC for PREDICT score (5-day model) was 0.699 (IC 95% 0.609–0.788). AUC for POSITIVE score was 0.771 (95% CI 0.696–0.846). AUC for VIRSTA score was 0.842 (0.771–0.912). In comparison, fulfilling major Duke’s criteria had an AUC of 0.971 (95% CI 0.94–1.00). AUC: Area under the receiving operator curve.
Figure 1. Receiving operator curve of different clinical prediction rules. AUC for PREDICT score (5-day model) was 0.699 (IC 95% 0.609–0.788). AUC for POSITIVE score was 0.771 (95% CI 0.696–0.846). AUC for VIRSTA score was 0.842 (0.771–0.912). In comparison, fulfilling major Duke’s criteria had an AUC of 0.971 (95% CI 0.94–1.00). AUC: Area under the receiving operator curve.
Jcm 11 01502 g001
Table 1. Factors associated with IE in patients with SAB.
Table 1. Factors associated with IE in patients with SAB.
VariableTotal (n = 404)IE (n = 50)Non-IE (n = 354)pMissing
Demographic and comorbidity
Age69 (56–79)68 (58–77)69 (55–80)0.9270
Sex (female)31.4% (127)26.0% (13)32.2% (1149)0.4200
Charlson index2 (1–5)2 (1–4)2 (1–5)0.6353
Age-adjusted Charlson index5 (3–7)5 (3–7)5 (3–7)0.9683
Arterial hypertension55.9% (226)72.0% (36)53.7% (190)0.0150
Diabetes mellitus29.2% (118)34.0% (17)28.5% (101)0.5060
Chronic heart failure30.4% (123)48.0% (24)28.0% (99)0.0050
Ischemic heart disease18.1% (73)22.0% (11)17.5% (62)0.5560
Natural cardiac valve disease18.3% (74)29.7% (22)14.7% (52)<0.0010
Prosthetic heart valve disease4.7% (19)14.0% (7)3.4% (12)0.0050
CIED6.2% (25)18.0% (9)4.5% (16)0.0010
Chronic renal failure22.8% (92)28.0% (14)22.0% (78)0.3690
Hemodialysis7.1% (29)8.0% (4)7.1% (25)0.7940
Liver cirrhosis3.2% (13)2.0% (1)3.4% (12)0.7151
Solid organ malignancy21.6% (87)12.0% (6)22.9% (81)0.0981
Parenteral drug user1.0% (4)2.0% (1)0.8% (3)0.4132
Clinical presentation
AcquisitionNosocomial51.5% (208)40.0% (20)53.1% (188)Ref.0
Healthcare-associated16.8% (68)14.0% (7)17.2% (61)0.870
Community31.7% (128)46.0% (23)29.7% (105)0.026
Source of infectionPrimary/unknown29.4% (116)49.0% (24)26.7% (92)<0.00110
Catheter-related34.2% (135)28.0% (14)35.2% (121)0.571
Other36.3% (143)24.0% (12)38.1% (131)ref
Fever89.8% (362)92.0% (46)89.5% (316)0.6351
Sepsis/septic shock28.3% (114)48.0% (24)25.5% (90)0.0011
Fever defervescence within 72 h89.2% (330)79.2% (38)90.6% (292)0.05034
Septic emboli13.4% (54)46.0% (23)8.8% (31)<0.0010
Acute kidney injury40.5% (162)60.0% (30)37.7% (132)0.0030
Acute cardiac failure20.9% (84)54.0% (27)16.2% (57)<0.0012
Pitt’s bacteremia score0 (0–3)1 (0–3)0 (0–2)0.0042
SOFA2 (0–4)3 (1–5)2 (0–4)0.0383
Microbiology
Time to positivity (hours)12 (9–16)11 (8–14)12 (10–16)0.0230
Persistent bacteriemia31.8% (99)62.2% (28)26.7% (71)<0.00193
Methicillin-resistant SAB19.6% (79)14.0% (7)20.3% (72)0.3450
Diagnostic workup
TTE62.3% (250)80.0% (40)59.8% (210)0.0073
TEE32.2% (128)72.0% (36)26.4% (92)<0.0016
PET-CT10.2% (41)26.0% (13)8.0% (28)<0.0013
Outcomes
30-day mortality15.4% (62)20.0% (10)14.8% (52)0.4012
In-hospital mortality20.3% (82)28.0% (14)19.3% (68)0.1870
SAB relapse4.5% (17)4.5% (2)4.5% (15)1.00062
IE: Infective endocarditis. Qualitative variables are presented as percentages (absolute number) and analyzed by means of chi-square test (or Fisher exact test when necessary). Quantitative variables are presented as median (interquartile range) and analyze by means of Mann–Whitney’s U. SAB: Staphylococcus aureus bacteremia. CIED: Cardiac implantable electronic device. SOFA: Sepsis-related Organ Failure Assessment. TTE: Transthoracic echocardiography. TEE: Transesophageal cardiography. PET-CT: Positron emission tomography–computed tomography.
Table 2. IE and non-IE case distribution according to clinical prediction scores classification.
Table 2. IE and non-IE case distribution according to clinical prediction scores classification.
PREDICT (5-Day Model)POSITIVEVIRSTA
High risk patientsIE16.7% (45)23.6% (38)20.8% (46)
Non IE83.3% (224)76.4% (123)79.2% (181)
Total66.3% (269)39.7% (161)54.4% (221)
Low risk patientsIE3.6% (5)4.9% (12)2.2% (4)
Non IE96.4% (132)95.1% (233)97.8% (181)
Total33.7% (137)60.3% (245)45.6% (185)
IE: Infective endocarditis.
Table 3. Validation of different clinical prediction rules to identify IE among SAB patients.
Table 3. Validation of different clinical prediction rules to identify IE among SAB patients.
Cut-Off Sens.Spec.PPVNPVPLRNLRAUC
PREDICT (5-day model)>1 point90%37.1%16.7%96.4%1.430.270.70
POSITIVE>4 points76%65.5%23.6%95.1%2.170.370.78
VIRSTA>2 points92.0%50.8%20.8%97.8%1.840.160.85
IE: infective endocarditis. SAB: Staphylococcus aureus bacteriemia. Sens: sensitivity. Spec: Specificity. PPV: Positive predictive value. NPV: Negative predictive value. PLR: Positive likelihood ratio. NLR: Negative likelihood ratio. AUC: Area under the curve.
Table 4. IE rate among patients identified as low-risk by different scores in different population according to echocardiographic evaluation and results.
Table 4. IE rate among patients identified as low-risk by different scores in different population according to echocardiographic evaluation and results.
PREDICT Low Risk POSITIVE Low RiskVIRSTA Low Risk
IE PrevalenceCI 95%IE PrevalenceCI 95%IE PrevalenceCI 95%
All patients (n = 404)3.6% (5/137)0.1–6.9%4.9% (12/245)2.2–7.7%2.2% (4/185)0.1–4.3%
Patients with TTE and/or TEE (n = 289)4.8% (5/104)0.1–9.0%7.5% (12/160)3.4–11.6%3.5% (4/116)0–6.8%
Patients with TEE (n = 128)5.3% (2/39)0–12.4%12.0% (6/50)2.7–21.3%5.7% (2/35)0–13.8%
Patients with negative TTE (n = 235)3.4% (3/89)0–7.2%2.8% (4/141)0.1–5.6%0.9% (1/103)0–2.8%
IE: Infective endocarditis. TEE: Transesophageal echocardiography. TTE: Transthoracic echocardiography.
Table 5. Multivariate logistic regression model of mortality and echocardiographic evaluation.
Table 5. Multivariate logistic regression model of mortality and echocardiographic evaluation.
30-Day MortalityOR95% CIp
Age (each year)1.041.01–1.070.008
Charlson index (each point)1.070.95–1.230.329
Unknown source of infection3.701.67–8.200.001
SOFA (each point)1.221.03–1.460.026
Complicated bacteriemia2.691.18–6.170.019
Low-risk VIRSTA score0.440.19–0.990.048
Echocardiographic evaluationTTE and/or TEE0.240.10–0.540.001
TTE0.280.13–0.600.001
TEE0.590.25–1.390.232
Only one echocardiographic variable at the time was included in the model. OR 95% CI and p values for variables other than echocardiographic evaluation are provided with the model including ETT and/or ETE. No significant different were observed within these variables when including the others echocardiographic evaluation. SOFA: Sepsis-related organ failure assessment. TTE: Transthoracic echocardiography. TEE: Transesophageal echocardiography. OR: Odds ratio. 95% CI: 95% confident interval.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Calderón-Parra, J.; Diego-Yagüe, I.; Santamarina-Alcantud, B.; Mingo-Santos, S.; Mora-Vargas, A.; Vázquez-Comendador, J.M.; Fernández-Cruz, A.; Muñez-Rubio, E.; Gutiérrez-Villanueva, A.; Sánchez-Romero, I.; et al. Unreliability of Clinical Prediction Rules to Exclude without Echocardiography Infective Endocarditis in Staphylococcus aureus Bacteremia. J. Clin. Med. 2022, 11, 1502. https://doi.org/10.3390/jcm11061502

AMA Style

Calderón-Parra J, Diego-Yagüe I, Santamarina-Alcantud B, Mingo-Santos S, Mora-Vargas A, Vázquez-Comendador JM, Fernández-Cruz A, Muñez-Rubio E, Gutiérrez-Villanueva A, Sánchez-Romero I, et al. Unreliability of Clinical Prediction Rules to Exclude without Echocardiography Infective Endocarditis in Staphylococcus aureus Bacteremia. Journal of Clinical Medicine. 2022; 11(6):1502. https://doi.org/10.3390/jcm11061502

Chicago/Turabian Style

Calderón-Parra, Jorge, Itziar Diego-Yagüe, Beatriz Santamarina-Alcantud, Susana Mingo-Santos, Alberto Mora-Vargas, José Manuel Vázquez-Comendador, Ana Fernández-Cruz, Elena Muñez-Rubio, Andrea Gutiérrez-Villanueva, Isabel Sánchez-Romero, and et al. 2022. "Unreliability of Clinical Prediction Rules to Exclude without Echocardiography Infective Endocarditis in Staphylococcus aureus Bacteremia" Journal of Clinical Medicine 11, no. 6: 1502. https://doi.org/10.3390/jcm11061502

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop