Early Identification of Sepsis by Emergency Medical Services: Diagnostic Accuracy of Scoring Systems in a Retrospective Cohort
Abstract
1. Introduction
2. Materials and Methods
2.1. Study Design, Patients, and Data Acquisition
- All consecutive EMS transports to the study ED between 1 May and 31 May 2023, were screened, and all adults aged 18 years or older brought to the study ED were eligible for inclusion.
- Exclusion criteria were predefined as incomplete prehospital records preventing score calculation, discharge diagnoses clearly incompatible with infection or sepsis (including acute ischemic stroke [International Classification of Diseases 10th revision, ICD-10 I63], acute myocardial infarction [ICD-10 I21], and cardiac arrest [ICD-10 I46]), interfacility transfers, and cases triaged into non-internal medicine categories. These exclusions were applied to focus the analysis on patients in whom sepsis was a realistic differential diagnosis.
2.2. Statistical Analysis
3. Results
3.1. Cohort Characteristics
3.2. EMSs’ Suspicion of Sepsis
3.3. Performance of Screening Scores
- For qSOFA, sensitivity was 83.3% and specificity was 74.2%. The AUC was 0.838 (95% CI 0.709–0.967). The optimal cut-off was ≥1 point, corresponding to a Youden index of 0.575.
- For PRESEP, sensitivity was 91.7% and specificity 41.2%, with an AUC of 0.695 (95% CI 0.546–0.844). The optimal cut-off was ≥1 point (Youden index 0.329). At the originally proposed threshold of ≥4, sensitivity dropped to 41.7% while specificity increased to 83.9%.
- For MEWS, sensitivity was 83.3%, and specificity was 77.6%. The AUC was 0.863 (95% CI 0.777–0.948). The optimal cut-off was ≥3, corresponding to a Youden index of 0.609.
4. Discussion
Limitations and Strengths
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
| AVPU | Alert/Verbal/Pain/Unresponsive |
| ED | Emergency Department |
| EMS | Emergency Medical Service |
| ESI | Emergency Severity Index |
| GCS | Glasgow Coma Scale |
| MEWS | Modified Early Warning Score |
| PRESEP | Prehospital Early Sepsis Detection |
| qSOFA | Quick Sequential Organ Failure Assessment |
References
- Singer, M.; Deutschman, C.S.; Seymour, C.W.; Shankar-Hari, M.; Annane, D.; Bauer, M.; Bellomo, R.; Bernard, G.R.; Chiche, J.-D.; Coopersmith, C.M.; et al. The Third International Consensus Definitions for Sepsis Septic Shock (Sepsis-3). Jama 2016, 315, 801–810. [Google Scholar] [CrossRef] [PubMed]
- Rudd, K.E.; Johnson, S.C.; Agesa, K.M.; Shackelford, K.A.; Tsoi, D.; Kievlan, D.R.; Colombara, D.V.; Ikuta, K.S.; Kissoon, N.; Finfer, S.; et al. Global, regional, and national sepsis incidence and mortality, 1990–2017: Analysis for the Global Burden of Disease Study. Lancet 2020, 395, 200–211. [Google Scholar] [CrossRef]
- Evans, L.; Rhodes, A.; Alhazzani, W.; Antonelli, M.; Coopersmith, C.M.; French, C.; Machado, F.R.; Mcintyre, L.; Ostermann, M.; Prescott, H.C.; et al. Surviving Sepsis Campaign: International Guidelines for Management of Sepsis and Septic Shock 2021. Crit. Care Med. 2021, 49, e1063–e1143. [Google Scholar] [CrossRef] [PubMed]
- Wang, H.E.; Weaver, M.D.; Shapiro, N.I.; Yealy, D.M. Opportunities for Emergency Medical Services care of sepsis. Resuscitation 2010, 81, 193–197. [Google Scholar] [CrossRef] [PubMed]
- Sjösten, O.; Nilsson, J.; Herlitz, J.; Axelsson, C.; Jiménez-Herrera, M.; Andersson Hagiwara, M. The prehospital assessment of patients with a final hospital diagnosis of sepsis: Results of an observational study. Australas. Emerg. Care 2019, 22, 187–192. [Google Scholar] [CrossRef]
- Lane, D.J.; Wunsch, H.; Saskin, R.; Cheskes, S.; Lin, S.; Morrison, L.J.; Oleynick, C.J.; Scales, D.C. Epidemiology and patient predictors of infection and sepsis in the prehospital setting. Intensive Care Med. 2020, 46, 1394–1403. [Google Scholar] [CrossRef]
- Kule, A.; Stassen, W.; Flores, G.E.; Djarv, T.; Singletary, E. Recognition and Awareness of Sepsis by First-Aid Providers in Adults with Suspected Infection: A Scoping Review. Cureus 2024, 16, e61612. [Google Scholar] [CrossRef]
- Green, R.S.; Travers, A.H.; Cain, E.; Campbell, S.G.; Jensen, J.L.; Petrie, D.A.; Erdogan, M.; Patrick, G.; Patrick, W. Paramedic Recognition of Sepsis in the Prehospital Setting: A Prospective Observational Study. Emerg. Med. Int. 2016, 2016, 6717261. [Google Scholar] [CrossRef] [PubMed]
- Barbara, P.; Graziano, C.; Caputo, W.; Litvak, I.; Battinelli, D.; Hahn, B. The quick sequential organ failure assessment (qSOFA) identifies septic patients in the out-of-hospital setting. Am. J. Emerg. Med. 2018, 36, 1022–1026. [Google Scholar] [CrossRef]
- Bayer, O.; Schwarzkopf, D.; Stumme, C.; Stacke, A.; Hartog, C.S.; Hohenstein, C.; Kabisch, B.; Reichel, J.; Reinhart, K.; Winning, J. An Early Warning Scoring System to Identify Septic Patients in the Prehospital Setting: The PRESEP Score. Acad. Emerg. Med. 2015, 22, 868–871. [Google Scholar] [CrossRef]
- Subbe, C.P.; Kruger, M.; Rutherford, P.; Gemmel, L. Validation of a modified Early Warning Score in medical admissions. QJM 2001, 94, 521–526. [Google Scholar] [CrossRef]
- Horton, D.J.; Graves, K.K.; Kukhareva, P.V.; A Johnson, S.; Cedillo, M.; Sanford, M.; A Dunson, W.; White, M.; Roach, D.; Arego, J.J.; et al. Modified early warning score-based clinical decision support: Cost impact and clinical outcomes in sepsis. JAMIA Open 2020, 3, 261–268. [Google Scholar] [CrossRef] [PubMed]
- Tirado, W.C. Early Recognition of Sepsis in Prehospital Settings: A Review of Screening Tools and Practices. Adv. Emerg. Nurs. J. 2025, 47, 152. [Google Scholar] [CrossRef] [PubMed]
- Peltan, I.D.; Rahmati, K.; Bledsoe, J.R.; Yoneoka, Y.; Alvarez, F.; Plendl, M.; Taillac, P.P.M.; Youngquist, S.T.; Samore, M.M.; Hough, C.L.M.; et al. Performance Evaluation of Prehospital Sepsis Prediction Models. Crit. Care Med. 2025, 53, e973–e978. [Google Scholar] [CrossRef]
- Piedmont, S.; Goldhahn, L.; Swart, E.; Robra, B.P.; Fleischmann-Struzek, C.; Somasundaram, R.; Bauer, W. Sepsis incidence, suspicion, prediction and mortality in emergency medical services: A cohort study related to the current international sepsis guideline. Infection 2024, 52, 1325–1335. [Google Scholar] [CrossRef]
- Kadish, C.B.; Lloyd, J.K.; Adelgais, K.M.; Ward, C.E.; Lo, C.B.; Truelove, A.; Leonard, J.C. Prehospital Recognition and Management of Pediatric Sepsis: A Qualitative Assessment. Prehosp. Emerg. Care 2023, 27, 775–785. [Google Scholar] [CrossRef] [PubMed]
- Wandl, B.; Kellerer, J.D.; Fuhrmann, V.; Tapinova, K.; Roth, D.; Müller, G. Diagnostic test accuracy of the Emergency Severity Index: A systematic review and meta-analysis. Eur. J. Emerg. Med. 2025, 32, 325–334. [Google Scholar] [CrossRef]
- Lane, D.; Ichelson, R.I.; Drennan, I.R.; Scales, D.C. Prehospital management and identification of sepsis by emergency medical services: A systematic review. Emerg. Med. J. 2016, 33, 408–413. [Google Scholar] [CrossRef]
- Schewe, J.C.; Kappler, J.; Dovermann, K.; Graeff, I.; Ehrentraut, S.F.; Heister, U. Diagnostic accuracy of physician-staffed emergency medical teams: A retrospective observational cohort study of prehospital versus hospital diagnosis in a 10-year interval. Scand J Trauma Resusc Emerg Med. 2019, 27, 36. [Google Scholar] [CrossRef]
- Moutinho, A.; Fontes, J.; Ferreira, L.; Lopes, J.; Martins, F.; Mega, S.; Gil, M.; Barros, F.; Correia, A.M. Alerts in the Pre-hospital Setting: An Observational Retrospective Study of Emergency Medical Services’ Response in Portugal (2020–2023). Cureus 2025, 17, e82528. [Google Scholar] [CrossRef]
- Peltan, I.D.; Mitchell, K.H.; Rudd, K.E.; Mann, B.A.; Carlbom, D.J.; Rea, T.D.; Butler, A.M.; Hough, C.L.; Brown, S.M. Prehospital Care Emergency Department Door-to-Antibiotic Time in Sepsis. Ann. Am. Thorac. Soc. 2018, 15, 1443–1450. [Google Scholar] [CrossRef]
- Kim, H.J.; Ko, R.E.; Lim, S.Y.; Park, S.; Suh, G.Y.; Lee, Y.J. Sepsis Alert Systems, Mortality, and Adherence in Emergency Departments: A Systematic Review and Meta-Analysis. JAMA Netw. Open 2024, 7, e2422823. [Google Scholar] [CrossRef]
- Pinto-Villalba, R.S.; Balseca-Arellano, D.; Leon-Rojas, J.E. Septic shock in the prehospital setting: A scoping review. Scand. J. Trauma Resusc. Emerg. Med. 2024, 32, 113. [Google Scholar] [CrossRef]
- Smyth, M.A.; Brace-McDonnell, S.J.; Perkins, G.D. Identification of adults with sepsis in the prehospital environment: A systematic review. BMJ Open 2016, 6, e011218. [Google Scholar] [CrossRef] [PubMed]
- Melero-Guijarro, L.; Sanz-García, A.; Martín-Rodríguez, F.; Lipari, V.; Mazas Perez Oleaga, C.; Carvajal Altamiranda, S.; López, N.M.M.; Azpíroz, I.D.; Villamor, M.A.C.; Soberón, I.S.; et al. Prehospital qSOFA, mSOFA, and NEWS2 performance for sepsis prediction: A prospective, multi-center, cohort study. Front. Med. 2023, 10, 1149736. [Google Scholar] [CrossRef]
- Dorsett, M.; Kroll, M.; Smith, C.S.; Asaro, P.; Liang, S.Y.; Moy, H.P. qSOFA Has Poor Sensitivity for Prehospital Identification of Severe Sepsis and Septic Shock. Prehosp. Emerg. Care 2017, 21, 489–497. [Google Scholar] [CrossRef]
- Nualprasert, P.; Pattanarattanamolee, R.; Padtalaka, P.; Nakahara, S. Evaluation of the PRESEP Score and the Miami Sepsis Score for Prehospital Sepsis Screening. Prehosp. Emerg. Care 2024, 28, 369–374. [Google Scholar] [CrossRef] [PubMed]
- Polito, C.C.; Bloom, I.; Dunn, C.; Moore, R.; Chen, J.; Yancey, A.H.; Sevransky, J.E. Implementation of an EMS protocol to improve prehospital sepsis recognition. Am. J. Emerg. Med. 2022, 57, 34–38. [Google Scholar] [CrossRef]
- Alam, N.; Oskam, E.; Stassen, P.M.; van Exter, P.; van de Ven, P.M.; Haak, H.R.; Holleman, F.; van Zanten, A.; van Leeuwen-Nguyen, H.; Bon, V.; et al. Prehospital antibiotics in the ambulance for sepsis: A multicentre, open label, randomised trial. Lancet Respir. Med. 2018, 6, 40–50. [Google Scholar] [CrossRef] [PubMed]


| Overall Study Population n = 597 | Sepsis n = 12 | No Sepsis n = 585 | |
|---|---|---|---|
| Age, years (IQR) | 66 (50–79) | 65 (52–74) | 66 (50–79) |
| Female, n (%) | 279 (47) | 7 (58) | 272 (47) |
| Sepsis suspected by EMS, n (%) | 3 (0.5) | 2 (17) | 1 (0.2) |
| Comorbidities | |||
| Arterial hypertension, n (%) | 267 (45) | 2 (17) | 265 (45) |
| Diabetes mellitus 2, n (%) | 130 (22) | 1 (8) | 129 (22) |
| Hyperlipidemia, n (%) | 104 (17) | 1 (8) | 103 (18) |
| Coronary disease, n (%) | 74 (12) | 1 (8) | 73 (13) |
| Chronic kidney injury, n (%) | 58 (10) | 2 (17) | 56 (10) |
| Chronic cerebral disease, n (%) | 35 (6) | 1 (8) | 34 (6) |
| Active malignant disease, n (%) | 46 (8) | 5 (42) | 41 (7) |
| Active smoker, n (%) | 28 (5) | 0 | 28 (5) |
| Chronic alcohol abuse, n (%) | 19 (3) | 0 | 19 (3) |
| Hospital discharge diagnosis—main medical problem | |||
| Cardiac, n (%) | 196 (33) | 0 | 196 (34) |
| Pulmonary, n (%) | 99 (17) | 2 (17) | 97 (17) |
| Renal, n (%) | 49 (8) | 5 (42) | 44 (8) |
| Gastroenterological, n (%) | 80 (13) | 3 (25) | 77 (13) |
| Infectious, n (%) | 115 (19) | 12 (100) | 103 (18) |
| Upper respiratory tract, n (%) | 36 (6) | 1 (8) | 35 (6) |
| Urogenital, n (%) | 20 (3) | 5 (42) | 15 (3) |
| Oncologic, n (%) | 23 (4) | 1 (8) | 22 (4) |
| Neurologic, n (%) | 36 (6) | 1 (8) | 35 (6) |
| Endocrinologic, n (%) | 12 (2) | 1 (8) | 35 (6) |
| Intoxicative, n (%) | 25 (4) | 0 | 25 (4) |
| Other, n (%) | 74 (12) | 0 | 74 (13) |
| Overall Study Population n = 597 | Sepsis n = 12 | No Sepsis n = 585 | |
|---|---|---|---|
| EMS priority category | |||
| O, n (%) | 3 (1) | 0 | 3 (1) |
| A, n (%) | 101 (17) | 1 (8) | 100 (18) |
| B, n (%) | 73 (13) | 1 (8) | 72 (13) |
| C, n (%) | 213 (37) | 6 (50) | 207 (36) |
| D, n (%) | 180 (31) | 3 (25) | 177 (31) |
| E, n (%) | 9 (2) | 1 (8) | 8 (1) |
| ED triage level (ESI) | |||
| 1, n (%) | 95 (16) | 8 (73) | 87 (15) |
| 2, n (%) | 165 (28) | 3 (27) | 162 (28) |
| 3, n (%) | 313 (53) | 0 | 313 (54) |
| 4, n (%) | 12 (2) | 0 | 12 (2) |
| 5, n (%) | 3 (1) | 0 | 3 (1) |
| Sepsis | No Sepsis | ||
|---|---|---|---|
| Sepsis suspected by EMS | 2 (16.7%) | 1 (0.2%) | 3 → PPV 66.7% |
| No sepsis suspicion by EMS | 10 (83.3%) | 584 (99.8%) | 594 → NPV 98.3% |
| 12 | 585 |
| Sensitivity | Specificity | PPV | NPV | Youden-Index | |
|---|---|---|---|---|---|
| qSOFA | |||||
| 1 | 83.3% | 74.2% | 6.2% | 99.5% | 0.5752 |
| 2 | 50.0% | 96.4% | 22.2% | 98.9% | 0.4641 |
| 3 | 8.3% | 99.7% | 33.3% | 98.1% | 0.0799 |
| PRESEP | |||||
| 1 | 91.7% | 41.2% | 3.1% | 99.6% | 0.3286 |
| 4 | 41.7% | 83.9% | 5.1% | 98.6% | 0.256 |
| 8 | 25.0% | 99.1% | 37.5% | 98.5% | 0.2415 |
| 5 | 33.3% | 90.8% | 6.9% | 98.5% | 0.241 |
| 7 | 25.0% | 97.9% | 20.0% | 98.5% | 0.2295 |
| MEWS | |||||
| 3 | 83.3% | 77.6% | 7.1% | 99.6% | 0.6094 |
| 2 | 91.7% | 59.3% | 4.4% | 99.7% | 0.5098 |
| 4 | 58.3% | 88.7% | 9.6% | 99.0% | 0.4705 |
| 1 | 100% | 38.6% | 3.2% | 100% | 0.3863 |
| 5 | 33.3% | 94.7% | 11.4% | 98.6% | 0.2803 |
| Score | |||||
| qSOFA ≥ 1 | 83.3% | 74.2% | 6.2% | 99.5% | 0.5752 |
| PRESEP ≥ 1 | 91.7% | 41.2% | 3.1% | 99.6% | 0.3286 |
| MEWS ≥ 3 | 83.3% | 77.6% | 7.1% | 99.6% | 0.6094 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Kornfehl, A.; Mickerts, D.; Krammel, M.; Hauer, D.; Schnaubelt, S. Early Identification of Sepsis by Emergency Medical Services: Diagnostic Accuracy of Scoring Systems in a Retrospective Cohort. J. Clin. Med. 2026, 15, 827. https://doi.org/10.3390/jcm15020827
Kornfehl A, Mickerts D, Krammel M, Hauer D, Schnaubelt S. Early Identification of Sepsis by Emergency Medical Services: Diagnostic Accuracy of Scoring Systems in a Retrospective Cohort. Journal of Clinical Medicine. 2026; 15(2):827. https://doi.org/10.3390/jcm15020827
Chicago/Turabian StyleKornfehl, Andrea, David Mickerts, Mario Krammel, David Hauer, and Sebastian Schnaubelt. 2026. "Early Identification of Sepsis by Emergency Medical Services: Diagnostic Accuracy of Scoring Systems in a Retrospective Cohort" Journal of Clinical Medicine 15, no. 2: 827. https://doi.org/10.3390/jcm15020827
APA StyleKornfehl, A., Mickerts, D., Krammel, M., Hauer, D., & Schnaubelt, S. (2026). Early Identification of Sepsis by Emergency Medical Services: Diagnostic Accuracy of Scoring Systems in a Retrospective Cohort. Journal of Clinical Medicine, 15(2), 827. https://doi.org/10.3390/jcm15020827

