Next Article in Journal
Characteristics of SARS-CoV-2 Seropositivity among Emergency Department Healthcare Workers at a Tertiary Care Center in Baltimore
Previous Article in Journal
Effectiveness of Custom Foot Insoles to Decrease Plantar Pressure: A Cross-over Randomized Trial Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Clinical Prediction Scoring Scheme for 24 h Mortality in Major Traumatic Adult Patients

by
Waratsuda Samuthtai
1,
Jayanton Patumanond
2,
Pawitrabhorn Samutrtai
3,
Thammanard Charernboon
4,
Kijja Jearwattanakanok
5 and
Jiraporn Khorana
6,7,8,*
1
Department of Emergency Medicine, Nakornping Hospital, Chiang Mai 50180, Thailand
2
Division of Clinical Epidemiology and Clinical Statistics, Faculty of Medicine, Thammasat University, Bangkok 12120, Thailand
3
Department of Pharmaceutical Sciences, Faculty of Pharmacy, Chiang Mai University, Chiang Mai 50200, Thailand
4
Department of Psychiatry, Faculty of Medicine, Thammasat University, Bangkok 12120, Thailand
5
Department of Surgery, Nakornping Hospital, Chiang Mai 50180, Thailand
6
Department of Surgery, Faculty of Medicine, Chiang Mai University, Chiang Mai 50200, Thailand
7
Center of Clinical Epidemiology and Clinical Statistics, Faculty of Medicine, Chiang Mai University, Chiang Mai 50200, Thailand
8
Clinical Surgical Research Center, Department of Surgery, Faculty of Medicine, Chiang Mai University, Chiang Mai 50200, Thailand
*
Author to whom correspondence should be addressed.
Healthcare 2022, 10(3), 577; https://doi.org/10.3390/healthcare10030577
Submission received: 26 February 2022 / Revised: 13 March 2022 / Accepted: 17 March 2022 / Published: 20 March 2022
(This article belongs to the Section Healthcare Quality and Patient Safety)

Abstract

:
A death rate of approximately 32.7 in 100,000 traffic injury victims was reported in Thailand. The prediction of early death would identify and enable prioritization of the most severe patients for resuscitation and consequently reduce the number of deaths. This study aimed to develop a clinical prediction scoring system for 24 h mortality in adult major trauma patients. Retrospective-prognostic clinical prediction was applied in the case of 3173 adult trauma patients who were classified into three groups: death within 8 h, death between 8 and 24 h, and alive at 24 h. The predictors were obtained by univariable and multivariable logistic regression, and the coefficient of parameters was converted to predict early death. The numbers of patients who died within 8 h and between 8 and 24 h were 46 (1.5%) and 123 (3.8%), respectively. The predictors included systolic blood pressure <90 mmHg, heart rate ≥120 bpm, Glasgow coma scale ≤8, traffic injury, and assault injury. The scores of 4 indicated a mortality rate of 12% with a high specificity of 0.89. The suggested TERMINAL-24 scoring system can be used for the prediction of early death in the Emergency Department. However, its discrimination ability and precision should be validated before practical use.

1. Introduction

In the latest WHO report in 2016, Thailand ranked ninth globally as regards road accidental deaths with a fatality rate of 32.7 per 100,000 [1]. From the Information Technology for Emergency Medical System (ITEM), the number of trauma patients in Chiang Mai, Thailand in 2015–2017 was shown to be approximately 18,000 persons per year, with 270 deaths [2]; therefore, physicians have encountered many injured patients in the Emergency Department. The database of a tertiary hospital in Chiang Mai indicated the average number of trauma patients in the Emergency Department during 2014–2019 to be roughly 14,000 persons per year; 4000 were admitted and 15 died. Given the large number of trauma cases, in addition to the increased number of traffic trauma patients in the past 6 years, using a derivative scoring scheme to predict early death within the first 24 h would be helpful to advocate emergency surgery, prioritize treatment in mass casualty incidents, and inform the relatives of the victims of the chance of death. In situations in which the Emergency Department is crowded and there are many trauma patients at the same time, patients needing surgery need to be prioritized. In addition, if multiple trauma incidents are referred to deficient facilities, efficient transfer of the most severe patients to the trauma center is crucial. In these situations, we need some simple trauma scores to facilitate the rapid triage of multiple trauma patients.
Previous scoring systems for the prediction of death in traumatic patients have been proposed including RTS [3,4], ISS [5], TRISS [6], EMTRAS [7], REMS [8], MGAP [9], and GAP [10], as well as the predictive studies focusing on time and causes of death [11,12,13,14,15,16,17,18,19]. Most systems defined early death as death within 24 h [11,12,17,18,19]. Our study had a focus on earlier death, death between 8 and 24 h, and specifically death within 8 h, which is the period targeting the resuscitation of the patients in an emergency room.
This tertiary hospital in Chiang Mai has been adopting the existing trauma scores such as RTS and ISS, but these scoring systems exhibited low capability of predicting 24 h mortality with the area under the receiver operating characteristic (ROC) curves of 59% and 58%, respectively. The reason for this poor competency may be due to the lack of some predictors, for example, the mechanisms of injury or transfer processes. Therefore, we decided to derive a new scoring system in our setting.
In this study, we aimed to develop a new scoring system to more powerfully identify the prediction of early death in traffic trauma patients, which would be practical in an emergency setting and inform and promote the treatment decision plan for those patients.

2. Materials and Methods

All adult traumatic patients aged ≥15 years, categorized as resuscitation and emergency level, who visited the emergency department in this tertiary hospital in the northern region of Thailand between January 2012 and December 2017 were included in this study.
We retrieved medical records from a database called Injury Surveillance system (IS data), which classified trauma patients into 3 groups: died within 8 h, died between 8 and 24 h, and alive at 24 h. These were used as the outcomes of interest. The ATLS program (Advanced Trauma Life Support) developed by the American College of Surgeons, proposes trimodal death as immediate, early, and late death. Our study focused on early death, defined as death within 8 h, and death between 8 and 24 h [20].
Indicator parameters, including the relevant information of the patients, were (1) demographic profiles: sex and age; (2) prehospital profiles: blunt or penetrating injuries, traffic, assault, or falling injury; transfer by referring or an emergency response team; (3) hemodynamic profiles: blood pressure, pulse rate, respiratory rate at triage area, and level of consciousness using Glasgow Coma Scale (GCS). Records with missing data were excluded from the analysis.
To derive the clinical scoring, the parameters across 3 groups were compared by order using a nonparametric test for trend since the process of death is a continuation ratio. The continuous data were analyzed by statistics and clinical judgment, i.e., age ≥ 50, systolic blood pressure < 90 mmHg, pulse rate ≥ 120 bpm, respiratory rate < 10 or >30, GCS ≤ 8, to produce 2 ordinal variables. The predictability of each parameter was explored using a univariable ordinal continuation ratio model, a model based on the continuation ratio of the outcome ordered by the time of death in 3 levels of severity: dead within 8 h, dead between 8 and 24 h, and alive at 24 h. Multivariable ordinal continuation ratio logistic regression was used to evaluate the predictability of combined parameters: odds ratio, coefficient, and p-value of significant predictors. The insignificant parameters were individually removed from the model judged by the odds ratio of less than 1 and a p-value > 0.05 until all parameters in the model were significant. The coefficients of each significant parameter were converted to item scores with the lowest coefficient as the smallest common division. Each item score was added up, and the total score of each patient was calculated. We called the new scoring system “TERMINAL-24” (Traumatic Emergency Room Major INjury death At Least 24 h).
To test the score performance, a distributive box plot was created to find a score difference and the distribution across levels. Individual score prediction was made by the probability of death in each patient, then the cumulative probability of TERMINAL-24 score was built to indicate a cutoff point to classify the group of patients. The goodness of fit of this model was calibrated using the Hosmer–Lemeshow test from the aspects of the area under ROC and the risk curve of each time band of death. Finally, the mortality rate of each patient according to the TERMINAL-24 score was calculated to validate risk estimation. The internal validity of the model was conducted using a bootstrapping method. We used 3000 bootstrap samples for model derivation and tested the overfitting by the optimism of real performance and model performance.

3. Results

3.1. Characteristics of Study Subjects

A total of 3173 traumatic patients were included in the study, 46 (1.5%) of which were dead within 8 h, 123 (3.8%) died between 8 and 24 h, and 3004 (94.7%) were alive at 24 h, as illustrated in Figure 1. According to the univariable ordinal continuation ratio logistic analysis, the parameters affecting the death order of traumatic patients were hemodynamic profile and traffic injury, as shown in Table 1.

3.2. Main Results

As indicated by the multivariable ordinal continuation ratio logistic analysis, the significant parameters were hypotension (odds ratio, OR = 1.9, 95% CI = 1.3–2.8, p = 0.001), tachycardia (OR = 1.8, 95% CI = 1.3–2.6, p < 0.001), Glasgow Coma Scale ≤8 (OR = 2.7, 95% CI = 1.9–3.7, p < 0.001), and traffic injury (OR = 1.8, 95% CI = 1.3–2.4, p < 0.001). The coefficients of these parameters were converted to item scores by choosing the lowest (0.57) as the smallest common division and rounding to the nearest 0.5 integer. The item scores ranged from 1 to 2, and total scores from 0 to 5 (Table 2). The general design and example scenario are provided in the Supplementary Materials S1.
Applying a TERMINAL-24 score to all data, we found that the median and interquartile range of the scores among three groups: death in under 8 h, death between 8 and 24 h, and alive at 24 h were 3 (1,3), 1 (1–2), and 1 (0–2), respectively. The differences between scores and distribution across levels are illustrated as a stacked bar chart (Figure 2). The probability of death was observed as the exponential pattern at a score over 2 in the overall rate of death. The crossing between groups was observed at a score over 3, indicating the separation between the time of death under 8 h and that between 8–24 h (Figure 3). The Hosmer–Lemeshow goodness-of-fit test was used to assess the precision of the TERMINAL-24 score. The p-values for the groups of death under 8 h and between 8 and 24 h were 0.31 and 0.53, respectively. The indication was that the precision of the model was acceptable (0.1: lack of fit; almost 1: very fit).
The TERMINAL-24 score gave a poor to fair prediction for death of patients in the moderate group (under 24 h death) with an area under the ROC curve of 0.6814 (95% CI = 0.6387–0.7241). It predicted the severe group (death in under 8 h) more effectively with a greater area under the ROC curve of 0.7554 (95% CI = 0.6752–0.8356), as illustrated in Figure 4. The risk curve of within 8 h and within 24 h death demonstrated the correction of the TERMINAL-24 score in predicting the order of death, i.e., the predicted and observed risks increased in accordance with the TERMINAL-24 scores. Moreover, the predicted risk in the death within 8 h group was closer to the observed risk than that found in the group of 24 h death, as shown in Figure 5.
To ensure efficacy in clinical use, the sensitivity and specificity of the TERMINAL-24 score were calculated in the two groups, death under 8 h and between 8 and 24 h. The mortality rate was also calculated in association with the TERMINAL-24 score. It was indicated that at a score of 3, the mortality rate was higher than 10%. It was supported by a high specificity of 0.98 in both bands. Therefore, we suggested a TERMINAL-24 score of 3 as a mark for ICU admission. A TERMINAL-24 score of 4 or more showed a higher potential mortality rate (more than approximately 16%), indicating essential intervention by both an emergency doctor and a surgeon with the need for a specific treatment (Table 3).
We calculated a risk estimation validity of three levels of urgency classified by TERMINAL-24 score with the criteria of severity levels of the patients. The risk estimation validity indicated 85% exact correction, 11% overestimation, and 4% underestimation (Table 4). The likely ratio of a positive of a low-risk group (score 0–2) and a high-risk group (score 4–5) was 0.5 and 8.7, respectively (Table 5). The internal validation of the TERMINAL-24 score by the bootstrapping method was displayed as the mean optimism. The two groups death in under 8 h and death in under 24 h yielded a mean optimism of 0.0039 and 0.0033, respectively.

4. Discussion

Our study resulted in a novel informative continuous ratio ordinal outcome, which predicted the time of death of trauma patients who visited an emergency department during the first 24 h. This is important because in the majority of trauma patients, time has been spent in resuscitation in the first few hours before admission into hospital, thus their time in the emergency room was not longer than 8 h. Therefore, the focus of this study was the possibility of death in under 8 h and between 8 and 24 h. We also suggested that this ordinal outcome would be more effective than a binary outcome, specifically at the cutoff point of death in less than 24 h, as shown by the area under the ROC of 75% and 68% in under 8 h death and between 8 and 24 h death, respectively, while the binary outcome, dead or alive at 24 h, yielded an area under ROC of 70%. As an emergency physician, the death of multiple trauma patients should be classified as a continuous process, thus this continuous ratio ordinal outcome should be chosen.
We also included a systolic blood pressure parameter with only one cut-point, i.e., <90 mmHg, into our scoring system, while other systems suggested various cutoff points, e.g., MGAP [9] and GAP [10] use three cutoff points of >120, 60–120, and <60 mmHg, RTS [4] includes four cutoff points of 0, 1–49, 50–75, >89 mmHg, and NTS [21] employs five cutoff points of <70, 70–89, 90–109, 110–149, and >150 mmHg. We chose only one cutoff point in our study because a simple practical parameter would be more efficient in an emergency department where time taken to make decisions is crucial.
We derived a simple scoring system to predict 24 h mortality in major trauma adult patients for an emergency setting. Our scoring system would be more practicable than previous scoring systems, for example RTS and ISS. RTS is a score that calculates the probability of death for each patient [4], but it does not suggest any clinical judgment, while our score divided the patients into three levels of risk of early death. By using our score, we could manage the patients by the level of severity and thus prioritize patients on admission. The ISS score can be calculated after an investigation or treatment [5], whereas our score evaluates the patients at the initial state; thus, they are not comparable. Usefully, our “TERMINAL-24 score” does not require any laboratory or radiology results, in contrast to an EMTRAS score. It also classified the early death using the definitions described by the ATLS in an emergency room, time of death within 8 h, making the system suitable for emergency physicians who need to advise patients and their relatives, as well make decisions as to the best way forward with regard to surgery or other treatment. The TERMINAL-24 score has been designed to facilitate the planning of subsequent treatment, in contrast to other scoring systems whose purpose is to predict in-hospital death. In addition, those scoring systems monitor the time of death at 24 h, while TERMINAL-24 can be used to predict death within 8 h with a high level of precision. This is also advantageous for emergency doctors in Thailand as it enables the following of the trauma patients to subsequent shifts. There have been recent developments of new prediction models including machine learning [22], federated learning [23], mathematic algorithm [24], or system scoring. The last one was adopted for the performance of the TERMINAL-24 score.
This TERMINAL-24 score could be used to predict early death by dividing the time of death into three levels; dead within 8 h, dead between 8 and 24 h, and alive after 24 h; therefore, it can be applied in any emergency settings. For example, if patients arrive at an ED that has insufficient resources, the TERMINAL-24 score could be used to predict the patients in the high-risk group of patients, enabling immediate referral to the trauma center. Furthermore, this score could identify the patients at a high risk of mortality within 8 h in the trauma center, facilitating the prioritization of the most severe patients for emergency intervention. We found that our “TERMINAL-24 score” predicted early death competently. This made the score practicable in overcrowding situations in the emergency room, which can commonly occur in a tertiary care hospital that serves many patients, not only those that have been referred but also walk-in patients and when there are cases of mass casualty. This scoring system can be used for prioritizing trauma patients for admittance to ICU or to a general ward, as well as in other settings of overcrowding in the emergency room. Although the internal validation of TERMINAL-24 yielded a satisfactory mean optimism level, our scoring system still requires other validations to establish its discriminative ability and precision in future studies. However, due to fewer parameters being required for the calculation of this score, it can be applied by any medical professional in their setting. Moreover, we are planning to validate this score with another dataset from a different setting in the future.
The limitation of this score is that although it can predict the overall mortality rate for each level of severity, it cannot define the time of death of an individual patient. The external validation should be done.

5. Conclusions

The TERMINAL-24 scoring system was competent for the prediction of early death in admissions to the Emergency Department, especially for the band death within 8 h, which would be appropriate in any emergency setting. Importantly, this scoring system does not require any laboratory or radiology results, with simple, solely practical parameters being sufficient to predict the probability of mortality. However, further evaluation of this score in different settings is needed before it can be routinely used in clinical practice.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/healthcare10030577/s1.

Author Contributions

Conceptualization, W.S. and J.P.; methodology, W.S. and J.P.; software, W.S.; validation, W.S. and J.K.; formal analysis, K.J.; investigation, W.S.; resources, W.S.; data curation, W.S.; writing—original draft preparation, W.S.; writing—review and editing, P.S.; visualization, W.S.; supervision, J.P., T.C. and J.K.; project administration, W.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Faculty of Medicine, Chiang Mai University Hospital, there was no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the guidelines of the Declaration of Helsinki and was approved by the Ethical Committee for clinical research with a clinical trial registration number: TCTR20200408001.

Informed Consent Statement

Patient consent was waived because the data obtained from the database were anonymized.

Data Availability Statement

The datasets used during the current study are available from the first author on reasonable request.

Acknowledgments

The authors wish to thank the trauma nurse coordinator and administrator of database registration for their work with the patient records used in this study. The project was conducted as part of a Ph.D. program at Thammasart University, Thailand. The authors also wish to express their gratitude to the Clinical Surgical Research Center, Department of Surgery, Faculty of Medicine, Chiang Mai University, and the Faculty of Medicine, Chiang Mai University Chiang Mai, Thailand, who have supported both the research and the publication of this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. Global Status Report on Road Safety 2018: Summary; World Health Organization: Geneva, Switzerland, 2018. [Google Scholar]
  2. NIEMS. Emergency Medical Information Systems. Available online: https://ws.niems.go.th/ITEMS_DWH/ (accessed on 6 June 2021).
  3. Champion, H.R.; Sacco, W.J.; Carnazzo, A.J.; Copes, W.; Fouty, W.J. Trauma score. Crit. Care Med. 1981, 9, 672–676. [Google Scholar] [CrossRef] [PubMed]
  4. Champion, H.R.; Sacco, W.J.; Copes, W.S.; Gann, D.S.; Gennarelli, T.A.; Flanagan, M.E. A revision of the trauma score. J. Trauma 1989, 29, 623–629. [Google Scholar] [CrossRef] [PubMed]
  5. Baker, S.P.; O’Neill, B.; Haddon, W., Jr.; Long, W.B. The injury severity score: A method for describing patients with multiple injuries and evaluating emergency care. J. Trauma 1974, 14, 187–196. [Google Scholar] [CrossRef] [PubMed]
  6. Boyd, C.R.; Tolson, M.A.; Copes, W.S. Evaluating trauma care: The TRISS method. Trauma score and the injury severity score. J. Trauma 1987, 27, 370–378. [Google Scholar] [CrossRef] [PubMed]
  7. Raum, M.R.; Nijsten, M.W.; Vogelzang, M.; Schuring, F.; Lefering, R.; Bouillon, B.; Rixen, D.; Neugebauer, E.A.; Duis, H.J.T. Emergency trauma score: An instrument for early estimation of trauma severity. Crit. Care Med. 2009, 37, 1972–1977. [Google Scholar] [CrossRef]
  8. Imhoff, B.F.; Thompson, N.J.; Hastings, M.A.; Nazir, N.; Moncure, M.; Cannon, C.M. Rapid Emergency Medicine Score (REMS) in the trauma population: A retrospective study. BMJ Open 2014, 4, e004738. [Google Scholar] [CrossRef] [Green Version]
  9. Sartorius, D.; Le Manach, Y.; David, J.S.; Rancurel, E.; Smail, N.; Thicoipe, M.; Wiel, E.; Ricard-Hibon, A.; Berthier, F.; Gueugniaud, P.Y.; et al. Mechanism, glasgow coma scale, age, and arterial pressure (MGAP): A new simple prehospital triage score to predict mortality in trauma patients. Crit. Care Med. 2010, 38, 831–837. [Google Scholar] [CrossRef]
  10. Kondo, Y.; Abe, T.; Kohshi, K.; Tokuda, Y.; Cook, E.F.; Kukita, I. Revised trauma scoring system to predict in-hospital mortality in the emergency department: Glasgow coma scale, age, and systolic blood pressure score. Crit. Care 2011, 15, R191. [Google Scholar] [CrossRef] [Green Version]
  11. Abbasi, H.; Bolandparvaz, S.; Yadollahi, M.; Anvar, M.; Farahgol, Z. Time distribution of injury-related in-hospital mortality in a trauma referral center in South of Iran (2010–2015). Medicine 2017, 96, e6871. [Google Scholar] [CrossRef]
  12. Arslan, E.D.; Kaya, E.; Sonmez, M.; Kavalci, C.; Solakoglu, A.; Yilmaz, F.; Durdu, T.; Karakilic, E. Assessment of traumatic deaths in a level one trauma center in Ankara, Turkey. Eur. J. Trauma Emerg. Surg. 2015, 41, 319–323. [Google Scholar] [CrossRef]
  13. Clark, D.E.; Qian, J.; Sihler, K.C.; Hallagan, L.D.; Betensky, R.A. The distribution of survival times after injury. World J. Surg. 2012, 36, 1562–1570. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Gomes, E.; Araujo, R.; Carneiro, A.; Dias, C.; Lecky, F.E.; Costa-Pereira, A. Mortality distribution in a trauma system: From data to health policy recommendations. Eur. J. Trauma Emerg. Surg. 2008, 34, 561–569. [Google Scholar] [CrossRef]
  15. Gunst, M.; Ghaemmaghami, V.; Gruszecki, A.; Urban, J.; Frankel, H.; Shafi, S. Changing epidemiology of trauma deaths leads to a bimodal distribution. Bayl. Univ. Med. Cent. Proc. 2010, 23, 349–354. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Kleber, C.; Giesecke, M.T.; Tsokos, M.; Haas, N.P.; Schaser, K.D.; Stefan, P.; Buschmann, C.T. Overall distribution of trauma-related deaths in Berlin 2010: Advancement or stagnation of German trauma management? World J. Surg. 2012, 36, 2125–2130. [Google Scholar] [CrossRef] [PubMed]
  17. Sobrino, J.; Shafi, S. Timing and causes of death after injuries. Bayl. Univ. Med. Cent. Proc. 2013, 26, 120–123. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Trajano, A.D.; Pereira, B.M.; Fraga, G.P. Epidemiology of in-hospital trauma deaths in a Brazilian university hospital. BMC Emerg. Med. 2014, 14, 22. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Valdez, C.; Sarani, B.; Young, H.; Amdur, R.; Dunne, J.; Chawla, L.S. Timing of death after traumatic injury—A contemporary assessment of the temporal distribution of death. J. Surg. Res. 2016, 200, 604–609. [Google Scholar] [CrossRef]
  20. Hunt, R.C.K.J. American College of Surgeons Committee on Trauma. In Advanced Trauma Life Support Program for Doctors, 7th ed.; American College of Surgeons: Chicago, IL, USA, 2004. [Google Scholar]
  21. Jeong, J.H.; Park, Y.J.; Kim, D.H.; Kim, T.Y.; Kang, C.; Lee, S.H.; Lee, S.B.; Kim, S.C.; Lim, D. The new trauma score (NTS): A modification of the revised trauma score for better trauma mortality prediction. BMC Surg. 2017, 17, 77. [Google Scholar] [CrossRef]
  22. Baloglu, O.; Nagy, M.; Ezetendu, C.; Latifi, S.Q.; Nazha, A. Simplified pediatric index of mortality 3 score by explainable machine learning algorithm. Crit. Care Explor. 2021, 3, e0561. [Google Scholar] [CrossRef]
  23. Pang, J.; Huang, Y.; Xie, Z.; Li, J.; Cai, Z. Collaborative city digital twin for the COVID-19 pandemic: A federated learning solution. Tsinghua Sci. Technol. 2021, 26, 759–771. [Google Scholar] [CrossRef]
  24. Santos, P. The role of cardiovascular risk assessment in preventive medicine: A perspective from portugal primary health-care cardiovascular risk assessment. J. Environ. Public Health 2020, 2020, 1639634. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Flow diagram to show the development of TERMINAL-24 score.
Figure 1. Flow diagram to show the development of TERMINAL-24 score.
Healthcare 10 00577 g001
Figure 2. The distribution of TERMINAL-24 score by criterion-classified severity level; stacked bar charts with 0–100% bar for median/IQR (at 25%, 50%, and 75%); for each outcome group; the number in the bar chart represents the number of patients.
Figure 2. The distribution of TERMINAL-24 score by criterion-classified severity level; stacked bar charts with 0–100% bar for median/IQR (at 25%, 50%, and 75%); for each outcome group; the number in the bar chart represents the number of patients.
Healthcare 10 00577 g002
Figure 3. The discrimination of the probability of death based on TERMINAL-24 score. The dotted line represents the probability of overall death in 24 h, the dashed line represents the probability of death between 8 and 24 h, and the solid line represents the probability of death in under 8 h.
Figure 3. The discrimination of the probability of death based on TERMINAL-24 score. The dotted line represents the probability of overall death in 24 h, the dashed line represents the probability of death between 8 and 24 h, and the solid line represents the probability of death in under 8 h.
Healthcare 10 00577 g003
Figure 4. The area under ROC curve of TERMINAL-24 score in (A) death within 8 h and (B) death within 24 h.
Figure 4. The area under ROC curve of TERMINAL-24 score in (A) death within 8 h and (B) death within 24 h.
Healthcare 10 00577 g004
Figure 5. Risk curve of TERMINAL-24 score in (A) the death within 8 h group and (B) the death within 24 h group. The lines represent the predicted risks using TERMINAL-24 score. The circles represent the observed risks, and the size of circles represents the sample size.
Figure 5. Risk curve of TERMINAL-24 score in (A) the death within 8 h group and (B) the death within 24 h group. The lines represent the predicted risks using TERMINAL-24 score. The circles represent the observed risks, and the size of circles represents the sample size.
Healthcare 10 00577 g005
Table 1. Characteristics of patients with major trauma, criterion-classified into three levels of severity.
Table 1. Characteristics of patients with major trauma, criterion-classified into three levels of severity.
Patient CharacteristicsDead < 8 h Dead 8–24 h Alive at 24 h p-Value *Missing
n = 46n = 123n = 3004
n (%)n (%)n (%) n (%)
DemographicsMale 39 (84.8)85 (69.1)2179 (72.5)0.3620
Age ≥ 50 years13 (28.3)53 (43.1)1031 (34.3)0.5660
Vital signsSBP < 90 mmHg14 (30.4)15 (12.3)278 (9.3)<0.00125 (0.79)
DBP < 60 mmHg17 (37)27 (22.1)559 (18.8)0.00325 (0.79)
PR ≥ 120/min17 (37)25 (20.5)450 (15.1)<0.00118 (0.57)
Abnormal RR (<10, >30/min)22 (47.8)46 (37.7)722 (24.1)<0.00112 (0.38)
Mechanism of injuryTraffic 24 (52.2)75 (61)1432 (47.8)0.0269 (0.28)
Fall 10 (21.7)30 (24.4)675 (22.5)0.8280
Assault 7 (15.2)27 (22)426 (15)0.1030
Type of injuryBlunt 33 (71.7)66 (55)2058 (68.7)0.11111 (0.35)
Penetrating 2 (4.3)7 (5.8)107 (3.6)0.31411 (0.35)
Combination 3 (6.5)15 (12.5)373 (12.5)0.35211 (0.35)
Other 8 (17.4)32 (26.7)458 (15.3)0.01811 (0.35)
Glasgow Coma ScaleMild (14–15)19 (41.3)71 (58.2)2103 (70.2)<0.00111 (0.35)
Moderate (9–13)1 (2.2)12 (9.8)321 (10.7)0.16511 (0.35)
Severe (3–8)26 (56.5)39 (32)570 (19)<0.00111 (0.35)
Transfer byEMS34 (74)66 (53.7)1751 (58.3)0.309217 (6.84)
Referral 12 (26)58 (47.2)1213 (40.4)0.5570
* p-value from nonparametric test for trend; SBP: systolic blood pressure; DBP: diastolic blood pressure; PR: pulse rate; RR: respiratory rate; EMS: emergency medical service; mmHg: millimeters of mercury; min: minutes.
Table 2. Significant predictors of the three time bands of death (dead ≤ 8 h, dead 8–24 h, alive at 24 h) and assigned item score.
Table 2. Significant predictors of the three time bands of death (dead ≤ 8 h, dead 8–24 h, alive at 24 h) and assigned item score.
Predictors Category OR95% CIp-ValueCoefficient *Score
Systolic blood pressure (mmHg)<90 mmHg1.881.28, 2.750.0010.631
≥90 mmHg1ref 0
Pulse (/min)≥120 mmHg1.841.32, 2.56<0.0010.611
<120 mmHg1ref 0
Glasgow Coma ScaleSevere (3–8)2.711.98, 3.70<0.0011.002
Mild to moderate (9–15)1ref 0
Traffic injuryYes 1.761.31, 2.38<0.0010.571
No 1ref 0
* Coefficients from multivariable continuation ratio logistic regression; OR: odds ratio; CI: confidence interval, ref: reference category; mmHg: millimeters of mercury; min: minutes. (TERMINAL-24 score = 1 * hypotension (SBP < 90) + 1 * tachycardia (HR ≥ 120) + 2 * coma (Glasgow coma scale < 9) + 1 * traffic injury).
Table 3. TERMINAL-24 score of three groups: death within 8 h, death between 8 and 24 h, and alive at 24 h. The sensitivity and specificity were calculated for the score in the following groups: death in under 8 h and death between 8 and 24 h. The mortality rate is shown in association with the TERMINAL-24 score.
Table 3. TERMINAL-24 score of three groups: death within 8 h, death between 8 and 24 h, and alive at 24 h. The sensitivity and specificity were calculated for the score in the following groups: death in under 8 h and death between 8 and 24 h. The mortality rate is shown in association with the TERMINAL-24 score.
TERMINAL-24 ScoreDeath within
8 h
Death between
8 and 24 h
Survival at 24 hMortality Rate (%)
nSensitivitySpecificitynSensitivitySpecificityn
050.890.32150.880.329492.06
1110.650.73510.460.7312054.89
250.540.89310.200.894767.03
3150.220.98200.040.9826711.59
490.020.9850.000.987316.09
510.001.0000.001.00150.00
Table 4. Score-classified levels of urgency, criterion-classified levels of severity, and validity of risk estimation validity.
Table 4. Score-classified levels of urgency, criterion-classified levels of severity, and validity of risk estimation validity.
Score-Classified Urgency LevelsScore RangeCriterion-Classified Severity LevelsRisk Estimation Validity *
Alive at 24 hDead 8–24 hDead < 8 hOverCorrectUnder
n = 2971n = 122n = 46(%)(%)(%)
Median (IQR) 1 (0,2)1 (1,2)3 (1,3)
Low riskn = 27480–226309721-83.83.8
Moderate risk n = 302326720158.50.60.5
High riskn = 894–5745102.50.3-
Total1184.74.3
* Percentage of total patients; h: hours.
Table 5. Score-classified levels of urgency, criterion-classified levels of severity, likelihood ratio of positive, 95% confidence interval, and p-value.
Table 5. Score-classified levels of urgency, criterion-classified levels of severity, likelihood ratio of positive, 95% confidence interval, and p-value.
Score-Classified Urgency LevelsScore RangeCriterion-Classified Severity LevelsLHR+95% CIp-Value
Alive at 24 hDead 8–24 hDead < 8 h
n = 2971n = 122n = 46
Low riskn = 27480–2263097210.50.5–1.00.007
Moderate risk n = 302326720153.61.9–4.7<0.001
High riskn = 894–5745108.74–13.5<0.001
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Samuthtai, W.; Patumanond, J.; Samutrtai, P.; Charernboon, T.; Jearwattanakanok, K.; Khorana, J. Clinical Prediction Scoring Scheme for 24 h Mortality in Major Traumatic Adult Patients. Healthcare 2022, 10, 577. https://doi.org/10.3390/healthcare10030577

AMA Style

Samuthtai W, Patumanond J, Samutrtai P, Charernboon T, Jearwattanakanok K, Khorana J. Clinical Prediction Scoring Scheme for 24 h Mortality in Major Traumatic Adult Patients. Healthcare. 2022; 10(3):577. https://doi.org/10.3390/healthcare10030577

Chicago/Turabian Style

Samuthtai, Waratsuda, Jayanton Patumanond, Pawitrabhorn Samutrtai, Thammanard Charernboon, Kijja Jearwattanakanok, and Jiraporn Khorana. 2022. "Clinical Prediction Scoring Scheme for 24 h Mortality in Major Traumatic Adult Patients" Healthcare 10, no. 3: 577. https://doi.org/10.3390/healthcare10030577

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop