Abstract
Background/Objectives: It is essential to identify acute myocardial infarction patients with greater risk of deterioration following primary percutaneous coronary intervention. Due to an inconsistent result about predictors of 30-day outcomes regarding scoring systems for the first episode of acute myocardial infarction, the objective of this study is to develop novel scoring systems to predict 30-day mortality among patients with a first episode of acute myocardial infarction who underwent primary percutaneous coronary intervention. Methods: This retrospective study was conducted with total sampling for all patients with first-time acute myocardial infarction who underwent primary percutaneous coronary intervention between 2021 and 2024 at Dr. Soetomo Hospital, Indonesia. We performed a total sampling and collected 1714 patients, of which 1535 patients were included. Our primary outcomes included 30-day mortality. Results: The analysis included 1535 patients: 926 in the derivation set and 609 in the validation set. In our study, the 30-day mortality rate was 20.7%. Multivariate logistic regression analysis was used to build prediction models in the derivation group and then validated in the validation cohort. The area under the ROC curve of the RURUS SURYAWAN score to predict 30-day mortality was 0.944 (0.906–0.972) in the derivation set and 0.959 (0.921–0.983) in the validation set, with 94.6% sensitivity and 97.3% specificity (p < 0.001). Conclusions: After adjusting for potential confounders, we developed RURUS SURYAWAN, a novel scoring system to identify predictors of 30-day mortality among acute myocardial infarction before primary percutaneous coronary intervention.
1. Introduction
The mortality rate of acute myocardial infarction has significantly decreased in the last decade due to the invention of primary percutaneous coronary intervention by Geoffrey Hartzler in the early 1980s []. The prognosis of acute myocardial infarction after the invention of primary percutaneous coronary intervention is better []. Every time earlier, reperfusion treatment results in an improvement in mortality rate, and primary percutaneous coronary intervention is still a treatment of choice for acute myocardial infarction []. Almost all reports showed a consequent reduction in mortality in acute myocardial infarction patients compared with thrombolysis, which was insufficient to assess the extent of the improvement []. Unfortunately, according to several reports, residual 30-day mortality among patients with acute myocardial infarction who underwent primary percutaneous coronary intervention is still high, ranging from 5–10%, especially in developing countries []. Data conducted by Pramudyo et al. (2022) revealed that Indonesia ranked fourth in the world for the highest mortality rate of acute myocardial infarction patients compared to 186 other countries []. The 30-day mortality rate of acute myocardial infarction in Indonesia was approximately 10.6% for patients with acute myocardial infarction []. Still, this number is higher when compared to the mortality rate in other Asian countries (5%), as well as European (4–8%) and American (6–9%) countries [,,].
The high mortality rate of acute myocardial infarction in Indonesia has attracted much attention from cardiologists and is influenced by many factors, such as demographic factors, a history of cardiovascular risk factors, clinical presentation, and the results of investigations and management in the hospital []. The high mortality rate in patients with acute myocardial infarction has also raised particular concerns for cardiologists to develop a method to accurately identify patients who are at high risk so that awareness can be increased to reduce the risk of death [,]. Over the last 2 decades, there are several prognostic tools developed in the field of acute myocardial infarction: Global Registry of Acute Coronary Events (GRACE), Thrombolysis in Myocardial Infarction (TIMI), Platelet Glycoprotein IIb/IIIa in Unstable Angina: Receptor Suppression Using Integrilin (PURSUIT), Oxford Acute Severity of Illness Score (OASIS), Logistic Organ Dysfunction System (LODS), and Simplified Acute Physiology Score (SAPS II) [,,,,,].
The GRACE score was established to assess 30-day mortality and identify high-risk groups among patients with acute myocardial infarction globally []. For global use, the GRACE score demonstrated a superior predictive power for 1-year mortality due to acute myocardial infarction compared with other scoring systems, such as the TIMI and PURSUIT risk scores [,]. The TIMI and GRACE risk scores were calculated using data from a Western Caucasian cohort with limited participation from an Asian cohort. Asian patients have been understudied [,].
OASIS was proposed in 2013 by machine-learning algorithms. This scoring system has achieved better predictive models for ICU mortality with an area under the receiver operating characteristic curve of 0.88 with only 10 simplified parameters []. Unfortunately, this machine-learning technique requires the collection of numerous physiologic measurements, known as particle swarm optimization, making their applications in clinical practice difficult []. In China, Wang et al. (2021) introduced a 30-day mortality predictor for ST-Elevation Myocardial Infarction (STEMI) patients known as the LODS scoring system []. LODS is an organ dysfunction-based scoring system that should be calculated within the first 24 h of admission. LODS permits the calculation of predicted mortality based on the organ dysfunction score on the day of ICU admission []. With a more concise composition of the local population and greater clinical benefit, LODS may be a better predictor of 30-day mortality for intensive care patients with STEMI in China [].
As many countries developed their own scoring system based on their own data, Indonesia still does not have a local registry nor a scoring system for predictors of 30-day mortality among patients with acute myocardial infarction or acute coronary syndrome [,,]. Since Indonesia had higher mortality for acute myocardial infarction compared to other Asian or Western countries, existing scoring systems were found to be insufficient in predicting 30-day mortality among our local patients. Patient clinical characteristics, genetics, local cultures, and centre performances may affect the results and may even cause the scoring system to overestimate the mortality rate. An accurate scoring system could guide the decisions of treatment in clinical practice and improve the prognosis. For example, the clinical strategies for acute myocardial infarction patients have changed dramatically over a relatively long time period (from 2008 to 2019), from early complete revascularization of all vessels to culprit vessel-only revascularization, indication for CABG and potent antiplatelet, etc. Thus, the aim of this study is to develop a novel scoring system to predict 30-day mortality of patients with firstly diagnosed acute myocardial infarction after primary percutaneous coronary intervention at Dr. Soetomo General Academic Hospital, Surabaya, Indonesia based on our own data and variables, which are obtained before Primary Percutaneous Coronary Intervention (PCI).
2. Materials and Methods
2.1. Study Population and Design
This retrospective study was conducted at Dr. Soetomo General Academic Hospital, Surabaya, as a tertiary referral hospital in Indonesia from 2021 to 2024. The data collected included the baseline demographics, clinical characteristics, comorbidities, laboratory, echocardiography, and angiography parameters, and we compared it with 30-day mortality rate of first episode of acute myocardial infarction for patients who underwent primary percutaneous coronary intervention during hospital admission. This study has been approved by the Health Research Ethics Committee of the Dr. Soetomo General Academic Hospital, Surabaya. The study was conducted according to the guidelines of the Declaration of Helsinki. The patients in the database are anonymous.
2.2. Inclusion and Exclusion Criteria
The population of this study consisted of hospitalized patients with first episode of acute myocardial infarction who underwent primary percutaneous coronary intervention at Dr. Soetomo General Academic Hospital, Surabaya. The inclusion criteria were: (a) adults aged above 18 years; (b) those admitted to the hospital for the first time with emergency causes or complications from first episode of acute myocardial infarction; (c) those who underwent primary percutaneous coronary intervention with total or subtotal occlusion coronary artery from cardiac catheterization; (d) those willing to participate in the study by signing the informed consent form; (e) those who underwent anamnesis and had 50 mL blood taken for laboratory examination; and (f) those able to be followed up at least 1 month after hospitalization. The exclusion criteria were: (a) those admitted for elective procedures; (b) presence of other unrelated diseases such as primary valvular heart disease, congenital heart disease, liver cirrhosis, malignancy, tuberculosis, or HIV/AIDS; (c) history of mechanical circulatory support such as intra-aortic balloon pump or extracorporeal membrane oxygenation; (d) special or vulnerable patients such as prisoners or homeless individuals; and (e) history of cardiac arrest before primary percutaneous coronary intervention.
2.3. Statistical Analysis
Statistical analyses were performed using IBM SPSS Statistics for Windows Operating System, version 26.0 software (IBM Corp., Armonk, NY, USA), STATA software, version 15.0 (Stata Corporation, College Station, TX, USA), and R statistics 4.0.3 with the “glmnet” package (R Foundation for Statistical Computing, Vienna, Austria). Baseline characteristics such as gender, age, and categories were described as a proportion if the data were categorical and described as mean or median. Clinical characteristics and comorbidities, such as laboratory, echocardiography, and angiography parameters, were tested using the Multivariate Cox Regression test. A p-value below 0.05 was declared statistically significant. The scoring system was assessed to develop the score for each predictor variable contributing to 30-day mortality. To avoid the occurrence of intercorrelation among two or more independent variables, multicollinearity was assessed by examining tolerance and the Variance Inflation Factor (VIF). Primary outcome was 30-day mortality. The score was calculated using the beta coefficient and standard error. The predictive values of our novel risk score were assessed by receiver operating characteristic curve (ROC) analysis (using MedCalc Version 12.2.1; MedCalc Software, Mariakerke, Belgium), applying net reclassification and integrated discrimination improvement. Prognostic utility of the risk models for 30-day mortality has been assessed by deriving their C-statistics, using ROC curves. The final scores were classified based on the risk of acute myocardial infarction patients with high, moderate, and low mortality rates.
In the derivation set, we performed multivariable logistic regression model to determine predictors for 30-day mortality. We use the Least Absolute Shrinkage and Selection Operator (LASSO) logistic regression algorithm in order to obtain a subset of predictor variables from the 20 candidate variables. The LASSO algorithm can select from the set of candidate variables that achieve greater importance once regularized. The LASSO algorithm finds the variables that contribute the least in the logistic regression model and forces them to have coefficients equal to zero. A prior LASSO (pLASSO) was also conducted to incorporate prior information into the generalized linear models and to improve the prediction accuracy for each variable, which were also identified as statistically significant variables using multivariate likelihood ratio (LR). We have removed multicollinear predictors before LASSO to lessen the variance inflation of the standard errors of our variables. For binary variables entered into the multivariate LR model mentioned previously, potential non-linearity in the prediction of 30-day mortality was explored using two-stage prior LASSO (TSPLASSO). To check the stability in the selection of variables and in the calculation of the coefficients of the logistic regression, an analysis with random partitions of the derivation and validation sets was conducted. One hundred sets of derivation have been created randomly with the same number of records as those used in the temporal validation (n = 926). The LASSO variable selection methodology has been applied to each of these sets, and the corresponding logistic regression coefficients have been calculated. These results were compared with those obtained in the temporal validation.
3. Results
This retrospective study evaluates 30-day mortality from 1535 patients assigned to Dr. Soetomo General Academic Hospital with the first episode of acute myocardial infarction and having undergone primary percutaneous coronary intervention during hospital admission. The Hosmer–Lemeshow statistic was 3.56df8, (p = 0.795). The C statistic for the model in the test cohort was 0.85.
3.1. Baseline Characteristics
A total of 1714 patients assigned to Dr. Soetomo General Academic Hospital with the first episode of acute myocardial infarction and having undergone primary percutaneous coronary intervention during hospital admission were screened. All 1714 eligible patients were randomly divided into a derivation (n = 926, 60.33%) and a validation (n = 609, 39.67%) group, according to the grouping method from the previous study (Table 1).
Table 1.
Baseline characteristics of study participants.
3.2. Model Development
For the derivation group, Table 2 shows the variables selected using regression analysis, which were associated with 30-day mortality from univariate analysis. Statistically significant variables screened from the univariate analysis were included in the non-conditional binary multivariate logistic regression. Univariate and multivariate logistic regression identified several variables, as shown in Table 2, as the most significant mortality risk predictors. Heart rate at discharge was related to 1-year mortality after adjustment for these variables (hazard ratio 1.13; 95% confidence interval [CI], 1.03–1.24 per 10 beats per minute, p = 0.02). We performed LASSO regression with prior LASSO (pLASSO) to incorporate prior information into the generalized linear models and to improve the prediction accuracy for each variable, which were also identified as statistically significant variables using multivariate likelihood ratio (LR). For binary variables entered into the multivariate LR model mentioned previously, potential non-linearity in the prediction of 30-day mortality was explored using two-stage prior LASSO (TSPLASSO).
Table 2.
Univariate and multivariate logistic regression analysis variables.
3.3. RURUS SURYAWAN as Novel Risk Score for 30-Day Mortality Among Acute Myocardial Infarction Patients Undergoing Primary Percutaneous Coronary Intervention
After obtaining results from univariate and multivariate logistic regression analysis, we developed a novel score “RURUS SURYAWAN” to predict 30-day mortality among first-diagnosed acute myocardial infarction patients undergoing primary percutaneous coronary intervention (Table 3).
Table 3.
RURUS SURYAWAN score assignment.
The estimated multivariate logistic regression model with the 30-day mortality risk score demonstrated excellent calibration-in-the-large, with an intercept of 0.016. The difference in the log-odds ratio between predictions and observed outcomes in the validation group was statistically significant (p = 0.009). When the logistic regression model was recalibrated to the derivation group and applied to subjects in the validation group, it demonstrated good calibration-in-large, and the calibration slope was significantly different (p < 0.001). The concordance between the observed probability of 30-day mortality and the predicted probability of 30-day mortality across the 13 vigintiles of variables in the validation sample is described in Figure 1. The Hosmer–Lemeshow X2 statistic of the full model was 3.56 (p = 0.795).
Figure 1.
Observed and predicted 30-day mortality based on RURUS SURYAWAN score (maximum 13 points).
When assigning a point score, each variable in Table 3 had one point assigned. Therefore, a total of 13 points could be assigned. The score ranged from 0 to 13, and mortality rates increased with a higher score (p trend < 0.0001). After grouping patients into low risk (0–3 points), intermediate risk (4–6 points), high risk (7–9 points), and very high risk (10–13 points) in classification groups (Table 4), most deaths occurred in the high-risk and very-high-risk groups. Mortality rates were <1%, 2–5%, 8–30%, and >50% in low-risk, intermediate-risk, high-risk, and very-high-risk groups, respectively (p trend < 0.001). This trend persisted when using multiple imputations or a conservative analytical approach, as seen in Figure 1.
Table 4.
RURUS SURYAWAN score stratification.
4. Discussion
We developed and validated the RURUS SURYAWAN score, an improvisation from the previous risk model to predict 30-day mortality for first-diagnosed acute myocardial infarction patients after primary percutaneous coronary intervention. The RURUS SURYAWAN scoring system contains 13 variables, with a score range from 0–13. The final parsimonious scoring systems do not require any collection of sophisticated parameters, making their applications in clinical practice easier and quicker than other scoring systems. This model includes resting heart rate (>110 bpm), underweight (BMI < 18 kg/m2), respiratory rate (>28/min), first 24 h urine output (<0.5 mL/kg BW/hour), peripheral O2 saturation (<90%), systolic blood pressure during admission (<90 mmHg), urea nitrogen (>50 mg/dL), reduced ejection fraction (<40%), timing of primary percutaneous coronary intervention (door-to-balloon time >2 h), age (>70 years old), sex (women), anemia (Hb < 10 g/dL), and elevated NT-proBNP (>1500 pg/mL) as factors for risk adjustment. The model performed well in an independent validation cohort. A simplified integer score based on this model also performed well and can potentially serve as a foundation for prospective risk stratification at the point of care.
The RURUS SURYAWAN score is stratified into low-risk, intermediate-risk, and high-risk categories based on 13 variables, as mentioned in Table 3. The scores vary from “0-to-13-point scores”. As seen in Table 4, a score of 0–3 indicates a patient is at “low risk” and advises consideration of routine or usual care after primary PCI, and further investigations can be planned during outpatient department visits. Our study saw 30-day mortality for less than 1% of low-risk patients. Patients with a score of 4–6 are classified as “intermediate risk”, and they are usually considered safe but sometimes require monitoring as they have a 2–5% risk of 30-day mortality. Patients with a score of 7–9 are classified as “high risk”, and they require strict clinical observation, including longer duration of intensive care. About 8–30% of high-risk patients had 30-day mortality in our study. Patients with a score of 10–13 are deemed “very high risk” with a more than 50% risk of 30-day mortality and require early aggressive care with very close hemodynamic monitoring during a 30-day stay.
The calculated area under the ROC curve for the RURUS SURYAWAN score to predict 30-day mortality was 0.944 (0.906–0.972) in the derivation set and 0.959 (0.921–0.983) in the validation set, with 94.6% sensitivity and 97.3% specificity (p < 0.001). It was non-inferior compared to the existing score. AUROC for the HAS-BLED score was 0.717 (0.680–0.752), with 85.1% sensitivity and 51.5% specificity (p < 0.001), whilst AUROC for the TIMI score was 0.844 (0.813–0.871), with a 91.0% sensitivity and 61.6% specificity (p < 0.001). AUROC for LODS was 0.867 (0.834–0.895), AUROC for OASIS was 0.827 (0.792–0.859), and AUROC for SAPS II was 0.894 (0.864–0.919), as seen in Table 5 [,,].
Table 5.
Comparison of ROC curves between each scoring system.
In the literature, mostly comparable results were found when comparing the RURUS SURYAWAN score with the HEART score, TIMI score, ACUITY score, CRUSADE score, and GRACE score. In previous study, the AUC of the HEART score was 0.83 (95% CI: 0.81–0.85), the AUC of the TIMI score was 0.844 (95% CI: 0.813–0.871), the AUC of the ACUITY score was 0.72 (95% CI: 0.69–0.75), the AUC of the CRUSADE score was 0.64 (95% CI: 0.61–0.68), and the AUC of the GRACE score was 0.78 (95% CI: 0.75–0.81), which are slightly lower than our AUC of RURUS SURYAWAN score, which was 0.944 (0.906–0.972) in the derivation set and 0.959 (0.921–0.983) in the validation set [,]. The TIMI risk score estimates mortality based on: age ≥65, ≥3 coronary artery disease (CAD) risk factors, known CAD (stenosis ≥ 50%), aspirin use in the past 7 days, severe angina (≥2 episodes in 24 h), ST-segment deviation ≥0.5 mm, and positive cardiac markers. The GRACE risk score was calculated by the eight different baseline variables incorporated in the risk calculator: age, heart rate (beats per minute), systolic blood pressure, serum creatinine level, cardiac arrest at admission, ST-segment deviation on ECG, elevated cTn, and congestive heart failure (Killip class).
Scoring systems and prediction models have become essential tools in clinical practice for the stratification of acute myocardial infarction patients. A valid, reliable, and accurate scoring system could help to identify priority and individual criterion scores. Personalized medicine seeks to derive tailored therapies for each acute myocardial infarction patient based on their risk. Any measurable score can be used as a basis to stratify patient risks and guide the treatment. Scoring systems and prediction models are very useful in the physician’s arsenal to facilitate appropriate decision-making processes and to weigh the benefits and risks of any high-risk percutaneous coronary intervention [], especially to achieve early complete revascularization.
In our retrospective study, several predictors were associated with higher 30-day mortality. Relevant risk factors included vital signs. Vital signs are easy and inexpensive to measure, and when they are measured under controlled conditions, the results are highly reproducible. There are no technical or financial barriers to its incorporation during 30 days of follow-up. Deterioration in vital signs due to acute myocardial infarction is known to indicate a worsened prognosis. Thus, close and intense monitoring, early recognition of deterioration, and appropriate treatment to intervene in vital signs during hospital admission may be beneficial to improve the prognosis of AMI patients. Cardiac arrest has been shown to be a strong important predictor of AMI mortality from several reports []. Nevertheless, we decided not to include cardiac arrest since we faced difficulty in adjusting risk for these events due to their heterogeneity in clinical severity, and the inclusion of these patients in hospital scorecards for percutaneous coronary intervention can result in unintended consequences to withhold aggressive treatment.
One of the most important predictors of mortality is the resting heart rate. This study is in line with the study from Jabre, et al. (2014), which revealed that elevated resting heart rate at the time of the acute myocardial infarction identifies patients at increased risk of all-cause and cardiovascular mortality []. Even though heart rate measured upon admission is dependent on the sympathetic activity due to chest pain, stress, or anxiety, Jabre et al. (2014) found that resting heart rate upon admission was still a strong prognostic marker of all-cause and cardiovascular mortality for resting heart rate > 110 bpm and cardiovascular mortality only for resting heart rate > 80 bpm during admission []. Indeed, resting heart rate might theoretically contribute to increased mortality by increasing myocardial oxygen consumption, thus worsening ischemia, increasing infarct size, and stimulating atherosclerotic progression and plaque instability [].
Regarding blood urea nitrogen, according to Zhu et al. (2022), blood urea nitrogen was robustly associated with increased short-term mortality in patients with acute myocardial infarction developing cardiogenic shock []. Horiuchi et al. (2018) also found that blood urea nitrogen is a strong predictor for 30-day mortality among acute myocardial infarction patients [].
The inclusion of ejection fraction obtained from transthoracic echocardiography may add significant prognostic information. A previous report from Bosch and Théroux (2005) revealed that adding baseline LVEF into the model improved the prediction of mortality (C statistic 0.73 vs. 0.67) [].
Individual patient data from four trials (CAPRICORN, EPHESUS, OPTIMAAL, and VALIANT) showed that LVEF is a ubiquitous risk marker associated with death, regardless of the type of AMI. Thus, recent clinical practice guidelines recommended an initial measurement of LVEF for patients with STEMI and NSTEMI because LVEF has both prognostic and therapeutic significance for acute myocardial infarction patients []. Unfortunately, significant variability in LVEF measurement rates across clinicians remains.
Additionally, our study results showed that delayed primary percutaneous coronary intervention poses a greater risk of 30-day mortality among patients with first-diagnosed acute myocardial infarction patients. Data from the Thailand PCI registry in 2006 showed the median door-to-device time for AMI patients was 122 min, and the overall mortality rate was 17.0% []. Existing studies have also revealed that the impact of short door-to-device time, particularly those smaller than 60 min, on patient mortality remains debatable []. Tsukui, et al. (2020) observed that a longer duration of primary PCI > 2 h was significantly linked with 30-day mortality from all causes despite correcting for cardiogenic shock, arrhythmia, or kidney injury []. However, shortening door-to-device time < 1 h was not related to mortality from any cause in the multivariate Cox regression analysis []. Consistent with our study, in AMI patients treated with primary PCI, door-to-device time longer than 120 min (2 h) was related to 30-day mortality, but a door-to-device time of less than 60 min (1 h) was not associated with a survival benefit (OR 1.89, 95% CI: 1.56–2.37, p = 0.002).
Age is one of the most important predictors of survival after acute myocardial infarction. Older patients have a greater risk of 30-day mortality due to recurrent myocardial infarction, heart failure, cardiogenic shock, atrioventricular block, and atrial fibrillation or flutter. In the angiographic substudy of the GUSTO-III trial, older patients had greater risk for TIMI grade 0 flow and lower rates of TIMI grade 3 flow, more multivessel disease, and lower left ventricular ejection fractions []. Older patients had their own risk for all-cause mortality due to their anatomic complexity, physiological vulnerability, age-related risks (including prevalent geriatric syndromes), multimorbidity, frailty, disability, cognitive decline, polypharmacy, heterogeneity in life expectancy, and goals of care [].
Compared to men, women tend to have significantly higher in-hospital mortality for acute myocardial infarction, according to our study. There are several hypothetical reasons why women have poorer prognosis: women who got acute myocardial infarction are generally older during their hospitalization and have higher comorbidity rates than men. Previous reports have suggested that women have longer delays from symptom onset to hospitalization due to several uncertainties in diagnosis and, as a result, tend to have higher 30-day mortality rates for acute myocardial infarction than men []. There is one study that revealed that women experiencing acute myocardial infarction died more frequently than men (9.3% vs. 6.1%, p < 0.01) [].
Anemia is also recognized as a strong, independent risk factor for mortality after acute myocardial infarction. The prevalence of anemia is 28% among acute myocardial infarction patients who underwent primary percutaneous coronary intervention. Our study suggested a significantly increased risk for 30-day mortality in acute myocardial infarction patients with anemia (Hb < 10 g/dL) once various confounding conditions were adjusted for. A previous study revealed that overall mortality in each group containing patients with anemia was higher than in the corresponding non-anemic groups []. From the Myocardial Ischemia National Audit Project (MINAP) registry, anemia is independently associated with 30-day (OR 1.28, 95% CI 1.22–1.35) and 1-year mortality (OR 1.31, 95% CI 1.27–1.35), with a reverse J-shaped relationship between hemoglobin levels and mortality outcomes []. In the setting of acute myocardial infarction, anemia might worsen ischemia by decreasing the oxygen delivery to the jeopardized myocardium and increasing myocardial oxygen demand due to greater cardiac output to maintain adequate systemic oxygen delivery []. Also, patients with anemia are often underprescribed antiplatelet therapy due to bleeding concerns [].
Lastly, NT-proBNP also has an incremental prognostic value for 30-day mortality over and beyond the TIMI risk score and the GRACE risk calculator. Data concerning optimal timing to measure NT-proBNP during acute myocardial infarction are limited. One of the aforementioned studies, which confirmed the additional value of NT-proBNP, was based on measurements at 24–96 h []. Another study revealed that NT-proBNP values upon admission were significantly higher in patients who died compared to those who survived []. Thus, it is consistent with our findings that NT-proBNP had a good and comparable predictive value for 30-day mortality.
4.1. Strength
As far as we know, the RURUS SURYAWAN score has the strongest AUC with better sensitivity and specificity to discriminate 30-day mortality in the disease-specific cohorts among Asian patients with a first episode of acute myocardial infarction who underwent primary percutaneous coronary intervention during hospital admission. Our study used a combination of derivation and validation feature selection methods. Cross-validation and hyperparameter tuning improved model performance and reduced over-fitting risk. A LASSO regression with prior LASSO (pLASSO) was used to incorporate prior information into the generalized linear models and to improve the prediction accuracy for each variable, which were also identified as statistically significant variables using multivariate likelihood ratio (LR). To ensure the current study’s reliability, all models were validated using untouched validation data that were not used for model construction. We expect our score to be further externally validated in different databases, allowing for additional comparison with other scores.
4.2. Limitation
There are certain limitations to our current study. Firstly, the RURUS SURYAWAN score that we developed was for predicting 30-day mortality. The scores have not been validated for predicting mortality within different time frames. Secondly, it requires the collection of variables during admission, making their applications in clinical practice difficult. We attempted to mitigate this effect by using easily obtained variables in the emergency ward. On the other hand, we recognized that several missing variables could result in a skewed outcome. We try to handle missing data by pairwise deletion. Other potential limitations of this study should be acknowledged. Since this research is based on a single-centre retrospective study, this study inevitably has a particular selection bias. We believed that our limitation of a single-centre study might have been contradicted when tested in other settings, thus limiting its indication to be applied outside of our centre. Fortunately, since Dr. Soetomo General Academic Hospital is the biggest referral hospital for the eastern part of Indonesia, we did believe that our subjects were representable enough to be implemented as a novel scoring system for Indonesian patients. Therefore, further studies with larger samples and multicentre cohort should be done to test the external validity of our novel scoring system and to enhance generalizability once our manuscript has been published. We expect that subsequent investigations conducted in the multicentre study will corroborate our findings.
5. Conclusions
We developed a RURUS SURYAWAN score, a scoring system to predict risks of 30-day mortality among patients diagnosed with acute myocardial infarction. The variables are easily obtainable upon admission and do not require complex examinations to be observed before primary percutaneous coronary intervention. This risk model for 30-day mortality could evaluate interventions to improve the outcomes of patients with acute myocardial infarction. Although it has achieved adequate internal validation, it must be externally validated.
Author Contributions
Conceptualization, I.G.R.S. and R.A.N.; methodology, I.G.R.S. and R.A.N.; software, D.N.; validation, Y.H.O., B.B.D., A.P.H. and M.Y.A.; formal analysis, P.B.T.S. and R.A.N.; investigation, I.G.R.S. and M.E.R.S.E.; resources, M.E.R.S.E.; data curation, M.E.R.S.E.; writing—original draft preparation, R.A.N.; writing—review and editing, Y.H.O., B.B.D., A.P.H. and M.Y.A.; visualization, R.A.N.; supervision, Y.H.O., B.B.D., A.P.H. and M.Y.A.; project administration, I.G.R.S. and R.A.N.; funding acquisition, I.G.R.S. All authors have read and agreed to the published version of the manuscript.
Funding
A research grant was obtained from the Universitas Airlangga Health Research and Development Grant (Project number: 055/PAN.KKE/VI/2023) as part of the Sustainable Development Goals. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The opinions, results, and conclusions reported in this paper are those of the authors and are independent of the funding sources. No endorsement by the Faculty of Medicine Universitas Airlangga or Dr. Soetomo General Academic Hospital is intended or should be inferred.
Institutional Review Board Statement
The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of Dr. Soetomo General Academic Hospital, Surabaya (0135/KEPK/I/2021) on 29 January 2021 under the name of I Gde Rurus Suryawan as the principal investigator.
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study. Written informed consent has been obtained from the patient(s) to publish this paper.
Data Availability Statement
The data belong to the Division of Interventional Cardiology, Department of Cardiology and Vascular Medicine, Faculty of Medicine Universitas Airlangga—Dr. Soetomo General Academic Hospital and require institutional agreements for data release to third parties. Hence, ethical approval is needed for analysis. However, data are available from the Division of Interventional Cardiology, Department of Cardiology and Vascular Medicine, Faculty of Medicine Universitas Airlangga—Dr. Soetomo General Academic Hospital upon reasonable request by emailing them at kardiologiunair@gmail.com.
Acknowledgments
The authors thank all patients, cardiology residents, nurses, secretaries, and local laboratories for their kind assistance, especially their extensive help during the data collection. Furthermore, we would like to thank Budi Santoso and Cita Rosita Sigit Prakoeswa as Dean of Airlangga School of Medicine and Director of Dr. Soetomo General Academic Hospital for allowing this research to be held in Universitas Airlangga—Dr. Soetomo General Academic Hospital, and for their permission to publish this manuscript. We also thank Fita Triastuti for her secretarial support and Andrianto for performing the editorial translation. We also acknowledge the Indonesian Heart Association for its technical support.
Conflicts of Interest
The authors declare no conflicts of interest.
Abbreviations
The following abbreviations are used in this manuscript:
| ACS | Acute Coronary Syndrome |
| AMI | Acute Myocardial Infarction |
| AUC | Area under the curve |
| AUROC | Area under the receiver operating characteristic |
| CAPRICORN | CArvedilol Post-infaRct survIval COntRolled evaluatioN |
| EPHESUS | Eplerenone in patients with heart failure due to systolic dysfunction complicating acute myocardial infarction |
| GRACE | Global Registry of Acute Coronary Events |
| GUSTO | Global Utilization of Streptokinase and Tissue Plasminogen Activator for Occluded Coronary Arteries |
| ICU | Intensive Care Unit |
| LASSO | Least Absolute Shrinkage and Selection Operator |
| MINAP | Myocardial Ischemia National Audit Project |
| NSTEMI | Non-ST-Elevation Myocardial Infarction |
| NT-proBNP | N-terminal prohormone of brain natriuretic peptide |
| OASIS | Oxford Acute Severity of Illness Score |
| OPTIMAAL | Optimal Therapy in Myocardial Infarction with the Angiotensin II Antagonist Losartan |
| PCI | Percutaneous Coronary Intervention |
| PPCI | Primary Percutaneous Coronary Intervention |
| PURSUIT | Platelet Glycoprotein IIb/IIIa in Unstable Angina: Receptor Suppression Using Integrilin |
| ROC | Receiver operating characteristic |
| STEMI | ST-Elevation Myocardial Infarction |
| TIMI | Thrombolysis in Myocardial Infarction |
| VALIANT | VALsartan In Acute Myocardial Infarction |
| VIF | Variance Inflation Factor |
References
- Bamford, P.; Henry, T.D.; O’Neill, W.W.; Grines, C.L. The Revolution of STEMI Care: A Story of Resilience, Persistence, and Success. J. Soc. Cardiovasc. Angiogr. Interv. 2024, 11, 102395. [Google Scholar] [CrossRef] [PubMed]
- Dadjoo, Y.; Mahmoodi, Y. The prognosis of primary percutaneous coronary intervention after one year clinical follow up. Int. Cardiovasc. Res. J. 2013, 7, 21–24. [Google Scholar] [PubMed]
- Widimsky, P.; Wijns, W.; Fajadet, J.; de Belder, M.; Knot, J.; Aaberge, L.; Andrikopoulos, G.; Baz, J.A.; Betriu, A.; Claeys, M.; et al. Reperfusion therapy for ST elevation acute myocardial infarction in Europe: Description of the current situation in 30 countries. Eur. Heart J. 2010, 31, 943–957. [Google Scholar] [CrossRef]
- Yan, F.; Zhang, Y.; Pan, Y.; Li, S.; Yang, M.; Wang, Y.; Yanru, C.; Su, W.; Ma, Y.; Han, L. Prevalence and associated factors of mortality after percutaneous coronary intervention for adult patients with ST-elevation myocardial infarction: A systematic review and meta-analysis. J. Res. Med. Sci. 2023, 28, 17. [Google Scholar] [CrossRef]
- Kawamura, Y.; Yoshimachi, F.; Murotani, N.; Karasawa, Y.; Nagamatsu, H.; Kasai, S.; Ikari, Y. Comparison of Mortality Prediction by the GRACE Score, Multiple Biomarkers, and Their Combination in All-comer Patients with Acute Myocardial Infarction Undergoing Primary Percutaneous Coronary Intervention. Intern. Med. 2023, 62, 503–510. [Google Scholar] [CrossRef]
- Pramudyo, M.; Yahya, A.F.; Martanto, E.; Tiksnadi, B.B.; Karwiky, G.; Rafidhinar, R.; Putri, G.N.I. Predictors of 30-day Mortality in Patients with Acute Coronary Syndrome in Hasan Sadikin Hospital, Bandung, Indonesia: A Retrospective Cohort Study. Acta Medica Indones. 2022, 3, 379–388. [Google Scholar]
- Ioacara, S.; Popescu, A.C.; Tenenbaum, J.; Dimulescu, D.R.; Popescu, M.R.; Sirbu, A.; Fica, S. Acute Myocardial Infarction Mortality Rates and Trends in Romania between 1994 and 2017. Int. J. Environ. Res. Public Health 2019, 17, 285. [Google Scholar] [CrossRef]
- Salari, N.; Morddarvanjoghi, F.; Abdolmaleki, A.; Rasoulpoor, S.; Khaleghi, A.A.; Hezarkhani, L.A.; Shohaimi, S.; Mohammadi, M. The global prevalence of myocardial infarction: A systematic review and meta-analysis. BMC Cardiovasc. Disord. 2023, 23, 206. [Google Scholar] [CrossRef]
- Yoon, S.S.S.; Dillon, C.F.; Illoh, K.; Carroll, M. Trends in the prevalence of coronary heart disease in the US: National Health and Nutrition Examination Survey, 2001–2012. Am. J. Prev. Med. 2016, 51, 437–445. [Google Scholar] [CrossRef]
- Danny, S.; Roebiono, P.; Soesanto, A.; Kasim, M. Factors Influencing Major Cardiovascular Event Post Acute Myocardial Infarction in Woman. Indones. J. Cardiol. 2009, 30, 3–12. [Google Scholar]
- Sachdeva, P.; Kaur, K.; Fatima, S.; Mahak, F.; Noman, M.; Siddenthi, S.M.; Surksha, M.A.; Munir, M.; Fatima, F.; Sultana, S.S.; et al. Advancements in Myocardial Infarction Management: Exploring Novel Approaches and Strategies. Cureus 2023, 15, e45578. [Google Scholar] [CrossRef] [PubMed]
- Rohani, C.; Jafarpoor, H.; Mortazavi, Y.; Esbakian, B.; Gholinia, H. Mortality in patients with myocardial infarction and potential risk factors: A five-year data analysis. ARYA Atheroscler. J. 2022, 18, 1–8. [Google Scholar]
- Gong, I.Y.; Goodman, S.G.; Brieger, D.; Gale, C.P.; Chew, D.P.; Welsh, R.C.; Huynh, T.; DeYoung, J.P.; Baer, C.; Gyenes, G.T.; et al. GRACE risk score: Sex-based validity of 30-day mortality prediction in Canadian patients with acute coronary syndrome. Int. J. Cardiol. 2017, 244, 24–29. [Google Scholar] [CrossRef] [PubMed]
- McClure, M.W.; Berkowitz, S.D.; Sparapani, R.; Tuttle, R.; Kleiman, N.S.; Berdan, L.G.; Lincoff, A.M.; Deckers, J.; Diaz, R.; Karsch, K.R.; et al. Clinical significance of thrombocytopenia during a non-ST-elevation acute coronary syndrome. The platelet glycoprotein IIb/IIIa in unstable angina: Receptor suppression using integrilin therapy (PURSUIT) trial experience. Circulation 1999, 99, 2892–2900. [Google Scholar] [CrossRef]
- Amin, S.T.; Morrow, D.A.; Braunwald, E.; Sloan, S.; Contant, C.; Murphy, S.; Antman, E.M. Dynamic TIMI risk score for STEMI. J. Am. Heart Assoc. 2013, 2, e003269. [Google Scholar] [CrossRef]
- Chen, Y.H.; Huang, S.S.; Lin, S.J. TIMI and GRACE Risk Scores Predict Both Short-Term and Long-Term Outcomes in Chinese Patients with Acute Myocardial Infarction. Acta Cardiol Sin. 2018, 34, 4–12. [Google Scholar] [CrossRef]
- Johnson, A.E.; Kramer, A.A.; Clifford, G.D. A new severity of illness scale using a subset of acute physiology and chronic health evaluation data elements shows comparable predictive accuracy. Crit. Care Med. 2013, 41, 1711–1718. [Google Scholar] [CrossRef]
- Wang, L.; Zhang, Z.; Hu, T. Effectiveness of LODS, OASIS, and SAPS II to predict 30-day mortality for intensive care patients with ST elevation myocardial infarction. Sci. Rep. 2021, 11, 23887. [Google Scholar] [CrossRef]
- Le Gall, J.R.; Lemeshow, S.; Saulnier, F. A new simplified acute physiology score (SAPS II) based on a European/North American multicenter study. JAMA 1993, 270, 2957–2963. [Google Scholar] [CrossRef]
- Kolovou, G.D.; Katsiki, N.; Mavrogeni, S. Risk Scores After Acute Coronary Syndrome. Angiology 2017, 68, 185–188. [Google Scholar] [CrossRef]
- Correia, L.C.; Garcia, G.; Kalil, F.; Ferreira, F.; Carvalhal, M.; Oliveira, R.; Silva, A.; Vasconcelos, I.; Henri, C.; Noya-Rabelo, M. Prognostic value of TIMI score versus GRACE score in ST-segment elevation myocardial infarction. Arq. Bras. Cardiol. 2014, 103, 98–106. [Google Scholar] [CrossRef] [PubMed]
- Choi, S.Y.; Kim, M.H.; Serebruany, V. Comparison of ACUITY, CRUSADE, and GRACE Risk Scales for Predicting Clinical Outcomes in Patients Treated with Dual-Antiplatelet Therapy. TH Open 2018, 2, e399–e406. [Google Scholar] [CrossRef] [PubMed]
- Amador, P.; Santos, J.F.; Gonçalves, S.; Seixo, F.; Soares, L. Comparison of ischemic and bleeding risk scores in non-ST elevation acute coronary syndromes. Acute Card Care 2011, 13, 68–75. [Google Scholar] [CrossRef] [PubMed]
- Hudzik, B.; Lekston, A.; Gasior, M. Risk Prediction in Acute Myocardial Infarction. J. Am. Coll. Cardiol. 2016, 68, 2918–2919. [Google Scholar] [CrossRef]
- McNamara, R.L.; Kennedy, K.F.; Cohen, D.J.; Diercks, D.B.; Moscucci, M.; Ramee, S.; Wang, T.Y.; Connolly, T.; Spertus, J.A. Predicting 30-day Mortality in Patients with Acute Myocardial Infarction. J. Am. Coll. Cardiol. 2016, 68, 626–635. [Google Scholar] [CrossRef]
- Jabre, P.; Roger, V.L.; Weston, S.A.; Adnet, F.; Jiang, R.; Vivien, B.; Empana, J.P.; Jouven, X. Resting heart rate in first year survivors of myocardial infarction and long-term mortality: A community study. Mayo Clin. Proc. 2014, 89, 1655–1663. [Google Scholar] [CrossRef]
- Heidland, U.E.; Strauer, B.E. Left ventricular muscle mass and elevated heart rate are associated with coronary plaque disruption. Circulation 2001, 104, 1477–1482. [Google Scholar] [CrossRef]
- Zhu, Y.; Sasmita, B.R.; Hu, X.; Xue, Y.; Gan, H.; Xiang, Z.; Jiang, Y.; Huang, B.; Luo, S. Blood Urea Nitrogen for Short-Term Prognosis in Patients with Cardiogenic Shock Complicating Acute Myocardial Infarction. Int. J. Clin. Pract. 2022, 2022, 9396088. [Google Scholar] [CrossRef]
- Horiuchi, Y.; Aoki, J.; Tanabe, K.; Nakao, K.; Ozaki, Y.; Kimura, K.; Ako, J.; Yasuda, S.; Noguchi, T.; Suwa, S.; et al. A High Level of Blood Urea Nitrogen Is a Significant Predictor for 30-day Mortality in Patients with Acute Myocardial Infarction. Int. Heart J. 2018, 59, 263–271. [Google Scholar] [CrossRef]
- Bosch, X.; Théroux, P. Left ventricular ejection fraction to predict early mortality in patients with non-ST-segment elevation acute coronary syndromes. Am. Heart J. 2005, 150, 215–220. [Google Scholar] [CrossRef]
- Miller, A.L.; Dib, C.; Li, L.; Chen, A.Y.; Amsterdam, E.; Funk, M.; Saucedo, J.F.; Wang, T.Y. Left ventricular ejection fraction assessment among patients with acute myocardial infarction and its association with hospital quality of care and evidence-based therapy use. Circ. Cardiovasc. Qual. Outcomes 2012, 5, 662–671. [Google Scholar] [CrossRef] [PubMed][Green Version]
- Srimahachota, S.; Kanjanavanit, R.; Boonyaratavej, S.; Boonsom, W.; Veerakul, G.; Tresukosol, D.; TACSR Group. Demographic, management practices and 30-day outcomes of Thai Acute Coronary Syndrome Registry (TACSR): The difference from the Western world. J. Med. Assoc. Thai. 2007, 90 (Suppl. S1), 1–11. [Google Scholar] [PubMed]
- Champasri, K.; Srimahachota, S.; Chandavimol, M.; Udayachalerm, W.; Thakkinstian, A.; Sookananchai, B.; Phatharajaree, W.; Kiatchoosakun, S.; Sansanayudh, N. Door-to-device time and mortality in patients with ST-elevation myocardial infarction treated with primary percutaneous coronary intervention: Insight from real world data of Thai PCI Registry. Cardiovasc. Diagn. Ther. 2023, 13, 843–854. [Google Scholar] [CrossRef] [PubMed]
- Tsukui, T.; Sakakura, K.; Taniguchi, Y.; Yamamoto, K.; Seguchi, M.; Wada, H.; Momomura, S.-I.; Fujita, H. Association between the Door-to-balloon Time and Mid-term Clinical Outcomes in Patients with ST-Segment Elevation Myocardial Infarction. Intern. Med. 2020, 59, 1597–1603. [Google Scholar] [CrossRef]
- Al-Khatib, S.M.; Stebbins, A.L.; Califf, R.M.; Lee, K.L.; Granger, C.B.; White, H.D.; Armstrong, P.W.; Topol, E.J.; Ohman, E.M. Sustained ventricular arrhythmias and mortality among patients with acute myocardial infarction: Results from the GUSTO-III trial. Am. Heart J. 2003, 145, 515–521. [Google Scholar] [CrossRef]
- Damluji, A.A.; Forman, D.E.; Wang, T.Y.; Chikwe, J.; Kunadian, V.; Rich, M.W.; Young, B.A.; Page, R.L., 2nd; DeVon, H.A.; Alexander, K.P.; et al. Management of Acute Coronary Syndrome in the Older Adult Population: A Scientific Statement from the American Heart Association. Circulation 2023, 147, e32–e62. [Google Scholar] [CrossRef]
- Stehli, J.; Martin, C.; Brennan, A.; Dinh, D.T.; Lefkovits, J.; Zaman, S. Sex differences persist in time to presentation, revascularization, and mortality in myocardial infarction treated with percutaneous coronary intervention. J. Am. Heart Assoc. 2019, 8, e012161. [Google Scholar] [CrossRef]
- Dennis, J.A.; Zhang, Y.; Zhang, F.; Kopel, J.; Abohelwa, M.; Nugent, K. Comparison of 30-day mortality and readmission frequency in women versus men with acute myocardial infarction. Bayl. Univ. Med. Cent. Proc. 2021, 34, 668–672. [Google Scholar] [CrossRef]
- Shu, D.H.; Ransom, T.P.; O’Connell, C.M.; Cox, J.L.; Kaiser, S.M.; A Gee, S.; Rowe, R.C.; Ur, E.; Imran, S.A. Anemia is an independent risk for mortality after acute myocardial infarction in patients with and without diabetes. Cardiovasc. Diabetol. 2006, 5, 8. [Google Scholar] [CrossRef][Green Version]
- Mamas, M.A.; Kwok, C.S.; Kontopantelis, E.; Fryer, A.A.; Buchan, I.; Bachmann, M.O.; Zaman, M.J.; Myint, P.K. Relationship Between Anemia and Mortality Outcomes in a National Acute Coronary Syndrome Cohort: Insights from the UK Myocardial Ischemia National Audit Project Registry. J. Am. Heart Assoc. 2016, 5, e003348. [Google Scholar] [CrossRef]
- Eikelboom, J.W.; Mehta, S.R.; Anand, S.S.; Xie, C.; Fox, K.A.; Yusuf, S. Adverse impact of bleeding on prognosis in patients with acute coronary syndromes. Circulation 2006, 114, 774–782. [Google Scholar] [CrossRef] [PubMed]
- Nikolsky, E.; Aymong, E.D.; Halkin, A.; Grines, C.L.; Cox, D.A.; Garcia, E.; Merhan, R.; Tcheng, J.E.; Griffin, J.J.; Guagliumi, G.; et al. Impact of anemia in patients with acute myocardial infarction undergoing primary percutaneous coronary intervention: Analysis from the Controlled Abciximab and Device Investigation to Lower Late Angioplasty Complications (CADILLAC) Trial. J. Am. Coll. Cardiol. 2004, 44, 547–553. [Google Scholar] [CrossRef] [PubMed]
- Garcia-Alvarez, A.; Regueiro, A.; Hernández, J.; Kasa, G.; Sitges, M.; Bosch, X.; Heras, M. Additional value of B-type natriuretic peptide on discrimination of patients at risk for mortality after a non-ST-segment elevation acute coronary syndrome. Eur. Heart J. Acute Cardiovasc. Care 2014, 3, 132–140. [Google Scholar] [CrossRef] [PubMed]
- Schellings, D.A.; Adiyaman, A.; Dambrink, J.-H.E.; Gosselink, A.M.; Kedhi, E.; Roolvink, V.; Ottervanger, J.P.; Van’t Hof, A.W. Predictive value of NT-proBNP for 30-day mortality in patients with non-ST-elevation acute coronary syndromes: A comparison with the GRACE and TIMI risk scores. Vasc. Health Risk Manag. 2016, 12, 471–476. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).