Next Article in Journal
Relevance of Routine Postoperative CT Scans Following Aneurysm Clipping—A Retrospective Multicenter Analysis of 423 Cases
Previous Article in Journal
Effect of the Pandemic Outbreak on ICU-Associated Infections and Antibiotic Prescription Trends in Non-COVID19 Acute Respiratory Failure Patients
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

External Validation of the American College of Surgeons Surgical Risk Calculator in Elderly Patients Undergoing General Surgery Operations

by
Stamatios Kokkinakis
,
Alexandros Andreou
,
Maria Venianaki
,
Charito Chatzinikolaou
,
Emmanuel Chrysos
and
Konstantinos Lasithiotakis
*
Department of Surgery, University Hospital of Heraklion, Medical School, University of Crete, 71110 Heraklion, Greece
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2022, 11(23), 7083; https://doi.org/10.3390/jcm11237083
Submission received: 13 October 2022 / Revised: 27 November 2022 / Accepted: 28 November 2022 / Published: 29 November 2022
(This article belongs to the Section General Surgery)

Abstract

:
Preoperative risk stratification in the elderly surgical patient is an essential part of contemporary perioperative care and can be done with the use of the American College of Surgeons Surgical Risk Calculator (ACS-SRC). However, data on the generalizability of the ACS-SRC in the elderly is scarce. In this study, we report an external validation of the ACS-RC in a geriatric cohort. A retrospective analysis of a prospectively maintained database was performed including patients aged > 65 who underwent general surgery procedures during 2012–2017 in a Greek academic centre. The predictive ability of the ACS-SRC for post-operative outcomes was tested with the use of Brier scores, discrimination, and calibration metrics. 471 patients were included in the analysis. 30-day postoperative mortality was 3.2%. Overall, Brier scores were lower than cut-off values for almost all outcomes. Discrimination was good for serious complications (c-statistic: 0.816; 95% CI: 0.762–0.869) and death (c-statistic: 0.824; 95% CI: 0.719–0.929). The Hosmer-Lemeshow test showed good calibration for all outcomes examined. Predicted and observed length of stay (LOS) presented significant differences for emergency and for elective cases. The ACS-SRC demonstrated good predictive performance in our sample and can aid preoperative estimation of multiple outcomes except for the prediction of post-operative LOS.

1. Introduction

In contemporary surgical practice, geriatric patients constitute a growing proportion of the surgical population, in elective and emergency settings [1]. This patient group poses a challenge to healthcare professionals, due to the higher rate of comorbidities and influence of conditions, such as sarcopenia and frailty, which have an effect on the occurrence of post operative complications [2,3]. Routine pre-operative discussion about the perioperative risks allows for enhanced shared decision-making with the patient and their relatives, improving communication and understanding of possible outcomes, which is desirable for the elderly surgical patient [4,5]. Documentation of risk estimates can also facilitate better allocation of resources, including higher level of care and post-discharge rehabilitation services, which are essential for a large proportion of geriatric patients [6]. Risk estimation is best performed with the use of validated prediction tools.
The American College of Surgeons surgical risk calculator (ACS-SRC) is an online prediction tool, which provides estimates for multiple post-operative outcomes, based on pre-operative patient variables [7]. It was developed using clinical data from more than a million patients from multiple surgical subspecialties in the USA from 2009 to 2012. Both elective and emergency cases were included, and universal as well as procedure-specific calculators were developed. There is a lack of external validation studies for the ACS-SRC in the elderly population, with existing literature consisting of internal validations from the USA [8,9], or studies focusing on other specific surgical subgroups [10,11]. The objective of this study was to perform an external validation of the ACS-SRC for postoperative outcomes in geriatric patients undergoing general surgery.

2. Materials and Methods

2.1. Study Population

Patients 65 years or older who underwent operations within the spectrum of general surgery from 2012 to 2017 were included in this study. Procedures included elective and emergency abdominal wall hernia repairs, upper and lower gastrointestinal tract procedures, as well as soft tissue and endocrine gland operations. Written informed consent was obtained from all patients, and the study protocol was approved by the Institutional Scientific and Ethical Committee of the University Hospital of Heraklion. All patients underwent physical examination and an interview by a senior surgical trainee up to 24–48 h prior to an elective operation and immediately prior to an emergency operation. In patients with cognitive impairment, the necessary information was gathered or confirmed by their closest relative or caregiver.

2.2. Perioperative Data

All patients had an ACS-SRC report retrospectively completed for predicted risk assessment. Outputs of the SRC included the predicted risk of serious complications, any complication, return to the operating room, renal failure, surgical site infection (SSI), pneumonia, and death within the 30-day postoperative period. Serious complications in the ACS-SRC include cardiac arrest, myocardial infarction, pneumonia, progressive renal insufficiency, acute renal failure, pulmonary embolism, deep vein thrombosis, return to the operating room, deep incisional SSI, organ space SSI, systemic sepsis, unplanned intubation, urinary tract infection and wound disruption. Return to the operating room includes reoperation which was not planned at the time of initial surgery. Renal failure includes any rise in postoperative creatinine > 2 mg or postoperative requirement for dialysis in a patient who did not require haemodialysis preoperatively. Postoperative pneumonia diagnosis was based on radiological and clinical criteria.

2.3. Statistical Analysis

Categorical variables were presented as numbers (percentage) and continuous variables are presented as mean ± standard deviation (SD) if they were normally distributed or as median with interquartile range (IQR), if they did not follow the normal distribution. Normal distribution was tested with the use of Q–Q plots and the Kolmogorov–Smirnoff test. The ACS-SRC’s predictive performance was evaluated using multiple performance metrics. C-statistic is a test that represents the area under the curve (AUC) of a receiver operating characteristic curve and it is a measure of discrimination of a prediction model [12]. Discrimination relates to how well a prediction model can discriminate those with the outcome from those without the outcome. If the SRC demonstrates perfect discriminatory performance, the AUC will be 1. If the prediction model fails to distinguish between those who will have a complication to those who will not, the AUC will be 0.5. In general, an AUC value of >0.7 indicates relatively good discrimination, and an AUC value > 0.8 indicates good discrimination. Calibration denotes the agreement between observed outcomes and predictions. For calibration, the Hosmer-Lemeshow (H-L) goodness-of-fit test was used [13]. The Brier score is a combined measure of calibration and discrimination [14]. It is reported as a score between 0 and 1. A score of 0 indicates no difference between the predicted and actual outcome, thus indicating the best possible test result. A score of 1 indicates that the test did not predict the outcome. The Brier score is compared with a Brier score cut-off, which is partially based on the incidence in the sample, meaning that a lower possible maximum value is possible for a lower incidence of the respective outcome [15]. A score above the cut-off is considered not useful. All p-values were two-sided, and the significance level was chosen to be 0.05. All calculations were performed with the Statistical Package for Social Sciences (SPSS) ver. 26.0 (SPSS Inc., Chicago, IL, USA).

3. Results

Four hundred and seventy-one patients were included in the analysis. Preoperative patient characteristics and key variables entered in the ACS-SRC are displayed in Table 1. The median age was 74 years, and the median body mass index (BMI) was 27.2. Most of the patients were American Society of Anesthesiologists (ASA) class II (48.2%), followed by ASA III (20.8%). The most common operation was cholecystectomy (28.2%) followed by lower gastrointestinal tract (GI) procedures (25.5%) and hernia repairs (22.6%). The most common operation was cholecystectomy (28.2%) followed by lower gastrointestinal tract (GI) procedures (25.5%) and hernia repairs (22.6%). Upper GI procedures included subtotal and total gastrectomies (2.5%), gastroenterostomies, and fundoplications (0.9%). Lower GI procedures mainly included colectomies (3.4% left, 5.7% right, 1.7% sigmoidectomy/Hartman’s), low anterior resections (3.4%), abdominoperineal resections (0.9%), colostomy formations (0.9%), small bowel resections (2.8%), palliative bypass (0.6%, hemorrhoidectomy (0.6%), adhesiolysis (0.6%), appendectomies (1%), and other procedures (3.6%). The rate of complications (“any complication”) reached 31.6%, 58 of them were classified as serious (12.3%), and 30-day postoperative mortality was 3.2%. Missing data rates were <2% for all variables. Discriminative performance was good for serious postoperative complications and death and relatively good for the occurrence of any complication, surgical site infection, renal failure, and pneumonia (Table 2). Brier score was 0.094 for serious postoperative complications and 0.027 for postoperative death and was lower than the calculated cut-off value for every outcome except for “any complication” as displayed in Table 2. Significant differences in the predicted and observed median length of hospital stay (LOS) were noticed, as seen in Table 3. The median observed and predicted LOS was eight days and two days, respectively (p < 0.001). The highest differences in the median LOS were observed in Hepatopancreatobiliary, upper, and lower gastrointestinal operations (15, 11 and 13 days respectively) and were less pronounced in emergency than in elective operations (5.5 vs. 3 days, respectively).

4. Discussion

In this study, we present the results of external validation of the ACS-SRC focusing on geriatric patients undergoing general surgery over five years in a Greek academic center. The predictive ability of the SRC for post-operative outcomes was assessed with the use of multiple performance measures. Overall, Brier scores, discrimination, and calibration metrics favoured the use of the ACS-SRC for the prediction of postoperative mortality and morbidity, as well as for specific postoperative complications in our geriatric cohort. The SRC’s predictive ability was low for the length of hospital stay, both in the elective and in the emergency setting.
There is a small number of studies externally validating the predictive ability of the ACS-SRC for geriatric patients, with equivocal results regarding its performance. In a recent Dutch study focusing on colorectal cancer patients, the SRC showed poor discrimination and calibration for almost all outcomes measured [10]. D’Acapito et al. performed an external validation on geriatric cholecystectomies, concluding that predictive performance was good for emergency cholecystectomies, but discrimination was low in the elective ones [11]. When multiple performance metrics were examined for elderly patients undergoing lumbar surgery, the ACS-NSQIP’s overall usefulness was low, except for moderate accuracy in predicting death [16]. The aforementioned mixed results could be partially explained by the fact that they are derived from studies focusing on specific procedures, patient samples, and health systems quite different than the one, in which the model was developed. Differences in healthcare systems may influence patient outcomes, and the Greek healthcare system is perhaps different in many aspects from its western counterparts such as lack of personnel and operative theatres, time lost for transfer to the correct level of care, absence of a cultural and legal framework for escalation of care and lack of specialized units to provide optimal care [17]. ACS-SRC is arguably the most widely used generic prognostic tool in surgery. Other novel prediction models, designed for geriatric surgical patients, have recently been mentioned in the literature [18,19]. Examples are the colorectal geriatric model (GerCRC), which used geriatric-specific predictors to estimate the risk of severe postoperative complications, and a deep neural network model from Chinese patients predicting postoperative pulmonary complications, but external validations are still lacking [18,19].
The ACS-SRC can be used in a variety of settings, both elective and urgent, for a wide range of surgical procedures and takes into consideration 21 key preoperative prognostic variables. However, a few widely accepted prognostic factors are not considered. An example is the preoperative diagnosis that prompted the surgeon to operate. The same operation can be indicated by different or multiple pathologies with significantly diverse risk profiles. Factors like hospital and surgeon volume, healthcare system, and relevant resources are also not considered. When NSQIP standards are implemented in low-middle-income countries, higher rates of adverse events highlight the need for improvement [20]. Recently, Mehaffey et al. showed that socioeconomic factors are independent predictors of postoperative outcomes and should be integrated with the ACS-SRC model [21]. All these factors might limit the generalizability of the model.
In our study, observed and predicted length of stay differed significantly both in the entire sample and when specific procedures were analysed. The low predictive ability for LOS in our cohort can be partially explained by the lack of post-discharge facilities within the Greek healthcare system, leading to increased observed LOS, even in elective cases. The addition of geriatric consultation within the context of a standardized perioperative program has been found to result in decreased length of stay in recent reports of geriatric orthopedic and cardiac surgery patients [22,23]. Karlsson et al. reported significantly lower length of stay in Swedish elderly hip fracture patients receiving geriatric interdisciplinary home rehabilitation in the setting of a randomized controlled trial [24]. The absence of routine geriatric input and organized rehabilitation centers in Greece might imply that patients take longer to reach preoperative functional status, compared to their US counterparts in the development sample of the ACS-SRC.
Interest in improving geriatric surgical outcomes has led to organized risk stratification programmes. The ACS- National Surgery Quality Improvement Program Geriatric Surgery Pilot recently added six new variables, such as fall history and origin status on admission, specific for elderly patients, and provides risk estimates for four geriatric outcomes, such as functional decline and new mobility aid use [25]. The information provided from prediction models can be used in combination with the pre-operative patient status, to reach common ground about goals of care. Pre-operative living status, as well as transition to new caregivers post-operatively, are associated with higher rates of discharge to rehabilitation settings and increased readmissions [26]. Knowledge of these factors leads to healthcare systems, that are more prepared to deal with the complexity of the geriatric patient within organized pathways, which have been shown to improve outcomes [27].
Our study has a few limitations. It is a retrospective single-institution study, performed in a tertiary center, therefore, the sample is not representative of the entire Greek population. We included elective and emergency surgical procedures in a single-group analysis. There is a great number of factors, like limited preoperative optimization for acute-care surgery that can influence postoperative outcomes in the emergency setting. Although this methodological analysis has the drawback of increasing the heterogeneity of our sample, it is pragmatic, with results that can be generalized in an average surgical practice. Predictive performance was good when the entire cohort was considered, however, due to the small sample size, subgroup analysis based on different procedures was not possible, which could potentially identify inaccurate predictions in specific types of procedures.
The case-mix of our study was different from that, in which the ACS-NSQIP was originally developed. The satisfactory predictive performance of the model in a Southeastern European population is promising for the transportability of the calculator to different settings. Further prospective external validations of existing models should be performed focusing on the vulnerable subset of geriatric patients, and comparative validations can identify which best suits a specific healthcare system. Incorporation of risk stratification into routine geriatric perioperative practice will contribute to a higher level of care, that fits the needs of a growing surgical population.

5. Conclusions

The ACS-NSQIP surgical risk calculator is a valuable tool in predicting serious complications and mortality rates in elective and emergency surgical operations, in a Greek geriatric patient sample. However, its predictive ability for hospital length of stay was low. Further research to incorporate confounding factors might make results more applicable to geriatric surgery practice.

Author Contributions

Conceptualization, K.L. and E.C.; methodology, K.L., A.A. and M.V.; software, K.L. and C.C.; validation, K.L., M.V. and A.A.; formal analysis, K.L.; investigation, K.L., M.V. and C.C.; resources, K.L.; data curation, C.C., M.V., A.A. and E.C.; writing—original draft preparation, S.K. and K.L.; writing—review and editing, S.K., E.C. and K.L.; visualization, K.L.; supervision, K.L.; project administration, K.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of the University Hospital of Heraklion (protocol code 811 and date of 29 November 2012).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data generated or analyzed during this study are included in this published article or are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Pearce, L.; Bunni, J.; McCarthy, K.; Hewitt, J. Surgery in the older person: Training needs for the provision of multidisciplinary care. Ann. R. Coll. Surg. Engl. 2016, 98, 367–370. [Google Scholar] [CrossRef] [Green Version]
  2. Rangel, E.L.; Rios-Diaz, A.J.; Uyeda, J.W.; Castillo-Angeles, M.; Cooper, Z.; Olufajo, O.A.; Salim, A.; Sodickson, A.D. Sarcopenia increases risk of long-term mortality in elderly patients undergoing emergency abdominal surgery. J. Trauma Acute Care Surg. 2017, 83, 1179–1186. [Google Scholar] [CrossRef]
  3. Ko, F.C. Preoperative Frailty Evaluation: A Promising Risk-stratification Tool in Older Adults Undergoing General Surgery. Clin. Ther. 2019, 41, 387–399. [Google Scholar] [CrossRef] [Green Version]
  4. Portelli Tremont, J.N.; Sloane, P.D. Applying Evidence-based Principles to Guide Emergency Surgery in Older Adults. J. Am. Med. Dir. Assoc. 2022, 23, 537–546. [Google Scholar] [CrossRef]
  5. Mohanty, S.; Rosenthal, R.A.; Russell, M.M.; Neuman, M.D.; Ko, C.Y.; Esnaola, N.F. Optimal Perioperative Management of the Geriatric Patient: A Best Practices Guideline from the American College of Surgeons NSQIP and the American Geriatrics Society. J. Am. Coll. Surg. 2016, 222, 930–947. [Google Scholar] [CrossRef] [Green Version]
  6. Davis, P.J.B.; Bailey, J.G.; Molinari, M.; Hayden, J.; Johnson, P.M. The Impact of Nonelective Abdominal Surgery on the Residential Status of Older Adult Patients. Ann. Surg. 2016, 263, 274–279. [Google Scholar] [CrossRef]
  7. Bilimoria, K.Y.; Liu, Y.; Paruch, J.L.; Zhou, L.; Kmiecik, T.E.; Ko, C.Y.; Cohen, M.E. Development and Evaluation of the Universal ACS NSQIP Surgical Risk Calculator: A Decision Aid and Informed Consent Tool for Patients and Surgeons. J. Am. Coll. Surg. 2013, 217, 833–842e3. [Google Scholar] [CrossRef] [Green Version]
  8. Hornor, M.A.; Ma, M.; Zhou, L.; Cohen, M.E.; Rosenthal, R.A.; Russell, M.M.; Ko, C.Y. Enhancing the American College of Surgeons NSQIP Surgical Risk Calculator to Predict Geriatric Outcomes. J. Am. Coll. Surg. 2020, 230, 88–100e1. [Google Scholar] [CrossRef] [Green Version]
  9. Kongwibulwut, M.; Chiang, K.; Lee, J.M.; Eid, A.I.; Kongkaewpaisan, N.; Han, K.; Nordestgaard, A.T.; King, D.; Saillant, N.; Mendoza, A.E.; et al. Life after 90: Predictors of mortality and performance of the ACS-NSQIP risk calculator in 4,724 nonagenarian patients undergoing emergency general surgery. J. Trauma Acute Care Surg. 2019, 86, 853–857. [Google Scholar] [CrossRef]
  10. Van der Hulst, H.C.; Dekker, J.W.T.; Bastiaannet, E.; van der Bol, J.M.; van den Bos, F.; Hamaker, M.E.; Schiphorst, A.; Sonneveld, D.J.A.; Schuijtemaker, J.S.; de Jong, R.J.; et al. Validation of the ACS NSQIP surgical risk calculator in older patients with colorectal cancer undergoing elective surgery. J. Geriatr. Oncol. 2022, 13, 788–795. [Google Scholar] [CrossRef]
  11. D’Acapito, F.; Cucchetti, A.; Di Pietrantonio, D.; Tauceri, F.; Mirarchi, M.T.; Framarini, M.; Bova, R.; Fappiano, F.; Ercolani, G. Forecasting outcomes after cholecystectomy in octogenarian patients. Surg. Endosc. 2022, 36, 4479–4485. [Google Scholar] [CrossRef]
  12. Harrell, F.E. Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis; Springer: Berlin, Germany, 2001. [Google Scholar] [CrossRef]
  13. Hosmer, D.W.; Lemesbow, S. Goodness of fit tests for the multiple logistic regression model. Commun. Stat. Theory Methods 1980, 9, 1043–1069. [Google Scholar] [CrossRef]
  14. Brier, G.W. Verification of forecasts expressed in terms of probability. Mon. Weather Rev. 1950, 78, 1–3. [Google Scholar] [CrossRef]
  15. Steyerberg, E.W.; Vickers, A.J.; Cook, N.R.; Gerds, T.; Gonen, M.; Obuchowski, N.; Pencina, M.J.; Kattan, M.W. Assessing the performance of prediction models: A framework for traditional and novel measures. Epidemiology 2010, 21, 128–138. [Google Scholar] [CrossRef] [Green Version]
  16. Wang, X.; Hu, Y.; Zhao, B.; Su, Y. Predictive validity of the ACS-NSQIP surgical risk calculator in geriatric patients undergoing lumbar surgery. Medicine 2017, 96, e8416. [Google Scholar] [CrossRef]
  17. Zacharis, G.; Seretis, C. Letter to the Editor: The Hellenic Emergency Laparotomy Study (HELAS): A Prospective Multicentre Study on the Outcomes of Emergency Laparotomy in Greece. World J. Surg. 2022. [Google Scholar] [CrossRef]
  18. Souwer, E.T.D.; Bastiaannet, E.; Steyerberg, E.W.; Dekker, J.W.T.; Steup, W.H.; Hamaker, M.M.; Sonneveld, D.J.A.; Burghgraef, T.A.; van den Bos, F.; Portielje, J.E.A. A Prediction Model for Severe Complications after Elective Colorectal Cancer Surgery in Patients of 70 Years and Older. Cancers 2021, 13, 3110. [Google Scholar] [CrossRef]
  19. Peng, X.; Zhu, T.; Chen, G.; Wang, Y.; Hao, X. A multicenter prospective study on postoperative pulmonary complications prediction in geriatric patients with deep neural network model. Front. Surg. 2022, 9, 976536. [Google Scholar] [CrossRef]
  20. Hussain, M.M.; Bibi, F.; Shah, S.; Mitha, R.; Shamim, M.S.; Ziauddin, A.; Zafar, H. First American College of Surgeons National Surgical Quality Improvement Program Report from a Low-Middle-Income Country: A 1-Year Outcome Analysis of Neurosurgical Cases. World Neurosurg. 2021, 155, e156–e167. [Google Scholar] [CrossRef]
  21. Mehaffey, J.H.; Hawkins, R.B.; Charles, E.J.; Turrentine, F.E.; Hallowell, P.T.; Friel, C.; Jones, R.S.; Tracci, M.C. Socioeconomic “Distressed Communities Index” Improves Surgical Risk-adjustment. Ann. Surg. 2020, 271, 470–474. [Google Scholar] [CrossRef]
  22. Adogwa, O.; Elsamadicy, A.A.; Vuong, V.D.; Moreno, J.; Cheng, J.; Karikari, I.O.; Bagley, C.A. Geriatric comanagement reduces perioperative complications and shortens duration of hospital stay after lumbar spine surgery: A prospective single-institution experience. J. Neurosurg. Spine 2017, 27, 670–675. [Google Scholar] [CrossRef] [PubMed]
  23. Bobet, A.S.; Brouessard, C.; Le Tourneau, T.; Manigold, T.; de Decker, L.; Boureau, A.S. Length of Stay in Older Patients Undergoing Transcatheter Aortic Valve Replacement: Value of a Geriatric Approach. Gerontology 2022, 68, 746–754. [Google Scholar] [CrossRef] [PubMed]
  24. Karlsson, Å.; Berggren, M.; Gustafson, Y.; Olofsson, B.; Lindelöf, N.; Stenvall, M. Effects of Geriatric Interdisciplinary Home Rehabilitation on Walking Ability and Length of Hospital Stay after Hip Fracture: A Randomized Controlled Trial. J. Am. Med. Dir. Assoc. 2016, 17, 464.e9–464.e15. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Robinson, T.; Rosenthal, R. The ACS NSQIP Geriatric Surgery Pilot Project: Improving care for older surgical patients. Bull. Am. Coll. Surg. 2014, 99, 21–23. [Google Scholar] [PubMed]
  26. Sokas, C.M.; Hu, F.Y.; Dalton, M.K.; Jarman, M.P.; Bernacki, R.E.; Bader, A.; Rosenthal, R.A.; Cooper, Z. Understanding the role of informal caregivers in postoperative care transitions for older patients. J. Am. Geriatr. Soc. 2022, 70, 208–217. [Google Scholar] [CrossRef] [PubMed]
  27. Ehrlich, A.L.; Owodunni, O.P.; Mostales, J.C.; Qin, C.X.; Hadvani, P.J.; Sirisegaram, L.; Bettick, D.; Gearhart, S.L. Early Outcomes following Implementation of a Multispecialty Geriatric Surgery Pathway. Ann. Surg. 2022. [Google Scholar] [CrossRef]
Table 1. Baseline characteristics of 471 elderly patients undergoing general surgery procedures between 2012 and 2017.
Table 1. Baseline characteristics of 471 elderly patients undergoing general surgery procedures between 2012 and 2017.
Characteristicn (%)
Age (years)74 (10)
Female gender209 (44.4)
Body mass index (kg/m2)27.2 (6)
Preoperative functional status (missing 0.8%)
Independent 390 (82.8)
Partially dependent 40 (8.5)
Totally dependent 37 (7.9)
ASA class (missing 2.1%)
I131 (27.8)
II227 (48.2)
III98 (20.8)
IV4 (0.8)
Steroid use for chronic condition6 (1.3)
Ascites within 30 days prior to surgery0
Systemic sepsis within 48 h prior to surgery23 (4.9)
Ventilator dependent0
Cancer (disseminated) 25 (5.3)
Diabetes 106 (22.5)
Hypertension requiring medication 23 (4.9)
Congestive heart failure in 30 days prior to surgery23 (4.9)
Dyspnoea with moderate exertion 23 (4.9)
Current smoker55 (11.7)
History of severe COPD45 (9.6)
Dialysis 3 (0.6)
Acute renal failure 12 (2.5)
Emergency case (yes/no) *
Yes74 (15.7)
No393 (83.4)
Site of operation
Hernia102 (22.6)
Upper GI17 (3.6)
HPB39 (8.3)
Cholecystectomy132 (28.2)
Lower GI119 (25.5)
Soft tissue/thyroid/other59 (11.8)
Data are presented as n (%) for categorical measures and as median (IQR) for continuous measures. Total number of patients in variable “Emergency case” and “Site of operation” was lower than 471 due to missing values (<2%). BMI: body mass index, ASA: American Society of Anesthesiologists, HPB: hepato-pancreato-biliary, GI: gastrointestinal, COPD: chronic obstructive pulmonary disease, OR: operating room. * according to the ACS-SRC.
Table 2. Performance measures of the ACS-NSQIP Risk Calculator for post-operative outcomes in Greek elderly patients undergoing general surgery procedures between 2012–2017.
Table 2. Performance measures of the ACS-NSQIP Risk Calculator for post-operative outcomes in Greek elderly patients undergoing general surgery procedures between 2012–2017.
OutcomeEvents
n (%)
Brier Score Brier Score Cut-OffC-Statistic (95% CI)p-ValueHosmer-Lemeshow Test
Any complication149 (31.6%)0.2300.2160.749 (0.702–0.796)<0.0010.063
Serious complications58 (12.3%)0.0940.1070.816 (0.762–0.869)<0.0010.225
Death15 (3.2%)0.0270.0310.824 (0.719–0.929)<0.0010.082
Return to OR7 (1.5%)0.0150.0150.639 (0.460–0.819)<0.0010.815
Surgical site infection30 (6.4%)0.0560.0590.763 (0.691–0.835)<0.0010.385
Renal failure7 (1.5%)0.0130.0140.778 (0.659–0.896)0.0190.297
Pneumonia18 (3.8%)0.0370.0370.789 (0.722–0.856)<0.0010.815
OR: Operating Room, CI: Confidence Interval.
Table 3. Observed versus Predicted Length of hospital stay (LOS) of 471 elderly patients who underwent general surgery procedures using the ACS-NSQIP Surgical Risk Calculator.
Table 3. Observed versus Predicted Length of hospital stay (LOS) of 471 elderly patients who underwent general surgery procedures using the ACS-NSQIP Surgical Risk Calculator.
Procedure TypeObserved LOS
(Days)
Predicted LOS
(Days)
p-Value *
All procedures8 (10)2 (5)<0.001
All emergency 9 (9)6 (7.5)<0.001
All elective 7 (10)1.5 (4.5)<0.001
Hernia4 (4)0.5 (0.5)<0.001
Upper GI18 (16)7 (2.5)<0.001
HPB21 (17)6 (3)<0.001
Cholecystectomy8 (10)2 (3)<0.001
Lower GI13 (7)6 (2.8)<0.001
Soft tissue/thyroid/other8 (10)2 (3)<0.001
Length of stay (LOS) is expressed as median (IQR); * Wilcoxon signed rank test; LOS: length of stay, IQR: interquartile range, HPB: hepato-pancreato-biliary, GI: gastrointestinal.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kokkinakis, S.; Andreou, A.; Venianaki, M.; Chatzinikolaou, C.; Chrysos, E.; Lasithiotakis, K. External Validation of the American College of Surgeons Surgical Risk Calculator in Elderly Patients Undergoing General Surgery Operations. J. Clin. Med. 2022, 11, 7083. https://doi.org/10.3390/jcm11237083

AMA Style

Kokkinakis S, Andreou A, Venianaki M, Chatzinikolaou C, Chrysos E, Lasithiotakis K. External Validation of the American College of Surgeons Surgical Risk Calculator in Elderly Patients Undergoing General Surgery Operations. Journal of Clinical Medicine. 2022; 11(23):7083. https://doi.org/10.3390/jcm11237083

Chicago/Turabian Style

Kokkinakis, Stamatios, Alexandros Andreou, Maria Venianaki, Charito Chatzinikolaou, Emmanuel Chrysos, and Konstantinos Lasithiotakis. 2022. "External Validation of the American College of Surgeons Surgical Risk Calculator in Elderly Patients Undergoing General Surgery Operations" Journal of Clinical Medicine 11, no. 23: 7083. https://doi.org/10.3390/jcm11237083

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop