Abstract
The majority of patients with solid tumors undergo a curative resection of their tumor burden. However, the reported rate of postoperative complications varies widely, ranging from 10% to 70%. This narrative review aims to determine the impact of postoperative complications on recurrence and overall survival rates following elective cancer surgeries, thereby providing valuable insights into perioperative cancer care. A systematic electronic search of published studies and meta-analyses from January 2000 to August 2023 was conducted to examine the effect of postoperative complications on long-term survival after cancer surgeries. This comprehensive search identified fifty-one eligible studies and nine meta-analyses for review. Recurrence-free survival (RFS) and overall survival (OS) rates were extracted from the selected studies. Additionally, other oncological outcomes, such as recurrence and cancer-specific survival rates, were noted when RFS and OS were not reported as primary outcomes. Pooled hazard ratios and 95% confidence intervals were recorded from the meta-analyses, ensuring the robustness of the data. The analysis revealed that long-term cancer outcomes progressively worsen, from patients with no postoperative complications to those with minor postoperative complications (Clavien–Dindo grade ≤ II) and further to those with major postoperative complications (Clavien–Dindo grade III–IV), irrespective of cancer type. This study underscores the detrimental effect of postoperative complications on long-term oncological outcomes, particularly after thoracoabdominal surgeries. Importantly, we found a significant gap in the data regarding postoperative complications in surface and soft tissue surgical procedures, highlighting the need for further research in this area.
1. Introduction
Worldwide, the incidence of cancer is on the rise. Approximately 60% of patients with solid tumors require surgery as a part of cancer management [1]. Postoperative complications are defined as any deviations from the normal postoperative course, which includes asymptomatic complications but excludes cancer sequelae and recurrence [2]. Postoperative complications after major curative cancer surgery are common. The rate of these complications varies from 10 to 70%, depending on factors such as cancer staging, preoperative cancer therapies (neoadjuvant), patients’ physiological reserve and functional capacity following neoadjuvant therapies, coexisting medical comorbidities, the type and complexity of the surgery, and the extent of resection [1,3] There is evidence regarding the short-term outcomes of these postoperative complications, including perioperative morbidity and mortality, increased length of hospital stay, and financial burden [1,2,3]. A pioneering study by Khuri et al. [4] in 2005 analyzed data from 105,951 patients (from the National Surgical Quality Improvement Program database in the United States) who underwent eight different types of surgical procedures (both oncological and non-oncological). The study reported that 30-day postoperative complications reduced the median patient survival by 69% [5]. Five-year mortality in patients with any 30-day postoperative complications was 57.6%, compared to 39.5% in patients with no complications. The study also found that mortality rates varied with the type and severity of complications, with five-year mortality after perioperative myocardial infarction as high as 73%, compared to 58% in patients with urinary tract infections.
Regarding cancer, some believe that surgery may stimulate cancer growth and dissemination through mechanisms such as the release of circulating tumor cells, the disruption of stromal tissue, and induced neuro-inflammatory signaling, resulting in an endocrine–metabolic stress response [5,6,7,8]. Other researchers have implicated cancer-mediated immune suppression in the formation of micrometastases and further seeding [9]. The use of neo-adjuvant chemotherapy has also shown to have an immune-modulatory role, potentially impacting both perioperative complications and cancer recurrence [10]. Given the inflammatory–immune responses and alterations in the systemic milieu following major postoperative complications, there has been a growing interest in exploring the association between postoperative complications and long-term outcomes in a wide spectrum of cancers, including colorectal, gastric, and breast cancers. Furthermore, the severity of postoperative complications may also affect the resumption of timely postoperative adjuvant therapy, delaying the return to intended oncological treatment and potentially worsening long-term oncological outcomes [2]. This article reviews the impact of postoperative complications after major curative oncological surgery on long-term oncological outcomes, including recurrence-free survival (RFS) and overall survival (OS).
2. Materials and Methods
The primary objective of this narrative review was to evaluate the published literature regarding RFS and OS following postoperative complications after potentially curative oncological surgery. In this review, disease-free survival is reported under RFS. Other long-term oncological outcomes, such as cancer-specific survival, overall recurrence rates, and local or distant recurrence rates, are documented only if the included studies did not report RFS or OS. The secondary objectives were to record the incidence and nature of the most frequent postoperative complications, including surgical site infections, anastomotic leaks, bowel perforation, renal dysfunction, cardiovascular and respiratory complications, bleeding, and others. Additionally, the grading and severity of these complications were assessed.
2.1. Selection Criteria, Search Strategies, and Data Collection
An electronic literature search on PubMed, Embase, Scopus, and Google Scholar was conducted for peer-reviewed English language articles using the terms “postoperative complications”, “postsurgical complications”, “long-term cancer outcomes”, “long-term oncological outcome”, “recurrence-free survival”, “overall survival”, “disease-free survival”, “local recurrence”, “cancer-specific survival”, “distant recurrence”, “anastomotic leak”, “wound complications”, and “septic complications” in different combinations. All randomized controlled trials, non-randomized controlled trials, cohort studies, and observational studies published between January 2000 and August 2023 addressing postoperative complications and the specified survival outcomes were included in the review. Abstracts without full-text access, duplicates, and non-English language texts were excluded, as well as those with animal model studies, case reports, studies with incomplete text, and conference proceedings.
2.2. Data Extraction and Synthesis
All articles were independently evaluated by two researchers who reported all collected data in an Excel 2021 (Microsoft, Redwood, MS, USA) spreadsheet designed for the purposes of this study. The collected information included the year of publication, place of study, type of study, inclusive period of study, aim of the study, inclusion and exclusion criteria, definitions of postoperative complications and postoperative mortality, number of patients, and OS and/or RFS rates.
Due to the heterogeneity in the published and included studies, data synthesis was conducted using a qualitative approach (narrative synthesis) to summarize and interpret different parameters. The postoperative complications and other outcome parameters were calculated by averaging reported percentages or means and standard deviations, or by converting medians with ranges or interquartile ranges to approximate means and standard deviations using established formulas [5]. These converted values were combined using an inverse-variance weighted method to derive the final estimates.
2.3. Literature Search Results
A total of 1384 articles were identified after the initial literature search (Figure 1). The initial review, conducted by two authors, involved screening the article titles for relevance. The full-text assessment identified 51 original articles and 9 meta-analyses focusing on postoperative complications and long-term cancer outcomes for inclusion in the final review. The disease site distribution of the included studies was as follows: colorectal (n = 19), urological (n = 6), colorectal liver metastasis (n = 5), gastrointestinal (n = 2), hepato-pancreatico-biliary (n = 4), peritoneal (n = 3), thoracic (n = 3), breast (n = 4), soft tissue sarcoma (n = 2), and head and neck (n = 2) malignancies [1,3,6,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58]. Table 1 contains demographic details and the Table 2 contains the details of the postoperative complications and cancer outcomes data of the various studies included in the review. Table 3 includes all the meta-analysis data [59,60,61,62,63,64,65,66,67].
Figure 1.
Flowchart of study selection.
Table 1.
Demographics of original articles.
Table 2.
Postoperative complications and long-term oncological outcomes in the original studies.
Table 3.
Postoperative complications and long-term oncological outcomes in the meta-analysis.
3. Results
While most studies have reported 30-day outcomes, postoperative complications have also been reported in 90-day outcomes [1,11,13,31,33,45,46,53]. These complications are further graded using different classification systems: the Clavien–Dindo (CD) classification, the Comprehensive Complication Index (CCI), and the National Cancer Institute Common Terminology Criteria for Adverse Events (CTCAE) ver. 5.0, which are among the most common [68,69,70].
3.1. Classification Systems for Grading POSTOPERATIVE COMPLICATIONS
The CD classification has been commonly used to grade surgical complications based on the level of intervention required to achieve resolution. Due to its simplicity, uniform reporting across a wide range of surgeries, and low inter-rater variability, it is a popular classification system. However, a few drawbacks of the CD classification system include excluding intraoperative complications and reporting only the highest-grade complication, thereby excluding any “lesser” complications. The CCI summarizes all the postsurgical complications, calculating a cumulative burden of morbidity on a continuous scale ranging from 0 to 100. Despite its comprehensive approach, the CCI has not yet found widespread application due to its complex calculations [7,8].
For the purpose of this review, we have combined the surgical procedures for gastrointestinal, colorectal, hepato-pancreatico-biliary, peritoneal, urological, and thoracic malignancies under the umbrella term of “thoracoabdominal surgeries”. All other procedures, such as those for breast, extremity soft tissue sarcoma, and head and neck malignancies, are grouped under “surface and soft tissue surgeries”. Postoperative complications are commonly identified based on anatomy (cardiovascular, respiratory, or renal) or their mechanism (infection/sepsis, hematoma/effusions, etc.).
3.2. Reported Postoperative Complications Grading Systems
The challenge of heterogeneity in the classification systems used to grade complications in published literature is significant. While the CD classification system is the predominant system, being utilized in 23 out of the selected 51 studies, other systems are also in use. Four studies have employed the CCI, and two have used the CTCAE version 3.0. Additionally, a study from Potkrajcic et al. [55] on soft tissue sarcoma utilized a major wound complication classification. Furthermore, four studies used both the CD and CCI systems to grade postoperative complications. Among these studies, two focused on patients with colorectal liver metastasis and peritoneal malignancies, respectively, and reported that the CCI was a better prognostic indicator of immediate postoperative morbidity, re-admission, and long-term survival. Despite the seemingly better correlation of cancer outcomes with the CCI classification grade, the CD system remains more commonly used. It is observed that long-term cancer outcomes progressively worsen from patients with no postoperative complications to those with minor and then major postoperative complications, irrespective of the cancer type. Given the heterogeneity in reporting methodologies and the differences in outcomes related to the reporting system, it is critically important to standardize the reporting system of postoperative complications following cancer surgery. This standardization would facilitate more consistent and comparable research findings, ultimately contributing to improved patient care and outcomes.
3.3. Overall Impact of Postoperative Complications on Cancer Outcomes
There is extensive literature on the incidence and severity of postoperative complications after surgical procedures in patients with cancer, as well as the numerous factors that predict the development of these complications. Multivariate analysis has identified higher age, patient comorbidities, surgical technique (open vs. minimally invasive), surgical duration and complexity, and intraoperative blood loss as some of the most common predictors of postoperative complications across a range of cancers and, consequently, their long-term outcomes [7,8,25,37,50].
3.3.1. Thoracoabdominal Surgery
The presence of even a single postoperative complication led to worse RFS in one study, whereas others reported worsening RFS only when patients suffered both surgical and medical postoperative complications [8,14,43]. After colorectal cancer surgery, multiple postoperative complications led to shorter OS [13]. Several studies have reported poor long-term oncological outcomes in patients undergoing colorectal resections with or without hyperthermic intraperitoneal chemotherapy, followed by major postoperative complications [26,39,40]. Although multi-visceral resections for colon cancer independently increased the rates of both postoperative complications and local recurrence, there was no direct association between postoperative complications and 5-year RFS or OS [3]. Fukami et al. [32] reported that postoperative complications were independently associated with OS only after repeat hepatectomies for colorectal hepatic metastasis, but not primary hepatectomies. Meanwhile, Yin et al. [66], in their meta-analysis, reported that postoperative complications were strongly correlated with poorer long-term outcomes. Wang et al. [64], in their meta-analysis, concluded that postoperative complications, especially infectious and anastomotic leaks, correlated with worse outcomes in stage II and III gastric carcinomas, but its effect in stage I gastric carcinoma is indeterminate. The negative effect of the severity of postoperative complications on 2-year RFS and OS persists even after oncologic lung resections, from patients with no postoperative complications to those with minor postoperative complications (CD grade ≤ II) and major postoperative complications (CD grade III–IV) [48]. Several meta-analyses in non-metastatic colorectal cancers, gastric cancer, and hepatocellular cancers found that postoperative complications have a significant harmful impact on RFS (a cumulative hazard ratio of 1.35 [95% CI 1.29–1.40]) and OS (a cumulative hazard ratio of 1.46 [95% CI 1.37–1.55]) [59,60,61,62,63,64,65,66,67].
3.3.2. Surface and Soft Tissue Surgeries
Only one study by Broecker et al. [56] reported that postoperative complications following truncal and extremity soft tissue sarcomas led to significantly reduced RFS and OS compared to the group with no postoperative complications. We found a significant gap in the data on postoperative complications in surface and soft tissue surgical procedures, highlighting the need for further research in this area.
3.4. Subgroup Analysis of Types of Postoperative Complications and Their Impact on Cancer Outcomes
3.4.1. Anastomotic Leak
An anastomotic leak is a significant surgical complication following thoracoabdominal surgery, with incidence rates varying from 3% to 40% [18,65]. Anastomotic leaks are associated with longer surgical duration, increased intraoperative bleeding, higher conversion rates from minimally invasive to open surgery, and prolonged postoperative hospital stays [18,65]. They often require surgical, radiological, or endoscopic intervention. Out of 19 studies on colorectal cancer patients, 13 identified anastomotic leak as one of the most frequent postoperative complications. Most studies have reported that anastomotic leaks after colorectal cancer surgeries are associated with significantly lower RFS and/or OS [17,18,24,25,28,29,65,67]. The cumulative 5-year RFS (from 6 studies) and OS (from 5 studies) are (mean (SD)) 67.37% (11.85%) and 71.8% (15.06%), respectively. Ptok et al. [25] reported that only anastomotic leaks requiring surgical treatment were linked to poor 5-year RFS. Only two single-center studies reported that anastomotic leaks did not result in reduced RFS or OS in colorectal cancer [14,21]. Biliary leaks were identified as common postoperative complications after hepatectomy in only two out of eight studies, which found postoperative complications to be an independent predictor of reduced RFS and OS [30,36]. Neenan et al. [34] reported no association between major postoperative complications, particularly pancreatic fistula, and RFS, OS, or local recurrence after pancreaticoduodenectomy.
3.4.2. Wound Complications
The incidence of wound complications following cancer surgery ranges from 6% to 30% [18,52,54]. Postoperative wound complications have a multifactorial pathophysiology. Wound infections are often the most common source of nosocomial infections in these patients. These complications can lead to both local and systemic manifestations, worsening not only short-term outcomes, such as increased length of hospital stay, but also potentially impacting long-term cancer outcomes.
Wound-Related Complications in Thoracoabdominal Surgeries
Wound-related complications were identified as common and major issues in five studies on colorectal surgeries and three studies on hepato-pancreatico-biliary surgeries. Sprenger et al. [18] reported a significant decline in 10-year OS (45.7%) and an increase in local recurrence (17.3%) in patients with wound complications after rectal surgery. Although wound complications (4.5%) were the third most frequent postoperative issue following radical colorectal resection, they were not associated with poorer cancer outcomes [26]. A study by Kube et al. [23] found a higher incidence of wound complications in patients with anastomotic leaks after colon surgery and significantly poorer RFS and OS in patients with major postoperative complications. Another study in the post-hepatectomy cohort found wound complications (including infections and dehiscence) to be the most common postoperative complications, but these were not significantly related to either RFS or OS [37].
Wound-Related Complications in Surface and Soft Tissue Surgeries
Three out of four studies on breast cancer surgeries reported that wound complications did not lead to poorer oncological outcomes [51,52,53]. However, one older single-center study involving breast cancer patients, with data collected before 2002, reported increased rates of systemic recurrence [54]. Potkrajcic et al. [55] found that postoperative major wound complications occurred most frequently in patients with diabetes mellitus, but these complications did not affect long-term oncological outcomes after soft tissue sarcoma excision. In a study of total laryngectomy patients, wound complications were identified as the most common postoperative issue and were found to be an independent predictor of decreased long-term cancer outcomes [57].
3.4.3. Other Infectious Complications
In surface and soft tissue surgeries, only one study in total laryngectomy patients mentioned pneumonia (5.8%) as the second most frequently occurring postoperative complication. It concluded that postoperative complications lead to significantly poorer RFS and OS. A study on colonic oncological surgeries reported an incidence of 2.85% infective complications (including surgical infectious complications) and 2.53% non-infectious complications, which were graded as CD grade ≥ III [19]. The study found that the overall recurrence rate was similar in groups with and without complications; however, both local anastomotic site and peritoneal recurrence were more common in stage III colorectal cancer patients with major complications. Septic complications following hepatectomy and colorectal resections have been shown to significantly affect 1-, 3-, 5-, and 10-year RFS and/or OS in several studies [26,31,35,37].
3.4.4. Non-Infectious Complications
After rectal surgeries, compared to cases without postoperative complications, regardless of grade, infectious complications and intestinal dysmotility complications were associated with worse RFS, while cardiopulmonary and thromboembolic complications were linked to reduced OS. Postoperative renal dysfunction was associated with both worse RFS and worse OS [13]. Among non-infectious complications post-hepatectomy, Chok et al. [37] identified liver failure, cardiac complications, renal failure, pulmonary complications, and postoperative hemorrhage, in that order, as significantly associated with reduced OS. One study reported worse long-term survival after nephrectomy for individual complications such as acute renal failure, cardiac complications, and septic or neurologic complications [47]. Law et al. [26] found that cardiopulmonary complications significantly worsened 5-year OS but did not affect overall recurrence rates. The surface and soft tissue surgery studies included in this review did not report the rates and impact of non-infectious complications.
4. Discussion
Given the increasing global incidence of cancer and the growing number of patients with solid tumors requiring curative resections to control their tumor burden, it is crucial to understand the perioperative factors that can be optimized to improve cancer outcomes. In this literature review, we found that postoperative complications lead to poorer long-term oncological outcomes after thoracoabdominal surgeries. Specifically, categorizing the complications and their effects on outcomes revealed that anastomotic leaks significantly contribute to poorer oncological outcomes in colorectal surgeries [17,18,24,25,28,29,65,67]. There is a lack of data on postoperative complications in non-coelomic cancer surgeries. Long-term oncological outcomes progressively worsen, from patients with no postoperative complications to those with minor and then major postoperative complications, regardless of cancer type.
When evaluating perioperative factors on oncological outcomes, two additional considerations are the role of neoadjuvant therapies in postoperative complications and the impact of postoperative complications on delays in initiating planned adjuvant therapies.
4.1. Role of Neoadjuvant Chemotherapy on Postoperative Complications
Neoadjuvant chemotherapy is incorporated into cancer treatment regimens to induce tumor shrinkage, improve resectability, and enhance survival [10]. Chemotherapy-induced leukocytopenia and neutropenia are well-documented effects. Additionally, chemotherapy has been reported to have immunomodulatory effects, promoting lymphocyte activation and reducing the production of inhibitory immune cells [10]. However, the impact of neoadjuvant chemotherapy on postoperative complications and, consequently, on long-term cancer outcomes, has yielded contrasting results.
Takeuchi et al. [49] reported that administering neoadjuvant chemotherapy mitigated the negative impact of postoperative complications on long-term cancer outcomes after esophagectomy. In contrast, Wu et al. [41] found that postoperative complications worsened RFS in gastric cancer patients treated with neoadjuvant chemotherapy. Sprenger et al. [18] reported worse 10-year OS (51%) in patients with anastomotic leaks after rectal surgery compared to those without anastomotic leaks, regardless of perioperative chemotherapy use. The nuanced effects of neoadjuvant therapies on postoperative complications and cancer-specific outcomes warrant further exploration.
4.2. Postoperative Complications and Delay in Initiation of Adjuvant Treatment
Another mechanism speculated for poor long-term outcomes after postoperative complications may be the delay in receiving adjuvant therapy. Several studies have reported that the occurrence of postoperative complications leads to an increased length of ICU or hospital stays, higher re-surgery rates, and readmission within 90 days [1,6,12,17,23,26,37,53,56]. Whether this results in a delay in the onset of adjuvant treatment after surgery and consequently worsens cancer outcomes is a subject of much discussion. A few studies on patients with colorectal liver metastasis, breast cancer, and soft tissue sarcomas have reported no delay in the initiation of adjuvant therapy between groups with and without postoperative complications, and even between groups with minor versus major complications [6,33,54,56]. Similarly, some studies on colorectal and breast cancer patients have shown no association between the occurrence of postoperative complications and long-term cancer outcomes when adjusted for the delay in starting adjuvant chemotherapy [13,14,53]. However, a study of total laryngectomy patients found that both postoperative complications and delays in adjuvant therapy were independent predictors of decreased disease-free survival (DFS) and OS [57]. Krarup et al. [22] reported that patients with stage III colon carcinoma who experienced anastomotic leaks were less likely to receive adjuvant chemotherapy, or its initiation was significantly delayed (16 days, 95% CI: 12–20 days) compared to patients without anastomotic leaks. This delay in receiving adjuvant chemotherapy led to a significant reduction in OS but not in distant recurrence. The effects of postoperative complications on the initiation of adjuvant therapy and outcomes related to RFS and OS are intriguing and evolving areas of research. Further studies are needed in the context of specific diseases and cancer stages to reach a conclusive understanding.
5. Limitations of the Current Literature on Postoperative Complications and Oncological Outcomes
As previously reported, contaminated surgical sites are a risk factor for an increased likelihood of postoperative complications. Among our cohort of studies included for analysis, those on colorectal surgery patients constituted the largest group. The data from these studies are heterogeneous in their reporting of both postoperative complications and long-term oncological outcomes. Studies have used various terms, such as local, distant, or overall recurrence rates, cancer-specific survival, etc. This complexity is further compounded by subgroup analyses based on different postoperative complication grading systems, RAS gene mutations, and surgical techniques (open, laparoscopic, conversion). Some studies focus on a single surgical complication and its effect on cancer outcomes, while others include all postoperative complications. This heterogeneity makes it challenging to synthesize meaningful data.
6. Future Research
Further research is needed to identify procedure-specific risk factors for the development of postoperative complications and to understand the mechanisms through which different complications impact long-term cancer outcomes. Additional areas for research include surgical techniques, the role of perioperative chemo-radiation therapies, and the impact of enhanced recovery pathways on the risk of postoperative complications. Finally, optimizing patients in the preoperative period—especially concerning frailty and prehabilitation—and employing continuous vital sign monitoring technologies, as well as utilizing machine learning for early risk prediction and implementing rapid rescue measures, may improve long-term oncological outcomes.
7. Conclusions
Most of the studies included in this review focus on thoracoabdominal surgeries, where postoperative complications are linked to poorer long-term oncological outcomes. Specifically, anastomotic leaks contribute to worse outcomes in colorectal surgeries. There is a lack of sufficient data on postoperative complications in surface and soft tissue cancer surgeries. For these types of surgeries, wound complications are reported as the most common postoperative issues and are associated with higher cancer recurrence rates. Among the studies on thoracoabdominal cancer surgeries, comparisons of postoperative complication grading systems found that the high CCI was a better predictor of complications than the CD classification. Long-term cancer outcomes progressively worsen from patients with no postoperative complications to those with minor and major complications, regardless of cancer type.
Author Contributions
Conceptualization: V.G., J.C., S.L.S. and A.W.; Methodology: S.L.S., A.W., J.C. and V.G.; Writing—original draft preparation: A.W. and S.L.S.; Writing—review and editing: S.L.S., A.W. and J.C.; Visualization: S.L.S. and A.W.; Supervision: V.G. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Conflicts of Interest
Authors declare no conflicts of interest.
References
- Notarfrancesco, M.; Fankhauser, C.D.; Lorch, A.; Ardizzone, D.; Helnwein, S.; Hoch, D.; Hermanns, T.; Thalmann, G.; Beyer, J. Perioperative complications and oncological outcomes of post-chemotherapy retroperitoneal lymph node dissection in patients with germ cell cancer at two high-volume university centres in Switzerland—A retrospective chart review. Swiss. Med. Wkly. 2023, 153, 40053. [Google Scholar] [CrossRef] [PubMed]
- McSorley, S.T.; Watt, D.G.; Horgan, P.G.; McMillan, D.C. Postoperative Systemic Inflammatory Response, Complication Severity, and Survival Following Surgery for Colorectal Cancer. Ann. Surg. Oncol. 2016, 23, 2832–2840. [Google Scholar] [CrossRef] [PubMed]
- Wasmann, K.A.T.G.M.; Klaver, C.E.L.; van der Bilt, J.D.W.; Nagtegaal, I.D.; Wolthuis, A.M.; van Santvoort, H.C.; Ramshorst, B.; D’Hoore, A.; de Wilt, J.H.W.; Tanis, P.J. Subclassification of Multivisceral Resections for T4b Colon Cancer with Relevance for Postoperative Complications and Oncological Risks. J. Gastrointest. Surg. 2020, 24, 2113–2120. [Google Scholar] [CrossRef] [PubMed]
- Khuri, S.F.; Henderson, W.G.; DePalma, R.G.; Mosca, C.; Healey, N.A.; Kumbhani, D.J. Determinants of long-term survival after major surgery and the adverse effect of postoperative complications. Ann. Surg. 2005, 242, 326–341; discussion 341–343. [Google Scholar] [CrossRef] [PubMed]
- Wan, X.; Wang, W.; Liu, J.; Tong, T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med. Res. Methodol. 2014, 14, 135. [Google Scholar] [CrossRef] [PubMed]
- Yamashita, S.; Sheth, R.A.; Niekamp, A.S.; Aloia, T.A.; Chun, Y.S.; Lee, J.E.; Vauthey, J.N.; Conrad, C. Comprehensive Complication Index Predicts Cancer-specific Survival after Resection of Colorectal Metastases Independent of RAS Mutational Status. Ann. Surg. 2017, 266, 1045–1054. [Google Scholar] [CrossRef]
- Kaukonen, K.M.; Bailey, M.; Pilcher, D.; Cooper, D.J.; Bellomo, R. Systemic inflammatory response syndrome criteria in defining severe sepsis. N. Engl. J. Med. 2015, 372, 1629–1638. [Google Scholar] [CrossRef] [PubMed]
- Bain, C.R.; Myles, P.S.; Corcoran, T.; Dieleman, J.M. Postoperative systemic inflammatory dysregulation and corticosteroids: A narrative review. Anaesthesia 2023, 78, 356–370. [Google Scholar] [CrossRef] [PubMed]
- Wajekar, A.S.; Solanki, S.L.; Patil, V.P. Postoperative complications and critical care management after cytoreduction surgery and hyperthermic intraperitoneal chemotherapy: A systematic review of the literature. World J. Crit. Care Med. 2022, 11, 375–386. [Google Scholar] [CrossRef]
- Xue, J.; Yan, X.; Ding, Q.; Li, N.; Wu, M.; Song, J. Effect of neoadjuvant chemotherapy on the immune microenvironment of gynaecological tumours. Ann. Med. 2023, 55, 2282181. [Google Scholar] [CrossRef]
- Koedam, T.W.A.; Bootsma, B.T.; Deijen, C.L.; Van De Brug, T.; Kazemier, G.; Cuesta, M.A.; Fürst, A.; Lacy, A.M.; Haglind, E.; Tuynman, J.B.; et al. Oncological Outcomes After Anastomotic Leakage After Surgery for Colon or Rectal Cancer: Increased Risk of Local Recurrence. Ann. Surg. 2022, 275, e420–e427. [Google Scholar] [CrossRef]
- Bao, Q.R.; Pellino, G.; Spolverato, G.; Restivo, A.; Deidda, S.; Capelli, G.; Ruffolo, C.; Bianco, F.; Cuicchi, D.; Jovine, E.; et al. The impact of anastomotic leak on long-term oncological outcomes after low anterior resection for mid-low rectal cancer: Extended follow-up of a randomised controlled trial. Int. J. Color. Dis. 2022, 37, 1689–1698. [Google Scholar] [CrossRef]
- Gamboa, A.C.; Lee, R.M.; Turgeon, M.K.; Varlamos, C.; Regenbogen, S.E.; Hrebinko, K.A.; Holder-Murray, J.; Wiseman, J.T.; Ejaz, A.; Feng, M.P.; et al. Impact of Postoperative Complications on Oncologic Outcomes After Rectal Cancer Surgery: An Analysis of the US Rectal Cancer Consortium. Ann. Surg. Oncol. 2021, 28, 1712–1721. [Google Scholar] [CrossRef]
- Fransgaard, T.; Caspar Thygesen, L.; Gögenur, I. The impact of postoperative complications and delay of adjuvant chemotherapy on oncological outcomes in patients with colorectal cancer. Color. Dis. 2021, 23, 1132–1140. [Google Scholar] [CrossRef] [PubMed]
- Oh, C.K.; Huh, J.W.; Lee, Y.J.; Choi, M.S.; Pyo, D.H.; Lee, S.C.; Park, S.M.; Shin, J.K.; Park, Y.A.; Cho, Y.B.; et al. Long-term oncologic outcome of postoperative complications after colorectal cancer surgery. Ann. Coloproctol. 2020, 36, 273–280. [Google Scholar] [CrossRef] [PubMed]
- Miyamoto, Y.; Hiyoshi, Y.; Tokunaga, R.; Akiyama, T.; Daitoku, N.; Sakamoto, Y.; Yoshida, N.; Baba, H. Postoperative complications are associated with poor survival outcome after curative resection for colorectal cancer: A propensity-score analysis. J. Surg. Oncol. 2020, 122, 344–349. [Google Scholar] [CrossRef] [PubMed]
- Furnée, E.J.B.; Aukema, T.S.; Oosterling, S.J.; Borstlap, W.A.A.; Bemelman, W.A.; Tanis, P.J. Influence of Conversion and Anastomotic Leakage on Survival in Rectal Cancer Surgery; Retrospective Cross-sectional Study. J. Gastrointest. Surg. 2019, 23, 2007–2018. [Google Scholar] [CrossRef]
- Sprenger, T.; Beißbarth, T.; Sauer, R.; Tschmelitsch, J.; Fietkau, R.; Liersch, T.; Hohenberger, W.; Staib, L.; Gaedcke, J.; Raab, H.R.; et al. Long-term prognostic impact of surgical complications in the German Rectal Cancer Trial CAO/ARO/AIO-94. Br. J. Surg. 2018, 105, 1510–1518. [Google Scholar] [CrossRef]
- Cienfuegos, J.A.; Baixauli, J.; Beorlegui, C.; Ortega, P.M.; Granero, L.; Zozaya, G.; Hernández Lizoáin, J.L. The impact of major postoperative complications on long-term outcomes following curative resection of colon cancer. Int. J. Surg. 2018, 52, 303–308. [Google Scholar] [CrossRef]
- Park, E.J.; Baik, S.H.; Kang, J.; Hur, H.; Min, B.S.; Lee, K.Y.; Kim, N.K. The Impact of Postoperative Complications on Long-term Oncologic Outcomes after Laparoscopic Low Anterior Resection for Rectal Cancer. Medicine 2016, 95, e3271. [Google Scholar] [CrossRef] [PubMed]
- Espín, E.; Ciga, M.A.; Pera, M.; Ortiz, H.; Spanish Rectal Cancer Project. Oncological outcome following anastomotic leak in rectal surgery. Br. J. Surg. 2015, 102, 416–422. [Google Scholar] [CrossRef] [PubMed]
- Krarup, P.M.; Nordholm-Carstensen, A.; Jorgensen, L.N.; Harling, H. Anastomotic leak increases distant recurrence and long-term mortality after curative resection for colonic cancer: A nationwide cohort study. Ann. Surg. 2014, 259, 930–938. [Google Scholar] [CrossRef] [PubMed]
- Kube, R.; Mroczkowski, P.; Granowski, D.; Benedix, F.; Sahm, M.; Schmidt, U.; Gastinger, I.; Lippert, H.; Study Group Qualitätssicherung Kolon/Rektum-Karzinome (Primärtumor) (Quality Assurance in Primary Colorectal Carcinoma). Anastomotic leakage after colon cancer surgery: A predictor of significant morbidity and hospital mortality, and diminished tumour-free survival. Eur. J. Surg. Oncol. 2010, 36, 120–124. [Google Scholar] [CrossRef]
- Marra, F.; Steffen, T.; Kalak, N.; Warschkow, R.; Tarantino, I.; Lange, J.; Zünd, M. Anastomotic leakage as a risk factor for the long-term outcome after curative resection of colon cancer. Eur. J. Surg. Oncol. 2009, 35, 1060–1064. [Google Scholar] [CrossRef] [PubMed]
- Ptok, H.; Marusch, F.; Meyer, F.; Schubert, D.; Gastinger, I.; Lippert, H. Impact of anastomotic leakage on oncological outcome after rectal cancer resection. Br. J. Surg. 2007, 94, 1548–1554. [Google Scholar] [CrossRef] [PubMed]
- Law, W.L.; Choi, H.K.; Lee, Y.M.; Ho, J.W.C. The impact of postoperative complications on long-term outcomes following curative resection for colorectal cancer. Ann. Surg. Oncol. 2007, 14, 2559–2566. [Google Scholar] [CrossRef] [PubMed]
- McArdle, C.S.; McMillan, D.C.; Hole, D.J. Impact of anastomotic leakage on long-term survival of patients undergoing curative resection for colorectal cancer. Br. J. Surg. 2005, 92, 1150–1154. [Google Scholar] [CrossRef]
- Walker, K.G.; Bell, S.W.; Rickard, M.J.F.X.; Mehanna, D.; Dent, O.F.; Chapuis, P.H.; Bokey, E.L. Anastomotic leakage is predictive of diminished survival after potentially curative resection for colorectal cancer. Ann. Surg. 2004, 240, 255–259. [Google Scholar] [CrossRef] [PubMed]
- Bell, S.W.; Walker, K.G.; Rickard, M.J.F.X.; Sinclair, G.; Dent, O.F.; Chapuis, P.H.; Bokey, E.L. Anastomotic leakage after curative anterior resection results in a higher prevalence of local recurrence. Br. J. Surg. 2003, 90, 1261–1266. [Google Scholar] [CrossRef]
- Wang, H.W.; Jin, K.M.; Li, J.; Wang, K.; Xing, B.C. Postoperative complications predict poor outcomes only in patients with a low modified clinical score after resection of colorectal liver metastases: A retrospective cohort study. Updates Surg. 2022, 74, 1601–1610. [Google Scholar] [CrossRef]
- Fernández-Moreno, M.C.; Dorcaratto, D.; Garcés-Albir, M.; Muñoz, E.; Arvizu, R.; Ortega, J.; Sabater, L. Impact of type and severity of postoperative complications on long-term outcomes after colorectal liver metastases resection. J. Surg. Oncol. 2020, 122, 212–225. [Google Scholar] [CrossRef] [PubMed]
- Fukami, Y.; Kaneoka, Y.; Maeda, A.; Takayama, Y.; Onoe, S. Postoperative complications following aggressive repeat hepatectomy for colorectal liver metastasis have adverse oncological outcomes. Surg. Today 2017, 47, 99–107. [Google Scholar] [CrossRef] [PubMed]
- Mavros, M.N.; De Jong, M.; Dogeas, E.; Hyder, O.; Pawlik, T.M. Impact of complications on long-term survival after resection of colorectal liver metastases. Br. J. Surg. 2013, 100, 711–718. [Google Scholar] [CrossRef] [PubMed]
- Neeman, U.; Lahat, G.; Goykhman, Y.; Geva, R.; Peles-Avraham, S.; Nachmany, I.; Nakache, R.; Klausner, J.M.; Lubezky, N. Prognostic significance of pancreatic fistula and postoperative complications after pancreaticoduodenectomy in patients with pancreatic ductal adenocarcinoma. Surgeon 2020, 18, 24–30. [Google Scholar] [CrossRef] [PubMed]
- Ma, K.W.; Cheung, T.T.; She, W.H.; Chok, K.S.H.; Chan, A.C.Y.; Dai, W.C.; Tsang, S.H.Y.; Lo, C.M. Major postoperative complications compromise oncological outcomes of patients with intrahepatic cholangiocarcinoma after curative resection—A 13-year cohort in a tertiary center. Asian J. Surg. 2019, 42, 164–171. [Google Scholar] [CrossRef] [PubMed]
- Harimoto, N.; Shirabe, K.; Ikegami, T.; Yoshizumi, T.; Maeda, T.; Kajiyama, K.; Yamanaka, T.; Maehara, Y. Postoperative complications are predictive of poor prognosis in hepatocellular carcinoma. J. Surg. Res. 2015, 199, 470–477. [Google Scholar] [CrossRef] [PubMed]
- Chok, K.S.; Ng, K.K.; Poon, R.T.; Lo, C.M.; Fan, S.T. Impact of postoperative complications on long-term outcome of curative resection for hepatocellular carcinoma. Br. J. Surg. 2009, 96, 81–87. [Google Scholar] [CrossRef]
- Choudry, M.H.A.; Shuai, Y.; Jones, H.L.; Pai, R.K.; Pingpank, J.F.; Ahrendt, S.S.; Holtzman, M.P.; Zeh, H.J.; Bartlett, D.L. Postoperative Complications Independently Predict Cancer-Related Survival in Peritoneal Malignancies. Ann. Surg. Oncol. 2018, 25, 3950–3959. [Google Scholar] [CrossRef]
- Schneider, M.A.; Eshmuminov, D.; Lehmann, K. Major Postoperative Complications Are a Risk Factor for Impaired Survival after CRS/HIPEC. Ann. Surg. Oncol. 2017, 24, 2224–2232. [Google Scholar] [CrossRef]
- Baratti, D.; Kusamura, S.; Iusco, D.; Bonomi, S.; Grassi, A.; Virzì, S.; Leo, E.; Deraco, M. Postoperative complications after cytoreductive surgery and hyperthermic intraperitoneal chemotherapy affect long-term outcome of patients with peritoneal metastases from colorectal cancer: A two-center study of 101 patients. Dis. Colon Rectum 2014, 57, 858–868. [Google Scholar] [CrossRef]
- Wu, C.; Wang, N.; Zhou, H.; Wang, T.; Mao, Q.; Zhang, X.; Zhao, D. Effects of Neoadjuvant Chemotherapy Toxicity and Postoperative Complications on Short-term and Long-term Outcomes After Curative Resection of Gastric Cancer. J. Gastrointest. Surg. 2020, 24, 1278–1289. [Google Scholar] [CrossRef] [PubMed]
- Climent, M.; Hidalgo, N.; Vidal Puig, S.; Iglesias, M.; Cuatrecasas, M.; Ramón, J.M.; García-Albéniz, X.; Grande, L.; Pera, M. Postoperative complications do not impact on recurrence and survival after curative resection of gastric cancer. Eur. J. Surg. Oncol. 2016, 42, 132–139. [Google Scholar] [CrossRef] [PubMed][Green Version]
- Léonard, G.; Pradère, B.; Monléon, L.; Boutin, J.M.; Branchereau, J.; Karam, G.; Rigaud, J.; Bruyère, F. Oncological and Post-Operative Outcomes of Robot-Assisted Laparoscopic Radical Prostatectomy in Renal Transplant Recipients: A Multicenter and Comparative Study. Transplant. Proc. 2020, 52, 850–856. [Google Scholar] [CrossRef]
- Muto, S.; Kitamura, K.; Ieda, T.; Shimizu, F.; Nagata, M.; Isotani, S.; Ide, H.; Yamaguchi, R.; Horie, S. A preliminary oncologic outcome and postoperative complications in patients undergoing robotassisted radical cystectomy: Initial experience. Investig. Clin. Urol. 2017, 58, 171–178. [Google Scholar] [CrossRef]
- Cusano, A.; Haddock, P.; Jackson, M.; Staff, I.; Wagner, J.; Meraney, A. A comparison of preliminary oncologic outcome and postoperative complications between patients undergoing either open or robotic radical cystectomy. Int. Braz. J. Urol. 2016, 42, 663–670. [Google Scholar] [CrossRef] [PubMed]
- Nguyen, D.P.; Awamlh BAHAl Charles Osterberg, E.; Chrystal, J.; Flynn, T.; Lee, D.J.; Scherr, D.S. Postoperative complications and short-term oncological outcomes of patients aged ≥80 years undergoing robot-assisted radical cystectomy. World J. Urol. 2015, 33, 1315–1321. [Google Scholar] [CrossRef]
- Tan, H.J.; Hafez, K.S.; Ye, Z.; Wei, J.T.; Miller, D.C. Postoperative complications and long-term survival among patients treated surgically for renal cell carcinoma. J. Urol. 2012, 187, 60–67. [Google Scholar] [CrossRef]
- Casanova Barea, J.; De la Gala, F.; Piñeiro, P.; Reyes, A.; Simón, C.; Rancan, L.; Vara, E.; Paredes, S.; Bellón, J.M.; Garutti Martinez, I. Influence of postoperative complications on long-term outcome after oncologic lung resection surgery. Substudy of a randomized control trial. J. Clin. Monit. Comput. 2021, 35, 1183–1192. [Google Scholar] [CrossRef] [PubMed]
- Takeuchi, M.; Kawakubo, H.; Mayanagi, S.; Irino, T.; Fukuda, K.; Nakamura, R.; Wada, N.; Takeuchi, H.; Kitagawa, Y. Influence of Neoadjuvant Therapy on Poor Long-Term Outcomes of Postoperative Complications in Patients with Esophageal Squamous Cell Carcinoma: A Retrospective Cohort Study. Ann. Surg. Oncol. 2019, 26, 2081–2089. [Google Scholar] [CrossRef]
- Kinjo, Y.; Kurita, N.; Nakamura, F.; Okabe, H.; Tanaka, E.; Kataoka, Y.; Itami, A.; Sakai, Y.; Fukuhara, S. Effectiveness of combined thoracoscopic-laparoscopic esophagectomy: Comparison of postoperative complications and midterm oncological outcomes in patients with esophageal cancer. Surg. Endosc. 2012, 26, 381–390. [Google Scholar] [CrossRef]
- Machiels, M.; Weytjens, R.; Erven, K.; Westerhoff, J.M.; Amrouch, S.; Bosiers, J.; Verkinderen, L.; Hauspy, J.; van Dam, P.; Stevens, P.; et al. Oncological outcome, postoperative complications, and mammographic changes after intraoperative radiotherapy with electrons (IOERT) as a boost in a large single-institution cohort of breast cancer patients. Breast J. 2020, 26, 1937–1945. [Google Scholar] [CrossRef] [PubMed]
- Teoh, L.Y.; Lai, L.L.; Hanim, A.A.A.; Teh, M.S.; Jamaris, S.; Yahya, A.; Ng, K.H.; See, M.H. Oncological safety and postoperative complications in oncoplastic breast surgery among Asian women: A single institutional review. Breast J. 2020, 26, 2208–2212. [Google Scholar] [CrossRef] [PubMed]
- Mousa, M.; Barnea, Y.; Arad, U.; Inbal, A.; Klausner, J.; Menes, T. Association Between Postoperative Complications After Immediate Alloplastic Breast Reconstruction and Oncologic Outcome. Clin. Breast Cancer 2018, 18, e699–e702. [Google Scholar] [CrossRef]
- Murthy, B.L.; Thomson, C.S.; Dodwell, D.; Shenoy, H.; Mikeljevic, J.S.; Forman, D.; Horgan, K. Postoperative wound complications and systemic recurrence in breast cancer. Br. J. Cancer 2007, 97, 1211–1217. [Google Scholar] [CrossRef] [PubMed]
- Potkrajcic, V.; Kolbenschlag, J.; Sachsenmaier, S.; Daigeler, A.; Ladurner, R.; Golf, A.; Gani, C.; Zips, D.; Paulsen, F.; Eckert, F. Postoperative complications and oncologic outcomes after multimodal therapy of localized high risk soft tissue sarcoma. Radiat. Oncol. 2022, 17, 210. [Google Scholar] [CrossRef] [PubMed]
- Broecker, J.S.; Ethun, C.G.; Monson, D.K.; Lopez-Aguiar, A.G.; Le, N.; McInnis, M.; Godette, K.; Reimer, N.B.; Oskouei, S.V.; Delman, K.A.; et al. The Oncologic Impact of Postoperative Complications Following Resection of Truncal and Extremity Soft Tissue Sarcomas. Ann. Surg. Oncol. 2017, 24, 3574–3586. [Google Scholar] [CrossRef] [PubMed]
- Boukovalas, S.; Goepfert, R.P.; Smith, J.M.; Mecham, E.; Liu, J.; Zafereo, M.E.; Chang, E.I.; Hessel, A.C.; Hanasono, M.M.; Gross, N.D.; et al. Association between postoperative complications and long-term oncologic outcomes following total laryngectomy: 10-year experience at MD Anderson Cancer Center. Cancer 2020, 126, 4905–4916. [Google Scholar] [CrossRef] [PubMed]
- Milliet, F.; Gal, J.; Chamorey, E.; Dassonville, O.; Poissonnet, G.; Peyrade, F.; Benezery, K.; Hechema, R.; Sudaka, A.; Sanchez-Luini, M.; et al. Total pharyngolaryngectomy in the elderly: The impact of age on postoperative complications and oncologic and functional outcomes. Surg. Oncol. 2018, 27, 767–772. [Google Scholar] [CrossRef] [PubMed]
- Li, J.; Zhang, Y.; Hu, D.M.; Gong, T.P.; Xu, R.; Gao, J. Impact of postoperative complications on long-term outcomes of patients following surgery for gastric cancer: A systematic review and meta-analysis of 64 follow-up studies. Asian J. Surg. 2020, 43, 719–729. [Google Scholar] [CrossRef]
- Mualla, N.M.; Hussain, M.R.; Akrmah, M.; Malik, P.; Bashir, S.; Lin, J.J. The Impact of Postoperative Complications on Long-Term Oncological Outcomes Following Curative Resection of Colorectal Cancer (Stage I-III): A Systematic Review and Meta-Analysis. Cureus 2021, 13, e12837. [Google Scholar] [CrossRef]
- Kong, J.; Li, G.; Chai, J.; Yu, G.; Liu, Y.; Liu, J. Impact of Postoperative Complications on Long-Term Survival After Resection of Hepatocellular Carcinoma: A Systematic Review and Meta-Analysis. Ann. Surg. Oncol. 2021, 28, 8221–8233. [Google Scholar] [CrossRef] [PubMed]
- Chen, G.; Wang, J.; Chen, K.; Kang, M.; Zhang, H.; Jin, X.; Lin, L.; Chen, J. Relationship Between Postoperative Complications and the Prognosis of Gastric Carcinoma Patients Who Underwent Surgical Resection: A Systematic Review and Meta-Analysis. Cancer Control. 2021, 28, 10732748211011955. [Google Scholar] [CrossRef]
- Dorcaratto, D.; Mazzinari, G.; Fernandez, M.; Muñoz, E.; Garcés-Albir, M.; Ortega, J.; Sabater, L. Impact of postoperative complications on survival and recurrence after resection of colorectal liver metastases: Systematic review and meta-analysis. Ann. Surg. 2019, 270, 1018–1027. [Google Scholar] [CrossRef]
- Wang, S.; Xu, L.; Wang, Q.; Li, J.; Bai, B.; Li, Z.; Wu, X.; Yu, P.; Li, X.; Yin, J. Postoperative complications and prognosis after radical gastrectomy for gastric cancer: A systematic review and meta-analysis of observational studies. World J. Surg. Oncol. 2019, 17, 52. [Google Scholar] [CrossRef] [PubMed]
- Lu, Z.R.; Rajendran, N.; Lynch, A.C.; Heriot, A.G.; Warrier, S.K. Anastomotic leaks after restorative resections for rectal cancer compromise cancer outcomes and survival. Dis. Colon Rectum 2016, 59, 236–244. [Google Scholar] [CrossRef] [PubMed]
- Yin, Z.; Huang, X.; Ma, T.; Jin, H.; Lin, Y.; Yu, M.; Jian, Z. Postoperative complications affect long-term survival outcomes following hepatic resection for colorectal liver metastasis. World J. Surg. 2015, 39, 1818–1827. [Google Scholar] [CrossRef] [PubMed]
- Mirnezami, A.; Mirnezami, R.; Chandrakumaran, K.; Sasapu, K.; Sagar, P.; Finan, P. Increased local recurrence and reduced survival from colorectal cancer following anastomotic leak: Systematic review and meta-analysis. Ann. Surg. 2011, 253, 890–899. [Google Scholar] [CrossRef] [PubMed]
- Slankamenac, K.; Graf, R.; Barkun, J.; Puhan, M.A.; Clavien, P.A. The comprehensive complication index: A novel continuous scale to measure surgical morbidity. Ann. Surg. 2013, 258, 1–7. [Google Scholar] [CrossRef]
- Dindo, D.; Demartines, N.; Clavien, P.A. Classification of surgical complications: A new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann. Surg. 2004, 240, 205–213. [Google Scholar] [CrossRef]
- US Department of Health and Human Services; National Institutes of Health; National Cancer Institute. Common Terminology Criteria for Adverse Events (CTCAE); Version 5; US Department of Health and Human Services; National Institutes of Health; National Cancer Institute: Rockville, MD, USA, 2017.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).