Predictors for Perioperative Blood Transfusion in Patients Undergoing Open Cystectomy and Urinary Diversion and Development of a Nomogram: An Observational Cohort Study
by
, , ,
Dominique Engel
1,†
,
Christian M. Beilstein
1,†,
Pascal Jerney
1,
Marc A. Furrer
2,3,
Fiona C. Burkhard
2,
Lukas M. Löffel
1 and
Patrick Y. Wuethrich
1,* 1
Department of Anaesthesiology and Pain Medicine, Inselspital, Bern University Hospital, University of Bern, CH 3010 Bern, Switzerland
2
Department of Urology, Inselspital, Bern University Hospital, University of Bern, CH 3010 Bern, Switzerland
3
Department of Urology, Royal Melbourne Hospital, The University of Melbourne, Melbourne, VIC 3050, Australia
*
Author to whom correspondence should be addressed.
†
Shared first authorship.
J. Clin. Med. 2021, 10(13), 2797; https://doi.org/10.3390/jcm10132797
Submission received: 18 May 2021
/
Revised: 10 June 2021
/
Accepted: 22 June 2021
/
Published: 25 June 2021
(This article belongs to the Section Nephrology & Urology)
Abstract
:Open radical cystectomy is associated with a substantial rate of perioperative blood transfusion. Early detection of potentially modifiable perioperative factors could reduce the need for perioperative blood transfusion and thus positively impact the outcome. We conducted an observational, single-center cohort study of 1168 patients undergoing cystectomy. Perioperative blood transfusion was defined as the need for packed red blood cells and/or fresh frozen plasma units within the first 24 h after the initiation of surgery. Multiple logistic regression analysis was performed to model the association between risk factors and blood transfusion, and a nomogram was developed. Blood transfusion occurred in 370/1168 patients (31.7%). Significant predictors were age (OR: 1.678, (95% CI: 1.379–2.042); p < 0.001), blood loss ratio (6.572, (4.878–8.853); p < 0.001), preoperative hemoglobin (0.316, (0.255–0.391); p < 0.001), tumor stage (2.067, (1.317–3.244); p = 0.002), use of oral anticoagulants (2.70, (1.163–6.270), p = 0.021), and interaction between female sex and blood loss ratio (1.344, (1.011–1.787); p = 0.042). Of the major predictors found to affect perioperative blood transfusion, two can be influenced: blood loss ratio by meticulous surgery and hemoglobin by preoperative optimization. Others such as age or advanced disease are not modifiable. This emphasizes the importance of optimal management of patients prior to surgery.
1. Introduction
Radical cystectomy, pelvic lymph node dissection, and urinary diversion remain the standard of care for patients with muscle-invasive bladder cancer [1]. Despite substantial improvement over the last decades in terms of surgical technique including robotic-assisted surgery, this procedure is still associated with substantial intraoperative blood loss and transfusion of packed red blood cells (PRBC) with or without administration of fresh frozen plasma (FFP) [2,3]. While robotic-assisted radical cystectomy has been associated with reduced blood loss and blood transfusion and is gaining more relevance, open radical cystectomy is still widely performed worldwide [4]. An overly restrictive blood transfusion strategy has been shown to increase the risk of the composite event “inadequate oxygen supply plus mortality” in a systematic review and meta-analysis, including context-specific conditions like patients’ characteristics and clinical setting [5]. On the other hand, the reported harm of blood transfusions is manifold. Perioperative blood transfusions have been associated with worse outcomes following cystectomy [6,7,8,9,10,11,12]. Blood transfusions have an immunomodulatory and immunosuppressive effect in the perioperative period [13,14], which predisposes patients to an increased rate of infection [15,16]. The intraoperative period is also crucial as the physiological response to surgery can induce a pro-tumor environment and thus negatively impact the control of minimal residual disease or metastatic spread of tumor cells. In this setting, the administration of PRBC and FFP with its profound negative effects on the immune system is detrimental [17]. In addition, blood transfusions per se are associated with adverse reactions like transfusion-related acute lung injury, which is considered the leading cause of blood transfusion-related morbidity. Finally, blood transfusions result in a relevant increase in overall medical costs [18,19].
Cystectomy patients are particularly inclined to receive blood transfusions as a substantial number of patients (up to 50%) are anemic preoperatively [20,21]. Based on these findings, we aimed to determine the risk factors for early blood transfusions, to identify potentially modifiable pre- and intraoperative factors, and to develop a nomogram to identify patients in need of preoperative optimization to reduce perioperative blood transfusions in patients planned for cystectomy.
2. Materials and Methods
This study reports a single, tertiary, high case-load center cohort study in accordance with the STROBE recommendations. Ethical approval was provided by the Ethics Committee of Canton Bern, Switzerland (2 June 2016, KEKBE 2016-00660), and the need for informed consent was waived.
2.1. Study Population and Data Collection
We identified 1174 consecutive patients at the Department of Urology, Bern University Hospital, between 4 January 2000 and 13 June 2016. We excluded six (0.51%) patients with insufficient follow-up or incomplete data, leaving 1168 for the final analysis.
All patient data evaluated were from a prospectively maintained database, including all relevant preoperative and oncological variables. Surgical factors were duration of surgery, intraoperative blood loss, previous surgery, perioperative need for PRBC and FFP transfusion, defined as blood transfusion within the first 24 h after the beginning of surgery [22,23].
Our institution has performed a similar and standardized open surgical technique for cystectomy and urinary diversion for the last 20 years, which has been described previously according to the Studer’s technique [24,25]. All patients were followed prospectively. During the observed period, PRBC was administered if hemoglobin values decreased to <80 g/L (or <100 g/L in patients with coronary artery disease). FFP was administered in the case of clinical coagulopathy or secondary to coagulation factor deficiency.
2.2. Outcome Measures
The need for a blood transfusion cannot be based on absolute blood loss alone but also depends on the patient’s blood volume. We, therefore, decided to implement a blood loss ratio based on the following calculations [26]:
- Indexed blood volume:
- Estimated blood volume:
- Blood loss ratio:
where BVi = indexed blood volume, BMI = body mass index, BVe = estimated blood volume, BLr = blood loss ratio, BLa = absolute blood loss
2.3. Statistical Analysis
Baseline, intraoperative, and postoperative variables between patients who received blood transfusions and patients who did not were compared. Continuous variables are presented as median and interquartile ranges (IQR) and categorical variables as frequencies (%). Group comparisons were calculated using the χ2 test for categorical and the Wilcoxon test for continuous variables. To identify independent risk factors for blood transfusions, we performed multiple logistic regression analyses. We first partitioned data into a training (90%) and a testing set (10%) to avoid overfitting and to assess model performance (ROC-AUC) on previously unseen data. We performed a stepwise selection procedure minimizing the Akaike information criterion (AIC) using the MASS package for R for the variable section. BMI, Charlson comorbidity index (CCI), use of blood thinners, previous surgery, tumor stage (using polynomial contrasts), positive nodal stage and neoadjuvant chemotherapy, duration of surgery, use of norepinephrine, and the total amount of fluid administered as well as the presence of and all two-way interactions between blood loss ratio, preoperative hemoglobin, age, and gender were evaluated for predictors of transfusion.
All continuous variables were normalized. Multicollinearity between predictors was checked using the variance inflation factor. Marginal means were calculated for ordinal categorical predictors using the “emmeans” package with multiplicity adjustment using the multivariate t distribution method. Model fit was assessed with the le Cessie–van Houwelingen–Copas–Hosmer global goodness of fit test, the Hosmer–Lemeshow test, binned residual plots (“performance” package), and GiViTi calibration plots (“givitiR” package) [27,28] (Appendix A, Table A1, Figure A1 and Figure A2).
A nomogram was used to visualize the final logistic regression model using the “rms” package [14]. We chose the inverse-logit transformation of the linear predictor to depict the probabilities of the outcomes.
We conducted a sensitivity analysis using modern machine learning models, especially elastic net logistic regression, random forest classification, and support vector machine. The results are depicted in the Appendix B and Appendix C (Table A3 and Figure A3).
A two-sided p < 0.05 was considered significant. Analyses were performed using the R software environment (R Foundation for Statistical Computing, Vienna, Austria, Version 4.0.2).
The sample size was based on a consecutive series of patients who underwent cystectomy and urinary diversion during the observation time. No formal statistical power calculation was calculated before the study.
3. Results
Overall, 370/1168 patients (31.7%) received blood transfusions within 24 h after the beginning of surgery. In the univariate analysis, patients in the transfused group were older (71 (64–77) vs. 67 years (59–74); p < 0.001), more often had neoadjuvant chemotherapy (20.3% vs. 12.7%; p = 0.001), were more often taking oral anticoagulants (5.7% vs. 2.9%; p = 0.03), had lower preoperative hemoglobin values (120 (104–131) vs. 135 g/L (123–145), p < 0.001) and were more comorbid (p < 0.001). There was a higher proportion of women (37.8% vs. 29.9%, p = 0.009) and more with advanced disease (positive nodal stage (p = 0.009) and tumor stage (p < 0.001)) in the transfused group. Duration of surgery was longer in transfused patients (409 (351–454) vs. 390 min (345–426); p < 0.001), and blood loss was higher (1400 mL (1000–2088) vs. 900 mL (700–1245); p < 0.001). This last observation persisted when blood loss ratio was applied (0.31 (0.22–0.42) vs. 0.19 (0.14–0.26). Consequently, the amount of crystalloids administered was higher 5.3 mL/kg/h (3.80–7.06) vs. 4.5 mL/kg/h (3.30–6.02); p < 0.001) in transfused patients (Table 1).
The multiple logistic regression model is shown in Figure 1. ROC-AUC assessed on an independent test set was 0.87. The model showed a well-calibrated goodness of fit (Hosmer and Lemeshow C test: p = 0.617, Hosmer and Lemeshow H test: p = 0.100 and le Cessie–van Houwelingen–Copas–Hosmer test: p = 0.525). Diagnostic performance indicators were 65% sensitivity and 91% specificity. Multiple logistic regression detected blood loss ratio (OR: 6.572 (95% CI: 4.878–8.853); p < 0.001), oral anticoagulants (2.701 (1.163–6.270), p = 0.021), preoperative hemoglobin (0.316 (0.255–0.391), p < 0.001), age (1.678 (1.379–2.042), p < 0.001), and tumor stage (linear trend: 2.067 (1.317–3.244), p = 0.002 and quadratic trend: 1.623 (1.059–2.489), p = 0.026) as significant predictors for blood transfusions (Table 2). The interaction between female sex and blood loss ratio was significant (1.344 (1.011–1.787), p = 0.042). Table 3 shows the estimated marginal means for confirmed tumor stage with implemented polynomial contrasts. With more advanced tumor stages, there was a significantly increased risk for blood transfusions: pT3-4 vs. pT0-2 (OR: 2.028 (95% CI: 1.251–3.287), p = 0.001).
Figure 2 shows the nomogram for predicting blood transfusions, based on the final multiple logistic regression model. Exemplary patients are presented in Appendix D (Figure A4, Figure A5, Figure A6, Figure A7 and Figure A8) and Appendix E (Table A4, Table A5, Table A6, Table A7, Table A8 and Table A9).
The sensitivity analyses using sophisticated machine learning models showed a non-inferiority of our traditional logistic regression model. We thus favored it because of the better interpretability (Appendix B and Appendix C).
4. Discussion
This study aimed to detect predictors for perioperative blood transfusion and to develop a nomogram to predict the need for transfusion in patients undergoing cystectomy. In our cohort, we found an incidence of blood transfusion of around 30%, comparable with the current literature [29,30].
Blood loss ratio, preoperative hemoglobin, and advanced age had the strongest association with the likelihood of receiving a blood transfusion. Other relevant factors were the use of oral anticoagulants, advanced tumor stage, and interaction of female sex with blood loss ratio.
Age and tumor stage are given for the perioperative period, but their impact on the probability of a blood transfusion is limited as they contribute to the total score in the nomogram by less than 2 points. This holds true for the use of oral anticoagulants as well.
However, we identified two potentially modifiable factors that highly influence the probability of blood transfusion. These are easily discernable in the developed nomogram by a thick line indicating their predominance: preoperative hemoglobin and blood loss ratio outweigh all other factors by far, as they contribute up to 16 points to the total score in the nomogram.
The leading and most evident protective factor is a high circulating oxygen transport capacity, thus a high preoperative hemoglobin value. Its higher impact compared to other factors like duration of surgery, tumor stage, or oral anticoagulation is striking, particularly for female patients. This further emphasizes the importance of a solid preparation of patients by implementing standardized patient blood management concepts prior to cystectomy. Preoperative anemia should be corrected accordingly, through intravenous administration of an iron formulation, which results in a more rapid response compared to the oral formulation [31,32]. In addition, vitamin B12 and folic acid are also recommended for intravenous iron administration [33].
Furthermore, the use of continuous low-dose norepinephrine intraoperatively was included in the final model and nomogram, albeit not reaching statistical significance. This has been shown previously and is now confirmed in a large series of more than 1000 patients [34,35]. The protective effect of norepinephrine against blood transfusion is most likely attributed to vasoconstriction induced by the pre-emptive/concomitant use of a predominantly α-adrenergic vasopressor with only mild but dose-dependent β-adrenergic effects [29,35].
Female sex has been associated with an increased rate of blood transfusion in cardiac and major non-cardiac surgery [36,37,38]. Furthermore, Siegrist et al. found in a large cystectomy cohort that blood loss and transfusion rate were higher in 280 females [39]. In our series, this is only true if interacted with the blood loss ratio, potentially due to the lower circulating blood volume in females. Based on our nomogram, anemic female patients have a nearly twofold higher risk of receiving a blood transfusion than male patients with a similar blood loss ratio. In addition, we confirmed once again that the type of urinary diversion has no impact on blood loss and the rate of blood transfusion [34].
Although blood transfusions can be lifesaving and necessary in some cases, and they are safer than they have ever been, they still negatively influence the immune system. Blood transfusions are associated with promoting a proangiogenic environment inducing tumor growth by releasing cytokines IL6, IL10, and TNFα, and regulatory T-cell activation suppressing the anti-tumoral Th1 response [14]. Notably, not only PRBC but also FFP induce a pro-inflammatory burden and have the potential to affect natural killer cell activity. FFP contains Th2 cytokines, which induce a dose-dependent release of TNFα and IL10 [40]. This cytokine response is known to be pro-tumoral.
The ideal perioperative blood transfusion strategy in major oncological surgery remains unclear. This is especially important for older comorbid patients because a too restrictive blood transfusion regimen could increase the risk of early major postoperative complications (ischemic, cardiogenic). On the other hand, a too liberal strategy raises the risk of thromboembolic events [5,41,42,43]. Thus, a careful balance between the short-term benefits of blood transfusions in terms of reduction in early major postoperative complications versus the long-term benefits in terms of better cancer-related outcomes should be made depending on the patient's characteristics. Meticulous surgical technique reducing blood loss, restrictive fluid administration avoiding hemodilution, normothermia reducing the risk of coagulopathy, and a restrictive threshold for transfusions of PRBC and FFP are valuable intraoperative options to reduce blood transfusion rates [29,44]. In the era of cryoprecipitate and fibrinogen concentrates, the indication for FFP should be reconsidered as it has been associated with transfusion-associated circulatory overload and transfusion-related acute lung injury. Malignancy and the disturbances in the perioperative period are known to induce prothrombotic stimuli, and administration of blood transfusions has been associated with an elevated risk of thromboembolic events [45]. Hence, the administration of PRBC and FFP units must be evaluated carefully.
The key finding of this study is that the most important and most efficient method to avoid blood transfusion is preoperative patient optimization as depicted in our nomogram. The cornerstone in preparing patients scheduled for cystectomy is to optimize hemoglobin levels in anemic patients to within the normal to high hemoglobin range (≥130 g/L in both sexes) as proposed in the international consensus statement on the perioperative management of anemia and iron deficiency [46]. Their recommendations include a perioperative care pathway to investigate and correct anemia. In order to minimize the risk of unfavorable transfusion-related outcomes, the implementation of patient blood management strategies is valuable, even if the time between decision and surgery is limited, to avoid postponing major cancer-related surgery [47].
5. Conclusions
The incidence of perioperative blood transfusions in patients undergoing cystectomy was around 30%. Of the predictors affecting blood transfusions, only blood loss ratio and preoperative hemoglobin can be addressed by meticulous surgery and surgical technique, or optimization of preoperative hemoglobin as depicted in our nomogram. Others, like age or advanced tumor disease, are not modifiable. This emphasizes the importance of optimal preparation of patients undergoing cystectomy and minimal bleeding during surgery. We, therefore, strongly suggest the implementation of solid patient blood management, as previously proposed, to increase preoperative hemoglobin concentration.
Limitations
This is a retrospective study based on prospectively recorded data. We, therefore, cannot exclude deviation of the transfusion protocol due to clinical decision-making. This limits the generalizability of these findings. However, we were able to confirm, in part, precedent results. In addition, there is a high likelihood for a negative selection bias in the group receiving blood transfusions. Patients receiving blood transfusions were more likely to have more advanced oncological disease, were older, and more comorbid at the time of surgery. A randomized, controlled trial, which would be the ideal design to avoid bias and answer this question, seems ethically not justifiable.
Author Contributions
Conceptualization, P.Y.W., D.E., and C.M.B.; methodology, P.Y.W., D.E., and C.M.B.; software, P.J.; validation, P.Y.W., P.J., and L.M.L.; formal analysis, P.Y.W. and P.J.; investigation, P.Y.W., M.A.F., D.E., and F.C.B.; data curation, P.Y.W. and P.J.; writing—original draft preparation, P.Y.W., D.E., and F.C.B.; writing—review and editing, all authors, visualization, P.J.; supervision, P.Y.W. and F.C.B. All authors have read and agreed to the published version of the manuscript.
Funding
This study was supported by internal institutional research funds of the Department of Anaesthesiology and Pain Medicine and the Department of Urology, Bern University Hospital, University of Bern, Bern, Switzerland.
Institutional Review Board Statement
This study reports a single, tertiary, high case-load center cohort study in accordance with the STROBE recommendations. The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of Canton Bern, Switzerland (KEKBE 2016-00660).
Informed Consent Statement
Patient consent was waived due to the retrospective design of the study and accords to the Swiss Human Research law.
Data Availability Statement
Data supporting generated results are available by the corresponding author.
Acknowledgments
Assistance with the study: The authors thank Markus Huber, (Department of Anaesthesiology and Pain Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland) for the support in statistical analyses.
Conflicts of Interest
The authors declare no conflict of interest.
Appendix A
Table A1.
Model diagnostics variance inflation factor (VIF) >10 indicating the presence of multicollinearity.
Table A1.
Model diagnostics variance inflation factor (VIF) >10 indicating the presence of multicollinearity.
| Variable | VIF | Df |
|---|---|---|
| Blood loss ratio | 1.468 | 1 |
| Oral anticoagulants | 1.041 | 1 |
| Preoperative hemoglobin | 1.322 | 1 |
| Age | 1.180 | 1 |
| Tumor stage | 1.155 | 4 |
| Duration of surgery | 1.326 | 1 |
| Norepinephrine | 1.071 | 1 |
| Female sex | 1.091 | 1 |
| Blood loss ratio x preoperative hemoglobin | 1.109 | 1 |
| Blood loss ratio x female | 1.138 | 1 |
Figure A1.
Gruppo Italiano per la valutazione degli interventi in Terapia Intensiva (GiViTi) internal calibration.
Figure A1.
Gruppo Italiano per la valutazione degli interventi in Terapia Intensiva (GiViTi) internal calibration.
Figure A2.
GiViTi external calibration.
Appendix B. Comparison with Machine Learning Models
All machine learning models were performed using the “tidymodels” package for R.
Elastic Net Logistic Regression
A 10-fold repeated 10-fold cross-validation was performed to find the best tuning parameters out of 50 combinations, which were chosen by the maximum entropy method. The best model was selected with a penalty of 0.0331 and a mixture parameter of 0.381 (0 being only ridge regression and 1 being only lasso regression), maximizing ROC-AUC.
Random Forest
A 10-fold repeated, 10-fold cross-validation was performed to find the best tuning parameters out of 100 combinations, which were chosen by the maximum entropy method. The best model was selected with mtry (number of variables available for splitting at each tree node) of 3 and a min_n (minimum number of data points in a node that are required for the node to be split further) of 34, maximizing ROC-AUC. The number of trees contained in the ensemble was always 1000.
Support Vector Machine
We used a radial basis function for the kernel. A 10-fold repeated, 10-fold cross-validation was performed to find the best tuning parameters out of 100 combinations, which were chosen by the maximum entropy method. The best model was selected with a cost of 3 and a sigma for the kernel of 0.0339, maximizing ROC-AUC.
Model performance
Model performance was assessed using a separate test set comprised of 10% of the whole data set as described in the Methods section of the main article.
Table A2.
Comparison.
| Model | Accuracy | ROC-AUC | Brier |
|---|---|---|---|
| Elastic Net Logistic Regression | 0.783 | 0.867 | 0.137 |
| Stepwise Logistic Regression | 0.800 | 0.864 | 0.136 |
| Support Vector Machine | 0.800 | 0.864 | 0.133 |
| Random Forest | 0.800 | 0.829 | 0.147 |
Appendix C. Feature Importance
Figure A3.
Feature importance plot with bars showing the loss in ROC-AUC when the corresponding term is removed.
Figure A3.
Feature importance plot with bars showing the loss in ROC-AUC when the corresponding term is removed.
Appendix D. Model Predictions for Exemplary Patients
Figure A4.
Younger female patient with normal hemoglobin level and lower blood loss (probability of transfusion: ptrans = 1%).
Figure A4.
Younger female patient with normal hemoglobin level and lower blood loss (probability of transfusion: ptrans = 1%).
Figure A5.
Older female patient with lower hemoglobin levels and higher blood loss (ptrans = 95%).
Figure A6.
Older male patient with lower hemoglobin levels and lower blood loss (ptrans = 24.5%).
Figure A7.
Younger male patient with higher hemoglobin levels and higher blood loss (ptrans = 25.5%).
Figure A7.
Younger male patient with higher hemoglobin levels and higher blood loss (ptrans = 25.5%).
Figure A8.
Older male patient with higher hemoglobin levels and higher blood loss (ptrans = 47.4%).
Appendix E. Nomogram Manual Score
Table A3.
Age.
| YEARS | POINTS |
|---|---|
| <65 | 0 |
| 65–79 | 1 |
| >79 | 2 |
Table A4.
Duration of surgery.
| MINUTES | POINTS |
|---|---|
| <480 | 0 |
| 480–959 | 1 |
| >960 | 2 |
Table A5.
Preoperative hemoglobin—Blood loss ratio—Sex.
| BLOOD LOSS RATIO—MALE | BLOOD LOSS RATIO—FEMALE | |||||||
|---|---|---|---|---|---|---|---|---|
| HB | 0.1 | 0.2 | 0.3 | 0.4 | 0.1 | 0.2 | 0.3 | 0.4 |
| 160 | 1 | 3 | 5 | 8 | 0 | 3 | 6 | 9 |
| 150 | 2 | 4 | 6 | 8 | 1 | 4 | 7 | 10 |
| 140 | 3 | 5 | 7 | 9 | 3 | 5 | 8 | 10 |
| 130 | 5 | 6 | 8 | 10 | 4 | 6 | 9 | 11 |
| 120 | 6 | 8 | 9 | 11 | 5 | 7 | 10 | 12 |
| 110 | 7 | 9 | 10 | 12 | 6 | 8 | 11 | 13 |
| 100 | 8 | 10 | 11 | 13 | 8 | 10 | 12 | 14 |
| 90 | 10 | 11 | 12 | 13 | 9 | 11 | 13 | 14 |
| 80 | 11 | 12 | 13 | 14 | 10 | 12 | 13 | 15 |
| 70 | 12 | 13 | 14 | 15 | 11 | 13 | 14 | 16 |
Table A6.
Oral anticoagulation.
| POINTS | |
|---|---|
| NO | 0 |
| YES | 2 |
Table A7.
Confirmed tumor stage.
| STAGE | POINTS |
|---|---|
| PT0 | 0 |
| PT1 | 0 |
| PT2 | 0 |
| PT3 | 1 |
| PT4 | 2 |
Table A8.
Norepinephrine use.
| POINTS | |
|---|---|
| NO | 1 |
| YES | 0 |
Table A9.
Probability of transfusion.
| TOTAL POINTS | PROBABILITY OF TRANSFUSION |
|---|---|
| 4 | 0.01 |
| 8 | 0.1 |
| 10 | 0.25 |
| 12 | 0.5 |
| 14 | 0.75 |
| 15 | 0.9 |
| 19 | 0.99 |
References
- Stenzl, A.; Cowan, N.C.; De Santis, M.; Jakse, G.; Kuczyk, M.A.; Merseburger, A.S.; Ribal, M.J.; Sherif, A.; Witjes, J.A. The updated EAU guidelines on muscle-invasive and metastatic bladder cancer. Eur. Urol. 2009, 55, 815–825. [Google Scholar] [CrossRef]
- Pillai, P.; McEleavy, I.; Gaughan, M.; Snowden, C.; Nesbitt, I.; Durkan, G.; Johnson, M.; Cosgrove, J.; Thorpe, A. A double-blind randomized controlled clinical trial to assess the effect of Doppler optimized intraoperative fluid management on outcome following radical cystectomy. J. Urol. 2011, 186, 2201–2206. [Google Scholar] [CrossRef] [PubMed]
- Hollenbeck, B.K.; Miller, D.C.; Taub, D.A.; Dunn, R.L.; Khuri, S.F.; Henderson, W.G.; Montie, J.E.; Underwood, W., 3rd; Wei, J.T. The effects of adjusting for case mix on mortality and length of stay following radical cystectomy. J. Urol. 2006, 176, 1363–1368. [Google Scholar] [CrossRef] [PubMed]
- Parekh, D.J.; Reis, I.M.; Castle, E.P.; Gonzalgo, M.L.; Woods, M.E.; Svatek, R.S.; Weizer, A.Z.; Konety, B.R.; Tollefson, M.; Krupski, T.L.; et al. Robot-assisted radical cystectomy versus open radical cystectomy in patients with bladder cancer (RAZOR): An open-label, randomised, phase 3, non-inferiority trial. Lancet 2018, 391, 2525–2536. [Google Scholar] [CrossRef]
- Hovaguimian, F.; Myles, P.S. Restrictive versus Liberal Transfusion Strategy in the Perioperative and Acute Care Settings: A Context-specific Systematic Review and Meta-analysis of Randomized Controlled Trials. Anesthesiology 2016, 125, 46–61. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Sui, W.; Onyeji, I.C.; Matulay, J.T.; James, M.B.; Theofanides, M.C.; Wenske, S.; DeCastro, G.J. Perioperative blood transfusion in radical cystectomy: Analysis of the National Surgical Quality Improvement Program database. Int. J. Urol. Off. J. Jpn. Urol. Assoc. 2016, 23, 745–750. [Google Scholar] [CrossRef]
- Kluth, L.A.; Xylinas, E.; Rieken, M.; El Ghouayel, M.; Sun, M.; Karakiewicz, P.I.; Lotan, Y.; Chun, F.K.; Boorjian, S.A.; Lee, R.K.; et al. Impact of peri-operative blood transfusion on the outcomes of patients undergoing radical cystectomy for urothelial carcinoma of the bladder. BJU Int. 2014, 113, 393–398. [Google Scholar] [CrossRef] [Green Version]
- Abel, E.J.; Linder, B.J.; Bauman, T.M.; Bauer, R.M.; Thompson, R.H.; Thapa, P.; Devon, O.N.; Tarrell, R.F.; Frank, I.; Jarrard, D.F.; et al. Perioperative blood transfusion and radical cystectomy: Does timing of transfusion affect bladder cancer mortality? Eur. Urol. 2014, 66, 1139–1147. [Google Scholar] [CrossRef]
- Linder, B.J.; Frank, I.; Cheville, J.C.; Tollefson, M.K.; Thompson, R.H.; Tarrell, R.F.; Thapa, P.; Boorjian, S.A. The Impact of Perioperative Blood Transfusion on Cancer Recurrence and Survival Following Radical Cystectomy. Eur. Urol. 2013. [Google Scholar] [CrossRef]
- Volz, Y.; Eismann, L.; Pfitzinger, P.L.; Jokisch, J.F.; Buchner, A.; Schlenker, B.; Stief, C.G.; Schulz, G.B. Prognostic impact of perioperative blood transfusions on oncological outcomes of patients with bladder cancer undergoing radical cystectomy: A systematic review. Arab J. Urol. 2020, 19, 24–30. [Google Scholar] [CrossRef]
- Morgan, T.M.; Barocas, D.A.; Chang, S.S.; Phillips, S.E.; Salem, S.; Clark, P.E.; Penson, D.F.; Smith, J.A., Jr.; Cookson, M.S. The relationship between perioperative blood transfusion and overall mortality in patients undergoing radical cystectomy for bladder cancer. Urol. Oncol. 2011. [Google Scholar] [CrossRef] [Green Version]
- Buchner, A.; Grimm, T.; Schneevoigt, B.S.; Wittmann, G.; Kretschmer, A.; Jokisch, F.; Grabbert, M.; Apfelbeck, M.; Schulz, G.; Gratzke, C.; et al. Dramatic impact of blood transfusion on cancer-specific survival after radical cystectomy irrespective of tumor stage. Scand. J. Urol. 2017. [Google Scholar] [CrossRef] [PubMed]
- Sugita, S.; Sasaki, A.; Iwaki, K.; Uchida, H.; Kai, S.; Shibata, K.; Ohta, M.; Kitano, S. Prognosis and postoperative lymphocyte count in patients with hepatocellular carcinoma who received intraoperative allogenic blood transfusion: A retrospective study. Eur. J. Surg. Oncol. J. Eur. Soc. Surg. Oncol. Br. Assoc. Surg. Oncol. 2008, 34, 339–345. [Google Scholar] [CrossRef] [PubMed]
- Karam, O.; Tucci, M.; Toledano, B.J.; Robitaille, N.; Cousineau, J.; Thibault, L.; Lacroix, J.; Le Deist, F. Length of storage and in vitro immunomodulation induced by prestorage leukoreduced red blood cells. Transfusion 2009, 49, 2326–2334. [Google Scholar] [CrossRef] [PubMed]
- Houbiers, J.G.; van de Velde, C.J.; van de Watering, L.M.; Hermans, J.; Schreuder, S.; Bijnen, A.B.; Pahlplatz, P.; Schattenkerk, M.E.; Wobbes, T.; de Vries, J.E.; et al. Transfusion of red cells is associated with increased incidence of bacterial infection after colorectal surgery: A prospective study. Transfusion 1997, 37, 126–134. [Google Scholar] [CrossRef]
- Vamvakas, E.C. Possible mechanisms of allogeneic blood transfusion-associated postoperative infection. Transfus. Med. Rev. 2002, 16, 144–160. [Google Scholar] [CrossRef]
- Vamvakas, E.C.; Pineda, A.A. Autologous transfusion and other approaches to reduce allogeneic blood exposure. Best Pract. Res. Clin. Haematol. 2000, 13, 533–547. [Google Scholar] [CrossRef] [PubMed]
- Kaserer, A.; Rössler, J.; Braun, J.; Farokhzad, F.; Pape, H.C.; Dutkowski, P.; Plass, A.; Horisberger, T.; Volbracht, J.; Manz, M.G.; et al. Impact of a Patient Blood Management monitoring and feedback programme on allogeneic blood transfusions and related costs. Anaesthesia 2019, 74, 1534–1541. [Google Scholar] [CrossRef] [Green Version]
- Drabinski, T.; Zacharowski, K.; Meybohm, P.; Rüger, A.M.; Ramirez de Arellano, A. Estimating the Epidemiological and Economic Impact of Implementing Preoperative Anaemia Measures in the German Healthcare System: The Health Economic Footprint of Patient Blood Management. Adv. Ther. 2020, 37, 3515–3536. [Google Scholar] [CrossRef] [PubMed]
- Ferran-Carpintero, A.; Domínguez-García, A.; Muñoz-Rodríguez, J.; Barquero-López, M.; Prera-Vilaseca, Á.; Bonfill-Abella, T.; Gallardo-Díaz, E.; Hannaoui-Hadi, N.; García-Rojo, D.; Prats-López, J. Impact of anemia on the survival of patients undergoing radical cystectomy for bladder cancer. Actas Urol. Esp. 2020, 44, 489–496. [Google Scholar] [CrossRef] [PubMed]
- Ceanga, A.I.; Ceanga, M.; Eveslage, M.; Herrmann, E.; Fischer, D.; Haferkamp, A.; Wittmann, M.; Müller, S.; Van Aken, H.; Steinbicker, A.U. Preoperative anemia and extensive transfusion during stay-in-hospital are critical for patient`s mortality: A retrospective multicenter cohort study of oncological patients undergoing radical cystectomy. Transfus. Apher. Sci. Off. J. World Apher. Assoc. Off. J. Eur. Soc. Haemapheresis 2018, 57, 739–745. [Google Scholar] [CrossRef]
- Dindo, D.; Demartines, N.; Clavien, P.A. Classification of surgical complications: A new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann. Surg. 2004, 240, 205–213. [Google Scholar] [CrossRef] [PubMed]
- Slankamenac, K.; Graf, R.; Barkun, J.; Puhan, M.A.; Clavien, P.A. The comprehensive complication index: A novel continuous scale to measure surgical morbidity. Ann. Surg. 2013, 258, 1–7. [Google Scholar] [CrossRef] [Green Version]
- Burkhard, F.C.; Kessler, T.M.; Mills, R.; Studer, U.E. Continent urinary diversion. Crit. Rev. Oncol. Hematol. 2006, 57, 255–264. [Google Scholar] [CrossRef] [PubMed]
- Perimenis, P.; Studer, U.E. Orthotopic continent urinary diversion an ileal low pressure neobladder with an afferent tubular segment: How I do it. Eur. J. Surg. Oncol. J. Eur. Soc. Surg. Oncol. Br. Assoc. Surg. Oncol. 2004, 30, 454–459. [Google Scholar] [CrossRef]
- Lemmens, H.J.; Bernstein, D.P.; Brodsky, J.B. Estimating blood volume in obese and morbidly obese patients. Obes. Surg. 2006, 16, 773–776. [Google Scholar] [CrossRef]
- Hosmer, D.W.; Hosmer, T.; Le Cessie, S.; Lemeshow, S. A comparison of goodness-of-fit tests for the logistic regression model. Stat. Med. 1997, 16, 965–980. [Google Scholar] [CrossRef]
- Nattino, G.; Finazzi, S.; Bertolini, G. A new test and graphical tool to assess the goodness of fit of logistic regression models. Stat. Med. 2016, 35, 709–720. [Google Scholar] [CrossRef] [PubMed]
- Wuethrich, P.Y.; Studer, U.E.; Thalmann, G.N.; Burkhard, F.C. Intraoperative Continuous Norepinephrine Infusion Combined with Restrictive Deferred Hydration Significantly Reduces the Need for Blood Transfusion in Patients Undergoing Open Radical Cystectomy: Results of a Prospective Randomised Trial. Eur. Urol. 2014, 66, 352–360. [Google Scholar] [CrossRef] [PubMed]
- Bostrom, P.J.; Mirtti, T.; Kossi, J.; Laato, M.; Nurmi, M. Twenty-year experience of radical cystectomy for bladder cancer in a medium-volume centre. Scand. J. Urol. Nephrol. 2009, 43, 357–364. [Google Scholar] [CrossRef]
- Theusinger, O.M.; Leyvraz, P.F.; Schanz, U.; Seifert, B.; Spahn, D.R. Treatment of iron deficiency anemia in orthopedic surgery with intravenous iron: Efficacy and limits: A prospective study. Anesthesiology 2007, 107, 923–927. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Jones, J.J.; Mundy, L.M.; Blackman, N.; Shwarz, M. Ferric Carboxymaltose for Anemic Perioperative Populations: A Systematic Literature Review of Randomized Controlled Trials. J. Blood Med. 2021, 12, 337–359. [Google Scholar] [CrossRef]
- Mottet, N.; Ribal, M.J.; Boyle, H.; De Santis, M.; Caillet, P.; Choudhury, A.; Garg, T.; Nielsen, M.; Wuthrich, P.; Gust, K.M.; et al. Management of bladder cancer in older patients: Position paper of a SIOG Task Force. J. Geriatr. Oncol. 2020, 11, 1043–1053. [Google Scholar] [CrossRef]
- Furrer, M.A.; Fellmann, A.; Schneider, M.P.; Thalmann, G.N.; Burkhard, F.C.; Wuethrich, P.Y. Impact of Packed Red Blood Cells and Fresh Frozen Plasma Given During Radical Cystectomy and Urinary Diversion on Cancer-related Outcome and Survival: An Observational Cohort Study. Eur. Urol. Focus 2018, 4, 916–923. [Google Scholar] [CrossRef]
- Wuethrich, P.Y.; Burkhard, F.C. Improved perioperative outcome with norepinephrine and a restrictive fluid administration during open radical cystectomy and urinary diversion. Urol. Oncol. 2014. [Google Scholar] [CrossRef] [PubMed]
- Stammers, A.H.; Tesdahl, E.A.; Mongero, L.B.; Stasko, A. Gender and intraoperative blood transfusion: Analysis of 54,122 non-reoperative coronary revascularization procedures. Perfusion 2019, 34, 236–245. [Google Scholar] [CrossRef] [PubMed]
- Cao, G.; Huang, Z.; Huang, Q.; Zhang, S.; Xu, B.; Pei, F. Incidence and Risk Factors for Blood Transfusion in Simultaneous Bilateral Total Joint Arthroplasty: A Multicenter Retrospective Study. J. Arthroplast. 2018, 33, 2087–2091. [Google Scholar] [CrossRef]
- Gombotz, H.; Schreier, G.; Neubauer, S.; Kastner, P.; Hofmann, A. Gender disparities in red blood cell transfusion in elective surgery: A post hoc multicentre cohort study. BMJ Open 2016, 6, e012210. [Google Scholar] [CrossRef]
- Siegrist, T.; Savage, C.; Shabsigh, A.; Cronin, A.; Donat, S.M. Analysis of gender differences in early perioperative complications following radical cystectomy at a tertiary cancer center using a standardized reporting methodology. Urol. Oncol. 2010, 28, 112–117. [Google Scholar] [CrossRef] [PubMed]
- Theusinger, O.M.; Baulig, W.; Seifert, B.; Emmert, M.Y.; Spahn, D.R.; Asmis, L.M. Relative concentrations of haemostatic factors and cytokines in solvent/detergent-treated and fresh-frozen plasma. Br. J. Anaesth. 2011, 106, 505–511. [Google Scholar] [CrossRef] [Green Version]
- de Almeida, J.P.; Vincent, J.L.; Galas, F.R.; de Almeida, E.P.; Fukushima, J.T.; Osawa, E.A.; Bergamin, F.; Park, C.L.; Nakamura, R.E.; Fonseca, S.M.; et al. Transfusion requirements in surgical oncology patients: A prospective, randomized controlled trial. Anesthesiology 2015, 122, 29–38. [Google Scholar] [CrossRef] [PubMed]
- Hajjar, L.A.; Fukushima, J.T.; Almeida, J.P.; Osawa, E.A.; Galas, F.R. Strategies to reduce blood transfusion: A Latin-American perspective. Curr. Opin. Anaesthesiol. 2015, 28, 81–88. [Google Scholar] [CrossRef]
- Nakamura, R.E.; Vincent, J.L.; Fukushima, J.T.; de Almeida, J.P.; Franco, R.A.; Lee Park, C.; Osawa, E.A.; Pinto Silva, C.M.; Costa Auler, J.O., Jr.; Landoni, G.; et al. A liberal strategy of red blood cell transfusion reduces cardiogenic shock in elderly patients undergoing cardiac surgery. J. Thorac. Cardiovasc. Surg. 2015, 150, 1314–1320. [Google Scholar] [CrossRef] [Green Version]
- Syan-Bhanvadia, S.; Drangsholt, S.; Shah, S.; Cai, J.; Miranda, G.; Djaladat, H.; Daneshmand, S. Restrictive transfusion in radical cystectomy is safe. Urol. Oncol. 2017, 35, 528.e15–528.e21. [Google Scholar] [CrossRef] [PubMed]
- Xenos, E.S.; Vargas, H.D.; Davenport, D.L. Association of blood transfusion and venous thromboembolism after colorectal cancer resection. Thromb. Res. 2012, 129, 568–572. [Google Scholar] [CrossRef]
- Muñoz, M.; Acheson, A.G.; Auerbach, M.; Besser, M.; Habler, O.; Kehlet, H.; Liumbruno, G.M.; Lasocki, S.; Meybohm, P.; Rao Baikady, R.; et al. International consensus statement on the peri-operative management of anaemia and iron deficiency. Anaesthesia 2017, 72, 233–247. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Carli, F.; Awasthi, R.; Gillis, C.; Kassouf, W. Optimizing a frail elderly patient for radical cystectomy with a prehabilitation program. Can. Urol. Assoc. J. 2014, 8, E884–E887. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1.
Effect plots for the predictors included in the final model (multiple logistic regression with adjusted odds ratio). Asterisks show the level of significance, *** for p < 0.001, ** for p < 0.01, * for p < 0.05.
Figure 1.
Effect plots for the predictors included in the final model (multiple logistic regression with adjusted odds ratio). Asterisks show the level of significance, *** for p < 0.001, ** for p < 0.01, * for p < 0.05.
Figure 2.
Nomogram of the logistic regression model to predict early perioperative blood transfusion.
Figure 2.
Nomogram of the logistic regression model to predict early perioperative blood transfusion.
Table 1.
Baseline, oncological, and surgical/anesthetic characteristics.
| Non-Transfused | Blood Transfusion | p-Value | SMD | |
|---|---|---|---|---|
| Baseline Characteristics | ||||
| Number of Patients (%) | 798 (68.3) | 370 (31.7) | ||
| Age (years) (median (IQR)) | 67.08 (59.21, 74.29) | 71.05 (64.04, 77.41) | <0.001 | 0.296 |
| Sex (female) (%) | 239 (29.9) | 140 (37.8) | 0.009 | 0.167 |
| BMI (kg/m2) (median (IQR)) | 25.56 (22.86, 28.72) | 25.40 (22.73, 28.51) | 0.710 | 0.039 |
| Charlson Comorbidity Index (%) | <0.001 | 0.317 | ||
| 0 | 304 (38.1) | 106 (28.6) | ||
| 1 | 131 (16.4) | 48 (13.0) | ||
| 2 | 181 (22.7) | 90 (24.3) | ||
| 3 | 98 (12.3) | 56 (15.1) | ||
| 4 | 55 (6.9) | 37 (10.0) | ||
| 5 and more | 29 (3.6) | 33 (8.9) | ||
| Oral anticoagulation (%) | 23 (2.9) | 21 (5.7) | 0.030 | 0.138 |
| Thrombocyte aggregation inhibition (%) | 87 (10.9) | 40 (10.8) | 1.000 | 0.003 |
| Preoperative Hb (g/L) (median (IQR)) | 135.00 (123, 145) | 120.00 (104, 130.75) | <0.001 | 0.826 |
| Preoperative Tc (G/L) (median (IQR)) | 251.5 (211, 309) | 267.00 (214.25, 338.75) | 0.002 | 0.236 |
| Oncological characteristics | ||||
| Confirmed tumor stage pT (%) | <0.001 | 0.414 | ||
| 0 | 201 (25.2) | 59 (15.9) | ||
| 1 | 111 (13.9) | 38 (10.3) | ||
| 2 | 193 (24.2) | 75 (20.3) | ||
| 3 | 233 (29.2) | 129 (34.9) | ||
| 4 | 60 (7.5) | 69 (18.6) | ||
| Confirmed positive nodal stage (%) | 167 (20.9) | 104 (28.1) | 0.009 | 0.168 |
| Neoadjuvant chemotherapy (%) | 101 (12.7) | 75 (20.3) | 0.001 | 0.206 |
| Surgical/anesthetic characteristics | ||||
| Previous surgery (%) | 326 (40.9) | 162 (43.8) | 0.378 | 0.059 |
| Duration of surgery (min) (median (IQR)) | 390 (345, 425.75) | 408.50 (351, 454) | <0.001 | 0.293 |
| Blood loss (ml) (median (IQR)) | 900 (700, 1245) | 1400.00 (1000, 2087.5) | <0.001 | 0.782 |
| Blood loss ratio (median (IQR)) | 0.19 (0.14, 0.26) | 0.31 (0.22, 0.42) | <0.001 | 0.862 |
| Norepinephrine use (%) | 519 (65.0) | 203 (54.9) | 0.001 | 0.209 |
| Crystalloids (ml/kg/h) (median (IQR)) | 4.5 (3.30, 6.02) | 5.30 (3.80, 7.06) | <0.001 | 0.253 |
Abbreviations: Tc, thrombocytes; Hb, hemoglobin, SMD: standardized mean difference.
Table 2.
Multivariate analysis of factors associated with the rate of early blood transfusion.
| Variables | Odds Ratio | 95% CI | p-Value |
|---|---|---|---|
| * Blood loss ratio | 6.5717 | 4.8781–8.8532 | <0.0001 |
| * Oral anticoagulants | 2.7007 | 1.1633–6.2699 | 0.0208 |
| * Preoperative Hemoglobin (g/L) | 0.3155 | 0.2545–0.3912 | <0.0001 |
| * Age (y) | 1.6782 | 1.3794–2.0416 | <0.0001 |
| * Confirmed tumor stage (linear trend) | 2.0670 | 1.317–3.2441 | 0.0016 |
| * Confirmed tumor stage (quadratic trend) | 1.6233 | 1.0587–2.4892 | 0.0263 |
| * Confirmed tumor stage (cubic trend) | 0.9408 | 0.6111–1.4484 | 0.7818 |
| * Confirmed tumor stage (quartic trend) | 0.9705 | 0.6541–1.4398 | 0.8816 |
| * Duration of surgery < (min) | 1.2011 | 0.9812–1.4701 | 0.0757 |
| * Norepinephrine used | 0.7220 | 0.5028–1.0367 | 0.0776 |
| Sex (female) | 1.0356 | 0.8666–1.2376 | 0.7002 |
| Blood loss ratio * preoperative Hb | 1.2619 | 0.9714–1.6393 | 0.0814 |
| * Blood loss ratio * female gender | 1.3443 | 1.0112–1.7871 | 0.0417 |
* = Variables included in the final model. Level of significance p < 0.05, CI = confidence interval, Hb = hemoglobin.
Table 3.
Estimated marginal means for tumor stage (i.e., mean change contrasts for confirmed tumor stage).
Table 3.
Estimated marginal means for tumor stage (i.e., mean change contrasts for confirmed tumor stage).
| Variable | Contrast | Odds Ratio | 95% CI | p-Value |
|---|---|---|---|---|
| Confirmed tumor stage | 0 vs. 1–4 | 1.2595 | 0721–2.199 | 0.6774 |
| Confirmed tumor stage | 0–1 vs. 2–4 | 1.6052 | 0.978–2.635 | 0.0662 |
| Confirmed tumor stage | 0-2 vs. 3–4 | 2.0278 | 1.252–3.285 | 0.0014 |
| Confirmed tumor stage | 0–3 vs. 4 | 2.3849 | 1.223–4.650 | 0.0057 |
Level of significance p < 0.05, CI = confidence interval.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
MDPI and ACS Style
Engel, D.; Beilstein, C.M.; Jerney, P.; Furrer, M.A.; Burkhard, F.C.; Löffel, L.M.; Wuethrich, P.Y. Predictors for Perioperative Blood Transfusion in Patients Undergoing Open Cystectomy and Urinary Diversion and Development of a Nomogram: An Observational Cohort Study. J. Clin. Med. 2021, 10, 2797. https://doi.org/10.3390/jcm10132797
AMA Style
Engel D, Beilstein CM, Jerney P, Furrer MA, Burkhard FC, Löffel LM, Wuethrich PY. Predictors for Perioperative Blood Transfusion in Patients Undergoing Open Cystectomy and Urinary Diversion and Development of a Nomogram: An Observational Cohort Study. Journal of Clinical Medicine. 2021; 10(13):2797. https://doi.org/10.3390/jcm10132797
Chicago/Turabian StyleEngel, Dominique, Christian M. Beilstein, Pascal Jerney, Marc A. Furrer, Fiona C. Burkhard, Lukas M. Löffel, and Patrick Y. Wuethrich. 2021. "Predictors for Perioperative Blood Transfusion in Patients Undergoing Open Cystectomy and Urinary Diversion and Development of a Nomogram: An Observational Cohort Study" Journal of Clinical Medicine 10, no. 13: 2797. https://doi.org/10.3390/jcm10132797
Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.
