Skip to Content
You are currently on the new version of our website. Access the old version .
JCMJournal of Clinical Medicine
  • Article
  • Open Access

6 May 2023

Single Center, Propensity Score Matching Analysis of Different Reconstruction Techniques following Pancreatoduodenectomy

,
,
,
,
,
,
,
,
1
Department of Visceral, Transplant and Thoracic Surgery, Center of Operative Medicine, Medical University of Innsbruck, 6020 Innsbruck, Austria
2
Department of General, Visceral and Vascular Surgery, Salzkammergut Hospital, 4840 Vöcklabruck, Austria
*
Author to whom correspondence should be addressed.

Abstract

Background: Pancreatoduodenectomy is still hampered by significant morbidity. So far, there is no universally accepted technique aimed at minimizing postoperative complications. Herein, we compare three different reconstruction techniques. Methods: This is a retrospective study of a prospectively maintained database including 283 patients operated between January 2010 and December 2020. Three reconstruction techniques were compared: (1) the Neuhaus-style telescope pancreatojejunostomy, (2) the pancreatogastrostomy, and (3) the modified Blumgart-style, duct-to-mucosa pancreatojejunostomy. The primary endpoint consisted in determining the rates of clinically relevant postoperative pancreatic fistulas (CR-POPF); the secondary endpoints included 90 days morbidity and mortality rates. A propensity score matching analysis was used. Results: Rates of CR-POPF did not differ significantly between the groups (Neuhaus-style pancreatojejunostomy 16%, pancreatogastrostomy 17%, modified Blumgart-style pancreatojejunostomy 15%), neither in the unmatched nor in the matched analysis (p = 0.993 and p = 0.901, respectively). Similarly, no significant differences could be observed with regard to major morbidity (unmatched p = 0.596, matched p = 0.188) and mortality rates (unmatched p = 0.371, matched p = 0.209) within the first 90 days following surgery. Propensity-score matching analyses revealed, however, a higher occurrence of post-pancreatectomy hemorrhage after pancreatogastrostomy (p = 0.015). Conclusion: Similar CR-POPF rates suggest no crucial role of the applied reconstruction technique. Increased incidence of intraluminal post-pancreatectomy hemorrhages following pancreatogastrostomy demands awareness for meticulous hemostasis.

1. Introduction

Pancreatoduodenectomy (PD) is still hampered by significant morbidity varying between 20% and 50% [1,2]. The most feared complication is represented hereby by the clinically relevant postoperative pancreatic fistula (CR-POPF). The occurrence of CR-POPF is associated with erosion bleedings, sepsis, and multiple organ failure, necessitating further invasive treatments [3], and even resulting in patient death in up to 5% [4,5].
Aimed at minimizing the occurrence of CR-POPF, numerous techniques to restore the continuity between the pancreatic stump and the gastro-enteric tract following PD have been proposed. However, so far, no universally accepted reconstruction procedure has shown a clear superiority. Recent prospective randomized controlled trials (RCTs) as well as retrospective analyses comparing different reconstruction techniques resulted in discordant conclusions and lacked in identifying a technique able to clearly decrease the occurrence of CR-POPF [3,6,7,8,9,10,11,12,13,14,15,16,17]. However, both performed RCTs emphasized the higher incidence of major complications following pancreatogastrostomy (PG), with Andrianello et al., showing that PG was associated with an increased burden of complications in patients developing CR-POPF and suggesting PJ as an appropriate reconstruction technique for patients at high risk of POPF [6].
Not only the use of different anastomosis techniques but also the application of several mitigation strategies has been suggested in the past years to reduce the rates of CR-POPF. While the efficacy of sealants or of an omental roll-up in preventing postoperative morbidity is still a matter of debate [18,19,20], the use of external drainage of the pancreatic duct showed improved rates of CR-POPF [21,22,23]. Moreover, contrasting results concerning POPF have been achieved using somatostatin analogs [6,24,25].
Over the last ten years, three different reconstruction techniques following PD have been performed at our department. Rather than deciding on the basis of specific organ features such as the consistency of the pancreatic parenchyma or the size of the main pancreatic duct, the different techniques represent three different historical phases of the department. Two dunking or telescope techniques and one duct-to-mucosa technique were used. First, the one-layered telescope pancreatojejunostomy using inverted mattress sutures according to Neuhaus [26] was performed, then a one-layered pancreatogastrostomy [27], and in the third period, the modified duct-to-mucosa, Blumgart-style pancreatojejunostomy completed with transpancreatic sutures to cover the cut pancreatic surface with jejunal serosa [28].
This study aimed to review postoperative outcomes focusing on the three different reconstruction techniques performed at our institution with regard to the rate of CR-POPF as well as the overall complication rate. To obviate shortcomings of the retrospective character, a propensity score matching model, based on an inverse probability of treatment weights (IPTWs) [29] was applied.

2. Materials and Methods

A retrospective analysis of prospectively collected and auditable medical records from all patients who underwent a PD between January 2010 and December 2020 at the Department of Visceral, Transplant and Thoracic Surgery, Innsbruck, Austria, was performed. Reporting is consistent with the STROBE guidelines [30] for observational research and the principles of the Declaration of Helsinki.

2.1. Data Collection and Cohort Selection

Data collected included baseline demographics and clinical characteristics, fistula risk score (FRS) [31], intraoperative aspects such as portal vein/superior mesenteric vein resection, CR-POPF as defined by the International Study Group on Pancreatic Surgery (ISGPS) [32], major complications (defined as Clavien–Dindo classification ≥ 3a) [33], hospital readmission, and mortality rates, all within 90 days following surgery.
Patients were divided into three groups according to the reconstruction technique used: (1) one-layered telescope pancreatojejunostomy using inverted mattress sutures according to Neuhaus (tsPJN, Figure 1) [26], (2) one-layered pancreatogastrostomy (PG, Figure 2) [27], or (3) modified Blumgart-style, duct-to-mucosa pancreatojejunostomy (dtmPJB, Figure 3) [28].
Figure 1. Neuhaus-style telescope pancreatojejunostomy (tsPJN): (A) U-shaped sutures running through the jejunal wall from back to front straight through the pancreatic parenchyma; (B) tied U-shaped sutures placed through the front wall of the jejunal loop; and (C) transverse section. The pancreas stump becomes completely enclosed by the jejunal loop. (Picture realized with Affinity Designer 1.10.5).
Figure 2. Pancreatogastrostomy (PG): The anastomosis is carried out under direct vision following an anterior gastrostomy. The pancreatic stump is brought through a posterior gastric incision and sutured to the posterior pancreatic wall. (Picture realized with Affinity Designer 1.10.5).
Figure 3. Modified Blumgart-style, duct-to-mucosa pancreatojejunostomy (dtmPJB): (A) U-shaped sutures running through the pancreatic parenchyma from the anterior to the posterior side, through the seromuscular layer of the jejunal loop, and then back from the posterior to the anterior side of the pancreatic remnant. The duct-to-mucosa anastomosis is sutured with 6 interrupted sutures; (B) tied U-shaped sutures brought through the seromuscular layer of the jejunal loop; and (C) transverse section. The cut pancreatic surface is covered by the jejunal loop. (Picture realized with Affinity Designer 1.10.5).
The primary endpoint of the study was defined as the rate of CR-POPF. Secondary endpoints were the incidence of delayed gastric emptying (DGE), post-pancreatectomy hemorrhage (PPH), and biliary fistula, as well as the rates of major complications (Clavien–Dindo ≥ 3a) and mortality within the first 90 days after surgery [26].

2.2. Surgical Procedures

All PDs were performed by experienced surgeons. Excluding the years 2011, 2014, and 2015, more than 20 PDs per year were regularly performed at our institution with up to three surgeons operating the yearly occurring caseload. They were mostly performed according to the Traverso–Longmire procedure [34], and only in 11 cases, due to suspected tumoral invasion of the pyloric region, the Whipple–Kausch technique was used [35]. Standard lymphadenectomy was regularly performed according to the guidelines of the International Study Group on Pancreatic Surgery (ISGPS) [36]. In the Supplementary Materials (Figure S1), time distribution and caseload for each anastomosis group are depicted.
The tsPJN was performed as originally described [26]. In brief, an antimesenteric incision of the jejunal loop is performed, similar in size to the resection surface of the pancreatic stump. Starting at the back wall of the jejunum, U-stitches are placed through the jejunal wall and from back to front straight through the pancreatic parenchyma, 1 cm distally from the cut surface. Finally, the sutures are placed through the front wall of the jejunal loop. In order not to occlude the pancreatic duct, an externally draining stent is inserted. Finally, resembling the ‘‘telescope’’ or ‘‘dunking’’ technique [37], the pancreas stump becomes completely enclosed by the jejunal loop (Figure 1).
Concerning the pancreatic drain, the external end is guided through the intestinal wall 20 cm distally from the pancreatic anastomosis using a small metal trocar. Following fixation using the Witzel tunnel technique, the external end is finally guided through the abdominal wall with the metal trocar before abdominal closure.
The PG was performed as previously published [38]. Following 4 cm mobilization of the pancreatic remnant, a horizontal incision is performed on the posterior gastric wall and a purse-string suture is placed. After that, the anastomosis can be carried out under direct vision following an anterior gastrostomy. The pancreatic stump is brought through the posterior gastric incision and sutured to the posterior gastric wall. An internal stent is applied to avoid occlusion of the pancreatic duct. Finally, the anterior gastrostomy is closed with a two-layer continuous suture (Figure 2).
The dtmPJB was slightly modified compared to the original publication [28]. Briefly, using 4 U-sutures, the needle is passed through the pancreatic stump from the anterior to the posterior side, and then, in a parallel fashion, through the seromuscular layer of the jejunal loop, and finally back from the posterior to the anterior side of the pancreatic remnant. Then, a small jejunostomy is performed and the duct-to-mucosa anastomosis is sutured using 6 interrupted sutures. An externally draining pancreatic stent is inserted as described above.
The last step of the procedure consists in passing the U-sutures through the seromuscular layer of the jejunum before tying them. Hereby, the cut pancreatic surface is entirely covered by the jejunal loop (Figure 3). In the original procedure, sutures were tied also on the anterior face of the pancreatic parenchyma before passing them through the seromuscular layer of the jejunal loop.
Mitigation strategies such as perioperative somatostatin or positioning of an omental roll-up around the pancreatic anastomosis were performed depending on the surgeons’ preferences. In all patients, prophylactic antibiotics and low molecular weight heparin were administered. The amylase and lipase levels in drain fluid were measured daily. Levels of these enzymes were considered pathological if more than threefold higher than the serum levels on or after postoperative day 3 [32]. In the case of normal amylase and lipase levels in the drainage and drainage output <50 mL in the last 24 h, this was removed on the following day.
The externally draining pancreatic stents (in tsPJN and dtmPJB) were removed 6 weeks following PD.

2.3. Statistical Analysis

Statistical analysis was performed using R 2016 statistical software (Team RC, Foundation for Statistical Computing, Vienna, Austria) [39]. Continuous variables are reported as median (range) and categorical variables as frequency and percentage. A univariate analysis to compare the three different anastomosis techniques was conducted. The Pearson’s chi-squared test and Wilcoxon test were used in the univariate analysis. Regression analyses, more specifically, likelihood ratio chi-square tests (LR-Chisq), were used to perform the comparative analysis of clinical outcomes between the three anastomosis groups. Two-tailed p-values less than 0.05 were considered statistically significant.
To overcome biases due to observed confounders among preoperative variables, we performed a matched propensity score (PS) analysis to assess treatment effects. A logistic regression model including all the covariates from Table 1 was used to estimate the PS.
Table 1. Demographic, Clinical/Pretreatment, Operative, and Organ Characteristics.
Following recommendations in the current literature [40,41], weighting was performed using IPTW [42]. To control all possible confounders in our regression model, we adjusted the analysis for all of them using the application of a weighting factor calculated with the PS. A treated patient with a low PS (for the treatment) receives a high weighting because he/she is similar to an untreated patient in terms of his/her characteristics (expressed as his/her low PS), so a valid comparison can be made between the two. For the evaluation of the treatment effect, patients enter the statistical analysis according to their weight.
Case matching with IPTW allows the inclusion of all study subjects in the matched analysis and is applied to estimate the Average Treatment Effect (ATE), hence, overcoming the bias of a small observational study with many confounders.
Balance measurements were conducted for each group against the other two groups. The overall assessment of the discrimination was evaluated using the z-difference, with larger values indicating a better discrimination [29]. Propensity scoring and matching were conducted using the twang package version 2.5 for R software version 4.1.2. The estimation method was performed with ATE, and the stop method was the effect size (ES) and the Kolmogorov–Smirnov (KS) statistic mean [43].

3. Results

This study included 282 patients undergoing PD. In total, 116 patients underwent a tsPJN, 75 a PG, and 91 a dtmPJB. One patient was excluded from the general statistical analysis because of an incomplete data set.
Regarding the demographic data, the unmatched analysis revealed some statistically significant differences between the three groups such as pre-existing diabetes, alcohol consumption, neoadjuvant chemotherapy, ASA classification, and preoperative biliary drainage (ERCP and/or PTCD) as well as endoscopic stenting. However, following the PS analysis with IPTW estimation, there were no more statistically significant differences between the analyzed groups.
Similarly, mitigation strategies did not differ significantly between the three reconstruction techniques. With regard to the different items in the FRS, only the intraoperative blood loss showed a statistical significance with a higher number of patients losing more than 400 mL of blood in the PG group. The low number of patients with portal/mesenteric reconstruction and those where sealants were applied did not allow any further analysis (Table 1).
Chronic infections including any stable bacterial/fungal colonization of the skin (decubitus) or the mucosa (candidiasis) and jaundice and cholangitis were excluded. Previous malignancies included any liquid or solid tumor in the past patient history (before pancreatic surgery). Low-risk pathologies according to the FRS were pancreatic ductal adenocarcinoma and chronic pancreatitis. High-risk pathologies according to the FRS were ampullary cancer, duodenal carcinoma, cholangiocarcinoma of the distal bile duct, neuroendocrine neoplasms, any cystic lesions, benign entities, and distant metastases to the pancreas (specific diagnosis are listed in the Supplementary Table S1).
The postoperative complication rates are indicated in Table 2. Regarding the primary study endpoint, tsPJN, PG, and dtmPJB resulted in a similar rate of CR-POPF (16% vs. 17% vs. 15%, respectively) and showed no significant differences in the unmatched analysis (p = 0.993). The PS confirmed the missing significant differences in CR-POPF rates between the three groups (p = 0.901).
Table 2. Postoperative Complications.
Similarly, no significant differences could be detected for the occurrence of biliary fistulas (unmatched p = 0.607; matched p = 0.253) or DGE (unmatched p = 0.682; matched p = 0.441). Of note, PG showed numerically higher DGE rates (21% PG vs. 16% tsPJN vs. 14% dtmPJB, respectively).
While there was no statistical significance in the unweighted analysis (p = 0.556), PS matching revealed, that PG was associated with significantly higher PPH of any grade compared to both PJs (p = 0.015). The difference was still there when comparing each single PPH grade between the three different techniques; however, the higher occurrence in the PG group did not reach statistical significance (p = 0.064).
Neither of the three techniques revealed a significant reduction in severe complications (Clavien–Dindo ≥ 3a) both in the unmatched and matched analyses (p = 0.596 and p = 0.188, respectively). Equally, both analyses showed no difference concerning 90 days mortality between the three different techniques (p = 0.371 and p = 0.209, respectively), even if restricted to cases with POPF type C (p = 0.682 and p = 0.209, respectively).
The median follow-up time for our patients was 30 months (range 0–134) and differed significantly between the three study groups (tsPJN 33 months; PG 45 months; dtmPJB: 18 months, respectively; p < 0.001).

4. Discussion

To our knowledge, this is the first retrospective study comparing one PG with two different PJ techniques following PD using an IPTW-based PS matching. The general occurrence of CR-POPF is in line with that of other reporting centers [3,16,17]. Using the IPTW-based PS matching, we could not observe any differences between the analyzed reconstruction techniques concerning the rate of CR-POPF. None of the three analyzed pancreatic anastomosis techniques resulted in a significant advantage, neither concerning the occurrence of CR-POPF in general nor specifically concerning grade C fistulas.
Our findings reflect the currently available literature [44], where no specific reconstruction technique after PD was demonstrated to be clearly superior concerning the rates of CR-POPF. Publications are, in fact, conflicting. While the comparison between PJ and PG did not show any significant difference in a recent randomized controlled trial (RCT) [3,6] and in recent meta-analyses [9,14,15], previous publications [45,46] showed the superiority of PG compared to PJ in preventing this complication.
On the same line, studies focusing solely on different PJ techniques also present heterogeneous results. A recent retrospective study including 110 patients and using PS matching suggested a minimization of grade C POPF using the Blumgart technique [16]. These findings are supported by some meta-analyses and other retrospective studies showing that the Blumgart-style anastomosis is more effective in preventing CR-POPF compared to other PJ invagination techniques [7,8,12,17], even for high-risk subjects [13]. In contrast, no significant differences in preventing CR-POPF could be observed in an RCT [13], a meta-analysis [14], and two other retrospective studies [10,11]. These contrasting results presumably reflect various biases such as lack of statistical power, the mostly retrospective, single-center nature of the studies, and, last but not least, also the different modifications of the described anastomosis techniques, which makes a direct comparison impossible.
The presented data are also consistent with those from the RECOPANC study [3], which is one of the largest RCTs conducted on this topic. Not restricted to a specific PJ or PG technique, in this RCT, both reconstruction strategies, PJ as well as PG, shared analogous CR-POPF rates.
The risk to develop a CR-POPF is classically calculated using different FRS. Parenchymal texture, dimensions of the main pancreatic duct at the cut surface, intraoperative blood loss, underlying pathology, neoadjuvant treatment, and also minimal-invasive techniques are all recognized factors influencing the occurrence of POPF and were considered in the different FRS developed over the last years [31,47,48]. Unfortunately, the parenchymal structure is poorly documented in our database. Therefore, the exact FRS could only be calculated in less than half of the included patients (135/283). Due to the questionable validity of a sub-analysis on a small patient cohort, we decided to limit the FRS analysis by defining the number of patients presenting a high FRS in each group. With only the parenchymal structure missing in 148 patients, an indirect calculation able to identify FRS 7–10 was possible, resulting finally in the characterization of almost all (278/283) patients.
In our cohort, only very few patients showed a high classical FRS [31], most of them occurring in the PG group. With all items except intraoperative blood loss being different between the groups, the higher number of patients presenting high FRS in the PG group depended mostly on this item rather than on pancreas characteristics.
The use of such scores and their clinical relevance was the object of recent debates. In an analysis of different externally validated fistula scores and their comparison with each other, the PARANOIA study group showed that these are only of limited advice regarding their predictive accuracy [49]. Along the same line, a newly FRS comprehensive catalog showed that rather than a single numeric score, an improved granularity resulting in 80 different FRS scenarios would outperform the existing FRS. Of note, the 10 most clinically impactful scenarios for POPF development included FRS ranging from 2 to 7; however, all of them included a soft gland. Interestingly, this study group showed the superiority of PJ in the upper values of the moderate risk zone of the FRS [50].
With regard to the effect of neoadjuvant radiotherapy and the use of mitigation strategies such as the use of sealants, omental roll-up, and perioperative somatostatin, treatment sample size did not allow any further analysis for the impact of these factors on CR-POPF occurrence. All patients received either an internal (PG) or an externally draining (tsPJN and dtmPJB) pancreatic stent. This resulted in similar rates of CR-POPF for all techniques, supporting data showing no difference between the two stenting strategies [51].
Even regarding the occurrence of biliary fistulas, there was not any significant difference in the three analyzed patient groups. This is in line with other studies that did not find any relation between the pancreatic anastomosis technique and early biliary complications more in general [52] or between different reconstruction techniques and biliary fistula/leakage [53].
Reported rates of DGE following PD range from 5 to 59% [54]. Even though PG is mostly considered to be a risk factor for DGE, findings regarding its association with a certain type of pancreatic remnant reconstruction are conflicting [55,56,57]. In our cohort, DGE rates were comparable between the three groups, both in the unmatched and matched analyses. Nevertheless, the PG group showed a considerably higher trend toward DGE development.
Another particularity observed in the PS analysis was the higher occurrence of any grade of PPH following PG reconstruction. Of note, despite the comparable rates of PV/SMV resection and therapeutic anticoagulation in all groups, the intraoperative bleeding rates of the PG group were significantly higher. These results are concordant with the RECOPANC study [3] and also with the recent RCT considering patients with high risk for CR-POPF [6]. Considering the PPH classification of the ISGPS [58], the wide majority of bleedings after PG in our series occurred intraluminal within the stomach (17 out of 23). Conversely, patients becoming any type of PJ showed bleeding episodes mostly in correspondence with the gastroduodenal artery, the pancreatic arterial arcades, and the hepatic artery. This finding could be related to the conspicuous vascularization of the gastric wall.
Concerning major surgical morbidity rates, a recent PS matching analysis comparing three different PJs showed that the Blumgart-anastomosis could reduce them [16]. Similar results have been also reported by other studies [8,17]. The superiority of the Blumgart technique is thought to be related to the reduction in tangential tension and shear force at the pancreatic stump. This should guarantee better blood supply to the remnant if compared to other types of pancreatojejunostomies. However, the originally described technique has repeatedly been subject to critical debate. Kim et al., argued that the originally reported Blumgart technique did not completely cover the pancreatic remnant with the jejunal loop, therefore bearing an even increased risk for CR-POPF [59]. Therefore, a plethora of variants of this technique have been proposed, and the resulting inhomogeneity leads to a difficult standardization and comparison of the reported data regarding surgical morbidity.
On the contrary, the RECOPANC study showed no significant correlation between any type of pancreatic anastomosis and surgical complications other than PPH [3]. Similarly, in the present study, the occurrence of severe complications (Clavien–Dindo ≥ 3a) was not related to the anastomosis technique.
Several studies highlight the importance of center volume when discussing mortality and major morbidities as well as the failure to rescue rates following pancreatic resections. A nationwide comparison between German and Dutch audits highlights a significant center volume–outcome relationship concerning in-hospital mortality for very low- and low-volume centers (defined as ≤20 procedures per year) [60]. Similarly, two recent nationwide analyses on major pancreatic surgery in Germany and Italy suggest a strong relationship between volume center and in-hospital mortality rates, advocating new centralization policies based on volume and mortality thresholds [61,62]. The results presented in the present study go along with this point of view, where the focus should be more on numbers and standardization rather than on the reconstruction techniques itself. In fact, during the reported time, most surgeons performed not only one but at least two of the three reconstruction techniques without observing major differences in the rates of postoperative complications. Our data suggest that surgical experience combined with an adequate caseload seems to be more important than choosing a specific reconstruction technique. However, the development of new techniques should not be neglected when aiming at improving patient outcomes. In the last years, new techniques applying purse-string sutures on the jejunal opening [63] or around the pancreatic duct [64] have been described as showing promising results considering the rates of CR-POPF. Since the published caseload available is still limited, further studies are needed to validate the superiority of these techniques.
There are several limitations of this study, including incomplete documentation of the pancreatic texture as well as the relatively small number of patients per year over a relatively long “recruiting” time. The statistically significant difference in follow-up times among the different study groups reflects the different time periods when different anastomosis techniques were performed. Regarding postoperative records within the first 90 days, we could only define the presence of postoperative diabetes (type IIIc) according to the need for anti-diabetic drugs and by observing the mean fasting glycemia of the whole cohort. Unfortunately, records concerning HbA1c could only be retrieved for 50 patients. This sub-cohort of patients with no diabetes at the time of diagnosis and developing type IIIc diabetes after PD showed no differences in relation to the anastomosis technique (32.3% for tsPJN, 20.3% for PG, and 27.8% for dtmPJB, respectively, and p = 0.239). Still, the low number of patients presenting with postoperative diabetes precludes any apodictic conclusions.
Regarding the inherent limitations of retrospective databases, we tried to compensate for this bias using the IPTW-based PS analysis, which is a useful tool to diminish possible confounder-related errors, and which also allows the inclusion of all analyzed patients. PS matching has been increasingly used in the surgical literature in the last decade to balance patient groups across known risk factors and confounders, representing a reasonable tool to overcome the shortcomings of retrospective analyses [65].

5. Conclusions

Our study compares three different pancreatic anastomosis techniques (one PG and different PJs) using techniques using an IPTW-based, PS-matched analysis. The presented data suggest that the applied reconstruction technique following pancreatoduodenectomy does not necessarily represent a crucial factor with regard to CR-POPF occurrence. These results are in line with those of a recent RCT and thus confirm the validity and reliability of PS-matched analysis on retrospective databases. The increased incidence of intraluminal postoperative bleedings following PG in these patients demands special awareness concerning intraoperative hemostasis but also during the early postoperative period.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm12093318/s1, Table S1: Histologic Diagnosis; Figure S1: Distribution of the performed pancreatic anastomosis techniques.

Author Contributions

Conceptualization, R.B., B.C. and M.M.; methodology, R.B. and M.M.; software, S.S. (Stefan Scheidl); validation, S.S. (Stefan Schneeberger), S.S. (Stefan Stättner), C.M., R.O., E.B. and T.R.; formal analysis, R.B.; investigation, R.B. and C.J.S.; resources, D.Ö. and M.M.; data curation, R.B., C.J.S., B.C. and M.M.; writing—original draft preparation, R.B.; writing—review and editing, M.M., S.S. (Stefan Schneeberger), C.M. and D.Ö.; visualization, S.S. (Stefan Scheidl); supervision, M.M.; project administration, M.M. and D.Ö.; funding acquisition, M.M. and D.Ö. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the “In memoriam Dr. Gabriel Salzner Stiftung” to M.M. and D.Ö. The funding institute was not involved in study design, data collection, data analysis, manuscript preparation, or publication decisions.

Institutional Review Board Statement

This study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of the Medical University of Innsbruck (1356/2021).

Data Availability Statement

The datasets used and/or analyzed during the current study are available from the corresponding author upon reasonable request.

Acknowledgments

We are indebted to Wolfgang Peter for expert statistical assistance.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Parikh, P.; Shiloach, M.; Cohen, M.E.; Bilimoria, K.Y.; Ko, C.Y.; Hall, B.L.; Pitt, H.A. Pancreatectomy risk calculator: An ACS-NSQIP resource. HPB 2010, 12, 488. [Google Scholar] [CrossRef] [PubMed]
  2. Cardini, B.; Primavesi, F.; Maglione, M.; Oberschmied, J.; Guschlbauer, L.; Gasteiger, S.; Kuscher, S.; Resch, T.; Oberhuber, R.; Margreiter, C.; et al. Outcomes following pancreatic resections—Results and challenges of an Austrian university hospital compared to nationwide data and international centres. Eur. Surg.—Acta Chir. Austriaca 2019, 51, 81–89. [Google Scholar] [CrossRef]
  3. Keck, T.; Wellner, U.F.; Bahra, M.; Klein, F.; Sick, O.; Niedergethmann, M.; Wilhelm, T.J.; Farkas, S.A.; Borner, T.; Bruns, C.; et al. Pancreatogastrostomy versus pancreatojejunostomy for reconstruction after PANCreatoduodenectomy (RECOPANC, DRKS 00000767): Perioperative and long-term results of a multicenter randomized controlled trial. Ann. Surg. 2016, 263, 440–449. [Google Scholar] [CrossRef] [PubMed]
  4. Bassi, C.; Dervenis, C.; Butturini, G.; Fingerhut, A.; Yeo, C.; Izbicki, J.; Neoptolemos, J.; Sarr, M.; Traverso, W.; Buchler, M. Postoperative pancreatic fistula: An international study group (ISGPF) definition. Surgery 2005, 138, 8–13. [Google Scholar] [CrossRef] [PubMed]
  5. Pulvirenti, A.; Ramera, M.; Bassi, C. Modifications in the International Study Group for Pancreatic Surgery (ISGPS) definition of postoperative pancreatic fistula. Transl. Gastroenterol. Hepatol. 2017, 2, 107. [Google Scholar] [CrossRef]
  6. Andrianello, S.; Marchegiani, G.; Malleo, G.; Masini, G.; Balduzzi, A.; Paiella, S.; Esposito, A.; Landoni, L.; Casetti, L.; Tuveri, M.; et al. Pancreaticojejunostomy with Externalized Stent vs. Pancreaticogastrostomy with Externalized Stent for Patients with High-Risk Pancreatic Anastomosis: A Single-Center, Phase 3, Randomized Clinical Trial. JAMA Surg. 2020, 155, 313–321. [Google Scholar] [CrossRef]
  7. Kojima, T.; Niguma, T.; Watanabe, N.; Sakata, T.; Mimura, T. Modified Blumgart anastomosis with the “complete packing method” reduces the incidence of pancreatic fistula and complications after resection of the head of the pancreas. Am. J. Surg. 2018, 216, 941–948. [Google Scholar] [CrossRef]
  8. Li, Z.; Wei, A.; Xia, N.; Zheng, L.; Yang, D.; Ye, J.; Xiong, J.; Hu, W. Blumgart anastomosis reduces the incidence of pancreatic fistula after pancreaticoduodenectomy: A systematic review and meta-analysis. Sci. Rep. 2020, 10, 17896. [Google Scholar] [CrossRef]
  9. Gómez, T.; Palomares, A.; Serradilla, M.; Tejedor, L. Reconstruction after Pancreatoduodenectomy: Pancreatojejunostomy vs. Pancreatogastrostomy. World J. Gastrointest. Oncol. 2014, 6, 369–376. [Google Scholar] [CrossRef]
  10. Lee, Y.-N.; Kim, W.-Y. Comparison of Blumgart versus conventional duct-to-mucosa anastomosis for pancreaticojejunostomy after pancreaticoduodenectomy. Ann. Hepato-Biliary-Pancreat. Surg. 2018, 22, 253. [Google Scholar] [CrossRef]
  11. Kawakatsu, S.; Inoue, Y.; Mise, Y.; Ishizawa, T.; Ito, H.; Takahashi, Y.; Saiura, A. Comparison of pancreatojejunostomy techniques in patients with a soft pancreas: Kakita anastomosis and Blumgart anastomosis. BMC Surg. 2018, 18, 88. [Google Scholar] [CrossRef] [PubMed]
  12. Kalev, G.; Marquardt, C.; Matzke, H.; Matovu, P.; Schiedeck, T. The modified Blumgart anastomosis after pancreaticoduodenectomy: A retrospective single center cohort study. Innov. Surg. Sci. 2020, 5, 105–109. [Google Scholar] [CrossRef] [PubMed]
  13. Senda, Y.; Shimizu, Y.; Natsume, S.; Ito, S.; Komori, K.; Abe, T.; Matsuo, K.; Sano, T. Randomized clinical trial of duct-to-mucosa versus invagination pancreaticojejunostomy after pancreatoduodenectomy. Br. J. Surg. 2018, 105, 48–57. [Google Scholar] [CrossRef] [PubMed]
  14. Lyu, Y.; Li, T.; Wang, B.; Cheng, Y.; Zhao, S. Selection of pancreaticojejunostomy technique after pancreaticoduodenectomy: Duct-to-mucosa anastomosis is not better than invagination anastomosis A meta-analysis. Medicine 2018, 97, e12621. [Google Scholar] [CrossRef]
  15. Jin, Y.; Feng, Y.-Y.; Qi, X.-G.; Hao, G.; Yu, Y.-Q.; Li, J.-T.; Peng, S.-Y. Pancreatogastrostomy vs. pancreatojejunostomy after pancreaticoduodenectomy: An updated meta-analysis of RCTs and our experience. World J. Gastrointest. Surg. 2019, 11, 322–332. [Google Scholar] [CrossRef]
  16. Casadei, R.; Ricci, C.; Ingaldi, C.; Alberici, L.; De Raffele, E.; Minni, F. Comparison of Blumgart Anastomosis with Duct-to-Mucosa Anastomosis and Invagination Pancreaticojejunostomy after Pancreaticoduodenectomy: A Single-Center Propensity Score Matching Analysis. J. Gastrointest. Surg. 2021, 25, 411–420. [Google Scholar] [CrossRef]
  17. Li, Y.-T.; Zhang, H.-Y.; Xing, C.; Ding, C.; Wu, W.-M.; Liao, Q.; Zhang, T.-P.; Zhao, Y.-P.; Dai, M.-H. Effect of Blumgart anastomosis in reducing the incidence rate of pancreatic fistula after pancreatoduodenectomy. World J. Gastroenterol. 2019, 25, 2514. [Google Scholar] [CrossRef]
  18. Gong, J.; He, S.; Cheng, Y.; Cheng, N.; Gong, J.; Zeng, Z. Fibrin sealants for the prevention of postoperative pancreatic fistula following pancreatic surgery. Cochrane Database Syst. Rev. 2018, 6, CD009621. [Google Scholar] [CrossRef]
  19. Andreasi, V.; Partelli, S.; Crippa, S.; Balzano, G.; Tamburrino, D.; Muffatti, F.; Belfiori, G.; Cirocchi, R.; Falconi, M. A systematic review and meta-analysis on the role of omental or falciform ligament wrapping during pancreaticoduodenectomy. HPB 2020, 22, 1227–1239. [Google Scholar] [CrossRef]
  20. Tangtawee, P.; Mingphruedhi, S.; Rungsakulkij, N.; Suragul, W.; Vassanasiri, W.; Muangkaew, P. Prospective randomized controlled trial of omental roll-up technique on pancreatojejunostomy anastomosis for reducing perioperative complication in patients undergoing pancreatoduodenectomy. J. Hepato-Biliary-Pancreat. Sci. 2021, 28, 450–456. [Google Scholar] [CrossRef]
  21. Halle-Smith, J.M.; Pande, R.; Hall, L.; Hodson, J.; Roberts, K.J.; Arshad, A.; Connor, S.; Conlon, K.C.P.; Dickson, E.J.; Giovinazzo, F.; et al. Perioperative interventions to reduce pancreatic fistula following pancreatoduodenectomy: Meta-analysis. Br. J. Surg. 2022, 109, 812–821. [Google Scholar] [CrossRef] [PubMed]
  22. Meng, G.; Xing, Q.; Yuan, Q.; Du, Z.; Wang, Y.; Meng, H. Internal compared with external drainage of pancreatic duct during pancreaticoduodenectomy: A retrospective study. Chin. J. Cancer Res. 2014, 26, 277–284. [Google Scholar] [CrossRef] [PubMed]
  23. Poon, R.T.P.; Fan, S.T.; Lo, C.M.; Ng, K.K.; Yuen, W.K.; Yeung, C.; Wong, J. External drainage of pancreatic duct with a stent to reduce leakage rate of pancreaticojejunostomy after pancreaticoduodenectomy: A prospective randomized trial. Ann. Surg. 2007, 246, 425–433. [Google Scholar] [CrossRef] [PubMed]
  24. Schorn, S.; Vogel, T.; Demir, I.E.; Demir, E.; Safak, O.; Friess, H.; Ceyhan, G.O. Do somatostatin-analogues have the same impact on postoperative morbidity and pancreatic fistula in patients after pancreaticoduodenectomy and distal pancreatectomy?—A systematic review with meta-analysis of randomized-controlled trials. Pancreatology 2020, 20, 1770–1778. [Google Scholar] [CrossRef]
  25. Pillarisetty, V.G.; Abbasi, A.; Park, J.O.; Sham, J.G. A phase II trial of lanreotide for the prevention of postoperative pancreatic fistula. HPB 2022, 24, 2029–2034. [Google Scholar] [CrossRef]
  26. Langrehr, J.M.; Bahra, M.; Jacob, D.; Glanemann, M.; Neuhaus, P. Prospective randomized comparison between a new mattress technique and Cattell (duct-to-mucosa) pancreaticojejunostomy for pancreatic resection. World J. Surg. 2005, 29, 1111–1119. [Google Scholar] [CrossRef]
  27. Aroori, S.; Puneet, P.; Bramhall, S.R.; Muiesan, P.; Mayer, A.D.; Mirza, D.F.; Buckels, J.C.; Isaac, J. Outcomes comparing a pancreaticogastrostomy (PG) and a pancreaticojejunostomy (PJ) after a pancreaticoduodenectomy (PD). HPB 2011, 13, 723. [Google Scholar] [CrossRef]
  28. Grobmyer, S.R.; Kooby, D.; Blumgart, L.H.; Hochwald, S.N. Novel Pancreaticojejunostomy with a Low Rate of Anastomotic Failure-Related Complications. J. Am. Coll. Surg. 2010, 210, 54–59. [Google Scholar] [CrossRef]
  29. Kuss, O.; Blettner, M.; Börgermann, J. Propensity Score: An Alternative Method of Analyzing Treatment EffectsPart 23 of a Series on Evaluation of Scientific Publications. Dtsch. Arztebl. Int. 2016, 113, 597–603. [Google Scholar]
  30. von Elm, E.; Altman, D.G.; Egger, M.; Pocock, S.J.; Gøtzsche, P.C.; Vandenbroucke, J.P. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for reporting observational studies. Int. J. Surg. 2014, 12, 1495–1499. [Google Scholar] [CrossRef]
  31. Callery, M.P.; Pratt, W.B.; Kent, T.S.; Chaikof, E.L.; Vollmer, C.M. A prospectively validated clinical risk score accurately predicts pancreatic fistula after pancreatoduodenectomy. J. Am. Coll. Surg. 2013, 216, 1–14. [Google Scholar] [CrossRef] [PubMed]
  32. Bassi, C.; Marchegiani, G.; Dervenis, C.; Sarr, M.; Abu Hilal, M.; Adham, M.; Allen, P.; Andersson, R.; Asbun, H.J.; Besselink, M.G.; et al. The 2016 update of the International Study Group (ISGPS) definition and grading of postoperative pancreatic fistula: 11 Years After. Surgery 2017, 161, 584–591. [Google Scholar] [CrossRef] [PubMed]
  33. Dindo, D.; Demartines, N.; Clavien, P.-A. Classification of Surgical Complications. Ann. Surg. 2004, 240, 205–213. [Google Scholar] [CrossRef] [PubMed]
  34. Traverso, L.W.; Longmire, W.P. Preservation of the pylorus in pancreaticoduodenectomy. A follow-up evaluation. Ann. Surg. 1980, 192, 306–310. [Google Scholar] [CrossRef]
  35. Whipple, A.O.; Parsons, W.B.; Mullins, C.R. Treatment of carcinoma of the ampulla of Vater. Ann. Surg. 1935, 102, 763. [Google Scholar] [CrossRef]
  36. Tol, J.A.M.G.; Gouma, D.J.; Bassi, C.; Dervenis, C.; Montorsi, M.; Adham, M.; Andrén-Sandberg, A.; Asbun, H.J.; Bockhorn, M.; Büchler, M.W.; et al. Definition of a standard lymphadenectomy in surgery for pancreatic ductal adenocarcinoma: A consensus statement by the International Study Group on Pancreatic Surgery (ISGPS). Surgery 2014, 156, 591–600. [Google Scholar] [CrossRef]
  37. Kusnierz, K.; Mrowiec, S.; Lampe, P. A comparison of two invagination techniques for pancreatojejunostomy after pancreatoduodenectomy. Gastroenterol. Res. Pract. 2015, 2015, 894292. [Google Scholar] [CrossRef]
  38. Aranha, G.V. A technique for pancreaticogastrostomy. Am. J. Surg. 1998, 175, 328–329. [Google Scholar] [CrossRef]
  39. RR Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2013. [Google Scholar]
  40. Mccaffrey, D.F.; Griffin, B.A.; Almirall, D.; Slaughter, M.E.; Ramchand, R.; Burgette, L.F. A tutorial on propensity score estimation for multiple treatments using generalized boosted models. Stat. Med. 2013, 32, 3388–3414. [Google Scholar] [CrossRef]
  41. Desai, R.J.; Franklin, J.M. Alternative approaches for confounding adjustment in observational studies using weighting based on the propensity score: A primer for practitioners. BMJ 2019, 367, l5657. [Google Scholar] [CrossRef]
  42. Chesnaye, N.C.; Stel, V.S.; Tripepi, G.; Dekker, F.W.; Fu, E.L.; Zoccali, C.; Jager, K.J. An introduction to inverse probability of treatment weighting in observational research. Clin. Kidney J. 2021, 15, 14–20. [Google Scholar] [CrossRef] [PubMed]
  43. Ridgeway, G.; McCaffrey, D.F.; Morral, A.R.; Cefalu, M.; Burgette, L.F.; Pane, J.D.; Griffin, B.A. Twang: Toolkit for Weighting and Analysis of Nonequivalent Groups; R package version 2.5; RAND Corporation: Santa Monica, CA, USA, 2021. [Google Scholar]
  44. Shrikhande, S.V.; Sivasanker, M.; Vollmer, C.M.; Friess, H.; Besselink, M.G.; Fingerhut, A.; Yeo, C.J.; Fernandez-delCastillo, C.; Dervenis, C.; Halloran, C.; et al. Pancreatic anastomosis after pancreatoduodenectomy: A position statement by the International Study Group of Pancreatic Surgery (ISGPS). Surgery 2017, 161, 1221–1234. [Google Scholar] [CrossRef] [PubMed]
  45. Figueras, J.; Sabater, L.; Planellas, P.; Muñoz-Forner, E.; Lopez-Ben, S.; Falgueras, L.; Sala-Palau, C.; Albiol, M.; Ortega-Serrano, J.; Castro-Gutierrez, E. Randomized clinical trial of pancreaticogastrostomy versus pancreaticojejunostomy on the rate and severity of pancreatic fistula after pancreaticoduodenectomy. Br. J. Surg. 2013, 100, 1597–1605. [Google Scholar] [CrossRef] [PubMed]
  46. Xiong, J.J.; Tan, C.L.; Szatmary, P.; Huang, W.; Ke, N.W.; Hu, W.M.; Nunes, Q.M.; Sutton, R.; Liu, X.B. Meta-analysis of pancreaticogastrostomy versus pancreaticojejunostomy after pancreaticoduodenectomy. Br. J. Surg. 2014, 101, 1196–1208. [Google Scholar] [CrossRef]
  47. Tabchouri, N.; Bouquot, M.; Hermand, H.; Benoit, O.; Loiseau, J.C.; Dokmak, S.; Aussilhou, B.; Gaujoux, S.; Turrini, O.; Delpero, J.R.; et al. A Novel Pancreatic Fistula Risk Score Including Preoperative Radiation Therapy in Pancreatic Cancer Patients. J. Gastrointest. Surg. 2021, 25, 991–1000. [Google Scholar] [CrossRef]
  48. Mungroop, T.H.; Klompmaker, S.; Wellner, U.F.; Steyerberg, E.W.; Coratti, A.; D’Hondt, M.; de Pastena, M.; Dokmak, S.; Khatov, I.; Saint-Marc, O.; et al. Updated Alternative Fistula Risk Score (ua-FRS) to Include Minimally Invasive Pancreatoduodenectomy: Pan-European Validation. Ann. Surg. 2021, 273, 334–340. [Google Scholar] [CrossRef]
  49. Pande, R.; Halle-Smith, J.M.; Phelan, L.; Thorne, T.; Panikkar, M.; Hodson, J.; Roberts, K.J.; Arshad, A.; Connor, S.; Conlon, K.C.; et al. External validation of postoperative pancreatic fistula prediction scores in pancreatoduodenectomy: A systematic review and meta-analysis. HPB 2022, 24, 287–298. [Google Scholar] [CrossRef]
  50. Trudeau, M.T.; Casciani, F.; Ecker, B.L.; Maggino, L.; Seykora, T.F.; Puri, P.; Mcmillan, M.T.; Miller, B.; Pratt, W.B.; Asbun, H.J.; et al. The Fistula Risk Score Catalog: Toward Precision Medicine for Pancreatic Fistula After Pancreatoduodenectomy. Ann. Surg. 2022, 275, E463–E472. [Google Scholar] [CrossRef]
  51. Tani, M.; Kawai, M.; Hirono, S.; Ina, S.; Miyazawa, M.; Shimizu, A.; Yamaue, H. A prospective randomized controlled trial of internal versus external drainage with pancreaticojejunostomy for pancreaticoduodenectomy. Am. J. Surg. 2010, 199, 759–764. [Google Scholar] [CrossRef]
  52. Malgras, B.; Duron, S.; Gaujoux, S.; Dokmak, S.; Aussilhou, B.; Rebours, V.; Palazzo, M.; Belghiti, J.; Sauvanet, A. Early biliary complications following pancreaticoduodenectomy: Prevalence and risk factors. HPB 2016, 18, 367–374. [Google Scholar] [CrossRef]
  53. El Nakeeb, A.; El Sorogy, M.; Hamed, H.; Said, R.; Elrefai, M.; Ezzat, H.; Askar, W.; Elsabbagh, A.M. Biliary leakage following pancreaticoduodenectomy: Prevalence, risk factors and management. Hepatobiliary Pancreat. Dis. Int. 2019, 18, 67–72. [Google Scholar] [CrossRef] [PubMed]
  54. Hanna, M.; Gadde, R.; Tamariz, L.; Allen, C.; Meizoso, J.; Sleeman, D.; Livingstone, A.; Yakoub, D. Delayed Gastric Emptying After Pancreaticoduodenectomy: Is Subtotal Stomach Preserving Better or Pylorus Preserving? J. Gastrointest. Surg. 2015, 19, 1542–1552. [Google Scholar] [CrossRef] [PubMed]
  55. Hayama, S.; Senmaru, N.; Hirano, S. Delayed gastric emptying after pancreatoduodenectomy: Comparison between invaginated pancreatogastrostomy and pancreatojejunostomy. BMC Surg. 2020, 20, 60. [Google Scholar] [CrossRef]
  56. Vandermeeren, C.; Loi, P.; Closset, J. Does Pancreaticogastrostomy Decrease the Occurrence of Delayed Gastric Emptying after Pancreatoduodenectomy? Pancreas 2017, 46, 1064–1068. [Google Scholar] [CrossRef] [PubMed]
  57. Komokata, T.; Nuruki, K.; Tada, N.; Imada, R.; Aryal, B.; Kaieda, M.; Sane, S. An invaginated pancreaticogastrostomy following subtotal stomach-preserving pancreaticoduodenectomy: A prospective observational study. Asian J. Surg. 2021, 44, 1510–1514. [Google Scholar] [CrossRef]
  58. Wente, M.N.; Veit, J.A.; Bassi, C.; Dervenis, C.; Fingerhut, A.; Gouma, D.J.; Izbicki, J.R.; Neoptolemos, J.P.; Padbury, R.T.; Sarr, M.G.; et al. Postpancreatectomy hemorrhage (PPH)-An International Study Group of Pancreatic Surgery (ISGPS) definition. Surgery 2007, 142, 20–25. [Google Scholar] [CrossRef]
  59. Kim, S.G.; Paik, K.Y.; Oh, J.S. The vulnerable point of modified blumgart pancreaticojejunostomy regarding pancreatic fistula learned from 50 consecutive pancreaticoduodenectomy. Ann. Transl. Med. 2019, 7, 630. [Google Scholar] [CrossRef]
  60. Mackay, T.M.; Wellner, U.F.; van Rijssen, L.B.; Stoop, T.F.; Busch, O.R.; Groot Koerkamp, B.; Bausch, D.; Petrova, E.; Besselink, M.G.; Keck, T.; et al. Variation in pancreatoduodenectomy as delivered in two national audits. Br. J. Surg. 2019, 106, 747–755. [Google Scholar] [CrossRef]
  61. Balzano, G.; Guarneri, G.; Pecorelli, N.; Paiella, S.; Rancoita, P.M.V.; Bassi, C.; Falconi, M. Modelling centralization of pancreatic surgery in a nationwide analysis. Br. J. Surg. 2020, 107, 1510–1519. [Google Scholar] [CrossRef]
  62. Krautz, C.; Nimptsch, U.; Weber, G.F.; Mansky, T.; Grützmann, R. Effect of Hospital Volume on In-hospital Morbidity and Mortality Following Pancreatic Surgery in Germany. Ann. Surg. 2018, 267, 411–417. [Google Scholar] [CrossRef]
  63. Ferencz, S.; Bíró, Z.; Vereczkei, A.; Kelemen, D. Innovations in pancreatic anastomosis technique during pancreatoduodenectomies. Langenbeck’s Arch. Surg. 2020, 405, 1039–1044. [Google Scholar] [CrossRef] [PubMed]
  64. Mitsuyoshi, A.; Hamada, S.; Ohe, H.; Fujita, H.; Okabe, H.; Inoguchi, K. Proposal for a Safe and Functional Pancreaticojejunostomy Technique from a Histopathological Perspective. World J. Surg. 2018, 42, 4090–4096. [Google Scholar] [CrossRef] [PubMed]
  65. Lonjon, G.; Porcher, R.; Ergina, P.; Fouet, M.; Boutron, I. Potential Pitfalls of Reporting and Bias in Observational Studies with Propensity Score Analysis Assessing a Surgical Procedure: A Methodological Systematic Review. Ann. Surg. 2017, 265, 901–909. [Google Scholar] [CrossRef] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.