Next Article in Journal
PARP Inhibitors in Small-Cell Lung Cancer: Rational Combinations to Improve Responses
Previous Article in Journal
Senolytics for Cancer Therapy: Is All that Glitters Really Gold?
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Cancers
Volume 13
Issue 4
10.3390/cancers13040721
cancers-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Perineal Wound Closure Following Abdominoperineal Resection and Pelvic Exenteration for Cancer: A Systematic Review and Meta-Analysis

by
Etienne Buscail
1,2,
Cindy Canivet
1,3,
Jason Shourick
4,
Elodie Chantalat
5,
Nicolas Carrere
1,
Jean-Pierre Duffas
1,
Antoine Philis
1,
Emilie Berard
4,
Louis Buscail
3,*,
Laurent Ghouti
1 and
Benoit Chaput
6
1
Department of Digestive Surgery, Toulouse University Hospital, 31100 Toulouse, France
2
INSERM, U1220, Digestive Health Research Institute (IRSD), University of Toulouse, 31100 Toulouse, France
3
Department of Gastroenterology and Pancreatology, Toulouse University Hospital, 31100 Toulouse, France
4
Department of Epidemiology and Public Health, UMR 1027 INSERM, Toulouse University Hospital, University of Toulouse, 31100 Toulouse, France
5
Department of Surgery, Oncopole, INSERM-UPS UMR U1048, Institute of Metabolic and Cardiovascular Diseases, University of Toulouse, 31100 Toulouse, France
6
Department of Plastic and Reconstructive Surgery, Toulouse University Hospital, 31100 Toulouse, France
*
Author to whom correspondence should be addressed.
Cancers 2021, 13(4), 721; https://doi.org/10.3390/cancers13040721
Submission received: 17 January 2021 / Revised: 1 February 2021 / Accepted: 5 February 2021 / Published: 10 February 2021
(This article belongs to the Section Cancer Therapy)
Browse Figures
Review Reports Versions Notes

Abstract

:

Simple Summary

Abdominoperineal resection (APR) and pelvic exenteration (PE) for the treatment of cancer (mainly anal and rectal cancers) require extensive pelvic resection with a high rate of postoperative complications. The objective of this work was to systematically review and meta-analyze the effects of vertical rectus abdominis myocutaneous flap (VRAMf) and mesh closure on perineal morbidity following APR and PE. The studies were distributed as follows: Group A comparing primary closure (PC) and VRAMf, Group B comparing PC and mesh closure, Group C comparing PC and VRAMf in PE. The meta-analysis of Groups A and B showed PC to be associated with an increase in the rate of total and major perineal wound complications. PC was associated with a decrease in total and major perineal complications in Group C.

Abstract

Background. Abdominoperineal resection (APR) and pelvic exenteration (PE) for the treatment of cancer require extensive pelvic resection with a high rate of postoperative complications. The objective of this work was to systematically review and meta-analyze the effects of vertical rectus abdominis myocutaneous flap (VRAMf) and mesh closure on perineal morbidity following APR and PE (mainly for anal and rectal cancers). Methods. We searched PubMed, Cochrane, and EMBASE for eligible studies as of the year 2000. After data extraction, a meta-analysis was performed to compare perineal wound morbidity. The studies were distributed as follows: Group A comparing primary closure (PC) and VRAMf, Group B comparing PC and mesh closure, and Group C comparing PC and VRAMf in PE. Results. Our systematic review yielded 18 eligible studies involving 2180 patients (1206 primary closures, 647 flap closures, 327 mesh closures). The meta-analysis of Groups A and B showed PC to be associated with an increase in the rate of total (Group A: OR 0.55, 95% CI 0.43–0.71; p < 0.01/Group B: OR 0.54, CI 0.17–1.68; p = 0.18) and major perineal wound complications (Group A: OR 0.49, 95% CI 0.35–0.68; p < 0.001/Group B: OR 0.38, 95% CI 0.12–1.17; p < 0.01). PC was associated with a decrease in total (OR 2.46, 95% CI 1.39–4.35; p < 0.01) and major (OR 1.67, 95% CI 0.90–3.08; p = 0.1) perineal complications in Group C. Conclusions. Our results confirm the contribution of the VRAMf in reducing major complications in APR. Similarly, biological prostheses offer an interesting alternative in pelvic reconstruction. For PE, an adapted reconstruction must be proposed with specialized expertise.

1. Introduction

Perineal wound problems after abdominoperineal resection (APR) in the context of anal and rectal cancers are frequent [1]. These types of resection problems occur because of wound complications caused by large perineal defects. Indeed, perineal wound complications, perineal abscesses, wound dehiscence, chronic fistulas, and sinuses lengthen hospital stays. Furthermore, the standardization of the surgery since the late 2000s and the extra-levator abdomino-perineal resection [2] (ELAPE) technique have led to a larger defect and increased perineal complications. In addition, advances in terms of pelvic oncology make it possible to manage increasingly advanced diseases or cancer recurrence [3], leading to the performance of pelvic exenterations [4].
Several strategies are used to decrease the complication rate. Closure by direct approximation of the pelvic muscles leads to a rate of major complications up to 57%, depending on the series [5]. Musculocutaneous flaps help to reduce this rate (16–46%) [6,7], but they generate their own morbidity, require experience, and require a specialized reconstructive surgery team. Finally, since the early 2010s, the use of biologic meshes seems to have improved the healing process [8,9]. However, results are still variable, and a recent randomized controlled study comparing direct closure and mesh closure showed no significant difference on morbidity at one year [10].
The effectiveness of flap and mesh closure strategies remains uncertain due to the small size of the populations studied, the heterogeneity of studies, and the varying availability of the data and experience of reconstructive surgeons in different institutions [11,12]. We conducted a systematic review and meta-analysis to compare myocutaneous flaps versus primary closure, as well as mesh closure versus primary closure for pelvic reconstruction after abdominal perineal resection and pelvic exenteration, with regard to perineal complications and post-operative length of stay.

2. Materials and Methods

The study protocol was prospectively registered at PROSPERO (registration number: CRD42020185719), following the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA), and Meta-Analyses of Observational Studies in Epidemiology (MOOSE) checklist [13,14].

2.1. Search Strategy and Data Collection

All studies reporting on perineal wound healing after abdominoperineal resection for rectal and anal cancer were considered eligible for analysis. The literature was systematically reviewed by searching in the PubMed library, EMBASE, and Cochrane library from 2000 to March 2020. The used medical subject headings (MESH) used are summarized in Table S1.

2.2. Inclusion and Exclusion Criteria

Original studies aiming at comparing the surgical outcomes of flap and primary closure or mesh and primary closure after abdominoperineal resection and pelvic exenteration for malignant indication were included. Exenteration is defined as the excision of the tumor mass (including rectum or neorectum) and at least one adjacent organ. Randomized controlled trials and observational studies including patients undergoing abdominoperineal resection for cancer and reporting primary, flap, and mesh closure were potentially eligible.
Articles meeting the following criteria were excluded: case series, case reports, commentaries, letters to the editor, literature reviews or meta-analyses, non-English language, cohort less than 10 patients, inflammatory bowel disease studies, or surgical intervention or outcomes of interest not reported. Studies evaluating only a single intervention group were excluded. Studies that did not report details of complications and those eliciting no response from the corresponding authors contacted by mail were also excluded.

2.3. Outcome Parameters

Our study analysis compared outcome settings defining perineal wound complications of flap, primary, and mesh closure procedures. This included total perineal wound complications. Major and minor perineal wound complications were classified according to the Southampton Wound Assessment Scale [10,15] (Table S2). When the Southampton score was not established in a study, complications were classified according to the details given and the corresponding authors’ answers. A score of 0 or 1 reports normal healing, a score of 2 or 3 reports minor complications, and a score of 4 or 5 reports major complications. Studies were eligible if one or more of these outcomes were reported or provided by the corresponding author. The length of postoperative stay was also collected. To reach optimal homogeneity and comparability, we divided the studies into three groups as follows: Group A studies comparing primary and flap closure in APR and ELAPE, Group B studies comparing primary and mesh closure in in APR and ELAPE, and Group C studies comparing primary and flap closure in pelvic exenterations only.

2.4. Data Collection and Extraction

A data abstraction form was designed a priori with Excel (Microsoft Corp, Redmond Washington, DC, USA) to standardize data collection. Two independent reviewers (E. Buscail. and C.Ca.) scanned all abstracts identified by search cross-referencing. The full text was then identified for each study that potentially met the inclusion criteria. Two reviewers (E. Buscail and C. Canivet) independently reviewed the full-text eligibility. If no consensus could be reached by the two reviewers and after discussion, a third specialist author was consulted and made the decision (B. Chaput). Articles that did not meet the inclusion criteria were excluded (Figure 1). Data extraction included general study information (age, sex ratio, BMI), neoadjuvant treatment (long/short-course radiotherapy and chemotherapy), surgical data (surgical resection technique, perineal reconstruction type), postoperative perineal wound healing details (total, major, and minor complication, and flap failure), and the postoperative length of stay and the duration of follow-up. In case of missing data or lack of details regarding the study, the corresponding authors were contacted.

2.5. Quality Assessment

A quality assessment of the studies was performed by two independent reviewers (E. Buscail and C. Canivet) using the Newcastle-Ottawa Scale [16,17]. The study quality was evaluated in 3 domains: patient selection, comparability, and outcome. A star rating of 0 to 9 was allocated to each study according to these parameters. Studies with scores of 8 or higher were classified as high quality, scores of 4 to 8 as moderate quality and scores of less than 4 as low quality. Any disagreement was resolved by discussion or by consulting a third investigator (B. Chaput).

2.6. Statistical Analysis

Each group was described using a weighted incidence rate for total, major, and minor complications, and a weighted pooled mean for length of stay. Overall odds ratio (OR) was used to compare complication rates and standardized mean difference (SMD) for length of stay. The generic inverse variance method was used to weight the effects. We assessed statistical heterogeneity between trials using the I2 statistic. We used a fixed effect model if I2 was below 0.5 and a random effects model if it was above 0.5. We evaluated the potential publication bias using funnel plot analysis and Egger’s test for each comparison of the total complication rate. All analyses were conducted using R statistical software version 4 and the metafor package. Significance was set for values <0.05.

3. Results

3.1. Literature Search and Results

The initial search resulted in 2588 citations, and one citation was added with a manual cross-reference. Then, 2088 titles remained after removing duplicates. After screening, 71 publications were retrieved for full-text review. When data was not available, the corresponding authors were contacted: four of them answered [18,19,20,21], and two of them could provide data details [18,21]. From the 71 articles, 53 articles were excluded, and the reasons are detailed in Figure 1. Finally, eighteen articles were included in quantitative synthesis (Figure 1) [6,7,9,10,18,21,22,23,24,25,26,27,28,29,30,31,32,33].

3.2. Study and Patient Characteristics

Study descriptions are provided in Table 1. Study endpoint details for each study are provided in the Supplementary Data. The quality of studies was moderate to good (range 3–9; Table 1 and Table S3). Fourteen compared flap to primary closure, including three studies on pelvic exenteration, and four articles compared mesh to primary closure. The 18 included studies covered 2180 patients (1206 primary closures, 647 flap closures, and 327 mesh closures). Pooled baseline characteristics are displayed in Table 2.

3.3. Study Endpoints

The outcomes of each study are detailed in the Supplementary Data (Tables S4–S20). The main findings of the studies are summarized in Table 2. Visual inspection of the funnel plots for the main and secondary outcomes of interest, as well as the non-statistically significant Egger’s test for each comparison of the main outcome (p = 0.68 and p = 0.96), suggested the absence of publication bias in our study (Figures S2 and S3).

3.4. Total Perineal Wound Complication

Eighteen included studies reported total perineal wound complications [6,7,9,10,18,21,22,23,24,25,26,27,28,29,30,31,32,33]. Eleven studies reported total perineal wound complication in Group A [6,7,21,22,23,24,25,26,27,28,29,30] four studies in Group B [9,10,18,31], and three in Group C [25,32,33]. The overall pooled weighted rate for the primary closure was 39.9% (95% CI 35.7%–44.6%) in Group A, 30.6% (95% CI 23.3%–40%) in Group B, and 51.3 % (95% CI 33.3%–79.6%) in Group C. The overall pooled weighted rate for flap closure was 30.3% (95% CI 21.8 %-42.2%) in Group A and 67.2% (95% CI 52.2%–86.5%) in Group C. The overall pooled weighted rate for mesh closure (Group B) was 18.7% (95% CI 10.6%–32.9%). Meta-analysis shows that primary closure is associated with a significant increase in total perineal wound complications compared to flap closure in Group A (OR 0.55, 95% CI 0.43–0.71; p < 0.01; I2 = 34%; p < 0.01). In Group B, the primary closure is associated with a higher rate of total perineal wound complication, but this result was not significant (OR 0.54, CI 0.17–1.68; p = 0.18; I2 = 54%; p = 0.18). In Group C, flap closure is significantly associated with an increase in total perineal complications (OR 2.46, 95% CI 1.39–4.35; p < 0.01; I2 = 46%). (Figure 2).

3.5. Major Wound Complications

Sixteen studies reported major perineal wound complications [6,7,9,10,18,22,23,25,26,27,28,29,30,31,32,33]. Ten studies reported major perineal wound complication rates in Group A [6,7,22,23,25,26,27,27,29,30], four studies in Group B [9,10,18,31], and three in Group C [25,32,33]. The overall pooled weighted rate for the primary closure was 23.6% (95% CI 17%–32.8%) in Group A, 20.7% (95% CI 14.8%–28.8%) in Group B, and 27.6% (95% CI 11.2%–68%) in Group C. The overall pooled weighted rate for flap closure was 14.3% (95% CI 11.2 %–18.3%) in Group A and 36.7% (95% CI 20.7%–65.3%) in Group C. The overall pooled weighted rate for mesh closure (Group B) was 10.5% (95% CI 7.3%–15.2%).
Meta-analysis shows that primary closure is associated with a significant increase in major perineal wound complications compared to flap closure in Group A (OR 0.49, 95% CI 0.35–0.68; p < 0.001). In Group B, major complications ranged significantly higher in primary closure (OR 0.38, 95% CI 0.12–1.17; p < 0.01). In Group C, flap closure is associated with an increase in major perineal complications (OR 1.67, 95% CI 0.90–3.08; p = 0.1). A low heterogeneity was identified for reported events in each group (I2 Group A = 22%; I2 Group B = 24%; I2 Group C = 0%) (Figure 3).

3.6. Minor Wound Complications

Fifteen studies reported minor perineal wound complications [6,7,9,10,18,22,23,25,26,28,29,30,31,32,33]. Nine studies reported minor perineal wound complications in Group A [6,7,22,23,25,26,28,29,30], four in Group B [9,10,18,31], and three in Group C [25,32,33]. The overall pooled weighted rate for the primary closure was 20.9% (95% CI 17.7%–24.6%) in Group A, 13% (95% CI 7.8%–21.5%) in Group B, and 15.6% (95% CI 11.1%–21.9%) in Group C. The overall pooled weighted rate for flap closure was 18.4% (95% CI 10.5 %–32.4%) in t Group A and 32.2% (95% CI 13.3%–77.8%) in Group C. The overall pooled weighted rate for mesh closure (Group B) was 13.9% (95% CI 6.5%–26.9%). Meta-analysis did not show any difference in studies comparing flap and primary closure: Group A (OR 0.83; 95% CI 0.39–1.79; p = 0.60) and Group C (OR; 95% CI 0.04–135.57; p = 0.47), with high heterogeneity (I2 = 70% and I2 = 86%, respectively). There was also no difference in the study group comparing the meshes to the primary closure (Group B (OR 1.09; 95% CI 0.54–2.21; p = 0.80)) with a more limited heterogeneity (I2 = 41%) (Figure 4).

3.7. Length of Stay

Eight articles providing data for the postoperative length of stay in Group A were included in our meta-analysis [6,7,21,22,26,27,28,29]. The pooled weighted mean length of stay was 15.1 days (95% CI 13.2, 16.9) for primary closure, and 17.4 (95% CI 13.5, 21.2) days for flap closure, which was not significantly different (SMD −0.07 CI 95% −0.25–0.11) (Figure 5).

4. Discussion

Our literature review and meta-analysis showed the necessity to fill the vacuum left by APR to reduce major perineal wound complications. This observation is more difficult to assert for more extensive resections, which are most often for more specialized and less standardized indications such as recurrence of pelvic cancer [4] or rarer neoplasia such as sarcomas. For this reason, we have endeavored to separate the studies of pelvic exenterations, on the one hand, and to standardize the classification of complication outcomes with the Southampton Wound Complication Scale complications, on the other hand.
APR morbidity remains high. The series comparing flap closure and primary closure presented a rate for major perineal wound complications ranging from 13% to 55% [22,27] for primary closure and up to 26% for flap closure [6] (Table S14). For studies comparing morbidity between mesh closure and primary closure, the major morbidity reported reaches 31% for primary closure [31]. The major complication rate is as high as 64% in pelvic exenterations [32]. This morbidity may be explained by the fact that the oncological results of a complete surgery are accompanied in the vast majority of cases by neoadjuvant radiotherapy, which is a risk factor for postoperative complications [5,34]. Another factor now being considered is the ELAPE, which is currently the standard for lower rectal cancer and leaves more dead space in the pelvis [35]. This space encourages the formation of collections, perineal abscesses, and chronic failure of the perineal wound [36,37].
Faced with the need to fill the space in the perineum to prevent the formation of collections, the option of musculocutaneous flaps has been increasingly used [38]. The most widely used and described here is the VRAM flap. A noteworthy result is that our meta-analysis shows a significant reduction in total (OR 0.55, 95% CI 0.43–0.71; I2 = 34%) and major complications (OR 0.49, 95% CI 0.35–0.68; p < 0.001) when using the VRAM flap. This result has already been shown in previous work, but the studies included gracilis flaps and pelvic exenterations [1]. The homogeneity of surgical strategies (e.g., VRAM flap and exclusion of pelvic exenteration) of the studies included here strengthens these findings. The flap donor site complications are one important aspect but are not discussed here, as we have focused our analyses on perineal wound healing.
The issue remains more complex and less clear-cut in the case of pelvic exenterations. Indeed, this specialized center surgery often requires a multidisciplinary team including plastic and pelvic surgeons [39]. This surgery is intended for patients with a long oncological history who have received numerous courses of chemotherapy and often even re-irradiation for pelvic recurrences [4]. Our meta-analysis shows a significant increase in total perineal complications in case of closure with the VRAM flap (OR 2.46, 95% CI 1.39–4.35; p < 0.01; I2 = 46%) This result is found for major complications, but it was not significant (OR 1.67, 95% CI 0.90–3.08; p = 0.1). Davidge et al. report a 4.8 higher perineal complication rate in cases of sacral resection manifested most often by dehiscence at the junction of the sacral incision and the posterior part of the flap [25]. Jacombs et al., who reported a retrospective study on 203 patients with pelvic exenteration, found a higher rate of major complications in patients with flap (25% vs. 14%) [33]. This result is weighted by the presence of risk factors identified by the authors: history of radiotherapy and APR, as well as total pelvic exenteration and sacral resection. Thus, the authors suggest that patients with fewer factors may have primary closure without increasing the rate of perineal wound complications.
More recently, closure with a biological prosthesis has emerged as an attractive alternative. It has the advantage that, unlike flaps, it does not require additional operating time and does not cause additional abdominal parietal defect. Interestingly, fewer major complications were found with the insertion of a prosthesis compared to primary closure (OR 0.38, 95% CI 0.12–1.17; p < 0.01). Of note, the meta-analysis includes two controlled prospective studies comparing primary closure with mesh closure. First, Munster et al. (BIOPEX study) [10] did not find any significant difference in total, minor and major complications. On the other hand, Han et al. found a significantly higher rate of total complications in the primary closure group than in the mesh closure group (12% vs. 36% p < 0.05) [31].
Besides the functional aspect, the medico-economic aspect could make the difference between the different closure strategies, but few studies report data on this subject. Woodfield et al. compared the direct costs and the costs of complications between a primary closure group (n = 37) and a VRAM flap closure group (n = 31) [29]. They reported higher costs in the VRAM group, particularly in relation to operating time and hospitalization; on the other hand, there were higher costs for the management of complications in the primary closure group (8394 New Zealand dollars vs. 25,911 New Zealand dollars, p = 0.012). Billig et al. compared a group of 2363 patients with primary closure and 194 patients with flap closure and found no significant difference between the two groups in terms of total and direct costs [40]. Regarding cost-effectiveness, it was higher for the primary closure group ($259/healthy day) than for the flap group ($186/healthy day) [40]; nevertheless, this result was not significant (p = 0.17). Currently, three ongoing multicenter trials could provide some answers as to which strategy to choose. The functional aspect was the question raised by the NEAPE trial (NCT 01347697) [41] comparing the gluteus flap to mesh closure. The issue of the gluteus flap is also studied by the BIOPEX-2 trial (NCT04004650) [42] with a primary closure control group. Finally, we are conducting an ongoing, randomized, multicenter, controlled trial on medico-economic issues and quality of life comparing primary closure with mesh closure by the GRECCAR 9 study (NCT 02841293).
Several limitations were encountered in this meta-analysis. First, this review included mostly observational studies, with only two randomized controlled trials and one controlled trial. Even with the strict inclusion criteria, limitations in the level of studies were met. Control groups (primary closure) were often poorly matched to study groups, especially for studies involving flaps, limiting the potency of the comparative analysis. Several studies used historical controls from an earlier period or constructed controls creating selection bias. Indications for perineal resection in groups A and C included patients with rarer cancers of the anus, rectum, and other neoplasias with less homogeneous neo-adjuvant treatments. However, our review was not significantly limited by the heterogeneity, as reflected by symmetric Funnel plots (Supplemental Figure) and acceptable I2 value, except for minor perineal wound complication. In flap studies, patients with co-morbidities, especially cardiovascular disease (e.g., diabetes, arterial hypertension, etc.), are often excluded due to the risk of flap necrosis and are, therefore, in the primary closure control groups. However, this finding must be weighed against the fact that flap indications are often associated with larger resections.

5. Conclusions

Our meta-analysis is the first to include a comparative analysis of the two most commonly used strategies for perineal closure. Our results confirm the contribution of the VRAM flap in reducing major complications in non-extensive perineal resection. Similarly, biological prostheses offer an interesting alternative in pelvic reconstruction, especially in the case of laparoscopic reconstruction, allowing the abdominal wall to be spared. For pelvic exenterations, an adapted reconstruction must be proposed and requires specialized multidisciplinary collegial surgical expertise.

Supplementary Materials

The following are available online at https://www.mdpi.com/2072-6694/13/4/721/s1, Figure S1: Forest plot for total length stay mesh versus primary closure, Figures S2 and S3: Funnel plot analyses for the detection of publication bias, Table S1 electronic search strategy, Table S2: Southampton wound assessment scale, Table S3: Newcastle Ottawa scale details. Table S4–S21 studies details.

Author Contributions

Study concept and design: E.B. (Etienne Buscail), C.C., J.S., E.B. (Emilie Berard), B.C. Acquisition of data: E.B. (Etienne Buscail), C.C., A.P., J.-P.D., B.C. Analysis and interpretation of data: E.B. (Etienne Buscail), C.C., J.S., N.C., L.G., E.B. (Emilie Berard), L.B., B.C. Manuscript writing: E.B. (Etienne Buscail), C.C., J.S., B.C. Critical revision: L.G., E.C., N.C., J.-P.D., A.P., L.B., E.B. (Emilie Berard), B.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethical review and approval were waived for this study not involving humans but only systematic literature review and meta-analysis.

Informed Consent Statement

Patient consent was waived considering that the manuscript only used previously published works and that there is no data on any new patient.

Data Availability Statement

The data presented in this study are all available in the present article and supplementary material included in the present manuscript.

Acknowledgments

PubMed citable collaborators: Denmark: S.K. Perdawood; Department of Surgery, Slagelse Hospital, Ingemannsvej 18, 4200 Slagelse; Denmark: Emilie Colov, Department of surgery C, Rigshospitalet, University of Copenhagen, Copenhagen; Brazil: Rodrigo Oliva Perez, MD; Ludwig Institute for Cancer Research Sao Paulo Branch, Rua Manoel da Nó brega 1564, Saõ Paulo, SP 04001-005; France: Gilles Houvenaeghel, MD; Institut Paoli-Calmettes, 232 Bd de Sainte Marguerite, 13009, Marseille.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Devulapalli, C.; Wei, A.T.J.; di Biagio, J.R.; Baez, M.L.; Baltodano, F.P.; Seal, S.M.; Broyles, J.M.; Cooney, C.M.; Rosson, G.D. Primary versus Flap Closure of Perineal Defects following Oncologic Resection. Plast. Reconstr. Surg. 2016, 137, 1602–1613. [Google Scholar] [CrossRef] [PubMed]
  2. West, N.P.; Anderin, C.; Smith, K.J.E.; Holm, T.; Quirke, P. Multicentre experience with extralevator abdominoperineal excision for low rectal cancer. BJS 2010, 97, 588–599. [Google Scholar] [CrossRef]
  3. Tuech, J.-J.; Pinson, J.; Nouhaud, F.-X.; Wood, G.; Clavier, T.; Sabourin, J.-C.; di Fiore, F.; Monge, M.; Papet, E.; Coget, J. Total Pelvic Exenteration, Cytoreductive Surgery, and Hyperthermic Intraperitoneal Chemotherapy for Rectal Cancer with Associate Peritoneal Metastases: Surgical Strategies to Optimize Safety. Cancers 2020, 12, 3478. [Google Scholar] [CrossRef] [PubMed]
  4. Denost, Q.; Solomon, M.; Tuech, J.-J.; Ghouti, L.; Cotte, E.; Panis, Y.; Lelong, B.; Rouanet, P.; Faucheron, J.-L.; Jafari, M.; et al. International variation in managing locally advanced or recurrent rectal cancer: Prospective benchmark analysis. BJS 2020, 107, 1846–1854. [Google Scholar] [CrossRef] [PubMed]
  5. Musters, G.D.; Buskens, C.J.; Bemelman, W.A.; Tanis, P.J. Perineal Wound Healing After Abdominoperineal Resection for Rectal Cancer. Dis. Colon Rectum 2014, 57, 1129–1139. [Google Scholar] [CrossRef]
  6. Chessin, D.B.; Hartley, J.; Cohen, A.M.; Mazumdar, M.; Cordeiro, P.; Disa, J.; Mehrara, B.; Minsky, B.D.; Paty, P.; Weiser, M.; et al. Rectus Flap Reconstruction Decreases Perineal Wound Complications After Pelvic Chemoradiation and Surgery: A Cohort Study. Ann. Surg. Oncol. 2005, 12, 104–110. [Google Scholar] [CrossRef]
  7. Butler, C.E.; Gündeslioglu, A.Ö.; Rodriguez-Bigas, M.A. Outcomes of Immediate Vertical Rectus Abdominis Myocutaneous Flap Reconstruction for Irradiated Abdominoperineal Resection Defects. J. Am. Coll. Surg. 2008, 206, 694–703. [Google Scholar] [CrossRef]
  8. Thomas, P.W.; Blackwell, J.E.M.; Herrod, P.J.J.; Peacock, O.; Singh, R.; Williams, J.P.; Hurst, N.G.; Speake, W.J.; Bhalla, A.; Lund, J.N. Long-term outcomes of biological mesh repair following extra levator abdominoperineal excision of the rectum: An observational study of 100 patients. Tech. Coloproctol. 2019, 23, 761–767. [Google Scholar] [CrossRef] [Green Version]
  9. Han, J.G.; Wang, Z.J.; Gao, Z.G.; Wei, G.H.; Yang, Y.; Zhai, Z.W.; Zhao, B.C.; Yi, B.Q. Perineal Wound Complications After Extralevator Abdominoperineal Excision for Low Rectal Cancer. Dis. Colon Rectum 2019, 62, 1477–1484. [Google Scholar] [CrossRef]
  10. Musters, G.D.; Klaver, C.E.L.; Bosker, R.J.I.; Burger, J.W.A.; van Duijvendijk, P.; van Etten, B.; van Geloven, A.A.W.; de Graaf, E.J.R.; Hoff, C.; Leijtens, J.W.A.; et al. Biological Mesh Closure of the Pelvic Floor After Extralevator Abdominoperineal Resection for Rectal Cancer. Ann. Surg. 2017, 265, 1074–1081. [Google Scholar] [CrossRef]
  11. Foster, J.D.; Tou, S.; Curtis, N.J.; Smart, N.J.; Acheson, A.; Maxwell-Armstrong, C.; Watts, A.; Singh, B.; Francis, N.K. Closure of the perineal defect after abdominoperineal excision for rectal adenocarcinoma—ACPGBI Position Statement. Color. Dis. 2018, 20, 5–23. [Google Scholar] [CrossRef]
  12. Yang, T.; Shen, Y.; Wang, Z. Perineal Wound Complications After Extralevator Abdominoperineal Excision for Low Rectal Cancer: A Call to Introduce a Standard Definition and Classification. Dis. Colon Rectum 2020, 63, e496. [Google Scholar] [CrossRef]
  13. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Int. J. Surg. 2010, 8, 336–341. [Google Scholar] [CrossRef] [Green Version]
  14. Stroup, D.F.; Berlin, J.A.; Morton, S.C.; Olkin, I.; Williamson, G.D.; Rennie, D.; Moher, D.; Becker, B.J.; Sipe, T.A.; Thacker, S.B.; et al. Meta-analysis of Observational Studies in EpidemiologyA Proposal for Reporting. JAMA 2000, 283, 2008–2012. [Google Scholar] [CrossRef]
  15. Bailey, I.S.; Karran, S.E.; Toyn, K.; Brough, P.; Ranaboldo, C. Community surveillance of complications after hernia surgery. BMJ 1992, 304, 469–471. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Higgins, J.P.T.; Altman, D.G.; Gøtzsche, P.C.; Jüni, P.; Moher, D.; Oxman, A.D.; Savović, J.; Schulz, K.F.; Weeks, L.; Sterne, J.A.C.; et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011, 343, d5928. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Wells, G.; Shea, B.; O’connell, D.L.; Peterson, J.; Welch; Losos, M.; Tugwell, P.; Ga, S.W.; Zello, G.A.; Petersen, J.; et al. The Newcastle-Ottawa Scale (NOS) for Assessing the Quality of Nonrandomised Studies in Meta-Analyses; Ottawa Hospital Research Institute: Ottawa, ON, Canada, 2014. [Google Scholar]
  18. Habr-Gama, A.; Julião, G.P.S.; Mattacheo, A.; de Campos-Lobato, L.F.; Aleman, E.; Vailati, B.B.; Gama-Rodrigues, J.; Perez, R.O. Extralevator Abdominal Perineal Excision Versus Standard Abdominal Perineal Excision: Impact on Quality of the Resected Specimen and Postoperative Morbidity. World J. Surg. 2017, 41, 2160–2167. [Google Scholar] [CrossRef]
  19. Perdawood, S.K.; Lund, T. Extralevator versus standard abdominoperineal excision for rectal cancer. Tech. Coloproctol. 2015, 19, 145–152. [Google Scholar] [CrossRef]
  20. Colov, E.P.; Klein, M.; Gögenur, I. Wound Complications and Perineal Pain After Extralevator Versus Standard Abdominoperineal Excision. Dis. Colon Rectum 2016, 59, 813–821. [Google Scholar] [CrossRef]
  21. Ghouti, L.; Houvenaeghel, G.; Moutardier, V.; Giovannini, M.; Magnin, V.; Lelong, B.; Bardou, V.-J.; Delpero, J.-R. Salvage Abdominoperineal Resection After Failure of Conservative Treatment in Anal Epidermoid Cancer. Dis. Colon Rectum 2005, 48, 16–22. [Google Scholar] [CrossRef]
  22. Lefevre, J.H.; Parc, Y.; Kernéis, S.; Shields, C.; Touboul, E.; Chaouat, M.; Tiret, E. Abdomino-Perineal Resection for Anal Cancer. Ann. Surg. 2009, 250, 707–711. [Google Scholar] [CrossRef]
  23. Chan, S.; Miller, M.; Ng, R.; Ross, D.; Roblin, P.; Carapeti, E.; Williams, A.B.; George, M.L. Use of myocutaneous flaps for perineal closure following abdominoperineal excision of the rectum for adenocarcinoma. Color. Dis. 2009, 12, 555–560. [Google Scholar] [CrossRef] [PubMed]
  24. Stelzner, S.; Hellmich, G.; Schubert, C.; Puffer, E.; Haroske, G.; Witzigmann, H. Short-term outcome of extra-levator abdominoperineal excision for rectal cancer. Int. J. Color. Dis. 2011, 26, 919–925. [Google Scholar] [CrossRef] [PubMed]
  25. Davidge, K.M.; Raghuram, K.; Hofer, S.; Ferguson, P.C.; Wunder, J.S.; Swallow, C.J.; Zhong, T. Impact of Flap Reconstruction on Perineal Wound Complications Following Ablative Surgery for Advanced and Recurrent Rectal Cancers. Ann. Surg. Oncol. 2014, 21, 2068–2073. [Google Scholar] [CrossRef] [PubMed]
  26. Althumairi, A.A.; Canner, J.K.; Ahuja, N.; Sacks, J.M.; Safar, B.; Efron, J. Time to Chemotherapy After Abdominoperineal Resection: Comparison Between Primary Closure and Perineal Flap Reconstruction. World J. Surg. 2016, 40, 225–230. [Google Scholar] [CrossRef] [PubMed]
  27. O’Dowd, V.; Burke, J.P.; Condon, E.; Waldron, D.; Ajmal, N.; Deasy, J.; McNamara, D.A.; Coffey, J.C. Vertical rectus abdominis myocutaneous flap and quality of life following abdominoperineal excision for rectal cancer: A multi-institutional study. Tech. Coloproctol. 2014, 18, 901–906. [Google Scholar] [CrossRef] [PubMed]
  28. Touny, A.; Othman, H.; Maamoon, S.; Ramzy, S.; Elmarakby, H. Perineal reconstruction using pedicled vertical rectus abdominis myocutaneous flap (VRAM). J. Surg. Oncol. 2014, 110, 752–757. [Google Scholar] [CrossRef]
  29. Woodfield, J.; Hulme-Moir, M.; Ly, J. A comparison of the cost of primary closure or rectus abdominis myocutaneous flap closure of the perineum after abdominoperineal excision. Color. Dis. 2017, 19, 934–941. [Google Scholar] [CrossRef] [PubMed]
  30. Chaudhry, A.; Oliver, J.D.; Vyas, K.S.; Tran, N.V.; Martinez-Jorge, J.; Larson, D.; Dozois, E.; Nelson, H.; Manrique, O.J. Comparison of Outcomes in Oncoplastic Pelvic Reconstruction with VRAM versus Omental Flaps: A Large Cohort Analysis. J. Reconstr. Microsurg. 2019, 35, 425–429. [Google Scholar] [CrossRef]
  31. Han, J.G.; Wang, Z.J.; Qian, Q.; Dai, Y.; Zhang, Z.Q.; Yang, J.S.; Li, F.; Bin Li, X. A Prospective Multicenter Clinical Study of Extralevator Abdominoperineal Resection for Locally Advanced Low Rectal Cancer. Dis. Colon Rectum 2014, 57, 1333–1340. [Google Scholar] [CrossRef]
  32. Chokshi, R.J.; Kuhrt, M.P.; Arrese, D.; Martin, E.W. Reconstruction of total pelvic exenteration defects with rectus abdominus myocutaneous flaps versus primary closure. Am. J. Surg. 2013, 205, 64–70. [Google Scholar] [CrossRef]
  33. Jacombs, A.S.W.; Rome, P.; Harrison, J.D.; Solomon, M.J. Assessment of the selection process for myocutaneous flap repair and surgical complications in pelvic exenteration surgery. BJS 2013, 100, 561–567. [Google Scholar] [CrossRef]
  34. Buscail, E.; Blondeau, V.; Adam, J.-P.; Pontallier, A.; Laurent, C.; Rullier, E.; Denost, Q. Surgery for rectal cancer after high-dose radiotherapy for prostate cancer: Is sphincter preservation relevant? Color. Dis. 2015, 17, 973–979. [Google Scholar] [CrossRef]
  35. West, N.P.; Finan, P.J.; Anderin, C.; Lindholm, J.; Holm, T.; Quirke, P. Evidence of the Oncologic Superiority of Cylindrical Abdominoperineal Excision for Low Rectal Cancer. J. Clin. Oncol. 2008, 26, 3517–3522. [Google Scholar] [CrossRef]
  36. Holm, T. Abdominoperineal Excision: Technical Challenges in Optimal Surgical and Oncological Outcomes after Abdominoperineal Excision for Rectal Cancer. Clin. Colon Rectal Surg. 2017, 30, 357–367. [Google Scholar] [CrossRef] [PubMed]
  37. Hawkins, A.T.; Berger, D.L.; Shellito, P.C.; Sylla, P.; Bordeianou, L. Wound Dehiscence After Abdominoperineal Resection for Low Rectal Cancer Is Associated with Decreased Survival. Dis. Colon Rectum 2014, 57, 143–150. [Google Scholar] [CrossRef] [Green Version]
  38. Weichman, K.E.; Matros, E.; Disa, J.J. Reconstruction of Peripelvic Oncologic Defects. Plast. Reconstr. Surg. 2017, 140, 601e–612e. [Google Scholar] [CrossRef] [PubMed]
  39. Pelv Ex Collaborative. Pelvic Exenteration for Advanced Nonrectal Pelvic Malignancy. Ann. Surg. 2019, 270, 899–905. [Google Scholar] [CrossRef] [PubMed]
  40. Billig, J.I.; Hsu, J.J.; Zhong, L.; Wang, L.; Chung, K.C.; Kung, T.A. Comparison of Effective Cost and Complications after Abdominoperineal Resection. Plast. Reconstr. Surg. 2019, 144, 866e–875e. [Google Scholar] [CrossRef] [PubMed]
  41. Rutegård, J.; Rutegård, J.; Haapamäki, M.M. Multicentre, randomised trial comparing acellular porcine collagen implant versus gluteus maximus myocutaneous flap for reconstruction of the pelvic floor after extended abdominoperineal excision of rectum: Study protocol for the Nordic Extended Abdominoperineal Excision (NEAPE) study. BMJ Open 2019, 9, e027255. [Google Scholar] [CrossRef] [Green Version]
  42. Sharabiany, S.; Blok, R.D.; Lapid, O.; Hompes, R.; Bemelman, W.A.; Alberts, V.P.; Lamme, B.; Wijsman, J.H.; Tuynman, J.B.; Aalbers, A.G.J.; et al. Perineal wound closure using gluteal turnover flap or primary closure after abdominoperineal resection for rectal cancer: Study protocol of a randomised controlled multicentre trial (BIOPEX-2 study). BMC Surg. 2020, 20, 1–8. [Google Scholar] [CrossRef] [PubMed]
Cancers 13 00721 g001 550
Figure 1. Flow diagram showing the search strategy for articles included in the systematic review and meta-analysis reported following the Preferred Reporting Systems for Systematic Reviews and Meta-Analysis statement.
Figure 1. Flow diagram showing the search strategy for articles included in the systematic review and meta-analysis reported following the Preferred Reporting Systems for Systematic Reviews and Meta-Analysis statement.
Cancers 13 00721 g001
Cancers 13 00721 g002 550
Figure 2. Forest plot for total perineal wound complications between patients with primary closure and with flap closure (A); forest plot for total perineal wound complications between patients with primary closure and with mesh closure (B); forest plot for total perineal wound complications between patients with primary closure and with flap closure in pelvic exenteration (C). Odds ratio: overall ratio of total perineal wound complications when comparing primary closure with flap closure. All weights are from random effects analysis. M–H, Mantel–Haenszel.
Figure 2. Forest plot for total perineal wound complications between patients with primary closure and with flap closure (A); forest plot for total perineal wound complications between patients with primary closure and with mesh closure (B); forest plot for total perineal wound complications between patients with primary closure and with flap closure in pelvic exenteration (C). Odds ratio: overall ratio of total perineal wound complications when comparing primary closure with flap closure. All weights are from random effects analysis. M–H, Mantel–Haenszel.
Cancers 13 00721 g002
Cancers 13 00721 g003 550
Figure 3. Forest plot for major perineal wound complications between patients with primary closure and with flap closure (A); forest plot for major perineal wound complications between patients with primary closure and with mesh closure (B); forest plot for major perineal wound complications between patients with primary closure and with flap closure in pelvic exenteration (C). Odds ratio: overall ratio of major perineal wound complications when comparing primary closure with flap closure. All weights are from random effects analysis. M–H, Mantel–Haenszel.
Figure 3. Forest plot for major perineal wound complications between patients with primary closure and with flap closure (A); forest plot for major perineal wound complications between patients with primary closure and with mesh closure (B); forest plot for major perineal wound complications between patients with primary closure and with flap closure in pelvic exenteration (C). Odds ratio: overall ratio of major perineal wound complications when comparing primary closure with flap closure. All weights are from random effects analysis. M–H, Mantel–Haenszel.
Cancers 13 00721 g003
Cancers 13 00721 g004 550
Figure 4. Forest plot for minor perineal wound complications between patients with primary closure and with flap closure (A); forest plot for minor perineal wound complications between patients with primary closure and with mesh closure (B); forest plot for minor perineal wound complications between patients with primary closure and with flap closure in pelvic exenteration (C). Odds ratio: overall ratio of minor perineal wound complications when comparing primary closure with flap closure. All weights are from random effects analysis. M–H, Mantel–Haenszel.
Figure 4. Forest plot for minor perineal wound complications between patients with primary closure and with flap closure (A); forest plot for minor perineal wound complications between patients with primary closure and with mesh closure (B); forest plot for minor perineal wound complications between patients with primary closure and with flap closure in pelvic exenteration (C). Odds ratio: overall ratio of minor perineal wound complications when comparing primary closure with flap closure. All weights are from random effects analysis. M–H, Mantel–Haenszel.
Cancers 13 00721 g004
Cancers 13 00721 g005 550
Figure 5. Forest plot for length of stay between patients with primary closure and with flap closure. Odds ratio: overall ratio of length of stay when comparing primary closure with flap closure. All weights are from random effects analysis. M–H, Mantel–Haenszel.
Figure 5. Forest plot for length of stay between patients with primary closure and with flap closure. Odds ratio: overall ratio of length of stay when comparing primary closure with flap closure. All weights are from random effects analysis. M–H, Mantel–Haenszel.
Cancers 13 00721 g005
Table
Table 1. Study description of the included studies.
Table 1. Study description of the included studies.
Study (Author)YearCountryDesignQuality *DiseasePatient (n = 2180)Primary Closure ** (n = 1206)Flap closure ** (n = 647)Mesh Closure ** (n = 327)
Ghouti et al. [21]2005FranceRetrospective cohort study5Anal cancer411526-
Chessin et al. [6]2005USARetrospective cohort study5Rectal cancer and anal cancer785919-
Butler et al. [7]2008USARetrospective cohort study5Rectal and anal cancer1117635-
Lefevre et al. [22]2009FranceRetrospective cohort study7Anal cancer955243-
Chan et al. [23]2010UKRetrospective cohort study4Rectal cancer512130-
Stelzner et al. [24]2011GermanyRetrospective cohort study3Rectal cancer744628-
Jacombs et al. [33]2012AustraliaRetrospective cohort study5Rectal cancer20316439-
Chokshi et al. [32]2013USARetrospective cohort study5Rectal cancer, anal cancer, and other cancers533617-
Davidge et al. [25]2014CanadaRetrospective cohort study4Rectal cancer17712552-
O’Dowd et al. [27]2014IrelandRetrospective cohort study8Rectal cancer392712-
Touny et al. [28]2014EgyptRCT9Rectal cancer603030-
Althumairi et al. [26]2015USARetrospective cohort study4Rectal cancer675611-
Woodfield et al. [29]2017New ZelandRetrospective cohort study3Rectal cancer, anal cancer, and other cancers683731-
Chaudhry et al. [30]2018USARetrospective cohort study 5Rectal cancer, anal cancer, and other cancers562288274-
Han et al. # [31]2014ChinaRCT9Rectal cancer10219-83
Musters et al. # [10]2017NetherlandsRCT9Rectal cancer10153-48
Habr-Gama et al. # [18]2017BrazilRetrospective cohort study6Rectal cancer72 ***48-22
Han et al. # [9]2019ChinaRetrospective cohort study6Rectal cancer22854-174
* Newcastle–Ottawa quality assessment scale. ** Patient included in analysis. *** 2 patients had a flap closure. # Mesh type: Han et al. [9,31], Human acellular dermal matrix (Ruinuo, Qingyuanweiye Bio-Tissue Engineer- ing Ltd., Beijing, China); Musters et al. [10], Strattice ®® LifeCell non-crosslinked dermis porcine; Habr-Gama et al. [18], Bio-A®® WL Gore synthetic bioabsorbable.
Table
Table 2. Pooled baseline characteristics of study population with flap closure and primary closure; mesh closure and primary closure.
Table 2. Pooled baseline characteristics of study population with flap closure and primary closure; mesh closure and primary closure.
Flap and Primary Closure (n = 1679)Mesh and Primary Closure (n = 501)
Flap (n = 647) *Primary Closure (n = 1032)Total (n = 1679)Mesh (n = 327)Primary Closure (n = 174)Total (n = 501)
Sex
Male463 (77%)716 (69%)1179 (70%)164 (37%)67 (38%)319 (63%) **
NR35 (5%)76 (7%) 312 (32%)67 (38%)0
Disease ***
Rectal cancer256 (40%)623 (60%)879 (53%)327 (100%)174 (100%)501 (100%)
Anal Cancer88 (13%)72 (7%)160 (9%)000
Other cancers11 (2%)011 (0.5%)000
NR292 (45%)337 (33%)629 (37.5%)000
Neoadjuvant therapy
None141 (22%)220 (21%)361 (22%)85 (26%)35 (20%)120 (23%)
Short course (25 Gy)000182 (56%)49 (28%)231 (47%)
Long course (40–60 Gy)381 (59%)541 (52%)922 (55%)60 (18%)90 (52%)150 (30%)
Chemotherapy305 (46%)455 (43%)760 (45%)232 (70%)129 (75%)361 (72%)
NR125 (19%)283 (27%)398 (23%)000
Type of resection
APR460 (71%)749 (73%)1209 (72%)3 (1%)47 (27%)50 (9%)
ELAPE97 (15%)67 (6%)164 (10%)324 (99%)127 (73%)451 (91%)
Pelvic exenteration90 (14%)216 (21%)306 (18%)000
NR000000
* All patients underwent VRAM reconstruction except 35 gracilis flaps and 3 gluteus flaps. ** 2 out of 4 studies did not provide sex details between the two groups (Han 2014 [31]; Habr-Gama 2017 [18]). *** Choksi et al. [32] did not provide details on disease between squamous cell carcinoma and rectal cancer.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Buscail, E.; Canivet, C.; Shourick, J.; Chantalat, E.; Carrere, N.; Duffas, J.-P.; Philis, A.; Berard, E.; Buscail, L.; Ghouti, L.; et al. Perineal Wound Closure Following Abdominoperineal Resection and Pelvic Exenteration for Cancer: A Systematic Review and Meta-Analysis. Cancers 2021, 13, 721. https://doi.org/10.3390/cancers13040721

AMA Style

Buscail E, Canivet C, Shourick J, Chantalat E, Carrere N, Duffas J-P, Philis A, Berard E, Buscail L, Ghouti L, et al. Perineal Wound Closure Following Abdominoperineal Resection and Pelvic Exenteration for Cancer: A Systematic Review and Meta-Analysis. Cancers. 2021; 13(4):721. https://doi.org/10.3390/cancers13040721

Chicago/Turabian Style

Buscail, Etienne, Cindy Canivet, Jason Shourick, Elodie Chantalat, Nicolas Carrere, Jean-Pierre Duffas, Antoine Philis, Emilie Berard, Louis Buscail, Laurent Ghouti, and et al. 2021. "Perineal Wound Closure Following Abdominoperineal Resection and Pelvic Exenteration for Cancer: A Systematic Review and Meta-Analysis" Cancers 13, no. 4: 721. https://doi.org/10.3390/cancers13040721

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop