Next Article in Journal
Conformational Flexibility and Local Frustration in the Functional States of the SARS-CoV-2 Spike B.1.1.7 and B.1.351 Variants: Mutation-Induced Allosteric Modulation Mechanism of Functional Dynamics and Protein Stability
Next Article in Special Issue
The Effects of Probiotics, Prebiotics and Synbiotics in Non-Alcoholic Fat Liver Disease (NAFLD) and Non-Alcoholic Steatohepatitis (NASH): A Systematic Review
Previous Article in Journal
Upregulation of miR-34a-5p, miR-20a-3p and miR-29a-3p by Onconase in A375 Melanoma Cells Correlates with the Downregulation of Specific Onco-Proteins
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Diagnostic Performance of Pancreatic Cytology with the Papanicolaou Society of Cytopathology System: A Systematic Review, before Shifting into the Upcoming WHO International System

by
Ilias P. Nikas
1,*,
Tanja Proctor
2,
Svenja Seide
2,
Stylianos S. Chatziioannou
1,
Jordan P. Reynolds
3 and
Dimitrios Ntourakis
1
1
School of Medicine, European University Cyprus, Nicosia 2404, Cyprus
2
Institute of Medical Biometry, University of Heidelberg, 69120 Heidelberg, Germany
3
Department of Laboratory Medicine and Pathology, Mayo Clinic, Jacksonville, FL 32256, USA
*
Author to whom correspondence should be addressed.
Int. J. Mol. Sci. 2022, 23(3), 1650; https://doi.org/10.3390/ijms23031650
Submission received: 27 December 2021 / Revised: 19 January 2022 / Accepted: 28 January 2022 / Published: 31 January 2022

Abstract

:
The Papanicolaou Society of Cytopathology (PSC) reporting system classifies pancreatobiliary samples into six categories (I–VI), providing guidance for personalized management. As the World Health Organization (WHO) has been preparing an updated reporting system for pancreatobiliary cytopathology, this systematic review aimed to evaluate the risk of malignancy (ROM) of each PSC category, also the sensitivity and specificity of pancreatic FNA cytology using the current PSC system. Five databases were investigated with a predefined search algorithm. Inclusion and exclusion criteria were applied to select the eligible studies for subsequent data extraction. A study quality assessment was also performed. Eight studies were included in the qualitative analysis. The ROM of the PSC categories I, II, III, IV, V, VI were in the ranges of 8–50%, 0–40%, 28–100%, 0–31%, 82–100%, and 97–100%, respectively. Notably, the ROM IVB (“neoplastic—benign”) subcategory showed a 0% ROM. Four of the included studies reported separately the ROMs for the IVO subcategory (“neoplastic—other”; its overall ROM ranged from 0 to 34%) with low (LGA) and high-grade atypia (HGA). ROM for LGA ranged from 4.3 to 19%, whereas ROM for HGA from 64 to 95.2%. When the subcategory IVO with HGA was considered as cytologically positive, together with the categories V and VI, there was a higher sensitivity of pancreatic cytology, at minimal expense of the specificity. Evidence suggests the proposed WHO international system changes—shifting the IVB entities into the “benign/negative for malignancy” category and establishing two new categories, the “pancreatic neoplasm, low-risk/grade” and “pancreatic neoplasm, high-risk/grade”—could stratify pancreatic neoplasms more effectively than the current PSC system.

1. Introduction

Fine-needle aspiration (FNA) of the pancreas—performed mostly with endoscopic ultrasound (EUS-FNA)—is a safe, minimally-invasive, and specific diagnostic procedure. EUS-FNA can effectively triage the aspirated material for cytomorphologic, biochemical, and molecular pathology evaluation, facilitating the diagnosis of pancreatic solid and cystic lesions and improving patient care [1,2,3]. The Papanicolaou Society of Cytopathology (PSC) reporting system uses a standardized approach, classifying pancreatobiliary samples into the following categories: I, nondiagnostic; II, negative; III, atypical; IV, neoplastic (consisting of two subcategories: IVB, neoplastic—benign; IVO, neoplastic—other); V, suspicious for malignancy; and IV, malignant. While the IVB category comprises mostly serous cystadenoma (SCA), the IVO is rather heterogeneous including intraductal papillary mucinous neoplasms (IPMNs) and mucinous cystic neoplasms (MCNs) of any grade, besides solid neoplasms exhibiting malignant potential, like pancreatic neuroendocrine tumors (PanNETs) and solid pseudopapillary neoplasms (SPNs) [4,5]. The goals of the PSC reporting system implementation are to summarize the morphologic criteria and provide risk stratification of each reporting category, as well as to incorporate radiologic, biochemical, and ancillary technique findings, and facilitate the communication among physicians [4,5].
Of interest, the World Health Organization (WHO) has been preparing an updated system for reporting pancreatobiliary cytopathology. Proposed changes include eliminating the “neoplastic: benign” PSC subcategory, while shifting SCA and lymphangioma interpretations into the “benign/negative for malignancy” WHO category; replacing the “neoplastic—other” PSC category with two new WHO categories, the “pancreatic neoplasm, low-risk/grade” and “pancreatic neoplasm, high-risk/grade”, encompassing the interpretations of IPMN or MCN with low-to intermediate and high-grade dysplasia, respectively; and moving the PanNETs and SPNs from the “neoplastic—other” PSC subcategory into the WHO category “positive for malignancy”, aligning with the recent WHO Classification of the Digestive System Tumors [6,7].
As no systematic review of studies presenting their results with the PSC reporting system has been published in the literature to date, the main outcomes of our study were to evaluate the ROM of each PSC category (I–IV) while reporting pancreatic FNAs, in addition to the sensitivity and specificity of pancreatic FNA cytology with the PSC system. We believe this analysis is important before implementing the upcoming WHO system into everyday practice.

2. Materials and Methods

2.1. Search Strategy

This systematic review was performed according to the Preferred Reporting Item for Systematic Review and Meta-Analysis (PRISMA) Statement [8]. Five databases (PubMed, Embase, Scopus, Web of Science, Cochrane Library) were investigated up until 31 August, 2020, with the following search algorithm: “Papanicolaou AND (system OR classification OR terminology OR nomenclature OR reporting OR guideline*) AND pancrea*”. The same term was applied once more on the PubMed database to update the search and include any eligible articles until August 2021. No filters were used, while the duplicates were removed with the Paperpile reference manager (https://paperpile.com/app, accessed on 31 August 2020).

2.2. Study Selection

The study inclusion and exclusion criteria are presented in Table 1. Two authors (I.P.N, S.S.C.) first performed the initial title–abstract selections in an independent manner, using the Rayan App (https://www.rayyan.ai/, accessed on 31 August 2020) [9]. They subsequently performed a full-text evaluation of all eligible articles derived from the selection step, arriving at the final list of articles to be used for data extraction. For any discrepancies, the two authors reached a consensus.

2.3. Data Extraction

The following data were extracted in an Excel® file: first author, year, country, study design, study period, research setting, lesion types included (solid; cystic; both), type of intervention (e.g., EUS-FNA), needle size, follow-up type (histology; histology and clinical/radiological follow-up), follow-up duration, time of classification with the PSC system (at initial diagnosis or reclassification for the study), total number of patients, total number of FNA cases, and number of cases with follow-up. In addition, the total number of cases reported under each PSC reporting category, and the number and percentage of them with a positive outcome, were also extracted.

2.4. Study Quality Assessment

The study quality assessment was conducted with the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool [10,11]. Risk of bias under each domain (patient selection; index test; reference standard; flow and timing) was assessed as low, unclear, or high.

3. Results

3.1. Literature Search

The flowchart of this systematic review is shown in Figure 1. The initial search (31 August, 2020) identified 563 articles (PubMed, 71; Embase, 171; Scopus, 84; Web of Science, 227; Cochrane Library, 10); of them, 225 were duplicates. The extra PubMed search revealed 6 more eligible studies (PubMed, 77 studies in total) until 31 August, 2021. Subsequently, a total of 344 studies were screened in a title-abstract fashion. Following this step, 15 studies were considered as eligible for full-text evaluation. The latter resulted in the exclusion of seven more studies, resulting in eight eligible studies that were further analyzed in this review.

3.2. Characteristics of the Included Studies

The main characteristics of the eight eligible studies are displayed in Table 2. These were published between 2014 and 2020, while they were most often reported from authors employed in the USA (n = 5). Most studies had a retrospective (n = 6), rather than a prospective design (n = 2). Study period ranged from one year to 15 years and 8 months. All but one were single center studies (n = 7), while all (n = 8) were performed in a university setting. Seven of them stated they only used EUS-FNA for all their included cases. Needle size ranged from 19 to 25 G. Most studies evaluated both solid and cystic lesions (n = 6), whereas two of them only cystic. Six studies considered both histology and clinical/radiological information as follow-up, while two studies only histology. Categorization with the PSC system was performed at the initial diagnosis in four studies, whereas cases were reclassified from the initial reporting in three studies. The total number of patients included was 2254 and the total number of pancreatic FNA cases 2448, whereas follow-up was available for 1959 patients.

3.3. Study Quality Assessment

In the study quality assessment (Table 3), no study was regarded as having low-risk in all four domains of the QUADAS-2 tool. In the “patient selection” domain, two studies reported only cystic, rather than a mixture of solid and cystic lesions from a specific period, thus were considered of high bias risk. All studies were rated with an unclear risk of bias in the domain “reference standard”, as pathologists often know the result of the index test (cytology) before interpreting the histology sample (the relevant signaling QUADAS-2 question, under this domain, says: “Were the reference standard results interpreted without knowledge of the results of the index test?” [10,11]). Lastly, in the “flow and timing” domain, six studies were considered having a high-risk of bias, as they had different reference standards across their included cases (either histology or clinical/radiological follow-up).

3.4. ROM of the PSC Reporting System

Table 4 shows the number of cases diagnosed under each PSC category, the number of them found positive with the reference standard used in each study (either histology or histology and clinical/radiological), and the percentage of positive cases confirmed with the reference standard/total number of cases (ROM). In the “nondiagnostic” category I, the ROM ranged from 8 to 50%, while in the “negative” category II from 0 to 40%, the “atypical” category III from 28 to 100%, the “neoplastic” category IV from 0 to 31% (also the “neoplastic—other” subcategory IVO from 0 to 34%), the “suspicious for malignancy” category V from 82 to 100%, and the “malignant” category VI from 97 to 100%. Of interest, in the “neoplastic—benign” subcategory IVB, the ROM was 0% in all three studies reporting separately the case numbers from the IVB category [13,14,15].
Notably, a few studies divided the “neoplastic—other” category into neoplasms with low (LGA) and high-grade atypia (HGA). All found the ROM was much higher neoplasms with HGA [12,13,14,18]. Hoda et al. reported the ROM was just 4.3% (2/46 cases) in the LGA, whereas 90% (18/20 cases) in the HGA subcategory [13]. Similarly, Sung et al. found that the ROM was 19% (16/84 cases) in the LGA and 95.2% (20/21 cases) in the HGA subcategory [14]. Lastly, Smith et al. [18] and Gilani et al. [12] reported a ROM of 13% (10/78 cases) and 17% (11/65 cases) in the LGA subcategory, whereas a ROM of 64% (7/11 cases) and 100% (3/3 cases) in the HGA subcategory, respectively.

3.5. Sensitivity and Specificity of Pancreatic FNA Cytology Using the PSC Reporting System

Table 5 shows the sensitivity and specificity of pancreatic FNA cytology reported with the PSC system, as displayed in the eligible studies of this systematic review. Different cut-offs were used each time, to decide if cytology would be considered positive or negative for this analysis. When only category VI was regarded as positive, sensitivity ranged from 12.50 to 73.26% and the specificity from 96.55 to 100%. When both categories V and VI were considered positive, sensitivity ranged from 29.17 to 82.89% and the specificity from 85.7 to 100%. Notably, a few studies showed that considering as cytologically-positive the subcategory IVO-with HGA (together with the categories V and VI) resulted in higher sensitivity, at almost no expense of the test specificity [12,13,14,18].

4. Discussion

The PSC reporting system was developed with the aim to improve communication among clinicians and offer guidance for personalized management, through providing risk stratification and supporting a multimodal approach that incorporates cytomorphologic, radiologic, biochemical, immunochemical, and molecular findings [4,5]. For instance, CEA cystic fluid levels more than 192 ng/mL and/or the presence of a KRAS mutation support the diagnosis of mucinous neoplastic cyst, while a GNAS mutation the diagnosis of IPMN [5,20,21,22,23]. This standardized system has been reported to reduce nondiagnostic and atypical interpretations [12,24]. However, its implementation has received some criticism, especially for the controversial subcategory “neoplastic—other”, which encompasses lesions of variable malignant potential (IPMNs and MCNs of all grades, also PanNETs and SPNs) [6].
The upcoming WHO international system aims to align cytology reporting with the recent WHO classification of the digestive system tumors, facilitating the communication among physicians of different specialties [6,7]. In this system, both “neoplastic—benign” and “neoplastic—other” PSC subcategories have been eliminated, whereas two new WHO categories—the “pancreatic neoplasm, low-risk/grade” and “pancreatic neoplasm, high-risk/grade”—have been established, encompassing IPMN or MCN with low-to intermediate and high-grade dysplasia, respectively. In addition, SCA have been shifted from the “neoplastic—benign” PSC subcategory into the “benign/negative for malignancy” WHO category, while PanNETs and SPNs have been moved from the “neoplastic—other” PSC subcategory into the WHO category “positive for malignancy” (Figure 2) [6,7]. As the WHO cytology reporting system has not officially been published yet, evidence concerning its diagnostic value is still lacking. In a recent study, Hoda et al. retrospectively reclassified their previously published data into this upcoming WHO system, aiming to calculate the ROM of each WHO category. They reported that the ROM was 7.7% for the WHO category I, 1% for the category II, 28% for the category III, 4.8% for the category IV, 60% for the category V, and 100% for both WHO categories VI and VII [6]. However, this has been the only study published so far concerning this system.
The evidence presented in our systematic review, although limited, supports the proposed changes in the upcoming WHO international system. All included studies reporting “neoplastic—benign” results showed that the latter had a 0% ROM (Table 3). The most common interpretation under this category is the SCA, a benign neoplasm most often followed-up rather than operated [4,25]. Thus, incorporation of these interpretations into the “benign/negative for malignancy” new WHO category seems reasonable. Furthermore, four of the included studies reported separately the ROMs for “neoplastic—other” with LGA and HGA [12,13,14,18]. ROM for LGA ranged from 4.3 to 19%, whereas ROM for HGA ranged from 64 to 95.2%. Notably, when the subcategory “neoplastic—other” with HGA was regarded as cytologically-positive (together with the categories “suspicious” and “malignant”), this resulted in higher sensitivity of the pancreatic FNA, at almost no expense of the specificity (Table 5) [12,13,14,18]. Hence, evidence suggests the proposed WHO reporting system, with its two new “pancreatic neoplasm, low-risk/grade” and “pancreatic neoplasm, high-risk/grade” categories, could potentially stratify pancreatic neoplasms (conservative management vs potential surgery) more effectively than the existing PSC system, as high-risk/grade cystic lesions have been associated with a much higher ROM. The criteria to detect HGA in pancreatic cystic fluid cytology—high nuclear/cytoplasmic ratio, nuclear membrane irregularities, hyper- or hypochromasia, and necrosis [26,27]—have been reported to be sensitive and specific to predict HGD or malignancy in histology [28], while demonstrating good interobserver reproducibility [29,30]. Notably, a recent immunohistochemical marker, the Das-1, has shown to be highly accurate detecting high-risk mucinous pancreatic cysts, especially when combined with cytology [31,32]. Our study found the ROM of the “atypical” category ranged from 28 to 100%. Reporting under this category has been linked with significant interobserver variability; while reasons for an “atypical” interpretation include sample degeneration, limited cellularity, prominent reactive or dysplastic changes, gastrointestinal contamination, or inexperience of the pathologist [33]. Rapid on-site evaluation (ROSE) could reduce sampling artifacts during EUS-FNA [34]. However, it seems to be of reduced value in pancreatic cystic lesions [35]. Reduction in “atypical” interpretations could be reached by applying ancillary techniques like immunohistochemistry or next-generation sequencing, asking help from experts, or performing a repeat FNA [33,36,37,38].
As expected, both “suspicious” and “malignant” categories exhibited high ROM (82–100% and 97–100%, respectively) in our study. Ancillary testing performed on the cytologic material may help to additionally reach a specific malignant diagnosis; for instance, BCL-10 immunopositivity supports the diagnosis of acinar cell carcinoma [39], while specific IHC panels may help identify PDAC variants [40,41] or metastases to the pancreas [42,43].
This study has some important limitations. The number of included studies was small, mostly of retrospective design and short duration. There was significant heterogeneity, especially in the patient selection—a mixture of studies with solid and cystic or only cystic lesions—and follow-up types, as some studies used only histology, whereas most a mixture of histology and clinical/radiologic follow-up. While relying on histologic-only follow-up could overrate the ROM, especially in the categories I–III of the PSC reporting system due to partial verification bias, a mixture of histology and clinical/radiologic follow-up could have the opposite effect [13]. Moreover, the eligible studies used different criteria to define their positive histologic outcome; some used only PDAC or other cancers, while others added HGD, PanNETs, or IPMNs of any grade. For these reasons, we decided not to perform a prevalence or diagnostic accuracy meta-analysis to calculate the pooled ROM and sensitivity/specificity, respectively, because its results could be misleading to the scientific community.

5. Conclusions

A standardized reporting system helps stratify patients undergoing pancreatic FNA. Whereas heterogeneity was present among the studies included in our systematic review, evidence supports the changes proposed in the upcoming WHO international system. Future studies will examine the ability of the latter to provide high diagnostic accuracy and effective risk stratification of patients with pancreatic lesions.

Author Contributions

Conceptualization: I.P.N.; methodology: I.P.N., T.P., S.S., and D.N.; software: I.P.N., T.P., and S.S.; validation: I.P.N., T.P., S.S., S.S.C., J.P.R., and D.N.; formal analysis: I.P.N., T.P., S.S., S.S.C., J.P.R., and D.N.; investigation: I.P.N., T.P., S.S., S.S.C., J.P.R., and D.N.; resources: I.P.N., T.P., S.S., and D.N.; data curation: I.P.N., T.P., S.S., and S.S.C.; writing—original draft preparation: I.P.N.; writing—review and editing: I.P.N., T.P., S.S., S.S.C., J.P.R., and D.N.; visualization: I.P.N., T.P., and S.S.; supervision: I.P.N., and D.N.; project administration: I.P.N. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chen, J.; Yang, R.; Lu, Y.; Xia, Y.; Zhou, H. Diagnostic Accuracy of Endoscopic Ultrasound-Guided Fine-Needle Aspiration for Solid Pancreatic Lesion: A Systematic Review. J. Cancer Res. Clin. Oncol. 2012, 138, 1433–1441. [Google Scholar] [CrossRef] [PubMed]
  2. Puli, S.R.; Bechtold, M.L.; Buxbaum, J.L.; Eloubeidi, M.A. How Good Is Endoscopic Ultrasound-Guided Fine-Needle Aspiration in Diagnosing the Correct Etiology for a Solid Pancreatic Mass? A Meta-Analysis and Systematic Review. Pancreas 2013, 42, 20–26. [Google Scholar] [CrossRef] [PubMed]
  3. Hoda, R.S.; Pitman, M.B. Pancreatic Cytology. Surg. Pathol. Clin. 2018, 11, 563–588. [Google Scholar] [CrossRef] [PubMed]
  4. Pitman, M.B.; Centeno, B.A.; Ali, S.Z.; Genevay, M.; Stelow, E.; Mino-Kenudson, M.; Fernandez-del Castillo, C.; Max Schmidt, C.; Brugge, W.; Layfield, L.; et al. Standardized Terminology and Nomenclature for Pancreatobiliary Cytology: The Papanicolaou Society of Cytopathology Guidelines. Diagn. Cytopathol. 2014, 42, 338–350. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Layfield, L.J.; Ehya, H.; Filie, A.C.; Hruban, R.H.; Jhala, N.; Joseph, L.; Vielh, P.; Pitman, M.B. Papanicolaou Society of Cytopathology Utilization of Ancillary Studies in the Cytologic Diagnosis of Biliary and Pancreatic Lesions: The Papanicolaou Society of Cytopathology Guidelines for Pancreatobiliary Cytology. Diagn. Cytopathol. 2014, 42, 351–362. [Google Scholar] [CrossRef] [Green Version]
  6. Hoda, R.S.; Arpin, R.N., 3rd; Rosenbaum, M.W.; Pitman, M.B. Risk of Malignancy Associated with Diagnostic Categories of the Proposed World Health Organization International System for Reporting Pancreaticobiliary Cytopathology. Cancer Cytopathol. 2021. [Google Scholar] [CrossRef]
  7. Nagtegaal, I.D.; Odze, R.D.; Klimstra, D.; Paradis, V.; Rugge, M.; Schirmacher, P.; Washington, K.M.; Carneiro, F.; Cree, I.A. WHO Classification of Tumours Editorial Board The 2019 WHO Classification of Tumours of the Digestive System. Histopathology 2020, 76, 182–188. [Google Scholar] [CrossRef] [Green Version]
  8. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews. Int. J. Surg. 2021, 88, 105906. [Google Scholar] [CrossRef]
  9. Ouzzani, M.; Hammady, H.; Fedorowicz, Z.; Elmagarmid, A. Rayyan—A Web and Mobile App for Systematic Reviews. Syst. Rev. 2016, 5, 210. [Google Scholar] [CrossRef] [Green Version]
  10. Whiting, P.F.; Rutjes, A.W.S.; Westwood, M.E.; Mallett, S.; Deeks, J.J.; Reitsma, J.B.; Leeflang, M.M.G.; Sterne, J.A.C.; Bossuyt, P.M.M. QUADAS-2 Group QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies. Ann. Intern. Med. 2011, 155, 529–536. [Google Scholar] [CrossRef]
  11. Campbell, J.M.; Klugar, M.; Ding, S.; Carmody, D.P.; Hakonsen, S.J.; Jadotte, Y.T.; White, S.; Munn, Z. Diagnostic Test Accuracy: Methods for Systematic Review and Meta-Analysis. Int. J. Evid. Based Healthc. 2015, 13, 154–162. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Gilani, S.M.; Adeniran, A.J.; Cai, G. Endoscopic Ultrasound-Guided Fine Needle Aspiration Cytologic Evaluation of Intraductal Papillary Mucinous Neoplasm and Mucinous Cystic Neoplasms of Pancreas. Am. J. Clin. Pathol. 2020, 154, 559–570. [Google Scholar] [CrossRef] [PubMed]
  13. Hoda, R.S.; Finer, E.B.; Arpin, R.N., 3rd; Rosenbaum, M.; Pitman, M.B. Risk of Malignancy in the Categories of the Papanicolaou Society of Cytopathology System for Reporting Pancreaticobiliary Cytology. J. Am. Soc. Cytopathol. 2019, 8, 120–127. [Google Scholar] [CrossRef] [PubMed]
  14. Sung, S.; Del Portillo, A.; Gonda, T.A.; Kluger, M.D.; Tiscornia-Wasserman, P.G. Update on Risk Stratification in the Papanicolaou Society of Cytopathology System for Reporting Pancreaticobiliary Cytology Categories: 3-Year, Prospective, Single-Institution Experience. Cancer Cytopathol. 2020, 128, 29–35. [Google Scholar] [CrossRef] [PubMed]
  15. Wright, P.K.; Shelton, D.A.; Holbrook, M.R.; Thiryayi, S.A.; Narine, N.; Slater, D.; Rana, D.N. Outcomes of Endoscopic Ultrasound-Guided Pancreatic FNAC Diagnosis for Solid and Cystic Lesions at Manchester Royal Infirmary Based upon the Papanicolaou Society of Cytopathology Pancreaticobiliary Terminology Classification Scheme. Cytopathology 2018, 29, 71–79. [Google Scholar] [CrossRef] [PubMed]
  16. Trisolini, E.; Armellini, E.; Paganotti, A.; Veggiani, C.; Bozzola, C.; Frattini, M.; Pizio, C.; Mancuso, G.; Andorno, S.; Boldorini, R. KRAS Mutation Testing on All Non-Malignant Diagnosis of Pancreatic Endoscopic Ultrasound-Guided Fine-Needle Aspiration Biopsies Improves Diagnostic Accuracy. Pathology 2017, 49, 379–386. [Google Scholar] [CrossRef]
  17. Chen, B.; Zhao, Y.; Gu, J.; Wu, H.; Liang, Z.; Meng, Z. Papanicolaou Society of Cytopathology New Guidelines Have a Greater Ability of Risk Stratification for Pancreatic Endoscopic Ultrasound-Guided Fine-Needle Aspiration Specimens. Oncotarget 2017, 8, 8154–8161. [Google Scholar] [CrossRef] [Green Version]
  18. Smith, A.L.; Abdul-Karim, F.W.; Goyal, A. Cytologic Categorization of Pancreatic Neoplastic Mucinous Cysts with an Assessment of the Risk of Malignancy: A Retrospective Study Based on the Papanicolaou Society of Cytopathology Guidelines. Cancer Cytopathol. 2016, 124, 285–293. [Google Scholar] [CrossRef] [Green Version]
  19. Layfield, L.J.; Dodd, L.; Factor, R.; Schmidt, R.L. Malignancy Risk Associated with Diagnostic Categories Defined by the Papanicolaou Society of Cytopathology Pancreaticobiliary Guidelines. Cancer Cytopathol. 2014, 122, 420–427. [Google Scholar] [CrossRef]
  20. Brugge, W.R.; Lewandrowski, K.; Lee-Lewandrowski, E.; Centeno, B.A.; Szydlo, T.; Regan, S.; del Castillo, C.F.; Warshaw, A.L. Diagnosis of Pancreatic Cystic Neoplasms: A Report of the Cooperative Pancreatic Cyst Study. Gastroenterology 2004, 126, 1330–1336. [Google Scholar] [CrossRef] [Green Version]
  21. Sawhney, M.S.; Devarajan, S.; O’Farrel, P.; Cury, M.S.; Kundu, R.; Vollmer, C.M.; Brown, A.; Chuttani, R.; Pleskow, D.K. Comparison of Carcinoembryonic Antigen and Molecular Analysis in Pancreatic Cyst Fluid. Gastrointest. Endosc. 2009, 69, 1106–1110. [Google Scholar] [CrossRef] [PubMed]
  22. Singhi, A.D.; Nikiforova, M.N.; Fasanella, K.E.; McGrath, K.M.; Pai, R.K.; Ohori, N.P.; Bartholow, T.L.; Brand, R.E.; Chennat, J.S.; Lu, X.; et al. Preoperative GNAS and KRAS Testing in the Diagnosis of Pancreatic Mucinous Cysts. Clin. Cancer Res. 2014, 20, 4381–4389. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Kadayifci, A.; Al-Haddad, M.; Atar, M.; Dewitt, J.M.; Forcione, D.G.; Sherman, S.; Casey, B.W.; Fernandez-Del Castillo, C.; Schmidt, C.M.; Pitman, M.B.; et al. The Value of KRAS Mutation Testing with CEA for the Diagnosis of Pancreatic Mucinous Cysts. Endosc. Int. Open 2016, 4, E391–E396. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Saieg, M.; Pitman, M.B. Experience and Future Perspectives on the Use of the Papanicolaou Society of Cytopathology Terminology System for Reporting Pancreaticobiliary Cytology. Diagn. Cytopathol. 2020, 48, 494–498. [Google Scholar] [CrossRef]
  25. Sydney, G.I.; Ioakim, K.J.; Michaelides, C.; Sepsa, A.; Sopaki-Valalaki, A.; Tsiotos, G.G.; Theocharis, S.; Salla, C.; Nikas, I. EUS-FNA Diagnosis of Pancreatic Serous Cystadenoma with the Aid of Cell Blocks and α-Inhibin Immunochemistry: A Case Series. Diagn. Cytopathol. 2019, 48, 239–243. [Google Scholar] [CrossRef]
  26. Pitman, M.B.; Centeno, B.A.; Daglilar, E.S.; Brugge, W.R.; Mino-Kenudson, M. Cytological Criteria of High-Grade Epithelial Atypia in the Cyst Fluid of Pancreatic Intraductal Papillary Mucinous Neoplasms. Cancer Cytopathol. 2014, 122, 40–47. [Google Scholar] [CrossRef] [Green Version]
  27. Salla, C.; Karvouni, E.; Nikas, I.; Ikonomakis, A.; Konstantinou, P.; Karoumpalis, I.; Sepsa, A.; Papaparaskeva, K.; Tsopanomichalou, M.; Georgiadou, D.; et al. Imaging and Cytopathological Criteria Indicating Malignancy in Mucin-Producing Pancreatic Neoplasms: A Series of 68 Histopathologically Confirmed Cases. Pancreas 2018, 47, 1283–1289. [Google Scholar] [CrossRef]
  28. Hoda, R.S.; Lu, R.; Arpin, R.N., 3rd; Rosenbaum, M.W.; Pitman, M.B. Risk of Malignancy in Pancreatic Cysts with Cytology of High-Grade Epithelial Atypia. Cancer Cytopathol. 2018, 126, 773–781. [Google Scholar] [CrossRef] [Green Version]
  29. Goyal, A.; Abdul-Karim, F.W.; Yang, B.; Patel, J.B.; Brainard, J.A. Interobserver Agreement in the Cytologic Grading of Atypia in Neoplastic Pancreatic Mucinous Cysts with the 2-Tiered Approach. Cancer Cytopathol. 2016, 124, 909–916. [Google Scholar] [CrossRef]
  30. Pitman, M.B.; Centeno, B.A.; Genevay, M.; Fonseca, R.; Mino-Kenudson, M. Grading Epithelial Atypia in Endoscopic Ultrasound-Guided Fine-Needle Aspiration of Intraductal Papillary Mucinous Neoplasms: An International Interobserver Concordance Study. Cancer Cytopathol. 2013, 121, 729–736. [Google Scholar] [CrossRef]
  31. Das, K.K.; Geng, X.; Brown, J.W.; Morales-Oyarvide, V.; Huynh, T.; Pergolini, I.; Pitman, M.B.; Ferrone, C.; Al Efishat, M.; Haviland, D.; et al. Cross Validation of the Monoclonal Antibody Das-1 in Identification of High-Risk Mucinous Pancreatic Cystic Lesions. Gastroenterology 2019, 157, 720–730.e2. [Google Scholar] [CrossRef] [PubMed]
  32. Heidarian, A.; Das, K.K.; Mino-Kenudson, M.; Fernandez-Del Castillo, C.; Pitman, M.B. Cytology Adds Value to Monoclonal Antibody Das-1 Testing for Detection of High-Risk Pancreatic Cysts. J. Am. Soc. Cytopathol. 2021, 10, 249–254. [Google Scholar] [CrossRef] [PubMed]
  33. HooKim, K.; Reid, M.D. Atypical Cells in Fine Needle Aspiration Biopsies of Pancreas: Causes, Work-Up, and Recommendations for Management. Diagn. Cytopathol. 2021. [Google Scholar] [CrossRef] [PubMed]
  34. Hébert-Magee, S.; Bae, S.; Varadarajulu, S.; Ramesh, J.; Frost, A.R.; Eloubeidi, M.A.; Eltoum, I.A. The Presence of a Cytopathologist Increases the Diagnostic Accuracy of Endoscopic Ultrasound-Guided Fine Needle Aspiration Cytology for Pancreatic Adenocarcinoma: A Meta-Analysis. Cytopathology 2013, 24, 159–171. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Estrada, P.; Benson, M.; Gopal, D.; Buehler, D.; Pfau, P. Cytology with Rapid on-Site Examination (ROSE) Does Not Improve Diagnostic Yield of EUS-FNA of Pancreatic Cystic Lesions. Diagn. Cytopathol. 2019, 47, 1184–1189. [Google Scholar] [CrossRef] [PubMed]
  36. Rosenbaum, M.W.; Jones, M.; Dudley, J.C.; Le, L.P.; Iafrate, A.J.; Pitman, M.B. Next-Generation Sequencing Adds Value to the Preoperative Diagnosis of Pancreatic Cysts. Cancer Cytopathol. 2017, 125, 41–47. [Google Scholar] [CrossRef] [PubMed]
  37. Ozretić, L.; Simonović, A.V.; Rathbone, M.L.; Young, M.P.A.; Perez-Machado, M.A. The Benefits of the Papanicolaou Society of Cytopathology System for Reporting Pancreatobiliary Cytology: A 2-Year Review from a Single Academic Institution. Cytopathology 2021, 32, 227–232. [Google Scholar] [CrossRef]
  38. Hosoda, W.; Chianchiano, P.; Griffin, J.F.; Pittman, M.E.; Brosens, L.A.; Noë, M.; Yu, J.; Shindo, K.; Suenaga, M.; Rezaee, N.; et al. Genetic Analyses of Isolated High-Grade Pancreatic Intraepithelial Neoplasia (HG-PanIN) Reveal Paucity of Alterations in TP53 and SMAD4. J. Pathol. 2017, 242, 16–23. [Google Scholar] [CrossRef] [Green Version]
  39. Hosoda, W.; Sasaki, E.; Murakami, Y.; Yamao, K.; Shimizu, Y.; Yatabe, Y. BCL10 as a Useful Marker for Pancreatic Acinar Cell Carcinoma, Especially Using Endoscopic Ultrasound Cytology Specimens. Pathol. Int. 2013, 63, 176–182. [Google Scholar] [CrossRef]
  40. Reid, M.D.; Muraki, T.; HooKim, K.; Memis, B.; Graham, R.P.; Allende, D.; Shi, J.; Schaeffer, D.F.; Singh, R.; Basturk, O.; et al. Cytologic Features and Clinical Implications of Undifferentiated Carcinoma with Osteoclastic Giant Cells of the Pancreas: An Analysis of 15 Cases. Cancer Cytopathol. 2017, 125, 563–575. [Google Scholar] [CrossRef]
  41. Sydney, G.I.; Ioakim, K.J.; Sergentanis, T.N.; Tsiotos, G.G.; Kyriakidou, V.; Sepsa, A.; Theocharis, S.; Salla, C.; Nikas, I. Dissecting the Presence of Malignant Squamous Cells in Pancreatic Cytopathology: A Case Series. Diagn. Cytopathol. 2019, 47, 1287–1292. [Google Scholar] [CrossRef] [PubMed]
  42. Pannala, R.; Hallberg-Wallace, K.M.; Smith, A.L.; Nassar, A.; Zhang, J.; Zarka, M.; Reynolds, J.P.; Chen, L. Endoscopic Ultrasound-Guided Fine Needle Aspiration Cytology of Metastatic Renal Cell Carcinoma to the Pancreas: A Multi-Center Experience. Cytojournal 2016, 13, 24. [Google Scholar] [CrossRef] [PubMed]
  43. Ioakim, K.J.; Sydney, G.I.; Michaelides, C.; Sepsa, A.; Psarras, K.; Tsiotos, G.G.; Salla, C.; Nikas, I.P. Evaluation of Metastases to the Pancreas with Fine Needle Aspiration: A Case Series from a Single Centre with Review of the Literature. Cytopathology 2020, 31, 96–105. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The flowchart of this systematic review.
Figure 1. The flowchart of this systematic review.
Ijms 23 01650 g001
Figure 2. Comparison of the Papanicolaou Society of Cytopathology (PSC) System and the proposed WHO international system for reporting pancreatobiliary cytology. The neoplasms highlighted with blue are shifted into their new categories of the upcoming WHO system.
Figure 2. Comparison of the Papanicolaou Society of Cytopathology (PSC) System and the proposed WHO international system for reporting pancreatobiliary cytology. The neoplasms highlighted with blue are shifted into their new categories of the upcoming WHO system.
Ijms 23 01650 g002
Table 1. Study inclusion and exclusion criteria.
Table 1. Study inclusion and exclusion criteria.
Inclusion Criteria
Original studies
Studies reporting pancreatic FNA cases of solid and/or cystic lesions
Studies reporting pancreatic FNA cases with available follow-up
Studies performed on humans
Exclusion Criteria
Studies written in a language other than English
Animal model or in vitro studies
Studies where results were not reported with the PSC reporting system
Sampling other than FNA (e.g., brushings)
Studies reporting cytology sampling of the biliary tract
Studies including less than 30 cases with follow-up
Studies where follow-up was not reported
Inability to extract data
Potential data overlap with already included studies
Follow-up with only a single diagnosis (e.g., pancreatic adenocarcinoma)
Reviews, editorials, conference abstracts, and case reports
Table 2. Main characteristics of the studies included in the systematic review.
Table 2. Main characteristics of the studies included in the systematic review.
First Author, Year (Reference)CountryLesion TypesInitial Dx or ReclassificationTotal No of Patients (F/M)Mean AgeTotal No of FNA CasesCases with Follow-UpFollow-Up Type
Gilani, 2020 [12]USACysticReclassification120 (72/48)62120120Histology
Hoda, 2019 [13]USASolid and CysticInitial322 (154/168)66.1334334Histology and Clinical
Sung, 2019 [14]USASolid and CysticInitial856 (456/400)67 *1029548Histology and Clinical
Wright, 2018 [15]UKSolid and CysticInitial111 (59/52)63120112Histology and Clinical
Trisolini, 2017 [16]ItalySolid and CysticInitial107 (56/51)67107107Histology and Clinical
Chen, 2017 [17]ChinaSolid and CysticReclassification294 (111/183)55 *294294Histology and Clinical
Smith, 2016 [18]USACysticReclassification127 (44/37 in IPMNs; 45/1 in MCNs)IPMNs: 67
MCNs: 54
127127Histology
Layfield, 2014 [19]USASolid and CysticNR317 (NR)NR317317Histology and Clinical
Abbreviations: IPMNs, intraductal papillary mucinous neoplasms; MCNs, mucinous cystic neoplasms. * These studies reported the median, rather than the mean age.
Table 3. Risk of bias of the studies included in the meta-analysis, according to the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2).
Table 3. Risk of bias of the studies included in the meta-analysis, according to the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2).
First Author, Year (Reference)Patient SelectionIndex TestReference StandardFlow and Timing
Gilani, 2020 [12]HUUL
Hoda, 2019 [13]LLUH
Sung, 2019 [14]LLUH
Wright, 2018 [15]LLUH
Trisolini, 2017 [16]LLUH
Chen, 2017 [17]LLUH
Smith, 2016 [18]HLUL
Layfield, 2014 [19]LLUH
Table 4. Risk of malignancy associated with each of the Papanicolaou System categories (I–VI) in the eligible studies of this systematic review. Every column contains the total number cases reported under each category, followed by a parenthesis including the number of cases with a positive outcome (P) and its percentage (highlighted with Bold).
Table 4. Risk of malignancy associated with each of the Papanicolaou System categories (I–VI) in the eligible studies of this systematic review. Every column contains the total number cases reported under each category, followed by a parenthesis including the number of cases with a positive outcome (P) and its percentage (highlighted with Bold).
First Author, Year (Reference)I (P, %)II (P, %)III (P, %)IV (P, %)IVΒ (P, %)IVO (P, %)IVO with HGA (P, %)V (P, %)VI (P, %)
Gilani, 2020 [12]6 (2, 33%)18 (2, 11%)7 (2, 29%)68 (14, 21%) 68 (14, 21%)3 (3, 100%)5 (5, 100%)16 (16, 100%)
Hoda, 2019 [13]39 (3, 8%)100 (1, 1%)25 (7, 28%)70 (20, 29%)4 (0, 0%)66 (20, 30%)20 (18, 90%)6 (6, 100%)94 (94, 100%)
Sung, 2019 [14]44 (11, 25%)23 (4, 17%)86 (36, 42%)117 (36, 31%)12 (0, 0%)105 (36, 34%)21 (20, 95%)22 (21, 95%)256 (255, 100%)
† Wright, 2018 [15]9 (2, 22%)36 (3, 8%)2 (2, 100%)18 (0, 0%)3 (0, 0%)15 (0, 0%) 4 (4, 100%)43 (43, 100%)
Trisolini, 2017 [16]18 (10, 56%)10 (4, 40%)14 (14, 100%) 15 (14, 93%)50 (50, 100%)
Chen, 2017 [17]21 (12, 57%)83 (15, 18%)13 (9, 69%)20 (4, 20%) 20 (4, 20%) 32 (28, 88%)125 (125, 100%)
Smith, 2016 [18]23 (4, 17%)7 (0, 0%) 89 (17, 19%) 89 (17, 19%)11 (7, 64%)5 (4, 80%)3 (3, 100%)
Layfield, 2014 [19]14 (3, 21%)103 (13, 13%)23 (17, 74%)14 (2, 14%) 22 (18, 82%)141 (137, 97%)
Abbreviations: I, nondiagnostic; II, negative; III, atypical; IVB, neoplastic—benign; IVO, neoplastic—other; V, suspicious for malignancy; IV, malignant; VI, HGA, high-grade atypia. † In this study, ROM of each category was recalculated using the raw data provided by the authors in the manuscript; histology showing a mucinous cystic neoplasm of any grade, a neoplasm with malignant potential (e.g., neuroendocrine neoplasm of any grade), or a carcinoma was considered a positive outcome. The authors also used the same positive outcome to calculate sensitivity and specificity.
Table 5. Sensitivity and specificity of pancreatic fine-needle aspiration cytology reported with the Papanicolaou System, as reported in the eligible studies of this systematic review.
Table 5. Sensitivity and specificity of pancreatic fine-needle aspiration cytology reported with the Papanicolaou System, as reported in the eligible studies of this systematic review.
First Author, Year (Reference)Cytology Categories Considered PositiveAdditional Histology Classified as Positive (Besides “Malignancy”)Sensitivity (%)Specificity (%)
† Gilani, 2020 [12]IVO with HGA, V, VIHGD61.54100
V, VI 53.85100
VI 41.03100
Hoda, 2019 [13]IVO with HGA, V, VIHGD, PanNET92.298.8
V, VI 78.1100
VI 66.2100
‡ Sung, 2019 [14]IVO with HGA, V, VIHGD84.0998.03
IVO, V, VI 85.761.4
V, VI 75.898.9
VI 70.199.5
Wright, 2018 [15]IVO, V, VIPanNET, IPMN, MCN95.4100
Trisolini, 2017 [16]V, VIPanNET, IPMN7885.7
VI 61100
Chen, 2017 [17]V, VI§ NE79.2796.04
VI 64.77100
† Smith, 2016 [18]IVO with HGA, V, VIHGD58.3393.75
V, VI 29.1798.75
VI 12.50100
Layfield, 2014 [19]V, VI§ NE82.8993.10
VI 73.2696.55
Abbreviations: I, nondiagnostic; II, negative; III, atypical; IVB, neoplastic—benign; IVO, neoplastic—other; V, suspicious for malignancy; IV, malignant; HGA, high-grade atypia; HGD, high-grade dysplasia; PDAC, pancreatic adenocarcinoma; PanNEC, pancreatic neuroendocrine carcinoma; PanNET, pancreatic neuroendocrine tumor; SPN, solid pseudopapillary neoplasm; IPMN, intraductal pancreatic mucinous neoplasm; MCN, mucinous cystic neoplasm; NE, nothing else. † In the Gilani et al. and Smith et al. studies, sensitivity and specificity of all scenarios were calculated using the raw data provided by the authors of the manuscript. In the calculations we added, we did not include the results of the nondiagnostic category. ‡ In the Sung et al. study, sensitivity and specificity in the first scenario (cytology categories considered positive: IVO with HGA, V, VI) were calculated using the raw data provided by the authors of the manuscript. In the calculations we added, we did not include the results of the nondiagnostic category. § In the Chen et al. study, nothing else (no other diagnoses rather than the ones written in the column title) was mentioned as a positive outcome. In the Layfield et al. study, histologic or clinical evidence of malignancy were used as a positive outcome. “Malignancy” included: PDAC, PanNEC, SPN with high-grade malignant transformation, IPMN or MCN with invasion, acinar cell carcinoma, pancreatoblastoma, lymphoma, and metastases.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Nikas, I.P.; Proctor, T.; Seide, S.; Chatziioannou, S.S.; Reynolds, J.P.; Ntourakis, D. Diagnostic Performance of Pancreatic Cytology with the Papanicolaou Society of Cytopathology System: A Systematic Review, before Shifting into the Upcoming WHO International System. Int. J. Mol. Sci. 2022, 23, 1650. https://doi.org/10.3390/ijms23031650

AMA Style

Nikas IP, Proctor T, Seide S, Chatziioannou SS, Reynolds JP, Ntourakis D. Diagnostic Performance of Pancreatic Cytology with the Papanicolaou Society of Cytopathology System: A Systematic Review, before Shifting into the Upcoming WHO International System. International Journal of Molecular Sciences. 2022; 23(3):1650. https://doi.org/10.3390/ijms23031650

Chicago/Turabian Style

Nikas, Ilias P., Tanja Proctor, Svenja Seide, Stylianos S. Chatziioannou, Jordan P. Reynolds, and Dimitrios Ntourakis. 2022. "Diagnostic Performance of Pancreatic Cytology with the Papanicolaou Society of Cytopathology System: A Systematic Review, before Shifting into the Upcoming WHO International System" International Journal of Molecular Sciences 23, no. 3: 1650. https://doi.org/10.3390/ijms23031650

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop