Next Article in Journal
CT-Guided vs. Navigational Bronchoscopic Biopsies for Solitary Pulmonary Nodules: A Single-Institution Retrospective Comparison
Next Article in Special Issue
Functional Outcome and Overall Survival in Patients with Primary or Secondary CNS Lymphoma after Surgical Resection vs. Biopsy
Previous Article in Journal
Baseline Values of Circulating IL-6 and TGF-β Might Identify Patients with HNSCC Who Do Not Benefit from Nivolumab Treatment
Previous Article in Special Issue
Leveraging Attention-Based Convolutional Neural Networks for Meningioma Classification in Computational Histopathology
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Impact of Human Papillomavirus-Negative Dominance in Oropharyngeal Cancer on Overall Survival: A Population-Based Analysis in Germany from 2018 to 2020

1
Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany
2
Department of Otorhinolaryngology, Suedharzklinikum Nordhausen, 99734 Nordhausen, Germany
3
Department of Otorhinolaryngology, Helios-Klinikum Erfurt, 99089 Erfurt, Germany
4
Department of Otorhinolaryngology, SRH Zentralklinikum Suhl, 98527 Suhl, Germany
5
Department of Otorhinolaryngology, SRH Wald-Klinikum Gera, 07548 Gera, Germany
6
University Tumor Center, Jena University Hospital, 07747 Jena, Germany
*
Author to whom correspondence should be addressed.
Cancers 2023, 15(21), 5259; https://doi.org/10.3390/cancers15215259
Submission received: 19 September 2023 / Revised: 26 October 2023 / Accepted: 30 October 2023 / Published: 2 November 2023
(This article belongs to the Special Issue Oncology: State-of-the-Art Research in Germany)

Abstract

:

Simple Summary

The impact of the relation of human papillomavirus (HPV) infection and smoking status of oropharyngeal squamous cell carcinoma (OPSCC) on overall survival (OS) was investigated in a retrospective population-based study in Thuringia, Germany. All patients with OPSCC (from 2018 to 2020) were included. OPSCC cases were 37.3% HPV-positive (+) (31.2% smokers; mean incidence: 2.91/100,000 population) and 57.8% HPV-negative (63.5% smokers; mean incidence: 4.50/100,000 population). HPV+ patients had significantly better OS than HPV-negative (−) patients. In multivariable analysis, HPV− patients had an increased 4.5-fold higher hazard of death, but the smoking status had no independent influence on risk of death. In binary logistic regression analysis, smokers showed a 4.5 increased odds ratio (OR) of being tested HPV− than for nonsmokers. HPV− smokers formed the majority in Thuringia. Optimizing OPSCC therapeutic strategies due to the dominance of HPV− is more important than discussing de-escalation strategies for HPV+ patients.

Abstract

The impact of the relation of human papillomavirus (HPV) and smoking status of oropharyngeal squamous cell carcinoma (OPSCC) on overall survival (OS) was investigated in a retrospective population-based study in Thuringia, Germany. A total of 498 patients with OPSCC (76.9% men; mean age 62.5 years) from 2018 to 2020 were included. OPSCC cases were 37.3% HPV-positive (+) (31.2% smokers; mean incidence: 2.91/100,000 population) and 57.8% HPV-negative (63.5% smokers; mean incidence: 4.50/100,000 population). Median follow-up was 20 months. HPV+ patients had significantly better OS than HPV-negative (−) patients (HPV+: 2-year OS: 90.9%; HPV−: 2-year OS: 73.6%; p < 0.001). In multivariable analysis, HPV− patients (hazard ratio (HR) = 4.5; 95% confidence interval (CI): 2.4–8.6), patients with higher N classification (N2: HR = 3.3; 95% CI: 1.71–6.20; N3: HR = 3.6; 95% CI: 1.75–7.31) and with a higher cancer staging (III: HR = 5.7; 95% CI: 1.8–17.6; IV: HR = 19.3; 95% CI: 6.3–57.3) had an increased hazard of death. HPV− smokers formed the majority in Thuringia. Nicotine and alcohol habits had no impact on OS. Optimizing OPSCC therapeutic strategies due to the dominance of HPV− is more important than discussing de-escalation strategies for HPV+ patients.

1. Introduction

Oropharyngeal squamous cell carcinoma (OPSCC) is increasing in importance among head and neck cancer (HNC), as a significant increase in incidence has been observed, whereas head and neck squamous cell carcinoma (HNSCC) has shown a decreasing trend worldwide. This change in the epidemiology of OPSCC is attributed to a decrease in tobacco use and an increase in exposure to sexually transmitted oral HPV infections [1,2]. With the release of the 8th edition of the TNM classification of malignant tumors in 2017, HPV status is even given its own consideration in OPSCC [3]. Patients with an HPV-associated OPSCC have a better prognosis than patients with classic risk factors and an HPV-negative (−) OPSCC [4]. Compared with HPV− OPSCC patients, HPV-positive (+) OPSCC patients have significantly higher overall survival (OS) and have a mean 30% higher 5-year overall survival (5-OS) [5]. Accordingly, HPV+ OPSCC patients may benefit from de-escalation of treatment. According to recent evidence, bimodal diagnostics (HPV-DNA and p16 expression) are recommended to detect HPV association [6].
According to the Robert Koch Institute (RKI), 9834 men and 4375 women were diagnosed with oral cavity and oropharyngeal carcinomas (C00–C14) in Germany in 2018, based on the International Classification of Diseases for Oncology, 10th revision, German modification (ICD-10-GM) [7]. Male patients are about twice as likely as female patients to develop HNSCC. In addition, female patients have a better 5-year OS rate than male patients. In male patients, incidence rates of HNSCC are declining. In contrast, incidence rates in female patients have remained constant, and in some cases have increased slightly [8]. In Germany, the proportion of HPV+ OPSCC cases is estimated to be between 40% and 50%, which is in line with the general trend in Europe [9,10]. In the UK, the prevalence of HPV+ OPSCC is about 51.8% [11]. In Denmark, HPV+ prevalence is approximately 55%. In a retrospective semi-national registry study in Denmark, a threefold increase in HPV+ OPSCC was observed between 2000 and 2017 [12]. The proportion of HPV+ OPSCC cases in Italy increased from 16.7% in 2000–2006 to 46.1% in 2013–2018 [13]. The highest HPV+ prevalence of OPSCC is reported in the United States, with approximately 70% [14,15]. In addition, the incidence of HPV-related oropharyngeal cancer in the United States differed by age and race. Older white men had the highest incidence rate, increasing to more than 18 per 100,000 in 2015, compared with incidence rates of 6 and 4 per 100,000 for Hispanic and Black men, respectively [16].
In different German studies, the prevalence of HPV+ HNSCC varied from 21% to 53% between 2000 and 2015, and from 38% to 71% between 2004 and 2013 [9,17,18]. The differences in incidence trends result from the retrospective, hospital-based nature of the studies. The calculation of incidence was not based on population-based data, but on data from tumor registries. In addition, prior to the publication of the 8th edition of the TNM classification in 2017, HPV status was not or insufficiently recorded by tumor registries. In previous population-based studies in Germany, HPV+ OPSCC patients showed a 5-year OS of about 80%, whereas the 5-year OS of HPV− OPSCC was only 40–50% [9,18].
To investigate the current impact of HPV association and its incidence, a population-based analysis of cancer registry data of all patients treated for primary OPSCC from 2018 to 2020 was performed. The aim of this retrospective study was to determine the impact of HPV association on patient and tumor characteristics of OPSCC. In addition, the influence of HPV association, considering patient and tumor characteristics, on the OS of OPSCC patients were analyzed.

2. Methods

2.1. Patients

This population-based, retrospective study was conducted using patient data from the five Thuringian cancer registries (Gera, Erfurt, Nordhausen, Suhl, and Jena). Thuringia is a state in the Federal Republic of Germany and has a population about 2.1 million people. All patients diagnosed with primary OPSCC from January 2018 to December 2020 were included. A total of 498 new cases of primary OPSCC were included. Pathological stages of the primary tumor were recorded using the UICC classification and TNM classification (7th edition) [19]. The standard data set of the cancer registries was used. This data set included patients’ characteristics, tumor characteristics including HPV data, the tumor classification as well as uniform data on the treatment. The HPV test material was derived from the primary tumors. Diagnostics were performed by polymerase chain reaction (PCR) and chip hybridization or by immunohistochemical detection of p16 [20]. To cross-check the validity of the HPV data and to collect additional data on smoking habits and alcohol consumption (both not assessed on the cancer registries), the individual data sets of the five cancer registries were deblinded within each of the centers. Then, a crosscheck with each patient chart could be performed, i.e., a data linkage between the cancer registry data (population-based data) and the patient chart in the treating hospital (hospital-based data) could be performed. After this process, the complete data set was re-anonymized and evaluated.

2.2. Statistical Analysis

SPSS Statistics version 29.0 (IBM Deutschland GmbH, 71139 Ehningen, Germany) was used to perform the statistical analyses. Epidemiological measures were calculated from absolute case numbers and data from the Thuringian State Office of Statistics (https://www.statistik.thueringen.de/; accesses on 30 March 2023) on the population of Thuringia during the observation period. Frequency analyses and cross-tabulations were performed. Furthermore, the chi-square test was performed to analyze ordinal and nominal data. Binary logistic regression analyses were performed to examine the association of HPV status with patients’ characteristics, tumor characteristics and treatment characteristics. Results for independent factors are reported as odds ratios (OR) with 95% confidence intervals (CI) and a significance level of p < 0.05. For analysis of survival time data, significant factors from univariate analysis were included in multivariate analyses using Cox proportional hazard ratio (HR) with corresponding 95% CI. Kaplan–Meier calculations were performed to estimate the impact of the variables on OS. The significance level was set to p < 0.05.

2.3. Ethical Considerations

The Ethics Committee of the Jena University Hospital approved the retrospective study (IRB No. 2018-1075-Material; 2022-2526-BO). Informed consent of the patients was waived, as this study had a non-interventional retrospective design, and all data were analyzed anonymously.

3. Results

3.1. Patients’ Characteristics and Tumor Characteristics

The distribution of patient and tumor characteristics of oropharyngeal carcinomas in Thuringia in the period 2018–2020 is shown in Table 1. A total of 498 patients were included in the study. Of those, 383 (76.9%) were male and 115 (23.1%) were female patients. The mean age was 62.5 ± 9.4 years at the time of diagnosis (median: 61 years). The most common sub-localization of OPSCC was in the tonsil (43.8%). Most patients (288 patients; 57.8%) were HPV−. About one third of patients (186 patients; 37.3%) were HPV+. The proportion of smokers was 51.4% (256). Further relationships between HPV status and smoking habits are shown in Figure 1. The proportion of patients who regularly consumed alcohol was 34.9%. Most patients were in the highest UICC tumor stage, stage IV (40.4%). According to the T classification, most patients were classified as stage T4 (145 patients; 29.3%). At the time of diagnosis, no lymph node involvement (N0) was detected in 131 patients (26.5%). An N1 stage was assigned to 91 patients (18.4%). Most patients were classified as stage N2 (205 patients, 41.4%). Most patients (455 patients; 91.9%) had no distant metastases (M0) at the time of diagnosis. Many patients (254 patients; 51%) were graded as type G2 (moderately differentiated) for tumor grading, and less than one-third (143 patients; 28.7%) were graded as G3 (poorly differentiated). Radiotherapy was the most common treatment modality used (385 patients, 77.3%). Surgical therapy was used in half of the cases (276 patients, 55.4%). Immunotherapy was used in only 89 patients (17.9%).

3.2. Associations of HPV Status with Patient and Tumor Characteristics

The correlations between an HPV association and patient and tumor characteristics are shown in Table 2. There was no significant association with age, alcohol drinking, recurrence, radiotherapy, and chemotherapy (all p > 0.5). In contrast, gender, smoking status, localization, T classification, N classification, M classification, UICC stage, grading, surgery, and immunotherapy showed a significant correlation with HPV status (all p < 0.5). Thus, male patients (80.2%) and patients with smoking habits (63.5%) were predominantly HPV−. Patients with the sub-localization oropharynx without any specification (27.8%) and soft palate (12.5%) were predominantly HPV−. Regarding tumor characteristics, patients with T3 (25.35%) and T4 (34.72%) classification, N2 (41.67%) and N3 (15.97%) classification and M1 (11.81%) classification were also predominantly HPV−. Patients treated surgically (50.0%) or not receiving immunotherapy (77.1%) were also predominantly HPV−. Patients with moderately differentiated carcinomas (G2 grading) were predominantly HPV− (56.94%).

3.3. Binary Logistic Regression of HPV Status to Patient and Tumor Characteristics

The odds ratio (OR) and 95% CI for HPV-negative association are shown in Table 3. Model 1 grouped patient, staging and treatment characteristics, whereas in model 2, treatment characteristics were excluded. Smokers showed a 4.5-fold increased OR of being tested HPV− than nonsmokers (OR: 4.5; 95% CI: 2.76–7.35; p < 0.001). The sub-localizations soft palate and oropharynx without any specification were associated with a higher risk of being HPV− than tonsils (soft palate: OR: 5.5; 95% CI: 1.71–17.77, p = 0.004; oropharynx without any specification: OR: 2.2; 95% CI: 1.20–4.20, p = 0.012). Patients with metastases were 6.1 times more likely to be tested HPV-negative than patients without metastases (OR: 6.1; 95% CI: 1.30–28.97; p = 0.022). With additional consideration for cancer staging and treatment characteristics in model 3, cancer staging III and IV were also associated with a higher risk of being HPV− (stage III: OR: 5.4; 95% CI: 2.60–11.31, p < 0.001; stage IV: OR: 274.3; 95% CI: 85.77–877.34, p < 0.001). Patients who underwent surgical treatment were 2.4 times more likely to test negative for HPV (OR: 2.4; 95% CI: 1.23–4.57; p = 0.010). Gender, T classification, N classification, grading and immunotherapy showed no significance.

3.4. Influence of HPV Status and Other Factors on Overall Survival

The median follow-up of all patients was 20 months. A total of 106 patients (21.3%) died during the observation period. For the 392 patients alive, the median follow-up was 24 months (Supplementary Table S1). OS was worse in patients without HPV association (HPV−: 2-year OS: 73.6%, mean survival of 36.3 months; 95% confidence interval (CI): 33.65–38.94) than in patients with HPV association (HPV+: 2-year OS: 90.9%, mean survival of 47.18 months; 95% CI: 45.07–48.29; p < 0.001; Supplementary Table S2). Kaplan–Meier calculations according to gender, cancer staging, HPV status, smoking status and alcohol drinking habits are shown in Figure 2. The 2-year survival rate was 77.8% for male patients and 86.1% for female patients (p < 0.040). Smoking and alcohol abuse were correlated with significantly lower OS (2-year OS = 75.39% smokers and 85.1% non-smokers; 2-year OS = 75.3% alcoholics and 83.5% non-alcoholics). The extent of T classification had a significant effect on OS (p < 0.001). The 2-year survival rate was 88.2% for T1 and 86.7% for T2. In contrast, the 2-year survival rates for T3 and T4 were 78.5% and 70.3%, respectively. Lymph node involvement also had a significant impact on overall survival (2-year OS: N0 = 87.8%; N1 = 86.8%; N2 = 75.6%; N3 = 67.7%; p < 0.001). The development of distant metastases (M) significantly affected survival (p < 0.001). There was significantly lower OS in patients with advanced cancer staging (p = 0.001). UICC stage I patients had a 2-year survival rate of 96.3%, and stage II patients, 90.9%. In contrast, locally advanced stage III and IV patients had a rate of 83.9% and 67.5%, respectively.

3.5. Multivariable Analysis of Factors Influencing Overall Survival

Table 4 shows the multivariable analysis for patient, staging and treatment characteristics. Several patient and staging characteristics were grouped in model 1, and staging and treatment characteristics were grouped in model 2. HPV− patients had a significantly higher mortality rate (hazard ratio (HR) = 4.5; 95% CI: 2.36–8.59; p < 0.001). Gender, age, nicotine and alcohol habits and T and M classification had no significant effect on overall survival (all p > 0.005). In model 1 and model 2, higher N classification correlated with a significantly higher mortality rate (model 2: N2: HR = 3.3; 95% CI: 1.71–6.20; p < 0.001; N3: HR = 3.6; 95% CI: 1.75–7.31; p < 0.001). With additional consideration for cancer staging in model 3, patients with cancer staging III and IV had significantly worse survival (III: HR = 5.7; 95% CI: 1.82–17.56; p = 0.003; IV: HR = 19.3; 95% CI: 6.52–57.32; p < 0.001). Patients who did not receive any kind of treatment (primary surgery, radiation, or chemotherapy) had an increased risk of death. Patients without primary surgery had 2.5 times greater risk of death than patients with primary surgery (HR = 2.5; 95% CI: 1.54–3.92; p < 0.001) and without radiation had a 5.6-fold higher risk of death than patients treated with radiation (HR = 5.6; 95% CI: 3.18–9.74; p < 0.001). Patients without chemotherapy had a 1.7-fold greater risk of dying (HR = 1.7; 95% CI: 1.05–2.97; p = 0.033) than patients with chemotherapy.

3.6. Incidence of OPSCC

On 31 December 2018, 2,143,145 people lived in Thuringia. On 31 December 2019 and 2020, 2,133,378 and 2,120,237 people lived in Thuringia, respectively. The crude incidence rate for patients with OPSCC in Thuringia was 7.56 in 2018, 8.25 in 2019 and 7.55 in 2020 per 100,000 population (Table 5 and Figure 3). The incidence of OPSCC in male patients (2018: 11.88; 2019: 12.78; 2020: 11.63 per 100,000 population) was higher than that in female patients (2018: 3.33; 2019: 3.81; 2020: 3.55 per 100,000 population). Accordingly, HPV+ and HPV− incidence was also higher in men than in women. The incidence among smokers was higher in all years (2018: 3.92; 2019: 4.27; 2020: 3.82 per 100,000 population) than among nonsmokers (2018: 3.08; 2019: 3.75; 2020: 3.25 per 100,000 population). The incidence among smokers with HPV+ was 0.56 in 2018, 1.03 in 2019 and 1.13 in 2020 per 100,000 population. In comparison, the incidence among non-smoking patients with HPV+ was higher than that among smokers with HPV+ (1.87 in 2018, 1.83 in 2019 and 1.84 in 2020 per 100,000 population). HPV− smokers had the highest incidence rate (2.99 in 2018, 3.14 in 2019 and 2.45 in 2020 per 100,000 population). Regarding alcohol drinking, the incidence rate among patients that consumed alcohol was lower in all years (2018: 2.47; 2019: 2.53; 2020: 3.16 per 100,000 population) than that in non-alcoholics (2018: 4.34; 2019: 5.39; 2020: 3.87 per 100,000 population).

4. Discussion

HPV association indicates a better prognosis in OPSCC compared to patients with the classical risk factors and an HPV− tumor. However, the results of our population-based study showed that HPV− status was dominant and had the greatest impact on OS here. In contrast to the Anglo-Saxon countries, the proportion of classical risk factors, especially smoking, remains very high in Germany for HNC [21]. Therefore, consideration of the association of HPV status and smoking status in a population-based analysis is very important. The results of binary logistic regression analysis showed that smoking, M1 classification, and higher cancer staging were associated with a higher chance of being HPV−. HPV− patients were more frequently treated with primary surgery. There was no significant association with age, alcohol drinking, recurrence, or decision to use radiation and chemotherapy. In multivariate analysis, negative, significantly associated factors for OS were HPV−, higher N classification (N2/3), M1 classification, higher cancer staging (UICC III/IV), and no treatment (primary surgery, radiation, and chemotherapy). Wagner et al. reported a similar finding in their population-based study in another federal state in Germany [22]. Wagner et al. showed that HPV status, tobacco smoking, T and N classification and age were significant predictors of OS in univariate analysis, and except for smoking in multivariate analysis. According to Wagner et al., HPV status was more important for OS in OPSSC than smoking. These results are consistent with our findings. Gillison et al. indicated that there is an association between HPV− and nicotine and alcohol abuse [5,15]. These findings are consistent with Yin et al., who reported an association between lower OS in HPV− OPSCC and smoking, but the association between smoking and lower OS in HPV− OPSCC was not statistically significant (p = 0.14) [23]. Alcohol consumption, on the other hand, showed no significant correlation with HPV status in our study. In the literature, however, alcohol consumption and HPV+ status are synergistically associated with OPSCC [24,25].
Accordingly, the risk factor HPV had a higher influence on the mortality risk of the Thuringian patients than the classical risk factor nicotine consumption. Nevertheless, the proportion of smoking patients in this population should be noted, as it was slightly more than half (51.4%). In other countries, the prevalence of smoking has been significantly reduced through tobacco control programs [26,27]. In the literature, there is a considerable discussion regarding de-escalation strategies for HPV+ OPSCC [28,29,30]. However, our results indicate that HPV− status has the greatest impact on patient OS, and treatment optimization of HPV− OPSCC should be considered in further studies.
The proportion of tonsil cancer to OPSCC was greatest in this study and was associated with HPV+ status. A Swedish study by Nasman et al. reported a rising incidence of tonsillar squamous cell carcinoma that was also associated with HPV+ status [31].
As in many other studies, HPV+ patients showed significantly better OS than HPV− patients in the present study. A comparison of mean OS time highlights the better prognosis in HPV+ patients.
The incidence of HPV+ OPSCC in this population-based study was 2.61 per 100,000 population with a proportion of 37.3% HPV+ OPSCC. In contrast, a previous study from the same population showed a much lower proportion of HPV+ OPSCC (17.2%) with an incidence of 1.89 per 100,000 population. Population-based data are sparse. The population-based studies by Wagner et al. and Wittekindt et al. reported a lower proportion of HPV+ OPSCC in another federal state in Germany (20.6% and 27.1%, respectively) [9,22]. In contrast, European comparisons showed significantly higher proportions of HPV+ OPSCC cases. In the UK, the prevalence of HPV+ OPSCC cases between 2002 and 2011 was 51.8%, in Denmark, HPV+ OPSCC accounted for approximately 55% of all cases between 2000 and 2017, and in Italy HPV+ OPSCC cases increased from 16.7% in 2000–2006 to 46.1% in 2013–2018 [11,12,13]. In their retrospective analysis of 730 OPSCC patients, Wittekindt et al. recorded an increase in the incidence of OPSCC for the period 1999–2014, from 6.2 to about 6.8 per 100,000 population [9]. The Danish study showed an age-adjusted increase in the incidence of OPSCC, from 1.8 in 2000 to 5.1 in 2017 per 100,000 population [12]. This is consistent with the age-adjusted incidence of OPSCC across Germany (2018: 5.1 and 2019: 5.0 per 100,000 population).
In a study of the same federal state during a treatment period from 1996 to 2016, Dittberner et al. reported an increase in the incidence of OPSCC patients with HPV-independent HNSCC (crude incidence rate: 15.98 per 100,000 population). HPV status was not examined, but the incidence increase was attributed to the possibility of increased HPV prevalence in OPSCC [32].
The present study was limited by its retrospective character and the only 24 months of follow-up. Pre-existing conditions and comorbidities could not be considered in more detail, as they are only partially recorded in the cancer registry. In addition, the coding for the sub-localization oropharynx without any specification might be inaccurate. Whether the tumor has spread over one region or over several localizations was unknown. Furthermore, the exact amount of nicotine and alcohol consumption was unknown. Data on existing nicotine and alcohol consumption were not sufficient. An exact indication of the amount of nicotine consumption in pack years and alcohol consumption could be more relevant. One advantage of the study is the uniform detection method for HPV association since the introduction of the TNM classification in the 8th edition of 2017. Since the vast majority of patients with OPSCC were HPV−, better treatment strategies are needed for this population. This is more important than a discussion of de-escalation strategies for HPV+ patients. And although nicotine use did not show a significant impact on OS in multivariable analyses, anti-smoking education campaigns continue to be very important. More epidemiologic studies of HPV-associated OPSCC with larger populations over a longer study period are needed to show the incidence trend.

5. Conclusions

This retrospective, population-based study from 2018 to 2020 in Thuringia describes the dominance of HPV− status in OPSCC. According to this study, HPV+ OPSCC patients were a minority in Thuringia. Smokers, patients with an OPSCC without any specification and soft palate, M1 classification and UICC stage III/IV had a higher chance of being HPV−. In multivariable analysis, HPV− status, N2/3 classification, and higher cancer staging were associated with lower OS. Classical risk factors continue to dominate and have the greatest impact on OS. Therefore, better therapeutic strategies for HPV− OPSCC patients should be developed for this population. Optimizing therapeutic strategies due to the dominance of HPV− status is more important than discussing de-escalation strategies for HPV+ OPSCC patients.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/cancers15215259/s1, Table S1. Distribution of head and neck cancer patients according to clinical and demographic parameters; Table S2. Univariable analyses on predictors for overall survival.

Author Contributions

Conceptualization, O.G.-L. and T.E.; methodology, O.G.-L. and T.E.; formal analysis, L.G., M.K. and O.G.-L.; investigation, all authors; resources, all authors; writing—original draft preparation, O.G.-L. and M.K.; writing—review and editing, all authors; visualization, O.G.-L. and M.K. All authors have read and agreed to the published version of the manuscript.

Funding

We acknowledge support by the German Research Foundation Projekt-Nr. 512648189 and the Open Access Publication Fund of the Thueringer Universitaets- und Landesbibliothek Jena.

Institutional Review Board Statement

The Ethics Committee of the Jena University Hospital approved the retrospective study (IRB No. 2018-1075-Material; 2022-2526-BO).

Informed Consent Statement

Patient consent was waived, as the authors used anonymized data supplied by the Zentrales klinisches Krebsregister Thjüringen gGmnbH, Jena, Thuringia, Germany, based on the current legal situation (Thuringian Cancer Registry Act. [ThürKRG] §14 Abs. 1 Satz 1 ThürKRG).

Data Availability Statement

The datasets used during the current study are available from the corresponding author upon reasonable request.

Acknowledgments

We want to thank all departments and outpatient clinics that were involved in the treatment and data collection of the patients. We thank the coordinators of the five Thuringian cancer registries for their collaboration: Hubert Göbel (Erfurt), Uwe Funke (Gera), Ulrike Burger (Jena), Manuela Geist (Nordhausen) and Matthias Wackes (Suhl).

Conflicts of Interest

The authors declare no conflict of interest. The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

References

  1. Marur, S.; D’Souza, G.; Westra, W.H.; Forastiere, A.A. HPV-associated head and neck cancer: A virus-related cancer epidemic. Lancet Oncol. 2010, 11, 781–789. [Google Scholar] [CrossRef] [PubMed]
  2. Pytynia, K.B.; Dahlstrom, K.R.; Sturgis, E.M. Epidemiology of HPV-associated oropharyngeal cancer. Oral. Oncol. 2014, 50, 380–386. [Google Scholar] [CrossRef] [PubMed]
  3. Huang, S.H.; O’Sullivan, B. Overview of the 8th Edition TNM Classification for Head and Neck Cancer. Curr. Treat Options Oncol. 2017, 18, 40. [Google Scholar] [CrossRef] [PubMed]
  4. Ragin, C.C.; Taioli, E. Survival of squamous cell carcinoma of the head and neck in relation to human papillomavirus infection: Review and meta-analysis. Int. J. Cancer 2007, 121, 1813–1820. [Google Scholar] [CrossRef]
  5. Fakhry, C.; Westra, W.H.; Li, S.; Cmelak, A.; Ridge, J.A.; Pinto, H.; Forastiere, A.; Gillison, M.L. Improved survival of patients with human papillomavirus-positive head and neck squamous cell carcinoma in a prospective clinical trial. J. Natl. Cancer Inst. 2008, 100, 261–269. [Google Scholar] [CrossRef]
  6. Machczyński, P.; Majchrzak, E.; Niewinski, P.; Marchlewska, J.; Golusiński, W. A review of the 8th edition of the AJCC staging system for oropharyngeal cancer according to HPV status. Eur. Arch. Otorhinolaryngol. 2020, 277, 2407–2412. [Google Scholar] [CrossRef]
  7. Zentrum für Krebsregisterdaten im Robert Koch-Institut. Datenbankabfrage mit Schätzung der Inzidenz, Prävalenz und des Überlebens von Krebs in Deutschland auf Basis der Epidemiologischen Landeskrebsregisterdaten. Available online: www.krebsdaten.de/abfrage (accessed on 9 August 2023).
  8. Wienecke, A.; Kraywinkel, K. Epidemiologie von Kopf-Hals-Tumoren in Deutschland. Der Onkol. 2019, 25, 190–200. [Google Scholar] [CrossRef]
  9. Wittekindt, C.; Wagner, S.; Bushnak, A.; Prigge, E.S.; von Knebel Doeberitz, M.; Würdemann, N.; Bernhardt, K.; Pons-Kühnemann, J.; Maulbecker-Armstrong, C.; Klussmann, J.P. Increasing Incidence rates of Oropharyngeal Squamous Cell Carcinoma in Germany and Significance of Disease Burden Attributed to Human Papillomavirus. Cancer Prev. Res. 2019, 12, 375–382. [Google Scholar] [CrossRef]
  10. Quabius, E.S.; Haag, J.; Kuhnel, A.; Henry, H.; Hoffmann, A.S.; Gorogh, T.; Hedderich, J.; Evert, M.; Beule, A.G.; Maune, S.; et al. Geographical and anatomical influences on human papillomavirus prevalence diversity in head and neck squamous cell carcinoma in Germany. Int. J. Oncol. 2015, 46, 414–422. [Google Scholar] [CrossRef]
  11. Schache, A.G.; Powell, N.G.; Cuschieri, K.S.; Robinson, M.; Leary, S.; Mehanna, H.; Rapozo, D.; Long, A.; Cubie, H.; Junor, E.; et al. HPV-Related Oropharynx Cancer in the United Kingdom: An Evolution in the Understanding of Disease Etiology. Cancer Res. 2016, 76, 6598–6606. [Google Scholar] [CrossRef]
  12. Zamani, M.; Gronhoj, C.; Jensen, D.H.; Carlander, A.F.; Agander, T.; Kiss, K.; Olsen, C.; Baandrup, L.; Nielsen, F.C.; Andersen, E.; et al. The current epidemic of HPV-associated oropharyngeal cancer: An 18-year Danish population-based study with 2,169 patients. Eur. J. Cancer 2020, 134, 52–59. [Google Scholar] [CrossRef] [PubMed]
  13. Del Mistro, A.; Frayle, H.; Menegaldo, A.; Favaretto, N.; Gori, S.; Nicolai, P.; Spinato, G.; Romeo, S.; Tirelli, G.; da Mosto, M.C.; et al. Age-independent increasing prevalence of Human Papillomavirus-driven oropharyngeal carcinomas in North-East Italy. Sci. Rep. 2020, 10, 9320. [Google Scholar] [CrossRef] [PubMed]
  14. Senkomago, V.; Henley, S.J.; Thomas, C.C.; Mix, J.M.; Markowitz, L.E.; Saraiya, M. Human Papillomavirus-Attributable Cancers—United States, 2012–2016. MMWR Morb. Mortal Wkly. Rep. 2019, 68, 724–728. [Google Scholar] [CrossRef] [PubMed]
  15. Gillison, M.L.; Chaturvedi, A.K.; Anderson, W.F.; Fakhry, C. Epidemiology of Human Papillomavirus-Positive Head and Neck Squamous Cell Carcinoma. J. Clin. Oncol. 2015, 33, 3235–3242. [Google Scholar] [CrossRef]
  16. Tota, J.E.; Best, A.F.; Zumsteg, Z.S.; Gillison, M.L.; Rosenberg, P.S.; Chaturvedi, A.K. Evolution of the Oropharynx Cancer Epidemic in the United States: Moderation of Increasing Incidence in Younger Individuals and Shift in the Burden to Older Individuals. J. Clin. Oncol. 2019, 37, 1538–1546. [Google Scholar] [CrossRef]
  17. Tinhofer, I.; Jöhrens, K.; Keilholz, U.; Kaufmann, A.; Lehmann, A.; Weichert, W.; Stenzinger, A.; Stromberger, C.; Klinghammer, K.; Becker, E.T.; et al. Contribution of human papilloma virus to the incidence of squamous cell carcinoma of the head and neck in a European population with high smoking prevalence. Eur. J. Cancer 2015, 51, 514–521. [Google Scholar] [CrossRef] [PubMed]
  18. Kouka, M.; Landgraf, J.; Büntzel, J.; Kaftan, H.; Böger, D.; Mueller, A.; Schultze-Mosgau, S.; Ernst, T.; Guntinas-Lichius, O. Mortality risk for oral and oropharyngeal carcinomas in Thuringia: A population-based analysis. Laryngorhinootologie 2023, 102, 601–611. [Google Scholar] [CrossRef]
  19. Sobin, L.H.; Gospodarowicz, M.K.; Wittekind, C. TNM Classification of Malignant Tumours, 7th ed.; Wiley-Blackwell: Chichester, UK; Hoboken, NJ, USA, 2010. [Google Scholar]
  20. Glombitza, F.; Guntinas-Lichius, O.; Petersen, I. HPV status in head and neck tumors. Pathol. Res. Pract. 2010, 206, 229–234. [Google Scholar] [CrossRef]
  21. Kotz, D.; Bockmann, M.; Kastaun, S. The Use of Tobacco, E-Cigarettes, and Methods to Quit Smoking in Germany. Dtsch. Arztebl. Int. 2018, 115, 235–242. [Google Scholar] [CrossRef]
  22. Wagner, S.; Wittekindt, C.; Sharma, S.J.; Wuerdemann, N.; Jüttner, T.; Reuschenbach, M.; Prigge, E.S.; von Knebel Doeberitz, M.; Gattenlöhner, S.; Burkhardt, E.; et al. Human papillomavirus association is the most important predictor for surgically treated patients with oropharyngeal cancer. Br. J. Cancer 2017, 116, 1604–1611. [Google Scholar] [CrossRef]
  23. Yin, L.X.; D’Souza, G.; Westra, W.H.; Wang, S.J.; van Zante, A.; Zhang, Y.; Rettig, E.M.; Ryan, W.R.; Ha, P.K.; Wentz, A.; et al. Prognostic factors for human papillomavirus-positive and negative oropharyngeal carcinomas. Laryngoscope 2018, 128, E287–E295. [Google Scholar] [CrossRef] [PubMed]
  24. Kumar, R.; Rai, A.K.; Das, D.; Das, R.; Kumar, R.S.; Sarma, A.; Sharma, S.; Kataki, A.C.; Ramteke, A. Alcohol and Tobacco Increases Risk of High Risk HPV Infection in Head and Neck Cancer Patients: Study from North-East Region of India. PLoS ONE 2015, 10, e0140700. [Google Scholar] [CrossRef] [PubMed]
  25. Min, K.J.; Lee, J.K.; Lee, S.; Kim, M.K. Alcohol consumption and viral load are synergistically associated with CIN1. PLoS ONE 2013, 8, e72142. [Google Scholar] [CrossRef]
  26. Cole, L.; Polfus, L.; Peters, E.S. Examining the incidence of human papillomavirus-associated head and neck cancers by race and ethnicity in the U.S., 1995–2005. PLoS ONE 2012, 7, e32657. [Google Scholar] [CrossRef]
  27. Ma, C.; Xi, B.; Li, Z.; Wu, H.; Zhao, M.; Liang, Y.; Bovet, P. Prevalence and trends in tobacco use among adolescents aged 13-15 years in 143 countries, 1999-2018: Findings from the Global Youth Tobacco Surveys. Lancet Child. Adolesc. Health 2021, 5, 245–255. [Google Scholar] [CrossRef]
  28. Economopoulou, P.; Kotsantis, I.; Psyrri, A. De-Escalating Strategies in HPV-Associated Head and Neck Squamous Cell Carcinoma. Viruses 2021, 13, 1787. [Google Scholar] [CrossRef]
  29. Mensour, E.A.; Alam, S.; Mawani, S.; Bahig, H.; Lang, P.; Nichols, A.; Palma, D.A.; Jasper, K. What is the future of treatment de-escalation for HPV-positive oropharyngeal cancer? A review of ongoing clinical trials. Front. Oncol. 2022, 12, 1067321. [Google Scholar] [CrossRef] [PubMed]
  30. Mirghani, H.; Amen, F.; Blanchard, P.; Moreau, F.; Guigay, J.; Hartl, D.M.; Lacau St Guily, J. Treatment de-escalation in HPV-positive oropharyngeal carcinoma: Ongoing trials, critical issues and perspectives. Int. J. Cancer 2015, 136, 1494–1503. [Google Scholar] [CrossRef]
  31. Nasman, A.; Attner, P.; Hammarstedt, L.; Du, J.; Eriksson, M.; Giraud, G.; Ahrlund-Richter, S.; Marklund, L.; Romanitan, M.; Lindquist, D.; et al. Incidence of human papillomavirus (HPV) positive tonsillar carcinoma in Stockholm, Sweden: An epidemic of viral-induced carcinoma? Int. J. Cancer 2009, 125, 362–366. [Google Scholar] [CrossRef]
  32. Dittberner, A.; Friedl, B.; Wittig, A.; Buentzel, J.; Kaftan, H.; Boeger, D.; Mueller, A.H.; Schultze-Mosgau, S.; Schlattmann, P.; Ernst, T.; et al. Gender Disparities in Epidemiology, Treatment, and Outcome for Head and Neck Cancer in Germany: A Population-Based Long-Term Analysis from 1996 to 2016 of the Thuringian Cancer Registry. Cancers 2020, 12, 3418. [Google Scholar] [CrossRef]
Figure 1. Distribution of patients by HPV-positive (HPV+) and HPV-negative (HPV−) and smoking habits for 2018 (A), 2019 (B), and 2020 (C), and extra for the tonsil sub-localization (D).
Figure 1. Distribution of patients by HPV-positive (HPV+) and HPV-negative (HPV−) and smoking habits for 2018 (A), 2019 (B), and 2020 (C), and extra for the tonsil sub-localization (D).
Cancers 15 05259 g001
Figure 2. Kaplan–Meier curves of overall survival according to gender (A), cancer staging (B), HPV-positive (HPV+) and HPV-negative (HPV−) (C), smoking status (D) and alcohol drinking habits (E).
Figure 2. Kaplan–Meier curves of overall survival according to gender (A), cancer staging (B), HPV-positive (HPV+) and HPV-negative (HPV−) (C), smoking status (D) and alcohol drinking habits (E).
Cancers 15 05259 g002
Figure 3. Incidence of oropharyngeal cancer (OPSCC) in Thuringia per 100,000 population in the years 2018, 2019, and 2020 in relation to patient characteristics.
Figure 3. Incidence of oropharyngeal cancer (OPSCC) in Thuringia per 100,000 population in the years 2018, 2019, and 2020 in relation to patient characteristics.
Cancers 15 05259 g003
Table 1. Patients’ characteristics, histopathology, and treatment characteristics.
Table 1. Patients’ characteristics, histopathology, and treatment characteristics.
ParameterFrequency (N)%
Gender
Male38376.9
Female11523.1
Localization
Oropharynx without specification12224.5
Tonsil21843.8
Base of tongue11623.3
Soft palate428.4
HPV status (HPV-DNA or p16) *
HPV-positive18637.3
HPV-negative28857.8
Unknown244.8
Cigarette smoking
Yes25651.4
No21543.2
Unknown275.4
Alcohol drinking
Yes17434.9
No29058.2
Unknown346.8
Cancer staging
010.2
I8216.6
II8817.8
III9318.8
IV20040.4
Unknown316.3
T classification
Carcinoma in situ10.2
T19218.6
T212825.9
T312124.4
T414529.3
TX81.6
N classification
N013126.5
N19118.4
N220541.4
N36212.5
NX61.2
M classification
M045591.9
M1408.1
Recurrence
Yes6913.9
No27855.8
Unknown15130.3
Grading
G1173.4
G225451.0
G314328.7
Undifferentiated367.2
Unknown489.6
Treatment
Best supportive care (BSC)316.2
Surgery **27655.4
Radiation38577.3
Chemotherapy28958.0
Immunotherapy8917.9
Unknown51.0
Mean ± SDMedian, Range
Age in years62.45 ± 9.561, 33–95
** ± adjuvant therapy, HPV-DNA = human papillomavirus-deoxyribonucleic acid, which was detected by polymerase chain reaction (PCR), p16 = immunohistochemical evidence of p16INK4a expression, * in case of discrepancy, HPV-DNA was preferred over p16 status.
Table 2. Correlations between HPV status and patients’ characteristics, histopathology and treatment.
Table 2. Correlations between HPV status and patients’ characteristics, histopathology and treatment.
ParameterHPV-Positive, N = 186HPV-Negative, N = 288Total, N = 498p
N(%)N(%)N(%)
GenderMale13271.023180.236372.90.020
Female5429.05719.811122.3
Age, median≤61 years9048.415353.124348.80.314
>61 years9651.613546.923146.4
Cigarette smokingYes5831.218363.524148.4<0.001
No11863.49131.620942.0
Alcohol drinkingYes5730.610837.516533.10.106
No11863.416155.927956.0
LocalizationOropharynx without specification3317.78027.811322.7<0.001
Tonsil10757.510536.521242.6
Base of tongue4021.56723.310721.5
Soft palate63.23612.5428.4
T classificationT14624.734615.979218.47<0.001
T26233.336422.2212625.30
T33920.977325.3511222.49
T43518.8210034.7213527.11
N classificationN04624.738027.7812625.30<0.001
N15127.423612.508717.47
N27540.3212041.6719539.16
N3136.994615.975911.85
M classificationM018096.7725488.1943487.15<0.001
M152.693411.81397.83
Cancer stagingStage I6434.41186.258216.47<0.001
Stage II6534.95237.998817.67
Stage III4725.274615.979318.67
Stage IV52.6919567.7120040.16
Grading GG142.15134.51173.410.007
G27540.3216456.9423947.99
G35227.968730.2113927.91
Undifferentiated2010.75134.51336.63
Primary surgeryYes12868.814450.027254.60.001
No5831.213948.319739.6
RadiationYes15181.221976.037074.30.324
No3518.86422.29919.9
ChemotherapyYes11059.116456.927455.00.798
No7640.911941.319539.2
ImmunotherapyYes2312.46121.28416.90.011
No16387.622277.138577.3
RecurrenceYes2111.34616.06713.50.153
No16588.724284.040781.7
HPV = human papillomavirus; significant p-values (p < 0.05) in bold.
Table 3. Binary logistic regression models of associations with HPV-negative status.
Table 3. Binary logistic regression models of associations with HPV-negative status.
Parameter OR95% CIp
Model 1: Patient, staging and treatment characteristics
GenderFemale1Reference0.906
Male1.00.59–1.83
Cigarette smokingNo1Reference<0.001
Yes4.52.76–7.35
LocalizationTonsil1Reference
Base of tongue1.50.80–2.700.216
Oropharynx without specification2.21.20–4.200.012
Soft palate5.51.71–17.770.004
T classificationT11Reference
T20.70.39–1.540.462
T30.90.43–1.980.839
T41.00.45–2.420.931
N classificationN01Reference
N10.70.34–1.370.282
N21.00.53–1.760.895
N31.30.51–3.080.617
M classificationM01Reference0.022
M16.11.30–28.97
GradingG11Reference
G20.50.13–2.120.361
G30.50.12–2.080.341
Undifferentiated0.30.06–1.390.119
Primary surgeryYes1Reference
No1.60.9–2.90.145
ImmunotherapyNo1Reference
Yes1.20.64–2.380.534
Model 2: Patient and staging characteristics
GenderFemale1Reference0.919
Male1.00.59–1.81
Cigarette smokingNo1Reference<0.001
Yes4.22.61–6.87
LocalizationTonsil1Reference
Base of tongue1.50.83–2.760.178
Oropharynx without specification2.31.2–4.200.010
Soft palate5.51.71–17.690.004
T classificationT11Reference
T20.80.41–1.630.570
T31.10.52–2.240.840
T41.40.68–3.050.335
N classificationN01Reference
N10.60.31–1.260.188
N21.00.54–1.760.938
N31.30.56–3.250.513
M classificationM01Reference0.015
M16.81.45–31.73
GradingG11Reference
G20.60.14–2.140.386
G30.50.13–2.040.342
Undifferentiated0.30.06–1.370.116
Model 3: Staging and treatment characteristics
Cancer stagingI1Reference
II1.50.72–3.120.280
III5.42.60–11.31<0.001
IV274.385.77–877.34<0.001
Primary surgeryNo1Reference0.010
Yes2.41.23–4.57
ImmunotherapyYes1Reference0.466
No1.40.60–3.02
OR—Odds ratio; CI—Confidence interval; significant p-values (p < 0.05) in bold.
Table 4. Multivariable Cox regression analysis for associations with lower overall survival.
Table 4. Multivariable Cox regression analysis for associations with lower overall survival.
Parameter HR95% CIp
Model 1: Patient and staging characteristics
GenderFemale1Reference0.803
Male1.10.58–2.02
Age≤61 years1Reference0.064
>61 years1.60.98–2.47
Cigarette smokingNo1Reference0.748
Yes1.10.65–1.83
Alcohol drinkingNo1Reference0.168
Yes1.40.87–2.27
HPV statusHPV+1Reference<0.001
HPV−4.52.36–8.59
T classificationT11Reference
T21.00.46–2.070.953
T31.10.52–2.320.817
T41.90.93–3.790.078
N classificationN01Reference
N11.30.61–2.950.467
N22.01.11–3.760.022
N33.21.57–6.570.001
M classificationM01Reference0.909
M11.00.52–2.10
Model 2: Staging and treatment characteristics I
T classificationT11Reference
T21.10.50–2.210.898
T31.60.77–3.500.205
T42.10.96–4.740.063
N classificationN01Reference
N11.70.80–3.710.168
N23.31.71–6.20<0.001
N33.61.75–7.31<0.001
M classificationM01Reference0.093
M11.70.92–3.05
Primary surgeryYes1Reference0.007
No2.21.24–3.81
RadiationYes1Reference<0.001
No4.02.31–6.75
ChemotherapyYes1Reference0.009
No1.91.18–3.14
Model 3: Staging and treatment characteristics II
Cancer stagingI1Reference
II2.70.81–9.100.104
III5.71.82–17.560.003
IV19.36.52–57.32<0.001
Primary surgeryYes1Reference
No2.51.54–3.92<0.001
RadiationYes1Reference
No5.63.18–9.74<0.001
ChemotherapyYes1Reference0.033
No1.71.05–2.97
Significant p-values (p < 0.05) in bold.
Table 5. Incidence of oropharyngeal carcinoma (OPSCC) in Thuringia from 2018 to 2020.
Table 5. Incidence of oropharyngeal carcinoma (OPSCC) in Thuringia from 2018 to 2020.
201820192020
NIncidence/
100.000
NIncidence/
100.000
NIncidence/
100.000
OPSCC1627.561768.251607.55
HPV+562.61643.00663.11
HPV−954.431075.02864.06
Male12611.8813512.7812211.63
HPV+353.30494.64484.57
HPV−827.73837.86666.29
Female363.33413.81383.55
HPV+211.94151.39181.68
HPV−131.20242.22201.87
Cigarette smoking843.92914.27813.82
HPV+120.56221.03241.13
HPV−642.99673.14522.45
Non-smoking663.08803.75693.25
HPV+401.87391.83391.84
HPV−241.12391.83281.32
Age≤Median 61 years823.83974.55783.68
>Median 61 years803.73793.70823.87
Alcohol drinkingYes532.47542.53673.16
No934.341155.39823.87
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kouka, M.; Gerlach, L.; Büntzel, J.; Kaftan, H.; Böger, D.; Müller, A.H.; Ernst, T.; Guntinas-Lichius, O. Impact of Human Papillomavirus-Negative Dominance in Oropharyngeal Cancer on Overall Survival: A Population-Based Analysis in Germany from 2018 to 2020. Cancers 2023, 15, 5259. https://doi.org/10.3390/cancers15215259

AMA Style

Kouka M, Gerlach L, Büntzel J, Kaftan H, Böger D, Müller AH, Ernst T, Guntinas-Lichius O. Impact of Human Papillomavirus-Negative Dominance in Oropharyngeal Cancer on Overall Survival: A Population-Based Analysis in Germany from 2018 to 2020. Cancers. 2023; 15(21):5259. https://doi.org/10.3390/cancers15215259

Chicago/Turabian Style

Kouka, Mussab, Laura Gerlach, Jens Büntzel, Holger Kaftan, Daniel Böger, Andreas H. Müller, Thomas Ernst, and Orlando Guntinas-Lichius. 2023. "Impact of Human Papillomavirus-Negative Dominance in Oropharyngeal Cancer on Overall Survival: A Population-Based Analysis in Germany from 2018 to 2020" Cancers 15, no. 21: 5259. https://doi.org/10.3390/cancers15215259

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop