Next Article in Journal
Cardiotoxicity, Cardioprotection, and Prognosis in Survivors of Anticancer Treatment Undergoing Cardiac Surgery: Unmet Needs
Next Article in Special Issue
PET/CT in Patients with Breast Cancer Treated with Immunotherapy
Previous Article in Journal
The Emerging Role of Histone Deacetylase Inhibitors in Cervical Cancer Therapy
Previous Article in Special Issue
FDG-PET/CT in the Monitoring of Lymphoma Immunotherapy Response: Current Status and Future Prospects
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Total Metabolic Tumor Volume on 18F-FDG PET/CT Is a Useful Prognostic Biomarker for Patients with Extensive Small-Cell Lung Cancer Undergoing First-Line Chemo-Immunotherapy

by
Julia Grambow-Velilla
1,2,†,
Romain-David Seban
3,4,*,†,
Kader Chouahnia
5,
Jean-Baptiste Assié
6,
Laurence Champion
3,4,
Nicolas Girard
7,8,
Gerald Bonardel
9,
Lise Matton
5,
Michael Soussan
1,
Christos Chouaïd
10 and
Boris Duchemann
5,11
1
Department of Nuclear Medicine, AP-HP, Avicenne University Hospital, 93000 Bobigny, France
2
Department of Nuclear Medicine, AP-HP, European Hospital Georges-Pompidou, University of Paris, 75015 Paris, France
3
Department of Nuclear Medicine, Institut Curie, 92210 Saint-Cloud, France
4
Laboratoire d’Imagerie Translationnelle en Oncologie, Inserm, Institut Curie, 91401 Orsay, France
5
Department of Medical Thoracic and Medical Oncology, AP-HP, Avicenne University Hospital, 93000 Bobigny, France
6
Unité de Pneumologie, CHU Henri Mondor, UPEC, 94000 Créteil, France
7
Institut du Thorax Curie Montsouris, Institut Curie, 75005 Paris, France
8
Paris Saclay, UVSQ, UFR Simone Veil, 78180 Versailles, France
9
Nuclear Medicine, Centre Cardiologique du Nord, 93200 Saint-Denis, France
10
Department of Pneumology, Centre Hospitalier Inter-Communal de Créteil, Paris-Est University, 94010 Créteil, France
11
Inserm UMR 1272 “Hypoxie et Poumon”, UFR SMBH Léonard de Vinci, Université Sorbonne Paris Nord, 93000 Bobigny, France
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Cancers 2023, 15(8), 2223; https://doi.org/10.3390/cancers15082223
Submission received: 2 March 2023 / Revised: 25 March 2023 / Accepted: 6 April 2023 / Published: 10 April 2023
(This article belongs to the Special Issue PET/CT in Tumor Immunotherapy Assessment)

Abstract

:

Simple Summary

Chemotherapy with immune checkpoint inhibitors is the new standard of care for first-line systemic therapy in extensive small-cell lung cancer. The identification of biomarkers for patients that are likely or not likely to respond to such therapy is critical. We aimed at determining whether imaging could help to predict outcomes among these patients. We showed that the total metabolic tumor burden, extracted from pre-treatment 18-FDG PET/CT imaging, may be a useful biomarker associated with survival. Finally, we think that this result should be taken into account in clinical trials, and that it might need further validation through large, independent, and prospective cohorts.

Abstract

Background: We aimed to evaluate the prognostic value of imaging biomarkers on 18F-FDG PET/CT in extensive-stage small-cell lung cancer (ES-SCLC) patients undergoing first-line chemo-immunotherapy. Methods: In this multicenter and retrospective study, we considered two cohorts, depending on the type of first-line therapy: chemo-immunotherapy (CIT) versus chemotherapy alone (CT). All patients underwent baseline 18-FDG PET/CT before therapy between June 2016 and September 2021. We evaluated clinical, biological, and PET parameters, and used cutoffs from previously published studies or predictiveness curves to assess the association with progression-free survival (PFS) or overall survival (OS) with Cox prediction models. Results: Sixty-eight patients were included (CIT: CT) (36: 32 patients). The median PFS was 5.9:6.5 months, while the median OS was 12.1:9.8 months. dNLR (the derived neutrophils/(leucocytes-neutrophils) ratio) was an independent predictor of short PFS and OS in the two cohorts (p < 0.05). High total metabolic tumor volume (TMTVhigh if > 241 cm3) correlated with outcomes, but only in the CIT cohort (PFS for TMTVhigh in multivariable analysis: HR 2.5; 95%CI 1.1–5.9). Conclusion: Baseline 18F-FDG PET/CT using TMTV could help to predict worse outcomes for ES-SCLC patients undergoing first-line CIT. This suggests that baseline TMTV may be used to identify patients that are unlikely to benefit from CIT.

1. Introduction

At diagnosis, on average, two-thirds of patients with small-cell lung cancer (SCLC) have extensive-stage (ES) disease. The prognosis is very poor, with a 5-year survival rate of 7% [1]. Despite initial high response rates with chemotherapy, the majority of patients relapse rapidly [2]. Recently, immune checkpoint inhibitors (ICIs) have demonstrated improved survival and antitumoral responses in patients with ES-SCLC. Consequently, atezolizumab or durvalumab, both program-death ligand 1 (PD-L1) inhibitors, in association with platinum-etoposide chemotherapy, became the new standard of care for first-line ES-SCLC patients [3,4,5].
Only a few ES-SCLC patients experience a long-term benefit under ICI, and it is much more difficult to predict this benefit at an individual level in comparison with metastatic non-small cell lung cancer patients. To date, there are no useful predictive biomarkers to select the subgroup of patients that might benefit from immunotherapy in the long term. Therefore, the identification of biomarkers for patients that are likely to respond to ICI therapy is critical, and might be a relevant step in enhancing the standard of care for ES-SCLC patients [6].
In the era of immunotherapy and personalized medicine,18F-FDG PET/CT is a functional molecular imaging modality used to assess several aspects of the disease status of oncological patients, including disease staging, prognosis, and response to therapy [7]. Among the metabolic parameters extracted from 18F-FDG PET/CT, the total metabolic tumor volume (TMTV), reflecting the tumor burden (TB), has been shown to be a prognostic factor for overall survival (OS) and progression-free survival (PFS) in patients treated with chemotherapy in several metastatic malignancies, especially in lung cancer [8,9].
Recent evidence has also suggested that a high TB harms anticancer immunity; hence, a high metabolic tumor volume in patients treated with ICI was also shown as a significant prognostic biomarker in some cancers [6,10,11,12]. For SCLC, the most important prognostic parameter is the disease stage, and to a lesser extent age, sex, performance status, lactate dehydrogenase (LDH), and albumin as well [13].
However, to our knowledge, the prognostic value of baseline metabolic tumor burden on 18F-FDG PET/CT has never been evaluated yet in patients with ES-SCLC treated using chemo-immunotherapy.
The present study aimed to determine if 18F-FDG PET/CT parameters can predict outcomes in patients with ES-SCLC undergoing first-line CIT. To assess the possible prognostic or predictive impact on the outcomes, we also included a control group of patients treated using chemotherapy alone.

2. Materials and Methods

2.1. Patients

We carried out a retrospective study across multiple centers of patients with ES-SCLC who were treated with either chemotherapy alone or a combination of chemotherapy and first-line immune checkpoint inhibitors (ICIs). These patients underwent 18-FDG PET/CT scans at baseline, between June 2016 and September 2021, as part of standard care in three French centers. From May 2019, patients could receive immunotherapy from an early-access program in ES-SCLC. For the CT group, we analyzed a historical cohort of consecutive patients treated before this early-access program.
The flow-chart is provided in Figure 1. The study was approved by our local institutional review board (CLEA-2022-239).
Patients were eligible if they had: (i) biopsy-proven SCLC, (ii) stage IV disease, or (iii) treatment with platinum-etoposide chemotherapy alone (CT group) or in association with first-line PD-L1 inhibitors, atezolizumab, or durvalumab (CIT group). Patients were excluded if: (i) the delay between FDG PET/CT and the first ICI perfusion was >7 weeks (n = 7), (ii) the follow-up was <6 months, defined as the delay between the last contact and the diagnostic (n = 7), or (iii) they had another primary malignancy (n = 10). The inclusion criteria for blood samples assessment before ICI and chemotherapy was 7 days. Demographic, clinical, pathological, biological, and molecular data were also collected.

2.2. FDG PET/CT Acquisitions

After a fasting time of at least 6 h, 18F-FDG PET/CT scans were performed 60 min (median 60 min; range 44–73) after the injection of 18F-FDG (median activity 219 MBq; range: 99–411). In most cases, images were obtained from the skull vertex to the proximal femur. Images were acquired and reconstructed according to current guidelines [14] using six PET/CT scanners (Gemini TF Philips Medical system: n = 9 patients, General Electric Discovery MI: n = 32 patients, General Electric Discovery 710: n = 18 patients, General Electric Discovery IQ: n = 4 patients, Philips Vereos: n = 5 patients). Finally, images were interpreted by two experienced physicians, board-certified in nuclear medicine (RDS and JGV).

2.3. Measurement of Biological and Imaging Biomarkers

All hypermetabolic metastatic lesions were selected for the analysis, while hypermetabolic foci explained by inflammatory or physiologic activity were excluded. As a measure of the tumor glycolytic activity, the 18F-FDG PET/CT uptake was quantified by the maximum standardized uptake values normalized by body weight (SUVmax). To assess the metabolic tumor burden, MTV was measured by setting a margin threshold of 42% of SUVmax [15]. The tumor SUVmax was the maximum SUV of all of the lesions in a patient. TMTV was defined as the sum of the individual MTVs of all of the lesions analyzed. Blood cell counts at baseline before ICI treatment (within 7 days before the first treatment) were extracted from electronic medical records.

2.4. Outcomes: Progression-Free Survival and Overall Survival

The primary endpoint analysis was to build a multivariable model using pretreatment 18F-FDG PET imaging to predict the outcome. Progression-free survival (PFS) was defined as the delay between the first CIT or the CT perfusion, and the disease progression or the death from any cause; and overall survival (OS) was defined as the delay between the first ICI-chemotherapy or chemotherapy administration, and the death from any cause or censoring at the time when the patient was known to be alive. Follow-up was determined from the first ICI-chemotherapy or chemotherapy perfusion to the date of the last clinical consultation. The assessment of outcome was blinded.

2.5. Statistical Analysis

For the derived neutrophils/(leucocytes–neutrophils) ratio (dNLR), we used the cutoff of 3 (>3 vs. ≤3) from the largest published study with ICIs [16]. For biomarkers extracted from 18F-FDG PET imaging (TMTV and Tumor SUVmax), we used predictiveness curves to determine the relevant cut-off values [17,18] using 6-month PFS as a state variable based on the results of the pivotal IMpower133 study [3]. ROC curves were obtained to determine AUC for the prediction of survival outcomes at several time horizons. To analyze the connections between different factors, Spearman’s rank correlation coefficients were computed. Survival curves were estimated for each group using the Kaplan-Meier method, and compared using the log-rank test. The potentials of all pretreatment blood and [18F]-FDG PET biomarkers for predicting survival were examined using Cox models. The Cox proportional hazard regression models were used in multivariable analyses after backward variable selection, to identify significant independent factors. The likelihood ratio test (LRT) for the added prognostic values of TMTV and dNLR were obtained by comparing the log likelihoods of multivariable prognostic models without TMTV or dNLR, and with TMTV plus dNLR (chi-square test: χ2). All statistical tests were two-sided, and a p-value of less than 0.05 was deemed statistically significant. Analyses were performed with RStudio (version 1.3.1073, 2009–2020 RStudio, PBC).

3. Results

3.1. Patient Characteristics

Table 1 summarizes the initial characteristics of the patients. We analyzed 68 patients with ES-SCLC, 36 from the CIT group, and 32 from the CT group. The median age was 67 years old (with a range of 50 to 84 years old), and 50 of the patients (which represents 74% of the total) were male. Patients had a median of two metastatic sites (range, 1–8), 64 patients (94%) had a smoking history, 26 patients (38%) had liver metastasis (LM+), and 22 (32%) had brain metastasis. The median follow-up for the entire population was 11.9 (95%CI 8.5–16.3) months, 12.2 (95%CI 9.6–17.0) months in the CIT group, and 9.8 (95%CI 7.5–15.3) in the CT group. Thresholds determined by predictiveness curves were as follows: TMTV > 241 cm3 vs. ≤241 and Tumor SUVmax > 12 vs. ≤ 12 (Figure S1).

3.2. Correlation between Biomarkers

Correlations between PET biomarkers, extracted from tumor lesions and variables of interest, are presented in Figure S2. We found that biomarkers extracted from 18F-FDG PET/CT imaging (TMTV and tumor SUVmax) did not correlate significantly with each other (p > 0.05). Furthermore, there was no significant relationship between these biomarkers, and clinical or biological parameters (Spearman’s correlation coefficient < 0.3). As an example, when testing the relationship between TMTV and dNLR, Spearman’s correlation coefficient was 0.08 (p > 0.10).

3.3. Univariable and Multivariable Analyses: PFS

The median PFS was 5.9 (95% CI 5.2–7.9) months in the CIT group and 6.5 (95% CI 4.6–7.6) months in the CT group. In the study, progressive disease was observed in 96% of the patients (65 patients), with 34 patients (94%) from the CIT group and 31 (97%) from the CT group. The AUCs for the predictions of PFS at 6, 12, and 18 months in the two groups based on TMTV and dNLR are provided in Table S1. When analyzing the data using univariable analysis, high dNLR and high TMTV were significantly related to a shorter PFS in the CIT group (Table 2, Figure 2). However, only a high dNLR was correlated with a shorter PFS in the CT group. (Table 3, Figure S3). Moreover, a high tumor SUVmax, liver or brain metastases, age > 70 years, or PS ≥ 2 did not correlate with PFS in the two groups.
After conducting a multivariable analysis, the study found that both a high dNLR and a high TMTV were independent and statistically significant prognostic factors in the CIT group (HR 3.1, 95% CI 1.3–7.2 and HR 2.5, 95% CI 1.1–5.9, respectively). However, only a high dNLR was found to be statistically significant in the CT group (HR 3.3, 95% CI 1.4–7.7).
TMTV and dNLR did not provide any additional prognostic value to the multivariable model obtained with backward elimination for PFS in the CIT group (p > 0.05 for both; Table S2).

3.4. Univariable and Multivariable Analyses: OS

The study’s results showed that the median OS was 12.1 months (95% CI 9.6–17.0) in the CIT group, and 9.8 months (95% CI 7.5–15.3) in the CT group. Of the total of 68 patients, 56 patients (which represents 82% of the total) died, with 25 (69%) in the CIT group and 31 (97%) in the CT group. The AUCs for the prediction of OS at 6, 12, and 18 months in the two groups based on TMTV and dNLR are provided in Table S2.
The univariable analysis revealed that high dNLR and liver metastases (LM+) were both associated with poor OS in the CIT group (Table 2; Figure 3). However, only a high dNLR was found to be associated with a worse OS in the CT group (Table 3, Figure S3). Despite a clear trend in the univariable analysis, a high TMTV was not a statistically significant prognostic factor for OS in the CIT group (HR 2.2, 95%CI 1.0–4.8, p = 0.06). High Tumor SUVmax, brain metastases, age > 70 years, and PS ≥ 2 did not correlate with OS in the two groups.
According to the analysis of multiple variables, having a high dNLR was found to be a significant and independent factor for predicting outcomes in both groups (CIT group: HR 2.7, 95% CI 1.1–6.5; CT group: HR 3.2, 95% CI 1.2–8.7). The presence of liver metastases did not remain as a significant predictor for OS in the CIT group (HR 1.7, 95% CI 0.9–5.8).
Furthermore, TMTV and dNLR added significant prognostic values to the multivariable model obtained with the backward elimination process for OS in the CIT group (p < 0.05 for both; Table S2).

3.5. Signature Using TMTV and LM Status for the Prediction of Survival

We combined the TMTV and LM status (yes: LM+; no: LM−), both with p values < 0.10 in a univariable analysis for PFS and OS in the CIT cohort, and used them to build a signature for baseline risk stratification. Based on these two prognostic factors, we identified three distinct risk groups as low- (TMTVlow and LM− n = 18 in the CIT cohort and n = 15 in the CT cohort), intermediate- (TMTVhigh or LM+ n = 10 in the CIT cohort and n = 10 in the CT cohort), and high risk (TMTVhigh and LM+ n = 8 in the CIT cohort and n = 7 in the CT cohort).
In the CIT cohort, the median OS was 9.4 months (95%CI 7.9-NA) for the high-risk group versus 13.9 months (95%CI 11.6-NA) for the intermediate risk group versus 14.1 months (95%CI 12.0-NA) for the low-risk group (p < 0.01: the statistical difference between the high-risk group versus the intermediate/low-risk groups) (Table 4). At 12 months, the probability of OS was approximately 12% for the high-risk group, versus 51% and 60 % for the intermediate and low risk groups, respectively (Table S3). This TMTV/LM signature was not associated with PFS in the CIT cohort (Figure S4). In the CT cohort, the comparison of survival probabilities did not produce similar results, since no significant association was detected between our TMTV/LM signature and the outcomes (neither PFS nor OS: Table 4 and Table S4, Figure 4 and Figure S4).

4. Discussion

This study explored the prognostic values of specific metabolic parameters from the pretreatment 18F-FDG PET/CT of ES-SCLC patients undergoing first-line therapy with CIT or CT. The prognosis of patients displaying a high metabolic TB before first-line CIT was worse than patients displaying a low metabolic TB. A similar trend was observed for the OS analysis in the CIT group; however, TMTV did not reach statistical significance.
We identified a relevant cut-off to determine patients displaying a high versus low TMTV (> or ≤241 cm3), using predictiveness curves, which is consistent with other studies (a cut-off at 245.7 cm3 was used in a recent study for a patient treated with first-line treatment in ES-SCLC [19]). A recent meta-analysis [8] showed that high baseline TMTV is also prognostic for OS and PFS in SCLC patients treated with CT. Our results suggest that TMTV may have a strong prognostic impact in patients treated with CIT. This is evidenced by its significant correlation with PFS in the group treated with CIT. However, it cannot be excluded that TMTV would not have been significantly associated with survival outcomes in patients treated with CT alone if the sample size was larger. Beyond a better understanding of the extent and severity of the disease, further larger studies are warranted to determine whether and how measuring TMTV could be useful for clinicians to tailor their treatment strategies to individual patients and potentially improve their outcomes.
Recent evidence has also suggested that a high TB harms anticancer immunity [6] in several other malignancies, including non-small cell lung cancer (NSCLC) [20]. To our best knowledge, this had never been studied before in ES-SCLC patients treated with CIT. This phenomenon might be explained by a local immunosuppressive effect owing to certain characteristics of the tumor microenvironment. In some instances of high TB, tumor size, levels of inflammation, T cell senescence and exhaustion, and weakening anticancer immunity might explain the lack of response to ICI [6].
In our study, a high tumor SUVmax (>12) was not correlated with OS, either with PFS in ES-SCLC patients treated with CIT, or in patients treated with CT. These results are consistent with previous studies: a recent meta-analysis published in 2021 by Christensen [8], showed that only 7 out of 28 studies showed a significant prognostic value of SUVmax for OS and/or PFS.
Moreover, we showed that liver metastasis was associated with a worse OS for ES-SCLC patients treated with CIT (univariable analysis only), but not for patients treated with CT. Patients with liver metastases often have more aggressive cancers, which also contribute to poorer responses to systemic therapies. Liver involvement is a well-known pejorative indicator that is associated with reduced responses and worse outcomes (PFS and OS) in patients treated with ICI [21]. One reason for this is that the liver is an important site for immune regulation and tolerance, which make it more difficult for the immune system to recognize and to attack cancer cells in this organ [22]. Liver metastases were associated with reduced marginal CD8+ T-cell infiltration and decreased activated CD8+ T cells from the systemic circulation in patients with melanoma and NSCLC [21], and the mouse model [22]: which may explain the diminished immunotherapy efficacy. While the presence of liver metastases suggests a more advanced stage of disease, it may also indicate an increase in difficulty in effectively targeting cancer cells in the liver. Indeed, the liver is a vital organ that plays a critical role in metabolizing drugs, including ICI, which can lead to lower drug concentrations in the liver, and reduced efficacy [23].
A combination of multiple biomarkers could be a relevant way to optimize both prediction and prognostic accuracy [24,25]. We developed a score, combining the TMTV at baseline before therapy and the LM status, stratifying the population into three risk groups. Our research indicates that combining TMTV and LM in a promising signature has a more significant impact on predicting OS. However, this approach needs to be tested and confirmed in larger, independent, and prospective groups.
Multiple previous studies had demonstrated that a high peripheral pro-inflammatory status, which can be measured using biomarkers such as LDH and dNLR, was associated with worse outcomes in patients with cancer [26,27,28], and was correlated with a reduction in the efficacy of immunotherapy [29]. However, several randomized studies comparing Atezolizumab versus Docetaxel in advanced-stage NSCLC suggested these biomarkers had a prognostic rather than a predictive role [30]. The results in our study were consistent with previous findings: a high dNLR was associated with worse outcomes (OS and PFS) in the two groups.
The main limitations of our study are its retrospective nature and its relatively small sample size. We compared patients from a period before and after immunotherapy availability in this setting. Nevertheless, there was no major modification in the standard of care of ES-SCLC for the two cohorts. Furthermore, another strength was the use of predictiveness curves for testing the predictive capacity of candidate biomarkers that enables the most complete analysis. Indeed, predictiveness curves fit into an integrative approach which could give information about risk (as well as logistic regression, Cox models, and Kaplan-Meier analysis) but also classification performance (as well as ROC curves).

5. Conclusions

A high TMTV on 18F-FDG PET/CT was correlated with a worse outcome for ES-SCLC patients undergoing first-line CIT. This finding suggests that TMTV on 18F-FDG PET/CT could be used as a prognostic biomarker, identifying patients who shall not benefit from ICIs. Moreover, the TMTV/LM signature could also help to stratify patients at baseline, and guide clinical decision-making for ES-SCLC patients before first-line therapy. Such findings could be taken into account in clinical trials, and they might need further validation through large, independent, and prospective cohorts.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/cancers15082223/s1, Figure S1: Predictiveness curves for TMTV (A) and Tumor SUVmax (B) for 6-month PFS; Figure S2: Relationships between FDG uptake of tumor (tumor SUVmax), metabolic tumor burden (TMTV), and clinic–biological parameters (age, leukocytes, neutrophils, lymphocytes, and dNLR) evaluated using Spearman’s correlation coefficients; Figure S3: Kaplan-Meier curves of overall survival (OS) (A) and progression-free survival (PFS) (B) according to the derived Neutrophil-to-Lymphocyte Ratio (dNLR) in the chemotherapy (CT) cohort; Figure S4: Kaplan-Meier curves of progression-free survival (PFS) based on total metabolic tumor volume (TMTV) and liver metastases (LM) status in the chemo-immunotherapy (CIT) cohort (A), and in the chemotherapy (CT) cohort (B); Table S1: Area under the curve (AUC) for the prediction of PFS and OS at 6, 12, and 18 months in the chemo-immunotherapy (CIT) and chemotherapy (CT) groups based on total metabolic tumor volume (TMTV) and derived neutrophil-to-liver ratio (dNLR); Table S2: Tests for the additional prognostic values of TMTV and dNLR in the chemo-immunotherapy group; Table S3: Estimated overall survival (OS) probabilities at 6, 12, and 18 months in the chemo-immunotherapy (CIT) cohort based on total metabolic tumor volume (TMTV) and liver metastases (LM) status; Table S4: Estimated overall survival (OS) probabilities at 6, 12, and 18 months in the chemotherapy (CT) cohort based on total metabolic tumor volume (TMTV) and liver metastases (LM) status.

Author Contributions

(1) All authors made substantial contributions to the design of the work, or to the acquisition, analysis, or interpretation of data; (2) All authors revised it critically for important intellectual content; (3) All authors approved the version to be published, and (4) All authors agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or the integrity of any part of the work are appropriately investigated and resolved. Material preparation, and data collection and analysis were performed by R.-D.S. and J.G.-V. The first draft of the manuscript was written by J.G.-V., R.-D.S. and B.D. All authors commented on previous versions of the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research did not receive any specific grants from funding agencies in the public, commercial, or not-for-profit sectors.

Institutional Review Board Statement

All procedures performed in this study were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki Declaration. The study was approved by our local institutional review board (CLEA-2022-239) in June 2022.

Informed Consent Statement

For this type of study (retrospective), formal consent was not required.

Data Availability Statement

The data presented in this study are available in the article and supplementary material.

Conflicts of Interest

The following competing interests have been declared: J.G.-V., R.-D.S., K.C., J.-B.A., L.C., G.B., L.M., M.S., and C.C.: The authors declare that they have no conflict of interest. N.G.: Consultancy, hospitality, and research grants: AstraZeneca and Roche. A family member is an employee: AstraZeneca. B.D.: Reports personal fees from Roche, Pfizer, Astra Zeneca, Chiesi, Amgen, Lilly, Medscape, MSD, and Sanofi. Reports congress fees from AZ, Pfizer, and Oxyvie.

References

  1. Bernhardt, E.B.; Jalal, S.I. Small Cell Lung Cancer. Cancer Treat. Res. 2016, 170, 301–322. [Google Scholar] [CrossRef] [PubMed]
  2. Foster, N.R.; Renfro, L.A.; Schild, S.E.; Redman, M.W.; Wang, X.F.; Dahlberg, S.E.; Ding, K.; Bradbury, P.A.; Ramalingam, S.S.; Gandara, D.R.; et al. Multitrial Evaluation of Progression-Free Survival as a Surrogate End Point for Overall Survival in First-Line Extensive-Stage Small-Cell Lung Cancer. J. Thorac. Oncol. 2015, 10, 1099–1106. [Google Scholar] [CrossRef] [Green Version]
  3. Horn, L.; Mansfield, A.S.; Szczęsna, A.; Havel, L.; Krzakowski, M.; Hochmair, M.J.; Huemer, F.; Losonczy, G.; Johnson, M.L.; Nishio, M.; et al. First-Line Atezolizumab plus Chemotherapy in Extensive-Stage Small-Cell Lung Cancer. N. Engl. J. Med. 2018, 379, 2220–2229. [Google Scholar] [CrossRef] [PubMed]
  4. Paz-Ares, L.; Dvorkin, M.; Chen, Y.; Reinmuth, N.; Hotta, K.; Trukhin, D.; Statsenko, G.; Hochmair, M.J.; Özgüroğlu, M.; Ji, J.H.; et al. Durvalumab plus Platinum-Etoposide versus Platinum-Etoposide in First-Line Treatment of Extensive-Stage Small-Cell Lung Cancer (CASPIAN): A Randomised, Controlled, Open-Label, Phase 3 Trial. Lancet 2019, 394, 1929–1939. [Google Scholar] [CrossRef] [PubMed]
  5. Zugazagoitia, J.; Paz-Ares, L. Extensive-Stage Small-Cell Lung Cancer: First-Line and Second-Line Treatment Options. J. Clin. Oncol. 2022, 40, 671–680. [Google Scholar] [CrossRef]
  6. Dall’Olio, F.G.; Marabelle, A.; Caramella, C.; Garcia, C.; Aldea, M.; Chaput, N.; Robert, C.; Besse, B. Tumour Burden and Efficacy of Immune-Checkpoint Inhibitors. Nat. Rev. Clin. Oncol. 2022, 19, 75–90. [Google Scholar] [CrossRef]
  7. Lopci, E.; Hicks, R.J.; Dimitrakopoulou-Strauss, A.; Dercle, L.; Iravani, A.; Seban, R.D.; Sachpekidis, C.; Humbert, O.; Gheysens, O.; Glaudemans, A.W.J.M.; et al. Joint EANM/SNMMI/ANZSNM Practice Guidelines/Procedure Standards on Recommended Use of [18F]FDG PET/CT Imaging during Immunomodulatory Treatments in Patients with Solid Tumors Version 1.0. Eur. J. Nucl. Med. Mol. Imaging 2022, 49, 2323–2341. [Google Scholar] [CrossRef]
  8. Christensen, T.N.; Andersen, P.K.; Langer, S.W.; Fischer, B.M.B. Prognostic Value of 18F-FDG-PET Parameters in Patients with Small Cell Lung Cancer: A Meta-Analysis and Review of Current Literature. Diagnostics 2021, 11, 174. [Google Scholar] [CrossRef]
  9. Sharma, A.; Mohan, A.; Bhalla, A.S.; Sharma, M.C.; Vishnubhatla, S.; Das, C.J.; Pandey, A.K.; Sekhar Bal, C.; Patel, C.D.; Sharma, P.; et al. Role of Various Metabolic Parameters Derived from Baseline 18F-FDG PET/CT as Prognostic Markers in Non-Small Cell Lung Cancer Patients Undergoing Platinum-Based Chemotherapy. Clin. Nucl. Med. 2018, 43, e8–e17. [Google Scholar] [CrossRef] [PubMed]
  10. Prelaj, A.; Tay, R.; Ferrara, R.; Chaput, N.; Besse, B.; Califano, R. Predictive Biomarkers of Response for Immune Checkpoint Inhibitors in Non-Small-Cell Lung Cancer. Eur. J. Cancer 2019, 106, 144–159. [Google Scholar] [CrossRef]
  11. Seban, R.-D.; Mezquita, L.; Berenbaum, A.; Dercle, L.; Botticella, A.; Le Pechoux, C.; Caramella, C.; Deutsch, E.; Grimaldi, S.; Adam, J.; et al. Baseline Metabolic Tumor Burden on FDG PET/CT Scans Predicts Outcome in Advanced NSCLC Patients Treated with Immune Checkpoint Inhibitors. Eur. J. Nucl. Med. Mol. Imaging 2020, 47, 1147–1157. [Google Scholar] [CrossRef] [PubMed]
  12. Zhang, H.; Wroblewski, K.; Appelbaum, D.; Pu, Y. Independent Prognostic Value of Whole-Body Metabolic Tumor Burden from FDG-PET in Non-Small Cell Lung Cancer. Int. J. Comput. Assist. Radiol. Surg. 2013, 8, 181–191. [Google Scholar] [CrossRef] [PubMed]
  13. Yip, D.; Harper, P.G. Predictive and Prognostic Factors in Small Cell Lung Cancer: Current Status. Lung Cancer 2000, 28, 173–185. [Google Scholar] [CrossRef] [PubMed]
  14. Boellaard, R.; Delgado-Bolton, R.; Oyen, W.J.G.; Giammarile, F.; Tatsch, K.; Eschner, W.; Verzijlbergen, F.J.; Barrington, S.F.; Pike, L.C.; Weber, W.A.; et al. FDG PET/CT: EANM Procedure Guidelines for Tumour Imaging: Version 2.0. Eur. J. Nucl. Med. Mol. Imaging 2015, 42, 328–354. [Google Scholar] [CrossRef]
  15. Meignan, M.; Sasanelli, M.; Casasnovas, R.O.; Luminari, S.; Fioroni, F.; Coriani, C.; Masset, H.; Itti, E.; Gobbi, P.G.; Merli, F.; et al. Metabolic Tumour Volumes Measured at Staging in Lymphoma: Methodological Evaluation on Phantom Experiments and Patients. Eur. J. Nucl. Med. Mol. Imaging 2014, 41, 1113–1122. [Google Scholar] [CrossRef]
  16. Mezquita, L.; Auclin, E.; Ferrara, R.; Charrier, M.; Remon, J.; Planchard, D.; Ponce, S.; Ares, L.P.; Leroy, L.; Audigier-Valette, C.; et al. Association of the Lung Immune Prognostic Index with Immune Checkpoint Inhibitor Outcomes in Patients With Advanced Non-Small Cell Lung Cancer. JAMA Oncol. 2018, 4, 351–357. [Google Scholar] [CrossRef] [PubMed]
  17. Empereur-Mot, C.; Guillemain, H.; Latouche, A.; Zagury, J.-F.; Viallon, V.; Montes, M. Predictiveness Curves in Virtual Screening. J. Cheminform. 2015, 7, 52. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Viallon, V.; Latouche, A. Discrimination Measures for Survival Outcomes: Connection between the AUC and the Predictiveness Curve. Biom. J. 2011, 53, 217–236. [Google Scholar] [CrossRef] [Green Version]
  19. Andrini, E.; Lamberti, G.; Argalia, G.; Fortunati, E.; Ambrosini, V.; Fanti, S.; Ardizzoni, A.; Campana, D. 149P Total Metabolic Tumor Volume: A New Potential Prognostic Factor in SCLC. Ann. Oncol. 2022, 33, S101. [Google Scholar] [CrossRef]
  20. Dall’Olio, F.G.; Calabrò, D.; Conci, N.; Argalia, G.; Marchese, P.V.; Fabbri, F.; Fragomeno, B.; Ricci, D.; Fanti, S.; Ambrosini, V.; et al. Baseline Total Metabolic Tumour Volume on 2-Deoxy-2-[18F]Fluoro-d-Glucose Positron Emission Tomography-Computed Tomography as a Promising Biomarker in Patients with Advanced Non–Small Cell Lung Cancer Treated with First-Line Pembrolizumab. Eur. J. Cancer 2021, 150, 99–107. [Google Scholar] [CrossRef]
  21. Tumeh, P.C.; Hellmann, M.D.; Hamid, O.; Tsai, K.K.; Loo, K.L.; Gubens, M.A.; Rosenblum, M.; Harview, C.L.; Taube, J.M.; Handley, N.; et al. Liver Metastasis and Treatment Outcome with Anti-PD-1 Monoclonal Antibody in Patients with Melanoma and NSCLC. Cancer Immunol. Res. 2017, 5, 417–424. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Yu, J.; Green, M.D.; Li, S.; Sun, Y.; Journey, S.N.; Choi, J.E.; Rizvi, S.M.; Qin, A.; Waninger, J.J.; Lang, X.; et al. Liver Metastasis Restrains Immunotherapy Efficacy via Macrophage-Mediated T Cell Elimination. Nat. Med. 2021, 27, 152–164. [Google Scholar] [CrossRef]
  23. Cabibbo, G.; Aghemo, A.; Lai, Q.; Masarone, M.; Montagnese, S.; Ponziani, F.R.; Italian Association for the Study of the Liver (AISF). Optimizing Systemic Therapy for Advanced Hepatocellular Carcinoma: The Key Role of Liver Function. Dig. Liver Dis. 2022, 54, 452–460. [Google Scholar] [CrossRef] [PubMed]
  24. Seban, R.-D.; Assié, J.-B.; Giroux-Leprieur, E.; Massiani, M.-A.; Soussan, M.; Bonardel, G.; Chouaid, C.; Playe, M.; Goldfarb, L.; Duchemann, B.; et al. Association of the Metabolic Score Using Baseline FDG-PET/CT and DNLR with Immunotherapy Outcomes in Advanced NSCLC Patients Treated with First-Line Pembrolizumab. Cancers 2020, 12, 2234. [Google Scholar] [CrossRef] [PubMed]
  25. Castello, A.; Toschi, L.; Rossi, S.; Mazziotti, E.; Lopci, E. The Immune-Metabolic-Prognostic Index and Clinical Outcomes in Patients with Non-Small Cell Lung Carcinoma under Checkpoint Inhibitors. J. Cancer Res. Clin. Oncol. 2020, 146, 1235–1243. [Google Scholar] [CrossRef] [PubMed]
  26. McMillan, D.C. The Systemic Inflammation-Based Glasgow Prognostic Score: A Decade of Experience in Patients with Cancer. Cancer Treat. Rev. 2013, 39, 534–540. [Google Scholar] [CrossRef]
  27. Dercle, L.; Ammari, S.; Champiat, S.; Massard, C.; Ferté, C.; Taihi, L.; Seban, R.-D.; Aspeslagh, S.; Mahjoubi, L.; Kamsu-Kom, N.; et al. Rapid and Objective CT Scan Prognostic Scoring Identifies Metastatic Patients with Long-Term Clinical Benefit on Anti-PD-1/-L1 Therapy. Eur. J. Cancer 2016, 65, 33–42. [Google Scholar] [CrossRef] [PubMed]
  28. Castello, A.; Rossi, S.; Mazziotti, E.; Toschi, L.; Lopci, E. Hyperprogressive Disease in Patients with Non-Small Cell Lung Cancer Treated with Checkpoint Inhibitors: The Role of 18F-FDG PET/CT. J. Nucl. Med. 2020, 61, 821–826. [Google Scholar] [CrossRef]
  29. Cassidy, M.R.; Wolchok, R.E.; Zheng, J.; Panageas, K.S.; Wolchok, J.D.; Coit, D.; Postow, M.A.; Ariyan, C. Neutrophil to Lymphocyte Ratio Is Associated with Outcome During Ipilimumab Treatment. EBioMedicine 2017, 18, 56–61. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Sorich, M.J.; Rowland, A.; Karapetis, C.S.; Hopkins, A.M. Evaluation of the Lung Immune Prognostic Index for Prediction of Survival and Response in Patients Treated with Atezolizumab for NSCLC: Pooled Analysis of Clinical Trials. J. Thorac. Oncol. 2019, 14, 1440–1446. [Google Scholar] [CrossRef]
Figure 1. Flow-chart.
Figure 1. Flow-chart.
Cancers 15 02223 g001
Figure 2. Kaplan-Meier curves of progression-free survival (PFS) according to the Total Metabolic Tumor Volume (TMTV) (A) and the derived Neutrophil-to-Lymphocyte Ratio (dNLR) (B) in the chemo-immunotherapy (CIT) cohort.
Figure 2. Kaplan-Meier curves of progression-free survival (PFS) according to the Total Metabolic Tumor Volume (TMTV) (A) and the derived Neutrophil-to-Lymphocyte Ratio (dNLR) (B) in the chemo-immunotherapy (CIT) cohort.
Cancers 15 02223 g002
Figure 3. Kaplan-Meier curves of overall survival (OS) according to the derived Neutrophil-to-Lymphocyte Ratio (dNLR) (A), and the presence of liver metastases (B) in the chemo-immunotherapy (CIT) cohort.
Figure 3. Kaplan-Meier curves of overall survival (OS) according to the derived Neutrophil-to-Lymphocyte Ratio (dNLR) (A), and the presence of liver metastases (B) in the chemo-immunotherapy (CIT) cohort.
Cancers 15 02223 g003
Figure 4. Kaplan-Meier curves of overall survival (OS) based on total metabolic tumor volume (TMTV) and liver metastases (LM) status in the chemo-immunotherapy (CIT) cohort (A), and in the chemotherapy (CT) cohort (B).
Figure 4. Kaplan-Meier curves of overall survival (OS) based on total metabolic tumor volume (TMTV) and liver metastases (LM) status in the chemo-immunotherapy (CIT) cohort (A), and in the chemotherapy (CT) cohort (B).
Cancers 15 02223 g004
Table 1. Patient characteristics.
Table 1. Patient characteristics.
All Patients (n = 68)CIT Group (n = 36)CT Group (n = 32)
Median [Range], n (%)Median [Range], n (%)Median [Range], n (%)
CLINICAL CHARACTERISTICS
Demographic parameters
Age (years)67 (50–84)67 (51–84)66 (50–84)
Gender (Male/Female)50 (74)/18 (26)25 (69)/11 (31)25 (78)/7 (22)
Performance Status (ECOG)1 (0–3)1 (0–2)1 (0–3)
Smoking history (current/former/no/unknown)31 (46)/33 (49)/3 (4)/1 (1)13 (36)/20 (55)/2 (6)/1 (3)18 (56)/13 (41)/1 (3)/0 (0)
Biology
Leukocytes (G/L)8.9 (5.8–19.6)8.7 (6.1–19.6)9.6 (5.8–16.4)
Neutrophils (G/L)6.5 (2.0–15.0)5.9 (2.6–15.0)6.7 (2.0–12.1)
dNLR2.5 (0.3–10.1)2.6 (0.7–9.0)2.4 (0.3–10.1)
Lymphocytes (G/L)1.7 (0.3–3.7)1.7 (0.6–3.0)1.7 (0.3–3.7)
Staging
Number of metastatic sites2 (1–8)2 (1–8)2 (1–6)
Liver involvement26 (38)14 (39)12 (37)
Brain involvement22 (32)10 (28)12 (37)
PET IMAGING PARAMETERS
Tumor glucose uptake
Tumor SUVmax12.7 (3.7–44.0)13.4 (6.0–44.0)12.3 (3.7–29.3)
Metabolic Tumor Burden
TMTV182.9 (1.7–2257.2)178.5 (3.1–2257.2)196.3 (1.7–880.6)
TREATMENT
First-line
Carboplatin—Etoposide—Atezolizumab34 (50)34 (94)NA
Carboplatin—Etoposide—Durvalumab2 (3)2 (6)NA
Carboplatin—Etoposide32 (47)NA32 (100)
SURVIVAL
Progression65 (96)34 (94)31 (97)
Death56 (82)25 (69)31 (97)
Abbreviations: chemotherapy (CT), chemo-immunotherapy (CIT), derived neutrophil-to-lymphocyte ratio (dNLR), total metabolic tumor volume (TMTV), maximum standardized uptake value (SUVmax).
Table 2. Significance of biomarkers in predicting progression-free survival and overall survival in patients who underwent first-line chemo-immunotherapy with univariable and multivariable analyses.
Table 2. Significance of biomarkers in predicting progression-free survival and overall survival in patients who underwent first-line chemo-immunotherapy with univariable and multivariable analyses.
N = 36 ptsOVERALL SURVIVAL
(Events: n = 25)
PROGRESSION-FREE SURVIVAL
(Events: n = 34)
UnivariableMultivariableUnivariableMultivariable
VariablepHR (95CI)pHR (95CI)pHR (95CI)pHR (95CI)
DEMOGRAPHICS
  Age ≥ 70 years (vs. <70 years)0.082.1 (0.9–4.8)0.411.5 (0.6–3.8) 0.141.8 (0.8–3.7)--
  Male (vs. female)0.150.5 (0.2–1.2)--0.451.3 (0.4–1.6)--
  PS ≥ 2 (vs. <2)0.631.3 (0.4–3.8)--0.781.1 (0.4–2.1)--
BIOLOGY
  High dNLR0.022.7 (1.2–6.0)0.032.7 (1.1–6.5)0.052.1 (0.9–4.3)<0.013.1 (1.3–7.2)
IMAGING
 18F-FDG PET/CT
  High TMTV0.062.2 (1.0–4.8)0.072.3 (0.9–5.8)0.042.2 (1.1–4.6)0.032.5 (1.1–5.9)
  High tumor SUVmax0.751.1 (0.4–1.9)--0.531.2 (0.4–1.6)--
  Liver metastases (vs. no)0.032.5 (1.1–5.6)0.261.7 (0.9–5.8)0.57 1.2 (0.6–2.5)--
 BRAIN MRI and/or CT
  Brain metastases (vs. no)0.680.8 (0.3–2.0)--0.480.8 (0.4–1.6)--
Notes: Each biomarker’s distribution is originally a continuous variable, but it is converted into a discrete categorization with two categories (high and low) using cutoffs from previously published studies or predictiveness curves: dNLR (>3 vs. ≤3), TMTV (>241 vs. ≤241cm3), and tumor SUVmax (>12 vs. ≤12). Abbreviations: hazard ratio (HR), confidence interval (CI), performance status (PS), derived neutrophil-to-lymphocyte ratio (dNLR), total metabolic tumor volume (TMTV), maximum standardized uptake value (SUVmax).
Table 3. Prognostic significance of biomarkers for progression-free survival and overall survival in univariable and multivariable analyses for patients treated with first-line chemotherapy.
Table 3. Prognostic significance of biomarkers for progression-free survival and overall survival in univariable and multivariable analyses for patients treated with first-line chemotherapy.
N = 32 ptsOVERALL SURVIVAL
(Events: n = 31)
PROGRESSION-FREE SURVIVAL
(Events: n = 31)
UnivariableMultivariableUnivariableMultivariable
VariablepHR (95CI)pHR (95CI)pHR (95CI)pHR (95CI)
DEMOGRAPHICS
  Age ≥ 70 years (vs. <70 years)0.091.8 (0.9–3.8)0.83 1.1 (0.5–2.7)0.381.4 (0.7–3.0)
  Male (vs. female)0.370.7 (0.3–1.6)--0.100.5 (0.2–1.2)0.580.8 (0.3–1.9)
  PS ≥ 2 (vs. <2)0.151.9 (0.8–4.7)--0.901.1 (0.4–2.5)--
BIOLOGY
  High dNLR<0.013.4 (1.5–7.9)0.023.2 (1.2–8.7)0.052.2 (1.0–4.8)<0.013.3 (1.4–7.7)
IMAGING
 18F-FDG PET/CT
  High TMTV0.181.7 (0.8–3.6)--0.281.5 (0.7–3.3)--
  High tumor SUVmax0.120.6 (0.3–1.2)--0.680.9 (0.4–1.8)--
  Liver metastases (vs. no)0.941.0 (0.5–2.1)--0.280.6 (0.3–1.4)--
 BRAIN MRI and/or CT
  Brain metastases (vs. no)0.341.4 (0.7–3.0)--0.291.5 (0.7–3.2)--
Notes: The distribution of each PET biomarker is a continuous variable that is transformed into a discrete categorization in 2 categories (high vs. low) using cutoffs from previously published studies or predictiveness curves: dNLR (>3 vs. ≤3), TMTV (>241 vs. ≤241), and tumor SUVmax (>12 vs. ≤12). Abbreviations: hazard ratio (HR), confidence interval (CI), performance status (PS), derived neutrophil-to-lymphocyte ratio (dNLR), total metabolic tumor volume (TMTV), maximum standardized uptake value (SUVmax).
Table 4. Estimation of median overall survival (OS) and median progression-free survival (PFS) in the chemotherapy (CIT) cohort, and in the chemotherapy (CT) cohort based on total metabolic tumor volume (TMTV) and liver metastases (LM) status.
Table 4. Estimation of median overall survival (OS) and median progression-free survival (PFS) in the chemotherapy (CIT) cohort, and in the chemotherapy (CT) cohort based on total metabolic tumor volume (TMTV) and liver metastases (LM) status.
Cohort and StrataPatients (n)Median OS
[95% CI]
Events (n)p-ValueMedian PFS
[95% CI]
Events (n)p-Value *
CIT cohort 36 <0.01 0.33
 High risk89.4 [7.9–NA]8 5.4 [5.2–NA]8
 Intermediate risk1013.9 [11.6–NA]6 5.8 [4.7–NA]10
 Low risk1814.1 [12.0–NA]11 6.6 [5.6–10.5]16
CT cohort32 0.71 0.38
 High risk79.9 [7.9–NA]7 6.5 [5.5–NA]7
 Intermediate risk109.5 [6.4–NA]10 7.3 [3.5–NA]9
 Low risk1513.8 [8.0–20.4]14 6.1 [5.0–8.5]15
Abbreviations: confidence interval (CI), not applicable (NA). Legend: * p value for the difference between the high-risk group and low/intermediate-risk groups.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Grambow-Velilla, J.; Seban, R.-D.; Chouahnia, K.; Assié, J.-B.; Champion, L.; Girard, N.; Bonardel, G.; Matton, L.; Soussan, M.; Chouaïd, C.; et al. Total Metabolic Tumor Volume on 18F-FDG PET/CT Is a Useful Prognostic Biomarker for Patients with Extensive Small-Cell Lung Cancer Undergoing First-Line Chemo-Immunotherapy. Cancers 2023, 15, 2223. https://doi.org/10.3390/cancers15082223

AMA Style

Grambow-Velilla J, Seban R-D, Chouahnia K, Assié J-B, Champion L, Girard N, Bonardel G, Matton L, Soussan M, Chouaïd C, et al. Total Metabolic Tumor Volume on 18F-FDG PET/CT Is a Useful Prognostic Biomarker for Patients with Extensive Small-Cell Lung Cancer Undergoing First-Line Chemo-Immunotherapy. Cancers. 2023; 15(8):2223. https://doi.org/10.3390/cancers15082223

Chicago/Turabian Style

Grambow-Velilla, Julia, Romain-David Seban, Kader Chouahnia, Jean-Baptiste Assié, Laurence Champion, Nicolas Girard, Gerald Bonardel, Lise Matton, Michael Soussan, Christos Chouaïd, and et al. 2023. "Total Metabolic Tumor Volume on 18F-FDG PET/CT Is a Useful Prognostic Biomarker for Patients with Extensive Small-Cell Lung Cancer Undergoing First-Line Chemo-Immunotherapy" Cancers 15, no. 8: 2223. https://doi.org/10.3390/cancers15082223

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop