Next Article in Journal
Prognostic Potential of Galectin-9 mRNA Expression in Chronic Lymphocytic Leukemia
Previous Article in Journal
Unlocking New Horizons in Small-Cell Lung Cancer Treatment: The Onset of Antibody–Drug Conjugates
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Cancers
Volume 15
Issue 22
10.3390/cancers15225369
cancers-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Radiomics Approach to Identify Immunologically Active Tumor in Patients with Head and Neck Squamous Cell Carcinomas

by
Tan Mai Nguyen
1,2,3,
Chloé Bertolus
1,2,
Paul Giraud
3,4,
Anita Burgun
3,
Pierre Saintigny
2,5,
Jean-Emmanuel Bibault
3,6 and
Jean-Philippe Foy
1,7,*
1
Sorbonne Université, Department of Maxillo-Facial Surgery, Hôpital Pitié-Salpêtrière, Assistance Publique des Hôpitaux de Paris, 75013 Paris, France
2
Univ Lyon, Université Claude Bernard Lyon 1, INSERM 1052, CNRS 5286, Centre Léon Bérard, Centre de Recherche en Cancérologie de Lyon, 69008 Lyon, France
3
INSERM, UMR S1138, Cordeliers Research Center, Université Paris Cité, 75005 Paris, France
4
Sorbonne Université, Department of Radiation Oncology, Hôpital Pitié-Salpêtrière, Assistance Publique des Hôpitaux de Paris, 75013 Paris, France
5
Department of Medical Oncology, Centre Léon Bérard, 69008 Lyon, France
6
Department of Radiation Oncology, Hôpital Européen Georges-Pompidou, Université Paris Cité, 75015 Paris, France
7
Sorbonne Université, INSERM UMRS 938, Centre de Recherche de Saint Antoine, Team Cancer Biology and Therapeutics, 75011 Paris, France
*
Author to whom correspondence should be addressed.
Cancers 2023, 15(22), 5369; https://doi.org/10.3390/cancers15225369
Submission received: 21 September 2023 / Revised: 5 November 2023 / Accepted: 6 November 2023 / Published: 11 November 2023
(This article belongs to the Section Methods and Technologies Development)
Browse Figures
Versions Notes

Abstract

:

Simple Summary

We recently established a biological classification of head and neck cancers into hot and cold tumors, which were associated with different responses to immunotherapy (a type of cancer treatment helping the immune system fight cancer). Because this classification requires a tumor biopsy, the development of a non-invasive approach, based on imaging data, would be relevant to determine this hot/cold tumor status without performing an invasive biopsy. Thus, our goal was to determine whether imaging data from computed tomography (CT) scans can distinguish hot and cold head and neck squamous cell carcinomas (HNSCCs). Using biological and clinical imaging data from two independent cohorts, we established a computational model to determine the hot/cold status from the CT scan. This non-invasive approach, based on a “virtual” biopsy, could help for the identification and monitoring of patients with HNSCC who may benefit from immunotherapy.

Abstract

Background: We recently developed a gene-expression-based HOT score to identify the hot/cold phenotype of head and neck squamous cell carcinomas (HNSCCs), which is associated with the response to immunotherapy. Our goal was to determine whether radiomic profiling from computed tomography (CT) scans can distinguish hot and cold HNSCC. Method: We included 113 patients from The Cancer Genome Atlas (TCGA) and 20 patients from the Groupe Hospitalier Pitié-Salpêtrière (GHPS) with HNSCC, all with available pre-treatment CT scans. The hot/cold phenotype was computed for all patients using the HOT score. The IBEX software (version 4.11.9, accessed on 30 march 2020) was used to extract radiomic features from the delineated tumor region in both datasets, and the intraclass correlation coefficient (ICC) was computed to select robust features. Machine learning classifier models were trained and tested in the TCGA dataset and validated using the area under the receiver operator characteristic curve (AUC) in the GHPS cohort. Results: A total of 144 radiomic features with an ICC >0.9 was selected. An XGBoost model including these selected features showed the best performance prediction of the hot/cold phenotype with AUC = 0.86 in the GHPS validation dataset. Conclusions and Relevance: We identified a relevant radiomic model to capture the overall hot/cold phenotype of HNSCC. This non-invasive approach could help with the identification of patients with HNSCC who may benefit from immunotherapy.

1. Introduction

Head and neck squamous cell carcinomas (HNSCCs) are common epithelial tumors arising from the mucosa of the oral cavity, oropharynx, nasopharynx, larynx, or hypopharynx. They are ranked as the 7th most common cancers worldwide with over 800,000 patients diagnosed per year globally, and they are responsible for over 400,000 deaths [1]. HNSCC is characterized by a high inter- and intra-tumoral heterogeneity, which may significantly impact treatment response.
Recent clinical trials evaluating immunotherapies, notably PD-1/PD-L1 inhibitors, represent an unprecedented advance in the management of HNSCC [2,3]. Beyond the identification of a specific biomarker associated with the response to a given immune checkpoint inhibitor (ICI), the upcoming era of new immunotherapy strategies combining different ICIs with co-stimulatory agonists or therapeutic vaccines, as well as with cytotoxic drugs, has recently led to the concept of targeting hot versus cold tumors [4,5].
Briefly, compared to cold tumors, hot tumors have been characterized by an overall activated immune microenvironment with high infiltrating immune cells and are more likely to respond to immunomodulatory strategies. Although the concept of hot versus cold tumors is questionable regarding the known complexity of the immune microenvironment [6], it is of particular relevance in clinical research for the identification of patients more likely to benefit from immunotherapies, including in neoadjuvant settings. In this context, we recently developed an HOT score based on the expression of 27 genes in order to identify hot head and neck tumors [7]. We showed that hot tumors, as defined by a positive HOT score, were characterized by a high TCD8 (T-cell) infiltrate as well as an activation of the interferon-gamma (IFN-γ) response. Interestingly, in two independent cohorts of patients with HNSCC or non-small-cell lung cancers (NSCLCs) treated with immunotherapies, we also showed that patients with hot tumors had a better overall survival as well as progression-free survival compared to cold tumors.
Medical imaging is routinely used for cancer patients and is promising in the development of non-invasive biomarkers for the molecular characterization of a tumor phenotype [8]. Computational medical imaging, known as radiomics, is an emerging field first defined in 2012 as the high-throughput extraction of large amounts of image features from radiographic images [9,10]. Radiomics provides fast, low-cost, and non-invasive instruments through the generation of image-driven biomarkers directly extracted from standard-of-care medical images. Over the past few years, we have observed an increasing trend of publications on radiomic approaches in oncology [11], especially for predicting diagnosis [12,13,14] and treatment response [15,16,17,18,19], as well as tumor molecular profiles [20,21]. In particular, in patients with HNSCC, different radiomic features extracted from computed tomography (CT) imaging, which is routinely performed in this setting, were significantly associated with clinical (local control, tumor failure, lymph node metastasis, extranodal extension, overall survival, human papillomavirus (HPV) status) and histological (differentiation grade, perineural and lymphovascular invasion) parameters as well as molecular features, especially some specific somatic mutations, in patients with head and neck cancer [22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39].
Because some radiomic features were also associated with the tumor immune microenvironment of HNSCC, such as the T-cell infiltration [40], we hypothesized that radiomic analysis can predict the immune tumor hot phenotype of HNSCC. Using radiomic features extracted from pretreatment CT images of HNSCC, we developed a radiomic model for tumor classification according to the hot/cold phenotype.

2. Methods

2.1. Datasets (Table 1)

2.1.1. Training and Testing Datasets

The “TCGA-HNSCC” dataset includes molecular and imaging data of patients with HNSCC from The Cancer Genome Atlas database. Gene expression profiles as well as clinical data were downloaded using the TCGA2STAT R package [41] as well as from the cBioportal database (https://www.cbioportal.org/study/summary?id=hnsc_tcga (accessed on 3 March 2020) [42,43]. DICOM files of corresponding pre-treatment CT scans were downloaded from The Cancer Imaging Archive (TCIA) (https://www.cancerimagingarchive.net/nbia-search/?CollectionCriteria=TCGA-HNSC (accessed on 3 March 2020) (N = 188).

2.1.2. External Validating Dataset

The “GHPS” dataset included 20 patients treated in the department of maxillo-facial surgery at the Groupe Hospitalier la Pitié-Salpétrière (GHPS), with available gene expression profiles as well as corresponding pre-treatment CT scans (DICOM images). For each patient, targeted gene expression profiles were previously generated in order to define the hot/cold tumor phenotype based on the HOT score as previously defined [7,44]. We retrospectively reviewed corresponding contrast-enhanced pre-treatment CT scans and data were de-identified. For both datasets, inclusion criteria were patients suffering from histologically confirmed HNSCC with available pretreatment contrast-enhanced CT scans. Only patients with CT scans of the proper quality were included (contrast-enhanced CT, soft or standard convolution kernel, slice thickness ≤ 5 mm, no artifacts (dental) in the region of interest, visualization of the tumor).
In all samples from the training and validating datasets, we computed the HOT score using the gene set variation analysis (GSVA) [45], as previously defined, in order to identify the hot/cold tumor. Tumors with a score ≥ 0 and <0 were classified as hot and cold, respectively.
Tumor characteristics are detailed for each dataset in Table 1.
Table 1. Patient characteristics of the two cohorts. NA: not available.
Table 1. Patient characteristics of the two cohorts. NA: not available.
TCGA-HNSCC
(N = 113)		GHPS-COSMOS (N = 20)
N (%)N (%)
Age (mean) at diagnosis59.6962.15
Gender
Female27 (23.9%)8 (40.0%)
Male86 (76.1%)12 (60.0%)
Anatomic Site
Oral cavity68 (60.2%)20 (100%)
Larynx31 (27.4%)0
Oropharynx13 (11.5%)0
Hypopharynx1 (0.9%)0
Alcohol
Yes28 (24.8%)8 (40.0%)
No85 (75.2%)10 (50.0%)
NA 02 (10.0%)
Smoking
Current45 (39.8%)10 (50.0%)
Former46 (40.7%)2 (10.0%)
No21 (18.6%)8 (40.0%)
NA1 (0.9%)0
Pathological T stage
T16 (5.3%)1 (5.0%)
T223 (20.3%)5 (25.0%)
T323 (30.3%)3 (10.0%)
T441 (36.3%)11 (55.0%)
Tx13 (38.0%)0
NA5 (11.5%)0
N stage (%)
N047 (41.6%)10 (50%)
N113 (11.5%)2 (10%)
N232 (28.3%)4 (20%)
N31 (0.9%)4 (20%)
Nx15 (13.3%)0
NA5 (4.4%)0
M stage (%)
M0109 (96.5%)20 (100%)
M11 (0.9%)0
Mx3 (2.6%)0
Phenotype (%)
HOT48 (42.5%)9 (45%)
COLD65 (57.5%)11 (55%)

2.2. Radiomics Workflow (Figure 1)

2.2.1. Tumor Volume Segmentation

We manually outlined the regions of interest (ROIs, defined as the gross tumor volume) using the “Imaging Biomarker Explorer” IBEX radiomics software [46,47] on each axial slice. During this process of segmentation, all artifacts and other tissues around the tumor as well as airways were avoided in order to include only tumor tissues in the ROIs. All the ROIs were segmented by a head and neck specialist (T.-M.N.). In the TCGA dataset, a second delineation was performed on 17 randomly selected CT scans by a radiation oncologist (J.-E.B.). This repeated manual segmentation was performed to assess the reproducibility and stability of radiomic features in light of the variation in manual selection. The ROIs from the two independent specialists were downloaded into the IBEX software and compared. Divergences in the two segmentations for each tumor volume were resolved through discussion with another head and neck expert (J.-P.F.).

2.2.2. Quantitative Image Feature Extraction

The IBEX software automatically generates tumor radiomic features in six principal categories: shape, intensity histogram, gray level co-occurrence matrix (GLCOM) 25 (computed from all 2-D image slices) and 3 (computed from all 3-D image matrices), neighborhood gray-tone difference matrix (NGTDM) 3 and 25, gray level run-length matrix (GLRLM) 25, and histogram of oriented gradients (Supplementary Table S1). A total of 1767 quantitative image features were extracted from the segmented region of interest of each gross tumor volume, without image preprocessing filters.

2.2.3. Feature Selection

Extracted radiomic feature scaling was performed through normalization in a linear manner within the range [0:1]. To assess the robustness of the radiomic features from the ROIs, we computed the intraclass correlation coefficient (ICC) for each radiomic feature [48]. Thus, the ICC can be used when quantitative measurements are performed on units organized into groups [49]. It ranges from 0 to 1, indicating null and perfect reproducibility, respectively. We used the “ICC” R package (version 3.4.2) to calculate this coefficient (https://cran.r-project.org/web/packages/ICC/ICC.pdf (accessed on 20 May 2020). Only features with an ICC greater than or equal to 0.90 were selected.
Cancers 15 05369 g001
Figure 1. Radiomic workflow.
Figure 1. Radiomic workflow.
Cancers 15 05369 g001

2.3. Radiomic Model (Figure 2)

Selected features were used as predictor inputs for constructing XGBoost models, which is a decision-tree-based ensemble machine learning algorithm using a gradient-boosting framework for regression and classification problems. This model uses a large number of “weak learners,” which are relatively simple classifiers, each trained using only part of the data. The estimate produced by each weak learner is then aggregated into an overall decision using mechanisms such as voting. In this manner, a large number of weak learners are combined to produce one strong learner. Thus, a sequential training process creates a cascade of weak learners, such that in each subsequent step, weak learners focus on the data that were most difficult to classify in the previous step. To improve our model, we performed hyperparameter tuning using a grid search. Moreover, to limit overfitting and increase the generalizability of our models, we constructed our model based on training, validation, and independent testing in separate datasets [50]: the TCGA dataset was randomly divided into the training dataset (80%) and the testing dataset (20%), while the GHPS cohort was an independent validating dataset. The characteristics of the datasets are available in Supplementary Table S2. Finally, to minimize the true error estimate bias, each classifier model was trained using three-fold cross-validation (3-fold CV) on the training set [51]. We estimated the contribution of each variable to the model using the varImp function from the R caret package.
In order to assess the predictive performance of our model, we computed different well-established metrics from the literature. Notably, we measured the area under the receive operator characteristic (ROC) curve (AUC) using the pROC package in R. We also computed accuracy, recall, precision, F-score, and area under the precision–recall curve using the precrec package in R (https://cran.r-project.org/web/packages/precrec/vignettes/introduction.html (accessed on 10 September 2020). AUC and accuracy are two of the most commonly used classification metrics in machine learning. AUC is commonly recognized as the best indicator of model performance, especially due to the relationship between true positive rate and false positive rate [52], except in the case of class imbalance. In this context and because the hot and cold classes are well balanced, we used AUC to select the best model for the classification of the hot/cold phenotype. A brief description of each performance metric is provided in Supplementary Table S3.
All the machine learning algorithms were conducted using the R caret package [50]. All the analyses were completed using the R software (version R 4.0.1) [51]. The code is available at https://github.com/TMNgn/Master2IBM.git (accessed on 3 March 2020).
Cancers 15 05369 g002
Figure 2. Model construction.
Figure 2. Model construction.
Cancers 15 05369 g002

3. Results

3.1. Identification of the Hot Phenotype and Radiomic Feature Selection

A total of 113 and 20 patients suffering from HNSCC were included from the TCGA-HNSCC and the GHPS cohorts, respectively. The hot/cold phenotype was previously computed using the HOT score in each sample. We identified 48/113 and 9/20 hot tumors from the TCGA and GHPS cohorts, respectively.
We initially extracted 1767 radiomic features from the segmented tumor regions of the pretreatment CT images from the TCGA-HNSCC cohort. The ICC was computed from the tumor ROI delineation by two independent investigators (T.-M.N. and J.-E.B.) in 17 randomly selected patients. A total of 144/1767 features with ICC ≥ 0.90 were selected for further analysis (Supplementary Table S3).

3.2. Predictive Radiomic Model of the Hot Phenotype

Using the 144 selected radiomic features, we trained an XGBoost model on the training set of the TCGA cohort and tuned the hyperparameters.
Our best XGBoost model after hyperparameter tuning (booster = gbtree, nrounds = 4900, eta = 0.01, max_depth = 6, gamma = 0.5, colsample_bytree = 0.6, min_child_weight = 1, subsample = 1) on the independent validating cohort (GHPS) predicted the hot/cold phenotype with the following performance metrics: AUC = 0.859, PR-AUC = 0.734, accuracy = 0.750, precision = 0.833, recall = 0.556, and F1-score = 0.667 (Figure 3). The confusion matrix and the model performance metrics are summarized in Figure 3a,c. The top five contributive radiomic features using the varImp function from the R caret package were F10.Shape Voxel Size, F1.Gradient Orient Histogram 0.975 Quantile, F1.Gradient Orient Histogram 85 Percentile, F1.Gradient Orient Histogram 95 Percentile Area, and F2. Gray Level Co-occurence Matrix 25270.7 Auto Correlation.
The min–max values of the performance metrics of all the classification methods trained with the selected features are reported in Supplementary Table S4.

4. Discussion

Medical imaging is routinely used for cancer patients and is promising in the development of non-invasive biomarkers for the molecular characterization of a tumor phenotype [53]. While most radiomic studies in patients with HNSCC focused on diagnosis and prognosis prediction [16,23,24,25,27,54,55], few publications only showed the association between radiomic features and the molecular characteristics of head and neck cancers, especially involving the immune tumor microenvironment [40,56,57,58,59]. Because we previously demonstrated the association between a hot/cold tumor phenotype based on gene expression and the association with the response to anti-PD1/PD-L1 in patients with HNSCC, we assessed whether some radiomic features extracted from the tumor ROI could help with the prediction of this molecular phenotype. Based on initial CT scans, we built and tested a radiomic XGBoost model, including 144 robust features, to predict our hot/cold tumor phenotype. Notably, we observed the good performance of our model for the prediction of the hot/cold phenotype, with AUC = 0.86. Besides the performance metrics, this study showed the relevance of a non-invasive imaging radiomics-based approach to capture molecular tumor characteristics in HNSCC.
The association between radiomics and cancer biology, especially regarding the tumor immune microenvironment, has been recently investigated in some cancer types, especially in lung and breast cancers [60,61,62,63,64,65,66,67]. Some studies have focused on HNSCC [60,68], with most of them investigating the relevance of radiomics to capture histological features related to HPV status [25] and immune cell infiltration [40]. Indeed, different radiomic signatures were identified to assess tumor T-CD8 cell infiltration [69] as well as PD-L1 expression or other immune checkpoint molecules [58,59,70,71], which were associated with the response to PD1/PD-L1 inhibitors. Interestingly, some radiomic features were also associated with the histological classification between immune-inflamed and immune-desert tumors [59]. However, the inter- and intra-observer variability in the pathological assessment of immune features in cancer samples, especially PDL1 expression [72], may limit the extrapolability of radiomic signatures for capturing histological immune features, suggesting the need to identify radiomic surrogates of the molecular biomarkers of the immune infiltrate. In line with previous studies showing the relevance of radiomic models to identify gene-expression- and methylome-based subtypes [56], with distinct immune molecular features [40], we built a radiomic model to classify hot and cold tumors, as defined by our score based on the expression of 27 genes. Thus, our study confirms, in patients with HNSCC, the relevance of a non-invasive imaging approach to identify different immune subtypes, as previously performed in other cancer types [63,64,73,74,75].
Our model was based on an XGBoost method, which is a relevant machine learning algorithm for problem classification [76]. This algorithm has recently been dominating applied machine learning and Kaggle competitions for structured or tabular data, and it has proven its relevance in building radiomic classification models for different cancer types [28,77,78,79,80]. This model includes a large number of hyperparameters that are divided into general parameters (booster), booster parameters (eta, min_child_weight, max_depth, max_leaf_nodes, gamma, max_ delta_step, subsample, etc.), and learning task parameters (objective, eval_metric, and seed). Thus, we performed exhaustive parameter tuning in this model in order to improve the predictive performance of our model. Hyperparameter tuning as well as the cross-validation method and feature selection were used to limit overfitting, as previously recommended [81], with very good predictive performance (AUC = 0.86) in the external validation dataset.
We observed that shape and textural radiomic features were the most relevant quantitative image features that contributed to the predictive performance of our model. This observation is consistent with recent reports of radiomics and biology in HNSCC, showing that textural features were associated with tumor heterogeneity and were commonly used in radiomic model biological prediction [68,71]. In particular, image-derived textural diversity has been associated with increased immune cell infiltration, causing tumor imaging heterogeneity [65,82]. Although the relevance of radiomic features to identify molecular immune features is questionable regarding the known complexity of the immune microenvironment, the very good predictive performances of our model may also be related to a relatively simple binary classification with major biological differences between hot and cold tumors [7], which goes beyond the expression of a single gene or protein biomarker.
The principal limitation of our study is the relatively small sample size (<150 patients). However, the TCGA dataset was split into a training and a testing dataset to build a model that we validated in an independent dataset, strengthening confidence in the generalizability of our model. Indeed, the inter-scanner variability in CT image radiomic studies especially related to scanner manufacturers [83] may limit the extrapolability of previously published radiomic models using training and validation from a single institutional dataset. Because the TCGA and GHPS datasets are two independent datasets with different imaging parameters, we believe that our radiomic model is robust and could be extrapolated in other centers to predict this hot/cold molecular phenotype. With the goal of the further clinical application of our model in routine practice to predict clinical outcomes of patients treated with immunotherapies, larger institutional cohorts are needed to validate our model, with the possibility of “face to face” verification of the clinical characteristics and the natural evolution of the disease in every single case. Moreover, this model was constructed from manually delineated ROIs. Although the variability in manual segmentation may cause intra- and inter-reader variability [84], a second delineation was performed by an independent investigator in order to select stable features by computing the ICC. Semi-automated approaches can help reduce this variability but are still reliant on human input [85]. Although automatic segmentation techniques are objective, they may generate errors, especially when images have artifacts and noise and when lesions of interest are highly heterogeneous.

5. Conclusions

In conclusion, we identified a robust radiomic model using an XGBoost classifier to predict gene-expression-based hot and cold phenotypes, which were associated with the clinical benefit of PD1/PD-L1 inhibitors. Overall, this non-invasive-imaging-based approach, called a “virtual biopsy”, could help with the selection of patients for treatment with immunotherapies in different clinical settings: (i) before surgery in order to refine neoadjuvant immunomodulatory strategies based on the hot/cold phenotype and (ii) in patients with recurrent and/or metastatic disease in order to avoid repeated invasive biopsies and/or technically challenging biopsies. Moreover, compared to molecular analysis, the cost-effectiveness of radiomics is a crucial point when considering the incorporation of radiomic signatures/models within future clinical trials for precision medicine.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/cancers15225369/s1, Table S1: Radiomics features used in the analysis; Table S2: Subtypes characteristics in the different datasets; Table S3: 144 radiomic features used for the analysis; Table S4: Performance metrics with XG Boost models to predict the hot/cold phenotype.

Author Contributions

Conceptualization: J.-P.F.; Methodology: T.M.N., J.-E.B. and J.-P.F.; Software: T.M.N. and J.-E.B.; Formal Analysis: T.M.N., J.-E.B. and J.-P.F.; Investigation: T.M.N. and J.-P.F.; Resources: T.M.N., P.S., A.B., P.S. and J.-P.F.; Data Curation: T.M.N., P.G. and J.-E.B.; Writing—Original Draft: T.M.N. and J.-P.F.; Writing—Review and Editing: C.B., P.G., A.B. and P.S.; Visualization: T.M.N. and J.-P.F.; Supervision: J.-P.F. and J.-E.B.; Project Administration: J.-P.F.; Funding Acquisition: J.-P.F. and C.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by a French grant in 2022 from the Fondation de l’Avenir with the support of Assurance Mutuelle des Fonctionnaires (AMF) (project AP-RM-22-016) (JPF). TMN was supported by a French grant from Fondation pour le Recherche Médicale (FRM) and the association Les chirurgiens maxillo-faciaux.

Institutional Review Board Statement

Ethical review was waived for this new study using publicly available data (see data availability statement). We analyzed data from The Cancer Genome Atlas (TCGA) as well as data from a previously published institutional cohort of patients treated at Groupe Hospitalier Pitié-Salpêtrière (GHPS) (1,2).

Informed Consent Statement

Patient consent was waived in this study because we analyzed publicly available clinical and biological data (see data availability statement).

Data Availability Statement

Clinical data as well as gene expression profiles are publicly available from The Cancer Genome Atlas and Gene Expression Omnibus (GSE159067).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bray, F.; Ferlay, J.; Soerjomataram, I.; Siegel, R.L.; Torre, L.A.; Jemal, A. Global Cancer Statistics 2018: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J. Clin. 2018, 68, 394–424. [Google Scholar] [CrossRef] [PubMed]
  2. Ferris, R.L.; Blumenschein, G.; Fayette, J.; Guigay, J.; Colevas, A.D.; Licitra, L.; Harrington, K.; Kasper, S.; Vokes, E.E.; Even, C.; et al. Nivolumab for Recurrent Squamous-Cell Carcinoma of the Head and Neck. N. Engl. J. Med. 2016, 375, 1856–1867. [Google Scholar] [CrossRef] [PubMed]
  3. Seiwert, T.Y.; Burtness, B.; Mehra, R.; Weiss, J.; Berger, R.; Eder, J.P.; Heath, K.; McClanahan, T.; Lunceford, J.; Gause, C.; et al. Safety and Clinical Activity of Pembrolizumab for Treatment of Recurrent or Metastatic Squamous Cell Carcinoma of the Head and Neck (KEYNOTE-012): An Open-Label, Multicentre, Phase 1b Trial. Lancet Oncol. 2016, 17, 956–965. [Google Scholar] [CrossRef] [PubMed]
  4. Haanen, J.B.A.G. Converting Cold into Hot Tumors by Combining Immunotherapies. Cell 2017, 170, 1055–1056. [Google Scholar] [CrossRef]
  5. Galon, J.; Bruni, D. Approaches to Treat Immune Hot, Altered and Cold Tumours with Combination Immunotherapies. Nat. Rev. Drug Discov. 2019, 18, 197–218. [Google Scholar] [CrossRef]
  6. De Guillebon, E.; Dardenne, A.; Saldmann, A.; Séguier, S.; Tran, T.; Paolini, L.; Lebbe, C.; Tartour, E. Beyond the Concept of Cold and Hot Tumors for the Development of Novel Predictive Biomarkers and the Rational Design of Immunotherapy Combination. Int. J. Cancer 2020, 147, 1509–1518. [Google Scholar] [CrossRef]
  7. Foy, J.-P.; Karabajakian, A.; Ortiz-Cuaran, S.; Boussageon, M.; Michon, L.; Bouaoud, J.; Fekiri, D.; Robert, M.; Baffert, K.-A.; Hervé, G.; et al. Immunologically Active Phenotype by Gene Expression Profiling Is Associated with Clinical Benefit from PD-1/PD-L1 Inhibitors in Real-World Head and Neck and Lung Cancer Patients. Eur. J. Cancer 2022, 174, 287–298. [Google Scholar] [CrossRef]
  8. Gillies, R.J.; Anderson, A.R.; Gatenby, R.A.; Morse, D.L. The Biology Underlying Molecular Imaging in Oncology: From Genome to Anatome and Back Again. Clin. Radiol. 2010, 65, 517–521. [Google Scholar] [CrossRef]
  9. Kumar, V.; Gu, Y.; Basu, S.; Berglund, A.; Eschrich, S.A.; Schabath, M.B.; Forster, K.; Aerts, H.J.W.L.; Dekker, A.; Fenstermacher, D.; et al. Radiomics: The Process and the Challenges. Magn. Reson. Imaging 2012, 30, 1234–1248. [Google Scholar] [CrossRef]
  10. Lambin, P.; Rios-Velazquez, E.; Leijenaar, R.; Carvalho, S.; van Stiphout, R.G.; Granton, P.; Zegers, C.M.; Gillies, R.; Boellard, R.; Dekker, A.; et al. Radiomics: Extracting More Information from Medical Images Using Advanced Feature Analysis. Eur. J. Cancer 2012, 48, 441–446. [Google Scholar] [CrossRef]
  11. Foy, J.P.; Durdux, C.; Giraud, P.; Bibault, J.E. RE: The Rise of Radiomics and Implications for Oncologic Management. J. Natl. Cancer Inst. 2018, 110, 1275–1276. [Google Scholar] [CrossRef] [PubMed]
  12. Iv, M.; Zhou, M.; Shpanskaya, K.; Perreault, S.; Wang, Z.; Tranvinh, E.; Lanzman, B.; Vajapeyam, S.; Vitanza, N.A.; Fisher, P.G.; et al. MR Imaging-Based Radiomic Signatures of Distinct Molecular Subgroups of Medulloblastoma. Am. J. Neuroradiol. 2019, 40, 154–161. [Google Scholar] [CrossRef] [PubMed]
  13. Wang, S.; Shi, J.; Ye, Z.; Dong, D.; Yu, D.; Zhou, M.; Liu, Y.; Gevaert, O.; Wang, K.; Zhu, Y.; et al. Predicting EGFR Mutation Status in Lung Adenocarcinoma on Computed Tomography Image Using Deep Learning. Eur. Respir. J. 2019, 53, 1800986. [Google Scholar] [CrossRef] [PubMed]
  14. Han, Y.; Xie, Z.; Zang, Y.; Zhang, S.; Gu, D.; Zhou, M.; Gevaert, O.; Wei, J.; Li, C.; Chen, H.; et al. Non-Invasive Genotype Prediction of Chromosome 1p/19q Co-Deletion by Development and Validation of an MRI-Based Radiomics Signature in Lower-Grade Gliomas. J. Neuro-Oncol. 2018, 140, 297–306. [Google Scholar] [CrossRef] [PubMed]
  15. Gevaert, O.; Xu, J.; Hoang, C.D.; Leung, A.N.; Xu, Y.; Quon, A.; Rubin, D.L.; Napel, S.; Plevritis, S.K. Non-Small Cell Lung Cancer: Identifying Prognostic Imaging Biomarkers by Leveraging Public Gene Expression Microarray Data--Methods and Preliminary Results. Radiology 2012, 264, 387–396. [Google Scholar] [CrossRef] [PubMed]
  16. Carles, M.; Fechter, T.; Grosu, A.L.; Sörensen, A.; Thomann, B.; Stoian, R.G.; Wiedenmann, N.; Rühle, A.; Zamboglou, C.; Ruf, J.; et al. 18 F-FMISO-PET Hypoxia Monitoring for Head-and-Neck Cancer Patients: Radiomics Analyses Predict the Outcome of Chemo-Radiotherapy. Cancers 2021, 13, 3449. [Google Scholar] [CrossRef] [PubMed]
  17. Liu, X.; Long, M.; Sun, C.; Yang, Y.; Lin, P.; Shen, Z.; Xia, S.; Shen, W. CT-Based Radiomics Signature Analysis for Evaluation of Response to Induction Chemotherapy and Progression-Free Survival in Locally Advanced Hypopharyngeal Carcinoma. Eur. Radiol. 2022, 32, 7755–7766. [Google Scholar] [CrossRef]
  18. Joye, I.; Debucquoy, A.; Deroose, C.M.; Vandecaveye, V.; Van Cutsem, E.; Wolthuis, A.; D’Hoore, A.; Sagaert, X.; Zhou, M.; Gevaert, O.; et al. Quantitative Imaging Outperforms Molecular Markers When Predicting Response to Chemoradiotherapy for Rectal Cancer. Radiother. Oncol. 2017, 124, 104–109. [Google Scholar] [CrossRef]
  19. Bibault, J.E.; Giraud, P.; Housset, M.; Durdux, C.; Taieb, J.; Berger, A.; Coriat, R.; Chaussade, S.; Dousset, B.; Nordlinger, B.; et al. Deep Learning and Radiomics Predict Complete Response after Neo-Adjuvant Chemoradiation for Locally Advanced Rectal Cancer. Sci. Rep. 2018, 8, 12611. [Google Scholar] [CrossRef]
  20. Itakura, H.; Achrol, A.S.; Mitchell, L.A.; Loya, J.J.; Liu, T.; Westbroek, E.M.; Feroze, A.H.; Rodriguez, S.; Echegaray, S.; Azad, T.D.; et al. Magnetic Resonance Image Features Identify Glioblastoma Phenotypic Subtypes with Distinct Molecular Pathway Activities. Sci. Transl. Med. 2015, 7, 303ra138. [Google Scholar] [CrossRef]
  21. Gevaert, O.; Mitchell, L.A.; Achrol, A.S.; Xu, J.; Echegaray, S.; Steinberg, G.K.; Cheshier, S.H.; Napel, S.; Zaharchuk, G.; Plevritis, S.K. Glioblastoma Multiforme: Exploratory Radiogenomic Analysis by Using Quantitative Image Features. Radiology 2014, 273, 168–174. [Google Scholar] [CrossRef] [PubMed]
  22. Aerts, H.J.W.L.; Velazquez, E.R.; Leijenaar, R.T.H.; Parmar, C.; Grossmann, P.; Cavalho, S.; Bussink, J.; Monshouwer, R.; Haibe-Kains, B.; Rietveld, D.; et al. Decoding Tumour Phenotype by Noninvasive Imaging Using a Quantitative Radiomics Approach. Nat. Commun. 2014, 5, 4006. [Google Scholar] [CrossRef] [PubMed]
  23. Parmar, C.; Leijenaar, R.T.H.; Grossmann, P.; Velazquez, E.R.; Bussink, J.; Rietveld, D.; Rietbergen, M.M.; Haibe-Kains, B.; Lambin, P.; Aerts, H.J.W.L. Radiomic Feature Clusters and Prognostic Signatures Specific for Lung and Head & Neck Cancer. Sci. Rep. 2015, 5, srep11044. [Google Scholar] [CrossRef]
  24. Parmar, C.; Grossmann, P.; Rietveld, D.; Rietbergen, M.M.; Lambin, P.; Aerts, H.J.W.L. Radiomic Machine-Learning Classifiers for Prognostic Biomarkers of Head and Neck Cancer. Front. Oncol. 2015, 5, 272. [Google Scholar] [CrossRef]
  25. Bogowicz, M.; Riesterer, O.; Ikenberg, K.; Stieb, S.; Moch, H.; Studer, G.; Guckenberger, M.; Tanadini-Lang, S. Computed Tomography Radiomics Predicts HPV Status and Local Tumor Control After Definitive Radiochemotherapy in Head and Neck Squamous Cell Carcinoma. Int. J. Radiat. Oncol. Biol. Phys. 2017, 99, 921–928. [Google Scholar] [CrossRef] [PubMed]
  26. Ou, D.; Blanchard, P.; Rosellini, S.; Levy, A.; Nguyen, F.; Leijenaar, R.T.H.; Garberis, I.; Gorphe, P.; Bidault, F.; Ferté, C.; et al. Predictive and Prognostic Value of CT Based Radiomics Signature in Locally Advanced Head and Neck Cancers Patients Treated with Concurrent Chemoradiotherapy or Bioradiotherapy and Its Added Value to Human Papillomavirus Status. Oral Oncol. 2017, 71, 150–155. [Google Scholar] [CrossRef] [PubMed]
  27. Vallières, M.; Kay-Rivest, E.; Perrin, L.J.; Liem, X.; Furstoss, C.; Aerts, H.J.W.L.; Khaouam, N.; Nguyen-Tan, P.F.; Wang, C.S.; Sultanem, K.; et al. Radiomics Strategies for Risk Assessment of Tumour Failure in Head-and-Neck Cancer. Sci. Rep. 2017, 7, 10117. [Google Scholar] [CrossRef]
  28. Tsai, Y.-L.; Chen, S.-W.; Kao, C.-H.; Cheng, D.-C. Neck Lymph Node Recurrence in HNC Patients Might Be Predicted before Radiotherapy Using Radiomics Extracted from CT Images and XGBoost Algorithm. J. Pers. Med. 2022, 12, 1377. [Google Scholar] [CrossRef]
  29. Mukherjee, P.; Cintra, M.; Huang, C.; Zhou, M.; Zhu, S.; Colevas, A.D.; Fischbein, N.; Gevaert, O. CT-Based Radiomic Signatures for Predicting Histopathologic Features in Head and Neck Squamous Cell Carcinoma. Radiol. Imaging Cancer 2020, 2, e190039. [Google Scholar] [CrossRef]
  30. Zhao, X.; Li, W.; Zhang, J.; Tian, S.; Zhou, Y.; Xu, X.; Hu, H.; Lei, D.; Wu, F. Radiomics Analysis of CT Imaging Improves Preoperative Prediction of Cervical Lymph Node Metastasis in Laryngeal Squamous Cell Carcinoma. Eur. Radiol. 2023, 33, 1121–1131. [Google Scholar] [CrossRef]
  31. Zheng, Y.-M.; Chen, J.; Zhang, M.; Wu, Z.-J.; Tang, G.-Z.; Zhang, Y.; Dong, C. CT Radiomics Nomogram for Prediction of the Ki-67 Index in Head and Neck Squamous Cell Carcinoma. Eur. Radiol. 2023, 33, 2160–2170. [Google Scholar] [CrossRef] [PubMed]
  32. Zheng, Y.-M.; Pang, J.; Liu, Z.-J.; Yuan, M.-G.; Li, J.; Wu, Z.-J.; Jiang, Y.; Dong, C. A CT-Based Deep Learning Radiomics Nomogram for the Prediction of EGFR Mutation Status in Head and Neck Squamous Cell Carcinoma. Acad. Radiol. 2023; in press. [Google Scholar] [CrossRef]
  33. Zwirner, K.; Hilke, F.J.; Demidov, G.; Socarras Fernandez, J.; Ossowski, S.; Gani, C.; Thorwarth, D.; Riess, O.; Zips, D.; Schroeder, C.; et al. Radiogenomics in Head and Neck Cancer: Correlation of Radiomic Heterogeneity and Somatic Mutations in TP53, FAT1 and KMT2D. Strahlenther. Onkol. 2019, 195, 771–779. [Google Scholar] [CrossRef] [PubMed]
  34. Zheng, Y.-M.; Che, J.-Y.; Yuan, M.-G.; Wu, Z.-J.; Pang, J.; Zhou, R.-Z.; Li, X.-L.; Dong, C. A CT-Based Deep Learning Radiomics Nomogram to Predict Histological Grades of Head and Neck Squamous Cell Carcinoma. Acad. Radiol. 2023, 30, 1591–1599. [Google Scholar] [CrossRef] [PubMed]
  35. Lin, C.-H.; Yan, J.-L.; Yap, W.-K.; Kang, C.-J.; Chang, Y.-C.; Tsai, T.-Y.; Chang, K.-P.; Liao, C.-T.; Hsu, C.-L.; Chou, W.-C.; et al. Prognostic Value of Interim CT-Based Peritumoral and Intratumoral Radiomics in Laryngeal and Hypopharyngeal Cancer Patients Undergoing Definitive Radiotherapy. Radiother. Oncol. 2023, 189, 109938. [Google Scholar] [CrossRef] [PubMed]
  36. Huang, T.-T.; Lin, Y.-C.; Yen, C.-H.; Lan, J.; Yu, C.-C.; Lin, W.-C.; Chen, Y.-S.; Wang, C.-K.; Huang, E.-Y.; Ho, S.-Y. Prediction of Extranodal Extension in Head and Neck Squamous Cell Carcinoma by CT Images Using an Evolutionary Learning Model. Cancer Imaging 2023, 23, 84. [Google Scholar] [CrossRef] [PubMed]
  37. Liu, J.; Song, L.; Zhou, J.; Yu, M.; Hu, Y.; Zhang, J.; Song, P.; Ye, Y.; Wang, J.; Feng, G.; et al. Prediction of Prognosis of Tongue Squamous Cell Carcinoma Based on Clinical MR Imaging Data Modeling. Technol. Cancer Res. Treat. 2023, 22, 15330338231207006. [Google Scholar] [CrossRef]
  38. Corti, A.; De Cecco, L.; Cavalieri, S.; Lenoci, D.; Pistore, F.; Calareso, G.; Mattavelli, D.; de Graaf, P.; Leemans, C.R.; Brakenhoff, R.H.; et al. MRI-Based Radiomic Prognostic Signature for Locally Advanced Oral Cavity Squamous Cell Carcinoma: Development, Testing and Comparison with Genomic Prognostic Signatures. Biomark. Res. 2023, 11, 69. [Google Scholar] [CrossRef]
  39. Jiang, S.; Locatello, L.G.; Maggiore, G.; Gallo, O. Radiomics-Based Analysis in the Prediction of Occult Lymph Node Metastases in Patients with Oral Cancer: A Systematic Review. J. Clin. Med. 2023, 12, 4958. [Google Scholar] [CrossRef]
  40. Katsoulakis, E.; Yu, Y.; Apte, A.P.; Leeman, J.E.; Katabi, N.; Morris, L.; Deasy, J.O.; Chan, T.A.; Lee, N.Y.; Riaz, N.; et al. Radiomic Analysis Identifies Tumor Subtypes Associated with Distinct Molecular and Microenvironmental Factors in Head and Neck Squamous Cell Carcinoma. Oral Oncol. 2020, 110, 104877. [Google Scholar] [CrossRef]
  41. Wan, Y.W.; Allen, G.I.; Liu, Z. TCGA2STAT: Simple TCGA Data Access for Integrated Statistical Analysis in R. Bioinformatics 2016, 32, 952–954. [Google Scholar] [CrossRef] [PubMed]
  42. Gao, J.; Aksoy, B.A.; Dogrusoz, U.; Dresdner, G.; Gross, B.E.; Sumer, S.O.; Sun, Y.; Jacobsen, A.; Sinha, R.; Larsson, E.; et al. Integrative Analysis of Complex Cancer Genomics and Clinical Profiles Using the cBioPortal. Sci. Signal 2013, 6, pl1. [Google Scholar] [CrossRef] [PubMed]
  43. Cerami, E.; Gao, J.; Dogrusoz, U.; Gross, B.E.; Sumer, S.O.; Aksoy, B.A.; Jacobsen, A.; Byrne, C.J.; Heuer, M.L.; Larsson, E.; et al. The cBio Cancer Genomics Portal: An Open Platform for Exploring Multidimensional Cancer Genomics Data. Cancer Discov. 2012, 2, 401–404. [Google Scholar] [CrossRef] [PubMed]
  44. Foy, J.P.; Karabajakian, A.; Ortiz-Cuaran, S.; Boussageon, M.; Michon, L.; Bouaoud, J.; Fekiri, D.; Robert, M.; Baffert, K.A.; Hervé, G.; et al. Datasets for Gene Expression Profiles of Head and Neck Squamous Cell Carcinoma and Lung Cancer Treated or Not by PD1/PD-L1 Inhibitors. Data Brief. 2022, 44, 108556. [Google Scholar] [CrossRef] [PubMed]
  45. Hänzelmann, S.; Castelo, R.; Guinney, J. GSVA: Gene Set Variation Analysis for Microarray and RNA-Seq Data. BMC Bioinform. 2013, 14, 7. [Google Scholar] [CrossRef]
  46. Zhang, L.; Fried, D.V.; Fave, X.J.; Hunter, L.A.; Yang, J.; Court, L.E. IBEX: An Open Infrastructure Software Platform to Facilitate Collaborative Work in Radiomics. Med. Phys. 2015, 42, 1341–1353. [Google Scholar] [CrossRef]
  47. Ger, R.B.; Cardenas, C.E.; Anderson, B.M.; Yang, J.; Mackin, D.S.; Zhang, L.; Court, L.E. Guidelines and Experience Using Imaging Biomarker Explorer (IBEX) for Radiomics. J. Vis. Exp. 2018, 2018, e57132. [Google Scholar] [CrossRef]
  48. Plaks, V.; Koopman, C.D.; Werb, Z. Cancer. Circulating Tumor Cells. Science 2013, 341, 1186–1188. [Google Scholar] [CrossRef]
  49. Shrout, P.E.; Fleiss, J.L. Intraclass Correlations: Uses in Assessing Rater Reliability. Psychol. Bull. 1979, 86, 420–428. [Google Scholar] [CrossRef]
  50. Choy, G.; Khalilzadeh, O.; Michalski, M.; Do, S.; Samir, A.E.; Pianykh, O.S.; Geis, J.R.; Pandharipande, P.V.; Brink, J.A.; Dreyer, K.J. Current Applications and Future Impact of Machine Learning in Radiology. Radiology 2018, 288, 318–328. [Google Scholar] [CrossRef]
  51. Browne, M.W. Cross-Validation Methods. J. Math. Psychol. 2000, 44, 108–132. [Google Scholar] [CrossRef] [PubMed]
  52. Ling, C.X.; Huang, J.; Zhang, H. AUC: A Better Measure than Accuracy in Comparing Learning Algorithms. In Proceedings of the Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Springer: Berlin/Heidelberg, Germany, 2003; Volume 2671, pp. 329–341. [Google Scholar]
  53. Lambin, P.; Leijenaar, R.T.H.; Deist, T.M.; Peerlings, J.; de Jong, E.E.C.; van Timmeren, J.; Sanduleanu, S.; Larue, R.; Even, A.J.G.; Jochems, A.; et al. Radiomics: The Bridge between Medical Imaging and Personalized Medicine. Nat. Rev. Clin. Oncol. 2017, 14, 749–762. [Google Scholar] [CrossRef] [PubMed]
  54. Zhu, Y.; Mohamed, A.S.R.; Lai, S.Y.; Yang, S.; Kanwar, A.; Wei, L.; Kamal, M.; Sengupta, S.; Elhalawani, H.; Skinner, H.; et al. Imaging-Genomic Study of Head and Neck Squamous Cell Carcinoma: Associations Between Radiomic Phenotypes and Genomic Mechanisms via Integration of The Cancer Genome Atlas and The Cancer Imaging Archive. JCO Clin. Cancer Inform. 2019, 3, 1–9. [Google Scholar] [CrossRef] [PubMed]
  55. Joye, I.; Debucquoy, A.; Deroose, C.M.; Vandecaveye, V.; Van Cutsem, E.; Wolthuis, A.; D’Hoore, A.; Sagaert, X.; Zhou, M.; Gevaert, O.; et al. Non–Small Cell Lung Cancer Radiogenomics Map Identifies Relationships between Molecular and Imaging Phenotypes with Prognostic Implications. Radiology 2018, 5, 150–155. [Google Scholar] [CrossRef]
  56. Huang, C.; Cintra, M.; Brennan, K.; Zhou, M.; Colevas, A.D.; Fischbein, N.; Zhu, S.; Gevaert, O. Development and Validation of Radiomic Signatures of Head and Neck Squamous Cell Carcinoma Molecular Features and Subtypes. EBioMedicine 2019, 45, 70–80. [Google Scholar] [CrossRef] [PubMed]
  57. Caudell, J.J.; Torres-Roca, J.F.; Gillies, R.J.; Enderling, H.; Kim, S.; Rishi, A.; Moros, E.G.; Harrison, L.B. The Future of Personalised Radiotherapy for Head and Neck Cancer. Lancet Oncol. 2017, 18, e266–e273. [Google Scholar] [CrossRef] [PubMed]
  58. Zheng, Y.-M.; Zhan, J.-F.; Yuan, M.-G.; Hou, F.; Jiang, G.; Wu, Z.-J.; Dong, C. A CT-Based Radiomics Signature for Preoperative Discrimination between High and Low Expression of Programmed Death Ligand 1 in Head and Neck Squamous Cell Carcinoma. Eur. J. Radiol. 2022, 146, 110093. [Google Scholar] [CrossRef]
  59. Zhu, Y.; Wu, M. Noninvasive Radiomic Analysis of Enhanced CT Predicts CTLA4 Expression and Prognosis in Head and Neck Squamous Cell Carcinoma. Sci. Rep. 2023, 13, 16782. [Google Scholar] [CrossRef]
  60. Wang, J.H.; Wahid, K.A.; van Dijk, L.V.; Farahani, K.; Thompson, R.F.; Fuller, C.D. Radiomic Biomarkers of Tumor Immune Biology and Immunotherapy Response. Clin. Transl. Radiat. Oncol. 2021, 28, 97–115. [Google Scholar] [CrossRef]
  61. Tong, H.; Sun, J.; Fang, J.; Zhang, M.; Liu, H.; Xia, R.; Zhou, W.; Liu, K.; Chen, X. A Machine Learning Model Based on PET/CT Radiomics and Clinical Characteristics Predicts Tumor Immune Profiles in Non-Small Cell Lung Cancer: A Retrospective Multicohort Study. Front. Immunol. 2022, 13, 859323. [Google Scholar] [CrossRef]
  62. Adams, S.; Gatti-Mays, M.E.; Kalinsky, K.; Korde, L.A.; Sharon, E.; Amiri-Kordestani, L.; Bear, H.; McArthur, H.L.; Frank, E.; Perlmutter, J.; et al. Current Landscape of Immunotherapy in Breast Cancer: A Review. JAMA Oncol. 2019, 5, 1205–1214. [Google Scholar] [CrossRef] [PubMed]
  63. Tang, C.; Hobbs, B.; Amer, A.; Li, X.; Behrens, C.; Canales, J.R.; Cuentas, E.P.; Villalobos, P.; Fried, D.; Chang, J.Y.; et al. Development of an Immune-Pathology Informed Radiomics Model for Non-Small Cell Lung Cancer. Sci. Rep. 2018, 8, 1922. [Google Scholar] [CrossRef] [PubMed]
  64. Feng, Z.; Li, H.; Liu, Q.; Duan, J.; Zhou, W.; Yu, X.; Chen, Q.; Liu, Z.; Wang, W.; Rong, P. CT Radiomics to Predict Macrotrabecular-Massive Subtype and Immune Status in Hepatocellular Carcinoma. Radiology 2023, 307, e221291. [Google Scholar] [CrossRef] [PubMed]
  65. Khalili, N.; Kazerooni, A.F.; Familiar, A.; Haldar, D.; Kraya, A.; Foster, J.; Koptyra, M.; Storm, P.B.; Resnick, A.C.; Nabavizadeh, A. Radiomics for Characterization of the Glioma Immune Microenvironment. npj Precis. Oncol. 2023, 7, 59. [Google Scholar] [CrossRef] [PubMed]
  66. Sun, R.; Henry, T.; Laville, A.; Carré, A.; Hamaoui, A.; Bockel, S.; Chaffai, I.; Levy, A.; Chargari, C.; Robert, C.; et al. Imaging Approaches and Radiomics: Toward a New Era of Ultraprecision Radioimmunotherapy? J. Immunother. Cancer 2022, 10, e004848. [Google Scholar] [CrossRef]
  67. Kang, C.Y.; Duarte, S.E.; Kim, H.S.; Kim, E.; Park, J.; Lee, A.D.; Kim, Y.; Kim, L.; Cho, S.; Oh, Y.; et al. Artificial Intelligence-Based Radiomics in the Era of Immuno-Oncology. Oncologist 2022, 27, e471–e483. [Google Scholar] [CrossRef]
  68. Tanadini-Lang, S.; Balermpas, P.; Guckenberger, M.; Pavic, M.; Riesterer, O.; Vuong, D.; Bogowicz, M. Radiomic Biomarkers for Head and Neck Squamous Cell Carcinoma. Strahlenther. Onkol. 2020, 196, 868–878. [Google Scholar] [CrossRef]
  69. Sun, R.; Limkin, E.J.; Vakalopoulou, M.; Dercle, L.; Champiat, S.; Han, S.R.; Verlingue, L.; Brandao, D.; Lancia, A.; Ammari, S.; et al. A Radiomics Approach to Assess Tumour-Infiltrating CD8 Cells and Response to Anti-PD-1 or Anti-PD-L1 Immunotherapy: An Imaging Biomarker, Retrospective Multicohort Study. Lancet Oncol. 2018, 19, 1180–1191. [Google Scholar] [CrossRef]
  70. Wang, F.; Zhang, W.; Chai, Y.; Wang, H.; Liu, Z.; He, Y. Constrast-Enhanced Computed Tomography Radiomics Predicts CD27 Expression and Clinical Prognosis in Head and Neck Squamous Cell Carcinoma. Front. Immunol. 2022, 13, 1015436. [Google Scholar] [CrossRef]
  71. Chen, R.-Y.; Lin, Y.-C.; Shen, W.-C.; Hsieh, T.-C.; Yen, K.-Y.; Chen, S.-W.; Kao, C.-H. Associations of Tumor PD-1 Ligands, Immunohistochemical Studies, and Textural Features in 18F-FDG PET in Squamous Cell Carcinoma of the Head and Neck. Sci. Rep. 2018, 8, 105. [Google Scholar] [CrossRef]
  72. Tramm, T.; Di Caterino, T.; Jylling, A.-M.B.; Lelkaitis, G.; Lænkholm, A.-V.; Ragó, P.; Tabor, T.P.; Talman, M.-L.M.; Vouza, E. Scientific Committee of Pathology, Danish Breast Cancer Group (DBCG) Standardized Assessment of Tumor-Infiltrating Lymphocytes in Breast Cancer: An Evaluation of Inter-Observer Agreement between Pathologists. Acta Oncol. 2018, 57, 90–94. [Google Scholar] [CrossRef] [PubMed]
  73. Gu, Y.; Huang, H.; Tong, Q.; Cao, M.; Ming, W.; Zhang, R.; Zhu, W.; Wang, Y.; Sun, X. Multi-View Radiomics Feature Fusion Reveals Distinct Immuno-Oncological Characteristics and Clinical Prognoses in Hepatocellular Carcinoma. Cancers 2023, 15, 2338. [Google Scholar] [CrossRef] [PubMed]
  74. Duan, J.; Zhang, Z.; Chen, Y.; Zhao, Y.; Sun, Q.; Wang, W.; Zheng, H.; Liang, D.; Cheng, J.; Yan, J.; et al. Imaging Phenotypes from MRI for the Prediction of Glioma Immune Subtypes from RNA Sequencing: A Multicenter Study. Mol. Oncol. 2023, 17, 629–646. [Google Scholar] [CrossRef] [PubMed]
  75. Wu, J.; Mayer, A.T.; Li, R. Integrated Imaging and Molecular Analysis to Decipher Tumor Microenvironment in the Era of Immunotherapy. Semin. Cancer Biol. 2022, 84, 310–328. [Google Scholar] [CrossRef] [PubMed]
  76. Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. arXiv 2016, arXiv:1603.02754. [Google Scholar]
  77. Shi, Y.; Zou, Y.; Liu, J.; Wang, Y.; Chen, Y.; Sun, F.; Yang, Z.; Cui, G.; Zhu, X.; Cui, X.; et al. Ultrasound-Based Radiomics XGBoost Model to Assess the Risk of Central Cervical Lymph Node Metastasis in Patients with Papillary Thyroid Carcinoma: Individual Application of SHAP. Front. Oncol. 2022, 12, 897596. [Google Scholar] [CrossRef]
  78. Li, J.; Shi, Z.; Liu, F.; Fang, X.; Cao, K.; Meng, Y.; Zhang, H.; Yu, J.; Feng, X.; Li, Q.; et al. XGBoost Classifier Based on Computed Tomography Radiomics for Prediction of Tumor-Infiltrating CD8+ T-Cells in Patients with Pancreatic Ductal Adenocarcinoma. Front. Oncol. 2021, 11, 671333. [Google Scholar] [CrossRef] [PubMed]
  79. Wang, X.; You, X.; Zhang, L.; Huang, D.; Aramini, B.; Shabaturov, L.; Jiang, G.; Fan, J. A Radiomics Model Combined with XGBoost May Improve the Accuracy of Distinguishing between Mediastinal Cysts and Tumors: A Multicenter Validation Analysis. Ann. Transl. Med. 2021, 9, 1737. [Google Scholar] [CrossRef]
  80. Song, B.-I. A Machine Learning-Based Radiomics Model for the Prediction of Axillary Lymph-Node Metastasis in Breast Cancer. Breast Cancer 2021, 28, 664–671. [Google Scholar] [CrossRef]
  81. Fournier, L.; Costaridou, L.; Bidaut, L.; Michoux, N.; Lecouvet, F.E.; de Geus-Oei, L.-F.; Boellaard, R.; Oprea-Lager, D.E.; Obuchowski, N.A.; Caroli, A.; et al. Incorporating Radiomics into Clinical Trials: Expert Consensus Endorsed by the European Society of Radiology on Considerations for Data-Driven Compared to Biologically Driven Quantitative Biomarkers. Eur. Radiol. 2021, 31, 6001–6012. [Google Scholar] [CrossRef]
  82. Narang, S.; Kim, D.; Aithala, S.; Heimberger, A.B.; Ahmed, S.; Rao, D.; Rao, G.; Rao, A. Tumor Image-Derived Texture Features Are Associated with CD3 T-Cell Infiltration Status in Glioblastoma. Oncotarget 2017, 8, 101244–101254. [Google Scholar] [CrossRef]
  83. Mackin, D.; Fave, X.; Zhang, L.; Fried, D.; Yang, J.; Taylor, B.; Rodriguez-Rivera, E.; Dodge, C.; Jones, A.K.; Court, L. Measuring Computed Tomography Scanner Variability of Radiomics Features. Investig. Radiol. 2015, 50, 757–765. [Google Scholar] [CrossRef]
  84. Kocak, B.; Durmaz, E.S.; Kaya, O.K.; Ates, E.; Kilickesmez, O. Reliability of Single-Slice-Based 2D CT Texture Analysis of Renal Masses: Influence of Intra- and Interobserver Manual Segmentation Variability on Radiomic Feature Reproducibility. Am. J. Roentgenol. 2019, 213, 377–383. [Google Scholar] [CrossRef]
  85. Larue, R.T.H.M.; Defraene, G.; De Ruysscher, D.; Lambin, P.; Van Elmpt, W. Quantitative Radiomics Studies for Tissue Characterization: A Review of Technology and Methodological Procedures. Br. J. Radiol. 2017, 90, 20160665. [Google Scholar] [CrossRef]
Cancers 15 05369 g003
Figure 3. Best XGBoost prediction model of the HOT–COLD phenotype in the GHPS cohort. (a) Confusion matrix. (b) ROC curve and precision–recall curve. (c) Performance metrics values.
Figure 3. Best XGBoost prediction model of the HOT–COLD phenotype in the GHPS cohort. (a) Confusion matrix. (b) ROC curve and precision–recall curve. (c) Performance metrics values.
Cancers 15 05369 g003
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Nguyen, T.M.; Bertolus, C.; Giraud, P.; Burgun, A.; Saintigny, P.; Bibault, J.-E.; Foy, J.-P. A Radiomics Approach to Identify Immunologically Active Tumor in Patients with Head and Neck Squamous Cell Carcinomas. Cancers 2023, 15, 5369. https://doi.org/10.3390/cancers15225369

AMA Style

Nguyen TM, Bertolus C, Giraud P, Burgun A, Saintigny P, Bibault J-E, Foy J-P. A Radiomics Approach to Identify Immunologically Active Tumor in Patients with Head and Neck Squamous Cell Carcinomas. Cancers. 2023; 15(22):5369. https://doi.org/10.3390/cancers15225369

Chicago/Turabian Style

Nguyen, Tan Mai, Chloé Bertolus, Paul Giraud, Anita Burgun, Pierre Saintigny, Jean-Emmanuel Bibault, and Jean-Philippe Foy. 2023. "A Radiomics Approach to Identify Immunologically Active Tumor in Patients with Head and Neck Squamous Cell Carcinomas" Cancers 15, no. 22: 5369. https://doi.org/10.3390/cancers15225369

APA Style

Nguyen, T. M., Bertolus, C., Giraud, P., Burgun, A., Saintigny, P., Bibault, J. -E., & Foy, J. -P. (2023). A Radiomics Approach to Identify Immunologically Active Tumor in Patients with Head and Neck Squamous Cell Carcinomas. Cancers, 15(22), 5369. https://doi.org/10.3390/cancers15225369

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop