Next Article in Journal
From Head and Neck Tumour and Lymph Node Segmentation to Survival Prediction on PET/CT: An End-to-End Framework Featuring Uncertainty, Fairness, and Multi-Region Multi-Modal Radiomics
Next Article in Special Issue
18F-FDG PET-Derived Volume-Based Parameters to Predict Disease-Free Survival in Patients with Grade III Breast Cancer of Different Molecular Subtypes Candidates to Neoadjuvant Chemotherapy
Previous Article in Journal
Diagnosis and Treatment of Peripheral and Cranial Nerve Tumors with Expert Recommendations: An EUropean Network for RAre CANcers (EURACAN) Initiative
Previous Article in Special Issue
Qualitative and Semiquantitative Parameters of 18F-FDG-PET/CT as Predictors of Malignancy in Patients with Solitary Pulmonary Nodule
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Characterization of Mediastinal Bulky Lymphomas with FDG-PET-Based Radiomics and Machine Learning Techniques

by
Elisabetta Maria Abenavoli
1,*,†,
Matteo Barbetti
2,3,†,
Flavia Linguanti
1,
Francesco Mungai
4,
Luca Nassi
5,
Benedetta Puccini
5,
Ilaria Romano
5,
Benedetta Sordi
5,6,
Raffaella Santi
7,
Alessandro Passeri
1,
Roberto Sciagrà
1,
Cinzia Talamonti
3,8,
Angelina Cistaro
9,10,*,
Alessandro Maria Vannucchi
6 and
Valentina Berti
1
1
Nuclear Medicine Unit, Department of Experimental and Clinical Biomedical Sciences ‘Mario Serio’, University of Florence, 50139 Florence, Italy
2
Department of Information Engineering, University of Florence, 50134 Florence, Italy
3
Istituto Nazionale di Fisica Nucleare (INFN), Florence Division, 50019 Sesto Fiorentino, Italy
4
Department of Radiology, Azienda Ospedaliero Universitaria Careggi, 50139 Florence, Italy
5
Hematology Department, Azienda Ospedaliero Universitaria Careggi, University of Florence, 50139 Florence, Italy
6
Department of Experimental and Clinical Medicine, CRIMM, Center Research and Innovation of Myeloproliferative Neoplasms, Azienda Ospedaliera Universitaria Careggi, University of Florence, 50139 Florence, Italy
7
Pathology Section, Department of Health Sciences, University of Florence, 50139 Florence, Italy
8
Medical Physics Unit, Department of Experimental and Clinical Biomedical Sciences ‘Mario Serio’, University of Florence, 50139 Florence, Italy
9
Nuclear Medicine Department, Salus Alliance Medical, 16128 Genoa, Italy
10
Pediatric Study Group for Italian Association of Nuclear Medicine (AIMN), 20159 Milan, Italy
*
Authors to whom correspondence should be addressed.
E.M.A. and M.B. contributed equally.
Cancers 2023, 15(7), 1931; https://doi.org/10.3390/cancers15071931
Submission received: 30 January 2023 / Revised: 11 March 2023 / Accepted: 20 March 2023 / Published: 23 March 2023

Abstract

:

Simple Summary

This manuscript aims to address the diagnostic challenges of mediastinal bulky lymphomas with the baseline value of 18F-FDG PET/CT metabolic, volumetric and texture parameters, also relying on machine learning techniques, in patients with grey zone lymphoma, primary diffuse large B-cell lymphoma of the mediastinum and classical Hodgkin lymphoma. Different types of histology demonstrated several baseline 18F-FDG PET/CT radiomics parameters that were significantly different from one another, suggesting the possibility of identifying potential histological heterogeneity and aggressive transformation. Moreover, using radiomics-based imaging biomarkers, machine learning techniques offer a solution for separating not completely disjoint histological types. To date, the gold standard for diagnosis is biopsy, but machine learning methods could be combined with radiomics to build a histological representation of mediastinal bulky masses that is able to successfully identify different types of lymphomas. Finally, this preliminary study supports the potential of metabolic texture analyses as future imaging biomarkers, with a growing role in clinical diagnosis.

Abstract

Background: This study tested the diagnostic value of 18F-FDG PET/CT (FDG-PET) volumetric and texture parameters in the histological differentiation of mediastinal bulky disease due to classical Hodgkin lymphoma (cHL), primary mediastinal B-cell lymphoma (PMBCL) and grey zone lymphoma (GZL), using machine learning techniques. Methods: We reviewed 80 cHL, 29 PMBCL and 8 GZL adult patients with mediastinal bulky disease and histopathological diagnoses who underwent FDG-PET pre-treatment. Volumetric and radiomic parameters were measured using FDG-PET both for bulky lesions (BL) and for all lesions (AL) using LIFEx software (threshold SUV ≥ 2.5). Binary and multiclass classifications were performed with various machine learning techniques fed by a relevant subset of radiomic features. Results: The analysis showed significant differences between the lymphoma groups in terms of SUVmax, SUVmean, MTV, TLG and several textural features of both first- and second-order grey level. Among machine learning classifiers, the tree-based ensembles achieved the best performance both for binary and multiclass classifications in histological differentiation. Conclusions: Our results support the value of metabolic heterogeneity as an imaging biomarker, and the use of radiomic features for early characterization of mediastinal bulky lymphoma.

1. Introduction

The presence of a mediastinal bulky mass at the time of diagnosis in patients with lymphoma is a poor prognostic factor in treatment response and overall survival [1,2,3,4]. Therefore, an accurate characterization of the bulky mass is crucial and represents a diagnostic challenge in clinical and imaging evaluation.
Despite the similarities in clinical presentation, the treatment strategies and outcomes are highly different among the most common mature B-cell lymphomas associated with mediastinal bulky masses, which are classical Hodgkin lymphoma (cHL), primary mediastinal B-cell lymphoma (PMBCL) and grey zone lymphoma (GZL). Since the treatment approaches for cHL and PMBCL are historically different, correctly differentiating their histology is of paramount importance, even if it often represents a non-trivial task. GZL is an uncommon, unclassifiable B-cell lymphoma, with intermediate features between diffuse large B-cell lymphoma and cHL. Furthermore, a spectrum of morphologies with features of cHL and PMBL can occur in GZL. In addition, the same lymphoma type could exhibit not only clinical behavioral differences, but also intra-tumor heterogeneities, reflecting different cell subpopulations distributed in different regions of the same lesion. Both inter- and intra-patient heterogeneity may be found, varying with the histopathological pattern of the lymphoma, resulting in a different prognosis [5].
In this scenario, morphological and functional imaging represents a fundamental diagnostic method to fully characterize bulky mediastinal lymphoma. Nowadays, FDG-PET is considered an indispensable tool for staging and defining the treatment response in different lymphomas. Its value derives both from the intrinsic ability to quantify the use of glucose as a local functional activity, providing information on specific metabolic patterns, and from the continuous refinement of many methodological and interpretative aspects such as metabolic semi-quantification and volumetric parameters as SUV, MTV and TLG [1,2,6,7].
Radiomics is a quantitative approach to medical imaging based on the assumption that biomedical images contain information of disease-specific processes that human eyes cannot detect. It provides several image properties that can be used to characterize tumor phenotypes and support clinical decision-making in a non-invasive manner [8]. Furthermore, texture analysis (TA) quantitively estimates intra-tumor heterogeneity, reflecting the heterogeneities in the distribution of cell subpopulations [9]. Radiomics deeply benefits from the progress achieved by the machine learning (ML) community, relying on state-of-the-art algorithms for medical image segmentation [10,11,12], for the extraction of imaging biomarkers or even for the analysis of textural radiomic signatures [13,14,15]. In the era of precision medicine and personalized treatment [16], metabolic texture analyses may become the future imaging biomarker, with prognostic and predictive values [17].
We assessed the diagnostic value of metabolic FDG-PET and TA in the differentiation of the most common mature B-cell lymphomas associated with mediastinal bulky masses due to cHL, PMBCL and GZL. Then, using radiomic features to feed ML algorithms, we aimed to build a radiomics-based histological representation of mediastinal bulky masses despite the presence of not completely disjoint lymphoma types.

2. Materials and Methods

2.1. Population

From January 2010 to April 2021, a cohort of untreated patients with a histopathological diagnosis of cHL, PMBCL or GZL were retrospectively evaluated in a monocentric study conducted by both the Nuclear Medicine and Hematology Divisions of Azienda Ospedaliero-Universitaria Careggi (Florence, Italy). Eligibility criteria included ≥18 years, histologically proven cHL, PMBCL and GZL, and the presence of mediastinal bulky disease with diameter ≥5 cm in a computed tomography scan and FDG-PET at baseline (Figure 1). Relapse or refractory patients were excluded from the study. The study was approved by the Institutional Ethics Review Board of the center, and all patients provided written informed consent. The study was conducted according to the Helsinki Declaration, good clinical practice and the applicable national regulations.

2.2. Image Acquisition

All patients fasted for at least 4 h before examination, with blood glucose levels < 170 mg/dL. Images from the mid-skull to pelvis were obtained using a dedicated PET/CT scanner (Philips Gemini TF 16 PET/CT), 60 min after intravenous injection of 3.7 MBq/kg of 18F-FDG. Before the PET scans, a low-dose CT (120 kV; 50–80 mA) was acquired to allow attenuation correction and lesion localization. PET images were reconstructed using an iterative algorithm (3D LOR RAMLA reconstruction with TOF, FOV: 576, matrix: 144 × 144, voxel dimension: 4 × 4 × 4 mm). Fused images of matching pairs of PET and CT images were available for review in axial, coronal and sagittal planes and in maximum intensity projections (MIPs).

2.3. Data Analysis

FDG-PET images were independently evaluated by two nuclear medicine experts, using the open-source software LIFEx 6.3 (www.lifexsoft.org accessed from January 2020 to August 2021) that enables the computation of conventional, histogram-based textural and shape characteristics from medical images [18]. Each measurement was performed using the SUV thresholding method, based on the absolute SUV value > 2.5 on a bulky lesion (BL) [19].
The SUVmax and SUVmean of the BL were also evaluated, computed in SUVbw units for both variables. The segmentation was performed using the default settings suggested by the LIFEx user guide. Regions containing only physiological FDG uptake were edited out. For each bulky lesion, metabolic tumor volume (MTV) and tumor lesion glycolysis (TLG) were computed.

2.4. Texture Analysis

The features defined as first-order and second-order were extracted on the BL VOI using LIFEx software [18]. First-order features are typically drawn from the histogram of grey-level values obtained from the considered VOIs. They describe the overall signal variation in the VOI regardless of the relative position of the voxels. Therefore, these features are invariant to geometric transformations, and robust to image reconstruction and filtering. They include basic statistics such as mean, median, range, standard deviation, skewness and kurtosis.
Second-order features are those that are usually referred to as texture features, since they consider the spatial relationship between neighboring VOIs in an image; thus, they are capable of capturing details on lesion heterogeneity. They include the grey-level co-occurrence matrix (GLCM), the neighborhood grey-level different matrix (NGLDM), the grey-level run-length matrix (GLRLM) and the grey-level zone-length matrix (GLZLM), and indices from sphericity and histogram. A detailed description of the various texture parameters provided by LIFEx can be found at www.lifexsoft.org accessed from January 2020 to August 2021.
The conventional and advanced metabolic tumor parameters as well as the radiomics features assessed are summarized in Table 1.

2.5. Machine Learning

GZL exhibits mixed characteristics between cHL and PMBCL. This represents a major difficulty in the differentiation of the three mediastinal lymphoma types. Particularly, it prevents the direct performing of multiclass classifications. To build a representation of mediastinal lymphomas that considers this limitation, the ML study was divided into two steps:
  • Training a model to perform a binary classification between cHL and PMBCL;
  • Promoting the trained model to cope with a multiclass classification.
Since it was a preliminary study, several ML strategies were compared in order to assess their capability to build a reliable histological representation for the three lymphoma types. The performance of logistic regression, support vector machine (with linear kernel), Gaussian process, random forest and gradient-boosted decision trees (BDT) are discussed in the following sections of this document.
The ML classifiers were trained on a sample of the study cohort containing 80% of patients, namely the training set. The model training was driven by an independent and robust subset of the radiomic features extracted from LIFEx [18]. Feature importance was measured with the recursive feature elimination (RFE) algorithm [20]. When possible, hyperparameter optimization (HPO) was used to enhance the discriminant capabilities of binary classifiers. In particular, HPO studies were carried out using Bayesian optimization methods [21,22] to maximize the AUC score obtained by tree-based ensemble models in an independent subset of the training set (validation set).
The performance of both binary and multiclass classifiers was evaluated with the AUC score computed on a separate sample containing 20% of never-seen patients, namely the test set. Given the limited statistic of the study, preventing models from overtraining and controlling possible bias is crucial. Thus, the robustness of the trained classifiers and the uncertainties associated with their performance were measured through the bootstrap technique. The various ML models were implemented in Python (the code for our models is available at https://github.com/mbarbetti/mediastinal-lymphoma-classification) using the Scikit-Learn package [23], while the Bayesian optimization of the tree-based ensembles was driven by the Optuna framework [24].
Following what was undertaken by Montes de Jesus et al. [25], the performance achieved by the trained classifiers was compared to what was obtained using the SUVmax parameter alone, which was used as a baseline for the benchmark studies.
Before training any model, an intense data cleaning was performed, keeping only a limited number of the radiomic features extracted from LIFEx [18]. The intensity-based features were selected to ensure highly independent parameters (|PCC| > 0.75) and to provide the SUVmax value. The texture features were taken in line with Orlhac et al. [26], selecting the indices robust to segmentation and relatively independent from one another. Lastly, to test the discriminant power of each feature, a Mann-Whitney U test [27] was performed on the chosen subset, requiring a confidence level of 99% to reject the null hypothesis. A complete list of the selected features is reported in Figure 2 together with a probabilistic estimation of the relative ranking computed after 100 iterations of the RFE algorithm on the logistic regression training.

2.6. Statistical Analysis

Statistical analysis was performed with SPSS software (SPSS25) by means of ANOVA to evaluate the differences between means among measured variables. Quantitative data are presented as the mean  ±  standard deviation (SD). p value < 0.05 was considered significant.

3. Results

3.1. Patients

One-hundred-seventeen histologically proven patients were included in the study (Table 2). Twenty-nine patients were PMBCL (24.8%), 80 (68.4%) were cHL, and 8 (6.8%) were GZL. The median age for PMBCL was 40 years (range, 21–59), for cHL it was 33 years (range, 18–74) in the 73 available patients, and for GZL it was 47 years (range, 18–60). The median largest mediastinal diameter measured for PMBCL was 11.0 cm (range, 6.5–17), 8.9 cm (range, 5–20) in cHL patients and 13.5 cm (range, 5–16) in GZL patients.

3.2. Radiomic Features

Several metabolic and volumetric indices, as well as texture features, were significantly different among the three groups. SUVmax and TLG were significantly different between groups, with the highest values in PMBCL, intermediate in GZL and lowest in cHL (Figure 3). PMBCL and GZL had similar MTV values, but they were significantly higher than cHL.
Among first-order variables, histogram skewness and kurtosis were significantly different between groups (p < 0.001). PMBCL showed significantly lower values with respect to the other groups, indicating asymmetrical histograms with left-sided skewness. On the contrary, cHL showed significantly higher positive values than the other groups, indicating asymmetrical histograms with right-sided skewness.
Regarding kurtosis, cHL showed significantly higher kurtosis values, indicating a value distribution with a heavier tail as compared to PMBCL, which showed significantly lower kurtosis values.
Among the features extracted from NGLDM, only contrast resulted significantly different between groups, with PMBCL showing significantly higher contrast than GZL and cHL, and GZL significantly higher than cHL.
In the GLZLM matrix, GLZLM_SZE, GLZLM_HGZE, GLZLM_SZHE and GLZLM_ZLNU parameters showed significantly increasing values between groups, with lower values in cHL, intermediate values in GZ and higher values in PMBCL. On the contrary, GLZLM_LZE, GLZLM_LGZE and GLZLM_SZLGE parameters showed significantly decreasing values between groups, with significantly higher values in cHL, as compared to both GZL and PMBCL (Figure 4).
GLCM features showed significantly different results between groups: variance, entropy and dissimilarity showed lower values in cHL, higher values in PMBCL and intermediate values in GZL. On the contrary, GLCM homogeneity resulted significantly lower in cHL, intermediate in GZL and higher in PMBCL.
Among the GLRLM features, GLRLM_LRE, GLRLM_LRLGE, GLRLM_SRLGE, GLRLM_HGRE and GLRLM_RP showed significantly lower values in cHL, intermediate values in GZL and higher values in PMBCL. Instead, in GLRLM_ SRHGE and GLRLM_ SRE, higher values were seen in cHL, with intermediate values in GZL and lower values in PMBCL. Regarding GLRLM_RLNU, PMBCL and GZL showed similar values, both significantly higher than cHL.

3.3. Machine Learning

The use of ML techniques assumes that the training set is statistically significant, not only in terms of instance multiplicity but also in terms of the discriminant power brought by each instance. The first step of the ML study was the separation between cHL and PMBCL. Since the patient cohort dataset was highly unbalanced, the SMOTE technique [28] was applied to the training set to boost the lower-represented class through over-sampling and to prevent models from overtraining. The five classifiers were trained over such SMOTE-corrected sample, while their performance was evaluated using the unbalanced test set. The true positive rate (TPR, also known as sensitivity or recall), true negative rate (TNR, also called specificity), positive predictive value (PPV, also referred to as precision), AUC-ROC (AUC) and AUC-PR (AP) scores of different classifiers are listed in Table 3. Figure 5 reports the ROC curves (left) and the precision-recall curves (right), together with the corresponding AUC and AP scores. The TPR and TNR scores were computed using two custom decision thresholds chosen to require strict performance in output to the classifiers; in particular, the scores reported in Table 3 correspond to a TPR score greater than 0.7 and 0.9 on the training set. The random forest classifier achieved the best performance with an AUC score of 0.87 against the 0.78 score achieved by the SUVmax-based classifier.
The next step of the ML study was the promotion of the five binary classifiers to include GZL within the available classes. Since GZL can be described as a sort of classification uncertainty between cHL and PMBCL, its representation can be implemented by cutting out a decision boundary in the space induced by the trained models between the regions depicting the two separate classes. The one-vs-all TPR, TNR, PPV, AUC and AP scores for GZL and PMBCL of promoted classifiers are listed in Table 4. Figure 6 reports the one-vs-all ROC curves (left) and precision-recall curves (right), together with the corresponding AUC and AP scores for the GZL classification. Similar curves and scores are depicted in Figure 7 for the PMBCL classification. Again, the random forest classifier achieved the best performance with one-vs-all AUC scores of (0.68, 0.78) against the (0.77, 0.70) totaled by the SUVmax-based classifier.

4. Discussion

This study showed the diagnostic value of FDG-PET volumetric and texture parameters in discriminating mediastinal bulky lymphomas caused by different histological types, i.e., GZL, PMBCL and cHL.
Among conventional quantitative variables, SUV measurements showed significantly different results between the three lymphoma types, with lower values in cHL, intermediate in GZL and higher in PMBCL.
SUVs have been the first and most investigated measures to provide objective quantification of tumor biological activity. Several studies in lymphoma patients correlated FDG activity with tumor proliferative ability, demonstrating that high-proliferative lymphomas, such as PMBCL, often show very high metabolic activity [29,30,31]. Our results are consistent with these findings, confirming that differences in proliferation activity may be a possible explanation for the different FDG uptakes between various histo-types. Moreover, both SUVmax and SUVmean values were significantly lower in cHL compared with NHL, consistent with its peculiar neoplastic tissue architecture, composed of few and scattered neoplastic cells called Hodgkin and Reed-Sternberg cells, accounting for less than 1% of the total cell count, surrounded by an overwhelming population of non-neoplastic mononuclear bystander cells with relatively high metabolism [32,33,34,35]. Such unique pathological features may explain the differences in metabolic activity of cHL compared to PMBCL. Finally, we found an intermediate behavior in the GZL group, again consistent with its biological characteristics. Indeed, GZL could show a wide range of cell types, with the coexistence of cells resembling HRS cells, cells with centroblastic or immunoblastic cytology and marked nuclear pleomorphism, and cells with more monomorphic cytology, resembling PMBCL [36].
Beyond SUV values, there were also significant differences among lymphoma types regarding volume-based variables, such as MTV and TLG. MTV represents one important prognostic factor in lymphoma, in addition to stage and the other clinical factors such as LDH, performance status, age and presence of extra-nodal disease. Not surprisingly, most studies have demonstrated that MTV was an adverse prognostic factor, regardless of lymphoma histology and choice of quantification method [37,38,39,40].
Our data are in line with the concept that volumetric parameters have greater values in aggressive histo-types. Indeed, in our study, PMBCL and GZL showed higher values of both MTV and TLG than cHL, but at the same time PMBCL significantly differs from GZL due to the higher value of TLG.
One of the most interesting findings is the significant difference between lymphoma types regarding several texture features extracted from FDG-PET images. Metabolic heterogeneity is a remarkable feature of malignancy, and texture analysis provides tools for its quantification [41]. In recent years, several studies convincingly showed the complex relationship between textural features and biological characteristics of a tissue and how the spatial intensity variations found in an image could differ depending on biological processes. This association has been found to be more robust for high-order features, which refer to the relative distribution of intensity value within the neighborhood, than first-order variables, which only measure intensity variability independently of the underlying spatial distribution in the tumor microenvironment. Those features measuring increasing heterogeneity within tumors may be associated with differences in regional tumor cellularity, proliferation, hypoxia, angiogenesis and necrosis, but also genomic variety, factors that independently have been associated with more aggressive behavior, poorer response to treatment and worse prognosis [42,43,44]. We chose to focus on patients presenting with mediastinal bulky lymphomas since it is well established that the complementary information provided by textural analysis strongly depends on tumor size. Although information increases substantially with larger volumes, the level of correlation between the variables tends to decrease substantially [36,45].
In our study, the high co-occurrence features, analyzing inter-relationships between pairs of voxels and thus characterizing local non-uniformities, were able to significantly differentiate the three lymphoma groups. Orlhac et al. [46] reported that low grey-level zone emphasis exhibited higher values in visually homogeneous lesions than in heterogeneous lesions. They identified two different sets of texture indices able to reflect the different characteristics of uptake heterogeneity. The first included GLCM_homogeneity, GLCM_entropy, GLRLM_SRE and GLRLM_LRE, all of which were sensitive to the presence of uptake heterogeneity, in absence of the influence of the nature of the heterogeneity (hyposignal or hypersignal). The second comprised GLZLM_HZE and GLZLM_LZE, which were mostly sensitive to the average uptake rather than to the local heterogeneity uptake. So, homogeneous lesions like cHL had a higher value of homogeneity and GLZM_LGZE and a lower value of entropy and GLZM_HGZE than heterogeneous lesions such as PMBCL and GZL. As expected, entropy, which reflects disorder, varies in the opposite direction to homogeneity. Another important aspect is how SUV measurements and entropy are strongly correlated [47,48]. Since the more chaotic the image, the greater the entropy will be, this is reflected in the trend of our results, too, with higher values in PMBCL and lower values in cHL [8,49].
The other features evaluated in this study highlight tumor heterogeneity, depending on the type of matrix used and the kind of feature computed on this matrix. Consequently, whereas a single feature cannot be directly linked to a specific biological process, one could assume that a combination of textural parameters may be closely related to underlying pathophysiological processes, such as vascularization, neoangiogenesis, tumor aggressiveness or hypoxia [50,51].
Finally, referring to the GLZM matrix, the “Zone-Length Non-Uniformity”, which measures the variability of the intensity values of the grey-level in the image, showed lower values, indicating greater homogeneity in the intensity values as in the cHL and instead very high values in the PMBCL.
The literature studying the possibility of pathological predictions of histological subtypes based on radiomic features from FDG-PET images has produced conflicting results. Previous studies excluded the possibility of creating a close correlation between histology and radiomics, even if texture indices may provide some useful information in the spatial organization of tumor cells [52]. However, more recently, ML has been shown to provide promising methods for predicting the different subtypes of malignant lymphomas based on radiomics [26,53].
Our data are consistent with these latter results, demonstrating that ML algorithms powered by radiomics and texture features can build robust histological-based classifiers, with good discriminant power. In fact, through a set of selected features (reported in Figure 2), the ML algorithms show promising results in inferring the histological type of the mediastinal bulky masses evaluated with a good sensitivity and specificity for the binary classification PMBCL/cHL, as well as with acceptable performance for the multiclass classification.
Among the set of radiomic and texture features selected for model training, there is no strong indication of the importance order of such features in the classification task. What appears in Figure 2 on the feature ranking obtained by iterating 100 times the RFE algorithm on the logistic regression training is that SUV kurtosis is the best ranked feature most of the time. The texture GLRLM and GLZLM indices follow, achieving high-ranked positions on average. On the contrary, GLCM_entropy and SUVmax seem to be less important for the logistic regression peaking at low-ranked positions. SUVmean and GLCM_homogeneity look to be moderately important, while it is hard to infer something about the importance of TLG and SUV skewness from Figure 2.
The best performing binary classifier is the random forest that, with an AUC score of 0.87, totalized a balanced set of scores in TPR and TNR. Referring to the decision threshold with TPR > 0.9 (on the training set), the random forest can correctly classify PMBCL in 81% of patients, and cHL in 80%. The other ML models achieve slightly better performance in identifying PMBCL cases (82–85%), at the cost of lower performing capabilities for cHL identification (77–79%). The SUVmax-based classifier exacerbates this behavior, totalizing the best sensitivity score (88%), but the worst specificity score (63%).
The multiclass problem confirms the domain of the random forest classifier as the best performing model with one-vs-all AUC scores for GZL/PMBCL classification of 0.68/0.78. The ensemble classifier can identify PMBCL lymphomas within a multi-type cohort in 80% of patients, and GZL cases in 86%, keeping acceptable performance in correctly excluding GZL/PMBCL instances for at least 56% of patients. The other ML models show similar multiclass capabilities, even if there are some cases where higher scores in TPR are at the cost of worse performance in TNR and vice versa (Table 4). Again, the SUVmax-based classifier exhibits the same behavior, obtaining the best TPR scores (88% for PMBCL and 89% for GZL), but failing in correctly excluding GZL/PMBCL instances in 55% of all cases.
Despite the fact that SUVmax delivers information about the histological nature of masses that can be tuned to identify specific lymphoma types, such information is not enough to finalize the complementary task that is shown with a significant drop in the specificity performance. Including more features besides the SUV-based ones makes it possible to recover the missing information, providing more balanced performance. Our results on the conjunction of radiomics with ML methods demonstrates that textural features derived from FDG-PET imaging are correlated with histologic diagnosis in patients with mediastinal bulky lymphomas, and thus may support pathological analyses.
In this context, FDG-PET could aim to be used in several additional ways beyond the standard clinical use. On one hand, it could represent the best method for guiding a biopsy in a bulky mass by answering the questions “where and how many samples”, identifying the metabolic patterns corresponding to the specific histology as well. On the other hand, FDG-PET radiomics could help clarify possible discordances between the histopathological diagnosis and clinical characteristics of the patient. In this last case, radiomic features of the bulky mass could represent an additional variable that could help clinicians and pathologists define the diagnosis or guide the decision to undergo a second biopsy in a more suggestive area of the bulky lesion.
The literature on functional imaging radiomics for lymphoma remains scant. Nevertheless, most of the published researchers in this field highlight the capacity of PET-related ML to differentiate lymphomas from other entities [54,55]. Just recently, Montes de Jesus et al. [25] analyzed ML algorithms to discriminate follicular lymphoma from diffuse large B-cell lymphoma with promising results.
The present study had some limitations. Firstly, this was a retrospective study. Secondly, the PMBCL and GZL cohorts were limited, especially compared to the cHL group, even if such proportions reflect the true incidence of these diseases. Moreover, it should be highlighted that most of the results come with large uncertainties, surely due to the limited statistic available. Thus, it could be important to extend this research in a multicenter retrospective study with an enlarged sample size to develop more robust histological-based classifiers and to validate the results in a prospective multicenter one. To harmonize radiomic features calculated from images coming from different scanners or protocols, the use of harmonization methods is of key importance. Moreover, with the current technological evolution, it may also be interesting to implement our approach in full digital PET/CT to confirm our findings. Finally, the relationship between texture parameters and histopathological findings also requires further study to determine the tumor biological dependency of each textural feature.

5. Conclusions

Different subtypes of bulky mediastinal lymphomas, namely cHL, GZL and PMBCL, demonstrated different FDG-PET characteristics and metabolic heterogeneity when examined using radiomics and texture analysis. ML methods could be combined with radiomics to build a histological representation of bulky mediastinal masses that can successfully identify different types of lymphomas. In the era of precision medicine and personalized treatment, this preliminary study supports the potential of metabolic texture analyses as a future imaging biomarker, with a growing role in clinical diagnosis.

Author Contributions

E.M.A., M.B., F.L., F.M., L.N., I.R., B.S.: conception and design, acquisition of data, literature search, analysis/interpretation of data and writing of the manuscript. V.B., A.C., A.M.V., C.T., R.S. (Roberto Sciagrà), B.P., A.M.V.: conception and design, analysis/interpretation of data, supervision, and writing of the manuscript. A.P., R.S. (Raffaella Santi): conception and design, acquisition of data, interpretation of data, writing of the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards (31/11/2021 CEAVC 21101). (The authors affirm that human research participants provided informed consent for publication of the images in Figure 1a–c).

Informed Consent Statement

Informed consent was obtained from the participants included in the study.

Data Availability Statement

Anonymized data for our analyses presented in this report are available upon request from the corresponding authors.

Acknowledgments

This work has been carried out within the next-AIM and ML-INFN projects of INFN-CNS5.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Swerdlow, S.H.; Campo, E.; Pileri, S.A.; Harris, N.L.; Stein, H.; Siebert, R.; Advani, R.; Ghielmini, M.; Salles, G.A.; Zelenetz, A.D.; et al. The 2016 revision of the World Health Organization classification of lymphoid neoplasms. Blood 2016, 127, 2375–2390. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Cheson, B.D. PET/CT in Lymphoma: Current Overview and Future Directions. Semin Nucl. Med. 2018, 48, 76–81. [Google Scholar] [CrossRef] [PubMed]
  3. Eichenauer, D.A.; Aleman, B.M.P.; André, M.; Federico, M.; Hutchings, M.; Illidge, T.; Engert, A.; Ladetto, M.; ESMO Guidelines Committee. Hodgkin lymphoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann. Oncol. 2018, 29, iv19–iv29. [Google Scholar] [CrossRef] [PubMed]
  4. Song, M.K.; Chung, J.S.; Sung-Yong, O.; Lee, G.W.; Kim, S.G.; Seol, Y.M.; Shin, H.J.; Choi, G.J.; Shin, D.H.; Yun, E.-Y. Clinical impact of bulky mass in the patient with primary extranodal diffuse large B cell lymphoma treated with R-CHOP therapy. Ann. Hematol. 2010, 89, 985–991. [Google Scholar] [CrossRef]
  5. Schürch, C.M.; Federmann, B.; Quintanilla-Martinez, L.; Fend, F. Tumor Heterogeneity in Lymphomas: A Different Breed. Pathobiology 2018, 85, 130–145. [Google Scholar] [CrossRef]
  6. Cheson, B.D.; Fisher, R.I.; Barrington, S.F.; Cavalli, F.; Schwartz, L.H.; Zucca, E.; Lister, T.A. Recommendations for initial evaluation, staging, and response assessment of hodgkin and non-hodgkin lymphoma: The lugano classification. J. Clin. Oncol. 2014, 32, 3059–3067. [Google Scholar] [CrossRef]
  7. Piña-Oviedo, S.; Moran, C.A. Primary Mediastinal Classical Hodgkin Lymphoma. Adv. Anat. Pathol. 2016, 23, 285–309. [Google Scholar] [CrossRef]
  8. Sun, Y.W.; Ji, C.F.; Wang, H.; He, J.; Liu, S.; Ge, Y.; Zhou, Z.Y. Differentiating gastric cancer and gastric lymphoma using texture analysis (TA) of positron emission tomography (PET). Chin. Med. J. 2020, 134, 439–447. [Google Scholar] [CrossRef]
  9. Van Timmeren, J.E.; Cester, D.; Tanadini-Lang, S.; Alkadhi, H.; Baessler, B. Radiomics in medical imaging—“how-to” guide and critical reflection. Insights Imaging 2020, 11, 91. [Google Scholar] [CrossRef]
  10. Litjens, G.; Kooi, T.; Bejnordi, B.E.; Setio, A.A.A.; Ciompi, F.; Ghafoorian, M.; Van Der Laak, J.A.; Van Ginneken, B.; Sánchez, C.I. A survey on deep learning in medical image analysis. Med. Image Anal. 2017, 42, 60–88. [Google Scholar] [CrossRef] [Green Version]
  11. Shen, D.; Wu, G.; Suk, H.I. Deep learning in medical image analysis. Annu. Rev. Biomed. Eng. 2017, 19, 221–248. [Google Scholar] [CrossRef] [Green Version]
  12. Hesamian, M.H.; Jia, W.; He, X.; Kennedy, P. Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges. J. Digit. Imaging 2019, 32, 582–596. [Google Scholar] [CrossRef] [Green Version]
  13. Wang, J.; Wu, C.J.; Bao, M.L.; Zhang, J.; Wang, X.N.; Zhang, Y.D. Machine learning-based analysis of MR radiomics can help to improve the diagnostic performance of PI-RADS v2 in clinically relevant prostate cancer. Eur. Radiol. 2017, 27, 4082–4090. [Google Scholar] [CrossRef]
  14. Cho, H.H.; Lee, H.Y.; Kim, E.; Lee, G.; Kim, J.; Kwon, J.; Park, H. Radiomics-guided deep neural networks stratify lung adenocarcinoma prognosis from CT scans. Commun. Biol. 2021, 4, 1286. [Google Scholar] [CrossRef]
  15. Tang, Y.; Yang, C.M.; Su, S.; Wang, W.J.; Fan, L.P.; Shu, J. Machine learning-based Radiomics analysis for differentiation degree and lymphatic node metastasis of extrahepatic cholangiocarcinoma. BMC Cancer 2021, 21, 1268. [Google Scholar] [CrossRef]
  16. Keek, S.A.; Leijenaar, R.T.H.; Jochems, A.; Woodruff, H.C. A review on radiomics and the future of theranostics for patient selection in precision medicine. Br. J. Radiol. 2018, 91, 1091. [Google Scholar] [CrossRef]
  17. Mirestean, C.C.; Pagute, O.; Buzea, C.; Iancu, R.I.; Iancu, D.T. Radiomic Machine Learning and Texture Analysis—New Horizons for Head and Neck Oncology. Maedica 2019, 14, 126–130. [Google Scholar]
  18. Nioche, C.; Orlhac, F.; Boughdad, S.; Reuzé, S.; Goya-Outi, J.; Robert, C.; Pellot-Barakat, C.; Soussan, M.; Frouin, F.; Buvat, I. LIFEx: A freeware for radiomic feature calculation in multimodality imaging to accelerate advances in the characterization of tumor heterogeneity. Cancer Res. 2018, 78, 4786–4789. [Google Scholar] [CrossRef] [Green Version]
  19. Kanoun, S.; Tal, I.; Berriolo-Riedinger, A.; Rossi, C.; Riedinger, J.M.; Vrigneaud, J.M.; Legrand, L.; Humbert, O.; Casasnovas, O.; Brunotte, F.; et al. Influence of Software Tool and Methodological Aspects of Total Metabolic Tumor Volume Calculation on Baseline [18F]FDG PET to Predict Survival in Hodgkin Lymphoma. PLoS ONE 2015, 10, e0140830. [Google Scholar] [CrossRef] [Green Version]
  20. Guyon, I.; Weston, J.; Barnhill, S.; Vapnik, V. Gene selection for cancer classification using support vector machines. Mach. Learn. 2002, 46, 389–422. [Google Scholar] [CrossRef]
  21. Bergstra, J.; Bandernet, R.; Bengio, Y.; Kégl, B. Algorithms for Hyper-Parameter Optimization. In Proceedings of the Advances in Neural Information Processing Systems 24 (NeurIPS 2011), Granada, Spain, 12–14 December 2011. [Google Scholar]
  22. Bergstra, J.; Yamins, D.; Cox, D. Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures. In Proceedings of the 30th International Conference on Machine Learning (PMLR 2013), Atlanta, GA, USA, 17–19 June 2013; pp. 115–123. [Google Scholar]
  23. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  24. Akiba, T.; Sano, S.; Yanase, T.; Ohta, T.; Koyama, M. Optuna: A Next-generation Hyperparameter Optimization Framework. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Anchorage, AK, USA, 4–8 August 2019; Association for Computing Machinery: New York, NY, USA, 2019; pp. 2623–2631. [Google Scholar]
  25. de Jesus, F.M.; Yin, Y.; Mantzorou-Kyriaki, E.; Kahle, X.U.; de Haas, R.J.; Yakar, D.; Glaudemans, A.W.J.M.; Noordzij, W.; Kwee, T.C.; Nijland, M. Machine learning in the differentiation of follicular lymphoma from diffuse large B-cell lymphoma with radiomic [18F]FDG PET/CT features. Eur. J. Nucl. Med. Mol. Imaging 2022, 49, 1535–1543. [Google Scholar] [CrossRef] [PubMed]
  26. Orlhac, F.; Soussan, M.; Chouahnia, K.; Martinod, E.; Buvat, I. 18F-FDG PET-Derived Textural Indices Reflect Tissue-Specific Uptake Pattern in Non-Small Cell Lung Cancer. PLoS ONE 2015, 12, e0145063. [Google Scholar] [CrossRef] [PubMed]
  27. Mann, H.B.; Whitney, D.R. On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other. Ann. Math. Stat. 1947, 18, 50–60. [Google Scholar] [CrossRef]
  28. Chawla, N.V.; Bowyer, K.W.; Hall, L.O.; Kegelmeyer, W.P. SMOTE: Synthetic Minority Over-sampling Technique. J. Artif. Intell. Res. 2002, 16, 321–357. [Google Scholar] [CrossRef]
  29. Minn, H.; Joensuu, H.; Ahonen, A.; Klemi, P. Florodeoxyglucose imaging: A method to assess the proliferative activity of human cancer in vivo. Comparison with DNA flow cytometry in head and neck tumors. Cancer 1988, 61, 1776–1781. [Google Scholar] [CrossRef]
  30. Higashi, K.; Ueda, Y.; Yagishita, M.; Arisaka, Y.; Sakurai, A.; Oguchi, M.; Seki, H.; Nambu, Y.; Tonami, H.; Yamamoto, M. FDG PET measurement of the proliferative potential of non-small cell lung cancer. J. Nucl. Med. 2000, 41, 85–92. [Google Scholar]
  31. Lu, J.; Ma, D.; Shou, Y.; Chen, T.; Tong, L. Correlation of fluorodeoxyglucose uptake and tumor-proliferating antigen Ki-67 in lymphomas. J. Cancer Res. Ther. 2012, 8, 96–102. [Google Scholar] [CrossRef]
  32. Ngeow, J.Y.Y.; Quek, R.H.H.; Ng, D.C.E.; Hee, S.W.; Tao, M.; Lim, L.C.; Tan, Y.H.; Lim, S.T. High SUV uptake on FDG-PET/CT predicts for an aggressive B-cell lymphoma in a prospective study of primary FDG-PET/CT staging in lymphoma. Ann. Oncol. 2009, 20, 1543–1547. [Google Scholar] [CrossRef]
  33. Riester, M.; Xu, Q.; Moreira, A.; Zheng, J.; Michor, F.; Downey, R. The Warburg effect: Persistence of stem-cell metabolism in cancers as a failure of differentiation. Ann. Oncol. 2018, 29, 264–270. [Google Scholar] [CrossRef]
  34. Canellos, G.P. Residual mass in lymphoma may not be residual disease. J. Clin. Oncol. 1988, 6, 931–933. [Google Scholar] [CrossRef]
  35. Álvaro, T.; Lejeune, M.; García, J.F.; Salvadó, M.T.; López, C.; Bosch, R.; Jaén, J.; Escrivá, P.; Pons, L.E. Tumor-infiltrated immune response correlates with alterations in the apoptotic and cell cycle pathways in Hodgkin and Reed-Sternberg cells. Clin Cancer Res. 2008, 14, 685–691. [Google Scholar] [CrossRef] [Green Version]
  36. Hatt, M.; Majdoub, M.; Vallières, M.; Tixier, F.; Le Rest, C.C.; Groheux, D.; Hindié, E.; Martineau, A.; Pradier, O.; Hustinx, R.; et al. 18F-FDG PET uptake characterization through texture analysis: Investigating the complementary nature of heterogeneity and functional tumor volume in a multi-cancer site patient cohort. J. Nucl. Med. 2015, 56, 38–44. [Google Scholar] [CrossRef] [Green Version]
  37. Sasanelli, M.; Meignan, M.; Haioun, C.; Berriolo-Riedinger, A.; Casasnovas, R.-O.; Biggi, A.; Gallamini, A.; Siegel, B.A.; Cashen, A.F.; Véra, P.; et al. Pretherapy metabolic tumour volume is an independent predictor of outcome in patients with diffuse large B-cell lymphoma. Eur. J. Nucl. Med. Mol. Imaging 2014, 41, 2017–2022. [Google Scholar] [CrossRef]
  38. Nakagawa, K.; Takahashi, S.; Endo, M.; Ohde, Y.; Kurihara, H.; Terauchi, T. Can 18F-FDG PET predict the grade of malignancy in thymic epithelial tumors? An evaluation of only resected tumors. Cancer Manag. Res. 2017, 9, 761–768. [Google Scholar] [CrossRef] [Green Version]
  39. Song, M.-K.; Chung, J.-S.; Shin, H.-J.; Lee, S.-M.; Lee, S.-E.; Lee, H.-S.; Lee, G.-W.; Kim, S.-J.; Lee, S.-M.; Chung, D.-S. Clinical significance of metabolic tumor volume by PET/CT in stages II and III of diffuse large B cell lymphoma without extranodal site involvement. Ann. Hematol. 2012, 91, 697–703. [Google Scholar] [CrossRef] [Green Version]
  40. Tateishi, U.; Tatsumi, M.; Terauchi, T.; Ando, K.; Niitsu, N.; Kim, W.S.; Suh, C.; Ogura, M.; Tobinai, K. Prognostic significance of metabolic tumor burden by positron emission tomography/computed tomography in patients with relapsed/refractory diffuse large B-cell lymphoma. Cancer Sci. 2015, 106, 186–193. [Google Scholar] [CrossRef]
  41. Ha, S.; Choi, H.; Cheon, G.J.; Kang, K.W.; Chung, J.-K.; Kim, E.E.; Lee, D.S. Autoclustering of Non-small Cell Lung Carcinoma Subtypes on 18F-FDG PET Using Texture Analysis: A Preliminary Result. Nucl. Med. Mol. Imaging 2014, 48, 278–286. [Google Scholar] [CrossRef] [Green Version]
  42. Chicklore, S.; Goh, V.; Siddique, M.; Roy, A.; Marsden, P.K.; Cook, G.J. Quantifying tumour heterogeneity in 18F-FDG PET/CT imaging by texture analysis. Eur. J. Nucl. Med. Mol. Imaging 2013, 40, 133–140. [Google Scholar] [CrossRef]
  43. Jackson, A.; O’Connor, J.P.; Parker, G.J.; Jayson, G.C. Imaging tumor vascular heterogeneity and angiogenesis using dynamic contrast-enhanced magnetic resonance imaging. Clin Cancer Res. 2007, 13, 3449–3459. [Google Scholar] [CrossRef] [Green Version]
  44. Diehn, M.; Nardini, C.; Wang, D.S.; McGovern, S.; Jayaraman, M.; Liang, Y.; Aldape, K.; Cha, S.; Kuo, M.D. Identification of noninvasive imaging surrogates for brain tumor gene-expression modules. Proc. Natl. Acad. Sci. USA 2008, 105, 5213–5218. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Ben Bouallègue, F.; Tabaa, Y.A.; Kafrouni, M.; Cartron, G.; Vauchot, F.; Mariano-Goulart, D. Association between textural and morphological tumor indices on baseline PET-CT and early metabolic response on interim PET-CT in bulky malignant lymphomas. Med. Phys. 2017, 44, 4608–4619. [Google Scholar] [CrossRef] [PubMed]
  46. Orlhac, F.; Nioche, C.; Soussan, M.; Buvat, I. Understanding changes in tumor texture indices in PET: A comparison between visual assessment and index values in simulated and patient data. J. Nucl. Med. 2017, 58, 387–392. [Google Scholar] [CrossRef] [PubMed]
  47. Gebejes, A.; Huertas, R. Texture Characterization based on Grey-Level Co-occurrence Matrix. In Proceedings of the Conference of Informatics and Management Sciences—SECTION: Artificial Intelligence and Image Processing, ICTIC 2013, Chongqing, China, 25–29 March 2013. [Google Scholar]
  48. Tan, S.; Kligerman, S.; Chen, W.; Lu, M.; Kim, G.; Feigenberg, S.; D’Souza, W.D.; Suntharalingam, M.; Lu, W. Spatial-temporal [18F]FDG-PET features for predicting pathologic response of esophageal cancer to neoadjuvant chemoradiation therapy. Int. J. Radiat. Oncol. Biol. Phys. 2013, 85, 1375–1382. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Tixier, F.; Le Rest, C.C.; Hatt, M.; Albarghach, N.; Pradier, O.; Metges, J.-P.; Corcos, L.; Visvikis, D. Intratumor heterogeneity characterized by textural features on baseline 18F-FDG PET images predicts response to concomitant radiochemotherapy in esophageal cancer. J. Nucl. Med. 2011, 52, 369–378. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Kunkel, M.; Reichert, T.E.; Benz, P.; Lehr, H.-A.; Jeong, J.-H.; Wieand, S.; Bartenstein, P.; Wagner, W.; Whiteside, T.L. Overexpression of Glut-1 and increased glucose metabolism in tumors are associated with a poor prognosis in patients with oral squamous cell carcinoma. Cancer 2003, 97, 1015–1024. [Google Scholar] [CrossRef]
  51. Kazmierska, J.; Cholewinski, W.; Piotrowski, T.; Sowinska, A.; Bak, B.; Cegła, P.; Malicki, J. Assessment of tumour hypoxia, proliferation and glucose metabolism in head and neck cancer before and during treatment. Br. J. Radiol. 2020, 93, 20180781. [Google Scholar] [CrossRef]
  52. Orlhac, F.; Thézé, B.; Soussan, M.; Boisgard, R.; Buvat, I. Multiscale Texture Analysis: From 18F-FDG PET Images to Histologic Images. J. Nucl. Med. 2016, 57, 1823–1828. [Google Scholar] [CrossRef] [Green Version]
  53. Lippi, M.; Gianotti, S.; Fama, A.; Casali, M.; Barbolini, E.; Ferrari, A.; Fioroni, F.; Iori, M.; Luminari, S.; Menga, M.; et al. Texture analysis and multiple-instance learning for the classification of malignant lymphomas. Comput. Methods Programs Biomed. 2020, 185, 105153. [Google Scholar] [CrossRef]
  54. Zhu, S.; Xu, H.; Shen, C.; Wang, Y.; Xu, W.; Duan, S.; Chen, H.; Ou, X.; Chen, L.; Ma, X. Differential diagnostic ability of 18f-fdg PeT/cT radiomics features between renal cell carcinoma and renal lymphoma. Q. J. Nucl. Med. Mol. Imaging 2021, 65, 72–78. [Google Scholar] [CrossRef]
  55. Feng, B.; Huang, L.; Li, C.; Quan, Y.; Chen, Y.; Xue, H.; Chen, Q.; Sun, S.; Li, R.; Long, W. A Heterogeneity Radiomic Nomogram for Preoperative Differentiation of Primary Gastric Lymphoma From Borrmann Type IV Gastric Cancer. J. Comput. Assist. Tomogr. 2021, 45, 191–202. [Google Scholar] [CrossRef]
Figure 1. 18F-FDG-PET/CT maximum intensity projection (MIP) and mediastinal transaxial images show the mediastinal bulky mass in patient with (a) cHL, (b) GZL and (c) PMBCL.
Figure 1. 18F-FDG-PET/CT maximum intensity projection (MIP) and mediastinal transaxial images show the mediastinal bulky mass in patient with (a) cHL, (b) GZL and (c) PMBCL.
Cancers 15 01931 g001
Figure 2. Matrix N features × N features reporting the fraction of times the i-feature ends up in the j-position of the ranking obtained from the RFE algorithm during a 100-iterated bootstrap technique on the logistic regression training.
Figure 2. Matrix N features × N features reporting the fraction of times the i-feature ends up in the j-position of the ranking obtained from the RFE algorithm during a 100-iterated bootstrap technique on the logistic regression training.
Cancers 15 01931 g002
Figure 3. Histograms representing mean SUVmax and SUVmean (a), MTV (b) and TLG (c) in the subsets of cHL, GZL and PMBCL. * p < 0.05, ** p < 0.01.
Figure 3. Histograms representing mean SUVmax and SUVmean (a), MTV (b) and TLG (c) in the subsets of cHL, GZL and PMBCL. * p < 0.05, ** p < 0.01.
Cancers 15 01931 g003
Figure 4. Histograms representing mean LRE and SRE derived from GLRLM (a), homogeneity and entropy derived from GLCM (b) and LGZE, HGZE, SZHGE and ZLNU derived from GLZLM (c) in the subsets of cHL, GZL and PMBCL. * p < 0.05, ** p < 0.01.
Figure 4. Histograms representing mean LRE and SRE derived from GLRLM (a), homogeneity and entropy derived from GLCM (b) and LGZE, HGZE, SZHGE and ZLNU derived from GLZLM (c) in the subsets of cHL, GZL and PMBCL. * p < 0.05, ** p < 0.01.
Cancers 15 01931 g004
Figure 5. ROC curves (left) and precision-recall curves (right) of the different binary classifiers under investigation. Each classifier is reported together with mean and standard deviation (in square brackets) of the AUC and AP scores achieved during a 300-iterated bootstrap technique.
Figure 5. ROC curves (left) and precision-recall curves (right) of the different binary classifiers under investigation. Each classifier is reported together with mean and standard deviation (in square brackets) of the AUC and AP scores achieved during a 300-iterated bootstrap technique.
Cancers 15 01931 g005
Figure 6. ROC curves (left) and precision-recall curves (right) of the different multiclass-promoted binary classifiers under investigation. Each classifier is reported together with mean and standard deviation (in square brackets) of the one-vs-all AUC and AP scores achieved during a 300-iterated bootstrap technique for GZL classification.
Figure 6. ROC curves (left) and precision-recall curves (right) of the different multiclass-promoted binary classifiers under investigation. Each classifier is reported together with mean and standard deviation (in square brackets) of the one-vs-all AUC and AP scores achieved during a 300-iterated bootstrap technique for GZL classification.
Cancers 15 01931 g006
Figure 7. ROC curves (left) and precision-recall curves (right) of the different multiclass-promoted binary classifiers under investigation. Each classifier is reported together with mean and standard deviation (in square brackets) of the one-vs-all AUC and AP scores achieved during a 300-iterated bootstrap technique for PMBCL classification.
Figure 7. ROC curves (left) and precision-recall curves (right) of the different multiclass-promoted binary classifiers under investigation. Each classifier is reported together with mean and standard deviation (in square brackets) of the one-vs-all AUC and AP scores achieved during a 300-iterated bootstrap technique for PMBCL classification.
Cancers 15 01931 g007
Table 1. Parameters evaluated included conventional and volumetric indices and texture features.
Table 1. Parameters evaluated included conventional and volumetric indices and texture features.
Index Matrix ParameterMatrixParameter
Conventional indices SUVmean, SUVmax, SUVpeak
Volumetric indices MTV, TLG
Texture features: first-orderHistogramskewness, kurtosis, entropy, energy
Texture features: second-orderGLCMhomogeneity, energy, contrast, correlation, entropy, dissimilarity
NGLDMcoarseness, contrast, busyness
GLRLMSRE/LRE, LGRE/HGRE, SRLGE/SRHGE, LRLGE/LRHGE, GLNUr/RLNU, RP
GLZLMSZE, LZE, LGZE, HGZE, SZLGE, SZHGE, LZLGE, LZHGE, GLNUz, ZLNU, ZP
Table 2. Summary of the study population.
Table 2. Summary of the study population.
CharacteristicsPMBCL, n (%)cHL, n (%)GZL, n (%)
Patients29 (24.8%)80 (68.4%)8 (6.8%)
Male sex10 (34.5%)35 (43.8%)5 (62.5%)
Median age y (range)40 (21–59)33 (18–74)47 (16–60).
Ann Arbor Stage
I6 (21%)1 (2%)0 (0%)
II12 (58%)48 (66%)7 (87.5%)
III2 (7%)12 (16%)1 (12.5%)
IV4 (14%)12 (16%)0 (0%)
B symptoms8 (28%)29 (40%)4 (50%)
LDH UI/l (range)355 (134–757)207 (135–630)255.5 (206–335)
ERS mm/h (range)37 (6–106)321 (4–120)34.5 (20–62)
Median bulky
diameter cm (range)
11.0 (6.5–17)8.9 (5–20)13.5 (5–20)
Table 3. Performance of different machine learning models and the SUVmax-based classifier in separating PMBCL and cHL lymphomas. TPR, TNR and PPV scores are reported for two user-defined decision thresholds, indicated in the table as tight/slight requirements and obtained requiring a sensitivity score greater than 0.9/0.7 on the training set.
Table 3. Performance of different machine learning models and the SUVmax-based classifier in separating PMBCL and cHL lymphomas. TPR, TNR and PPV scores are reported for two user-defined decision thresholds, indicated in the table as tight/slight requirements and obtained requiring a sensitivity score greater than 0.9/0.7 on the training set.
Logistic RegressionLinear SVMGaussian ProcessRandom ForestGradient BDT SUV max
AUC
[10th, 32nd percentiles]
0.81 [0.73, 0.78]0.78 [0.68, 0.75]0.77 [0.68, 0.75]0.87 [0.79, 0.83]0.85 [0.74, 0.81]0.78 [0.73, 0.75]
AP
[10th, 32nd percentiles]
0.82 [0.64, 0.77]0.82 [0.65, 0.76]0.82 [0.66, 0.78]0.77 [0.56, 0.69]0.75 [0.58, 0.69]0.80 [0.63, 0.75]
TPR
[10th, 32nd percentiles]
Tight requirement0.84 [0.67, 0.83]0.82 [0.67, 0.83]0.85 [0.67, 0.83]0.81 [0.50, 0.67]0.59 [0.33, 0.50]0.88 [0.67, 0.83]
Slight requirement0.69 [0.50, 0.67]0.69 [0.33, 0.67]0.69 [0.50, 0.67]0.65 [0.33, 0.50]0.62 [0.33, 0.50]0.76 [0.50, 0.67]
TNR
[10th, 32nd percentiles]
Tight requirement0.79 [0.62, 0.75]0.79 [0.62, 0.75]0.77 [0.56, 0.75]0.80 [0.62, 0.75]0.90 [0.81, 0.88]0.63 [0.38, 0.56]
Slight requirement0.90 [0.81, 0.88]0.90 [0.81, 0.88]0.91 [0.81, 0.88]0.91 [0.81, 0.88]0.91 [0.81, 0.88]0.82 [0.62, 0.75]
PPV
[10th, 32nd percentiles]
Tight requirement0.13 [0.11, 0.12]0.14 [0.11, 0.12]0.14 [0.12, 0.13]0.15 [0.10, 0.14]0.16 [0.09, 0.14]0.12 [0.10, 0.11]
Slight requirement0.18 [0.13, 0.16]0.18 [0.10, 0.17]0.18 [0.13, 0.17]0.17 [0.09, 0.14]0.17 [0.09, 0.14]0.18 [0.14, 0.16]
Table 4. Performance of different machine learning models and the SUVmax-based classifier in separating cHL, GZL and PMBCL lymphomas. One-vs-all TPR, TNR and PPV scores are reported imposing the tight requirement, namely requiring the TPR score of the binary classifier greater than 0.9 on the training set.
Table 4. Performance of different machine learning models and the SUVmax-based classifier in separating cHL, GZL and PMBCL lymphomas. One-vs-all TPR, TNR and PPV scores are reported imposing the tight requirement, namely requiring the TPR score of the binary classifier greater than 0.9 on the training set.
Logistic RegressionLinear SVMGaussian ProcessRandom ForestGradient BDT SUV max
AUC
[10th, 32nd percentiles]
One-vs-all for GZL classification0.67 [0.60, 0.65]0.65 [0.58, 0.63]0.68 [0.58, 0.65]0.68 [0.59, 0.66]0.65 [0.52, 0.62]0.77 [0.73, 0.77]
One-vs-all for PMBCL classification0.76 [0.66, 0.72]0.76 [0.66, 0.72]0.74 [0.63, 0.71]0.78 [0.65, 0.74]0.80 [0.66, 0.76]0.70 [0.59, 0.67]
AP
[10th, 32nd percentiles]
One-vs-all for GZL classification0.44 [0.37, 0.41]0.42 [0.35, 0.39]0.41 [0.33, 0.38]0.46 [0.37, 0.42]0.42 [0.31, 0.38]0.64 [0.55, 0.60]
One-vs-all for PMBCL classification0.62 [0.42, 0.56]0.65 [0.46, 0.58]0.70 [0.50, 0.63]0.54 [0.33, 0.45]0.62 [0.40, 0.55]0.36 [0.28, 0.33]
TPR
[10th, 32nd percentiles]
One-vs-all for GZL classification0.74 [0.67, 0.67]0.67 [0.56, 0.67]0.86 [0.78, 0.89]0.86 [0.89, 0.89]0.66 [0.22, 0.56]0.89 [0.89, 0.89]
One-vs-all for PMBCL classification0.84 [0.67, 0.83]0.81 [0.65, 0.67]0.85 [0.67, 0.83]0.80 [0.50, 0.67]0.76 [0.50, 0.67]0.88 [0.67, 0.83]
TNR
[10th, 32nd percentiles]
One-vs-all for GZL classification0.60 [0.41, 0.55]0.63 [0.45, 0.59]0.59 [0.41, 0.55]0.64 [0.45, 0.59]0.66 [0.50, 0.64]0.49 [0.27, 0.41]
One-vs-all for PMBCL classification0.59 [0.44, 0.67]0.63 [0.52, 0.60]0.53 [0.40, 0.52]0.56 [0.44, 0.52]0.64 [0.48, 0.60]0.45 [0.28, 0.40]
PPV
[10th, 32nd percentiles]
One-vs-all for GZL classification0.44 [0.35, 0.40]0.43 [0.35, 0.40]0.47 [0.38, 0.44]0.50 [0.38, 0.47]0.44 [0.26, 0.40]0.43 [0.27, 0.41]
One-vs-all for PMBCL classification0.33 [0.27, 0.31]0.35 [0.28, 0.32]0.31 [0.25, 0.29]0.31 [0.24, 0.29]0.35 [0.25, 0.30]0.28 [0.22, 0.25]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Abenavoli, E.M.; Barbetti, M.; Linguanti, F.; Mungai, F.; Nassi, L.; Puccini, B.; Romano, I.; Sordi, B.; Santi, R.; Passeri, A.; et al. Characterization of Mediastinal Bulky Lymphomas with FDG-PET-Based Radiomics and Machine Learning Techniques. Cancers 2023, 15, 1931. https://doi.org/10.3390/cancers15071931

AMA Style

Abenavoli EM, Barbetti M, Linguanti F, Mungai F, Nassi L, Puccini B, Romano I, Sordi B, Santi R, Passeri A, et al. Characterization of Mediastinal Bulky Lymphomas with FDG-PET-Based Radiomics and Machine Learning Techniques. Cancers. 2023; 15(7):1931. https://doi.org/10.3390/cancers15071931

Chicago/Turabian Style

Abenavoli, Elisabetta Maria, Matteo Barbetti, Flavia Linguanti, Francesco Mungai, Luca Nassi, Benedetta Puccini, Ilaria Romano, Benedetta Sordi, Raffaella Santi, Alessandro Passeri, and et al. 2023. "Characterization of Mediastinal Bulky Lymphomas with FDG-PET-Based Radiomics and Machine Learning Techniques" Cancers 15, no. 7: 1931. https://doi.org/10.3390/cancers15071931

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop