Next Article in Journal
Management of Ground-Glass Nodules: When and How to Operate?
Previous Article in Journal
Early-Stage Lung Adenocarcinoma MDM2 Genomic Amplification Predicts Clinical Outcome and Response to Targeted Therapy
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Cancers
Volume 14
Issue 3
10.3390/cancers14030713
cancers-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Radiomics Features of the Spleen as Surrogates for CT-Based Lymphoma Diagnosis and Subtype Differentiation

by
Johanna S. Enke
1,*,†,
Jan H. Moltz
2,†,
Melvin D'Anastasi
1,3,
Wolfgang G. Kunz
1,
Christian Schmidt
4,
Stefan Maurus
1,
Alexander Mühlberg
5,
Alexander Katzmann
5,
Michael Sühling
5,
Horst Hahn
2,
Dominik Nörenberg
1,6,‡ and
Thomas Huber
1,6,‡
1
Department of Radiology, University Hospital, LMU Munich, 81377 Munich, Germany
2
Fraunhofer Institute for Digital Medicine MEVIS, 28359 Bremen, Germany
3
Medical Imaging Department, Mater Dei Hospital, 2090 MSD Msida, Malta
4
Department of Medicine III, University Hospital, LMU Munich, 81377 Munich, Germany
5
CT R&D Image Analytics, Siemens Healthineers, 91301 Forchheim, Germany
6
Department of Radiology and Nuclear Medicine, University Medical Center Mannheim, 68167 Mannheim, Germany
*
Author to whom correspondence should be addressed.
†
These authors contributed equally to this work.
‡
These authors contributed equally to this work.
Cancers 2022, 14(3), 713; https://doi.org/10.3390/cancers14030713
Submission received: 16 December 2021 / Revised: 26 January 2022 / Accepted: 27 January 2022 / Published: 29 January 2022
Browse Figures
Versions Notes

Abstract

:

Simple Summary

In malignant lymphoma an early and accurate diagnosis is essential for therapy initiation and patient outcome. Within the diagnostic process, imaging plays a crucial role in disease staging. However, an invasive biopsy is required for subtype classification. Involvement of the spleen, a major lymphoid organ, is frequent in malignant lymphoma; this may be reactive or due to infiltration by malignant cells. Using radiomics features of the spleen in a machine learning approach, we investigated the possibility of distinguishing malignant lymphoma patients from other cancer patients and to classify lymphoma subtypes in the case of disease presence. Recent studies have proven the value of radiomics analysis in differentiating lymphoma from non-lymphoma groups on involved sites. Supported by machine learning, imaging could gain importance as a noninvasive diagnostic tool for future lymphoma classification, offering more precise radiological information for an interdisciplinary approach regarding treatment planning.

Abstract

The spleen is often involved in malignant lymphoma, which manifests on CT as either splenomegaly or focal, hypodense lymphoma lesions. This study aimed to investigate the diagnostic value of radiomics features of the spleen in classifying malignant lymphoma against non-lymphoma as well as the determination of malignant lymphoma subtypes in the case of disease presence—in particular Hodgkin lymphoma (HL), diffuse large B-cell lymphoma (DLBCL), mantle-cell lymphoma (MCL), and follicular lymphoma (FL). Spleen segmentations of 326 patients (139 female, median age 54.1 +/− 18.7 years) were generated and 1317 radiomics features per patient were extracted. For subtype classification, we created four different binary differentiation tasks and addressed them with a Random Forest classifier using 10-fold cross-validation. To detect the most relevant features, permutation importance was analyzed. Classifier results using all features were: malignant lymphoma vs. non-lymphoma AUC = 0.86 (p < 0.01); HL vs. NHL AUC = 0.75 (p < 0.01); DLBCL vs. other NHL AUC = 0.65 (p < 0.01); MCL vs. FL AUC = 0.67 (p < 0.01). Classifying malignant lymphoma vs. non-lymphoma was also possible using only shape features AUC = 0.77 (p < 0.01), with the most important feature being sphericity. Based on only shape features, a significant AUC could be achieved for all tasks, however, best results were achieved combining shape and textural features. This study demonstrates the value of splenic imaging and radiomic analysis in the diagnostic process in malignant lymphoma detection and subtype classification.

1. Introduction

Malignant lymphomas represent a heterogenous group of neoplasms of lymphatic tissue and are divided into Hodgkin lymphoma (HL) and non-Hodgkin lymphoma (NHL). While many patients with malignant lymphoma present with rapid, indolent swelling of lymph nodes, the spleen as a major lymphoid organ is also often involved in the course of disease of these malignant processes. Splenic involvement is seen in approximately one third of all HL [1] at presentation and in varying proportions in other subtypes of NHL [2]. Splenomegaly alone has limited value as a sufficient biomarker for splenic involvement as 30% of normal-sized spleens can have focal tumor infiltration without splenomegaly [3,4]. Additionally, splenomegaly can occur without involvement in malignant lymphomas [4] and other causes of splenomegaly, such as infectious or autoimmune diseases are numerous.
Apart from histopathological classification according to the WHO classification of tumors of hematopoietic and lymphoid tissues, clinical imaging plays an important role in pretherapeutic staging and risk assessment of malignant lymphoma [5]. While PET-CT has some significant advantages to contrast-enhanced CT (ceCT) in detecting extranodal involvement, ceCT offers better accuracy in nodal size assessment [6,7]. Both HL and NHL are commonly staged using the Lugano classification of 2014 [7], which suggests a modified Ann Arbor staging system [8]. While splenic involvement is best determined by PET-CT, splenomegaly can be measured using a craniocaudal diameter (CCD) with a cut-off of more than 13 cm as proposed by the Lugano classification [7]. The CCD offers an easy-to-measure parameter to first assess potential splenic involvement in daily routine. We believe that the CCD and assessment of the entire spleen can be used for further analysis in lymphoma imaging. Quantitative imaging analysis techniques, including the field of radiomics, have shown in the past that a high-dimensional radiological feature set can correlate to pathophysiological aspects of cancer entities and can be linked to patient outcome [9,10,11,12,13,14].
This study evaluates whether quantitative imaging biomarkers (QIB) of the spleen can be used as a surrogate for predictions in the diagnostic process of malignant lymphoma. Therefore, we applied advanced machine learning techniques by using radiomics features of the spleen to explore the predictive value of the spleen for distinguishing malignant lymphoma patients from other cancer patients and to differentiate between malignant lymphoma subtypes, in particular, in HL and NHL subtypes: diffuse large B-cell lymphoma (DLBCL), follicular lymphoma (FL), and mantle-cell lymphoma (MCL). Recent studies on malignant lymphoma patients have shown the value of QIB analysis in distinguishing malignant lymphoma from other cancer entities [11,15,16,17,18]. Only a few studies further evaluated the potential benefit of radiomics analyses to distinguish between various malignant lymphoma subtypes [19,20].
While a differentiation of subtypes via noninvasive imaging will surely not replace histopathological analysis, it helps to better understand imaging characteristics of malignant lymphoma as complementary biomarkers and may offer more precise radiological information prior to, during, and after therapy.
The purpose of this study was to investigate the diagnostic value of radiomic features of the spleen in distinguishing malignant lymphoma from non-lymphoma as well as the determination of malignant lymphoma subtypes in the case of disease presence—in particular HL, DLBCL, MCL, and FL.

2. Materials and Methods

This study was approved by the Ethics Committee of the Ludwig Maximilians University of Munich and performed according to current guidelines for retrospective studies.

2.1. Patient Cohort and Non-Lymphoma Cohort

We collected data from 385 patients with malignant lymphoma, who were treated in the University hospital Munich between March 2010 and March 2018. Data were retrieved as part of our inter-institutional study collaboration, which closed the study in March 2020. To be included in the study, patients had to be diagnosed with a histologically proven HL, DLBCL, FL, or MCL. Patients with a prior lymphoma or a primary CNS lymphoma were excluded. Furthermore, patients were excluded, if no ceCT staging was available, or no full image of the spleen was acquired. The final cohort consisted of 326 patients (Figure 1). For non-lymphoma patients, imaging data of patients with colorectal cancer were used. Spleen segmentations of a total of 56 patients were obtained for further analysis.

2.2. Imaging Data

The standard protocol for initial CT staging included a contrast-enhanced image series of the neck, chest, and abdomen. Images were acquired in the portal venous phase using 27 different multidetector-row CT scanners from 4 different vendors, of which the vast majority was acquired at the university hospital, nearly 40% of all scans were taken on a SOMATOM Definition Flash (Siemens Healthineers, Erlangen, Germany) in-house scanner. CeCT images were obtained by using a weight-adapted intravenous contrast agent. Chest images were obtained after 30 s; abdomen images were obtained after 70 s. For reconstruction, standard soft tissue kernels (I30f, B30f, Br36) were used. Slice thickness varied between 0.5 and 5 mm. To reflect the reality of lymphoma diagnosis in major lymphoma treatment centers, a heterogeneous image acquisition cohort was used to produce generalizable results and identify stable features. In daily clinical routine, patients either present themselves with preclinical imaging or receive a clinical and radiological workup during a hospital stay. All CT scans were reviewed by board-certified radiologists during clinical routine for stage of disease and splenic involvement. Radiological information about splenic involvement was retrieved from the radiology and nuclear medicine report whenever applicable, otherwise the images were reviewed again as part of this project to retrieve missing data. Screening of splenic involvement was performed by two board-certified radiologists in a blinded manner.
Images of the non-lymphoma cohort were acquired in portal venous phase using 17 different CT scanners from 3 different companies and included a ceCT of the abdomen in portal venous phase.

2.3. Image Segmentation

As a prerequisite for quantitative image analysis, the spleen was segmented on all CT scans. For 190 patients, this was done semi-automatically by board-certified radiologists in a custom software based on MeVisLab (MeVis Medical Solutions, Bremen, Germany; Fraunhofer MEVIS, Bremen, Germany) that offers automatic interpolation and refinement of contours to organ boundaries. A 3D neural network based on the U-Net [21] was then trained on these segmentations using deep learning. To ensure consistency of image segmentations, the U-Net was applied to both the remaining patients and the patients it was trained on. The results were carefully approved by board-certified radiologists and contours were corrected manually in rare cases if required.

2.4. Statistical Analysis

To summarize the data, descriptive statistics were used: dichotomous variables were stated in absolute frequency and percentage and were compared with the chi-squared test. Continuous data were tested for normal distribution with the Kolmogorov–Smirnov test and presented in median and lower and upper quartiles. To evaluate not normally distributed data the Mann–Whitney U-test was used.

2.5. Feature Extraction

To characterize the radiological appearance of the spleen, we computed all features available in the Python package PyRadiomics 3.0 [22], which provides a reference implementation of the features defined by the Image Biomarker Standardisation Initiative [23]. These first-order statistics, shape features, and different kinds of texture features were extracted on the original CT image, on eight Wavelet-filtered images, and on five LoG-filtered images (σ = 1, …, 5 mm). To the shape features, we added the CCD, defined as the extent of the spleen bounding box along the body axis, because it is the most common measure for spleen enlargement in the clinic [7]. Overall, we considered 1317 radiomics features.
To make the features from scans with different slice thicknesses comparable, all images were resampled to an isotropic voxel size of 1 mm prior to feature computation. To account for the heterogeneous CT scanners in our cohort, we investigated the effect of an additional feature harmonization using the ComBat method [24]. Batches were created by scanner vendor and slice thickness rounded to 1, …, 5 mm. Harmonization was applied to all features except shape features because the latter are directly computed from the segmentations and are therefore independent of the underlying image data.
To enable a better interpretability of the relevant features, we also investigated predictive models on subsets of these features: only 448 features on the original CT image, only 14 shape features (14), which are independent of variations in image acquisition, and, as baseline models reflecting clinical knowledge, CCD only and spleen volume only. Shape features including CCD and spleen volume are computed directly on the segmentations and not on the underlying image data. Therefore, these features are particularly suitable for a real-world data set like ours that is heterogeneous in terms of scanners and imaging settings.

2.6. Model Building and Analysis

For investigating associations between radiomics features of the spleen and the presence of lymphoma or the distinction of different lymphoma subtypes, we trained Random Forest classifiers in a 10-times repeated stratified 10-fold cross-validation. We used the Python package scikit-learn 0.24 [25] with default settings. We did not perform any feature scaling or selection because this is not required for the Random Forest classifier. Model quality was assessed using the mean area under the curve (AUC) over the folds and repetitions. Confidence intervals (CI) at 95% were computed by 100-times bootstrapping of the pooled out-of-sample predictions on patient level [26]. Models were considered significantly better than guessing when the 95% CIs of the AUC were completely above 0.5. Finally, to understand which features were most relevant for the classification, we trained a model on 80% of the data, this time with mRMR selection of 10 features to remove correlations and analyzed the permutation importance of the features with 100 permutations on the remaining 20%.
We applied this methodology to four different classification tasks, creating a cascade of binary classifiers to distinguish the five classes: (i) non-lymphoma, (ii) Hodgkin lymphoma, (iii) DLBCL, (iv) follicular lymphoma, and (v) mantle-cell lymphoma (Figure 2). To account for a potential bias by splenic involvement we analyzed the classification tasks on two cohorts: all patients and patients without diagnosed splenic involvement.

3. Results

3.1. Demographic Data

Baseline characteristics of the included patients are shown in Table 1. Overall, we retrieved imaging data from 326 patients, 125 (38.3%) ceCT images were available in a thin reconstruction (0.5 or 0.75 mm). The non-lymphoma cohort consisted of 56 patients with a median age of 61.5 years (SD 11.49 years), of which 35.7% were male. The patient cohort without splenic involvement consisted of 285 patients.

3.2. Segmentations of the Spleen

In Figure 3, five representative patients are shown, visualizing a spleen whose radiomics features are closest to the median of the control cohort and each malignant lymphoma subtype, respectively.

3.3. Classifying Malignant Lymphoma vs. Non-Lymphoma

A Random Forest classifier for distinguishing all malignant lymphoma patients from controls based on features of the spleen achieved an AUC of 0.86 (CI: [0.80, 0.90]). The most important feature according to permutation importance is gray level non-uniformity on an image filtered with a LoG of σ = 3 mm, with an AUC decrease of 0.10. The AUC is almost the same when only using original features, but although sphericity is the most important feature, restricting the model to shape features leads to a drop of the AUC to 0.77 (CI: [0.70, 0.83]). Using CCD of the spleen as the only feature, malignant lymphoma patients are distinguished from controls with an AUC of 0.68 (CI: [0.61, 0.75]). For splenic volume in all patients, the AUC is 0.67 (CI: [0.60, 0.76]). After feature harmonization with ComBat, similar AUCs are achieved. The AUC when using original features is 0.81 vs. 0.85 but the CIs overlap and therefore the difference is not significant. The Random Forest classifiers were also applied to the subgroup of malignant lymphoma patients without splenic involvement, which produced similar AUCs as the classifiers on all patients. All results are summarized in Table 2.

3.4. Subtype Prediction in Malignant Lymphoma

The results for the cascade of classifiers predicting subtypes of malignant lymphoma are shown in Table 3, Table 4 and Table 5. For HL vs. NHL, the best AUC of all patients is 0.75 (CI [0.69, 0.81]) using all features, dropping to 0.65 (CI: [0.58, 0.71]) when using only original features (Table 3). For distinguishing DLBCL from other NHL in all patients, an AUC of 0.65 (CI: [0.56, 0.71]) is achieved with all features, but shape features are sufficient to reach an AUC of 0.62 (CI: [0.55, 0.68]) (Table 4). Finally, shape features alone yield the highest AUC of 0.71 (CI: [0.60, 0.80]) for FL vs. MCL in all patients, compared to 0.64 (CI: [0.54, 0.76]) with original features (Table 5). For none of the three tasks completed, classifiers using only volume or only CCD achieved an AUC above 0.6; significance over random was shown in only two of six cases in all patients. Again, the analysis was repeated with ComBat feature harmonization and the subgroup of patients without splenic involvement were analyzed separately. In both cases, similar results were achieved in nearly all classification tasks.
When using all features, the most important feature according to permutation importance was always a feature on a LoG-filtered image. In two cases, as well as in the lymphoma vs. non-lymphoma case, it is a texture feature. When using only features from the original image, the most important feature is always a shape feature, again consistent with lymphoma vs. non-lymphoma. Furthermore, shape features always perform comparably to original features.

4. Discussion

The goal of this study was to explore whether potentially robust predictors of the spleen for lymphoma detection and subtype classification could be identified based on quantitative imaging, which may serve as an imaging biomarker for noninvasive, early diagnostic directions in lymphoma patients. The results of this study suggest that (i) shape features of the spleen have more predictive value than the craniocaudal diameter of the spleen and spleen volume in detecting malignant lymphoma, (ii) radiomics features and subsets, like shape features, allow the differentiation of different malignant lymphoma subtypes, and (iii) the sphericity of the spleen is a key characteristic that has not gained a lot of scientific attention in malignant lymphoma classification until now. While there are several studies that used QIB for diagnostic classifications and predictions of patient outcome and prognosis in different cancer entities [9,13,28,29], only few have focused on malignant lymphoma [11,15,16,17]. Various studies focused on building a machine learning classification model significantly differentiating primary central nervous system lymphoma from glioblastoma [28,29]. Reinert et al. used a radiomics-based model to differentiate DLBCL Richter Transformation patients from chronic lymphocytic leukemia patients on ceCT images reaching an AUC of 0.85 [17]. In malignant lymphoma, a fast and precise diagnostic process is essential. Decisions regarding the therapy regimen and start of therapy are dependent on the subtype classification by the WHO [30] and on clinical imaging primarily for disease staging. All current methods of subtype classification are relying on invasive biopsies. The diagnostic standard is the extirpation of a whole involved lymph node, typically the easiest to biopsy, for pathological viewing and immunohistochemical staining. Histopathologic tissue analysis will doubtlessly remain the best diagnostic method in identifying malignant lymphoma subtypes. However, imaging methods can contribute complementary information throughout the patient journey and help to better understand malignant lymphoma dispersion in patients before, during, and after therapy.
Only few studies have focused on differentiating between lymphoma subgroups with imaging techniques, mostly focusing on involved lymph node sites. A recent study showed promising results in categorizing DLBCL and FL patients on MRI using statistical analysis correlating texture features and subtype [20]. Featuring the same subgroups as this study, Lippi et al. exploited a machine learning setting on texture analysis of involved lymph node sites in PET/CT images to further classify lymphoma [19]. One major time-consuming task in studies exploiting involved lymph node sites is the segmentation process, often requiring experts to manually segment volumes of interest. As intratumoral heterogeneity between involved sites has been demonstrated [31,32], imaging features can vary between involved sites [33], which is why choosing what sites to further exploit is a crucial step in those studies. In this study we focused on the spleen for two major reasons: firstly, malignant lymphoma is a systemic disease developing from lymphocytes. Therefore, the spleen as a major lymphoid organ is often involved in the process. Involvement of the spleen can be seen as primary or secondary involvement or as a reaction to a systemic lymphoid disease, without direct lymphoma manifestation in the spleen. We hypothesized that these reactions vary between lymphoma subgroups and can be represented using QIBs. Secondly, the spleen is a parenchymatous organ surrounded by peri-splenic fat and therefore easy to automatically segment. Humpire-Mamani et al. have shown that a neural network can be trained to segment the spleen in CT scans with an accuracy that is comparable to an experienced radiologist [34,35]. Such a performance would not be expected for involved lymph node sites, which can occur on any site within the scan volume. A recent study found significantly different CT-textural features in splenomegaly, differentiating splenic infiltration of lymphoma versus splenomegaly in liver cirrhosis and further exploiting their role in longitudinal lymphoma monitoring [36].
To evaluate the diagnostic value of the spleen in lymphoma patients for differentiating malignant lymphoma from non-lymphoma patients and classifying subtypes, segmentations of the spleen on baseline ceCT imaging were used to derive different QIBs. Extracted imaging features of the spleen included those from which Aerts et al. derived their established radiomics signature [9]. Meanwhile, this feature set has been extended and standardized [37] and the PyRadiomics package provides a reference implementation [22] that was used in this study. While these features include well-known parameters such as the mean density or the volume of a segmented structure, in particular, the texture features can be less intuitive. As an example, the gray level size zone matrix (GLSZM) non-uniformity, that is used by the most predictive feature for distinguishing lymphoma from non-lymphoma, measures whether some image values typically appear in larger connected areas than others, which would show as a particular pattern in the image. Such patterns can be unnoticeable to the human eye but still reflect properties of the visualized tissue [9,38,39].
In this study, we followed a classification tree (Figure 2) to assess binary classification tasks: to start with, we compared spleens of malignant lymphoma patients to spleens of non-lymphoma patients, as ceCT imaging is mostly the first imaging modality to be used to further explore an incidental finding or when symptoms occur. In the following step the differentiation of HL and NHL was addressed as they are historically divided into these subtypes by pathological appearance. For further classification of NHL subtypes, the aggressive subtype, DLBCL, was compared against other NHL. DLBCL is the most common subtype of NHL [40], matching our data set. Nearly equal sample sizes could be achieved by differentiating DLBCL against MCL and FL. The final step included classifying two indolent malignant lymphoma subtypes, FL to MCL. For classification, we applied machine learning to different feature sets, such as CCD and spleen volume and different types of radiomic features, to address each hypothesis.
The CCD of the spleen was used as a baseline to evaluate the binary classification tasks, as it represents a daily used splenic parameter and is easy to retrieve during clinical routine. Spleen volume on the other hand is unlikely to be retrieved in clinical routine but corresponds well with the CCD of the spleen for assessing splenomegaly [6,38]. By using an automated segmentation of the spleen, the exact volume could easily be extracted from images. While both CCD and volume could be used to significantly differentiate malignant lymphoma from the non-lymphoma cohort, the predictive value for further subtype differentiation was limited in following evaluations. That indicates an overall growth of spleens in lymphoma patients, but not necessarily above the cutoff for splenomegaly, as only 16.9% of included malignant lymphoma patients had a splenomegaly with a CCD > 13 cm. A classifier using shape features of the spleen produced a higher AUC = 0.77 (CI: [0.70, 0.83]) in differentiating malignant lymphoma patients and non-lymphoma patients, indicating that there is a benefit from other shape features as the spleen is not only increasing in size in malignant lymphoma patients but also changing its shape due to malignant lymphoma. Accordingly, the most important feature, when using only features from the original image for classifying malignant lymphoma against non-lymphoma, was a shape feature, the sphericity of the spleen. The sphericity describes the roundness of the shape of the spleen in relation to a sphere. As stated in the study by Reinert et al., it was possible to significantly differentiate splenomegaly in malignant lymphoma from splenomegaly in liver cirrhosis by only using textural features over time [36]. By combining shape and texture features we built a classification model with an AUC = 0.86 (CI: [0.80, 0.90]) for the first task.
Classifiers based on shape features could also be used to significantly differentiate between the varying subgroups of lymphoma, indicating that shape is not only different in malignant lymphoma vs. non-lymphoma patients but also varying between malignant lymphoma subtypes. Accordingly, the most important features, when using only features from the original image, were again shape features in all classification tasks. The best outcome for differentiating malignant lymphoma subtypes could be achieved in most of the binary classifiers using all available radiomic features, combining shape and texture features. It must be noted that numerically superior classifying results in differentiating the indolent subtypes MCL and FL were on the other hand achieved using only shape features. While the AUC is numerically higher than other classifiers, the CIs overlap and therefore the difference is not significant.
Direct splenic involvement of malignant lymphoma was observed in 12.6% of all patients in our cohort. In order to account for a potential bias in our analysis due to splenic involvement, we additionally analyzed a subgroup where we excluded patients with splenic involvement. In this subgroup, similar results as in the complete cohort were observed. These results suggest that other anatomical characteristics of the spleen are more relevant for the classification task. Overall, our results indicate that radiomic features of the spleen can serve as surrogates for CT-based lymphoma diagnosis and subtype differentiation. In order to extract this valuable information in CT scans, segmentations of the spleen are required. Currently, clinicians usually either do not have enough time or do not have the right tools to perform segmentations in their daily routine. In this study, a U-Net for automatic spleen segmentation was successfully trained with high accuracy. The U-Net is currently the state of the art for automatic image segmentation and was also used by Humpire-Mamani et al. for spleen segmentation [34]. When a U-Net is trained on scans from different scanners, with different slice thicknesses and so on, it learns a general concept of the appearance of a spleen that is independent of the actual imaging settings. Therefore, it performs robustly under a wide range of conditions. It is likely that new image viewing software will use these or similar technologies in the near future, leading to automated organ segmentations and therefore enabling radiologists to use inherent image information such as radiomics features in their clinical routine. The results of this study suggest that this could lead to an improved diagnostic assessment.
Our study has some potential limitations. As a retrospective, single-center study, we were able to retrieve a large sample size, however, when dividing our cohort into subgroups sample sizes varied between entities with DLBCL being the largest one and MCL patients being the smallest one with 48 patients. While there are many different subtypes of lymphoma, we only concentrated on four of the largest malignant lymphoma entities. As the non-lymphoma group, we used imaging data of patients with colorectal cancer, which of course does not necessarily indicate a healthy spleen, although splenic metastases in colorectal cancer are uncommon [39]. However, more subtle alterations of splenic size and shape cannot be definitely ruled out as cancer is a systemic disease with widespread effects on the whole body. The reason for choosing the colorectal cancer control group was mainly the similar scanning protocol and comparable scanning conditions at our center.
With 326 patients and images retrieved from 27 different CT scanners, images were acquired with a high variability in image acquisition. Especially textural features can be sensitive to image acquisition and reconstruction settings [41]. As the protocol suggests, ceCT images in portal venous phase, contrast enhancement can vary between patients due to contrast medium administration [42]. To ensure the validity of our results in this heterogeneous data set reflecting clinical reality, we additionally performed an analysis where the ComBat feature harmonization algorithm is applied to the extracted first-order and texture features. With this approach, we reduced potential effects of different scanner types and slice thicknesses on these features. However, we found that the AUCs remained very similar, indicating that the high degree of standardization in CT imaging is sufficient to make features comparable in a heterogeneous cohort for the given task.
As this study focuses solely on the spleen in differentiating lymphoma subtypes, additional information could be gained by analyzing other sites of disease such as enlarged lymph nodes. Further prospective studies are needed that combine the prognostic value of the spleen and other involved sites in malignant lymphoma patients.
Being able to differentiate malignant lymphoma subtypes from imaging data using radiomics analysis may be useful in the future for creating diagnostic support systems, benefiting the patient with a fast and interdisciplinary approach to a final diagnosis. While it will not replace the histopathological analysis of lymphoma, the diagnostic value of the spleen and other involved sites could become more important in noninvasive examination of lymphoma, offering more precise imaging information, and therefore assisting the pathologist in immunohistochemical decisions. In addition, it could also offer early valuable information on lymphoma progress and intratumoral mutations of genetic markers in lymphoma, which would have to be evaluated in further studies.

5. Conclusions

Imaging plays an important role in the diagnosis of lymphoma for defining the stage of disease, while the immunohistopathological workup of extracted lymph nodes defines the subtype of malignant lymphoma. The results of this study suggest that (i) shape features of the spleen have more predictive value than CCD and spleen volume in detecting malignant lymphoma, (ii) radiomics features allow the differentiation of different malignant lymphoma subtypes (HL, DLBCL, MCL, FL), and (iii) the sphericity of the spleen is a key characteristic that has not gained a lot of scientific attention in malignant lymphoma until now. The best results were achieved using all features to build classifiers. Classifiers using only shape features performed significantly as well, indicating that the shape of the spleen changes depending on lymphoma subtypes. The results of this study conclusively demonstrate that the spleen offers potential diagnostic value in lymphoma patients and should be evaluated in further studies.

Author Contributions

Conceptualization, J.S.E., J.H.M., D.N. and T.H.; methodology, J.H.M., J.S.E., T.H., A.K. and A.M.; software, J.H.M.; validation, J.H.M.; formal analysis, J.H.M. and J.S.E.; investigation, J.H.M. and J.S.E.; resources, J.H.M., S.M., T.H., D.N., H.H. and M.S.; data curation, J.H.M., J.S.E., D.N., C.S., S.M., M.D. and T.H.; writing—original draft preparation, J.S.E. and J.H.M.; writing—review and editing, D.N., M.D., W.G.K., C.S., S.M., A.M., A.K., M.S., H.H. and T.H.; visualization, J.H.M.; supervision, T.H., J.H.M., D.N., M.S. and H.H.; project administration, M.S., J.H.M., S.M., D.N. and T.H.; funding acquisition, D.N. and T.H. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by the German Federal Ministry of Education and Research (BMBF) as part of the PANTHER project (FKZ 13GW0163B).

Institutional Review Board Statement

This study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Ethics Committee of the Ludwig Maximilians University of Munich (approval no. 502-16 from 20 September 2016 and 17-421 from 8 August 2017).

Informed Consent Statement

Patient consent was waived by the local ethics committee due to the retrospective study design.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest. TH and DN work as medical consultants for Smart Reporting GmbH, the work is not related to the present study.

References

  1. Guermazi, A.; Brice, P.; de Kerviler, E.; Fermé, C.; Hennequin, C.; Meignin, V.; Frija, J. Extranodal Hodgkin Disease: Spectrum of Disease. Radiographics 2001, 21, 161–179. [Google Scholar] [CrossRef] [PubMed]
  2. De Jong, P.A.; Van Ufford, H.M.Q.; Baarslag, H.J.; De Haas, M.J.; Wittebol, S.H.; Quekel, L.G.; De Klerk, J.M. CT and 18F-FDG PET for noninvasive detection of splenic involvement in patients with malignant lymphoma. Am. J. Roentgenol. 2009, 192, 745–753. [Google Scholar] [CrossRef] [PubMed]
  3. Bhatia, K.; Sahdev, A.; Reznek, R.H. Lymphoma of the Spleen. Semin. Ultrasound, CT MRI 2007, 28, 12–20. [Google Scholar] [CrossRef] [PubMed]
  4. Saboo, S.; Krajewski, K.M.; O’Regan, K.N.; Giardino, A.; Brown, J.R.; Ramaiya, N.; Jagannathan, J.P. Spleen in haematological malignancies: Spectrum of imaging findings. Br. J. Radiol. 2012, 85, 81–92. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Even-Sapir, E.; Lievshitz, G.; Perry, C.; Herishanu, Y.; Lerman, H.; Metser, U. Fluorine-18 Fluorodeoxyglucose PET/CT Patterns of Extranodal Involvement in Patients with Non-Hodgkin Lymphoma and Hodgkin’s Disease. Radiol. Clin. N. Am. 2007, 45, 697–709. [Google Scholar] [CrossRef] [PubMed]
  6. Barrington, S.F.; Mikhaeel, N.G.; Kostakoglu, L.; Meignan, M.; Hutchings, M.; Müeller, S.P.; Schwartz, L.H.; Zucca, E.; Fisher, R.I.; Trotman, J.; et al. Role of imaging in the staging and response assessment of lymphoma: Consensus of the international conference on malignant lymphomas imaging working group. J. Clin. Oncol. 2014, 32, 3048–3058. [Google Scholar] [CrossRef] [PubMed]
  7. Cheson, B.D.; Fisher, R.I.; Barrington, S.F.; Cavalli, F.; Schwartz, L.H.; Zucca, E.; Lister, T.A. Recommendations for initial evaluation, staging, and response assessment of hodgkin and non-hodgkin lymphoma: The lugano classification. J. Clin. Oncol. 2014, 32, 3059–3067. [Google Scholar] [CrossRef]
  8. Cheson, B.D.; Pfistner, B.; Juweid, M.E.; Gascoyne, R.D.; Specht, L.; Horning, S.J.; Coiffier, B.; Fisher, R.I.; Hagenbeek, A.; Zucca, E.; et al. Revised response criteria for malignant lymphoma. J. Clin. Oncol. 2007, 25, 579–586. [Google Scholar] [CrossRef]
  9. Aerts, H.J.W.L.; Velazquez, E.R.; Leijenaar, R.T.H.; Parmar, C.; Grossmann, P.; Cavalho, S.; Bussink, J.; Monshouwer, R.; Haibe-Kains, B.; Rietveld, D.; et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat. Commun. 2014, 5, 4644. [Google Scholar] [CrossRef] [Green Version]
  10. Nakagawa, M.; Nakaura, T.; Namimoto, T.; Kitajima, M.; Uetani, H.; Tateishi, M.; Oda, S.; Utsunomiya, D.; Makino, K.; Nakamura, H.; et al. Machine learning based on multi-parametric magnetic resonance imaging to differentiate glioblastoma multiforme from primary cerebral nervous system lymphoma. Eur. J. Radiol. 2018, 108, 147–154. [Google Scholar] [CrossRef]
  11. Ba-Ssalamah, A.; Muin, D.; Schernthaner, R.; Kulinna-Cosentini, C.; Bastati, N.; Stift, J.; Gore, R.; Mayerhoefer, M.E. Texture-based classification of different gastric tumors at contrast-enhanced CT. Eur. J. Radiol. 2013, 82, e537–e543. [Google Scholar] [CrossRef] [PubMed]
  12. Ganeshan, B.; Miles, K.A.; Babikir, S.; Shortman, R.; Afaq, A.; Ardeshna, K.M.; Groves, A.M.; Kayani, I. CT-based texture analysis potentially provides prognostic information complementary to interim fdg-pet for patients with hodgkin’s and aggressive non-hodgkin’s lymphomas. Eur. Radiol. 2017, 27, 1012–1020. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Gebauer, L.; Moltz, J.; Mühlberg, A.; Holch, J.; Huber, T.; Enke, J.; Jäger, N.; Haas, M.; Kruger, S.; Boeck, S.; et al. Quantitative Imaging Biomarkers of the Whole Liver Tumor Burden Improve Survival Prediction in Metastatic Pancreatic Cancer. Cancers 2021, 13, 5732. [Google Scholar] [CrossRef]
  14. Mühlberg, A.; Holch, J.W.; Heinemann, V.; Huber, T.; Moltz, J.; Maurus, S.; Jäger, N.; Liu, L.; Froelich, M.F.; Katzmann, A.; et al. The relevance of CT-based geometric and radiomics analysis of whole liver tumor burden to predict survival of patients with metastatic colorectal cancer. Eur. Radiol. 2021, 31, 834–846. [Google Scholar] [CrossRef] [PubMed]
  15. Ma, Z.; Fang, M.; Huang, Y.; He, L.; Chen, X.; Liang, C.; Huang, X.; Cheng, Z.; Dong, D.; Liang, C.; et al. CT-based radiomics signature for differentiating Borrmann type IV gastric cancer from primary gastric lymphoma. Eur. J. Radiol. 2017, 91, 142–147. [Google Scholar] [CrossRef] [PubMed]
  16. Huang, Z.; Li, M.; He, D.; Wei, Y.; Yu, H.; Wang, Y.; Yuan, F.; Song, B. Two-dimensional Texture Analysis Based on CT Images to Differentiate Pancreatic Lymphoma and Pancreatic Adenocarcinoma: A Preliminary Study. Acad. Radiol. 2019, 26, e189–e195. [Google Scholar] [CrossRef]
  17. Reinert, C.P.; Federmann, B.; Hofmann, J.; Bösmüller, H.; Wirths, S.; Fritz, J.; Horger, M. Computed tomography textural analysis for the differentiation of chronic lymphocytic leukemia and diffuse large B cell lymphoma of Richter syndrome. Eur. Radiol. 2019, 29, 6911–6921. [Google Scholar] [CrossRef]
  18. Seidler, M.; Forghani, B.; Reinhold, C.; Pérez-Lara, A.; Romero-Sanchez, G.; Muthukrishnan, N.; Wichmann, J.L.; Melki, G.; Yu, E.; Forghani, R. Dual-Energy CT Texture Analysis With Machine Learning for the Evaluation and Characterization of Cervical Lymphadenopathy. Comput. Struct. Biotechnol. J. 2019, 17, 1009–1015. [Google Scholar] [CrossRef]
  19. Lippi, M.; Gianotti, S.; Fama, A.; Casali, M.; Barbolini, E.; Ferrari, A.; Fioroni, F.; Iori, M.; Luminari, S.; Menga, M.; et al. Texture analysis and multiple-instance learning for the classification of malignant lymphomas. Comput. Methods Programs Biomed. 2020, 185, 105153. [Google Scholar] [CrossRef]
  20. Wu, X.; Sikiö, M.; Pertovaara, H.; Järvenpää, R.; Eskola, H.; Dastidar, P.; Kellokumpu-Lehtinen, P.L. Differentiation of Diffuse Large B-cell Lymphoma From Follicular Lymphoma Using Texture Analysis on Conventional MR Images at 3.0 Tesla. Acad. Radiol. 2016, 23, 696–703. [Google Scholar] [CrossRef]
  21. Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015; Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F., Eds.; Springer International Publishing: Cham, Switzerland, 2015; pp. 234–241. [Google Scholar]
  22. Van Griethuysen, J.J.M.; Fedorov, A.; Parmar, C.; Hosny, A.; Aucoin, N.; Narayan, V.; Beets-Tan, R.G.H.; Fillion-Robin, J.C.; Pieper, S.; Aerts, H.J.W.L. Computational radiomics system to decode the radiographic phenotype. Cancer Res. 2017, 77, e104–e107. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Zwanenburg, A.; Vallières, M.; Abdalah, M.A.; Aerts, H.J.W.L.; Andrearczyk, V.; Apte, A.; Ashrafinia, S.; Bakas, S.; Beukinga, R.J.; Boellaard, R.; et al. The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping. Radiology 2020, 295, 328–338. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Fortin, J.-P.; Cullen, N.; Sheline, Y.I.; Taylor, W.D.; Aselcioglu, I.; Cook, P.A.; Adams, P.; Cooper, C.; Fava, M.; McGrath, P.J.; et al. Harmonization of cortical thickness measurements across scanners and sites. Neuroimage 2018, 167, 104–120. [Google Scholar] [CrossRef] [PubMed]
  25. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  26. Tsamardinos, I.; Greasidou, E.; Borboudakis, G. Bootstrapping the out-of-sample predictions for efficient and accurate cross-validation. Mach. Learn. 2018, 107, 1895–1922. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Lister, T.A.; Crowther, D.; Sutcliffe, S.B.; Glatstein, E.; Canellos, G.P.; Young, R.C.; Rosenberg, S.A.; Coltman, C.A.; Tubiana, M. Report of a committee convened to discuss the evaluation and staging of patients with Hodgkin’s disease: Cotswolds meeting. J. Clin. Oncol. 1989, 7, 1630–1636. [Google Scholar] [CrossRef] [PubMed]
  28. Yun, J.; Park, J.E.; Lee, H.; Ham, S.; Kim, N.; Kim, H.S. Radiomic features and multilayer perceptron network classifier: A robust MRI classification strategy for distinguishing glioblastoma from primary central nervous system lymphoma. Sci. Rep. 2019, 9, 5746. [Google Scholar] [CrossRef] [Green Version]
  29. Kim, Y.; Cho, H.H.; Kim, S.T.; Park, H.; Nam, D.; Kong, D.S. Radiomics features to distinguish glioblastoma from primary central nervous system lymphoma on multi-parametric MRI. Neuroradiology 2018, 60, 1297–1305. [Google Scholar] [CrossRef]
  30. Campo, E.; Harris, N.L.; Jaffe, E.S.; Stein, H.; Thiele, J. WHO Classification of Tumours of Haematopoietic and Lymphoid Tissues, 4th ed.; Swerdlow, S.H., Campo, E., Harris, N.L., Pileri, S.A., Jaffe, E.S., Stein, H., Thiele, J., Eds.; International Agency for Research on Cancer: Lyon, France, 2017; ISBN 9789283244943.
  31. Swerdlow, S.H.; Campo, E.; Pileri, S.A.; Harris, N.L.; Stein, H.; Siebert, R.; Advani, R.; Ghielmini, M.; Salles, G.A.; Zelenetz, A.D.; et al. The 2016 revision of the World Health Organization classification oflymphoid neoplasms. Blood J. 2017, 127, 453–462. [Google Scholar] [CrossRef]
  32. Schürch, C.M.; Federmann, B.; Quintanilla-Martinez, L.; Fend, F. Tumor Heterogeneity in Lymphomas: A Different Breed. Pathobiology 2018, 85, 130–145. [Google Scholar] [CrossRef]
  33. Khan, S.; Naim, S.; Bilwani, R.; Salem, A.; Gorlin, D.; Muhammad, A.; Gul, M.; Imam, M.H.; Chaudhry, A. Radiogenomics and Its Role in Lymphoma. Curr. Hematol. Malig. Rep. 2020, 15, 211–224. [Google Scholar] [CrossRef] [PubMed]
  34. Humpire-Mamani, G.E.; Bukala, J.; Scholten, E.T.; Prokop, M.; van Ginneken, B.; Jacobs, C. Fully Automatic Volume Measurement of the Spleen at CT Using Deep Learning. Radiol. Artif. Intell. 2020, 2, e190102. [Google Scholar] [CrossRef] [PubMed]
  35. Barat, M.; Hoeffel, C.; Aissaoui, M.; Dohan, A.; Oudjit, A.; Dautry, R.; Paisant, A.; Malgras, B.; Cottereau, A.-S.; Soyer, P. Focal splenic lesions: Imaging spectrum of diseases on CT, MRI and PET/CT. Diagn. Interv. Imaging 2021, 102, 501–513. [Google Scholar] [CrossRef] [PubMed]
  36. Reinert, C.P.; Kloth, C.; Fritz, J.; Nikolaou, K.; Horger, M. Discriminatory CT-textural features in splenic infiltration of lymphoma versus splenomegaly in liver cirrhosis versus normal spleens in controls and evaluation of their role for longitudinal lymphoma monitoring. Eur. J. Radiol. 2018, 104, 129–135. [Google Scholar] [CrossRef]
  37. Zwanenburg, A.; Leger, S.; Vallières, M.; Löck, S. Image biomarker standardisation initiative. arXiv 2016, arXiv:1612.07003. [Google Scholar]
  38. Bezerra, A.S.; D’Ippolito, G.; Faintuch, S.; Szejnfeld, J.; Ahmed, M. Determination of splenomegaly by CT: Is there a place for a single measurement? Am. J. Roentgenol. 2005, 184, 1510–1513. [Google Scholar] [CrossRef]
  39. Abi Saad, G.S.; Hussein, M.; El-Saghir, N.S.; Termos, S.; Sharara, A.I.; Shamseddine, A. Isolated splenic metastasis from colorectal cancer. Int. J. Clin. Oncol. 2011, 16, 306–313. [Google Scholar] [CrossRef]
  40. Siegel, R.L.; Miller, K.D.; Jemal, A. Cancer statistics, 2019. CA. Cancer J. Clin. 2019, 69, 7–34. [Google Scholar] [CrossRef] [Green Version]
  41. Yan, J.; Chu-Shern, J.L.; Loi, H.Y.; Khor, L.K.; Sinha, A.K.; Quek, S.T.; Tham, I.W.K.; Townsend, D. Impact of Image Reconstruction Settings on Texture Features in 18F-FDG PET. J. Nucl. Med. 2015, 56, 1667–1673. [Google Scholar] [CrossRef] [Green Version]
  42. Bae, K.T. Intravenous contrast medium administration and scan timing at CT: Considerations and approaches. Radiology 2010, 256, 32–61. [Google Scholar] [CrossRef]
Cancers 14 00713 g001 550
Figure 1. CONSORT diagram illustrating the final patient cohort of lymphoma patients and exclusion criteria.
Figure 1. CONSORT diagram illustrating the final patient cohort of lymphoma patients and exclusion criteria.
Cancers 14 00713 g001
Cancers 14 00713 g002 550
Figure 2. Cascade of binary classification tasks to distinguish malignant lymphoma and different lymphoma subtypes.
Figure 2. Cascade of binary classification tasks to distinguish malignant lymphoma and different lymphoma subtypes.
Cancers 14 00713 g002
Cancers 14 00713 g003a 550Cancers 14 00713 g003b 550Cancers 14 00713 g003c 550
Figure 3. Example CT slices with splenic segmentation and 3D renderings of typical spleens: (a,b) non-lymphoma cohort, (c,d) Hodgkin lymphoma, (e,f) DLBCL, (g,h) follicular lymphoma, (i,j) mantle-cell lymphoma. For each type, we selected the spleen whose radiomics features were closest to the median of all spleens of that type.
Figure 3. Example CT slices with splenic segmentation and 3D renderings of typical spleens: (a,b) non-lymphoma cohort, (c,d) Hodgkin lymphoma, (e,f) DLBCL, (g,h) follicular lymphoma, (i,j) mantle-cell lymphoma. For each type, we selected the spleen whose radiomics features were closest to the median of all spleens of that type.
Cancers 14 00713 g003aCancers 14 00713 g003bCancers 14 00713 g003c
Table
Table 1. Basic demographic data at initial diagnosis of the malignant lymphoma cohort and non-lymphoma cohort. Stages are defined following the Cotswold modification of the Ann Arbor staging system [27], the category “advanced disease” for initial staging of disease is defined by the Lugano classification system of 2014 [7].
Table 1. Basic demographic data at initial diagnosis of the malignant lymphoma cohort and non-lymphoma cohort. Stages are defined following the Cotswold modification of the Ann Arbor staging system [27], the category “advanced disease” for initial staging of disease is defined by the Lugano classification system of 2014 [7].
CharacteristicsHLDLBCLMCLFLNon-Lymphoma
Cases (percentage of cohort)97 (29.8%)129 (39.6%)48 (14.7%)52 (16%)56
Age
Median (years)34.0067.063.565.061.5
Lower/upper quartile (years)25.0/45.050.0/74.551.0/68.853.3/71.051.3/67.0
Gender
Male49 (50.5%)70 (54.3%)34 (70.8%)34 (65.4%)20 (35.7%)
Female48 (49.5%)59 (45.7%)14 (29.2%)18 (34.6%)36 (64.3%)
Stage (Ann Arbor)
III/IV—“advanced disease”38 (39.2%)49 (38.0%)40 (83.3%)39 (75%)-
IV24 (24.7%)31 (24.0%)32 (66.7%)21 (40.4%)-
Craniocaudal diameter
Median (mm)101.6093.00131.50101.2089.50
Lower/upper quartile (mm)90.00/116.2577.15/110.70100.00/189.0091.88/119.8076.50/101.75
Minimum–maximum (mm)60.00–163.2055.00–235.0049.60–310.0060.00–248.0047.00–127.00
Splenic involvement12 (12.4%)10 (7.8%)15 (31.6%)4 (7.7%)-
Table
Table 2. Results for lymphoma vs. non-lymphoma classification with different feature sets. AUCs are given with 95% CI and marked with an asterisk (*) if the CIs are completely above 0.5.
Table 2. Results for lymphoma vs. non-lymphoma classification with different feature sets. AUCs are given with 95% CI and marked with an asterisk (*) if the CIs are completely above 0.5.
FeaturesAUC [CI]
All Patients		AUC [CI]
All Patients
+ComBat		AUC [CI]
Patients without Splenic Involvement		Most Important Feature
All0.86 * [0.80, 0.90]0.85 * [0.80, 0.90]0.85 * [0.79, 0.89]log-sigma-3-0-mm-3D_glszm_GrayLevelNonUniformity
Original0.85 * [0.78, 0.90]0.81 * [0.74, 0.86]0.83 * [0.78, 0.88]original_shape_Sphericity
Shape0.77 * [0.70, 0.83]0.77 * [0.70, 0.83]0.75 * [0.69, 0.80]original_shape_Sphericity
Volume0.67 * [0.60, 0.76]0.67 * [0.60, 0.76]0.65 * [0.58, 0.72]-
CCD0.68 * [0.61, 0.75]0.68 * [0.61, 0.75]0.67 * [0.59, 0.76]-
Table
Table 3. Results for Hodgkin vs. non-Hodgkin lymphoma classification with different feature sets. AUCs are given with 95% CI and marked with an asterisk (*) if the CIs are completely above 0.5.
Table 3. Results for Hodgkin vs. non-Hodgkin lymphoma classification with different feature sets. AUCs are given with 95% CI and marked with an asterisk (*) if the CIs are completely above 0.5.
FeaturesAUC [CI]
All Patients		AUC [CI]
All Patients
+ComBat		AUC [CI]
Patients without Splenic Involvement		Most Important Feature
All0.75 * [0.69, 0.81]0.75 * [0.69, 0.80]0.73 * [0.65, 0.78]log-sigma-5-0-mm-3D_firstorder_90Percentile
Original0.65 * [0.58, 0.71]0.65 * [0.58, 0.71]0.63 * [0.57, 0.69]original_shape_Maximum2DDiameterRow
Shape0.61 * [0.54, 0.66]0.61 * [0.54, 0.66]0.63 * [0.56, 0.69]original_shape_Sphericity
Volume0.56 * [0.51, 0.61]0.56 * [0.51, 0.61]0.57 * [0.51, 0.63]-
CCD0.53 [0.46, 0.58]0.53 [0.46, 0.58]0.56 * [0.51, 0.62]-
Table
Table 4. Results for DLBCL vs. other non-Hodgkin lymphoma classification with different feature sets. AUCs are given with 95% CI and marked with an asterisk (*) if the CIs are completely above 0.5.
Table 4. Results for DLBCL vs. other non-Hodgkin lymphoma classification with different feature sets. AUCs are given with 95% CI and marked with an asterisk (*) if the CIs are completely above 0.5.
FeaturesAUC [CI]
All Patients		AUC [CI]
All Patients
+ComBat		AUC [CI]
Patients without Splenic Involvement		Most Important Feature
All0.65 * [0.56, 0.71]0.65 * [0.56, 0.71]0.64 * [0.58, 0.70]log-sigma-2-0-mm-3D_glrlm_RunEntropy
Original0.63 * [0.55, 0.70]0.63 * [0.55, 0.70]0.66 * [0.60, 0.73]original_shape_Maximum2DDiameterColumn
Shape0.62 * [0.55, 0.68]0.62 * [0.55, 0.68]0.63 * [0.56, 0.69]original_shape_Maximum2DDiameterColumn
Volume0.52 [0.46, 0.59]0.52 [0.46, 0.59]0.53 [0.46, 0.61]-
CCD0.60 * [0.52, 0.66]0.60 * [0.52, 0.66]0.57 * [0.50, 0.63]-
Table
Table 5. Results for follicular vs. mantle-cell lymphoma classification with different feature sets. AUCs are given with 95% CI and marked with an asterisk (*) if the CIs are completely above 0.5.
Table 5. Results for follicular vs. mantle-cell lymphoma classification with different feature sets. AUCs are given with 95% CI and marked with an asterisk (*) if the CIs are completely above 0.5.
FeaturesAUC [CI]
All Patients		AUC [CI]
All Patients
+ComBat		AUC [CI]
Patients without Splenic Involvement		Most Important Feature
All0.67 * [0.55, 0.79]0.67 * [0.55, 0.79]0.65 * [0.53, 0.76]log-sigma-5-0-mm-3D_glszm_SizeZoneNonUniformity
Original 0.64 * [0.54, 0.76]0.65 * [0.54, 0.76]0.64 * [0.52, 0.75]original_shape_SurfaceVolumeRatio
Shape0.71 * [0.60, 0.80]0.71 * [0.60, 0.80]0.69 * [0.60, 0.80]original_shape_Flatness
Volume0.59 [0.49, 0.70]0.59 [0.49, 0.70]0.58 [0.47, 0.70]-
CCD0.59 [0.46, 0.69]0.59 [0.46, 0.69]0.71 * [0.56, 0.83]-
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Enke, J.S.; Moltz, J.H.; D'Anastasi, M.; Kunz, W.G.; Schmidt, C.; Maurus, S.; Mühlberg, A.; Katzmann, A.; Sühling, M.; Hahn, H.; et al. Radiomics Features of the Spleen as Surrogates for CT-Based Lymphoma Diagnosis and Subtype Differentiation. Cancers 2022, 14, 713. https://doi.org/10.3390/cancers14030713

AMA Style

Enke JS, Moltz JH, D'Anastasi M, Kunz WG, Schmidt C, Maurus S, Mühlberg A, Katzmann A, Sühling M, Hahn H, et al. Radiomics Features of the Spleen as Surrogates for CT-Based Lymphoma Diagnosis and Subtype Differentiation. Cancers. 2022; 14(3):713. https://doi.org/10.3390/cancers14030713

Chicago/Turabian Style

Enke, Johanna S., Jan H. Moltz, Melvin D'Anastasi, Wolfgang G. Kunz, Christian Schmidt, Stefan Maurus, Alexander Mühlberg, Alexander Katzmann, Michael Sühling, Horst Hahn, and et al. 2022. "Radiomics Features of the Spleen as Surrogates for CT-Based Lymphoma Diagnosis and Subtype Differentiation" Cancers 14, no. 3: 713. https://doi.org/10.3390/cancers14030713

APA Style

Enke, J. S., Moltz, J. H., D'Anastasi, M., Kunz, W. G., Schmidt, C., Maurus, S., Mühlberg, A., Katzmann, A., Sühling, M., Hahn, H., Nörenberg, D., & Huber, T. (2022). Radiomics Features of the Spleen as Surrogates for CT-Based Lymphoma Diagnosis and Subtype Differentiation. Cancers, 14(3), 713. https://doi.org/10.3390/cancers14030713

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop