Next Article in Journal
Comparison of SYK Signaling Networks Reveals the Potential Molecular Determinants of Its Tumor-Promoting and Suppressing Functions
Next Article in Special Issue
A New Era of Neuro-Oncology Research Pioneered by Multi-Omics Analysis and Machine Learning
Previous Article in Journal
Epigenetics and Communication Mechanisms in Microglia Activation with a View on Technological Approaches
Previous Article in Special Issue
Convolutional Neural Network-Based Artificial Intelligence for Classification of Protein Localization Patterns
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Imaging-Based Staging of Hepatic Fibrosis in Patients with Hepatitis B: A Dynamic Radiomics Model Based on Gd-EOB-DTPA-Enhanced MRI

1
Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai 200433, China
2
Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), Ministry of Education, Shanghai 200433, China
3
Department of Radiology, Shanghai Public Health Clinical Center, Fudan University, Shanghai 201052, China
4
Human Phenome Institute, Fudan University, Shanghai 200433, China
5
Market Solutions Center, Philips Healthcare, Shanghai 200072, China
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this study.
Biomolecules 2021, 11(2), 307; https://doi.org/10.3390/biom11020307
Submission received: 18 January 2021 / Revised: 13 February 2021 / Accepted: 17 February 2021 / Published: 18 February 2021

Abstract

:
Accurate grading of liver fibrosis can effectively assess the severity of liver disease and help doctors make an appropriate diagnosis. This study aimed to perform the automatic staging of hepatic fibrosis on patients with hepatitis B, who underwent gadolinium ethoxybenzyl diethylenetriamine pentaacetic acid (Gd-EOB-DTPA)-enhanced magnetic resonance imaging with dynamic radiomics analysis. The proposed dynamic radiomics model combined imaging features from multi-phase dynamic contrast-enhanced (DCE) images and time-domain information. Imaging features were extracted from the deep learning-based segmented liver volume, and time-domain features were further explored to analyze the variation in features during contrast enhancement. Model construction and evaluation were based on a 132-case data set. The proposed model achieved remarkable performance in significant fibrosis (fibrosis stage S1 vs. S2–S4; accuracy (ACC) = 0.875, area under the curve (AUC) = 0.867), advanced fibrosis (S1–S2 vs. S3–S4; ACC = 0.825, AUC = 0.874), and cirrhosis (S1–S3 vs. S4; ACC = 0.850, AUC = 0.900) classifications in the test set. It was more dominant compared with the conventional single-phase or multi-phase DCE-based radiomics models, normalized liver enhancement, and some serological indicators. Time-domain features were found to play an important role in the classification models. The dynamic radiomics model can be applied for highly accurate automatic hepatic fibrosis staging.

1. Introduction

Hepatic fibrosis is a common pathological process in a variety of chronic liver diseases. It reflects the response to liver damage due to various causes. During hepatic stellate cell proliferation, large amounts of extracellular matrix components are deposited in the extravascular space to cause hepatic fibrosis [1]. Evidence indicates that treatment is necessary for patients with hepatic fibrosis Scheuer–Ludwig ≥S2 [2]. Liver fibrosis can be reversed with antiviral and antifibrotic treatment, even in early cirrhosis [3,4]. Therefore, accurate diagnosis of different grades of liver fibrosis is the prerequisite for evaluating the liver disease status in patients and providing effective and reasonable treatment.
Liver biopsy is the gold standard for diagnosing liver fibrosis; however, approximately 2% of patients experience symptoms such as bleeding and infection during the examination due to the invasiveness of the test. Therefore, this method is not acceptable to all patients, especially those with low-grade fibrosis and relatively stable disease [5]. Sampling errors may occur in biopsy analysis due to the diffuse nature of liver fibrosis [1] and limited material collected, and low repeatability of specimen collection is observed for different operators [6]. As a result, identifying an accurate, non-invasive, safe, simple, reproducible, and long-term follow-up examination approach has been a hot spot in clinical studies.
By definition, radiomics is an approach that extracts quantitative features, including gray-scale patterns, inter-pixel relationships, and shape and spectral properties, from specific regions of interest (ROI) in medical images. Some of these pivotal features can be further applied to generate computational models based on machine learning algorithms, so as to address clinical issues and provide treatment guidance [7]. Radiomics has been adopted in studies assessing various diseases for risk prediction, tumor typing, survival prediction, classification, and staging [8,9,10,11]. In addition, previous radiomics research involved liver fibrosis classification [12,13,14,15,16,17,18].
Gadolinium ethoxybenzyl (EOB) diethylenetriamine pentaacetic acid (Gd-EOB-DTPA; Bayer Health Care Co., Ltd.) is a new hepatocyte-specific magnetic resonance imaging (MRI) contrast agent that can accelerate research and development in liver imaging. The hepatocyte absorbance of Gd-EOB-DTPA is higher than those of conventional agents due to the presence of a lipophilic EOB group in the molecular structure [19]. Moreover, the biochemical properties of Gd-EOB-DTPA provide an overall assessment of tissue perfusion in the arterial phase, while also assessing the specific accumulation in the liver hepatobiliary phase (HBP) after 20 min [20,21]. Studies pointed out that liver-specific Gd-EOB-DTPA-enhanced MRI had great potential to assess liver function and liver fibrosis [22,23,24,25,26,27].

1.1. Related Studies

1.1.1. Liver Stiffness Measurement

Amon ultrasound-based techniques, shear wave elastography and acoustic radiation force impulse (ARFI) techniques are commonly used to stage liver fibrosis based on non-invasive tissue stiffness [28]. Both Cassinotto and Friedrich and their collaborators noted that liver stiffness could be detected by ultrasound elastography to assess the extent of fibrosis [29,30]. However, this method is unreliable because of no reproducibility and operator dependence [31]. Magnetic resonance elastography (MRE) is a non-invasive MRI-based technique that can be used to quantitatively evaluate the mechanical properties of body tissues [32]. Many studies demonstrated that hepatic stiffness, measured by MRE, had a strong correlation with the stage of fibrosis according to histology [33,34,35]. The acquisition time of MRE can be less than a minute. In addition, MRE is much less operator-dependent, and has a low rate of technical failure compared with ultrasound-based techniques [32]. However, compared with conventional MRI, MRE requires additional equipment and is more expensive. In addition, the evaluation of liver stiffness-based hepatic fibrosis may be limited by confounders of increased tissue stiffness, which were previously analyzed in detail [36].

1.1.2. Radiomics Analysis

Multiple studies based on radiomics analysis have been proposed for hepatic fibrosis assessment. Duan et al. [12] evaluated hepatic fibrosis in rats based on vessel features, including the textural features of the vessel’s inner wall, by high-resolution computed tomography (CT) using diffraction-enhanced imaging. Zhang et al. [13] compared texture patterns in CT and MRI for hepatic fibrosis staging and found that MRI images had an advantage over CT findings. Kato et al. [14] performed texture analysis on T1-weighted MRI images, with seven texture features extracted using the finite difference method and processed by an artificial neural network program. In a study by House et al. [15], 14 texture features from T2-weighted images were used to investigate the ability of texture analysis to stage liver fibrosis in patients with a range of liver diseases. Cannella et al. [16] investigated the performance of texture analysis in T1-weighed MRI images for hepatic fibrosis evaluation in patients with nonalcoholic fatty liver disease (NAFLD). In studies involving the HBP, Wu et al. [17] assessed the feasibility of texture analysis for hepatic fibrosis staging on T2-weighted, T1-weighted, and Gd-EOB-DTPA-enhanced hepatocyte-phase images in patients with hepatitis C, from which 279 texture features were extracted in a circular ROI for each sequence, including 30 selected for the classification. Park et al. [18] assessed a large data set including patients with 436 pathologically proven liver fibrosis and performed a radiomics analysis in the HBP; the radiomics model significantly outperformed for clinical parameters commonly used for liver fibrosis assessment.

1.1.3. Deep Learning Model

Deep learning has been widely reported for detection, classification, and segmentation of lesions in recent years. In liver imaging, deep learning has also been used for assessing of liver fibrosis. Wang et al. [37] adopted a neural network to extract radiomics features that could provide some high-level features and result in a considerable staging performance for hepatic fibrosis in two-dimensional shear wave elastography (2D-SWE). Yasaka et al. [38] applied a deep convolutional neural network (DCNN) in cropped CT images and found areas under the curves (AUC) of 0.73–0.76 for significant fibrosis, advanced fibrosis, and cirrhosis classification. In another study by Yasaka et al. [39], DCNN in cropped HBP MRI images was used, and AUCs of 0.84–0.85 were obtained for liver fibrosis grading. Recent studies collected larger data sets and achieved higher accuracy [37,40]. Deep learning models are powerful, but highly data dependent and therefore not suitable for small-sample studies, leading to severe overfitting.

1.2. Our Contributions

Although many studies were performed for automatic liver fibrosis grading with radiomics analysis or deep learning algorithms, few studies reported using time-domain information, that is, the variation of imaging features in the time series. We proposed a novel dynamic radiomics model combining imaging features from multi-phase DCE images and time-domain features through the contrast enhancement process to assess liver fibrosis. The proposed model outperformed conventional single-phase or multi-phase-based radiomics models, normalized liver enhancement (NLE), as well as some clinical serum parameters.
The main contributions of our liver fibrosis staging pipeline were as follows:
  • Time-domain information was fully used based on time-varying curves and discrepancy of imaging features with the contrast enhancement process, which was found to play a critical role in all stages of classification.
  • ROI extraction was based on whole-liver region segmentation using three-dimensional (3D) U-net and transfer learning, with the post-processing algorithm for interference information excluded. This method of ROI extraction replaced manual selection and delineation, eliminating the influence of region selection on the results of radiomics analysis while being more automated.
  • Feature extraction was performed in liver volume and more valuable information, such as morphological changes in the liver, was considered, which facilitated the classification of cirrhosis.

2. Materials and Methods

2.1. Dataset

2.1.1. Study Population

This study was approved by the ethics committee of Shanghai Public Health Clinical Center (YJ-2019-S037–02; 05/11/2019). The sample comprised mainly patients with chronic hepatitis B and Child-Pugh score <7. A total of 132 participants were recruited from August 2016 to February 2019. These patients, who underwent liver aspiration biopsy, were divided into four subgroups, including the S1 (n = 30), S2 (n = 28), S3 (n = 32), and S4 (n = 42) groups, according to the Scheuer–Ludwig scoring (S) system.
The inclusion criteria were as follows: (1) clinical diagnosis of chronic hepatitis B; (2) liver biopsy within 3 months; (3) no MRI enhancement contraindications, such as implanted incompatible devices, claustrophobia, and severe renal insufficiency; (4) age >18 years; (5) alcohol consumption <20g/day; and (6) signed informed consent. The exclusion criteria were as follows: (1) combined with other types of viral hepatitis; (2) Child–Pugh score ≥7 points; (3) antiviral, antifibrotic, or antifibrotic treatments before MRI examination; (4) diffuse liver-occupying position; (5) a history of liver surgery or interventional therapy; and (6) difficulty in breathing cooperation. The diagnosis of chronic hepatitis B complied with the diagnostic criteria issued by the European Association for the Study of Liver Diseases in 2017. The baseline characteristics of the patients are shown in Table 1.
Further, 40 of 132 patients were randomly assigned to the test set (with the original distribution of positive and negative cases). The remaining 92 patients constituted the training set for each liver fibrosis classification task (Table 1).
Another 120 patients with hepatocellular carcinoma (HCC) (DCE sequences) having existing manually labeled liver contours were enrolled in this study for transfer learning in liver segmentation.

2.1.2. MRI Protocol

The patient were required to fast for 6 h before the MRI examination. The elimination of interference with image acquisition during the examination was achieved by training for breath-holding and adopting the abdominal band and respiratory gating. A Philips Ingenia 3.0 T MR scanner (Philips Healthcare, Best, the Netherlands) equipped with a dStream Torso Coil body coil was used for scanning. The scan’s field of view included the entire liver, and the contrast agent was injected with Gd-EOB-DTPA at a rate of 2.0 mL/s and a dose of 0.025 mmol/kg. The DCE sequences were acquired within 5 min (mask, arterial, portal venous, and delayed phases) and 20 min (hepatobiliary phase) after contrast agent injection using an mDIXON Water (mDIXON-W) sequence. The mDIXON-W is a 3D T1−weighted gradient echo sequence that applies multiple acquired echo-generating water images. The specific scanning parameters were as follows: flip angle (FA): 10°; echo time (TE1 and TE2): 1.14 and 2.0 ms, respectively; repetition time (TR): 3.3 ms; slice thickness: 3.5 mm; field of view (FOV): 380 × 332 mm2; matrix size: 216 × 188; and scanning time: 9.2 s.

2.1.3. Reference Standard

The Scheuer–Ludwig scoring system is the standard for assessing the level of liver fibrosis [41], which encompasses five degrees as follows: S0, not fibrotic; S1, door tube area expansion; S2, fibrosis around the portal area and retention of the leaflet structure; S3, fibrosis with the lobular structural disorder and no cirrhosis; and S4, possible or affirmative cirrhosis. In this study, grades S2–S4 indicated significant fibrosis, whereas grades S3–S4 indicated advanced fibrosis and S4 reflected cirrhosis.

2.2. Serum Fibrosis Tests

The aspartate transaminase-to-platelet ratio index (APRI) and the fibrosis-4 index (FIB-4) were recorded, which are the two most widely studied indexes for liver fibrosis assessment, as noninvasive tools [42]. The APRI was calculated as follows: (aspartate aminotransferase (AST) (U/L)/upper limit of the normal AST range × 100)/(platelet count (PLT) (109/L)) and the FIB-4 was calculated as (age (years) × AST (U/L))/(PLT (109/L) × (alanine aminotransferase (ALT) (U/L))1/2) [43,44].

2.3. Normalized Liver Enhancement

NLE was calculated as the relative enhancement on the pre-contrast images using the following formula: NLE = (SIHBP − SIDYN1)/(SIDYN1), where SIDYN1 and SIHBP are the mean signal intensities of the segmented liver ROI in the mask phase and HBP, respectively. NLE is actually a time-domain feature reported to be associated with the liver fibrosis grade in existing studies [22,23,24,25].

2.4. Overall Framework of the Proposed Dynamic Radiomics Model

As illustrated in Figure 1, the framework of the proposed dynamic radiomics model mainly consisted of three steps: (a) liver ROI extraction based on transfer learning, with the post-processing algorithm to exclude interference information; (b) extraction of radiomics features from multi-phase DCE images and through time-domain information; and (c) feature selection, training and evaluation of various classifiers, and prediction in the test set.

2.5. Processing Pipeline

2.5.1. ROI Extraction

This study developed a new automatic ROI extraction approach based on 3D liver segmentation and post-processing, which was different from previous manual ROI drawing modes. First, multiple DCE phases were co-registered to the HBP space using a symmetric normalization algorithm [45], performed in Advanced Normalization Tools, which is a state-of-the-art medical image registration and segmentation toolkit. Liver segmentation was implemented on a 3D U-net [46], including multiscale encoding and decoding with convolutional layers, batch normalization layers, max pooling layers, and concatenate structure. The detailed network architecture is shown in Figure 2a. Transfer learning was performed. Specifically, the neural network was pre-trained on a dataset of 120 liver MRI scans with manually labeled liver contours, and fine-tuned and evaluated on the current database (the liver contours of 12 patients in the current database were delineated by an experienced radiologist, including 8 for fine-tuning and 4 for testing). The liver ROIs of the remaining cases were predicted using the trained network.
Moreover, the segmented liver mask was post-processed using image processing techniques, including hole filling, finding the 3D maximum connected component, eroding, and local thresholding [47] to ensure that the extracted ROIs were in the hepatic region and to exclude interference from large portal veins.

2.5.2. Feature Extraction

Feature extraction was first performed separately in each phase of DCE images, collecting radiomics features, including shape and first-order statistical and textural features [48,49]. In total, 14 common shape characteristics described differences in liver shape affected by different degrees of fibrosis, 18 first-order statistical features showed the distribution of voxel intensities, and 73 textural features reflected the internal heterogeneity of the ROI based on five textural matrices. Additionally, some-time domain features were determined for considering the changes in features during the enhancement process. The extracted time-domain features were mainly composed of two parts: (1) the feature discrepancy between different DCE phases and (2) the mean (1), variance (2), skewness (3), kurtosis (4), and entropy (5) of the time-varying curves for each feature except for the common shape features.
m e a n ( X = [ x 1 x N ] ) = 1 N i = 1 N x i
V a r ( X = [ x 1 x N ] ) = 1 N 1 i = 1 N ( x i X ¯ ) 2
S k e w ( X = [ x 1 x N ] ) = 1 N i = 1 N [ x i X ¯ σ ] 3
K u r t ( X = [ x 1 x N ] ) = { 1 N i = 1 N [ x i X ¯ σ ] 4 } 3
E n t r o ( X = [ x 1 x N ] ) = i = 1 N ( x i n o r m log 2 ( x i n o r m + ε ) ) x i n o r m = [ x i min ( X ) ] [ max ( X ) min ( X ) ]       i f   x i 0 x i n o r m = [ max ( X ) x i ] [ max ( X ) min ( X ) ]       i f   x i < 0 x i n o r m = x i n o r m   X
where N = 5 corresponds to five DCE phases (mask, arterial, portal venous, delayed, and hepatobiliary phases), σ = V a r ( x 1 x N ) is the distribution’s standard deviation, and ε = 1 e 16 is an extremely small value to ensure the computability of the equation. Finally, a total of 1379 features were included in the feature base, including 471 spatial domain characteristics, 455 feature discrepancy features and 455 time-varying curve-based features. A detailed breakdown of the extracted features is shown in Appendix A. After feature extraction, each feature was normalized using the z-score method based on its distribution in the training set, and the same mean and standard deviation were applied to the normalization of the test set to avoid the overfitting effect introduced by feature normalization.

2.5.3. Feature Selection and Classification

Feature selection aims to obtain the smallest subset of features to avoid the potential problem of overfitting [50] without reducing classification accuracy and retaining the classification distribution. In this study, features were first filtered based on correlation. Specifically, Spearman correlation was performed for correlation analysis, and the permutation test was applied for statistical analysis. Features with correlation coefficients greater than 0.2, and P values less than 0.05, were retained. The least absolute shrinkage and selection operator (LASSO) logistic regression algorithm [51] was further used to filter out the five most important features in the feature subset for classification. Due to the limited sample size, this study adopted a small number of features (top five features) for classifier construction underneath insignificance reduction in training performance to guarantee the generalizability of the model.
In total, six mainstream classifiers, including logistic regression (LR), linear discriminant (LD), k-nearest-neighbor (KNN), Gaussian naive Bayes (GNB), decision tree (DT), and support vector machine (SVM), were trained and evaluated through five-fold cross-validation in the training set. The optimal classifier with the highest AUC value was selected to make predictions in the test set.

2.6. Data Resampling

In this study, the data distribution in classification tasks was unbalanced and might lead to biased prediction. The synthetic minority oversampling technique (SMOTE) approach [52] was employed to generate a new balanced data set for subsequent analysis. In specific, the SMOTE algorithm generates new instances from existing minority cases through interpolating new feature values between the target instance and its neighbors in the feature space, while keeping the number of majority cases unchanged. In this study, the number of neighbors to be considered was set as 3. Oversampling was only performed in the training set, and data in the validation and test sets were kept real without interpolation. The resampling process was applied after feature selection because most variable selection algorithms were based on the assumption of sample independence [53].

2.7. Evaluation Metrics

The Dice coefficient was used to evaluate the performance in liver segmentation. The performance of the radiomics model was evaluated using the classification accuracy, AUC, average precision (AP), and F1 score. The receiver operating characteristic (ROC) curve, precision-recall (PR) curve, and violin graph of distribution were constructed to demonstrate the performance of the model visually.

2.8. Implementation Details

The liver segmentation model based on the 3D U-net architecture was trained and tested with Keras (2.3.1, backend TensorFlow 1.14.0) on a 32 GB NVIDIA TESLA 39C graphics processing unit (GPU). Adaptive moment estimation (Adam) was used as an optimizer in the training procedure, with an initial learning rate of 0.001, and reduced to half of the original value every 100 epochs. The total number of training epochs was set to 500, with a batch size of 5. All volumetric data were downsized to 80 × 256 × 256 and fed into the network in an overlapping manner (eight overlapping layers) with a size of 16 × 256 × 256 during the training process (Figure 2b). In prediction, we only considered the prediction results of the middle eight layers (Figure 2c). The radiomics features were extracted using an open-source ”Pyradiomics“ package (https://pyradiomics.readthedocs.io/en/latest/features.html, version 2.1.2). All classifiers were trained and tested using the ”sklearn“ package (version 0.22.1). The quadratic classification issue (S1–S4) was turned into three binary classification tasks due to the limited number of cases, significant fibrosis (S1 vs. S2–S4), advanced fibrosis (S1–S2 vs. S3–S4) and cirrhosis (S1–S3 vs. S4) classification tasks. Statistical evaluation was based on the subject level in this study, implying that the classifications were performed on each patient rather than on each slice. The Mann–Whitney test was performed to compare the selected feature values and predicted scores between the positive and control groups. A p-value < 0.05 indicated a statistically significant difference.

3. Results

3.1. Liver Segmentation

Liver segmentation based on deep learning achieved a 3D volume Dice score of 0.961 ± 0.007 in the test set of current datasets. A segmentation slice demonstration is illustrated in Figure 3. The segmented mask fitted the real label well, and the post-processing algorithms effectively removed interfering information such as large vessels.

3.2. Proposed Dynamic Radiomics Model

A total of five features were included in the final feature subset in each classification task. The corresponding regularization parameters in LASSO logistic regression was 0.103, 0.147, and 0.129 for staging significant fibrosis, advanced fibrosis, and cirrhosis, respectively. The selected features and their importance are demonstrated in Figure 4 (left panel). In the classification of significant fibrosis and advanced fibrosis, three of the selected features belonged to the variation of textural features in the time domain, one was the variation of histogram variable in the time domain, and the other was textural feature in hepatobiliary phase. In cirrhosis classification, two important variables were shape-based features, two were the variation of textural features in the time domain, and the other belonged to textural feature in delayed phase. The Mann–Whitney test was performed for each selected feature, and p-values were further corrected by false discovery rate (FDR) method. The results are shown in Table 2.
It can be seen that after correction, one feature in significant fibrosis classification and four features in advanced fibrosis and cirrhosis classifications are statistically significant. In addition, the values of features in two subsets of patients with extreme classifier prediction scores were investigated, one was chosen as the 20% with the lowest prediction scores in the control group, and the other was 20% with the highest prediction scores in the positive group [54]. The results are shown in Table 3.
According to results of statistical test for each feature and statistics of feature values for patients with extreme values of the prediction scores by the classifier, it can be found that there was an obvious difference in studied features between the positive and control groups, and this difference was more significant between two subgroups with extreme classifier prediction scores. In addition, the way features change in the time domain undoubtedly played an important role in the liver fibrosis grading model, which accounted for a large part of the selected features. For example, dependence variance measured the variance in dependence size in the liver region based on gray level dependence matrix (GLDM), and it showed a bigger difference between arterial phase and mask phase for significant fibrosis cases. Moreover, informational measure of correlation assessed the correlation between the probability distributions of different grey levels based on gray level co-occurrence matrix (GLCM), which can quantify the complexity of the texture, and both in advanced fibrosis and cirrhosis, a smaller difference was obtained between HBP and earlier phase for higher grade liver fibrosis. Furthermore, the morphology of the liver changed significantly in cirrhosis stage, with a larger diameter in sagittal plane, and a smaller sphericity value, which was important for identifying patients with cirrhosis. The image comparison between a typical cirrhotic patient and a non-cirrhotic patient is shown in Figure 5, and the normalized feature values for these two cases were as follows: GLDM Large Dependence High Gray Level Emphasis in DYN4 (positive: −1.174, control: 1.395); Shape-based Maximum 2D diameter (positive: 0.370, control: −0.793); Shape-based Sphericity (positive: −0.563, control: 0.032); GLCM Informational Measure of Correlation (HBP-DYN4) (positive: −2.273, control: 1.493); and GLCM Kurtosis of Cluster Prominence in time domain (positive: 1.259, control: −1.285). Liver tumors were common in patients with cirrhosis, it can be found from Figure 5a that the liver portion used for feature extraction did not include the tumor region and thus the interference information was well excluded, which reflected the effectiveness of the post-processing algorithms.
The performance of the six classifiers in five-fold cross-validation and the corresponding AUC value in the test set of the selected optimal classifier are shown in Figure 6 (top panel). For significant fibrosis, the best performance classifier was GNB with an AUC value of 0.874 ± 0.078 in the validation set. The selected classifier achieved an accuracy of 0.875, with an AUC value of 0.867 (95% confidence interval (CI): 0.723–0.954), an AP score of 0.939, and an F1 score of 0.921 in the test set. In the stage of advanced fibrosis, SVM was selected with a validation AUC value of 0.883 ± 0.080, whereas the performance in the test set had an accuracy of 0.825, an AUC value of 0.874 (95%CI: 0.730–0.957), an AP score of 0.906, and an F1 score of 0.837. The selected top classifier was LR with an AUC value of 0.897 ± 0.059 in cross-validation, and achieved an accuracy of 0.850, with an AUC value of 0.900 (95%CI: 0.764–0.972), an AP score of 0.866, and an F1 score of 0.750 in the test set in cirrhosis cases. The prediction scores generated by the classifier for each case in the test set are shown in Figure 4 (right panel), the scores (median (interquartile range)) of positive patients were significantly higher than the control group in significant fibrosis classification: 0.971 (0.942~0.983) vs. 0.210 (0.050~0.719), p < 0.001; advanced fibrosis classification: 0.764 (0.552~0.837) vs. 0.283 (0.170~0.392), p < 0.001; and cirrhosis classification: 0.768 (0.303~0.897) vs. 0.049 (0.018~0.208), p < 0.001. The confusion matrix in the test set for each classification task is illustrated in Figure 6 (bottom panel).

3.3. Performance Comparison

The performance of the proposed model for fibrosis grading was compared with those of single-phase DCE-based radiomics model (radiomics features from the mask phase, arterial phase, portal venous phase, delayed phase, and HBP, individually), multi-phase DCE-based radiomics model (combination of imaging features from the mask phase, arterial phase, portal venous phase, delayed phase, and HBP, without time-domain features), NLE, and serological indicators including APRI and FIB-4. The number of selected features in the single-phase or multi-phase DCE-based radiomics models was five; the training and test sets remained unchanged, and the entire radiomics analysis followed the same process with the proposed dynamic radiomics model.
The ROC and PR curves of various liver fibrosis staging models are shown in Figure 7. The dynamic radiomics model had the most stable and best overall performance in each classification task, with AUC improvements of at least 0.03 in significant fibrosis, 0.05 in advanced fibrosis, and 0.01 in cirrhosis classification. Moreover, the prediction accuracy of the dynamic radiomics model was also the highest in each classification task. Table 4 illustrates the specific performance of each model in terms of accuracy, AUC, AP score, and F1 score. Furthermore, violin graphs were constructed for various models to observe their discrimination abilities in liver fibrosis grading. As shown in Figure 8, the proposed radiomics model had the best discriminatory potential for each classification task.

4. Discussion

This study aimed to assess hepatic fibrosis based on dynamic radiomics analysis combining multiple DCE phases and time-domain information. The proposed method demonstrated a considerable value in classifying significant fibrosis, advanced fibrosis, and cirrhosis, indicating that the dynamic radiomics analysis of Gd-EOB-DTPA MRI images might have the potential for automatic hepatic fibrosis staging in patients with hepatitis B. However, physicians need to depend on liver biopsy tests for grading in general.
Non-invasive hepatic fibrosis assessment is a hot topic and has been explored in multiple studies. One of the main directions is to measure liver stiffness, usually by ultrasound elastography [29,30] or MRE [33,34,35]. This approach shows a high correlation between the degree of fibrosis and liver stiffness. However, ultrasound-based measurement methods may suffer from unreliable issues due to the lack of reproducibility and operator dependence [31]. MRE can ameliorate these drawbacks to some extent, but requires additional equipment and is more expensive compared with conventional MRI. Therefore, radiomics analysis has attracted increasing attention recently. The discriminating ability of radiomics analysis has a strong correlation with histopathological characteristics. The destruction of liver parenchyma homogeneity is reflected in the liver by textural features [17] and characterized by fibrous septa and nodules of different sizes because lymphocyte infiltration and hepatocyte damage are the characteristics of the necroinflammatory process in chronic viral hepatitis [55,56]. Most established radiomics studies have been performed on CT and MRI images. According to a study by Zhang et al. [13], MRI images generally have an advantage over CT images in hepatic fibrosis evaluation based on radiomics analysis. In another study, Watanabe et al. [57] pointed to a conspicuous correlation between the contrast enhancement index in gadoxetate disodium-enhanced MRI and fibrosis staging. Thus, enhanced MRI is more reliable for staging hepatic fibrosis than diffusion-weighted MRI, besides hematologic and clinical parameters. Furthermore, previous studies demonstrated the potential of liver-specific Gd-EOB-DTPA-enhanced MRI in hepatic fibrosis assessment, in which the HBP after 20 min highly correlated with the degree of liver fibrosis [22,23,24,25,26,27]. In this study, we performed a systematic work on radiomics analysis based on Gd-EOB-DTPA-enhanced MRI. A dynamic radiomics model was proposed, which used radiomics features from multi-phase DCE images as well as time-domain features through the enhancement process. Time-domain information played an important role in liver fibrosis staging, which was not discussed previously.
This study was novel in proposing fully automatic dynamic radiomics analysis for hepatic fibrosis staging based on Gd-EOB-DTPA-enhanced MRI. The proposed model had the most stable and best overall performance in all stages of classification compared with the staging results of conventional single-phase or multi-phase DCE-based radiomics models, NLE, and serological indicators. Meanwhile, this study found that the HBP was also critical to hepatic fibrosis staging, outperforming other individual phases in classification, corroborating previous findings. Moreover, a simple combination of imaging features from five DCE phases did not achieve better results and was even worse than using HBP features alone. Indeed, the time-domain features played a key role in the dynamic radiomics model.
The strengths of this study were as follows. First, in previous studies, most texture analyses of hepatic fibrosis were performed on a manual extraction area at a representative slice, for example, a circular or square region [12,13,14,16,17]. Alternatively, the entire liver delineated on the slice contained the largest cross-section through the liver, carefully avoiding the portal vein, very large intrahepatic vessels, and any obvious motion-affected regions [15]. This pattern of ROI extraction was extremely time consuming, and might result in the loss or destruction of valid texture information due to the investigator’s experience and other uncontrollable factors. The choice of ROI might also heavily influence the results of radiomics models. Different from previously used methods, an automatic liver ROI extraction strategy based on transfer learning was applied in this study and the segmented mask was post-processed to remove interfering information effectively. This fully automatic extraction method could reduce the workload of the radiologist to a large extent, and eliminate the influence of region selection on the results of radiomics analysis. Second, the radiomics features from multiple DCE phases and the time-domain features extracted from the time-varying curves and characteristic differences in imaging features through the enhancement process were combined in the feature extraction step to establish a larger feature base. Hence, a more valuable feature combination was explored, resulting in superior classification performance. Although only five features were covered after feature selection in the classification model, the time-domain features accounted for a large proportion of the final feature subset, indicating the critical role of time-domain features in the grading of liver fibrosis. Specifically, 80% of the features ultimately contributing to the classification model were time-domain features in significant fibrosis and advanced fibrosis classification, while 40% were time-domain features in cirrhosis classification. In addition, feature extraction was performed based on the segmented liver volume, hence some valuable morphological features of the liver could be considered. As a result, two shape-based features were selected in cirrhosis classification, revealing significant changes in liver morphology in this stage. This was also supported by a previous study [58], reporting that the shape of the liver could be altered to some extent due to hepatocyte necrosis and collapse. The exploitation of shape features was also not possible with the traditional circular or square ROI extraction mode. Considering the aforementioned improvements, the proposed model had the most stable and best overall performance in hepatic fibrosis staging tasks, while being more automated.
Although the proposed dynamic radiomics model has achieved superior performance on the current dataset, the generalization of the model is still a challenging task. MRI-based radiomics features can be affected by many factors, for example, multiple MR scanners, MR acquisition parameters, reconstruction algorithms, introduced noise and artefacts, and pre-processing and post-processing of images or features [59,60,61,62]. We believe that the first priority is to standardize the entire process, that is, for future data collection, the acquisition parameters and processing algorithms should remain as consistent as possible with the developed standards. In addition, the assessment of liver fibrosis was based on the whole liver region in this study, so it can be inferred that the model was robust to local noise and artifacts. The biggest concern is the inevitable data fluctuations that occur when models are applied to multi-center data, due to differences in MR scanners and scanning protocols. Fortunately, the acquisition process of Gd-EOB-DTPA-enhanced MRI is relatively fixed in different centers, with similar timing of acquisition for each enhanced phase after contrast injection (arterial phase, portal venous phase, delayed phase, and hepatobiliary phase). For the differences in image intensity distribution in multi-center datasets, two strategies can be explored, (1) for radiomics model, the reproducibility and stability of radiomics features can be evaluated and the features that are more robust across multi-center data can be selected to build classification models [63,64]. (2) Some intensity standardization algorithms can be applied to the preprocessing of multi-center image data to adjust the intensity distribution, for example, global histogram matching algorithm, joint histogram registration algorithm, and generative adversarial network-based method [65].
This study had some limitations. The sample size needed to be enlarged, and the generalizability of the hepatic fibrosis model needed further validation in a multi-center large-scale study. In addition, this study was conducted for Gd-EOB-DTPA-enhanced MRI, and the effect of dynamic information in conventional MRI contrast agents needed to be further tested. Finally, the value of the model in grading non-diffuse hepatic fibrosis remains unknown. In future work, a multi-center large-scale data set will be collected prospectively, and the classification performance and generalization ability of the proposed dynamic radiomics model are expected to be further improved.

5. Conclusions

This study proposed an automatic hepatic fibrosis grading model based on dynamic radiomics analysis in multiple Gd-EOB-DTPA-enhanced DCE phases. The whole process was highly automated, which could save time and energy for new case prediction or additional dataset training. The prediction performance of the dynamic radiomics model was more superior for the classification of all stages of hepatic fibrosis compared with the conventional single-phase or multi-phase DCE-based radiomics models, NLE, and some clinical serum parameters, indicating an association of fibrosis stage with dynamic radiomics features.

Author Contributions

Conceptualization, H.W. and Y.S.; methodology, R.Z., C.W., H.W.; software, R.Z., C.W., W.C., C.S., N.S. and T.Q.; validation, R.Z. and H.W.; formal analysis, R.Z., C.S. and C.W.; investigation, R.Z., C.S., N.S. and T.Q.; resources, H.W. and Y.S.; data curation, C.S., N.S., T.Q. and Y.S.; writing—original draft preparation, R.Z. and C.S.; writing—review and editing, H.W., Y.S., C.W., W.C.; visualization, R.Z., H.W. and C.W.; supervision, H.W., Y.S. and C.W.; project administration, R.Z., C.S.; funding acquisition, H.W. and Y.S. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by the National Natural Science Foundation of China (No. 81971583), the National Key R&D Program of China (No. 2018YFC1312900), the Shanghai Municipal Science and Technology Major Project (No. 2017SHZDZX01 and No. 2018SHZDZX01) and ZJLab, Shanghai Hospital Development Center (No. SHDC12019128).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of Shanghai Public Health Clinical Center (YJ-2019-S037–02; 05/11/2019).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The example data and extracted features that support the findings of this study is openly available at link: http://180.167.250.222:8888/d/f78490a9288d4c6dbdeb/.

Acknowledgments

The authors wish to acknowledge the medical doctors in the Shanghai Public Health Clinical Center for data collection, and all members of the Institute of Science and Technology for Brain-inspired Intelligence for their helpful discussions.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

A total of 1379 radiomics features were included in the feature base. The enrolled mask phase, arterial phase, portal venous phase, delayed phase and hepatobiliary phase were denoted as DCE1, DCE2, DCE3, DCE4 and HBP, respectively. The feature set included 14 common shape features for all phases; 18 first-order statistical features, and 73 textural features based on gray level co-occurrence matrix (GLCM) (22 features), gray level size zone matrix (GLSZM) (16 features), gray level run length matrix (GLRLM) (16 features), neighboring gray tone difference matrix (NGTDM) (5 features) and gray level dependence matrix (GLDM) (14 features) for each phase, resulting in 455 features. In the time domain, feature discrepancy between different phases consisted of 455 features from DCE2-DCE1, DCE3-DCE2, DCE4-DCE3, HBP-DCE4, and HBP-DCE1 for first-order statistical features and textural features. In addition, a time-varying curve was constructed for each feature except for the common shape features, and the values of mean, variance, kurtosis, skewness and entropy were determined as another part of time-dimension features, resulting in 455 features.

References

  1. Bataller, R.; Brenner, D.A. Liver fibrosis. J. Clin. Investig. 2005, 115, 209–218. [Google Scholar] [CrossRef]
  2. European Association for the Study of the Liver. EASL-ALEH Clinical Practice Guidelines: Non-invasive tests for evaluation of liver disease severity and prognosis. J. Hepatol. 2015, 63, 237–264. [Google Scholar] [CrossRef] [Green Version]
  3. Cadranel, J.F.; Rufat, P.; Degos, F. Practices of liver biopsy in France: Results of a prospective nationwide survey. For the Group of Epidemiology of the French Association for the Study of the Liver (AFEF). Hepatology 2000, 32, 477–481. [Google Scholar] [CrossRef]
  4. Shiha, G.; Ibrahim, A.; Helmy, A.; Sarin, S.K.; Omata, M.; Kumar, A.; Bernstien, D.; Maruyama, H.; Saraswat, V.; Chawla, Y.; et al. Asian-Pacific Association for the Study of the Liver (APASL) consensus guidelines on invasive and non-invasive assessment of hepatic fibrosis: A 2016 update. Hepatol. Int. 2017, 11, 1–30. [Google Scholar] [CrossRef]
  5. Chang, P.E.; Goh, G.B.; Ngu, J.H.; Tan, H.K.; Tan, C.K. Clinical applications, limitations and future role of transient elastography in the management of liver disease. World J. Gastrointest. Pharmacol. Ther. 2016, 7, 91–106. [Google Scholar] [CrossRef]
  6. Singh, S.; Venkatesh, S.K.; Loomba, R.; Wang, Z.; Sirlin, C.; Chen, J.; Yin, M.; Miller, F.H.; Low, R.N.; Hassanein, T.; et al. Magnetic resonance elastography for staging liver fibrosis in non-alcoholic fatty liver disease: A diagnostic accuracy systematic review and individual participant data pooled analysis. Eur. Radiol. 2016, 26, 1431–1440. [Google Scholar] [CrossRef]
  7. Parekh, V.; Jacobs, M.A. Radiomics: A new application from established techniques. Expert Rev. Precis. Med. Drug Dev. 2016, 1, 207–226. [Google Scholar] [CrossRef] [Green Version]
  8. Tang, M.; Feng, S.-T.; Peng, S.; Kuang, M. IDDF2018-ABS-0098 Preoperative prediction of microvascular invasion in hepatocellular cancer: A radiomics model using GD-EOB-DTPA enhanced MRI. Gut 2018, 67, A96. [Google Scholar]
  9. Aerts, H.J.; Velazquez, E.R.; Leijenaar, R.T.; Parmar, C.; Grossmann, P.; Carvalho, S.; Bussink, J.; Monshouwer, R.; Haibe-Kains, B.; Rietveld, D.; et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat. Commun. 2014, 5, 1–9. [Google Scholar] [CrossRef]
  10. Dohan, A.; Gallix, B.; Guiu, B.; Le Malicot, K.; Reinhold, C.; Soyer, P.; Bennouna, J.; Ghiringhelli, F.; Barbier, E.; Boige, V. Early evaluation using a radiomic signature of unresectable hepatic metastases to predict outcome in patients with colorectal cancer treated with FOLFIRI and bevacizumab. Gut 2020, 69, 531–539. [Google Scholar] [CrossRef]
  11. Ribeiro, R.T.; Marinho, R.T.; Sanches, J.M. Classification and staging of chronic liver disease from multimodal data. IEEE Trans. Biomed. Eng. 2012, 60, 1336–1344. [Google Scholar] [CrossRef]
  12. Duan, J.; Hu, C.; Luo, S.; Zhao, X.; Wang, T. Microcomputed tomography with diffraction-enhanced imaging for morphologic characterization and quantitative evaluation of microvessel of hepatic fibrosis in rats. PLoS ONE 2013, 8, e78176. [Google Scholar] [CrossRef] [Green Version]
  13. Zhang, X.; Gao, X.; Liu, B.J.; Ma, K.; Yan, W.; Liling, L.; Yuhong, H.; Fujita, H. Effective staging of fibrosis by the selected texture features of liver: Which one is better, CT or MR imaging? Comput. Med. Imaging Graph. 2015, 46, 227–236. [Google Scholar] [CrossRef]
  14. Kato, H.; Kanematsu, M.; Zhang, X.; Saio, M.; Kondo, H.; Goshima, S.; Fujita, H. Computer-aided diagnosis of hepatic fibrosis: Preliminary evaluation of MRI texture analysis using the finite difference method and an artificial neural network. AJR Am. J. Roentgenol. 2007, 189, 117–122. [Google Scholar] [CrossRef] [Green Version]
  15. House, M.J.; Bangma, S.J.; Thomas, M.; Gan, E.K.; Ayonrinde, O.T.; Adams, L.A.; Olynyk, J.K.; St Pierre, T.G. Texture-based classification of liver fibrosis using MRI. J. Magn. Reson. Imaging 2015, 41, 322–328. [Google Scholar] [CrossRef]
  16. Cannella, R.; Borhani, A.A.; Tublin, M.; Behari, J.; Furlan, A. Diagnostic value of MR-based texture analysis for the assessment of hepatic fibrosis in patients with nonalcoholic fatty liver disease (NAFLD). Abdom. Radiol. 2019, 44, 1816–1824. [Google Scholar] [CrossRef]
  17. Wu, Z.; Matsui, O.; Kitao, A.; Kozaka, K.; Koda, W.; Kobayashi, S.; Ryu, Y.; Minami, T.; Sanada, J.; Gabata, T. Hepatitis C related chronic liver cirrhosis: Feasibility of texture analysis of MR images for classification of fibrosis stage and necroinflammatory activity grade. PLoS ONE 2015, 10, e0118297. [Google Scholar] [CrossRef] [Green Version]
  18. Park, H.J.; Lee, S.S.; Park, B.; Yun, J.; Sung, Y.S.; Shim, W.H.; Shin, Y.M.; Kim, S.Y.; Lee, S.J.; Lee, M.G. Radiomics analysis of gadoxetic acid–enhanced MRI for staging liver fibrosis. Radiology 2019, 290, 380–387. [Google Scholar] [CrossRef]
  19. Piechnik, S.K.; Ferreira, V.M.; Dall’Armellina, E.; Cochlin, L.E.; Greiser, A.; Neubauer, S.; Robson, M.D. Shortened Modified Look-Locker Inversion recovery (ShMOLLI) for clinical myocardial T1-mapping at 1.5 and 3 T within a 9 heartbeat breathhold. J. Cardiovasc. Magn. Reson. 2010, 12, 1–11. [Google Scholar] [CrossRef] [Green Version]
  20. Bluemke, D.A.; Sahani, D.; Amendola, M.; Balzer, T.; Breuer, J.; Brown, J.J.; Casalino, D.D.; Davis, P.L.; Francis, I.R.; Krinsky, G.; et al. Efficacy and safety of MR imaging with liver-specific contrast agent: U.S. multicenter phase III study. Radiology 2005, 237, 89–98. [Google Scholar] [CrossRef]
  21. Kobayashi, S.; Matsui, O.; Gabata, T.; Koda, W.; Minami, T.; Ryu, Y.; Kozaka, K.; Kitao, A. Relationship between signal intensity on hepatobiliary phase of gadolinium ethoxybenzyl diethylenetriaminepentaacetic acid (Gd-EOB-DTPA)-enhanced MR imaging and prognosis of borderline lesions of hepatocellular carcinoma. Eur. J. Radiol. 2012, 81, 3002–3009. [Google Scholar] [CrossRef]
  22. Verloh, N.; Utpatel, K.; Haimerl, M.; Zeman, F.; Fellner, C.; Fichtner-Feigl, S.; Teufel, A.; Stroszczynski, C.; Evert, M.; Wiggermann, P. Liver fibrosis and Gd-EOB-DTPA-enhanced MRI: A histopathologic correlation. Sci. Rep. 2015, 5, 1–10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Choi, Y.R.; Lee, J.M.; Yoon, J.H.; Han, J.K.; Choi, B.I. Comparison of magnetic resonance elastography and gadoxetate disodium–enhanced magnetic resonance imaging for the evaluation of hepatic fibrosis. Invest. Radiol. 2013, 48, 607–613. [Google Scholar] [CrossRef]
  24. Feier, D.; Balassy, C.; Bastati, N.; Stift, J.; Badea, R.; Ba-Ssalamah, A. Liver fibrosis: Histopathologic and biochemical influences on diagnostic efficacy of hepatobiliary contrast-enhanced MR imaging in staging. Radiology 2013, 269, 460–468. [Google Scholar] [CrossRef] [PubMed]
  25. Verloh, N.; Probst, U.; Utpatel, K.; Zeman, F.; Brennfleck, F.; Werner, J.M.; Fellner, C.; Stroszczynski, C.; Evert, M.; Wiggermann, P.; et al. Influence of hepatic fibrosis and inflammation: Correlation between histopathological changes and Gd-EOB-DTPA-enhanced MR imaging. PLoS ONE 2019, 14, e0215752. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Haimerl, M.; Verloh, N.; Zeman, F.; Fellner, C.; Nickel, D.; Lang, S.A.; Teufel, A.; Stroszczynski, C.; Wiggermann, P. Gd-EOB-DTPA-enhanced MRI for evaluation of liver function: Comparison between signal-intensity-based indices and T1 relaxometry. Sci. Rep. 2017, 7, 1–12. [Google Scholar] [CrossRef]
  27. Haimerl, M.; Schlabeck, M.; Verloh, N.; Zeman, F.; Fellner, C.; Nickel, D.; Barreiros, A.P.; Loss, M.; Stroszczynski, C.; Wiggermann, P. Volume-assisted estimation of liver function based on Gd-EOB-DTPA-enhanced MR relaxometry. Eur. Radiol. 2016, 26, 1125–1133. [Google Scholar] [CrossRef] [PubMed]
  28. Barr, R.G.; Ferraioli, G.; Palmeri, M.L.; Goodman, Z.D.; Garcia-Tsao, G.; Rubin, J.; Garra, B.; Myers, R.P.; Wilson, S.R.; Rubens, D.; et al. Elastography assessment of liver fibrosis: Society of radiologists in ultrasound consensus conference statement. Radiology 2015, 276, 845–861. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Cassinotto, C.; Lapuyade, B.; Ait-Ali, A.; Vergniol, J.; Gaye, D.; Foucher, J.; Bailacq-Auder, C.; Chermak, F.; Le Bail, B.; de Ledinghen, V. Liver fibrosis: Noninvasive assessment with acoustic radiation force impulse elastography—Comparison with FibroScan M and XL probes and FibroTest in patients with chronic liver disease. Radiology 2013, 269, 283–292. [Google Scholar] [CrossRef]
  30. Friedrich-Rust, M.; Nierhoff, J.; Lupsor, M.; Sporea, I.; Fierbinteanu-Braticevici, C.; Strobel, D.; Takahashi, H.; Yoneda, M.; Suda, T.; Zeuzem, S.; et al. Performance of Acoustic Radiation Force Impulse imaging for the staging of liver fibrosis: A pooled meta-analysis. J. Viral Hepat. 2012, 19, e212–e219. [Google Scholar] [CrossRef]
  31. Bota, S.; Sporea, I.; Sirli, R.; Popescu, A.; Danila, M.; Costachescu, D. Intra- and interoperator reproducibility of acoustic radiation force impulse (ARFI) elastography—Preliminary results. Ultrasound Med. Biol. 2012, 38, 1103–1108. [Google Scholar] [CrossRef] [PubMed]
  32. Venkatesh, S.K.; Yin, M.; Ehman, R.L. Magnetic resonance elastography of liver: Technique, analysis, and clinical applications. J. Magn. Reson. Imaging 2013, 37, 544–555. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Rouviere, O.; Yin, M.; Dresner, M.A.; Rossman, P.J.; Burgart, L.J.; Fidler, J.L.; Ehman, R.L. MR elastography of the liver: Preliminary results. Radiology 2006, 240, 440–448. [Google Scholar] [CrossRef] [PubMed]
  34. Huwart, L.; Sempoux, C.; Vicaut, E.; Salameh, N.; Annet, L.; Danse, E.; Peeters, F.; ter Beek, L.C.; Rahier, J.; Sinkus, R.; et al. Magnetic resonance elastography for the noninvasive staging of liver fibrosis. Gastroenterology 2008, 135, 32–40. [Google Scholar] [CrossRef]
  35. Asbach, P.; Klatt, D.; Hamhaber, U.; Braun, J.; Somasundaram, R.; Hamm, B.; Sack, I. Assessment of liver viscoelasticity using multifrequency MR elastography. Magn. Reson. Med. 2008, 60, 373–379. [Google Scholar] [CrossRef]
  36. Low, G.; Kruse, S.A.; Lomas, D.J. General review of magnetic resonance elastography. World J. Radiol. 2016, 8, 59. [Google Scholar] [CrossRef]
  37. Wang, K.; Lu, X.; Zhou, H.; Gao, Y.; Zheng, J.; Tong, M.; Wu, C.; Liu, C.; Huang, L.; Jiang, T.; et al. Deep learning Radiomics of shear wave elastography significantly improved diagnostic performance for assessing liver fibrosis in chronic hepatitis B: A prospective multicentre study. Gut 2019, 68, 729–741. [Google Scholar] [CrossRef]
  38. Yasaka, K.; Akai, H.; Kunimatsu, A.; Abe, O.; Kiryu, S. Deep learning for staging liver fibrosis on CT: A pilot study. Eur. Radiol. 2018, 28, 4578–4585. [Google Scholar] [CrossRef]
  39. Yasaka, K.; Akai, H.; Kunimatsu, A.; Abe, O.; Kiryu, S. Liver fibrosis: Deep convolutional neural network for staging by using gadoxetic acid–enhanced hepatobiliary phase MR images. Radiology 2018, 287, 146–155. [Google Scholar] [CrossRef]
  40. Choi, K.J.; Jang, J.K.; Lee, S.S.; Sung, Y.S.; Shim, W.H.; Kim, H.S.; Yun, J.; Choi, J.-Y.; Lee, Y.; Kang, B.-K.; et al. Development and Validation of a Deep Learning System for Staging Liver Fibrosis by Using Contrast Agent–enhanced CT Images in the Liver. Radiology 2018, 289, 688–697. [Google Scholar] [CrossRef]
  41. Scheuer, P.J. Classification of chronic viral hepatitis: A need for reassessment. J. Hepatol. 1991, 13, 372–374. [Google Scholar] [CrossRef]
  42. Xiao, G.; Yang, J.; Yan, L. Comparison of diagnostic accuracy of aspartate aminotransferase to platelet ratio index and fibrosis-4 index for detecting liver fibrosis in adult patients with chronic hepatitis B virus infection: A systemic review and meta-analysis. Hepatology 2015, 61, 292–302. [Google Scholar] [CrossRef]
  43. Wai, C.-T.; Greenson, J.K.; Fontana, R.J.; Kalbfleisch, J.D.; Marrero, J.A.; Conjeevaram, H.S.; Lok, A.S.-F. A simple noninvasive index can predict both significant fibrosis and cirrhosis in patients with chronic hepatitis C. Hepatology 2003, 38, 518–526. [Google Scholar] [CrossRef] [Green Version]
  44. Sterling, R.K.; Lissen, E.; Clumeck, N.; Sola, R.; Correa, M.C.; Montaner, J.; Sulkowski, M.S.; Torriani, F.J.; Dieterich, D.T.; Thomas, D.L.; et al. Development of a simple noninvasive index to predict significant fibrosis in patients with HIV/HCV coinfection. Hepatology 2006, 43, 1317–1325. [Google Scholar] [CrossRef]
  45. Avants, B.B.; Epstein, C.L.; Grossman, M.; Gee, J.C. Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain. Med. Image Anal. 2008, 12, 26–41. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Çiçek, Ö.; Abdulkadir, A.; Lienkamp, S.S.; Brox, T.; Ronneberger, O. 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation. In Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2016, Athens, Greece, 17–21 October 2016; pp. 424–432. [Google Scholar]
  47. Sankur, B.; Sezgin, M. Image thresholding techniques: A survey over categories. Pattern Recognit. 2001, 34, 1573–1583. [Google Scholar]
  48. Van Griethuysen, J.J.M.; Fedorov, A.; Parmar, C.; Hosny, A.; Aucoin, N.; Narayan, V.; Beets-Tan, R.G.H.; Fillion-Robin, J.-C.; Pieper, S.; Aerts, H.J.W.L. Computational radiomics system to decode the radiographic phenotype. Cancer Res. 2017, 77, e104–e107. [Google Scholar] [CrossRef] [Green Version]
  49. Zwanenburg, A.; Vallières, M.; Abdalah, M.A.; Aerts, H.J.W.L.; Andrearczyk, V.; Apte, A.; Ashrafinia, S.; Bakas, S.; Beukinga, R.J.; Boellaard, R. The image biomarker standardization initiative: Standardized quantitative radiomics for high-throughput image-based phenotyping. Radiology 2020, 295, 328–338. [Google Scholar] [CrossRef] [Green Version]
  50. Bermingham, M.L.; Pong-Wong, R.; Spiliopoulou, A.; Hayward, C.; Rudan, I.; Campbell, H.; Wright, A.F.; Wilson, J.F.; Agakov, F.; Navarro, P.; et al. Application of high-dimensional feature selection: Evaluation for genomic prediction in man. Sci. Rep. 2015, 5, 10312. [Google Scholar] [CrossRef] [Green Version]
  51. Tibshirani, R. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B (Methodol.) 1996, 58, 267–288. [Google Scholar] [CrossRef]
  52. Chawla, N.V.; Bowyer, K.W.; Hall, L.O.; Kegelmeyer, W.P. SMOTE: Synthetic minority over-sampling technique. J. Artif. Int. Res. 2002, 16, 321–357. [Google Scholar] [CrossRef]
  53. Blagus, R.; Lusa, L. SMOTE for high-dimensional class-imbalanced data. BMC Bioinformatics 2013, 14, 106. [Google Scholar] [CrossRef] [Green Version]
  54. Avanzo, M.; Pirrone, G.; Vinante, L.; Caroli, A.; Stancanello, J.; Drigo, A.; Massarut, S.; Mileto, M.; Urbani, M.; Trovo, M. Electron density and Biologically Effective Dose (BED) radiomics-based machine learning models to predict late radiation-induced subcutaneous fibrosis. Front. Oncol. 2020, 10. [Google Scholar] [CrossRef] [Green Version]
  55. Guido, M.; Mangia, A.; Faa, G. Chronic viral hepatitis: The histology report. Dig. Liver Dis. 2011, 43, S331–S343. [Google Scholar] [CrossRef]
  56. Rahn, S.B. Liver biopsy interpretation in chronic hepatitis. J. Insur. Med. 2001, 33, 110–113. [Google Scholar] [PubMed]
  57. Watanabe, H.; Kanematsu, M.; Goshima, S.; Kondo, H.; Onozuka, M.; Moriyama, N.; Bae, K.T. Staging hepatic fibrosis: Comparison of gadoxetate disodium–enhanced and diffusion-weighted MR imaging—preliminary observations. Radiology 2011, 259, 142–150. [Google Scholar] [CrossRef]
  58. Wolf, D.C. Evaluation of the Size, Shape, and Consistency of the Liver. In Clinical Methods: The History, Physical, and Laboratory Examinations, 3rd ed.; Walker, H.K., Hall, W.D., Hurst, J.W., Eds.; Butterworths: Boston, MA, USA, 1990. [Google Scholar]
  59. Collewet, G.; Strzelecki, M.; Mariette, F. Influence of MRI acquisition protocols and image intensity normalization methods on texture classification. Magn. Reson. Imaging 2004, 22, 81–91. [Google Scholar] [CrossRef]
  60. Yang, F.; Dogan, N.; Stoyanova, R.; Ford, J.C. Evaluation of radiomic texture feature error due to MRI acquisition and reconstruction: A simulation study utilizing ground truth. Phys. Med. 2018, 50, 26–36. [Google Scholar] [CrossRef] [PubMed]
  61. Rai, R.; Holloway, L.C.; Brink, C.; Field, M.; Christiansen, R.L.; Sun, Y.; Barton, M.B.; Liney, G.P. Multicenter evaluation of MRI-based radiomic features: A phantom study. Med. Phys. 2020, 47, 3054–3063. [Google Scholar] [CrossRef] [PubMed]
  62. Ford, J.; Dogan, N.; Young, L.; Yang, F. Quantitative radiomics: Impact of pulse sequence parameter selection on MRI-based textural features of the brain. Contrast Media Mol. Imaging 2018, 2018. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  63. Leijenaar, R.T.H.; Carvalho, S.; Velazquez, E.R.; Van Elmpt, W.J.C.; Parmar, C.; Hoekstra, O.S.; Hoekstra, C.J.; Boellaard, R.; Dekker, A.L.A.J.; Gillies, R.J. Stability of FDG-PET Radiomics features: An integrated analysis of test-retest and inter-observer variability. Acta Oncol. 2013, 52, 1391–1397. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  64. Balagurunathan, Y.; Gu, Y.; Wang, H.; Kumar, V.; Grove, O.; Hawkins, S.; Kim, J.; Goldgof, D.B.; Hall, L.O.; Gatenby, R.A. Reproducibility and prognosis of quantitative features extracted from CT images. Transl. Oncol. 2014, 7, 72–87. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  65. Gao, Y.; Liu, Y.; Wang, Y.; Shi, Z.; Yu, J. A universal intensity standardization method based on a many-to-one weak-paired cycle generative adversarial network for magnetic resonance images. IEEE Trans. Med. Imaging 2019, 38, 2059–2069. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Overall framework of the proposed dynamic radiomics model, including liver ROI extraction, features extraction, feature selection, and classification.
Figure 1. Overall framework of the proposed dynamic radiomics model, including liver ROI extraction, features extraction, feature selection, and classification.
Biomolecules 11 00307 g001
Figure 2. Three-dimensional U-net in liver segmentation. (a) Network architecture; (b) training strategy: image patches with eight slices of overlap; and (c) testing strategy: image patches with eight slices of overlap and retention of prediction results of middle eight slices.
Figure 2. Three-dimensional U-net in liver segmentation. (a) Network architecture; (b) training strategy: image patches with eight slices of overlap; and (c) testing strategy: image patches with eight slices of overlap and retention of prediction results of middle eight slices.
Biomolecules 11 00307 g002
Figure 3. Liver segmentation results. (a) Manually labeled liver contour; (b) predicted liver contour through deep learning; and (c) final segmentation mask after post-processing.
Figure 3. Liver segmentation results. (a) Manually labeled liver contour; (b) predicted liver contour through deep learning; and (c) final segmentation mask after post-processing.
Biomolecules 11 00307 g003
Figure 4. Selected features with corresponding feature importance (left panel) and prediction scores in positive and control groups (right panel) for (a) significant fibrosis, (b) advanced fibrosis, and (c) cirrhosis classification. GLCM, gray level co-occurrence matrix; GLDM, gray level dependence matrix; GLRLM, gray level run length matrix. Significance level: *** p < 0.001.
Figure 4. Selected features with corresponding feature importance (left panel) and prediction scores in positive and control groups (right panel) for (a) significant fibrosis, (b) advanced fibrosis, and (c) cirrhosis classification. GLCM, gray level co-occurrence matrix; GLDM, gray level dependence matrix; GLRLM, gray level run length matrix. Significance level: *** p < 0.001.
Biomolecules 11 00307 g004
Figure 5. Comparison of cirrhotic and non-cirrhotic images. (a) One patient from the positive group (S = 4); and (b) one patient from the control group (S = 1). From left to right: DCE images from the pre-contrast phase, arterial phase, portal venous phase, delayed phase, and hepatobiliary phase. The rightmost column represents the segmented liver mask after post-processing.
Figure 5. Comparison of cirrhotic and non-cirrhotic images. (a) One patient from the positive group (S = 4); and (b) one patient from the control group (S = 1). From left to right: DCE images from the pre-contrast phase, arterial phase, portal venous phase, delayed phase, and hepatobiliary phase. The rightmost column represents the segmented liver mask after post-processing.
Biomolecules 11 00307 g005
Figure 6. Performances of various classifiers in five-fold cross-validation and the corresponding AUC value in the test set of the selected optimal classifier (top panel); confusion matrix in the test set (bottom panel) for (a) significant fibrosis, (b) advanced fibrosis, and (c) cirrhosis classification. Purple bar: optimal classifier in cross-validation; blue bar: corresponding AUC value in the test set.
Figure 6. Performances of various classifiers in five-fold cross-validation and the corresponding AUC value in the test set of the selected optimal classifier (top panel); confusion matrix in the test set (bottom panel) for (a) significant fibrosis, (b) advanced fibrosis, and (c) cirrhosis classification. Purple bar: optimal classifier in cross-validation; blue bar: corresponding AUC value in the test set.
Biomolecules 11 00307 g006
Figure 7. ROC curves (left panel) and PR curves (right panel) in the test set for various models in (a) significant fibrosis, (b) advanced fibrosis, and (c) cirrhosis staging. Dynamic, dynamic radiomics model; DCE_opt, single-phase DCE-based radiomics model with best overall performance between the mask phase, arterial phase, portal venous phase, and delayed phase (delayed phase for significant fibrosis, mask phase for advanced fibrosis, and arterial phase for cirrhosis); HBP, hepatobiliary phase based-radiomics model; DCE_comb, multi-phase DCE-based radiomics model; NLE, normalized liver enhancement model; APRI, aspartate transaminase-to-platelet ratio index model; FIB-4, fibrosis-4 index model.
Figure 7. ROC curves (left panel) and PR curves (right panel) in the test set for various models in (a) significant fibrosis, (b) advanced fibrosis, and (c) cirrhosis staging. Dynamic, dynamic radiomics model; DCE_opt, single-phase DCE-based radiomics model with best overall performance between the mask phase, arterial phase, portal venous phase, and delayed phase (delayed phase for significant fibrosis, mask phase for advanced fibrosis, and arterial phase for cirrhosis); HBP, hepatobiliary phase based-radiomics model; DCE_comb, multi-phase DCE-based radiomics model; NLE, normalized liver enhancement model; APRI, aspartate transaminase-to-platelet ratio index model; FIB-4, fibrosis-4 index model.
Biomolecules 11 00307 g007
Figure 8. Violin graph of the distribution of various models in the test set for (a) significant fibrosis, (b) advanced fibrosis, and (c) cirrhosis staging. Dynamic, dynamic radiomics model; DCE_opt, single-phase DCE-based radiomics model with best overall performance between the mask phase, arterial phase, portal venous phase and delayed phase (delayed phase for significant fibrosis, mask phase for advanced fibrosis, and arterial phase for cirrhosis). HBP, hepatobiliary phase-based radiomics model; DCE_comb, multi-phase DCE-based radiomics model; NLE, normalized liver enhancement model; APRI, aspartate transaminase-to-platelet ratio index model; FIB-4, fibrosis-4 index model. The dotted lines in the graph indicate the median and interquartile range.
Figure 8. Violin graph of the distribution of various models in the test set for (a) significant fibrosis, (b) advanced fibrosis, and (c) cirrhosis staging. Dynamic, dynamic radiomics model; DCE_opt, single-phase DCE-based radiomics model with best overall performance between the mask phase, arterial phase, portal venous phase and delayed phase (delayed phase for significant fibrosis, mask phase for advanced fibrosis, and arterial phase for cirrhosis). HBP, hepatobiliary phase-based radiomics model; DCE_comb, multi-phase DCE-based radiomics model; NLE, normalized liver enhancement model; APRI, aspartate transaminase-to-platelet ratio index model; FIB-4, fibrosis-4 index model. The dotted lines in the graph indicate the median and interquartile range.
Biomolecules 11 00307 g008
Table 1. Baseline characteristics of the study population and patient statistics.
Table 1. Baseline characteristics of the study population and patient statistics.
OverallSignificantAdvancedCirrhosis
Sex
Male93 (70.5%)79 (77.5%)61 (82.4%)36 (85.7%)
Female39 (29.6%)23 (22.6%)13 (17.6%)6 (14.3%)
Age (years) *45.8±13.247.7 ± 13.350.8 ± 12.652.6 ± 11.1
Fibrosis score
S130 (22.7%)0 (0%)0 (0%)0 (0%)
S228 (21.2%)28 (27.45%)0 (0%)0 (0%)
S332 (24.2%)32 (31.4%)32 (43.2%)0 (0%)
S442 (31.8%)42 (41.2%)42 (56.8%)42 (100%)
Group +++
Training 712152402963
Test 31922181327
* Data are mean ± standard deviation; + represents the positive patient and – represents the control group; S means the Scheuer–Ludwig degree.
Table 2. Comparison of selected features between positive and control groups and the results of statistical tests.
Table 2. Comparison of selected features between positive and control groups and the results of statistical tests.
FeaturePositiveControlp-ValueAdjusted p-Value
Significant fibrosis
GLRLM, Run Variance (DYN4-DYN3)−0.518
(−0.675~−0.257)
0.181
(−0.643~0.934)
0.0670.084
GLDM, Dependence Variance (DYN2-DYN1)0.208
(−0.088~0.557)
−0.442
(−1.275~0.117)
0.006 **0.028 *
GLDM, the variance of Dependence Variance in time domain−0.617
(−0.716~−0.110)
−0.247
(−0.410~0.495)
0.037 *0.077
GLDM, Dependence Variance in HBP−0.479
(−0.953~0.198)
0.717
(−0.521~1.271)
0.046 *0.077
First Order, Median (DYN4-DYN3)0.169
(−0.837~0.868)
0.527
(−0.192~1.202)
0.3080.308
Advanced fibrosis
GLDM, Large Dependence High Gray Level Emphasis in HBP−0.310
(−0.920~0.005)
0.288
(−0.451~0.502)
0.030 *0.037 *
First Order, 10th percentile difference (DYN4-DYN3)0.048
(−0.548~0.574)
0.204
(−0.224~1.076)
0.2650.265
GLCM Informational Measure of Correlation (DYN3-DYN2)0.914
(0.214~1.412)
−0.258
(−0.733~0.416)
0.002 **0.006 **
GLCM Informational Measure of Correlation (HBP-DYN1)−0.645
(−0.864~−0.048)
0.648
(−0.279~1.357)
0.004 **0.006 **
GLCM Correlation difference (DYN3-DYN2)−0.680
(−0.961~0.039)
0.400
(0.038~1.064)
0.002 **0.006 **
Cirrhosis
GLDM Large Dependence High Gray Level Emphasis in DYN4−0.784
(−1.066~0.256)
0.601
(−0.403~1.027)
0.010**0.034*
Shape-based Maximum 2D diameter0.429
(−0.060~0.800)
−0.175
(−0.763~0.481)
0.022*0.034*
Shape-based Sphericity−0.699
(−1.151~0.226)
0.366
(−0.168~0.817)
0.027*0.034*
GLCM Informational Measure of Correlation (HBP-DYN4)−0.428
(−1.392~0.069)
0.212
(−0.255~1.274)
0.020*0.034*
GLCM Kurtosis of Cluster Prominence in time domain0.457
(0.015~1.162)
−0.725
(−1.140~0.344)
0.0550.055
Time domain features. (i-j), feature difference between i and j. Single feature values (Fi) were normalized (Fi,norm) with total feature means and standard deviations as Fi,norm = (Fi-mean (Fi))/SD (Fi). Feature values are listed as median (Interquartile range). p-values were calculated based on Mann–Whitney test and the adjusted p-values were corrected by false discovery rate method. DYN1, mask phase; DYN2, arterial phase; DYN3, portal venous phase; DYN4, delayed phase; HBP, hepatobiliary phase; GLCM, gray level co-occurrence matrix; GLDM, gray level dependence matrix; GLRLM, gray level run length matrix. Significance level: * p < 0.05, ** p < 0.01.
Table 3. Comparison of selected features between two subsets of patients with extreme classifier prediction scores.
Table 3. Comparison of selected features between two subsets of patients with extreme classifier prediction scores.
FeaturePositive Subset (20%)Control Subset (20%)
Significant fibrosis
GLRLM, Run Variance (DYN4-DYN3)−0.7860.289
GLDM, Dependence Variance (DYN2-DYN1)0.090−1.684
GLDM, the variance of Dependence Variance in time domain−0.4550.044
GLDM, Dependence Variance in HBP−0.7750.397
First Order, Median (DYN4-DYN3)−1.8690.832
Advanced fibrosis
GLDM, Large Dependence High Gray Level Emphasis in HBP−0.8830.149
First Order, 10th percentile difference (DYN4-DYN3)−0.2630.581
GLCM Informational Measure of Correlation (DYN3-DYN2)1.176−0.948
GLCM Informational Measure of Correlation (HBP-DYN1)−1.0701.087
GLCM Correlation difference (DYN3-DYN2)−0.9840.657
Cirrhosis
GLDM Large Dependence High Gray Level Emphasis in DYN4−0.8511.050
Shape-based Maximum 2D diameter0.855−0.839
Shape-based Sphericity−1.8090.531
GLCM Informational Measure of Correlation (HBP-DYN4)−1.6910.901
GLCM Kurtosis of Cluster Prominence in time domain1.161−0.562
Time domain features. (i-j), feature difference between i and j. Single feature values (Fi) were normalized (Fi,norm) with total feature means and standard deviations as Fi,norm = (Fi-mean (Fi))/SD (Fi). Feature values are listed as mean value. DYN1, mask phase; DYN2, arterial phase; DYN3, portal venous phase; DYN4, delayed phase; HBP, hepatobiliary phase; GLCM, gray level co-occurrence matrix; GLDM, gray level dependence matrix; GLRLM, gray level run length matrix. Those were defined as the 20% patients in the positive group with the highest prediction scores and the 20% patients in the control group with the lowest prediction scores.
Table 4. Detailed performance comparison for the proposed model, single-phase or multi-phase DCE-based radiomics models, NLE, and some clinical serum parameters.
Table 4. Detailed performance comparison for the proposed model, single-phase or multi-phase DCE-based radiomics models, NLE, and some clinical serum parameters.
ModelAccuracyAUC (95%CI)APF1
Significant fibrosis
Dynamic (proposed)0.8750.867 (0.723~0.954)0.9390.921
DYN10.7500.778 (0.619~0.894)0.9340.839
DYN20.5750.581 (0.414~0.735)0.8550.667
DYN30.7250.814 (0.659~0.919)0.9220.792
DYN40.7750.789 (0.631~0.901)0.9380.857
HBP0.7500.839 (0.688~0.936)0.9550.828
DYN combined0.7750.803 (0.647~0.911)0.9360.852
NLE0.6250.724 (0.560~0.853)0.9120.706
APRI0.6250.695 (0.530~0.831)0.8950.706
FIB-40.7250.821 (0.667~0.924)0.9520.784
Advanced fibrosis
Dynamic (proposed)0.8250.874 (0.730~0.957)0.9060.837
DYN10.7500.768 (0.607~0.886)0.8410.773
DYN20.5250.710 (0.545~0.842)0.7680.387
DYN30.5750.692 (0.526~0.828)0.7160.485
DYN40.6500.715 (0.550~0.846)0.7540.667
HBP0.8000.826 (0.673~0.927)0.8520.818
DYN combined0.6750.768 (0.607~0.886)0.8300.723
NLE0.7000.692 (0.526~0.828)0.7260.714
APRI0.5750.583 (0.417~0.737)0.6630.541
FIB-40.6750.775 (0.616~0.892)0.8390.629
Cirrhosis
Dynamic (proposed)0.8500.900 (0.764~0.972)0.8660.750
DYN10.7750.852 (0.704~0.944)0.8250.640
DYN20.8500.875 (0.732~0.958)0.8250.750
DYN30.8250.855 (0.707~0.946)0.8330.741
DYN40.7750.832 (0.680~0.931)0.7850.640
HBP0.8500.892 (0.753~0.968)0.8590.786
DYN combined0.8500.858 (0.711~0.948)0.8470.750
NLE0.7250.812 (0.657~0.918)0.7470.645
APRI0.7250.755 (0.593~0.877)0.6130.522
FIB-40.8500.866 (0.721~0.953)0.8400.700
Abbreviations: AUC, Area under the curve; 95%CI, 95% confidence interval; AP, average precision; Dynamic, dynamic radiomics model; DYN1, mask phase-based radiomics model; DYN2, arterial phase-based radiomics model; DYN3, portal venous phase-based radiomics model; DYN4, delayed phase-based radiomics model; HBP, hepatobiliary phase-based radiomics model; DYN combined, multi-phase DCE-based radiomics model; NLE, normalized liver enhancement model; APRI, aspartate transaminase-to-platelet ratio index model; FIB-4, fibrosis-4 index model.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zheng, R.; Shi, C.; Wang, C.; Shi, N.; Qiu, T.; Chen, W.; Shi, Y.; Wang, H. Imaging-Based Staging of Hepatic Fibrosis in Patients with Hepatitis B: A Dynamic Radiomics Model Based on Gd-EOB-DTPA-Enhanced MRI. Biomolecules 2021, 11, 307. https://doi.org/10.3390/biom11020307

AMA Style

Zheng R, Shi C, Wang C, Shi N, Qiu T, Chen W, Shi Y, Wang H. Imaging-Based Staging of Hepatic Fibrosis in Patients with Hepatitis B: A Dynamic Radiomics Model Based on Gd-EOB-DTPA-Enhanced MRI. Biomolecules. 2021; 11(2):307. https://doi.org/10.3390/biom11020307

Chicago/Turabian Style

Zheng, Rencheng, Chunzi Shi, Chengyan Wang, Nannan Shi, Tian Qiu, Weibo Chen, Yuxin Shi, and He Wang. 2021. "Imaging-Based Staging of Hepatic Fibrosis in Patients with Hepatitis B: A Dynamic Radiomics Model Based on Gd-EOB-DTPA-Enhanced MRI" Biomolecules 11, no. 2: 307. https://doi.org/10.3390/biom11020307

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop