Next Article in Journal
The Overall Survival and Progression-Free Survival in Patients with Advanced Adrenocortical Cancer Is Increased after the Multidisciplinary Team Evaluation
Next Article in Special Issue
Breast-Specific Gamma Imaging: An Added Value in the Diagnosis of Breast Cancer, a Systematic Review
Previous Article in Journal
Investigating the Role of CTCs with Stem/EMT-like Features in Metastatic Breast Cancer Patients Treated with Eribulin Mesylate
Previous Article in Special Issue
Lung Nodules Missed in Initial Staging of Breast Cancer Patients in PET/MRI—Clinically Relevant?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Radiomic Signatures Derived from Hybrid Contrast-Enhanced Ultrasound Images (CEUS) for the Assessment of Histological Characteristics of Breast Cancer: A Pilot Study

by
Ioana Bene
1,
Anca Ileana Ciurea
1,*,
Cristiana Augusta Ciortea
2,
Paul Andrei Ștefan
3,4,
Larisa Dorina Ciule
5,
Roxana Adelina Lupean
6 and
Sorin Marian Dudea
1
1
Department of Radiology, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania
2
Department of Radiology, Emergency County Hospital, 400006 Cluj-Napoca, Romania
3
Anatomy and Embryology, Morphological Sciences Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Victor Babes, Street, Number 8, 400012 Cluj-Napoca, Romania
4
Department of Biomedical Imaging and Image-Guided Therapy, General Hospital of Vienna (AKH), Medical University of Vienna, 1090 Vienna, Austria
5
Department of Oncology, Emergency County Hospital, 400006 Cluj-Napoca, Romania
6
Histology, Morphological Sciences Department, “Iuliu Hațieganu” University of Medicine and Pharmacy, Louis Pasteur Street, Number 4, 400349 Cluj-Napoca, Romania
*
Author to whom correspondence should be addressed.
Cancers 2022, 14(16), 3905; https://doi.org/10.3390/cancers14163905
Submission received: 28 June 2022 / Revised: 9 August 2022 / Accepted: 11 August 2022 / Published: 12 August 2022
(This article belongs to the Special Issue Breast Cancer Imaging: Current Trends and Future Direction)

Abstract

:

Simple Summary

The hybrid images obtained at the CEUS present an overlap of the tumor in grayscale over the enhancement pattern, which allows an appropriate evaluation of the entire lesion without including in the analysis the peritumoral area. We hypothesized that the spatial heterogeneity of tissue enhancement differs depending on histological characteristics. Therefore, the aim of this study was to evaluate the diagnostic performance of radiomic features extracted from standardized hybrid CEUS data for the assessment of hormone receptor status, HER2 status, tumor grade and Ki-67 in patients with primary breast cancer. The clinical benefit of this study would be to use CEUS and bioinformatics tools for improved biopsy planning or even guiding treatment decisions.

Abstract

The purpose of this study was to evaluate the diagnostic performance of radiomic features extracted from standardized hybrid contrast-enhanced ultrasound (CEUS) data for the assessment of hormone receptor status, human epidermal growth factor receptor 2 (HER2) status, tumor grade and Ki-67 in patients with primary breast cancer. Methods: This prospective study included 72 patients with biopsy-proven breast cancer who underwent CEUS examinations between October 2020 and September 2021. Results: A radiomic analysis found the WavEnHH_s_4 parameter as an independent predictor associated with the HER2+ status with 76.92% sensitivity, and 64.41% specificity and a prediction model that could differentiate between the HER2 entities with 76.92% sensitivity and 84.75% specificity. The RWavEnLH_s-4 parameter was an independent predictor for estrogen receptor (ER) status with 55.93% sensitivity and 84.62% specificity, while a prediction model (RPerc01, RPerc10 and RWavEnLH_s_4) could differentiate between the progesterone receptor (PR) status with 44.74% sensitivity and 88.24% specificity. No texture parameter showed statistically significant results at the univariate analysis when comparing the Nottingham grade and the Ki-67 status. Conclusion: Our preliminary data indicate a potential that hybrid CEUS radiomic features allow the discrimination between breast cancers of different receptor and HER2 statuses with high specificity. Hybrid CEUS radiomic features might have the potential to provide a noninvasive, easily accessible and contrast-agent-safe method to assess tumor biology before and during treatment.

1. Introduction

Contrast-enhanced ultrasound (CEUS) is a valuable imaging technique in the assessment of breast pathology. Several studies in the literature have demonstrated the usefulness of CEUS in differentiating benign and malignant breast lesions, evaluating pathological characteristics of breast cancer (estrogen and progesterone receptors, histological grade, human epidermal growth factor receptor 2, Ki-67), detecting the sentinel lymph node and even predicting the response to neoadjuvant chemotherapy (NAC) [1,2,3,4].
Breast tumor structure consists of a high degree of heterogeneity observed at histological and genetic levels, and increased intratumor genetic heterogeneity is associated with poor clinical outcomes.
Radiomics (through texture analysis) is a technique based on the extracting and processing of image-specific parameters that provide an objective description of image content by quantifying the distribution patterns and intensity of pixels. Radiomics is able to extract features from medical images that can be used to understand relationships between the imaging heterogeneity and the genetic and phenotypical characteristics of tumors, and it can be integrated in prediction models that may improve diagnostic, prognostic and even expect treatment outcomes. The basic principle of the ultrasonography-based radiomic analysis is that a pathological process that alters the tissue produces a modified ultrasound signal, which will in turn give textural features with different values from those of the normal structure [5,6,7].
Radiomics allows an objective and quantitative characterization of the morphology, texture and pharmacokinetic behavior of breast tumors by obtaining features that are not visible to the naked eye, therefore improving the predictive power of medical imaging [8].
Breast radiomics studies are mostly applied to the diagnosis of breast cancer, the prediction of the molecular classification, lymph nodes metastasis and molecular markers of invasiveness [9,10,11,12]. Luo et al. [13] found in their study that radiomics had better performance in distinguishing breast lesions than BI-RADS, and according to Wang et al. [14], radiomics was superior in differentiating small benign and malignant breast lesions.
Several studies have already reported the value of radiomic analyses of contrast-enhanced imaging techniques such as dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) and contrast-enhanced spectral mammography (CESM) in predicting breast cancer molecular subtypes with a similar performance [9,10,15,16]. Both techniques provide functional information on neoplastic neo-angiogenesis reflecting underlying tumor biological characteristics. Furthermore, Wang et al. [17] found a correlation between CEUS and acoustic radiation force impulse (ARFI), which also provides quantitative features, regarding the assessment of HER-2 expression levels in breast cancer.
The hybrid images obtained at the CEUS represent an overlap of the tumor in grayscale over the enhancement pattern, which allows an appropriate evaluation of the entire lesion without including in the analysis the peritumoral area.
We hypothesized that the spatial heterogeneity of tissue enhancement differs depending on histological characteristics. Therefore, the aim of this study was to evaluate the diagnostic performance of radiomic features extracted from standardized hybrid CEUS data for the assessment of hormone receptor status, HER2 status, tumor grade and Ki-67 in patients with primary breast cancer.
The clinical benefit of this study would be to use CEUS and bioinformatics tools for improved biopsy planning or even guiding treatment decisions.

2. Materials and Methods

This prospective study was approved by the Institutional Review Board (Number/Date: 280/11 August 2020), and informed consent was obtained from each patient before performing CEUS. The informed consent included information related to the purpose and duration of the study; risks; benefits; responsibility of the participant; the rights of the participant to withdraw from the study; confidentiality; and the procedure, including the way of administration of the contrast agent and contraindications.

2.1. Study Design and Population

Between October 2020 and September 2021, 87 patients underwent CEUS examinations.
CEUS was performed only in patients with suspicious breast lesions detected at mammography and/or ultrasound and classified according to the American College of Radiology (ACR) Breast Imaging-Reporting and Data System (BI-RADS) in 4A, 4B, 4C or 5. None of the included patients had contraindications for the administration of contrast media such as hypersensitivity to sulfur hexafluoride (or any of the components of SonoVue®), acute cardiac failure, recent acute coronary syndrome or clinically unstable ischemic cardiac disease, known right-to-left shunts, severe rhythm disorders or pulmonary hypertension (pulmonary artery pressure >90 mmHg), uncontrolled systemic hypertension and respiratory distress syndrome.
All the patients agreed to perform biopsy.
We excluded from the study benign biopsy-proven lesions and malignant lesions under 6 mm diameter due to the difficulty of depicting their margins.
Figure 1 summarizes the flowchart of the patient selection.

2.2. Image Acquisition

All breast CEUS examinations were acquired with a LOGIQ S8 ultrasound machine (General Electric Ultrasound Korea, Seongnam-si, Korea).
Before the contrast examination, the lesion was assessed on both grayscale and color Doppler ultrasound to identify the scanning plane with the largest diameter of the lesion and with the richest vascularization.
For all the examinations, we set the mechanical index (MI) at 0.06, the gain of 100–120 dB, single focus, image depth of approximately 3–4 cm and SonoVue® (sodium hexachloride microbubbles; Bracco, Amsterdam, The Netherlands) was administered intravenously as a bolus of 2.4 mL followed by a flush of 5 mL sodium chloride 0.9% using a 20-gauge cannula.
Before the examination, we asked the patients not to speak or move and avoid coughing or extensive breathing movements during the image acquisition in order to avoid artifacts.
All CEUS examinations were performed by the same physician, before the biopsy and the images were recorded for at least 180 s. We started recording the examination synchronously with the injection of the contrast agent. No patient presented side effects to SonoVue® (sensitivity at the injection site, hypersensitivity reactions such as facial flushing, nausea, bradycardia, hypotension or anaphylactic shock).

2.3. Image Processing

The images were processed by the same physician who performed the examinations using the time-intensity curve (TIC) analysis software integrated into the ultrasound device.
The start cine loop was selected when the first microbubbles arrived in the lesion, and the stop cine loop at the end of the examination (around second 180). On the touch panel for the fitting curve, “Gamma variate” was selected, and as smoothing “Gaussian 600 ms”.
A region of interest (ROI) was placed in the most perfused area of the malignant lesion. Corresponding to the peak of the selected ROI, the “Hybrid image” option was selected on the touch panel.

2.4. Reference Standard

The pathology reports of all biopsied lesions were considered as the gold standard. The reports of malignant lesions included information regarding the histological tumor grade, the estrogen receptor (ER), progesterone receptor (PR), and human epidermal growth factor receptor 2 (HER2) status and the value of Ki-67.

2.5. Texture Analysis (TA)

A texture analysis was conducted on hybrid CEUS images acquired at the peak. In the MaZda program, all the hybrid images had a black and white appearance, but even in these conditions the overlap of the perfusion map on the grayscale image could be observed even with the naked eye.
The TA protocol comprised of the following five steps: image pre-processing, lesion segmentation, feature extraction, feature selection and prediction.
To ensure the repeatability and the reproducibility of our results, in the first step of our texture analysis process, the images were normalized. Therefore, we excluded the grey-level variations that could affect the true textures of the images. In the second step, the segmentation process was performed semi-automatically, based on gradient and geometry coordinates, therefore lowering the variability produced by the manual segmentation.

2.5.1. Image Pre-Processing and Segmentation

Tumor segmentation was performed by an experienced breast radiologist. Contours were depicted on hybrid images. Multifocality or bilaterality of breast tumors was not observed in any patient.
A semi-automatic level-set technique was used for the definition and positioning of ROI using gradient and geometry coordinates. As this technique does not require the manual delineation of the structure of interest contours, the inter- and intra-observer reproducibility was not assessed in this study. The researcher placed a seed in the area of interest, and the software automatically delineated the area based on gradient and geometrical contours. When necessary, manual corrections were applied (Figure 2). Before the extraction of texture parameters, the imported image’s grey levels were normalized based on the mean and three standard deviations of grey level intensities to reduce the contrast and brightness variations (which could affect the true image textures). The parameters are detailed in the table below (Table 1).

2.5.2. Feature Extraction

The feature computation from every ROI was automatically performed by the MaZda software version 4.6 (MaZda, Institute of Electronics, Technical University of Lodz, Lodz, Poland).

2.5.3. Feature Selection

First, the MaZda software allows the selection of the best-suited parameters for differentiating between classes through several reduction methods. We applied a selection method based on Fisher coefficients (F, the ratio of between-class to within-class variance). This method allowed us to select a set of the ten most discriminative features that were best suited to discriminate between selected groups [18].
Second, the parameters highlighted by the selection method underwent a statistical analysis. The absolute values recorded by each of the previously selected parameters were compared between groups by conducting a univariate analysis test (the Mann–Whitney U test). The statistical significance level was set at a p-value of below 0.05. Features that did not meet the above-mentioned criteria were excluded from further analysis.
Abbreviations of feature characteristics produced by the extraction algorithm appeared in the feature name generated by the MaZda software. The first letter indicated the color channel through which the image was computed (R” identifies the red color channel). This color channel was automatically chosen by the software; the investigators had no intervention on this procedure.

2.5.4. Class Prediction

A multivariate analysis was performed to identify which of the previously selected parameters were independent predictors for PR and HER2 status. The analysis was constructed using the “enter” input model, and the coefficient of determination (R-squared) and the variance inflation factor (VIF) were computed from the same data. The final prediction model included only variables that showed a p-value of below 0.05 following a multivariate analysis. In addition, features that showed high VIF (>104) were excluded from further analysis due to multicollinearity. Finally, the predicted values were saved and subsequently used in a receiver operating characteristics (ROC) analysis to assess the diagnostic power of the entire prediction model. The ROC analysis was also used to determine the diagnostic power of other parameters that showed statistically significant results at the univariate analysis. The ROC analysis implied the calculation of the area under the curve (AUC), sensitivity and specificity, all with 95% confidence intervals (CIs). Sensitivity (Se) and specificity (Sp) were computed from the same data, without further adjustments. A statistical analysis was performed using a commercially available dedicated software, MedCalc v14.8.1 (MedCalc Software, Mariakerke, Belgium).

3. Results

A total of 72 patients with biopsy-proven malignant breast lesions were included in the study. Participants’ ages ranged from 29 to 83 years (56.5 + 14.34, mean age + SD). All the characteristics regarding the patients are listed in Table 2.
The extracted parameters for each histological characteristic (Nottingham grade, ER, PR, HER2 status and Ki-67) are listed in Table 3.
The multivariate analysis involving the HER2 status showed a coefficient of determination of 0.2, an R2-adjusted of 0.12, MCC of 0.45 and a residual standard deviation of 0.36. One parameter (WavEnHH_s_4) was independently associated with the HER2+ status (Table 4).
The ROC analysis of the WavEnHH_s_4 parameter showed a statistical significance level of 0.003, an AUC of 0.726 (CI, 0.608–0.825) and a Youden index of 0.4133. For a cut-off value of ≤8.124, the WavEnHH_s_4 parameter could differentiate between the HER2 entities with 76.92% Se (CI, 46.2–95%), and 64.41% Sp (CI, 50.9–76.4%). For the same scope, the ROC analysis of the HER2 prediction model showed a statistical significance level of <0.0001, and an AUC of 0.836 (CI, 0.73–0.913) and a Youden index of 0.6167. For a cut-off value of >0.2840, the prediction model could differentiate between the HER2 entities with 76.92% Se (CI, 46.2–95%) and 84.75% Sp (CI, 73.0–92.8%) (Figure 3).
Table 5 shows the diagnostic values of the parameters that were included in the prediction model but were not independently associated with the HER2 status.
The multivariate analysis involving the PR status showed a coefficient of determination of 0.97, R2-adjusted of 0.5, MCC of 0.31 and a residual standard deviation of 0.48. Neither of the three included parameters were independent predictors for the PR+ status (Table 6).
The ROC analysis of the prediction model that incorporated all three parameters that showed statistically significant results at the univariate analysis (RPerc01, RPerc10 and RWavEnLH_s_4) showed a significance level of 0.0048, and an AUC of 0.678 (CI, 0.554–0.802) and a Youden index of 0.3297. For a cut-off value of >0.617, the prediction model could differentiate between the PR status with 44.74% Se (CI, 28.6–61.7%) and 88.24% Sp (CI, 62.1–91.3%) (Figure 4).
No texture parameter showed statistically significant results at the univariate analysis when comparing the Nottingham grade and the Ki-67 status.
Another wavelet transformation parameter (RWavEnLH_s-4) was the only one that showed statistically significant results when comparing the ER+ and ER− patients (p = 0.0181). The ROC analysis for this parameter in the diagnosis of ER+ patients showed a significance level of 0.0015, and an AUC of 0.711 (CI, 0.592–0.811) and a Youden index of 0.4. For a cut-off value of ≤32.81, the RWavEnLH_s-4 parameter was able to identify ER+ tumors with 55.93% (CI, 42.4–68.8%) sensitivity and 84.62% (CI, 54.6–98.1%) specificity (Figure 5).

4. Discussion

In this study, we investigated the diagnostic performance of radiomic features derived from hybrid images obtained at CEUS for the assessment of breast cancer receptor status, HER2 and Ki-67 status and histological grade. We hypothesized that the spatial heterogeneity of tissue enhancement differs depending on histological characteristics and could be quantified by a radiomic analysis. Our results demonstrate that hybrid CEUS radiomic features allow the discrimination between breast cancers of different receptor and HER2 statuses with high specificity.
To the best of our knowledge, no study has been conducted to investigate the usefulness of a radiomic analysis of hybrid CEUS images in order to predict the hormone receptor status, HER2 status, tumor grade and Ki-67 in patients with primary breast cancer. Currently, the way to determine these prognostic factors is through invasive tissue sampling; however, it may not be representative of tumor biology in its entirety, with the process depending on site selection or sampling bias. Therefore, there is a strong argument for the development of alternatives to the formal biopsy analysis that could provide the information which reflects the tumor in its entirety; thus, the performance of radiomics analysis is worth being investigated.
Wavelet transformation is a multiresolution technique for transforming images into representations that include both spatial and frequency information [19]. This transformation allows for the quantification of an image’s frequency content, which is proportional to the image’s gray level variations. To begin, images are scaled five times in both vertical and horizontal directions. In addition, to separate the image data, two types of filters (high and low pass) are applied [20]. Finally, different subbands are extracted from an image divided into four parts, each of which corresponds to a different frequency component. The result is a five-scaled image with four frequency bands on every scale. Each subband’s energy feature is calculated. The distribution of this energy along the frequency axis over scale and orientation is quantified through the wavelet energy parameter, which reflects the local uniformity of an image. When an image’s grey levels are distributed in a consistent or periodic pattern, energy levels become high [19]. We obtained higher values of the WavEnHH_s_4 parameter for the HER2− than for the HER2+ patients, meaning that HER2+ tumors have an inhomogeneous distribution of gray levels within the pixels. This aspect was consistent with the literature, according to which HER2+ tumors have a higher proliferation rate, areas of necrosis and fibrosis leading to an inhomogeneous appearance on DCE MRI and CEUS [21,22]. Furthermore, La Forgia et al. [23] concluded that a radiomics analysis of CESM images can distinguish HER2 positive and triple-negative breast cancers. It would be interesting to conduct a study in order to investigate if this parameter could predict the HER2+ status in benign lesions, thus producing false positive results.
Wu et al. [11] conducted a study using a radiomics analysis on grayscale ultrasound images that managed to predict the HER2 and hormone receptor status of DCIS with good accuracy. In our study, the multivariate analysis showed that no parameters were independent predictors for the PR+ status. Again, a wavelet energy parameter (RWavEnLH_s_4) showed statistically significant results at the univariate analysis and held higher values for the PR− than for PR+ breast tumors. In addition, two percentile parameters also showed statistically significant results when comparing the PR+ and PR− patients. The percentile value (n) is the point at which n% of the pixel values that form the histogram are found to the left [24]. In other words, a percentile gives the highest gray-level value under which a given percentage of the pixels in the image is contained [20]. This signifies that 1% and 10% of the pixels within images were distributed under higher values for PR− than for PR+ patients.
When comparing ER+ and ER− patients, a single wavelet transformation parameter (RWavEnLH_s-4) showed statistically significant results. This parameter held higher values for ER− than for ER+ patients. Our results were contrary to prior studies, or what we expected, because breast cancers with positive estrogen receptors have a lower rate of cell proliferation, so less necrotic tissue, and a homogeneous appearance at CEUS. On the other hand, breast cancers with negative ER present areas of central necrosis and fibrosis, and therefore an inhomogeneous appearance at CEUS [21,25,26,27,28]. However, in these articles, the lesion enhancement pattern was assessed subjectively, compared to the objective evaluation performed through a radiomic analysis. Furthermore, in the study, we did not take into account the entire tumor biology (tumor cellularity, areas of hyaline stroma, tumor-infiltrating mononuclear lymphoid cells, areas of necrosis and microcalcifications) that might influence this parameter.
Our study showed no texture parameter with statistically significant results at the univariate analysis when comparing the Ki-67 status and the Nottingham grade. Ki-67 expression indicates a guiding role in evaluating the efficacy of neoadjuvant chemotherapy for breast cancer, being closely related to the patient’s prognosis [29]. Demircioglu et al. [30] constructed radiomics models for predicting Ki67 expression in invasive breast cancer based on eight features extracted from MRI images, with an AUC of 0.81.
Marino et al. [31] investigated the potential of a radiomic analysis of both DCE-MRI and CESM of the breast for predicting tumor invasiveness, hormone receptor status (HR) and tumor grade in patients with primary breast cancer. They included 48 female patients with 49 biopsy-proven breast cancers. An MRI radiomic analysis yielded classification accuracies of up to 90% for invasive vs. noninvasive breast cancers, 82.6% for HR+ vs. HR− breast cancers and 77.8% for G1 + G2 vs. G3 cancers. A CESM radiomic analysis yielded classification accuracies of up to 92% for invasive vs. noninvasive breast cancers, 95.6% for HR+ vs. HR− breast cancers and 77.8% for G1 + G2 vs. G3 invasive cancers. Furthermore, in a radiomic analysis, Bhooshan et al. [32] also found that DCE-MRI was promising for distinguishing breast tumors of different grades.
CEUS is an imaging technique comparable in terms of cost and performance time to CESM, but it involves less time and lower costs compared to DCE-MRI. This new approach, which involves the radiomic analysis of hybrid CEUS images, has as additional costs to CEUS, the costs related to the MaZda program. Furthermore, it would be interesting to conduct a study in order to explore the learning curve of this method, although we predict that it is similar to the ones involving other imaging techniques.
Despite some significant findings, the work presented has limitations. First, it is a single institution prospective study, and the sample size is small, limiting accurate analysis. It would be interesting to evaluate a larger database, with examinations performed in several institutions, even if slightly different CEUS imaging protocols were used, to compare the results and evaluate the reproducibility of the method. Second, some molecular subtypes (HER2+ and triple-negative) are too poorly represented. Third, the relatively low sensitivity compared to conventional existing tests is a major limitation of our method. However, this method could still be used as an additional criterion to increase diagnostic confidence, especially since the technique required for the extraction of the TA parameters is relatively straightforward. Furthermore, all CEUS examinations were performed by a single radiologist, which eliminated inter-operator variability, but we used the same parameters for every examination, and thus by following the protocol the method could be reproducible. Finally, it would be of interest to perform an intra-tumoral analysis based on other imaging modalities, such as DCE-MRI, to validate and extend this work. Therefore, additional work is needed before these methods can be utilized to facilitate the noninvasive assessment of breast cancer histopathological characteristics in clinical practice.

5. Conclusions

Our preliminary data indicate a potential that hybrid CEUS radiomic features allow the discrimination between breast cancers of different receptor and HER2 statuses with high specificity. Although hybrid CEUS radiomic features are unlikely to replace formal tissue biopsy and analysis, they might have the potential to provide a noninvasive, easily accessible and contrast-agent-safe method to assess tumor biology before and during treatment.

Author Contributions

Conceptualization, I.B. and A.I.C.; methodology, I.B., A.I.C., C.A.C., L.D.C., P.A.Ș. and S.M.D.; investigation, I.B.; statistical analysis, P.A.Ș.; interpretation, I.B., A.I.C. and C.A.C.; writing—original draft preparation, I.B., A.I.C., C.A.C., R.A.L. and L.D.C.; writing—review and editing, I.B., A.I.C., R.A.L. and S.M.D. All authors have read and agreed to the published version of the manuscript.

Funding

This work was granted by project PDI-PFE-CDI 2021, entitled Increasing the Performance of Scientific Research, Supporting Excellence in Medical Research and Innovation, PROGRES, no. 40PFE/30.12.2021 of Iuliu Hatieganu University of Medicine and Pharmacy, Cluj-Napoca, Romania.

Institutional Review Board Statement

This study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of “Iuliu Hatieganu” University of Medicine and Pharmacy (registration number 280; 11 August 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data are available only by request.

Acknowledgments

We are grateful that this work was granted by project PDI-PFE-CDI 2021, entitled Increasing the Performance of Scientific Research, Supporting Excellence in Medical Research and Innovation, PROGRES, no. 40PFE/30.12.2021.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Vraka, I.; Panourgias, E.; Sifakis, E.; Koureas, A.; Galanis, P.; Dellaportas, D.; Gouliamos, A.; Antoniou, A. Correlation between contrast-enhanced ultrasound characteristics (qualitative and quantitative) and pathological prognostic factors in breast cancer. In Vivo 2018, 32, 945–954. [Google Scholar] [CrossRef] [PubMed]
  2. Esfehani, M.H.; Yazdankhah-kenari, A.; Omranipour, R. Validation of Contrast Enhanced Ultrasound Technique to Wire Localization of Sentinel Lymph Node in Patients with Early Breast Cancer. Indian J. Surg. Oncol. 2015, 6, 370–373. [Google Scholar] [CrossRef] [PubMed]
  3. Jia, K.; Li, L.; Wu, X.J.; Hao, M.J.; Xue, H.Y. Contrast-enhanced ultrasound for evaluating the pathologic response of breast cancer to neoadjuvant chemotherapy: A meta-analysis. Medicine 2019, 98, 14258. [Google Scholar] [CrossRef]
  4. Boca, I.; Ciurea, A.I.; Ciortea, C.A.; Ștefan, P.A.; Lisencu, L.A.; Dudea, S.M. Differentiating breast tumors from background parenchymal enhancement at contrast-enhanced mammography: The role of radiomics—A pilot reader study. Diagnostics 2021, 11, 1248. [Google Scholar] [CrossRef]
  5. Lupean, R.-A.; Ștefan, P.-A.; Csutak, C.; Lebovici, A.; Măluțan, A.; Buiga, R.; Melincovici, C.; Mihu, C. Differentiation of endometriomas from ovarian hemorrhagic cysts at magnetic resonance: The role of texture analysis. Medicina 2020, 56, 487. [Google Scholar] [CrossRef] [PubMed]
  6. Gillies, R.J.; Kinahan, P.E.; Hricak, H. Radiomics: Images are more than pictures, they are data. Radiology 2016, 278, 563–577. [Google Scholar] [CrossRef] [PubMed]
  7. Ștefan, P.-A.; Lupean, R.-A.; Mihu, C.M.; Lebovici, A.; Oancea, M.D.; Hîțu, L.; Duma, D.; Csutak, C. Ultrasonography in the diagnosis of adnexal lesions: The role of texture analysis. Diagnostics 2021, 11, 812. [Google Scholar] [CrossRef] [PubMed]
  8. Pinker, K.; Chin, J.; Melsaether, A.N.; Morris, E.A.; Moy, L. Precision medicine and radiogenomics in breast cancer: New approaches toward diagnosis and treatment. Radiology 2018, 287, 732–747. [Google Scholar] [CrossRef]
  9. Fan, M.; Zhang, P.; Wang, Y.; Peng, W.; Wang, S.; Gao, X.; Xu, M.; Li, L. Radiomic analysis of imaging heterogeneity in tumours and the surrounding parenchyma based on unsupervised decomposition of DCE-MRI for predicting molecular subtypes of breast cancer. Eur. Radiol. 2019, 29, 4456–4467. [Google Scholar] [CrossRef]
  10. Li, W.; Yu, K.; Feng, C.; Zhao, D. Molecular Subtypes Recognition of Breast Cancer in Dynamic Contrast-Enhanced Breast Magnetic Resonance Imaging Phenotypes from Radiomics Data. Comput. Math Methods Med. 2019, 2019, 6978650. [Google Scholar] [CrossRef]
  11. Wu, L.; Zhao, Y.; Lin, P.; Qin, H.; Liu, Y.; Wan, D.; Li, X.; He, Y.; Yang, H. Preoperative ultrasound radiomics analysis for expression of multiple molecular biomarkers in mass type of breast ductal carcinoma in situ. BMC Med. Imaging. 2021, 21, 84. [Google Scholar] [CrossRef] [PubMed]
  12. Shan, Y.N.; Xu, W.; Wang, R.; Wang, W.; Pang, P.P.; Shen, Q.J. A Nomogram Combined Radiomics and Kinetic Curve Pattern as Imaging Biomarker for Detecting Metastatic Axillary Lymph Node in Invasive Breast Cancer. Front. Oncol. 2020, 10, 1643. [Google Scholar] [CrossRef] [PubMed]
  13. Luo, W.Q.; Huang, Q.X.; Huang, X.W.; Hu, H.T.; Zeng, F.Q.; Wang, W. Predicting Breast Cancer in Breast Imaging Reporting and Data System (BI-RADS) Ultrasound Category 4 or 5 Lesions: A Nomogram Combining Radiomics and BI-RADS. Sci. Rep. 2019, 9, 11921. [Google Scholar] [CrossRef]
  14. Wang, Z.; Lin, F.; Ma, H.; Shi, Y.; Dong, J.; Yang, P.; Zhang, K.; Guo, N.; Zhang, R.; Cui, J.; et al. Contrast-Enhanced Spectral Mammography-Based Radiomics Nomogram for the Prediction of Neoadjuvant Chemotherapy-Insensitive Breast Cancers. Front. Oncol. 2021, 11, 605230. [Google Scholar] [CrossRef] [PubMed]
  15. Leithner, D.; Bernard-Davila, B.; Martinez, D.F.; Horvat, J.V.; Jochelson, M.S.; Marino, M.A.; Avendano, D.; Ochoa-Albiztegui, R.E.; Sutton, E.J.; Morris, E.A.; et al. Radiomic Signatures Derived from Diffusion-Weighted Imaging for the Assessment of Breast Cancer Receptor Status and Molecular Subtypes. Mol. Imaging Biol. 2020, 22, 453–461. [Google Scholar] [CrossRef]
  16. Zhang, Y.; Liu, F.; Zhang, H.; Ma, H.; Sun, J.; Zhang, R.; Song, L.; Shi, H. Diagnostic Value of Radiomics Analysis in Contrast-Enhanced Spectral Mammography for Identifying Triple-Negative Breast Cancer. Front. Oncol. 2021, 11, 773196. [Google Scholar] [CrossRef]
  17. Wang, X.-Y.; Hu, Q.; Fang, M.-Y.; He, Y.; Wei, H.-M.; Chen, X.-X.; Zhang, B. The correlation between HER-2 expression and the CEUS and ARFI characteristics of breast cancer. PLoS ONE 2017, 12, e0178692. [Google Scholar] [CrossRef] [PubMed]
  18. Mayerhoefer, M.E.; Breitenseher, M.; Amann, G.; Dominkus, M. Are signal intensity and homogeneity useful parameters for distinguishing between benign and malignant soft tissue masses on MR images? Objective evaluation by means of texture analysis. Magn. Reson. Imaging 2008, 26, 1316–1322. [Google Scholar] [CrossRef]
  19. Yadav, A.K.; Roy, R. Wavelet Based Texture Analysis for Medical Images. Int. J. Adv. Res. Electr. Electron. Instrum. Eng. 2015, 4, 3958–3963. [Google Scholar]
  20. Materka, A. Texture analysis methodologies for magnetic resonance imaging. Dialogues Clin. Neurosci. 2004, 6, 243–250. [Google Scholar] [CrossRef]
  21. Cao, X.-L.; Bao, W.; Zhu, S.-G.; Wang, L.-H.; Sun, M.-H.; Men, Y.-M.; Xue, J. Contrast-enhanced ultrasound characteristics of breast cancer: Correlation with prognostic factors. Ultrasound Med. Biol. 2014, 40, 11–17. [Google Scholar] [CrossRef] [PubMed]
  22. Li, C.; Gong, H.; Ling, L.; Du, L.; Su, T.; Wang, S.; Wang, J. Diagnostic performance of contrast-enhanced ultrasound and enhanced magnetic resonance for breast nodules. J. Biomed. Res. 2018, 32, 198–207. [Google Scholar] [PubMed]
  23. La Forgia, D.; Fanizzi, A.; Campobasso, F.; Bellotti, R.; Didonna, V.; Lorusso, V.; Moschetta, M.; Massafra, R.; Tamborra, P.; Tangaro, S.; et al. Radiomic Analysis in Contrast-Enhanced Spectral Mammography for Predicting Breast Cancer Histological Outcome. Diagnostics 2020, 10, 708. [Google Scholar] [CrossRef] [PubMed]
  24. Huang, Y.Q.; Liang, H.Y.; Yang, Z.X.; Ding, Y.; Zeng, M.S.; Rao, S.X. Value of MR histogram analyses for prediction of microvascular invasion of hepatocellular carcinoma. Medicine 2016, 95, e4034. [Google Scholar] [CrossRef] [PubMed]
  25. Zhao, L.-X.; Liu, H.; Wei, Q.; Xu, G.; Wu, J.; Xu, H.-X.; Wu, R.; Pu, H. Contrast-enhanced ultrasonography features of breast malignancies with different sizes: Correlation with prognostic factors. BioMed Res. Int. 2015, 2015, 613831. [Google Scholar] [CrossRef] [PubMed]
  26. Zhao, Y.X.; Liu, S.; Hu, Y.B.; Ge, Y.Y.; Lv, D.M. Diagnostic and prognostic values of contrast-enhanced ultrasound in breast cancer: A retrospective study. Onco Targets Ther. 2017, 10, 1123–1129. [Google Scholar] [CrossRef] [PubMed]
  27. Putti, T.C.; El-Rehim, D.M.A.; Rakha, E.; Paish, C.E.; Lee, A.H.; Pinder, S.E.; Ellis, I. Estrogen receptor-negative breast carcinomas: A review of morphology and immunophenotypical analysis. Mod. Pathol. 2005, 18, 26–35. [Google Scholar] [CrossRef]
  28. Wan, C.F.; Du, J.; Fang, H.; Li, F.H.; Zhu, J.S.; Liu, Q. Enhancement Patterns and Parameters of Breast Cancers at contrast-enhanced US: Correlation with prognostic factors. Radiology 2012, 262, 450–459. [Google Scholar] [CrossRef]
  29. Mu, K.; Li, L.; Yang, Q.; Yun, H.; Kharaziha, P.; Ye, D.-W.; Auer, G.; Lagercrantz, S.B.; Zetterberg, A. A standardized method for quantifying proliferation by Ki-67 and cyclin A immunohistochemistry in breast cancer. Ann. Diagn. Pathol. 2015, 19, 243–248. [Google Scholar] [CrossRef]
  30. Demircioglu, A.; Grueneisen, J.; Ingenwerth, M.; Hoffmann, O.; Pinker-Domenig, K.; Morris, E.; Haubold, J.; Forsting, M.; Nensa, F.; Umutlu, L. A rapid volume of interest-based approach of radiomics analysis of breast MRI for tumor decoding and phenotyping of breast cancer. PLoS ONE. 2020, 15, e0234871. [Google Scholar] [CrossRef]
  31. Marino, M.A.; Leithner, D.; Sung, J.; Avendano, D.; Morris, E.A.; Pinker, K.; Jochelson, M.S. Radiomics for tumor characterization in breast cancer patients: A feasibility study comparing contrast-enhanced mammography and magnetic resonance imaging. Diagnostics 2020, 10, 492. [Google Scholar] [CrossRef] [PubMed]
  32. Bhooshan, N.; Giger, M.L.; Jansen, S.A.; Li, H.; Lan, L.; Newstead, G.M. Cancerous breast lesions on dynamic contrast-enhanced MR images: Computerized characterization for image-based prognostic markers. Radiology 2010, 254, 680–690. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Flowchart of patient inclusion in the study.
Figure 1. Flowchart of patient inclusion in the study.
Cancers 14 03905 g001
Figure 2. Contrast-enhanced ultrasound (CEUS) of histologically proven breast cancer; (a) grayscale image; (b,c) hybrid images with the tumor applied regions of interest (ROIs) that were automatically delineated by the software (green) and the final ROI after manual correction (red).
Figure 2. Contrast-enhanced ultrasound (CEUS) of histologically proven breast cancer; (a) grayscale image; (b,c) hybrid images with the tumor applied regions of interest (ROIs) that were automatically delineated by the software (green) and the final ROI after manual correction (red).
Cancers 14 03905 g002
Figure 3. ROC curves of the WavEnHH_s_4 parameter that was independently associated with the HER+ status and the HER prediction model.
Figure 3. ROC curves of the WavEnHH_s_4 parameter that was independently associated with the HER+ status and the HER prediction model.
Cancers 14 03905 g003
Figure 4. ROC curves of the parameters that showed statistically significant results in the comparison of PR+ and the PR− patients (RPerc01, RPerc10 and RWavEnLH_s_4) and of the prediction model that incorporated the three parameters.
Figure 4. ROC curves of the parameters that showed statistically significant results in the comparison of PR+ and the PR− patients (RPerc01, RPerc10 and RWavEnLH_s_4) and of the prediction model that incorporated the three parameters.
Cancers 14 03905 g004
Figure 5. ROC curve of the RWavEnLH_s-4 in the diagnosis of ER+ tumors.
Figure 5. ROC curve of the RWavEnLH_s-4 in the diagnosis of ER+ tumors.
Cancers 14 03905 g005
Table 1. Texture parameters.
Table 1. Texture parameters.
Radiomics FeaturesComputation MethodComputational VariationsClass
Perc.01–99%, Skewness, Kurtosis, Variance, Mean--Histogram
GLevNonU, LngREmph, RLNonUni, ShrtREmp, Fraction6 bits/pixel4 directionsRLM
Teta 1–4, Sigma--ARM
InvDfMom, SumAverg, SumVarnc, SumEntrp, Entropy, DifVarnc, DifEntrp, AngScMom, Contrast, Correlat, SumOfSqs6 bits/pixel;
5 between-pixel distances
4 directionsCOM
WavEn5 scales4 frequency bandsWT
GrNonZeros, percentage of pixels with nonzero gradient, GrMean, GrVariance, GrSkewness, GrKurtosis4 bits/pixel-AR
AR, absolute gradient; RLM, run length matrix; COM, co-occurrence matrix; ARM, auto-regressive model; WT, wavelet transformation; Mean, histogram’s mean; Variance, histogram’s variance; Skewness, histogram’s skewness; Kurtosis, histogram’s kurtosis; Perc.01–99%, 1st to 99th percentile; GrMean, absolute gradient mean; GrVariance, absolute gradient variance; GrSkewness, absolute gradient skewness; GrKurtosis, absolute gradient kurtosis; GrNonZeros, percentage of pixels with nonzero gradient; RLNonUni, run-length nonuniformity; GLevNonU, grey level nonuniformity; LngREmph, long-run emphasis; ShrtREmp, short-run emphasis; Fraction, the fraction of image in runs; AngScMom, angular second moment; Contrast, contrast; Correlat, correlation; SumOfSqs, the sum of squares; InvDfMom, inverse difference moment; SumAverg, sum average; SumVarnc, sum variance; SumEntrp, sum entropy; Entropy, entropy; DifVarnc, the difference of variance; DifEntrp, the difference of entropy; Teta 1–4, parameters θ1–θ14; Sigma, parameter σ; WavEn, wavelet energy.
Table 2. Patients’ characteristics.
Table 2. Patients’ characteristics.
Patients’ CharacteristicsNumberFrequency (%)
Mean age, years (range)56.5 (29–83)
Mean lesion size, mm (range)24.07 (7–60)
Pathological Type
 DCIS11.38
 DCIS + Borderline phyllodes11.38
 IDC NST6387.56
 IDC with mucinous components11.38
 Tubular carcinoma11.38
 Papillary carcinoma22.77
 Malignant phyllodes11.38
 ILC22.77
Nottingham grade
 I1115.28
 II3954.17
 III2230.55
Estrogen receptor status
 Negative1318.05
 Positive5981.95
Progesterone receptor status
 Negative3440.27
 Positive3859.73
Her2 status
 Negative5981.94
 Positive1318.06
Ki-67
 <20%3548.61
 ≥20%3751.39
Luminal subtype
 A2940.27.
 B3041.66
 HER2+68.33
 Triple-negative79.74
Table 3. Texture parameter depending on histological characteristics.
Table 3. Texture parameter depending on histological characteristics.
Nottingham I vs. Nottingham II + III
Texture ParametersFp-ValueNottingham INottingham II + III
MedianIQRMedianIQR
RATeta30.30890.28320.490.43–0.560.510.46–0.57
RATeta40.28810.32890.160.12–0.170.140.12–0.16
RCV4D6DifVarnc0.24580.22936.533.37–7.717.045.51–7.98
RCV3D6DifVarnc0.24280.3215.152.80–65.454.42–6.07
RCV5D6DifVarnc0.2380.23567.433.77–9.168.396.18–9.69
RCV2D6DifVarnc0.21910.41513.452–3.913.522.89–3.91
RWavEnHH_s-40.20970.15326.444.18–10.639.676.40–13.32
RATeta20.20730.3132−0.58−0.64–−0.48−0.59−0.64–−0.55
RCZ3D6DifVarnc0.20290.35356.523.23–7.066.475.34–7.42
RCN2D6DifVarnc0.20060.42443.712.24–4.754.073.31–4.71
ER Negative vs. ER Positive
Texture ParametersFp-ValueER NegativeER Positive
MedianIQRMedianIQR
RWavEnLH_s-40.49510.018139.4434.77–51.9731.6418.5–44.76
RWavEnHL_s-40.34130.085426.6617.677–31.8318.3411.67–27.36
RATeta10.30170.15350.930.92–0.940.930.91–0.93
RWavEnLL_s-60.28740.16651511.371024.61–2972.411168.38711.04–1775.91
RWavEnLL_s-50.28510.19011347.991034.33–3232.671137.51703.89–1882.82
RWavEnHL_s-60.24670.153525.6614.75–46.6316.9312.07–30.72
RPerc100.20420.1141157.5–25.75103–15.75
RWavEnLL_s-40.19570.26271193.40889.87–3281.361108688.71–1738.54
RPerc500.19260.29512521.5–53.252418.25–35
RWavEnLL_s-30.17710.37581238.59744.08–3315.791019.02676.08–1729.19
PR Negative vs. PR Positive
Texture ParametersFp-ValuePR NegativePR Positive
MedianIQRMedianIQR
RPerc010.33410.010872–1222–7
RPerc100.3250.035213.56–208.52–16
RWavEnLH_s-40.29640.019536.6627.74–48.2828.8817.57–38.36
RWavEnLL_s-50.28090.11171408.29773.71–2509.741125.22617.94–1697.62
RWavEnLL_s-40.26340.13071257.85729.63–2883.871039.67533.92–1671.16
RPerc500.25410.11812521–4323.515–33
RWavEnLL_s-30.24730.1521324.88715.54–2705.421008.67537.07–1652.83
RWavEnLL_s-60.24540.15861408.96786.48–2145.921142.90742.80–1637.12
RMean0.24440.106731.5825.23–47.4428.5419.63–35.84
RCZ4D6SumAverg0.24390.097316.5013.01–24.5414.8010.57–18.86
Ki-67 Negative vs. Ki-67 Positive
Texture ParametersFp-ValueKi-67 NegativeKi-67 Positive
MedianIQRMedianIQR
RWavEnLH_s-60.170.144642.2827.07–56.6732.7715.98–50.05
RATeta40.13090.14460.160.12–0.170.140.12–0.16
RCN1D6AngScMom0.1290.14460.010.009–0.040.020.01–0.04
RCV1D6AngScMom0.1290.15740.010.01–0.040.020.01–0.04
RCZ1D6AngScMom0.12840.14770.010.009–0.040.020.01–0.04
RCV2D6AngScMom0.1260.14770.010.006–0.020.010.008–0.029
RCN2D6AngScMom0.12460.15090.010.006–0.020.010.008–0.02
RCH2D6AngScMom0.12440.18560.020.01–0.040.030.01–0.04
RCH3D6AngScMom0.12440.16750.010.008–0.030.020.01–0.03
RCV3D6AngScMom0.12420.15090.010.005–0.020.010.007–0.02
HER2 Negative vs. HER2 Positive
Texture ParametersFp-ValueHER2 NegativeHER2 Positive
MedianIQRMedianIQR
RWavEnLH_s-60.70150.003740.7826.56–56.7222.208.96–36.05
RWavEnHH_s-40.66930.01119.836.51–13.326.302.98–8.67
RRZD6ShrtREmp0.57540.04570.790.73–0.820.720.68–0.80
RRHD6ShrtREmp0.56770.07290.670.59–0.700.610.52–0.66
RRND6ShrtREmp0.56220.05240.790.73–0.820.720.68–0.80
RRVD6ShrtREmp0.53770.07060.770.72–0.800.700.65–0.78
RRHD6Fraction0.50630.03570.490.41–0.540.400.34–0.48
RCH1D6InvDfMom0.45970.04260.720.68–0.770.770.71–0.81
RCH2D6InvDfMom0.45710.0370.560.51–0.640.630.57–0.69
RCH3D6InvDfMom0.44740.03320.470.42–0.550.550.48–0.61
IQR, interquartile range.
Table 4. Multivariate analysis of the parameters independently associated with the HER2+ status.
Table 4. Multivariate analysis of the parameters independently associated with the HER2+ status.
Independent VariablesCoefficientStd. ErrortprpartialrsemipartialVIF
RCH1D6InvDfMom12.7119.760.640.5220.080.07813.42
RCH2D6InvDfMom−43.6038.37−1.130.260−0.140.126252.58
RCH3D6InvDfMom10.6920.280.520.5990.060.052153.36
RRHD6Fraction−19.039.60−1.980.052−0.240.22499
RRZD6ShrtREmp−1.612−0.80.424−0.10.0810.73
RWavEnHH_s_4−0.020.01−2.050.044−0.240.222.33
RWavEnLH_s_6−0.0020.001−1.090.279−0.130.121.46
t-value; p-value; VIF, variance inflation factor.
Table 5. Parameters not independently associated with the HER2 status. Between the brackets are the values corresponding to the 95% confidence interval.
Table 5. Parameters not independently associated with the HER2 status. Between the brackets are the values corresponding to the 95% confidence interval.
Parameterp-ValueAUCJCut-OffSe (%)Sp (%)
RWavEnLH_s_60.00020.759 (0.644–0.852)0.3977≤42.4192.31 (64.0–99.8)47.46 (34.3–60.9)
RRZD6ShrtREmp0.03440.678 (0.557–0.783)0.3690≤0.7253.85 (25.1–80.8)83.05 (71.0–91.6)
RRHD6Fraction0.02120.687 (0.567–0.791)0.3716≤0.4884.62 (54.6–98.1)52.54 (39.1–65.7)
RCH1D6InvDfMom0.02490.681 (0.560–0.786)0.3977>0.70692.31 (64.0–99.8)47.46 (34.3–60.9)
RCH2D6InvDfMom0.02110.686 (0.566–0.790)0.3977>0.54992.31 (64.0–99.8)47.46 (34.3–60.9)
RCH3D6InvDfMom0.01740.690 (0.570–0.794)0.3716>0.47884.62 (54.6–98.1)52.54 (39.1–65.7)
AUC—area under the curve; Se—sensitivity; Sp—specificity
Table 6. Multivariate analysis of the parameters independently associated with the PR+ status.
Table 6. Multivariate analysis of the parameters independently associated with the PR+ status.
Independent VariablesCoefficientStd. ErrortprpartialrsemipartialVIF
RPerc01−0.010.02−0.620.5329−0.070.075.8
RPerc10−0.0010.01−0.080.9296−0.010.016.33
RWavEnLH_s_4−0.0040.003−1.170.2445−0.140.131.44
Std.—standard; t-value; p-value; VIF, variance inflation factor.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Bene, I.; Ciurea, A.I.; Ciortea, C.A.; Ștefan, P.A.; Ciule, L.D.; Lupean, R.A.; Dudea, S.M. Radiomic Signatures Derived from Hybrid Contrast-Enhanced Ultrasound Images (CEUS) for the Assessment of Histological Characteristics of Breast Cancer: A Pilot Study. Cancers 2022, 14, 3905. https://doi.org/10.3390/cancers14163905

AMA Style

Bene I, Ciurea AI, Ciortea CA, Ștefan PA, Ciule LD, Lupean RA, Dudea SM. Radiomic Signatures Derived from Hybrid Contrast-Enhanced Ultrasound Images (CEUS) for the Assessment of Histological Characteristics of Breast Cancer: A Pilot Study. Cancers. 2022; 14(16):3905. https://doi.org/10.3390/cancers14163905

Chicago/Turabian Style

Bene, Ioana, Anca Ileana Ciurea, Cristiana Augusta Ciortea, Paul Andrei Ștefan, Larisa Dorina Ciule, Roxana Adelina Lupean, and Sorin Marian Dudea. 2022. "Radiomic Signatures Derived from Hybrid Contrast-Enhanced Ultrasound Images (CEUS) for the Assessment of Histological Characteristics of Breast Cancer: A Pilot Study" Cancers 14, no. 16: 3905. https://doi.org/10.3390/cancers14163905

APA Style

Bene, I., Ciurea, A. I., Ciortea, C. A., Ștefan, P. A., Ciule, L. D., Lupean, R. A., & Dudea, S. M. (2022). Radiomic Signatures Derived from Hybrid Contrast-Enhanced Ultrasound Images (CEUS) for the Assessment of Histological Characteristics of Breast Cancer: A Pilot Study. Cancers, 14(16), 3905. https://doi.org/10.3390/cancers14163905

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop