Skip to Content
You are currently on the new version of our website. Access the old version .
DiagnosticsDiagnostics
  • Article
  • Open Access

7 November 2026

16 Pages

Contrast-Enhanced Ultrasound Combined with the NLR–PMR Phenotype for Prostate Cancer Prediction and Risk Stratification in Patients with PSA 4–20 ng/mL and PI-RADS ≤ 3

,
,
,
,
,
,
and
1
Department of Ultrasound, Harbin Medical University Cancer Hospital, Harbin 150006, China
2
College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150081, China
*
Authors to whom correspondence should be addressed.

Abstract

Background/Objectives: To assess contrast-enhanced ultrasound (CEUS) combined with the neutrophil-to-lymphocyte ratio–platelet-to-monocyte ratio (NLR–PMR) phenotype for predicting prostate cancer (PCa) and clinically significant PCa (csPCa) in patients with PSA 4–20 ng/mL and PI-RADS ≤ 3. Methods: This single-center retrospective study included 418 biopsy patients. Outcomes were PCa and csPCa (ISUP Grade Group ≥ 2). A continuous NLR–PMR score and CEUS were added to an age–PSA density baseline model. Discrimination was assessed using the area under the receiver operating characteristic curve (AUC). Three risk strata were defined using CEUS and NLR–PMR status. Results: PCa and csPCa were detected in 60 (14.4%) and 42 (10.0%) patients. Adding NLR–PMR improved AUCs beyond age and PSA density for PCa (0.798 vs. 0.747; p = 0.025) and csPCa (0.805 vs. 0.752; p = 0.026). Combined-model AUCs were 0.798 for PCa and 0.812 for csPCa. CEUS positivity remained associated with csPCa after adjustment (OR = 2.26, 95% CI: 1.08–4.91; p = 0.033). Across low-, intermediate-, and high-risk strata, detection rates were 3.9%, 15.2%, and 34.3% for PCa and 2.0%, 8.0%, and 28.4% for csPCa. The low-risk stratum comprised 48.8% of patients, with a csPCa negative predictive value of 98.0% and no ISUP Grade Group 4–5 cancers. Dual CEUS/NLR–PMR positivity increased with pathological grade (p < 0.001). Conclusions: In this exploratory cohort, NLR–PMR improved discrimination for PCa and csPCa, and CEUS further differentiated csPCa risk among NLR–PMR-positive patients. The combined assessment identified strata with progressively increasing cancer detection rates, providing preliminary evidence for individualized pre-biopsy risk assessment. Prospective multicenter external validation is required before clinical implementation.

1. Introduction

Serum prostate-specific antigen (PSA) is widely used for the early detection of prostate cancer (PCa), but its limited tumor specificity necessitates integration with other risk information [1]. Multiparametric magnetic resonance imaging (mpMRI) has improved pre-biopsy risk assessment and lesion targeting [2]. Nevertheless, clinically significant prostate cancer (csPCa) cannot be completely excluded in patients with Prostate Imaging Reporting and Data System (PI-RADS) scores ≤ 3 [3]. A large multi-institutional cohort reported a csPCa detection rate of approximately 20% among patients with PI-RADS 3 lesions [4]. Although PSA density (PSAD) can further refine risk assessment in these patients, reliance on a single threshold may reduce biopsies at the cost of missing some csPCa cases [5]. Moreover, the predictive performance and optimal threshold of PSAD vary according to prostate volume and PI-RADS category [6]. Additional information is therefore needed to improve biopsy decision-making in patients with elevated PSA levels but no highly suspicious lesions on MRI. The EAU guideline update recommends integrating MRI findings with PSAD and other clinical risk factors when considering biopsy, including in patients with negative or equivocal MRI [7]. Comparative evidence from Ahdoot et al. also illustrates how systematic and MRI-targeted sampling provide complementary diagnostic information and influence the reference standard used to assess risk models [8].
Contrast-enhanced ultrasound (CEUS) enables real-time visualization of prostatic microvascular perfusion and provides qualitative and quantitative information for lesion assessment [9]. The EFSUMB recommendations provide a technical framework for non-hepatic CEUS, including contrast administration, low-mechanical-index imaging, and acquisition of enhancement information; consistent acquisition and interpretation are important for reproducibility [10]. Previous research has suggested that adding CEUS to PI-RADS may improve pre-biopsy risk assessment in patients with PSA levels of 4–10 ng/mL [11]. However, benign prostatic hyperplasia and chronic inflammation may also exhibit abnormal enhancement patterns, limiting the diagnostic specificity of CEUS [12]. Multiparametric ultrasound approaches may improve lesion characterization by integrating complementary imaging features [13]. More recently, the combination of hemodynamic and tissue-stiffness features has shown improved performance in predicting csPCa [14]. These findings suggest that combining CEUS-derived perfusion information with other risk factors may enhance pre-biopsy assessment.
Blood-based inflammatory markers derived from routine complete blood counts are readily available, inexpensive, and reproducible. A systematic review and meta-analysis by Salciccia et al. identified heterogeneous prognostic findings for NLR and platelet-to-lymphocyte ratio across PCa settings [15]. This evidence supports studying inflammatory markers while highlighting that prognostic associations require separate evaluation for pre-biopsy diagnosis. Various hematological inflammatory markers have been evaluated in relation to prostate biopsy outcomes, but their independent predictive ability and incremental value have been inconsistent [16]. The neutrophil-to-lymphocyte ratio (NLR) has previously been combined with PI-RADS in pre-biopsy prediction models for csPCa [17]. In patients with PSA levels of 4–20 ng/mL, composite indices such as the pan-immune-inflammation value have also shown discriminatory value for PCa [18]. Associations between monocyte-based ratios and biopsy-detected csPCa have also been reported [19]. By incorporating different circulating blood-cell components, NLR and the platelet-to-monocyte ratio (PMR) may provide complementary inflammation-related information. Combining these hematological features with local perfusion information from CEUS may enable a more comprehensive risk assessment in patients with elevated PSA levels and low-suspicion MRI findings; however, evidence supporting this approach remains limited.
Accordingly, this study focused on patients with PSA levels of 4–20 ng/mL and PI-RADS scores ≤ 3, in whom uncertainty about cancer risk may persist after PSA testing and MRI. We investigated the associations of qualitative CEUS findings and the NLR–PMR phenotype with biopsy-detected PCa and csPCa, and evaluated their combined performance in prediction and risk stratification. The aim was to explore whether these complementary sources of information could help refine pre-biopsy risk assessment and inform individualized biopsy decisions.

2. Materials and Methods

2.1. Study Population

This single-center retrospective study reviewed 2754 patients who underwent prostate biopsy at Harbin Medical University Cancer Hospital between May 2020 and June 2026. Eligible patients had pre-biopsy PSA levels of 4–20 ng/mL, PI-RADS v2.1 scores ≤ 3, evaluable CEUS data, definitive pathology from a 12-core biopsy, and sufficient clinical and laboratory data. Patients with previous PCa or related treatment were excluded. The final cohort included 418 patients; the sequential exclusion reasons and counts are shown in Figure 1. Biopsy decisions were made by the treating clinician after considering additional clinical indications; biopsy was performed selectively among patients meeting the PSA and MRI criteria.
Figure 1. Patient screening and analysis workflow. During the study period, 2754 patients underwent prostate biopsy. Sequential screening according to CEUS evaluability, MRI availability and PI-RADS score, availability of PSA and required blood cell counts, and PSA range yielded 418 patients for analysis. Abbreviations: CEUS, contrast-enhanced ultrasound; PI-RADS, Prostate Imaging Reporting and Data System; PSA, prostate-specific antigen.
This study was approved by the Ethics Committee of Harbin Medical University Cancer Hospital.

2.2. MRI Assessment

All patients underwent 3.0-T prostate mpMRI before biopsy using either a MAGNETOM Skyra scanner (Siemens Healthineers, Erlangen, Germany) or a SIGNA Architect scanner (GE Healthcare, Waukesha, WI, USA). The routine imaging protocol included T2-weighted imaging (T2WI), diffusion-weighted imaging (DWI), and dynamic contrast-enhanced MRI (DCE-MRI). Two radiologists with at least 5 years of experience in prostate MRI independently assigned PI-RADS scores according to PI-RADS version 2.1 while blinded to the patients’ clinical information and final biopsy results [20]. Any disagreement was reviewed by a third senior radiologist and resolved by consensus.

2.3. CEUS Examination and Interpretation

All patients underwent conventional transrectal ultrasound and CEUS before biopsy. Examinations were performed using either a MyLabTwice ultrasound system with a TRT-33 transrectal probe operating at 3.0–13.0 MHz (Esaote, Genoa, Italy) or a Resona R9 Exp system with an ELC13-4U transrectal probe operating at 4.0–13.0 MHz (Mindray, Shenzhen, China). In low-mechanical-index mode (MI < 0.1), a 2.4mL bolus of sulfur hexafluoride microbubble contrast agent (SonoVue; Bracco, Milan, Italy) was administered through an antecubital vein, followed by a rapid 5mL saline flush. Prostatic perfusion was continuously observed for 120 s after injection, and dynamic video clips were stored.
The CEUS images were independently evaluated by two sonographers with at least 5 years of experience who were blinded to the patients’ clinical information and MRI scores. Assessment was qualitative and based on visual interpretation of enhancement patterns. CEUS positivity was defined as rapid early hyperenhancement followed by rapid washout relative to the surrounding or contralateral gland, presenting either focally or diffusely; all other enhancement patterns were classified as CEUS-negative. No time–intensity curves or quantitative perfusion parameters were analyzed. Figure 2 shows the ultrasound and MRI findings in a representative patient with a PI-RADS 3 lesion and biopsy-confirmed csPCa.
Figure 2. Ultrasound and MRI findings in a representative patient with a PI-RADS 3 lesion and biopsy-confirmed clinically significant prostate cancer. (A) Transrectal B-mode ultrasound shows the right peripheral-zone lesion region. (B) CEUS at 18 s shows early heterogeneous enhancement. (C) CEUS at 58 s shows reduced enhancement in part of the corresponding region compared with the early phase. (D) Axial T2-weighted image at the corresponding anatomical level. (E) High-b-value diffusion-weighted image (b = 2000 s/mm2) shows high signal in the right peripheral zone. (F) Corresponding apparent diffusion coefficient (ADC) map. The lesion was assigned PI-RADS 3, and the lesion ADC value was reported as 0.711 × 10−3 mm2/s. Biopsy showed prostate cancer with a Gleason score of 3 + 4 = 7 (ISUP Grade Group 2). White arrows indicate the lesion region.
Any disagreement was reviewed by a third senior sonographer and resolved by consensus.

2.4. Prostate Biopsy and Histopathological Assessment

All patients underwent a 12-core prostate biopsy under transrectal ultrasound guidance. In patients with focal abnormal perfusion on CEUS, selected cores within the 12-core scheme were directed toward the corresponding suspicious region, while the remaining cores were obtained according to the systematic biopsy protocol. Biopsy specimens were evaluated by genitourinary pathologists, and Gleason scores and ISUP Grade Groups were assigned according to the International Society of Urological Pathology consensus criteria [21].
The study outcomes were biopsy-detected PCa and csPCa, with csPCa defined as PCa of ISUP Grade Group ≥ 2. For exploratory analyses, pathological findings were further classified as no PCa, ISUP Grade Group 1, ISUP Grade Groups 2–3, or ISUP Grade Groups 4–5.

2.5. Calculation and Selection of Inflammatory Markers

Ten inflammatory markers were calculated from peripheral blood counts obtained within 7 days before biopsy: the systemic immune-inflammation index (SII), NLR, systemic inflammation response index (SIRI), pan-immune-inflammation value (PIV), platelet-to-lymphocyte ratio (PLR), lymphocyte-to-monocyte ratio (LMR), eosinophil-to-lymphocyte ratio (ELR), basophil-to-lymphocyte ratio (BLR), neutrophil-to-monocyte ratio (NMR), and PMR. NLR was calculated as the absolute neutrophil count divided by the absolute lymphocyte count, and PMR as the platelet count divided by the absolute monocyte count. The remaining indices were calculated as follows: SII = P × N/L, SIRI = N × M/L, PIV = N × P × M/L, PLR = P/L, LMR = L/M, ELR = E/L, BLR = B/L, and NMR = N/M, where N, L, M, E, and B denote the absolute neutrophil, lymphocyte, monocyte, eosinophil, and basophil counts, respectively, and P denotes the platelet count.
Candidate markers were Z-score standardized and initially screened using 10-fold cross-validated least absolute shrinkage and selection operator logistic regression, with biopsy-detected PCa as the outcome [22]. Their discriminative performance was also assessed using individual receiver operating characteristic analyses. Candidate combined models were subsequently constructed and compared in terms of discrimination and relative model fit, leading to the selection of NLR and PMR for subsequent analyses.

2.6. Statistical Analysis

Interobserver agreement for the two sonographers’ individual binary CEUS classifications was assessed using unweighted Cohen’s κ with a 95% confidence interval and the percentage of concordant classifications, before consensus resolution. Continuous variables are presented as medians with interquartile ranges (IQRs), and categorical variables as frequencies and percentages. Between-group comparisons were performed using the Mann–Whitney U test, Pearson’s χ2 test, or Fisher’s exact test, as appropriate. Patients with missing variables were excluded from the corresponding analyses, and no missing-value imputation was performed.
Initial marker screening was performed using 10-fold cross-validated LASSO at λ_min and λ_1se. Two-marker models were subsequently constructed using NLR as the base marker. The independent effect of each additional marker, model fit, and discriminative performance were considered jointly, leading to the selection of NLR and PMR for subsequent analyses.
The NLR and PMR cutoff values were derived from separate ROC analyses using biopsy-detected PCa as the outcome, by maximizing the Youden index (sensitivity + specificity − 1). An NLR–PMR-positive phenotype was defined as either NLR reaching or exceeding its optimal cutoff or PMR reaching or falling below its optimal cutoff; the cutoff values used for classification were 2.495 and 386.402, respectively. A strict classification rule requiring both conditions was also evaluated. The diagnostic performance of each classification rule was assessed using sensitivity, specificity, predictive values, and the area under the receiver operating characteristic curve (AUC). Cutoff stability was evaluated using 1000 bootstrap resamples, with the median, IQR, and 95% empirical percentile interval reported.
Four joint subgroups were constructed according to CEUS status and the NLR–PMR phenotype, and the detection of PCa, csPCa, and tumors across ISUP Grade Groups was compared among these subgroups. The two NLR–PMR-negative subgroups were combined to form the low-risk stratum. Patients with an NLR–PMR-positive phenotype and negative CEUS were classified as intermediate risk, whereas those positive for both CEUS and NLR–PMR were classified as high risk. The Cochran–Armitage trend test was used to evaluate changes in outcome detection rates across risk strata and changes in the proportions of positive phenotypes across pathological categories. Within the NLR–PMR-positive subgroup, comparisons according to CEUS status were performed using two-sided Fisher’s exact tests with Holm correction for multiple comparisons. The 95% confidence intervals for the detection rates shown in the figures were calculated using the Clopper–Pearson exact binomial method.
Sequential logistic regression models were constructed separately for PCa and csPCa. M0 included age and PSAD; M1 added CEUS to M0; M2 added the continuous NLR–PMR score to M0; and M3 included both CEUS and the NLR–PMR score in addition to M0. The NLR–PMR score was generated from a logistic regression model with PCa as the outcome and standardized NLR and PMR as predictors. PSAD was scaled per 0.1 ng/mL/cm3 increase. Model discrimination was evaluated using the AUC and compared using the DeLong test [23]. Model fit was assessed using likelihood-ratio tests and the Akaike information criterion (AIC), and prediction error was evaluated using the Brier score.
Decision curve analysis (DCA) was used to compare the net benefit of M0 and M3 with the biopsy-all and biopsy-none strategies across threshold probabilities ranging from 2% to 30% [24]. Optimism was corrected using 1000 bootstrap resamples, with marker standardization, score derivation, and model fitting repeated in each resample, but without repeating candidate-marker selection [25]. This analysis was exploratory, and the selected threshold range should not be interpreted as recommended clinical thresholds for biopsy. An interaction model, M4, was constructed by adding the product term between CEUS and the continuous NLR–PMR composite score to M3, and Firth penalized logistic regression was used as a sensitivity analysis of the interaction effect [26]. In addition, an extended clinical adjustment analysis was performed by adding the free-to-total PSA ratio and PI-RADS score to the clinical baseline model.
The reported ROC curves and AUCs were based on apparent estimates. M0, M2, and M3 additionally underwent internal validation using 1000 bootstrap resamples to estimate optimism-corrected AUCs, Brier scores, calibration intercepts, and calibration slopes (Supplementary Table S6). Marker standardization, score derivation, and model fitting were repeated within each resample, whereas candidate-marker selection was not repeated. The net benefit estimates from DCA were also corrected for bootstrap optimism. No external validation was performed. All statistical analyses were conducted using R version 4.4.1. All tests were two-sided, and p < 0.05 was considered statistically significant.

3. Results

3.1. Patient Selection and Baseline Characteristics

Of the 2754 patients who underwent prostate biopsy during the study period, 418 met the eligibility criteria and were included in the final analysis (Figure 1). PCa was detected in 60 patients (14.4%), including 42 patients (10.0%) with csPCa. Patients with PCa were older and had higher PSAD and NLR values but lower PMR values than those without PCa (all p < 0.05). The proportions of patients with CEUS positivity and NLR–PMR positivity were also higher in the PCa group (60.0% vs. 41.9%, p = 0.009; 86.7% vs. 45.3%, p < 0.001; Table 1).
Table 1. Baseline clinical, imaging, and inflammatory characteristics of the study cohort.
The two sonographers agreed on the CEUS classification in 371 of 418 patients (88.8%). Cohen’s κ was 0.773 (95% CI: 0.711–0.834).

3.2. Selection of Inflammatory Markers and Derivation of the NLR–PMR Phenotype

Among the 10 candidate inflammatory markers, NLR had the highest individual AUC (0.736, 95% CI: 0.665–0.806; Supplementary Table S1). LASSO retained six markers at λ_min and only NLR at λ_1se (Supplementary Figures S1 and S2). When PMR was added to NLR, PMR remained independently associated with PCa (OR = 0.68, 95% CI: 0.48–0.93, p = 0.023), and model fit improved (likelihood-ratio test p = 0.015), although the AUC did not increase (DeLong p = 0.876). The AIC values of the NLR + BLR and NLR + PMR models were similar (310.70 vs. 311.61), whereas the individual AUC of PMR was numerically higher than that of BLR (0.634 vs. 0.533). Considering these findings together with clinical interpretability, NLR and PMR were selected for subsequent analyses (Supplementary Table S2).
The optimal cutoff values for NLR and PMR were 2.495 and 386.402, respectively. Patients meeting either the elevated NLR or reduced PMR threshold were classified as NLR–PMR-positive, whereas those meeting neither condition were classified as NLR–PMR-negative. In 1000 bootstrap analyses, the median cutoff values for NLR and PMR were 2.49 and 386.60, respectively; their distributions are presented in Supplementary Table S3 and Supplementary Figure S3. The positive and negative groups included 214 and 204 patients, respectively. The corresponding detection rates were 24.3% and 3.9% for PCa and 17.8% and 2.0% for csPCa. All 15 ISUP Grade Group 4–5 cancers were NLR–PMR-positive. Diagnostic performance is presented in Table 2.
Table 2. Diagnostic performance of NLR, PMR, and their combined decision rules for PCa and csPCa detection.

3.3. Risk Stratification Using the Combined CEUS and NLR–PMR Phenotype

The CEUS−/NLR–PMR−, CEUS+/NLR–PMR−, CEUS−/NLR–PMR+, and CEUS+/NLR–PMR+ groups included 120, 84, 112, and 102 patients, respectively. Overall differences in the detection rates of PCa, csPCa, and ISUP Grade Group 4–5 cancers across the four groups were statistically significant (all p < 0.001; Table 3). Among NLR–PMR-positive patients, the CEUS-positive group had higher detection rates for all three outcomes, with Holm-adjusted p values of 0.003, <0.001, and 0.014, respectively (Supplementary Table S4).
Table 3. Distribution of biopsy outcomes according to the combined CEUS/NLR-PMR phenotype.
For exploratory risk stratification, the two NLR–PMR-negative subgroups were combined to form the low-risk stratum, while the remaining two groups were classified as intermediate and high risk, respectively. Across the low-, intermediate-, and high-risk strata, the detection rates were 3.9%, 15.2%, and 34.3% for PCa; 2.0%, 8.0%, and 28.4% for csPCa; and 0%, 2.7%, and 11.8% for ISUP Grade Group 4–5 cancers, respectively (all p for trend < 0.001; Figure 3). The high-risk stratum comprised 24.4% of the cohort and included 69.0% of all csPCa cases and 80.0% of all ISUP Grade Group 4–5 cancers. The low-risk stratum comprised 48.8% of the cohort, with no ISUP Grade Group 4–5 cancers detected.
Figure 3. Detection rates across the three risk phenotypes. Error bars indicate 95% Clopper–Pearson confidence intervals. Low, intermediate, and high risk were defined as NLR–PMR negative, NLR–PMR positive/CEUS negative, and NLR–PMR positive/CEUS positive, respectively. All p for trend < 0.001.
The proportions of CEUS positivity, NLR–PMR positivity, and dual positivity showed overall increasing trends across pathological categories (p for trend = 0.001, <0.001, and <0.001, respectively; Supplementary Table S5).

3.4. Predictive Performance of the Sequential Models

The baseline model M0, comprising age and PSAD, yielded AUCs of 0.747 for PCa and 0.752 for csPCa. After addition of the continuous NLR–PMR score, the AUCs of M2 increased to 0.798 and 0.805, respectively (DeLong p = 0.025 and 0.026). With the further addition of CEUS, M3 yielded AUCs of 0.798 for PCa and 0.812 for csPCa, both higher than those of M0 (p = 0.038 and 0.0496). The differences in AUC between M3 and M2 did not reach statistical significance for either PCa (p = 0.953) or csPCa (p = 0.689). Model comparisons and the ROC curves for M0 and M3 are presented in Table 4 and Figure 4.
Table 4. Predictive performance and model comparisons for PCa and csPCa.
Figure 4. Receiver operating characteristic curves of the clinical and final combined models. ROC curves for (A) PCa and (B) csPCa. M0 included age and PSAD; M3 additionally included CEUS and the continuous NLR–PMR score. p values were obtained using paired DeLong tests. Results represent apparent performance without optimism correction.
In the M3 model for csPCa, CEUS positivity remained independently associated with the outcome (OR = 2.26, 95% CI: 1.08–4.91, p = 0.033), and M3 showed improved model fit compared with M2 (likelihood-ratio test p = 0.030; Table 4).
After internal validation with 1000 bootstrap resamples, the optimism-corrected AUCs of M3 were 0.787 for PCa and 0.803 for csPCa, with calibration slopes of 0.940 and 0.936, respectively (Supplementary Table S6).

3.5. Exploratory Decision Curve Analysis

Within the exploratory threshold probability range of 2–30%, M3 showed a more consistent net benefit advantage over M0 at approximately 10–30% after correction for optimism using 1000 bootstrap resamples. At some lower-threshold intervals, the curves crossed. These findings were observed for both PCa and csPCa (Figure 5). At threshold probabilities of 10%, 20%, and 30%, the corrected net benefit differences between M3 and M0 were 0.0082, 0.0292, and 0.0199 for PCa and 0.0202, 0.0110, and 0.0070 for csPCa, respectively.
Figure 5. Bootstrap optimism-corrected decision curves for the clinical and combined models. Bootstrap optimism-corrected decision curves for (A) PCa and (B) csPCa. M0 included age and PSAD; M3 additionally included CEUS and the continuous NLR–PMR score. Corrections were based on 1000 bootstrap resamples. The evaluated threshold range of 2–30% was exploratory and does not represent recommended clinical thresholds. Note the different y-axis scales; negative net benefit below the plotting range is not shown.

3.6. Multivariable and Sensitivity Analyses

After further adjustment for the free-to-total PSA ratio and PI-RADS score, the association between CEUS and csPCa remained similar (OR = 2.28, 95% CI: 1.07–5.03, p = 0.035; Supplementary Table S7). Neither conventional logistic regression nor Firth regression provided clear evidence of an interaction between CEUS and the continuous NLR–PMR score for csPCa (p = 0.636 and 0.694, respectively; Supplementary Table S8).

4. Discussion

In patients with PSA levels of 4–20 ng/mL and PI-RADS scores ≤ 3, combined CEUS and NLR–PMR assessment identified groups with distinct cancer detection rates. NLR–PMR improved discrimination beyond age and PSAD. For csPCa, adding CEUS improved model fit (likelihood-ratio test p = 0.030), and CEUS positivity remained associated with the outcome after adjustment (OR = 2.26, 95% CI: 1.08–4.91). Among NLR–PMR-positive patients, csPCa detection rates were 28.4% with positive CEUS and 8.0% with negative CEUS. These findings support the potential of the combined assessment to refine pre-biopsy risk stratification in this clinically uncertain population.
The full model achieved AUCs of 0.798 for PCa and 0.812 for csPCa, both higher than those of the baseline model comprising age and PSAD. Liu et al. previously reported that a model combining CEUS and PI-RADS showed good discriminative performance in patients with PSA levels of 4–10 ng/mL [11]. The present study further focused on patients with low-suspicion MRI findings and explored the predictive and stratification value of incorporating hematological information. The CADMUS study also found that the clinically significant tumors detected by multiparametric ultrasound, which included CEUS, did not completely overlap with those detected by mpMRI, although this finding cannot be attributed to CEUS alone [27]. In the present study, adding CEUS to the continuous-score model did not significantly improve AUC, whereas CEUS status was still associated with different detection risks among NLR–PMR-positive patients. Together with the observed subgroup risk separation, these findings support further evaluation of CEUS as a supplementary risk-assessment tool.
The performance of inflammatory markers has varied across study populations. In 276 patients with PI-RADS 3 lesions, Kayar et al. reported associations between NLR, PIV, SIRI, and PCa detection, with SIRI showing relatively better discrimination [28]. In a separate two-center cohort, adding SII and NLR increased the AUC for PI-RADS 3 lesions, but the difference was not statistically significant [29]. These findings indicate that an association between a marker and an outcome does not necessarily translate into a consistent improvement in model performance. Salciccia et al. also found substantial heterogeneity in the prognostic evidence for inflammatory ratios [15]. Prognostic findings and pre-biopsy diagnostic performance concern different clinical settings and require separate interpretation. In the present study, NLR and PMR were retained after comparisons of candidate markers to evaluate their contribution within the defined PSA and MRI population. Gokce et al. reported that NLR was even higher in patients with prostatitis than in those with PCa, further indicating that these markers should not be directly equated with a tumor-related immune state [30].
Lower PMR was independently associated with PCa in our cohort. A lower ratio can reflect a higher monocyte count, a lower platelet count, or both. Relative monocyte predominance provides a possible biological context, given the role of monocyte/macrophage-related processes in the tumor microenvironment. Loberg et al. demonstrated that CCL2 blockade reduced macrophage infiltration, microvascular density, and tumor growth in a prostate cancer xenograft model [31]. Circulating PMR does not directly measure intratumoral macrophage abundance or activity. Studies combining individual blood-cell counts with tissue immune markers could clarify the basis of this association.
The double-negative subgroup did not have the lowest PCa detection rate, a finding that requires cautious interpretation. The detection rate was 1.2% in the CEUS+/NLR–PMR− subgroup, compared with 5.8% in the double-negative subgroup; however, only one PCa case was detected in the former subgroup. Sparse events and random variation may therefore have contributed substantially to this nonmonotonic distribution. Previous studies have reported that some cases of benign prostatic hyperplasia and chronic inflammation may exhibit abnormal enhancement resembling that of malignant lesions, providing another possible explanation for this finding [12]. However, because enhancement patterns were not directly matched with benign histopathological findings in this study, these results should not be interpreted as indicating a protective effect of CEUS positivity or an ability of NLR–PMR to exclude false-positive CEUS findings. Combining the two NLR–PMR-negative subgroups simplified risk presentation but did not establish that their risks were equivalent.
The three-tier classification revealed substantial differences in cancer risk among patients sharing the same broad PSA and MRI eligibility criteria. The low-risk stratum comprised 48.8% of the cohort and had a csPCa detection rate of 2.0%, whereas the high-risk stratum comprised 24.4% and included 69.0% of all csPCa cases and 80.0% of Grade Group 4–5 cancers. This concentration of clinically significant disease suggests that the combined assessment may help identify patients who warrant greater attention during pre-biopsy evaluation. Within the NLR–PMR-positive subgroup, CEUS further separated patients with csPCa detection rates of 28.4% and 8.0%, providing additional information when blood-based assessment indicated elevated risk. Previous studies combining MRI and PSAD have similarly emphasized risk-adapted biopsy triage integrating complementary risk information [32]. These findings give the combined phenotype a clinically interpretable role and support evaluating its contribution to individualized biopsy decisions. The low-risk stratum still contained csPCa cases, so the classification requires prospective evaluation before it can guide biopsy deferral. The interaction analyses provided no clear evidence of an interaction, and the observed risk gradient should not be interpreted as evidence of a biological synergistic effect.
Exploratory DCA complemented these findings from a decision-making perspective. DCA uses threshold probabilities to reflect the trade-off between missed diagnoses and unnecessary interventions [24]. Within the evaluated range of 2–30%, the net benefit advantage of M3 over M0 was more consistent at approximately 10–30%; the curves crossed over some lower-threshold intervals. A threshold probability represents the estimated cancer risk at which biopsy would be considered worthwhile. For example, a 10% csPCa threshold means considering biopsy when estimated csPCa risk reaches or exceeds 10%. Lower thresholds place greater emphasis on avoiding missed cancers and favor biopsy in more patients, leaving less opportunity for additional information to change decisions. The observed advantage at approximately 10–30% suggests a potentially more favorable balance between cancer detection and unnecessary biopsies when thresholds in this range are chosen. At csPCa thresholds of 10%, 20%, and 30%, the corrected net benefit differences between M3 and M0 corresponded to net biopsy reduction equivalents of 18.2, 4.4, and 1.6 per 100 patients, respectively. These threshold-weighted estimates illustrate the potential benefit and do not represent observed reductions in biopsy procedures. Threshold selection depends on the outcome of interest, clinical circumstances, and patient preferences. This range describes the comparative advantage observed in this cohort and does not establish recommended biopsy thresholds. The magnitude and clinical importance of net benefit differences require assessment through independent validation and prospective evaluation of actual biopsy decisions [33].
The hematological component uses routine pre-biopsy blood-count data. When CEUS findings are already available, the combined assessment can use existing information without requiring another scan or clinic visit. When CEUS would be an additional examination, patients with unresolved biopsy decisions would be a relevant population for prospective evaluation. The observed subgroup risk separation provides a rationale for examining this focused application. Costs and additional clinic attendance were not assessed in this study. Future comparisons with the current diagnostic pathway should consider biopsy decisions, missed csPCa, additional examinations and visits, and costs.
This study has several limitations. First, the retrospective single-center design may have introduced selection bias. Biopsy was performed following clinical assessment, so the cohort represents patients selected for both CEUS and biopsy within the PSA and MRI criteria. Clinical selection may affect the distribution of cancer risk and the observed detection rates. PPV and NPV depend on disease prevalence; at comparable sensitivity and specificity, higher prevalence generally increases PPV and decreases NPV. Detailed PSA and MRI data were not collected for patients who did not undergo CEUS. Consequently, the total number of otherwise eligible biopsy patients and the proportion receiving CEUS could not be determined. Interpretation in other settings should consider local referral criteria and disease prevalence.
The 60 PCa and 42 csPCa events limit the precision and stability of multivariable estimates and four-group comparisons. Although CEUS positivity remained associated with csPCa after adjustment (OR = 2.26, 95% CI: 1.08–4.91, p = 0.033), the confidence interval is compatible with a broad range of effect sizes. The limited number of csPCa events may contribute to this uncertainty. Marker selection, cutoff determination, and model evaluation were performed in the same cohort. Candidate-marker selection was not repeated during internal validation or DCA correction, leaving the possibility of residual optimism.
Biopsy pathology may be affected by sampling error and grade underestimation. Comparisons with radical prostatectomy specimens have shown that underdetection and grade underestimation may persist even when systematic and targeted biopsy are combined [8]. In our study, suspicious CEUS regions could influence core placement within the 12-core scheme, which may also affect the observed relationship between CEUS and biopsy detection. Reliable information on subsequent radical prostatectomy and postoperative pathology was unavailable; the number undergoing surgery and performance against surgical pathology could therefore not be assessed. The reported outcomes relate to biopsy-detected PCa and csPCa.
CEUS assessment was qualitative, and time–intensity curves or quantitative perfusion parameters were not analyzed. Quantitative analysis could provide additional information on enhancement kinetics. A single complete blood count could not capture temporal changes in inflammatory markers. NLR and PMR are non-specific markers that may be influenced by prostatitis, urinary tract infections, and antibiotic use. Patients with histological chronic inflammation were retained, and clinical infection status at blood sampling and recent antibiotic use were not systematically collected. Consequently, a sensitivity analysis addressing these factors could not be performed, and residual confounding may affect the observed associations and model performance. The extent of this influence cannot be determined from the available data.
Independent external validation was unavailable. Transferability may be influenced by the distribution of PI-RADS scores, csPCa prevalence, patient characteristics, biopsy strategies, and pathological reference standards. Differences in MRI equipment and protocols, CEUS equipment and acquisition techniques, contrast agents, and reader experience may also affect performance. We have planned prospective, multicenter external validation to assess discrimination, calibration, and potential net benefit in patients meeting the original eligibility criteria. Consecutive enrollment and documentation of CEUS use and biopsy referral reasons will be important for assessing selection effects; recalibration may be needed in new settings.

5. Conclusions

In this exploratory single-center cohort of patients with PSA levels of 4–20 ng/mL and PI-RADS scores ≤ 3, NLR–PMR improved discrimination for PCa and csPCa, and CEUS further differentiated csPCa risk among NLR–PMR-positive patients. The combined assessment identified strata with progressively increasing cancer detection rates, providing preliminary evidence for individualized pre-biopsy risk stratification. Its value for guiding biopsy decisions requires prospective, multicenter external validation.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/diagnostics16213680/s1, Supplementary Methods; Table S1: Diagnostic performance of individual inflammatory markers for PCa detection; Table S2: Comparative performance of NLR-based candidate inflammatory models; Table S3: Bootstrap distributions of the optimal cutoff values for NLR and PMR; Table S4: Outcomes stratified by CEUS status among NLR–PMR-positive patients; Table S5: Trends in CEUS and NLR–PMR phenotypes across pathological categories; Table S6: Bootstrap internal validation of the prediction models; Table S7: Association of CEUS with PCa and csPCa in extended multivariable models; Table S8: Interaction between CEUS and the continuous NLR–PMR score; Figure S1: LASSO coefficient profiles of the candidate inflammatory markers; Figure S2: Ten-fold cross-validation for LASSO tuning-parameter selection; Figure S3: Bootstrap distributions of the optimal NLR and PMR cutoff values.

Author Contributions

Conceptualization and methodology, W.Z.; investigation, Z.D., Y.G., J.H., H.Z. and X.B.; data curation, W.Z., Z.D., Y.G., J.H., H.Z. and X.B.; formal analysis, Z.D., Y.G., J.H., H.Z. and X.B.; writing—original draft preparation, W.Z.; writing—review and editing, B.W. and W.C.; supervision, B.W. and W.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Harbin Medical University Cancer Hospital (Approval Code: YD2026-26, Approval Date: 20 October 2026).

Data Availability Statement

The data supporting the findings of this study are not publicly available due to privacy or ethical restrictions. Requests for access to the data should be directed to the corresponding authors.

Acknowledgments

During the preparation of this manuscript, the authors used ChatGPT (GPT-6, OpenAI) to assist with language translation and manuscript revision. The authors reviewed and edited the output and take full responsibility for the content of this publication.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Wei, J.T.; Barocas, D.; Carlsson, S.; Coakley, F.; Eggener, S.; Etzioni, R.; Fine, S.W.; Han, M.; Kim, S.K.; Kirkby, E.; et al. Early Detection of Prostate Cancer: AUA/SUO Guideline Part I: Prostate Cancer Screening. J. Urol. 2023, 210, 46–53, Correction in J. Urol. 2025, 214, 111. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  2. Klotz, L.; Chin, J.; Black, P.C.; Finelli, A.; Anidjar, M.; Bladou, F.; Mercado, A.; Levental, M.; Ghai, S.; Chang, S.D.; et al. Comparison of Multiparametric Magnetic Resonance Imaging-Targeted Biopsy with Systematic Transrectal Ultrasonography Biopsy for Biopsy-Naive Men at Risk for Prostate Cancer: A Phase 3 Randomized Clinical Trial. JAMA Oncol. 2021, 7, 534–542. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  3. Wei, J.T.; Barocas, D.; Carlsson, S.; Coakley, F.; Eggener, S.; Etzioni, R.; Fine, S.W.; Han, M.; Kim, S.K.; Kirkby, E.; et al. Early Detection of Prostate Cancer: AUA/SUO Guideline Part II: Considerations for a Prostate Biopsy. J. Urol. 2023, 210, 54–63. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  4. Drevik, J.; Dalimov, Z.; Uzzo, R.; Danella, J.; Guzzo, T.; Belkoff, L.; Raman, J.; Tomaszewski, J.; Trabulsi, E.; Reese, A.; et al. Utility of PSA density in patients with PI-RADS 3 lesions across a large multi-institutional collaborative. Urol. Oncol. 2022, 40, 490.e1–490.e6. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  5. Sigle, A.; Borkowetz, A.; von Hardenberg, J.; Drerup, M.; Kornienko, K.; Kwe, J.; Wenzel, M.; Mandel, P.; Westhoff, N.; Rieger, C.; et al. Prediction of Significant Prostate Cancer in Equivocal Magnetic Resonance Imaging Lesions: A High-volume International Multicenter Study. Eur. Urol. Focus 2023, 9, 606–613. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  6. Durmaz, S.; Wu, S.J.; Lee, K.L.; Shakur, A.; Caglic, I.; Barrett, T. The effects of prostate volume and PI-RADS category on optimal PSA-density thresholds for biopsy decision-making. Eur. Radiol. 2026, 36, 4503–4512. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  7. Cornford, P.; van den Bergh, R.C.N.; Briers, E.; Chiu, P.; Eberli, D.; Epure, A.; Farolfi, A.; Fonteyne, V.; Gandaglia, G.; Gillessen, S.; et al. EAU-EANM-ESTRO-ESUR-ISUP-SIOG Guidelines on Prostate Cancer—2026 Update. Part I: Screening, Diagnosis, and Local Treatment with Curative Intent. Eur. Urol. 2026, 90, 254–269. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  8. Ahdoot, M.; Wilbur, A.R.; Reese, S.E.; Lebastchi, A.H.; Mehralivand, S.; Gomella, P.T.; Bloom, J.; Gurram, S.; Siddiqui, M.; Pinsky, P.; et al. MRI-Targeted, Systematic, and Combined Biopsy for Prostate Cancer Diagnosis. N. Engl. J. Med. 2020, 382, 917–928. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  9. Liu, Y.; Lu, D.; Xu, G.; Wang, S.; Zhou, B.; Zhang, Y.; Ye, B.; Xiang, L.; Zhang, Y.; Xu, H. Diagnostic accuracy of qualitative and quantitative magnetic resonance imaging-guided contrast-enhanced ultrasound (MRI-guided CEUS) for the detection of prostate cancer: A prospective and multicenter study. Radiol. Medica 2024, 129, 585–597. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  10. Sidhu, P.S.; Cantisani, V.; Dietrich, C.F.; Gilja, O.H.; Saftoiu, A.; Bartels, E.; Bertolotto, M.; Calliada, F.; Clevert, D.-A.; Cosgrove, D.; et al. The EFSUMB Guidelines and Recommendations for the Clinical Practice of Contrast-Enhanced Ultrasound (CEUS) in Non-Hepatic Applications: Update 2017 (Short Version). Ultraschall Med. 2018, 39, 154–180. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  11. Liu, Y.; Wang, S.; Xiang, L.-H.; Xu, G.; Dong, L.; Sun, Y.; Ye, B.; Zhang, Y.; Xu, H. The potential of a nomogram combined PI-RADS v2.1 and contrast-enhanced ultrasound (CEUS) to reduce unnecessary biopsies in prostate cancer diagnostics. Br. J. Radiol. 2022, 95, 20220209. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  12. Liu, G.; Wu, S.; Huang, L. Contrast-enhanced ultrasound evaluation of the prostate before transrectal ultrasound-guided biopsy can improve diagnostic sensitivity: A STARD-compliant article. Medicine 2020, 99, e19946. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  13. Chan, D.Y.; Morris, D.C.; Moavenzadeh, S.R.; Lye, T.H.; Polascik, T.J.; Palmeri, M.L.; Mamou, J.; Nightingale, K.R. Multiparametric Ultrasound Imaging of Prostate Cancer Using Deep Neural Networks. Ultrasound Med. Biol. 2024, 50, 1716–1723. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  14. Chen, P.; Turco, S.; Wang, Y.; Jager, A.; Daures, G.; Wijkstra, H.; Zwart, W.; Huang, P.; Mischi, M. Can 3D Multiparametric Ultrasound Imaging Predict Prostate Biopsy Outcome? Ultrasound Med. Biol. 2024, 50, 1194–1202. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  15. Salciccia, S.; Frisenda, M.; Bevilacqua, G.; Viscuso, P.; Casale, P.; De Berardinis, E.; Di Pierro, G.B.; Cattarino, S.; Giorgino, G.; Rosati, D.; et al. Prognostic role of platelet-to-lymphocyte ratio and neutrophil-to-lymphocyte ratio in patients with non-metastatic and metastatic prostate cancer: A meta-analysis and systematic review. Asian J. Urol. 2024, 11, 191–207. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  16. Nepal, S.P.; Nakasato, T.; Fukagai, T.; Ogawa, Y.; Nakagami, Y.; Shichijo, T.; Morita, J.; Maeda, Y.; Oshinomi, K.; Unoki, T.; et al. Neutrophil-to-lymphocyte and platelet-to-lymphocyte ratios alone or combined with prostate-specific antigen for the diagnosis of prostate cancer and clinically significant prostate cancer. Asian J. Urol. 2023, 10, 158–165. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  17. Sun, J.; Zhang, Z.; OuYang, J. A novel nomogram combined PIRADS v2 and neutrophil-to-lymphocyte ratio to predict the risk of clinically significant prostate cancer in men with PSA < 10 ng/ml at first biopsy. Urol. Oncol. 2020, 38, 401–409. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  18. Zhu, M.; Zhou, Y.; Liu, Z.; Jiang, Z.; Qi, W.; Chen, S.; Wang, W.; Shi, B.; Zhu, Y. Diagnostic Efficiency of Pan-Immune-Inflammation Value to Predict Prostate Cancer in Patients with Prostate-Specific Antigen between 4 and 20 ng/mL. J. Clin. Med. 2023, 12, 820. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  19. Cho, M.C.; Yoo, S.; Choo, M.S.; Son, H.; Jeong, H. Lymphocyte-to-monocyte ratio is a predictor of clinically significant prostate cancer at prostate biopsy. Prostate 2021, 81, 1278–1286. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  20. Turkbey, B.; Rosenkrantz, A.B.; Haider, M.A.; Padhani, A.R.; Villeirs, G.; Macura, K.J.; Tempany, C.M.; Choyke, P.L.; Cornud, F.; Margolis, D.J.; et al. Prostate Imaging Reporting and Data System Version 2.1: 2019 Update of Prostate Imaging Reporting and Data System Version 2. Eur. Urol. 2019, 76, 340–351. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  21. van Leenders, G.J.L.H.; van der Kwast, T.H.; Grignon, D.J.; Evans, A.J.; Kristiansen, G.; Kweldam, C.F.; Litjens, G.; McKenney, J.K.; Melamed, J.; Mottet, N.; et al. The 2019 International Society of Urological Pathology (ISUP) Consensus Conference on Grading of Prostatic Carcinoma. Am. J. Surg. Pathol. 2020, 44, e87–e99. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  22. Friedman, J.; Hastie, T.; Tibshirani, R. Regularization Paths for Generalized Linear Models via Coordinate Descent. J. Stat. Softw. 2010, 33, 1–22. [Google Scholar] [CrossRef] [Scilit]
  23. DeLong, E.R.; DeLong, D.M.; Clarke-Pearson, D.L. Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics 1988, 44, 837–845. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  24. Vickers, A.J.; Elkin, E.B. Decision curve analysis: A novel method for evaluating prediction models. Med. Decis. Mak. 2006, 26, 565–574. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  25. Vickers, A.J.; Cronin, A.M.; Elkin, E.B.; Gonen, M. Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med. Inform. Decis. Mak. 2008, 8, 53. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  26. Heinze, G.; Schemper, M. A solution to the problem of separation in logistic regression. Stat. Med. 2002, 21, 2409–2419. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  27. Grey, A.D.R.; Scott, R.; Shah, B.; Acher, P.; Liyanage, S.; Pavlou, M.; Omar, R.; Chinegwundoh, F.; Patki, P.; Shah, T.T.; et al. Multiparametric ultrasound versus multiparametric MRI to diagnose prostate cancer (CADMUS): A prospective, multicentre, paired-cohort, confirmatory study. Lancet Oncol. 2022, 23, 428–438. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  28. Kayar, R.; Tokuc, E.; Ozsoy, E.; Demir, S.; Kayar, K.; Topaktas, R.; Demir, S.; Ozturk, M. The predictive impact of hematological inflammatory markers in detecting prostate cancer in patients with PI-RADS 3 lesions on multiparametric magnetic resonance imaging. Prostate 2024, 84, 1244–1250. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  29. Eroglu, A.; Gezmis, C.T.; Arikan, Y.; Cilesiz, N.C.; Koras, O.; Emir, B.; Balci, M.B.C.; Keskin, M.Z. Hematological Inflammation Markers in the Prediction of Clinically Significant Prostate Cancer and the Individualization of Biopsy Decisions for PI-RADS 3 Lesions: A Two-Center Retrospective Study. Prostate 2026, 86, 1281–1291. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  30. Gokce, M.I.; Hamidi, N.; Suer, E.; Tangal, S.; Huseynov, A.; Ibiş, A. Evaluation of neutrophil-to-lymphocyte ratio prior to prostate biopsy to predict biopsy histology: Results of 1836 patients. Can. Urol. Assoc. J. 2015, 9, E761–E765. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  31. Loberg, R.D.; Ying, C.; Craig, M.; Yan, L.; Snyder, L.A.; Pienta, K.J. CCL2 as an important mediator of prostate cancer growth in vivo through the regulation of macrophage infiltration. Neoplasia 2007, 9, 556–562. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  32. Rajendran, I.; Lee, K.L.; Thavaraja, L.; Barrett, T. Risk stratification of prostate cancer with MRI and prostate-specific antigen density-based tool for personalized decision making. Br. J. Radiol. 2024, 97, 113–119. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  33. Collins, G.S.; Dhiman, P.; Ma, J.; Schlussel, M.M.; Archer, L.; Van Calster, B.; E Harrell, F.; Martin, G.P.; Moons, K.G.M.; van Smeden, M.; et al. Evaluation of clinical prediction models (part 1): From development to external validation. BMJ 2024, 384, e074819. [Google Scholar] [CrossRef] [Scilit] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.