1. Introduction
The kidney is a vital organ that eliminates metabolic waste, regulates electrolyte balance, and maintains blood pressure homeostasis [
1]. Kidney cancer is one of the most common malignancies worldwide, accounting for approximately 2.4% of all cancer cases, with more than 330,000 new cases and over 170,000 deaths reported annually [
2]. It is a major cause of renal dysfunction and imposes a substantial burden through increased morbidity, long-term treatment costs, and excess mortality [
3]. Early-stage kidney cancer often presents without specific symptoms or reliable serological biomarkers. As a result, many lesions are detected incidentally during imaging examinations performed for unrelated conditions, which frequently delays diagnosis [
4]. Therefore, rapid and accurate segmentation of kidney tumors, together with precise delineation of tumor boundaries, is essential for early detection and individualized treatment planning, thereby helping to limit disease progression and reduce unnecessary radical nephrectomy.
In recent years, AI-driven medical imaging has increasingly supported key clinical tasks, including disease diagnosis, prognosis assessment, and clinical decision-making. In particular, deep learning-based AI methods have made considerable progress in medical image segmentation and have been widely applied to the automated delineation and quantitative analysis of kidney and renal tumor regions [
5,
6]. Through end-to-end optimization, modern neural networks are able to learn discriminative representations directly from large-scale annotated datasets, integrate semantic and structural information across multiple scales, and progressively refine model fitting through data-driven parameter updates [
7]. Consequently, these methods not only improve segmentation accuracy and reduce manual workload, but also simplify the clinical imaging workflow, thereby enhancing both efficiency and inter-observer consistency.
Despite these advances, the automatic segmentation of kidney tumors remains challenging. First, as shown in
Figure 1, substantial inter-patient variability leads to pronounced heterogeneity in tumor size, location, and imaging appearance, making it difficult to learn discriminative features that are both transferable and generalizable. Second, the interface between renal tumors and normal parenchyma often exhibits low contrast or a gradual transition, which hinders precise boundary delineation [
8]. Finally, abdominal CT images present complex, scale-dependent variations in morphology and intensity, further increasing the uncertainty of lesion localization.
Given the challenges discussed above, there is a pressing need for more accurate algorithms to achieve fine-grained segmentation of renal tumors. With the continued development of deep learning in medical image analysis, CNN-based models have become the dominant framework for automatic medical image segmentation, and early representative architectures, such as fully convolutional networks (FCNs) [
9], have substantially advanced the field. However, when fine spatial details are progressively weakened during the encoding of features into high-level semantic representations, the subsequent upsampling process in FCN-style architectures often lacks sufficient localization information, resulting in blurred predictions and poorly defined tumor boundaries.
U-Net [
10] mitigates the loss of spatial details in FCN-style architectures by introducing skip connections that fuse high-level semantic information with low-level spatial cues, and it has become a foundational architecture for medical image segmentation. Building on this framework, subsequent variants of U-Net have mainly improved performance through multi-scale context aggregation [
11], residual feature learning, attention-based and boundary-aware refinement [
12], and stronger supervision, such as hybrid loss functions or multi-task objectives [
13]. These strategies enhance the integration of semantic and structural information and generally produce more accurate predictions in complex scenarios. However, they also suggest that accurate medical image segmentation increasingly relies on the coordinated enhancement of context modeling, feature refinement, and boundary recovery, rather than on simple architectural scaling.
However, CNN-based models are inherently constrained in their ability to capture global contextual information because convolutional receptive fields are local by design and are largely determined by factors such as kernel size. In complex kidney tumor segmentation tasks, these models often fail to fully exploit global semantic and anatomical context, which limits the stability of lesion localization and the precision of boundary delineation.
To address this limitation, researchers have introduced Transformer-based methods [
14], Vision Transformers [
15], and hybrid CNN-Transformer paradigms [
16] that aim to combine the strengths of CNNs in local feature extraction and multi-scale detail modeling with the ability of Vision Transformers to capture global dependencies, model long-range contextual interactions, and learn dynamic feature relationships. A representative example is TransUNet [
17], which adopts a hybrid CNN-Transformer encoder and uses self-attention-based global context modeling to compensate for the limited global representation capacity of CNNs. Swin-Unet [
18] further incorporates hierarchical Transformer modules into a U-Net-like encoder–decoder architecture, thereby enabling effective medical image segmentation. Shen et al. [
19] developed COTRNet, a hybrid segmentation framework in which convolutional blocks and Transformer blocks are alternately arranged to form a fused architecture; in addition, class imbalance is addressed through a composite objective that combines class-weighted cross-entropy loss with weighted Dice loss. Hou et al. [
20] proposed an end-to-end network termed DCCTNet, which employs ResNet34 as the primary branch and Swin Transformer as the auxiliary branch for hybrid feature extraction; moreover, a multi-scale feature pyramid is incorporated into the decoder to strengthen contextual modeling, thereby improving the recognition of kidney and renal tumors. Hu et al. [
21] introduced STC-UNet, which integrates selective kernel mechanisms with Vision Transformers and adopts a hierarchical strategy to promote the coordinated enhancement of local and global information, ultimately improving semantic feature extraction for the segmentation of the kidney and renal tumors. Yuan et al. [
22] constructed a hybrid encoder based on parallel CNN and Swin Transformer streams, resulting in a complementary CNN-Transformer network; furthermore, channel attention is incorporated into the self-attention component of the Transformer to capture dual attention cues.
Recent studies on related tumor segmentation tasks further indicate that robust tumor delineation often benefits from multi-modal information fusion, attention-guided feature refinement, and ensemble-based decision strategies. Mazher et al. [
23] combine deep learning with radiomics by extracting features from multimodal MRI-derived segmentation results and integrating them with clinical information for survival prediction in patients with brain tumors. Akter et al. [
24] develop a CNN- and U-Net-based framework in which segmentation information is used to improve brain tumor classification, highlighting the complementary relationship between segmentation and diagnostic prediction. More recently, Rasool et al. [
25] propose ResMHA-Net, a glioma segmentation framework that combines ResNet and U-Net with multi-head attention and uses multiple MRI modalities, including T1, T1ce, T2, and FLAIR, for tumor delineation. They further integrate radiomic features extracted from predicted masks with clinical variables and build a voting-based ensemble model for survival prediction. These studies suggest that, although their imaging modalities and anatomical targets differ from those of renal tumor segmentation, multi-modal fusion, attention-enhanced feature representation, and ensemble-based prediction are important methodological directions for tumor segmentation and clinically oriented medical image analysis.
Although existing studies have achieved notable progress in the segmentation of the kidney and renal tumors, substantial challenges remain. Inter-patient variability in renal anatomy and tumor presentation often leads to ambiguous boundary delineation and complicates the reliable separation of the kidney from adjacent organs and tissues. Moreover, the complex multi-scale characteristics of tumors in medical images, together with image noise and interference from surrounding tissues, often prevent current methods from extracting truly discriminative lesion features. Consequently, accurate segmentation of renal tumors remains a critical challenge in medical image segmentation, which continues to motivate the development of more precise and robust approaches.
This study aims to develop an end-to-end segmentation method for more accurate renal tumor segmentation based on enhanced multi-scale feature extraction and attention refinement, referred to as MDA-Net. Inspired by TransUNet [
17], the proposed network adopts a hybrid CNN–Transformer backbone. The main contributions of this study are summarized as follows:
This study proposes a novel U-shaped segmentation network for accurate kidney tumor segmentation. To address the limitation of conventional skip connections that rely on simple feature concatenation, the network embeds a customized Multi-Scale Feature Extraction Block (MSFE), which enriches decoder representations with multi-scale detail and texture cues and strengthens multi-scale texture modeling.
This study designs a Deformable Pyramid Feature Refinement (DPFR) Block at the bottleneck, which serially combines deformable convolution for adaptive sampling with an ASPP module, thereby improving the modeling of complex tumor morphologies and enhancing robustness to variations in tumor shape, location, and scale.
This study introduces a Channel and Spatial Attention (CASA) Block into the decoder and applies coordinated channel and spatial attention to refine features during upsampling reconstruction. The CASA module suppresses background noise and amplifies tumor-relevant responses, thereby improving tumor contour recovery and localization accuracy.
The remainder of this paper is organized as follows.
Section 2 describes the dataset and the proposed methodology.
Section 3 presents the datasets and evaluation metrics used to assess model performance and reports the experimental results.
Section 4 discusses the limitations of the proposed model and outlines potential directions for future improvement. Finally,
Section 5 concludes the paper by summarizing the present study.
2. Materials and Methods
2.1. Dataset Description
This study uses two public datasets, KiTS19 [
26] and KiTS21 [
27], for model training and evaluation. The first dataset is KiTS19, which contains abdominal CT scans from 210 patients and provides expert-annotated segmentation labels for the kidney and tumor regions. All images and annotations are provided in NIfTI format. The second dataset is KiTS21, which contains 300 contrast-enhanced abdominal CT scans from patients who underwent partial or radical nephrectomy for suspected kidney malignancy. The definitions of the kidney and tumor regions in KiTS21 are consistent with those in KiTS19.
Raw CT volumes were preprocessed before model training. Following commonly used window-width and window-level settings for abdominal CT images, HU values were clipped to
to increase the contrast between renal tumors and surrounding tissues. The clipped images were then normalized to
to ensure input consistency and improve the stability of model training [
28]. For each patient, axial slices were extracted as the model input [
29]. Each input image was resized to
. Slices without corresponding mask annotations were excluded, and the remaining slices are retained as valid inputs to the network. Before training, data augmentation techniques, including random rotation, horizontal flipping, and vertical flipping, are applied to improve generalization and reduce the risk of overfitting.
The KiTS19 dataset is randomly split at the patient level into the training set, validation set, and independent test set at a ratio of 6:2:2, which include 126, 42, and 42 patients, respectively. The test set is reserved exclusively for final evaluation, while the training and validation sets are used for optimal model selection. The preprocessing procedure for the KiTS21 dataset was consistent with that used for KiTS19, and KiTS21 was employed as an independent dataset to evaluate model generalization.
2.2. Overall Architecture
Figure 2 illustrates the overall architecture of MDA-Net, which comprises a hybrid encoder, skip connections, a bottleneck stage, and a decoder. Unlike conventional variants of U-Net, MDA-Net integrates CNNs and Transformers within the encoder, where the CNN branch extracts fine-grained local texture and structural information, while the Transformer branch uses self-attention to model long-range dependencies and capture global contextual information. The MDA-Net adopts ResNet-50 as the CNN backbone and further incorporates a Vision Transformer encoder based on CNN features to extract global semantic information. The Vision Transformer encoder follows the 12-layer Transformer configuration used in TransUNet, with a patch size of
, 12 attention heads, and a hidden feature dimension of 768.
MDA-Net introduces several targeted architectural refinements. First, a DPFR Block is inserted at the bottleneck between the Vision Transformer encoder and the decoder, which substantially enlarges the effective receptive field without reducing feature resolution, thereby enhancing global discriminability and regional consistency. Second, in the skip connections, the proposed MSFE Block is incorporated to extract and fuse multi-scale features from shallow CNN stages, providing the decoder with rich multi-scale detail and texture information. Finally, the decoder extends the conventional stage-wise U-shaped decoding pathway by embedding CASA Blocks throughout the decoding process, where coordinated channel attention and spatial attention improve detail recovery and semantic representation during resolution reconstruction.
2.3. Multi-Scale Feature Extraction (MSFE) Block
Although skip connections in conventional U-shaped architectures help preserve shallow spatial details, they often lack explicit multi-scale refinement and therefore cannot fully exploit such detailed information. This limitation may prevent the decoder from receiving the spatial and semantic cues required for accurate resolution recovery. To address this limitation, we design a Multi-Scale Feature Extraction Block and embed it into the skip connections between the shallow encoder stages and the decoder, thereby enabling more effective multi-scale feature extraction and providing the decoder with features enriched by edge information and texture details. The architecture of MSFE is illustrated in
Figure 3.
Given an input feature map
, where
denotes the number of channels and
and
represent the height and width, respectively, MSFE employs four dilated convolutions with distinct dilation rates to capture multi-scale features
, thereby obtaining representations under different receptive-field sizes:
where
denotes the number of dilated convolution branches and is set to 4 in this study. The dilation rates of the four branches are set to 1, 2, 4, and 8, respectively, to progressively enlarge the receptive field while preserving fine-grained spatial details. For a
dilated convolution with dilation rate
, the effective kernel size is given by
. Accordingly, the adopted dilation rates correspond to effective receptive fields of
,
, and
. This configuration enables the MSFE block to hierarchically capture local boundary details, neighborhood-level structural continuity, medium-scale tumor morphology, and broader contextual cues. Since MSFE is embedded in the skip connections between the shallow encoder stages and the decoder, excessively large dilation rates may introduce sparse sampling patterns and weaken boundary continuity, particularly for small or low-contrast tumor regions.
After feature extraction from the four branches, the resulting multi-scale features are each passed through global average pooling followed by a
convolution to generate channel-wise attention weights. Next, a sigmoid activation is applied to map these weights into the range of
, and a softmax operation is subsequently used to normalize the weights across branches, thereby emphasizing informative signals. Finally, for each branch, the normalized weight is multiplied by the corresponding multi-scale feature map to obtain the reweighted feature representation. The output feature of the
-th branch, denoted by
, is given as follows:
where
denotes element-wise multiplication. Subsequently, the outputs from all branches are fused through element-wise addition. A residual connection is then introduced by adding the original input feature map to the aggregated reweighted features, followed by an additional
convolution to obtain the final output feature map. By leveraging dilated convolutions with different dilation rates, MSFE captures tumor-related cues at multiple scales and effectively integrates multi-scale representations, thereby enriching spatial information and enhancing semantic expressiveness.
2.4. Deformable Pyramid Feature Refinement (DPFR) Block
Conventional convolutions often perform effectively when segmenting objects with regular shapes because they aggregate features within fixed local windows determined by the kernel size. However, their effectiveness may decline in the segmentation of complex renal tumors, as abdominal CT images exhibit substantial variability in tumor morphology, size, and location. Therefore, to enhance the ability of the model to capture tumors with complex shapes, we introduce the proposed DPFR Block, as illustrated in
Figure 4.
The encoder output feature map produced by the proposed module has dimensions of , where denotes the number of high-dimensional feature channels, and and represent the spatial resolution. This feature map is first processed by a deformable convolution with a kernel and is then fed into several parallel branches for multi-scale feature extraction, ultimately producing a refined feature map with the same spatial dimensions as the input.
Specifically, the parallel branches include three dilated convolution branches with dilation rates of 6, 12, and 18, a convolution branch, and a global average pooling branch followed by upsampling. Together, these branches provide receptive fields of different sizes to capture contextual information at multiple scales. Deformable convolution (DC) introduces additional offsets into the convolution operation to adaptively adjust the sampling locations of standard convolution, thereby expanding the sampling coverage and receptive field in the spatial domain. In this study, these offsets are learned from the kidney tumor segmentation task, which enables the module to better account for variations in tumor shape.
2.5. Channel and Spatial Attention (CASA) Block
In prior studies, the decoders of U-shaped networks commonly use transposed convolution or bilinear interpolation for resolution reconstruction. Although computationally efficient, these operations may cause a mismatch between semantic information and fine-grained details, leading to over-smoothed boundaries, loss of fine structures, and background interference from noisy skip connection features. These limitations can introduce redundant channel responses during decoding and weaken the localization of low-contrast tumors and small lesions.
Channel and spatial attention mechanisms provide an effective way to address these issues by selectively refining features from complementary dimensions. Channel attention emphasizes task-relevant semantic responses and suppresses redundant feature channels, whereas spatial attention highlights lesion-related regions and reduces interference from irrelevant background areas. This refinement is particularly suitable for the decoder, where spatial resolution is progressively restored and pixel-level segmentation masks are reconstructed by integrating high-level semantic features with shallow spatial details. Therefore, attention-guided feature selection during decoding can directly support boundary recovery and tumor localization. The CASA Block [
30] has shown effectiveness in feature refinement in previous segmentation studies; we embed it into the stage-wise reconstruction process of the decoder to enhance tumor-relevant responses while suppressing background interference. The CASA Block combines parallel channel attention and spatial attention to capture contextual features in a more comprehensive manner. Through the coordinated interaction of these two attention mechanisms, CASA enables more precise reconstruction of fine-grained tumor morphology and boundary structures while preserving global semantic consistency, thereby reducing the risk of missed detections and boundary deviations and improving robustness in the presence of small tumors and low-contrast conditions. The architecture of CASA is illustrated in
Figure 5.
The CASA module consists of a feature refinement unit, a channel-attention module, and a spatial-attention module. Given an input feature map , it is first processed by two serial convolutional layers with kernel sizes of and , respectively, each followed by batch normalization and a ReLU activation. The resulting feature map is then fed in parallel into the channel-attention branch and the spatial-attention branch.
In the channel-attention module, global average pooling and global max pooling are first applied to capture salient details and global contextual information. The resulting pooled descriptors are then combined and passed through two fully connected layers arranged in series, with the Swish activation function [
31] used to introduce nonlinearity and preserve smooth gradients. The reduction ratio is set to 16. Specifically, a sigmoid function is applied after the second fully connected layer to generate attention weights, thereby emphasizing the channels that are most relevant to the target task. The output of CAM can be expressed as follows:
where
denotes the sigmoid activation function,
denotes matrix multiplication, and
represents the feature map refined by the feature refinement module.
In the spatial-attention module, the input feature map is processed by average pooling (MP), max pooling (
), min pooling (
), and sum pooling (SP). The resulting descriptors are then concatenated and fed into a
convolution layer for further feature refinement. Finally, Swish and sigmoid activations are applied to emphasize informative spatial patterns and generate attention weights. The output of SAM can be expressed as follows:
Here,
and
denote the original feature map fed into SAM and the pooled feature descriptor obtained after concatenation, respectively.
and
denote the
and
convolution operations, respectively. The final output of the CASA module is formulated as
where ConvBlock denotes a feature refinement unit composed of a convolutional layer, batch normalization, and a ReLU activation function.
2.6. Loss Function
This study adopts a hybrid loss function that combines binary cross-entropy loss with Dice loss [
32,
33,
34]. Class imbalance is common in medical imaging, and reliance on binary cross-entropy loss alone may bias the training process toward the majority class, causing minority regions to be overlooked. In contrast, the Dice similarity coefficient effectively alleviates this issue and can also help reduce overfitting. The Dice loss is defined as follows:
where
denotes the number of overlapping foreground pixels between the predicted segmentation map and the ground-truth label, and
and
denote the numbers of foreground pixels in the prediction and the ground truth (GT), respectively. The binary cross-entropy loss used in this study is defined as follows:
where
denotes the total number of pixels in an image,
denotes the ground-truth label of the
-th pixel, and
denotes the model prediction for the
-th pixel. The final loss function of MDA-Net is defined as follows:
where
and
are hyperparameters that control the relative contributions of the Dice loss and the BCE loss, respectively. Based on extensive empirical experiments, we found that the model achieves its best segmentation performance when
and
.
3. Results
This section presents the evaluation protocol, implementation details of MDA-Net, and the corresponding visualization results.
3.1. Experimental Setup
All models in the comparative experiments were trained under identical hyperparameter and implementation settings to ensure a fair evaluation. Specifically, all experiments were conducted using Python 3.10 on an Intel(R) Xeon(R) Gold 6226R CPU @ 2.90 GHz and an NVIDIA RTX A6000 48 GB GPU. Adam was used as the optimizer, and the training objective combined BCE loss and Dice loss. The initial learning rate was set to , the weight decay coefficient was set to , the batch size was set to 8, and each model was trained for 100 epochs. Early stopping was triggered when the validation loss did not improve for 10 consecutive epochs, which prevented unnecessary computation and reduced the risk of overfitting. For each model, the optimal checkpoint was selected based on the validation set performance, and the final performance was reported on the test set.
3.2. Evaluation Metrics
To comprehensively evaluate the segmentation performance of the proposed MDA-Net, we adopt four metrics: Dice coefficient, Intersection over Union (IoU), Recall, and Precision. The Dice coefficient quantifies the overlap agreement between the predicted segmentation and the ground-truth annotation, and is computed as follows:
where TP, FP, and FN denote the numbers of true positives, false positives, and false negatives, respectively. In the kidney tumor segmentation task, tumor pixels are treated as the positive class, whereas all non-tumor pixels are regarded as the negative class.
IoU quantifies the ratio between the intersection and the union of the predicted region and the ground-truth region, providing a more stringent measure of spatial agreement and region-level matching accuracy. It is computed as follows:
Recall measures the proportion of ground-truth positive samples that are correctly predicted as positive, thereby characterizing the model’s detection sensitivity and its tendency to miss target regions. It is computed as follows:
Precision is defined as the proportion of predicted positive samples that are truly positive, reflecting the reliability of positive predictions and the extent of false alarms. It is computed as follows:
Collectively, these four metrics provide a comprehensive assessment of segmentation quality: higher values indicate closer agreement between the predicted masks and the GT, with greater spatial overlap and, consequently, more accurate delineation.
3.3. Ablation Experiments
Kidney tumor segmentation remains a highly challenging task. To evaluate the segmentation performance of MDA-Net, we conduct ablation studies to quantify the individual and combined effects of MSFE, DPFR, and CASA on the overall segmentation performance.
Section 3.3.1 presents the ablation results of the proposed model on the KiTS19 dataset, and
Section 3.3.2 reports the sensitivity analysis of the loss-function parameters on the same dataset. To ensure statistical robustness and reduce the influence of random variation during training, each experiment is independently repeated five times. The results are reported as the mean
standard deviation across these repeated runs.
3.3.1. Ablation Experiment on Model Components
Table 1 presents the ablation results on the KiTS19 dataset. As shown, the introduction of these components consistently improves performance across all evaluation metrics. Starting from the baseline results of 0.7698 Precision, 0.7895 Recall, 0.7789, and 0.6929, the addition of MSFE yields improvements of 0.0488, 0.0329, 0.0268, and 0.0449 in Precision, Recall, Dice, and IoU, respectively. This improvement is primarily attributed to the MSFE block, which enhances multi-scale feature fusion within skip connections and effectively supplements shallow texture cues and boundary details.
Building on this configuration, the incorporation of the DPFR block further improves Precision, Recall, and Dice by 0.19%, 0.43%, and 0.69%, respectively. By combining deformable sampling with pyramid-based contextual refinement, DPFR enlarges the effective receptive field and strengthens the internal representation of encoder features. In the final stage, the integration of CASA introduces coordinated channel attention and spatial attention into the decoder, thereby suppressing redundant background responses while enhancing lesion-relevant regions. As a result, both false positives and false negatives are reduced, and the overlap between predicted masks and ground truth is further improved. Overall, the complete MDA-Net outperforms the baseline by 6.81%, 5.43%, 5.36%, and 5.60% percentage points in Precision, Recall, Dice, and IoU, respectively. These results confirm the effectiveness of the three modules and indicate a clear synergistic effect. By capturing complementary cues from multi-scale context and discriminative feature channels, the proposed design improves both segmentation accuracy and robustness.
Table 2 further presents the ablation results of the DPFR Block. Compared with the baseline TransUNet, the use of deformable convolution alone improves Precision, Recall, Dice, and IoU from 0.7698, 0.7895, 0.7789, and 0.6929 to 0.7812, 0.7946, 0.7861, and 0.7018, respectively. This improvement indicates that deformable convolution enhances the ability of the model to adapt to irregular tumor morphology and local structural variations. Similarly, the use of ASPP alone also improves all evaluation metrics, with Dice and IoU reaching 0.7874 and 0.7031, respectively, suggesting that multi-scale contextual aggregation contributes to more effective representation of tumor regions. When deformable convolution and ASPP are further integrated into the proposed DPFR Block, the model achieves the best overall performance, with Precision, Recall, Dice, and IoU reaching 0.8016, 0.8073, 0.8042, and 0.7258, respectively. These results demonstrate that the DPFR Block effectively combines local deformation modeling and multi-scale context perception, thereby improving the segmentation of tumor boundaries, morphological variations, and low-contrast regions.
3.3.2. Sensitivity Analysis of Loss Function Parameters
To analyze the influence of BCE and Dice loss weights on segmentation performance, this study compares three representative weighting configurations. These configurations correspond to BCE-dominant weighting, balanced weighting, and Dice-dominant weighting, respectively. For each setting, MDA-Net is trained and tested under the same experimental configuration.
Table 3 reports the experimental results obtained under different weight-parameter settings. The results show that the setting
and
achieves the best and most balanced performance in terms of Dice and IoU. This result suggests that assigning a relatively higher weight to BCE loss provides more stable pixel-level supervision, which helps improve the discrimination between tumor and non-tumor pixels. Meanwhile, the Dice loss term still contributes to optimizing the overlap between the predicted mask and the ground-truth annotation, which is important for handling the foreground–background imbalance in kidney tumor segmentation. Therefore, the setting
and
achieves a better balance between pixel-level classification accuracy and region-level overlap consistency, and is adopted in the final loss function.
3.4. Comparison of the Latest Networks
To further validate the effectiveness and practicality of MDA-Net for kidney tumor segmentation, we compare it with several representative segmentation methods, including U-Net [
10], U-Net++ [
35], DeepLabv3+ [
36], PIDNet-L [
37], Swin-Unet [
18], Spider-Net [
38], CMUNeXt [
39], and UCTransNet [
40]. These baselines span classic CNN encoder–decoder designs, multi-scale context modeling, boundary-aware parsing, and Transformer-based U-shaped architectures. U-Net introduces skip connections to fuse semantic and spatial cues, whereas U-Net++ strengthens feature fusion through nested and dense skip pathways. DeepLabv3+ combines atrous spatial pyramid pooling with an encoder–decoder design and atrous separable convolution to capture multi-scale contextual information and refine object boundaries. PIDNet-L adopts a three-branch architecture that parses detail, context, and boundary information, and uses boundary attention to guide the fusion of detail and context features. Swin-Unet constructs a U-shaped encoder–decoder architecture based on hierarchical Swin Transformer blocks with shifted-window self-attention, thereby enabling long-range dependency modeling within a pure Transformer framework. Spider-Net employs a high-resolution multi-scale attention encoder together with a full-attention decoder for tumor segmentation. UCTransNet revisits the original skip connections of U-Net from a channel-wise perspective. It uses the CTrans module, which consists of Channel-wise Cross Fusion Transformer and Channel-wise Cross Attention, to reduce the semantic gap between encoder and decoder features. CMUNeXt designs a lightweight fully convolutional U-shaped segmentation network. It uses large-kernel depthwise convolution and inverted bottleneck structures to capture global contextual information, and introduces a Skip-Fusion block to enable efficient feature fusion between encoder and decoder representations.
Through comparison with these established methods, the performance and potential of MDA-Net for kidney tumor segmentation are further evaluated, and the results provide practical insights for both research and clinical application in this field.
All models are evaluated on the KiTS19 dataset, and performance is assessed using four metrics: Dice coefficient, Intersection over Union (IoU), Precision, and Recall. To ensure statistical robustness and reduce the influence of random variation during training, each experiment is independently repeated five times. The results are reported as the mean
standard deviation across these repeated runs. The quantitative results are summarized in
Table 4.
The quantitative comparison results for kidney tumor segmentation on the KiTS19 dataset show that MDA-Net achieves competitive and relatively balanced performance across the four evaluation metrics, reaching 83.79% Precision, 84.38% Recall, 83.25% Dice, and 74.89% IoU. It ranks first in Precision, Dice, and IoU, while achieving near-best Recall, which indicates improved overlap quality without compromising sensitivity to tumor regions.
Compared with the baseline TransUNet, MDA-Net improves Precision by 6.81% and Recall by 5.43%, while Dice and IoU increase by 5.36% and 5.60%, respectively. Beyond the baseline comparison, MDA-Net shows modest gains over several strong competing methods in specific metrics. Relative to PIDNet-L, which ranks second in both Precision and IoU, MDA-Net further improves Precision by 1.04% and IoU by 0.36%. Relative to Swin-Unet, which achieves the second-highest Dice score, MDA-Net improves Dice by 0.73%. Notably, although DeepLabv3+ attains the highest Recall of 84.42%, MDA-Net achieves a comparable Recall of 84.38% together with a substantially higher Precision of 83.79%, compared with 80.19% for DeepLabv3+, which suggests fewer false positives at a nearly equivalent detection level. Compared with CMUNeXt, MDA-Net achieves improvements of 7.36, 2.91, 6.60, and 5.24 percentage points in Precision, Recall, Dice, and IoU, respectively. Although CMUNeXt employs large-kernel depthwise convolution and skip-fusion operations to enhance contextual representation within a lightweight fully convolutional framework, its segmentation performance remains limited in this task, especially in Precision, Dice, and IoU. This result suggests that lightweight convolutional feature fusion alone may be insufficient to capture the complex boundary variations and heterogeneous tumor appearances associated with renal tumor segmentation. Compared with UCTransNet, MDA-Net also achieves consistent gains across all evaluation metrics, with improvements of 5.46, 3.30, 5.44, and 4.62 percentage points in Precision, Recall, Dice, and IoU, respectively. UCTransNet refines skip connections from a channel-wise Transformer perspective and reduces the semantic gap between encoder and decoder features. However, its relatively lower Dice and IoU indicate that channel-wise feature interaction alone may not be sufficient to address multi-scale tumor morphology and boundary ambiguity. In contrast, MDA-Net integrates multi-scale feature enhancement, deformable pyramid refinement, and coordinated channel–spatial attention, thereby enabling more accurate lesion localization and mask reconstruction.
Figure 6 presents representative segmentation examples produced by MDA-Net, the baseline model, and eight competing methods on the KiTS19 dataset. Owing to variations in tumor size and morphology, indistinct boundaries, and interference from adjacent tissues, different models exhibit distinct segmentation behaviors. U-Net and U-Net++ often produce incomplete masks with coarse contours, indicating limited boundary recovery. TransUNet and Swin-Unet tend to generate over-smoothed predictions and may show local mis-segmentation when tumor boundaries are ambiguous. DeepLabv3+, PIDNet-L, Spider-Net, CMUNeXt, and UCTransNet produce relatively continuous masks in some cases, but they still suffer from boundary deviations, under-segmentation, or inaccurate recovery of small and irregular lesions. In contrast, MDA-Net delineates tumor boundaries more precisely and remains stable under complex shapes and scale variations. By jointly capturing local details and global context with attention-guided feature refinement, MDA-Net improves discrimination in regions with uncertain boundaries and produces segmentation results that are more consistent with the ground-truth annotations.
Table 5 presents the independent evaluation results of different models on the KiTS21 dataset. Compared with the evaluation on KiTS19, this experiment provides a more direct assessment of the generalization performance of each model in an external test setting. As shown in
Table 5, MDA-Net achieves the best overall performance across all four evaluation metrics, with 78.51% Precision, 81.40% Recall, 78.83% Dice, and 70.87% IoU. These results indicate that the proposed method maintains stable segmentation performance on an independent dataset.
Compared with the strongest competing methods, MDA-Net also shows consistent advantages. Specifically, MDA-Net improves Precision by 1.20 percentage points over Spider-Net, which obtains the second-best Precision. It improves Recall by 1.59 percentage points over PIDNet-L, which achieves the second-best Recall. For Dice and IoU, MDA-Net outperforms PIDNet-L by 1.91 and 1.54 percentage points, respectively. These results suggest that MDA-Net improves tumor-region sensitivity while enhancing region-level overlap consistency. In addition, compared with TransUNet, MDA-Net achieves improvements of 5.22, 8.34, 8.46, and 8.92 percentage points in Precision, Recall, Dice, and IoU, respectively. This further demonstrates the effectiveness of the proposed multi-scale feature enhancement, deformable pyramid refinement, and channel–spatial attention modules.
Overall, the independent evaluation results on KiTS21 show that MDA-Net achieves better generalization than the compared methods and provides more accurate tumor localization and mask reconstruction in cross-dataset evaluation.
Figure 7 presents representative segmentation examples from different models on the KiTS21 dataset. Compared with KiTS19, KiTS21 provides an independent evaluation setting and includes tumors with diverse sizes, irregular shapes, and ambiguous boundaries, further increasing the difficulty of accurate segmentation. Visually, U-Net and TransUNet tend to produce incomplete masks and frequently miss substantial tumor regions, especially when lesion boundaries are unclear or tumor morphology is complex. U-Net++, CMUNeXt, and UCTransNet can capture parts of tumor regions, but their predictions often exhibit under-segmentation and fail to recover the full tumor extent. DeepLabv3+, PIDNet-L, Swin-Unet, and Spider-Net generate relatively continuous masks in some cases, but they still suffer from boundary deviations, over-smoothed contours, or small false-positive regions. In contrast, MDA-Net produces segmentation masks that are more consistent with the ground-truth annotations in most examples. The predicted regions preserve more complete tumor structures and show better agreement with irregular lesion boundaries. These qualitative results further support the robustness and generalization ability of MDA-Net in cross-dataset evaluation.
3.5. Grad-CAM Based Interpretability Analysis
We further employ Grad-CAM as an interpretability technique to visualize the activations of the final convolutional layer in the proposed model. This technique highlights the image regions that make stronger contributions to model prediction, thereby providing visual evidence for understanding the decision basis of the model and improving model transparency [
41,
42,
43]. To strengthen the interpretability analysis beyond qualitative visualization, we further conduct a quantitative experiment to measure the spatial agreement between the Grad-CAM attention maps and the ground-truth tumor masks in the KiTS19 test set. Specifically, each Grad-CAM heatmap is first resized to the same spatial resolution as the corresponding tumor mask and normalized to the range of
. The normalized heatmap is then binarized using a threshold of 0.5, and the Intersection over Union is computed between the binarized attention map and the corresponding ground-truth tumor mask. Across three random-sampling validation runs with a sampling rate of 0.3, the mean IoU is 0.5857, with a standard deviation of 0.0026. This metric provides a quantitative measure of whether the regions attended to by the model are spatially consistent with the clinically relevant tumor regions. In addition, three cases are randomly selected from the test set for qualitative visualization, where the Grad-CAM heatmaps are presented together with the input images and tumor masks to provide an intuitive interpretation of model behavior.
Figure 8 presents Grad-CAM heatmaps, GT, and the corresponding predicted masks of MDA-Net on representative KiTS19 cases. In each example, the heatmap visualizes the image regions that contribute most strongly to the segmentation decision, where warmer colors indicate higher relevance. GT denotes the tumor regions manually annotated by clinical experts. Overall, the predicted masks closely match the GT in both extent and shape. Meanwhile, Grad-CAM activations are concentrated on tumor regions and areas adjacent to tumor boundaries, with limited responses in irrelevant background tissues. These qualitative results indicate that the predictions of MDA-Net are primarily driven by tumor-related cues. They also suggest that the proposed components improve the overall ability of the model to extract tumor-relevant information and to attend to features associated with tumor boundaries and salient regions in medical images.
3.6. Computational Efficiency Comparison
In the complexity analysis experiments, this study evaluates key efficiency indicators, including inference efficiency, parameter count, and floating-point operations (FLOPs). Inference efficiency is defined as the average time required for each model to generate predictions on the target dataset. Parameter count reflects the total number of learnable parameters in the model. FLOPs are computed using an input tensor size of to characterize the computational cost of a single forward pass. The KiTS21 dataset is used for evaluation, and all experiments are conducted under identical hardware settings to ensure fair and reliable comparisons.
As shown in
Table 6, CMUNeXt has the lowest computational cost, with 59.34 G FLOPs, and the smallest parameter count, with 3.15 M parameters. PIDNet-L achieves the fastest inference speed, with an inference time of 1.82 ms. UCTransNet has the highest FLOPs among the compared methods, requiring 344.02 G FLOPs and 158.27 ms for inference. The proposed MDA-Net requires 328.06 G FLOPs and contains 113.03 M parameters, reflecting the additional computational cost introduced by the multi-scale feature enhancement, deformable pyramid refinement, and channel–spatial attention modules. Although MDA-Net is not the lightest model, it achieves an inference time of 31.21 ms, which is faster than those of TransUNet, Spider-Net, and UCTransNet by 12.02 ms, 56.77 ms, and 127.06 ms, respectively. Compared with Transformer-based and attention-enhanced models, these results indicate that MDA-Net maintains acceptable inference efficiency while improving segmentation accuracy. Therefore, the proposed model achieves a reasonable trade-off between computational complexity and segmentation performance.
4. Discussion
Experimental results on the KiTS19 and KiTS21 dataset support the effectiveness of MDA-Net for kidney tumor segmentation and show competitive performance compared with existing methods. By integrating a hybrid encoder with the multi-scale feature enhancement (MSFE) Block, MDA-Net is able to capture fine-grained texture cues and multi-scale contextual information, which is essential for separating low-contrast tumors from surrounding tissues. The deformable pyramid feature refinement (DPFR) Block further strengthens the ability of the model to accommodate tumors with varying shapes and sizes while preserving high-resolution representations, making the network particularly effective for lesions with irregular boundaries or pronounced intensity variation. In the decoder, the channel-and-spatial attention (CASA) Block refines boundary delineation and suppresses background interference, thereby enabling the network to focus more precisely on tumor regions. Compared with the baseline model, MDA-Net shows improved segmentation performance for tumors with irregular shapes, small volumes, or low contrast. Compared with strong competing methods, the numerical gains are modest, indicating that further validation is needed to determine whether these improvements translate into clinically meaningful benefits. These findings highlight the importance of multi-scale feature integration and attention-guided refinement in medical image segmentation, where accurate boundary detection and reliable tumor localization are of critical importance. Moreover, Grad-CAM-based interpretability analysis improves clinical transparency by highlighting tumor-relevant regions and providing insights into the decision-making process of the model.
Despite its strong performance, MDA-Net still has several limitations. First, the inference efficiency of the model may be insufficient to satisfy real-time clinical requirements, particularly for high-resolution CT scans. Second, dependence on large-scale fully annotated datasets raises concerns about training scalability and annotation cost. In addition, the generalization ability of MDA-Net across other imaging modalities, such as PET and MRI, has not been thoroughly evaluated, which may limit its applicability in multimodal clinical settings. Addressing these issues is essential for translating MDA-Net from a research prototype into broader clinical practice. In this regard, the exploration of lightweight variants through model pruning or knowledge distillation may improve deployment feasibility in time-sensitive clinical workflows.
5. Conclusions
This paper proposes MDA-Net, an end-to-end network for kidney tumor segmentation based on enhanced multi-scale feature extraction and attention-guided refinement. The proposed framework integrates the MSFE, DPFR, and CASA modules to improve multi-scale contextual modeling, adapt to irregular tumor morphology, and refine tumor-relevant features during decoder reconstruction. By combining these complementary components, MDA-Net enhances fine-grained boundary delineation, lesion localization, and mask reconstruction for renal tumor segmentation.
Extensive experiments on the KiTS19 dataset demonstrate that MDA-Net achieves competitive segmentation performance compared with representative CNN-based, Transformer-based, and attention-enhanced segmentation networks. Independent evaluation on the KiTS21 dataset further shows that the proposed method maintains stable performance under cross-dataset testing, indicating improved robustness and generalizability. Ablation experiments confirm the individual and complementary contributions of MSFE, DPFR, and CASA, while Grad-CAM-based visualization provides additional evidence that the model focuses on tumor-related regions and boundary-sensitive structures. Computational efficiency analysis also shows that, although MDA-Net introduces additional computational cost, it maintains acceptable inference speed compared with several Transformer-based and attention-enhanced methods.
Despite these advantages, MDA-Net still has several limitations. The relatively large parameter count and computational cost of the model may restrict its deployment in real-time or resource-constrained clinical scenarios. In addition, the current validation is limited to CT-based kidney tumor segmentation, and the applicability of the method to other imaging modalities or multi-center clinical data requires further investigation. Future work will focus on developing lightweight variants through model compression, pruning, or knowledge distillation, extending validation to larger and more diverse datasets, and exploring multimodal integration to further improve clinical applicability and generalization.