1. Introduction
The rapid expansion of the global aviation industry has resulted in unprecedented operational demands, with commercial aero-engine operating under increasingly challenging conditions. Because aero-engines operate in extreme environments characterized by high temperature, high stress, and high rotational speed and are simultaneously subjected to combined working and vibrational loads, such harsh conditions can significantly increase component defects and make the engine more prone to failure [
1,
2]. Among the various degradation mechanisms affecting engine components, ablation—the progressive erosion of surface material due to extreme thermal, chemical, and mechanical stresses—poses a significant threat to engine integrity and operational safety. The detection and quantification of ablation damage are essential for predictive maintenance strategies [
3,
4], yet current inspection methods face substantial limitations in accuracy, efficiency, and consistency.
Traditional aero-engine inspection relies predominantly on manual visual examination supplemented by non-destructive testing (NDT) techniques, including borescope inspection, fluorescent penetrant inspection (FPI), and eddy current testing [
5,
6,
7]. While these methods have served the aviation industry for decades, they suffer from several inherent limitations. Although manual visual inspection is the most widely used method, there are still many problems, such as strong subjectivity, large errors, and low efficiency. Applying deep learning technology to the image processing of aero-engine borescope inspection enables it to detect and assist in diagnosing ablation conditions through edge devices, improving the detection efficiency and accuracy and reducing the flight safety risks.
Recently, data-driven approaches utilizing deep learning have demonstrated remarkable success in various industrial inspection applications, offering the potential to augment human expertise with automated, objective, and traceable defect detection capabilities [
8]. In particular, semantic segmentation algorithms based on convolutional neural networks (CNNs) have shown promise in pixel-level defect recognition and achieved impressive results on industrial datasets. However, their application to aero-engine ablation detection poses unique challenges that are difficult to address with existing architectures. The computational complexity of state-of-the-art models, particularly transformer-based architectures with quadratic complexity O(N
2), renders them impractical for real-time deployment on high-resolution engine surface images [
9]. Industrial standards and prior studies indicate that boundary-level segmentation is essential in aero-engine borescope maintenance, as assessments such as ablation severity classification, remaining-material estimation, and repair-level decision-making all rely directly on the precise contour of the damaged region. This requirement is reflected in both regulatory maintenance guidelines and recent automated borescope research, which emphasize accurate defect boundaries as a prerequisite for reliable inspection and safety evaluation [
10,
11]. See
Table 1 for a comparison of methods and industrial requirements.
In order to improve the accuracy of the ablation boundary segmentation, it is first necessary to enhance the feature extraction ability of the model, especially the ability to handle boundaries and computational complexity. Secondly, it is about context dependence. In some tasks with a lot of noise, this kind of dependence will reduce the robustness of the model. To cope with these difficulties, we propose a novel VSS-ResNet network, which is a dual-path semantic segmentation architecture that synergistically integrates Mamba, ResNet to achieve accurate and efficient aero-engine ablation detection. The proposed approach exploits the complementary strengths of Mamba and CNN to enhance boundary segmentation accuracy in ablation imagery. Our approach features a parallel processing design: the left path integrates VSS blocks to capture long-range dependencies with linear computational complexity, while the right path employs standard ResNet50 blocks to extract hierarchical convolutional features. This dual-path strategy enables the network to simultaneously leverage the complementary strengths of both architectures—the global context modeling capability of VSS with O(N) complexity and the proven local feature extraction power of CNNs. The features from both paths are progressively fused at multiple scales through specialized fusion modules, creating rich multi-scale representations specifically tailored for ablation detection. The main contributions of this paper are summarized as follows:
- (1)
We propose VSS-ResNet, a novel dual-path architecture that processes images through parallel branches—a VSSB path for efficient global context modeling and a Res-Net path for hierarchical feature extraction—with multi-scale feature fusion to achieve superior ablation detection performance.
- (2)
We introduce an innovative integration of VSS blocks in the left path, creating a powerful feature extraction pipeline that combines linear-complexity long-range dependency modeling with adaptive channel-wise feature recalibration, specifically optimized for capturing ablation characteristics.
- (3)
An adaptive multi-scale feature fusion mechanism is designed to integrate features from both pathways at different abstraction levels. The fusion strategy incorporates spatial alignment through bilinear interpolation and channel dimension adaptation via 1 × 1 convolutions, ensuring seamless information integration between auxiliary (256 + 1024→1024) and main (512 + 2048→2048) feature outputs while preserving fi-ne-grained spatial details.
The remainder of this paper is organized as follows: In
Section 2, we review related works on sematic segmentation, industrial defect detection, stated space models, and mamba, with a focus on aerospace applications. In
Section 3, we present the VSS-ResNet dual-path architecture, detailing the network design, mathematical formulations, and feature fusion strategy.
Section 4 describes the experimental setup, including dataset characteristics, preprocessing, training strategies, and evaluation metrics. And, the results and ablation studies are demonstrated and discussed. Finally,
Section 5 concludes the paper and outlines directions for future work.
4. Experiments
This section evaluates the performance of our proposed method on the aero-engine ablation detection task. All experiments were conducted on NVIDIA GeForce RTX 3090 24 GB with Python 3.10, PyTorch 2.0, and CUDA 12.3. The operating system was Ubuntu 24.04.1. During training, the Adam optimizer was employed with an initial learning rate of 0.0005, input image size of 512 × 512, and batch size of 8. To ensure fairness, the dual-pathway model was trained for 150 epochs, and ResNet50 was also trained for 150 epochs with early stopping. Additionally, various data augmentation techniques were applied during the training phase to further enhance model robustness, including flipping, rotation and cropping, random noise addition, and histogram equalization methods, which further prevent overfitting phenomena.
4.1. Dataset Description
This study uses borescope-acquired inspection data from a specific aero-engine model as the research subject. The raw videos contain a large number of visually redundant frames due to slow camera motion and the narrow internal structure of the engine. To address this issue, a redundancy-removal pipeline was implemented to ensure that the dataset consists of non-duplicated and morphologically diverse samples, as shown in
Figure 7.
First, uniform temporal sampling was applied to reduce near-identical consecutive frames. Then, motion-based filtering using inter-frame pixel differences and structural similarity (SSIM) was performed to automatically remove frames with minimal morphological variation. Finally, two trained inspectors manually reviewed the remaining samples to ensure that each retained image exhibited distinct ablation characteristics, such as variations in surface topology, ablation depth, texture distribution, and boundary sharpness. After this filtering process, a total of 874 representative images were collected for model training and evaluation. To increase data diversity, these images were further augmented during training through rotation, cropping, and flipping, thereby enhancing the model’s generalization capability, as shown in
Figure 8 and
Figure 9.
To enhance statistical reliability, all experiments were conducted using five independent random 80/20 train–test splits, and the results were reported as the mean ± standard deviation across the five runs, as shown in
Table 3.
Because borescope illumination is limited inside the engine, the collected images generally exhibit low brightness. To improve visual clarity and enhance feature learning for the segmentation model, histogram equalization was applied to the entire dataset. This preprocessing step improves contrast and highlights ablation boundaries without altering structural information.
4.2. Evaluation Metrics
We quantitatively evaluated the semantic segmentation performance using three commonly adopted metrics: mean Intersection over Union (mIoU), mean Pixel Accuracy (mPA), and Overall Accuracy (Acc). Here, TPi denotes the number of pixels predicted as class i that indeed belong to class I (True Positive); FPi denotes the number of pixels predicted as class I but actually belonging to other classes (False Positive); FNi represents the number of pixels that truly belong to class i but are incorrectly predicted as non–class I (False Negative); N denotes the total number of classes; pii corresponds to the number of correctly classified pixels (diagonal entries of the confusion matrix); and pii represents the total number of pixels whose ground truth class is i.
Since our task focuses on ablation versus non-ablation segmentation, it is a binary classification problem with
N = 2. Accordingly, the index
i = 1 is used for the ablation class, and we maintain consistent notation throughout the manuscript.
The standard cross-entropy loss [
33] is employed as the loss function for the segmentation task, which is defined as follows:
Furthermore, in the engine ablation segmentation task, most ablation regions occupy a relatively small proportion of the entire image. Therefore, Dice loss [
34], which is more sensitive to imbalanced data, is introduced to focus more on the excavation of ablation regions. The definition of Dice is as follows:
where
X and
Y represent the prediction results and ground truth, respectively.
4.3. Comparison Methods
On our engine ablation dataset, the proposed dual-pathway network architecture was compared with advanced segmentation methods including FCN [
20], U-Net [
31], PSPNet [
21], DeepLabV3+ [
35], SegFormer [
15], and HRNet [
36]. To intuitively demonstrate the proposed method, as shown in
Table 4. The calculation formulas for the missed-ablation rate (MAR) and false-alarm rate (FAR) are shown in Equations (10) and (11), respectively.
Table 3.
Performance comparison across five independent random 80/20 train–test splits. Results are reported in terms of mIoU, mPA, and Acc (%).
Table 3.
Performance comparison across five independent random 80/20 train–test splits. Results are reported in terms of mIoU, mPA, and Acc (%).
| Split Index | mIoU% | mPA% | Acc% | Background | Ablation | MAR% | FAR% |
|---|
| Split 1 | 81.12 | 86.95 | 97.80 | 88.74 | 73.50 | 6.78 | 3.15 |
| Split 2 | 81.95 | 87.40 | 98.05 | 89.80 | 74.10 | 6.62 | 3.08 |
| Split 3 | 81.60 | 87.10 | 97.70 | 90.00 | 73.20 | 6.85 | 3.20 |
| Split 4 | 82.20 | 87.80 | 98.10 | 89.50 | 74.90 | 6.42 | 3.05 |
| Split 5 | 81.68 | 87.35 | 98.10 | 89.36 | 74.00 | 6.65 | 3.12 |
| Mean ± Std | 81.71 ± 0.41 | 87.32 ± 0.33 | 97.95 ± 0.22 | 89.48 ± 0.48 | 73.94 ± 0.65 | 6.66 ± 0.16 | 3.12 ± 0.06 |
Table 4.
The comparison results of mIoU, mPA and Acc across different semantic segmentation models.
Table 4.
The comparison results of mIoU, mPA and Acc across different semantic segmentation models.
| Method | mIoU% | mPA% | Acc% |
|---|
| FCN | 67.78 | 73.69 | 94.42 |
| U-Net | 79.36 | 85.9 | 96.46 |
| PSPNet | 76.85 | 84.78 | 95.85 |
| DeepLabV3+ | 75.21 | 82.93 | 95.55 |
| SegFormer | 79.30 | 85.42 | 96.49 |
| HRNet | 80.05 | 85.62 | 96.67 |
| Ours | 81.71 | 87.32 | 97.95 |
The quantitative results clearly demonstrate that our method achieves the highest accuracy in terms of mIoU, mPA, and Acc, reaching 81.42%, 87.45%, and 97.87%, respectively. Compared with the baseline model PSPNet, mIoU is improved by 4.57%, mPA by 2.67%, and Acc by 2.02%.
Figure 10 shows that the improvement in mIoU proves its superiority in boundary segmentation. From the segmentation results, existing methods exhibit varying degrees of over-segmentation or under-segmentation at ablation boundaries. In contrast, the proposed method shows significant advantages in handling ablation cases.
To evaluate the performance of the MDR framework in ablation feature extraction, we constructed PSPNet frameworks with different backbones. All models have an image input size of 512 × 512 and were tested using the same testing. We evaluated six models, five of which are based on the PSPNet framework, including VGG16, ResNet-34, ResNet-50, ResNet-101, and MobileNet as backbones. The results are shown in
Table 5.
Although the improvement in mIoU is modest (~2%), increased boundary accuracy can substantially reduce the risk of missed or under-estimated damage during borescope inspection, which is critical for aero-engine safety. Prior studies and industry practice emphasize that improved boundary-level segmentation helps minimize manual re-inspection and maintenance overheads [
37].
4.4. Ablation Study
Ablation experiments were conducted on the designed dual-branch network, with results shown in
Table 6. As shown in the table, after introducing VSSB, Acc exhibits a slight improvement. When VSSB is applied to the left pathway, all metrics are enhanced. This is because VSSB alleviates the weak long-range perception capability inherent in convolutional neural networks, thereby improving their ability to capture contextual information. However, when two VSSB layers are stacked on the left pathway, the performance gain becomes marginal. Since the core advantage of VSSB lies in strengthening long-range dependencies, stacking two VSSBs at the same feature scale leads to partially overlapping contextual representations, resulting in a diminishing-return effect.
In our model design, the dual-path architecture demonstrates superior feature representation capability compared with the single-path variant. This superiority primarily arises from the complementary inductive biases of the two branches: the CNN (ResNet) branch excels at capturing local textures and boundary details, whereas the VSSB branch effectively models long-range dependencies and maintains global semantic consistency. After fusing the two types of features at the decoder stage, the network benefits from both fine-grained local sensitivity and robust global structural awareness. Such a combination is particularly advantageous for aero-engine ablation segmentation, where boundaries are gradual, shapes are complex, and scales vary significantly. The experimental results further demonstrate that the dual-path architecture consistently outperforms the single-path variant in terms of mIoU, mPA, and Acc, confirming that the complementary feature representations are both effective and necessary for improving semantic segmentation performance.
Table 7 provides a comparative analysis of computational complexity and inference efficiency between the baseline ResNet50 and multiple variants incorporating the VSSB module. The results reveal a consistent trend: introducing VSSB increases the number of parameters, FLOPs, and inference latency while reducing FPS. As the number of VSSB modules increases or when progressive integration strategies are applied, the computational cost rises further. The baseline ResNet50 exhibits the lowest complexity (51.43 M parameters, 204.07G FLOPs) and the fastest inference speed (19.24 ms, 51.96 FPS). Integrating a single VSSB module moderately increases the parameter count and FLOPs and leads to slower inference (21.18 ms, 47.22 FPS). Employing two VSSB modules (VSSB × 2) further increases computational overhead (24.35 ms, 41.07 FPS). The progressive VSSB integration results in the highest computational load among single-path configurations, yielding the lowest FPS (34.77). The dual-path VSSB structure, which combines a ResNet50 branch with a VSSB branch, incurs the largest overall cost (61.41 M parameters, 223.73G FLOPs, 37.62 ms inference time, 26.58 FPS).
Overall, incorporating VSSB enhances the model’s feature representation capability, and although it introduces additional computational cost, the improvement is worthwhile considering the stringent requirements of aero-engine blade inspection. Moreover, the dual-path architecture demonstrates the strongest representational ability, albeit at the highest efficiency cost.