Next Article in Journal
Bus-Mounted Vision Sensing for Traffic Object Detection: BFTD and a Local–Global Attention Framework
Previous Article in Journal
Research on Multi-Dimensional Bionic Design of Flexible ECG Electrodes for Wearable Monitoring
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

FF-DEIM: DEIM with Image Dehazing and Self-Supervised Pretraining for Catenary Support Component Detection

1
Hunan Provincial Engineering Technology Research Center for High-Speed Railway Operation Safety Assurance, Hunan Railway Professional Technology College, Zhuzhou 412001, China
2
China Railway No. 5 Engineering Group Co., Ltd., Changsha 410017, China
3
School of Electrical Engineering, Southwest Jiaotong University, Chengdu 610097, China
*
Author to whom correspondence should be addressed.
Sensors 2026, 26(15), 5000; https://doi.org/10.3390/s26155000
Submission received: 23 May 2026 / Revised: 24 July 2026 / Accepted: 30 July 2026 / Published: 6 August 2026

Abstract

The catenary support component (CSC) is a key part of the electrified railway system, and its operational status directly affects railway operational safety. These components’ images are collected using inspection equipment and detected using computer vision techniques. However, catenary network inspection faces the following issues: (1) due to limitations in the equipment’s shooting angle and changes in viewing distance, the collected images contain multi-scale and multi-class problems, and (2) the railway environment is highly variable, and adverse weather conditions such as fog, rain, and low light affect the imaging devices, leading to degraded image quality. To address these issues, this paper proposes a novel detection framework, FF-DEIM, for detecting catenary support components. First, a dual-channel fusion network (DCFNet) is introduced, which significantly improves image quality by removing foreground interferences such as fog, raindrops, and dynamic blur. Second, a pretraining framework based on contrastive learning, mask image modeling with contrastive learning (MIMCL), is designed to enhance the model’s focus on key regions of the catenary network components, optimizing feature extraction capabilities and improving model convergence speed. Then, a feature-focusing pyramid network (FFPN) is proposed, which uses the focus feature module to fuse cross-level contextual features, enhancing the ability to capture local details and improving the model’s small object detection performance. Finally, a drone-based catenary network image dataset, including scenes with fog, rain, and low light, is constructed, and experiments validate the effectiveness of the proposed method.

1. Introduction

The catenary network is a crucial component of electrified railways, responsible for continuously supplying power to trains [1,2,3,4,5]. However, during high-speed operation, the frequent mechanical contact between the pantograph and the catenary network can cause strong vibrations, potentially leading to structural failures such as loosening, damage, or breakage of the catenary support component (CSC) system [6,7,8,9,10]. If these issues are not detected in time, they pose a serious threat to train operation safety and may even lead to major accidents. For a long time, catenary network inspections have mainly relied on manual methods, which, although ensuring a certain level of accuracy, are labor-intensive and inefficient [11,12]. Additionally, due to human factors, inconsistent or missed inspections may occur. To improve detection efficiency and accuracy, the Chinese electrified railway system has started using non-contact inspection equipment such as the JX300 and unmanned aerial vehicle (UAV) to collect catenary network images, enabling more efficient inspection tasks [13,14]. However, the collected images face two main issues due to limited equipment shooting angles, varying view distances, and changing environmental conditions (such as fog, rain, and low light): (1) there are significant size differences between different components (e.g., screws, insulators, and brackets have noticeable scale differences, and small parts like pins are too tiny), and (2) images contain phenomena from fog, rain, and low light scenes.
Existing catenary network detection methods can be divided into traditional methods and deep learning-based methods. Traditional methods, such as the one proposed by Yang et al., use affine invariant moment detection to inspect catenary network insulators, classifying anomalies through Hough transform and grayscale statistical curves [15]. The same team later proposed a defect detection method for catenary network insulators based on SURF feature matching, which quickly and accurately locates defective insulators through feature matching, angle correction, and grayscale statistics [16]. While traditional methods can offer high accuracy and low computational cost for specific tasks, they rely on manually designed features and perform poorly under complex environments and scale variations [17]. With the development of deep learning technology, deep learning-based algorithms have gradually become the focus of catenary network detection research [18]. These methods overcome the limitations of traditional methods by automatically learning image features, especially in multi-faceted complex environments and addressing multi-scale issues, demonstrating stronger robustness and accuracy [19,20]. It is worth noting that most of these methods focus on region-level components but lack research on multi-scale components in global images. To address this, the CSCNET framework proposed by Liu et al. effectively achieves precise positioning of the CSC through cascading coarse and fine localization networks [21]. In practical applications, the collected images often face severe visual degradation issues. Liu et al. proposed an improved Faster R-CNN method that solves the small-scale detection problem of support sleeve bolts [22]. However, these methods typically use feature concatenation to obtain multi-scale information, lacking exploration of cross-scale feature information. Therefore, this paper adopts a cross-layer focusing approach to extend cross-layer feature information to all feature layers to address this problem. Furthermore, catenary network images are often disturbed by complex backgrounds, such as the surrounding environment and rails, making object detection more difficult. Research has shown that unsupervised learning methods can effectively separate the foreground from the background, reducing background interference. Contrastive learning focuses on the identification of local defects and details. Hu proposed a self-supervised steel surface defect detection model that learns defect features on unlabeled data through contrastive learning [23]. Mask image modeling focuses on global structure and the relationships between components [24]. Contrastive learning may not effectively handle global structural information, while mask learning may not perform well on images with complex backgrounds and high noise [25]. Factors such as lighting changes, rain, and fog can still cause images to have low contrast, blurred edges, and color deviations, severely affecting the accuracy of subsequent object detection tasks.
Traditional dehazing methods are typically based on the RGB color space for image processing, directly recovering the image’s brightness and color. For example, Fattal proposed a single image dehazing method based on color lines, analyzing the 1D distribution in the RGB color space to recover the scene transmission map and using a Markov random field model to solve transmission issues in isolated areas [26]. Additionally, dehazing methods based on the YCbCr color space, especially for hazy images, better preserve image structure and color perception, improving dehazing effects. For instance, Saihood proposed a YCbCr color space-based dehazing method combining Sigmoid function mapping, adaptive histogram equalization (AHE), and dark channel prior (DCP) to optimize brightness (Y channel) and chrominance (CbCr channels) [27]. While the RGB color space is intuitive, its coupling of brightness and chrominance information limits the effectiveness of dehazing in complex haze environments. In contrast, the YCbCr color space enhances image quality by separating brightness (Y channel) and chrominance (CbCr channels), although it is more complex to operate [28]. Therefore, Zahid Tufail combined the DCP method with RGB and YCbCr color spaces by calculating transmission maps in both and using dark channel information to estimate atmospheric light and optimize edge information [29]. However, traditional methods generally have limitations when handling complex scenes, detail recovery, and high dynamic range images. To overcome these challenges, deep learning methods have been widely applied to image dehazing tasks, using neural networks to automatically learn image features, significantly improving dehazing effects and detail recovery capabilities. For example, Ki et al. proposed the conditional BEGAN method, using a U-Net generator and RGB input images to increase the receptive field and optimize the discriminator using Wasserstein distance [30]. Despite several dehazing networks achieving good results, the advantages of combining RGB and YCbCr color spaces in deep learning have not been fully explored. Most methods focus primarily on a single-color space, either RGB or YCbCr, without fully combining their complementary advantages during training [31]. Transfer learning is often limited by domain gap issues, where pre-trained knowledge from source datasets may not effectively transfer to target-specific scenarios, leading to suboptimal feature adaptation and performance degradation [32].
Recent studies address multi-scale and degradation issues through improved feature pyramid designs. Transformer-based multi-scale modeling and deep image restoration techniques are used, such as dehazing and low-light enhancement [33]. Related advances in industrial defect detection and interpretable machine learning have also provided valuable insights into feature representation, model robustness, and reliable decision-making [34,35]. Beyond conventional visual perception, the integration of computational modeling with intelligent design and automated manufacturing has demonstrated the value of constructing coordinated and automated processing frameworks [36]. AIoT-based research has further combined secure trajectory prediction with task offloading, highlighting the importance of jointly considering intelligent prediction, computational efficiency, and system reliability in safety-critical applications [37]. In complex visual environments, adaptive cross-attention mechanisms have been employed to strengthen complementary information interaction between multispectral modalities [38]. Multivariate feature learning and associative spatial information enhancement have also been investigated to improve object representation under adverse weather conditions, such as snowy scenes [39]. Moreover, large-kernel spatially parallel feature fusion has shown the potential to enhance spatial-context aggregation and multi-level representation for monocular 3D perception [40]. These studies collectively indicate that coordinated computation, cross-modal interaction, spatial information enhancement, and robust feature fusion are essential for reliable perception in complex environments. However, most existing methods treat multi-scale variation, image degradation, and robust feature learning as separate problems, leading to suboptimal feature consistency between image enhancement and object detection. Therefore, there is still a lack of a unified framework that can simultaneously handle multi-scale variation, image degradation, and robust feature representation for CSC detection in complex railway environments.
Inspired by the above analysis, this paper designs a new detector (FF-DEIM) for CSC detection in complex and variable environments. Specifically, the main contributions of this paper are as follows:
(1)
A dual-channel fusion network (DCFNet) image dehazing method is proposed, which significantly improves the quality of input images by removing foreground interferences (such as fog, raindrops, and dynamic blur).
(2)
A pretraining method based on contrastive learning for mask image modeling (MIMCL) is designed, which enhances the model’s ability to focus on key regions of the catenary network components, optimizing the feature extraction ability of the backbone and improving overall detection performance and model convergence speed.
(3)
A feature-focusing pyramid network (FFPN) module is proposed, which uses the focus feature module to fuse cross-layer contextual features, enhancing the ability to capture local details and improving the detection performance of multi-scale components.
(4)
A UAV-based catenary network image dataset is constructed, which includes images with fog, rain, and low light conditions. Various experiments demonstrate the effectiveness of the proposed method.
The following content is structured as follows: Section 2 introduces the proposed method. Section 3 mainly introduces the experimental environment and settings, datasets, experimental results, and analysis of this paper. Section 4 presents the conclusions and further prospects.

2. The Proposed Method

To address image degradation, large-scale variation, and weak-feature representation in CSC detection, this study proposes a three-stage framework. The design follows a progressive feature refinement strategy, where image quality enhancement, representation learning, and object detection are jointly optimized in a coarse-to-fine manner. As shown in Figure 1, the first stage employs a DCFNet to improve input image quality by combining RGB and YCbCr feature representations, which helps suppress weather-related degradation while preserving structural details. The second stage introduces masked image modeling with MIMCL to learn robust feature representations by integrating global context modeling and local discrimination under limited annotations. In the final stage, DETR is enhanced with an FFPN to strengthen multi-scale feature representation and improve small object detection before transformer-based decoding.

2.1. Guided Image Dehazing with Dual-Color Feature Fusion

We present a DCFNet designed to tackle the challenging task of image dehazing in real-world scenarios. DCFNet utilizes both the RGB and YCbCr color spaces to enhance image texture details and color perception. The architecture, as illustrated in Figure 2, adopts an asymmetric encoder–decoder structure with large kernel attention blocks, ensuring that both coarse structures and fine details are preserved during the dehazing process. The process begins by converting the input hazy image from the RGB color space to the YCbCr color space using a standard linear transformation. After this transformation, both RGB and YCbCr versions of the image are processed through a shared encoder to extract multi-scale feature representations, capturing both global and local image features. These features are then processed by the chromatic fusion bridge (CFB), which consists of two key modules: the progressive fusion module (PFM) and the adaptive cross-attention module (ACAM). For the RGB features, an average pooling operation is applied to smooth out noise and preserve the global structure of the image.
h a i = A v g P o o l h r g b i
where h r g b i is the input RGB feature map, and h a i is the feature map after the average pooling operation, which retains the global structure of the image by smoothing out noise. Similarly, for the YCbCr features, a max pooling operation is applied to enhance local image details and chrominance, ensuring robust activation values:
h m i = M a x P o o l h y c b c r i
where h y c b c r i is the input YCbCr feature map, and h m i is the feature map after the max pooling operation, which enhances local details and chrominance, making them more robust to minor variations. In the progressive fusion module (PFM), the amplitude and phase components of the RGB and YCbCr features are extracted using Fourier transform (FFT). The amplitude captures the overall intensity, while the phase retains important structural information.
A r g b i , P r g b i = S F f r g b i A y c b c r i , P y c b c r i = S F f y c b c r i
where F(·) represents the Fourier transform operation, and S(·) is the phase and amplitude extraction. A r g b i and P y c b r i are the amplitude and phase components of the RGB feature, while A y c b c r i and P y c b c r i are the amplitude and phase components of the YCbCr feature. The phase components from both color spaces are then fused to enhance the image’s structural clarity:
P m i = C o n v 3 × 3 P r g b i + C o n v 3 × 3 P y c b c r i
where conv3×3 is a convolution operation applied to merge the phase components from both color spaces, P r g b i and P y c b c r i , to form a combined phase spectrum P m i that helps enhance structural clarity. Finally, the fused amplitude and phase components are reconstructed into the spatial domain via the inverse Fourier transform (IFFT):
F r g b i = F 1 C o n v 1 × 1 A r g b i , P m i F y c b c r i = F 1 C o n v 1 × 1 A y c b c r i , P m i
where F1(·) represents the inverse FFT. Next, the adaptive cross-attention module (ACAM) further refines the important regions in the RGB and YCbCr features using a cross-attention mechanism. We first downsample A r g b i and A y c b c r i to obtain U r i and U y i . The refined features are passed to the decoder through residual connections, resulting in the final fused feature.
U m i x i = S i g U r i h r g b i + 1 + S i g U y i h y c b c r i + 1
where Sig (·) is an activation function, and ⊙ denotes element-wise multiplication. The final fused feature map U m i x i is the result of the attention-guided fusion of the RGB and YCbCr features. Finally, after processing both RGB and YCbCr features, DCFNet uses the color enhancement module (CEM) to improve color perception. The enhanced chrominance information is fused into the RGB features.
D o = v c h r g b i + h y c b c r i
where v c is the attention weight calculated from the YCbCr features and Do is the final enhanced RGB feature with improved color perception. To optimize the network’s performance, DCFNet employs a multi-scale loss function during training. This combines pixel-level L1 loss, structural similarity index (SSIM) loss, and FFT. The learning strategies of this module can be introduced in Section 2.4.

2.2. Masked Image Modeling with Contrastive Learning

As introduced in the Introduction, contrastive learning (CL) tends to focus on fine-grained features such as local defects or geometric details of key components in catenary systems, enhancing the model’s discriminative ability for localized targets [41]. In contrast, masked image modeling (MIM) emphasizes the understanding of the global structure and interrelationships among components, thereby offering stronger generalization capabilities. This contrast highlights a fundamental trade-off in unsupervised pretraining between local discriminability and global generalization. To bridge this gap, we employ a contrastive mask learning method, which combines the principles of MIM and CL. The method works by masking parts of the input image, creating visible and masked regions, and training the model to predict the masked portions based on the visible ones. The objective is to guide the model to learn valuable feature representations that focus on visible image parts, while simultaneously distinguishing between the unmasked and masked areas. To further enhance the semantic relevance of masked modeling, we incorporate semantic masks as guidance during the patch masking process [42,43]. Unlike purely random masking, we selectively mask regions corresponding to catenary components and divide the image into foreground and background masks. These are subsequently treated as visible and masked patches, respectively, guiding the model to focus more effectively on the reconstruction of critical structural information.
In this pretraining stage, as shown in Figure 3, the input image is divided into visible patches Pv and masked patches Pm. The encoder processes the visible patches P v to generate latent representations Lv, capturing essential visual information. The decoder then uses these representations along with a class token Tcls to reconstruct the masked regions Pm. This process is done by passing through multiple transformer blocks that progressively refine the predicted masked patches. We use a vision transformer (ViT) as the backbone of our model due to its effectiveness in capturing long-range dependencies within image patches. ViT processes images by dividing them into non-overlapping patches, which are then linearly embedded into fixed-size vectors. The advantage of ViT lies in its ability to model global relationships through self-attention mechanisms, making it well-suited for our pretraining task. The semantic masks in MIMCL are generated automatically from the teacher network’s patch-level attention responses. The normalized attention scores are thresholded to separate foreground and background patches without using bounding boxes, segmentation masks, category labels, or other manual annotations. Pretraining uses only unlabeled training images, excluding validation and test data, thereby preserving the self-supervised setting and preventing data leakage.
The encoder transforms the visible patches Pv into latent representations L v . In the first step, the encoder linearly projects each visible patch into embeddings. To retain spatial information, position embeddings Xv are added to these embeddings. These embeddings are then processed through multiple transformer layers, using self-attention mechanisms to generate the latent representations L v , which encapsulate the key features of the visible patches. The decoder, which plays a dual role, takes these latent representations and transforms them. Its primary function is to convert the latent representations of both visible patches Pv and masked patches Pm back into the reconstructed masked patches. This transformation involves passing through several transformer layers, followed by a linear layer that accurately regenerates the original masked patches. In addition, the decoder refines the input class token Z c l s into an enhanced version Zcls, which is crucial for effective contrastive learning.
Unlike traditional methods, where the class token is integrated early in the process, our method strategically delays the integration of the class token until the decoding phase. This allows the encoder to focus more on extracting a diverse range of visual features from the visible patches, while the decoder fine-tunes the class token, balancing the model’s objectives of feature extraction and classification. During the unsupervised pretraining phase, we begin by sampling an input image from a large, unlabeled base dataset. To generate two distinct views of the image, we apply random augmentations, resulting in two different versions, I1 and I2. These augmented views are processed separately by two networks: a teacher network, parameterized by θ t , and a student network, parameterized by θs. The key idea behind this approach is that the teacher network is updated through an exponentially moving average (EMA) of the student network, which facilitates a more stable and consistent knowledge transfer between the two networks. The learning strategies of this module can be introduced in Section 2.4.

2.3. DETR with Feature-Focused Pyramids and Matching-Aware Design

In this work, we employ DETR with feature-focused pyramids and matching-aware design (FF-DEIM) for localization tasks on de-hazed and de-rained images, leveraging pre-trained weights from MIMCL to fine-tune the model for enhanced performance. DEIM, a variant of DETR, shares similarities with the traditional transformer-based architecture but introduces several key improvements to optimize matching efficiency and training convergence. The DEIM architecture builds upon the standard transformer design, utilizing a backbone encoder for feature extraction, followed by an efficient encoder to enhance representation learning. The FFPN module then refines features across multiple scales, improving multi-scale feature representations. Finally, the decoder processes these features to output high-quality detection results.
The FFPN module is illustrated in Figure 4, which is designed to refine features across multiple scales, improving the representation of both local and global information in the input image. The module begins by projecting the input feature maps into a unified hidden dimension through a 1 × 1 convolution, ensuring consistent dimensionality across all feature maps, regardless of their original sizes. The core component of the FFPN module is the focus feature module, which is specifically designed to handle multi-scale features. It processes three different resolution feature maps, performing operations such as up-sampling, down-sampling, and convolution with various kernel sizes. These operations are followed by a series of depth-wise convolutions, which are applied to capture detailed spatial patterns at different scales. The outputs from these convolutions are then aggregated to produce a refined feature representation, which is passed through a final pointwise convolution to generate the final refined features. The process for handling the feature maps is as follows:
x ¯ 1 = C o n v 1 ( x 1 ) , x ¯ 2 = C o n v 2 ( x 2 ) , x ¯ 3 = A D o w n ( x 3 )
First, the input feature maps are processed individually. The first feature map x 1 undergoes up-sampling and a 1 × 1 convolution, the second feature map x2 is processed by a 1 × 1 convolution, and the third feature map x 3 undergoes the ADown operation, which includes average pooling followed by max pooling and convolution. After these initial steps, the results x ¯ 1 , x ¯ 1 , and x ¯ 3 are concatenated. The concatenated feature map is then processed by depth-wise convolutions with kernel sizes k = {5, 7, 9, 11}, allowing the network to capture multi-scale contextual information more effectively.
x ¯ = C o n c a t x ¯ 1 , x ¯ 2 , x ¯ 3   f e a t u r e = k D W C o n v k x ¯
The resulting feature map is then processed by a pointwise convolution to aggregate the multi-scale information:
  F r = P W C o n v F
where F denotes the input feature, and Fr represents the refined feature obtained through pointwise convolution.
Finally, the refined feature is added to the original feature map, and a 1 × 1 convolution is applied to produce the final output:
  F o u t = C o n v 1 × 1 ( x + F r )
where Fout denotes the final output feature. Beyond the focus feature module, the overall FFPN architecture consists of two consecutive stages for progressive feature refinement. In the first stage, the projected feature maps are fed into a focus feature module, whose output is further fused with the highest- and lowest-resolution features through down-sampling and up-sampling paths, respectively. These fusion steps are followed by a CSP bottleneck with two convolution blocks(C2f) to enhance contextual understanding [44]. The second stage takes the output of the first stage, along with its fused multi-scale counterparts, and processes them through another focus feature module. The refined output is again passed through top-down and bottom-up pathways, followed by additional C2f blocks. This hierarchical fusion results in final feature maps at three different resolutions, which are then forwarded to the detection head. By combining progressive feature interaction, multi-scale spatial refinement, and lightweight attention via depth-wise convolutions, the FFPN structure significantly enhances the semantic richness and spatial consistency of the intermediate representations.
In this module, the use of depth-wise convolutions and the integration of features at different scales allow for the enhancement of both local details and broader contextual information, ensuring that the FFPN module improves the overall feature representation in the network. With the detailed explanation of the FFPN module that refines multi-scale features, it becomes evident that the quality of feature representations is significantly improved. The refined features produced by FFPN are crucial for enhancing the subsequent operations in the DEIM framework, especially in the context of feature matching.

2.4. Learning Strategy

A unified training objective is designed for the proposed framework, consisting of three loss components corresponding to image dehazing, self-supervised pretraining, and detection stages, respectively. These include guided image dehazing with DCF-NET, MIMCL, and DEIM.

2.4.1. Loss of DCF-NET

To optimize the network’s performance, DCFNet employs a multi-scale loss function during training. This combines pixel-level L1 loss, SSIM loss, and FFT. The various loss functions are listed as follows:
L 1 = 1 N i = 1 N | I p r e d i I t a r g e t i |
where I p r e d i denotes the predicted foreground interference picture, I t a r g e t i denotes the target foreground interference picture, and N represents the total number of pixels. In DCFNet, the L1 loss is mainly used to constrain the pixel-level consistency between the enhanced image and the ground-truth clear image. It directly reduces the differences in brightness, color, and detail between the reconstructed image and the ground-truth image, making the output visually closer to the real clear image. Compared with MSE loss, the L1 loss is less sensitive to outlier pixels, which makes it more effective in preserving edge and texture details and reducing over-smoothing. In image enhancement, dehazing, and low-light restoration tasks, the L 1 loss can help the model generate more natural and clearer reconstructed results.
SSIM is a metric used to measure the structural similarity between two images. It considers luminance, contrast, and structural information. Unlike traditional pixel-level difference metrics such as PSNR, SSIM is more consistent with human visual perception and can therefore more accurately reflect the quality of dehazed images, especially in terms of detail preservation and structural consistency.
The calculation of SSIM mainly involves three components: luminance, which measures brightness differences based on the mean intensity of images; contrast, which evaluates contrast differences based on variance; and structure, which measures local structural and texture differences based on covariance.
L S S I M I x , I y = 2 μ x μ y + C 1 2 σ x y + C 2 μ x 2 + μ y 2 + C 1 σ x 2 + σ y 2 + C 2
where μx and μy denote the mean pixel values of the RGB image (Ix) and the processed output image (Iy), respectively. σ x 2 and σ y 2 represent their variances, and σ x y denotes the covariance between images x and y. The constants C1 and C2 are introduced to avoid division by zero and are usually determined according to the dynamic range L of the image. Common default settings are C1 = (0.01L)2 and C2 = (0.03L)2.
Frequency-domain learning has been widely explored in image restoration because the Fourier transform provides an effective way to model global contextual information. In the frequency domain, low-frequency components mainly describe smooth regions and global illumination, while high-frequency components preserve edges, textures, and fine image details. For the frequency-domain loss, LFFT, we adopt formula 8 from reference [45] to calculate it. Finally, the total loss is computed across multiple scales.
L D C F N E T = s = 1 3 α 1 L 1 s + α 2 L S S I M s + α 3 L F F T s
where s represents the different feature map scales [1, 0.5, 0.25], and the coefficients α 1 = 1.0, α 2 = 0.5, and α 3 = 0.1 are empirically determined. In summary, DCFNet effectively combines the advantages of both RGB and YCbCr color spaces, allowing it to restore image details and enhance color perception, making it highly effective for real-world dehazing tasks. This method ensures significant improvement in image quality and provides clearer and more accurate input for subsequent high-level computer vision tasks.

2.4.2. Loss of MIMCL

The model’s primary objective during this phase is to align the output distributions of the teacher and student networks. Specifically, the cross-entropy loss between their class token predictions is minimized, as expressed as follows:
L c l s = H Z c l s t , Z c l s s
where H(⋅) represents the cross-entropy loss, and Z c l s t and Z c l s s are the class token outputs from the teacher and student networks, respectively. For MIM, we incorporate self-distillation techniques, where M random mask sequences m ∈ {0, 1} are applied to the image. The masked patches are then replaced by a learnable token embedding, resulting in a corrupted image. The teacher network processes the original image, while the student network processes the corrupted image and aims to recover the masked patches. The loss for the masked patches is defined as follows:
L p a t c h = i = 1 M m i H P i t , P i s
where m i is the binary mask indicating whether the i-th patch is masked, and P i t and P i s are the predictions from the teacher and student networks, respectively. This loss ensures that the student network reconstructs the masked regions by aligning with the teacher network’s output distribution. Additionally, to further enhance image reconstruction, the decoder is tasked with predicting the RGB values of the image. To accomplish this, we use a mean squared error (MSE) loss that compares the predicted RGB features Y ^ with the true features Y , as follows:
L M S E = 1 N i = 1 N Y i Y ^ i 2 2
where Y and Y ^ are the input RGB image features and the predicted RGB image features. This ensures that the decoder not only reconstructs the masked patches but also recovers the overall image’s RGB information. Once the pretraining phase is completed, the model continues to leverage the feature representations learned during this stage, which helps improve its generalization ability. By learning the discriminative features of the components from the contact network, the MIMCL framework significantly enhances the model’s transferability, enabling it to effectively apply the knowledge gained during the pretraining phase to new tasks.
L m i m c l = L c l s + α 3 L p a t c h + α 4 L M S E
where α3 = 0.5 and α4 = 2. By jointly optimizing these objectives, MIMCL enables the student network to learn both global semantic consistency and local structural representations from the teacher network. The class-token distillation loss promotes high-level semantic alignment, the patch reconstruction loss strengthens the recovery of masked regions, and the RGB reconstruction loss further improves pixel-level fidelity. As a result, the pretrained model can obtain more robust and transferable feature representations, which provides a stronger initialization for downstream CSC detection tasks under complex railway environments.

2.4.3. Loss of DEIM

The one-to-one (O2O) matching approach, commonly adopted in DETR-based models, pairs each target with exactly one predicted query. This method, which uses the Hungarian algorithm, enables end-to-end training and eliminates the need for NMS. However, a major limitation of this approach is its tendency to produce fewer positive matches compared to traditional one-to-many (O2M) techniques like SimOTA. As a result, supervision becomes sparse, which can slow down training convergence. To address this issue, we introduce Dense O2O, an enhanced strategy that retains the one-to-one matching structure of O2O (with M i = 1) while increasing the number of targets N per image to provide denser supervision [46]. Specifically, we divide the original image into four quadrants and merge them into a single image, maintaining the original size. This process boosts the target count from 1 to 4, thereby improving the supervision level as shown in Equation (19), without altering the matching structure. Dense O2O achieves a supervision level comparable to O2M but avoids additional complexity and computational cost.
L D E I M = i = 0 N j = 0 M F y i j , y i
where N is the total number of targets, Mi is the number of matches for the i-th target, y i j represents the j-th match for the i-th target, yi denotes the i-th ground-truth label, and f is the loss function. Alongside improving matching efficiency, enhancing matching quality is another critical objective in the DEIM framework. Although varifocal loss (VFL) has demonstrated effectiveness in improving detection performance by emphasizing high-confidence predictions, it tends to assign lower weights to low-quality matches, resulting in insufficient supervision for these samples. This imbalance limits the model’s ability to effectively learn from hard or ambiguous predictions. To address this issue, we propose the match ability-aware loss (MAL), which explicitly incorporates match quality into the loss formulation. Unlike VFL, MAL is designed to be more sensitive to low-quality matches by re-weighting supervision according to match ability scores, ensuring that both high- and low-IoU predictions contribute to model optimization. In this way, MAL improves learning stability across different match qualities and enhances overall robustness, particularly for challenging or uncertain predictions. The MAL can be defined as follows:
M A L ( p , q , y ) = q γ l o g ( p ) 1 q γ l o g ( 1 p ) , y = 1 p γ l o g ( 1 p ) , y = 0
where γ is a tunable parameter that adjusts the loss sensitivity to match quality; the loss focuses more on refining the prediction for high-quality matches (q) and penalizes background samples (q = 0) by treating them as negative samples, ensuring the model improves both foreground and background match quality.

3. Experiments and Result Analysis

3.1. Experimental Settings

The operating environment of the experimental is PyTorch 2.3.1, and the operating environment configuration is as follows: (1) Processor: Intel(R) Xeon(R) CPU E5-2697A v4 @ 2.60GHz; (2) Operating Memory: 16G RAM; (3) GPU: NVIDIA RTX 2080TI GPU; (4) Code Operating Environment: Torch = 2.3.1, Python = 3.10, and Ultralytics8.2; and (5) CUDA Version: CUDA 11.6, cuDNN 8.9.7. DCFNet was optimized with an initial learning rate of 3 × 10−4 and a weight decay of 5 × 10−4. For MIMCL, the learning rate and weight decay were set to 1.5 × 10−4 and 1 × 10−3, respectively, to ensure stable teacher–student representation alignment during self-supervised pretraining. For DEIM, a layer-wise learning-rate strategy was employed. The base learning rate was set to 1 × 10−4, while the learning rates of the pretrained backbone and the encoder–decoder were set to 1 × 10−5 and 1 × 10−4, respectively. The weight decay of DEIM was set to 5 × 10−4. The AdamW optimizer was adopted to train the proposed framework. The batch size was set to 16. DCFNet, MIMCL, and DEIM were trained for 72, 200, and 500 epochs, respectively. For visualization experiments, a confidence threshold of 0.7 was applied only to YOLO-based methods during postprocessing.

3.2. Introduction of Dataset

To validate the proposed method, a CSC dataset was created using a UAV. The dataset was gathered with a DJI Matrice M30T UAV (SZ DJI Technology Co., Ltd. Shenzhen, Guangdong, China) while flying over a railway segment. This UAV is equipped with a 480,000-pixel zoom camera, a 120,000-pixel wide-angle camera, a laser rangefinder, and an RTK navigation system that also includes obstacle avoidance. During image collection, the 480,000-pixel zoom camera was used with a 20× zoom for capturing the images. The images were captured at a resolution of 6000 × 8000, which corresponds to 8K resolution. These high-resolution images were taken from approximately 50 m from the contact network using a 20× zoom lens. An image of the UAV is shown in Figure 5.
The dataset includes a total of 5832 UAV cruise images, and this experiment has studied part of the important, electrified railway catenary support components. Specifically, it contains a total of 17 catenary components as shown below: casing base (C1), insulator (C2), insulator base (C3), isoelectric line (C4), load-bearing cable base (C5), locator-bracing base (C6), locator-bracing base ear (C7), locator clamp (C8), locator hook (C9), locator ring (C10), locator tube connector (C11), rectangular locator (C12), rotary double ear (C13), sleeve double ear (C14), sleeve screw (C15), windproof wire (C16), and windproof wire ring (C17). The target detection models are usually trained on clear images. However, in practical applications, contact network images are often affected by adverse conditions such as low light, smog, and heavy rain, which leads to a decrease in detection accuracy. To enhance the robustness of the model in complex working conditions, this study employed algorithms to simulate three typical visual interference environments and generated corresponding enhanced data: (1) Low-Light Environment Simulation: To address the issue of unclear details caused by components in low-light conditions or low luminance, the brightness of the image is adjusted to simulate the change in illumination, enabling the model to adapt to significant variations in light and ensuring that the model can identify and judge components even in dimly lit environments. (2) Haze Environment Simulation: Haze causes images to become blurry and the contrast to decrease, and thus the image with haze (with haze coefficient α) is simulated to different degrees to simulate the interference caused by haze, training the model to adapt to the characteristics of low-contrast features. (3) Heavy Rain Environment Simulation: For rain obscuration and visual noise, visual noise effects such as fog and water droplets are added to the image to simulate the visual effect under such conditions, ensuring the stability of the training model in the visual conditions of a rainy day or fog. Among them, a total of 143,202 component instances are included, and the distribution of each component is shown in Figure 6. We have divided the training and test sets in a 4:1 ratio. Images collected from the same UAV inspection route and adjacent frames are assigned to the same subset to avoid overlap between the training and testing sets. This ensures that images from the same railway segment, viewpoint, or acquisition sequence do not appear in both splits.

3.3. Evaluation Indicator

To comprehensively evaluate both the dehazing quality and detection performance of the proposed model, we adopt a set of quantitative metrics. For image quality assessment, PSNR and SSIM are employed as reference-based indicators.
P S N R = 10 log 10 M A X 2 M S E , M S E = 1 H W i = 1 H j = 1 W I i j K i j 2 , S S I M ( x , y ) = 2 μ x μ y + C 1 2 σ x y + C 2 μ x 2 + μ y 2 + C 1 σ x 2 + σ y 2 + C 2
where MAX is the maximum possible pixel value (typically 255), I is the ground truth image, K is the predicted image, and H and W denote the height and width of the image, respectively. For SSIM, μ x and μ y are the means of images x and y; σ 2 , x, σ, and y are their variances; σ x y is the covariance; and C1 and C2 are constants for stability.

3.4. Detection Performance Metrics

To reasonably evaluate the detection performance of the model, the following indexes are used in this paper: average precision (AP), mean average precision (mAP), frames per second (FPS), floating-point operations (FLOPs), and parameters (Pa).
P = T P T P + F P , R = T P T P + F N A P = 1 0 P ( R ) d R , m A P = q = 1 Q A P ( q ) Q
where TP, FP, and FN represent the number of true positive samples, false positive samples, and false negative samples, respectively. P and R represent precision and recall. AP is average precision, which is the area of the PR curve. mAP represents mean average precision, which is the mean value for all catenary components.

3.5. Experimental Analysis

(1)
The Analysis of Image Dehazing Methods: To evaluate the effectiveness of the proposed DCFNET in image dehazing tasks, comparative experiments were conducted using images resized to 640 × 512 for both training and testing. Two image quality metrics—PSNR and SSIM—were adopted for comprehensive evaluation, where higher values of PSNR and SSIM indicate better image quality. As presented in Table 1, DCFNET achieves the best performance across all quality metrics (PSNR: 22.56, SSIM: 0.826), significantly outperforming other methods. Furthermore, DCFNET maintains a lightweight computational footprint (13.32M parameters and 53.40G FLOPs), demonstrating an optimal balance between visual quality and efficiency.
Figure 7 presents a visual comparison of different methods on our UAV-based dataset for image dehazing. Our proposed method demonstrates superior performance compared to other methods. Specifically, DAE-Net improves overall visibility but still leaves residual haze in certain regions. DCMPNet achieves a balanced trade-off between haze removal and texture preservation; however, slight haze remains visible in complex regions. Although NSDNet effectively removes most of the haze, it tends to blur the image and compromise fine details and image contrast. In comparison, DCFNet not only achieves more thorough haze removal but also better preserves natural textures and visual contrast.
(2)
The Analysis of Ablation Study Analysis: To further validate the effectiveness of the proposed components, we perform ablation studies on MIMCL, FFPN, and Dense O2O. Notably, all ablation experiments are conducted on dehazed images to ensure consistency with the full detection pipeline. The corresponding results are summarized in Table 2. The FPS is measured on input images with a resolution of 640 × 640. An analysis of the results shown in the ablation table indicates the following findings: (1) The integration of MIMCL, FFPN, and Dense O2O each contributes to noticeable improvements in detection accuracy. (2) Specifically, MIMCL alone improves mAP50–95 from 0.652 to 0.703, while FFPN and Dense O2O individually raise it to 0.671 and 0.683, respectively. When combining MIMCL with FFPN or Dense O2O, the mAP50–95 further increases to 0.734 and 0.727. Upon enabling all modules, the best performance is achieved with an mAP50–95 of 0.755, an mAP50 of 0.992, and a mAR of 0.991. (3) In terms of inference speed, the model maintains real-time performance, achieving 20.9 FPS even when all modules are enabled. The additional computational cost introduced by each component is minimal. These results demonstrate that the proposed modules are complementary and effective, striking a favorable balance between detection accuracy and speed.
Figure 8 shows the total loss curves of DCFNet, MIMCL, and DEIM during training. The blue curves represent the original training results, while the orange curves denote the smoothed loss trends. As training progresses, the total losses of all three modules decrease steadily and gradually converge, indicating stable optimization. DCFNet converges rapidly within a relatively short training schedule, demonstrating effective learning of low-level restoration features. MIMCL shows a smooth and continuous decline, suggesting stable self-supervised representation learning. DEIM is trained for a longer period, and its loss gradually stabilizes, indicating effective optimization of the detection objective. Overall, the convergence behavior confirms that the proposed loss functions can effectively guide the training of different modules.
(3)
The Analysis of Self-Supervised Learning: It is also important to note that all subsequent experiments are conducted on dehazed images to ensure consistency with real-world UAV inspection scenarios. The evaluation results of the network utilizing different pre-trained weights from various self-supervised learning methods are presented in Table 3. Clearly, our proposed method, MIMCL, consistently outperforms comparative self-supervised methods across multiple critical metrics. Specifically, MIMCL achieves the highest mAP of 75.53%, AP50 of 99.27%, and A P 75 of 80.23%. In comparison, other self-supervised methods such as MAE, IGPT, SimMIM, BEIT, and DINO achieve relatively lower performance. For example, MAE achieves a mAP of 67.91%, SimMIM reaches 72.18%, and BEIT attains 74.31%. Particularly notable is MIMCL’s significant improvement in mAP and AP75, surpassing baseline methods by approximately 1.22–7.62%. These results demonstrate that our proposed MIMCL framework effectively leverages self-supervised strategies, leading to enhanced feature representation capabilities and improved detection performance.
To validate the application of prior knowledge learned through MIMCL, heatmap visualization analysis, as shown in Figure 9, reveals that with the deeper layers of the network, the model increasingly focuses on the regions corresponding to the catenary components. The heatmap colors range from blue (low attention) to yellow and red (high attention), indicating that deeper layers pay more attention to these critical areas. This demonstrates that the prior feature information learned during self-supervised training is successfully integrated into the backbone network, leading to improved detection performance. This further and more intuitively validates the effectiveness and rationality of the MIMCL method.
(4)
The Analysis of Multi-Scale Feature Fusion Module: By analyzing the results in Table 4, we observe the following findings: (1) Our proposed metised hod, FFPN, achieves the best overall detection performance, with an mAP of 67.43%, an AP50 of 95.54%, an AP75 of 75.26%, and an APs of 65.88%, demonstrating its strong ability to handle both small and large object detection tasks. (2) The CFP method performs well, reaching the highest performance on AP75 and APl, with values of 73.96% and 83.95%, respectively, benefiting from its cross-feature pyramid design that helps preserve local details in high-level features. (3) CR-FPN and Bi-FPN show comparable results, but FFPN slightly outperforms them, especially in mAP and AP75, highlighting the effectiveness of FFPN in aggregating multi-level features and improving robustness in complex environments. At the core of FFPN is the focus feature module, which introduces a more focused and detailed approach to multi-scale feature handling. By refining features at multiple scales and capturing spatial patterns at different granularities, the focus feature module enhances the model’s ability to handle complex, multi-scale objects and improve overall detection performance. This focus on detailed feature refinement makes FFPN particularly effective in scenarios where object size and scale vary significantly, outperforming other FPN variations.
(5)
The Analysis of Classic Detection Methods: Following the FPN experiments, we further evaluated the performance of our method on object detection tasks. Specifically, we conducted comparative experiments with several classical object detection approaches, as shown in Table 5. Both training and testing images were resized to 640 × 640. The comparison experiments were structured as follows: (1) For one-stage detectors, YOLOv11-l, YOLOv12-l, and ATSS served as baseline methods. (2) For two-stage detectors, Cascade R-CNN and Dynamic R-CNN were selected as comparison methods. (3) Among state-of-the-art DETR-based approaches, Align-DETR, DDQ (DETR), DINO, HDINO, and RT-DETR were also included in the evaluations. As demonstrated in Table 5, the proposed method achieves an excellent balance between detection accuracy and inference speed, highlighting its advantages as follows: (1) Our proposed method achieves optimal performance across multiple detection metrics, obtaining mAP50–95 = 75.53%, AP50 = 99.27%, AP75 = 80.23%, APs = 65.71%, and APl = 85.34%, while maintaining a competitive inference speed (20.9 FPS). (2) Notably, in small-object detection, our method achieves APs = 65.71%, clearly outperforming representative models such as YOLOv11-L (63.53%), YOLOv12-L (63.98%), and RT-DETR (62.01%), demonstrating superior effectiveness in challenging small-scale scenarios. (3) Although YOLO-series methods (YOLOv11-L and YOLOv12-L) achieve higher inference speeds (32.6 FPS and 30.7 FPS, respectively), they show significantly lower overall detection accuracy and small-object performance compared to our method. (4) When compared with RT-DETR, our method not only increases mAP50–95 by approximately 10.26% but also significantly enhances small-object detection accuracy at similar inference speeds, further underscoring the efficiency of our designed modules. In summary, the proposed method effectively balances detection accuracy, especially for small-scale objects, and inference speed, providing clear advantages over both YOLO-series and DETR models.
(6)
Visualization of Detection Results: To further verify the practical effectiveness of the proposed method, object detection experiments were conducted on the dehazed images. As shown in Figure 10, our method is capable of accurately detecting components with significant scale variations, such as insulators (within insulator groups) and screws (support sleeve screws). This clearly demonstrates the adaptability and robustness of our method in addressing complex backgrounds and multi-scale challenges. To further validate the superiority of the proposed method, we conducted additional visualization experiments using six different detection methods. As shown in Figure 10, the letters (a) to (f) correspond to the detection results of the ATSS, DDQ, Dynamic R-CNN, YOLOv12, RT-DETR, and FF-DEIM detectors on the same image. In this experiment, we selected the detector with the best overall performance from various methods. Red arrows in the figure indicate the areas where catenary components were missing by the detectors. Based on the results, we can make the following observations: (1) the ATSS detector (a) failed to detect multiple components, including four sleeve screws, a load-bearing cable base, a sleeve double ear, and an isoelectric line; (2) the DDQ (b) and Dynamic R-CNN (c) detectors exhibited similar performance, each missing four sleeve screws and one isoelectric line; (3) RT-DETR (e) also showed some deficiency, with three sleeve screws left undetected; and (4) in contrast, both YOLOv12 (d) and FF-DEIM (f) demonstrated complete detection coverage, successfully identifying all catenary support components without any omissions. As shown in Figure 11, the proposed method achieves accurate detection of components with significant scale variations, such as insulators within insulator groups and support sleeve screws. The results demonstrate the robustness of the method under complex backgrounds and multi-scale scenarios.

4. Conclusions

In summary, we propose an efficient method for detecting catenary support components, integrating multiple innovative strategies. The contributions of our method are as follows: (1) DCFNet enhances image quality by removing haze, improving detection accuracy; (2) MIMCL pretraining improves feature representation, enabling the model to focus on small-scale components and enhancing performance in complex scenarios; (3) in the FF-DEIM framework, FFPN refines multi-scale feature fusion, improving feature quality by integrating features at different scales, which enhances detection accuracy, especially for small-scale and complex objects. Additionally, Dense O2O improves supervision by increasing the number of targets per image, providing denser supervision and accelerating training convergence without adding complexity. Finally, we draw the following conclusions from the comparative experiments and visual analysis: (1) The proposed DCFNet method significantly enhances image quality by removing haze while preserving fine details, leading to better detection performance. (2) The integration of MIMCL pretraining improves feature representation, enabling the model to focus on key components, particularly small-scale catenary components, which enhances overall detection accuracy. (3) The FFPN module improves multi-scale feature fusion, refining feature representations at different scales, which enhances the model’s ability to handle both small and large objects effectively. (4) The combination of FFPN with Dense O2O improves the localization accuracy, providing denser supervision and accelerating training convergence without additional complexity, leading to better detection of catenary components. In future research, we will combine image dehazing techniques with anomaly detection methods to enhance the detection of irregularities in catenary components, particularly in challenging environmental conditions.

Author Contributions

L.Z.; methodology, L.Z.; software, J.H. and G.Q.; validation, J.C., F.F. and H.W.; formal analysis, L.Z.; investigation, L.Z.; resources, F.F.; data curation, G.Q.; writing—original draft preparation, L.Z.; writing—review and editing, J.H., F.F. and H.Y.; visualization, J.C.; supervision. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported in part by the National Natural Science Foundation of China under Grants 52402481; in part by the Postdoctoral Fellowship Program of China Postdoctoral Science Foundation under Grant GZB20240626; and in part by the Fundamental Research Funds for the Central Universities under Grant XJ2024017801 and 2682025CX020.

Data Availability Statement

The data presented in this study are not publicly available due to confidentiality restrictions. Access to the data is restricted to the research team and authorized personnel only. Further inquiries can be directed to the corresponding author.

Conflicts of Interest

Jinyong Huang and Guojin Qin are employees of China Railway No. 5 Engineering Group Co., Ltd. Other authors declare no conflict of interest.

References

  1. Duan, F.; Wang, H.; Yang, H.; Wei, C.; Zhang, C.; Song, Y.; Liu, Z. MRFM-IFCOS: An Anchor-Free Interactive Detector Based on Multireceptive Field Mamba for Detecting Catenary Support Components. IEEE Trans. Instrum. Meas. 2025, 74, 2553415. [Google Scholar] [CrossRef]
  2. Yang, H.; Liu, Z.; Liu, W.; Wang, H.; Zhang, Y.; Wang, H. Graph-MDETR: A Graph-Guided Mamba-DETR Network for UAV Catenary Support Components Detection in Electrified Railways. IEEE Trans. Intell. Transp. Syst. 2026, 27, 6319–6332. [Google Scholar] [CrossRef]
  3. Song, Y.; Liu, Z.; Ouyang, H.; Wang, H.; Lu, X. Sliding mode control with PD sliding surface for high-speed railway pantograph-catenary contact force under strong stochastic wind field. Shock. Vib. 2017, 4, 4895321. [Google Scholar]
  4. Yan, J.; Zhou, N.; Cheng, Y.; Zhang, F.; Wang, H.; Wang, M.; Zhang, W. Application of machine-vision-driven physics-informed neural networks in pantograph–catenary system state detection. Mech. Syst. Signal Process. 2026, 257, 114577. [Google Scholar] [CrossRef]
  5. Zhang, M.; Ma, L.; Wu, Y.; Shen, K.; Sun, Y.; Leung, H. High-Traversability and Precise Navigation for Mobile Robots in Constrained Environments. IEEE Sens. J. 2025, 25, 22815–22826. [Google Scholar] [CrossRef]
  6. Zhang, M.; Ma, L.; Wu, Y.; Shen, K.; Huang, D.; Leung, H. Tackling the Kidnapped Robot Problem via Sparse Feasible Hypothesis Sampling and Reliable Batched Multistage Inference. IEEE Trans. Instrum. Meas. 2026, 75, 7504614. [Google Scholar] [CrossRef]
  7. Shajeena, J.; Govindasamy, B.; Gnanasundaram, M.; Robinson Joel, M. Mobile-Le Harmonic Fusion Network for Object Recognition and Siam MoT Based Multi-Object Tracking Using Video Surveillance. Cybern. Syst. 2025, 57, 866–896. [Google Scholar] [CrossRef]
  8. Yang, H.; Hu, K.; Wang, H.; Hong, W.; Wang, X.; Wang, H.; Liu, Z. BCLIP-ADer: A Bayesian Prompt Contrastive Language-Image Pretraining Method for Catenary Component Anomaly Detection in Electrified Railways. IEEE Trans. Transp. Electrif. 2026, 1. [Google Scholar] [CrossRef]
  9. Yang, G.; Jiang, Y.; Wang, S.; Chen, K. VinsFusion-Line: Binocular Vision Inertial Navigation Real-Time SLAM System Based on Line Features. Cybern. Syst. 2025, 57, 350–375. [Google Scholar] [CrossRef]
  10. Song, Y.; Rønnquist, A.; Jiang, T.; Nåvik, P. Railway pantograph-catenary interaction performance in an overlap section: Modeling, validation and analysis. J. Sound Vib. 2023, 548, 117506. [Google Scholar] [CrossRef]
  11. Sreekala, K.; Maniraj, S.P.; Singh, A.; Pratap Singh, A.; Pyingkodi, M.; Inthiyaz, S. Enhancing Medical Diagnosis through Multimodal Image Fusion: A Novel Approach Using Modified Swin-Based Cross Attention Fusion. Cybern. Syst. 2025, 57, 765–807. [Google Scholar] [CrossRef]
  12. Reddy, K.; Sekhar, M.; Nelakuditi, U.R. Illustration of Image Registration-Based Novel Segmentation and Classification Model Using Multimodal Medical Images with 3D-TRRSegnet and Adaptive RAN. Cybern. Syst. 2025, 1–35. [Google Scholar] [CrossRef]
  13. Han, Y.; Liu, Z.; Han, Z.; Yang, H.M. Fracture detection of ear pieces of catenary support devices of high-speed railway based on SIFT feature matching. J. China Railw. Soc. 2014, 36, 31–36. [Google Scholar]
  14. Han, Y.; Liu, Z.; Lyu, Y.; Liu, K.; Li, C.; Zhang, W. Deep learning-based visual ensemble method for high-speed railway catenary clevis fracture detection. Neurocomputing 2020, 396, 556–568. [Google Scholar] [CrossRef]
  15. Yang, H.M.; Liu, Z.G.; Han, Z.W.; Han, Y. Foreign body detection between insulator pieces in electrified railway based on affine moment invariant. J. China Rail-Way Soc. 2013, 35, 30–36. [Google Scholar]
  16. Yang, H.; Liu, Z.; Han, Y.; Han, Z. Defective Condition detection of insulators in electrified railway based on feature matching of speeded-up robust features. Power Syst. Technol. 2013, 37, 2297–2302. [Google Scholar]
  17. Zhong, J.; Liu, Z.; Zhang, G.; Han, Z. Condition detection of swivel clevis pins in overhead contact system of high-speed railway. J. China Railw. Soc. 2017, 39, 65–71. [Google Scholar]
  18. Feng, Z.; Peng, L.; Kang, D.; Zhou, M.; Kuang, P.; Wu, M.; Su, J. TIPS: Two-level prompt selection for more stability-plasticity balance in continual learning. Pattern Recognit. 2025, 171, 112276. [Google Scholar]
  19. Zhang, H.; Chang, H.; Ma, B.; Wang, N.; Chen, X. Dynamic R-CNN: Towards high quality object detection via dynamic training. In Proceedings of the European Conference on Computer Vision (ECCV), Glasgow, Scotland, 23–28 August 2020; pp. 260–275. [Google Scholar]
  20. Tian, X.; Xianyu, X.; Li, Z.; Chen, J.; Zhang, Y. Infrared and visible image fusion based on multi-level detail enhancement and generative adversarial network. Intell. Robot. 2024, 4, 524–543. [Google Scholar] [CrossRef]
  21. Liu, Z.; Liu, K.; Zhong, J.; Han, Z.; Zhang, W. A high-precision positioning approach for catenary support components with multiscale difference. IEEE Trans. Instrum. Meas. 2019, 69, 700–711. [Google Scholar]
  22. Liu, Z.; Lyu, Y.; Wang, L.; Han, Z. Detection approach based on an improved faster RCNN for brace sleeve screws in high-speed railways. IEEE Trans. Instrum. Meas. 2019, 69, 4395–4403. [Google Scholar]
  23. Hu, X.; Yang, J.; Jiang, F.; Hussain, A.; Dashtipour, K.; Gogate, M. Steel surface defect detection based on self-supervised contrastive representation learning with matching metric. Appl. Soft Comput. 2023, 145, 110578. [Google Scholar] [CrossRef]
  24. Ma, X.; Wu, Z.; Pan, J.; Zheng, K.; Lian, R.; Wu, W.; Zhang, W. CDMask: Change Customized Mask Architecture for Change Detection. IEEE Trans. Geosci. Remote Sens. 2026, 64, 5619919. [Google Scholar] [CrossRef]
  25. Meng, C.; Huang, G.; Fu, R.; Jian, R.; Gan, Z.; Ouyang, C. CLCR: Cross-Level Semantic Collaborative Representation for Multimodal Learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Denver, CO, USA, 5–7 June 2026; pp. 1606–1615. [Google Scholar]
  26. Fattal, R. Dehazing using color-lines. ACM Trans. Graph. TOG 2014, 34, 1–14. [Google Scholar] [CrossRef]
  27. Saihood, R.T. Aerial Image Enhancement based on YCbCr Color Space. Int. J. Intell. Eng. Syst. 2021, 14, 177. [Google Scholar] [CrossRef]
  28. Hemalatha, S.; Acharya, U.D.; Renuka, A. Comparison of secure and high capacity color image steganography techniques in RGB and YCbCr domains. arXiv 2013, arXiv:1307.3026. [Google Scholar]
  29. Tufail, Z.; Khurshid, K.; Salman, A.; Nizami, I.F.; Jeon, B. Improved dark channel prior for image defogging using RGB and YCbCr color space. IEEE Access 2018, 6, 32576–32587. [Google Scholar] [CrossRef]
  30. Ki, S.; Sim, H.; Choi, J.S.; Kim, S.Y.; Seo, S.; Kim, S.; Kim, M. Fully end-to-end learning based conditional boundary equilibrium gan with receptive field sizes enlarged for single ultra-high resolution image dehazing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA, 18–22 June 2018; pp. 817–824. [Google Scholar]
  31. Belmer Gladson, V.; Kumar, S.; Rajesh, M.; Karthik, R. Image Steganography with Security Using Massive Threefold Attentional Residual GAN Optimized By Chaotic PSO Algorithm. Cybern. Syst. 2025, 1–32. [Google Scholar] [CrossRef]
  32. Feng, Z.; Zhou, M.; Gao, Z.; Stefanidis, A.; Su, J.; Dang, K.; Li, C. Adaptive knowledge transfer for class incremental learning. Pattern Recognit. Lett. 2024, 183, 165–171. [Google Scholar] [CrossRef]
  33. Liu, Z.; Zhao, W.; Jia, N.; Liu, X.; Yang, J. SANet: Scale-adaptive network for lightweight salient object detection. Intell. Robot. 2024, 4, 503–523. [Google Scholar] [CrossRef]
  34. Yang, C.; Yang, S.; He, Y.; Fan, L.; Gao, X.; Tang, M.; Sun, J. Research on defect detection performance of silicon carbide wafer surface based on ESN-YOLOv8 algorithm. Comput. Mater. Sci. 2026, 268, 114656. [Google Scholar] [CrossRef]
  35. Fan, L.; He, Y.; Mo, Y.; Cao, Y. An interpretable ensemble machine learning model for predicting carbon dioxide adsorption on magnesium oxide-based sorbents. Environ. Res. 2026, 297, 124126. [Google Scholar] [CrossRef] [PubMed]
  36. Chen, J.; Shao, Z.; Zhu, H.; Chen, Y.; Li, Y.; Zeng, Z.; Yang, Y.; Wu, J.; Hu, B. Sustainable interior design: A new approach to intelligent design and automated manufacturing based on Grasshopper. Comput. Ind. Eng. 2023, 183, 109509. [Google Scholar] [CrossRef]
  37. Wu, X.; Dong, J.; Bao, W.; Zou, B.; Wang, L.; Wang, H. Augmented intelligence of things for emergency vehicle secure trajectory prediction and task offloading. IEEE Internet Things J. 2024, 11, 36030–36043. [Google Scholar] [CrossRef]
  38. Zhang, J.; Song, X.; Li, Y.; Liang, D.; Zhang, Z.; Cai, J. Adaptive dual cross-attention network for multispectral object detection in autonomous driving. Expert Syst. Appl. 2026, 318, 132012. [Google Scholar] [CrossRef]
  39. Zhang, J.; Xiang, M.; Hu, Y.; Hao, W.; Lei, L.; Yi, K. Multivariate feature learning and associative spatial information enhancement for snow object detection in autonomous driving. Eng. Appl. Artif. Intell. 2026, 175, 114672. [Google Scholar] [CrossRef]
  40. Jiao, R.; Zhang, J.; Li, C.; Hu, L. Large-kernel spatially parallel feature fusion for monocular 3D perception in autonomous driving. Knowl.-Based Syst. 2026, 343, 115998. [Google Scholar] [CrossRef]
  41. Khosla, P.; Teterwak, P.; Wang, C.; Sarna, A.; Tian, Y.; Isola, P.; Maschinot, A.; Liu, C.; Krishnan, D. Supervised contrastive learning. Adv. Neural Inf. Process. Syst. 2020, 33, 18661–18673. [Google Scholar] [CrossRef] [PubMed]
  42. Xie, Z.; Zhang, Z.; Cao, Y.; Lin, Y.; Bao, J.; Yao, Z.; Dai, Q.; Hu, H. Simmim: A simple framework for masked image modeling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 21–24 June 2022; pp. 9653–9663. [Google Scholar]
  43. Li, M.; Xu, P.; Li, C.G.; Guo, J. MaskCL: Semantic mask-driven contrastive learning for unsupervised person re-identification with clothes change. arXiv 2023, arXiv:2305.13600. [Google Scholar]
  44. He, M.; Qin, L.; Deng, X.; Liu, K. MFI-YOLO: Multi-fault insulator detection based on an improved YOLOv8. IEEE Trans. Power Deliv. 2023, 39, 168–179. [Google Scholar] [CrossRef]
  45. Cui, Y.; Ren, W.; Cao, X.; Knoll, A. Image restoration via frequency selection. IEEE Trans. Pattern Anal. Mach. Intell. 2023, 46, 1093–1108. [Google Scholar] [CrossRef] [PubMed]
  46. Huang, S.; Lu, Z.; Cun, X.; Yu, Y.; Zhou, X.; Shen, X. DEIM: DETR with Improved Matching for Fast Convergence. arXiv 2024, arXiv:2412.04234. [Google Scholar]
  47. Qiu, Y.W.; Zhang, K.; Wang, C.; Luo, W.; Li, H.; Jin, Z. Mb-taylorformer: Multi-branch efficient transformer expanded by taylor formula for image dehazing. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France, 2–6 October 2023; pp. 12802–12813. [Google Scholar]
  48. Fan, J.; Li, X.; Qian, J.; Li, J.; Yang, J. Non-aligned supervision for real image dehazing. arXiv 2023, arXiv:2303.04940. [Google Scholar]
  49. Liu, K.X.; Zhang, Y.; Li, W.; Wang, J. Image Dehazing Technique Based on DenseNet and the Denoising Self-Encoder. Processes 2024, 12, 2568. [Google Scholar] [CrossRef]
  50. Cui, Y.; Ren, W.; Knoll, A. Omni-kernel network for image restoration. Proc. AAAI Conf. Artif. Intell. 2024, 38, 1426–1434. [Google Scholar] [CrossRef]
  51. Zhang, Y.; Zhou, S.; Li, H. Depth information assisted collaborative mutual promotion network for single image dehazing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 16–22 June 2024; pp. 2846–2855. [Google Scholar]
  52. He, K.; Chen, X.; Xie, S.; Li, Y.; Dollár, P.; Girshick, R. Masked autoencoders are scalable vision learners. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 18–24 June 2022; pp. 16000–16009. [Google Scholar]
  53. Chen, M.; Radford, A.; Child, R.; Wu, J.; Jun, H.; Luan, D.; Sutskeve, I. Generative pretraining from pixels. In Proceedings of the International Conference on Machine Learning, PMLR, Virtual, 13–18 July 2020; pp. 1691–1703. [Google Scholar]
  54. Bao, H.; Dong, L.; Piao, S.; Wei, F. Beit: Bert pre-training of image transformers. arXiv 2021, arXiv:2106.08254. [Google Scholar]
  55. Caron, M.; Touvron, H.; Misra, I.; Jégou, H.; Mairal, J.; Bojanowski, P.; Joulin, A. Emerging properties in self-supervised vision transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada, 10–17 October 2021; pp. 9650–9660. [Google Scholar]
  56. Liu, S.; Qi, L.; Qin, H.; Shi, J.; Jia, J. Path aggregation network, for instance, segmentation. In Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA; IEEE Press: Piscataway, NJ, USA, 2018; pp. 8759–8768. [Google Scholar]
  57. Xie, W.; Yang, H.; Shi, L.; Liu, Z. MTA-Net: A One-stage Detector Based on a Multi-scale Task-aligned Network for Catenary Support Components. IEEE Trans. Instrum. Meas. 2024, 73, 5020413. [Google Scholar] [CrossRef]
  58. Yang, H.; He, J.; Liu, Z.; Zhang, C. LLD-MFCOS: A Multiscale Anchor-Free Detector Based on Label Localization Distillation for Wheelset Tread Defect Detection. IEEE Trans. Instrum. Meas. 2023, 73, 5003815. [Google Scholar] [CrossRef]
  59. Quan, Y.; Zhang, D.; Zhang, L.; Tang, J. Centralized feature pyramid for object detection. IEEE Trans. Image Process. 2023, 32, 4341–4354. [Google Scholar] [CrossRef] [PubMed]
  60. Cai, Z.W.; Vasconcelos, N. Cascade R-CNN: High-quality object detection and instance segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2021, 43, 1483–1498. [Google Scholar] [CrossRef] [PubMed]
  61. Tao, W.Y.; Feng, A. ATSS-driven surface flame detection and extent evaluation using edge computing on UAVs. IEEE Access 2023, 11, 72108–72119. [Google Scholar] [CrossRef]
  62. Zhang, H.; Li, F.; Liu, S.; Zhang, L.; Su, H.; Zhu, J.; Shum, H.Y. DINO: DETR with Improved denoising anchor boxes for end-to-end object detection. In Proceedings of the Eleventh International Conference on Learning Representations (ICLR), Kigali, Rwanda, 1–5 May 2023. [Google Scholar] [CrossRef]
  63. Cai, Z.; Liu, S.; Wang, G.; Ge, Z.; Zhang, X.; Huang, D. Align-DETR: Improving DETR with simple IoU-aware BCE loss. arXiv 2023. [Google Scholar] [CrossRef]
  64. Jia, D.; Yuan, Y.; He, H.; Wu, X.; Yu, H.; Lin, W.; Hu, H. DETRs with hybrid matching. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada; IEEE Press: Piscataway, NJ, USA, 2023; pp. 19702–19712. [Google Scholar]
  65. Zhang, S.; Wang, X.; Wang, J.; Pang, J.; Lyu, C.; Zhang, W.; Chen, K. Dense distinct query for end-to-end object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada; IEEE Press: Piscataway, NJ, USA, 2023; pp. 7329–7338. [Google Scholar]
  66. Khanam, R.; Hussain, M. Yolov11: An overview of the key architectural enhancements. arXiv 2024, arXiv:2410.17725. [Google Scholar]
  67. Tian, Y.; Ye, Q. Doermann, DYolov12: Attention-centric real-time object detectors. arXiv 2025, arXiv:2502.12524. [Google Scholar]
  68. Zhao, Y.; Lv, W.; Xu, S.; Wei, J.; Wang, G.; Dang, Q.; Chen, J. Detrs beat yolos on real-time object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 16–22 June 2024; pp. 16965–16974. [Google Scholar]
Figure 1. The structural diagram of FF-DEIM. The overall process involves image processing to remove interference, pretraining the images using MIMCL, and finally using FF-DEIM for detection.
Figure 1. The structural diagram of FF-DEIM. The overall process involves image processing to remove interference, pretraining the images using MIMCL, and finally using FF-DEIM for detection.
Sensors 26 05000 g001
Figure 2. The structural diagram of DCFNet.
Figure 2. The structural diagram of DCFNet.
Sensors 26 05000 g002
Figure 3. The structural diagram of MIMCL.
Figure 3. The structural diagram of MIMCL.
Sensors 26 05000 g003
Figure 4. The structural diagram of FFPN.
Figure 4. The structural diagram of FFPN.
Sensors 26 05000 g004
Figure 5. Visualization of the inspection UAV and the collected original, fog, and rain images.
Figure 5. Visualization of the inspection UAV and the collected original, fog, and rain images.
Sensors 26 05000 g005
Figure 6. The distribution statistics of UAV datasets.
Figure 6. The distribution statistics of UAV datasets.
Sensors 26 05000 g006
Figure 7. The visual analysis of dehazing results across different methods.
Figure 7. The visual analysis of dehazing results across different methods.
Sensors 26 05000 g007
Figure 8. Training convergence of the proposed modules based on total loss.
Figure 8. Training convergence of the proposed modules based on total loss.
Sensors 26 05000 g008
Figure 9. The visualization of the heatmap in different layers.
Figure 9. The visualization of the heatmap in different layers.
Sensors 26 05000 g009
Figure 10. The visual analysis of FF-DEIM.
Figure 10. The visual analysis of FF-DEIM.
Sensors 26 05000 g010
Figure 11. The visual analysis with different methods.
Figure 11. The visual analysis with different methods.
Sensors 26 05000 g011
Table 1. Comparative experiments for image dehazing methods.
Table 1. Comparative experiments for image dehazing methods.
MethodsPSNRSSIMParams/MFLOPS/G
MB-Talyor [47]19.520.6057.4344.05
NSDNet [48]21.830.61111.3856.86
DAE-Net [49]21.220.5743.6532.23
OKNet [50]21.430.6344.7239.67
DCMPNet [51]19.930.5977.1662.89
DCFNet (Ours)22.560.82613.3253.40
Table 2. The results of ablation experiments.
Table 2. The results of ablation experiments.
ModuleAccuracySpeed
MIMCLFFPNDense O2OmAP50mAP50–95mARFPS
0.9790.6520.97124.1
0.9870.7030.98323.5
0.9820.6740.97423.8
0.9840.6830.97622.6
0.9890.7270.98721.8
0.9900.7340.98822.2
0.9920.7550.99120.9
Table 3. Comparative experiments for self-supervised learning methods.
Table 3. Comparative experiments for self-supervised learning methods.
SLmAPAP50AP75APsAPmAPl
MAE [52]67.9196.4477.962.6172.6482.55
IGPT [53]71.9896.9477.5465.5173.0882.92
SimMIM [42]72.1896.5777.3464.6272.4282.76
BEIT [54]74.3197.3378.5165.6874.2983.54
DINO [55]73.3298.2378.3165.5473.4783.11
MIMCL (ours)75.5399.2780.2365.7172.3287.34
Table 4. Analysis of feature pyramid network.
Table 4. Analysis of feature pyramid network.
MethodsmAPAP50AP75APsAPmAPl
FPN60.4194.2867.3359.2470.6281.39
PA-FPN [56]61.4693.2167.7660.9669.9580.07
NAS-BFPN [57]61.7394.0168.1660.5968.6180.72
CR-FPN [58]62.4793.9368.8460.7171.0381.39
CFP [59]65.4594.8173.9664.3272.4683.95
FFPN (ours)67.4395.5475.2665.8875.0883.07
Table 5. Comparative experiments for classic detection methods.
Table 5. Comparative experiments for classic detection methods.
MethodsmAPAP50AP75APsAPmAPlPa/MFLOPs/GFPS
Dynamic RCNN 58.3391.8362.5856.9762.6378.1741.41197.716.2
Cascade RCNN [60]56.8791.4162.6353.1662.3776.5869.19225.414.8
ATSS [61]57.7392.9361.8556.9665.5177.6932.14192.415.6
DINO [62]62.8794.0868.9361.5871.5881.9247.56265.615.5
Align-DETR [63]64.2594.5871.5860.8370.1381.5447.51253.815.1
HDINO [64]63.7694.1070.7860.1269.4980.8368.10281.416.5
DDQ (DETR) [65]63.4494.1871.4761.2570.4282.4265.75852.515.4
YOLOv11-L [66]66.2895.2175.2463.5373.2483.4325.3287.332.6
YOLOv12-L [67]67.7494.7973.5763.9873.8283.3826.4289.530.7
RT-DETR [68]65.2797.9272.2962.0173.0682.8442.14125.723.2
FF-DEIM (ours)75.5399.2780.2365.7172.3285.3467.35153.320.9
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhang, L.; Huang, J.; Qin, G.; Cao, J.; Fan, F.; Wang, H.; Yang, H. FF-DEIM: DEIM with Image Dehazing and Self-Supervised Pretraining for Catenary Support Component Detection. Sensors 2026, 26, 5000. https://doi.org/10.3390/s26155000

AMA Style

Zhang L, Huang J, Qin G, Cao J, Fan F, Wang H, Yang H. FF-DEIM: DEIM with Image Dehazing and Self-Supervised Pretraining for Catenary Support Component Detection. Sensors. 2026; 26(15):5000. https://doi.org/10.3390/s26155000

Chicago/Turabian Style

Zhang, Lingzhi, Jinyong Huang, Guojin Qin, Jincheng Cao, Fei Fan, Hui Wang, and Haonan Yang. 2026. "FF-DEIM: DEIM with Image Dehazing and Self-Supervised Pretraining for Catenary Support Component Detection" Sensors 26, no. 15: 5000. https://doi.org/10.3390/s26155000

APA Style

Zhang, L., Huang, J., Qin, G., Cao, J., Fan, F., Wang, H., & Yang, H. (2026). FF-DEIM: DEIM with Image Dehazing and Self-Supervised Pretraining for Catenary Support Component Detection. Sensors, 26(15), 5000. https://doi.org/10.3390/s26155000

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop