1. Introduction
With the rapid development of smart grids, not only has the coverage of power transmission lines expanded, but their operational safety has been directly linked to the stability of the power system. Foreign objects attached to power transmission lines (such as kites and birds’ nests) can easily cause short circuits and tripping, damage to equipment, or even localised grid failures; therefore, the timely and accurate detection of foreign objects on power transmission lines is of great significance [
1,
2,
3]. Traditional inspection methods rely primarily on manual checks, which are not only labour-intensive and inefficient but are also constrained by factors such as inspection distance, viewing angles, and image quality, making it difficult to meet the demands of large-scale, routine inspections [
4,
5]. In recent years, with the development of unmanned aerial vehicle (UAV) platforms and computer vision technology, power transmission line inspections have gradually shifted from traditional manual methods to intelligent visual inspection methods [
5,
6,
7,
8]. Multi-fault insulator detection based on an improved. Visual inspection refers to a class of technologies that utilise image or video data to automatically achieve target recognition, localisation and classification through algorithms.
In the field of visual detection tasks, relevant intelligent algorithms have gradually evolved from early traditional methods reliant on manually defined features to end-to-end detection frameworks based on deep learning. Especially in the domain of object detection, deep learning methods have demonstrated significant advantages in feature extraction, multi-scale representation, and the recognition of small objects, providing effective support for automated detection in complex industrial settings. With regard to foreign object detection on power transmission lines, existing research has made significant progress in optimising backbone networks, lightweight design, and the incorporation of attention mechanisms, thereby effectively enhancing detection accuracy and model efficiency [
4,
9,
10,
11,
12,
13].
However, although existing methods have effectively improved the detection performance of foreign objects on power transmission lines, complex and adverse weather conditions pose even more severe challenges to drone inspections. Power transmission lines frequently traverse mountainous and high-altitude regions, which are often plagued by haze and torrential rain [
14,
15,
16]. Under these adverse conditions, optical sensors suffer severe visual degradation, where atmospheric scattering caused by haze significantly reduces image contrast, whilst directional rain streaks obscure the geometric textures of transmitted components [
17,
18,
19,
20]. Models trained on datasets from clear weather conditions experience a rapid decline in detection performance when faced with adverse environments, rendering them unsuitable for reliable deployment in real-world scenarios. Existing research typically improves detection performance in adverse weather conditions by cascading fog or rain removal modules in front of the detector, or by directly enhancing the detector’s feature extraction capabilities [
21,
22]. Although these methods mitigate the impact of complex environments to some extent, most approaches still treat complex weather conditions as uniform visual noise in the spatial domain, and have not yet fully accounted for the fundamental differences in the physical degradation mechanisms between haze and rainfall.
To investigate this physical essence, we have moved beyond the traditional spatial domain to conduct an in-depth analysis of the visual degradation caused by adverse weather conditions from the frequency domain. As shown in
Figure 1, we compare the spectral plots of a clear power line image, a synthetic haze image, and a synthetic rain-affected image. It can be seen from
Figure 1 that, compared to the clear image, haze causes attenuation of high-frequency signal energy at the periphery, with energy concentrated more in the central low-frequency region. This also illustrates that atmospheric scattering caused by haze is essentially a form of contrast attenuation, obscuring the texture of the target. In contrast, the spectral analysis of rain streaks not only fails to attenuate high-frequency components but actually amplifies high-frequency rays orthogonal to the physical direction of raindrops’ descent, constituting a form of destructive high-frequency noise.
There have already been some studies on the application of frequency-domain methods for object detection in adverse weather conditions. Chen et al. proposed a module called AStem, which formed a dual-path network by integrating a dual-attention mechanism with the Fast Fourier Transform (FFT), enabling the network to preserve more critical local details. Compared to traditional convolutional architectures, this approach improved detection accuracy by 2.7% in rainy and snowy conditions [
23]. Chen et al. proposed the SMWG-DETR method, which is guided by Fourier spectral modulation and wavelets. This method first utilised the Fourier spectrum to extract key frequency components, then applied the Discrete Wavelet Transform (DWT) to low-level feature maps to obtain low- and high-frequency information, which in turn guided the upsampling process of high-level feature maps; this method demonstrated robust detection performance [
24]. However, traditional transformation methods such as FFT and DWT lack translation invariance, making it difficult to preserve the structural phase information of the target without introducing artefacts. Furthermore, purely data-driven feature extractors suffer from a ‘black-box’ problem, lacking physical interpretability.
To address this issue, we propose the following hypothesis: if we can integrate physical prior knowledge of atmospheric within a translation-invariant complex wavelet domain, we can develop an efficient and interpretable solution for detecting foreign objects on power transmission lines in adverse weather conditions. Based on this concept, this paper proposes a novel, plug-and-play Physics-Prior Complex Wavelet Unrolling Decoupling Module (PCW-UDM). First, we utilise the two-dimensional double-tree complex wavelet transform (2D-DTCWT) to decouple degraded image features into low-frequency signals and complex high-frequency sub-band signals. The low-frequency signal branch suppresses global haze effects using a physics-guided algorithm for estimating transmittance and atmospheric light, whilst the high-frequency signal branch eliminates directional rain streaks by expanding the traditional iterative threshold contraction method into a learnable neural network.
The main contributions of this paper are summarised as follows:
- (1)
We propose a novel feature-level decoupling module, PCW-UDM, for the task of detecting foreign objects on power transmission lines under adverse weather conditions. This module seamlessly integrates signal processing theory with deep learning techniques, thereby effectively avoiding the semantic conflicts caused by traditional image restoration methods.
- (2)
We introduce the Physics-Guided Low-Frequency Dehazing (PGLD) branch and the LISTA-Unrolled High-Frequency Deraining (LUHD) branch. To the best of our knowledge, this marks the first instance of extending sparse optimisation algorithms to the complex wavelet domain, enabling robust detection under adverse weather conditions.
- (3)
We design a cross-domain consistency loss function. This ensures that the frequency amplitude and spatial features of images affected by adverse weather conditions remain consistent with those of their corresponding clear images, enabling the network to learn weather invariance.
- (4)
We have collected two synthetic datasets and conducted comprehensive comparative experiments and ablation studies on them. The experimental results demonstrate that our method outperforms current state-of-the-art detectors in the detection of foreign objects on power transmission lines under adverse weather conditions.
3. Methodology
To address the challenge of robust detection of foreign objects on power transmission lines in rainy and hazy conditions, this paper proposes a Physics-Prior Complex Wavelet Unrolling Decoupling Module (PCW-UDM). Rather than performing pixel-level restoration on traditional images, this module is embedded as a plug-and-play feature component within multi-scale features. As shown in
Figure 1, the PCW-UDM ingeniously utilises the translational invariance and multi-directional selectivity of the B-tree complex wavelet transform to decouple the complex visual degradation problem into low-frequency haze signals and high-frequency rain streak signals, which are then reconstructed using corresponding physical prior models and deep expansion algorithms.
3.1. Overall Network Architecture
As shown in
Figure 2, the left-hand side illustrates the multi-scale feature extraction scheme, which employs the classic ResNet50 as the backbone module and a feature pyramid to extract multi-scale semantic feature maps. For images containing rain and haze, these feature maps contain strong atmospheric attenuation and directional rain streak noise; therefore, we embed the proposed PCW-UDM into the feature processing stage of the deep network.
Specifically, the feature maps generated at each scale are fed into the PCW-UDM. The PCW-UDM first employs a 2D DWDCT to downsample the feature maps whilst decomposing them into a low-frequency component and six complex high-frequency components in different directions. The generated low-frequency signal is fed into the PGLD module, which first estimates the spatial transmittance map and the global atmospheric light vector in parallel before inputting these into the inverse atmospheric scattering model to derive an estimated clear low-frequency background; the generated high-frequency signal is then fed into the LUHD module, where each angle is decomposed into amplitude and phase signals. Here, the phase signal is frozen and bypassed, whilst the amplitude signal is fed into an iterative thresholding algorithm with deep unfolding to obtain a clean high-frequency amplitude signal stripped of rain streak noise. This is then combined with the phase signal using Euler’s formula to generate new high-frequency edges. Finally, the low-frequency and high-frequency signals obtained from these two modules are transformed back into the spatial domain via a dual-tree complex wavelet inverse transform. They are then superimposed onto the original input features via residual interpolation to produce the final feature map, which is fed into the detection head.
3.2. Physics-Guided Low-Frequency Dehazing (PGLD)
The 2D-DTCWT procedure involves downsampling and filtering real and imaginary trees based on the input’s features at different scales, yielding four sets of real sub-bands
and
. The low-frequency components ensure translation invariance by taking the average of the two trees:
The high-frequency components are combined directionally to form complex coefficients:
where
i is the imaginary unit.
The low-frequency signal
obtained after 2D-DTCWT decoupling retains the image’s global illumination and contrast attenuation caused by haze. As shown in
Figure 1, haze primarily causes a shift in concentration of low-frequency energy whilst suppressing high-frequency signals. Therefore, we have not employed conventional black-box convolution for fitting here, instead utilising a classical atmospheric scattering model introduced into the feature space to physically model the degradation process:
where
denotes the clean low-frequency features we aim to obtain,
A represents the global atmospheric light feature, T is the spatial transmittance map, and
denotes element-wise multiplication.
To solve this inverse problem, PGLD employs two parallel lightweight parameter estimation sub-networks to estimate T and A, and then reconstructs the clean features via the inverse atmospheric scattering model.
(1) Estimate T
As shown in
Figure 3, in the Estimate T module, we first feed the low-frequency features into this sub-network. To maintain a local receptive field whilst significantly reducing computational complexity, we first apply a 3 × 3 deep separable convolution, followed by 1 × 1 pixel-wise convolution to perform cross-channel dimensionality reduction, and finally we normalise the output range using a Sigmoid activation function:
where
denotes deep separable convolution and
denotes the Sigmoid activation function.
(2) Estimate A
As shown in
Figure 4, in the Estimate A module, we first use global average pooling to compress the spatial dimensions from
to
, thereby extracting global information. This vector is then fed into a two-layer multi-layer perceptron to facilitate high-order non-linear interactions between channels, followed by normalisation using the Sigmoid activation function:
where
denotes global average pooling.
(3) Inverse Atmospheric Scattering Model Reconstruction (IASM)
After obtaining the clean transmittance map
T and atmospheric light vector
A through the above steps, the IASM module is employed to generate the purified low-frequency features
.
Here, represents a very small lower bound for the constant, primarily to prevent T from tending towards 0 when haze concentration is extremely high, which would cause a division-by-zero error in the above equation.
Through the proposed PGLD branch, the network can eliminate low-frequency haze interference under strong supervision without requiring any real reference clear images, relying solely on the hard constraints imposed by physical equations.
3.3. LISTA-Unrolled High-Frequency Deraining (LUHD)
The six high-frequency components obtained after 2D-DTCWT decomposition not only contain edge information of foreign objects but also incorporate directional high-frequency noise generated by heavy rain. Conventional spatial-domain convolution struggles to filter out these rain streaks without blurring the edges; therefore, we have designed the LUHD branch to remove rain streaks whilst preserving edges in the complex polar domain. This involves the following steps.
(1) Magnitude–Phase Separation and Phase Freezing
The essence of complex high-frequency features is that the magnitude represents the intensity of the edge, whilst the phase records the spatial position and orientation of the edge. As shown in the LUHD module in
Figure 2, we first convert the complex tensor
for each direction into polar coordinates by extracting its magnitude and phase:
To avoid introducing any spatial shifts or geometric distortions during the rain removal process, we freeze the phase information so that it does not participate in training. As indicated by the dotted arrows in
Figure 2, the phase is bypassed and does not contribute to the update of any network parameters; all rain removal operations are applied solely to the contaminated magnitude.
(2) LISTA-Unrolled Magnitude Purification
As can be seen from
Figure 1, rain streaks exhibit high sparsity in specific high-frequency information. Inspired by this, we model the process of separating clean edges from the contaminated magnitude as a classical sparse coding LASSO optimisation problem:
Since traditional iterative shrinkage algorithms require a significant amount of time to terminate the iteration when solving this optimisation problem, they cannot be applied to the engineering context of UAV inspections. We therefore introduce deep unrolling techniques here, unfolding the mathematical iteration process into a learnable feedforward neural network comprising K layers. The specific structure is shown in
Figure 5.
Setting the initial state as
, the update of the amplitude tensor in the
k-th expansion layer of the LISTA module strictly follows the following formula:
where
and
denote the learnable 3 × 3 convolutional filters in the
k-th layer, which replace the predefined analytical dictionary matrix required in traditional algorithms; and
is a non-linear soft-threshold activation function, in which
is an adaptive threshold parameter learned via a Connection Attention Module (CAM) through a
channel, allowing for dynamic adaptation to the intensity of rain streaks in different image regions. The specific CAM structure is shown in
Figure 6.
After K layers of expansion, the network outputs a clean amplitude estimate
that has been stripped of rain streak noise.
is then combined with the previously frozen original phase
using Euler’s formula to reconstruct the clean high-frequency information component in the complex plane, as shown in the following formula:
Finally, the
output from the PGLD branch and the six directional
components output from the LUHD branch are jointly fed into a two-dimensional dual-tree complex wavelet inverse transform to restore the resolution of the original space, and the final features are obtained via residual interpolation:
3.4. Joint Loss Function
To ensure that the PCW-UDM proposed in this paper can effectively decouple contaminated images and that the reconstructed features can serve the downstream detection head, we have designed a spatio-temporal cross-domain consistency optimisation strategy comprising three components: the object detection loss
, the spatial feature consistency loss
, and the frequency-domain amplitude consistency loss
.
where λ
1 and λ
2 are the weight hyperparameters for
and
, respectively. In this paper, the parameters are set to 0.2 and 0.05.
(1) Spatial Consistency Loss
As real-world adverse weather images lack paired clean images to serve as supervision, we utilise a frozen teacher network during the training phase to extract features
from clear images, which can serve as the ideal constraint benchmark for the spatial dimension. For the purified features
reconstructed by the PCW-UDM from the teacher network, we calculate the Euclidean distance between the two using the mean squared error. This loss function ensures that the image features after haze or rain removal align spatially and semantically with those of the clean image:
(2) Frequency-domain consistency loss
Relying solely on spatial absolute value constraints makes it difficult to detect residual low-frequency background signals from incomplete dehazing and residual high-frequency micro-oscillations from rain removal. We therefore innovatively introduce a frequency-domain alignment mechanism, utilising a two-dimensional Fast Fourier Transform (FFT) to map spatial features to frequency-domain features and obtain the corresponding amplitude spectrum:
To ensure the network can accurately remove the directional high-frequency signals caused by rain streaks in the frequency domain, we constrain the modulated
to converge towards
. Here, we have chosen the
norm over the
norm, as the
norm exhibits greater robustness to high-frequency fluctuations [
54].
(3) Object Detection Loss
The object detection loss comprises bounding box regression loss and classification loss:
where
and
represent the classification loss and regression loss, respectively.
4. Experiments and Analysis
4.1. Datasets and Implementation Details
4.1.1. Datasets
In real-world power line scenarios, it is difficult to obtain paired aerial images showing both adverse weather conditions and clear conditions from the same viewpoint; consequently, this work is currently carried out using physical models for synthesis. Following this approach, this paper has generated two datasets: the Single-Adverse Dataset and the Multi-Adverse Dataset.
Single-Adverse Dataset: This dataset was primarily sourced from publicly available material on the internet and images captured by our own drones. A total of 1000 images were compiled, with a training:test:validation ratio of 8:1:1. This dataset contains only one type of foreign object: bird nests.
Multi-Adverse Dataset: This dataset was also sourced from the internet and captured using drones, resulting in 4500 images. The dataset is divided into training, test, and validation sets in a ratio of 8:1:1, and contains four types of foreign objects: bird nests, kites, balloons, and rubbish.
For the synthesis of haze images, we selected a classic atmospheric scattering model, as shown in Equation (1), where
and
is the atmospheric scattering coefficient. Following the work of Feng et al., we selected
and
[
55]. We employed the Depth Anything v2 algorithm proposed by Yang et al. for monocular depth estimation [
56].
Figure 7 displays the synthetic haze images generated for the two datasets at different haze concentrations.
For the synthetic images of rainy weather, real-world rainfall is often accompanied by water vapour. We first generate a water vapour background accompanying the rainfall using the depth map and a scattering coefficient within a specified range. We then generate random noise using a predefined raindrop density distribution and apply motion blur kernels of varying sizes and descent angles, thereby generating highly directional high-frequency rain streaks.
Figure 8 shows examples of the synthetic rainy-day images generated for the two datasets.
4.1.2. Implementation Details
The method proposed in this paper and all comparison methods were evaluated under a unified experimental setup, with FCOS selected as the baseline detector and ResNet50 as the backbone network; the input image size was set to 640 × 640. We followed the standard ‘schedule_1x’ training configuration from MMDetection, with all models trained for 12 epochs. The training process utilised SGD, with an initial learning rate set to 0.01. The experiments in this paper were implemented on a workstation equipped with a single NVIDIA RTX 4090 (24GB VRAM) GPU, using the PyTorch 2.0 framework.
Regarding the key module parameters of the proposed method, the LISTA expansion step count was set to three, and the weights for the spatial consistency loss and frequency-domain consistency loss were set to 0.2 and 0.05, respectively. The teacher network acquires features at various scales from the clean dataset, whilst the remaining components do not participate in any training.
To verify the robustness of this algorithm against the inherent variance in deep learning, we report quantitative results obtained from three independent runs of key comparison methods, each using a different random seed. These results are presented in the form of ‘mean ± standard deviation’. Details are shown in
Table 1 and
Table 2.
4.2. Comparison with State-of-the-Art
We selected FCOS as the baseline detection framework. Based on current state-of-the-art strategies, we categorised existing methods into the following three classes: (1) Direct—no image restoration or enhancement is performed, and the detector is used directly for training and testing. This strategy includes Baseline-1, trained solely on clear weather data, and Baseline-2, trained on mixed weather data. (2) Separate—a separated cascade paradigm of restoration followed by detection is adopted. This paper selects the state-of-the-art dehazing network FFA-Net [
57] and the deraining network MPRNet [
58] as enhancement modules, respectively, and then cascades them with FCOS to form two sets of comparison methods. (3) Union—adverse weather feature enhancement is jointly optimised with the object detection task. This category includes IA-YOLO and DS-Net, which are designed for adverse weather, as well as the proposed PCW-UDM+FCOS. All experiments employ mAP@0.5 as the evaluation metric, reporting the detection accuracy of various methods on the clean, hazy, and rainy test sets.
4.2.1. Results on Single-Adverse Dataset
Table 1 presents a comparison of our proposed method with several other state-of-the-art methods. It is worth noting that, as the Single-Adverse Dataset contains only one type of foreign object (bird nests), the overall scenes are relatively simple, and the dataset consists predominantly of images featuring bird nests; consequently, the overall performance of different methods on this dataset is relatively high.
As can be seen from
Table 1, adverse weather conditions have a significant impact on object detection. Baseline-1, trained solely on the sunny dataset, achieved a precision of 91.5% on the clean dataset; however, due to atmospheric degradation, its performance on the hazy and rainy test sets dropped to 72.8% and 75.1%, respectively. This indicates that without supervision from adverse weather samples, the features learned by this model are unable to accurately detect objects in images with reduced contrast and directional stripe interference. Baseline-2, trained on mixed weather data, improved to 80.9% and 82.4% under hazy and rainy conditions, respectively, suggesting that incorporating adverse weather samples into training can mitigate the domain shift issue to some extent. However, the detection accuracy of this approach under clean conditions dropped to 88.6%, which is lower than Baseline-1′s 91.5%, indicating that simply using data mixing for robustness training comes at the expense of some detection performance under normal weather conditions.
The Separate strategy did not perform well here, as the Sep-1 model achieved an accuracy of 81.6% under hazy conditions, which is only 0.7% higher than Baseline-2. The Sep-2 model achieved 81.2% under rainy conditions, which is not as effective as the Union method. This suggests that the separate paradigm of restoration followed by detection can improve image visibility to some extent, but the image restoration process may over-smooth image edges and texture structures, leading to a decline in detection performance under clean conditions.
The Union strategy demonstrated superior balance, as IA-YOLO and DS-Net outperformed the Separate methods under all three weather conditions. Although there was still some decline in accuracy under clean conditions, accuracy was significantly improved under hazy and rainy conditions, indicating that jointly optimising feature enhancement and the detection process can effectively mitigate the semantic drift caused by rainy and hazy weather. The PCW-UDM+FCOS method proposed in this paper achieved the best results across all conditions, reaching 91.2%, 88.1%, and 87.4% on the clean, hazy, and rainy test sets, respectively. Compared with the state-of-the-art runner-up method, DS-Net, our method achieved improvements of 3.3 and 2.1 percentage points under hazy and rainy conditions, respectively. The minimal standard deviation further proves that these gains are inherently driven by our architectural design rather than training variance. It should be noted that although the proposed method exhibits some performance degradation under adverse weather conditions, the extent of this decline is significantly smaller than that of other methods, indicating that the proposed method is more effective at extracting stable structural information that is unaffected by weather interference.
4.2.2. Results on Multi-Adverse Dataset
The Multi-Adverse Dataset contains four types of foreign objects, resulting in greater background complexity and larger scale contrast. Consequently, on this dataset, adverse weather conditions not only degrade the image features of the target itself but also introduce background interference, making detection more challenging.
Table 2 presents the experimental results of each method on this dataset.
As can be seen from
Table 2, when the detection task is expanded from single-class to multi-class, the detection performance of all models declines significantly, indicating that the detrimental impact of adverse weather on detectors is amplified in complex scenarios. The Baseline-1 model maintained a high detection accuracy of 88.7% under clean conditions, but achieved only 61.4% and 64.2% under hazy and rainy conditions, respectively, demonstrating a marked decline in performance. This indicates that complex multi-class scenarios severely impair the generalisation of models trained under clear conditions to adverse weather conditions. Baseline-2, through mixed-weather training, achieved a partial improvement in accuracy under hazy and rainy conditions, rising to 73.8% and 75.1%, respectively; however, its performance under clean conditions still dropped to 84.6%, indicating that the data mixing strategy struggles to strike a balance between different weather domains.
The Separate strategy exhibits greater limitations in multi-class scenarios, with Sep-1 and Sep-2 achieving average accuracies of only 74.0% and 74.3%, respectively, which is lower than Baseline-2. This suggests that in multi-class object detection tasks, image restoration tends to treat key textures of certain classes as noise and remove them, resulting in a decline in the detector’s ability to distinguish between different objects.
The performance of IA-YOLO and DS-Net under the Union strategy was generally superior to that of Direct and Separate. Specifically, DS-Net achieved 83.4%, 79.6%, and 80.2% under the three weather conditions, indicating that end-to-end joint optimisation can more effectively coordinate the relationship between adverse weather modelling and object detection. The method proposed in this paper also performs best in multi-class adverse weather scenarios, achieving 86.5%, 83.8%, and 84.1% under clean, hazy, and rainy conditions, respectively. The lead is particularly pronounced in rainy and hazy conditions, indicating that the proposed method can effectively separate low-frequency haze degradation from high-frequency rain streak interference in complex scenarios, significantly enhancing the stable recognition capability of multi-class objects.
4.2.3. Qualitative Visual Analysis
Figure 9 and
Figure 10 demonstrate the qualitative visual results of various methods across the two datasets. The first column of each figure shows the corresponding hazy or rainy image and its ground-truth bounding box, whilst the remaining columns display the corresponding response heatmaps for each method. The detection results also present the predicted bounding boxes and confidence scores.
As can be seen from
Figure 9, some samples in Baseline-1 and Baseline-2 exhibit obvious false positives or false negatives, with significant shifts in their heatmaps and generally low confidence scores. Sep-1, Sep-2, IA-YOLO, and DS-Net are able to enhance the response in the target region to some extent, but the overall response remains somewhat dispersed. Furthermore, as the high-response regions in some samples extend into the surrounding background, the improvement in detection confidence is limited. The method proposed in this paper demonstrates a more concentrated and distinct response near the target region, with relatively high confidence scores.
As can be seen from
Figure 10, as the number of classes and background complexity increase, the differences between the various methods become more pronounced. Overall, all methods are affected to varying degrees.
The Baseline method is most severely affected, with very weak target responses and significant localisation shifts. The Separate method still manages to improve performance effectively; however, when other objects appear in the background—such as drones—the model’s responses are easily disrupted, leading to heatmap diffusion and low confidence. IA-YOLO and DS-Net perform slightly better, but still suffer from insufficient feature concentration and low confidence scores. In contrast, our model achieves the best results in terms of both region localisation and confidence scores, demonstrating that our method can strongly suppress complex backgrounds and effectively mitigate the interference caused by rainy and hazy weather and complex backgrounds on feature representation.
Furthermore, to evaluate the performance of our algorithm in real-world adverse weather scenarios, we conducted qualitative experiments using a subset of the Real-Time Traffic Scenarios (RTTS) dataset [
60]. The specific test results are shown in
Figure 11. As can be seen from
Figure 11, when faced with real-world environments, the Direct strategy is significantly affected by image degradation caused by atmospheric scattering; although the overall features do not undergo major shifts, false positives and false negatives occur in most cases. The Separate strategy mitigates this situation to some extent, but it tends to concentrate features on high-confidence targets rather than distributing weights across each target. IA-YOLO and DS-Net also demonstrate strong robustness in real-world scenarios, successfully detecting the majority of targets; however, they still exhibit excessive shifts in heatmap features. Our method demonstrates the best robustness, as the introduction of the PCW-UDM module enables the model to restore the original frequency-domain features of the image to the greatest extent possible when faced with image degradation, resulting in the most balanced heatmap features and generally high confidence levels.
4.3. Robustness Analysis Under Different Weather Conditions
Figure 12 illustrates a comparison of detection performance on the Single-Adverse Dataset under varying degrees of image degradation. Three scenarios—mild, moderate, and severe—were constructed by altering the atmospheric light intensity and scattering coefficient for haze and rainfall, respectively.
As shown in
Figure 12, the Baseline-1 model in the Direct category exhibits a significant decline in performance under both types of weather degradation. Under hazy conditions, detection accuracy dropped from 79.5% in the mild scenario to 72.8% in the moderate scenario, and suffered a catastrophic decline to 64.0% in the severe scenario; under rainfall conditions, detection accuracy also exhibited a sharp decline. This indicates that models trained on clear weather data are highly sensitive to adverse weather conditions, and their detection capabilities deteriorate rapidly when images exhibit more severe haze or directional rain streaks. In contrast, the Baseline-2 model mitigated detection performance to some extent; however, under severe hazy and rainy conditions, accuracy still only reached 75.0% and 76.5%, respectively. This suggests that whilst it can alleviate some domain shift issues, it remains unsuitable as a general-purpose detection model.
The Sep-1 and Sep-2 methods within the Separate strategy still demonstrate relatively good detection performance under mild weather degradation; however, as weather conditions worsen, their performance declines rapidly. This indicates that the separated image enhancement methods can improve image visibility to a certain extent, but this improvement remains largely confined to the visual level, making it difficult to maintain stable detection capabilities under severely degraded conditions.
The methods within the Union strategy generally demonstrate greater stability. IA-YOLO and DS-Net exhibit significantly less performance degradation under heavy hazy and rainy conditions compared to the Direct and Separate strategies. Specifically, DS-Net’s accuracy drops from 88.5% to 80.5% under hazy conditions and from 89.0% to 81.0% under rainy conditions, demonstrating overall robust performance. This demonstrates that end-to-end joint optimisation of feature enhancement tasks can effectively mitigate performance variations caused by severe weather conditions.
The method proposed in this paper achieves optimal results under both hazy and rainy conditions. In hazy scenarios, the method achieves accuracy rates of 90.0%, 88.1% and 85.5%; conversely, in rainy conditions, our method achieved 89.5%, 87.4% and 85.2%, outperforming other state-of-the-art methods in terms of both accuracy and the magnitude of performance degradation. This demonstrates that as weather degradation intensifies, the advantage of our method over other approaches gradually increases.
4.4. Ablation Studies
In this section, we conduct ablation studies on our model using the Single-Adverse Dataset, focusing on different modules. This primarily includes: (1) combinations of different modules within PCW-UDM; (2) a comparison of the effectiveness of consistency loss and different weights; and (3) an ablation comparison of different frequency-domain methods.
(1) Analysis of the effectiveness of different modules in PCW-UDM
Table 3 illustrates the contribution of different modules in PCW-UDM to the model’s detection performance under adverse weather conditions. Detection performance is relatively low when using the baseline model. After introducing PGLD, the model’s detection accuracy in haze scenarios improves significantly, indicating that the low-frequency degradation modelling branch can effectively mitigate the problem of global contrast reduction caused by haze. The introduction of LUHD improves the model’s performance in rainy conditions, indicating that the high-frequency decoupling branch effectively suppresses directional noise interference introduced by rain streaks. When both PGLD and LUHD are introduced simultaneously, the model’s performance in hazy and rainy conditions shows a slight decline; however, its overall average performance still improves significantly, and the two modules exhibit a certain degree of complementarity in terms of weather degradation.
(2) Effectiveness of the Consistency Loss and Comparison of Different Weights
Table 4 illustrates the contribution of the consistency loss function to detection accuracy. As can be seen from the table, when using only the detection loss, the model achieved detection accuracies of 90.3%, 86.7%, and 86.3% under clean, hazy, and rainy conditions, respectively. After introducing
, the improvement under hazy conditions is particularly pronounced, with an increase of 0.9%, indicating that this loss effectively promotes semantic alignment between degraded and clear features. Upon introducing
, the accuracy under rainy conditions improves by 0.7%, indicating that this loss function can suppress frequency interference caused by rain streaks. The model achieves optimal performance when both consistency loss functions are applied together, demonstrating that spatial-domain constraints and frequency-domain constraints complement each other well.
Additionally, a hyperparameter sensitivity analysis was conducted for the weights of the two losses, with the specific results shown in
Figure 13. The analysis employed the method of controlled variables by varying
whilst keeping
fixed at 0.05, and varying
whilst keeping
fixed at 0.2. As can be seen from
Figure 13, as the weight parameters vary, the model performance within the selected parameter range shows a trend of first increasing and then decreasing. This indicates that the selected parameter range is reasonable, and that the optimal values are achieved at
and
; therefore, these two values are selected as the final parameters for this paper.
(3) Ablation Comparison of Different Frequency-Domain Methods
Table 5 illustrates the impact of different frequency-domain representations on detection performance, comparing the most common FFT and DWT methods with the DTCWT method selected in this study. As the FFT method cannot directly capture low- and high-frequency information, we employed a low-pass and high-pass filter mask to extract these components from the image; however, some information loss is inevitable. As can be seen from
Table 5, when FFT is used directly for frequency-domain modelling, the model’s detection accuracy decreases under various conditions. This indicates that, due to its lack of spatial locality, FFT struggles to reconstruct degraded features in local regions under complex weather conditions; naturally, the loss of information may also contribute to this issue. Following the introduction of DWT, model performance improved slightly, reaching 88.8%, 81.4%, and 82.8% under clean, hazy, and rainy conditions, respectively, with an average accuracy of 84.3%. This indicates that the Discrete Wavelet Transform can, to a certain extent, enhance the model’s local frequency-domain representation capability, although limitations remain. In contrast, the DTCWT utilised in this paper achieved the best results under all three weather conditions, as it not only preserves local information effectively but also exhibits stronger directional selectivity. The experimental results fully demonstrate that the reduced wavelet frequency-domain method adopted in this paper can effectively accomplish the object detection task in rainy and hazy weather conditions.
Figure 14 displays the amplitude distribution results of some samples under different frequency-domain transformation methods, illustrating clear reference features, degraded features, and the corresponding frequency-domain amplitude responses of FFT, DWT, and 2D-DTCWT. It can be seen from
Figure 14 that, for rainy or hazy images, the FFT distribution tends towards a global frequency response; however, due to poor local resolution, it struggles to capture the loss of low- and high-frequency information caused by haze and the directional interference of rain streaks. Compared to the degraded signal, the DWT shows almost no change; its limited frequency-domain discrimination capability results in no significant improvement. The frequency-domain amplitude distribution of the 2D-DTCWT exhibits greater consistency with the clear reference features. Although there remains a certain disparity in amplitude, both low-frequency and high-frequency information are preserved relatively well. More importantly, it demonstrates a stronger ability to characterise directional rain streaks; this is because the directionality of the high-frequency signals represented by the 2D-DTCWT itself is relatively complex, enabling it to better express rain streak information.
4.5. Computational Complexity Analysis
To assess the feasibility of our proposed method in meeting real-time requirements for UAV inspection scenarios, we compared the computational overhead of our method with that of baseline and state-of-the-art methods, specifically in terms of FLOPs, the number of parameters, and frames per second. To ensure fairness across all methods, all evaluations were conducted on an NVIDIA RTX 4090 GPU with an input resolution of 640 × 640.
As shown in
Table 6, due to the introduction of an additional image-level restoration network, the method employing a Separate cascading strategy results in significant computational redundancy, with FLOPs increasing to 324.5 G and 286.2 G, whilst the inference speed drops to approximately 28–31 FPS. In contrast, as our method achieves decoupling directly within the feature domain rather than performing full-resolution image reconstruction, it significantly alleviates this computational bottleneck. Compared to the FCOS baseline method, our approach adds only 1.1 million parameters and 13.1 GFLOPs whilst still maintaining a high inference speed of 41 FPS. This result demonstrates that our method can effectively meet the real-time requirements of power line inspection tasks whilst achieving the highest mAP scores, striking an optimal balance between detection accuracy and computational efficiency.
5. Discussion
Table 1 and
Table 2 demonstrate that the PCW-UDM algorithm proposed in this paper, when combined with the FCOS baseline model, achieves optimal detection performance on both single-class and multi-class adverse weather datasets, significantly outperforming existing Direct strategies, Separate cascade strategies, and Union optimisation algorithms such as IA-YOLO and DS-Net. Notably, the robustness analysis across different weather intensities shown in
Figure 12 indicates that, as hazy concentration and rainfall intensity increase, the detection accuracy of the baseline model and other advanced methods exhibits a precipitous decline, whereas the accuracy degradation of our method is markedly smaller. This remarkable robustness stems from our model’s departure from traditional pixel-level restoration in the spatial domain; instead, it decouples degraded signals from target features within a translation-invariant complex wavelet domain, thereby avoiding semantic conflicts between image restoration and lower-level detection tasks.
From a mechanistic perspective, the performance gains of PCW-UDM arise from the synergy of its core components. Specifically:
- (1)
The PGLD branch effectively mitigates low-frequency contrast attenuation and energy shifts caused by atmospheric scattering through physically guided algorithms for estimating transmittance and atmospheric light.
- (2)
The LUHD branch implements an iterative threshold contraction method as a neural network, precisely separating directional rain streak noise from high-frequency features whilst freezing phase information to prevent geometric distortion.
- (3)
Ablation experiments further demonstrate that combining these two modules with a spatio-temporal cross-domain consistency loss enables the network to maintain superior detection performance in complex cross-domain scenarios.
Furthermore, in terms of visualisation results, as shown in
Figure 9,
Figure 10 and
Figure 11, the algorithm proposed in this paper exhibits superior localisation accuracy and background interference suppression capabilities, both on synthetic datasets and on real-world RTTS adverse weather datasets. Compared to baseline models and other competing algorithms, which are prone to diffuse thermal responses, low confidence levels, and severe false positives and false negatives in complex backgrounds, PCW-UDM is able to focus attention more precisely on the target area; this powerful feature representation capability is attributed to the introduction of the two-dimensional dual-tree complex wavelet transform. Frequency-domain ablation experiments demonstrate that, compared to the FFT, which lacks spatial locality, and the DWT, which lacks translation invariance, the 2D-DTCWT is capable of both better preserving local information and exhibiting stronger directional selectivity.
Despite these advantages, we recognise that there is a trade-off between accuracy and computational complexity. Mapping spatial image features to the complex wavelet domain and applying deep decomposition algorithms inevitably increases parameter and computational overhead. However, given the vulnerability of purely data-driven models under extremely adverse weather conditions, the PCW-UDM proposed in this paper successfully achieves high-precision localisation and robust environmental adaptability under adverse weather conditions at an acceptable computational cost, providing an extremely reliable solution for foreign object detection on power transmission lines.
6. Conclusions
To address the issue of object feature displacement caused by severe visual degradation in UAV aerial images under adverse weather conditions, this paper proposes a novel feature-level Physics-Prior Complex Wavelet Unrolling Decoupling Module (PCW-UDM).
Based on the seamless integration of signal processing theory and deep learning, the PCW-UDM effectively overcomes the semantic conflict between image restoration and detection tasks inherent in traditional cascaded paradigms. Firstly, the method utilises the translation invariance and multi-directional selectivity of 2D-DTCWT to achieve deep decoupling of degraded features in the frequency domain. Secondly, the PGLD branch utilises a parallel, lightweight parameter estimation sub-network and an inverse atmospheric scattering model to reconstruct a clear low-frequency background, whilst the LUHD branch employs an iterative threshold contraction algorithm with deep expansion to strip away high-frequency rain streak noise in the complex polar coordinate domain which preserves the phase of the target edges. Through a specially designed spatio-temporal cross-domain consistency loss function, the model is capable of deep learning whilst maintaining alignment between the spatial semantics and frequency-domain amplitudes of the target.
Experimental results on the Multi-Adverse Dataset, which contains multiple types of foreign objects, demonstrate that the proposed method achieves mAPs of 86.5%, 83.8%, and 84.1% under clear, hazy, and rainy conditions, respectively, exhibiting superior stability across varying degradation intensities and significantly outperforming current joint optimisation methods. Furthermore, visualisation results on the real-world RTTS dataset further validate the module’s generalisation capability and false positive suppression ability.
Future research will explore the effectiveness of PCW-UDM under more severe and complex meteorological conditions. Concurrently, to address the computational overhead associated with the complex wavelet transform, we will further investigate lightweight network design strategies to meet the stringent requirements of edge computing devices and real-time inference on power transmission lines. Furthermore, we will continue to focus on collecting and processing datasets of an even higher standard, such as images of power lines captured over extended periods using fixed cameras in various weather conditions. This is because there are fundamental differences between real-world and simulated environments.