Next Article in Journal
CustomNerd: A Framework and Tool for Fast Deployment of Production-Ready Expertise-Based Question Answering Systems
Previous Article in Journal
A DC-DC Converter Reuse-Based Double-Line Frequency Ripple Suppression Method for Substation Uninterruptible Power Supply Systems
Previous Article in Special Issue
Towards Reliable Evaluation of Underwater Image Enhancement Using Subjective and Objective Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Dynamic Displacement Measurement Method for Overhead Transmission Line Galloping Based on Deep Vision and Binocular Collaboration

1
State Grid Electric Power Engineering Research Institute Co., Ltd., Beijing 102206, China
2
Space Information Research Institute and Zhejiang Key Laboratory of Space Information Sensing and Transmission, Hangzhou Dianzi University, Hangzhou 310018, China
*
Author to whom correspondence should be addressed.
Electronics 2026, 15(14), 3040; https://doi.org/10.3390/electronics15143040
Submission received: 4 May 2026 / Revised: 3 June 2026 / Accepted: 15 June 2026 / Published: 10 July 2026

Abstract

Galloping of overhead transmission lines threatens grid safety and requires non-contact measurement methods that can quantify three-dimensional (3D) motion from field video. This paper proposes a deep-vision and binocular-collaboration framework for dynamic conductor displacement measurement. The framework combines three components that are matched to the physical structure of transmission lines: adaptive image enhancement using Retinex illumination decomposition and Wiener blind deconvolution; a structure-prior dual-branch extraction module that uses an improved YOLOv11 keypoint branch for spacer-equipped sections and an improved U-Net branch with Dynamic Snake Convolution (DSC) and Strip Pooling for bare conductors; and stereo reconstruction with Kalman-filter-based temporal association for continuous trajectory estimation. Compared with the original submission, the revised manuscript further clarifies the real-video data acquisition, annotation procedure, camera synchronization, calibration workflow, training/testing independence, and runtime measurement protocol. Additional validation on a public real power-line image dataset is also reported. The proposed method achieves a Z-axis Root Mean Square Error (RMSE) of 24.5 mm for spacer sections in the controlled binocular field test, a dominant-frequency relative error below 3.5%, and 32 FPS on edge hardware when preprocessing, visual extraction, stereo projection, and temporal filtering are included. On the supplementary public power-line dataset, the segmentation branch obtains a Dice coefficient of 0.9039 and an IoU of 0.8395. These results indicate that the proposed framework reduces the depth-scale limitation of monocular vision and provides a practical quantitative tool for field galloping monitoring.

1. Introduction

Overhead transmission lines span vast geographical areas and are frequently exposed to wind, icing, low illumination, and complex backgrounds. Under winter weather, asymmetric ice accretion on conductors and ground wires, coupled with transverse wind excitation, may trigger the low-frequency and large-amplitude aeroelastic motion known as galloping [1,2]. Sustained galloping can accelerate fatigue damage of tower structures, insulator strings, and hardware fittings, and in severe cases it may contribute to conductor breakage, phase-to-phase flashover, or local tower damage [3,4]. Therefore, field monitoring systems need not only to detect whether a conductor is visible, but also to quantify its dynamic 3D displacement.
Historically, line galloping has often been monitored using contact-type mechanical or inertial sensors, such as accelerometers, strain gauges, or tilt sensors, directly mounted on conductors [5]. These sensors can provide direct local measurements, but their installation and maintenance usually require live-line work or power outages. Their energy supply and wireless transmission may also be affected by icing, weather, and electromagnetic interference in high-voltage alternating current environments [6,7].
Consequently, non-contact visual inspection technologies, particularly those empowered by Unmanned Aerial Vehicles (UAVs), have rapidly emerged as the primary means for daily smart grid maintenance. Benefiting from high mobility, safe operational distances, and global spatial observation capabilities, UAV-based vision systems have made significant breakthroughs in power line inspection [8,9]. Currently, deep learning applications in this domain have achieved remarkable success in identifying static defects, such as broken insulator sheds, missing cotter pins, and slipped Stockbridge dampers [10,11,12].
However, quantitative analysis of the dynamic galloping process remains limited compared with static defect recognition [13,14]. The transition from object recognition to trajectory measurement is difficult because bare conductors are slender, weakly textured, and often low contrast. In practical transmission corridors, camera jitter, haze, background clutter, dusk illumination, and motion blur can reduce the visibility of conductor edges, leading to feature loss, tracking drift, and trajectory fragmentation [3,8,15].
Furthermore, the vast majority of existing visual vibration measurement frameworks rely on monocular vision paradigms [5,6]. Due to the inherent lack of depth information in a single camera view, monocular systems struggle to quantify the absolute displacement of conductors in three-dimensional (3D) space. When the conductor undergoes complex spatial galloping with significant out-of-plane motion, the 2D pixel displacement cannot be accurately mapped to physical coordinates, resulting in severe scale ambiguity and unacceptable measurement errors.
The central idea of this study is that line components with different physical structures should not be forced into a single visual representation. Spacer-equipped sections provide rigid geometric anchors, whereas bare conductors require continuous pixel-level topology. At the same time, the 2D visual observations must be converted into physically meaningful 3D trajectories and temporally stabilized across video frames. Based on this idea, this paper proposes a non-contact computer vision framework for dynamic 3D galloping displacement measurement. The framework integrates existing visual modules in a task-specific way around three design principles: structure-aware feature extraction, binocular scale recovery, and temporal motion consistency. The main contributions are summarized as follows:
  • Environmentally Adaptive Image Enhancement: To address optical degradation caused by field illumination variation and motion blur, an adaptive preprocessing pipeline integrating Wiener filtering blind deconvolution and Retinex illumination decomposition is introduced [16,17]. This module suppresses noise and enhances edge gradients under wind-induced blur and weak-light environments, improving the stability of subsequent feature extraction.
  • Structure-Prior-Based Dual-Branch Visual Extraction: For spacer-equipped sections, a lightweight YOLOv11 keypoint branch with a Feature Pyramid Network (FPN) is designed to obtain stable geometric anchors from rigid hardware [18]. For long bare conductors, a topology-aware U-Net branch integrating Dynamic Snake Convolution (DSC) and Strip Pooling is used to segment slender curved structures at pixel level [19,20,21]. The novelty lies in matching the visual representation to the physical component: sparse keypoints for rigid spacers and continuous masks/skeletons for flexible conductors.
  • 3D Spatiotemporal Reconstruction for Field Video: By coupling binocular stereo projection with cross-frame tracking based on optical flow and Kalman filtering [22,23], the system reconstructs continuous 3D conductor trajectories from video. This reduces the scale ambiguity of monocular vision and mitigates short-term trajectory fragmentation. Dynamic parameters, including 3D amplitude, dominant frequency, and spatial waveform inclination, can then be extracted [24,25] for galloping assessment.

2. Related Work

In the field of non-contact visual monitoring of transmission corridors, the core difficulties lie in the high-precision extraction of slender targets against complex backgrounds and the continuous quantification of high-frequency dynamic parameters. Existing research can be divided into three stages based on technical evolution.

2.1. Traditional Visual Feature Extraction Algorithms and Their Limitations

Early visual recognition of transmission lines primarily relied on underlying image processing technologies and hand-crafted feature operators. References [8,26] utilized Canny edge detection, Hough transform, and their improved algorithms to extract the linear or curved contours of conductors. The core mechanism of these methods relies on mapping image space edge pixels into a parameter space and accumulating local maximum votes to extract straight lines. For instance, Chen et al. [15] proposed an improved Cluster Radon Transform (CRT) to extract power lines from high-resolution remote sensing imagery. This method effectively avoids false alarms compared to conventional Radon transforms by grouping line segments, but it still relies heavily on prior linear assumptions. Reference [27] combined mathematical morphology with the region-growing method to achieve static sag measurement of conductors from specific perspectives.
However, the review in reference [1] clearly indicated that traditional feature operators highly depend on the prior contrast of images and predefined threshold settings. As typical low-contrast, textureless targets, the gradient features of overhead conductors are extremely fragile. In field conditions involving strong light reflection, smog, or low illumination, the signal-to-noise ratio drops drastically. The weak gradient features of the conductors are easily submerged by complex background clutter such as vegetation, ground buildings, or road markings, causing traditional edge detectors to yield severely fragmented contour maps.
Additionally, early vision-based Structural Health Monitoring (SHM) primarily adopted localized pattern matching and corner detection techniques to track the dynamic responses of large civil infrastructures [6,28]. While these methods achieved high sub-pixel tracking accuracy under stable laboratory lighting, they proved excessively brittle when deployed in transmission corridors. The feature points on conductors constantly experience non-rigid shape variations and severe illumination fluctuations, causing conventional tracking templates to drift or lose targets entirely.
Furthermore, in the domain of structural displacement measurement, traditional methods heavily relied on two-dimensional Digital Image Correlation (DIC) [29]. DIC tracks physical displacement by calculating the cross-correlation coefficient of image subsets before and after deformation. While DIC offers sub-pixel accuracy, it strictly requires distinct surface speckle patterns or artificial targets to perform block-matching. Since bare overhead conductors inherently lack surface textures and present uniform specular reflections under sunlight, the correlation calculation often falls into local optima. Considering that installing artificial markers on high-voltage lines is highly impractical and dangerous, DIC and other template-matching methods exhibit poor generalization and robustness, ultimately failing to meet the all-weather, marker-free engineering monitoring requirements of field transmission lines.

2.2. Application and Bottlenecks of Deep Learning in Transmission Inspection

The introduction of Convolutional Neural Networks (CNNs) has revolutionized the intellectualization of grid inspection by shifting from hand-crafted geometric features to data-driven semantic representations. Two-stage detection networks, represented by Faster R-CNN [30], introduced Region Proposal Networks (RPNs) to automatically generate candidate boxes, achieving high-precision localization. References [10,11] verified its robustness in recognizing rigid defects such as insulator breakage and Stockbridge damper slippage against complex backgrounds. However, two-stage networks are computationally expensive and struggle with real-time video stream processing.
To meet the real-time inference requirements of UAV-borne equipment with strictly limited computing power, single-stage lightweight detectors, represented by YOLO [31] and SSD, were widely adopted. By framing object detection as a single end-to-end regression problem, references [9,12] significantly improved the computational efficiency of hardware recognition. While these standard detection networks excel at category identification, they are mostly based on the Bounding Box Regression mechanism [32]. This paradigm presents inherent geometric defects when processing bare conductors with extreme aspect ratios. Rectangular bounding boxes inherently force the network to enclose the slender target, meaning that over 90% of the pixels inside the bounding box are background noise. This severe class imbalance inside the box leads to poor convergence of Intersection over Union (IoU) losses and fails to provide pixel-level topological structures.
To achieve finer extraction, instance segmentation models like Mask R-CNN [33] were developed to provide pixel-level masks alongside bounding boxes via the RoIAlign operation. However, their heavy multi-branch architectures further exacerbate the computational burden. More recently, the introduction of Vision Transformers has disrupted the object detection landscape. Models such as DETR (Detection Transformer) [34] eliminate the need for hand-crafted components like non-maximum suppression by framing detection as a direct set prediction problem. Although Transformer-based architectures have achieved state-of-the-art accuracy in complex scene understanding, their self-attention mechanisms introduce quadratic computational complexity with respect to the input spatial resolution. This massive computational overhead makes high-frame-rate tracking on airborne edge devices nearly impossible.
Furthermore, for tracking rigid structures like spacers in vibrating environments, dense pixel masks are often redundant. Instead, keypoint-based localization offers a more sparse yet geometrically stable representation [35]. Achieving high-precision keypoint regression under multi-scale variations remains a challenge, motivating the integration of specialized feature pyramids (FPNs) in our proposed lightweight YOLOv11 branch to decouple rigid component tracking from flexible conductor extraction while maintaining strict real-time efficiency.

2.3. Slender Target Segmentation and 3D Dynamic Tracking

To address the pixel-level localization bottleneck of flexible conductors, Fully Convolutional Networks (FCNs) [36] and semantic segmentation architectures have been introduced. Classic encoder–decoder networks, such as U-Net [19] and SegNet [37], utilize successive downsampling layers to capture rich global context and upsampling layers with skip connections to recover spatial resolution.
To address objects with diverse scales and extreme aspect ratios, advanced multi-scale feature aggregation architectures, such as Panoptic Feature Pyramid Networks (Panoptic FPN) [38], have been developed. While these architectures successfully unify instance and semantic segmentation by merging dense bottom-up features with semantic top-down pathways, they still fundamentally rely on regular grid convolutions. When applied to extremely slender power lines, these square receptive fields inadvertently incorporate excessive background features from adjacent regions. When the conductor undergoes non-linear bending due to wind-induced galloping, this structural mismatch leads to severe false positives or trajectory disconnections at conductor overlaps. To elegantly address this, references [20,21] proposed enhancing the network’s local geometric perception for slender, curved targets through Strip Pooling and Dynamic Snake Convolution (DSC). These operators dynamically adapt their receptive fields to strictly align with the tubular structures, effectively filtering out off-axis background interference.
Despite advancements in 2D target extraction, dynamic displacement measurement still faces significant physical hurdles. Vision-based Structural Health Monitoring (SHM) has made great progress [14,39], leveraging deep neural networks for multi-scale structural inspection [40]. Yet, most visual vibration measurement technologies are confined to monocular 2D planar estimation. Reference [3] utilized the optical flow method for sub-pixel modal vibration measurement. However, monocular methods suffer from severe scale ambiguity due to the inherent loss of depth information, especially when conductors exhibit large out-of-plane galloping motions where the absolute distance between the camera and the target changes constantly [6].
Binocular stereo vision reduces this scale ambiguity by recovering absolute spatial depth through epipolar geometry constraints. Recent geometric-vision studies on multi-camera and generalized-camera relative pose estimation have further improved the mathematical basis of calibrated multi-camera measurement. For example, affine-correspondence-based methods and six-point solvers reduce the required correspondence set and improve pose-estimation efficiency in multi-camera systems [41,42,43]. These studies are highly relevant to visual displacement measurement because accurate camera pose and correspondence estimation are prerequisites for reliable 3D reconstruction. The focus of this paper is different: instead of proposing a new minimal relative-pose solver, we use a calibrated binocular rig and task-specific conductor features to recover dynamic line trajectories in field video.
Nevertheless, standard stereo matching algorithms [44,45] typically rely on local patch-based cost aggregation (e.g., Sum of Absolute Differences or Normalized Cross-Correlation). When attempting to match weakly textured bare conductors against complex, low-contrast sky backgrounds, the cost volume often becomes flat. This leads to disparity discontinuities or “depth holes.” Moreover, airborne jitter and brief target occlusion under complex meteorology cause tracking losses. Therefore, bridging the disparity discontinuities of textureless conductors and maintaining the spatiotemporal consistency of dynamic tracking through cross-frame state estimation (e.g., Kalman filtering [22]) remains the task-specific technical gap that this paper aims to address.

3. Method

This paper proposes a non-contact visual galloping displacement measurement framework. The framework is cooperatively composed of three core modules: complex environment adaptive image enhancement, structure-prior-based dual-branch target extraction networks, and binocular-disparity-based spatiotemporally consistent trajectory reconstruction.

3.1. Adaptive Image Enhancement Under Complex Illumination and Meteorological Conditions

Due to the uncontrollability of field monitoring scenarios, acquired images are often accompanied by low-illumination noise and severe motion blur. To ensure the accuracy of subsequent feature extraction algorithms, the system first executes an adaptive preprocessing pipeline at the data input end.
Low-Illumination Compensation and Denoising: For nighttime and weak-light environments, the system adopts an illumination decomposition algorithm based on Retinex theory [16] to separate the reflection and illumination components of the image. This is combined with Contrast-Limited Adaptive Histogram Equalization (CLAHE) [46] to enhance local texture details. To address Poisson noise caused by high-gain exposure, Non-Local Means (NLM) filtering [47] is introduced to maximize the retention of the extremely thin edge gradients of conductors while smoothing background noise. Unlike traditional local filters that blur structural boundaries, NLM computes the filtered pixel value as a weighted average of all pixels in the image, where the weights are determined by the similarity of their surrounding geometric neighborhoods, effectively preserving the topological integrity of the wire edges.
Motion Blur Restoration: In scenarios involving high-frequency UAV camera jitter caused by strong winds or severe conductor galloping, target edges suffer from severe point spread degradation. This paper employs Wiener filtering combined with the Blind Deconvolution algorithm [17] to inversely solve motion-blurred images by iteratively estimating the unknown Point Spread Function (PSF), effectively restoring high-frequency edge features. Through an iterative maximum likelihood estimation, the algorithm refines the PSF estimate alongside the latent image until convergence is achieved.
For low-illumination compensation, the Retinex theory assumes that an image I ( x , y ) can be modeled as the product of the illumination component L ( x , y ) and the reflection component R ( x , y ) :
I ( x , y ) = L ( x , y ) · R ( x , y )
By transforming this into the logarithmic domain, the reflection component, which represents the intrinsic properties of the conductors, can be isolated:
log R ( x , y ) = log I ( x , y ) log ( F ( x , y ) I ( x , y ) )
where F ( x , y ) is a Gaussian surround function utilized to estimate the illumination distribution.
For motion blur restoration, the degradation process of the image caused by high-frequency jitter can be modeled as:
g ( x , y ) = f ( x , y ) h ( x , y ) + n ( x , y )
where g ( x , y ) is the blurred image, f ( x , y ) is the latent clear image, h ( x , y ) represents the unknown Point Spread Function (PSF), and n ( x , y ) is additive noise. A Wiener filter is applied in the frequency domain to perform the inverse solution:
F ^ ( u , v ) = H ( u , v ) | H ( u , v ) | 2 + K G ( u , v )
where F ^ ( u , v ) , G ( u , v ) , and H ( u , v ) are the Fourier transforms of f ^ , g, and h, respectively. H is the complex conjugate of H, and K is a constant related to the signal-to-noise ratio.

3.2. Structure-Prior-Based Dual-Branch Slender Target Extraction Network

Transmission lines present two distinctly different physical morphologies: “with hardware (spacers)” and “without hardware (bare conductors).” A single detection network cannot accommodate both local keypoint localization and global pixel segmentation simultaneously. Therefore, a dual-branch visual detection strategy is designed for different line topologies, as illustrated in Figure 1.

3.2.1. Lightweight Keypoint Detection for Spacers

For sections installed with spacers, the geometric morphology of the spacers provides a high-contrast rigid observation baseline for conductor tracking. Based on the YOLO architecture, this paper integrates a Feature Pyramid Network (FPN) [18] to enhance the cross-layer fusion of multi-scale features. As depicted in Figure 1a, the detection pipeline leverages a Cross Stage Partial (CSP) backbone for efficient feature extraction. To handle the significant scale variations in spacers caused by dynamically changing UAV flight distances, the FPN aggregates semantic information from deep layers with high-resolution spatial details from shallow layers.
The detection head is specifically modified to not only regress the 2D bounding boxes ( x , y , w , h ) of targets and confidence scores, but also to output the precise pixel coordinates of the upper and lower endpoints ( k x 1 , k y 1 , k x 2 , k y 2 ) of the spacers. To optimize the keypoint regression, a composite loss function is employed, combining bounding box regression loss with a normalized keypoint distance loss. This ensures that the gradient descent process prioritizes the alignment of the spacer’s structural joints over merely minimizing the bounding box scale error. These predicted keypoints serve as highly stable geometric anchors for subsequent spatial posture calculation, overcoming the inherent instability of traditional bounding box centers during hardware vibration. Through channel pruning and weight quantization, the model reduces computational redundancy and meets real-time inference requirements on airborne edge computing nodes.

3.2.2. Topology-Aware Semantic Segmentation for Bare Conductors

For extremely slender, low-contrast bare conductors without spacers, the traditional bounding box detection paradigm easily introduces background interference, since the target occupies only a fraction of the box area. This paper adopts an improved U-Net segmentation model [19], as detailed in Figure 1b. The network follows an encoder–decoder paradigm with skip connections to preserve fine-grained spatial features. Crucially, introducing DSC [21] in its encoder stage allows it to adaptively match the nonlinear curved morphology of conductors affected by wind deflection by learning deformation offsets.
In standard 2D convolution, the output feature map Y at location p 0 is computed by sampling the input feature map X over a regular grid R with weights w:
Y ( p 0 ) = p n R w ( p n ) · X ( p 0 + p n )
However, bare conductors constantly undergo nonlinear bending due to wind deflection, making regular rigid grids ineffective. The Dynamic Snake Convolution (DSC) introduces learned 2D offsets Δ p n to the regular grid, enabling the receptive field to dynamically align with the tubular topological structure of the conductor:
Y ( p 0 ) = p n R w ( p n ) · X ( p 0 + p n + Δ p n )
where the offset Δ p n is generated by an additional convolutional layer applied over the same input feature maps. This mechanism allows the network to adaptively focus on the continuous slender features while suppressing surrounding background noise.
Concurrently, combined with a Strip Pooling module [20] and a spatial attention mechanism, it captures the long-distance contextual dependencies of slender targets. Unlike traditional spatial pooling with square windows, Strip Pooling utilizes long, narrow pooling kernels (e.g., 1 × N and N × 1 ). Mathematically, given a 2D tensor X R H × W × C , the horizontal strip pooling computes the mean value of a row, yielding a 1D vector y h R H × 1 × C , while vertical strip pooling yields y v R 1 × W × C . These orthogonal features are expanded and fused to form a global receptive field that is highly sensitive to the continuous topological layout of the power lines without absorbing unnecessary background clutter. The combined architecture ultimately outputs a highly continuous mask, which is processed via morphological thinning to yield a single-pixel-width conductor center topological skeleton.

3.3. Spatial Trajectory Reconstruction and Dynamic Parameter Temporal Quantification

After obtaining stable 2D pixel coordinates or skeleton lines, the system achieves 2D-to-3D dynamic displacement quantification through stereo matching and temporal state estimation algorithms.

3.3.1. Stereo Matching and 3D Spatial Projection

The system calculates sub-pixel dense disparity maps for binocular views via Semi-Global Block Matching (SGBM) [23] or stereo matching networks (e.g., PSMNet) [24]. To suppress disparity discontinuities commonly found in textureless conductor surfaces, the SGBM algorithm optimizes a global energy function E ( D ) across the disparity map D:
E ( D ) = p C ( p , D p ) + q N p P 1 I ( | D p D q |   = 1 ) + q N p P 2 I ( | D p D q |   > 1 )
where C ( p , D p ) is the initial matching cost at pixel p for disparity D p , N p is the neighborhood of p, and P 1 , P 2 are empirically set penalty parameters for small and large disparity gradients, respectively, ensuring surface smoothness for the extracted targets.
Based on the binocular pinhole camera model and epipolar geometry principles, the absolute spatial depth Z c of a target point in the camera coordinate system can be calculated by:
Z c = f · b d
where f is the effective focal length of the camera, b is the baseline length of the binocular camera, and d = u l e f t u r i g h t is the corresponding horizontal disparity value between the left and right views.
Once the depth Z c is obtained, the 2D pixel coordinates ( u , v ) are back-projected into 3D coordinates ( X c , Y c , Z c ) within the local camera coordinate system using the camera intrinsic parameters:
X c = ( u c x ) · Z c f x , Y c = ( v c y ) · Z c f y
where ( c x , c y ) is the principal point of the image, and f x , f y are the focal lengths along the pixel axes.
It should be noted that the source of the 2D coordinate ( u , v ) depends on the active detection branch: for the spacer section, ( u , v ) represents the geometric center of the keypoints detected by YOLOv11, and for the bare conductor section, ( u , v ) represents the extracted skeleton points from the improved U-Net. This unified projection mechanism ensures that both rigid and flexible components can be reconstructed in the same 3D spatial framework.
Finally, the local coordinates are unified into the global geographic coordinate system ( X w , Y w , Z w ) via homogeneous coordinate transformation combined with airborne pose information (RTK/IMU):
X w Y w Z w 1 = T I M U W o r l d R t 0 1 X c Y c Z c 1
where R and t denote the rotation matrix and translation vector respectively.

3.3.2. Calibration, Synchronization, and Ground-Truth Alignment

To make the stereo measurement process reproducible, the binocular system is calibrated before field acquisition using a planar checkerboard target observed at multiple distances and orientations. The intrinsic parameters of the left and right cameras, distortion coefficients, stereo rotation, and stereo translation are estimated jointly, and the calibration is accepted only when the mean reprojection error is below one pixel. The rectified left–right image pairs are then used for the disparity calculation described above. In the field videos used in this study, the camera platform was kept stationary or in a hovering fixed-point state during each measurement sequence, so the observed image motion is dominated by conductor motion rather than intentional camera translation. Residual camera vibration is handled by feature-based background stabilization before conductor tracking.
The left and right image streams are hardware-triggered by the same acquisition controller when available; otherwise, frame timestamps are aligned before processing and frame pairs with excessive timestamp deviation are discarded. The dynamic displacement ground truth for the controlled field test is obtained by combining a Leica Nova TS60 total station and an RTK module. The total station records the 3D coordinates of selected conductor or spacer characteristic points, and the RTK/IMU records the camera pose used to transform local camera coordinates into the global coordinate system. The visual coordinate system and the survey coordinate system are aligned using common reference points on the tower or conductor fittings. Measurement uncertainty is mainly introduced by stereo calibration residuals, timestamp alignment error, manual/automatic reference-point localization, and total-station observation error; therefore, the reported ranging results are interpreted as field-test accuracy under the stated acquisition conditions rather than a universal accuracy guarantee for all corridor distances and weather conditions.

3.3.3. Cross-Frame Trajectory Association and Galloping Parameter Extraction

To address the problem of temporal fragmentation caused by large-scale conductor flipping or brief occlusions, this paper combines the optical flow method [3] and the Kalman Filter [22] for motion state prediction and data association. The state vector is defined as x k = [ X , Y , Z , X ˙ , Y ˙ , Z ˙ ] T , which represents the 3D position and velocity of the conductor.
Specifically, for a constant velocity kinematic model with time step Δ t , the state transition matrix A and observation matrix H are defined as:
A = I 3 × 3 Δ t I 3 × 3 0 3 × 3 I 3 × 3 , H = I 3 × 3 0 3 × 3
The state transition and observation models are formulated as:
x k | k 1 = A x k 1 | k 1 + w k
z k = H x k | k 1 + v k
where z k represents the 3D coordinates obtained from the binocular matching at frame k. w k and v k denote the process and measurement noise covariance matrices, respectively.
The optimal state estimate is iteratively updated using the Kalman gain K k :
x k | k = x k | k 1 + K k ( z k H x k | k 1 )
This mechanism ensures the spatiotemporal continuity of the 3D trajectory. After obtaining the continuous trajectory, a Savitzky–Golay smoothing filter [25] is first applied to suppress high-frequency observation noise. Subsequently, the vertical and horizontal galloping amplitudes are calculated from the range of the 3D coordinate sequence. The Fast Fourier Transform (FFT) is then utilized to convert the time-domain displacement signal into the frequency domain to extract the dominant galloping frequency. Finally, the waveform inclination angle of the galloping trajectory is analyzed through spatial ellipse fitting, outputting the complete set of galloping feature parameters.

4. Experiments

To verify the proposed visual measurement framework, systematic quantitative and qualitative experiments were conducted on self-built field/simulation videos and on an additional public real power-line image dataset. To align with the dual-branch architecture proposed in Section 3, the evaluations are categorized into two typical scenarios: sections with hardware (spacers) and sections without hardware (bare conductors).

4.1. Experimental Environment and Dataset Construction

The offline training and testing environment for the algorithm was configured as follows: Intel(R) Xeon(R) Platinum 8360Y CPU operating at 2.40 GHz, NVIDIA RTX 4090 (24 GB VRAM) GPU, and PyTorch 1.13.1+cu117 deep learning framework. To verify airborne real-time performance, edge-end inference testing was conducted on an NVIDIA Jetson AGX Xavier.
To ensure the reproducibility of the visual networks, the training hyper-parameters were set as follows: the AdamW optimizer was adopted with an initial learning rate of 1 × 10 4 and a weight decay of 1 × 10 4 . A cosine annealing learning rate scheduler was applied. The batch size was set to 16, and the models were trained for 150 epochs until the validation loss no longer decreased. For all comparative models, the same preprocessing pipeline, image resolution, dataset split, optimizer settings, and Jetson AGX Xavier deployment environment were used unless otherwise stated. The main experiments were repeated three times with different random seeds, and the tables report the mean values.
Due to the sudden and unrepeatable nature of transmission line galloping, real galloping data is scarce. This paper constructed a mixed dataset containing a total of 15,000 extracted image frames, which were strictly divided into training (70%, 10,500 frames), validation (20%, 3000 frames), and testing (10%, 1500 frames) sets. To avoid scene leakage, frames from the same continuous video segment were assigned to only one subset. The test subset contains video segments that are independent of the training and validation scenes. The data sources include:
  • Digital Twin Simulation Set: A 3D scene of a transmission corridor was constructed using a physical simulation engine to simulate conductor motion under different wind speeds. Video sequences containing known camera intrinsics, extrinsics, and absolute 3D target coordinates were synthesized, generating 120 video segments. These simulated data were mainly used for pretraining, ablation, and controlled error analysis, not as the only evidence for field performance.
  • Field Measurement Set: Real test data were acquired from field videos of conductor motion. During each sequence, the camera was kept fixed or in a hovering fixed-point state, so the data record conductor motion while reducing intentional camera translation. The videos include spacer-equipped conductors and bare conductor sections under clear daytime, weak-light, and wind-blur conditions. The images used in the manuscript are not isolated photographs; they are screenshots from the running measurement system when processing field video streams. To obtain physical ground truth in the controlled field tests, a Leica Nova TS60 high-precision total station combined with an RTK module was deployed on the ground to record 3D coordinates of selected characteristic points. The visual measurements and survey measurements were synchronized by acquisition timestamps and aligned through common reference points.
  • Public Real Power-Line Dataset: To further evaluate generalization on real non-synthetic images, the bare-conductor segmentation branch was additionally tested on a public powerline dataset Computer Vision Dataset. This dataset is independent of the training videos used in the main experiments. Since the public dataset provides 2D line annotations but not binocular depth ground truth, it is used only to assess segmentation generalization, not 3D ranging accuracy.
To improve traceability of the real-data evaluation, Table 1 summarizes the acquisition and validation information available for the controlled field videos. Parameters not preserved in the original field log are explicitly marked rather than inferred retrospectively.
For the manual annotation of field videos, conductor masks were labeled at pixel level and spacer endpoints were labeled as keypoints. Ambiguous frames with heavy occlusion, severe defocus, or impossible conductor-boundary judgment were reviewed twice before inclusion. The final masks were checked by overlay inspection, and a subset was re-labeled to verify annotation consistency.

4.2. Evaluation Metrics

This paper evaluates the system performance from two dimensions: visual target extraction and physical displacement measurement.
  • Visual Extraction Metrics: To evaluate the slender target segmentation performance of bare conductors, the mean Intersection over Union (mIoU) and Pixel Accuracy (PA) are adopted. Assuming there are N + 1 classes (including the background), mIoU is defined as:
    mIoU = 1 N + 1 i = 0 N T P i T P i + F P i + F N i
    where T P i , F P i , and F N i denote the number of true positive, false positive, and false negative pixels for class i, respectively. For spacer keypoint detection, the mean Average Precision at IoU thresholds of 0.5 (mAP@0.5) and the more stringent 0.5 to 0.95 (mAP@0.5:0.95) are utilized as primary metrics. To comprehensively assess hardware deployment feasibility, computational complexity (GFLOPs) and VRAM usage (MB) are also reported.
  • Dynamic Measurement Metrics: To quantify the absolute ranging accuracy of the reconstructed 3D trajectories against the Ground Truth, the Root Mean Square Error (RMSE) and Mean Absolute Error (MAE) are employed:
    RMSE = 1 M t = 1 M ( D t D ^ t ) 2
    MAE = 1 M t = 1 M | D t D ^ t |
    where M is the total number of sampled frames, D t is the ground truth displacement at frame t, and D ^ t is the system’s measured displacement. Furthermore, the Relative Error (RE) is used to evaluate the calculation accuracy of the dominant galloping frequency:
    RE = | f m f t | f t × 100 %
    where f m is the measured frequency derived from the FFT, and f t is the theoretical true frequency.

4.3. Performance Evaluation of Visual Detection and Segmentation Algorithms

To verify the effectiveness of the proposed dual-branch network and environmental preprocessing modules, systematic ablation experiments and comparative analyses with mainstream algorithms were conducted.

4.3.1. Ablation Validation of Complex Environment Adaptive Preprocessing

To verify the effectiveness of the environmental preprocessing pipeline proposed in Section 3.1, ablation experiments were constructed as shown in Table 2.
As shown in Table 2, in the Baseline without any preprocessing, the model’s metrics performed poorly, limited by extremely low contrast and edge point spread degradation. The strict mAP@0.5:0.95 was only 45.2%, indicating unstable keypoint localization. When the complete adaptive preprocessing pipeline was introduced, the mAP@0.5 and mIoU increased substantially by 12.4% and 15.2%, respectively. Although the preprocessing steps sacrificed approximately 10 FPS, the overall frame rate of 32 FPS still meets airborne real-time requirements.
Figure 2 further illustrates the performance degradation of the dual-branch models under increasing motion blur, with and without the adaptive preprocessing pipeline.

4.3.2. Ablation Experiments of Spacer Keypoint Detection Network (YOLO Branch)

To validate the structural improvements in the YOLOv11-based spacer detection branch, an ablation study was conducted (Table 3). The baseline was the standard YOLOv11 model.
The introduction of FPN significantly enhanced multi-scale perception during drone approaching maneuvers. Most importantly, replacing the standard bounding box head with the customized keypoint regression head sharply increased the strict mAP@0.5:0.95 from 55.6% to 61.3%, proving its superiority in maintaining stable anchor points during severe hardware vibrations.

4.3.3. Ablation Experiments of Slender Target Segmentation (U-Net Branch)

To verify the rationality of the improvements made to the U-Net network structure, DSC and Strip Pooling modules were introduced step by step (Table 4).
A single Strip Pooling module improved global context perception, but pixel misjudgments existed at bends. After introducing DSC, the network acquired the ability to adapt to nonlinear deformations, increasing mIoU significantly. When both were combined (Ours), the model accurately extracted the single-pixel skeleton with an mIoU of 89.3%.

4.3.4. Comparative Experiments on Dual-Stream Visual Extraction

To benchmark the dual-branch strategy, we evaluated both branches against state-of-the-art architectures in Table 5 and Table 6.
As shown, two-stage models (Faster R-CNN) and Transformer-based models (RT-DETR, Mask2Former) achieve competitive accuracy but incur excessive GFLOPs and VRAM usage, failing the >30 FPS real-time threshold on the Jetson AGX Xavier. The proposed dual-branch framework provides a favorable tradeoff between accuracy and deployment efficiency.
Figure 3 visualizes this accuracy–speed tradeoff on the edge node.

4.3.5. Supplementary Validation on a Public Real Power-Line Dataset

To address the concern that synthetic data alone cannot demonstrate field generalization, the bare-conductor segmentation branch was additionally evaluated on an independent public real power-line dataset. The model used the same preprocessing and inference settings as in the field-video experiments. Because this dataset contains 2D image annotations but no synchronized binocular depth ground truth, the evaluation focuses on conductor extraction rather than 3D displacement reconstruction.
The results in Table 7 show that the segmentation branch maintains high precision on real images outside the self-built dataset. The relatively lower recall compared with precision indicates that the model remains conservative near weak or partially occluded line pixels. This is acceptable for avoiding false line detections in 3D reconstruction, but it also reveals a limitation: very faint line segments may still require either stronger temporal aggregation or additional real-scene annotation in future work.
Figure 4 provides qualitative examples of the public dataset evaluation.

4.4. Validation of Galloping Trajectory Reconstruction and Temporal Measurement Accuracy

4.4.1. Dynamic Ranging Accuracy

Table 8 contrasts monocular vision constraints against our binocular collaborative measurement. The “Monocular Estimation” baseline was implemented by utilizing the Perspective-n-Point (PnP) algorithm, heavily relying on the known geometric prior of the spacer dimensions and standard conductor diameters to deduce depth.
The monocular baseline produces large Z-axis errors (RMSE greater than 140 mm) because the visual scale of a slender wire changes only weakly during out-of-plane motion. Under the controlled field-test setup, binocular disparity fusion reduces the spacer-section Z-axis RMSE to 24.5 mm and the bare-conductor Z-axis RMSE to 31.2 mm. These results show that stereo geometry substantially reduces, rather than universally eliminates, the depth-scale ambiguity of monocular measurement. Because the full target-depth distribution and pixel angular spacing were not retained in the original field log, the results should be interpreted as an empirical accuracy evaluation for the tested field sequences rather than as a complete analytical depth-accuracy model for every operating distance.

4.4.2. Temporal Consistency and Trajectory Smoothing

To address temporal fragmentation caused by airborne jitter or brief occlusion by moving vegetation, the cross-frame Kalman filtering acts as a critical stabilizer. Figure 5 maps the Z-axis depth tracking trajectory over time.
During continuous wind-induced galloping, raw stereo matching exhibits high-frequency noise and disparity dropouts when brief occlusions occur between t = 4.0 s and t = 5.5 s. By integrating the Kalman kinematic model, the system yields a smoother trajectory that remains close to the ground-truth trend during the short occlusion interval.

4.4.3. Comprehensive Test System and Dynamic Parameter Fitting Analysis

When field binocular test videos are input, the real-time operational interface of the system is shown in Figure 6. The interface synchronously displays the original video stream overlaid with feature extraction results (YOLO bounding boxes and U-Net skeletons). The reported edge-end speed of 32 FPS is measured at the test resolution used in the experiments and includes adaptive preprocessing, visual extraction, stereo projection, Kalman filtering, and dynamic-parameter calculation. GPU utilization and energy consumption were not recorded in the available deployment log; therefore, the real-time claim is limited to the measured end-to-end throughput on Jetson AGX Xavier. The system outputs dominant galloping frequency and spatial galloping amplitudes in real time; in the controlled field test, the dominant frequency was 1.25 Hz with a relative error below 3.5%.

4.4.4. Robustness Boundaries and Failure Case Analysis

No visual monitoring system is universally infallible. Through extensive field testing, this study identified three extreme corner cases (Failure Cases) where the proposed framework experiences accuracy degradation or complete tracking loss: (1) Severe Ice Coating Altering Topology: When conductors undergo extreme asymmetric ice accretion, their topological geometry changes from slender tubes to irregular clumps. This breaches the DSC operator’s structural priors, causing mIoU to drop below 40%. (2) Direct Sunglare and Lens Flare: When the UAV camera faces the sun at specific low angles, severe lens flare washes out all local gradients. Although Retinex enhancement recovers partial contrast, the stereo matching cost volume becomes completely flat, resulting in Z-axis tracking loss. (3) Camouflage in Dense Vegetation: In specific seasons, the oxidized surface color of old conductors perfectly matches the spectral signature of dense background deciduous forests. In such zero-contrast scenarios, the U-Net branch occasionally suffers from trajectory disconnection. Acknowledging these boundaries provides clear directions for future integration with multi-modal sensors (such as LiDAR or Thermal Imaging) to ensure all-weather reliability.

5. Discussion

5.1. Interpretation of Results and Working Hypotheses

The primary working hypothesis of this study was that the dynamic displacement of textureless, slender transmission lines in complex meteorological environments could be quantified more reliably by decoupling the visual extraction of rigid and flexible components, and by fusing binocular spatial data with temporal kinematic models. The experimental results support this hypothesis within the tested scenarios. By employing the proposed dual-branch architecture, the system achieved spacer detection precision of 61.3% in mAP@0.5:0.95 and bare-conductor segmentation accuracy of 89.3% in mIoU on the self-built test set, while maintaining 32 FPS on edge hardware. The public real power-line dataset further indicates that the segmentation branch generalizes to independent real images, with a Dice coefficient of 0.9039 and an IoU of 0.8395. Furthermore, the controlled binocular field test reduced the spacer-section Z-axis RMSE to 24.5 mm, demonstrating a clear advantage over the monocular baseline in the tested depth range.

5.2. Comparisons with Previous Studies

From the perspective of visual feature extraction, traditional techniques relying on gradient operators (e.g., Canny, Hough transform) [8,27] or Digital Image Correlation (DIC) [29] are vulnerable to low-contrast and textureless surfaces. While recent deep learning applications in power grid inspection have largely relied on bounding box regression (e.g., Faster R-CNN, standard YOLO) [10,30], these approaches are geometrically inefficient for slender conductors because they include excessive background pixels [32]. The proposed dual-branch strategy addresses this issue by using different representations for different structures: improved YOLOv11 keypoints for rigid spacers and DSC U-Net masks/skeletons [19,21] for flexible bare conductors.
In the context of Structural Health Monitoring (SHM), many vision-based vibration measurement technologies still rely on monocular 2D planar estimation [5,6]. Monocular methods are weak at capturing out-of-plane galloping motions because depth is not directly observed, as reflected by the large Z-axis RMSE in our baseline comparisons. Although stereo vision can recover depth, matching textureless conductors against complex sky backgrounds often leads to disparity discontinuities [44]. The integration of the Kalman filter with a constant velocity kinematic model in this study provides a spatiotemporal constraint that bridges short disparity holes and improves trajectory smoothness compared with isolated frame-by-frame stereo matching.

5.3. Broad Implications

The findings of this study have implications for the operation and maintenance of smart grids. By reducing the need for contact sensors in some monitoring scenarios [5], the proposed non-contact visual framework can provide dynamic parameters such as dominant frequency and 3D amplitude from field video. These parameters can support digital-twin modeling of transmission corridors, fatigue assessment of hardware, validation of wind-resistant designs, and early warning of galloping-induced risks.

5.4. Limitations and Future Research Directions

Despite the encouraging results, the current framework has several limitations. First, the structural priors relied upon by the DSC U-Net assume a generally tubular topology. Under extreme freezing rain or snow conditions, severe asymmetric ice accretion can change the conductor morphology into irregular clumps, reducing segmentation accuracy. Second, under direct low-angle sunglare, severe lens flare washes out local gradients, causing the stereo matching cost volume to flatten and resulting in transient tracking losses. Third, the supplementary public power-line dataset validates 2D segmentation generalization only; it does not contain synchronized binocular images or 3D ground truth for depth evaluation. Fourth, several physical acquisition metadata items requested for a complete stereo error budget, including exact field of view, pixel angular spacing, and the full depth and pixel-width distributions, were not fully retained in the available field logs. Finally, the current field tests are based on fixed or hovering camera videos, and larger-scale tests with moving platforms and more transmission corridors are still required.
Future research should focus on three aspects: (1) investigating the integration of multi-modal sensors, such as fusing binocular vision with LiDAR or thermal infrared imaging, to penetrate severe visual barriers (e.g., dense fog, absolute darkness, or severe sunglare); (2) exploring lightweight end-to-end stereo matching networks to replace the computationally heavy SGBM algorithm, further reducing the computational overhead on UAV edge nodes; and (3) expanding the dataset to include diverse ice-coated conductor morphologies to enhance the generalization capability of the segmentation models under extreme winter weather anomalies.

6. Conclusions

This paper developed a non-contact dynamic displacement measurement framework for transmission line galloping based on deep vision and binocular collaboration. By introducing adaptive image enhancement and a structure-prior-based dual-branch extraction network (improved YOLOv11 and DSC U-Net), the system localizes both rigid spacers and flexible bare conductors in field videos. The integration of binocular disparity calculation with cross-frame temporal filtering reduces the depth-scale ambiguity and short-term trajectory fragmentation observed in monocular or frame-by-frame baselines. In the controlled field tests, the system achieved a spacer-section Z-axis RMSE of 24.5 mm, a dominant-frequency relative error below 3.5%, and 32 FPS on edge hardware. The supplementary public dataset test further achieved a Dice coefficient of 0.9039 and an IoU of 0.8395 for real power-line segmentation. These results indicate that the proposed framework is a practical candidate for dynamic safety assessment and anti-galloping engineering of overhead transmission lines, while broader field validation remains necessary.

Author Contributions

Conceptualization, J.W. and X.G.; methodology, J.W. and D.L.; software, D.L. and W.G.; validation, D.L., B.L. and W.G.; formal analysis, B.L.; investigation, J.W. and B.L.; resources, B.L. and X.G.; data curation, D.L.; writing—original draft preparation, J.W. and W.G.; writing—review and editing, W.G. and X.G.; visualization, W.G.; supervision, X.G.; project administration, X.G.; funding acquisition, X.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Science and Technology Project of State Grid Corporation of China (Project Name: Research on Monitoring Technology and Equipment for Conductor and Ground Wire Icing and Galloping under Severe Operating Conditions), grant number 5200-202419390A-3-3-ZX.

Data Availability Statement

The self-built field videos and survey data are not publicly available due to privacy, safety, and commercial restrictions. The supplementary segmentation experiment used an independent public power-line Computer Vision Dataset; the corresponding evaluation scores are reported in this manuscript.

Acknowledgments

The authors would like to thank the State Grid Electric Power Engineering Research Institute Co., Ltd., for providing the experimental facilities and data support during the field tests.

Conflicts of Interest

Author Jian Wang, Danyu Li and Bin Liu were employed by the company State Grid Electric Power Engineering Research Institute Co., Ltd. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
DSCDynamic Snake Convolution
3Dthree-dimensional
UAVUnmanned Aerial Vehicle
CNNConvolutional Neural Network
FCNFully Convolutional Network
CLAHEContrast-Limited Adaptive Histogram Equalization
PSFPoint Spread Function
FPNFeature Pyramid Network
SGBMSemi-Global Block Matching
FFTFast Fourier Transform
RMSERoot Mean Square Error
MAEMean Absolute Error
RERelative Error

References

  1. Jenssen, R.; Roverso, D. Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning. Int. J. Electr. Power Energy Syst. 2018, 99, 107–120. [Google Scholar] [CrossRef] [Scilit]
  2. Huang, M.; Zhang, B.; Lou, W.; Kareem, A. A deep learning augmented vision-based method for measuring dynamic displacements of structures in harsh environments. J. Wind. Eng. Ind. Aerodyn. 2021, 217, 104758. [Google Scholar] [CrossRef] [Scilit]
  3. Javh, J.; Slavic, J.; Boltezar, M. The subpixel resolution of optical-flow-based modal analysis. Mech. Syst. Signal Process. 2017, 88, 89–99. [Google Scholar] [CrossRef] [Scilit]
  4. Jenssen, R.; Roverso, D. Intelligent monitoring and inspection of power line components powered by UAVs and deep learning. IEEE Power Energy Technol. Syst. J. 2019, 6, 11–21. [Google Scholar] [CrossRef] [Scilit]
  5. Ye, X.W.; Yi, T.H.; Dong, C.Z.; Liu, T. Vision-based structural displacement measurement: System performance evaluation and influence factor analysis. Measurement 2016, 88, 372–384. [Google Scholar] [CrossRef] [Scilit]
  6. Feng, D.; Feng, M.Q. Computer vision for SHM of civil infrastructure: From dynamic response measurement to damage detection—A review. Eng. Struct. 2018, 156, 105–117. [Google Scholar] [CrossRef] [Scilit]
  7. Dong, C.Z.; Catbas, F.N. A review of computer vision-based structural health monitoring at local and global levels. Struct. Health Monit. 2021, 20, 692–743. [Google Scholar]
  8. Zhang, J.; Liu, L.; Wang, B.; Chen, X.; Wang, Q.; Zheng, T. High speed automatic power line detection and tracking for a UAV-based inspection. In Proceedings of the 2012 International Conference on Industrial Control and Electronics Engineering; IEEE: Piscataway, NJ, USA, 2012; pp. 266–269. [Google Scholar]
  9. Shen, W.; Fang, M.; Wang, Y.; Xiao, J.; Chen, H.; Zhang, W.; Li, X. AE-YOLOv5 for detection of power line insulator defects. IEEE Open J. Comput. Soc. 2024, 5, 468–479. [Google Scholar] [CrossRef] [Scilit]
  10. Zhai, Y.; Chen, R.; Yang, Q.; Li, X.; Zhao, Z. Insulator fault detection based on spatial morphological features of aerial images. IEEE Access 2018, 6, 35316–35326. [Google Scholar] [CrossRef] [Scilit]
  11. Wang, S.; Liu, Y.; Qing, Y.; Wang, C.; Lan, T.; Yao, R. Detection of insulator defects with improved ResNeSt and region proposal network. IEEE Access 2020, 8, 184841–184850. [Google Scholar] [CrossRef] [Scilit]
  12. Miao, X.; Liu, X.; Chen, J.; Zhuang, S.; Fan, J.; Jiang, H. Insulator detection in aerial images for transmission line inspection using single shot multibox detector. IEEE Access 2019, 7, 9945–9956. [Google Scholar] [CrossRef] [Scilit]
  13. Baqersad, J.; Poozesh, P.; Niezrecki, C.; Avitabile, P. Photogrammetry and optical methods in structural dynamics—A review. Mech. Syst. Signal Process. 2017, 86, 17–34. [Google Scholar] [CrossRef] [Scilit]
  14. Ye, X.W.; Dong, C.Z.; Liu, T. A review of machine vision-based structural health monitoring: Methodologies and applications. J. Sens. 2016, 2016, 7103039. [Google Scholar] [CrossRef] [Scilit]
  15. Chen, Y.; Li, Y.; Zhang, H.; Tong, L.; Cao, Y.; Xue, Z. Automatic power line extraction from high resolution remote sensing imagery based on an improved radon transform. Pattern Recognit. 2016, 49, 174–186. [Google Scholar] [CrossRef] [Scilit]
  16. Jobson, D.J.; Rahman, Z.U.; Woodell, G.A. Properties and performance of a center/surround retinex. IEEE Trans. Image Process. 1997, 6, 451–462. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  17. Campisi, P.; Egiazarian, K. (Eds.) Blind Image Deconvolution: Theory and Applications; CRC Press: Boca Raton, FL, USA, 2017. [Google Scholar]
  18. Lin, T.Y.; Dollar, P.; Girshick, R.; He, K.; Hariharan, B.; Belongie, S. Feature pyramid networks for object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2017; pp. 2117–2125. [Google Scholar]
  19. Ronneberger, O.; Fischer, P.; Brox, T. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention; Springer International Publishing: Cham, Switzerland, 2015; pp. 234–241. [Google Scholar]
  20. Hou, Q.; Zhang, L.; Cheng, M.M.; Feng, J. Strip pooling: Rethinking spatial pooling for scene parsing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2020; pp. 4003–4012. [Google Scholar]
  21. Qi, Y.; He, Y.; Qi, X.; Zhang, Y.; Yang, G. Dynamic snake convolution based on topological geometric constraints for tubular structure segmentation. In Proceedings of the IEEE/CVF International Conference on Computer Vision; IEEE: Piscataway, NJ, USA, 2023; pp. 6070–6079. [Google Scholar]
  22. Bewley, A.; Ge, Z.; Ott, L.; Ramos, F.; Upcroft, B. Simple online and realtime tracking. In Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP); IEEE: Piscataway, NJ, USA, 2016; pp. 3464–3468. [Google Scholar]
  23. Hirschmuller, H. Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30, 328–341. [Google Scholar] [CrossRef] [Scilit]
  24. Chang, J.R.; Chen, Y.S. Pyramid stereo matching network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2018; pp. 5410–5418. [Google Scholar]
  25. Savitzky, A.; Golay, M.J. Smoothing and differentiation of data by simplified least squares procedures. Anal. Chem. 1964, 36, 1627–1639. [Google Scholar] [CrossRef] [Scilit]
  26. Zhang, H.; Yang, W.; Yu, H.; Zhang, H.; Xia, G.S. Detecting power lines in UAV images with convolutional features and structured constraints. Remote Sens. 2019, 11, 1342. [Google Scholar] [CrossRef] [Scilit]
  27. Li, Z.; Liu, Y.; Walker, R.; Hayward, R.; Zhang, J. Towards automatic power line detection for a UAV surveillance system using pulse coupled neural filter and an improved Hough transform. Mach. Vis. Appl. 2010, 21, 677–686. [Google Scholar]
  28. Fukuda, Y.; Feng, M.Q.; Narita, Y.; Kaneko, S.I.; Tanaka, T. Vision-based displacement sensor for monitoring dynamic response using robust object search algorithm. IEEE Sens. J. 2013, 13, 4725–4732. [Google Scholar] [CrossRef] [Scilit]
  29. Pan, B.; Qian, K.; Xie, H.; Asundi, A. Two-dimensional digital image correlation for in-plane displacement and strain measurement: A review. Meas. Sci. Technol. 2009, 20, 062001. [Google Scholar] [CrossRef] [Scilit]
  30. Ren, S.; He, K.; Girshick, R.; Sun, J. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 2016, 39, 1137–1149. [Google Scholar] [PubMed]
  31. Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2016; pp. 779–788. [Google Scholar]
  32. Rezatofighi, H.; Tsoi, N.; Gwak, J.; Sadeghian, A.; Reid, I.; Savarese, S. Generalized intersection over union: A metric and a loss for bounding box regression. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2019; pp. 658–666. [Google Scholar]
  33. Kaiming, H.; Georgia, G.; Piotr, D.; Ross, G.S. Mask r-cnn. In Proceedings of the IEEE International Conference on Computer Vision; IEEE: Piscataway, NJ, USA, 2017; Volume 2017, pp. 2961–2969. [Google Scholar]
  34. Carion, N.; Massa, F.; Synnaeve, G.; Usunier, N.; Kirillov, A.; Zagoruyko, S. End-to-end object detection with transformers. In European Conference on Computer Vision; Springer International Publishing: Cham, Switzerland, 2020; pp. 213–229. [Google Scholar]
  35. Liu, C.; Wu, Y.; Liu, J.; Sun, Z. Improved YOLOv3 network for insulator detection in aerial images with diverse background interference. Electronics 2021, 10, 771. [Google Scholar] [CrossRef] [Scilit]
  36. Long, J.; Shelhamer, E.; Darrell, T. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2015; pp. 3431–3440. [Google Scholar]
  37. Badrinarayanan, V.; Kendall, A.; Cipolla, R. Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 2481–2495. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  38. Kirillov, A.; Girshick, R.; He, K.; Dollar, P. Panoptic feature pyramid networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2019; pp. 6399–6408. [Google Scholar]
  39. Spencer, B.F., Jr.; Hoskere, V.; Narazaki, Y. Advances in computer vision-based civil infrastructure inspection and monitoring. Engineering 2019, 5, 199–222. [Google Scholar] [CrossRef] [Scilit]
  40. Hoskere, V.; Narazaki, Y.; Hoang, T.; Spencer, B., Jr. Vision-based structural inspection using multiscale deep convolutional neural networks. arXiv 2018, arXiv:1805.01055. [Google Scholar]
  41. Guan, B.; Zhao, J.; Kneip, L. Six-point method for multi-camera systems with reduced solution space. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2024; pp. 109–126. [Google Scholar]
  42. Guan, B.; Zhao, J. Affine correspondences between multi-camera systems for relative pose estimation. IEEE Trans. Pattern Anal. Mach. Intell. 2026, 48, 2012–2029. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  43. Guan, B.; Zhao, J.; Kneip, L. A complete solution to generalized relative pose estimation from affine correspondences. IEEE Trans. Pattern Anal. Mach. Intell. 2026, 48, 8598–8612. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  44. Zbontar, J.; LeCun, Y. Stereo matching by training a convolutional neural network to compare image patches. J. Mach. Learn. Res. 2016, 17, 1–32. [Google Scholar]
  45. Scharstein, D.; Szeliski, R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 2002, 47, 7–42. [Google Scholar] [CrossRef] [Scilit]
  46. Zuiderveld, K. Contrast limited adaptive histogram equalization. In Graphics Gems IV; Academic Press Professional, Inc.: Cambridge, MA, USA, 1994; pp. 474–485. [Google Scholar]
  47. Buades, A.; Coll, B.; Morel, J.M. A non-local algorithm for image denoising. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05); IEEE: Piscataway, NJ, USA, 2005; Volume 2, pp. 60–65. [Google Scholar]
Figure 1. The proposed dual-branch visual extraction architecture. (a) The improved YOLOv11 lightweight network for spacer keypoint detection. (b) The topology-aware improved U-Net utilizing Dynamic Snake Convolution for bare conductor semantic segmentation.
Figure 1. The proposed dual-branch visual extraction architecture. (a) The improved YOLOv11 lightweight network for spacer keypoint detection. (b) The topology-aware improved U-Net utilizing Dynamic Snake Convolution for bare conductor semantic segmentation.
Electronics 15 03040 g001
Figure 2. Performance degradation of the dual-branch models under varying motion blur severities, with and without adaptive preprocessing.
Figure 2. Performance degradation of the dual-branch models under varying motion blur severities, with and without adaptive preprocessing.
Electronics 15 03040 g002
Figure 3. Accuracy versus Inference Speed (FPS) scatter plot for different detection and segmentation baselines on edge computing hardware. The orange star denotes the proposed U-Net-based bare-conductor segmentation branch, and the red star denotes the proposed YOLOv11-based spacer keypoint detection branch.
Figure 3. Accuracy versus Inference Speed (FPS) scatter plot for different detection and segmentation baselines on edge computing hardware. The orange star denotes the proposed U-Net-based bare-conductor segmentation branch, and the red star denotes the proposed YOLOv11-based spacer keypoint detection branch.
Electronics 15 03040 g003
Figure 4. Qualitative segmentation results on the public real power-line dataset. From top to bottom, the four rows show the original images, ground-truth annotations, model-output heatmaps, and thresholded segmentation predictions, respectively.
Figure 4. Qualitative segmentation results on the public real power-line dataset. From top to bottom, the four rows show the original images, ground-truth annotations, model-output heatmaps, and thresholded segmentation predictions, respectively.
Electronics 15 03040 g004
Figure 5. Comparison of 3D trajectory tracking on the Z-axis. Kalman filtering maintains trajectory continuity during a simulated 1.5-s brief occlusion and reduces the large dropouts observed in raw stereo matching.
Figure 5. Comparison of 3D trajectory tracking on the Z-axis. Kalman filtering maintains trajectory continuity during a simulated 1.5-s brief occlusion and reduces the large dropouts observed in raw stereo matching.
Electronics 15 03040 g005
Figure 6. Test interface of the visual galloping dynamic measurement system. The image is a screenshot captured while the system processed a field binocular video sequence with a fixed or hovering camera. The different colored curves represent waveform trajectories of different conductors during galloping.
Figure 6. Test interface of the visual galloping dynamic measurement system. The image is a screenshot captured while the system processed a field binocular video sequence with a fixed or hovering camera. The different colored curves represent waveform trajectories of different conductors during galloping.
Electronics 15 03040 g006
Table 1. Traceability of the Controlled Field-Test Data and Stereo Evaluation.
Table 1. Traceability of the Controlled Field-Test Data and Stereo Evaluation.
ItemStatus in This Study
Data type for final evaluationReal field videos of conductor motion; synthetic videos were used for pretraining, ablation, and controlled error analysis.
Camera state during each sequenceFixed or hovering fixed-point acquisition; residual platform vibration was compensated by background stabilization.
Training/testing independenceContinuous video segments were assigned to only one subset to reduce scene leakage.
Ground-truth sourceLeica Nova TS60 total-station measurements combined with RTK/IMU pose information and common reference-point alignment.
Stereo calibration recordCheckerboard calibration with intrinsic/extrinsic estimation, stereo rectification, and mean reprojection error below one pixel.
Runtime protocolThe reported 32 FPS includes preprocessing, visual extraction, stereo projection, Kalman filtering, and dynamic-parameter calculation on Jetson AGX Xavier.
Public real-data validationIndependent public power-line images were used for 2D segmentation validation only because synchronized binocular depth ground truth is unavailable.
Unrecorded hardware metadataExact field of view, pixel angular spacing, full target-depth distribution, and conductor pixel-width distribution were not fully retained in the available field log.
Table 2. Ablation Experiments of Image Preprocessing Algorithms. ✓ indicates that the corresponding module is used, and ✕ indicates that it is not used.
Table 2. Ablation Experiments of Image Preprocessing Algorithms. ✓ indicates that the corresponding module is used, and ✕ indicates that it is not used.
RetinexWienerSpacerSpacerConductorInference
Comp.Deconv.mAP@0.5 (%)mAP@0.5:0.95 (%)mIoU (%)FPS
68.545.265.242
76.852.174.138
74.255.472.535
80.961.380.432
Table 3. Ablation Experiments of YOLOv11 Improvements for Spacer Anchoring. Bold values indicate the best performance in each metric.
Table 3. Ablation Experiments of YOLOv11 Improvements for Spacer Anchoring. Bold values indicate the best performance in each metric.
Model ConfigurationmAP@0.5 (%)mAP@0.5:0.95 (%)GFLOPsVRAM (MB)
Baseline (Standard YOLOv11)75.148.310.2650
+ FPN (Feature Pyramid)78.455.611.5780
+ FPN + Keypoint Head (Ours)80.961.312.4815
Table 4. Ablation Experiments of Network Structure for Bare Conductor Segmentation. ✓ indicates that the corresponding module is used, and ✕ indicates that it is not used.
Table 4. Ablation Experiments of Network Structure for Bare Conductor Segmentation. ✓ indicates that the corresponding module is used, and ✕ indicates that it is not used.
DSCStrip PoolingmIoU (%)PA (%)GFLOPsVRAM (MB)FPS
73.688.545.3105038
84.292.152.1120035
78.590.348.6112034
89.395.156.4135032
Table 5. Comparison of Mainstream Detection Algorithms for Spacer Sections. Bold values indicate the best performance among the compared methods.
Table 5. Comparison of Mainstream Detection Algorithms for Spacer Sections. Bold values indicate the best performance among the compared methods.
AlgorithmmAP@0.5mAP@0.5:0.95Param(M)GFLOPsVRAM(MB)FPS
Faster R-CNN81.2%52.4%41.5180.5245012
SSD72.4%40.1%24.385.2110035
CenterNet74.5%44.8%32.476.3154030
RT-DETR82.1%62.5%35.1110.4198022
YOLOv5s75.8%48.9%7.216.568058
YOLOv8s79.1%54.2%11.128.675045
Ours80.9%61.3%12.432.181540
Table 6. Comparison of Semantic Segmentation Algorithms for Bare Conductors. Bold values indicate the best performance among the compared methods.
Table 6. Comparison of Semantic Segmentation Algorithms for Bare Conductors. Bold values indicate the best performance among the compared methods.
AlgorithmPA (%)mIoU (%)Param(M)GFLOPsVRAM(MB)FPS
FCN-8s78.462.1134.5285.4310015
PSPNet81.666.446.7198.2245020
DeepLabv3+85.270.854.7210.5260018
HRNet87.172.428.5154.3185025
SegFormer90.476.813.745.6110030
Mask2Former89.175.243.0245.1280016
U-Net88.573.631.045.3105038
Ours95.189.333.256.4135032
Table 7. Segmentation Performance on the Public Power-Line Dataset.
Table 7. Segmentation Performance on the Public Power-Line Dataset.
DatasetDiceIoUAccuracyPrecisionRecall
Public powerline dataset0.90390.83950.99170.96930.8577
Table 8. Accuracy Comparison of 3D Spatial Ranging for Different Line Sections. Bold values indicate the best performance in each line section.
Table 8. Accuracy Comparison of 3D Spatial Ranging for Different Line Sections. Bold values indicate the best performance in each line section.
Measurement SchemeSection TypeX-Axis RMSE (mm)Y-Axis RMSE (mm)Z-Axis RMSE (mm)
Monocular EstimationSpacer18.422.1145.6
Monocular EstimationBare Conductor25.328.7178.2
Binocular (Ours)Spacer8.211.524.5
Binocular (Ours)Bare Conductor12.414.631.2
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, J.; Li, D.; Liu, B.; Gao, W.; Gong, X. A Dynamic Displacement Measurement Method for Overhead Transmission Line Galloping Based on Deep Vision and Binocular Collaboration. Electronics 2026, 15, 3040. https://doi.org/10.3390/electronics15143040

AMA Style

Wang J, Li D, Liu B, Gao W, Gong X. A Dynamic Displacement Measurement Method for Overhead Transmission Line Galloping Based on Deep Vision and Binocular Collaboration. Electronics. 2026; 15(14):3040. https://doi.org/10.3390/electronics15143040

Chicago/Turabian Style

Wang, Jian, Danyu Li, Bin Liu, Wenbo Gao, and Xinyi Gong. 2026. "A Dynamic Displacement Measurement Method for Overhead Transmission Line Galloping Based on Deep Vision and Binocular Collaboration" Electronics 15, no. 14: 3040. https://doi.org/10.3390/electronics15143040

APA Style

Wang, J., Li, D., Liu, B., Gao, W., & Gong, X. (2026). A Dynamic Displacement Measurement Method for Overhead Transmission Line Galloping Based on Deep Vision and Binocular Collaboration. Electronics, 15(14), 3040. https://doi.org/10.3390/electronics15143040

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop