1. Introduction
Electricity powers the activities of modern-day societies. The power line networks transmitting the electricity are located in numerous transmission line corridor (i.e., Right-of-Ways (ROW)) areas. The inspection of the ROWs is one of the major responsibilities of operating and maintaining power transmission grids. ROWs are vulnerable to potential hazards (e.g., icing), resulting in short- or long-term power outages [
1,
2]. It is critical for the safe operation of power transmission grids to monitor the ROW to find potential threats on the power line networks in an efficient and reliable way [
3,
4]. The inspection of the ROWs incorporates two aspects: electrical facilities and surrounding objects [
5]. The condition of the power components (e.g., insulators) needs to be checked for mechanical and electrical faults (e.g., corrosion) [
6,
7] regularly. The surrounding objects, especially vegetation, often poses potential threats to the ROWs, by violating clearance between conductors and assets [
8,
9,
10]. Vegetation has been considered as one of the most hazardous factors in the ROW environments [
11,
12,
13,
14], because it may be close to or in contact with the power line by growing in and falling down in the ROW region. The ROW clearance anomaly detection measures the distance between the power lines and the surrounding non-power-facility objects in the corridor such as trees and buildings to judge whether the clearance is within the safe range. The ROW clearance management plays a critically important role in the power line risk management [
15] and is an important task of the transmission line inspection. The clearance hazard (e.g., tree encroachment discharges) may lead to power facility infrastructure failures, power-tripping and outage [
16] or even serious safety accidents, such as bushfire [
11,
17]. There is an urgent need to develop an automatic and flexible ROW clearance anomaly detection method for the safe operation of the power transmission grid.
Traditional methods used for monitoring the high voltage (HV) transmission line mainly rely on aerial- and ground-based human on-site inspection with optical measuring devices (e.g., telescope and video/infrared camera) to manually find the defects such as faulty components or encroaching vegetation. Due to the complex and harsh natural environment where HV transmission line corridors are usually located, the detection and removal of the safety hazards are low timeliness and dangerous. Traditional methods are difficult to adapt to the high development speed of modern power grids, because of the high labor intensity, hard working conditions, low labor efficiency and management inconvenience [
9,
18]. To overcome this limitation, various remote sensing (RS) methods have been proposed and applied for power line monitoring tasks in research, aiming to assist or replace the traditional inspection methods. Detailed literature reviews were given by Matikainen et al. [
5]. Benefit from its characteristics of long-range detection of objects or natural phenomena without direct contact, remote sensing methods have become one of the important technical means to acquire spatial and spectral information of the power transmission grid which is the foundation of further safety hazard detection and analysis. The applied RS data sources for the inspection of ROWs mainly include: synthetic aperture radar (SAR) images [
19,
20], optical satellite images [
11,
21], optical aerial images [
22], thermal images [
23,
24], airborne laser scanning (ALS) data [
25,
26,
27,
28], land-based mobile mapping data [
29], and unmanned aerial vehicle (UAV) laser scanning data [
30,
31].
Existing studies focused on inspection and monitoring ROWs with remote sensing methods can be generally categorized into two groups according to the primary data source: (a) 2D image-based; and and (b) 3D point-based approaches. The 2D image-based studies detect the utilities in the ROW according to the prior information such as the uniform brightness, straight line properties, etc. Hough Transform (HT) is widely used to extract power lines from imagery [
32,
33,
34]. Regularities of the conductors in a span have also been utilized to detect the power line [
35,
36]. To infer the 3D geometry of the ROWs from the 2D imagery, stereo vision techniques are applied to identify pylon structures [
22], reconstruct line-segment based pylon models [
37] and power line curves [
38,
39] in both automatic and semi-automatic manner. The 2D image-based ROW inspection approaches essentially rely on the image gradient between power facilities and their background, thus are sensitive to noise and less well adaptive to different senses. The 2D images lack direct 3D information and the image occlusions cannot be omitted, although the 3D geometry of the ROW environment can be restored through stereo vision. However, robust and accurate reconstruction of ultra-thin power line structures remains unsolved.
LiDAR (Light Detection and Ranging) acquires the spatial geometry of the detected object in the form of discrete 3D point clouds. Airborne laser scanning (ALS) has become one of the primary information sources for the ROW inspection. Compared with the image-based techniques, ALS method directly generates dense 3D point clouds describing the geometry with auxiliary information (e.g., multiple echoes and intensity) rather than recover the 3D structure from stereo vision [
5,
40,
41,
42,
43]. Various approaches have been reported on the ROW point clouds classification as well as the subsequent power facilities modeling including power lines, pylons, etc. General machine learning methods, for example, Dempster–Shafer theory [
44], supervised classification using Random Forest classifier [
45] and JointBoost classifier [
46], have been used to accomplish the probabilistic prediction of ROW class label (e.g., power line). Substantial training samples are required in machine learning methods, and the selection of training samples can influence the classification accuracy. Prior knowledge such as transmission line structure types and presence of multiple echoes have also been used to extract power facilities from point clouds [
47,
48,
49]. Existing studies related to the modeling process mainly include wind adaptive modeling using minimum description length [
14], catenary curve embedded local affine modeling [
27], minimum linkage hierarchical clustering and RANSAC [
50], Eigen-analysis of point distribution tensor [
51], voxel-based hierarchical method [
52] and Markov Random Field (MRF) [
53]. Those studies mainly focused on the fitting of continuous mathematic models to the classified discrete point clouds. Acquisition point density of the ALS is typically in the order of 1–10 points/m
2, depending on flight altitude and scanner configuration [
54]. According to the power industry standard of China DL/T 1346—“Operating code of helicopter laser scanning for transmission line”—the point density of the manned helicopter borne LiDAR data for ROW inspection should be higher than 50 points/m
2. Despite the contributions of the previous research, certain limitations such as irregularity in data distribution, lack of point density and occlusions due to the relatively long observation distance of the ALS may lead to classification and modeling failures.
ALS data are suitable for the ROW inspection. However, the standard manned aircraft (e.g., helicopter) borne ALS LiDAR systems are limited because of the inflexibility and high costs of the fight acquisition. Moreover, the spatial and temporal resolutions of fixed-wing aircraft borne ALS are relatively low due to the long observation distance. Unmanned aerial vehicles (UAVs) provide an alternative to the traditional remote sensing platforms. In recent years, UAV LiDAR system equipped with GPS, IMU, laser scanners, and optical cameras have presented several characteristics, including flexibility, high resolution, efficiency, and potential for customization [
55,
56,
57], and have led to promising solutions for many applications including fine-scale mapping [
58], biomass change detection [
59] and forest inventory [
60]. UAVs are flexible and can acquire RS data at low altitudes (e.g., 100 m). UAV LiDAR complements standard remote ALS acquisition systems in both spatial and temporal resolutions, because of the flexible and close-range data collection. Recent examples of UAV LiDAR systems are operated by a field operator [
54,
57,
59,
61,
62]. However, with the perfection of the related legal regulations and technological developments of the full autonomous navigation of the UAV, manual interventions from pilots can be downgraded, resulting in further efficiencies. Using UAV LiDAR data to detect the ROW clearance anomaly can effectively improve the flexibility and mobility of the power line inspection and save a large number of manpower, material resources and time cost in the manned aerial vehicle or manual inspection. It is particularly important for transmission lines inspection in difficult terrains, such as mountainous regions.
Aiming to automatically detect the clearance anomalies in the ROW for power line risk management, this study thus proposed an automatic clearance anomaly detection method utilizing LiDAR point clouds collected by a large-scale UAV power line inspection system. Firstly, the terrain points were filtered out using two-step adaptive terrain filter and the pylons were detected in the non-terrain points following a feature map method. After dividing the ROW point clouds into spans based on the pylon detection results, the power lines point clouds were extracted according to their geometric distribution in local span point clouds slices, and were further segmented into clusters by applying conditional Euclidean clustering with linear feature constraints. Secondly, the discrete power line point clouds were fitted with 3D catenary curves using two geometric forms that are a horizontal line and a vertical catenary curve defined by a hyperbolic cosine function. Finally, a piecewise clearance calculation method which converts the point-to-catenary curve distance measurements to minimal distance calculation based on differential geometry was used to calculate the distance between the power line and the non-power-facility objects in the ROW. The calculated clearance was checked against with the threshold defined in the regulations. The clearance over-limit locations are marked as anomalies for further on-site dispose.
The main contribution of the presented ROW clearance anomaly detection method utilizing UAV-borne LiDAR data was that it proposed a novel power line point cloud extraction algorithm combining geometric distributions analysis in span slices and clustering with linear feature constraints in span for further piecewise clearance calculation that solves the point-to-catenary curve distance based on differential geometry, resulting in a flexible, practical and automatically detection solution of clearance hazards such as tree encroachment for ROW clearance anomaly detection in the power line risk management.
The rest of the paper is organized as follows:
Section 2 elaborates the proposed automatic clearance anomaly detection method for power lines inspections utilizing UAV LiDAR point clouds. Experimental studies on the clearance anomaly detection results are presented and analyzed in
Section 3. The advantages and disadvantages of the proposed method are discussed according to comparison experiments in
Section 4. Conclusions are drawn in
Section 5.
3. Experiments and Analysis
Experiments were performed to validate the effectiveness and accuracy of the proposed diagnostic algorithm for the clearance anomaly detection using two point cloud datasets captured by a large UAV-borne power line inspection robot [
18] (
Figure 7) equipped with a custom built LiDAR system. The sensor specifications of the equipped LiDAR are listed in
Table 1. The post-processed accuracy specifications of the custom built POS are listed in
Table 2. Considering the terrain diversity of the ROW, two 220 kV transmission line located in Guangdong Province, China are chosen as the inspection targets with the help of the local power supply bureau. The operation altitude/navigation speed of the UAV are set to 150 m (above the ground) and 7 m/s, respectively. The laser pulse rate of the scanner is set to 300 kHz. The acquisition procedures concerning the autonomous navigations of the UAV, etc. are elaborated by Peng et al. [
18,
71]. The description of the datasets is shown in
Table 3. The ROW 1 is featured with relatively flat terrain in which large areas of farmland areas exists. The length of the ROW 1 inspection section is 9.2 km with a total of 21 pylons. The terrain is mainly plain paddy fields, with about 2 km of cross-river topography and 3 km of gentle hills. ROW 1 dataset includes 99.31 million points and its point cloud density is 35 points per square meter. The terrain of ROW 2 is mountainous and covered with vegetation. ROW 2 inspection section is 6.2 km with a total of 16 pylons. The terrain is an undulating chain of hills. The point cloud density of ROW 2 dataset is 34.3 points per square meter and the total number of points is 53.2 million. The raw LiDAR point cloud data and the local enlarged snapshot of ROWs 1 and 2 are shown in
Figure 8 and
Figure 9. Because the inspected area is located in a non-residential region, there are no buildings inside the ROWs. Experiment data for ROWs 1 and 2 are collected on calm weather day. The datasets express no wind-bias phenomenon.
According to the known coarse position and direction of the PL, the LiDAR point cloud collected by our UAV inspection robot is trimmed to obtain concerned point clouds inside the ROW which represent a regular strip pattern. The power line point clouds are extracted and fitted with the proposed method described in
Section 2.1 and
Section 2.2.
Figure 10 and
Figure 11 shows the power line extraction results of ROW 1 and 2 datasets, respectively. The extracted power lines, pylons, and the non-power-facility objects (i.e., vegetation in our scope) are rendered in red, green and gray, respectively. There are 160 and 120 conductors and 21 and 16 pylons detected in ROW 1 and ROW 2 datasets, respectively, which is in accordance with the real scene. The power line point clouds are extracted according to their geometric distribution in local span point clouds slices for further clustering (
Section 2.1). The slice length
is set to 10 m. The
should be determined based on the slope characteristic of the ROWs. Small
(e.g., 10 m) is preferred for datasets with large slope values because more classification planes will be generated to approximate the irregular dividing surface, resulting in complex terrain adaptability. For flat terrains,
could be set to a large value (e.g., 30 m) to accelerate the power line point cloud segmentation process. Despite the efficiency requirement,
is recommended to be set to a small value (5 m–15 m) to guarantee a high quality point clouds classification results.
To quantify the performance of the power line point clouds extraction method, the ground truth of the power line point clouds are labeled manually and compared with the automatic detection results. The precision, recall, and F-measure of the power line points are used to evaluate the results:
where TP is true positive, FP is false positive, and FN is false negative, which denote the number of points that are labeled as power line correctly and incorrectly, and falsely labeled as other category, respectively. F is the harmonic mean of the recall and precision. The positional accuracy of the catenary curve fitting described in
Section 2.2 is evaluated by measuring the max (PMAX) and root-mean-square error (PRMSE) fitting error.
Table 4 shows the overall performance of proposed approach in terms of the abovementioned five criteria for power line extraction and fitting.
In regard to the accuracy of the power line point clouds extraction: (1) the FP points are mainly the points on the insulators and the linear shaped connection hardware that are incorrectly labelled as power line points; and (2) the FN points are the points that are excluded when the linear shape constrained Euclidean clustering are performed. This region growth clustering process may reject some of the true power line points if the dimensionality feature is not linear shaped or the point spaces are larger than the clustering distance threshold. The overall F-Measure is 0.956 on average. The mislabeled power line points are majorly located at the ends of the conductor where are considered less crucial to the clearance anomaly detection. Because the end points of the power line are usually much higher than the sag points. The performance is considered to be better than the power line point clouds extraction algorithm proposed by Kim et al. [
45,
53] and close to the algorithm proposed by Guan [
29] using very dense vehicle-borne LiDAR data, in terms of precision, recall, and F-measure. The average model fitting error PMAX and PRMSE are 0.153 m and 0.078 m, respectively. The model fitting accuracy is related to the mathematical model of the catenary curve mentioned in
Section 2.3, the point density and many other factors such as the accuracy of the laser point clouds or windy weather. The achieved PMAX and PRMSE are considered to be fair for clearance anomaly detection application utilizing the experiment datasets.
The clearance between the conductor and non-power-facility objects in the ROW is calculated and the locations exceeding the safe threshold is found, according to the clearance anomaly detection method proposed in
Section 2.3. The safe clearance threshold is chosen following the relevant regulation that is the power industry standard of China DL/T 741-2010—“Operation code for overhead transmission line”. Eleven clearance anomalies have been discovered after the detection process, as listed in
Table 5. There are two and nine clearance anomalies detected in ROW 1 and ROW 2 datasets, respectively. Ten out of the eleven clearance anomalies (threshold: 4.5 m) are confirmed to be high vegetation through visual inspection. The second clearance anomaly of ROW 1 (threshold: 4 m) is a low voltage transmission line (380 V) crossing the HV 200 kv transmission line corridor.
To quantitatively analyze the clearance anomalies detection results derived from the proposed method, the calculated values are compared with the results derived from manual surveying and another clearance measuring algorithm proposed by Peng et al. [
31] (Denoted by Peng’s algorithm). The distances between the power line and the non-power-facility objects in the two ROWs are manually measured in the point clouds and taken as the ground truth of the clearance measurements at the locations where the safe thresholds are exceeded. The comparison results are shown in
Table 5 and
Table 6. The minimum and maximum error between the clearance obtained from the proposed detection algorithm and the manually measured true value is 0.02 m and 0.14 m, respectively. The average error and the root mean square error is 0.08 m and 0.04 m. The minimum error and maximum error of Peng’s algorithm [
31] is 0.04 m and 0.31 m, the average error is 0.17 m, and the root mean square error is 0.09 m. It can be learned from the statistics of the comparison results that the algorithm proposed in this paper outperforms Peng’s algorithm [
31], and the difference between the clearance measurements algorithm delivered and the manual surveyed references are within decimeter (average error is 0.08 m). Compared with Peng’s algorithm [
31], the improvement of the proposed algorithm achieved in this paper is mainly attributable to the different extraction and fitting method of the power line. The proposed method improves the accuracy of clearance measuring by geometric distribution analysis in local span point clouds slices and replacing segmented centroid fitting in Peng’s algorithm [
31] with catenary fitting, thus obtaining more accurate results.
4. Discussion
The experiment results mentioned above have proven the effectiveness and accuracy of the proposed clearance anomaly detection algorithms utilizing UAV-borne LiDAR data. The detected results illustrate that the proposed method can extract anomalies exceeding the minimal clearance thresholds, such as tree encroachments. The differences between the clearance measurements delivered by the proposed algorithm and the manual surveyed references in the point clouds are within decimeter. The UAVs are more wind-sensitive than the manned helicopters or fixed wing planes. To guarantee a safe inspection, the experiment datasets are collected in calm weather condition. The datasets express no wind-bias phenomenon. Windy weather will affect the catenary shape of the conductors, resulting in precision losses of the catenary fitting. Under this circumstance, a wind adaptive power line modeling strategy such as minimum description length approach [
14] should be used to fit the power line point clouds segments.
The point density is vitally important in the automatic clearance anomaly detection process. The lack of laser point clouds density will lead to less well sampled point clouds on the non-power-facility objects in the ROW, resulting in loss of precision of the clearance measurement. To investigate the impact of the point clouds density on the clearance calculation, we compared the results derived from the proposed algorithm and the field survey. An easy-to-reach detected clearance anomaly location (
Figure 12) was selected for field verification of the clearance anomaly detection results short after the data collection, restricted by the inconvenient transportation caused by the complex terrain of the experimental regions. The surveyed clearance fault locates on the C phase (lowest conductor) of the power lines between pylons 40 and 41 in the ROW 1 dataset. The distance between the power line and the tree encroachment is manually measured by a total station. The clearance anomaly location is shown in the photo taken in the field during the verification process (
Figure 12a) and in the LiDAR point clouds (
Figure 12b), respectively. The staff of the local power supply bureau uses total station to measure the distance between low point on the C phase of the power lines and the underlying tree canopy, and the result is reported as 2.42 m. The clearance calculated by the proposed algorithm is 2.22 m, resulting in a 0.20 m difference. At this clearance anomaly location, the manual measurement of the clearance in the laser point clouds is 2.31 m that is 0.09 m different from that of the proposed algorithm. The detected clearance anomaly are depicted in
Figure 13a,b. The corresponding clearance curve of the span 40–41 is shown in
Figure 13c.
In the field verification working condition, many error sources can cause the observed 0.20 m error, including the manual alignment error between the treetop and the low point on the conductor when operating the total station, the deviation caused by wind influencing the actual treetop position, etc. It is worth noting that insufficient LiDAR point cloud density may cause the precision related issues observed. In our experiment, the point density is about 35 points/m2. The lack of point density should be considered as one of the reasons for the measurement deviation. The laser point clouds fail to reconstruct the full geometry of the top of the tree encroachment because of the relatively low point density, which directly leads to the measurement deviation.
Existing studies related to tree height measurements usually took advantage of the low flying altitude of the UAV and repeated scans to achieve a very high point density to guarantee accurate results in the investigated forest plots. Jaakkola et al. [
59] built the first UAV LiDAR system for tree measurements. The density of its generated point clouds of the test flights was 100–1500 points/m
2. Wallace el al. [
60,
61] presented estimates of tree location (mean deviation (MD) of less than 0.48 m) and tree height (MD of 0.35 m) achieved using point clouds of up to 300 points/m
2 density collected by their customized UAV LiDAR. Recently, UAV laser scanning-based automated tree-level field reference collection has been proven feasible using point clouds with an average density of 800 points/m
2 [
62]. In addition, the UAV LiDAR system (e.g., RiCOPTER) has the potential to perform comparable to terrestrial laser scanning for estimating forest canopy height utilizing its very high density point clouds (3000–5000 points/m
2) [
54]. However, those studies mainly focus on the refined investigation of forest plots within relatively small areas (e.g., 500 m
2) using low altitude (e.g., 50 m above the ground) UAV LiDAR data.
The ROW inspection applications are different from forest applications. The inspected ROWs are usually long (>5 km) during each flight. Very low flying altitude and repeated scans is considered as inefficient and dangerous (threats to the power facilities). It is not technically sound and applicable to endeavor to collect very high density point clouds (e.g., >1000 points/m
2) for detailed tree top modeling in ROW inspection applications. Finding an appropriate point density for ROW inspection is a compromise and balance of the efficiency and the precision. The 35 points/m
2 point density of the developed UAV LiDAR system is already much higher than the general point density of the standard manned air-borne LiDAR system (e.g., typical value: 10 points/m
2). Compared with the manual measurements in the point clouds, the proposed algorithm achieved an average error of 0.08 m and RMSE of 0.04 m (
Table 5 and
Table 6), which is considered applicable according to the power industry standard of China DL/T 741-2010—“Operation code for overhead transmission line”. The proposed clearance anomaly detection method only considers the current status of the ROW. Thus, in future work, the dynamic feature of the conductors and the objects in the ROW should be considered. Geometric ecological modeling of individual trees will be carried out to simulate the dynamic change of the forest geometrical shape under different environment conditions to find the potential clearance faults. Environmental adaptive power line modeling methods will be explored to model the changes of the conductors under different weather conditions for better detection of the clearance anomalies.