Next Article in Journal
Enhancing Robot Task Planning and Execution through Multi-Layer Large Language Models
Previous Article in Journal
Measurement of 3D Wrist Angles by Combining Textile Stretch Sensors and AI Algorithm
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Efficient Vertical Structure Correlation and Power Line Inference

1
Robotics Department, University of Michigan, Ann Arbor, MI 48109, USA
2
Aerospace and Ocean Engineering Department, Virginia Tech, Blacksburg, VA 24061, USA
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(5), 1686; https://doi.org/10.3390/s24051686
Submission received: 3 January 2024 / Revised: 10 February 2024 / Accepted: 1 March 2024 / Published: 5 March 2024
(This article belongs to the Section Physical Sensors)

Abstract

:
High-resolution three-dimensional data from sensors such as LiDAR are sufficient to find power line towers and poles but do not reliably map relatively thin power lines. In addition, repeated detections of the same object can lead to confusion while data gaps ignore known obstacles. The slow or failed detection of low-salience vertical obstacles and associated wires is one of today’s leading causes of fatal helicopter accidents. This article presents a method to efficiently correlate vertical structure observations with existing databases and infer the presence of power lines. The method uses a spatial hash key which compares an observed tower location to potential existing tower locations using nested hash tables. When an observed tower is in the vicinity of an existing entry, the method correlates or distinguishes objects based on height and position. When applied to Delaware’s Digital Obstacle File, the average horizontal uncertainty decreased from 206 to 56 ft. The power line presence is inferred by automatically comparing the proportional spacing, height, and angle of tower sets based on the more accurate database. Over 87% of electrical transmission towers were correctly identified with no false negatives.

1. Introduction

Power lines are difficult to sense directly due to their small cross-section and irregular catenary shape. Occlusion from parallel wires, movement due to wind, sagging, and highly varied background further increase the power line sensing complexity. Tracking and indexing these structures relies on largely voluntary reporting followed by manual correlation and entry, which results in incomplete and inaccurate databases. The inadequate detection and perception of vertical structures is behind only a loss of situational awareness such as controlled flight into terrain (CFIT), as the most common known cause of fatal civilian helicopter accidents [1]. Obstacle strikes are also a leading cause of military rotor craft losses [2]. Wire strikes cause even more accidents than collisions with vertical structures [3] due to their near invisibility to the naked eye and sensors.
The paper proposes an automatic and efficient method to correlate sensed vertical structures. First, we create a hash table to enable lookup and correlation. Our hash key resolution is within DOF’s most accurate horizontal uncertainty, thus avoiding repeated entries for the same coordinates while retaining relevance throughout a hemisphere. Next, an index hash table (IHT) assigns this spatial key to existing entry values (such as position and height uncertainty). The uncertainty hash table (UHT) builds a list of vertical structure hashes whose uncertainty encompasses a given spatial hash. Observed towers are efficiently correlated and used to update existing IHT entries.
The refined IHT tower position is leveraged to infer the presence of associated power lines. Instead of searching for the virtually invisible wire, we predict a wire’s presence based on the configuration and geometric arrangement of the supporting transmission towers or other vertical structure. Pairs of towers that are within a distance proportional to their height and have a similar height are associated. The angle between continuous sets of three towers is also taken into account to reduce false positives.
This topic is of critical importance to low-flying aircraft ranging from the helicopters of today to the advanced air mobility (AAM) and uncrewed aircraft systems (UAS) of tomorrow.
The goals of this article are to first efficiently consolidate vertical structure position information from sensor data and then find power lines based on structure locations. This article offers a method for efficiently correlating and updating existing vertical obstacle databases with new observations. Next, towers within the updated database are compared to infer the presence of power lines. Specific contributions are as follows:
  • A new method to efficiently correlate vertical structures;
  • A novel approach to reliably finding potentially hazardous wires based on their arrangement, proximity, and similarity;
  • Evaluation of these approaches against the current Delaware Digital Obstacle File.
Following the background and literature review, Section 2 provides an overview of the database update and power line inference methods. Section 3 describes the FAA Digital Obstacle File used for our experimentation. Section 4 presents results of our methods. Section 5 discusses the overall performance of our method, while Section 6 offers conclusions.

1.1. Current Uses of Vertical Structure Data

There are several examples where large amounts of raw information is organized into useful maps. This integrated data can then inform motion planning or other forms of action selection and decision making.
Several approaches use pole mapping for vehicle localization. The large data scale requires that the area of consideration be down-sampled due to onboard computer system storage and computation time constraints. Detecting numerous poles that maintain the same physical characteristics over time provides an opportunity to match detected pole patterns with an a priori map [4]. The technique in [4] used quantization to compare an average of 18 poles within 50 m of the moving vehicle with an a priori pole map with one-meter accuracy to locate a vehicle’s position. A more recent mapping approach minimizes residual error between extracted pole and road curb points in successive frames to create a local feature map [5]. Neither of these techniques update the high-accuracy a priori pole map. Both approaches rely on high resolution at close range for efficient correlation. Refs. [6,7] project extracted points to the ground plane as squares. If the squares overlap, they are combined into a single-pole entity. Poles that are not seen repeatedly are removed from the map using this sliding window. The extracted poles are compared with a 30 m square reference map for localization. Recent approaches that use semantic labeling for localization and mapping rely on continuous, dense surfaces that are associated with rich imagery [8].
Above the ground level, the Federal Aviation Administration’s (FAA’s) Digital Obstacle File (DOF) is the definitive, publicly available source for vertical structures that could be a hazard to flight operations. Currently, adding and revising human-made obstacles that are far away from airports with instrument approaches largely relies on voluntary reporting from infrastructure builders. These reports are occasionally supplemented by imprecise observations from aircrews or ground personnel. Reported vertical structures are manually entered into the database and are seldom confirmed by onsite inspections or correlation with other data sources. High-resolution 3D data, such as LiDAR point clouds, is not allowed to be a primary source of obstacle information [9]. Obstructions greater than three miles from designated airports that are less than 499 ft above the ground level are not considered “obstructions to air navigation”, ref. [10] making low-altitude obstacles especially prone to oversight. Figure 1 shows an example of the disparity in two leading vertical obstacle data bases: the Federal Aviation Administration’s (FAA) Digital Obstacle File (DOF) and the National Geospatial-Intelligence Agency’s (NGA) Digital Vertical Obstacle File (DVOF). Although some obstacles are mutually represented, a significant number of vertical structures are present in only one of the two databases.
DVOF and DOF use cases focus on two domains: ground-level and flight altitudes greater than 500 ft above ground level. These focus areas omit the low-altitude flight environment that is essential for traditional helicopters, emerging advanced aerial mobility (AAM) aircraft, and small uncrewed aircraft systems (UASs).

1.2. Current Data Structures

Efficiently representing the environment is a long-standing challenge. The data structure for the ground-level domain supports either short-range forecasting or high-level exhaustive comparison. Ref. [4] used quantization that divided the area of consideration based on radius (50 m) and position certainty (1 m). Infrastructure predictive mapping [11] consolidated the structures along with other map features and tiles in the GeoPackage data structure [12].
The data structure for aerial obstacles must include large geographical areas, but data latency depends on manual examination and verification. Obstacle accuracy and completeness wane at lower altitudes away from major airports. In DOF, an accuracy better than 250 ft horizontally and 50 ft vertically is only motivated by the need for obstacle clearance when descending to or departing from airports [13]. As a result, over half of the DOF obstacles have a position uncertainty larger than 250 ft horizontally and 50 ft vertically.
Other work has found ways to efficiently map more general features in other safety-critical applications. Recent approaches use feature matching between previously gathered point clouds and current perspectives [14]. Although this approach minimizes the memory required to match features in a variety of locations, it relies on a pre-processed, high-resolution point cloud previously gathered from a viewpoint that is similar to the current 3D sensor perspective.

1.3. Power Line Mapping

Due to the ever-changing nature and sheer quantity of electrical infrastructure, there have been several efforts to automate power line mapping. A crowd-sourcing approach [15] has been proposed but is no longer online. Recent efforts use night-time lighting patterns in satellite imagery to predict the infrastructure position to within 1000 m 70% [16] or 75% [11] of the time.
Other wire-finding methods depend on detecting wires directly. Airborne methods that automatically segment power lines rely on continuous contact [17,18], known location [19,20], and/or very close range [21,22,23]. We propose to leverage the fact that power lines and other wires are intrinsically associated with more apparent vertical structures.

1.4. Problem Statement

Quickly consolidating ever evolving information is the leading challenge. The previously described automatic approaches are vulnerable to false positives and false negatives. Given multiple incomplete and inaccurate databases and current observations, how can obstacles be reliably and automatically correlated and updated? Given the additional position accuracy, how can tower arrangement and relationship be used to infer the presence of power lines?

2. Methods

Our previous work presented methods for efficiently locating prominent vertical structures in large-point cloud data. We will compare these precise positions with the known a priori obstacle databases to create a more comprehensive and complete obstacle listing. Figure 2 presents a proposed method for correlating detected vertical structures to an existing database. If the vertical structure is not within the horizontal uncertainty of an existing structure, it will be added to the database as a new item. If the detected structure is within the horizontal uncertainty of a structure described in the database, they will be correlated and the database meta data will retain the more accurate position attributes.
Next, Section 2.2 uses this refined vertical obstacle position database to infer the presence of power lines. This method starts by associating vertical structures that have a similar height and proportional distance using Algorithm 2. Then, Algorithm 3 iterates through each set of vertical structures, checking whether the interior angle exceeds pre-determined alignment criteria.
Algorithm 1: Update algorithm. Array of existing database entries represented with p r i o r subscript. Array of aspects of newly observed structure denoted by o b s subscript.
1:
procedure UpdateExisting( I H T , U H T , O b s )
2:
     L a t L o n H a s h S p a t i a l H a s h e r ( l a t o b s , l o n o b s )
3:
    if  U H T [ L a t L o n H a s h ] then                 ▹ if observed hash exists in prior
4:
        for  c e n t e r U H T [ L a t L o n H a s h ]  do
5:
            p r i o r I H T [ c e n t e r ]
6:
            U p p e r p r i o r H t p r i o r + V e r t U n c e r t p r i o r
7:
            L o w e r p r i o r H t p r i o r V e r t U n c e r t p r i o r
8:
           if  o b s H t p r i o r L o w e r , o b s H t p r i o r U p p e r  then             ▹ similar height
9:
                h o r i D i s t d i s t B e t w e e n ( l a t p r i o r , l o n p r i o r , l a t o b s , l o n o b s )
10:
                a g e p r i o r Δ d a t e p r i o r
11:
                a g e o b s Δ d a t e o b s
12:
                a g e w e i g h t a g e o b s a g e o b s + a g e p r i o r
13:
               if  h o r i U n c e r t o b s h o r i D i s t  then
14:
                    h o r i D i s t h o r i U n c e r t o b s
15:
                h o r i D i s p a g e w e i g h t · h o r i D i s t
16:
                l a t L o n u p d a t e p o i n t O f f s e t ( h o r i D i s p , l a t p r i o r , l o n p r i o r , l a t o b s , l o n o b s )
17:
               if  h o r i U n c e r t o b s h o r i U n c e r t p r i o r  then
18:
                    h o r i U n c e r t u p d a t e h o r i U n c e r t o b s
19:
               else
20:
                    h o r i U n c e r t u p d a t e h o r i U n c e r t p r i o r
Algorithm 2: Tower association algorithm where ϵ represents the height uncertainty and P L is a list of sublists of tower spatial hash keys.
1:
ν height–distance ratio
2:
α additional height buffer
3:
z u p p e r upper-height limit
4:
z l o w e r lower-height limit
5:
procedure ListBuilder( o b s , I H T )
6:
    for  i o b s  do
7:
         o b s k e y S p a t i a l H a s h e r ( o b s ( i ) )
8:
         D i s t m a x o b s ( i ) z · ν
9:
         z m a x o b s ( i ) z + o b s ( i ) ϵ + α
10:
         z m i n o b s ( i ) z o b s ( i ) ϵ α
11:
        if  o b s ( i ) z > z u p p e r AND o b s ( i ) z < z l o w e r  then
12:
           for  j I H T do                      ▹ search subset in vicinity
13:
                D i s t d i s t a n c e B e t w e e n ( o b s ( i ) , I H T ( j ) )
14:
               if  D i s t < D i s t m a x  then
15:
                   if  I H T ( j ) z z m i n AND I H T ( j ) z z m a x  then
16:
                        f o u n d F a l s e
17:
                       for  k P L do                        ▹ k = sublist
18:
                          if  o b s k e y k  then           ▹ if observed tower exists on sublist
19:
                               P L ( k ) I H T ( j ) k e y             ▹ add similar tower to sublist
20:
                               f o u n d T r u e break
21:
                          if  I H T ( j ) k e y k  then             ▹ if similar tower is on sublist
22:
                               P L ( k ) o b s k e y                ▹ add observed tower to sublist
23:
                               f o u n d T r u e break
24:
                          if n o t   f o u n d then          ▹create new sublist with both towers
25:
                               P L [ o b s k e y , I H T ( j ) ]
Algorithm 3: Transmission tower list checking algorithm. P L = list of sublists, L, of tower spatial hash keys. Additional alignment checks in blue.
1:
n minimum number of towers per list
2:
θ m i n minimum tower angle
3:
θ a l i g n maximum angle for alignment
4:
H t m a x maximum height for less-aligned series
5:
H D R s e r i e s height–distance ratio for less-aligned series
6:
procedure ListScrubber( P L )
7:
    for  L P L  do
8:
        if  l e n g t h ( L ) n  then
9:
            L s o r t e d ( L )                     ▹ order entries W-E, N-S
10:
           for  i l e n g t h ( L 2 )  do
11:
                T 1 L ( i )
12:
                T 2 L ( i + 1 )
13:
                T 3 L ( i + 2 )
14:
                θ s e r i e s 180 a n g l e B e t w e e n ( T 1 , T 2 , T 3 )
15:
                H t s e r i e s m a x H e i g h t B e t w e e n ( T 1 , T 2 , T 3 )
16:
                D i s t s e r i e s m a x D i s t B e t w e e n ( T 1 , T 2 , T 3 )
17:
                D i s t m a x m a x H t ( T 1 , T 2 , T 3 ) · H D R s e r i e s
18:
               if i == 0 then
19:
                   if  θ s e r i e s < θ a l i g n  then continue
20:
                   if  θ s e r i e s > θ m i n  then continue    ▹ no continue for alignment checks
21:
                       if  H t s e r i e s < H t m a x  then continue
22:
                       if  D i s t s e r i e s < D i s t m a x  then continue
23:
                       else P L . a p p e n d ( L [ i + 1 : ] )
24:
                   else P L . a p p e n d ( L [ i + 1 : ] )             ▹ add new L without first tower
25:
               else
26:
                   if θ s e r i e s < θ a l i g n then continue
27:
                   if θ s e r i e s < θ m i n then continue
28:
                     if H t s e r i e s < H t m a x then continue
29:
                     if D i s t s e r i e s < D i s t m a x then continue
30:
                     else P L . a p p e n d ( L [ i : ] )
31:
                   else P L . a p p e n d ( L [ i : ] )

2.1. Efficient Database Updates

We create a hash table to enable lookup and correlation with constant time complexity. Hashtables rely on a succinct and descriptive key. Our key is based on the current World Geodetic System (WGS) 1984 projection. Selecting a resolution of 0.25 s equates to approximately 25 ft in latitude and between 19 and 24 ft in longitude for the continental United States. This resolution is within DOF’s most accurate horizontal uncertainty, thus avoiding repeated entries for the same coordinates.
In degree, minute, and second format, representing latitude or longitude requires seven digits (DD MM SS.SS) when we remove the character specifying the hemisphere. We retain degrees to retain relevance throughout a hemisphere. Also, a single degree of longitude is only 48 miles at the northern section of the continental United States, which is well within the span of an aerial vehicle’s operating range. Combining latitude and longitude provides a unique 16 character string.
Next, we build an index hash table (IHT). This table reads in the data fields from an existing DOF or DVOF database and adds a spatial hash key based on rounding the given coordinates up to the nearest 0.25 s. Simply searching for the nearest neighbor is not sufficient due to numerous vertical obstacles and their associated large, uneven, and overlapping horizontal uncertainties. An updated vertical structure coordinate may not be closest to its existing database location. Exhaustively searching within the overlapping uncertainties (even with the reduced spatial hash resolution) requires checking at least 9 (for 20 ft horizontal uncertainty) and rapidly increasing to over 54,000 cells with a horizontal uncertainty of one nautical mile. Given that most obstacles in DOF have an uncertainty of at least 250 ft (143 cells), the search process must be efficient.
We use the IHT with spatial hash keys to create a second hash table. The purpose of this second hash table is to readily determine whether a queried location is within the horizontal uncertainty of an existing vertical object. The uncertainty hash table (UHT) builds a list of vertical structure hashes whose uncertainty encompasses a given spatial hash. For example, the spatial hash for the center red cell in Figure 3 would be the value for the 31 keys that are the spatial hash for each of the cells that encompass the provided horizontal uncertainty.
When the array of uncertainty cells for an entry in the IHT overlap with another, as they do in Figure 4, the UHT key includes values for each relevant index. We instantiate a multimap to allow multiple entries for each key in the UHT.
After creating the initial IHT and the corresponding UHT, we incorporate new observations. An observation consists of the latitude, longitude, height above ground level (AGL), horizontal uncertainty, and observation date. Algorithm 1 provides an overview of the update process. If an observed vertical structure’s coordinate exists within the UHT, the observation is compared to each IHT element in the UHT list. First, we determine that the observation and existing IHT entry are similar when the observed height is within the uncertainty range of the existing entry. If the heights coincide, we determine the horizontal distance between the observation and the prior entry. Instead of updating the entry to the midpoint, we place the new location based on the age of the observation (Equation (1)). Since the majority of DOF entries are many years old, we make displacement proportional to the relative age of the observation and the prior database entry, as shown in the example in Figure 5. The horizontal uncertainty is updated to the observed horizontal uncertainty as long as the observed uncertainty is less than the prior IHT entry.
h o r i D i s p = a g e o b s a g e o b s + a g e p r i o r · h o r i D i s t

2.2. Power Line Inference

Using our more accurate and comprehensive vertical structure catalogs, we then implement and evaluate a power line finding algorithm.
We hypothesize that at least three towers are necessary to support power lines and other wires. We also hypothesize that a line of at least three power line pylons would share three characteristics:
  • The height above ground for each tower will be within a certain range;
  • The angle between this set of towers will be less than 90 degrees;
  • The spacing between successive towers will be within a certain range.
We assume a tower detection range of 1000 m. This conservative detection range coupled with a sensor azimuth of 40° could encompass three transmission towers supporting power lines with over 700 m uniform spacing ( 2128 m 3 t o w e r s ) as shown in Figure 6. This wide field of consideration is also suited for the low-altitude flight profile where the heading and flight path is consistently varied. The approach equally considers obstacles across the entire field of view versus depending on narrow foveal vision. Although this approach would be designed for relatively simple online implementation, it could function just as well in an offline application where the power line presence is inferred prior to takeoff.
Our approach starts by associating towers with a similar height and within a certain distance. Distance between towers is proportional to the tower height. In addition to tower height, the upper limit ( z u p p e r ) is defined by the uncertainty of the vertical measurement plus a global additional height buffer, α .
Next, Algorithm 3 cycles through each list of associated towers, L. It starts by sorting the list entries so that they are arranged from West to East, then North to South. Then, it removes any tower list that contains less than three towers. Next, the algorithm checks whether the interior angle between each set of three towers in the list has an interior angle greater than or equal to the minimum tower angle, θ m i n . Figure 7 shows an example of an interior angle.
Algorithm 3 also includes provisions for a more nuanced angle-based check. The blue text shows a secondary level of more restrictive height difference and distance if the towers are not aligned within a more conservative θ a l i g n . This secondary approach is designed to be more permissive for closely aligned towers while maintaining scrutiny on towers that are not in a straight line.

3. Setting

We use the Federal Aviation Administration’s publicly available Digital Obstacle File (DOF) as a baseline. DOF contains multiple descriptive fields for each obstacle entry, including location, height AGL, height accuracy, horizontal accuracy, and revision date. DOF files are separated by state and issued every 56 days. For our subsequent analysis, we chose the DOF file for the state of Delaware. Delaware offers a variety of urban, suburban, and rural infrastructure in a compact dataset. A histogram of Delaware’s 19 March 2023 DOF is shown in Figure 8. Table 1 shows the breakdown of horizontal accuracy attributed to each DOF entry. Of the 1063 objects, more than half have a horizontal uncertainty greater than 250 ft with an overall average horizontal accuracy of 206 ft. On average, the last time a DOF entry was added, updated, or verified was 2015.
The National Geospatial-Intelligence Agency has a similar vertical obstacle database, known as the Digital Vertical Obstacle File (DVOF). This database is unclassified but only available to United States government employees. For the state of Delaware, DVOF contains over 15,000 entries with an average horizontal accuracy of less than 100 ft. For this analysis, we use Delaware’s DVOF as observations against DOF.

4. Results

Delaware’s DOF dataset offers a variety of vertical obstacles. First, we ingest the DOF information into an index hash table (IHT) and assign unique spatial hash values. Next, we build an uncertainty hash table (UHT) which populates spatial hash cells within the radius of the existing DOF coordinate. This evaluation then finds whether a more recent DVOF observation lies within the UHT and proceeds to correlate and update the original DOF entry. We use the improved database for power line inference.

4.1. Database Updating

Figure 9 shows that, before implementing DVOF observations with Algorithm 1, the most frequent horizontal uncertainty value was 250 ft. The 1063 entries had an average horizontal accuracy of 206 ft.
Figure 10 shows (in orange) how 719 of the original 1063 entries were updated. Including the 344 uncorrelated entries (in blue), the overall horizontal uncertainty decreased to 56 ft.
We apply our method to all vertical structure entries in the refined list that result from the previously described database updating approach. This exhaustive comparison provides a sense of effectiveness with a variety of transmission tower arrangements. An entry in the Delaware DOF that was in the transmission line tower category and was also inferred to be a transmission line tower was a true positive (TP). An entry that was correctly categorized as another type was a true negative (TN). False positives (FPs) were DOF entries that were erroneously categorized as a transmission tower. False negatives (FN) were entries which were categorized as transmission towers in the DOF database, but were not labeled as a transmission tower with the previously described methods.
Table 2 categorizes several existing database update methods. These data structures either compile (in that they add new observations) or match (in that they quickly aggregate new obstacle information along with uncertainty). No existing approach both automatically (as opposed to manually) evaluates new entries and supplements (as opposed to overwriting) existing entries. Our proposed method refines object position accuracy, automatically adds new entries, and automatically supplements existing database objects.

4.2. Power Line Inference

4.2.1. Rejecting False Negatives

The most essential aspect while deducing the presence of power lines is avoiding false negatives. This requires the tower assembled transmission tower lists to include all potential transmission towers. The upper- and lower-height limit ( z u p p e r and z l o w e r ) in Algorithm 2 were set to 300 and 49 ft, respectively, according to descriptions of recent transmission tower construction projects [24,25]. Height–distance ratio, ν , was evaluated from 1 to 15. The additional height buffer, α , was evaluated from 5 to 200 ft in 5 ft increments.
There were several examples of entries in the Delaware DOF that were categorized as transmission line towers that escaped the consolidation approach in Algorithm 2. Most of these exceptions were due to isolated entries which only show one or two transmission towers of a much longer series (Figure 11). Other transmission towers had significant height variations (Figure 11 and Figure 12). Isolated entries were removed from further analysis since associated towers did not exist in Delaware’s DOF.
Figure 13 shows how false positives increase with a larger height buffer and height–distance ratio. False negatives show the opposite trend, dropping sharply with a height–distance ratio, ν , greater than 6. When ν = 85 f t and α = 9 , the false negative rate is zero and the false positive rate is 14.9%.

4.2.2. Further Reduction in False Positives

We hypothesized that false positives would reduce when successive sets of three towers within a list L were closely aligned with a large interior angle. Continuing with ν = 85 f t and α = 9 , the minimum tower angle, θ m i n was incrementally evaluated according to the basic (black only) steps in Algorithm 3. Even with a conservative 90 degree angle between towers, the algorithm isolated and incorrectly rejected several entries that were categorized as transmission towers. Figure 14 shows an example of a tower (in red circle) that is rejected. If at least two more towers supporting the same dashed orange power line were charted, the span would be depicted as a separate span. Figure 15 is an example of a single tower at the beginning of an electrical transmission line. Figure 16 shows another example of towers that are not in the Delaware DOF past the shoreline.
Even by ignoring these isolated entries, false negatives grew significantly while increasing the minimum tower angle, θ m i n (Figure 17). False positives slowly decreased with increasing θ m i n .
This rising number of false negatives led to the implementation of the secondary alignment checks in Algorithm 3. The secondary checks applied to sets of three tower series that had an angle of alignment, θ a l i g n , less than 4 deg. False negative and false positive rates for maximum series height differences ( H t m a x ) and height–distance ratios that were more restrictive than the baseline ν = 85 f t and α = 9 resulted in Figure 18 and Figure 19. As with the previous incremental checks, false negative rates increased when a smaller allowable height difference occurred between the towers. False negative rates also increase with a smaller height–distance ratio, H D R s e r i e s . False positive rates showed the opposite tendency, increasing with larger distance and height allowances. Ultimately, the lowest false positive rate that maintained zero false negatives was 13%. This occurred with H D R s e r i e s = 6 and H t m a x = 30 f t .
Overall results are presented in Table 3. Although adding the alignment filter described in Algorithm 3 reduces false positives and increases true negatives, it does not lead to the identification of any additional true positives.

5. Discussion

This article explains and evaluates methods for efficiently correlating tower observations with existing, potentially less accurate, database entries. Creating the index and uncertainty hash tables allows the rapid updating of existing entries with a common spatial hash key while significantly increasing average horizontal accuracy. Next, the article explains a way to exploit the improved accuracy of this database to determine whether a vertical structure is likely to be an electrical transmission tower. Although the categorization of transmission line towers in the Delaware DOF was mostly correct, isolated towers had to be manually removed to avoid false negatives. Removing these outliers left us with more than 99% of the original dataset.
This evaluation treated entries from a larger vertical structure database (DVOF) as updated observations. DVOF contained over ten times the number of DOF for the state of Delaware. Despite the larger number of entries, more than 30% of DOF entries were not updated. Spot checking showed that most of these DOF entries that were not updated were not contained in DVOF. This indicates that even a large database (such as DVOF) can benefit from being compared to other vertical structure listings.
This article used tower height, height uncertainty, position, position uncertainty, and date of last action to compare, contrast, and associate tower structures. In addition to these properties, vertical structure sensors (such as LiDAR or video) also collect gather geometric and radiometric information. Geometric properties, such as width or the presence of cross bars, could be another way to correlate power line transmission structures. Also, sets of transmission towers are typically made of the same material, whether that is steel, wood, or concrete. Each of these material types has a unique radiometric reflectance which could be yet another associative criteria.
The methods were evaluated against the 1063 vertical structures contained in a recent Delaware DOF. Although Delaware’s DOF offered a variety of power line structures, the state does not contain a significant amount of terrain relief. Both the database and power line inference methods rely on similar heights above ground level to consolidate duplicate entries and associate sets of transmission towers. Although the height above ground might remain similar for towers in rolling terrain, tower height could also vary to clear hills or other elevated points. Rolling terrain may also cause less uniform tower spacing, which could challenge the proposed power line inference method.
Airborne platforms that could be gathering tower locations will likely also have significant own ship position uncertainty. The platform action model that would inform the amount of uncertainty was not included in the experimental results. The uncertainty hash table construct is designed to accommodate large and overlapping horizontal uncertainties, but this ability should be verified in future work.
Future work should examine the effectiveness of the vertical structure and power line finding methods in rolling and steep terrain. Other efforts should also investigate an architecture that accepts dispersed observations, as opposed to comparing offline databases. Raw observations will contain additional details about each structure which are not included in these databases. Incorporating these radiometric and structural properties could further increase the effectiveness of associating towers when inferring power lines or comparing database entries.

6. Conclusions

The database correlation approach addresses critical aspects of distributed mapping for the safety-critical aviation use case. This article proposes a way of overcoming the difficult challenge of detecting power lines by considering the arrangement of associated towers which are much easier to detect. The simple and explainable process can be adapted to larger datasets supplemented with distributed observations. Comparing and correlating prior vertical obstacle databases between the wide variety of manual and automatic tower discoveries shows the potential for a comprehensive repository. This repository can be used for a variety of purposes, including reducing the risk of catastrophic obstacle collisions. The large-scale and critical nature of vertical obstacle infrastructure demands an efficient way to maintain awareness despite continuing expansion.

Author Contributions

Conceptualization, P.F. and E.A.; methodology, P.F. and E.A.; software, P.F.; validation, P.F. and E.A.; formal analysis, P.F.; investigation, P.F.; resources, P.F., E.A. and N.S.; data curation, P.F.; writing—original draft preparation, P.F.; writing—review and editing, E.A. and N.S.; visualization, P.F.; supervision, E.A. and N.S.; project administration, E.A. and N.S.; funding acquisition, P.F. and E.A. All authors have read and agreed to the published version of the manuscript.

Funding

This effort was partially funded by the Omar Nelson Bradley Fellowship and the United States Army.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The publicly available Digital Obstacle File (DOF) was analyzed in this study. Restrictions apply to the availability of Digital Vertical Obstruction Files (DVOF). DVOF was obtained from the NGA’s Aero Browser and is available with the permission of the National Geospatial-Intelligence Agency. Satellite imagery in figures is from Google Earth.

Conflicts of Interest

Paul Flanigen is a United States Army officer. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
AAMAdvanced Aerial Mobility
AGLAbove Ground Level
AHBAdditional Height Buffer
CFITControlled Flight into Terrain
DOFDigital Obstacle File
DVOFDigital Vertical Obstruction File
FAAFederal Aviation Administration
FNFalse Negative
FPFalse Positive
HDRHeight–Distance Ratio
IHTIndex Hash Table
LiDARLight Detection and Ranging
NGANational Geospatial-Intelligence Agency
TNTrue Negative
TPTrue Positive
UASUncrewed Aircraft Systems
UHTUncertainty Hash Table
WGSWorld Geodetic System

References

  1. Fox, R.G. The history of helicopter safety. In Proceedings of the International Helicopter Safety Symposium, Montréal, QC, Canada, 26–29 September 2005; Volume 690. [Google Scholar]
  2. Couch, M.; Lindell, D. Study on Rotorcraft Safety and Survivability; Technical Report; Defense Acquisition University: Fort Belvoir, VA, USA, 2010. [Google Scholar]
  3. Chandrasekaran, R.; Payan, A.P.; Collins, K.B.; Mavris, D.N. Helicopter wire strike protection and prevention devices: Review, challenges, and recommendations. Aerosp. Sci. Technol. 2020, 98, 105665. [Google Scholar] [CrossRef]
  4. Brenner, C. Global localization of vehicles using local pole patterns. In Proceedings of the Pattern Recognition: 31st DAGM Symposium, Jena, Germany, 9–11 September 2009; pp. 61–70. [Google Scholar]
  5. Cai, Y.; Lu, Z.; Wang, H.; Chen, L.; Li, Y. A Lightweight Feature Map Creation Method for Intelligent Vehicle Localization in Urban Road Environments. IEEE Trans. Instrum. Meas. 2022, 71, 8503115. [Google Scholar] [CrossRef]
  6. Schaefer, A.; Büscher, D.; Vertens, J.; Luft, L.; Burgard, W. Long-term urban vehicle localization using pole landmarks extracted from 3 to D lidar scans. In Proceedings of the 2019 European Conference on Mobile Robots (ECMR), Prague, Czech Republic, 4–6 September 2019; pp. 1–7. [Google Scholar]
  7. Dong, H.; Chen, X.; Stachniss, C. Online range image-based pole extractor for long-term lidar localization in urban environments. In Proceedings of the 2021 European Conference on Mobile Robots (ECMR), Bonn, Germany, 31 August–3 September 2021; pp. 1–6. [Google Scholar]
  8. Rosinol, A.; Abate, M.; Chang, Y.; Carlone, L. Kimera: An open-source library for real-time metric-semantic localization and mapping. In Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, 31 May–31 August 2020; pp. 1689–1696. [Google Scholar]
  9. Federal Aviation Admin. Advisory Circular 150/5300-17C. 2017. Available online: https://www.faa.gov/documentLibrary/media/Advisory_Circular/150-5300-17C-Chg1.pdf (accessed on 2 March 2024).
  10. Federal Aviation Admin. Advisory Circular 70/7460-1L. 2018. Available online: https://www.faa.gov/documentLibrary/media/Advisory_Circular/AC_70_7460-1L_-_Obstuction_Marking_and_Lighting_-_Change_2.pdf (accessed on 2 March 2024).
  11. Arderne, C.; Zorn, C.; Nicolas, C.; Koks, E. Predictive mapping of the global power system using open data. Sci. Data 2020, 7, 19. [Google Scholar] [CrossRef]
  12. GeoPackage Encoding Standard. 2021. Available online: https://www.ogc.org/standard/geopackage/ (accessed on 7 April 2023).
  13. Federal Aviation Admin. Order 8260.19I. 2020. Available online: https://www.faa.gov/documentLibrary/media/Order/Order_8260.19I.pdf (accessed on 2 March 2024).
  14. Wiesmann, L.; Marcuzzi, R.; Stachniss, C.; Behley, J. Retriever: Point cloud retrieval in compressed 3D maps. In Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA, 23–27 May 2022; pp. 10925–10932. [Google Scholar]
  15. Rivera, J.; Leimhofer, J.; Jacobsen, H.A. OpenGridMap: Towards automatic power grid simulation model generation from crowdsourced data. Comput. Sci.-Res. Dev. 2017, 32, 13–23. [Google Scholar] [CrossRef]
  16. Gershenson, D.; Rohrer, B.; Lerner, A. A New Predictive Model for More Accurate Electrical Grid Mapping. 2019. Available online: https://engineering.fb.com/2019/01/25/connectivity/electrical-grid-mapping/ (accessed on 7 April 2023).
  17. Zhou, G.; Yuan, J.; Yen, I.L.; Bastani, F. Robust real-time UAV based power line detection and tracking. In Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA, 25–28 September 2016; pp. 744–748. [Google Scholar] [CrossRef]
  18. Junior, A.A.V.; Cugnasca, P.S. Detecting cables and power lines in Small-UAS (Unmanned Aircraft Systems) images through deep learning. In Proceedings of the 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC), San Antonio, TX, USA, 3–7 October 2021; pp. 1–7. [Google Scholar]
  19. Stambler, A.; Cover, H.; Strabala, K. Benchmarking a LIDAR obstacle perception system for aircraft autonomy. In Unmanned Systems Technology XX, Proceedings of the SPIE DEFENSE + SECURITY, Orlando, FL, USA, 15–19 April 2018; SPIE: Bellingham, WA, USA, 2018; Volume 10640, pp. 159–169. [Google Scholar]
  20. Ippolito, C.; Krishnakumar, K.; Hening, S. Preliminary results of powerline reconstruction from airborne LiDAR for safe autonomous low-altitude urban operations of small UAS. In Proceedings of the 2016 IEEE SENSORS, Orlando, FL, USA, 30 October–3 November 2016; pp. 1–3. [Google Scholar]
  21. Golightly, I.; Jones, D. Corner detection and matching for visual tracking during power line inspection. Image Vis. Comput. 2003, 21, 827–840. [Google Scholar] [CrossRef]
  22. Zhou, C.; Yang, J.; Zhao, C.; Hua, G. Fast, accurate thin-structure obstacle detection for autonomous mobile robots. In Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA, 21–26 July 2017; pp. 1–10. [Google Scholar]
  23. Azevedo, F.; Dias, A.; Almeida, J.; Oliveira, A.; Ferreira, A.; Santos, T.; Martins, A.; Silva, E. Lidar-based real-time detection and modeling of power lines for unmanned aerial vehicles. Sensors 2019, 19, 1812. [Google Scholar] [CrossRef]
  24. Electrical Volt. Electrical Transmission Tower: Types, Design and Parts. 2022. Available online: https://www.electricalvolt.com/2022/11/electrical-transmission-tower-types-design-parts/ (accessed on 21 April 2023).
  25. Western Renewables Link. Fact Sheet: Transmission Towers and Conductors. 2022. Available online: https://www.westernrenewableslink.com.au/assets/resources/Transmission-towers-and-conductors-May-2022.pdf (accessed on 21 April 2023).
Figure 1. Vertical obstacles in San Francisco. Towers and other vertical structures from DOF are shown with yellow pins. Obstacles from DVOF are denoted by red X’s.
Figure 1. Vertical obstacles in San Francisco. Towers and other vertical structures from DOF are shown with yellow pins. Obstacles from DVOF are denoted by red X’s.
Sensors 24 01686 g001
Figure 2. Tower correlation options. Algorithm 1 compares an existing vertical structure entry and associated horizontal uncertainty (green) with an observation (orange). The observation and entries are either correlated and consolidated (true positive) or the observation is found to not exist in the database (true negative).
Figure 2. Tower correlation options. Algorithm 1 compares an existing vertical structure entry and associated horizontal uncertainty (green) with an observation (orange). The observation and entries are either correlated and consolidated (true positive) or the observation is found to not exist in the database (true negative).
Sensors 24 01686 g002
Figure 3. The light gray inner circle has a 50 ft radius to represent 50 ft horizontal uncertainty. The darker gray boundary is thickened to represent imprecision. This allows the center to be anywhere within the red center spatial hash’s 0.25 s resolution. The 30 outlying cells encompass this uncertain circumference.
Figure 3. The light gray inner circle has a 50 ft radius to represent 50 ft horizontal uncertainty. The darker gray boundary is thickened to represent imprecision. This allows the center to be anywhere within the red center spatial hash’s 0.25 s resolution. The 30 outlying cells encompass this uncertain circumference.
Sensors 24 01686 g003
Figure 4. Three cells that coincide with 50 ft (left) and 25 ft (right) horizontal uncertainties are shown in green. In the uncertainty hash table (UHT), the entries for the red and orange center cells of the 50 and 25 ft circles have the same spatial hash for the key and value. The off-center blue cell UHT entry has the blue spatial hash for its key, but the corresponding value is the spatial hash for the center coordinate of the 50 ft circle. Each green cell has its coordinate’s spatial hash for the key, but because the cells are within the uncertainty of two vertical structure entries, each green key has two values.
Figure 4. Three cells that coincide with 50 ft (left) and 25 ft (right) horizontal uncertainties are shown in green. In the uncertainty hash table (UHT), the entries for the red and orange center cells of the 50 and 25 ft circles have the same spatial hash for the key and value. The off-center blue cell UHT entry has the blue spatial hash for its key, but the corresponding value is the spatial hash for the center coordinate of the 50 ft circle. Each green cell has its coordinate’s spatial hash for the key, but because the cells are within the uncertainty of two vertical structure entries, each green key has two values.
Sensors 24 01686 g004
Figure 5. Example of position update procedure based on age of observation. The prior four-year-old tower observation (green) is compared to the more recent one-year-old tower observation (orange). The updated position (purple) is 1/5 of the horizontal distance between the prior entry and the observation.
Figure 5. Example of position update procedure based on age of observation. The prior four-year-old tower observation (green) is compared to the more recent one-year-old tower observation (orange). The updated position (purple) is 1/5 of the horizontal distance between the prior entry and the observation.
Sensors 24 01686 g005
Figure 6. Top–down view of a notional airborne 3D sensor (not to scale). With a 1000 m sensor range and 40° azimuth, at least three vertical obstacles (shown in blue) with spacing ≤ 709 m will be present in the field of view.
Figure 6. Top–down view of a notional airborne 3D sensor (not to scale). With a 1000 m sensor range and 40° azimuth, at least three vertical obstacles (shown in blue) with spacing ≤ 709 m will be present in the field of view.
Sensors 24 01686 g006
Figure 7. Top–down view of the interior dashed angle between three towers supporting an orange power line.
Figure 7. Top–down view of the interior dashed angle between three towers supporting an orange power line.
Sensors 24 01686 g007
Figure 8. Histogram for vertical obstacles contained in Delaware’s Digital Obstacle File.
Figure 8. Histogram for vertical obstacles contained in Delaware’s Digital Obstacle File.
Sensors 24 01686 g008
Figure 9. Original distribution of Delaware DOF horizontal uncertainty.
Figure 9. Original distribution of Delaware DOF horizontal uncertainty.
Sensors 24 01686 g009
Figure 10. Distribution of Delaware horizontal uncertainty after correlation. Blue bars represent entries that were not changed, orange bars represent updated entries.
Figure 10. Distribution of Delaware horizontal uncertainty after correlation. Blue bars represent entries that were not changed, orange bars represent updated entries.
Sensors 24 01686 g010
Figure 11. Isolated exceptions in the Delaware DOF. The 68 ft tall tower in the green rectangle (a) is within 230 ft of the accompanying towers in yellow rectangles that support the dashed red power line. A 123 ft cell tower (dashed orange rectangle) co-located with a line of uncharted 30 ft utility poles supporting the red power line (b).
Figure 11. Isolated exceptions in the Delaware DOF. The 68 ft tall tower in the green rectangle (a) is within 230 ft of the accompanying towers in yellow rectangles that support the dashed red power line. A 123 ft cell tower (dashed orange rectangle) co-located with a line of uncharted 30 ft utility poles supporting the red power line (b).
Sensors 24 01686 g011
Figure 12. A tall 433 ft cell tower in the Delaware river (left dashed orange rectangle) is much higher than the 139 ft tower on the shoreline. The next land-based tower (yellow dashed rectangle) does not exist in Delaware’s DOF.
Figure 12. A tall 433 ft cell tower in the Delaware river (left dashed orange rectangle) is much higher than the 139 ft tower on the shoreline. The next land-based tower (yellow dashed rectangle) does not exist in Delaware’s DOF.
Sensors 24 01686 g012
Figure 13. Results fromevaluating tower association algorithm, false negative (left) and false positive (right).
Figure 13. Results fromevaluating tower association algorithm, false negative (left) and false positive (right).
Sensors 24 01686 g013
Figure 14. A line of charted towers supports an solid orange power line which takes a 90 degree turn at the tower in the red square. The tower in the red circle is rejected due to this sharp angle. Subsequent towers supporting the same power line (now a dashed yellow line) are not charted. Three towers in the Delaware DOF support a power line shown with a solid yellow line; the towers supporting the dashed yellow portion are not charted.
Figure 14. A line of charted towers supports an solid orange power line which takes a 90 degree turn at the tower in the red square. The tower in the red circle is rejected due to this sharp angle. Subsequent towers supporting the same power line (now a dashed yellow line) are not charted. Three towers in the Delaware DOF support a power line shown with a solid yellow line; the towers supporting the dashed yellow portion are not charted.
Sensors 24 01686 g014
Figure 15. A transmission tower (red circle) is not categorized as a transmission tower supporting the dashed blue power line due to the sharp 90 degree turn towards the power plant. The power plant’s 189 ft smokestack is an entry in Delaware DOF.
Figure 15. A transmission tower (red circle) is not categorized as a transmission tower supporting the dashed blue power line due to the sharp 90 degree turn towards the power plant. The power plant’s 189 ft smokestack is an entry in Delaware DOF.
Sensors 24 01686 g015
Figure 16. Four transmission towers (solid red circles) that support a power line (orange line) across a river are in the Delaware DOF and are correctly recognized by the list-builder algorithm. The angle-checking algorithm rejects the assignment due to their rectangular arrangement. Uncharted towers (dashed red circles) that support the terrestrial portion of the power lines (orange-dashed lines) are not in the Delaware DOF.
Figure 16. Four transmission towers (solid red circles) that support a power line (orange line) across a river are in the Delaware DOF and are correctly recognized by the list-builder algorithm. The angle-checking algorithm rejects the assignment due to their rectangular arrangement. Uncharted towers (dashed red circles) that support the terrestrial portion of the power lines (orange-dashed lines) are not in the Delaware DOF.
Sensors 24 01686 g016
Figure 17. Concentration of false positive and false negative tower assignments with varying minimum tower angles, θ m i n .
Figure 17. Concentration of false positive and false negative tower assignments with varying minimum tower angles, θ m i n .
Sensors 24 01686 g017
Figure 18. False negative rates obtained by the incremental checking of maximum series height differences ( S H t m a x ) from 15 to 84 ft and height–distance ratios from 1 to 8.
Figure 18. False negative rates obtained by the incremental checking of maximum series height differences ( S H t m a x ) from 15 to 84 ft and height–distance ratios from 1 to 8.
Sensors 24 01686 g018
Figure 19. False positive rates obtained by the incremental checking of maximum series height differences ( S H t m a x ) from 15 to 84 ft and height–distance ratios from 1 to 8.
Figure 19. False positive rates obtained by the incremental checking of maximum series height differences ( S H t m a x ) from 15 to 84 ft and height–distance ratios from 1 to 8.
Sensors 24 01686 g019
Table 1. Distribution of horizontal accuracy for Delaware’s Digital Obstacle File.
Table 1. Distribution of horizontal accuracy for Delaware’s Digital Obstacle File.
Horizontal
Accuracy (±Feet)
QuantityPercent
2024923.4
50958.9
10020.2
25057153.7
50012011.3
100010.1
Undefined252.4
Table 2. Comparison of existing and proposed feature mapping processes. New entries are manually (M) or automatically (A) added. For mapping that absorbs found objects, new observations overwrite (O) or supplement (S) previous feature data.
Table 2. Comparison of existing and proposed feature mapping processes. New entries are manually (M) or automatically (A) added. For mapping that absorbs found objects, new observations overwrite (O) or supplement (S) previous feature data.
Object Position AccuracyNew Entries TreatmentMatches Objects
Arrangement
Matches Individual ObjectsObject Correlation
DOF, GeoPackage [12]M-S
2D projection [6,7]-A-O
Quantization [4,5]----
Predictive mapping [11,16]-A--O
Point cloud matching [14]----
Proposed database updating methodA-S
Table 3. Optimum setting for power line inference. HDR: height–distance ratio, AHB: additional height buffer, θ a l i g n : minimum angle for alignment, H t m a x : maximum height difference among aligned tower series, H D R s e r i e s : height–distance ratio for aligned tower series, TN: true negative, TP: true positive, FN: false negative (excludes previously described examples of isolated transmission towers), FP: false positive.
Table 3. Optimum setting for power line inference. HDR: height–distance ratio, AHB: additional height buffer, θ a l i g n : minimum angle for alignment, H t m a x : maximum height difference among aligned tower series, H D R s e r i e s : height–distance ratio for aligned tower series, TN: true negative, TP: true positive, FN: false negative (excludes previously described examples of isolated transmission towers), FP: false positive.
HDR, ν AHB, α (ft) θ align (deg) Ht max (ft) HDR series TNTPFNFPFP (%)
985---471408015514.99
4306492408013412.96
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Flanigen, P.; Atkins, E.; Sarter, N. Efficient Vertical Structure Correlation and Power Line Inference. Sensors 2024, 24, 1686. https://doi.org/10.3390/s24051686

AMA Style

Flanigen P, Atkins E, Sarter N. Efficient Vertical Structure Correlation and Power Line Inference. Sensors. 2024; 24(5):1686. https://doi.org/10.3390/s24051686

Chicago/Turabian Style

Flanigen, Paul, Ella Atkins, and Nadine Sarter. 2024. "Efficient Vertical Structure Correlation and Power Line Inference" Sensors 24, no. 5: 1686. https://doi.org/10.3390/s24051686

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop