1. Introduction
For the past few years, unmanned aerial vehicles (UAVs) have been widely used in precision agriculture [
1], terrain mapping [
2], battlefield surveillance [
3], search and rescue [
4], and disaster management [
5], etc. When performing these applications, the UAVs acquire high-resolution images that can be elaborated with PaRS techniques to obtain metric products (for example DEM, orthomosaics, etc.) [
6]. In photogrammetry, a large number of overlapping aerial images taken orthogonal to the ground need to be stitched together using structure from motion (SFM) algorithms to generate what is known as an “orthophoto” [
7]. Lots of commercially available photogrammetry software packages can be used to produce a digital elevation model (DEM) of the region of interest (ROI), which can then be used to extract valuable information on the surveyed areas [
8].
The task of generating a path that covers the entire ROI, considering the vehicle’s motion restrictions and sensor characteristics, is called coverage path planning (CPP) [
9]. UAV coverage path planning can usually be carried out by either a rotary-wing or fixed-wing UAV. When performing photogrammetric applications, the UAV is equipped with a camera, fixed directly to the airframe or mounted on a gimbal, pointing straight down or forward-down [
10,
11]. Rotary-wing UAVs, such as quadcopters and hexacopters, are capable of performing vertical take-off and landing (VTOL), low-altitude flights, and hovering tasks. However, these platforms have limited payload and endurance. The typical flight time for a rotary-wing UAV is less than half an hour, meaning only a small region can be imaged [
12]. As for fixed-wing UAVs, they are less maneuverable than rotor drones and are not able to perform hovering tasks, but they can carry heavier payloads and have much higher endurance in comparison with rotary-wing vehicles. A single flight of a fixed-wing UAV normally lasts more than an hour [
13]. Therefore, fixed-wing UAVs are more ideal for photogrammetry in a large detection area, which is the focus of this paper.
When dealing with a CPP problem, there are two questions that immediately come to mind: how to process the region of interest to simplify the path planning problem while guaranteeing complete coverage, and how to design an appropriate flight pattern in view of the practical situation. For the former, region decomposition has been studied in much of the literature and achieved fruitful results. No decomposition [
14], exact cellular decomposition [
15], and approximate cellular decomposition [
16] are three main categories of decomposition methods developed in the literature. There is no need for decomposition in regular-shaped and non-complex areas of interest, such as rectangular areas. The exact cellular decomposition method decomposes the workspace into sub-regions, also called cells, whose re-union exactly occupy the ROI. This method is usually applied to an irregular region [
17], a concave region [
18], and a region with obstacles [
19], and these types of regions are mostly decomposed in convex sub-regions in order to reduce the concavities and simplify coverage by boustrophedon decomposition [
20], and so on. As for approximate cellular decomposition, it discretizes the region of interest with an irregular shape into a set of regular cells in the form of squares [
21], hexagons [
22], or triangles. Then, grid-based methods such as the wavefront algorithm [
23] and the spanning tree coverage (STC) algorithm [
24] are applied over approximate areas to generate coverage paths. However, the path generated tends to be erratic and contains many sharp turns which violate the dynamic constraints of fixed-wing UAVs. Hence the grid-based methods are more commonly utilized with rotary-wing UAVs. Coming back to fixed-wing UAVs, it is not difficult to conclude that a fundamental and practical problem for the UAV is path planning in a convex polygon region, which will be studied in this paper.
In addition, it is worth paying attention in coverage path planning to the flight patterns of UAVs. Two simple geometric flight patterns that are employed most commonly in real-world scenarios are back-and-forth (BF) and spiral (SP), especially for fixed-wing UAVs with maneuver constraints. For a spiral flight pattern, the flight path is straight lines with 90 degrees turns, starting from the center of the ROI, and expanding outward or vice versa [
25]. The back-and-forth pattern is also known as boustrophedon or zigzag movement; in this type of movement, the UAV executes long straight flights and 180-degree turning maneuvers when reaching the boundaries [
26]. These scan-type paths (a group of parallel lines covering a certain area) are naturally suitable for UAV photogrammetry applications. As a result, there is no doubt that the BF pattern is widely utilized in photogrammetry with fixed-wing UAVs.
Finally, when it comes to the performance metrics of complete coverage path planning, the total traveled distance or the path length [
27], coverage flight time [
28], energy consumption [
29], and the number of turns [
30] are most commonly found in the literature. Among them, the number of turning maneuvers is frequently utilized as the main performance metric in CPP. For it has been proved that a path with fewer turns is more efficient in terms of route length, duration, and energy [
11]. Moreover, in a BF flight pattern where the ROI is covered by parallel lines and the fixed-wing UAV makes turns outside the region, the number of turns is even more critical. In fact, not only the number of turning maneuvers is important, but the path length of turning maneuvers also has a significant impact. It is not enough to merely take into account the number of turns. Nevertheless, to our best knowledge, the path length of turns has not been considered in the present literature, which triggered the current research.
Furthermore, the turning radius constraints of fixed-wing UAVs are usually ignored to simplify path planning and reduce the computational complexity in the current researches. Typically, the minimum turning radius is assumed to be smaller than the sensor footprint [
10]. However, in a practical scenario, the minimum turning radius is a function of vehicle maneuverability and speed, while the camera footprint is related to the camera’s focal length and the distance between the camera and the ground [
12]. As a consequence, the relationship between them is variable. When the minimum turning radius is larger than the camera footprint, there will be a wide turning maneuver between two adjacent paths, which can be found in fixed-wing UAV field trials in [
19]. These wide turning maneuvers are not expected in practice, as it means more energy consumption and longer turning distances. At present, although this is generally recognized to be important, there are few researches which have fully discussed the relationship between the minimum turning radius and the sensor footprint, which is the main motivation of our study.
In light of the above discussions, this paper is focused on the complete coverage path planning issue for a fixed-wing UAV in a convex polygon region, considering the photogrammetric-sensing application requirements and UAV’s turning radius constraints, with the aim of both minimizing the number of turns and the path length of turns. The main contributions are highlighted as follows: (1) A typical camera model pointing forward-down for photogrammetric application is given, and the relationship between the sensor footprint and the minimum turning radius is fully studied and modeled. (2) Considering the relationship between the minimum turning radius and the camera footprint, a novel flight pattern based on back-and-forth is proposed, named as the interlaced back-and-forth pattern in this paper. (3) In the framework of the proposed flight pattern, a practical low-computation algorithm for path generation is presented; furthermore, the path length of turns is proved to be shorter than the traditional BF pattern in mathematics.
The remainder of this paper is organized as follows:
Section 2 introduces the related work.
Section 3 gives the camera model and describes the coverage path planning problem. The new flight pattern and practical path generation algorithm are proposed in
Section 4. Simulation experiments and comparative analysis, to validate the proposed method, are shown in
Section 5. Finally, conclusions are given in
Section 6.
2. Related Work
For remote sensing in ports with an unmanned aerial vehicle, a coverage path planning method based on region optimal decomposition (ROD) was presented [
31]. Firstly, the concave detection area was completely decomposed into convex sub-regions, and an improved depth-first search (DFS) algorithm was applied to merge some sub-regions, which realized so-called “region optimal decomposition”. Then, the back-and-forth (BF) flight pattern was used to cover each sub-region, and the optimal traversal order of all sub-regions was determined by genetic algorithm (GA). The simulation showed that the number of turns was reduced by 4.34% and the non-working distance was shortened by about 29.91%, compared with the situation without decomposition. This reference gives us a good idea of region decomposition and traversal order determination. However, our study focused on path planning in a convex area. Furthermore, the remote sensing for the port environment with a multi-rotor UAV did not consider the dynamics constraints of the fixed-wing UAV.
Especially for photogrammetric applications, a novel energy-aware spiral (E-SP) pattern was first proposed in [
32]. This reference considered several practical necessities of photogrammetry, such as image overlapping rates, resolution of the camera, and field of view, to guarantee a complete area mapping. The energy model computing the energy consumption including climbing, descending, acceleration, deceleration, constant speed, and rotation. A wide range of simulations was done by MATLAB, compared with the energy-aware back-and-forth (E-BF) method. Results indicated that the E-SP pattern outperformed E-BF in all cases, providing an energy saving with a percentage improvement of 10.37%, even in the worst scenario. However, the energy-aware spiral model was based on a quadrotor, so it may not be suitable for fixed-wing UAVs.
In reference [
33], the maneuver constraints of fixed-wing UAVs were considered in path planning for performing persistent surveillance tasks. A low-computation algorithm that combined an A* graph search technique and spline-based methods was presented to generate feasible flight paths with
continuity. Two different experiments were provided; in the first case, the minimum turning radius was smaller than the sensor footprint, while in the other, the minimum turning radius played a critical role in planning feasible paths. It can be found that the paths in the target region contained many wide turns, particularly when the minimum turning radius exceeded the sensor footprint. This was due to the nature of the persistent surveillance task. In such a task, the UAV route was restricted to the target area and needed to be closed-loop. Differing from persistent surveillance missions, overlapping aerial images need to be taken in a regular pattern and the target area should only be covered once in UAV photogrammetry.
Probably the most relevant research to our paper is reference [
34]. In this reference, the back-and-forth (BF) flight pattern was used in the coverage path planning and the dynamics constraints of the fixed-wing UAV were taken into consideration. Three turning scenarios—span less than turning radius, span equal to turning radius, and span greater than turning radius—were discussed, and the second turning strategy was claimed to be the best. Then, the region of interest (ROI) was divided into parallel paths at regular intervals and the CPP problem was transformed into a TSP problem. To solve the TSP problem, an improved genetic algorithm (GA) was proposed and proved to be more effective than conventional GA by simulations. However, as pointed out by the authors, when the number of paths was increased, the data size would be squared in the TSP problem, greatly reducing the convergence speed, and increasing path planning time. In our paper, a practical iterative method with low computation for paths generation is presented. In any case, what calls for special attention is that our turning strategy varies according to the relationship between sensor footprint and the minimum turning radius; the turning span is not merely equal to the turning radius.
3. Problem Formulation
In this section, a camera model of the fixed-wing UAV pointing forward-down is established, and the entire region of interest (ROI) is divided into parallel sub-regions in the width of the sensor footprint considering the overlap rate. Then, the coverage path planning (CPP) problem is defined.
The camera model mounted on the fixed-wing UAV is shown in
Figure 1. As depicted in
Figure 1, a fixed-wing UAV flying at height
acquires an image with the camera pointing forward-down, the corresponding trapezium area
is called the projected area, also called the camera footprint.
For conservative reasons and to ensure the quality of the photos, the bottom width of the camera footprint
is defined as the sweep breadth of camera, which can be computed by:
where
is the horizontal angle of view,
is the vertical angle of view,
is the front-mounted angle (the included angle between the bisector of
and UAV’s longitudinal axis), and
is the pitch angle.
The zoom camera can vary the focal length
to meet different task requirements.
,
change as
changes:
where
and
are image width and height respectively.
By Equations (1) and (2), we can conclude that camera footprint is a function of , , , , , . The image width and height , are constants, and when the fixed-wing UAV flies horizontally at cruise speed , the front-mounted angle and the pitch angle are usually set as constants. Therefore, the camera footprint is varied according to flight height and the focal length , that is .
In path planning, a practical issue that is often overlooked is shooting advance distance
, shown in
Figure 1.
must be taken into account in waypoints generation. It can be computed by:
After the sweep breadth of camera
is calculated, the region of interest can be completely covered by parallel paths at a certain distance
, which means the distance between two adjacent paths, as shown in
Figure 2. In addition,
also means the width of a sub-region. It can be obtained that
, where
represents the overlap rate between two images. This overlap is generally necessary for photogrammetry. As depicted in
Figure 2, the ROI can be divided into a set of parallel sub-regions in the width of
; once all these sub-regions are scanned, the entire ROI is completely covered.
As for the kinematic model of the fixed-wing UAV, it can be obtained according to the reference [
34]:
where
is the lift of the UAV,
is the rolling angle of the UAV,
is the mass and
is the turning radius of the UAV,
represents the acceleration of gravity, and
is the instantaneous velocity of the UAV,
.
By Equation (4), the minimum turning radius of the fixed-wing UAV can be obtained as follows:
where
is the minimum flight speed of the UAV during the mission,
is the gravitational acceleration, and
is the rolling angle of the fixed-wing UAV.
The rolling angle represents the maneuverability of the fixed-wing UAV. It is not difficult to find that the minimum turning radius is related to its maneuverability and turning speed.
Based on the above discussions, the specific coverage path planning problems studied in this paper are given as follows:
Problem 1. For a convex polygon ROI, determine the best sweep direction of the UAV to reduce the number of turns.
Problem 2. Considering the relationship between the minimum turning radiusand the width of a sub-region, design a turning strategy to shorten the path length of turns.
Problem 3. Generating the waypoints for the fixed-wing UAV, ensure all sub-regions are searched, so that the ROI is entirely covered.
4. Materials and Methods
To solve the problems raised, the corresponding methods will be detailed in this section. Firstly, the coordinates of the ROI vertices are converted from the WGS-84 coordinate system to the local Cartesian coordinate system, which is also known as the East, North, Up (ENU) coordinate system. Secondly, the convex polygon of the ROI is rotated to find the minimum width direction, so as to determine the best sweep direction. Then, the convex polygon is divided into parallel polygonal sub-regions in the width of
, and the points where the UAV enters/leaves the sub-regions are computed. The turning strategy is determined by the relationship between the minimum turning radius
and the sub-region width
. Finally, the waypoints in the proposed interlaced back-and-forth flight pattern are generated and converted from the ENU coordinate system back to the WGS-84 coordinate system for the UAV field flight requirements. The flow chart of the CPP method proposed in the paper is shown in
Figure 3.
4.1. Coordinate Conversion
In a practical photogrammetry mission, the only information of the ROI that can be obtained is the vertex coordinates in the WGS-84 coordinate system. Assuming the input vertices of the ROI are
in turns,
is the number of vertices, the coordinates of the
i-th vertex
,
, are
, where
and
are the longitude and latitude of the vertex
, and
is the altitude of the vertex
. Since the vertices
,
are defined in the WGS-84 coordinate system, which is a spherical coordinate system and inconvenient for UAV path planning, it is necessary to convert the coordinates of the ROI vertices from the WGS-84 coordinate system to the ENU coordinate system. In the ENU coordinate system, the origin is set by the user, the
x-axis is pointing east, the
y-axis is pointing north, and the
z-axis is pointing up. To convert the coordinates from the WGS-84 coordinate system to the ENU coordinate system, the Earth-centered, Earth-fixed (ECEF) coordinate system is needed as a bridge. The coordinates of vertex
,
, are converted to coordinates that are in the ECEF coordinate system, then, they are converted to
,
that are in the ENU coordinate system. The specific conversion formulas can be found in [
26], which considered the Earth’s radius for higher accuracy.
Because the coverage path planning of the UAV in the following section is a two-dimensional path planning problem, only the information of the x-axis and y-axis is considered, vertices in the ENU coordinate system are set as , , ignoring the z-coordinate.
Depending on the task and endurance of the fixed-wing UAV, the area of the ROI can be up to 4 km
2. We assume the vertices of the ROI are
,
,
,
and
in the WGS-84 coordinate system. After coordinate conversion, the vertices are
,
,
,
and
in the ENU coordinate system,
is set as the origin, as shown in
Figure 4.
The coordinates of
,
, and
,
, are given in
Table 1.
4.2. Sweep Direction Determination
The sweep direction of the UAV plays a crucial role in the number of turning maneuvers when the back-and-forth (BF) flight pattern is utilized, as shown in
Figure 5. As suggested by [
35], the optimal sweep direction for coverage is parallel to the minimum width direction of the convex polygon. In this direction, the ROI can be covered with the smallest number of parallel paths, thus with the smallest number of turns.
In order to find the minimum width direction of the convex polygon of the ROI and determine the best sweep direction, a method based on rotation transformation is utilized. In the ENU coordinate system, the polygon of the ROI is rotated
,
degrees counterclockwise about the origin. After rotation transformation, the new vertices of the polygon
,
can be obtained:
where
is the rotational transfer matrix,
,
, are the vertex coordinates in the ENU coordinate system before rotation transformation.
The vertex coordinates
,
are computed for every degree of rotation. Set
,
,
. When
, we have
. Then
,
can be obtained:
where
is the rotational transfer matrix with
,
,
, are the vertex coordinates in the ENU coordinate system before rotation transformation.
For the polygon with vertices
,
, its minimum width direction is parallel to the
x-axis of the ENU coordinate system, so the optimal sweep direction of this polygon is parallel to the
x-axis too, as depicted in
Figure 6.
4.3. Polygon Decomposition
After the polygon of the ROI is converted to the polygon
whose minimum width direction is parallel to the
x-axis, it is not difficult to find that the flight direction of the UAV should be perpendicular to the
x-axis, as depicted in
Figure 5. Therefore, the polygon is divided into polygonal sub-regions parallel to the
y-axis, and the points where the UAV enters and leaves the sub-regions can be computed.
In this paper, the span coefficient of the fixed-wing UAV is first proposed, and is defined as follows:
where function
ceil represents rounding up,
is the minimum turning radius of the fixed-wing UAV,
is the sub-region width as defined in
Section 3.
The number of sub-regions can be calculated as follows:
where
is the span coefficient,
is the sub-region width,
,
,
are the maximum and minimum x-coordinate values of the vertices
,
.
The border between the
j-th sub-region and (
j+1)-th sub-region can be computed by Equation (10).
where
is minimum x-coordinate values of the vertices
,
,
is the sub-region width, and
is the number of sub-regions.
Then, the
j-th sub-region can be represented as follows:
The x-coordinate value of path that the UAV passes in the
j-th sub-region can be computed as follows:
The expressions of the edges of the convex polygon
can be written as follows:
where
is the slope of the
i-th edge,
is the y-intercept of the
i-th edge,
and
are the minimum and maximum x-coordinate values of the
i-th edge,
and
are the minimum and maximum y-coordinate values of the
i-th edge.
Since the polygon region and sub-regions have been modeled, the minimum and maximum y-coordinate values of the vertices of each sub-region can be calculated. Let the set of y-coordinates values of all vertices in the j-th subregion be , . The relationship between edges of the polygon and sub-regions are discussed and the set of are computed according to Equations (11) and (13).
- (i)
When the minimum and maximum x-coordinate values of the
i-th edge of the polygon
satisfy the following inequalities:
that means the
i-th edge passes through the left border of the
j-th subregion. Therefore,
and
should be included in the set of
, that is
.
- (ii)
When the minimum and maximum x-coordinate values of the
i-th edge of the polygon
satisfy the following inequalities:
that means the
i-th edge passes through the right border of the
j-th subregion. Hence,
and
should be included in the set of
, that is
.
- (iii)
When the minimum and maximum x-coordinate values of the
i-th edge of the polygon
satisfy the following inequalities:
that means the
i-th edge passes through the left and right border of the
j-th subregion, both. So,
and
should be included in the set of
, that is
.
Based on the discussions and calculations above, the set of
,
, can be obtained. Let the minimum and maximum values of the set of
be
and
, respectively, it can be obtained
,
,
. Considering the shooting advance distance
, the y-coordinate value of the UAV enters/leaves the
j-th subregion is
/
, where
,
, as shown in
Figure 7. Combine with
computed by Equation (10), the waypoints of the UAV entering or leaving the
j-th sub-region are determined as
or
.
4.4. Analysis of the Turning Strategy
To shorten the path length of turns, a novel turning strategy considering the relationship between the minimum turning radius and the width of a sub-region is proposed and compared with the traditional method.
Firstly, the traditional turning strategy is introduced. In a traditional turning scenario, the ROI is swept line by line, after a sub-region is scanned, the fixed-wing UAV will make a turn maneuver to the next sub-region adjacent. And the path of turning is usually a Dubins path. Dubins path is the shortest path connecting two points in a two-dimensional plane, with prescribed initial and terminal direction of the velocity [
36]. A typical turning scenario when
by traditional turning strategy is depicted in
Figure 8, which is an RLS type of Dubins path; R represents turning clockwise while L means turning counterclockwise, and S stands for a straight line.
Let the first path length of turn be
, and it can be obtained as follows:
where
is the angle of the arc
,
,
is the minimum turning radius of the fixed-wing UAV.
Let the second path length of turn be
, it can be obtained as follows:
where
is the angle of the arc
,
, and
is the minimum turning radius of the fixed-wing UAV.
Let the straight path length of turn be
, it can be calculated as follows:
where
is the minimum turning radius of the fixed-wing UAV and
is the width of a sub-region.
The total curve path length of a turn in traditional turning strategy is denoted as
, and it is defined as follows:
The total path length of a turn in traditional turning strategy is denoted as
, it is defined as follows:
As shown in
Figure 8, when
is larger than
, there will be a wide turning maneuver between two adjacent paths by the traditional turning strategy. These wide turns cost more energy and lead to longer turning distances. To solve this problem, a novel interlaced turning strategy is presented in the paper.
In the interlaced turning strategy, after a sub-region is scanned, the fixed-wing UAV will make a turn to the next sub-region, which is adjacent or apart by several sub-regions, depending on the relationship between
and
. The interlaced turning scenario is shown in
Figure 9, which is an LSL type of Dubins path, L represents turning counterclockwise, and S stands for a straight line.
Let the first curve path length of turn by the interlaced turning strategy be
, and it can be obtained as follows:
where
is the minimum turning radius of the fixed-wing UAV.
Let the second curve path length of turn by the interlaced turning strategy be
, it can be obtained as follows:
where
is the minimum turning radius of the fixed-wing UAV.
Let the straight path length of turn by the interlaced turning strategy be
, it can be calculated as follows:
where
is the span coefficient defined in Equation (6),
is the width of a sub-region, and
is the minimum turning radius of the fixed-wing UAV.
The total curve path length of a turn by the interlaced turning strategy is denoted as
, and it is defined as follows:
The total path length of a turn in the interlaced turning strategy is denoted as
, it is defined as follows:
Through comparative analyses of the traditional and proposed turning strategies, the following important results can be obtained:
Result 1. The total curve path length of a turnby the interlaced turning strategy is always shorter than that by the traditional turning strategy when , that is.
Proof. Equation (20) minus Equation (25), we can obtain . Since , , it is obvious that , thus . □
Result 2. The straight path length of a turn by the interlaced turning strategy is always shorter than that by the traditional turning strategy when.
Proof. Square Equation (19), we have:
Then, square Equation (24), we have:
Let Equation (27) minus Equation (28), it can be obtained that:
If we have
, the following condition needs to be met according to Equation (29):
that can be converted to in Equation (31) as follows:
where
is defined in Equation (8),
.
Denote the left-hand side of the inequality (31) as , where , . Denote the right-hand side of the inequality (31) as , where , , .
When , we have , , that is .
When , we have , , so .
When , we have , , so .
When
, we assume
,
, where
is a positive integer and
. It can be obtained that:
Since
, we have:
Because
is a positive integer and
, it can be obtained that:
By inequality (32) and (34), we have when .
Therefore, it can be obtained that , when . So, the inequality (30) holds, we have if . □
Result 3. The total path length of a turn by the interlaced turning strategy is always shorter than that by the traditional turning strategy when.
Proof. From Equation (26), we have the total path length of a turn in the interlaced turning strategy, that is , and we have the total path length of a turn in traditional turning strategy, that is according to Equation (21). Result 1 indicates while Result 2 states in the condition of . Hence it can be concluded that when . □
Result 4. The total path length of a turn by the interlaced turning strategy may be longer or shorter than that by the traditional turning strategy when.
Proof. From Equation (26), we have the total path length of a turn in the interlaced turning strategy, that is , and we have the total path length of a turn in traditional turning strategy, that is according to Equation (21). Result 1 indicates . However, when . Therefore, the relationship between and must be calculated by Equations (21) and (26). □
Remark 1. When,, the traditional turning strategy degenerates to the interlaced turning strategy presented in this paper.
4.5. Waypoints Generation
The aim of coverage path planning is path generation. For the UAV, the paths are generated through waypoints, because the UAV flies according to input waypoint instructions. Based on the above discussions, we have found the optimal sweep direction, and the waypoints where the UAV enters or leaves each sub-region. Above all, the interlaced turning strategy has been fully studied. It is time to determine all waypoints according to the proposed turning strategy and link them together in sequence.
Remark 2. The waypoints are firstly generated for the polygon regionfor convenience, then, the coordinates of the waypoints are transformed back to the ROIby the inverse rotational transfer matrix.
When
, that is
, the coverage flight pattern with the interlaced turning strategy is the same as the conventional BF flight pattern, just as shown in
Figure 5. However, when
, the flight pattern is quite different. The UAV will sweep the ROI
times; after the ROI has been swept once, the UAV makes a turn for the next sweep. This is due to the interlaced turning strategy. We have named this new type of flight pattern as the interlaced BF pattern. A typical coverage path in an interlaced BF flight pattern when
is shown in
Figure 10.
It can be obtained that the number of sub-regions that the UAV passes through in each sweep is:
where
is the span coefficient defined in Equation (8),
is the sub-region width,
,
,
are the maximum and minimum x-coordinate values of the vertices
,
.
The number of the UAV making a turn to the next sweep can be obtained as .
Assuming the start point of the UAV is
, at the upper left of the polygon region
. Let the set of sub-regions that the UAV passes through in the
p-th (
) sweep be
, it can be obtained as follows:
where
represents the serial number of the sub-region.
Combining the set of
with the waypoints of the UAV entering and leaving the
j-th sub-region obtained in
Section 4.3, the waypoints of the UAV in each sweep are determined. The waypoints connecting each sweep are discussed below:
- (i)
When
is odd, the UAV will make a turn to the next sweep at the bottom right of the polygon region
when it sweeps from the start point
. The start point
and end point
of the
p-th (
) turn to the next sweep are determined as follows:
where
,
is the minimum x-coordinate values of polygon
,
,
is the sub-region width,
represents the minimum y-coordinate value of the UAV waypoint before entering the
-th subregion,
represents the maximum y-coordinate value of the UAV waypoint before entering the
-th subregion.
- (ii)
When
is even, the UAV will make a turn to the next sweep at the upper right of the polygon region
when it sweeps from the start point
. The start point
and end point
of the
p-th (
) turn to the next sweep are determined as follows:
where
,
is the minimum x-coordinate values of polygon
,
,
is the sub-region width,
represents the maximum y-coordinate value of the UAV waypoint before entering the
-th subregion,
represents the maximum y-coordinate value of the UAV waypoint before entering the
-th subregion.
Connect all the waypoints in sequence, and the final waypoints of the UAV are obtained. These waypoints are firstly transformed back to the ROI by the inverse rotational transfer matrix . Then, they are converted from the ENU coordinate system to the WGS-84 coordinate system for the practical requirements.
At the end of this section, the pseudocode of the waypoint generation is given as Algorithm 1.
Algorithm 1. Waypoint generation with interlaced BF flight pattern |
1: Input: , the vertex coordinates of ROI in the WGS-84 coordinate system |
2: % Step 1. Coordinate conversion 3: for i = 1 to N do 4: Convert to % to the ECEF coordinate system 5: end for 6: for i = 1 to N do 7: Convert to % to the ENU coordinate system 8: end for 9: % Step 2. Find the optimal sweep direction 10: % Initialize 11: for = 1 to 360 do 12. for i = 1 to N do 13. Calculate using Equation (4) 14. end for 15. 16. if then 17. , 18. end if 19. end for 20. for i = 1 to N do 21. Calculate using Equation (5) 22. end for 23. % Step 3. Polygon decomposition and waypoints determination 24. Calculate n using Equation (7) % the number of sub-regions 25. for j = 1 to n do 26. Calculate the set of by Equations (9) and (11) 27. , 28. , 29. Calculate using Equation (10) 30. end for 31. % Step 4. Waypoints connecting according to interlaced BF pattern 32. Calculate using Equation (6) 33. Calculate using Equation (30) % the number of sub-regions in each sweep 34. for p = 1 to do 35. Calculate the set of by Equations (30) 36. if then 37. if is odd then 38. Calculate and by Equation (32) 39. else % is even 40. Calculate and by Equation (33) 41. end if 42. end if 43. end for 44. Sort , , , , 45. % Step 5. Coordinate conversion 46. Convert all waypoints by % the inverse rotational transfer matrix 47. Convert all waypoints to WGS-84 coordinate system 48. Output: Waypoints in the WGS-84 coordinate system. |
5. Simulations
In this section, to verify the effectiveness of the proposed interlaced BF coverage flight pattern, three groups of simulation experiments that compared the interlaced BF coverage with the traditional BF pattern are given. For the purpose of discussing the influence of the relationship between the minimum turning radius and the sub-region width defined in
Section 3 on the results, we have
in the first group of experiments, and
in the second group of experiments. Finally, a group of experiments are used to demonstrate the conventional pattern is the same as the proposed one when
.
The important input parameters of the experiments are summarized in
Table 2, where
is the speed of turning,
represents the roll angle of the fixed-wing UAV when making a turning maneuver,
is the minimum turning radius,
is the sweep breadth of camera,
is the overlap rate,
is the width of a sub-region, and
is the span coefficient.
In the first group of simulations, refer to [
34], the task is executed at a height of 300 m, the sweep breadth of camera
is 300 m, the maximum flight speed
, minimum flight speed
, and cruise speeds are 25 m/s, 20 m/s, and 22 m/s, respectively. When the UAV flies in straight lines, the average speed is around 23 m/s, while the speed of turning is 20 m/s. Roll angle
is set as 19 degrees. And the minimum turning radius
is calculated by Equation (5),
m. For a real and practical case of photogrammetry that uses SFM algorithm, the overlap between adjacent images is at least 45%. We have the overlap rate 50% in this simulation, that is
. Then, the width of a sub-region
can be obtained,
m, and the span coefficient
by Equation (8). Furthermore, the shooting advance distance
is 100 m. The ROI is shown in
Figure 4.
Figure 11a shows the coverage path that is generated by the proposed interlaced BF flight pattern, and the path that is generated by traditional BF pattern is shown in
Figure 11b. In
Figure 11a, it can be seen that the UAV sweeps the ROI twice; after the ROI has been swept once, the UAV makes a turn for the next sweep. By contrast, the UAV sweeps the ROI line by line in a conventional BF pattern as shown in
Figure 11b.
The number of turns, path length, and flight time of coverage path generated by different flight patterns when
are shown in
Table 3. The number of turns is the same in the interlaced BF pattern and the traditional BF pattern. However, the total path length of turns in the proposed interlaced BF pattern is greatly reduced, by 41.00% specifically. In addition, both the curve path and straight path length of turns in the interlaced BF pattern are shorter than that in the traditional BF pattern, which are consistent with
Result 1 and
Result 2. As for the total path length, it is reduced by 6.66% using the novel flight pattern, and more than 3 min of flight time are saved correspondingly. The percentage of the improvement of path saving and flight efficiency by the proposed method are shown in the right column of
Table 3.
In the second group of simulations, the average speed when flying in straight lines is 23 m/s, the speed of turning is 20 m/s, the flight height is 300 m, the sweep breadth of the camera
is 300 m, the shooting advance distance
is 100 m, which are similar to the first group of simulations. Differently, the overlap rate required is 60%, that is
and the width of a sub-region
can be calculated,
m. Moreover, the roll angle
is set as 15 degrees, and the minimum turning radius
is calculated by Equation (5),
m. Then, it can be obtained that the span coefficient
according to Equation (8).
Figure 12a shows the coverage path that is generated by the proposed interlaced BF flight pattern while
Figure 12b shows the path generated by the traditional BF pattern. In
Figure 12a, it can be seen that the UAV sweeps the ROI three times; after the ROI has been swept once, the UAV makes a turn for the next sweep. In the traditional BF pattern, however, the UAV sweeps the ROI line by line, as shown in
Figure 12b.
The path parameters of the coverage path generated by different flight patterns when
are shown in
Table 4. The number of turns in the interlaced BF pattern is more than that in the traditional BF pattern. However, the total path length of turns in the proposed interlaced BF pattern is reduced by more than 40%. In addition, both the curve path and straight path length of turns in the interlaced BF pattern are shorter than that in the traditional BF pattern, which is consistent with Result 1 and Result 2. As for the total path length, it is reduced by 5.27% using the interlaced BF flight pattern, and 3 min 45 s of flight time are saved correspondingly. For the same ROI, it is worth noting that the total path length of turns decreases more with the increase of
(
), 4792.4 m when
and 8473.3 m when
, respectively.
What needs to be pointed out is that when the is much smaller than the width of a sub-region , that is , the traditional BF pattern will degenerate to the interlaced BF pattern, as depicted by Remark 1. An example is given to demonstrate this condition as follows.
The flight height, sweep breadth of camera, shooting advance distance, and overlap rate are the same as the first group of simulations. So, the width of a sub-region
m. Assuming the UAV is on a slow flight photogrammetry mission, the average speed when flying in straight lines is 13 m/s, the speed of turning is 10 m/s, and the roll angle
is 15 degrees. Thus, we have the minimum turning radius
m according to Equation (5), and the span coefficient
by Equation (8).
Figure 13a shows the coverage path that is generated by the interlaced BF flight pattern, and the path that is generated by the traditional method is shown in
Figure 13b. It can be found that the coverage paths are the same by different methods.
The path parameters of the coverage path generated by different flight patterns when
are shown in
Table 5. The presented method performs the same as the conventional method in the condition of
, and the presented interlaced BF pattern outperforms the traditional BF pattern when
according to Result 1, Result 2 and Result 3.
By the above groups of simulation experiments, we can conclude that the proposed interlaced BF pattern is superior to the traditional BF pattern, in terms of the curve path length of turns, the total path length of turns, and the total path length, is more efficient and there is less energy consumption.
6. Conclusions
In this paper, a practical interlacing-based coverage path planning method for a fixed-wing UAV photogrammetry in convex polygon regions was introduced. A typical detection scenario of a camera pointing forward-down for photogrammetry was modeled and the coordinates of the ROI vertices were converted from the WGS-84 coordinate system to the local ENU coordinate system for path planning convenience. The main contribution of this paper is that it fully studies the relationship between the minimum turning radius and the camera footprint. The span coefficient of the fixed-wing UAV was first proposed, and a novel flight pattern, named as the interlaced back-and-forth pattern, was presented accordingly. By comparison with the traditional back-and forth pattern, four results were given and, most importantly, the curve path length of a turn by the interlaced turning strategy was proved to be always shorter than that of the traditional turning strategy in mathematics. In addition, a practical low-computation algorithm for waypoints generation was given. Finally, three groups of simulation experiments that compared the proposed interlaced BF pattern with the traditional BF pattern were conducted. Simulation results showed that the proposed interlaced BF pattern is superior to the traditional BF pattern not only in terms of the path length of turns but also in terms of the total path length.
However, there were some limitations in this work. Firstly, the generated coverage paths in simulations were ideal paths, which did not consider real-world disturbances, such as wind. In future work, we will conduct real-world flight experiments and study wind disturbances. Secondly, only a convex polygon ROI was considered in the presented work. More complex ROIs combined with the interlaced BF flight pattern could be studied in the future. Lastly, it is important to mention that multi-UAV collaboration is a trend; multi-UAV cooperative photogrammetry is left as a future development.