Next Article in Journal
Synthesis of Porous Biomimetic Composites: A Sea Urchin Skeleton Used as a Template
Next Article in Special Issue
Hybrid Chaotic Discrete Bat Algorithm with Variable Neighborhood Search for Vehicle Routing Problem in Complex Supply Chain
Previous Article in Journal
SPICE-Aided Compact Electrothermal Model of Impulse Transformers
Previous Article in Special Issue
A Two-Stage Hybrid Metaheuristic for a Low-Carbon Vehicle Routing Problem in Hazardous Chemicals Road Transportation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reactive Planning-Driven Approach to Online UAVs Mission Rerouting and Rescheduling

1
Faculty of Electronics and Computer Science, Koszalin University of Technology, 75-453 Koszalin, Poland
2
Faculty of Mechanical Engineering, Wrocław University of Science and Technology, 50-370 Wroclaw, Poland
*
Author to whom correspondence should be addressed.
Appl. Sci. 2021, 11(19), 8898; https://doi.org/10.3390/app11198898
Submission received: 1 September 2021 / Revised: 11 September 2021 / Accepted: 20 September 2021 / Published: 24 September 2021

Abstract

:
The presented problem concerns the route planning of a UAV fleet carrying out deliveries to spatially dispersed customers in a highly dynamic and unpredictable environment within a specified timeframe. The developed model allows for predictive (i.e., taking into account forecasted changing weather conditions) and reactive (i.e., enabling contingency UAVs rerouting) delivery mission planning (i.e., NP-hard problem) in terms of the constraint satisfaction problem. Due to the need to implement an emergency return of the UAV to the base or handling ad hoc ordered deliveries, sufficient conditions have been developed. Checking that these conditions are met allows cases to be eliminated if they do not guarantee acceptable solutions, thereby allowing the calculations to be sped up. The experiments carried out showed the usefulness of the proposed approach in DSS-based contingency planning of the UAVs’ mission performed in a dynamic environment.

1. Introduction

In this paper, we consider the planning of the fleet mission problem for UAVs with highly dynamic and unpredictable environment constraints [1,2,3,4,5]. Typical disruptions in deliveries by UAVs may be caused by ad hoc changes to the deliveries ordered or changing weather conditions, which affect the energy consumption of UAVs and result in their shorter range due to the depletion of batteries [6,7]. For this reason, routing and scheduling a UAV fleet in partially known and unpredictable environments should take into account both projected changes in orders and weather conditions and selected categories of interference not included in previous forecasts. In other words, the planning of the UAVs’ missions should take into account the possibility of implementing both proactive (e.g., taking into account the projected disturbances) and reactive (e.g., enabling contingency reactions) behaviour.
UAV routes can be determined through proactive planning [6] and generated in an offline mode or in reactive planning [8,9] while executed in an online mode. Routes determined in proactive planning guarantee the achievement of the planned mission’s goal in terms of environmental parameters, which change at predetermined intervals. Scenarios corresponding to planned reactive rules do not guarantee reactive end-to-end paths employed in the routing process while adapting to changes in the environment during the execution of a mission [7,9,10,11,12,13,14,15,16]. In particular, the reactive routing strategies linking “route discovery” (proactive route planning) and “route maintenance” (adopting reactive rules) concepts [17] are responsible for the robustness of UAVs in terms of the changes in weather conditions. In this context, our study focuses on reactive planning [18,19] of deliveries by the UAVs’ fleet that are resistant to sudden atmospheric changes, resulting in a change in wind direction and intensity, rain or snow, precipitation, or unforeseen changes in delivery schedules caused by the cancellation of ordered deliveries or the notification of new orders.
In this context, the studies presented are a continuation of the previously published work focused on methods for planning UAVs’ fleet missions online [20,21]. Previous research has focused on selected planning strategies for UAVs’ fleet missions. These focus on arbitrarily chosen decomposition concepts for planned volumes of deliveries being phased out under submissions and are responsible for the partial distribution of supplies. Both variable weather conditions and ad hoc changing conditions for the volume of planned deliveries are taken into account. The aim of the research was to develop methods of predictive and/or reactive planning of acceptable options successively implemented under the supply of sub-missions, in particular the methods that enable their online use.
The originality of the paper results from merging the proactive and reactive planning of UAV fleet missions. The developed model allows for predictive (i.e., taking into account forecasted weather conditions changing) and reactive (i.e., enabling the interruption of a drone’s mission) planning for delivery missions in terms of the constraint satisfaction problem (CSP). This is easily implemented and commercially available in a constraint programming environment, e.g., IBM ILOG. In particular, the conditions guaranteeing the resistance function convexity, which consequently speed up the calculations (involved in the CSP solution) for the extended version of the UAVs’ mission planning are developed (i.e., taking into account multiple depots).
To summarise, the main objective of this paper is to introduce constraint programming based on a hybrid model. This is a combination of proactive and reactive planning and routing the UAVs’ fleet delivery missions. The new contributions provided to the currently available literature are (i) presenting a resistance function determining the UAVs’ mission resistance to both changes in weather conditions and changes to the times and location of deliveries, (ii) demonstrating the condition guaranteeing convexity of the resistance function in the polar coordinate system and (iii) conducting computational experiments confirming the usefulness of the proposed approach (i.e., the model and the condition based on it) for online planning of the UAVs’ fleet missions.
In other words, the proposed approach supports the decision-makers in their search for a plan of the missions (with routes and flight schedules), which allows for the delivery of an expected quantity of goods to a specific group of recipients. Introducing a new measure of the UAVs’ mission resistance and the analysis of the conditions guaranteeing its convexity allowed us to develop a declarative model of proactive/reactive UAV mission planning. Its computer implementation enables us to solve problems of scale encountered in practice online (distribution of goods for up to 90 customers). The remainder of this paper is organised as follows: Section 2 elaborates on related research. Section 3 presents the methodology used in the approach to UAV mission contingency planning. Section 4 describes the mathematical formulation for the declarative model for reactive planning of deliveries by the UAV fleet in terms of the constraint satisfaction problem. In Section 5, we focus on the relaxation of the convex resistance function aimed at developing restrictions, reducing the time-consuming assessment of weather conditions. Section 6 presents experiments that have been carried out and elaborates on the results obtained. Finally, Section 7 provides the final conclusions followed by a description of future research.

2. Related Work

A great number of publications are devoted to the study of various aspects of the construction [22,23,24] and operation [1,4,5,12,14] of UAVs and the possibilities for their use in various areas of civil missions (real-time monitoring, surveillance, reconnaissance, search and rescue) [25,26,27] and military areas (weapons delivery, guided missile support, directing artillery, spotting enemy positions). These publications also look at the methods for planning their missions [28]. The trend of research dedicated to online planning missions carried out by UAV teams has become increasingly noticeable. Research conducted in this area is devoted to the application of UAVs in emergency situations where they are used for transport of much-needed water, food, and medical supplies over hazardous (flooded) terrain. This is required due to climate change [29], necessitating the introduction of online UAV mission planning systems [20]. Other studies conducted in this area are devoted to various fields of application, e.g., reconnaissance and mapping [17], package delivery [3], delivery communication capabilities [22], healthcare [24,25], and so on. Increasing interest in these kinds of issues follows on from a need to search for scenario-driven planning methods that are aimed at the preparation of plans for UAV missions and aimed at an interactive tool building that facilitates the analysis and comparison of different scenarios and an iterative identification of sound and efficient mitigation strategies.
In the considered research domain, two directions can be distinguished. The first focuses on planning methods, taking into account weather uncertainty (e.g., investigating the manner in which energy consumption in UAV deliveries is affected by windy environmental conditions), and searching for route planning methods resistant to ad hoc changes in procurement conditions (e.g., studying the impact of changes in order terms and volumes to complete the planned delivery mission) [6,7,11]. In turn, the second research direction deals with methods of design and utilising networks of autonomous UAVs with complementary sensing and actuation equipment to collectively perform complicated tasks, i.e., the flying ad-hoc network (FANET) [30]. FANET spontaneously forms when UAVs connect and communicate with each other to facilitate long range missions and can be seen as a temporary type of local area network.
Indicated research gaps have become an inspiration for conducting this study, focusing on hybrid planning, i.e., a combination of proactive and reactive planning of the UAVs’ fleet delivery missions resistant to sudden changes in weather conditions and unforeseen changes in the arrangements for governing delivery schedules. To clarify the motivation standing behind the selection of the hybrid routing mode, we should note that the routes determined in proactive planning guarantee the achievement of the planned mission goal within the environment’s parameters, including change in predetermined intervals. In turn, routes determined in proactive planning guarantee the achievement of the mission goal only in the event of a previously foreseen (pre-planned) occurrence of an assumed type of disturbance. This is because a number of reactive rules guaranteeing the existence of reactive end-to-end paths employed in the routing process scenario is limited to just few arbitrarily chosen environmental changes.
In this context, this study proposes a novel model for proactive and reactive planning (different scenarios) that allow for a higher degree of realism, thus a higher likelihood of a mission being executed according to plan even when weather forecasts, order terms, and volumes to complete the planned delivery are changing. The novelty of this study results in the addition of a function of UAVs mission resistance to changes in weather conditions. In this context, we consider online re-planning when disturbances appear (e.g., earlier return of some of the UAVs from the fleet to the base), which exceeds the values incorporated at the proactive planning stage. The challenge in solving these types of problems is high computational complexity limiting solutions to small-scale problems. The ongoing work is focused on building models that enable the time-efficient planning of systems that are weatherproof and resistant to all kinds of UAV mission disturbances. To the best of our knowledge, it is the first model for solving a problem with the above-mentioned properties. The presented problem has been neither previously addressed nor solved in the existing literature [8,9,10,17,28,31,32,33,34], thus it is not possible to compare it directly with existing methods. The novelty of the presented approach results from the extension of the declarative model used in our previous works, particularly in [6,7,20,21] by the addition of a function of the UAVs mission resistance to both changes in weather conditions and changes in the times and locations of deliveries. The condition that constitutes this extension allows the UAV’s battery depletion to be foreseen in online mode before completing its mission, and thus it can be used in DSS-based planning of the UAVs’ fleet mission.

3. Approach to UAV Fleet Online Routing

We consider a distribution network, that is modelled by the graph G = ( N , E ) where N = { N 1 , , N λ , , N n } signifies the set of n = | N | nodes and E = { ( N β ,   N λ ) | β , λ   { 1 , , n } , β   λ } signifies the set of edges determining the possible connections between nodes. Set N B N contains the nodes representing the bases and a set of N D N contains the nodes representing delivery points: N B   N D = N , N B   N D = . Given a fleet of UAVs U = { U 1 , , U k , , U K } that delivers goods to the points N D , the fleet U is spread between the bases N B , the subset U λ   U determines the UAVs allocated at base N λ N B . An ordered quantity of goods z λ   (taken from the base N 1 ) should be transported to each delivery point N λ N D . Deliveries are made as part of the mission S, which consists of sub-missions S   l (i.e., delivery plans that include a single course of UAVs: base-delivery points-base). Z   denotes a sequence consisting of variables z λ : Z   = ( z 1 , , z n ) where z λ = 0 for each N λ N B . It is assumed that all required goods should be delivered in the given horizon time H . The amount of goods delivered during one sub-mission S   l by the U k to the delivery point N λ N D is determined by the variable c   l λ k . C   l is a sequence :   C   l = ( c   l 1 1 , , c   l 1 K , , c   l n 1 , , c   l n K ) determining the payload weight delivered by fleet U ( c   l λ k = 0 for each N λ N B ). Variable Q k denotes the payload capacity of U k (amount of goods transported by U k cannot exceed Q k ). Moreover, each U k is described by the following technical parameters: the battery capacity C A P , airspeed v a , drag coefficient C D , front surface A , and UAV width b . The time spent on take-off and landing U k   on the delivery point N λ is indicated by variable w λ . Note that U   l U denotes a set of UAVs used during sub-mission S   l . The time when the U k U   l arrives at the delivery point N λ during a sub-mission S   l is indicated by the variable y   l λ k [s]. In this context, the sequence Y   l consisting of moments y   l λ k is called the schedule of the fleet U   l : Y   l = ( y   l 1 1 , , y   l 1 K , , y   l n 1 , , y   l n K ) .
We assume that the variable t β , λ   determines travelling time between nodes N β ,   N λ , where ( N β , N λ ) E , and routes of U k U   l during sub-mission S   l are represented by the sequences π   l k = ( N k 1 , , N k i , N k i + 1 , , N k μ ) , where k i { 1 , , n } , ( N k i , N k i + 1 ) E . Π   l denotes a sequence of UAV routes executed during the sub-mission S   l : Π   l = ( π   l 1 , , π   l k , , π   l K ) (in case when U k U   l then π   l k   =   ). The delivery plan of one UAV’s sub-mission S   l is defined as a sequence: S   l = ( U   l , Π   l , Y   l , C   l ) .
It is assumed that a plan of the UAVs’ sub-missions S   l is implemented under specific weather conditions, i.e., the weather forecast is known for each sub-mission S   l . The forecasted weather conditions are described by the set F of pairs composed of direction θ and wind speed v w   ( θ , v w ) F , i.e., F is defined as follows: F = { ( θ , v w ) | θ [ 0 ° , 360 ° ) , v w [ 0 ,   F ( θ ) ] } . Where Z ( θ ) is a function whose values determine the maximum forecasted wind speed for a given direction θ . The weather conditions determine the admissibility of the adopted sub-mission’s plan S   l , i.e., they determine whether the batteries of UAVs will be prematurely discharged during implementation.
A function Υ k , l ( θ ) determines the borderline wind speed (for a given direction θ ), which guarantees the successful completion of the delivery plan by the U k during the sub-mission S   l in the distribution network G : Υ k , l ( θ ) = max Γ k , l ( θ ) , where Γ k , l ( θ ) —the set of the wind speed’s values v w for a given direction θ , for which the batteries of U k are not discharged. The sub-mission’s plan S   l is assumed [12] to be resistant to the forecast weather conditions, F , if the boundary wind Υ k , l ( θ ) of all U k U   l in any direction θ does not exceed the forecasted value Z ( θ ) : U k U   l θ [ 0 ° , 360 ° ) Υ k , l ( θ ) F ( θ ) . The implementation of the designated mission S may be subject to various disturbances I S .
Among them, there are sudden changes in the weather (beyond the expected F * ( θ ) range and changes in orders Z ), order changes (increased/decreased amount of ordered deliveries   Z * ), changes to the number of delivery points served (changing the structure of the network G * ). The UAVs’ fleet, when performing the mission plan S , meets a disturbance I S ( t * ) —covering one of the cases: the weather F * ( θ ) , the network G * , orders Z * , the time t * . In such situations, it becomes necessary to answer to the question: Does a re-route plan exit for mission S * that guarantees timely deliveries in a given time horizon H and at acceptable battery levels?
In order to provide an example to illustrate the proposed approach, let us consider a distribution network (from Figure 1a) covering an area of 100 km2 and containing two bases, N B = { N 1 , N 2 } , and 38 delivery points N D = { N 3 , , N 40 } . The goods are delivered by a fleet of 4 UAVs ( U = { U 1 , , U 4 } ) divided into two sub-fleets ( U 1 = { U 1 , U 2 } and U 2 = { U 3 , U 4 } ) serving the bases N 1 and N 2 , respectively. The technical parameters of the UAVs are shown in the table in Figure 1c. The weight of individual orders is: z 3 ÷ z 6 = 5 ,   z 7 = 10 , z 8 = z 9 = 15 ,   z 10 ÷ z 16 = 5 ,   z 17 = 10 , z 18 = z 19 = 15 ,   z 20 ÷ z 26 = 5 ,   z 27 = 10 ,   z 28 = 15 ,   z 30 ÷ z 36 = 5 ,   z 37 = 10   ,   z 38 = z 39 = 15 ,   z 40 = 5 . These assumptions are used to seek the UAVs mission S plan guaranteeing timely deliveries (within the time horizon of 2.5 h) for the required amount of goods. The example of an admissible solution is presented in Figure 2. It consists of six sub-missions: S = ( S   1 , S   2 , , S   6 ) following the wind speed constraints of <9 m/s.
An example illustrating the course of the UAVs fleet mission, S   1 , and the values of the resistance functions, Υ 1 , 1 ( θ ) , Υ 2 , 1 ( θ ) , Υ 3 , 1 ( θ ) , Υ 4 , 1 ( θ ) , is shown in Figure 2. It is worth noting that the UAVs’ routing for mission S   1   is weatherproof for a given weather forecast (i.e., Υ k , l ( θ ) F ( θ ) ) :
π   1 1   = ( N 1 ,   N 14 ,   N 6 , N 3 , N 13 ,   N 11 , N 1 ) ;   π   1 2   = ( N 1 , N 24 , N 30 , N 12 , N 20 , N 12 , N 1 ) :
π   1 3   = ( N 2 , N 32 , N 40 , N 26 , N 22 , N 23 , N 2 ) ;   π   1 4   = ( N 2 , N 5 , N 31 , N 36 , N 12 , N 15 , N 2 )
All goods should be delivered within a time horizon not exceeding 2.5 h ( T = 9000   [ s ] ) . The deliveries are made under various weather conditions (set F ), which are illustrated in Figure 1b. According to the forecast, the wind speed does not exceed v w = 9 m s in a direction of θ = 0 ° 360 ° . Introducing of the additional base in node N 2 allows the delivery problem to be split into two sub-problems with one transportation network. As a result, this means that each base has its own unique parameters, e.g., the width of the time horizon for a given iteration, which can be overlapping. This approach can be used in real world applications, e.g., when two companies have the same transportation network, their own fleet of UAV’s, etc., they need to coordinate the transportation of goods between customers and avoid collisions.
We consider a situation in which the weather conditions of the mission carried out rapidly changed at the time t * = 3000 [s], i.e., during the execution of the sub-mission S   2 , the wind speed increased to v w   =   11   m / s with the same intensity and direction θ = 110 ° 130 ° . Such a change means that this mission cannot be continued due to too much energy consumption (the mission’s resistance function Υ 3 , 2 ( θ ) values are below the level corresponding to speed 11 m s —see Figure 3). Figure 3 shows the location of the UAVs at time t * = 3000   [ s ] , i.e., upon receipt of information about a change in weather and marking the place where the battery of U 3   will be discharged in the event of continuation of deliveries in accordance with the current plan S   2 .
In this situation, the route of the sub-mission S   2 being carried out needs to be corrected, requiring the below question to be answered.
Given a UAV fleet U = { U 1 , U 2 , U 3 , U 4   } providing deliveries to the delivery points allocated in the network G from Figure 1. The UAVs fleet carries out delivery mission plan S * from Figure 2. At the time t * = 3000 , there is a sudden change in the weather conditions, i.e., disturbance I S occurs, resulting in v w   =   11 m s ; θ = 110 ° 130 ° . This leads to a new question: Does a rerouting plan exist for mission S * that guarantees the timely delivery of the ordered supplies in a given time horizon H = 9000   [ s ] and at an acceptable battery level?

4. CSP Formulation

The proposed reaction to the occurrence of a disturbance I S ( t * ) can be reduced to dynamic re-routing and rescheduling of previously adopted routes Π   l , schedules Y   l and delivered goods C   l stated in the basic proactive plan for the mission by the UAVs’ fleet. This is a feasible adjustment of assumed Π   l , Y   l , and C   l values to the changes in forecasted weather F * ( θ ) , and corrections introduced to the network G * or orders Z * .
In order to formally define the concept of disturbance I S ( t * ) , let us introduce the concept of the state of the mission’s implementation S . The state of the mission S at the time t is defined as follows: I S ( t ) = ( M ( t ) ,   F * ( θ , t ) , G   * ( t ) , Z * ( t ) ) where M ( t ) is an allocation of UAVs to nodes at the time t : M     ( t ) = ( N a 1 , , N a k , , N a K ) , where a k { 1 , , n } determines the (delivery points) node N a k occupied by U k (or the node the U k is headed to). F * ( θ , t ) is the weather condition forecast at the time t . G   * ( t ) is the graph model of the distribution network structure at time t (number and location of delivery points). Z * ( t ) is the sequence of goods requested at the time t . The state I S ( t * ) following condition [ F * ( θ , t * ) F * ( θ ) ] [ G   * ( t * ) G ] [ Z * ( t * ) Z ] is called the disturbance occurring at the time t * .
Occurrence of I S ( t * ) disturbance should be assessed in terms of its impact on the further course of the mission of S (that is, whether the value of the resistance function Υ k , l ( θ ) is greater than   F ( θ ) ). If the implementation of the mission is at risk ( Υ k , l ( θ ) F ( θ ) ), an attempt should be made to reschedule it. The following condition action (if-then) rules are used for this purpose:
1.
If the adopted mission plan S is not resistant to disturbance I S ( t * )   ( k { 1 , , K } , l { 1 , , L } Υ k , l ( θ ) F ( θ ) ) ,   a check should be carried out to see whether it is possible to adapt (re-plan) to the new conditions. That is, decide whether all UAVs in the air continue their current missions or make their appropriate corrections.
2.
If there are UAVs (the set U R ) that cannot continue to fly due to disturbance I S ( t * ) , then they should be returned to base, ensuring that airborne UAVs ( the   set   U \ U R ) can take over their tasks.
3.
If the tasks of the UAVs returning to the base (the set U R ) cannot be taken over by UAVs still performing their missions, a check should be carried out as to whether the reserve UAVs available at base (the set U B ) can take over their responsibilities. This means the UAVs in the air continue their existing missions, while the reserve UAVs take over the liabilities of the UAVs returned to base.
4.
If the reserve UAVs (the set U B ) are unable to take over the responsibilities returned to the base (the set U R ), then their activity should be suspended until the disturbance is resolved.
The above rules have been used in the reactive mission planning method S . The idea behind this method is as follows: during the implementation of the mission S , there is a continuous monitoring of the state of the I S ( t ) (for t { 0 H } ). If at the state I S ( t ) , the following condition holds [ F * ( θ , t * ) F * ( θ ) ] [ G   * ( t * ) G ] [ Z * ( t * ) Z ] (i.e., there is a change in the weather forecast or in the structure of the distribution network, and the size of the requests, etc.) and the mission S is under threat (i.e., at least one of the UAVs will not return to base due to low battery), then an attempt must be made to replan. This type of reaction is performed by the function solve, the purpose of which is to designate a mission S   *   adapted to the new conditions determined by the disturbance I S ( t ) . In practice, it comes down to solving the relevant constraints satisfaction problem C S ( U   O , S ,   I S ( t ) ) (where: U   O defines the fleet designated by condition action rules 1–4). The relevant constraints distribution process follows the sequence where at first an attempt is made to designate the mission S   * for the fleet U   = U (according to the rule 1). In the event of failure, an attempt is made to designate this for the fleet U   = U \ U R (according to rule 2) and then for the fleet U   = ( U \ U R )   U B (according to rule 3). If an admissible solution S   * still does not exist, then the mission plan currently used should be modified (due to the reduce function) in such a way that it removes the UAVs’ sub-missions that are not resistant to disturbance I S ( t ) (according to rule 4).
It should be noted that the designation of mission S   * is associated with the designation of routings Π   l , schedules Y   l and delivery sequences C   l throughout the remaining time horizon { t H } . Due to the disturbance I S ( t * ) occurrence, the proposed reactive planning algorithm (implemented in the IBM ILOG environment) generates the end-to-end paths that modify previously planned routes, restoring the ability to implement the designated mission delivery plan.
The mathematical formulation of the constraint satisfaction problem C S ( U   O , S ,   I S ( t ) ) aimed at contingency planning for the UAVs’ mission design employs the following parameters, variables, sets, and constraints:
Parameters:
G   l the   graph   of   a   distribution   network   for   sub - mission   S   l , U   l the   subset   of   UAVs   U   l U   carrying   out   the   sub - mission   S   l ,
z λ the   demand   at   node   N λ ,   z 1 = 0 , K the size of the fleet of UAVs,
d β , λ the   distance   between   N β ,   N λ , A the front-facing area of a UAV,
t β , λ the   travel   time   between   N β ,   N λ , C D the aerodynamic drag coefficient,
w the time spent on take-off and landing of a UAV, t s the time interval at which UAVs can take off from the base,
Q the maximum loading capacity, e p the empty weight of a UAV,
I S ( t ) the state of UAV’s mission, D the air density,
H the time horizon, g the gravitational acceleration,
Υ k , l ( θ ) the weather resistance function, b the width of a UAV,
F ( θ )   the forecasted wind speed, C A P the energy capacity of a UAV,
v a β , λ   the   air   speed   between   nodes   N β ,   N λ , v g β , λ   ground   speed   between   N β ,   N λ ,
φ β , λ the   heading   angle   of   vector   v a β , λ   , ϑ β , λ the   course   angle   of   vector   v g β , λ   ,
N D the set of delivery points, N B the set of bases,
U λ the   set   of   UAVs   allocated   at   base   N λ N B ,   l y λ k the   time   at   which   U k   arrives   at   node   N λ ,   before   the   disturbance   I S ( t * ) occurrence,
  l s k the   take - off   time   of   U k   before   the   disturbance   I S ( t * ) ,   l x β , λ k the   binary   variable   used   to   indicate   whether   the   flight   between   points   N β ,     N λ ,   takes   place   before   the   disturbance   I S ( t * ) occurs,
  l y λ k the   time   at   which   U k   arrives   at   node   N λ   before   the   disturbance   I S ( t * ) ,   l c λ k the   weight   of   freight   delivered   to   node   N λ   by   U k ,   before   the   disturbance   I S ( t * ) occurrence,
Decision Variables:
  l x β , λ k ¯ the   binary   variable   used   to   indicate   if   U k   travels   between   nodes   N β ,   N λ   after   the   disturbance   I S ( t * )   occurrence   ( during   sub - mission   S   l ),
  l x β , λ k ¯ = { 1 i f   U k   t r a v e l s   b e t w e e n   n o d e s   N β ,   N λ 0 o t h e r w i s e .
  l y λ k ¯ the   time   at   which   U k   arrives   at   node   N λ   after   disturbance   I S ( t * )   occurrence   ( during   sub - mission   S   l ),
  l c λ k ¯ the   weight   of   freight   delivered   to   node   N λ   by   U k   after   the   disturbance   I S ( t * )   occurrence   ( during   sub - mission   S   l ),
  l f β , λ k ¯ the   weight   of   freight   carried   between   nodes   N β ,   N λ   by   U k   after   the   disturbance   I S ( t * )   occurrence   ( during   sub - mission   S   l ),
  l P β , λ k ¯ the   energy   per   unit   of   time   consumed   by   U k   during   the   flight   between   nodes   N β ,   N λ   ( after   the   disturbance   I S ( t * ) occurrence),
b   l a t k ¯ the   total   energy   consumed   by   U k   after   the   disturbance   I S ( t * )   occurrence   ( during   sub - mission   S   l ),
  l s k ¯ the   take - off   time   of   U k   after   disturbance   I S ( t * ) occurrence,
  l c p λ ¯ the   total   weight   of   freight   delivered   to   node   N λ   after   the   disturbance   I S ( t * )   occurrence   ( during   sub - mission   S   l ),
  l π k   ¯ the   route   of   U k   after   the   disturbance   I S ( t * )   occurrence   ( during   sub - mission   S   l ) ,     l π k ¯ = ( N k 1 , , N k i , N k i + 1 , , N k μ ) ,   k i { 1 , , n } , ( N k i , N k i + 1 ) E
Sets
Y   l ¯ the   sequence   of   moments     l y λ k ¯   that   schedules   the   fleet   U   l   after   the   disturbance   I S ( t * ) occurrence,
C   l ¯ the   sequence   of   weights   of   delivered   goods     l c λ k ¯ ,
Π   l ¯ the   set   of   UAV   routes     l π k   ¯ ,
S   l ¯   the   plan   of   sub - mission   after   the   disturbance   I S ( t * )   occurrence :   S   l ¯ = ( U   l , Π   l ¯ , Y   l ¯ , C   l ¯ ) ,
the   re - route   plan   of   the   mission   S   * = ( S   1 ¯   , , S   l ¯   , , S   L ¯   ) .
Constraints: routes, delivery of freight, and energy consumption.
1.
Routes. Relationships between the variables describing UAV take-off times/mission start times and task order:
  l s k ¯ 0 ;   k = 1 K ,   l = 1 L
  l s k ¯ 0 ;   k = 1 K ,   l = 1 L ,
( |   l s k ¯   l s q ¯ | t s )   ; U k ,   U q U λ ,   N λ N B ,   l = 1 L ,
(     l y j k t * ) (   l x i , j k ¯ =   l x i , j k ) ;   j = 1 n ,   i = 1 n ,   k = 1 K ,   l = 1 L ,
(     l y j k t * ) (   l y j k ¯ =   l y j k ) ;   j = 1 n ; k = 1 K ,   l = 1 L ,
j = 1 n   l x i , j k ¯ = 1   ;   k = 1 K ,   i = 1 n ,     l = 1 L ,
(   l x λ , j k ¯ = 1 ) (   l y j k ¯ =   l s k ¯ + t λ , j )   ;     N j N D ;     N λ N B ,   U k U λ ,     l = 1 L
(   l y λ k ¯ 0     l y λ q ¯ 0   ) ( |   l y λ k ¯   l y λ q ¯ | w )   ;   k , q = 1 K ;   k q ;     N λ N D
(   l x λ , j k ¯ = 1 ) (   l y j k ¯ =   l y λ k ¯ + t λ , j + w ) ;     N λ ,   N J N D ;   k = 1 K ,
  l y i k ¯ 0 ;   i = 1 n ;   k = 1 K ,
j = 1 n   l x i , j k ¯ = j = 1 n   l x j , i k ¯ ;   i = 1 n ;   k = 1 K ,
  l y i k ¯ H × j = 1 n   l x i , j k ¯ ,   i = 1 n ;   k = 1 K ,
  l y i k ¯ H × j = 1 n   l x i , j k ¯ ,   i = 1 n ;   k = 1 K ,
2.
Delivery of freight. Relationships between variables describing freight quantities already delivered and requested
(     l y j k ¯ t * ) (   l c j k ¯ =   l c j k ) ;   j = 1 n ; k = 1 K ;   l = 1 L ,
  l c i k ¯ 0 ;   i = 1 n ;   k = 1 K ; l = 1 L ,
  l c i k ¯ Q × j = 1 n x i , j k ;   i = 1 n ;   k = 1 K ,   l = 1 L ,
i = 1 n   l c i k ¯ Q ;   k = 1 K ; l = 1 L ,
(   l x i , j k ¯ = 1   ) (   l c i k ¯ 1 ) ;   k = 1 K ;   N i N ;   N j N D
l = 1 L k = 1 K   l c i k ¯ = z i ;   N i N D   ,
i = 1 n   l c i k ¯ =   l c s k ¯ ;   k = 1 K ;   l = 1 L ,
(   l x i , j k ¯ = 1 ) (   l f c j k ¯ =   l c s k ¯ )   ; j = 1 n ;   k = 1 K ,   l = 1 L ,
(   l x i , j k ¯ = 1 ) (   l f c j k ¯ = f c i k ¯   l c i k ¯ )   ; i , j = 1 n ;   k = 1 K ,   l = 1 L ,
(   l x i , j k ¯ = 1 ) (   l f 1 , j k ¯ =   l c s k ¯ )   ; j = 1 n ;   k = 1 K ,   l = 1 L ,
(   l x i , j k ¯ = 1 ) (   l f i , j k ¯ =   l f c j k ¯ )   ;   i , j = 1 n ;   k = 1 K ,   l = 1 L ,
3.
Energy consumption. In order to ensure the waterproof quality of the S   l sub-mission (i.e., its robustness to weather condition changes Z ( θ ) ) the amount of energy required to complete the task carried out by a UAV must not exceed the capacity of its battery.
Υ k , l ( θ ) F ( θ ) ;   θ [ 0 , 360 ) ,
Υ k , l ( θ ) = max Γ k , l ( θ )
Γ k , l ( θ ) = { v w   |   v w R + 0   k { 1 K } b   l a t k ¯ ( θ , v w ) C A P } ,
b   l a t k ¯ ( θ , v w ) = i = 1 n j = 1 n   l x i , j k ¯ × t i , j ×   l P i , j k ( θ , v w ) ,
  l P i , j k ( θ , v w ) = 1 2 C D × A × D × ( v a i , j   ( θ , v w ) ) 3 + ( ( e p +   l f i , j k ¯ ) × g ) 3 2 2 × D × A ,
where v   l a i , j   ( θ , v w ) and t i , j depend on the assumed goods delivery strategy, D is an air density that is equal to 1.225 kg/m3, and A is the front-facing area of UAV that is equal to 1.2 m2 (provided by the UAV manufacturer).
If the ground speed v g i , j   is constant, then an air speed v   l a i , j   is calculated from:
v   l a i , j   ( θ , v w ) = ( v g i , j   × c o s ϑ i , j v w × c o s θ   ) 2 + ( v g i , j   × s i n ϑ i , j v w × s i n θ   ) 2
t i , j = d i , j / v g i , j  
Since the re-planning of the mission delivery plan. S, is the result of the disturbance, I S ( t * ) , the new set of sub-missions S   1 ¯   , , S   l ¯   , , S   L ¯   guaranteeing timely delivery is determined by solving the following constraint satisfaction problem (32):
C S ( U   O , S ,   I S ( t * ) )   = ( ( V , D ) , C ( U   O , S ,   I S ( t * ) ) ) ,
where V ^ = { Π   l ¯ , Y   l ¯ , C   l ¯ | l = 1 L } —the set of decision variables; Π   l ¯ —the set of routes determining the schedule Y   l ¯ ; Y   l ¯ —schedule of the fleet U   O guarantees timely service of delivery points in the case of disturbance I S ( t * ) and the C   l ¯ —sequence of weights of delivered goods by the fleet U   O ; D —the finite set of decision variable domains:   l x i , j k ¯ { 0 , 1 } ,   l y λ k ¯ , c   l i k ¯ ; C ^ —the set of constraints, which takes into account the set of routes Π   l ¯ , schedules Y   l ¯ and the disturbance I S ( t * ) while determining the relationships linking the operations executed by UAVs (1)–(31).
To solve C S (32), the values of the decision variables must be determined from the adopted set of domains for which the given constraints are satisfied.

5. Constraints Relaxation

The previous section showed that solving the CS (32) problem enables the designation of an S   * mission resistant to I S ( t * ) for disturbances caused by changing weather conditions specified by F ( θ )   . Solving this problem, however, is very time-consuming, which results from the necessity of verifying the inequality (25) of the wind direction change Υ k , l ( θ ) F ( θ ) carried out for each increment θ [ 0 , 360 ) . Consequently, this section shows the relaxation of the above limitation, which allows for a significant acceleration of the calculations. The proposed relaxation assumes that the Υ k , l ( θ ) function is convex in the polar coordinate system. Appropriate conditions guaranteeing its convexity are shown below.

5.1. Resistance Function Convexity in the Polar Coordinate System

Note that function A ( θ ) is a convex function in the polar coordinate system if each section with ends belonging to an area limited by the function A ( θ ) is included in this area (see Figure 4).
Property 1. The function Υ k , l ( θ ) is convex in the polar coordinate system if the following condition holds:
R > R G
where:
R = ( C A P i , j t i , j ( W × g ) 3 2 2 × D × A 0.5 × C D × A × D ) 2 3 v g i , j   2
R G = 3 8 ( ( v g i , j   × s i n ϑ i , j ) 2 × ( 4 + 2 3 ) + ( v g i , j   × c o s ϑ i , j ) 2 × ( 4 2 3 ) 4 × ( v g i , j   × c o s ϑ i , j ) × ( v g i , j   × s i n ϑ i , j ) )
Proof: Proof amounts to the designation of an explicit form of the function Υ k , l ( θ ) and then to the demonstration that its constituents are convex functions.
1.
Function Υ k , l ( θ ) . According to the definition of the Υ k , l ( θ ) function, its values are the solution to the following equation:
C A P = b   l a t k ( θ , v w )
where C A P —the energy capacity of a UAV, b a t k ( θ , v w ) —the total energy consumed by U k (during sub-mission S   l —route π   l k   ):
b   l a t k ( θ , v w ) = ( i , j ) π   l k     t i , j × P   l i , j k ( θ , v w )
where t i , j —travel time from node i to node   j : t i , j = d i , j v g i , j   , P   l i , j k ( θ , v w ) —energy per unit of time, consumed by U k during a flight from node i to node   j in weather conditions ( θ , v w ) .
  l P i , j k ( θ , v w ) = 1 2 C D × A × D × ( v a i , j   ( θ , v w ) ) 3 + ( ( e p +   l f i , j k ) × g ) 3 2 2 × D × A
and after using the following substitutions A D =   1 2 C D × A × D and W A = ( W × g ) 3 2 2 D A :
  l P i , j k ( θ , v w ) = A D × ( v a i , j   ( θ , v w ) ) 3 + W A
where v   l a i , j   ( θ , v w ) = ( v g i , j   × c o s ϑ i , j v w × c o s θ   ) 2 + ( v g i , j   × s i n ϑ i , j v w × s i n θ   ) 2
Equation (2) can, therefore, be presented as:
C A P = ( i , j ) π k     t i , j × P   l i , j k ( θ , v w )
( i , j ) π k     C A P i , j = ( i , j ) π k     t i , j × P   l i , j k ( θ , v w )
where C A P i , j —a maximum amount of energy that can be used by U k on the section that matches node i with node j .
This equation can be further simplified to:
C A P i , j = t i , j × P   l i , j k ( θ , v w )
C T = P   l i , j k ( θ , v w )
where C T =   C A P i , j t i , j
C T = A D × ( v   l a i , j   ( θ , v w ) ) 3 + W A
C W = v   l a i , j   ( θ , v w )
where C W =   C T W A A D 3
C W = ( v g i , j   × c o s ϑ i , j v w × c o s θ   ) 2 + ( v g i , j   × s i n ϑ i , j v w × s i n θ   ) 2
C W 2 = ( v g i , j   × c o s ϑ i , j v w × c o s θ   ) 2 + ( v g i , j   × s i n ϑ i , j v w × s i n θ   ) 2
and after using the following substitutions V G =   v g i , j   × c o s ϑ i , j , V S =   v g i , j   × s i n ϑ i , j :
C W 2   = ( V G v w × c o s θ   ) 2 + ( V S v w × s i n θ   ) 2
C W 2 = V G 2 2 × V G × v w × c o s θ   + v w 2 × c o s θ   2 + V S 2 2 × V S × v w × s i n θ   + v w 2 × s i n θ   2
C W 2 V G 2 V S 2 = 2 × V G × v w × c o s θ   2 × V S × v w × s i n θ   + v w 2 × ( s i n θ   2 + c o s θ   2 )
C W 2 ( V G 2 + V S 2 ) = 2 × V G × v w × c o s θ   2 × V S × v w × s i n θ   + v w 2
C W 2 v g i , j   2 ( c o s ϑ i , j 2 + s i n ϑ i , j 2 ) = 2 × V G × v w × c o s θ   2 × V S × v w × s i n θ   + v w 2
C W 2 v g i , j   2 = 2 × V G × v w × c o s θ   2 × V S × v w × s i n θ   + v w 2
and after using the following substitution R = C W 2 v g i , j   2 :
R = 2 × v w × ( V G × c o s θ   + V S × s i n θ   ) + v w 2 × ( s i n θ   2 + c o s θ   2 )
and after using the following substitution X =   V G × c o s θ   + V S × s i n θ   :
0 = v w 2 2 × v w × X R
The solution to this equation takes the following form:
v w = X X 2 + R
Considering that: X =   V G × c o s θ   + V S × s i n θ   , the resistance function takes the following form:
Υ k , l ( θ ) = ( V G × c o s θ   + V S × s i n θ   ) ( V G × c o s θ   + V S × s i n θ   ) 2 + R
2.
Convexity of function Υ k , l ( θ ) components. Due to (51), Υ k , l ( θ ) is a sum of the following two functions:
A ( θ ) = a × c o s θ   + b × s i n θ  
B ( θ ) = ( a × c o s θ   + b × s i n θ   ) 2 + c
where a , b , c   0
Due to the fact that functions a × c o s θ   , b × s i n θ   are convex functions in the polar coordinate system (see Figure 5a) and a sum of convex functions is a convex function, A ( θ ) must also be convex. In turn, the function B ( θ ) becomes convex with correspondingly large c-values. In general, it can be demonstrated that the function   B ( θ ) is convex when the following condition holds:
c > 3 / 8 ( b 2 ( 4 + 2 3 ) + a 2 ( 4 2 3 ) 4 a b ) ,
For example, by adopting a , b = 1 the function B ( θ ) becomes a convex for c > 1.5 (see Figure 5b).
The value c is determined by the value of the R parameter which depends (see (2)–(18)) on the parameters of the environment where the flight is carried out and on the technical parameters of the UAV:
R = ( C A P i , j t i , j ( W × g ) 3 2 2 × D × A 0.5 × C D × A × D ) 2 3 v g i , j   2
The fact that function Υ k , l ( θ )   is convex implies the previously adopted findings, e.g., (22) and the following assumptions a = V G   =   v g i , j   × c o s ϑ i , j , b = V S =   v g i , j   × s i n ϑ i , j :
    ( C A P i , j t i , j ( W × g ) 3 2 2 × D × A 0.5 × C D × A × D ) 2 3 v g i , j   2                                         > 3 8 ( ( v g i , j   × s i n ϑ i , j ) 2 × ( 4 + 2 3 ) + ( v g i , j   × c o s ϑ i , j ) 2 × ( 4 2 3 ) 4                                         × ( v g i , j   × c o s ϑ i , j ) × ( v g i , j   × s i n ϑ i , j ) )
In simple terms:
R > R G
where R —parameter specified by (23), R G —parameter specified by the formula: R G = 3 8 ( ( v g i , j   × s i n ϑ i , j ) 2 × ( 4 + 2 3 ) + ( v g i , j   × c o s ϑ i , j ) 2 × ( 4 2 3 ) 4 × ( v g i , j   × c o s ϑ i , j ) × ( v g i , j   × s i n ϑ i , j ) ) .
Figure 6 shows a graph of the R values for the sample technical parameters and a graph of the R G values above which ( R > R G ) the function B ( θ ) becomes a convex function. Therefore, because the R-values encountered in practice are very high (i.e., R > > > 100), it is assumed that functions A ( θ ) and B ( θ ) are convex. Consequently, since the sum of the convex functions is also a convex function, the resistance function Υ k , l ( θ ) , described by (51) is also convex.

5.2. Relaxation of the Convex Resistance Function

The presented property guaranteeing the Υ k , l ( θ ) function convexity can be used to simplify the constraint (25). In order to replace the condition (25) with an equivalent that is less time consuming computationally, it was assumed that continuous (smooth) Υ k , l ( θ ) function will be approximated by a discrete function represented by a finite set Y k , l = { Υ k , l ( θ i ) | i = 1 l q ; θ i < θ i + 1 } ,   where l q is an number of samples taken arbitrarily. This set contains the vertices of a polygon Y k , l * ( θ ) depicted in Figure 7. The convexity of the Υ k , l ( θ ) function ensures that the polygon Y k , l * ( θ ) always includes the restricted area limited by this function (see Figure 6b).
This means that the function Υ k , l ( θ ) can be replaced by the function Y k , l * ( θ ) and, in fact, the set of vertices in Y k , l . In practice, it means reducing the quantity of condition (25) checks to the number of vertices of the adopted polygon. Consequently, the constraint (25) can be replaced by the following one:
Y k , l * ( θ ) F ( θ ) ; θ { θ 1 , , θ l q }

6. Computational Experiments

Consider the network from Figure 1, in which the UAVs fleet U = { U 1 , U 2 , U 3 , U 4 } service delivery points N 3 N 40 . The structure of subsequent sub-missions S   1 , S   2 , , S   6   of the adopted mission plan S is presented in Figure 2.
Let us assume (see Section 2) that at time t* = 3000 [s] during execution of sub-mission S   2 the wind speed increases to v w   =   11   m / s while its intensity and direction   θ = 110 ° 130 ° remain unchanged. With such a change in weather conditions, it becomes necessary to re-plan the mission, including the introduction of the sub-missions S   2 ¯ , S   3 ¯ , S   4 ¯ , S   5 ¯ , S   6 ¯ to correct its course. For this purpose, an algorithm described in our previous paper [30] has been used. Its implementation in the constraint programming environment IBM ILOG (Intel Core i7-M4800MQ 2.7 GHz, 32 GB RAM) has shown that the solution time for problems of a size considered does not exceed 35 s.
Figure 8a and Figure 9a show the plan (i.e., the route and schedule) of mission S   * adapted to the disturbance IS(3000). Rule 2 was used in assigning mission S   * , i.e., If there are UAVs that cannot continue to fly due to disturbance I S ( t * ) , they should be returned to the base and it should be ensured that airborne UAVs can take over their tasks. Consequently, a decision to turn U 3 back to base was made (see the sub-mission S   2 ¯ Figure 3) because there was a risk of premature battery depletion.
Therefore, the goods to the node N 7 will not delivered. At the same time, U 4 continued its mission unchanged. This decision forced the necessity of rescheduling subsequent sub-missions S   3 ¯ , S   4 ¯ , S   5 ¯ , S   6 ¯ , enabling the designation of a new alternative plan S   *   taking into account the specificity of the disturbance IS(3000) that occurs. Of course, the scope of each revised plan depends on the timing of the decision to reschedule the plan. In Figure 8, the possible routes of the sub-mission depending on the timing of the re-scheduling decision are shown. Figure 8 presents the two kinds of reaction to the disruption. The first type of reaction results in mission re-scheduling (after the end of the sub-mission S     3 ¯ affected by disruption), as shown in Figure 8a. In Figure 8b, the decision to re-plan the mission has been taken “ad hoc”. This means the flight mission plan for each UAV belonging to the fleet K = { U 1 ,   U 2 ,   U 3 , U 4 } has to be changed (see Figure 9b).
In other words, the main ideas behind the two methods following alternative approaches to the sudden weather changes are illustrated in Figure 8 and Figure 9. The cases presented in Figure 8a and Figure 9a can be used in the situation when the vehicles started from base number 1, but these should be less exploited, e.g., due to the quality of the engines used, whereas in Figure 8b and Figure 9b, the entire available fleet results in a shorter duration of the entire mission.
In order to assess the scalability of proposed approach in terms of the possibility of its use in an online mode (i.e., to solve the problem in <600 s) in decision support systems, a series of quantitative experiments have been carried out. Table 1 contains the results of experiments that have been conducted for the three functions of forecasted weather F   ( θ ) = 11 ,   12 ,   13   m / s . The experiments are carried out for the network of n , a randomly designated collection of delivery points (over an area of 10 km × 10 km) and a fleet consisting of K UAVs with the technical parameters as shown in the table in Figure 1c. For each of the considered variants of the network, a proactive mission plan has been set out to guarantee the delivery in the time horizon of H = 10 , 000 s. It was assumed that at time t * = 2000 s, there is a change in the weather forecast that lasts until the end of the considered time horizon. The change in weather involves increasing the expected wind speed by 2 m/s and accordingly equals F * ( θ ) = 11 ,   12 ,   13   m / s . The results (i.e., the times with a relaxation T C R and without a relaxation T C determining reactive mission plan designs) are presented in Table 1 where “×” highlights the cases where it was not possible to designate a mission plan in time t   > 600 s.
The conducted experiments (both qualitative and quantitative) show that for the distribution network of a size up to 80 delivery points serviced by two UAVs, the fleet mission plans can be effectively refined (in less than 600 s) and successfully carried out in changing weather conditions while taking into account specific types of disturbances. Such results were achieved through the implementation of the relaxation described by the constraint (58). The proposed constraint relaxation enables a linear reduction in computational complexity function. Results of experiments show that in the considered case the computational complexity is about 70 times smaller than in the case without relaxation.
In turn, the acceptance of condition (25) limits the size of the online analysing networks to 40 delivery points. The obtained results show that the adopted limitations force planning solutions consisting of many sub-missions but not exceeding 17, and the number of sub-missions needed to be accomplished in case of deteriorating weather conditions F ( θ ) (imposing an increase in energy consumption) and the size of the fleet U decreasing.
The obtained results show that the computer implementation of the proposed method within the constraint programming environment (e.g., IBM ILOG) will allow a solver to be built, enabling the development of an interactive and task-oriented decision support system.

7. Conclusions

The investigated cases of dynamic navigation of vehicles carrying out a common mission focus on the planning problem of the proactive and reactive driven hybrid routing of UAV fleet delivery missions. The class of considered cases includes situations related to planning UAV routes under changed weather conditions exceeding those previously forecasted and/or changes to previously agreed terms of order fulfilment. These occur, for example, in networks allowing the presence of impatient consumers [35,36]. Examples of such situations illustrate cases of automatic navigation of the UAV to a charging station when the battery drops to a certain level, designating a route bypassing the delivery point that refuses to accept the delivery and serves another previously un-planned delivery point in its place. Consequently, the need to react in such situations enforces the establishment of condition–action rules that allow the designation of appropriate possible end-to-end routes enabling emergency safe completion of the mission or its continuation in a modified version.
The case under consideration where UAVs depart from and return to one of multiple depot locations is the multi-depot extension of the previously considered contingency planning problem. Since the related problem of UAV mission planning has proven to be NP-hard, its constraint satisfaction-driven implementation has been proposed. A long-term objective of this study is to develop dedicated DSS software. With this in mind, we employ the declarative modelling framework, mostly because of its fast prototyping capability. The main advantage of the proposed approach follows from the open structure of the proposed model. This allows several other variables and restrictions to be taken into account (e.g., related to the cost of a mission, distribution system infrastructure, heterogeneity of UAVs, etc.). Computational results show that the permissible size of the distribution network (90 nodes and 2 UAVs) where considered reactive planning aims at a routing delivery design for a fleet mission makes the proposed approach suitable for online applications.
The scope of the current paper is limited to the modelling of robust delivery scenarios for the selected disturbances (a change in weather conditions). In general, we can consider the online re-planning of UAVs’ missions for disturbances implied by factors such as change in order (customer resignation, the appearance of a new customer), change in the delivery date, change in UAV fleet (failure of a UAV), change in the structure of the distribution network (shutdown of the UAVs base), etc. Taking into account these types of additional disturbances requires the reference model to be extended with appropriate decision variables each time. A similarly developed model (dedicated to the decision problem) can also be easily extended to the needs of optimization problems related to minimizing energy consumption, the size of the UAV fleet, the number of UAV depots, etc. Thanks to the approved relaxation of the nonlinear constraints, the above-mentioned modifications (extensions) will not significantly affect the computational complexity of the problem under consideration.
In our future research, we want to take into account the uncertain nature of the real-world variables that are not deterministic. Thus, a fuzzy approach could be applied to the UAVs’ mission planning problem while allowing for a more accurate estimation of the timeliness of deliveries, and distribution through multi-depot and multi-fleet delivery planning subject to constraints imposed by appearance and a range of varying time windows. Finally, the model might benefit from being added to different aspects related to the size of fleets with heterogeneous UAVs and coordination of different UAV fleets operating independently in a shared area.

Author Contributions

B.Z., R.G. and D.B. prepared the literature review. R.G. and B.G. formulated the problem and proposed the model. R.G. and B.G. conceived and designed the experiments. D.B. analysed the data; B.G., R.G., D.B. and B.Z. wrote the paper. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

This research was co-founded by the National Science Centre, Poland, grant number 2019/03/X/ST6/00429.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Dorling, K.; Heinrichs, J.; Messier, G.G.; Magierowski, S. Vehicle Routing Problems for Drone Delivery. IEEE Trans. Syst. Man Cybern. Syst. 2017, 47, 70–85. [Google Scholar] [CrossRef] [Green Version]
  2. Patella, S.M.; Grazieschi, G.; Gatta, V.; Marcucci, E.; Carrese, S. The Adoption of Green Vehicles in Last Mile Logistics: A Systematic Review. Sustainability 2021, 13, 6. [Google Scholar] [CrossRef]
  3. Troudi, A.; Addouche, S.-A.; Dellagi, S.; Mhamedi, A.E. Sizing of the Drone Delivery Fleet Considering Energy Autonomy. Sustainability 2018, 10, 3344. [Google Scholar] [CrossRef] [Green Version]
  4. Khosiawan, Y.; Khalfay, A.; Nielsen, I. Scheduling unmanned aerial vehicle and automated guided vehicle operations in an indoor manufacturing environment using differential evolution-fused particle swarm optimization. Int. J. Adv. Robot. Syst. 2018. [Google Scholar] [CrossRef]
  5. Sung, I.; Nielsen, P. Zoning a Service Area of Unmanned Aerial Vehicles for Package Delivery Services. J. Intell. Robot. Syst. 2020, 97, 719–731. [Google Scholar] [CrossRef]
  6. Thibbotuwawa, A.; Nielsen, P.; Banaszak, Z.; Bocewicz, G. Energy Consumption in Unmanned Aerial Vehicles: A Review of Energy Consumption Models and Their Relation to the UAV Routing. Adv. Intell. Syst. Comput. 2019, 853, 173–184. [Google Scholar]
  7. Thibbotuwawa, A.; Bocewicz, G.; Radzki, G.; Nielsen, P.; Banaszak, Z. UAV Mission Planning Resistant to Weather Uncertainty. Sensors 2020, 20, 515. [Google Scholar] [CrossRef] [Green Version]
  8. Hall, J.; Anderson, D. Reactive route selection from pre-calculated trajectories—Application to micro-UAV path planning. Aeronaut. J. 2011, 115, 635–640. [Google Scholar] [CrossRef] [Green Version]
  9. Shirani, R.; St-Hilaire, M.; Kunz, T.; Zhou, Y.; Li, J.; Lamont, L. On the delay of reactive-greedy-reactive routing in unmanned aeronautical ad-hoc networks. Procedia Comput. Sci. 2012, 10, 535–542. [Google Scholar] [CrossRef] [Green Version]
  10. Enright, J.J.; Frazzoli, E.; Pavone, M.; Ketan, S. Handbook of unmanned aerial vehicles. Handb Unmanned Aer. Veh. 2015. [Google Scholar] [CrossRef]
  11. Estrada, M.A.R.; Ndoma, A. The uses of unmanned aerial vehicles–UAV’s-(or drones) in social logistic: Natural disasters response and humanitarian relief aid. Procedia Comput. Sci. 2019, 149, 375–383. [Google Scholar] [CrossRef]
  12. Lohatepanont, M.; Barnhart, C. Airline Schedule Planning: Integrated Models and Algorithms for Schedule Design and Fleet Assignment. Transp. Sci. 2005, 38, 19–32. [Google Scholar] [CrossRef]
  13. Bożejko, W.; Gnatowski, A.; Pempera, J.; Wodecki, M. Parallel tabu search for the cyclic job shop scheduling problem. Comput. Ind. Eng. 2017, 113, 512–524. [Google Scholar] [CrossRef]
  14. Thibbotuwawa, A.; Bocewicz, G.; Banaszak, Z.; Nielsen, P. A Solution Approach for UAV Fleet Mission Planning in Changing Weather Conditions. Appl. Sci. 2019, 9, 3972. [Google Scholar] [CrossRef] [Green Version]
  15. Coelho, B.N.; Coelho, V.N.; Coelho, I.M. A multi-objective green UAV routing problem. Comput. Oper. Res. 2017. [Google Scholar] [CrossRef]
  16. Sitek, P.; Wikarek, J. A multi-level approach to ubiquitous modeling and solving constraints in combinatorial optimization problems in production and distribution. Appl. Intell. 2018, 48, 1344–1367. [Google Scholar] [CrossRef] [Green Version]
  17. Traverso, P.; Giunchiglia, E.; Spalazzi, L.; Giunchiglia, F. Formal Theories for Reactive Planning Systems: Some Considerations Raised from an Experimental Application. AAAI Technical Report WS-96-07, 1996, AAAI (www.aaai.org). pp. 127–136. Available online: https://www.researchgate.net/publication/2F270270 (accessed on 1 June 2021).
  18. Oubbati, O.S.; Chaib, N.; Lakas, A.; Bitam, S.; Lorenz, P. U2RV: UAV-assisted reactive routing protocol for VANETs. Int. J. Commun. Syst. 2020, 33, e4104. [Google Scholar] [CrossRef] [Green Version]
  19. Oubbati, O.; Lakas, A.; Güneş, M.; Zhou, F.; Yagoubi, M.B. UAV assisted reactive routing for urban VANETs. In Proceedings of the ACM Symposium on Applied Computing, Marrackech, Morocco, 4–6 April 2017. [Google Scholar]
  20. Radzki, G.; Nielsen, I.; Golińska-Dawson, P.; Bocewicz, G.; Banaszak, Z. Reactive UAV Fleet’s Mission Planning in Highly Dynamic and Unpredictable Environments. Sustainability 2021, 13, 5228. [Google Scholar] [CrossRef]
  21. Rudnik, K.; Bocewicz, G.; Smutnicki, C.; Pempera, J.; Banaszak, Z. Periodic distributed delivery routes planning subject to uncertainty of travel parameters, Rudnik, Bocewicz, Smutnicki, Pempera, Banaszak. In Proceedings of the 13th International Conference on Computational Collective Intelligence, ICCCI 21, Rhodes, Greece, 29 September–1 October 2021. (in print). [Google Scholar]
  22. Ragab, A.R.; Flores, P. Adapting Ad-hoc Routing Protocol for Unmanned Aerial Vehicle Systems. Int. J. Data Sci. 2021, 2, 1–8. [Google Scholar]
  23. Palazzetti, L. Routing Drones Being Aware of Wind Conditions: A Case Study, Wireless Sensors and Drones in Internet of Things (Wi-DroIT). 2021. Available online: https://www.researchgate.net/publication/352561019 (accessed on 1 June 2021).
  24. Ullah, S.; IlKim, K.; Kim, K.H.; Imran, M.; Khan, P.; Tovar, E.; Ali, F. UAV-enabled healthcare architecture: Issues and challenges. Future Gener. Comput. Syst. 2019, 97, 425–432. [Google Scholar] [CrossRef]
  25. Shiri, M.; Ahmadizar, F.; Mahmoudzadeh, H. A three-phase methodology for home healthcare routing and scheduling under uncertainty. Comput. Ind. Eng. 2021, 158, 107416. [Google Scholar] [CrossRef]
  26. Naghawi, H.; Wolshon, B. Operation of multimodal transport system during mass evacuations. Can. J. Civil Eng. 2015, 42, 81–88. [Google Scholar] [CrossRef]
  27. Tariq, S.; Jalil, M.N.; Zaffar, M.A. Multimodal logistics in disaster relief. In The Palgrave Handbook of Humanitarian Logistics and Supply Chain Management; Springer: Berlin/Heidelberg, Germany, 2018; pp. 445–487. [Google Scholar]
  28. Chadwick, S.; Miller, C.R. Military Unmanned Aerial Vehicles and Diversification Opportunities, Mississippi Defense Diversification Initiative; The University of Southern Mississippi: Hattiesburg, MS, USA, 2018. [Google Scholar] [CrossRef]
  29. Leifang, L.; Renyu, C.; Kecheng, W.; Wenzhuo, W.; Lei, C. Adapting climate change challenge: A new vulnerability assessment framework from the global perspective. J. Clean. Prod. 2019, 271, 216–224. [Google Scholar] [CrossRef]
  30. Khan, M.A.; Safi, A.; Qureshi, I.M.; Khan, I.U. Flying ad-hoc networks (FANETs): A review of communication architectures, and routing protocols. In Proceedings of the First International Conference on Latest trends in Electrical Engineering and Computing Technologies (INTELLECT), Karachi, Pakistan, 15–16 November 2017; pp. 1–9. [Google Scholar] [CrossRef]
  31. Chenxi, H.; Yisha, L.; Yuchen, L.; Wen, Z.; Hongbin, P.; Longzhi, Y.; Yongqiang, C.; Yongtao, H.; Yonghong, P. A New Dynamic Path Planning Approach for Unmanned Aerial Vehicles. Complexity 2018, 8420294. [Google Scholar] [CrossRef]
  32. Wirth, L.; Oettershagen, P.; Ambühl, J.; Siegwart, R. Meteorological path planning using dynamic programming for a solar-powered UAV. In Proceedings of the 2015 IEEE Aerospace Conference, Big Sky, Montana, USA, 7–14 March 2015; pp. 1–11. [Google Scholar] [CrossRef] [Green Version]
  33. Garcia, M.; Viguria, A.; Allero, A. Dynamic graph-search algorithm for global path planning in presence of hazardous weather. J. Intell. Robot. Syst. 2013, 69, 285–295. [Google Scholar] [CrossRef]
  34. Belkhouche, F. Reactive optimal UAV motion planning in a dynamic world. Robot. Auton. Syst. 2017, 96, 114–123. [Google Scholar] [CrossRef]
  35. Lederer, P.J.; Li, L. Pricing, Production, Scheduling, and Delivery-Time Competition. Oper. Res. 1997, 45, 407–420. [Google Scholar] [CrossRef]
  36. Bassamboo, A.; Randhawa, R.S. Scheduling homogeneous impatient customers, Managerial Economics, Decision Sciences and Operations. Manag. Sci. 2016, 62, 2120–2147. [Google Scholar] [CrossRef]
Figure 1. Graphical illustration of distributed delivery problem: distribution network (a) forecasted weather conditions (b) parameters of the UAVs (c).
Figure 1. Graphical illustration of distributed delivery problem: distribution network (a) forecasted weather conditions (b) parameters of the UAVs (c).
Applsci 11 08898 g001
Figure 2. Examples of delivery missions for the fleet U = { U 1 , U 2 , U 3 , U 4 } .
Figure 2. Examples of delivery missions for the fleet U = { U 1 , U 2 , U 3 , U 4 } .
Applsci 11 08898 g002
Figure 3. Sub-mission S   2 after changed weather conditions: the wind speed increased to v w   =   11 m s   in the direction of θ = 110 ° 130 ° .
Figure 3. Sub-mission S   2 after changed weather conditions: the wind speed increased to v w   =   11 m s   in the direction of θ = 110 ° 130 ° .
Applsci 11 08898 g003
Figure 4. Example of a convex function in the polar coordinate system.
Figure 4. Example of a convex function in the polar coordinate system.
Applsci 11 08898 g004
Figure 5. Function charts: (a) A ( θ ) = a × c o s θ   + b × s i n θ   and (b) B ( θ ) = ( a × c o s θ   + b × s i n θ   ) 2 + c .
Figure 5. Function charts: (a) A ( θ ) = a × c o s θ   + b × s i n θ   and (b) B ( θ ) = ( a × c o s θ   + b × s i n θ   ) 2 + c .
Applsci 11 08898 g005
Figure 6. Examples of UAVs technical parameters (a) and their corresponding values R and R G (b).
Figure 6. Examples of UAVs technical parameters (a) and their corresponding values R and R G (b).
Applsci 11 08898 g006
Figure 7. Discretisation of the function Υ k , l ( θ ) (a) function Υ k , l ( θ ) , (b) polygon Y k , l * ( θ ) .
Figure 7. Discretisation of the function Υ k , l ( θ ) (a) function Υ k , l ( θ ) , (b) polygon Y k , l * ( θ ) .
Applsci 11 08898 g007
Figure 8. Two kinds of response on the occurrence of a disruption: (a) the reaction after a finished mission in the given time window (sub-mission S     3 ¯ ), (b) the “ad hoc” reaction (sub-mission S   2 ¯ ).
Figure 8. Two kinds of response on the occurrence of a disruption: (a) the reaction after a finished mission in the given time window (sub-mission S     3 ¯ ), (b) the “ad hoc” reaction (sub-mission S   2 ¯ ).
Applsci 11 08898 g008
Figure 9. Two kinds of response on the occurrence of a disruption: (a) the reaction after a finished mission in the given time window and (b) the “ad hoc” reaction.
Figure 9. Two kinds of response on the occurrence of a disruption: (a) the reaction after a finished mission in the given time window and (b) the “ad hoc” reaction.
Applsci 11 08898 g009
Table 1. Results of the experiments conducted.
Table 1. Results of the experiments conducted.
NS F ( θ ) = 11 m s
Θ [ 0 ° , 360 ° )
NS F ( θ ) = 12 m s
Θ [ 0 ° , 360 ° )
NS F ( θ ) = 13 m s
Θ [ 0 ° , 360 ° )
nKTCR [s]TC [s]TCR [s]TC [s]TCR [s]TC [s]
40271876137,3417357125,34772769209,137
3615,416t > 600614,746t > 600754,151t > 600
4540,895t > 600544,202t > 600569,824t > 600
50298705635,1541010,385t > 600103964287,435
392874t > 600953,411t > 6009365,627t > 600
4×t > 600t > 600×t > 600t > 600×t > 600t > 600
6021230,944t > 600126642t > 600126794t > 600
31133,401t > 600×t > 600t > 60092368t > 600
4×t > 600t > 600×t > 600t > 600×t > 600t > 600
7021341,158t > 6001313,959t > 6001415,353t > 600
31275,658t > 600×t > 600t > 600×t > 600t > 600
4×t > 600t > 600×t > 600t > 600×t > 600t > 600
8021636.098t > 6001517,565t > 6001650,224t > 600
3×t > 600t > 600×t > 600t > 600×t > 600t > 600
4×t > 600t > 600×t > 600t > 600×t > 600t > 600
9021736,632t > 600×t > 600t > 6001732,727t > 600
3×t > 600t > 600×t > 600t > 600×t > 600t > 600
4×t > 600t > 600×t > 600t > 600×t > 600t > 600
1002×t > 600t > 600×t > 600t > 600×t > 600t > 600
3×t > 600t > 600×t > 600t > 600×t > 600t > 600
4×t > 600t > 600×t > 600t > 600×t > 600t > 600
1102×t > 600t > 600×t > 600t > 600×t > 600t > 600
3×t > 600t > 600×t > 600t > 600×t > 600t > 600
4×t > 600t > 600×t > 600t > 600×t > 600t > 600
n —number of nodes (delivery points); K —size of the UAV fleet; T R C —time of computation following condition (58); T C —time of computation following condition (25); ×—no solution allowed in time t   <   600 s ; NS—number of sub-missions.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Grzegorz, R.; Grzegorz, B.; Bogdan, D.; Zbigniew, B. Reactive Planning-Driven Approach to Online UAVs Mission Rerouting and Rescheduling. Appl. Sci. 2021, 11, 8898. https://doi.org/10.3390/app11198898

AMA Style

Grzegorz R, Grzegorz B, Bogdan D, Zbigniew B. Reactive Planning-Driven Approach to Online UAVs Mission Rerouting and Rescheduling. Applied Sciences. 2021; 11(19):8898. https://doi.org/10.3390/app11198898

Chicago/Turabian Style

Grzegorz, Radzki, Bocewicz Grzegorz, Dybala Bogdan, and Banaszak Zbigniew. 2021. "Reactive Planning-Driven Approach to Online UAVs Mission Rerouting and Rescheduling" Applied Sciences 11, no. 19: 8898. https://doi.org/10.3390/app11198898

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop