You are currently viewing a new version of our website. To view the old version click .
Electronics
  • Article
  • Open Access

13 July 2022

Dynamic Positioning and Energy-Efficient Path Planning for Disaster Scenarios in 5G-Assisted Multi-UAV Environments

,
,
,
,
and
1
School of Electronic Engineering, Beijing University of Posts & Telecommunication, Beijing 100876, China
2
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China
3
Engineering Department, University of Naples, “Parthenope”, 80143 Naples, Italy
*
Author to whom correspondence should be addressed.
This article belongs to the Special Issue UAV Networking Applications in the Internet-of-Things Era

Abstract

The integration of fifth-generation (5G) and unmanned aerial vehicle (UAV) technologies has become a promising solution for providing seamless communication in applications, such as disaster management, because of its bandwidth availability, cost-efficacy, and mobile nature. The state-of-the-art research in UAV communication concentrates on effective positioning and path planning. Despite this, these systems performed poorly due to a lack of dynamic control and external factors, such as weather. The solution presented in this paper addresses the problems listed above by using dynamic positioning and energy-efficient path planning for disaster scenarios in the 5G-assisted multi-UAV environments (Dynamic-UAV) to maximize the performance metrics. The lightweight gated recurrent unit (LGRU) is used for weather and event prediction to determine the disaster and non-disaster area and the context of the disaster. The density-based optics clustering (DBOC) algorithm is used to achieve reliability during communication with cluster IoT devices in disaster and non-disaster regions. The satellite determines the number of UAVs required and positions the UAVs using the dynamic positioning-based soft actor–critic (DPSAC) algorithm to achieve maximum throughput. Moreover, the UAVs’ path planning is performed using the shuffled shepherd optimization with dynamic-window method (SSO-DWM) to reduce energy consumption. The proposed approach is simulated using the NS 3.26 simulator and validated by comparing the results with existing techniques regarding the quality of service (QoS), reliability, and energy efficiency. Experimental results indicate that the proposed method achieved maximum throughput (1.59 bit/s), packet delivery ratio (0.88), coverage probability (0.82), number of collected packets (7109–5875), energy efficiency (1.544), minimum delay (16.4 ms–18.5 ms), and energy consumption (7.48 KJ).

1. Introduction

Unmanned aerial vehicles (UAVs) are highly demanding for various applications, such as rescue operations, surveillance, and disaster monitoring. Besides this, UAVs are also used to recover network facilities in the regions of natural disasters, such as forest fires, floods, cyclones, landslides, and manmade disasters, namely power plant explosions and terrorism, which can control emergencies when action is required [1]. In any area of interest, one or more UAVs are used for monitoring and collecting data from the ground devices equipped in that area. Each UAV has onboard sensors and cameras to collect data from the monitoring area. A UAV’s mission is to collect data from IoT devices in the absence of base stations or when a disaster damages the base stations. Therefore, UAV-based data collection and processing is a worldwide topic among researchers. The UAV collects data in air-to-air (A2A) and air-to-ground (A2G) communications. The base stations are prone to environmental conditions which affect the reliability of A2A and A2G UAV communication [2]. By utilizing flying base stations, the impact of weather and altitude on A2A and A2G communication is amplified, maximizing their energy consumption [3,4]. Less efficient path planning for UAVs leads to serious Quality of Service (QoS) issues, such as packet loss rate and network latency [5]. There is a lack of consideration for both static and moving obstacles and no differentiation between various emergency events, which reduces the performance and effectiveness of UAV communication [6].
The 5G-enabled UAV communication reduces the communication latency and bandwidth issues; however, the conventional problems, such as increased energy consumption, are not yet addressed [7]. Clustering is a promising solution for energy consumption since it increases network scalability, reduces overhead, extends battery life, and boosts the throughput [8]. The optimal cluster head (CH) is selected for managing different user groups; bypassing the information through CH reduces the network delay [9]. However, current clustering schemes are required to construct frequently. This is due to the poor grouping of nodes based on limited parameters. In addition, UAVs are clustered without focusing on the vulnerability of the devices and base stations [10,11]. Data collection from disaster environments is challenging; using multiple UAVs requires proper positioning and efficient path planning [12,13]. However, deploying many UAVs without prior knowledge of traffic demand and event occurrence increases deployment costs. To reduce such drawbacks, relay-based methods and deployment algorithms are used [14,15]. Multiple constraints must be evaluated, including weather impact, traffic demand, coverage ratio, and emergency event counts. Based on these factors, the number of UAVs is considered, and is also helpful in planning an optimum path and effective deployment [16,17].
In a multi-UAV environment, meteorological conditions must be monitored [18,19]; UAV speed, direction, altitude, position, and distance must be adjusted accordingly. On the other hand, dynamic path planning is critical in multi-UAV-served disaster situations to avoid collisions and minimize energy consumption due to random trajectories. The path planning problem is considered an optimization problem [20], and several optimization algorithms are used to determine the optimal path, such as particle swarm optimization (PSO), genetic algorithm (GA), etc. However, there is still a research gap in UAV positioning and path planning.

1.1. Motivation & Objectives

There is a need for an operational communication network whenever a disaster occurs, and a portion of the existing communication network is destroyed. Therefore, network operators must deploy an emergency communication network to provide connectivity to the ground devices. In this regard, using a mobile network through the deployment of UAVs can be viewed as a potential alternative for emergencies. Due to its dynamic nature and three-dimensional (3D) properties, UAV communication faces multiple challenges. Existing research in the multi-UAV environment has not adequately addressed various positioning and path planning problems. While deploying UAVs, limited parameters are considered in the literature, which is insufficient to perform optimal positioning, path planning, and reliable and energy-efficient communication. Different solutions have been used for the positioning and path planning of UAVs. However, a proper joint technique is still needed for positioning, clustering, and path planning, while considering multiple parameters to ensure optimal QoS, reliability, and energy efficiency in disaster and non-disaster scenarios. The challenges listed below inspired us to conduct this work and fill in the gaps in existing studies.
  • Lack of Weather Conditions—Wind factors, such as direction, speed, velocity, and turbulent flow significantly impact UAV communication. When determining optimal location and path planning, failing to do so will result in poor QoS performance.
  • Higher UAV Energy Consumption—The UAV is comprised of multiple resource-constrained sensors. UAVs consume energy in data gathering, movements, processing, and transmission. As a result, the issue of energy consumption requires careful consideration to reduce the need for frequent replacement and charging.
  • Obstacles in Path Planning—One of the challenges is path replanning is due to stationary and mobile obstacles in the network. Without prior knowledge of obstacles, path planning increases the likelihood of a collision between UAVs. Consideration of obstacles also minimizes packet loss and latency during data transfer.
  • Delay in Disaster Situations—To maximize performance, the latency in data transfer from the source to the UAV must be minimized in disaster scenarios, when data collecting is more susceptible to delay.
This research is motivated by the problems mentioned above encountered by state-of-the-art work. The primary goal of this study is to examine the performance of various UAV communications (A2A and A2G) under weather-suffered disaster scenarios. Path planning and positioning are required for a higher QoS, improved network coverage, and connectivity. These are met by the sub-objectives listed below.
  • Predicting the absolute weather impacts the selected area of interest based on past weather data, often known as historical weather information.
  • To maximize the scalability of the UAVs for a large-scale environment in which deployment of multiple UAVs positioning must be optimum.
  • To maximize the energy efficiency of UAVs and minimize the time of data collection without any packet loss.
  • To reduce the communication overhead in a multi-UAV environment by optimal path planning and positioning. The diagrammatical representation of motivation and objectives is presented in Figure 1 for a better understanding.
    Figure 1. Motivation and objectives.

1.2. Paper Contributions

We propose a dynamic positioning and path planning approach for disaster scenarios in a 5G-assisted muti-UAV environment (Dynamic-UAV), depending on the environmental context. The following are the significant step-by-step contributions of this paper:
  • Analyzing the context of the environment, the lightweight gated recurrent unit (LGRU) is applied to predict weather conditions (sunny, rain, lightning, cloudy, windy) and events (disaster/non-disaster). Consideration is given to historical weather information and environmental photographs while deploying UAVs for efficient communication.
  • Once the event and weather conditions are predicted, the density-based optics clustering (DBOC) method is used to cluster IoT devices in both disaster and non-disaster zones to increase the communication reliability between the UAV and devices.
  • A satellite that uses dynamic positioning-based soft actor-critic (DPSAC) algorithm is considered to estimate the required number of UAVs and dynamically position the UAVs, thereby reducing communication delay and maximizing the throughput and coverage.
  • The shuffled shepherd optimization with dynamic-window method (SSO-DWM) is used to design UAV paths, which takes into account both static and dynamic objects in the environment to avoid collisions and improve energy efficiency. The performance of the proposed method has been validated and determined to be superior compared to other existing approaches.

1.3. Paper Organization

The remainder of this paper is organized as follows: Section 2 outlines the fundamentals and different types of UAV communication. This section also provides a synopsis of the literature and relevant work. Section 3 addresses the problem statement and proposes dynamic UAV positioning and energy-efficient path planning for disaster scenarios in a 5G-assisted multi-UAVs environment. Section 4 includes the simulation setup and a comparative study of numerous metrics with existing works. Section 5 explains the application of the proposed approach, Section 6 provides the summary, and Section 7 provides the conclusion and future direction of the proposed work.

3. Problem Statement and Proposed Work

The summary presented in Table 1 shows that most existing approaches performed UAV positioning or path planning. However, the lack of consideration of obstacles makes it hard to achieve their objective. Moreover, the weather conditions in which UAVs travel greatly influence their performance. Our approach addresses these factors to achieve maximum throughput and minimum energy consumption in UAV communication. In our system, the environment is classified into disaster and non-disaster regions after predicting it through the LGRU algorithm. The IoT devices in both areas are clustered based on several factors given in Section 3.2. The UAVs are responsible for providing services to IoT devices. Let the number of devices present in the environment are Ν = { 1 , 2 , , N } and the number of devices in a single k th cluster be denoted as N k ,   k Κ = { 1 , 2 , , M } . The clusters of devices formed do not overlap with other clusters, which can be formulated as,
N k N k = ,   k k ,
Let’s write the number of UAVs as B = { 1 , 2 , , B } . The flight period of the UAVs can be expressed as f t [ 0 , T ] which depends on the mission and battery of the UAV. The location of both devices and UAVs can be formulated as,
w N = ( x N , y N , 0 )
w B = ( x B ( t ) , y B ( t ) , h B ( t ) )
where ( x , y ) denotes the latitude and longitude of the devices and UAVs. h B ( t ) denotes the height of the UAV B at time t . The term h B ( t ) influences the coverage of the UAV [36]; as the height of UAVs increase, the coverage also increases until the UAV reach its optimal location. h B ( t ) can be determined as:
h B ( t ) = Cr B tan ( θ max )
In Equation (4) C r B denote the coverage radius of the UAV B . The existence of objects in the surroundings affects the channel between the ground devices and UAVs. The probability of Line of Sight (LoS) between UAVs and devices is modeled as a function of ϕ N , B as [37]:
P LoS ( ϕ N , B ) = ν 1 ( 180 π ϕ N , B η ) ν 2
In Equation (5), ν 1 and ν 2 denote the constant values influencing the environment, η represents the constant representing the relation between environment and antenna. The LoS probability depends on the elevation angle. ϕ N , B denotes the angle of elevation between the IoT device and the UAV B , which can be formulated as:
ϕ N , B = sin 1 ( h B ( t ) Dt ( N , B ) ( t ) )
where, D t ( N , B ) ( t ) denotes the distance between the IoT device and the UAV. The probability of non-line of sight (NLoS) can be computed as [38]:
P NLoS = 1 P LoS
The path loss that occurrs in the channel between the device and the UAV can be formulated as [39]:
PL ( N , B ) = { λ 1 ( 4 π fr c Dt ( N , B ) c ) δ , LoS λ 2 ( 4 π fr c Dt ( N , B ) c ) δ , NLoS
In Equation (8), λ 1 , λ 2 denote the coefficient of attenuations of the LoS and NLoS channel link. 4 π f r c c is the path loss in free space. f r c , c and δ denote the carrier frequency, light speed, and path loss exponent, respectively. The throughput of the IoT devices can be formulated as [37]:
Tr N = 1 T i = 1 I C N , B G N log 2 ( 1 + P N U PG N If N + μ 2 )
where, C N , B denotes the connectivity between the device N and UAV B . The value of C N , B equals 1 if the device is under the coverage of UAV; otherwise the C N , B will be equal to 0. The last term in Equation (9) is the signal-to-noise and information ratio where P N U denotes the uplink power of the device, P G N denotes the power gain of the device, I f N denotes the interference between the UAV and neighbor cluster, and μ 2 is a function of power spectral density. The UAV’s energy consumption is divided into three categories, including energy consumption during motion and data collection. The entire energy consumption can be expressed in the following way:
E B = t M · P M + t C · P C
In Equation (10), t M and t C denote the time involved in motion and data collection, and P M and P C denote the power utilized during motion and data collection, respectively. From the above equations, we can formulate the primary problem as follows:
Maximize   Tr N
Minimize E B
The positioning of the UAVs in the environment is conducted to enhance the coverage of UAVs to maximize the throughput. The multi-objective utility-based maximization of the total sensing information in wireless sensor networks is proposed [40]. The optimal position is derived by using PSO based on sensing utility, communication path quality utility, and network connectivity utility functions. The positioning of low-altitude UAVs for effective data collection is proposed in [37]. The observed time difference of arrival time (OTDOA) positioning method was used for device location, with the UAV being positioned in a 2D plan. The following are the primary issues that various techniques face:
  • The UAV positioning considers only limited parameters, such as location and link quality, which is not enough for optimal positioning. Weather conditions are the essential factors in UAV positioning, which were not considered, thus reducing coverage.
  • The UAV was assumed to be at a constant height, which is not the case in reality; the channel has several variations, resulting in a coverage reduction.
  • The number of UAVs needed for adequate data gathering was not calculated, affecting the average data collecting throughput.
The optimal path planning of UAVs is performed by grouping the user equipment into clusters [36]. The individual communication between UAVs and UEs was terminated, and a CH-based communication was performed. This way of planning the path of UAVs considerably reduced the energy consumption of the UAVs. Time-sensitive data collection by planning UAV trajectory and resource allocation is executed to maximize the number of served IoT devices [41]. The game theory-based selection of UAVs and the reinforcement-based path planning optimization achieve minimum path loss [42]. The significant problems involved in these approaches are:
  • The UAV trajectory is affected by many weather conditions, but they only focus on wind speed, leading to poor trajectory planning, thus increasing path loss [36].
  • The planning only considers wind characteristics and the length of the path. However, the performance of this method is affected by the fact that obstacles in the environment. Furthermore, the UAV’s energy consumption was not taken into account [42].
  • The trajectory planning was conducted only on the basis of distance, which is insufficient for picking an ideal path; the weather is one of the most important aspects impacting UAV trajectory, and it was overlooked, resulting in poor trajectory planning and higher energy consumption [41].
The proposed approach overcomes all the problems mentioned above by performing the following processes; initially, the prediction of weather conditions and recognition of disaster regions are achieved by using the LGRU model. Significant features, such as wind characteristics and temperature parameters, are utilized. The clustering of IoT devices is performed in which the devices in disaster and non-disaster regions are grouped based on density. This eventually optimizes the communication between the devices and UAVs. The satellite is in charge of locating UAVs in 3D space, determining the number of UAVs to be deployed, and positioning them using the DPSAC algorithm. Further, the energy consumption of the UAVs is minimized by planning their path. Considering obstacles in the environment makes it more realistic that our approach would be be adopted. The path loss is also reduced by utilizing the dynamic window model.
The proposed work mainly focuses on performing the dynamic positioning and path planning in a 5G-assisted multi-UAV environment. The proposed Dynamic-UAV approach comprises entities, such as IoT devices, UAVs, 5G GBS, and a satellite. Figure 3 depicts the overall architecture of the proposed approach. The processes involved in the proposed Dynamic-UAV approach are given below.
Figure 3. The overall architecture of the dynamic UAV approach.

3.1. Events/Weather Prediction

The weather influences the position and communication channel of UAVs. Mainly the wind characteristics, such as wind direction ( w d ) , speed ( s ) , velocity ( v e ) , and turbulent flow ( t f ) mostly affect the UAV communication. Lightning and heavy rain are also the factors that limit UAV communication. Hence, we need to predict weather conditions for UAV communication. Let = { w d , s , v e , t f } where represents the wind characteristics. For instance, if there are extreme weather conditions, such as lightning, cyclones, etc., UAV communication may be impossible, or it may cause physical damage to the UAVs, so it must be predicted to achieve better communication and avoid those damages. The events are predicted using historical information, which helps improve UAVs’ communication efficiency. Based on the historical data, we predict the disaster regions from the UAV image by using a satellite. For example, if the image consists of collapsed buildings, then the event is known as an earthquake, and if the image has active flames or smoke, it is known as a fire accident. Prior knowledge of these weather conditions is very important for efficient communication. This historical information is used for predicting the disaster region, thus helping to give priority compared to the other areas. For this reason, we proposed the LGRU algorithm that contains an update gate and a reset gate. The update gate ( g u ) controls the iteration range of previous information state to current information state. The reset gate ( g e ) controls the overload of information state from the g u . For weather prediction, the wind characteristics are used respectively, which are updated periodically to the UAV.
g uo = ( WM g u [ Ph , CI ] )
g eo = ( WM g e [ Ph , CI ] )
h c = þ ( WM h [ g uo Ph , CI ] )
h s = ( 1 g eo ) Ph + h c g eo
The above equations represent the weather prediction formulas using LGRU. Equation (13) represents the gate update output ( g u o ) which acquires the current input (CI) as w d ,   s ,   v e , t f and previously hidden state information (Ph) as w d ,   s ,   v e , t f that forms a weighted matrix function of the gate update ( WM g u ) using activation function (ꭘ). Equation (14) shows the gate reset output ( g e o ) which controls the state information from g u o and forms a weighted matrix of gate reset ( WM g e ) using ꭘ. Equation (15) shows the contestant hidden state, which combines the previous information with current information ( h c ) that forms a weighted matrix function of the hidden state ( WM h ) using activation function (þ), and finally, all the state information is combined to give a predicted result. Equation (16) shows the hidden state ( h s ) which combines the processed results and gives predicted results which can be formulated as:
P Re ( wea ) = { h s ,   sunny ,   rainy ,   cloudy , windy }
Let the past images ( Im = e , f , t , b ) and ( wea ) denotes the weather. For event predictions, the past images are required for predicting the accurate event in the present, which can be formulated as:
g uo = ( WM g u [ Ph Im , CI Im ] )
g eo = ( WM g e [ Ph Im , CI Im ] )
h c = þ ( WM h [ g uo Ph Im , CI Im ] )
h s = ( 1 g eo ) Ph Im + h c g eo
The above equations represent the event prediction using past images ( Im ) of an earthquake ( e ) , fire ( f ) , tsunami ( t ) , and battle region ( b ) . With these past images, LGRU predicts the accurate event in the present ( P Re ) which can be formulated as:
P Re ( event ) = { h s ,   earthquake ,   fire ,   battle , tsunami }
Algorithm 1 and Figure 4 represent the working of LGRU in weather and event predictions, respectively. In Algorithm 1 we used the cost function ( F c ) , which holds the set of all parameters. F c is updated for every prediction based on the environmental condition. The performance is evaluated using this function. Cost function required constant minimization. The model’s performance improves with minimization in the cost function. In the case of accurate prediction, its value becomes zero. By using LGRU, we perform event prediction using images from past events and weather prediction with weather characteristic parameters, such as temperature ( Temp ), wind speed and direction ( wswd ), humidity ( H ), dew point ( DP ), pressure ( p ), time ( T ), and precipitation time ( P t ). The above measurements are considered for effective positioning, optimal path planning, and ensuring the safety of the UAVs. Table 2 represents the weather reports predicted by the proposed LGRU algorithm for 24 h.
Figure 4. LGRU weather and event prediction.
Table 2. Weather report for 24 h.
Algorithm 1 LGRU-based weather and event prediction.
1. Input CI , CI Im
2. Output P Re ( wea ) , P Re ( event )
3. Begin
4.     While ( F c ) 0 , do
5.         For each time slot, do
6.                Update Ph , CI // to UAV
7.                Compute g uo // using (13)
8.                Compute g eo // using (14)
9.                Calculate h c // bitwise multiplication using (15)
10.                h s // bitwise multiplication using (16)
11.                P Re ( wea ) // using (17)
12.          End
13.          For each time slot, do
14.              Update Ph ( Im ) , CI Im // to UAV
15.              Compute g uo // using (18)
16.              Compute g eo // using (19)
17.              Calculate h c // bitwise multiplication using (20)
18.              Calculate h s // bitwise multiplication using (21)
19.              Compute P Re ( event ) // using (22)
20.          End
21.    Stop
22. End

3.2. Event Aware Clustering

After predicting the weather conditions, a clustering of IoT devices is performed to increase communication reliability. Based on the past event information, the environment is clustered in two regions: disaster and non-disaster. The regions are clustered into the disaster region and non-disaster region. Each area has multiple clusters. Each cluster has various IoT devices that send the data to the UAV via the CH . For clustering, we consider the parameters ( ɰ ) of density ( de ) , distance ( di ) , and the number of users ( u ). Let us consider, ( ɰ = de , di , u ) . The DBOC algorithm performs the clustering process. For example, in case of any natural or manmade disasters, the base stations which sends the information to the authorities are affected; at that time, the IoT devices, such as sensors, actuators, etc., forms a cluster as a disaster and non-disaster region and sends data via the CH. The cluster formation can be formulated as:
D c ( MR ,   MP ) = { | UN dis ,   MP ( ɰ ) MR | < MP | UN non dis , MP ( ɰ ) MR | < MP MP dis ,   non dis ,   otherwise
Equation (23) represents the minimum points ( MP ) that are closely related to IoT devices in disaster and non-disaster regions. The D c ( MR ,   MP ) represents the MP and maximum radius ( MR ) for forming clusters between the IoT objects. The DBOC algorithm first calculates the main distance ( D c ) of the untreated IoT devices (UN) in the regions. UN dis ,   MP ( den ,   dis ,   users ) represents the untreated IoT device in the disaster area, which must be less than or equal to the MR , UN non dis ,   MP ( den ,   dis ,   users ) represents the untreated IoT device in the non-disaster areas, and if all the IoT devices are treated, then the MP are calculated in disaster and non-disaster regions. After calculating the D c of the IoT devices, the distance reachability ( D r ) is calculated for the devices to form clusters which can be formulated as:
D r ( MR ,   MP ) = { | UN dis ,   MP ( ɰ ) MR | < MP MR dis ,   non dis ,   otherwise
Equation (24) represents the distance reachability ( D r ( MR ,   MP ) ) for the untreated IoT devices from disaster and non-disaster regions. Afterwards, all the IoT devices compute D c and D r , and a list of a clusters is formed as disaster and non-disaster regions. The final clustered output is formulated as:
C o = { ( dis MR , MP ) ,   ( non dis MR , MP ) }
Equation (25) represents clusters output ( C o ) at the disaster ( dis ) and non-disaster ( non dis ) region based on the maximum radius ( MR ) and minimum points ( MP ) . The clustering method reduces the complexity and energy of UAV communication. As CH sends the data to UAV hence, we need to select optimal CH; for that, we consider energy and centrality that can be formulated as:
CH = { K N > energy ,   centrality }
Equation (26) shows the optimal CH selection from clustered IoT devices ( K N ) in C o for sending data to UAV. Centrality is the frequency of cluster nodes located on the shortest path between other cluster nodes. Energy is the capacity of cluster nodes to withstand other cluster nodes in the surrounding environment. Algorithm 2 and Figure 5 represent the working of DBOC in events-aware clustering.
Figure 5. Density-based optics clustering.
Algorithm 2 Events-aware Clustering.
1. Input UN ɰ
2. Output C o
3. Begin to obtain information form P Re ( wea ) , P Re ( event )
4.     For (cluster formation), do
5.          Compute D c ( MR ,   MP ) // using (23)
6.          Compute D r ( MR ,   MP ) // using (24)
7.          Elect CH // using (25)
8.          Compute C o // using (26)
9.     End
10. End

3.3. Multi-UAV Dynamic Positioning

The effective positioning of UAVs is performed after the clusters of IoT devices are generated by DBOC in a disaster region, which improves communication and provides adequate coverage during an emergency. Many variables influence UAV placement, including altitude, weather conditions, speed, and the existence of obstacles that obstruct communication between IoT devices and UAVs. During an emergency, the satellite is responsible for deploying the appropriate number of UAVs depending on traffic demand. In our proposed work, the UAV acts as an edge server that collects the data from the IoT devices and takes action based on that data. In the proposed Dynamic-UAV approach, the DPSAC algorithm is utilized. The goal of the DPSAC algorithm is to identify the optimal policy. The combination of policy and value-based approaches maximizes the long-term reward. The UAV positioning is constructed as a Markov Decision Process (MDP) with state attributes (ς) which are predicted weather conditions, coverage area, user density, delay sensitivity, elevation angle, path loss, and LoS/NLoS characteristics. The reason for adopting MDP is to allow sequential decision-making, and it gives optimal results for partially known environments. An MDP is comprised of state, action, transition probabilities, and reward. The DPSAC algorithm aims to identify the optimal policy and maximize the reward to determine the optimal position and number of UAVs. The combination of policy and value-based approaches maximizes the long-term reward. The position of UAVs in the proposed approach is constructed with state attributes ( ς ) that are predicted weather conditions, coverage area, path loss, angle of elevation, and LoS/NLoS characteristics. The state parameters for UAV number determination are delay sensitivity and density of users. The action set consists of two major actions: UAV count determination and positioning. Latency increases without determining the number of UAVs, which impacts the throughput. The coverage enhances while increasing the height of the UAVs from the ground. On the other side, path loss also occurs by increasing the height of UAVs, which creates interference, eventually influencing the throughput. Optimal positioning also improves the QoS in UAV communication. There is an impact on throughput by taking actions (position and number of UAVs to be deployed) in the environment, so it must be optimized to maximize the reward. The MDP tuple is given as [ T u , ς T , , Pro   ( . | ς T , ac ) ,   ( ς T , ac ) , Θ ]. The state, reward, and transitions are based on real-time interactions with environmental attributes. From the tuple, T u denotes the epochs, which range from T u = 1 , , N , ς T denotes the state, and denotes the action set consisting of two major actions discussed above. The actions are dynamically executed based on the current situation (disaster or non-disaster). The reward ( ) is generated based on the action value function to maximize the throughput. The DPSAC algorithm increases the reward from the agent’s interaction with the environment. DPSAC uses soft policy iteration to reach this goal. Soft policy iteration is evaluating the policy and making it optimal to maximize the reward. The Pro denotes the transition probability as Pro st ac = [ ς T + 1 = ς | ς t = st , = ac ] , and the discount factor is denoted by Θ , and is set between 0 and 1. The discount factor determines the agent’s care about the reward in the long term compared to those in the near future. When the discount factor is 0, the agent only cares about the immediate reward. When the discount factor is 1, the agent cares about the future reward, and the rewards can increase based on the interpretation of the discounting factor. For every given state and action, the reward can be provided based on adding immediate and future rewards. DPSAC consists of three networks. The first network represents state value, the second network represents policy function, and the third is the soft Q function derived in this section. The policy and Q-network are updated by collecting data from the policy that is different from the current policy. The transition of data is stored in a replay buffer for each roll-out of actor, which is denoted by (D) in Equation (27). The state value function is denoted as V ψ ( ς T ) .
The soft Q function is denoted as Q θ ( ς T , T ) which is trained as formulated below:
H v ( ψ ) = E ς T ~ D [ 1 2 ( V ψ ( ς T ) E Ω T ~ π ϕ [ Q θ ( ς T , T ) log π ϕ ( T | ς T ) ] ) 2 ]
A separate approximation function E ς T ~ D is utilized to minimize the squared residual error. The gradient function is estimated for the parameter updation, which is formulated as:
^ ψ H v ( ψ ) = ψ   V ψ ( ς T ) ( V ψ ( ς T ) Q θ ( ς T , T ) + log π ϕ ( T | ς T ) )
The optimization of the soft Q function is carried out by using the stochastic gradient function, which is computed as:
^ θ H Q ( θ ) = θ Q θ ( T , ς T ) ( Q θ ( ς T , T ) ( ς T , T ) δ   V ψ ( ς T + 1 )
The optimal policy of positioning the UAV is achieved by learning the parameter policy, which is computed as:
H π ( ϕ ) = E ς T ~ D , ϵ T ~ N [ log π ϕ ( f ϕ ( ϵ T ; ς T ) | ς T ) Q θ ( ς T , f ϕ ( ϵ T ; ς T ) ) ]
By doing so, the positioning of the UAV is achieved optimally amidst several challenging factors. Figure 6 illustrates the positioning of UAVs. The pseudocode for DPSAC-based optimal positioning of the UAV is given in Algorithm 3.
Figure 6. DPSAC-based multi-UAV positioning.
Algorithm 3 DPSAC-based UAV positioning.
1. Input: State attributes ( ς )
2. Output: Number determination and positioning of UAVs
3. Begin
4.     Parameter initialization ( θ , ϕ , ψ , ψ ˙ )
5.     For each episode, do
6.          Set initial state ς 0 = 0
7.          For each time step, do
8.               Perform action T from the policy π ϕ ( T | ς T )
9.               Move to the next state ς T + 1
10.            Generate reward based on T
11.            Store ( ς T , T , , ς T + 1 ) in the replay buffer
12.        End for
13.        For each gradient step, do
14.              ψ ψ α v ^ ψ H v ( ψ )
15.               θ n θ n α Q ^ θ n H Q ( θ n )
16.               ϕ ϕ α π ^ ϕ H π ( ϕ )
17.               ψ ˙ τ ψ + ( 1 τ ) ψ ˙
18.        End for
19.    End for
20. End

3.4. Energy-Efficient Path Planning

Path planning for UAVs is a crucial part of successful communication. After the UAVs have been dynamically positioned, the optimal path is planned in order to reduce their energy consumption. Many elements, such as wind conditions and limited availability of energy, influence UAV path planning. We propose a hybrid algorithm named SSO-DWM for path planning, which learns the obstacles’ mobility and dynamically changes the path. This process performs UAV path planning to maximize coverage capacity and reduce path loss. For that, we consider the parameters of wind characteristics ( ) , LoS/NLoS, energy ( E ) , static and moving obstacles, distance ( D ) , and optimality ( O P ) . et, Ώ = ( ,   E ,   D ,   O P ) . Initial evaluation of all alternative pathways and trajectories enables the UAV to determine the best path, which can be expressed as:
PT B ( Ώ ) = Ϣ × RM ( OPT i OPT B ) + Ϥ × RM ( ( OPT i OPT B )
Equation (31) represents the evaluation of the UAV path by using path parameters ( P T B ( Ώ ) ). O P T i denotes the first selected path and O P T j denotes the second selected path for the UAV to find an optimal path ( O P T B ). Ϣ , Ϥ are used for the iteration process, which can be set to zero at the time of the searching process. R M denotes the random number which states the UAV time interval [ f t = 0 ,   f t 0 ] while f t [ 0 , T ] . It depends on the UAV battery and mission. The flight time is the time taken by a UAV during motion and communication with IoT devices. The first path selected ( O P T i ) is the best path, and no path is more optimal than itself, so P T B ( Ώ ) is ‘0’, and the second path selected ( O P T j ) is the worse than any of the paths, so the second path P T B ( w c ,   E , D , O P ) is also ‘0’. Therefore, an increase in Ϣ and a decrease in Ϥ improves the manipulation of the algorithm and reduces the investigation, which can be formulated as:
Ϣ = Ϣ 0 Ϣ 0 iter   max × iter
Ϥ = Ϥ 0 Ϥ maxi Ϥ 0 iter   max × iter
The above two equations represent the manipulation of the algorithm for finding the optimal path using the SSO optimization algorithm with parameters w c ,   E ,   D ,   O P . Another set of parameters is also considered, such as LoS NLoS and SMO , which are used for detecting the static and moving obstacles which can be formulated as:
PT B ( LoS   NLoS ,   SMO ) = Ю ( W ɠ PT B ( Ώ ) head ( LoS   NLoS ,   SMO ) + W ʮ   Sep ( LoS   NLoS ,   SMO ) + W ϱ   SV ( LoS   NLoS ,   SMO )
Equation (34) represents the evaluation of the UAV path by using parameters ( P T B ( LoS   NLoS ,   SMO ) ). The head ( LoS   NLoS ,   SMO ) is used to calculate the angle between the direction of the current position, speed, and simulated trajectory direction. The angle of deviation must be more significant for a smaller value of head ( LoS   NLoS ,   SMO ). Sep ( LoS   NLoS ,   SMO ) represents the distance between simulated vector velocity (SV ( LoS   NLoS ,   SMO )) and trajectory. The overall value of P T B ( LoS   NLoS ,   SMO ) must be smaller to reduce the collision with obstacles. Ю, W ɠ , W ʮ , W ϱ denotes the weighted value co-efficient. Using DWM, obstacles in the path are detected, reducing the total energy consumption. The overall optimal path is formulated as:
OPTP B i , , n = PT B ( Ώ ) + PT B ( LoS   NLoS ,   SMO )
The energy consumption and path loss are reduced by using this approach. The effective path planning approach is depicted in Figure 7, in which the UAV optimally selects paths and detects obstacles using the proposed SSO-DWM. The proposed approach reduces path cost (1–4) and energy consumption compared to traditional UAV path planning. Traditional approaches detect the obstacles but have a high path cost, resulting in higher energy consumption. Algorithm 4 depicts the steps of SSO-DWM for energy-efficient path planning.
Figure 7. Hybrid SSO-DWM approach for obstacle detection.
Algorithm 4 Energy-efficient path planning.
1. Input P T B ( Ώ ) , P T B ( LoS   NLoS ,   SMO )
2. Output O P T P B i n
3. Begin to Evaluate the path
4.      while criteria for stopping not met ( f t 0 ) , do
5.           For each UAV
6.                Evaluate path // using (31)
7.                Manipulate path // using (32) & (33)
10.           End
11.           For each UAV
12.               Evaluate obstacles // using (34)
13.           End
14.           Compute O P T P B i n // using (35)
15.     End while
16. End

4. Simulation Setup, Comparative Analysis, and Experimental Results

The Dynamic-UAV technique is simulated using the NS 3.26 simulator [43]. Table 3 shows the hardware and software required to mimic our technique accurately. IoT devices, ground base stations, UAVs, and a satellite are all part of the network model. The prediction of weather conditions is performed first, followed by the prediction of the event. The placement and route planning of the UAVs is then performed to enhance the throughput and energy efficiency. The simulation parameters needed to execute the proposed technique are shown in Table 4.
Table 3. Hardware and software requirements of system.
Table 4. Simulation Parameters.
The Dynamic-UAV technique is experimentally analyzed. QoS, reliability, and energy efficiency are evaluated using the proposed method. This section comprises a simulation setup, comparative analysis, and summary. The proposed Dynamic-UAV approach is validated and compared to that of previously published studies, such as EIC-UAV [36], PSO-UAV [40], and DC-UAV [41], in terms of QoS (throughput (bps/Hz)), PDR, delay (ms)) reliability (coverage probability and the number of collected packets), and energy efficiency (KJ).

4.1. QoS Analysis

QoS is the measurement of overall network performance. The analysis of QoS is performed in terms of throughput, PDR, and delay.

4.1.1. Throughput Comparison

The amount of information transferred in a certain period is known as throughput. High throughput is essential for an effective communication system. Figure 8 represents the throughput achieved with an increasing number of UAVs, compared with existing approaches. As the number of UAVs increases, so does throughput, proving that the proposed Dynamic-UAV approach achieves a high throughput rate in comparison to existing works. This is because of weather prediction, multi-UAV placement, and events-aware clustering performed in the proposed Dynamic-UAV approach. The LGRU algorithm separates disaster and non-disaster regions. Then, the DBOC algorithm clusters the IoT devices to reduce complexity and energy consumption during the communication of UAVs with ground devices. DPSAC is used to determine the optimal number of UAVs to be deployed in disaster and non-disaster regions and then provides optimal positioning based on those numbers to increase the reliability of communications. Compared to the proposed Dynamic-UAV approach, the location of the UAV is fixed at a constant altitude in the DC-UAV approach [41], which reduces the throughput and increases communication complexity between UAVs and IoT devices. In PSO-UAV, the impact of weather conditions on UAV positioning is not addressed, which reduces the throughput performance [40]. The EIC-UAV approach only considers windspeed while other parameters considered in our approach are not taken into account; thus, it also increases the data loss, resulting in low throughput performance [36].
Figure 8. Number of UAVs vs. Throughput.
With 10 UAVs, the proposed Dynamic-UAV approach achieves a throughput of 2 bit/s, while the existing work EIC-UAV, PSO-UAV, and DC-UAV achieve 1.6 bit/s, 1.16 bit/s, and 0.8 bit/s, respectively. Compared to the existing approaches, the proposed work has a throughput rate of 1.593 bit/s on average, where the average throughput rate is 1.233 bit/s in EIC-UAV, 0.86 bit/s in PSO-UAV, and 0.64 bit/s in DC-UAV.

4.1.2. PDR Comparison

PDR is the ratio of packets successfully delivered to the destination compared to the total number of packets transmitted by the sender. Figure 9 compares PDR with the number of UAVs to existing works. The PDR increases with the number of UAVs, as illustrated in Figure 9. The proposed Dynamic-UAV method achieves a high PDR in comparison to the previous works. Event-aware clustering is utilized to boost the PDR in the proposed Dynamic-UAV approach. In PSO-UAV, the information from all the devices is collected randomly by UAVs, thus increasing communication complexity and decreasing the PDR. The PDR is lower due to the unaddressed impact of weather conditions in the EIC-UAV approach. The DC-UAV approach leads to a lower PDR due to the fixed altitude of the UAV, channel fluctuations, and inability to adjust its position dynamically.
Figure 9. Number of UAVs vs. PDR.
When the number of UAVs increases to 10, the proposed Dynamic-UAV approach achieves a PDR of 0.95. In contrast, the state-of-the-art approaches DC-UAV, PSO-UAV, and EIC-UAV earn PDRs of 0.79, 0.8, and 0.85, respectively. The average PDR of the proposed work is 0.88. In terms of PDR, the numerical results depicted in Figure 9 reflect the effectiveness of the proposed method.

4.1.3. Delay Comparison

Delay is the time taken by a packet from the source IoT device to its destination. It is formulated as follows:
=
where represents the delay, denotes the packet transmission time, and shows the actual transmission time. Figure 10 depicts the delay as the number of IoT devices increases. The proposed Dynamic-UAV transmits packets from source to destination with a shorter delay than the existing approaches. It is due to proper clustering using the DBOC algorithm, which clusters the IoT devices in disaster and non-disaster regions and selects the optimal CH based on energy and centrality. The existing EIC-UAV approach used shift algorithm for clustering ground devices in which a detailed explanation of centroid selection is not present. In the PSO-UAV approach, the UAV tries to collect information from all the sensors, which increases the delay when the number of sensors increases. Due to the fixed altitude, the DC-UAV approach encounters path loss; hence, the delay increases when the number of IoT devices increases.
Figure 10. Delay vs. Number of IoT devices.
When we increased the number of IoT devices to 100, Dynamic-UAV encountered a 35 ms delay in packet transmission. In contrast, the DC-UAV, PSO-UAV, and EIC-UAV approaches encounter delays of 150 ms, 120 ms, and 130 ms, respectively. The average delay in the proposed work is 18.5 ms for the number of IoT devices, which is less than the existing approaches.
Figure 11 depicts the delay experienced during packet transmission as the number of UAVs increases. The length of delay increases with the number of UAVs. The proposed approach outperforms the existing schemes due to multi-UAV positioning in terms of delay. UAVs are effectively positioned using the DPSAC algorithm, which optimally determines the number of UAVs required for a specific area while minimizing communication delays between UAVs and IoT devices. The EIC-UAV approach is inefficient when the number of UAVs increases because of the absence of centroid during the clustering of ground devices. In PSO-UAV, the algorithm falls into local minima for an increasing number of UAVs, due to which the delay also increases, whereas the number of UAV increases the DC-UAV encounters high delay because of its fixed altitude.
Figure 11. Delay vs. Number of UAVs.
When the number of UAVs is increased to 10, the proposed Dynamic-UAV approach has a delay of 33 ms. On the other hand, DC-UAV, PSO-UAV, and EIC-UAV have delays of 130, 104, and 81 milliseconds, respectively. Our system experiences an average delay of 16.4 ms, validating its effectiveness. The average performance of each QoS metric is displayed in Table 5.
Table 5. QoS analysis.

4.2. Reliability Analysis

Reliability is the measure of the successful delivery of data packets without loss. The proposed reliability analysis is compared in terms of coverage probability and a number of collected data packets.

4.2.1. Coverage Probability Comparison

The coverage probability is defined as the distance that UAVs cover as their altitude increases. Figure 12 depicts the coverage probability of the proposed Dynamic-UAV technique relative to the UAV’s height, compared to the existing approaches.
Figure 12. The altitude of UAVs vs. coverage probability.
In Figure 12, it is demonstrated that as the altitude of UAVs increases, so does the likelihood of coverage. Since the DPSAC algorithm considers several different parameters while positioning multi-UAVs, the proposed Dynamic-UAV method achieves a high probability of coverage in comparison to previous techniques as a result.
On the other hand, the most traditional systems use UAVs that are fixed in place, resulting in a limited likelihood of coverage. Only wind speed is not sufficient for positioning of UAV, and that is why coverage probability of the EIC-UAV approach is affected. The coverage probability of PSO-UAV is also affected due to the lack of weather conditions and other parameters. After reaching a maximum height of 100 m, the coverage probability of the proposed approach increases to 1, while that of the existing DC-UAV, PSO-UAV, and EIC-UAV techniques is only 0.5, 0.6, and 0.8, respectively. The proposed Dynamic-UAV approach has an average coverage probability of 0.82, significantly higher than the previous DC-UAV, PSO-UAV, and EIC-UAV techniques.

4.2.2. Number of Collected Packets Comparison

Compared to previous methodologies, Figure 13 shows the number of packets captured as a function of UAV speed. In proportion to the speed of UAVs, the pace of packet collection slows down. The Dynamic-UAV technique has a greater packet-collecting rate than previous approaches.
Figure 13. Number of the collected packet compared to UAV speed.
Effective path planning is performed using the hybrid SSO-DWM, which finds an optimal path, detects obstacles during flight, and increases the packet collection rate despite increasing UAV speed. In contrast, the existing DC-UAV, PSO-UAV, and EIC-UAV approaches consider limited path planning parameters, decreasing the packet collection rate. When the speed of the UAV is 25 m/s, the suggested Dynamic-UAV approach collects 6000 packets, while the existing DC-UAV, PSO-UAV, and EIC-UAV systems gather 2000, 3000, and 4250 packets, respectively. The proposed work has an average packet collection rate of 7109, outperforming the existing DC-UAV, PSO-UAV, and EIC-UAV techniques.
Figure 14 depicts the correlation between UAV altitude and the number of collected packets. From Figure 14, it is clear that the packet collection rate grows linearly with the increasing altitude of UAVs up to 80 m. The graph declines after 80 m (the saturation threshold) since the UAV is designed to fly only up to 80 m. Due to event/weather predictions and multi-UAV placement, the Dynamic-UAV technique achieves a large number of collected packets even at that height.
Figure 14. Number of collected packets to UAV altitude.
The LGRU prediction algorithm is used to predict weather and events based on past data, reducing the risk of UAVs suffering from physical damage. In contrast, the DPSAC algorithm is used to optimize UAV placement to provide enough coverage to IoT devices, even when UAVs fly at a high altitude. The average performance of each reliability matric is presented in Table 6.
Table 6. Reliability analysis.

4.3. Energy Consumption and Efficiency Analysis

The amount of energy consumed when the number of IoT devices increases is known as energy consumption ( ) . It is measured by taking the difference of total energy ( ) to the residual energy ( ) of the IoT devices, which is formulated as follows.
=
We computed the total energy consumed by the IoT devices. Figure 15 represents the comparison of energy consumption to the number of IoT devices. Figure 15 demonstrates that, as the number of IoT devices increases, so does their energy consumption. However, the Dynamic-UAV approach reduces energy consumption due to event/weather prediction, event-based clustering, and multi-UAV positioning. Predicting weather/events using the LGRU algorithm and event-aware clustering using the DB-OPTICS method minimizes energy consumption under extreme weather conditions. DPSAC-based multi-UAV positioning finds the suitable altitude for UAVs, decreasing the energy consumption and minimizing the delay significantly.
Figure 15. Energy consumption to the Number of IoT devices.
PSO-UAV solely considers wind speed; however, obstacles were not considered, resulting in poor path planning, increased risk of damage, and high energy consumption. The proposed approach consumes 8.5 kilojoules of energy for 100 IoT devices, compared to 13, 11.2, and 10 kilojoules for DC-UAV, PSO-UAV, and EIC-UAV. The proposed work consumes 7.68 kilojoules of energy on average, compared to DC-UAV, PSO-UAV, and EIC-UAV methods.
Energy efficiency is known as the minimum amount of energy consumed when the number of UAV devices increases. A perfect system must have high energy efficiency. More devices with low energy consumption lead to high energy efficiency. The energy efficiency is calculated by:
EE = Energy   consumed   Initial   Energy  
Figure 16 demonstrates that, as the number of UAVs increases, so does energy efficiency. Our proposed Dynamic-UAV approach provides excellent energy efficiency due to event/weather prediction and energy-efficient path planning. Efficient path planning uses a hybrid approach of the SSO-DWM methods to find the optimal path and detect obstacles, increasing energy efficiency. Collectively, these approaches are implemented to improve the overall system performance in an orderly manner.
Figure 16. Energy efficiency to Number of UAVs.
Using 100 UAVs, the proposed Dynamic-UAV technique has an energy efficiency of 2, whereas the existing DC-UAV, PSO-UAV, and EIC-UAV are 0.75, 1.23, and 1.58, respectively. The proposed work has an average energy efficiency of 1.41 compared to the existing ones. A lack of weather conditions, lack of consideration of static and moving obstacles, and a lack of dynamic positioning reduces the performance of EIC-UAV, PSO-UAV, and DC-UAV, which results in higher energy consumption and lower energy efficiency. The amount of average energy consumption and average energy efficiency is presented in Table 7.
Table 7. Average energy consumption and energy efficiency analysis.

5. Application of Dynamic-UAV Approach

It is essential to establish reliable communication during a disaster. The proposed work can be applied to relay the information when the existing ground network is no longer functional. The conventional communication network is not functional during floods, fires, or earthquakes. In such a case, a UAV with a long endurance time can be used to enable the network and restore the information exchange. The proposed work can be applied in the real-time vehicular ad hoc network (VANET) environment. The UAV-based monitoring system is widely adopted in-vehicle road safety. The VANET environment is highly vulnerable to manmade disasters (i.e., accidents). Hence, a monitoring and early detection system should be deployed to mitigate and rescue the losses caused by these disasters.

6. Summary

This section summarizes the proposed Dynamic-UAV approach presented in this paper. The numerical analysis of the performance of our approach, along with the existing approaches presented in Table 5, Table 6 and Table 7 proves its efficacy in terms of QoS, reliability, and energy efficiency. The proposed Dynamic-UAV approach achieves linear performance when the number of UAVs and IoT devices increases because of the linear capacity constraints of each UAV and IoT device, respectively. The proposed methods and algorithms support the linearity of the proposed work. The analysis of the context of the environment periodically helps the approach to differentiate disaster regions from non-disaster regions and maintain the system’s performance in any situation. The communication reliability between the devices and UAVs is enhanced by clustering the devices at the ground level. Further, the proposed approach takes advantage of 5G communication to eradicate bandwidth and latency issues. The dynamic determination of the required number of UAVs and the ideal location of the UAVs helps to improve the coverage and total throughput. Considering both static and dynamic obstacles in the environment eliminates the chances of collisions and improves the coordination between UAVs. This helps to obtain the optimal path and improves the system’s energy efficiency. The highlights mentioned above of the Dynamic-UAV approach confirm its optimal performance. The individual LGRU, DBOC, DPSAC, and SSO-DWM techniques jointly improve the overall system performance. Table 8 shows the temporal complexity involved in executing the proposed method.
Table 8. Time complexity analysis.

7. Conclusions

This study addresses the major obstacles in 5G-assisted UAV communications, such as high dynamicity and weather-related disturbances. Based on historical weather conditions and visuals of the environment, a dynamic-UAV method is proposed that performs weather prediction and event monitoring utilizing the LGRU algorithm to understand the environmental context. The DBOC algorithm is used to cluster IoT devices in disaster and non-disaster areas to improve communication reliability between the devices and UAVs. The DPSAC method is used to determine the required number of UAVs. The DPSAC algorithm also performed dynamic positioning of UAVs by considering predicted weather conditions and other important elements to enhance coverage probability and throughput. Obstacle-aware path planning is achieved using the SSO-DWM algorithm, which considers static and dynamic obstacles to identify the ideal path, conserve energy, and improve LoS communication. The proposed approach is evaluated by comparing it to existing techniques in terms of throughput, PDR, delay, coverage probability, number of collected packets, energy consumption, and energy efficiency. The effectiveness of our approach is assessed using numerical analysis, which demonstrates that our method surpasses all existing methods across all metrics. The future development of the proposed work will focus on enhancing the security of UAVs to ensure uninterrupted services.

Author Contributions

Writing—Original Draft Preparation, A.K.; Writing—Review and Editing, J.Z. and H.A.Q.; Methodology, A.K.; Software, A.K.; Formal analysis, A.K. and S.A.; Validation, A.K. and S.A.; Data Curation, M.I.; Investigation, S.M. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Fundamental Research Funds for the Central Universities (No. 2019XD-A07), the Director Fund of Beijing Key Laboratory of Space-ground Interconnection and Convergence, and the National Key Laboratory of Science and Technology on Vacuum Electronics.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hassan, A.; Ahmad, R.; Ahmed, W.; Magarini, M.; Alam, M.M. UAV and SWIPT Assisted Disaster Aware Clustering and Association. IEEE Access 2020, 8, 204791–204803. [Google Scholar] [CrossRef]
  2. Koumaras, H.; Makropoulos, G.; Batistatos, M.C.; Kolometsos, S.; Gogos, A.; Xilouris, G.; Sarlas, A.; Kourtis, M. 5G-Enabled UAVs with Command and Control Software Component at the Edge for Supporting Energy Efficient Oppor-tunistic Networks. Energies 2021, 14, 1480. [Google Scholar] [CrossRef]
  3. Zhang, L.; Zhao, H.; Hou, S.; Zhao, Z.; Xu, H.; Wu, X.; Wu, Q.; Zhang, R. A Survey on 5G Millimeter Wave Com-munications for UAV-Assisted Wireless Networks. IEEE Access 2019, 7, 117460–117504. [Google Scholar] [CrossRef]
  4. Wang, X.; Yang, Y.; Wu, D.; Zhang, Z.; Ma, X. Mission-Oriented 3D Path Planning for High-Altitude Long-Endurance Solar-Powered UAVs with Optimal Energy Management. IEEE Access 2020, 8, 227629–227641. [Google Scholar] [CrossRef]
  5. Mardani, A.; Chiaberge, M.; Giaccone, P. Communication-Aware UAV Path Planning. IEEE Access 2019, 7, 52609–52621. [Google Scholar] [CrossRef]
  6. Mao, Y.; Chen, M.; Wei, X.; Chen, B. Obstacle Recognition and Avoidance for UAVs Under Resource-Constrained Environments. IEEE Access 2020, 8, 169408–169422. [Google Scholar] [CrossRef]
  7. Li, B.; Fei, Z.; Zhang, Y. UAV Communications for 5G and Beyond: Recent Advances and Future Trends. IEEE Internet Things J. 2018, 6, 2241–2263. [Google Scholar] [CrossRef] [Green Version]
  8. Arafat, M.Y.; Moh, S. Localization and Clustering Based on Swarm Intelligence in UAV Networks for Emergency Communications. IEEE Internet Things J. 2019, 6, 8958–8976. [Google Scholar] [CrossRef]
  9. Arafat, M.Y.; Moh, S. Bio-Inspired Approaches for Energy-Efficient Localization and Clustering in UAV Networks for Monitoring Wildfires in Remote Areas. IEEE Access 2021, 9, 18649–18669. [Google Scholar] [CrossRef]
  10. Wang, Y.-S.; Hong, Y.-W.P.; Chen, W.-T. Trajectory Learning, Clustering, and User Association for Dynamically Connectable UAV Base Stations. IEEE Trans. Green Commun. Netw. 2020, 4, 1091–1105. [Google Scholar] [CrossRef]
  11. Duan, T.; Wang, W.; Wang, T.; Chen, X.; Li, X. Dynamic Tasks Scheduling Model of UAV Cluster Based on Flexible Network Architecture. IEEE Access 2020, 8, 115448–115460. [Google Scholar] [CrossRef]
  12. Ronghua, Z.; Hemin, S.; Hao, L.; Weilin, L. TDOA and track optimization of UAV swarm based on D-optimality. J. Syst. Eng. Electron. 2020, 31, 1140–1151. [Google Scholar] [CrossRef]
  13. Wang, Y.; Wei, G.; Guan, Q.; Liu, Y. A Novel Positioning System of UAV Based on IMA-GPS Three-Layer Data Fusion. IEEE Access 2020, 8, 158449–158458. [Google Scholar] [CrossRef]
  14. Zhong, X.; Guo, Y.; Li, N.; Li, S. Deployment Optimization of UAV Relays for Collecting Data from Sensors: A Potential Game Approach. IEEE Access 2019, 7, 182962–182973. [Google Scholar] [CrossRef]
  15. Zhang, T.; Wang, Y.; Liu, Y.; Xu, W.; Nallanathan, A. Cache-Enabling UAV Communications: Network Deployment and Resource Allocation. IEEE Trans. Wirel. Commun. 2020, 19, 7470–7483. [Google Scholar] [CrossRef]
  16. Jayaweera, H.M.; Hanoun, S. A Dynamic Artificial Potential Field (D-APF) UAV Path Planning Technique for Following Ground Moving Targets. IEEE Access 2020, 8, 192760–192776. [Google Scholar] [CrossRef]
  17. Xiao, Z.; Dong, H.; Bai, L.; Wu, D.O.; Xia, X.-G. Unmanned Aerial Vehicle Base Station (UAV-BS) Deployment with Millimeter-Wave Beamforming. IEEE Internet Things J. 2019, 7, 1336–1349. [Google Scholar] [CrossRef]
  18. Xue, R.; Zhao, M.; Tang, H. Information Transmission Schemes Based on Adaptive Coded Modulation for UAV Surveillance Systems with Satellite Relays. IEEE Access 2020, 8, 191355–191364. [Google Scholar] [CrossRef]
  19. El-Sayed, H.; Chaqfa, M.; Zeadally, S.; Puthal, D. A Traffic-Aware Approach for Enabling Unmanned Aerial Vehicles (UAVs) in Smart City Scenarios. IEEE Access 2019, 7, 86297–86305. [Google Scholar] [CrossRef]
  20. Brown, A.; Anderson, D. Trajectory Optimization for High-Altitude Long-Endurance UAV Maritime Radar Sur-veillance. IEEE Trans. Aerosp. Electron. Syst. 2020, 56, 2406–2421. [Google Scholar] [CrossRef] [Green Version]
  21. Bhandari, S.; Wang, X.; Lee, R. Mobility and Location-Aware Stable Clustering Scheme for UAV Networks. IEEE Access 2020, 8, 106364–106372. [Google Scholar] [CrossRef]
  22. Tan, Z.; Qu, H.; Zhao, J.; Zhou, S.; Wang, W. UAV-Aided Edge/Fog Computing in Smart IoT Community for Social Augmented Reality. IEEE Internet Things J. 2020, 7, 4872–4884. [Google Scholar] [CrossRef]
  23. Zhong, X.; Huo, Y.; Dong, X.; Liang, Z. QoS-Compliant 3-D Deployment Optimization Strategy for UAV Base Stations. IEEE Syst. J. 2020, 15, 1795–1803. [Google Scholar] [CrossRef]
  24. Ausonio, E.; Bagnerini, P.; Ghio, M. Drone Swarms in Fire Suppression Activities: A Conceptual Framework. Drones 2021, 5, 17. [Google Scholar] [CrossRef]
  25. Cheng, L.; Zhong, L.; Zhang, X.; Xing, J. A staged adaptive firefly algorithm for UAV charging planning in wireless sensor networks. Comput. Commun. 2020, 161, 132–141. [Google Scholar] [CrossRef]
  26. Wang, H.; Wang, J.; Ding, G.; Chen, J.; Gao, F.; Han, Z. Completion Time Minimization with Path Planning for Fixed-Wing UAV Communications. IEEE Trans. Wirel. Commun. 2019, 18, 3485–3499. [Google Scholar] [CrossRef]
  27. Li, K.; Ge, F.; Han, Y.; Wang, Y.; Xu, W. Path planning of multiple UAVs with online changing tasks by an ORPFOA algorithm. Eng. Appl. Artif. Intell. 2020, 94, 103807. [Google Scholar] [CrossRef]
  28. Hu, X.; Pang, B.; Dai, F.; Low, K.H. Risk Assessment Model for UAV Cost-Effective Path Planning in Urban Environments. IEEE Access 2020, 8, 150162–150173. [Google Scholar] [CrossRef]
  29. Tang, J.; Song, J.; Ou, J.; Luo, J.; Zhang, X.; Wong, K.-K. Minimum Throughput Maximization for Multi-UAV Enabled WPCN: A Deep Reinforcement Learning Method. IEEE Access 2020, 8, 9124–9132. [Google Scholar] [CrossRef]
  30. Qu, C.; Gai, W.; Zhong, M.; Zhang, J. A novel reinforcement learning based grey wolf optimizer algorithm for unmanned aerial vehicles (UAVs) path planning. Appl. Soft Comput. 2020, 89, 106099. [Google Scholar] [CrossRef]
  31. Shao, S.; Peng, Y.; He, C.; Du, Y. Efficient path planning for UAV formation via comprehensively improved particle swarm optimization. ISA Trans. 2020, 97, 415–430. [Google Scholar] [CrossRef] [PubMed]
  32. Shi, L.; Xu, S.; Liu, H.; Zhan, Z. QoS-Aware UAV Coverage path planning in 5G mmWave network. Comput. Netw. 2020, 175, 107207. [Google Scholar] [CrossRef]
  33. Shi, L.; Xu, S. UAV Path Planning with QoS Constraint in Device-to-Device 5G Networks Using Particle Swarm Optimization. IEEE Access 2020, 8, 137884–137896. [Google Scholar] [CrossRef]
  34. Wu, X.; Xu, L.; Zhen, R.; Wu, X. Bi-Directional Adaptive A* Algorithm Toward Optimal Path Planning for Large-Scale UAV Under Multi-Constraints. IEEE Access 2020, 8, 85431–85440. [Google Scholar] [CrossRef]
  35. Yu, X.; Li, C.; Zhou, J. A constrained differential evolution algorithm to solve UAV path planning in disaster scenarios. Knowl. Based Syst. 2020, 204, 106209. [Google Scholar] [CrossRef]
  36. Huang, Z.; Chen, C.; Pan, M. Multi-objective UAV Path Planning for Emergency Information Collection and Transmission. IEEE Internet Things J. 2020, 7, 6993–7009. [Google Scholar] [CrossRef]
  37. Wang, Z.; Liu, R.; Liu, Q.; Thompson, J.; Kadoch, M. Energy-Efficient Data Collection and Device Positioning in UAV-Assisted IoT. IEEE Internet Things J. 2020, 7, 1122–1139. [Google Scholar] [CrossRef]
  38. Holis, J.; Pechac, P. Elevation Dependent Shadowing Model for Mobile Communications via High Altitude Platforms in Built-Up Areas. IEEE Trans. Antennas Propag. 2008, 56, 1078–1084. [Google Scholar] [CrossRef]
  39. Goldsmith, A. Wireless Communications; Cambridge University Press: Cambridge, UK, 2005. [Google Scholar]
  40. Na, H.; Yoo, S. PSO-Based Dynamic UAV Positioning Algorithm for Sensing Information Acquisition in Wireless Sensor Networks. IEEE Access 2019, 7, 77499–77513. [Google Scholar] [CrossRef]
  41. Samir, M.; Sharafeddine, S.; Assi, C.; Nguyen, T.; Ghrayeb, A. UAV Trajectory Planning for Data Collection from Time-Constrained IoT Devices. IEEE Trans. Wirel. Commun. 2020, 19, 34–46. [Google Scholar] [CrossRef]
  42. Zhu, S.; Gui, L.; Cheng, N.; Sun, F.; Zhang, Q. Joint Design of Access Point Selection and Path Planning for UAV-Assisted Cellular Networks. IEEE Internet Things J. 2020, 7, 220–233. [Google Scholar] [CrossRef]
  43. Campanile, L.; Gribaudo, M.; Iacono, M.; Marulli, F.; Mastroianni, M. Computer Network Simulation with ns-3: A Systematic Literature Review. Electronics 2020, 9, 272. [Google Scholar] [CrossRef] [Green Version]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.