Next Article in Journal
A Novel Approach to Global Positioning System Accuracy Assessment, Verified on LiDAR Alignment of One Million Kilometers at a Continent Scale, as a Foundation for Autonomous DRIVING Safety Analysis
Next Article in Special Issue
Application Layer ARQ Algorithm for Real-Time Multi-Source Data Streaming in UAV Networks
Previous Article in Journal
Wireless Signal Propagation Prediction Based on Computer Vision Sensing Technology for Forestry Security Monitoring
Previous Article in Special Issue
Modeling Optimal Location Distribution for Deployment of Flying Base Stations as On-Demand Connectivity Enablers in Real-World Scenarios
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluating the Quality of Experience Performance Metric for UAV-Based Networks

by
Abdukodir Khakimov
1,*,
Evgeny Mokrov
1,
Dmitry Poluektov
1,
Konstantin Samouylov
1,2 and
Andrey Koucheryavy
3
1
Applied Mathematics & Communications Technology Institute, Peoples’ Friendship University of Russia (RUDN University), 117198 Moscow, Russia
2
Institute of Informatics Problems, FRC CSC RAS, 119333 Moscow, Russia
3
Department of Communication Networks and Data Transmission, The Bonch-Bruevich Saint-Petersburg State University of Telecommunications (SPBSUT), 193232 St. Petersburg, Russia
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(17), 5689; https://doi.org/10.3390/s21175689
Submission received: 29 June 2021 / Revised: 3 August 2021 / Accepted: 18 August 2021 / Published: 24 August 2021
(This article belongs to the Special Issue Unmanned Aerial Vehicles for Future Networking Applications)

Abstract

:
In this work, we consider a UAV-assisted cell in a single user scenario. We consider the Quality of Experience (QoE) performance metric calculating it as a function of the packet loss ratio. In order to acquire this metric, a radio-channel emulation system was developed and tested under different conditions. The system consists of two independent blocks, separately emulating connections between the User Equipment (UE) and unmanned aerial vehicle (UAV) and between the UAV and Base station (BS). In order to estimate scenario usage constraints, an analytical model was developed. The results show that, in the described scenario, cell coverage can be enhanced with minimal impact on QoE.

1. Introduction

Currently, 5th generation (5G) networks are standardized and deeply researched, which allows network operators to fully implement them in their architectures. However, many “challenges” that were posed to the 5G networks were not fully resolved; therefore, the discussion of the requirements and applications of the 6th generation (6G) networks is gaining momentum in the scientific community [1,2,3]. A number of new communication scenarios are predicted, which include holographic calls, e-medicine, flying networks, and Internet of skills [4]. This in turn imposes ambitious requirements for new networks. These are ultra low latency (less than 0.1 ms), and a higher level of security and privacy, and an increase in energy efficiency. It is also assumed that a level of reliability comparable to wired networks will be provided.
To achieve such a performance, especially in emergency situations or in cases when the coverage of the terrestrial BSs is limited due to terrain conditions, the development of non-terrestrial networks (NTNs) is being considered. Such networks allow operators to provide coverage for the areas where it is impossible or economically impractical to deploy terrestrial BSs. Additionally, in cases of an emergency situation, natural disaster or simple network overload (during a concert, festival or other event), such networks would deal with the situation in the shortest possible time.
Starting with release 15, the ability to use NTNs [5] has already been added to the 3GPP standard for 5G networks, but this generation of networks still remains largely 2D oriented. In 6G networks, a fully fledged three-dimensional heterogeneous network architecture is assumed to be used. In the frame of this architecture, in addition to terrestrial BSs, Unmanned Aerial Vehicles (UAVs), High Altitude Platforms (HAPs), and satellites are to be implemented [6].
The implementation of HAPs and satellites as network elements allows for a larger coverage area, especially in difficult terrain conditions. However, they present a number of significant disadvantages, such as high transmission delay, low bandwidth and high deployment complexity. At the same time, implementing UAVs makes it possible to provide communication services at a level comparable to terrestrial BSs. This fact emphasizes that UAVs have high implementation efficiency with significantly lower complexity and deployment costs. The most relevant and realistic scenario for the NTN implementation by 2030 is the implementation of UAVs as a tool to extend the coverage of the terrestrial BSs to the areas, which are hard to cover using traditional methods.
In this paper, we first present related works, given in Section 2, where we reference several papers regarding UAV implementation in telecommunications as well as some practical trials. In Section 3, a system model is presented and several trial scenarios are considered. In Section 4, a mathematical model derives some of the constraints for the scenario usages. Section 5 describes the proposed architecture of the testbed and its technical limitations. Section 6 presents the initial data for the trial, its results and their discussion. In the conclusion, we summarize the main results and define topics for further research.
The main contributions of our paper can be summarized as follows:
  • Proposed approach for a cell enhancement via UAV utilization as a repeater;
  • Proposed mathematical model to estimate the system constraints;
  • Developed and implement an emulator of a test network based on software defined radio (SDR) devices, which reproduces all interacting elements’ channel characteristics for the scenarios described in the system model.
The experimental results show that our proposed model allows us to enhance the cell coverage while still maintaining the required QoE levels.

2. Related Works

The implementation of UAVs in wireless networks for purposes of building emergency communication networks with uninterrupted network coverage and reducing the load on network sections has long attracted much attention both in scientific circles and in industry [7,8]. Due to their high mobility and deployment flexibility, UAVs are widely used in 5G networks.
The authors of [9,10] show that UAVs can be cost-effectively used as aerial platforms to provide or improve communication services of ground devices. Aerial base stations (BSs) and repeaters can be considered as examples of these platforms in cases where the terrestrial cellular network does not provide sufficient coverage. The authors of [11] examined possible use cases for drones to improve network performance, highlighting two main usage types: mobile-enabled drones (MEDs) and wireless infrastructure drones (WIDs).
In [12], to achieve maximum coverage of a UAV BS, a mathematical model calculating the optimal flight height depending on the conditions of the propagation environment is proposed.
The authors of [13], using UAVs in combination with mobile edge computing (MEC) technology with multiple access, present an algorithm for unloading traffic to UAVs, with consideration given to power consumption and movement trajectory. Expanding this approach, the authors of [14] consider offloading vehicle computations on UAVs and through UAVs to ground MEC servers, using drones as radio relays.
Application of UAVs in sensor networks and as radio bridges is also of great interest. In [15], a platform for organizing an ad hoc network using UAVs to achieve the required QoS level and GPSR and AODV is considered. Additionally, the authors of [16,17] proposed using an ad hoc network for UAVs.
In [18], a spatial network configuration scheme was constructed for additional coverage by a UAV-deployed base station to increase the QoS indicator. By dividing the coverage area into three sectors in accordance with the signal level, the authors motivate users to move towards an area with a higher signal level by offering them certain rewards. This method is partially considered in our work; however, the approach is applied in reverse, so that the UAV follows the user.
For these user-centered systems, QoE plays an essential role. The work of [19] proposes a method for optimizing this indicator through prediction, using a neural network and caching the content requested by the user on the UAV in advance. This approach, however, is effective for a network section with similar user content preferences.This paper considers an approach to the analysis of QoE in a UAV-assisted cell, studying the impact of using UAVs with directional antennas to enhance cell coverage.
To assess the effectiveness of the stochastic model of the millimeter-wave channel between a UAV and ground-based antenna, the authors of [20] carried out an analysis on an experimental setup using proprietary equipment and SDR to provide a wireless channel. A similar approach was used in [21] to build a platform for an elastic cognitive network. This approach allows one to flexibly change the network configuration by using an SDR; however, it has a high implementation cost due to the usage of proprietary equipment and the need for a special location for testing. In [22], the authors presented the possibility of emulating a wireless network using SDR or commercial radio devices in conjunction with a PC. We described a similar approach in [23] to possibly emulate signal propagation channels, potentially making changes to the signal propagation environment. This method allows an experiment to be carried out autonomously and cost-effectively, as well as its validation, before carrying out a trial using real equipment.
Table 1 presents a comparison analysis of the aforementioned works and our current paper. It can be noted that most works use either analytical or simulation approaches to derive the desired metrics; however, using an emulation approach is much closer to field trials than both of these approaches, since it emulates the channel behaviour unlike a simulation. The papers presenting experimental field trials are few in number and mostly focus on an emulation platform overview to showcase the platform’s capabilities. The current work is a continuation of [23], where the basis for the used emulation platform was to build and upgrade said emulator to analyze the QoE impact in terms of throughput in a UAV-assisted cell enhancement scenario.

3. System Model

We consider a scenario where the BS is insufficient to serve the user in terms of the required QoS/QoE and it implements a UAV to improve the latency and bit rate. The connection between the base station and the UAV is realized by the new radio (NR) technology using a directional antenna. The UAV is also equipped with a directional wide-angle antenna to connect to the mobile UE via NR. There are no blockers in between the BS and UAV and between the UAV and UE; thus, the free space path loss (FSPL) signal propagation model is considered. The BS always has all the information about the UAV location and the UAV always has all the information about both the BS and UE locations.
When the user is served via a UAV and moves from its preferred position, located directly under the UAV, the signal it receives from the UAV decreases. When the signal falls below a certain given threshold, the UAV starts moving towards the location where the user was at the moment the signal reached the threshold. The BS is equipped with a rotating antenna that follows UAV movements. The BS antenna coverage has a threshold area near the edges. When a UAV enters this threshold, the antenna rotates so that it is directed towards the current UAV position. The threshold depends on the antenna angular rotation speed and the distance between the BS and UAV.
The coverage area can be divided into several areas, as depicted in Figure 1: the inner area R 0 , BS coverage R 1 , middle area R 2 and outer area R 3 .
In the inner area, it is not advisable to use a UAV to connect to the UE, since in this area, it is possible for the BS antenna to lag behind the UAV position, resulting in connection loss. Since the area is relatively close to the BS, the UE can be connected directly to the BS with relatively good link quality. The BS coverage area is the coverage area of the multisector BS antenna, which is used to serve customers. In this area, the user can be connected via a UAV as well as directly via a multisector BS antenna. The decision regarding the connection type can be considered as an optimization problem of several parameters, such as channel quality, number of connected UEs, resource allocation scheme and others, and is not considered in the current paper. The middle area corresponds to the coverage area of the directional BS antenna, which is used for the connection between the BS and UAV. In this area, the UAV is used as a repeater to connect to the UE. Thus, UAV implementation widens the BS coverage area. The outer area is the area outside the BS coverage that can be covered by the UAV, located in the middle area. The BS is unable to provide the required signal quality directly to the user or UAV located in this area. Thus, it is advisable to utilize the UAV located in the middle area as a mediator. The outer area corresponds to the UAV coverage area under the condition that the UAV maintains its connection to the BS. In this way, the UAV essentially widens the BS coverage area even in the case of a directional antenna.
For the described scenario we consider following cases depicted on Figure 2 to test and configure emulation test-bed.
  • Case 1. This is a static case, where the BS antenna is turned towards UAV and does not change its angle. The UAV is located directly above the user and neither of them are moving. This case is proposed to test the emulator and to assure it is working as intended. This case is illustrated on Figure 2a.
  • Case 2. This is a semi-static case. The BS antenna is turned towards UAV and does not change its angle. The UAV is located in its initial position and does not move. UE moves in the area where the UAV can cover it without leaving the UAV antenna coverage. This case is to ensure that the simulator/emulator correctly reacts to the user mobility. This case is illustrated on Figure 2b.
  • Case 3. This is a semi-dynamic case. The BS antenna is turned towards UAV and does not change its angle. The UAV moves inside the BS antenna coverage in order to maintain user connection. The user moves in the area where the UAV can cover it without leaving the BS antenna coverage. This case tests the connection changes between BS and UAV depending on UAV position. This case is illustrated on Figure 2c.
  • Case 4. This is a dynamic case. User moves in circles/spirals/given paths around the BS. The UAV moves inside the potential BS coverage in order to maintain user connection. The BS antenna is turning towards UAV when it changes its position. This scenario lets us look into the performance of the fully dynamic system. This case is illustrated on Figure 2d.
The cases were tested sequentially to ensure that the designed emulator correctly reflects the changes in signal quality resulting from the mobility of corresponding nodes. The results presented in this paper correspond to case 4, the most general case. We studied the QoE characteristic of the signal according to [24]. We considered that the transmitted traffic uses an iLBC voice codec, and, in order to properly collect the data from the emulator, the BS sent a constant stream of data to the UE. We also propose an analytical model to calculate the borders of the coverage areas.

4. Analytical Model

This section contains an analytical model used to calculate different constraints for the emulation. It describes ways to calculate the coverage of inner, middle and outer areas under the assumption of implementing case 4 as the most general case. The equations presented here also hold true for the other three cases described in the previous section, although in these cases they may take a more simple form. Since the UAV’s location is relatively high, we implemented an FSPL model to calculate the distance. Additionally, in this section, we do not account for the Doppler effect, since its impact on the distance calculations is neglectfully small. The proposed analytical model is illustrated by Figure 3, and all the notations are described in the current section.
BS sends signal with power P t x B S to UAV using carrier frequency f 1 with bandwidth Δ ν . The UAV forwards this signal towards UE with power P t x U A V using carrier frequency f 2 with the same bandwidth. At moment t, the UE is located at coordinates ( x U E , y U E , 0 ) ( t ) , the UAV is located at coordinates ( x U A V , y U A V , h ) ( t ) and does not change its altitude, and the BS is always located at coordinates ( 0 , 0 , h B S ) , where h B S is the height of BS. Let us introduce notations S N R r x U A V ( t ) and S N R r x U E ( t ) for the SNR at the UAV and UE at moment t correspondingly. The UAV changes its position as soon as S N R r x U E ( t ) S N R U E * , where S N R U E * is a threshold value of the SNR received by UE from the UAV. This means that as soon as it is unable to maintain a high enough quality, the UAV would start moving to the point closest to the UE position at time t. The UAV moves in such a way that its antenna is always directed towards the BS. At the same time, the BS antenna starts following the UAV position in case S N R r x U A V ( t ) S N R U A V * , where S N R U A V * is a threshold value of the SNR received by the UAV from the BS.
Since we consider the FSPL propagation model, UAV coverage can be represented as
R U A V = c 4 π f 2 2 10 P t x B S S N R U E * N 10 + h 2 ,
where N is the noise floor.
The BS antenna has a directive diagram f ( α ) and thus the SNR value on the UAV can be calculated as
S N R r x U A V ( t ) = P t x B S f ( α ) N 4 π d B S , U A V ( t ) c 2 ,
where α is the angle between the antenna direction and the vector between the BS and UAS, and d B S , U A V ( t ) = ( x U A V 2 + y U A V 2 + ( h B S h ) 2 is the distance between the BS and UAV.
By introducing the threshold value S N R U E * , we can calculate the coverage of the middle and outer sections as solutions for the following equations
R 2 = c 4 π f 1 2 10 P t x B S S N R U E * N 10 + ( h h B S ) 2 ,
R 3 = R 2 + R U A V .
Additionally, using threshold S N R U A V * , we can calculate the area where the BS antenna should start its rotation towards the drone position as a function of the UAV position
G ( x U A V , y U A V ) : P t x B S f a r c t g y U A V x U A V ϕ 4 π f 1 c 2 ( x U A V 2 + y U A V 2 ) = S N R U A V * + N 4 π f 1 c 2 ( h h B S ) 2 ,
where ϕ is the current antenna angle. Coverage of the inner area can be calculated as
R 0 = v U A V / ω
where v U A V is the velocity of the UAV and ω is the angular speed of the BS antenna.
By using data from this model and results of we can calculate the QoE as
Q o E = 3.010 e 4.473 p l o s s + 1.065 ,
where p l o s s is packet loss—a percentage of packets lost during data transmission session between BS and UE on downlink channel in data plane. It is acquired through emulation, described in the next section.

5. Proposed Testbed Architecture

The main factors influencing the signal propagation channel characteristics for dynamic objects are (i) the Doppler effect, which occurs due to the non-stationarity of objects relative to one another, (ii) possible signal blockers, and (iii) changes in the state of the propagation environment. The use of the UAV as a relay base station introduces significant Doppler shift variations, which leads to an increase in the symbol delivery time and a change in the channel frequency. Scenarios with UAVs show significant Doppler variations with delay. Furthermore, the channel expansion varies in time and frequency. This is due to several factors, but the main Doppler shifts are caused by interacting transmitters and receivers in the multipath channel. Other factors determine local delays and Doppler spectral characteristics of channels, such as antenna radiation patterns and angular statistics of individual multipath propagation components (MPCs).
Most channel characteristics, such as the gain and phase shifts of individual multipath components, can be modeled by complex-static processes. However, the estimation of more MPC parameters is required for a more accurate channel model calculation.
The impulse response of the channel of moving objects, h ( t , τ ) , is a continuous variable that depends on the signal transmission time, τ , and the signal processing time, t, and can be expressed as the sum of MPC:
h ( t , τ ) = p = 1 p h p ( t ) δ ( τ τ p ( t ) ) ,
where P represents the specific MPC beam determined by the received signal strength, whereas the component h p ( t ) is defined [25] as follows:
h p ( t ) = η p η p ^ ( t ) e j ( 2 π v p ( t ) + ϕ ( t ) ) ,
where η p is the attenuation constant of the ray p and v p is the Doppler shift’s value on this ray.
For the time-discrete output signal r ( m ) calculation, it is necessary to convolve the impulse response at each time with a given sampling period T, i.e.,
r ( t ) = h ( t , t τ ) s ( τ ) d ( τ ) = p = 1 p h p ( t ) s ( t τ p ) ,
where r ( t ) values are calculated for t = m T values, m = 1 , 2 , .
In this paper, we analyze the impact of the proposed approach, which utilizes UAVs to expand the terrestrial network coverage while maintaining the QoE service level. To this end, we implemented an emulator of a test network based on SDR devices, which reproduces all interacting elements’ channel characteristics for the scenarios described in the system model.
The USRP 2954R radio network prototyping tool from National Instruments [26] was used for SDR devices to build the emulator. This tool has a built-in FPGA and two radio frequency channels that allow simulating networks in the range up to 6 GHz with a bandwidth of up to 160 MHz.
Since the emulator operates in real time, an FPGA module is used to perform convolution for the output signal from Equation (10), which simulates any linear time-varying channel response using simple operations, e.g., multiplication and addition. The signal pre-conversion structure specified for the FPGA is shown in Figure 4. Specifically, it is a chain of two main signal processing units between the transmitter and the receiver. These units allow modification of the characteristics of each beam at the same time following the discrete form.
The transmitter sends the generated signal s [ m ] represented as the in-phase and quadrature (I&Q) components of each beam (MPC). Then, the signal is divided into separate beams and enters block 1 at the separate gates for each beam and is scaled in amplitude η ^ according to the left factor in Equation (11). In block 2 in Figure 4, the right factor e j ( 2 π v p ( t ) + ϕ ( t ) ) is already added, which is responsible for phase shifts in the environment. Finally, in the last block, all beams with new characteristics are combined into an output signal r [ m ] , which the receiver obtains in the form of I&Q.
r [ m ] = p = 1 p η p e j ( 2 π v p t + ϕ p ( t ) ^ ) .
In our implementation, the system operates at a bandwidth of 40 MHz, which corresponds to 200 mbps (QAM256) with a sampling time of 25 ns.
The test setup consists of three USRP instruments in conjunction with a PC: two instruments emulate transceiver devices, and one mimics the conditions of the radio signal propagation environment. PCs obtained with a PCIe to USRP interface card are responsible for loading the compiled FPGA configuration bit files and changing SDR devices’ parameters dynamically. A scheme of the organization of element interaction is illustrated in Figure 5 and Figure 6.
The devices were connected to each other via a coaxial cable. USPR #1 was connected via the RF1 interface to RF1 USPR #2, whereas USPR #2 and #3 were connected via RF2 to RF1, respectively. When emulating data transmission, an I&Q MPC radio signal is generated at node 1 (USRP + PC) and transmitted to node 2, where the signal changes via the USRP FPGA following the specified environment parameters. The converted signal is delivered to the RF node 3 and analyzed on the PC. The reverse transmission occurs similarly. Due to the design features of the USRP, while connecting the RX and TX of two USRPs with a coaxial cable, we used signal attenuators at −30 dBi for each channel.
Each simulation object (UAV, BS, UE, signal propagation channel) is represented as an individual SDR. In view of this fact, emulation was carried out in two stages:
  • BS-UAV signal propagation channel emulation—Figure 5;
  • UAV-UE signal propagation channel emulation—Figure 6.
In order to transmit a signal from the BS to UE, the signal is transmitted to the UAV via a signal propagation channel as I&Q and the data matrix are stored at the st3 node. Then, the matrix is used in the second emulation stage, while retaining all of its properties. This method lets us minimize the number of SDRs in the testbed.

6. Performance Evaluation

In this section, we present the results of emulation. We consider a single user scenario, where the user moves through the network. The architecture of the network is presented in Section 3. The entire network is divided into two large areas—BS area and UAV area. The BS area is limited by a circle of radius R 1 centered at the BS, i.e., cell coverage radius. Within this area, the user is serviced by the terrestrial BS since the channel quality is sufficient to meet the QoS/QoE requirements. When the user leaves the BS area, he enters the UAV area and is transferred to the UAV. Directional antennas with rotary mechanisms are used to establish the connection between the UAV and the terrestrial BS. This makes it possible to ensure the exact direction of the signal between the transceivers regardless of the UAV location. The radius of the area in which we observe the user’s movement is limited to 2 km and corresponds to the area R 2 . In view of the fact that we consider a single user scenario, the optimal location of the UAV relative to the user is strictly above him. In this case, when the user moves along the network border, it should lead to losses and, accordingly, a decrease in bandwidth and QoS/QoE, which is evaluated after the emulation is carried out. In cases when the signal is too strong, it is limited to the value of −55 dB. Table 2 presents the initial data used in the trial. The BS coverage area radius is given since usually coverage areas are known due to the cells at the deployment stage.
Since the emulator uses RSSI as the threshold, the corresponding SNR values for the analytical model are presented in the table, while RSSI values themselves are calculated.
Table 3 presents main calculated characteristics of the system, such as radius of different areas and SNR threshold values used for emulation.
During the trial, a single user was moving through the areas along a given trajectory. When the user moves through the inner and BS coverage areas, they are directly connected to the BS; however, when they leave the BS coverage area and enter the middle area, the UE switches to the UAV located at the point where the UE trajectory leaves the BS coverage area. Figure 7 depicts the UE movement trajectory in the trial. The figure shows the BS coverage area, user trajectory and measurement points. The BS coverage area is illustrated by a green circle; the yellow area depicts the middle area. The spiral trajectory was chosen to emulate the worst case for the BS directional antenna, when it should constantly move towards the UAV that follows the user.
Figure 8 and Figure 9 show the emulation results of packet loss and throughput for different UE velocities. It can be noted that the packet loss plots slightly rise up for points 1 to 9, similarly, and throughput plots fall for these values. This is because the first nine points are located inside the inner and BS coverage areas of the cell, where UE is directly connected to the BS. Thus, a slight increase in packet loss and fall in throughput can be explained by the fact that UE distances itself from the center of the cell, moving towards its edge. A more sharp packet loss incline and throughput decline for case of UE velocity of 100 kmph is due to the fact that the BS connects to the UE via a multisector antenna and switching between sectors happens quite often for the fast moving UE with a given trajectory. Thus, more time is spent switching between sectors.It can be seen that, after leaving the green area, packet loss first falls to a lower value and then rises with distance. The initial fall is due to the fact that after the UE enters the middle area, it connects to the BS via the UAV, and since the UAV uses the directional antenna to connect to the BS, the signal actually becomes more stable and then falls as the distance grows. The same explanation holds true for throughput.
Figure 10 presents QoE results according to the methodology of [24]. Plot behaviour is similar to that of packet loss and throughput and can be explained in a similar manner. One can see that for the considered scenario the best possible QoE value is 4.1 and it is reached inside the BS coverage area near the center of the cell. One can also note that using a UAV as a repeater to enhance the coverage keeps the QoE above 3. This means that in the considered scenario, while enhancing cell coverage from 650 m to 2 km, the overall loss in the QoE resulted in only one point at the edge of the new coverage. Even if we add an additional condition that the quality should not fall below four points, the cell coverage can still be doubled, since even for the UE moving with the same speed as the UAV, the flight speed plot falls below four points only after measurement point 30. If we consider three points as an adequate QoE, the coverage can be increased even further.

7. Conclusions

In order to study the performance of the UAV-assisted 5G network architecture considered in this work, a flexible functional complex testbed emulating traffic flows in such networks was developed. The deployed core network allowed us to artificially introduce delay distortions depending on the expected geographic location of the network nodes. It uses NFV in conjunction with SDR and allows virtualization of all network core functions, making it possible to quickly and flexibly change its configuration. The analytical model of the considered scenario was proposed to acquire the constraints used in the conducted emulation.
The acquired results show that using UAVs as repeaters can potentially double cell coverage area while retaining QoE level. Moreover, the coverage can be even further increased while maintaining a satisfactory QoE level with a drop of a single level.
This work scenario can be further developed by adding stationary and/or mobile blockers to a model urban environment. Another improvement would be considering multiple user scenarios while grouping users in small clusters, achieved via a single UAV. In order to prevent users from leaving their clusters, a rewards offering method can be implemented.

Author Contributions

Formal analysis and writing—original draft, E.M.; methodology, investigation and software, A.K. (Abdukodir Khakimov) and D.P.; project administration and conceptualization, K.S.; supervision and writing—review and editing, A.K. (Andrey Koucheryavy). All authors have read and agreed to the published version of the manuscript.

Funding

This paper has been supported by the RUDN University Strategic Academic Leadership Program (recipient Abdukodir Khakimov). The reported study was funded by RFBR, project number 20-37-90131 (recipient Dmitry Poluektov).

Acknowledgments

For the research, infrastructure of the 5G Lab RUDN (Russia) was used.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Dang, S.; Amin, O.; Shihada, B.; Alouini, M.S. What should 6G be? Nat. Electron. 2020, 3, 20–29. [Google Scholar] [CrossRef] [Green Version]
  2. Yaacoub, E.; Alouini, M.S. A Key 6G Challenge and Opportunity—Connecting the Base of the Pyramid: A Survey on Rural Connectivity. Proc. IEEE 2020, 108, 533–582. [Google Scholar] [CrossRef] [Green Version]
  3. Alsharif, M.H.; Nordin, R. Evolution towards Fifth Generation (5G) Wireless Networks: Current Trends and Challenges in the Deployment of Millimetre Wave, Massive MIMO, and Small Cells. Telecommun. Syst. 2017, 64, 617–637. [Google Scholar] [CrossRef]
  4. Yastrebova, A.; Kirichek, R.; Koucheryavy, Y.; Borodin, A.; Koucheryavy, A. Future Networks 2030: Architecture Requirements. In Proceedings of the 2018 10th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), Moscow, Russia, 5–9 November 2018; pp. 1–8. [Google Scholar] [CrossRef]
  5. TR 38.811, Study on New Radio (NR) to Support Non-Terrestrial Networks. Technical Report Release 15.4.0. 2020. Available online: https://www.3gpp.org/ftp//Specs/archive/38_series/38.811/38811-f40.zip (accessed on 20 August 2021).
  6. Giordani, M.; Zorzi, M. Non-Terrestrial Networks in the 6G Era: Challenges and Opportunities. IEEE Netw. 2021, 35, 244–251. [Google Scholar] [CrossRef]
  7. Gupta, L.; Jain, R.; Vaszkun, G. Survey of Important Issues in UAV Communication Networks. IEEE Commun. Surv. Tutor. 2016, 18, 1123–1152. [Google Scholar] [CrossRef] [Green Version]
  8. Hayat, S.; Yanmaz, E.; Muzaffar, R. Survey on Unmanned Aerial Vehicle Networks for Civil Applications: A Communications Viewpoint. IEEE Commun. Surv. Tutor. 2016, 18, 2624–2661. [Google Scholar] [CrossRef]
  9. Zeng, Y.; Zhang, R.; Lim, T.J. Wireless communications with unmanned aerial vehicles: Opportunities and challenges. IEEE Commun. Mag. 2016, 54, 36–42. [Google Scholar] [CrossRef] [Green Version]
  10. Chen, J.; Gesbert, D. Optimal positioning of flying relays for wireless networks: A LOS map approach. In Proceedings of the 2017 IEEE International Conference on Communications (ICC), Paris, France, 21–25 May 2017; pp. 1–6. [Google Scholar] [CrossRef]
  11. Bor-Yaliniz, I.; Salem, M.; Senerath, G.; Yanikomeroglu, H. Is 5G Ready for Drones: A Look into Contemporary and Prospective Wireless Networks from a Standardization Perspective. IEEE Wirel. Commun. 2019, 26, 18–27. [Google Scholar] [CrossRef]
  12. Al-Hourani, A.; Kandeepan, S.; Lardner, S. Optimal LAP Altitude for Maximum Coverage. IEEE Wirel. Commun. Lett. 2014, 3, 569–572. [Google Scholar] [CrossRef] [Green Version]
  13. Ashraf Ateya, A.A.; Muthanna, A.; Kirichek, R.; Hammoudeh, M.; Koucheryavy, A. Energy- and Latency-Aware Hybrid Offloading Algorithm for UAVs. IEEE Access 2019, 7, 37587–37600. [Google Scholar] [CrossRef]
  14. Zhao, L.; Yang, K.; Tan, Z.; Li, X.; Sharma, S.; Liu, Z. A Novel Cost Optimization Strategy for SDN-Enabled UAV-Assisted Vehicular Computation Offloading. IEEE Trans. Intell. Transp. Syst. 2021, 22, 3664–3674. [Google Scholar] [CrossRef]
  15. Kumar, K.; Kumar, S.; Kaiwartya, O.; Sikandar, A.; Kharel, R.; Mauri, J.L. Internet of Unmanned Aerial Vehicles: QoS Provisioning in Aerial Ad-Hoc Networks. Sensors 2020, 20, 3160. [Google Scholar] [CrossRef]
  16. Saraereh, O.A.; Alsaraira, A.; Khan, I.; Uthansakul, P. Performance Evaluation of UAV-Enabled LoRa Networks for Disaster Management Applications. Sensors 2020, 20, 2396. [Google Scholar] [CrossRef] [PubMed]
  17. Guillen-Perez, A.; Cano, M.D. Flying Ad Hoc Networks: A New Domain for Network Communications. Sensors 2018, 18, 3571. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Bor-Yaliniz, I.; El-Keyi, A.; Yanikomeroglu, H. Spatial Configuration of Agile Wireless Networks With Drone-BSs and User-in-the-loop. IEEE Trans. Wirel. Commun. 2019, 18, 753–768. [Google Scholar] [CrossRef] [Green Version]
  19. Chen, M.; Mozaffari, M.; Saad, W.; Yin, C.; Debbah, M.; Hong, C.S. Caching in the Sky: Proactive Deployment of Cache-Enabled Unmanned Aerial Vehicles for Optimized Quality-of-Experience. IEEE J. Sel. Areas Commun. 2017, 35, 1046–1061. [Google Scholar] [CrossRef]
  20. Garcia Sanchez, S.; Mohanti, S.; Jaisinghani, D.; Chowdhury, K.R. Millimeter-wave Base Stations in the Sky: An Experimental Study of UAV-to-Ground Communications. IEEE Trans. Mob. Comput. 2020. [Google Scholar] [CrossRef]
  21. Sklivanitis, G.; Gannon, A.; Tountas, K.; Pados, D.A.; Batalama, S.N.; Reichhart, S.; Medley, M.; Thawdar, N.; Lee, U.; Matyjas, J.D.; et al. Airborne Cognitive Networking: Design, Development, and Deployment. IEEE Access 2018, 6, 47217–47239. [Google Scholar] [CrossRef]
  22. Panicker, A.; Ozdemir, O.; Sichitiu, M.L.; Guvenc, I.; Dutta, R.; Marojevic, V.; Floyd, B. AERPAW emulation overview and preliminary performance evaluation. Comput. Netw. 2021, 194, 108083. [Google Scholar] [CrossRef]
  23. Khakimov, A.; Poluektov, D.; Mokrov, E.; Koucheryavy, Y.; Samouylov, K. Prototyping 5G Network in Laboratory Testbed with Virtual Deployment Environment. In Proceedings of the 2020 International Scientific and Technical Conference Modern Computer Network Technologies (MoNeTeC), Moscow, Russia, 27–29 October 2020; pp. 1–7. [Google Scholar] [CrossRef]
  24. Fiedler, M.; Hossfeld, T.; Tran-Gia, P. A generic quantitative relationship between quality of experience and quality of service. IEEE Netw. 2010, 24, 36–41. [Google Scholar] [CrossRef] [Green Version]
  25. Ghiaasi, G.; Blazek, T.; Ashury, M.; Santos, R.; Mecklenbräuker, C. Real-Time Emulation of Nonstationary Channels in Safety-Relevant Vehicular Scenarios. Wirel. Commun. Mob. Comput. 2018, 2018, 1–11. [Google Scholar] [CrossRef]
  26. USRP-2954 Specifications. 10 MHz to 6 GHz Tunable RF Transceiver. Available online: https://www.ni.com/pdf/manuals/375725c.pdf (accessed on 20 August 2021).
Figure 1. Base station and its coverage areas, divided into four areas, R 0 , R 1 , R 2 and R 3 , corresponding to the inner, BS coverage, middle and outer areas. The inner area is restricted to UAVs since the BS antenna would not be able to catch up to them and depends on the maximum allowed UAV speed. The BS coverage area corresponds to the area where users are directly connected to the BS. The middle area is the area where UAVs can have a stable link to the BS and together with the inner area and BS coverage area completes the overall coverage of the BS directional antenna. The outer area corresponds to the BS coverage extension provided by utilizing UAVs as forwarders.
Figure 1. Base station and its coverage areas, divided into four areas, R 0 , R 1 , R 2 and R 3 , corresponding to the inner, BS coverage, middle and outer areas. The inner area is restricted to UAVs since the BS antenna would not be able to catch up to them and depends on the maximum allowed UAV speed. The BS coverage area corresponds to the area where users are directly connected to the BS. The middle area is the area where UAVs can have a stable link to the BS and together with the inner area and BS coverage area completes the overall coverage of the BS directional antenna. The outer area corresponds to the BS coverage extension provided by utilizing UAVs as forwarders.
Sensors 21 05689 g001
Figure 2. UAV utilization scenarios: (a) Static case, when both UAV and UE are not moving. This case is considered to prepare and test the emulator. (b) Semi-static case, when UE changes its position inside static UAV coverage. Used to test the UAV-UE link. (c) Semi-dynamic case, when UAV changes its position inside the BS directional antenna coverage and UE changes its position inside the provided UAV coverage. Used to test the BS-UAV link. (d) Dynamic case, when UE freely changes its position inside coverage R2 and R3 and UAV changes its position inside R2 in order to keep the link to the UE. BS directional antenna follows UAV so that the BS-UAV-UE link remains stable. This is the target test scenario.
Figure 2. UAV utilization scenarios: (a) Static case, when both UAV and UE are not moving. This case is considered to prepare and test the emulator. (b) Semi-static case, when UE changes its position inside static UAV coverage. Used to test the UAV-UE link. (c) Semi-dynamic case, when UAV changes its position inside the BS directional antenna coverage and UE changes its position inside the provided UAV coverage. Used to test the BS-UAV link. (d) Dynamic case, when UE freely changes its position inside coverage R2 and R3 and UAV changes its position inside R2 in order to keep the link to the UE. BS directional antenna follows UAV so that the BS-UAV-UE link remains stable. This is the target test scenario.
Sensors 21 05689 g002
Figure 3. Analytical model of the considered scenario. UE moves with velocity v U E , UAV moves with velocity v U A V , BS directional antenna rotation speed is ω and the antenna angle is α . BS antenna is situated at altitude h B S , UAV operates at altitude h, and UE is located on the ground at altitude 0. UE and UAV planar coordinates here are defined as ( x U E , y U E ) and ( x U A V , y U A V ) correspondingly. BS transmission power is P t x B S and UAV transmission power towards UE is p t x D .
Figure 3. Analytical model of the considered scenario. UE moves with velocity v U E , UAV moves with velocity v U A V , BS directional antenna rotation speed is ω and the antenna angle is α . BS antenna is situated at altitude h B S , UAV operates at altitude h, and UE is located on the ground at altitude 0. UE and UAV planar coordinates here are defined as ( x U E , y U E ) and ( x U A V , y U A V ) correspondingly. BS transmission power is P t x B S and UAV transmission power towards UE is p t x D .
Sensors 21 05689 g003
Figure 4. Channel emulation model. Modifying the I&Q signal by shifting the phase and amplitude of each MPC.
Figure 4. Channel emulation model. Modifying the I&Q signal by shifting the phase and amplitude of each MPC.
Sensors 21 05689 g004
Figure 5. Testbed picture base station-UAV connection. (OFDMA 3300 MHz, QAM 256, bandwidth 40 MHz.)
Figure 5. Testbed picture base station-UAV connection. (OFDMA 3300 MHz, QAM 256, bandwidth 40 MHz.)
Sensors 21 05689 g005
Figure 6. Testbed picture UAV-UE connection. (OFDMA 3500 MHz, QAM 256, bandwidth 40 MHz.)
Figure 6. Testbed picture UAV-UE connection. (OFDMA 3500 MHz, QAM 256, bandwidth 40 MHz.)
Sensors 21 05689 g006
Figure 7. Testbed connection diagram depicts the movement trajectory of the UE with the blue line. The green circular area corresponds to the boundary between the BS coverage area, where the UE can be served by the BS directly and the middle area, where the UE should be served via the UAV. The red dots depict the measurement points at which system characteristics, such as packet loss and throughput on the UE side, were measured.
Figure 7. Testbed connection diagram depicts the movement trajectory of the UE with the blue line. The green circular area corresponds to the boundary between the BS coverage area, where the UE can be served by the BS directly and the middle area, where the UE should be served via the UAV. The red dots depict the measurement points at which system characteristics, such as packet loss and throughput on the UE side, were measured.
Sensors 21 05689 g007
Figure 8. Packet loss for different UE velocities. This figure shows packet loss plotted against measurement points from Figure 7. The blue line corresponds to the pedestrian UE walking along the trajectory, the red line corresponds to the UE riding a scooter, the gray line corresponds to the UE riding a car with velocity comparable to that of the UAV.
Figure 8. Packet loss for different UE velocities. This figure shows packet loss plotted against measurement points from Figure 7. The blue line corresponds to the pedestrian UE walking along the trajectory, the red line corresponds to the UE riding a scooter, the gray line corresponds to the UE riding a car with velocity comparable to that of the UAV.
Sensors 21 05689 g008
Figure 9. Throughput for different UE velocities. This figure shows the throughput plotted against measurement points from Figure 7. The blue line corresponds to the pedestrian UE walking along the trajectory, the red line corresponds to the UE riding a scooter, and the gray line corresponds to the UE riding a car with a velocity comparable to that of the UAV.
Figure 9. Throughput for different UE velocities. This figure shows the throughput plotted against measurement points from Figure 7. The blue line corresponds to the pedestrian UE walking along the trajectory, the red line corresponds to the UE riding a scooter, and the gray line corresponds to the UE riding a car with a velocity comparable to that of the UAV.
Sensors 21 05689 g009
Figure 10. Calculation of QoE by (7) for different UE velocities.
Figure 10. Calculation of QoE by (7) for different UE velocities.
Sensors 21 05689 g010
Table 1. Selected works in comparison.
Table 1. Selected works in comparison.
Related WorksUAVWireless Network TypeMetricsMethodologyDetails
[10]UnspecifiedThroughputanalyticalUAV positioning optimization
[12]CellularCell radiusanalyticalAltitude optimization
[13]CellularLatencysimulationOffloading Algorithm
[14]UnspecifiedThroughputsimulationOffloading execution time optimization
[15]Ad-hocLatencysimulationQoS provisioning
[16]LoRaLatencysimulationNetwork coverage extension
[17]Ad-hoc, WiFiRadiation patternexperimentalThe best position of the antennas
[18]CellularThe number of served usersanalyticalSpatial network configuration scheme
[19]CellularTransmit powersimulationQoE optimization
[20]mmWaveBit rateexperimentalFading estimation
[21]UnspecifiedThroughputexperimentalCode-waveform optimization
[22]UnspecifiedChannel characteristicsemulationEmulation platform overview
[23]CellularChannel characteristicsemulationEmulation platform overview
This workCellularThroughputemulation, analyticalEmulation platform, QoE optimization
Table 2. Initial data.
Table 2. Initial data.
NotationValueDescription
Δ ν 40 MHzbandwidth
f 1 3300 MHzBS-UAV frequency
c3 × 10 8 m/slight speed
QAM 256modulation
P B S 21 dBmtransmission power of BS
P U A V 21 dbmtransmission power of UAV towards BS
ϕ B S 15BS-UAV antenna angle
ϕ U A V , B S 15UAV-BS antenna angle
ϕ U A V , U E 90UAV-UE antenna angle
f ( x ) c o s ( x ) Antenna direction diagram
ω 1 rad/sBS an a rotation speed
N−100 dBnoise floor
h B S 20 mheight of BS
h55 mUAV flight altitude
S N R U E * 40 dbmthreshold SNR between UAV and UE
S N R U A V * 12 dbmthreshold SNR between BS and UAV
f 2 3500 MhzUAV-UE frequency
v U A V 100 km/hUAV flight speed
v 1 4 km/hpedestrian UE velocity
v 2 50 km/hbus UE velocity
v 3 100 km/hcar UE velocity
R 1 650 mBS coverage radius
Table 3. Calculated data.
Table 3. Calculated data.
NotationValueDescription
R 0 27 minner area radius
R 2 2038 mmiddle area radius
R U A V 54 mUAV coverage area
R S S I U E * −60 dbmthreshold RSSI between UAV and UE
R S S I U A V * −88 dbmthreshold RSSI between BS and UAV
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Khakimov, A.; Mokrov, E.; Poluektov, D.; Samouylov, K.; Koucheryavy, A. Evaluating the Quality of Experience Performance Metric for UAV-Based Networks. Sensors 2021, 21, 5689. https://doi.org/10.3390/s21175689

AMA Style

Khakimov A, Mokrov E, Poluektov D, Samouylov K, Koucheryavy A. Evaluating the Quality of Experience Performance Metric for UAV-Based Networks. Sensors. 2021; 21(17):5689. https://doi.org/10.3390/s21175689

Chicago/Turabian Style

Khakimov, Abdukodir, Evgeny Mokrov, Dmitry Poluektov, Konstantin Samouylov, and Andrey Koucheryavy. 2021. "Evaluating the Quality of Experience Performance Metric for UAV-Based Networks" Sensors 21, no. 17: 5689. https://doi.org/10.3390/s21175689

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop