Next Article in Journal
Cloud- and Fog-Integrated Smart Grid Model for Efficient Resource Utilisation
Next Article in Special Issue
Closing Connectivity Gap: An Overview of Mobile Coverage Solutions for Not-Spots in Rural Zones
Previous Article in Journal
LMI-Based H Controller of Vehicle Roll Stability Control Systems with Input and Output Delays
Previous Article in Special Issue
Optimal UAV Deployment and Resource Management in UAV Relay Networks
Article

Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach

1
Department of Electrical and Electronic Engineering, School of Engineering, Tokyo Institute of Technology, Meguro, Tokyo 152-8550, Japan
2
Electrical Engineering Department, College of Engineering, Prince Sattam Bin Abdulaziz University, Wadi Addwasir 11991, Saudi Arabia
3
Electrical Engineering Department, Faculty of Engineering, Aswan University, Aswan 81542, Egypt
*
Author to whom correspondence should be addressed.
Academic Editor: Margot Deruyck
Sensors 2021, 21(23), 7855; https://doi.org/10.3390/s21237855
Received: 5 November 2021 / Revised: 23 November 2021 / Accepted: 23 November 2021 / Published: 25 November 2021
Modern wireless networks are notorious for being very dense, uncoordinated, and selfish, especially with greedy user needs. This leads to a critical scarcity problem in spectrum resources. The Dynamic Spectrum Access system (DSA) is considered a promising solution for this scarcity problem. With the aid of Unmanned Aerial Vehicles (UAVs), a post-disaster surveillance system is implemented using Cognitive Radio Network (CRN). UAVs are distributed in the disaster area to capture live images of the damaged area and send them to the disaster management center. CRN enables UAVs to utilize a portion of the spectrum of the Electronic Toll Collection (ETC) gates operating in the same area. In this paper, a joint transmission power selection, data-rate maximization, and interference mitigation problem is addressed. Considering all these conflicting parameters, this problem is investigated as a budget-constrained multi-player multi-armed bandit (MAB) problem. The whole process is done in a decentralized manner, where no information is exchanged between UAVs. To achieve this, two power-budget-aware PBA-MAB) algorithms, namely upper confidence bound (PBA-UCB (MAB) algorithm and Thompson sampling (PBA-TS) algorithm, were proposed to realize the selection of the transmission power value efficiently. The proposed PBA-MAB algorithms show outstanding performance over random power value selection in terms of achievable data rate. View Full-Text
Keywords: unmanned aerial vehicles; dynamic spectrum access; quality of service; reinforcement learning; multi-armed bandit unmanned aerial vehicles; dynamic spectrum access; quality of service; reinforcement learning; multi-armed bandit
Show Figures

Figure 1

MDPI and ACS Style

Amrallah, A.; Mohamed, E.M.; Tran, G.K.; Sakaguchi, K. Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach. Sensors 2021, 21, 7855. https://doi.org/10.3390/s21237855

AMA Style

Amrallah A, Mohamed EM, Tran GK, Sakaguchi K. Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach. Sensors. 2021; 21(23):7855. https://doi.org/10.3390/s21237855

Chicago/Turabian Style

Amrallah, Amr, Ehab M. Mohamed, Gia K. Tran, and Kei Sakaguchi. 2021. "Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach" Sensors 21, no. 23: 7855. https://doi.org/10.3390/s21237855

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop