Next Article in Journal
Development of a Capacitive Ice Sensor to Measure Ice Growth in Real Time
Previous Article in Journal
Water Area Extraction Using RADARSAT SAR Imagery Combined with Landsat Imagery and Terrain Information
Article Menu

Export Article

Open AccessArticle
Sensors 2015, 15(3), 6668-6687;

Beamforming and Power Control in Sensor Arrays Using Reinforcement Learning

UFERSA—Federal Rural University of the Semi-Árido, Pau dos Ferros 59900-000, Brazil
DCA-CT-UFRN, Federal University of Rio Grande do Norte, Natal 59072-970, Brazil
These authors contributed equally to this work.
Author to whom correspondence should be addressed.
Academic Editor: Vittorio M.N. Passaro
Received: 31 October 2014 / Revised: 14 February 2015 / Accepted: 4 March 2015 / Published: 19 March 2015
(This article belongs to the Section Physical Sensors)
Full-Text   |   PDF [1504 KB, uploaded 19 March 2015]   |  


The use of beamforming and power control, combined or separately, has advantages and disadvantages, depending on the application. The combined use of beamforming and power control has been shown to be highly effective in applications involving the suppression of interference signals from different sources. However, it is necessary to identify efficient methodologies for the combined operation of these two techniques. The most appropriate technique may be obtained by means of the implementation of an intelligent agent capable of making the best selection between beamforming and power control. The present paper proposes an algorithm using reinforcement learning (RL) to determine the optimal combination of beamforming and power control in sensor arrays. The RL algorithm used was Q-learning, employing an ε-greedy policy, and training was performed using the offline method. The simulations showed that RL was effective for implementation of a switching policy involving the different techniques, taking advantage of the positive characteristics of each technique in terms of signal reception. View Full-Text
Keywords: beamforming; power control; sensor arrays; Q-learning beamforming; power control; sensor arrays; Q-learning

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Almeida, N.C.; Fernandes, M.A.; Neto, A.D. Beamforming and Power Control in Sensor Arrays Using Reinforcement Learning. Sensors 2015, 15, 6668-6687.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top