Next Article in Journal
An Energy-Efficient and Fault-Tolerant Topology Control Game Algorithm for Wireless Sensor Network
Previous Article in Journal
Time Domain Performance of Reconfigurable Filter Antenna for IR-UWB, WLAN, and WiMAX Applications
Open AccessArticle

Balancing Distributed Key-Value Stores with Efficient In-Network Redirecting

National Key Laboratory for Parallel and Distributed Processing, National University of Defense Technology, Changsha 410073, China
*
Author to whom correspondence should be addressed.
Electronics 2019, 8(9), 1008; https://doi.org/10.3390/electronics8091008
Received: 25 August 2019 / Revised: 6 September 2019 / Accepted: 6 September 2019 / Published: 9 September 2019
(This article belongs to the Section Networks)
Today’s cloud-based online services are underpinned by distributed key-value stores (KVSs). Keys and values are distributed across back-end servers in such scale-out systems. One primary real-life performance bottleneck occurs when storage servers suffer from load imbalance under skewed workloads. In this paper, we present KVSwitch, a centralized self-managing load balancer that leverages the power and flexibility of emerging programmable switches. The balance is achieved by dynamically predicting the hot items and by creating replication strategies according to KVS loading. To overcome the challenges in realizing KVSwitch given the limitations of the switch hardware, we decompose KVSwitch’s functions and carefully design them for the heterogeneous processors inside the switch. We prototype KVSwitch in a Tofino switch. Experimental results show that our solution can effectively keep the KVS servers balanced even under highly skewed workloads. Furthermore, KVSwitch only replicates 70 % of hot items and consumes 9.88 % of server memory rather than simply replicating all hot items to each server. View Full-Text
Keywords: load balancing; key-value stores; programmable switches; replication load balancing; key-value stores; programmable switches; replication
Show Figures

Figure 1

MDPI and ACS Style

Shi, Y.; Fei, J.; Wen, M.; Zhang, C. Balancing Distributed Key-Value Stores with Efficient In-Network Redirecting. Electronics 2019, 8, 1008.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map

1
Back to TopTop