Next Article in Journal
A Community Network Ontology for Participatory Collaboration Mapping: Towards Collective Impact
Previous Article in Journal
Effective Intrusion Detection System Using XGBoost
Article Menu

Export Article

Open AccessArticle
Information 2018, 9(7), 150; https://doi.org/10.3390/info9070150

Rack Aware Data Placement for Network Consumption in Erasure-Coded Clustered Storage Systems

School of Management, Xi’an University of Architecture and Technology, Xi’an 710055, China
*
Author to whom correspondence should be addressed.
Received: 30 April 2018 / Revised: 15 June 2018 / Accepted: 16 June 2018 / Published: 21 June 2018
(This article belongs to the Section Information and Communications Technology)
Full-Text   |   PDF [2883 KB, uploaded 21 June 2018]   |  

Abstract

The amount of encoded data replication in an erasure-coded clustered storage system has a great impact on the bandwidth consumption and network latency, mostly during data reconstruction. Aimed at the reasons that lead to the excess data transmission between racks, a rack aware data block placement method is proposed. In order to ensure rack-level fault tolerance and reduce the frequency and amount of the cross-rack data transmission during data reconstruction, the method deploys partial data block concentration to store the data blocks of a file in fewer racks. Theoretical analysis and simulation results show that our proposed strategy greatly reduces the frequency and data volume of the cross-rack transmission during data reconstruction. At the same time, it has better performance than the typical random distribution method in terms of network usage and data reconstruction efficiency. View Full-Text
Keywords: data placement; rack aware; erasure codes; network consumption; clustered storage systems data placement; rack aware; erasure codes; network consumption; clustered storage systems
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Shao, B.; Song, D.; Bian, G.; Zhao, Y. Rack Aware Data Placement for Network Consumption in Erasure-Coded Clustered Storage Systems. Information 2018, 9, 150.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Information EISSN 2078-2489 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top