Next Article in Journal
Modeling the Multi-Period and Multi-Classification-Yard Location Problem in a Railway Network
Previous Article in Journal
Towards Generalized Noise-Level Dependent Crystallographic Symmetry Classifications of More or Less Periodic Crystal Patterns
Article Menu
Issue 5 (May) cover image

Export Article

Open AccessArticle
Symmetry 2018, 10(5), 134; https://doi.org/10.3390/sym10050134

Bandwidth-Guaranteed Resource Allocation and Scheduling for Parallel Jobs in Cloud Data Center

1
College of System Engineering, National University of Defense Technology, Changsha 410073, China
2
The 66029th Troop of PLA, Inner Mongolia Autonomous Region 011216, China
3
The Naval 902 Factory, Shanghai 200083, China
*
Author to whom correspondence should be addressed.
Received: 29 March 2018 / Revised: 19 April 2018 / Accepted: 19 April 2018 / Published: 25 April 2018
Full-Text   |   PDF [1703 KB, uploaded 25 April 2018]   |  

Abstract

Cloud Computing has emerged as a powerful and promising way for running high performance computing (HPC) jobs. Most HPC jobs are designed under multi-processes paradigm and involve frequent communication and synchronization among parallel processes. However, as the underlying resources of cloud data centers are always shared among multiple tenants, the competition of jobs for limited bandwidth resources lead to unpredictable completion times for jobs in the cloud, which may lead to QoS violation and inefficient utilization of resources when scheduling parallel jobs in the cloud. To tackle the issue, it is essential to provide bandwidth guarantees for parallel jobs running in the cloud. Offering a dedicated virtual cluster (VC) for running applications in the cloud is a popular way to guarantee bandwidth demands. Motivated by these problems, in this paper, we firstly design a time-aware virtual cluster (TVC) request model for parallel jobs and consider how to embed requested TVCs of jobs into cloud efficiently under parallel job scheduling framework. An adaptive bandwidth-aware heuristic algorithm, which is denoted as AdaBa, is proposed to improve the job accept rate by adjusting the priorities of servers to accommodate the VMs of TVC adaptively according to the relative size of requested bandwidth demand. Then, a bandwidth-guaranteed migration and backfilling scheduling algorithm, which is denoted as BgMBF, is designed to schedule parallel jobs and the bandwidth demands are guaranteed by AdaBa. To obtain high job responsiveness performance, a bandwidth-reserved job backfilling strategy is designed when the requested TVC for current scheduled job cannot be allocated in the cloud. The migration cost of BgMBF is also considered and an enhanced version BgMBFSDF is then proposed to minimize the number of migration when the execution time of jobs are known. Through extensive simulation experiments on popular parallel workloads, our proposed TVC embedding algorithm AdaBa achieves up to 15 percent of improvement on accept rate compared with existing algorithms such as Oktupus and greedy algorithm. Our proposed BgMBF and BgMBFSDF also significantly outperform other popular scheduling algorithms integrated with AdaBa on average response time and average bounded slow down. View Full-Text
Keywords: virtual cluster embedding; parallel job scheduling; cloud data center; bandwidth allocation virtual cluster embedding; parallel job scheduling; cloud data center; bandwidth allocation
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Li, Z.; Chen, B.; Liu, X.; Ning, D.; Wei, Q.; Wang, Y.; Qiu, X. Bandwidth-Guaranteed Resource Allocation and Scheduling for Parallel Jobs in Cloud Data Center. Symmetry 2018, 10, 134.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Symmetry EISSN 2073-8994 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top