Articles


Document Type
Journal article (JA)
Title
A benchmark approach and its toolkit for online scheduling of multiple deadline-constrained workflows in big-data processing systems
Author
Zhang, Dongzhan(1); Yan, Wenjing(1); Bugingo, Emmanuel(1); Zheng, Wei(1); Chen, Jinjun(2)
Address
(1) Department of Computer Science, School of Information Science and Engineering, Xiamen University, China; (2) Swinburne Data Science Research Institute, Swinburne University of Technology, Australia
RPAddress
Xiamen Univ, Sch Informat Sci & Engn, Dept Comp Sci, Xiamen, Peoples R China.
Email
ResearchID
ORCID
Journal
Future Generation Computer Systems
Publisher
Elsevier B.V.
ISSN
0167-739X
Published
2018-08, 85:222-234.
JCR
ImpactFactor
ISBN
Fund_Code
National Natural Science Foundation of China (NSFC) [61671397, 61672439]
HYMC
HYDD
HYKSRQ
HYJSRQ
HYLWLB
HYJB
Keywords
Benchmarking - Data handling - Online systems - Scheduling - Simulators
Abstract
As distributed systems such as clouds get increasingly popular in the use for big-data processing, there is a need of shifting research attention from minimizing the workflow completion time to satisfying the deadline constraints specified by the users and boosting the benefit of the resource providers. This paper focuses on the online deadline-constrained workflow scheduling problem of how to schedule a set of sequentially submitted workflows with deadline constraints to maximize the resource utilization as well as the success rate of meeting the deadlines. A discrete-event based simulator with a novel benchmark approach is proposed to ease the analysis of the problem. Extensive evaluation has been done to exhibit the effectiveness and significance of the proposed benchmark approach and the developed simulator. ? 2018 Elsevier B.V.
WOS Categories
Computer Science, Theory & Methods
Accession Number
WOS:000432100600021
UT
20181605022535
DOI
10.1016/j.future.2018.03.046
ESI_Type
COMPUTER
Collection
SCIE, EI

Back to List