Title :
Minimizing Data Transmission Latency by Bipartite Graph in MapReduce
Author :
Jie Wei;Shangguang Wang;Lingyan Zhang;Ao Zhou;Qibo Sun;Ruisheng Shi;Fangchun Yang
Author_Institution :
State Key Lab. of Networking &
Abstract :
Many factors affect the time cost of Cloud computing tasks. One of the most serious factors is data transmission latency, which reduces the efficiency of Cloud computing. Existing notable schemes ignore the communication cost among virtual machines (VMs) in the MapReduce environment. In this paper, we propose a VM placement approach to reduce data transmission latency with the communication cost among VMs. We first construct bipartite graph and classify VMs as two groups according to their transmission latency with data nodes. Then we propose two VM placement optimization algorithms to minimize the total data transmission latency (TDTL) and the maximum data transmission latency (MDTL) in the MapReduce environment. Finally, we place VMs for Reduce phase. The evaluation results show that our approach reduces the average data transmission latency by 26.3% compared with other approaches.
Keywords :
"Data communication","Optimization","Bipartite graph","Data models","Conferences","Cloud computing","Virtual machining"
Conference_Titel :
Cluster Computing (CLUSTER), 2015 IEEE International Conference on
DOI :
10.1109/CLUSTER.2015.93