DocumentCode
672094
Title
A simple cluster-scaling policy for MapReduce clouds
Author
Sheng-Wei Huang ; Ce-Kuen Shieh ; Syue-Ru Lyu ; Tzu-Chi Huang ; Chien-Sheng Chen ; Ping-Fan Ho ; Ming-Fong Tsai
Author_Institution
Dept. of Electr. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan
fYear
2013
fDate
20-22 Nov. 2013
Firstpage
1
Lastpage
6
Abstract
Due to the rise of cloud computing, many cloud services have been developed. Google proposed a programming model called MapReduce for processing large amounts of data. After YAHOO! proposed Hadoop, many companies and enterprises have started using this programming model to establish their own cluster for handling large amounts of data. Computing resources within a cluster are often not all be used. Therefore, many researches about cluster-scaling are presented. These studies were proposed to reduce the size of the cluster to achieve power saving or to add more computing nodes in order to obtain better performance. However, there is always a trade-off between performance and power saving. Therefore, taking both performance and energy saving into account, we propose a simple policy which can effectively identify how many computing nodes can be inactivated from a cluster without affecting the execution time. We evaluate our policy in many cases to prove that it is well-performed in different configurations and achieves performance and power saving both.
Keywords
cloud computing; pattern clustering; power aware computing; public domain software; Google; Hadoop; MapReduce cloud services; YAHOO!; cloud computing; cluster-scaling policy; large data processing; power saving; programming model; Cloud computing; Equations; Heuristic algorithms; Mathematical model; Power demand; Programming; Time factors; Cloud Computing; Cluster scaling; MapReduce; Power saving;
fLanguage
English
Publisher
ieee
Conference_Titel
Wireless and Pervasive Computing (ISWPC), 2013 International Symposium on
Conference_Location
Taipei
Type
conf
DOI
10.1109/ISWPC.2013.6707441
Filename
6707441
Link To Document