• DocumentCode
    672094
  • Title

    A simple cluster-scaling policy for MapReduce clouds

  • Author

    Sheng-Wei Huang ; Ce-Kuen Shieh ; Syue-Ru Lyu ; Tzu-Chi Huang ; Chien-Sheng Chen ; Ping-Fan Ho ; Ming-Fong Tsai

  • Author_Institution
    Dept. of Electr. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan
  • fYear
    2013
  • fDate
    20-22 Nov. 2013
  • Firstpage
    1
  • Lastpage
    6
  • Abstract
    Due to the rise of cloud computing, many cloud services have been developed. Google proposed a programming model called MapReduce for processing large amounts of data. After YAHOO! proposed Hadoop, many companies and enterprises have started using this programming model to establish their own cluster for handling large amounts of data. Computing resources within a cluster are often not all be used. Therefore, many researches about cluster-scaling are presented. These studies were proposed to reduce the size of the cluster to achieve power saving or to add more computing nodes in order to obtain better performance. However, there is always a trade-off between performance and power saving. Therefore, taking both performance and energy saving into account, we propose a simple policy which can effectively identify how many computing nodes can be inactivated from a cluster without affecting the execution time. We evaluate our policy in many cases to prove that it is well-performed in different configurations and achieves performance and power saving both.
  • Keywords
    cloud computing; pattern clustering; power aware computing; public domain software; Google; Hadoop; MapReduce cloud services; YAHOO!; cloud computing; cluster-scaling policy; large data processing; power saving; programming model; Cloud computing; Equations; Heuristic algorithms; Mathematical model; Power demand; Programming; Time factors; Cloud Computing; Cluster scaling; MapReduce; Power saving;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Wireless and Pervasive Computing (ISWPC), 2013 International Symposium on
  • Conference_Location
    Taipei
  • Type

    conf

  • DOI
    10.1109/ISWPC.2013.6707441
  • Filename
    6707441