• DocumentCode
    3345107
  • Title

    Survey on improved Autoscaling in Hadoop into cloud environments

  • Author

    Jam, Masoumeh Rezaei ; Khanli, Leili Mohammad ; Akbari, Mohammad Kazem ; Hormozi, Elham ; Javan, Morteza Sargolzaei

  • Author_Institution
    Dept. of Comput. Eng., Univ. of Tabriz, Tabriz, Iran
  • fYear
    2013
  • fDate
    28-30 May 2013
  • Firstpage
    19
  • Lastpage
    23
  • Abstract
    Nowadays technologies for analyzing big data are evolving rapidly. Because of that models and methods to design and analyze parallel processing of data is done automatically. So MapReduce is one of these methods in order to overcome the complexity of very large data. MapReduce-based systems are suited for performing analysis at this scale since they were designed from the beginning to scale to thousands of nodes in a shared-nothing architecture. This model has been developed under a cloud computing platform. There are many implementations of MapReduce. One of them is the Apache Hadoop project that is an Apache\´s Open Source implementation of Google\´s MapReduce parallel processing framework. Running Hadoop on a cloud means that we have the facilities to add or remove computing power from the Hadoop cluster within minutes or even less by provisioning more machines or shutting down currently running ones. In this survey, we investigate some methods to improve scalability of Hadoop platform and Autoscaling of that. Based on the evaluation methods we understand that "The controller module and BEEMR" are best way to improve energy performance.
  • Keywords
    cloud computing; data analysis; parallel programming; public domain software; software performance evaluation; Apache Hadoop project; Hadoop cluster; Hadoop platform scalability; MapReduce parallel processing framework; MapReduce-based systems; autoscaling; cloud computing platform; cloud environments; energy performance; evaluation methods; open source software; shared-nothing architecture; Cloud computing; Computers; Data processing; Educational institutions; Energy efficiency; Green products; Servers; auto scaling; cloud computing; dynamic resource allocation; energy efficiency; hadoop; mapreduce;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information and Knowledge Technology (IKT), 2013 5th Conference on
  • Conference_Location
    Shiraz
  • Print_ISBN
    978-1-4673-6489-8
  • Type

    conf

  • DOI
    10.1109/IKT.2013.6620031
  • Filename
    6620031