• DocumentCode
    258289
  • Title

    Automating the Hadoop configuration for easy setup in resilient cloud systems

  • Author

    Celesti, Antonio ; Fazio, Maria ; Puliafito, Antonio ; Villari, Massimo

  • Author_Institution
    DICIEAMA, Univ. of Messina, Messina, Italy
  • fYear
    2014
  • fDate
    23-26 June 2014
  • Firstpage
    1
  • Lastpage
    4
  • Abstract
    Hadoop is widely used in many application scenarios, where a massive computation is required. The Hadoop framework is an open-source distributed computing system adopting the Map-Reduce paradigm for data processing, which is gaining more and more popularity. Indeed, recently, many Big Data solutions benefited from the Hadoop framework. One of the main issues in using Hadoop is related to its impossibility to dynamically scale and re-configure the environment, e.g, adding/removing nodes in a cluster for an efficient resource usage. This paper presents a new approach to dynamically setup Hadoop using a Message Oriented Middleware for Cloud computing (MOM4C), in order to make the system much more suitable to Cloud providers´ requirements.
  • Keywords
    Big Data; cloud computing; distributed programming; middleware; public domain software; Big Data solutions; Hadoop configuration; MOM4C; MapReduce paradigm; cloud providers; data processing; message oriented middleware for cloud computing; open-source distributed computing system; resilient cloud systems; Cloud computing; Computer architecture; Distributed databases; Educational institutions; Message-oriented middleware; Protocols; Big Data; Cloud Computing; HDFS; Hadoop; Resilient Cloud Storage;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Computers and Communication (ISCC), 2014 IEEE Symposium on
  • Conference_Location
    Funchal
  • Type

    conf

  • DOI
    10.1109/ISCC.2014.6912631
  • Filename
    6912631