• DocumentCode
    2076740
  • Title

    Benchmarking a MapReduce Environment on a Full Virtualisation Platform

  • Author

    Kontagora, Maryam ; Gonzalez-Velez, H.

  • Author_Institution
    Sch. of Comput., Robert Gordon Univ., Aberdeen, UK
  • fYear
    2010
  • fDate
    15-18 Feb. 2010
  • Firstpage
    433
  • Lastpage
    438
  • Abstract
    This work analyses the performance of Hadoop, an implementation of the MapReduce programming model for distributed parallel computing, executing on a virtualisation environment comprised of 1 + 16 nodes running the VMWare workstation software. A set of experiments using the standard Hadoop benchmarks has been designed in order to determine whether or not significant reductions in the execution time of computations are experienced using Hadoop on this virtualisation platform on a local area network. Our findings indicate that a significant decrease in computing times is observed under these conditions. They also highlight how overheads and virtualisation in a distributed environment hinder the possibility of achieving the maximum (peak) performance.
  • Keywords
    parallel programming; virtual reality; Hadoop benchmarks; MapReduce programming model; VMWare workstation software; distributed parallel computing; distributed programming model; full virtualisation platform; local area network; Concurrent computing; Distributed computing; Functional programming; Hardware; Operating systems; Parallel processing; Parallel programming; Software performance; Virtual machining; Workstations; Algorithmic Skeletons; MapReduce; Master Worker; Parallel Programming; Server Virtualization; Structured Parallelism; Task Farm;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Complex, Intelligent and Software Intensive Systems (CISIS), 2010 International Conference on
  • Conference_Location
    Krakow
  • Print_ISBN
    978-1-4244-5917-9
  • Type

    conf

  • DOI
    10.1109/CISIS.2010.45
  • Filename
    5447459