Title :
Benchmarking a MapReduce Environment on a Full Virtualisation Platform
Author :
Kontagora, Maryam ; Gonzalez-Velez, H.
Author_Institution :
Sch. of Comput., Robert Gordon Univ., Aberdeen, UK
Abstract :
This work analyses the performance of Hadoop, an implementation of the MapReduce programming model for distributed parallel computing, executing on a virtualisation environment comprised of 1 + 16 nodes running the VMWare workstation software. A set of experiments using the standard Hadoop benchmarks has been designed in order to determine whether or not significant reductions in the execution time of computations are experienced using Hadoop on this virtualisation platform on a local area network. Our findings indicate that a significant decrease in computing times is observed under these conditions. They also highlight how overheads and virtualisation in a distributed environment hinder the possibility of achieving the maximum (peak) performance.
Keywords :
parallel programming; virtual reality; Hadoop benchmarks; MapReduce programming model; VMWare workstation software; distributed parallel computing; distributed programming model; full virtualisation platform; local area network; Concurrent computing; Distributed computing; Functional programming; Hardware; Operating systems; Parallel processing; Parallel programming; Software performance; Virtual machining; Workstations; Algorithmic Skeletons; MapReduce; Master Worker; Parallel Programming; Server Virtualization; Structured Parallelism; Task Farm;
Conference_Titel :
Complex, Intelligent and Software Intensive Systems (CISIS), 2010 International Conference on
Conference_Location :
Krakow
Print_ISBN :
978-1-4244-5917-9
DOI :
10.1109/CISIS.2010.45