DocumentCode :
2076740
Title :
Benchmarking a MapReduce Environment on a Full Virtualisation Platform
Author :
Kontagora, Maryam ; Gonzalez-Velez, H.
Author_Institution :
Sch. of Comput., Robert Gordon Univ., Aberdeen, UK
fYear :
2010
fDate :
15-18 Feb. 2010
Firstpage :
433
Lastpage :
438
Abstract :
This work analyses the performance of Hadoop, an implementation of the MapReduce programming model for distributed parallel computing, executing on a virtualisation environment comprised of 1 + 16 nodes running the VMWare workstation software. A set of experiments using the standard Hadoop benchmarks has been designed in order to determine whether or not significant reductions in the execution time of computations are experienced using Hadoop on this virtualisation platform on a local area network. Our findings indicate that a significant decrease in computing times is observed under these conditions. They also highlight how overheads and virtualisation in a distributed environment hinder the possibility of achieving the maximum (peak) performance.
Keywords :
parallel programming; virtual reality; Hadoop benchmarks; MapReduce programming model; VMWare workstation software; distributed parallel computing; distributed programming model; full virtualisation platform; local area network; Concurrent computing; Distributed computing; Functional programming; Hardware; Operating systems; Parallel processing; Parallel programming; Software performance; Virtual machining; Workstations; Algorithmic Skeletons; MapReduce; Master Worker; Parallel Programming; Server Virtualization; Structured Parallelism; Task Farm;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Complex, Intelligent and Software Intensive Systems (CISIS), 2010 International Conference on
Conference_Location :
Krakow
Print_ISBN :
978-1-4244-5917-9
Type :
conf
DOI :
10.1109/CISIS.2010.45
Filename :
5447459
Link To Document :
بازگشت