DocumentCode :
3089366
Title :
Performance Analysis of Hadoop for Query Processing
Author :
Wlodarczyk, Tomasz Wiktor ; Han, Yi ; Rong, Chunming
Author_Institution :
Dept. of Comput. Sci. & Electr. Eng., Univ. of Stavanger, Stavanger, Norway
fYear :
2011
fDate :
22-25 March 2011
Firstpage :
507
Lastpage :
513
Abstract :
Query processing using mostly various NoSQL languages becomes a significant application area for Hadoop. Despite significant work on performance improvement of these languages the performance dependence on basic configuration parameters seems not to be fully considered. In this paper we present a relatively comprehensive study into influence the basic configuration parameters have on performance of typical types of queries. We choose three queries from Lehigh University Benchmark that can represent the most typical challenges and we analyze their dependence on parameters such as: dataset size, number of nodes, number of reducers and loading overhead. The results indicate strong dependence on the amount of reducers and IO performance of the cluster, which proves the common opinion that MapReduce is IO bound. These results can help to compare performance behavior of different languages and serve as a basis for understanding the influence of configuration parameters on the final performance.
Keywords :
database management systems; query processing; Hadoop performance analysis; IO bound; Lehigh university benchmark; MapReduce; NoSQL languages; query processing; Benchmark testing; Database languages; Loading; Performance analysis; Query processing; Resource description framework; Web services; Amazon Web Services; Hadoop; LUBM; analysis; performance; query;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Advanced Information Networking and Applications (WAINA), 2011 IEEE Workshops of International Conference on
Conference_Location :
Biopolis
Print_ISBN :
978-1-61284-829-7
Electronic_ISBN :
978-0-7695-4338-3
Type :
conf
DOI :
10.1109/WAINA.2011.130
Filename :
5763552
Link To Document :
بازگشت