Performance comparison of Hadoop Clusters configured on virtual machines and as a cloud service

Author

Hyder, Muhammad Faraz ; Ismail, Muhammad Ali ; Ahmed, Hameeza

Author_Institution

Comput. & Inf. Syst. Eng. Dept., NED Univ. of Eng. & Technol., Karachi, Pakistan

fYear

2014

fDate

8-9 Dec. 2014

Firstpage

60

Lastpage

64

Abstract

Cloud computing is an emerging trend for online computing and resource management. OpenStack is one of the most widely used open source platform for building public and private clouds. Whereas, Apache Hadoop is an open source framework use to process large data sets spread across clusters of computers. Currently both OpenStack and Apache Hadoop are sharing the major consideration in research and open source communities. This paper focuses on integration of Hadoop Cluster on OpenStack cloud as it´s one of the services and then highlights the performance comparison of Hadoop cluster implemented with that of Hadoop cluster configured separately. The results concluded show the successful implementation of Hadoop as a cloud service and its performance enhancement in comparison to native virtual Hadoop cluster.

Keywords

cloud computing; data handling; parallel processing; public domain software; virtual machines; workstation clusters; OpenStack cloud; cloud service; virtual Hadoop cluster; virtual machines; Benchmark testing; Cloud computing; Random access memory; Servers; Software as a service; Virtual machine monitors; Virtual machining; Cloud service; Hadoop cluster; Hypervisor; OpenStack; SaaS;

fLanguage

English

Publisher

ieee

Conference_Titel

Emerging Technologies (ICET), 2014 International Conference on

Conference_Location

Islamabad

Print_ISBN

978-1-4799-6088-0

Type

conf

DOI

10.1109/ICET.2014.7021017

Filename

7021017