Application of Hadoop MapReduce technique to Virtual Database system design

Author

Sathya, S. ; Jose, M. Victor

Author_Institution

Dept. of Comput. Sci. & Eng., Noorul Islam Centre for Higher Educ., Kumaracoil, India

fYear

2011

fDate

23-24 March 2011

Firstpage

892

Lastpage

896

Abstract

Today in the world of cloud and grid computing integration of data from heterogeneous databases is inevitable. Virtual Database Technology (VDB) is one of the effective solutions for integration of data from heterogeneous sources. This will become complex when size of the database is very large. MapReduce is a new framework specifically designed for processing huge datasets on distributed sources. Apache´s Hadoop is an implementation of MapReduce. Currently Hadoop has been applied successfully for file based datasets. This paper proposes to utilize the parallel and distributed processing capability of Hadoop MapReduce for handling heterogeneous query execution on large datasets. So Virtual Database Engine built on top of this will result in effective high performance distributed data integration.

Keywords

cloud computing; distributed databases; grid computing; query processing; Apache Hadoop; MapReduce technique; Virtual; cloud computing; distributed data integration; distributed processing; grid computing; heterogeneous databases; heterogeneous query execution; virtual database system design; virtual database technology; Conferences; Distributed databases; Engines; Query processing; XML; Database integration; Hadoop MapReduce; Virtual Database technology; heterogeneous databases; query optimization;

fLanguage

English

Publisher

ieee

Conference_Titel

Emerging Trends in Electrical and Computer Technology (ICETECT), 2011 International Conference on

Conference_Location

Tamil Nadu

Print_ISBN

978-1-4244-7923-8

Type

conf

DOI

10.1109/ICETECT.2011.5760245

Filename

5760245