Title :
A Dynamic Data Placement Scheme for Hadoop Using Real-time Access Patterns
Author :
Poonthottam, Viju P. ; Madhu Kumar, S.D.
Author_Institution :
Dept. of Comput. Sci. & Eng., NIT Calicut, Calicut, India
Abstract :
Hadoop has become a popular platform for largescale data analytics. In this paper, we identify a major performance bottleneck of Hadoop-its lack of ability to place data near to its required users. This new Data Placement scheme using access patterns will improve the performance of Hadoop. With this strategy the data will be placed nearer to the required users thereby achieving optimization in access time and bandwidth. Finally, the simulation experiments indicate that our strategy behaves much better than the HDFS blocks placement.
Keywords :
data analysis; parallel processing; HDFS blocks placement; Hadoop distributed file system; access time optimization; bandwidth optimization; dynamic data placement scheme; large scale data analytics; realtime access patterns; Bandwidth; Heart beat; Informatics; Pipelines; Real-time systems; Servers; Software; Access pattern; HDFS; Hadoop; Load Optimization; block placement;
Conference_Titel :
Advances in Computing, Communications and Informatics (ICACCI), 2013 International Conference on
Conference_Location :
Mysore
Print_ISBN :
978-1-4799-2432-5
DOI :
10.1109/ICACCI.2013.6637175
