Title :
A Novel Blocks Placement Strategy for Hadoop
Author :
Xianglong Ye ; Mengxing Huang ; Donghai Zhu ; Peng Xu
Author_Institution :
Coll. of Inf. Sci. &Technol., Hainan Univ., Haikou, China
fDate :
May 30 2012-June 1 2012
Abstract :
A novel blocks placement strategy is developed for solving some shortages in recent Hadoop. With the Strategy, the optimal Data nodes, according to the real-time situation of Data nodes, are chosen dynamically to achieve load balancing. Finally, the simulation experiments indicate that our strategy behaves much better than the HDFS blocks placement when the situation is coherent to time.
Keywords :
distributed processing; file organisation; public domain software; resource allocation; Google MapReduce programming model; HDFS; Hadoop distributed file system; blocks placement strategy; load balancing; open-source implementation; optimal data nodes; Bandwidth; Fault tolerance; File systems; Load management; Network topology; Real time systems; Switches; HDFS; blocks placement; hadoop; load balance;
Conference_Titel :
Computer and Information Science (ICIS), 2012 IEEE/ACIS 11th International Conference on
Conference_Location :
Shanghai
Print_ISBN :
978-1-4673-1536-4
DOI :
10.1109/ICIS.2012.11
