Title :
Distributed storage method based on information dispersal algorithm
Author :
Jie Ling ; Xiangyang Jiang
Author_Institution :
Fac. of Comput., Guangdong Univ. of Technol., Guangzhou, China
Abstract :
In order to improve the storage efficiency of Hadoop Distributed File System (HDFS) and its load balancing ability, this paper presented a distributed storage method based on information dispersal algorithm (IDA). The method used IDA to encode files to blocks, and stored the blocks in the cluster by the improved data placement strategy. The results and analysis of the experiments show that the method improves the storage efficiency and load balancing ability.
Keywords :
distributed databases; resource allocation; HDFS; Hadoop distributed file system; IDA; data placement strategy; distributed storage method; information dispersal algorithm; load balancing ability; storage efficiency; Aerospace electronics; Algorithm design and analysis; Automation; Availability; Computers; Instrumentation and measurement; Load management; HDFS; distributed storage; information dispersal algorithm; load balancing ability;
Conference_Titel :
Instrumentation and Measurement, Sensor Network and Automation (IMSNA), 2013 2nd International Symposium on
Conference_Location :
Toronto, ON
DOI :
10.1109/IMSNA.2013.6743354
