Title :
Research and Practice of Distributed Parallel Search Algorithm on Hadoop_MapReduce
Author :
AiLing Duan ; HaiFang Si
Author_Institution :
Sch. of Inf. Sci. & Eng., Henan Univ. of Technol., Zhengzhou, China
Abstract :
Hadoop_Mapreduce is winning more and more attention with its open source distributed parallel computing technology, high efficiency and economy. This paper describes the Hadoop_Mapreduce and its related technologies, studies in detail the thought behind the Hadoop_MapReduce algorithm and the system architecture, and for the field of internet search relating massive amounts of data, discusses the algorithm parallelization method of the algorithm and its feasibility, and applies MapReduce model on the Hadoop platform to realize inverted index by means of parallelization.
Keywords :
Internet; parallel processing; public domain software; query processing; Hadoop_MapReduce algorithm; Internet; distributed parallel search algorithm; open source distributed parallel computing technology; system architecture; Algorithm design and analysis; Computer architecture; Distributed databases; File systems; Indexes; Search engines; Servers; Distributed parallel computing; Hadoop_MapReduce; Inverted index; algorithm;
Conference_Titel :
Control Engineering and Communication Technology (ICCECT), 2012 International Conference on
Conference_Location :
Liaoning
Print_ISBN :
978-1-4673-4499-9
DOI :
10.1109/ICCECT.2012.131
