Research and Practice of Distributed Parallel Search Algorithm on Hadoop_MapReduce

Author

AiLing Duan ; HaiFang Si

Author_Institution

Sch. of Inf. Sci. & Eng., Henan Univ. of Technol., Zhengzhou, China

fYear

2012

fDate

7-9 Dec. 2012

Firstpage

105

Lastpage

108

Abstract

Hadoop_Mapreduce is winning more and more attention with its open source distributed parallel computing technology, high efficiency and economy. This paper describes the Hadoop_Mapreduce and its related technologies, studies in detail the thought behind the Hadoop_MapReduce algorithm and the system architecture, and for the field of internet search relating massive amounts of data, discusses the algorithm parallelization method of the algorithm and its feasibility, and applies MapReduce model on the Hadoop platform to realize inverted index by means of parallelization.

Keywords

Internet; parallel processing; public domain software; query processing; Hadoop_MapReduce algorithm; Internet; distributed parallel search algorithm; open source distributed parallel computing technology; system architecture; Algorithm design and analysis; Computer architecture; Distributed databases; File systems; Indexes; Search engines; Servers; Distributed parallel computing; Hadoop_MapReduce; Inverted index; algorithm;

fLanguage

English

Publisher

ieee

Conference_Titel

Control Engineering and Communication Technology (ICCECT), 2012 International Conference on

Conference_Location

Liaoning

Print_ISBN

978-1-4673-4499-9

Type

conf

DOI

10.1109/ICCECT.2012.131

Filename

6413783