Title :
Distributed pipelining processing for index updating method
Author :
Udagawa, Minoru ; Sato, Nobuyoshi ; Uehara, Minoru ; Sakai, Yoshifumi
Author_Institution :
Dept. of Inf. & Comput. Sci., Toyo Univ., Saitama, Japan
Abstract :
Crawling and indexing have been considered regarding existing search engines, but whereas high speed crawling has been studied widely, improvements in the speed of indexing have seldom been discussed. Building a fresh information search engine should, however, unify these arguments concerning crawling and indexing. In this report, an index updating process based on a pipeline that unifies crawling and indexing was proposed. The techniques of a distributed index updating process are discussed with regards to a distributed cooperative search engine.
Keywords :
Internet; indexing; pipeline processing; search engines; cooperative search engine; crawling; distributed pipelining processing; index updating method; information search engine; Control systems; Data mining; Databases; File servers; Indexing; Information retrieval; Pipeline processing; Search engines; Web pages; Web server;
Conference_Titel :
Advanced Information Networking and Applications, 2004. AINA 2004. 18th International Conference on
Print_ISBN :
0-7695-2051-0
DOI :
10.1109/AINA.2004.1283850