Title :
Cooperation schemes between a Web server and a Web search engine
Author :
Castillo, Carlos
Author_Institution :
Dept. of Comput. Sci., Chile Univ., Santiago, Chile
Abstract :
Search engines provide search results based on a large repository of pages downloaded by a Web crawler from several servers. To provide best results, this repository must be kept as fresh as possible, but this can be difficult due to the large volume of pages involved and to the fact that polling is the only method for detecting changes. We explore and compare several alternatives for keeping fresh repositories of cooperation from servers.
Keywords :
Internet; Web sites; meta data; search engines; Web crawler; Web server; meta data; polling; search engine; Computer science; Crawlers; Humans; Proposals; Protocols; Robots; Search engines; Web pages; Web search; Web server;
Conference_Titel :
Web Congress, 2003. Proceedings. First Latin American
Print_ISBN :
0-7695-2058-8
DOI :
10.1109/LAWEB.2003.1250301
