Title :
A real-time retrieval system using change aware distributed file system
Author :
Uehara, Minoru ; Sato, Nobuyoshi
Author_Institution :
Dept. of Inf. & Comput. Sci., Toyo Univ., Japan
Abstract :
Intranet information retrieval is very important to discover the useful knowledge. In this process, search engine is useful. However, conventional search engines, which are based on centralized architecture, are not suited for the intranet information retrieval because intranet information is frequently updated. Centralized search engines take a long time to collect Web pages by robots. So, we have developed a distributed search engine, cooperative search engine (CSE), to retrieve fresh information. In CSE, a local search engine located in each Web server makes an index of local pages. And, a meta search server integrates these local search engines to realize a global search engine. CSE takes a few minutes to update index because each local search engine scans all files in its own disk. In this paper, we propose the notification mechanism using change aware distributed file system. As this result, we realize the real-time information retrieval.
Keywords :
Internet; distributed databases; file servers; information retrieval; intranets; real-time systems; search engines; Web pages; Web server; centralized architecture; centralized search engines; change aware distributed file system; cooperative search engine; distributed search engine; global search engine; intranet information retrieval; knowledge discovery; local pages; local search engine; meta search server; notification mechanism; real-time information retrieval; real-time retrieval system; Computer architecture; File systems; Information retrieval; Large-scale systems; Metasearch; Real time systems; Robots; Search engines; Web pages; Web server;
Conference_Titel :
Computer and Information Technology, 2004. CIT '04. The Fourth International Conference on
Print_ISBN :
0-7695-2216-5
DOI :
10.1109/CIT.2004.1357298