Title :
An evolutionary relevance calculation measure in topic crawler
Author :
Xiaoqing, Cui ; Chun, Yan
Author_Institution :
Comput. Sci. & Technol. Sch., Wuhan Univ. of Technol., Wuhan, China
Abstract :
In recent years, relevance calculation of Web page and the topic has been one of the important and valuable hotspot. And relevance calculation between the Web page and the topic becomes a key factor. However, the traditional calculations of the topic relevance have lots of defects. For example, high cost, vector length disturbance, excessive high MAE and so on... This paper provides a new algorithm named AdjustJaccard to get the relevance according to the analyses of the traditional calculation of the topic relevance. The results proved the method is highly effective.
Keywords :
search engines; Web craw;er; Web page; evolutionary relevance calculation; Communication system control; Computer science; Crawlers; Frequency; Functional analysis; Information analysis; Search engines; Technology management; Vectors; Web pages; AdjustJaccard algorithm; MAE; broad sense Jaccard coefficient; cosine similarity; relevance;
Conference_Titel :
Computing, Communication, Control, and Management, 2009. CCCM 2009. ISECS International Colloquium on
Conference_Location :
Sanya
Print_ISBN :
978-1-4244-4247-8
DOI :
10.1109/CCCM.2009.5267731