Study on Web Content Acquirement Technology Based on Conception Topic

For the improvement of recall and precision of search engine based on key words, this thesis makes a study of web pages acquirement technology based on conception topic. Initially it analyses the shortcoming of HITS algorithm and develop a new algorithm based on conception topic. The new algorithm reforms HITS by getting rid of link farms when extending the root set, it overcomes the weakness of which is based on text analysis or link analysis, it promotes the search engine´s intellectual judgment of the users´ interest and makes the crawling web pages more in need of the users´ requirement. Experiments in fashion field show the new algorithm is better than Google.