Title :
A Novel Approach To Automatically Extracting Main Content of Web News
Author :
Wang, Xuan ; Wang, WeiPing ; Liu, Bowen ; Wang, Zhen ; Wang, Xicai
Author_Institution :
Bus. Intell. Lab., Univ. of Sci. & Technol. of China, Hefei
Abstract :
Recently, the Web has been the data repository. In order to obtain the relevant information from the repository, many research have been made. The typical function of Web news extraction is to locate the useful content text and filter the noises , both main issues result in Web news extraction that is an open research problem. In this paper , we describe an approach that can cluster the pages which share common extracting path and automatically extract location of main text passages. Our approach can apply to structural Web pages . Moreover, we developed an extracting system by using our algorithm. Experiments are done over several important on-line news sites and experimental results on our extracting system show that the approach can achieve higher extraction accuracy than RTDM algorithm.
Keywords :
Web sites; content management; information filtering; pattern clustering; text analysis; Web site; automatic Web new content extraction; content text; data repository; noises filtering; structural Web page clustering; Clustering algorithms; Computer vision; Costs; Data mining; Information filtering; Information filters; Navigation; Tree data structures; Vegetation mapping; Web pages;
Conference_Titel :
E-Business and Information System Security, 2009. EBISS '09. International Conference on
Conference_Location :
Wuhan
Print_ISBN :
978-1-4244-2909-7
Electronic_ISBN :
978-1-4244-2910-3
DOI :
10.1109/EBISS.2009.5137884
