Title :
CDW: A text clustering model for diverse versions discovery
Author :
Rong Xiao ; Liang Kong ; Yan Zhang ; Min Wang
Author_Institution :
Dept. of Machine Intell., Peking Univ., Beijing, China
Abstract :
The development of information technology brings numerous online news and events to our daily life. One big problem of such information explosion is, many times there are diverse descriptions for one incident which make people confused. Although previous researches have provided various algorithms to detect and track events, few of them focus on uncovering the diversified versions of an event. In this paper, we propose a novel algorithm which is capable of discovering different versions of one event according to the news reports. We map documents to the topic layer to get the information of each topic. Then we extract the highly-differentiated words of each topic to cluster the documents. Compared with previous work, the accuracy of our algorithm is much higher. Experiments conducted on two data sets show that our algorithm is effective and outperforms various related algorithms, including classical methods such as K-means and LDA.
Keywords :
information technology; pattern clustering; text analysis; CDW; K-means; LDA; diverse versions discovery; information explosion; information technology development; map documents; text clustering model; Clustering algorithms; DVD; Event detection; Feature extraction; Semantics; Sun; Tuning;
Conference_Titel :
Fuzzy Systems and Knowledge Discovery (FSKD), 2011 Eighth International Conference on
Conference_Location :
Shanghai
Print_ISBN :
978-1-61284-180-9
DOI :
10.1109/FSKD.2011.6019733