Title :
A Topic Model of Observing Chinese Characters
Author :
Zhang, Yunkai ; Qin, Zengchang
Author_Institution :
Coll. of Software, Beihang Univ., Beijing, China
Abstract :
The Topic Models are a class of hierarchical statistical models for analyzing document collections and it has become one of the most used techniques in Natural Language Processing in the recent years. It assumes that each document could be expressed as a mixture of topics and each topic could be characterized by a distribution over words. In previous research, like in English language, Topic Models for Chinese Language use the words as observing data. In this research, we demonstrated the effectiveness of using Chinese characters as the basic units of observing data. The comparisons with those models based on Chinese words and English words are presented.
Keywords :
document handling; natural language processing; statistical analysis; Chinese characters; Chinese words; English words; document collections; hierarchical statistical models; natural language processing; topic models; Accuracy; Analytical models; Biological system modeling; Computational modeling; Probabilistic logic; Semantics; Training;
Conference_Titel :
Intelligent Human-Machine Systems and Cybernetics (IHMSC), 2010 2nd International Conference on
Conference_Location :
Nanjing, Jiangsu
Print_ISBN :
978-1-4244-7869-9
DOI :
10.1109/IHMSC.2010.99