Title :
Application of Boosting to Chinese word sense disambiguation
Author :
Quan, Changqin ; He, Tingting ; Po Hu ; Ji, DongHong
Author_Institution :
Dept. of Comput. Sci., Huazhang Normal Univ., Wuhan, China
fDate :
30 Oct.-1 Nov. 2005
Abstract :
AdaBoost.M1 is a well known boosting-based method for improving the accuracy of a given machine-learning algorithm. In this paper, we modify AdaBoost.M1 for Chinese word sense disambiguation. Unlike AdaBoost.M1 that adapts weights of training sets, in our modified algorithm, we provide a new method to adapt the classifiers´ weights. The base classifiers are trained on a small set of labeled examples, and then augmented by a large number of unlabeled examples. We report the results of systematic experimentation performed on a standard Chinese People Daily corpus (co-developed by Institute of Computational Linguistics (ICL) of Peking University, People´s Daily and Fujitsu Limited) of 12 thousand articles. These experiments demonstrate the advantage of our new weight adaptation method and its ability to overcome the noise factor within the unlabeled examples. We also demonstrate that the overall accuracy is improved as the number of classifiers increases.
Keywords :
learning (artificial intelligence); natural languages; AdaBoost.M1; Chinese People Daily corpus; Chinese word sense disambiguation; base classifier; machine-learning algorithm; weight adaptation method; Application software; Boosting; Computational linguistics; Computer science; Decision trees; Helium; Natural language processing; Software algorithms; Software engineering; Training data;
Conference_Titel :
Natural Language Processing and Knowledge Engineering, 2005. IEEE NLP-KE '05. Proceedings of 2005 IEEE International Conference on
Print_ISBN :
0-7803-9361-9
DOI :
10.1109/NLPKE.2005.1598698