Title :
A dynamic weighted method with support vector machines for Chinese word segmentation
Author :
Ren, Feiliang ; Shi, Lei ; Yao, Tianshun
Author_Institution :
Natural Language Process. Lab., Northeastern Univ., Shenyang, China
fDate :
30 Oct.-1 Nov. 2005
Abstract :
We explore how a dynamic weighted method with SVM works well for a Chinese word segmentation task. We set up two systems, System1 uses the uniform weight and we take it as our baseline system, System1 uses the dynamic weighted method as we proposed. We compare the performance of the two systems under different experiments conditions, and experiments results show that System2 got an outstanding performance in every condition we tested. It indicates that the dynamic weighted method we proposed has a stronger performance and can be used in many other SVM task such as chunking, POS and so on. At last, we describe a trick that can calculate the segmentation precision ratio and recall ratio for a segmentation task as soon as the end of the training or test process of a SVM procedure at essentially no extra cost.
Keywords :
computational linguistics; natural languages; support vector machines; word processing; Chinese word segmentation; SVM; dynamic weighted method; recall ratio; segmentation precision ratio; support vector machines; Costs; Dictionaries; Laboratories; Natural language processing; Natural languages; Software; Support vector machine classification; Support vector machines; System testing; Text categorization;
Conference_Titel :
Natural Language Processing and Knowledge Engineering, 2005. IEEE NLP-KE '05. Proceedings of 2005 IEEE International Conference on
Print_ISBN :
0-7803-9361-9
DOI :
10.1109/NLPKE.2005.1598763