Title :
Text Categorization for Vietnamese Documents
Author :
Nguyen, Giang-Son ; Gao, Xiaoying ; Andreae, Peter
Abstract :
Many machine learning methods have been proposed for text categorization, but most research has applied them to English documents. Vietnamese is a different language with different features and it is not clear whether the standard methods will work on the categorization of Vietnamese documents. This paper describes morphological level document representations that are appropriate for Vietnamese text documents and investigates the effectiveness of several standard learning algorithms including Naïve Bayes, K-Nearest Neighbour (KNN) and Support Vector Machine (SVM) with four different kernel functions. The results show that it is possible to build effective and efficient classifiers for Vietnamese text categorization using our representations and the standard algorithms, and demonstrate that the performance can be improved by using infogain for feature selection and using an external dictionary for filtering the vocabulary.
Keywords :
Dictionaries; Filtering algorithms; Kernel; Learning systems; Machine learning; Natural languages; Support vector machine classification; Support vector machines; Text categorization; Vocabulary; Vietnamese language processing; classification; machine learning;
Conference_Titel :
Web Intelligence and Intelligent Agent Technologies, 2009. WI-IAT '09. IEEE/WIC/ACM International Joint Conferences on
Conference_Location :
Milan, Italy
Print_ISBN :
978-0-7695-3801-3
Electronic_ISBN :
978-1-4244-5331-3
DOI :
10.1109/WI-IAT.2009.327