Title :
Improving Sequence Tagging using Machine-Learning Techniques
Author :
Jiang, Wei ; Wang, Xiao-long ; Guan, Yi
Author_Institution :
Sch. of Comput. Sci. & Technol., Harbin Inst. of Technol.
Abstract :
This paper presents an excel sequence tagging approach based on the combined machine learning methods. Firstly, conditional random fields (CRF) is presented as a new kind of discriminative sequential model, it can incorporate many rich features, and well avoid the label bias problem that is the limitation of maximum entropy Markov models (MEMM) and other discriminative finite-state models. Secondly, support vector machine is improved to adapt the sequential tagging task. Finally, these improved models and other existing models are combined together, which have achieved the state-of-the-art performance. Experimental results show that CRF approach achieves 0.70% improvement in POS tagging and 0.67% improvement in shallow parsing. Moreover, our combination method achieves F-measure 93.73% and 93.69% in above two tasks respectively, which is better than any sub-model
Keywords :
learning (artificial intelligence); sequences; support vector machines; conditional random fields; discriminative finite-state models; discriminative sequential model; excel sequence tagging; machine-learning techniques; maximum entropy Markov models; support vector machine; Biological system modeling; Computer science; Cybernetics; Entropy; Hidden Markov models; Labeling; Learning systems; Machine learning; Performance analysis; RNA; Support vector machines; Tagging; Conditional random fields; Multi-model combination; Sequence tagging; Support vector machine;
Conference_Titel :
Machine Learning and Cybernetics, 2006 International Conference on
Conference_Location :
Dalian, China
Print_ISBN :
1-4244-0061-9
DOI :
10.1109/ICMLC.2006.258917