DocumentCode
2484289
Title
Dictionary Chinese Word Segmentation research a method combined with CRFs
Author
Wang, Chengliang ; Chen, Juanjuan ; Wu, Xichuan
Author_Institution
Coll. of Comput. Sci. & Eng., Chongqing Univ., Chongqing, China
fYear
2010
fDate
Nov. 30 2010-Dec. 2 2010
Firstpage
962
Lastpage
965
Abstract
The Word Segmentation of matching literal based on Chinese Dictionary cannot resolve the problem of segmenting ambiguity and combinatorial ambiguity. Based on the dictionary segmentation, this paper proposes a method of Dictionary Chinese Word Segmentation combined with CRFs. It is proved that this method can have better performance than CRFs segmentation and traditional dictionary segmentation.
Keywords
dictionaries; natural language processing; random processes; word processing; CRF; combinatorial ambiguity; conditional random field model; dictionary Chinese word segmentation; segmenting ambiguity; Accuracy; Dictionaries; Equations; Hidden Markov models; Labeling; Mathematical model; Viterbi algorithm; CRFs; combinatorial ambiguity; matching literal; segmenting ambiguity; word segmentation;
fLanguage
English
Publisher
ieee
Conference_Titel
Computer Sciences and Convergence Information Technology (ICCIT), 2010 5th International Conference on
Conference_Location
Seoul
Print_ISBN
978-1-4244-8567-3
Electronic_ISBN
978-89-88678-30-5
Type
conf
DOI
10.1109/ICCIT.2010.5711199
Filename
5711199
Link To Document