Title :
A Model for Chinese Sentence Ordering Based on Markov Model
Author :
He, Yanxiang ; Peng, Gongfu ; Wen, Weidong
Author_Institution :
Dept. of Comput. Sci. & Technol., Wuhan Univ., Wuhan, China
Abstract :
In this paper, we discuss a method to improve the sentence ordering task in Chinese. The way we approach is based on the analysis of Markov model, which can train transition probability in raw corpus. We iteratively calculate the largest transition probability path in Markov model to confirm the correct order. The method avoids judging the first sentence, which could lead to an instable result in our early work. We also provide a way to evaluate the effect of experiments. Experimental results indicate that our method shows good results on accuracy, and significantly improves the readability and coherence of the article. The method could be used in various fields of Chinese text processing work and applications.
Keywords :
Markov processes; natural language processing; probability; text analysis; word processing; Chinese sentence ordering; Chinese text processing; Markov model; sentence ordering task; transition probability path; Application software; Coherence; Computer science; Data mining; Fuzzy systems; Helium; Humans; Information analysis; Probability; Text processing; Markov model; sentence ordering;
Conference_Titel :
Fuzzy Systems and Knowledge Discovery, 2009. FSKD '09. Sixth International Conference on
Conference_Location :
Tianjin
Print_ISBN :
978-0-7695-3735-1
DOI :
10.1109/FSKD.2009.489