Title :
Morpheme concatenation approach in language modeling for large-vocabulary Uyghur speech recognition
Author :
Ablimit, Mijit ; Hamdulla, Askar ; Kawahara, Tatsuya
Author_Institution :
Sch. of Inf., Kyoto Univ., Kyoto, Japan
Abstract :
For large-vocabulary continuous speech recognition (LVCSR) of highly-inflected languages, selection of an appropriate recognition unit is the first important step. The morpheme-based approach is often adopted because of its high coverage and linguistic properties. But morpheme units are short, often consisting of one or two phonemes, thus they are more likely to be confused in ASR than word units. Generally, word units provide better linguistic constraint, but increases the vocabulary size explosively, causing OOV (out-of-vocabulary) and data sparseness problems in language modeling. In this research, we investigate approaches of selecting word entries by concatenating morpheme sequences, which would reduce word error rate (WER). Specifically, we compare the ASR results of the word-based model and those of the morpheme-based model, and extract typical patterns which would reduce the WER. This method has been successfully applied to an Uyghur LVCSR system, resulting in a significant reduction of WER without a drastic increase of the vocabulary size.
Keywords :
linguistics; natural language processing; speech recognition; vocabulary; OOV; Uyghur LVCSR system; WER; data sparseness problems; language modeling; large-vocabulary Uyghur speech recognition; linguistic properties; morpheme concatenation approach; morpheme sequences; out-of-vocabulary; word error rate reduction; Acoustics; Hidden Markov models; Pragmatics; Speech recognition; Training; Training data; Vocabulary; Speech recognition; Uyghur; language model; morpheme;
Conference_Titel :
Speech Database and Assessments (Oriental COCOSDA), 2011 International Conference on
Conference_Location :
Hsinchu
Print_ISBN :
978-1-4577-0930-2
DOI :
10.1109/ICSDA.2011.6085990