Title :
Lip movement synthesis in audio-visual speech recognition system
Author :
Li, Junquan ; Yin, Yixin
Author_Institution :
Univ. of Sci. & Technol., Beijing, China
fDate :
30 Oct.-1 Nov. 2005
Abstract :
This paper describes a technique for synthesizing audio-visual speech based on HMM. The experiment "Lip movement synthesis" use VC++ and HTK toolkit. In the training stage, Japanese words will be change to text from the image sequence from using hidden Markov model (HMM). Experimental results show that the synthetic lip image sequence is smooth and realistic. This research was supported by NSFC, China (Grant No.60374032).
Keywords :
audio-visual systems; hidden Markov models; image sequences; natural languages; speech recognition; HMM; HTK toolkit; VC++; audio-visual speech recognition system; hidden Markov model; image sequence; lip movement synthesis; Application software; Control systems; Error correction; Hidden Markov models; Humans; Image sequences; Labeling; Natural languages; Speech recognition; Speech synthesis;
Conference_Titel :
Natural Language Processing and Knowledge Engineering, 2005. IEEE NLP-KE '05. Proceedings of 2005 IEEE International Conference on
Print_ISBN :
0-7803-9361-9
DOI :
10.1109/NLPKE.2005.1598781
