Title :
Visual speech and coarticulation effects
Author :
Bothe, Hans H. ; Rieger, Frauke
Author_Institution :
Dept. of Electron. Tech. Univ. of Berlin, Germany
Abstract :
The state of the art of a computer animation program showing realistic movements of an abstracted speaker´s face is presented. For this purpose, video tapes with prototypic speakers have been recorded and analyzed in order to investigate the fundamental correlation between phonetic sequences of given German texts and the corresponding visual movements of articulation. Considering coarticulation effects, a 2-D-motion model was set up on a commercial PC using a set of 38 key pictures and calculating interim frames. The coordinated movements of the visible speech synthesis cover the lips, the teeth, and the tip of the tongue. The possible text input is based on an open vocabulary. The program is designed to be a training aid for lip reading for hearing-impaired people.<>
Keywords :
computer aided instruction; computer animation; correlation methods; hearing aids; speech analysis and processing; speech synthesis; video recording; vocabulary; 2-D-motion model; German texts; coarticulation effects; computer animation program; coordinated movements; correlation; lip reading; open vocabulary; phonetic sequences; training aid; video tapes; visible speech synthesis;
Conference_Titel :
Acoustics, Speech, and Signal Processing, 1993. ICASSP-93., 1993 IEEE International Conference on
Conference_Location :
Minneapolis, MN, USA
Print_ISBN :
0-7803-7402-9
DOI :
10.1109/ICASSP.1993.319892
