DocumentCode
1565089
Title
Image-based talking heads using radial basis functions
Author
Edge, James D. ; Maddock, Steve
Author_Institution
Sheffield Univ., UK
fYear
2003
Firstpage
74
Lastpage
80
Abstract
In recent years talking heads have received a great deal of interest, both in their application to natural human-computer dialogue, and their benefit to the intelligibility of synthesized speech. A model for the realistic synthesis of visual speech animation is described. Images representing the key visual speech poses (visemes) are pre-recorded and labeled. Transitions between visemes are created by using an image morphing technique based upon the use of radial basis functions. Timing information from the festival speech synthesis system is used to plan the appropriate transitions to create realistic speech animation. A model of coarticulation is included in the system to improve the realism of articulatory motion.
Keywords
computer animation; image morphing; radial basis function networks; speech intelligibility; speech synthesis; speech-based user interfaces; Festival speech synthesis system; articulatory motion; audio-visual speech synthesizer; coarticulation model; image morphing; image-based talking head; key visual speech poses; natural human-computer dialogue; radial basis function; realistic speech animation; realistic synthesis; synthesized speech intelligibility; timing information; visemes; visual speech animation; Deformable models; Facial animation; Focusing; Head; Interpolation; Lattices; Muscles; Scattering; Speech synthesis; Synthesizers;
fLanguage
English
Publisher
ieee
Conference_Titel
Theory and Practice of Computer Graphics, 2003. Proceedings
Print_ISBN
0-7695-1942-3
Type
conf
DOI
10.1109/TPCG.2003.1206933
Filename
1206933
Link To Document