Talking faces

Author

Noh, Jun-yong ; Neumann, Ulrich

Author_Institution

Dept. of Comput. Sci., Univ. of Southern California, Los Angeles, CA, USA

Volume

2

fYear

2000

fDate

2000

Firstpage

627

Abstract

We present a method to generate mouth animations coupled with moderate movements of the head. Our method uses a coarse 2D textured mesh representation of images. With hardware texture mapping, we obtain 30 frames/sec animations on modest PC platforms. The synthesized animation sequence is realistic and lively. Radial basis functions are used in the underlying animation engine. At each phoneme transition, the positions of the mesh nodes are determined by RBF coefficients associated with a set of sparse feature points. Blending textures from key frame images on the displaced mesh produces animation sequences of talking faces

Keywords

computer animation; image morphing; image texture; multimedia computing; radial basis function networks; speech processing; PC platform; animation engine; coarse 2D textured mesh representation; key frame images; mesh nodes; mouth animations; phoneme transition; radial basis functions; sparse feature points; talking faces; texture mapping; Deformable models; Engines; Facial animation; Head; Image databases; Image segmentation; Mouth; Muscles; Pixel; Teleconferencing;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia and Expo, 2000. ICME 2000. 2000 IEEE International Conference on

Conference_Location

New York, NY

Print_ISBN

0-7803-6536-4

Type

conf

DOI

10.1109/ICME.2000.871441

Filename

871441