Lip tracking for MPEG-4 facial animation

Author

Wu, Zhilin ; Aleksic, Petar S. ; Katsaggelos, Aggelos K.

Author_Institution

Dept. of Electr. & Comput. Eng., Northwestern Univ., Evanston, IL, USA

fYear

2002

fDate

2002

Firstpage

293

Lastpage

298

Abstract

It is very important to accurately track the mouth of a talking person for many applications, such as face recognition and human computer interaction. This is in general a difficult problem due to the complexity of shapes, colors, textures, and changing lighting conditions. We develop techniques for outer and inner lip tracking. From the tracking results FAPs are extracted which are used to drive an MPEG-4 decoder. A novel method consisting of a Gradient Vector Flow (GVF) snake with a parabolic template as an additional external force is proposed. Based on the results of the outer lip tracking, the inner lip is tracked using a similarity function and a temporal smoothness constraint. Numerical results are presented using the Bernstein database.

Keywords

code standards; computer animation; feature extraction; image motion analysis; telecommunication standards; tracking; user interfaces; video coding; visual databases; Bernstein database; Gradient Vector Flow snake; MPEG-4 facial animation; decoder; face recognition; human computer interaction; image color; image texture; lighting conditions; lip tracking; multimedia compression; parabolic template; shapes; similarity function; talking person mouth tracking; temporal smoothness constraint; Application software; Databases; Decoding; Face recognition; Facial animation; Financial advantage program; Human computer interaction; MPEG 4 Standard; Mouth; Shape;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimodal Interfaces, 2002. Proceedings. Fourth IEEE International Conference on

Print_ISBN

0-7695-1834-6

Type

conf

DOI

10.1109/ICMI.2002.1167009

Filename

1167009