Tracking facial motion

Author

Essa, Irfan A. ; Darrell, Trevor ; Pentland, Alex

Author_Institution

Media Lab., MIT, Cambridge, MA, USA

fYear

1994

fDate

11-12 Nov 1994

Firstpage

36

Lastpage

42

Abstract

We describe a computer system that allows real-time tracking of facial expressions. Sparse, fast visual measurements using 2D templates are used to observe the face of a subject. Rather than track features on the face, the distributed response of a set of templates is used to characterize a given facial region. These measurements ape coupled via a linear interpolation method to states in a physically-based model of facial animation, which includes both skin and muscle dynamics. By integrating real-time 2D image-processing with 3D models we obtain a system that is able to quickly track and interpret complex facial motions

Keywords

computer animation; image processing; interpolation; real-time systems; tracking; 2D templates; 3D models; complex facial motion interpretation; computer system; distributed response; facial animation; facial expressions; facial motion tracking; linear interpolation method; muscle dynamics; physically-based model; real-time 2D image-processing; real-time tracking; sparse fast visual measurements; templates; Face detection; Facial animation; Interpolation; Laboratories; Muscles; Power system modeling; Real time systems; Skin; Solid modeling; Tracking;

fLanguage

English

Publisher

ieee

Conference_Titel

Motion of Non-Rigid and Articulated Objects, 1994., Proceedings of the 1994 IEEE Workshop on

Conference_Location

Austin, TX

Print_ISBN

0-8186-6435-5

Type

conf

DOI

10.1109/MNRAO.1994.346257

Filename

346257