Title :
A linear estimation method for 3D pose and facial animation tracking
Author :
Zepeda, José Alonso Ybáñez ; Davoine, Franck ; Charbit, Maurice
Author_Institution :
E.N.S.T., Paris
Abstract :
This paper presents an approach that incorporates Canonical Correlation Analysis (CCA) for monocular 3D face pose and facial animation estimation. The CCA is used to find the dependency between texture residuals and 3D face pose and facial gesture. The texture residuals are obtained from observed raw brightness shape-free 2D image patches that we build by means of a parameterized 3D geometric face model. This method is used to correctly estimate the pose of the face and the model´s animation parameters controlling the lip, eyebrow and eye movements (encoded in 15 parameters). Extensive experiments on tracking faces in long real video sequences show the effectiveness of the proposed method and the value of using CCA in the tracking context.
Keywords :
computer animation; gesture recognition; image sequences; image texture; 3D face pose; 3D pose tracking; canonical correlation analysis; facial animation estimation; facial animation tracking; facial gesture; linear estimation method; texture residuals; video sequences; Active appearance model; Computer vision; Eyebrows; Face detection; Facial animation; Geometry; Magnetic heads; Shape control; Solid modeling; Video sequences;
Conference_Titel :
Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on
Conference_Location :
Minneapolis, MN
Print_ISBN :
1-4244-1179-3
Electronic_ISBN :
1063-6919
DOI :
10.1109/CVPR.2007.383406