Title :
A Sparse and Low-rank approach to efficient face alignment for photo-real talking head synthesis
Author :
Wu, King Keung ; Wang, Lijuan ; Soong, Frank K. ; Yam, Yeung
Author_Institution :
Microsoft Res. Asia, Beijing, China
Abstract :
In this paper, we propose a framework for practical large-scale face alignment, based on the recent development of Robust Alignment by Sparse and Low-rank Decomposition for linearly correlated images (RASL). Unfortunately, the original implementation is not applicable in large image dataset. We extend this technique to deal with the situation with millions of images, with the aid of l1-regularized least squares. Our proposal is applied onto the photo-real talking head, a challenging application which requires highly precise alignments of faces from video sequences. We verify the efficacy of our algorithm with experiments using real talking head data. Our method attains comparable quality to RASL in the experiments.
Keywords :
correlation methods; face recognition; human computer interaction; image sequences; least squares approximations; video signal processing; RASL; image dataset; l1-regularized least squares method; large-scale face alignment; linearly correlated images; photo-real talking head synthesis; robust alignment by sparse and low-rank decomposition; video sequences; Dictionaries; Face; Least squares approximation; Mouth; Robustness; Three dimensional displays; face alignment; l1-regularized least squares; photo-real; talking head;
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on
Conference_Location :
Prague
Print_ISBN :
978-1-4577-0538-0
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2011.5946674