Lip Localization on Multi-View Faces in Video

Author

Ma, Rui ; Wu, Yi ; Hu, Wei ; Wang, Jiaxin ; Wang, Tao ; Zhang, Yimin ; Lu, Hanqing

Author_Institution

Tsinghua Univ., Beijing

fYear

2007

fDate

2-5 July 2007

Firstpage

1395

Lastpage

1398

Abstract

In this paper, a real time and robust multi-view lip localization in video frames is proposed. The objective of this research is to exactly localize lip surrounding box with sub-pixel accuracy in low quality video frames. This is achieved by multi-view face detection in video frames, lip ROI extraction, color space transformation, vertical edge feature detection and lip localization by a feature-spatial profile analysis on a joint color-edge plane. One possible application of talking face detection in video is used to evaluate our work. Experimental results on TV programs and movies demonstrate that the proposed approach is efficient and robust in lip localization.

Keywords

edge detection; face recognition; feature extraction; image colour analysis; video signal processing; ROI extraction; TV programs; color space transformation; feature-spatial profile analysis; joint color-edge plane; lip localization; multi view face detection; sub pixel accuracy; vertical edge feature detection; video frames; Face detection; Head; Image quality; Image segmentation; Laboratories; Lips; Motion pictures; Robustness; Skin; TV;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia and Expo, 2007 IEEE International Conference on

Conference_Location

Beijing

Print_ISBN

1-4244-1016-9

Electronic_ISBN

1-4244-1017-7

Type

conf

DOI

10.1109/ICME.2007.4284920

Filename

4284920