Title :
Automatic saliency inspired foreground object extraction from videos
Author :
Wei-Te Li ; Hui-Tang Chang ; Lyu, H.S. ; Wang, Y.F.
Author_Institution :
Res. Center for Inf. Technol. Innovation, Acad. Sinica, Taipei, Taiwan
fDate :
Sept. 30 2012-Oct. 3 2012
Abstract :
In this paper, we propose a saliency inspired video object extraction (VOE) method to extract and segment foreground objects of interest from videos captured by freely moving cameras. Our method aims at detecting visual and motion salient regions from an input video, and thus we integrate such cosaliency information with the associated foreground and background color models to achieve VOE. A conditional random field (CRF) is applied in our framework to automatically identify the foreground object regions based on the above features, while our method does not need any prior knowledge on the foreground objects of interest or any interaction from the users. Experiments on a variety of videos confirm that our method is able to provide quantitatively and qualitatively more satisfactory results when comparing to state-of-the-art VOE approaches.
Keywords :
feature extraction; image colour analysis; image segmentation; video signal processing; CRF; VOE method; automatic saliency inspired foreground object extraction; background color models; conditional random field; foreground color models; foreground object segmentation; freely moving cameras; motion salient regions; video object extraction method; visual salient regions; Color; Data mining; Image color analysis; Image segmentation; Optical imaging; Videos; Visualization; Video object extraction; conditional random field; saliency;
Conference_Titel :
Image Processing (ICIP), 2012 19th IEEE International Conference on
Conference_Location :
Orlando, FL
Print_ISBN :
978-1-4673-2534-9
Electronic_ISBN :
1522-4880
DOI :
10.1109/ICIP.2012.6467053