Title :
Human pose search using deep poselets
Author :
Jammalamadaka, Nataraj ; Zisserman, Andrew ; Jawahar, C.V.
Abstract :
Human pose as a query modality is an alternative and rich experience for image and video retrieval. We present a novel approach for the task of human pose retrieval, and make the following contributions: first, we introduce `deep poselets´ for pose-sensitive detection of various body parts, that are built on convolutional neural network (CNN) features. These deep poselets significantly outperform previous instantiations of Berkeley poselets [2]. Second, using these detector responses, we construct a pose representation that is suitable for pose search, and show that pose retrieval performance exceeds previous methods by a factor of two. The compared methods include Bag of visual words [24], Berkeley poselets [2] and Human pose estimation algorithms [28]. All the methods are quantitatively evaluated on a large dataset of images built from a number of standard benchmarks together with frames from Hollywood movies.
Keywords :
image representation; image retrieval; neural nets; pose estimation; video retrieval; Berkeley poselets; CNN; Hollywood movies; bag of visual words; body parts; convolutional neural network features; deep poselets; detector responses; human pose estimation algorithms; human pose retrieval; human pose search; image retrieval; pose representation; pose-sensitive detection; video retrieval; Cognition; Databases; Feature extraction; Hip; Motion pictures; Search methods; Training;
Conference_Titel :
Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops on
Conference_Location :
Ljubljana
DOI :
10.1109/FG.2015.7163099