Content based video retrieval on mobile devices: How much content is enough?

In the field of content based video retrieval, recent work has focused on creation and matching of signatures as an effective method for video search, copy or “near-duplicate” detection. In this paper, we address the question of how much content is enough to initiate a content based video retrieval query from a mobile device. We extract and utilize the motion vectors from an HEVC-encoded bitstream and use them as the content-dependent features to create video signatures. We propose an energy function to quantify the mount of motion information contained in video. Our experimental results exhibit that our proposed approach is able to generate a signature robust to common signal processing techniques and that our proposed energy function can be efficiently used to select the length of a video clip used to query the video database from a mobile device.