Robust copy detection by mining temporal self-similarities

This paper introduces a self-similarity matrix (SSM) based video copy detection scheme and a visual character-string (VCS) descriptor for SSM matching. SSM, which exploits the spatial and temporal information in a video clip, is extracted from exhaustive calculation of distances between the frames. The SSM based method treats the video clip as a whole and transforms the temporal self-similarity into a matrix. Moreover, by implementing the proposed VCS descriptor, the problem of SSM alignment failure and size variation can also be solved properly. Experimental evaluations based on CIVR07 copy detection corpus validate the effectiveness of the proposed solution.