Nearly-repetitive video synchronisation using nonlinear manifold embedding

This paper introduces a new method for synchronising nearly repetitive video sequences using manifold embedding. The approach recovers the optimal correspondences between two frame sequences in the embedded space. The synchronised map is estimated based on the spatio-temporal extension of Isomap. It is evaluated using the TRECVID rushes video collection. The accuracy for repetitive shot synchronisation is scored using precision and recall of all generated edges on synchronised graph. We show that the approach significantly improves the embedding for repetitive manifolds over the well investigated methods such as multidimensional scaling, locally linear embedding, and the conventional Isomap.