Subframe Video Synchronization via 3D Phase Correlation

This paper introduces an accurate approach for synchronization (temporal alignment) between two video sequences of the same dynamic scene captured by uncalibrated cameras. With the homography assumption in spatial domain, an iterative procedure that successively achieves the alignment in space and time is proposed and its convergence is experimentally verified. Subframe accuracy is achieved by extending the existing image subpixel registration scheme to subframe video synchronization. In order to demonstrate the accuracy of the proposed method, we adopt a novel use of audio signals for their high sampling rate to obtain the synchronization ground-truth. The proposed video synchronization technique has potential use in temporal super-resolution, image-based rendering and tele-immersion.