View Synthesis for Virtual Walk through in Real Scene Based on Catadioptric Omnidirectional Images

This paper proposes an approach to more conveniently and efficiently create virtual walk through in real scene from catadioptric omni directional images via view synthesis. Acquisition and unwarping process of omnidirectional image are discussed firstly, then, according to the speciality of cylindrical panoramic image, we utilize the advantage of epiline-sampling method for cylindrical image, which samples reference images along epilines as much as possible grounding on epipolar geometry. As to novel view generation after image rectification, a corresponding interpolation algorithm based on rectified images is developed. Results of proposed approach applied to both synthetic and real scene are given at the end of this paper. Experiments show that our method can reduce distortion and pixel information losing from image rectification obviously meanwhile maintain scene information well.