The use of homographies for view synthesis

The problem of synthesizing novel views consists of generating new views of a scene using at least two reference views. Although novel views might be rendered after the explicit 3D reconstruction of the scene, image based view synthesis is currently the most attractive approach. Image based view synthesis may be achieved through either epipolar geometry or trilinear tensors. We present a different approach based on plane homographies for image based view synthesis. Two cases are investigated here. In the first case, we assume that two physical planes in the scene can be identified and we show that a minimum of six matched points across three images is sufficient for view synthesis. In the second case however, we do not make any assumption and we show that we can calculate two plane homographies and use them for view synthesis. Experimental results on both real and simulated images show the feasibility and accuracy of our approach