Improved Motion Vector Compression Using 3D-Warping

In recent years Auto stereoscopic display systems are being developed to give viewers a realistic 3D perception. Towards this end Multiview Plus Depth format is becoming increasingly popular. Using Depth Image Based Rendering algorithms additional views can be synthesized by the display device. In the past enhancement of Multiview Video Coding using depth image based 3D-warping has been explored, primarily to improve disparity estimation. Generally it is assumed that the camera array is static but this assumption is not valid for a realistic application. In this paper we propose a method to generate 3D-warped reference frames for temporally displaced frames. Temporal motion compensation is enhanced by tracking the camera motion. Our experiments show significant improvements in coding efficiency of motion vectors at similar PSNR values.