Scalable multiview video coding using wavelet

In this paper, we propose a multiview video coding (MVC) scheme based on wavelets which can provide temporal, spatial, SNR as well as view scalabilities. To the best of our knowledge, wavelets have not been used for MVC in the literature before. In particular, we consider a multiview video as a 2D matrix with 1D along the temporal axis, 1D along the view axis, and each element in the 2D matrix represents a video frame. We first apply 1D wavelet decomposition to the 2D matrix along the temporal axis with motion compensation, and then along the view axis with disparity compensation. After that, 2D spatial wavelet decomposition is applied to each element in the matrix. Finally, all the subbands are encoded by 3D-ESCOT with rate-distortion optimization. Compared with traditional 3D wavelet coding, our proposed wavelet-based MVC scheme applies one more dimensional wavelet transform along the view direction to exploit the redundancy between adjacent views. Some preliminary experiments are carried out using standard multiview video sequences and the efficiency of the proposed system is confirmed.