3D video coding using redundant-wavelet multihypothesis and motion-compensated temporal filtering

A video coder is presented that combines mesh-based motion-compensated temporal filtering, phase-diversity multihypothesis motion compensation, and an embedded 3D wavelet-coefficient coder. The key contribution of this work is the introduction of the phase-diversity multihypothesis paradigm into motion-compensated temporal filtering, which is achieved by deploying temporal filtering in the domain of a spatially redundant wavelet transform. A regular triangle mesh is used to track motion between frames, and an affine transform between mesh triangles implements motion compensation within a lifting-based temporal transform. Experimental results reveal that the incorporation of pulse-diversity multihypothesis into mesh-based motion-compensated temporal filtering significantly improves the rate-distortion performance of the 3D video coder.