Collaborative walkthrough using 3D warping

A remote walkthrough environment based on 3D superview warping and view compensation streaming is presented. In the environment, 3D views are rendered on the remote clients using 3D oversized reference views and compensated on a view-on-demand basis by the graphically rendered views from the server. The view compensations (hole residuals and the depth map) are coded using a layered joint source-channel coding with unequal error corrections to protect the significant packets on noisy and erasure mobile channels. The new compensated view will then serve as a reference view for the subsequent rendering on the clients.