Title :
Spatio-temporal coherence for 3-D view synthesis with curve-based disparity warping
Author :
Hao Wang ; Xiaopeng Zhang ; Hongkai Xiong
Author_Institution :
Dept. of Electron. Eng., Shanghai Jiao Tong Univ., Shanghai, China
Abstract :
View synthesis is dedicated to generating arbitrary views of the same scene from given inputs. As an alternative to depth-image-based rendering (DIBR), image warping based view synthesis approaches could automatically generate visually plausible virtual views in real-time. Recognizing that existing techniques would lead to temporal incoherence and shape distortions in synthesized videos, this paper proposes a novel video warping algorithm which motion saliency map and global motion from reference views are incorporated into motion-aware constraints to maintain temporal coherence in virtual views. Furthermore, a salient curve based disparity constraint is imposed to prevent shape deformations and avoid possible artifacts. Extensive experiments are validated by visual comparison, which demonstrates that the proposed algorithm outperforms existing warping-based methods.
Keywords :
image motion analysis; rendering (computer graphics); shape recognition; 3D view synthesis; DIBR; curve based disparity warping; depth image based rendering; global motion; motion saliency map; shape deformations; shape distortions; spatio temporal coherence; temporal incoherence; video warping algorithm; videos synthesis; visually plausible virtual views; warping based methods; Cameras; Coherence; Estimation; Feature extraction; Shape; Three-dimensional displays; Videos; View synthesis; image warping; motion saliency map; salient curve detection; spatio-temporal coherence;
Conference_Titel :
Visual Communications and Image Processing Conference, 2014 IEEE
DOI :
10.1109/VCIP.2014.7051533