Title :
Geometrically Consistent Stereoscopic Image Editing Using Patch-Based Synthesis
Author :
Sheng-Jie Luo ; Ying-Tse Sun ; I-Chao Shen ; Bing-Yu Chen ; Yung-Yu Chuang
Author_Institution :
Nat. Taiwan Univ., Taipei, Taiwan
Abstract :
This paper presents a patch-based synthesis framework for stereoscopic image editing. The core of the proposed method builds upon a patch-based optimization framework with two key contributions: First, we introduce a depth-dependent patch-pair similarity measure for distinguishing and better utilizing image contents with different depth structures. Second, a joint patch-pair search is proposed for properly handling the correlation between two views. The proposed method successfully overcomes two main challenges of editing stereoscopic 3D media: (1) maintaining the depth interpretation, and (2) providing controllability of the scene depth. The method offers patch-based solutions to a wide variety of stereoscopic image editing problems, including depth-guided texture synthesis, stereoscopic NPR, paint by depth, content adaptation, and 2D to 3D conversion. Several challenging cases are demonstrated to show the effectiveness of the proposed method. The results of user studies also show that the proposed method produces stereoscopic images with good stereoscopics and visual quality.
Keywords :
controllability; image texture; optimisation; stereo image processing; 2D to 3D conversion; content adaptation; depth interpretation; depth-dependent patch-pair similarity measure; depth-guided texture synthesis; geometrically consistent stereoscopic image editing; joint patch-pair search; paint by depth; patch-based optimization framework; patch-based synthesis; scene depth controllability; stereoscopic 3D media editing; stereoscopic NPR; visual quality; Image color analysis; Joints; Media; Stereo image processing; Three-dimensional displays; Visualization; Stereoscopic images; patch-based synthesis;
Journal_Title :
Visualization and Computer Graphics, IEEE Transactions on
DOI :
10.1109/TVCG.2014.2327979