Title :
Depth-Based Disocclusion Filling for Virtual View Synthesis
Author :
Ahn, Ilkoo ; Kim, Changick
Author_Institution :
Dept. of Electr. Eng., Korea Adv. Inst. of Sci. & Technol. (KAIST), Daejeon, South Korea
Abstract :
Free-viewpoint rendering (FVR) has become a popular topic in 3D research. A promising technology in FVR is to generate virtual views using a single texture image and the corresponding depth image. A critical problem that occurs when generating virtual views is that the regions covered by the foreground objects in the original view may be disoccluded in the synthesized views. In this paper, a depth based disocclusion filling algorithm using patch based texture synthesis is proposed. In contrast to the existing patch based virtual view synthesis methods, the filling priority is driven by the robust structure tensor and the epipolar directional term. Moreover, the best-matched patch is searched in the background regions and finally the best-matched patch is chosen by considering the color similarity and some factors such as epipolar line and the magnitude of data term. Superiority of the proposed method over the existing methods is proved by comparing the experimental results.
Keywords :
image colour analysis; image texture; rendering (computer graphics); FVR; best-matched patch; color similarity; depth-based disocclusion filling; epipolar directional term; epipolar line; free-viewpoint rendering; patch based virtual view synthesis; robust structure tensor; single texture image; Eigenvalues and eigenfunctions; Filling; Image edge detection; Rendering (computer graphics); Robustness; Tensile stress; Vectors; depth image based rendering; disocclusion filling; free viewpoint rendering; image inpainting; view synthesis;
Conference_Titel :
Multimedia and Expo (ICME), 2012 IEEE International Conference on
Conference_Location :
Melbourne, VIC
Print_ISBN :
978-1-4673-1659-0
DOI :
10.1109/ICME.2012.95