Title :
Texture replacement in real images
Author :
Tsin, Yanghai ; Liu, Yanxi ; Ramesh, Visvanathan
Author_Institution :
Robotics Inst., Carnegie Mellon Univ., Pittsburgh, PA, USA
Abstract :
Texture replacement in real images has many applications, such as interior design, digital movie making and computer graphics. The goal is to replace some specified texture patterns in an image while preserving lighting effects, shadows and occlusions. To achieve convincing replacement results we have to detect texture patterns and estimate the lighting map from a given image. Near regular planar texture patterns are considered in this paper. Given a sample texture patch, a standard tile is computed. Candidate texture regions are determined by mutual information between the standard tile and each image patch. Regions with high mutual information scores are used to estimate the admissible lighting distributions, which is represented by cached statistics. Spatial lighting change constraints are represented by a Markov random field model. Maximum a posteriori estimation of the texture segmentation and lighting map is solved in a stochastic annealing fashion, namely, the Markov chain Monte Carlo method. Visually satisfactory result is achieved using this statistical sampling model.
Keywords :
Markov processes; Monte Carlo methods; computer vision; image segmentation; image texture; Markov chain Monte Carlo method; cached statistics; computer graphics; digital movie making; image patch; interior design; lighting effect preservation; lighting map estimation; maximum a posteriori estimation; mutual information; near regular planar texture patterns; real images; sample texture patch; shadows preservation; spatial lighting change constraints; statistical sampling model; stochastic annealing; texture pattern detection; texture replacement; texture segmentation; tile; Application software; Computer graphics; Image segmentation; Markov random fields; Maximum a posteriori estimation; Motion pictures; Mutual information; Statistical distributions; Stochastic processes; Tiles;
Conference_Titel :
Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on
Print_ISBN :
0-7695-1272-0
DOI :
10.1109/CVPR.2001.991009