Video bsckground inpainting using dynamic texture synthesis

This paper presents a novel framework that aims to complete background holes with still or dynamic textures in a video captured by a fixed or moving camera In our method, background mosaics are constructed based on camera motion estimation to establish the correspondence map between the to-be-filled pixels and the corresponding available or synthesized data obtained/trained from the non-occluded background in neighboring frames. By using a linear dynamic system model for dynamic texture analysis and synthesis, the proposed method can handle the completion of dynamic textured background. After filling the background holes with synthesized background data, we perform Mending-based post-processing on the boundaries of completed background in both the spatial and temporal domains to alleviate the artifacts of ghost shadows and flickers due to the spatio-temporal unsmoothed transitions on the boundaries. Experimental results show that the proposed method can nicely maintain both the spatial and temporal consistency of background after completion.