Spatio-temporal texture synthesis and image inpainting for video applications

In this paper we investigate the application of texture synthesis and image inpainting techniques for video applications. Working in the non-parametric framework, we use 3D patches for matching and copying. This ensures temporal continuity to some extent which is not possible to obtain by working with individual frames. Since, in present application, patches might contain arbitrary shaped and multiple disconnected holes, fast Fourier transform (FFT) and summed area table based sum of squared difference (SSD) calculation (S.L. Kilthau, et al, 2002) cannot be used. We propose a modification of above scheme which allows its use in present application. This results in significant gain of efficiency since search space is typically huge for video applications.