Hole Filling on Three-Dimensional Surface Texture

Real-world surface textures normally comprise rough surface geometry and various reflectance properties. These surface textures are different from 2D still texture as their images can therefore vary dramatically with illumination directions. Research into hole filling has long been focusing on 2D images, surfaces of 3D models or video clips to reconstruct missing information around the hole area. However, no reports are available regarding hole filling for rough or 3D surface textures. This paper presents a simple framework for filling holes on 3D surface texture. Firstly, we represent 3D surface texture under varied illumination directions using gradient and albedo maps as well as eigen base images. Then, the hole area is searched and an order map is established for filling the hole iteratively using patches from surface representation. Finally, the filling algorithm for the 3D surface representation is performed according to the order map to generate missing information in the hole area. Experiments show that the proposed approach can not only produce hole-filled images under arbitrary illumination directions, but also has the ability to repair the surface geometry.