Captured open book image de-warping using depth information

In this work, we discuss the use of depth information to correct the distortion due to the curved shape of the pages of an open book in captured images. This work is relevant to camera-based capture devices that can use a projector to cast structured light patterns to provide depth information. In order to improve the visual quality of captured documents, we use 3D shape reconstruction methods and geometric rectification to flatten the curvature of an open book. Shading correction is applied to the captured image, as well. Our models exploit specific prior assumptions about the nature of the printed material that is captured. The improvement in captured open book images obtained by using our method can be observed in the included experimental results.