Construction of perspective and panoramic images from omni-images taken from hypercatadioptric cameras for visual surveillance

A novel method for construction of perspective and panoramic images from omni-images taken from hypercatadioptric cameras for visual surveillance is proposed. The constructing work includes two major steps: unwarping of the omni-image into a rectangularly tessellated perspective or panoramic image, followed by interpolation of the coordinates of the image pixels which are unfilled in the first step. For the former step, techniques for combining the uses of a back-projection method and some geometric relations within the camera system to yield a forward-projection effect to accomplish the unwarping task are employed. And for the latter step, a novel scheme, called 8-directional-regions interpolation, to interpolate the unfilled pixels´ coordinates in the image yielded in the first step to complete the image construction work is proposed. Good experimental results are also included to show the feasibility of the proposed method.