Projective depth: A geometric invariant for 3D reconstruction from two perspective/orthographic views and for visual recognition

The author addresses the problems of reconstructing 3-D space in a projective framework from two views and of artificially generating novel views of the scene from two given views. It is shown that with the correspondences coming from four non-coplanar points in the scene and the corresponding epipoles, it is possible to define and reconstruct a projective invariant, referred to as projective depth, that can be used later to reconstruct the projective or affine structure of the scene or directly to generate novel views of the scene. The derivation has the advantage that the viewing transformation matrix need not be recovered in the course of computations