Optimal point correspondence through the use of rank constraints

We propose a solution to the n-frame correspondence problem under the factorization framework. During the matching process, our algorithm takes explicitly into account the geometrical constraints associated to the reconstruction process. To this end, a rank constraint is imposed on the measurement matrix. Since our method relies solely on geometric constraints, it is not dependent on corners as image features and can consequently match generic points (e.g. contours). Outlier rejection is integrated as a part of the actual matching process. In general the problem is formulated as combinatorial, but we develop a method, which can provide a solution with a low computational complexity. Because of this, our algorithm is able to handle high-dimensional matching problems that are common in real-life applications.