Multiple View Region Matching as a Lagrangian Optimization Problem

A method to establish correspondences between regions belonging to independent segmentations of multiple views of a scene is presented. The trade-off between color similarity and projective similarity of the matching regions is formulated in terms of a constrained optimization, analogous to a rate-distortion budget-constrained allocation problem, and solved using Lagrangian optimization techniques.