Joint Geometric Verification and Ranking Using Multi-view Vocabulary Trees for Mobile 3D Visual Search

This paper proposes multi-view vocabulary trees for mobile 3D visual search. We generate hierarchically structured multi-view features and construct a multi-view vocabulary tree from the multi-view images. As the 3D geometry information is incorporated in the multi-view vocabulary tree, it allows us to design an algorithm for fast 3D geometric verification at low computational complexity. With that, we devise an iterative algorithm that accomplishes jointly matching and geometric verification. The experimental results show that our joint approach to matching and verification improves the recall-data rate performance as well as the subjective ranking results for mobile 3D visual search.