Interactive model reconstruction with user guidance

ProFORMA, an on-line reconstruction system for textured objects rotated by a user´s hand, can be coupled with augmented reality (AR) to allow users to rapidly generate textured 3D models. We demonstrate how the use of an overlaid mesh model and 3D arrow can be used to assist the user in view planning, guiding the user to collect new keyframes from desirable views. The method described is particularly suited for use with AR headsets, providing guidance with minimal user input and allowing in situ modelling using the head-mounted camera (ProFORMA does not require a completely stationary camera).