Interactive augmented reality system using projector-camera system and smart phone

This paper proposes a user immersive augmented reality (AR) system which utilizes three kinds of computer vision technology: projector-camera-based spatial AR, hand-gesture-based user interaction, and mobile AR. The proposed system augments 2D virtual contents on a tabletop using the projector-camera-based AR, and a user can interact with the augmented 2D contents by using natural hand gestures and a physical object by using smart phone. Also, the proposed system further enhances user-immersion by adopting the mobile AR, which augments 3D virtual contents on the physical object when user sees the object through smart phone´s camera. This paper verifies the effectiveness of the proposed AR system through implementing a car driving application.