Interactive 3D visualization on a 4K wall-sized display

This paper introduces a novel vision-based approach for realistic interaction between user and display´s content. An extremely accurate motion capture system is proposed to measure and track the user´s head motion in 3D space. Video frames captured by the low-cost head-mounted camera are processed to retrieve the 3D motion parameters. The retrieved information facilitates the real-time 3D interaction. This technology turns any 2D screen to interactive 3D display, enabling users to control and manipulate the content as a digital window. The proposed system is tested and verified on a huge wall-sized 4K screen.