Building Virtual Entertainment Environment with Tiled Display Wall and Motion Tracking

Presented in this paper is an immersive and interactive entertainment environment which integrates multi-projector tiled display wall and motion tracking. Calibration methods are proposed for the geometry alignment and color consistency of the tiled display wall, achieving immersive visual experience. To track a player´s motion, two markers are clung to the left and right leg, and a robust motion tracking algorithm is designed to obtain the player´s moving direction and speed from video streams captured by a web camera. The resulted parameters are finally used to control the avatar in virtual scene on the display wall. The system prototype is featured with low-cost devices, easy and scalable installation, fast calibration and real-time tracking, which provides a natural human-computer interaction environment.