Constructing 3D position tracking system with Twin-Wiimote Structure

In this paper we describe the use of a standard game console joystick, namely the Nintendo WIIMOTE, for an active real-time 3D marker tracking. We show the ease of applicability of inexpensive and standard game controllers for 3D object tracking, e. g to track an infrared source in 3D space. Recovering the 3D information using stereo vision is still one of the major research areas in computer vision. In this paper we present the method for a Wiimote stereo pair to estimate the fingers of the users in virtual scene, finally achieve the purpose of virtual environment interaction. The comparison between the orthogonal structure and non-orthogonal tracking system is presented. According to the experimental results, the framework can effectively estimate the 3D virtual object space coordinates.