Gestural interface and the intuitive interaction with virtual objects

In the study of virtual reality and mixed reality, the developments of an input device and user interface are important for the interaction with virtual objects and environment. However, a mouse or a joystick is commonly used in present systems. If we could manipulate a virtual object intuitively by using natural gestures without any sensors or devices, the system would contribute to present reality. In this paper, we introduce a technique to let a user move his hand in front of a camera to manipulate a virtual object, and the gestural movements are recognized in real-time to establish an interactive communication with computational systems.