3D hand posture recognition using MultiCam

This paper presents the hand posture recognition in 3D using the MultiCam, a monocular 2D/3D camera developed by Center of Sensorsystems (ZESS). The MultiCam is a camera which is capable to provide high resolution of color data acquired from CMOS sensors and low resolution of distance (or range) data calculated based on time-of-flight (ToF) technology using Photonic Mixer Device (PMD) sensors. The availability of the distance data allows the hand posture to be recognized in z-axis direction without complex computational algorithms which also enables the program to work in real-time processing as well as eliminates the background effectively. The hand posture recognition will employ a simple but robust algorithm by checking the number of fingers detected around virtually created circle centered at the Center of Mass (CoM) of the hand and therefore classifies the class associated with a particular hand posture. At the end of this paper, the technique that uses intersection between the circle and fingers as the method to classify the hand posture which entails the MultiCam capability is proposed. This technique is able to solve the problem of orientation, size and distance invariants by utilizing the distance data.