Multi stereo camera data fusion for fingertip detection in gesture recognition systems

In this paper we present our results of fingertip detection to realize an automatic gesture recognition system by using a multi stereo camera setup. The online framework detects automatically the hands and the face of the user based on depth and color information. To estimate the spatial position and the joints of fingers a 3D hand model was generated. We used the Iterative Closest Point (ICP) algorithm to calculate the distance error between the model and 3D input data. In addition a separation and evaluation of hand and fingertip movements was implemented. To solve the general problem of self-occlusion we developed a multi stereo camera system to increase the information density. The required calibration is presented by using ICP algorithm and Genetic Algorithm.