Haarlet-based hand gesture recognition for 3D interaction

This paper presents a system to manipulate 3D objects or navigate through 3D models by detecting the gestures and the movements of the hands of a user in front of a camera mounted on top of a screen. This paper more particularly introduces an improved skin color segmentation algorithm which combines an online and an offline model; and a Haarlet-based hand gesture recognition system, where the Haarlets are trained based on Average Neighborhood Margin Maximization (ANMM). The result is a real-time marker-less interaction system which is applied to two applications, one for manipulating 3D objects, and the other for navigating through a 3D model.