Robust upper limb tracking for large interactive displays

In this paper, an approach is proposed for the robust tracking of upper body movement in unconstrained environments by using a Haar-Disparity algorithm together with a novel 2D silhouette projection algorithm. Haar-Disparity improves on the traditional skin manifold tracking by relaxing constraints on clothing, background and illumination. The 2D silhouette projection algorithm provides three orthogonal views of the 3D objects. This allows tracking of upper limbs to be performed in the 2D space as opposed to manipulating 3D noisy data directly. This paper also proposes a complete optimal set of interactions for very large interactive displays. The experimental results suggest that the proposed algorithm and optimal set of interactions are useful for interacting with large displays.