Projection and Interaction with Ad-hoc Interfaces on Non-planar Surfaces

Projector-based display systems have been used in area of computer interaction as Ad-hoc interface in recent time. The mobile hand-held projectors are becoming more popular. Many human centric user interfaces with the human wearable computer are being developed. Most of such system uses daily objects for projection and the interaction. But most of ignores the fact that these object surfaces are not planar. Hence such interfaces suffers from the distortion due to non-planar projection surface. Besides this projection quality also suffers from the radiometric distortion as well. Further more the interaction proposed with such interfaces bound to the planar surface only. Hence this paper is targeted to address the geometric distortion free projection of and interaction with such interfaces on non planar surfaces. Kinect is used as depth sensor for 3D scenario acquisition. We use image-per warping to mesh from Kinect. We use colored fingertip gloves for interaction. Here our system aims any day to day object surface for distortion free projection such as human body, curved wall, room corners, curtain´s and many more objects.