A Multitouchless Interface: Expanding User Interaction

Author

Krejov, Philip ; Gilbert, A. ; Bowden, Richard

Author_Institution

Univ. of Surrey, Guildford, UK

Volume

34

Issue

3

fYear

2014

fDate

May-June 2014

Firstpage

40

Lastpage

48

Abstract

A proposed multitouchless interface accurately tracks users´ hands and fingers in 3D, using a Microsoft Kinect sensor. The system tracks up to four hands simultaneously on a standard desktop computer at 30 fps, with approximately 5-mm accuracy. From this basic tracking, the system identifies gestures and uses them for interaction. The Making Sense demonstrator applied this technology to let users quickly summarize and explore complex multimedia data taken from hard drives.

Keywords

graphical user interfaces; Microsoft Kinect sensor; multimedia data; multitouchless interface; user interaction; Haptic interfaces; Real-time systems; Three-dimensional displays; Tracking; User interfaces; 3D; GUIs; Haptic interfaces; Real-time systems; Three-dimensional displays; Tracking; User interfaces; anamorphic projection; computer graphics; computer vision; data analysis; data mining; depth; digital forensics; fingertip tracking; gesture recognition; graphical user interfaces; graphics; hand pose; human-computer interaction; intelligent systems; interactive displays; machine learning; semantic labeling;

fLanguage

English

Journal_Title

Computer Graphics and Applications, IEEE

Publisher

ieee

ISSN

0272-1716

Type

jour

DOI

10.1109/MCG.2014.44

Filename

6813977