Title :
Gesture recognition using kinect for sign language translation
Author :
Verma, Harsh Vardhan ; Aggarwal, Eshan ; Chandra, Swarup
Author_Institution :
Dept. of Comput. Sc. & Eng., Jaypee Inst. of Inf. Technol., Noida, India
Abstract :
Sign Language is a widely used method of communication among the community of deaf-mute people. It contains some series of body gestures, which enables a person to interact without the need of spoken words. Although the use of sign language is very popular among the deaf-mute people but the other communities don´t even try to learn it, this creates a gulf of communication and hence becomes a cause of the isolation of physically impaired people. The problem creates a requirement of a system which can facilitate a way of communication between these two communities. This paper presents a novel method for identification of an isolated sign language gesture using Microsoft Kinect. This paper presents the way of extracting some highly robust features from the depth image provided by Kinect and to use them in creating a robust and accurate gesture recognition system, for the purpose of sign language translation. Apart from translation, the proposed system also opens the doors of endless applications in the field of Human Computer Interaction. The proposed algorithm helps in translating a sign language gesture performed by a user, which in-turn can be used as an input for different types of applications.
Keywords :
feature extraction; human computer interaction; language translation; sign language recognition; Microsoft Kinect; body gestures; deaf-mute people; depth image; gesture recognition system; human computer interaction; isolated sign language gesture; physically impaired people; robust feature extraction; sign language translation; Elbow; Feature extraction; Gesture recognition; Hidden Markov models; Thumb; Vectors; Gesture Recognition; Kinect; Natural Computing; OpenNI; Sign Language Translation;
Conference_Titel :
Image Information Processing (ICIIP), 2013 IEEE Second International Conference on
Conference_Location :
Shimla
Print_ISBN :
978-1-4673-6099-9
DOI :
10.1109/ICIIP.2013.6707563