A system for teaching sign language using live gesture feedback

Author

Kelly, Daniel ; McDonald, John ; Markham, Charles

Author_Institution

N.U.I. Maynooth, Maynooth

fYear

2008

fDate

17-19 Sept. 2008

Firstpage

1

Lastpage

2

Abstract

This paper presents a computer vision based virtual learning environment for teaching communicative hand gestures used in sign language. A virtual learning environment was developed to demonstrate signs to the user. The system then gives real time feedback to the user on their performance of the demonstrated sign. Gesture features are extracted from a standard web-cam video stream and shape and trajectory matching techniques are applied to these features to determine the feedback given to the user.

Keywords

computer aided instruction; computer vision; feedback; gesture recognition; virtual reality; communicative hand gestures; computer vision; live gesture feedback; real time feedback; shape matching techniques; sign language teaching; standard web-cam video stream; trajectory matching techniques; virtual learning environment; Deafness; Education; Feature extraction; Feedback; Handicapped aids; Performance analysis; Principal component analysis; Real time systems; Shape; Streaming media;

fLanguage

English

Publisher

ieee

Conference_Titel

Automatic Face & Gesture Recognition, 2008. FG '08. 8th IEEE International Conference on

Conference_Location

Amsterdam

Print_ISBN

978-1-4244-2153-4

Electronic_ISBN

978-1-4244-2154-1

Type

conf

DOI

10.1109/AFGR.2008.4813350

Filename

4813350