Deciphering layered meaning in gestures

Author

Ong, Sylvie C W ; Ranganath, Surendra ; Venkatesh, Y.V.

Author_Institution

Dept of Electr. & Comput. Eng., Nat. Univ. of Singapore, Singapore

Volume

3

fYear

2002

fDate

2002

Firstpage

815

Abstract

Signs produced by gestures (such as in American Sign Language) can have a basic meaning coupled with additional meanings that are layered over the basic meaning of the sign. These layered meanings are conveyed by temporal and spatial modification of the basic form of the gesture movement. The work reported in this paper seeks to recognize temporal and spatial modifiers of hand movement and integrates them with recognition of the basic meaning of the sign. To this end, a Bayesian network framework is explored with a simulated vocabulary of 4 basic signs which give rise to 14 different combinations of basic meanings and layered meanings. Recognition accuracies of up to 88.2% were obtained.

Keywords

belief networks; gesture recognition; vocabulary; American Sign Language; Bayesian network framework; gestures; hand movement; layered meaning deciphering; recognition accuracy; signs; simulated vocabulary; spatial modification; temporal modification; Acceleration; Character recognition; Dictionaries; Drives; Handicapped aids; Hidden Markov models; Humans; Pattern recognition; Production; Shape;

fLanguage

English

Publisher

ieee

Conference_Titel

Pattern Recognition, 2002. Proceedings. 16th International Conference on

ISSN

1051-4651

Print_ISBN

0-7695-1695-X

Type

conf

DOI

10.1109/ICPR.2002.1048145

Filename

1048145