Title :
Sign Language Recognition Using Intrinsic-Mode Sample Entropy on sEMG and Accelerometer Data
Author :
Kosmidou, Vasiliki E. ; Hadjileontiadis, Leontios J.
Author_Institution :
Dept. of Electr. & Comput. Eng., Aristotle Univ. of Thessaloniki, Thessaloniki, Greece
Abstract :
Sign language forms a communication channel among the deaf; however, automated gesture recognition could further expand their communication with the hearers. In this work, data from five-channel surface electromyogram and 3-D accelerometer from the signer´s dominant hand were analyzed using intrinsic-mode entropy (IMEn) for the automated recognition of Greek sign language (GSL) isolated signs. Discriminant analysis was used to identify the effective scales of the intrinsic-mode functions and the window length for the calculation of the IMEn that contributes to the efficient classification of the GSL signs. Experimental results from the IMEn analysis applied to GSL signs corresponding to 60-word lexicon repeated ten times by three native signers have shown more than 93% mean classification accuracy using IMEn as the only source of the classification feature set. This provides a promising bed-set toward the automated GSL gesture recognition.
Keywords :
accelerometers; electromyography; entropy; gesture recognition; handicapped aids; hearing aids; Greek sign language; IMEn analysis; accelerometer data; automated gesture recognition; deaf communication; discriminant analysis; five-channel surface electromyogram; intrinsic-mode sample entropy; sEMG; sign language recognition; Accelerometers; Communication channels; Data gloves; Deafness; Entropy; Handicapped aids; Hidden Markov models; Mobile communication; Recurrent neural networks; Shape; Vocabulary; Accelerometer; empirical mode decomposition (EMD); intrinsic-mode entropy (IMEn); sign recognition; surface electromyogram (sEMG); Acceleration; Algorithms; Communication Aids for Disabled; Electromyography; Entropy; Hand; Humans; Movement; Muscle Contraction; Pattern Recognition, Automated; Reproducibility of Results; Sensitivity and Specificity; Sign Language;
Journal_Title :
Biomedical Engineering, IEEE Transactions on
DOI :
10.1109/TBME.2009.2013200