Title :
American Sign Language recognition by using 3D geometric invariant feature and ANN classification
Author :
Tangsuksant, Watcharin ; Adhan, Suchin ; Pintavirooj, Chuchart
Author_Institution :
Dept. of Biomed. Eng., King Mongkut Inst. of Technol. Ladkrabang, Bangkok, Thailand
Abstract :
Communication between normal and disabled person has been developed in several researches. The hand gesture is one of important communication for the deaf, especially American Sign Language (ASL) which is used in order to represent each alphabet (A-Z). This paper aims to translate ASL from static postures. Besides, this research also designs the glove with six different colored markers and develops algorithm for alphabet classification. Moreover the system is set by two cameras in order to extract 3D coordinate points from each marker. There are three main important processes for algorithm consisting of marker detection by using Circle Hough Transform, computation of all feasible triangle area patches constructed from 3D coordinate triplet that is novel feature, and feature classification using feedforward backpropagation of Artificial Neural Network. The experimental result shows average of accuracy is 95 percent that is high performance and feasibility for proposed method.
Keywords :
Hough transforms; biomedical optical imaging; feature extraction; image classification; medical image processing; neural nets; sign language recognition; 3D coordinate points; 3D coordinate triplet; 3D geometric invariant feature; ANN classification; American sign language recognition; alphabet; alphabet classification; artificial neural network; cameras; circle Hough transform; colored markers; computation; deaf; feature classification; feedforward backpropagation; hand gesture; marker detection; static postures; Accuracy; Artificial neural networks; Assistive technology; Cameras; Feature extraction; Gesture recognition; Three-dimensional displays; 3D extraction; AAW; American Sign Language recognition; Geometric invariant feature;
Conference_Titel :
Biomedical Engineering International Conference (BMEiCON), 2014 7th
Conference_Location :
Fukuoka
DOI :
10.1109/BMEiCON.2014.7017372