Speech into Sign Language Statistical Translation System for Deaf People

Author

Gallo, B. ; San-Segundo, R. ; Lucas, J.M. ; Barra, R. ; D´Haro, Luis Fernando ; Fernandez, F.

Author_Institution

Dept. de Ing. Electron., Univ. Politec. de Madrid, Madrid, Spain

Volume

7

Issue

3

fYear

2009

fDate

7/1/2009 12:00:00 AM

Firstpage

400

Lastpage

404

Abstract

This paper presents a set of experiments used to develop a statistical system from translating speech to sign language for deaf people. This system is composed of an Automatic Speech Recognition (ASR) system, followed by a statistical translation module and an animated agent that represents the different signs. Two different approaches have been used to perform the translations: a phrase-based system and a finite state transducer. For the evaluation, the followings figures have been considered: WER (Word Error Rate), BLEU and NIST. The paper presents translation results of reference sentences and sentences from the automatic speech recognizer. Also three different configurations have been evaluated for the speech recognizer. The best results were obtained with the finite state transducer, with a word error rate of 28.21% for the reference text, and 29.27% using the ASR output.

Keywords

language translation; speech recognition; automatic speech recognition; deaf people; language model; sign language; statistical machine translation; translation model; word error rate; Animation; Automatic speech recognition; Deafness; Error analysis; Handicapped aids; NIST; Speech analysis; Speech recognition; Telecommunications; Transducers; Finite State Transducer; Language Model; Sign Language; Statistical Machine Translation; Translation Model; alignment; phrase; word error rate;

fLanguage

English

Journal_Title

Latin America Transactions, IEEE (Revista IEEE America Latina)

Publisher

ieee

ISSN

1548-0992

Type

jour

DOI

10.1109/TLA.2009.5336641

Filename

5336641