Title :
The Current State of Language Recognition: NIST 2005 Evaluation Results
Author :
Martin, Alvin F. ; Le, Audrey N.
Author_Institution :
Nat. Inst. of Stand. & Technol., Gaithersburg, MD
Abstract :
The National Institute of Standards and Technology (NIST) coordinated in 2005 an evaluation of language recognition capabilities of research systems developed by twelve participating sites. This evaluation followed fairly similar evaluations in 1996 and 2003. We describe here the protocols of the 2005 evaluation, including the data used, the evaluation rules, and the scoring metric. We present the overall performance results and compare these to results for the previous evaluations. We also discuss how the results varied across languages and the results of limited dialect recognition tests involving English and Mandarin speech data
Keywords :
natural languages; protocols; speech recognition; English; Mandarin speech data; NIST 2005; National Institute of Standards and Technology; language recognition; protocol; Africa; Automatic testing; Europe; NIST; Natural languages; Protocols; Speech analysis; Speech recognition; System testing; Telephony;
Conference_Titel :
Speaker and Language Recognition Workshop, 2006. IEEE Odyssey 2006: The
Conference_Location :
San Juan
Print_ISBN :
1-424400471-1
Electronic_ISBN :
1-4244-0472-X
DOI :
10.1109/ODYSSEY.2006.248104
