Title :
A grammar based method for systematic and generic spoken language understanding systems evaluation
Author :
Kurdi, Mohamed-Zakaria ; Ahafhaf, Mohamed
Author_Institution :
Natural Interactive Syst. Lab., Univ. of Southern Denmark, Odense, Denmark
Abstract :
We present a grammar based framework for deep evaluation of spoken language understanding (SLU) systems. The key point of our method is the use of a linguistic typology in order to generate an evaluation corpus that covers a significant number of the linguistic phenomena we want to evaluate our system on. This allows a more objective and deep evaluation of SLU systems.
Keywords :
computational linguistics; grammars; natural languages; speech processing; grammar based method; linguistic typology; spoken language understanding systems evaluation; Control systems; Interactive systems; Laboratories; Natural languages; System testing;
Conference_Titel :
Natural Language Processing and Knowledge Engineering, 2003. Proceedings. 2003 International Conference on
Conference_Location :
Beijing, China
Print_ISBN :
0-7803-7902-0
DOI :
10.1109/NLPKE.2003.1275956
