Evaluation of spoken language understanding and dialogue systems

Author

Hildebrandt, B. ; Rautenstrauch, H. ; Sagerer, G.

Author_Institution

AG Angewandte Inf., Bielefeld Univ., Germany

Volume

2

fYear

1996

fDate

3-6 Oct 1996

Firstpage

685

Abstract

A spoken-language understanding and dialogue system in the domain of appointment scheduling is presented. The system is capable of understanding complex times, e.g. it correctly combines discontinuous constituents and resolves ambiguities. A distributed representation of surface structure models and an incremental semantic analysis are used to manage the complexity. An elaborate evaluation of the system based on measurements of accuracy was carried out. Our approach combines pattern recognition with linguistic aspects, forming a system of measurement consisting of word accuracy, constituent accuracy and concept accuracy components

Keywords

linguistics; natural languages; pattern recognition; scheduling; speech recognition; time management; accuracy measurement; ambiguity resolution; appointment scheduling; complex times; complexity management; concept accuracy; constituent accuracy; dialogue system; discontinuous constituents; distributed representation; incremental semantic analysis; linguistic aspects; pattern recognition; spoken language understanding system; surface structure models; word accuracy; Natural languages; Scheduling; Speech analysis; Speech recognition; Surface structures; Testing;

fLanguage

English

Publisher

ieee

Conference_Titel

Spoken Language, 1996. ICSLP 96. Proceedings., Fourth International Conference on

Conference_Location

Philadelphia, PA

Print_ISBN

0-7803-3555-4

Type

conf

DOI

10.1109/ICSLP.1996.607454

Filename

607454