Evaluation and user acceptance of a dialogue system using Wizard-Of-Oz recordings

In this paper we present the evaluation of a multi-user multimodal spoken dialogue system for the restaurant search task. We analyse user questionnaires and video recordings of dialogues obtained using the Wizard-of-Oz technique to estimate user appraisal and acceptance of our novel system. Despite the rather slow respondence time of the system, the over-all results of the evaluation are positive and encouraging and denote clear directions for further development and improvements of the system.