Spoken Dialog Challenge 2010

This paper describes the 2010 Spoken Dialog Challenge, a multi-site challenge to help investigate different spoken dialog system and evaluation techniques. The aim of the Challenge is to bring together multiple implementations of the same dialog task and deploy them in uncontrolled real user conditions and then make the results available for common evaluation techniques. This paper gives an overview of teh Challenge itself and the task, and presents the results for the “controlled task” part of the evaluation. The paper also discusses the infrastructure and organizational issues encountered and the solutions that made this challenge possible.