Ten case studies of the effect of field conditions on speech recognition errors

The paper follows ten speech recognition services as they are deployed in live trials and services in the telephone network. We focus in particular on measured recognition accuracy in the lab setting, during the first field deployment, and through several field iterations. We cite factors that contribute to loss of accuracy when systems are used by real customers and relate how these problems are identified and overcome. We observe that a common pattern of performance emerges. We show that with proper planning, careful data collection and analysis, and adequate time for technology updates, field performance can match that of the laboratory