• DocumentCode
    3427532
  • Title

    Efficient computation of confidence intervals forword error rates

  • Author

    Vilar, Juan Miguel

  • Author_Institution
    Dept. de Lenguajes y Sist. Informaticos, Univ. Jaume I, Castellon
  • fYear
    2008
  • fDate
    March 31 2008-April 4 2008
  • Firstpage
    5101
  • Lastpage
    5104
  • Abstract
    Word error rate is a standard measure of quality for different tasks such as speech recognition, OCR or machine translation. As such, it is important to compute it together with confidence intervals. Previous works in the literature employ Monte Carlo methods in order to compute those intervals. We show how to compute them without simulations. We also adapt a method that compares two systems over the same test data so that it can be used without simulations.
  • Keywords
    error statistics; language translation; optical character recognition; speech recognition; Monte Carlo methods; OCR; confidence intervals; machine translation; speech recognition; word error rates; Computational modeling; Distributed computing; Error analysis; Length measurement; Measurement standards; Optical character recognition software; Random variables; Sampling methods; Speech recognition; System testing; error analysis; word error rate;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Acoustics, Speech and Signal Processing, 2008. ICASSP 2008. IEEE International Conference on
  • Conference_Location
    Las Vegas, NV
  • ISSN
    1520-6149
  • Print_ISBN
    978-1-4244-1483-3
  • Electronic_ISBN
    1520-6149
  • Type

    conf

  • DOI
    10.1109/ICASSP.2008.4518806
  • Filename
    4518806