Performance assessment of speaker-dependent recognition devices using Italian database

A method for investigating the performance of several speaker-dependent recognition devices is described. The authors call attention to deficiencies in current speech technology performance assessment and describe a test that provides a profile of phonetic performance accuracy for a speech recognizer. Preliminary data show that the test is sensitive enough to detect differences between different vocabularies. These data also show that the test results are quite independent of the particular speakers