Performance Evaluation of Symbol Recognition and Spotting Systems: An Overview

Author

Delalandre, Mathieu ; Valveny, Ernest ; Llados, Josep

Author_Institution

CVC, Barcelona

fYear

2008

fDate

16-19 Sept. 2008

Firstpage

497

Lastpage

505

Abstract

This paper deals with the topic of performance evaluation of the symbol recognition & spotting systems. It presents an overview as a result of the work and the discussions undertaken by a working group on this subject. The paper starts by giving a general view of symbol recognition & spotting and performance evaluation. Next, the two main issues of performance evaluation are discussed: groundtruthing and performance characterization. Different problems related to both issues are addressed: groundtruthing of real documents, generation of synthetic documents, degradation models, the use of a priori knowledge, mapping of the groundtruth with the system results, and so on. Open problems arising from this overview are also discussed at the end of the paper.

Keywords

document image processing; image recognition; spotting systems; symbol recognition; synthetic documents generation; Character recognition; Degradation; Graphics; Image recognition; Information retrieval; Pattern recognition; Performance analysis; System performance; System testing; Text analysis;

fLanguage

English

Publisher

ieee

Conference_Titel

Document Analysis Systems, 2008. DAS '08. The Eighth IAPR International Workshop on

Conference_Location

Nara

Print_ISBN

978-0-7695-3337-7

Type

conf

DOI

10.1109/DAS.2008.63

Filename

4669999