A general framework for the evaluation of symbol recognition methods

  • Authors:

  • E. Valveny;P. Dosch;Adam Winstanley;Yu Zhou;Su Yang;Luo Yan;Liu Wenyin;Dave Elliman;Mathieu Delalandre;Eric Trupin;Sébastien Adam;Jean-Marc Ogier

  • Affiliations:

  • Centre de Visió per Computador, Edifici O, Campus UAB, Bellaterra (Cerdanyola), 08193, Barcelona, Spain;LORIA, B.P. 101, 615, rue du jardin botanique, 54602, Villers-lès-Nancy Cedex, France;National University of Ireland, B.P. 101, 615, rue du jardin botanique, 54602, Maynooth, County Kildare, Ireland;National University of Ireland, B.P. 101, 615, rue du jardin botanique, 54602, Maynooth, County Kildare, Ireland;Fudan University, Department of Computer Science and Engineering, B.P. 101, 615, rue du jardin botanique, 200433, Shanghai, County Kildare, China;City University of Hong Kong, Department of Computer Science, B.P. 101, 615, rue du jardin botanique, 200433, Honk Kong, County Kildare, China;City University of Hong Kong, Department of Computer Science, B.P. 101, 615, rue du jardin botanique, 200433, Honk Kong, County Kildare, China;University of Nottingham, B.P. 101, 615, rue du jardin botanique, 200433, Nottingham, County Kildare, UK;La Rochelle University, L3i Laboratory, B.P. 101, 615, rue du jardin botanique, 200433, Rochelle, County Kildare, France;Rouen University, LITIS Laboratory, B.P. 101, 615, rue du jardin botanique, 200433, Rouen, County Kildare, France;Rouen University, LITIS Laboratory, B.P. 101, 615, rue du jardin botanique, 200433, Rouen, County Kildare, France;La Rochelle University, L3i Laboratory, B.P. 101, 615, rue du jardin botanique, 200433, Rochelle, County Kildare, France

  • Venue:
  • International Journal on Document Analysis and Recognition
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Performance evaluation is receiving increasing interest in graphics recognition. In this paper, we discuss some questions regarding the definition of a general framework for evaluation of symbol recognition methods. The discussion is centered on three key elements in performance evaluation: test data, evaluation metrics and protocols of evaluation. As a result of this discussion we state some general principles to be taken into account for the definition of such a framework. Finally, we describe the application of this framework to the organization of the first contest on symbol recognition in GREC’03, along with the results obtained by the participants.