Issues in Performance Evaluation: A Case Study of Math Recognition

Authors:
Adrien Lapointe;Dorothea Blostein
Affiliations:
-;-
Venue:
ICDAR '09 Proceedings of the 2009 10th International Conference on Document Analysis and Recognition
Year:
2009

Citing 0
Cited 4

Math-Literate Computers

Calculemus '09/MKM '09 Proceedings of the 16th Symposium, 8th International Conference. Held as Part of CICM '09 on Intelligent Computer Mathematics
A paradigm for handwriting-based intelligent tutors

International Journal of Human-Computer Studies
Recognition of on-line handwritten mathematical expressions using 2D stochastic context-free grammars and hidden Markov models

Pattern Recognition Letters
A global learning approach for an online handwritten mathematical expression recognition system

Pattern Recognition Letters

Quantified Score

Hi-index	0.01

Visualization

Abstract

Performance evaluation of document recognition systems is a difficult and practically important problem. Issues arise in defining requirements, in characterizing the system’s range of inputs and outputs, in interpreting published performance evaluation results, in reproducing performance evaluation experiments, in choosing training and test data, and in selecting performance metrics.We discuss these issues in the context of evaluating systems for recognition of mathematical expressions. Excellent progress has been made in the theory and practice of performance evaluation, but many open problems remain.