An evaluation of text analysis technologies
AI Magazine
On the Evaluation of Document Analysis Components by Recall, Precision, and Accuracy
ICDAR '99 Proceedings of the Fifth International Conference on Document Analysis and Recognition
Problem-adaptable document analysis and understanding for high-volume applications
International Journal on Document Analysis and Recognition
On benchmarking of invoice analysis systems
DAS'06 Proceedings of the 7th international conference on Document Analysis Systems
| Hi-index | 0.00 |
Before buying a document analysis system, companies typically perform an intensive evaluation project whereby several candidates are invited to process a test set of selected representative documents. Moreover, after a system was purchased, it should continuously be optimized regarding the given customer-specific document appearance. In this paper we discuss a set of metrics for measuring the performance of common document analysis systems as base for comparing the systems, on the one hand, and for pair-wise comparing the performance of different configurations of one system as the base of system optimization, on the other hand. Finally, we present the smartFIX Statistics tool that is used daily by our customers to tune their smartFIX document analysis system towards higher economic efficiency and, thus, holds as proof of concept of the presented approach.