PEAS, the first instantiation of a comparative framework for evaluating parsers of French

Authors:
V. Gendner;G. Illouz;M. Jardino;L. Monceaux;P. Paroubek;I. Robba;A. Vilnat
Affiliations:
LIMSI -- CNRS, Orsay, France;LIMSI -- CNRS, Orsay, France;LIMSI -- CNRS, Orsay, France;LIMSI -- CNRS, Orsay, France;LIMSI -- CNRS, Orsay, France;LIMSI -- CNRS, Orsay, France;LIMSI -- CNRS, Orsay, France
Venue:
EACL '03 Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics - Volume 2
Year:
2003

Citing 2
Cited 2

Procedure for quantitatively comparing the syntactic coverage of English grammars

HLT '91 Proceedings of the workshop on Speech and Natural Language
A dependency-based method for evaluating broad-coverage parsers

Natural Language Engineering

Large scale production of syntactic annotations to move forward

CrossParser '08 Coling 2008: Proceedings of the workshop on Cross-Framework and Cross-Domain Parser Evaluation
Multimodal annotation of conversational data

LAW IV '10 Proceedings of the Fourth Linguistic Annotation Workshop

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents PEAS, the first comparative evaluation framework for parsers of French whose annotation formalism allows the annotation of both constituents and functional relations. A test corpus containing an assortment of different text types has been built and part of it has been manually annotated. Precision/Recall and crossing brackets metrics will be adapted to our formalism and applied to the parses produced by one parser from academia and another one from industry in order to validate the framework.