A proposal for a configurable silver standard

  • Authors:
  • Udo Hahn;Katrin Tomanek;Elena Beisswanger;Erik Faessler

  • Affiliations:
  • Jena University Language & Information Engineering (JULIE) Lab, Friedrich-Schiller-Universitäät Jena, Fürstengraben, Jena, Germany;Jena University Language & Information Engineering (JULIE) Lab, Friedrich-Schiller-Universitäät Jena, Fürstengraben, Jena, Germany;Jena University Language & Information Engineering (JULIE) Lab, Friedrich-Schiller-Universitäät Jena, Fürstengraben, Jena, Germany;Jena University Language & Information Engineering (JULIE) Lab, Friedrich-Schiller-Universitäät Jena, Fürstengraben, Jena, Germany

  • Venue:
  • LAW IV '10 Proceedings of the Fourth Linguistic Annotation Workshop
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Among the many proposals to promote alternatives to costly to create gold standards, just recently the idea of a fully automatically, and thus cheaply, to set up silver standard has been launched. However, the current construction policy for such a silver standard requires crucial parameters (such as similarity thresholds and agreement cut-offs) to be set a priori, based on extensive testing though, at corpus compile time. Accordingly, such a corpus is static, once it is released. We here propose an alternative policy where silver standards can be dynamically optimized and customized on demand (given a specific goal function) using a gold standard as an oracle.