Stable classification of text genres

  • Authors:
  • Philipp Petrenz;Bonnie Webber

  • Affiliations:
  • University of Edinburgh;University of Edinburgh

  • Venue:
  • Computational Linguistics
  • Year:
  • 2011
  • Cross-lingual genre classification

    EACL '12 Proceedings of the Student Research Workshop at the 13th Conference of the European Chapter of the Association for Computational Linguistics

Quantified Score

Hi-index 0.00

Visualization

Abstract

Every text has at least one topic and at least one genre. Evidence for a text's topic and genre comes, in part, from its lexical and syntactic features-features used in both Automatic Topic Classification and Automatic Genre Classification (AGC). Because an ideal AGC system should be stable in the face of changes in topic distribution, we assess five previously published AGC methods with respect to both performance on the same topic-genre distribution on which they were trained and stability of that performance across changes in topic-genre distribution. Our experiments lead us to conclude that (1) stability in the face of changing topical distributions should be added to the evaluation critera for new approaches to AGC, and (2) Part-of-Speech features should be considered individually when developing a high-performing, stable AGC system for a particular, possibly changing corpus.