Genre as noise: noise in genre

  • Authors:
  • Andrea Stubbe;Christoph Ringlstetter;Klaus U. Schulz

  • Affiliations:
  • University of Munich, CIS, Oettingenstr 67, 80538, Munich, Germany;University of Alberta, AICML, Department of Computing Science, Oettingenstr 67, 80538, Edmonton, Canada;University of Munich, CIS, Oettingenstr 67, 80538, Munich, Germany

  • Venue:
  • International Journal on Document Analysis and Recognition
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Given a specific information need, documents of the wrong genre can be considered as noise. From this perspective, genre classification helps to separate relevant documents from noise. Orthographic errors represent a second, finer notion of noise. Since specific genres often include documents with many errors, an interesting question is whether this “micro-noise” can help to classify genre. In this paper we consider both problems. After introducing a comprehensive hierarchy of genres, we present an intuitive method to build specialized and distinctive classifiers that also work for very small training corpora. Special emphasis is given to the selection of intelligent high-level features. We then investigate the correlation between genre and micro noise. Using special error dictionaries, we estimate the typical error rates for each genre. Finally, we test if the error rate of a document represents a useful feature for genre classification.