Adapting the naive bayes classifier to rank procedural texts

  • Authors:
  • Ling Yin;Richard Power

  • Affiliations:
  • Natural Language Technology Group (NLTG), University of Brighton, Brighton, United Kingdom;Faculty of Mathematics and Computing, The Open University, Milton Keynes, United Kingdom

  • Venue:
  • ECIR'06 Proceedings of the 28th European conference on Advances in Information Retrieval
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a machine-learning approach for ranking web documents according to the proportion of procedural text they contain. By ‘procedural text' we refer to ordered lists of steps, which are very common in some instructional genres such as online manuals. Our initial training corpus is built up by applying some simple heuristics to select documents from a large collection and contains only a few documents with a large proportion of procedural texts. We adapt the Naive Bayes classifier to better fit this less than ideal training corpus. This adapted model is compared with several other classifiers in ranking procedural texts using different sets of features and is shown to perform well when only highly distinctive features are used.