An alternative approach for statistical single-label document classification of newspaper articles

  • Authors:
  • Georgios Mamakis;Athanasios G. Malamos;J. Andrew Ware

  • Affiliations:
  • Technological Educational Institute of Crete, Greeceand Department of Computing and Mathematical Sciences, University of Glamorgan,Wales, UK;Technological Educational Institute of Crete, Greece,;Department of Computing and Mathematical Sciences, Universityof Glamorgan, Wales, UK

  • Venue:
  • Journal of Information Science
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Text classification is one of the most important sectors of machine learning theory. It enables a series of tasks among which are email spam filtering and context identification. Classification theory proposes a number of different techniques based on different technologies and tools. Classification systems are typically distinguished into single-label categorization and multi-label categorization systems, according to the number of categories they assign to each of the classified documents. In this paper, we present work undertaken in the area of single-label classification which resulted in a statistical classifier, based on the Naive Bayes assumption of statistical independence of word occurrence across a document. Our algorithm, takes into account cross-category word occurrence in deciding the class of a random document. Moreover, instead of estimating word co-occurrence in assigning a class, we estimate word contribution for a document to belong in a class. This approach outperforms other statistical classifiers as Naive Bayes Classifier and Language Models, as proven in our results.