Adaptable term weighting framework for text classification

  • Authors:
  • Dat Huynh;Dat Tran;Wanli Ma;Dharmendra Sharma

  • Affiliations:
  • Faculty of Information Sciences and Engineering, University of Canberra, ACT, Australia;Faculty of Information Sciences and Engineering, University of Canberra, ACT, Australia;Faculty of Information Sciences and Engineering, University of Canberra, ACT, Australia;Faculty of Information Sciences and Engineering, University of Canberra, ACT, Australia

  • Venue:
  • CICLing'11 Proceedings of the 12th international conference on Computational linguistics and intelligent text processing - Volume Part II
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In text classification, term frequency and term co-occurrence factors are dominantly used in weighting term features. Category relevance factors have recently been used to propose term weighting approaches. However, these approaches are mainly based on their own-designed text classifiers to adapt to category information, where the advantages of popular text classifiers have been ignored. This paper proposes a term weighting framework for text classification tasks. The framework firstly inherits the benefits of provided category information to estimate the weighting of features. Secondly, based on the feedback information, it is able to continuously adjust feature weightings to find the best representations for documents. Thirdly, the framework robustly makes it possible to work with different text classifiers on classifying the text representations, based on category information. On several corpora with SVM classifier, experiments show that given predicted information from TFxIDF method as initial status, the proposed approach leverages accuracy results and outperforms current text classification approaches.