The role of word sense disambiguation in automated text categorization

  • Authors:
  • José María Gómez Hidalgo;Manuel de Buenaga Rodríguez;José Carlos Cortizo Pérez

  • Affiliations:
  • Universidad Europea de Madrid, Villaviciosa de Odón, Madrid, Spain;Universidad Europea de Madrid, Villaviciosa de Odón, Madrid, Spain;AINet Solutions, Fuenlabrada, Madrid, Spain

  • Venue:
  • NLDB'05 Proceedings of the 10th international conference on Natural Language Processing and Information Systems
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Automated Text Categorization has reached the levels of accuracy of human experts. Provided that enough training data is available, it is possible to learn accurate automatic classifiers by using Information Retrieval and Machine Learning Techniques. However, performance of this approach is damaged by the problems derived from language variation (specially polysemy and synonymy). We investigate how Word Sense Disambiguation can be used to alleviate these problems, by using two traditional methods for thesaurus usage in Information Retrieval, namely Query Expansion and Concept Indexing. These methods are evaluated on the problem of using the Lexical Database WordNet for text categorization, focusing on the Word Sense Disambiguation step involved. Our experiments demonstrate that rather simple dictionary methods, and baseline statistical approaches, can be used to disambiguate words and improve text representation and learning in both Query Expansion and Concept Indexing approaches.