Autonomous news clustering and classification for an intelligent web portal

  • Authors:
  • Traian Rebedea;Stefan Trausan-Matu

  • Affiliations:
  • "Politehnica" University of Bucharest, Department of Computer Science and Engineering, Bucharest, Romania;"Politehnica" University of Bucharest, Department of Computer Science and Engineering, Bucharest, Romania and Research Institute for Artificial Intelligence of the Romanian Academy, Bucharest, Rom ...

  • Venue:
  • ISMIS'08 Proceedings of the 17th international conference on Foundations of intelligent systems
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

The paper presents an autonomous text classification module for a news web portal for the Romanian language. Statistical natural language processing techniques are combined in order to achieve a completely autonomous functionality of the portal. The news items are automatically collected from a large number of news sources using web syndication. Afterward, machine-learning techniques are used for achieving an automatic classification of the news stream. Firstly, the items are clustered using an agglomerative algorithm and the resulting groups correspond to the main news topics. Thus, more information about each of the main topics is acquired from various news sources. Secondly, text classification algorithms are applied to automatically label each cluster of news items in a predetermined number of classes. More than a thousand news items were employed for both the training and the evaluation of the classifiers. The paper presents a complete comparison of the results obtained for each method.