Learning the importance of latent topics to discover highly influential news items

  • Authors:
  • Ralf Krestel;Bhaskar Mehta

  • Affiliations:
  • L3S Research Center, Leibniz Universität Hannover, Germany;Google Inc., Zurich, Switzerland

  • Venue:
  • KI'10 Proceedings of the 33rd annual German conference on Advances in artificial intelligence
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Online news is a major source of information for many people. The overwhelming amount of new articles published every day makes it necessary to filter out unimportant ones and detect ground breaking new articles. In this paper, we propose the use of Latent Dirichlet Allocation (LDA) to find the hidden factors of important news stories. These factors are then used to train a Support Vector Machine (SVM) to classify new news items as they appear. We compare our results with SVMs based on a bag-of-words approach and other language features. The advantage of a LDA processing is not only a better accuracy in predicting important news, but also a better interpretability of the results. The latent topics show directly the important factors of a news story.