Topic models conditioned on relations

  • Authors:
  • Mirwaes Wahabzada;Zhao Xu;Kristian Kersting

  • Affiliations:
  • Knowledge Discovery Department, Fraunhofer IAIS, Sankt Augustin, Germany;Knowledge Discovery Department, Fraunhofer IAIS, Sankt Augustin, Germany;Knowledge Discovery Department, Fraunhofer IAIS, Sankt Augustin, Germany

  • Venue:
  • ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part III
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Latent Dirichlet allocation is a fully generative statistical language model that has been proven to be successful in capturing both the content and the topics of a corpus of documents. Recently, it was even shown that relations among documents such as hyper-links or citations allow one to share information between documents and in turn to improve topic generation. Although fully generative, in many situations we are actually not interested in predicting relations among documents. In this paper, we therefore present a Dirichlet-multinomial nonparametric regression topic model that includes a Gaussian process prior on joint document and topic distributions that is a function of document relations. On networks of scientific abstracts and of Wikipedia documents we show that this approach meets or exceeds the performance of several baseline topic models.