Hybrid bilinear and trilinear models for exploratory analysis of three-way poisson counts

  • Authors:
  • Juha Raitio;Tapani Raiko;Timo Honkela

  • Affiliations:
  • Department of Information and Computer Science, Aalto University School of Science, Aalto, Finland;Department of Information and Computer Science, Aalto University School of Science, Aalto, Finland;Department of Information and Computer Science, Aalto University School of Science, Aalto, Finland

  • Venue:
  • ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part II
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a probabilistic model class for the analysis of three-way count data, motivated by studying the subjectivity of language. Our models are applicable for instance to a data tensor of how many times each subject used each term in each context, thus revealing individual variation in natural language use. As our main goal is exploratory analysis, we propose hybrid bilinear and trilinear models with zero-mean constraints, separating modeling the simpler and more complex phenomena. While helping exploratory analysis, this approach leads into a more involved model selection problem. Our solution by forward selection guided by cross-validation likelihood is shown to work reliably on experiments with synthetic data.