Semantic multi-grain mixture topic model for text analysis

  • Authors:
  • Jianping Zeng;Jiangjiao Duan;Wei Wang;Chengrong Wu

  • Affiliations:
  • School of Computer Science, Fudan University, Shanghai 200433, PR China;Department of Computer Science, Xiamen University, Xiamen 361005, PR China;School of Computer Science, Fudan University, Shanghai 200433, PR China;School of Computer Science, Fudan University, Shanghai 200433, PR China

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2011

Quantified Score

Hi-index 12.05

Visualization

Abstract

Granular topic extraction and modeling are fundament tasks in text analysis. Hierarchical topic clustering algorithms and hierarchical topic models are usually employed for these purposes. However, it is difficult to make a clear distinguish between each pair of hierarchical topics from the semantic granularity point of view. STG (semantic topic granularity) is proposed to indicate the details degree of topic description, and aim at providing discrimination for topics from semantic aspect. A new model, mgMTM (multi-grain mixture topic model) based on STG is then proposed to model grain topics. DCT (discrete cosine transform) is employed to provide a mechanism for computing STG, extracting grain topics and learning mgMTM. Experiments on real world datasets show that the proposed model has lower perplexity score than that of LDA model and thus has better generalization performance in describing text. Experiments also show that the description of the extracted grain topics can be well explained with respect to a dataset including topics about recent global financial crisis.