Constructing maximum entropy language models for movie review subjectivity analysis

  • Authors:
  • Bo Chen;Hui He;Jun Guo

  • Affiliations:
  • Pattern Recognition and Intelligent System Laboratory, School of Information Engineering, Beijing University of Posts and Telecommunications, Beijing, China;Pattern Recognition and Intelligent System Laboratory, School of Information Engineering, Beijing University of Posts and Telecommunications, Beijing, China;Pattern Recognition and Intelligent System Laboratory, School of Information Engineering, Beijing University of Posts and Telecommunications, Beijing, China

  • Venue:
  • Journal of Computer Science and Technology
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Document subjectivity analysis has become an important aspect of web text content mining. This problem is similar to traditional text categorization, thus many related classification techniques can be adapted here. However, there is one significant difference that more language or semantic information is required for better estimating the subjectivity of a document. Therefore, in this paper, our focuses are mainly on two aspects. One is how to extract useful and meaningful language features, and the other is how to construct appropriate language models efficiently for this special task. For the first issue, we conduct a Global-Filtering and Local-Weighting strategy to select and evaluate language features in a series of n-grams with different orders and within various distance-windows. For the second issue, we adopt Maximum Entropy (MaxEnt) modeling methods to construct our language model framework. Besides the classical MaxEnt models, we have also constructed two kinds of improved models with Gaussian and exponential priors respectively. Detailed experiments given in this paper show that with well selected and weighted language features, MaxEnt models with exponential priors are significantly more suitable for the text subjectivity analysis task.