Learning aspect models with partially labeled data

  • Authors:
  • Anastasia Krithara;Massih R. Amini;Cyril Goutte;Jean-Michel Renders

  • Affiliations:
  • Xerox Research Centre Europe, 6, Chemin de Maupertuis, 38240 Meylan, France and University Pierre et Marie Curie, 4, Place Jussieu, 75252 Paris cedex 05, France;University Pierre et Marie Curie, 4, Place Jussieu, 75252 Paris cedex 05, France and National Research Council Canada, 283, Bd. Alexandre-Taché, QC, Canada J8X 3X7;National Research Council Canada, 283, Bd. Alexandre-Taché, QC, Canada J8X 3X7;Xerox Research Centre Europe, 6, Chemin de Maupertuis, 38240 Meylan, France

  • Venue:
  • Pattern Recognition Letters
  • Year:
  • 2011

Quantified Score

Hi-index 0.10

Visualization

Abstract

In this paper, we address the problem of learning aspect models with partially labeled data for the task of document categorization. The motivation of this work is to take advantage of the amount of available unlabeled data together with the set of labeled examples to learn latent models whose structure and underlying hypotheses take more accurately into account the document generation process, compared to other mixture-based generative models. We present one semi-supervised variant of the Probabilistic Latent Semantic Analysis (PLSA) model (Hofmann, 2001). In our approach, we try to capture the possible data mislabeling errors which occur during the training of our model. This is done by iteratively assigning class labels to unlabeled examples using the current aspect model and re-estimating the probabilities of the mislabeling errors. We perform experiments over the 20Newsgroups, WebKB and Reuters document collections, as well as over a real world dataset coming from a Business Group of Xerox and show the effectiveness of our approach compared to a semi-supervised version of Naive Bayes, another semi-supervised version of PLSA and to transductive Support Vector Machines.