Arabic texts analysis for topic modeling evaluation

  • Authors:
  • Abderrezak Brahmi;Ahmed Ech-Cherif;Abdelkader Benyettou

  • Affiliations:
  • Department of Computer Science, University of Abdelhamid Ibn Badis, Mostaganem, Algeria;Department of Computer Science, USTO-MB, Oran, Algeria;Department of Computer Science, USTO-MB, Oran, Algeria

  • Venue:
  • Information Retrieval
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Significant progress has been made in information retrieval covering text semantic indexing and multilingual analysis. However, developments in Arabic information retrieval did not follow the extraordinary growth of Arabic usage in the Web during the ten last years. In the tasks relating to semantic analysis, it is preferable to directly deal with texts in their original language. Studies on topic models, which provide a good way to automatically deal with semantic embedded in texts, are not complete enough to assess the effectiveness of the approach on Arabic texts. This paper investigates several text stemming methods for Arabic topic modeling. A new lemma-based stemmer is described and applied to newspaper articles. The Latent Dirichlet Allocation model is used to extract latent topics from three Arabic real-world corpora. For supervised classification in the topics space, experiments show an improvement when comparing to classification in the full words space or with root-based stemming approach. In addition, topic modeling with lemma-based stemming allows us to discover interesting subjects in the press articles published during the 2007---2009 period.