Textual features for corpus visualization using correspondence analysis

  • Authors:
  • Saš/a Petrović/;Bojana Dalbelo Baš/ić/;Annie Morin;Blaž/ Zupan;Jean-Hugues Chauchat

  • Affiliations:
  • Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, 10000 Zagreb, Croatia;(Correspd. Tel.: +385 1 6129 871/ E-mail: bojana.dalbelo@fer.hr) Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, 10000 Zagreb, Croatia;IRISA, Université/ de Rennes 1, Rennes cedex 35042, France;Faculty of Computer and Information Science, University of Ljubljana, Trzaska 25, SI-10000 Ljubljana, Slovenia;Université/ Lyon, ERIC-Lyon2, 5 av. Pierre Mendè/s-France, 69676 Bron Cedex, France

  • Venue:
  • Intelligent Data Analysis
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Explorative data analysis in text mining essentially relies on effective visualization techniques which can expose hidden relationships among documents and reveal correspondence between documents and their features. In text mining, the documents are most often represented by feature vectors of very high dimensions, requiring dimensionality reduction to obtain visual projections in two- or three-dimensional space. Correspondence analysis is an unsupervised approach that allows for construction of low-dimensional projection space with simultaneous placement of both documents and features, making it ideal for explorative analysis in text mining. Its present use, however, has been limited to word-based features. In this paper, we investigate how this particular document representation compares to the representation with letter n-grams and word n-grams, and find that these alternative representations yield better results in separating documents of different class. We perform our experimental analysis on a bilingual Croatian-English parallel corpus, allowing us to additionally explore the impact of features in different languages on the quality of visualizations.