Pattern Mining with Natural Language Processing: An Exploratory Approach

  • Authors:
  • Ana Cristina Mendes;Cláudia Antunes

  • Affiliations:
  • Spoken Language Systems Laboratory - L2F/INESC-ID Instituto Superior Técnico, Technical University of Lisbon, Lisboa, Portugal 1000-029;Department of Computer Science and Engineering Instituto Superior Técnico, Technical University of Lisbon, Lisboa, Portugal 1049-001

  • Venue:
  • MLDM '09 Proceedings of the 6th International Conference on Machine Learning and Data Mining in Pattern Recognition
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Pattern mining derives from the need of discovering hidden knowledge in very large amounts of data, regardless of the form in which it is presented. When it comes to Natural Language Processing (NLP) , it arose along the humans' necessity of being understood by computers. In this paper we present an exploratory approach that aims at bringing together the best of both worlds. Our goal is to discover patterns in linguistically processed texts, through the usage of NLP state-of-the-art tools and traditional pattern mining algorithms. Articles from a Portuguese newspaper are the input of a series of tests described in this paper. First, they are processed by an NLP chain, which performs a deep linguistic analysis of text; afterwards, pattern mining algorithms Apriori and GenPrefixSpan are used. Results showed the applicability of sequential pattern mining techniques in textual structured data, and also provided several evidences about the structure of the language.