Characteristic Sets of Strings Common to Semi-structured Documents

  • Authors:
  • Daisuke Ikeda

  • Affiliations:
  • -

  • Venue:
  • DS '99 Proceedings of the Second International Conference on Discovery Science
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

We consider Maximum Agreement Problem which is, given positive and negative documents, to find a characteristic set that matches many of positive documents but rejects many of negative ones. A characteristic set is a sequence (x1,...., xd) of strings such that each xi is a suffix of xi+1 and all xi's appear in a document without overlaps. A characteristic set matches semi-structured documents with primitives or user's defined macros. For example, ("set", "characteristic set", "〈/title〉 characteristic set") is a characteristic set extracted from an HTML file. But, an algorithm that solves Maximum Agreement Problem does not output useless characteristic sets, such as those made of only tags of HTML, since such characteristic sets may match most of positive documents but also match most of negative ones. We present an algorithm that, given an integer d which is the number of strings in a characteristic set, solves Maximum Agreement Problem in O(n2hd) time, where n is the total length of documents and h is the height of the suffix tree of the documents.