A fast algorithm of retrieving common sentences

  • Authors:
  • Masao Fuketa;Jun-ichi Aoe

  • Affiliations:
  • Department of Information Science and Intelligent Systems, University of Tokushima, 2-1 Minami Josanjima Cho, Tokushima-shi, Japan;Department of Information Science and Intelligent Systems, University of Tokushima, 2-1 Minami Josanjima Cho, Tokushima-shi, Japan

  • Venue:
  • Information Sciences: an International Journal
  • Year:
  • 1998

Quantified Score

Hi-index 0.07

Visualization

Abstract

Storing and retrieving a useful example sentence efficiently is an important task in document management systems because text retrieval is the most time-consuming part of them. Inverted filing is a well-known approach, but there are some problems when storing a huge number of sentences. They arise when the intersection is computed for large postings indexed by terms, or keywords. Moreover, disk access for postings also takes a lot of time in this situation. This paper presents a technique for the storing of multi-stages of postings and retrieving them partly in order to compute efficiently the intersection between postings for the requested terms. From the simulation results, it is shown that the presented algorithm is 6 to 88 times faster than the traditional approach.