Efficient index-based KNN join processing for high-dimensional data

  • Authors:
  • Cui Yu;Bin Cui;Shuguang Wang;Jianwen Su

  • Affiliations:
  • Department of Computer Science, Monmouth University, West Long Branch, NJ 07764, USA;Department of Computer Science, Peking University, Beijing, China;Department of Computer Science, National University of Singapore, Singapore;Department of Computer Science, University of California, Santa Barbara, CA 93106, USA

  • Venue:
  • Information and Software Technology
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In many advanced database applications (e.g., multimedia databases), data objects are transformed into high-dimensional points and manipulated in high-dimensional space. One of the most important but costly operations is the similarity join that combines similar points from multiple datasets. In this paper, we examine the problem of processing K-nearest neighbor similarity join (KNN join). KNN join between two datasets, R and S, returns for each point in R its K most similar points in S. We propose a new index-based KNN join approach using the iDistance as the underlying index structure. We first present its basic algorithm and then propose two different enhancements. In the first enhancement, we optimize the original KNN join algorithm by using approximation bounding cubes. In the second enhancement, we exploit the reduced dimensions of data space. We conducted an extensive experimental study using both synthetic and real datasets, and the results verify the performance advantage of our schemes over existing KNN join algorithms.