Adaptive document clustering based on query-based similarity

  • Authors:
  • Seung-Hoon Na;In-Su Kang;Jong-Hyeok Lee

  • Affiliations:
  • Division of Electrical and Computer Engineering, POSTECH (Pohang University of Science and Technology), San 31, Hyojadong, Namgu, Pohang 790-784, Republic of Korea;Division of Electrical and Computer Engineering, POSTECH (Pohang University of Science and Technology), San 31, Hyojadong, Namgu, Pohang 790-784, Republic of Korea;Division of Electrical and Computer Engineering, POSTECH (Pohang University of Science and Technology), San 31, Hyojadong, Namgu, Pohang 790-784, Republic of Korea

  • Venue:
  • Information Processing and Management: an International Journal
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In information retrieval, cluster-based retrieval is a well-known attempt in resolving the problem of term mismatch. Clustering requires similarity information between the documents, which is difficult to calculate at a feasible time. The adaptive document clustering scheme has been investigated by researchers to resolve this problem. However, its theoretical viewpoint has not been fully discovered. In this regard, we provide a conceptual viewpoint of the adaptive document clustering based on query-based similarities, by regarding the user's query as a concept. As a result, adaptive document clustering scheme can be viewed as an approximation of this similarity. Based on this idea, we derive three new query-based similarity measures in language modeling framework, and evaluate them in the context of cluster-based retrieval, comparing with K-means clustering and full document expansion. Evaluation result shows that retrievals based on query-based similarities significantly improve the baseline, while being comparable to other methods. This implies that the newly developed query-based similarities become feasible criterions for adaptive document clustering.