Phrase processing methods for Japanese text retrieval

  • Authors:
  • Noriko Kando;Kyo Kageura;Masaharu Yoshioka;Keizo Oyama

  • Affiliations:
  • Research and Development Department, Tokyo, Japan;Research and Development Department, Tokyo, Japan;Research and Development Department, Tokyo, Japan;Research and Development Department, Tokyo, Japan

  • Venue:
  • ACM SIGIR Forum
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper examines the effectiveness of different phrase identification and weighting methods for Japanese text retrieval in an operational information retrieval (IR) system, called NACSIS-IR. Based on our previous experiments, we used character-based indexing with positional information and word-or phrase-based query processing, which allowed us to implement sophisticated linguistic analysis on large-scale databases while maintaining adequate efficiency. The results of retrieval experiments on a large-scale Japanese test collection showed that the combination of enhanced phrase identification using patterns defined over part-of-speech tags and our algorithms Phrase2 and Phrase5 made a significant positive contribution to retrieval effectiveness. The paper also discusses indexing and phrase processing of Japanese or East Asian languages.