Evaluating patent retrieval in the third NTCIR workshop

  • Authors:
  • Makoto Iwayama;Atsushi Fujii;Noriko Kando;Yozo Marukawa

  • Affiliations:
  • Hitachi, Ltd, Higashi-Koigakubo, Kokubunji, Japan;Graduate School of Library, Information and Media Studies, University of Tsukuba, Tsukuba, Japan;National Institute of Informatics, Chiyoda-ku, Japan;National Institute of Informatics, Chiyoda-ku, Japan

  • Venue:
  • Information Processing and Management: an International Journal - Special issue: Formal methods for information retrieval
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Reflecting the rapid growth in the utilization of large test collections for information retrieval since the 1990s, extensive comparative experiments have been performed to explore the effectiveness of various retrieval models. However, most collections were intended for retrieving newspaper articles and technical abstracts. In this paper, we describe the process of producing a test collection for patent retrieval, the NTCIR-3 Patent Retrieval Collection, which includes two years of Japanese patent applications and 31 topics produced by professional patent searchers. We also report experimental results obtained by using this collection to re-examine the effectiveness of existing retrieval models in the context of patent retrieval. The relative superiority among existing retrieval models did not significantly differ depending on the document genre, that is, patents and newspaper articles. Issues related to patent retrieval are also discussed.