The web retrieval task and its evaluation in the third NTCIR workshop

Authors:
Koji Eguchi;Keizo Oyama;Emi Ishida;Kazuko Kuriyama;Noriko Kando
Affiliations:
National Institute of Informatics, Chiyoda-ku, Tokyo, Japan;National Institute of Informatics, Chiyoda-ku, Tokyo, Japan;National Institute of Informatics, Chiyoda-ku, Tokyo, Japan;National Institute of Informatics, Chiyoda-ku, Tokyo, Japan;National Institute of Informatics, Chiyoda-ku, Tokyo, Japan
Venue:
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Year:
2002

Citing 0
Cited 4

An evaluation of the Web retrieval task at the third NTCIR workshop

ACM SIGIR Forum
Multilingual Web retrieval: An experiment in English–Chinese business intelligence

Journal of the American Society for Information Science and Technology
Give me just one highly relevant document: P-measure

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
An overview of Web search evaluation methods

Computers and Electrical Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper gives an overview of the evaluation method used for the Web Retrieval Task in the Third NTCIR Workshop, which is currently in progress. In the Web Retrieval Task, we try to assess the retrieval effectiveness of each Web search engine system using a common data set, and attempt to build a re-usable test collection suitable for evaluating Web search engine systems. With these objectives, we have built 100-gigabyte and 10-gigabyte document sets, mainly gathered from the '.jp' domain. Relevance judgment is performed on the retrieved documents, which are written in Japanese or English.