Summary of the NTCIR-10 INTENT-2 task: subtopic mining and search result diversification

Authors:
Tetsuya Sakai;Zhicheng Dou;Takehiro Yamamoto;Yiqun Liu;Min Zhang;Makoto P. Kato;Ruihua Song;Mayu Iwata
Affiliations:
MSRA, Beijing, China;MSRA, Beijing, China;Kyoto University, Kyoto, Japan;Tsinghua University, Beijing, China;Tsinghua University, Beijing, China;Kyoto University, Kyoto, China;MSRA, Beijing, China;Osaka Unversity, Japan
Venue:
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Year:
2013

Citing 11
Cited 1

Cumulated gain-based evaluation of IR techniques

ACM Transactions on Information Systems (TOIS)
Beyond independent relevance: methods and evaluation metrics for subtopic retrieval

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Evaluating evaluation metrics based on the bootstrap

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Diversifying search results

Proceedings of the Second ACM International Conference on Web Search and Data Mining
Selectively diversifying web search results

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
A comparative analysis of cascade measures for novelty and diversity

Proceedings of the fourth ACM international conference on Web search and data mining
Evaluating diversified search results using per-intent graded relevance

Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Intent-based diversification of web search results: metrics and algorithms

Information Retrieval
Evaluation with informational and navigational intents

Proceedings of the 21st international conference on World Wide Web
The impact of intent selection on diversified search evaluation

Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Diversified search evaluation: lessons from the NTCIR-9 INTENT task

Information Retrieval

The impact of intent selection on diversified search evaluation

Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

The NTCIR INTENT task comprises two subtasks: {\em Subtopic Mining}, where systems are required to return a ranked list of {\em subtopic strings} for each given query; and {\em Document Ranking}, where systems are required to return a diversified web search result for each given query. This paper summarises the novel features of the Second INTENT task at NTCIR-10 and its main findings, and poses some questions for future diversified search evaluation.