Searching distributed collections with inference networks
SIGIR '95 Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval
The use of MMR, diversity-based reranking for reordering documents and producing summaries
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Learning query intent from regularized click graphs
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Evaluation over thousands of queries
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Novelty and diversity in information retrieval evaluation
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
A Comparison of Interactive and Ad-Hoc Relevance Assessments
Focused Access to XML Documents
ACM SIGIR Forum
Proceedings of the Second ACM International Conference on Web Search and Data Mining
Integration of news content into web results
Proceedings of the Second ACM International Conference on Web Search and Data Mining
A probabilistic model based approach for blended search
Proceedings of the 18th international conference on World wide web
Sources of evidence for vertical selection
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
A Task-Based Evaluation of an Aggregated Search Interface
SPIRE '09 Proceedings of the 16th International Symposium on String Processing and Information Retrieval
Vertical selection in the presence of unlabeled verticals
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Evaluating interfaces for government metasearch
Proceedings of the third symposium on Information interaction in context
Factors affecting click-through behavior in aggregated search interfaces
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Aggregated search: A new information retrieval paradigm
ACM Computing Surveys (CSUR)
| Hi-index | 0.00 |
Major search engines perform what is known as Aggregated Search (AS). They integrate results coming from different vertical search engines (images, videos, news, etc.) with typical Web search results. Aggregated search is relatively new and its advantages need to be evaluated. Some existing works have already tried to evaluate the interest (usefulness) of aggregated search as well as the effectiveness of the existing approaches. However, most of evaluation methodologies were based (i) on what we call relevance by intent (i.e. search results were not shown to real users), and (ii) short text queries. In this paper, we conducted a user study which was designed to revisit and compare the interest of aggregated search, by exploiting both relevance by intent and content, and using both short text and fixed need queries. This user study allowed us to analyze the distribution of relevant results across different verticals, and to show that AS helps to identify complementary relevant sources for the same information need. Comparison between relevance by intent and relevance by content showed that relevance by intent introduces a bias in evaluation. Discussion about the results also allowed us to identify some useful thoughts concerning the evaluation of AS approaches.