Methods for comparing rankings of search engine results

Authors:
Judit Bar-Ilan;Mazlita Mat-Hassan;Mark Levene
Affiliations:
Department of Information Science, Bar-Ilan University, Ramat-Gan, Israel;School of Computer Science and Information Systems, Birkbeck, University of London, London, United Kingdom;School of Computer Science and Information Systems, Birkbeck, University of London, London, United Kingdom
Venue:
Computer Networks: The International Journal of Computer and Telecommunications Networking - Web dynamics
Year:
2006

Citing 23
Cited 25

Relevance: the whole history

Journal of the American Society for Information Science - Special topic issue on the history of documentation and information science: part II
The anatomy of a large-scale hypertextual Web search engine

WWW7 Proceedings of the seventh international conference on World Wide Web 7
A technique for measuring the relative size and overlap of public Web search engines

WWW7 Proceedings of the seventh international conference on World Wide Web 7
Finding information on the World Wide Web: the retrieval effectiveness of search engines

Information Processing and Management: an International Journal
Authoritative sources in a hyperlinked environment

Journal of the ACM (JACM)
Analysis of a very large web search engine query log

ACM SIGIR Forum
Accessibility of information on the Web

intelligence
Variations in relevance judgments and the measurement of retrieval effectiveness

Information Processing and Management: an International Journal
Rank aggregation methods for the Web

Proceedings of the 10th international conference on World Wide Web
Ranking retrieval systems without relevance judgments

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Modern Information Retrieval

Modern Information Retrieval
Automatic evaluation of world wide web search services

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Measuring Search Engine Quality

Information Retrieval
U.S. versus European web searching trends

ACM SIGIR Forum
Coverage, relevance, and ranking: The impact of query operators on Web search engine results

ACM Transactions on Information Systems (TOIS)
Comparing Top k Lists

SIAM Journal on Discrete Mathematics
A comprehensive and systematic model of user evaluation of web search engines: II. an evaluation by undergraduates

Journal of the American Society for Information Science and Technology
New measurements for search engine evaluation proposed and tested

Information Processing and Management: an International Journal
An analysis of web searching by European AlltheWeb.com users

Information Processing and Management: an International Journal
A temporal comparison of AltaVista Web searching: Research Articles

Journal of the American Society for Information Science and Technology
A subjective measure of web search quality

Information Sciences—Informatics and Computer Science: An International Journal
The indexable web is more than 11.5 billion pages

WWW '05 Special interest tracks and posters of the 14th international conference on World Wide Web
Comparing rankings of search results on the web

Information Processing and Management: an International Journal - Special issue: Infometrics

Search engines and their public interfaces: which apis are the most synchronized?

Proceedings of the 16th international conference on World Wide Web
Agreeing to disagree: search engines and their public interfaces

Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries
Designing clustering-based web crawling policies for search engine crawlers

Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
User rankings of search engine results

Journal of the American Society for Information Science and Technology
A random walk on the red carpet: rating movies with user reviews and pagerank

Proceedings of the 17th ACM conference on Information and knowledge management
A comparison of techniques for estimating IDF values to generate lexical signatures for the web

Proceedings of the 10th ACM workshop on Web information and data management
Top-level decisions through public deliberation on the internet: evidence from the evolution of Java governance

Proceedings of the 10th Annual International Conference on Digital Government Research: Social Networks: Making Connections between Citizens, Data and Government
Automatic keyword prediction using Google similarity distance

Expert Systems with Applications: An International Journal
A coherent measurement of web-search relevance

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
A comparison of social bookmarking with traditional search

ECIR'08 Proceedings of the IR research, 30th European conference on Advances in information retrieval
Clustering-based incremental web crawling

ACM Transactions on Information Systems (TOIS)
A similarity measure for indefinite rankings

ACM Transactions on Information Systems (TOIS)
Web search solved?: all result rankings the same?

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Word AdHoc Network: Using Google Core Distance to extract the most relevant information

Knowledge-Based Systems
Using Google latent semantic distance to extract the most relevant information

Expert Systems with Applications: An International Journal
Optimizing search engines results using linear programming

Expert Systems with Applications: An International Journal
An evolutionary PageRank approach for journal ranking with expert judgements

Journal of Information Science
Towards a collaborative ranking mechanism for efficient and personalized internet search service provisioning

Journal of Computational Methods in Sciences and Engineering - Intelligent Systems and Knowledge Management (Part II)
Searching the wikipedia with public online search engines

INEX'10 Proceedings of the 9th international conference on Initiative for the evaluation of XML retrieval: comparative evaluation of focused retrieval
Reranking search results for sparse queries

Proceedings of the 20th ACM international conference on Information and knowledge management
Reconstruction of network evolutionary history from extant network topology and duplication history

ISBRA'12 Proceedings of the 8th international conference on Bioinformatics Research and Applications
Harnessing collective intelligence in social tagging using Delicious

Journal of the American Society for Information Science and Technology
Measuring the Importance of Users in a Social Network Based on Email Communication Patterns

ASONAM '12 Proceedings of the 2012 International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2012)
Creation of individual photo selections: read preferences from the users' eyes

Proceedings of the 21st ACM international conference on Multimedia
Maximum Likelihood Inference of the Evolutionary History of a PPI Network from the Duplication History of Its Proteins

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present a number of measures that compare rankings of search engine results. We apply these measures to five queries that were monitored daily for two periods of 14 or 21 days each. Rankings of the different search engines (Google, Yahoo! and Teoma for text searches and Google, Yahoo! and Picsearch for image searches) are compared on a daily basis, in addition to longitudinal comparisons of the same engine for the same query over time. The results and rankings of the two periods are compared as well.