First 20 precision among World Wide Web search services (search engines)
Journal of the American Society for Information Science
Rank aggregation methods for the Web
Proceedings of the 10th international conference on World Wide Web
Algorithm for documents ranking: idea and simulation results
SEKE '02 Proceedings of the 14th international conference on Software engineering and knowledge engineering
ACM SIGIR Forum
The concept of relevance in IR
Journal of the American Society for Information Science and Technology
SIAM Journal on Discrete Mathematics
Journal of the American Society for Information Science and Technology
New measurements for search engine evaluation proposed and tested
Information Processing and Management: an International Journal
A subjective measure of web search quality
Information Sciences—Informatics and Computer Science: An International Journal
An algorithm to cluster documents based on relevance
Information Processing and Management: an International Journal
Accurately interpreting clickthrough data as implicit feedback
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Methods for comparing rankings of search engine results
Computer Networks: The International Journal of Computer and Telecommunications Networking - Web dynamics
An Introduction to Search Engines and Web Navigation
An Introduction to Search Engines and Web Navigation
Web Search: Public Searching of the Web (Information Science and Knowledge Management)
Web Search: Public Searching of the Web (Information Science and Knowledge Management)
“THAT’s what i was looking for”: comparing user-rated relevance with search engine rankings
INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
Searching for relevance in the relevance of search
CoLIS'05 Proceedings of the 5th international conference on Context: conceptions of Library and Information Sciences
Exploring educational standard alignment: in search of 'relevance'
Proceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries
Ranked-Listed or Categorized Results in IR: 2 Is Better Than 1
NLDB '08 Proceedings of the 13th international conference on Natural Language and Information Systems: Applications of Natural Language to Information Systems
Proceedings of the 9th ACM/IEEE-CS joint conference on Digital libraries
A coherent measurement of web-search relevance
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
ACM Transactions on Information Systems (TOIS)
Aspects of 'relevance' in the alignment of curriculum with educational standards
Information Processing and Management: an International Journal
Visualizing differences in web search algorithms using the expected weighted hoeffding distance
Proceedings of the 19th international conference on World wide web
Web search solved?: all result rankings the same?
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
World vs. method: educational standard formulation impacts document retrieval
Proceedings of the 11th annual international ACM/IEEE joint conference on Digital libraries
Mental models: have users' mental models of web search engines improved in the last ten years?
EPCE'11 Proceedings of the 9th international conference on Engineering psychology and cognitive ergonomics
Deriving query intents from web search engine queries
Journal of the American Society for Information Science and Technology
The impact of task phrasing on the choice of search keywords and on the search process and success
Journal of the American Society for Information Science and Technology
Harnessing collective intelligence in social tagging using Delicious
Journal of the American Society for Information Science and Technology
Measuring personalization of web search
Proceedings of the 22nd international conference on World Wide Web
Hi-index | 0.00 |
In this study, we investigate the similarities and differences between rankings of search results by users and search engines. Sixty-seven students took part in a 3-week-long experiment, during which they were asked to identify and rank the top 10 documents from the set of URLs that were retrieved by three major search engines (Google, MSN Search, and Yahoo!) for 12 selected queries. The URLs and accompanying snippets were displayed in random order, without disclosing which search engine(s) retrieved any specific URL for the query. We computed the similarity of the rankings of the users and search engines using four nonparametric correlation measures in [0,1] that complement each other. The findings show that the similarities between the users' choices and the rankings of the search engines are low. We examined the effects of the presentation order of the results, and of the thinking styles of the participants. Presentation order influences the rankings, but overall the results indicate that there is no "average user," and even if the users have the same basic knowledge of a topic, they evaluate information in their own context, which is influenced by cognitive, affective, and physical factors. This is the first large-scale experiment in which users were asked to rank the results of identical queries. The analysis of the experimental results demonstrates the potential for personalized search.