Variations in relevance assessments and the measurement of retrieval effectiveness
Journal of the American Society for Information Science - Special issue: evaluation of information retrieval systems
The anatomy of a large-scale hypertextual Web search engine
WWW7 Proceedings of the seventh international conference on World Wide Web 7
Finding information on the World Wide Web: the retrieval effectiveness of search engines
Information Processing and Management: an International Journal
Results and challenges in Web search evaluation
WWW '99 Proceedings of the eighth international conference on World Wide Web
Analysis of a very large web search engine query log
ACM SIGIR Forum
Collaborative relevance judgment: a group consensus method for evaluating user search performance
Journal of the American Society for Information Science and Technology
Methods for measuring search engine performance over time
Journal of the American Society for Information Science and Technology
Journal of the American Society for Information Science and Technology
Median measure: an approach to IR systems evaluation
Information Processing and Management: an International Journal
Introduction to Modern Information Retrieval
Introduction to Modern Information Retrieval
Measuring Search Engine Quality
Information Retrieval
Some thoughts on the reported results of TREC
Information Processing and Management: an International Journal
Scholarly use of the web: what are the key inducers of links to journal web sites?
Journal of the American Society for Information Science and Technology
Information Processing and Management: an International Journal
Bibliographic and Web citations: what is the difference?
Journal of the American Society for Information Science and Technology
Search engine coverage bias: evidence and possible causes
Information Processing and Management: an International Journal
Comparing rankings of search results on the web
Information Processing and Management: an International Journal - Special issue: Infometrics
The effectiveness of web search engines for retrieving relevant ecommerce links
Information Processing and Management: an International Journal
Visualizing linguistic and cultural differences using Web co-link data: Research Articles
Journal of the American Society for Information Science and Technology
Methods for comparing rankings of search engine results
Computer Networks: The International Journal of Computer and Telecommunications Networking - Web dynamics
The comparative effectiveness of sponsored and nonsponsored links for Web e-commerce queries
ACM Transactions on the Web (TWEB)
Web searching, search engines and Information Retrieval
Information Services and Use
Google Scholar citations and Google Web-URL citations: A multi-discipline exploratory analysis
Journal of the American Society for Information Science and Technology
Agreeing to disagree: search engines and their public interfaces
Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries
User rankings of search engine results
Journal of the American Society for Information Science and Technology
User-Oriented Evaluation Methods for Interactive Web Search Interfaces
WI-IATW '07 Proceedings of the 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Workshops
Tagging and searching: Search retrieval effectiveness of folksonomies on the World Wide Web
Information Processing and Management: an International Journal
Motivation for using search engines: A two-factor model
Journal of the American Society for Information Science and Technology
A generic construct based workload model for web search
Information Processing and Management: an International Journal
Comparing rankings of search results on the Web
Information Processing and Management: an International Journal - Special issue: Infometrics
A coherent measurement of web-search relevance
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
Visualizing differences in web search algorithms using the expected weighted hoeffding distance
Proceedings of the 19th international conference on World wide web
Optimizing search engines results using linear programming
Expert Systems with Applications: An International Journal
Search-logger analyzing exploratory search tasks
Proceedings of the 2011 ACM Symposium on Applied Computing
An overview of Web search evaluation methods
Computers and Electrical Engineering
PAKDD'05 Proceedings of the 9th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining
Testing the effectiveness of retrieval to queries using polish words with diacritics
AWIC'05 Proceedings of the Third international conference on Advances in Web Intelligence
An empirical investigation of factors affecting ubiquitous computing use and U-business value
International Journal of Information Management: The Journal for Information Professionals
Journal of the American Society for Information Science and Technology
Ranking Tagged Resources Using Social Semantic Relevance
International Journal of Information Retrieval Research
Measuring personalization of web search
Proceedings of the 22nd international conference on World Wide Web
Hi-index | 0.01 |
A set of measurements is proposed for evaluating Web search engine performance. Some measurement are adapted from the concepts of recall and precision, which are commonly used in evaluating traditional information retrieval systems. Others are newly developed to evaluate search engine stability, an issue unique to Web information retrieval systems. An experiment was conducted to test these new measurements by applying them to a performance comparison of three commercial search engines: Google, AltaVista, and Teoma. Twenty-four subjects ranked four sets of Web pages and their rankings were used as benchmarks against which to compare search engine performance. Results show that the proposed measurements are able to distinguish search engine performance very well.