An analysis of Internet search engines: assessment of over 200 search queries
Computers in Libraries
Variations in relevance assessments and the measurement of retrieval effectiveness
Journal of the American Society for Information Science - Special issue: evaluation of information retrieval systems
Guidelines for presentation and comparison of indexing techniques
ACM SIGMOD Record
Time, relevance and interaction modelling for information retrieval
Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval
Journal of the American Society for Information Science
How reliable are the results of large-scale information retrieval experiments?
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Variations in relevance judgments and the measurement of retrieval effectiveness
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Ethnography of novices' first use of Web search engines: affective control in cognitive processing
Internet Reference Services Quarterly
A technique for measuring the relative size and overlap of public Web search engines
WWW7 Proceedings of the seventh international conference on World Wide Web 7
Value of search results as a whole as the best single measure of information retrieval performance
Information Processing and Management: an International Journal
Finding information on the World Wide Web: the retrieval effectiveness of search engines
Information Processing and Management: an International Journal
Measuring index quality using random walks on the Web
WWW '99 Proceedings of the eighth international conference on World Wide Web
Results and challenges in Web search evaluation
WWW '99 Proceedings of the eighth international conference on World Wide Web
Discriminating meta-search: a framework for evaluation
Information Processing and Management: an International Journal - Special issue on progress toward digital libraries
First 20 precision among World Wide Web search services (search engines)
Journal of the American Society for Information Science
Analysis of a very large web search engine query log
ACM SIGIR Forum
Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking
A review of web searching studies and a framework for future research
Journal of the American Society for Information Science and Technology
A case study in web search using TREC algorithms
Proceedings of the 10th international conference on World Wide Web
Ranking retrieval systems without relevance judgments
Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Methods for measuring search engine performance over time
Journal of the American Society for Information Science and Technology
Getting answers to natural language questions on the web
Journal of the American Society for Information Science and Technology
Text Information Retrieval Systems
Text Information Retrieval Systems
The web retrieval task and its evaluation in the third NTCIR workshop
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Automatic evaluation of world wide web search services
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Assessing bias in search engines
Information Processing and Management: an International Journal
Measuring Search Engine Quality
Information Retrieval
Precision Evaluation of Search Engines
World Wide Web
Information Processing and Management: an International Journal
Evaluating and Enhancing Meta-Search Performance in Digital Libraries
WISE '02 Proceedings of the 3rd International Conference on Web Information Systems Engineering
The Philosophy of Information Retrieval Evaluation
CLEF '01 Revised Papers from the Second Workshop of the Cross-Language Evaluation Forum on Evaluation of Cross-Language Information Retrieval Systems
U.S. versus European web searching trends
ACM SIGIR Forum
On the effectiveness of evaluating retrieval systems in the absence of relevance judgments
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Automatic ranking of retrieval systems in imperfect environments
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
A new statistical method for performance evaluation of search engines
ICTAI '00 Proceedings of the 12th IEEE International Conference on Tools with Artificial Intelligence
Methods for ranking information retrieval systems without relevance judgments
Proceedings of the 2003 ACM symposium on Applied computing
Using titles and category names from editor-driven taxonomies for automatic evaluation
CIKM '03 Proceedings of the twelfth international conference on Information and knowledge management
Journal of the American Society for Information Science and Technology
Journal of the American Society for Information Science and Technology
Automatic performance evaluation of web search engines
Information Processing and Management: an International Journal
Scaling IR-system evaluation using term relevance sets
Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
On evaluating web search with very few relevant documents
Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
New measurements for search engine evaluation proposed and tested
Information Processing and Management: an International Journal
A subjective measure of web search quality
Information Sciences—Informatics and Computer Science: An International Journal
The indexable web is more than 11.5 billion pages
WWW '05 Special interest tracks and posters of the 14th international conference on World Wide Web
Automated evaluation of search engine performance via implicit user feedback
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Automatic ranking of information retrieval systems using data fusion
Information Processing and Management: an International Journal
Random sampling from a search engine's index
Proceedings of the 15th international conference on World Wide Web
The effectiveness of web search engines for retrieving relevant ecommerce links
Information Processing and Management: an International Journal
A statistical method for system evaluation using incomplete judgments
SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Estimating corpus size via queries
CIKM '06 Proceedings of the 15th ACM international conference on Information and knowledge management
Efficient search engine measurements
Proceedings of the 16th international conference on World Wide Web
User-Based Evaluations of Search Engines: Hygiene Factors and Motivation Factors
HICSS '07 Proceedings of the 40th Annual Hawaii International Conference on System Sciences
How are we searching the World Wide Web? A comparison of nine search engine transaction logs
Information Processing and Management: an International Journal - Special issue: Formal methods for information retrieval
Improving the evaluation of web search systems
ECIR'03 Proceedings of the 25th European conference on IR research
Improving the evaluation of web search systems
ECIR'03 Proceedings of the 25th European conference on IR research
Focused crawling of tagged web resources using ontology
Computers and Electrical Engineering
Russian web spam evolution: yandex experience
Proceedings of the 22nd international conference on World Wide Web companion
Hi-index | 0.00 |
Web search evaluation is the process of measuring the effectiveness of a Web search system. Such an evaluation helps in identifying the most effective one and helps the users to find the required information with less effort. Web search systems have been evaluated in many different ways in the last 15years. In this paper, we review some of the efforts made for the evaluation of Web search systems. We discuss these evaluation studies by classifying them into eight different categories. As the size and content of Web is changing rapidly, and hence, the Web search techniques, we mention the necessity of an automatic evaluation methodology. But, at the same time, we emphasize that the significance of user based evaluation can not be neglected. Finally, we conclude that an automatic evaluation method that models users' feedback based evaluation is required for the effective and realistic evaluation of Web search systems.