An evaluation of retrieval effectiveness for a full-text document-retrieval system
Communications of the ACM
The Cranfield tests on index language devices
Readings in information retrieval
Computer evaluation of indexing and text processing
Readings in information retrieval
Variations in relevance judgments and the measurement of retrieval effectiveness
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Finding information on the World Wide Web: the retrieval effectiveness of search engines
Information Processing and Management: an International Journal
First 20 precision among World Wide Web search services (search engines)
Journal of the American Society for Information Science
Analysis of a very large web search engine query log
ACM SIGIR Forum
Accessibility of information on the Web
intelligence
Evaluating evaluation measure stability
SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Scaling Up the TREC Collection
Information Retrieval
Non-linear reading for a structured web indexation
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
AuGEAS: authoritativeness grading, estimation, and sorting
Proceedings of the eleventh international conference on Information and knowledge management
Text Retrieval Systems for the Web
Programming and Computing Software
Using manually-built web directories for automatic evaluation of known-item retrieval
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Result merging strategies for a current news metasearcher
Information Processing and Management: an International Journal
Coverage, relevance, and ranking: The impact of query operators on Web search engine results
ACM Transactions on Information Systems (TOIS)
Engineering a multi-purpose test collection for web retrieval experiments
Information Processing and Management: an International Journal
Information Retrieval with Distributed Databases: Analytic Models of Performance
IEEE Transactions on Parallel and Distributed Systems
Using titles and category names from editor-driven taxonomies for automatic evaluation
CIKM '03 Proceedings of the twelfth international conference on Information and knowledge management
Automatic performance evaluation of web search engines
Information Processing and Management: an International Journal
New measurements for search engine evaluation proposed and tested
Information Processing and Management: an International Journal
Search engine coverage bias: evidence and possible causes
Information Processing and Management: an International Journal
Combining evidence for Web retrieval using the inference network model: an experimental study
Information Processing and Management: an International Journal - Special issue: Bayesian networks and information retrieval
A framework for determining necessary query set sizes to evaluate web search effectiveness
WWW '05 Special interest tracks and posters of the 14th international conference on World Wide Web
Search Adaptations and the Challenges of the Web
IEEE Internet Computing
Re-ranking method based on inter-document distances
Information Processing and Management: an International Journal
Comparing rankings of search results on the web
Information Processing and Management: an International Journal - Special issue: Infometrics
Quality and relevance of domain-specific search: A case study in mental health
Information Retrieval
Random sampling from a search engine's index
Proceedings of the 15th international conference on World Wide Web
The effectiveness of web search engines for retrieving relevant ecommerce links
Information Processing and Management: an International Journal
Methods for comparing rankings of search engine results
Computer Networks: The International Journal of Computer and Telecommunications Networking - Web dynamics
Evaluation by comparing result sets in context
CIKM '06 Proceedings of the 15th ACM international conference on Information and knowledge management
More evidence-based internet self-help depression websites now available
Journal of Theoretical and Applied Electronic Commerce Research
AllInOneNews: development and evaluation of a large-scale news metasearch engine
Proceedings of the 2007 ACM SIGMOD international conference on Management of data
The relationship between IR effectiveness measures and user satisfaction
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
An outranking approach for information retrieval
Information Retrieval
Tagging and searching: Search retrieval effectiveness of folksonomies on the World Wide Web
Information Processing and Management: an International Journal
Mining world knowledge for analysis of search engine content
Web Intelligence and Agent Systems
Enhancing web search by promoting multiple search engine use
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Random sampling from a search engine's index
Journal of the ACM (JACM)
Improving Search Performance: A Lesson Learned from Evaluating Search Engines Using Thai Queries
IEICE - Transactions on Information and Systems
Non-english web search: an evaluation of indexing and searching the Greek web
Information Retrieval
Sequential result refinement for searching the biomedical literature
Journal of Biomedical Informatics
A generic construct based workload model for web search
Information Processing and Management: an International Journal
Visualizing the problems with the INEX topics
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Comparing rankings of search results on the Web
Information Processing and Management: an International Journal - Special issue: Infometrics
A coherent measurement of web-search relevance
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
An initial proposal for cooperative evaluation on information retrieval in Portuguese
PROPOR'03 Proceedings of the 6th international conference on Computational processing of the Portuguese language
Relevance measurement on chinese search results
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: applications and services
Mining, ranking, and using acronym patterns
APWeb'08 Proceedings of the 10th Asia-Pacific web conference on Progress in WWW research and development
Evaluating search systems using result page context
Proceedings of the third symposium on Information interaction in context
LESSON: A system for lecture notes searching and sharing over Internet
Journal of Systems and Software
Web search solved?: all result rankings the same?
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
The influence of commercial intent of search results on their perceived relevance
Proceedings of the 2011 iConference
Beyond the usual suspects: context-aware revisitation support
Proceedings of the 22nd ACM conference on Hypertext and hypermedia
A preprocessing framework and approach for web applications
Journal of Web Engineering
A layered approach to revisitation prediction
ICWE'11 Proceedings of the 11th international conference on Web engineering
An overview of Web search evaluation methods
Computers and Electrical Engineering
Evaluation of result merging strategies for metasearch engines
WISE'05 Proceedings of the 6th international conference on Web Information Systems Engineering
Evaluation of the NSDL and google for obtaining pedagogical resources
ECDL'05 Proceedings of the 9th European conference on Research and Advanced Technology for Digital Libraries
Organizational search in email systems
Proceedings of the 50th Annual Southeast Regional Conference
Client- and server-side revisitation prediction with SUPRA
Proceedings of the 2nd International Conference on Web Intelligence, Mining and Semantics
To what problem is distributed information retrieval the solution?
Journal of the American Society for Information Science and Technology
Collect, compare, choose: supporting the decision making cycle on the web
CHINZ '03 Proceedings of the 4th Annual Conference of the ACM Special Interest Group on Computer-Human Interaction
Improving large-scale search engines with semantic annotations
Expert Systems with Applications: An International Journal
Designing search engine retrieval effectiveness tests with RAT
Information Services and Use - APE 2013 --The Funding of Publishing
Hi-index | 0.00 |
The effectiveness of twenty public search engines is evaluated using TREC-inspired methods and a set of 54 queries taken from real Web search logs. The World Wide Web is taken as the test collection and a combination of crawler and text retrieval system is evaluated. The engines are compared on a range of measures derivable from binary relevance judgments of the first seven live results returned. Statistical testing reveals a significant difference between engines and high intercorrelations between measures. Surprisingly, given the dynamic nature of the Web and the time elapsed, there is also a high correlation between results of this study and a previous study by Gordon and Pathak. For nearly all engines, there is a gradual decline in precision at increasing cutoff after some initial fluctuation. Performance of the engines as a group is found to be inferior to the group of participants in the TREC-8 Large Web task, although the best engines approach the median of those systems. Shortcomings of current Web search evaluation methodology are identified and recommendations are made for future improvements. In particular, the present study and its predecessors deal with queries which are assumed to derive from a need to find a selection of documents relevant to a topic. By contrast, real Web search reflects a range of other information need types which require different judging and different measures.