An evaluation of retrieval effectiveness for a full-text document-retrieval system
Communications of the ACM
Another look at automatic text-retrieval systems
Communications of the ACM
Annual review of information science and technology, vol. 22
Knapsack problems: algorithms and computer implementations
Knapsack problems: algorithms and computer implementations
The pragmatics of information retrieval experimentation, revisited
Information Processing and Management: an International Journal - Special issue on evaluation issues in information retrieval
Natural language vs. Boolean query evaluation: a comparison of retrieval performance
SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Consistency in the selection of search concepts and search terms
Information Processing and Management: an International Journal
An evaluation of interactive Boolean and natural language searching with an online medical textbook
Journal of the American Society for Information Science
Evaluation of evaluation in information retrieval
SIGIR '95 Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval
A deductive data model for query expansion
SIGIR '96 Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval
Freestyle vs. Boolean: a comparison of partial and exact match retrieval systems
Information Processing and Management: an International Journal
Boolean search: current state and perspectives
Journal of the American Society for Information Science - Special topic issue: youth issues in information science
Information Retrieval Experiment
Information Retrieval Experiment
Information Retrieval Today
Introduction to Modern Information Retrieval
Introduction to Modern Information Retrieval
Online Information Retrieval: Concepts, Principles, and Techniques
Online Information Retrieval: Concepts, Principles, and Techniques
Proceedings of the 24th BCS-IRSG European Colloquium on IR Research: Advances in Information Retrieval
Coverage, relevance, and ranking: The impact of query operators on Web search engine results
ACM Transactions on Information Systems (TOIS)
On the use of negation in Boolean IR queries
Information Processing and Management: an International Journal
| Hi-index | 0.00 |
Traditional methods for the system-oriented evaluation of Boolean IR system suffer from validity and reliability problems. Laboratory-based research neglects the searcher and studies suboptimal queries. Research on operational systems fails to make a distinction between searcher performance and system performance. This approach is neither capable of measuring performance at standard points of operation (e.g. across R0.0-R1.0).A new laboratory-based evaluation method for Boolean IR systems is proposed. It is based on a controlled formulation of inclusive query plans, on an automatic conversion of query plans into elementary queries, and on combining elementary queries into optimal queries at standard points of operation. Major results of a large case experiment are reported. The validity, reliability, and efficiency of the method are considered in the light of empirical and analytical test data.