Automatic text processing
SIGIR '89 Proceedings of the 12th annual international ACM SIGIR conference on Research and development in information retrieval
Nonmonotonic reasoning, preferential models and cumulative logics
Artificial Intelligence
Information retrieval: data structures and algorithms
Information retrieval: data structures and algorithms
Towards a probabilistic modal logic for semantic-based information retrieval
SIGIR '92 Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval
A comparison of text retrieval models
The Computer Journal - Special issue on information retrieval
Investigating aboutness axioms using information fields
SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Probability kinematics in information retrieval
SIGIR '95 Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval
Information calculus for information retrieval
Journal of the American Society for Information Science
Query expansion using local and global document analysis
SIGIR '96 Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval
Pivoted document length normalization
SIGIR '96 Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval
Retrieval of complex objects using a four-valued logic
SIGIR '96 Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval
A study of aboutness in information retrieval
Artificial Intelligence Review
Comparing Boolean and probabilistic information retrieval systems across queries and disciplines
Journal of the American Society for Information Science
(invited paper) A new theoretical framework for information retrieval
Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval
Information flow: the logic of distributed systems
Information flow: the logic of distributed systems
On the role of logic in information retrieval
Information Processing and Management: an International Journal
Logical models in information retrieval: introduction and overview
Information Processing and Management: an International Journal
A study of probability kinematics in information retrieval
ACM Transactions on Information Systems (TOIS)
Text retrieval and filtering: analytic models of performance
Text retrieval and filtering: analytic models of performance
What is information discovery about?
Journal of the American Society for Information Science
Fundamental properties of aboutness (poster abstract)
Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Aboutness from a commonsense perspective
Journal of the American Society for Information Science
Information retrieval and situation theory
ACM SIGIR Forum
Discovering information flow suing high dimensional conceptual space
Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Information Retrieval and HyperText
Information Retrieval and HyperText
Information Retrieval
Modern Information Retrieval
Informal Inference via Information Flow
DEXA '01 Proceedings of the 12th International Workshop on Database and Expert Systems Applications
Using Default Logic in Information Retrieval
ECSQARU '95 Proceedings of the European Conference on Symbolic and Quantitative Approaches to Reasoning and Uncertainty
Towards Functional Benchmarking of Information Retrieval Models
Proceedings of the Twelfth International Florida Artificial Intelligence Research Society Conference
Fundamental Properties of the Core Matching Functions for Information Retrieval
Proceedings of the Thirteenth International Florida Artificial Intelligence Research Society Conference
Intelligent Text Handling Using Default Logic
ICTAI '96 Proceedings of the 8th International Conference on Tools with Artificial Intelligence
A commonsense aboutness theory for information retrieval modeling
A commonsense aboutness theory for information retrieval modeling
Qualitative relevance and independence: a roadmap
IJCAI'97 Proceedings of the 15th international joint conference on Artifical intelligence - Volume 1
Towards context sensitive information inference
Journal of the American Society for Information Science and Technology - Mathematical, logical, and formal methods in information retrieval
Belief revision for adaptive information retrieval
Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
An exploration of axiomatic approaches to information retrieval
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Theoretical benchmarks of XML retrieval
SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Introduction to special issue on reasoning in natural language information processing
ACM Transactions on Asian Language Information Processing (TALIP)
Inferential language models for information retrieval
ACM Transactions on Asian Language Information Processing (TALIP)
Towards a belief-revision-based adaptive and context-sensitive information retrieval system
ACM Transactions on Information Systems (TOIS)
Specificity Aboutness in XML Retrieval
ICTIR '09 Proceedings of the 2nd International Conference on Theory of Information Retrieval: Advances in Information Retrieval Theory
Specificity aboutness in XML retrieval
Information Retrieval
Diagnostic Evaluation of Information Retrieval Models
ACM Transactions on Information Systems (TOIS)
Comparison of representations of multiple evidence using a functional framework for IR
SPIRE'05 Proceedings of the 12th international conference on String Processing and Information Retrieval
A framework for the theoretical evaluation of XML retrieval
Journal of the American Society for Information Science and Technology
Hi-index | 0.00 |
Experimental approaches are widely employed to benchmark the performance of an information retrieval (IR) system. Measurements in terms of recall and precision are computed as performance indicators. Although they are good at assessing the retrieval effectiveness of an IR system, they fail to explore deeper aspects such as its underlying functionality and explain why the system shows such performance. Recently, inductive (i.e., theoretical) evaluation of IR systems has been proposed to circumvent the controversies of the experimental methods. Several studies have adopted the inductive approach, but they mostly focus on theoretical modeling of IR properties by using some metalogic. In this article, we propose to use inductive evaluation for functional benchmarking of IR models as a complement of the traditional experiment-based performance benchmarking. We define a functional benchmark suite in two stages: the evaluation criteria based on the notion of "aboutness," and the formal evaluation methodology using the criteria. The proposed benchmark has been successfully applied to evaluate various well-known classical and logic-based IR models. The functional benchmarking results allow us to compare and analyze the functionality of the different IR models.