The vocabulary problem in human-system communication
Communications of the ACM
A re-examination of relevance: toward a dynamic, situational definition
Information Processing and Management: an International Journal
Logic and information
Information retrieval interaction
Information retrieval interaction
Journal of the American Society for Information Science - Special issue: relevance research
Visual information seeking: tight coupling of dynamic query filters with starfield displays
CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An introduction to Kolmogorov complexity and its applications (2nd ed.)
An introduction to Kolmogorov complexity and its applications (2nd ed.)
Journal of the American Society for Information Science - Special topic issue on the history of documentation and information science: part II
Spatial querying for image retrieval: a user-oriented evaluation
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Situated Cognition: On Human Knowledge and Computer Representations
Situated Cognition: On Human Knowledge and Computer Representations
Social and cognitive factors in the design and evaluation of multimedia systems
IRSG'98 Proceedings of the 20th Annual BCS-IRSG conference on Information Retrieval Research
Evaluation of Text Retrieval Systems
Programming and Computing Software
Exploring cost-effective approaches to human evaluation of search engine relevance
ECIR'05 Proceedings of the 27th European conference on Advances in Information Retrieval Research
Hi-index | 0.00 |
This work reports the results of an enquiry on the concept of relevance and on relevance judgments carried out during the MIRA workshops activities in 1998/1999. Starting from a previous proposal [23], we present the multidimensional relevance space, a framework for describing the various kinds of relevance, which has been negotiated with experts belonging to the MIRA community. The relevance dimensions of information needs, information resources, and information use context are presented, and a three dimensional graphical representation of the framework is proposed. The differences between the original framework and the revised one, and the advantages of the latter, are discussed. Some implications of the framework for the design and evaluation of information access systems and their user interfaces are also derived and, finally, an exploratory study on the issue of agreement in relevance judgments, and its consequences for the design of multimedia test collections, are presented.