On the evaluation of IR systems
Information Processing and Management: an International Journal - Special issue on evaluation issues in information retrieval
User-defined relevance criteria: an exploratory study
Journal of the American Society for Information Science - Special issue: relevance research
Users' criteria for relevance evaluation: a cross-situational comparison
Information Processing and Management: an International Journal
Journal of the American Society for Information Science
Color Sequences for Univariate Maps: Theory, Experiments and Principles
IEEE Computer Graphics and Applications
The concept of relevance in IR
Journal of the American Society for Information Science and Technology
Hi-index | 0.00 |
In this article we propose the concept of relevance criteria profiles, which provide a global view of user behaviour in judging the relevance of retrieved information. We further propose a plotting technique which provides a session based overview of the relevance judgement processes interlaced with interactions that allow the researcher to visualise and quickly detect emerging patterns in both interactions and relevance criteria usage. We discuss by example, using data from a user study conducted between the months of January and August of 2008, how these tools support the better understanding of task based user valuation of documents that is likely to lead to recommendations for improving enduser services in digital libraries.