Context matters: an analysis of assessments of XML documents

Authors:
Nils Pharo;Ragnar Nordlie
Affiliations:
Faculty of Journalism, Library and Information Science, Oslo University College, Oslo, Norway;Faculty of Journalism, Library and Information Science, Oslo University College, Oslo, Norway
Venue:
CoLIS'05 Proceedings of the 5th international conference on Context: conceptions of Library and Information Sciences
Year:
2005

Citing 6
Cited 9

A survey in indexing and searching XML documents

Journal of the American Society for Information Science and Technology - XML
Using graded relevance assessments in IR evaluation

Journal of the American Society for Information Science and Technology
A report on the first year of the INitiative for the evaluation of XML retrieval (INEX'02)

Journal of the American Society for Information Science and Technology
The overlap problem in content-oriented XML retrieval evaluation

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
User behaviour in the context of structured documents

ECIR'03 Proceedings of the 25th European conference on IR research
The interactive track at INEX 2004

INEX'04 Proceedings of the Third international conference on Initiative for the Evaluation of XML Retrieval

Users, structured documents and overlap: interactive searching of elements and the influence of context on search behaviour

IIiX Proceedings of the 1st international conference on Information interaction in context
The effect of granularity and order in XML element retrieval

Information Processing and Management: an International Journal
Reconsideration of the simulated work task situation: a context instrument for evaluation of information retrieval interaction

Proceedings of the third symposium on Information interaction in context
Overview of the INEX 2009 interactive track

INEX'09 Proceedings of the Focused retrieval and evaluation, and 8th international conference on Initiative for the evaluation of XML retrieval
Overview of the INEX 2010 interactive track

INEX'10 Proceedings of the 9th international conference on Initiative for the evaluation of XML retrieval: comparative evaluation of focused retrieval
The interactive track at INEX 2005

INEX'05 Proceedings of the 4th international conference on Initiative for the Evaluation of XML Retrieval
The use of summaries in XML retrieval

ECDL'06 Proceedings of the 10th European conference on Research and Advanced Technology for Digital Libraries
Examining the effect of task stage and topic knowledge on searcher interaction with a "digital bookstore"

Proceedings of the 4th Information Interaction in Context Symposium
Seven years of INEX interactive retrieval experiments --- lessons and challenges

CLEF'12 Proceedings of the Third international conference on Information Access Evaluation: multilinguality, multimodality, and visual analytics

Quantified Score

Hi-index	0.00

Visualization

Abstract

The paper analyses searchers' assessments of usefulness and specificity on different levels of granularity in XML-coded documents. Documents are assessed on 10 usefulness/specificity combinations and on the granularity levels of article, section, and subsection. Overlapping judgements show a remarkable lack of consistency between searchers. There is an inverse relationship between articles and sections both in the assessment of specificity and of usefulness, indicating that retrieval on different granularity levels are a useful feature of a retrieval system. Searchers find the full article more useful when they assess the same document both on the article and section level indicating that there is a need to provide context to the sections and subsections when presenting result list of XML-documents.