Evaluating personal information retrieval

Authors:
Liadh Kelly;Paul Bunbury;Gareth J. F. Jones
Affiliations:
Centre for Next Generation Localisation, School of Computing, Dublin City University (DCU), Dublin, Ireland;Centre for Next Generation Localisation, School of Computing, Dublin City University (DCU), Dublin, Ireland;Centre for Next Generation Localisation, School of Computing, Dublin City University (DCU), Dublin, Ireland
Venue:
ECIR'12 Proceedings of the 34th European conference on Advances in Information Retrieval
Year:
2012

Citing 4
Cited 0

Connections: using context to enhance file search

Proceedings of the twentieth ACM symposium on Operating systems principles
Introduction to Information Retrieval

Introduction to Information Retrieval
Evaluation Challenges and Directions for Information-Seeking Support Systems

Computer
Retrieval experiments using pseudo-desktop collections

Proceedings of the 18th ACM conference on Information and knowledge management

Quantified Score

Hi-index	0.00

Visualization

Abstract

Evaluation of personal search over an individual's personal information space on the desktop or elsewhere is problematic for reasons relating both to the personal and private nature of the data and the associated personal information needs of collection owners. Indeed challenges associated with evaluation in this space are recognised as one of the key factors hindering the development of research in personal information retrieval. We present the "personal information retrieval evaluation (PIRE)" tool, which provides a solution to this evaluation problem using a ‘living laboratory' approach. This tool allows for the evaluation of retrieval techniques using ‘real' individuals' personal collections, queries and result sets, in a cross-comparable repeatable way, while importantly maintaining an individual's informational privacy.