Evaluating a personal information assistant

Authors:
Ioannis Psarras;Joemon Jose
Affiliations:
University of Glasgow, Glasgow;University of Glasgow, Glasgow
Venue:
Large Scale Semantic Access to Content (Text, Image, Video, and Sound)
Year:
2007

Citing 11
Cited 0

Evaluation issues in information retrieval

Information Processing and Management: an International Journal - Special issue on evaluation issues in information retrieval
WebMate: a personal agent for browsing and searching

AGENTS '98 Proceedings of the second international conference on Autonomous agents
Spatial querying for image retrieval: a user-oriented evaluation

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Real life, real users, and real needs: a study and analysis of user queries on the web

Information Processing and Management: an International Journal
A review of web searching studies and a framework for future research

Journal of the American Society for Information Science and Technology
Reading time, scrolling and interaction: exploring implicit sources of user preferences for relevance feedback

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
The Use of Implicit Evidence for Relevance Feedback in Web Retrieval

Proceedings of the 24th BCS-IRSG European Colloquium on IR Research: Advances in Information Retrieval
A personalised information retrieval tool

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
A task-oriented study on the influencing effects of query-biased summarisation in web searching

Information Processing and Management: an International Journal
Letizia: an agent that assists web browsing

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 1
A system for adaptive information retrieval

AH'06 Proceedings of the 4th international conference on Adaptive Hypermedia and Adaptive Web-Based Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Personal Information Assistants that search on user's behalf aim to fetch relevant documents on a regular basis. We have developed such assistant system and evaluated it using a long-term, task-oriented approach involving real users. Current evaluation methodologies are inadequate and hence have resorted to a long-term real user study. This paper describes the design and development of our system and the results of the evaluation study.