Directing exploratory search: reinforcement learning from user interactions with keywords

  • Authors:

  • Dorota Glowacka;Tuukka Ruotsalo;Ksenia Konuyshkova;kumaripaba Athukorala;Samuel Kaski;Giulio Jacucci

  • Affiliations:

  • University of Helsinki, Helsinki, Finland;Aalto University, Espoo, Finland;University of Helsinki, Helsinki, Finland;University of Helsinki, Helsinki, Finland;Helsinki University, Helsinki, Finland;Helsinki University, Helsinki, Finland

  • Venue:
  • Proceedings of the 2013 international conference on Intelligent user interfaces
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Techniques for both exploratory and known item search tend to direct only to more specific subtopics or individual documents, as opposed to allowing directing the exploration of the information space. We present an interactive information retrieval system that combines Reinforcement Learning techniques along with a novel user interface design to allow active engagement of users in directing the search. Users can directly manipulate document features (keywords) to indicate their interests and Reinforcement Learning is used to model the user by allowing the system to trade off between exploration and exploitation. This gives users the opportunity to more effectively direct their search nearer, further and following a direction. A task-based user study conducted with 20 participants comparing our system to a traditional query-based baseline indicates that our system significantly improves the effectiveness of information retrieval by providing access to more relevant and novel information without having to spend more time acquiring the information.