Grounding abstractions in predictive state representations

  • Authors:
  • Brian Tanner;Vadim Bulitko;Anna Koop;Cosmin Paduraru

  • Affiliations:
  • Department of Computing Science, Edmonton, Alberta, Canada;Department of Computing Science, Edmonton, Alberta, Canada;Department of Computing Science, Edmonton, Alberta, Canada;Department of Computing Science, Edmonton, Alberta, Canada

  • Venue:
  • IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes a systematic approach of representing abstract features in terms of low-level, subjective state representations. We demonstrate that a mapping between the agent's predictive state representation and abstract features can be derived automatically from high-level training data supplied by the designer. Our empirical evaluation demonstrates that an experience-oriented state representation built around a single-bit sensor can represent useful abstract features such as "back against a wall", "in a corner", or "in a room". As a result, the agent gains virtual sensors that could be used by its control policy.