Resolute choice in sequential decision problems with multiple priors

  • Authors:
  • Hélène Fargier;Gildas Jeantet;Olivier Spanjaard

  • Affiliations:
  • IRIT-CNRS, UMR, Université Paul Sabatier, Toulouse, France;LIP6-CNRS, UMR, UPMC, Paris, France;LIP6-CNRS, UMR, UPMC, Paris, France

  • Venue:
  • IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper is devoted to sequential decision making under uncertainty, in the multi-prior framework of Gilboa and Schmeidler [1989]. In this setting, a set of probability measures (priors) is defined instead of a single one, and the decision maker selects a strategy that maximizes the minimum possible value of expected utility over this set of priors. We are interested here in the resolute choice approach, where one initially commits to a complete strategy and never deviates from it later. Given a decision tree representation with multiple priors, we study the problem of determining an optimal strategy from the root according to min expected utility. We prove the intractability of evaluating a strategy in the general case. We then identify different properties of a decision tree that enable to design dedicated resolution procedures. Finally, experimental results are presented that evaluate these procedures.