Bayesian Update of Recursive Agent Models

  • Authors:
  • Piotr J. Gmytrasiewicz;Sanguk Noh;Tad Kellogg

  • Affiliations:
  • Department of Computer Science and Engineering, University of Texas at Arlington, Arlington, TX 76019-0015.;Department of Computer Science and Engineering, University of Texas at Arlington, Arlington, TX 76019-0015.;Department of Computer Science and Engineering, University of Texas at Arlington, Arlington, TX 76019-0015.

  • Venue:
  • User Modeling and User-Adapted Interaction
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a framework for Bayesian updating of beliefs about modelsof agent(s) based on their observed behavior. We work within theformalism of the Recursive Modeling Method (RMM) that maintains andprocesses models an agent may use to interact with other agent(s), themodels the agent may think the other agent has of the original agent,the models the other agent may think the agent has, and so on. Thebeliefs about which model is the correct one are incrementally updatedbased on the observed behavior of the modeled agent and, as theresult, the probability of the model that best predicted the observedbehavior is increased. Analogously, the models on deeper levels ofmodeling can be updated; the models that the agent thinks anotheragent uses to model the original agent are revised based on how theother agent is expected to observe the original agent‘s behavior, andso on. We have implemented and tested our method in two domains, andthe results show a marked improvement in the quality of interactionswith the belief update in both domains.