Principles of Lifelong Learning for Predictive User Modeling

  • Authors:
  • Ashish Kapoor;Eric Horvitz

  • Affiliations:
  • Microsoft Research, Redmond WA 98052, USA;Microsoft Research, Redmond WA 98052, USA

  • Venue:
  • UM '07 Proceedings of the 11th international conference on User Modeling
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Predictive user models often require a phase of effortful supervised training where cases are tagged with labels that represent the status of unobservable variables. We formulate and study principles of lifelong learning where training is ongoing over a prolonged period. In lifelong learning, decisions about extending a case library are made continuously by balancing the cost of acquiring values of hidden states with the long-term benefits of acquiring new labels. We highlight key principles by extending BusyBody, an application that learns to predict the cost of interrupting a user. We transform the prior BusyBody system into a lifelong learner and then review experiments that highlight the promise of the methods.