Personalizing influence diagrams: applying online learning strategies to dialogue management

Authors:
David Maxwell Chickering;Tim Paek
Affiliations:
Microsoft Research, Redmond, USA 98052;Microsoft Research, Redmond, USA 98052
Venue:
User Modeling and User-Adapted Interaction
Year:
2007

Citing 0
Cited 4

Automating spoken dialogue management design using machine learning: An industry perspective

Speech Communication
Being Old Doesn’t Mean Acting Old: How Older Users Interact with Spoken Dialog Systems

ACM Transactions on Accessible Computing (TACCESS)
Website Morphing

Marketing Science
Layered evaluation of interactive adaptive systems: framework and formative methods

User Modeling and User-Adapted Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

We consider the problem of adapting the parameters of an influence diagram in an online fashion for real-time personalization. This problem is important when we use the influence diagram repeatedly to make decisions and we are uncertain about its parameters. We describe learning algorithms to solve this problem. In particular, we show how to modify various explore-versus-exploit strategies that are known to work well for Markov decision processes to the more general influence-diagram model. As an illustration, we describe how our techniques for online personalization allow a voice-enabled browser to adapt to a particular speaker for spoken dialogue management. We evaluate all the explore-versus-exploit strategies in this domain.