Discourse strategies for generating natural-language text
Artificial Intelligence
Attention, intentions, and the structure of discourse
Computational Linguistics
Practical Issues in Temporal Difference Learning
Machine Learning
Placing text labels on maps and diagrams
Graphics gems IV
User Interfaces for voice applications
Voice communication between humans and machines
Informational redundancy and resource bounds in dialogue
Informational redundancy and resource bounds in dialogue
Artificial intelligence: a modern approach
Artificial intelligence: a modern approach
A plan-based model for response generation in collaborative task-oriented dialogues
AAAI '94 Proceedings of the twelfth national conference on Artificial intelligence (vol. 1)
Learning to act using real-time dynamic programming
Artificial Intelligence - Special volume on computational research on interaction and agency, part 1
Spoken natural language dialog systems: a practical approach
Spoken natural language dialog systems: a practical approach
Empirical methods for artificial intelligence
Empirical methods for artificial intelligence
The effect of resource limits and task complexity on collaborative planning in dialogue
Artificial Intelligence - Special volume on empirical methods
What can I say?: evaluating a spoken language interface to Email
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Generating English discourse from semantic networks
Communications of the ACM
Understanding Natural Language
Understanding Natural Language
Introduction to Reinforcement Learning
Introduction to Reinforcement Learning
Understanding Spoken Language
Dynamic Programming
Towards developing general models of usability with PARADISE
Natural Language Engineering
TEAM: a transportable natural-language interface system
ANLC '83 Proceedings of the first conference on Applied natural language processing
Tracking initiative in collaborative dialogue interactions
ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
PARADISE: a framework for evaluating spoken dialogue agents
ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Learning optimal dialogue strategies: a case study of a spoken dialogue agent for email
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Planning text for advisory dialogues
ACL '89 Proceedings of the 27th annual meeting on Association for Computational Linguistics
Mixed initiative in dialogue: an investigation into discourse segmentation
ACL '90 Proceedings of the 28th annual meeting on Association for Computational Linguistics
Taking the initiative in natural language data base interactions: justifying why
COLING '82 Proceedings of the 9th conference on Computational linguistics - Volume 1
Automatic detection of poor speech recognition at the dialogue level
ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
HLT '91 Proceedings of the workshop on Speech and Natural Language
Nash q-learning for general-sum stochastic games
The Journal of Machine Learning Research
Towards developing general models of usability with PARADISE
Natural Language Engineering
Evaluating a trainable sentence planner for a spoken dialogue system
ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
NAACL '01 Proceedings of the second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies
Training a Dialogue Act Tagger for human-human and human-computer travel dialogues
SIGDIAL '02 Proceedings of the 3rd SIGdial workshop on Discourse and dialogue - Volume 2
Bridging the gap between dialogue management and dialogue models
SIGDIAL '02 Proceedings of the 3rd SIGdial workshop on Discourse and dialogue - Volume 2
HITIQA: an interactive question answering system a preliminary report
MultiSumQA '03 Proceedings of the ACL 2003 workshop on Multilingual summarization and question answering - Volume 12
An adaptive plan-based dialogue agent: integrating learning into a BDI architecture
AAMAS '06 Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems
The Knowledge Engineering Review
HITIQA: towards analytical question answering
COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Learning mixed initiative dialog strategies by using reinforcement learning on both conversants
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Comparing the utility of state features in spoken dialogue using reinforcement learning
HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
Accessing speech data using strategic fixation
Computer Speech and Language
Promoting extension and reuse in a spoken dialog manager: An evaluation of the queen's communicator
ACM Transactions on Speech and Language Processing (TSLP)
Automatic learning of dialogue strategy using dialogue simulation and reinforcement learning
HLT '02 Proceedings of the second international conference on Human Language Technology Research
A reinforcement agent for threshold fusion
Applied Soft Computing
Testing the performance of spoken dialogue systems by means of an artificially simulated user
Artificial Intelligence Review
Selection of Optimum Vocabulary and Dialog Strategy for Noise-Robust Spoken Dialog Systems
IEICE - Transactions on Information and Systems
Learning effective and engaging strategies for advice-giving human-machine dialogue
Natural Language Engineering
Technical support dialog systems: issues, problems, and solutions
NAACL-HLT-Dialog '07 Proceedings of the Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technologies
Semi-formal Evaluation of Conversational Characters
Languages: From Formal to Natural
Evaluation of a hierarchical reinforcement learning spoken dialogue system
Computer Speech and Language
Optimizing dialogue management with reinforcement learning: experiments with the NJFun system
Journal of Artificial Intelligence Research
Introspection and adaptable model integration for dialogue-based question answering
IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Comparing objective and subjective measures of usability in a human-robot dialogue system
ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
MP-Draughts: a multiagent reinforcement learning system based on MLP and Kohonen-SOM neural networks
SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
The Knowledge Engineering Review
Bayesian update of dialogue state: A POMDP framework for spoken dialogue systems
Computer Speech and Language
Using reinforcement learning to create communication channel management strategies for diverse users
SLPAT '10 Proceedings of the NAACL HLT 2010 Workshop on Speech and Language Processing for Assistive Technologies
Situated reference in a hybrid human-robot interaction system
INLG '10 Proceedings of the 6th International Natural Language Generation Conference
Towards learned feedback for enhancing trust in information seeking dialogue for radiologists
Proceedings of the 16th international conference on Intelligent user interfaces
Spatially-aware dialogue control using hierarchical reinforcement learning
ACM Transactions on Speech and Language Processing (TSLP)
User Modeling and User-Adapted Interaction
Estimating the number of segments for improving dialogue act labelling
Natural Language Engineering
International Journal of Artificial Intelligence in Education - Special issue on Best of ITS 2010
Two people walk into a bar: dynamic multi-party social interaction with a robot agent
Proceedings of the 14th ACM international conference on Multimodal interaction
Optimising incremental dialogue decisions using information density for interactive systems
EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Hi-index | 0.00 |
This paper describes a novel method by which a spoken dialogue system can learn to choose an optimal dialogue strategy from its experience interacting with human users. The method is based on a combination of reinforcement learning and performance modeling of spoken dialogue systems. The reinforcement learning component applies Q-learning (Watkins, 1989), while the performance modeling component applies the PARADISE evaluation framework (Walker et al., 1997) to learn the performance function (reward) used in reinforcement learning. We illustrate the method with a spoken dialogue system named elvis (EmaiL Voice Interactive System), that supports access to email over the phone. We conduct a set of experiments for training an optimal dialogue strategy on a corpus of 219 dialogues in which human users interact with elvis over the phone. We then test that strategy on a corpus of 18 dialogues. We show that elvis can learn to optimize its strategy selection for agent initiative, for reading messages, and for summarizing email folders.