Acting optimally in partially observable stochastic domains
AAAI'94 Proceedings of the twelfth national conference on Artificial intelligence (vol. 2)
Bayesian Networks and Decision Graphs
Bayesian Networks and Decision Graphs
Predicting and Adapting to Poor Speech Recognition in a Spoken Dialogue System
Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
Information state and dialogue management in the TRINDI dialogue move engine toolkit
Natural Language Engineering
PARADISE: a framework for evaluating spoken dialogue agents
ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Learning optimal dialogue strategies: a case study of a spoken dialogue agent for email
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Predicting user reactions to system error
ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Corpus-based discourse understanding in spoken dialogue systems
ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
Spoken dialogue management using probabilistic reasoning
ACL '00 Proceedings of the 38th Annual Meeting on Association for Computational Linguistics
Comparing several aspects of human-computer and human-human dialogues
SIGDIAL '01 Proceedings of the Second SIGdial Workshop on Discourse and Dialogue - Volume 16
ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Fast reinforcement learning of dialog strategies
ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 02
Automatic learning of dialogue strategy using dialogue simulation and reinforcement learning
HLT '02 Proceedings of the second international conference on Human Language Technology Research
Are We There Yet? Research in Commercial Spoken Dialog Systems
TSD '09 Proceedings of the 12th International Conference on Text, Speech and Dialogue
Optimizing dialogue management with reinforcement learning: experiments with the NJFun system
Journal of Artificial Intelligence Research
Point-based value iteration: an anytime algorithm for POMDPs
IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
Solving POMDPs with continuous or large discrete observation spaces
IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Solving POMDPs by searching in policy space
UAI'98 Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence
Supporting Multiple User Types with a Multimodal Dialog Agent
WI-IATW '07 Proceedings of the 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Workshops
A statistical approach to spoken dialog systems design and evaluation
Speech Communication
A Two Phases Statistical Approach for Dialog Management
PIT '08 Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems
A Dialog Management Methodology Based on Neural Networks and Its Application to Different Domains
CIARP '08 Proceedings of the 13th Iberoamerican congress on Pattern Recognition: Progress in Pattern Recognition, Image Analysis and Applications
Evaluating user simulations with the Cramér-von Mises divergence
Speech Communication
Statistical framework for a Spanish spoken dialogue corpus
Speech Communication
Computational Linguistics
Example-based dialog modeling for practical multi-domain dialog system
Speech Communication
Natural Language Engineering
Data-driven user simulation for automated evaluation of spoken dialog systems
Computer Speech and Language
Applying POMDPs to dialog systems in the troubleshooting domain
NAACL-HLT-Dialog '07 Proceedings of the Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technologies
NAACL-HLT-Dialog '07 Proceedings of the Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technologies
Mixture model POMDPs for efficient handling of uncertainty in dialogue management
HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers
Using automatically transcribed dialogs to learn user models in a spoken dialog system
HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers
Demonstration of a POMDP voice dialer
HLT-Demonstrations '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Demo Session
Decision making in assistive environments using multimodal observations
Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments
Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments
Learning to interpret utterances using dialogue history
EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Agenda-based user simulation for bootstrapping a POMDP dialogue system
NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers
The hidden information state dialogue manager: a real-world POMDP-based system
NAACL-Demonstrations '07 Proceedings of Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations
Situated conversational agents
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
A variance analysis for POMDP policy evaluation
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 2
Automatic agenda graph construction from human-human dialogs using clustering method
NAACL-Short '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers
The Hidden Information State model: A practical framework for POMDP-based spoken dialogue management
Computer Speech and Language
Evaluation of a hierarchical reinforcement learning spoken dialogue system
Computer Speech and Language
SETQA-NLP '09 Proceedings of the Workshop on Software Engineering, Testing, and Quality Assurance for Natural Language Processing
Optimal dialog in consumer-rating systems using a POMDP framework
SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
Training and evaluation of the HIS POMDP dialogue system in noise
SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
A frame-based probabilistic framework for spoken dialog management using dialog examples
SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
User simulation as testing for spoken dialog systems
SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
An evaluation understudy for dialogue coherence models
SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
Inverse reinforcement learning in partially observable environments
IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
ACLDemos '09 Proceedings of the ACL-IJCNLP 2009 Software Demonstrations
Setting up user action probabilities in user simulations for dialog system development
ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
Analysis of listening-oriented dialogue for building listening agents
SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Estimating probability of correctness for ASR N-best lists
SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
A comparison between dialog corpora acquired with real and simulated users
SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
A POMDP approach to P300-based brain-computer interfaces
Proceedings of the 15th international conference on Intelligent user interfaces
The Knowledge Engineering Review
The role of spoken language dialogue interaction in intelligent environments
Journal of Ambient Intelligence and Smart Environments
Three way relationship of human-robot interaction
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Hybrid approach to robust dialog management using agenda and dialog examples
Computer Speech and Language
Bayesian update of dialogue state: A POMDP framework for spoken dialogue systems
Computer Speech and Language
Recognition and understanding simulation for a spoken dialog corpus acquisition
TSD'07 Proceedings of the 10th international conference on Text, speech and dialogue
From dialogue management to pervasive interaction based assistive technology
Proceedings of the 3rd International Conference on PErvasive Technologies Related to Assistive Environments
Towards relational POMDPs for adaptive dialogue management
ACLstudent '10 Proceedings of the ACL 2010 Student Research Workshop
Controlling listening-oriented dialogue using partially observable Markov decision processes
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
User and noise adaptive dialogue management using hybrid system actions
IWSDS'10 Proceedings of the Second international conference on Spoken dialogue systems for ambient environments
Simulation of the grounding process in spoken dialog systems with Bayesian networks
IWSDS'10 Proceedings of the Second international conference on Spoken dialogue systems for ambient environments
Modeling user satisfaction transitions in dialogues from overall ratings
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Dialogue management based on entities and constraints
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Learning dialogue strategies from older and younger simulated users
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Sparse approximate dynamic programming for dialog management
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Statistical dialog management methodologies for real applications
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
User-adaptive coordination of agent communicative behavior in spoken dialogue
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Introduction to special issue on machine learning for adaptivity in spoken dialogue systems
ACM Transactions on Speech and Language Processing (TSLP)
Sample-efficient batch reinforcement learning for dialogue management optimization
ACM Transactions on Speech and Language Processing (TSLP)
Comparing user simulations for dialogue strategy learning
ACM Transactions on Speech and Language Processing (TSLP)
User Modeling and User-Adapted Interaction
Learning dialogue POMDP models from data
Canadian AI'11 Proceedings of the 24th Canadian conference on Advances in artificial intelligence
Inverse Reinforcement Learning in Partially Observable Environments
The Journal of Machine Learning Research
Reinforcement learning for parameter estimation in statistical spoken dialogue systems
Computer Speech and Language
Analysis and improvement of policy gradient estimation
Neural Networks
An empirical evaluation of a statistical dialog system in public use
SIGDIAL '11 Proceedings of the SIGDIAL 2011 Conference
Spoken dialogue in virtual worlds
COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
Managing implicit assumptions in natural language interfaces
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Learning automata-based approach to learn dialogue policies in large state space
International Journal of Intelligent Information and Database Systems
Sample efficient on-line learning of optimal dialogue policies with kalman temporal differences
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
Point-based value iteration for constrained POMDPs
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
International Journal of Artificial Intelligence in Education - Special issue on Best of ITS 2010
The Skyline algorithm for POMDP value function pruning
Annals of Mathematics and Artificial Intelligence
The role of spoken language dialogue interaction in intelligent environments
Journal of Ambient Intelligence and Smart Environments
Journal of Ambient Intelligence and Smart Environments - A software engineering perspective on smart applications for AmI
Learning observation models for dialogue POMDPs
Canadian AI'12 Proceedings of the 25th Canadian conference on Advances in Artificial Intelligence
SDCTD '12 NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data
Towards situated collaboration
SDCTD '12 NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data
A belief tracking challenge task for spoken dialog systems
SDCTD '12 NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data
Towards quality-adaptive spoken dialogue management
SDCTD '12 NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data
Optimising incremental generation for spoken dialogue systems: reducing the need for fillers
INLG '12 Proceedings of the Seventh International Natural Language Generation Conference
An unsupervised approach to user simulation: toward self-improving dialog systems
SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
The effect of cognitive load on a statistical dialogue system
SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Exploiting machine-transcribed dialog corpus to improve multiple dialog states tracking methods
SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Integrating incremental speech recognition and POMDP-based dialogue systems
SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
People, sensors, decisions: Customizable and adaptive technologies for assistance in healthcare
ACM Transactions on Interactive Intelligent Systems (TiiS) - Special issue on highlights of the decade in interactive intelligent systems
Modeling spoken dialog systems under the interactive pattern recognition framework
SSPR'12/SPR'12 Proceedings of the 2012 Joint IAPR international conference on Structural, Syntactic, and Statistical Pattern Recognition
Observer effect from stateful resources in agent sensing
Autonomous Agents and Multi-Agent Systems
A survey of point-based POMDP solvers
Autonomous Agents and Multi-Agent Systems
Using agents in virtual environments to assist controllers to manage multiple assets
CAVE'12 Proceedings of the First international conference on Cognitive Agents for Virtual Environments
What if everyone could do it?: a framework for easier spoken dialog system design
Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
Inverse reinforcement learning for interactive systems
Proceedings of the 2nd Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication
A historical perspective of speech recognition
Communications of the ACM
Learning to control listening-oriented dialogue using partially observable markov decision processes
ACM Transactions on Speech and Language Processing (TSLP)
Reward shaping for statistical optimisation of dialogue management
SLSP'13 Proceedings of the First international conference on Statistical Language and Speech Processing
Spoken language processing: where do we go from here?
Your Virtual Butler
A domain-independent statistical methodology for dialog management in spoken dialog systems
Computer Speech and Language
Gaussian Processes for POMDP-Based Dialogue Manager Optimization
IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)
MineralMiner: An active sensing simulation environment
Multiagent and Grid Systems
| Hi-index | 0.02 |
In a spoken dialog system, determining which action a machine should take in a given situation is a difficult problem because automatic speech recognition is unreliable and hence the state of the conversation can never be known with certainty. Much of the research in spoken dialog systems centres on mitigating this uncertainty and recent work has focussed on three largely disparate techniques: parallel dialog state hypotheses, local use of confidence scores, and automated planning. While in isolation each of these approaches can improve action selection, taken together they currently lack a unified statistical framework that admits global optimization. In this paper we cast a spoken dialog system as a partially observable Markov decision process (POMDP). We show how this formulation unifies and extends existing techniques to form a single principled framework. A number of illustrations are used to show qualitatively the potential benefits of POMDPs compared to existing techniques, and empirical results from dialog simulations are presented which demonstrate significant quantitative gains. Finally, some of the key challenges to advancing this method - in particular scalability - are briefly outlined.