Technical Note: \cal Q-Learning
Machine Learning
Fundamentals of speech recognition
Fundamentals of speech recognition
Intelligent multimedia interfaces
User Interfaces for voice applications
Voice communication between humans and machines
Informational redundancy and resource bounds in dialogue
Informational redundancy and resource bounds in dialogue
Artificial intelligence: a modern approach
Artificial intelligence: a modern approach
Spoken natural language dialog systems: a practical approach
Spoken natural language dialog systems: a practical approach
The Philips automatic train timetable information system
Speech Communication - Special issue on interactive voice technology for telecommunication applications
Learning in the presence of concept drift and hidden contexts
Machine Learning
Communications of the ACM
Speech Communication - Special issue on interactive voice technology for telecommunication applications (IVITA '96)
International Journal of Human-Computer Studies
Learning to predict user operations for adaptive scheduling
AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
Empirically evaluating an adaptable spoken dialogue system
UM '99 Proceedings of the seventh international conference on User modeling
A hybrid user model for news story classification
UM '99 Proceedings of the seventh international conference on User modeling
Interpreting symptoms of cognitive load in speech input
UM '99 Proceedings of the seventh international conference on User modeling
Reinforcement Learning
Information Retrieval
Evaluating Natural Language Processing Systems: An Analysis and Review
Evaluating Natural Language Processing Systems: An Analysis and Review
Designing Interactive Speech Systems: From First Ideas to User Testing
Designing Interactive Speech Systems: From First Ideas to User Testing
Hybrid Recommender Systems: Survey and Experiments
User Modeling and User-Adapted Interaction
Feature-based and Clique-based User Models for Movie Selection: A Comparative Study
User Modeling and User-Adapted Interaction
A Feature-based Approach to Recommending Selections based on Past Preferences
User Modeling and User-Adapted Interaction
Using Decision Trees for Agent Modeling: Improving Prediction Performance
User Modeling and User-Adapted Interaction
An Analysis of Initiative Selection in CollaborativeTask-Oriented Discourse
User Modeling and User-Adapted Interaction
Exploring Mixed-Initiative Dialogue Using Computer Dialogue Simulation
User Modeling and User-Adapted Interaction
Machine Learning for User Modeling
User Modeling and User-Adapted Interaction
Natural Language Processing and User Modeling: Synergies and Limitations
User Modeling and User-Adapted Interaction
Predictive Statistical Models for User Modeling
User Modeling and User-Adapted Interaction
Techniques for Plan Recognition
User Modeling and User-Adapted Interaction
ICDE '96 Proceedings of the Twelfth International Conference on Data Engineering
Empirical Evaluation of a Reinforcement Learning Spoken Dialogue System
Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
ECAI '96 Proceedings of the Workshop on Intelligent Agents III, Agent Theories, Architectures, and Languages
Generating Personalised Patient Information Using the Medical Record
AIME '95 Proceedings of the 5th Conference on Artificial Intelligence in Medicine in Europe: Artificial Intelligence Medicine
Assessment of dialogue systems by means of a new simulation technique
Speech Communication
Multimodal conversational systems for automobiles
Communications of the ACM - Multimodal interfaces that flex, adapt, and persist
A process model for recognizing communicative acts and modeling negotiation subdialogues
Computational Linguistics
Learning optimal dialogue strategies: a case study of a spoken dialogue agent for email
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Automatic optimization of dialogue management
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Taking the initiative in natural language data base interactions: justifying why
COLING '82 Proceedings of the 9th conference on Computational linguistics - Volume 1
Flexible guidance generation using user model in spoken dialogue systems
ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
Experiments in evaluating interactive spoken language systems
HLT '91 Proceedings of the workshop on Speech and Natural Language
Probabilistic simulation of human-machine dialogues
ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 02
Fast reinforcement learning of dialog strategies
ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 02
Automatic learning of dialogue strategy using dialogue simulation and reinforcement learning
HLT '02 Proceedings of the second international conference on Human Language Technology Research
Journal of Artificial Intelligence Research
Optimizing dialogue management with reinforcement learning: experiments with the NJFun system
Journal of Artificial Intelligence Research
Reinforcement learning: a survey
Journal of Artificial Intelligence Research
Letizia: an agent that assists web browsing
IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 1
The lumière project: Bayesian user modeling for inferring the goals and needs of software users
UAI'98 Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence
Tailored responses for decision support
UM'05 Proceedings of the 10th international conference on User Modeling
A statistical approach to spoken dialog systems design and evaluation
Speech Communication
A Two Phases Statistical Approach for Dialog Management
PIT '08 Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems
Hybrid reinforcement/supervised learning of dialogue policies from fixed data sets
Computational Linguistics
Natural Language Engineering
Being Old Doesn’t Mean Acting Old: How Older Users Interact with Spoken Dialog Systems
ACM Transactions on Accessible Computing (TACCESS)
Automatic annotation of context and speech acts for dialogue corpora
Natural Language Engineering
Training a real-world POMDP-based dialogue system
NAACL-HLT-Dialog '07 Proceedings of the Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technologies
User simulations for context-sensitive speech recognition in spoken dialogue systems
EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Learning lexical alignment policies for generating referring expressions in spoken dialogue systems
ENLG '09 Proceedings of the 12th European Workshop on Natural Language Generation
Agenda-based user simulation for bootstrapping a POMDP dialogue system
NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers
Reducing working memory load in spoken dialogue systems
Interacting with Computers
Realistic grammar error simulation using Markov Logic
ACLShort '09 Proceedings of the ACL-IJCNLP 2009 Conference Short Papers
ACLDemos '09 Proceedings of the ACL-IJCNLP 2009 Software Demonstrations
Setting up user action probabilities in user simulations for dialog system development
ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
A comparison between dialog corpora acquired with real and simulated users
SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
The Knowledge Engineering Review
Human robot interactions: towards the implementation of adaptive strategies for robust communication
BVAI'07 Proceedings of the 2nd international conference on Advances in brain, vision and artificial intelligence
A statistical user simulation technique for the improvement of a spoken dialog system
CIARP'07 Proceedings of the Congress on pattern recognition 12th Iberoamerican conference on Progress in pattern recognition, image analysis and applications
Semi-automatic creation of resources for spoken dialog systems
KI'09 Proceedings of the 32nd annual German conference on Advances in artificial intelligence
Learning to adapt to unknown users: referring expression generation in spoken dialogue systems
ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Hybrid user intention modeling to diversify dialog simulations
Computer Speech and Language
Learning adaptive referring expression generation policies for spoken dialogue systems
Empirical methods in natural language generation
A methodology for learning optimal dialog strategies
TSD'10 Proceedings of the 13th international conference on Text, speech and dialogue
User and noise adaptive dialogue management using hybrid system actions
IWSDS'10 Proceedings of the Second international conference on Spoken dialogue systems for ambient environments
Simulation of the grounding process in spoken dialog systems with Bayesian networks
IWSDS'10 Proceedings of the Second international conference on Spoken dialogue systems for ambient environments
Learning dialogue strategies from older and younger simulated users
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Sparse approximate dynamic programming for dialog management
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Adaptive referring expression generation in spoken dialogue systems: evaluation with real users
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Cooperative user models in statistical dialog simulators
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Statistical dialog management methodologies for real applications
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Introduction to special issue on machine learning for adaptivity in spoken dialogue systems
ACM Transactions on Speech and Language Processing (TSLP)
Spatially-aware dialogue control using hierarchical reinforcement learning
ACM Transactions on Speech and Language Processing (TSLP)
Comparing user simulations for dialogue strategy learning
ACM Transactions on Speech and Language Processing (TSLP)
Grammatical error simulation for computer-assisted language learning
Knowledge-Based Systems
Learning automata-based approach to learn dialogue policies in large state space
International Journal of Intelligent Information and Database Systems
Sample efficient on-line learning of optimal dialogue policies with kalman temporal differences
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
Journal of Ambient Intelligence and Smart Environments - A software engineering perspective on smart applications for AmI
Statistical user simulation for spoken dialogue systems: what for, which data, which future?
SDCTD '12 NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data
A web-based evaluation framework for spatial instruction-giving systems
ACL '12 Proceedings of the ACL 2012 System Demonstrations
Inverse reinforcement learning for interactive systems
Proceedings of the 2nd Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication
Machine learning for interactive systems and robots: a brief introduction
Proceedings of the 2nd Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication
Social signal and user adaptation in reinforcement learning-based dialogue management
Proceedings of the 2nd Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication
Bringing context-aware access to the web through spoken interaction
Applied Intelligence
A domain-independent statistical methodology for dialog management in spoken dialog systems
Computer Speech and Language
Providing personalized Internet services by means of context-aware spoken dialogue systems
Journal of Ambient Intelligence and Smart Environments - Context Awareness
Hi-index | 0.00 |
Within the broad field of spoken dialogue systems, the application of machine-learning approaches to dialogue management strategy design is a rapidly growing research area. The main motivation is the hope of building systems that learn through trial-and-error interaction what constitutes a good dialogue strategy. Training of such systems could in theory be done using human users or using corpora of human–computer dialogue, but in practice the typically vast space of possible dialogue states and strategies cannot be explored without the use of automatic user simulation tools.This requirement for training statistical dialogue models has created an interesting new application area for predictive statistical user modelling and a variety of different techniques for simulating user behaviour have been presented in the literature ranging from simple Markov models to Bayesian networks. The development of reliable user simulation tools is critical to further progress on automatic dialogue management design but it holds many challenges, some of which have been encountered in other areas of current research on statistical user modelling, such as the problem of ‘concept drift’, the problem of combining content-based and collaboration-based modelling techniques, and user model evaluation. The latter topic is of particular interest, because simulation-based learning is currently one of the few applications of statistical user modelling that employs both direct ‘accuracy-based’ and indirect ‘utility-based’ evaluation techniques.In this paper, we briefly summarize the role of the dialogue manager in a spoken dialogue system, give a short introduction to reinforcement-learning of dialogue management strategies and review the literature on user modelling for simulation-based strategy learning. We further describe recent work on user model evaluation and discuss some of the current research issues in simulation-based learning from a user modelling perspective.