On the limited memory BFGS method for large scale optimization
Mathematical Programming: Series A and B
Predictive Statistical Models for User Modeling
User Modeling and User-Adapted Interaction
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Assessment of dialogue systems by means of a new simulation technique
Speech Communication
BLEU: a method for automatic evaluation of machine translation
ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Developing a flexible spoken dialog system using simulation
ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Partially observable Markov decision processes for spoken dialog systems
Computer Speech and Language
Probabilistic simulation of human-machine dialogues
ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 02
Testing the performance of spoken dialogue systems by means of an artificially simulated user
Artificial Intelligence Review
User simulation in a stochastic dialog system
Computer Speech and Language
Agenda-based user simulation for bootstrapping a POMDP dialogue system
NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers
A frame-based probabilistic framework for spoken dialog management using dialog examples
SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
A probabilistic framework for dialog simulation and optimal strategy learning
IEEE Transactions on Audio, Speech, and Language Processing
Hybrid approach to user intention modeling for dialog simulation
ACLShort '09 Proceedings of the ACL-IJCNLP 2009 Conference Short Papers
Hybrid approach to robust dialog management using agenda and dialog examples
Computer Speech and Language
Optimising information presentation for spoken dialogue systems
ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
INLG '10 Proceedings of the 6th International Natural Language Generation Conference
Hybrid user intention modeling to diversify dialog simulations
Computer Speech and Language
Toward automated evaluation of interactive segmentation
Computer Vision and Image Understanding
Assessing user simulation for dialog systems using human judges and automatic evaluation measures
Natural Language Engineering
Data-driven response generation in social media
EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Generative goal-driven user simulation for dialog management
EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
An unsupervised approach to user simulation: toward self-improving dialog systems
SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
| Hi-index | 0.00 |
This paper proposes a novel integrated dialog simulation technique for evaluating spoken dialog systems. A data-driven user simulation technique for simulating user intention and utterance is introduced. A novel user intention modeling and generating method is proposed that uses a linear-chain conditional random field, and a two-phase data-driven domain-specific user utterance simulation method and a linguistic knowledge-based ASR channel simulation method are also presented. Evaluation metrics are introduced to measure the quality of user simulation at intention and utterance. Experiments using these techniques were carried out to evaluate the performance and behavior of dialog systems designed for car navigation dialogs and a building guide robot, and it turned out that our approach was easy to set up and showed similar tendencies to real human users.