The role of frame-based representation in reasoning
Communications of the ACM
Learning internal representations by error propagation
Parallel distributed processing: explorations in the microstructure of cognition, vol. 1
Multilingual spoken-language understanding in the MIT Voyager system
Speech Communication
Neural Networks for Pattern Recognition
Neural Networks for Pattern Recognition
Voicexml: Strategies and Techniques for Effective Voice Application Development with Voicexml 2.0 with Cdrom
Assessment of dialogue systems by means of a new simulation technique
Speech Communication
Spoken Dialogue Technology
Experiences creating three implementations of the repast agent modeling toolkit
ACM Transactions on Modeling and Computer Simulation (TOMACS)
Gradient field-based task assignment in an AGV transportation system
AAMAS '06 Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems
The Knowledge Engineering Review
Developing a flexible spoken dialog system using simulation
ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Partially observable Markov decision processes for spoken dialog systems
Computer Speech and Language
Automatic learning of dialogue strategy using dialogue simulation and reinforcement learning
HLT '02 Proceedings of the second international conference on Human Language Technology Research
Knowledge-based system to define context in commercial applications
SNPD '07 Proceedings of the Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing - Volume 03
User simulation in a stochastic dialog system
Computer Speech and Language
Modelling and simulation of social systems with INGENIAS
International Journal of Agent-Oriented Software Engineering
Relations between de-facto criteria in the evaluation of a spoken dialogue system
Speech Communication
A statistical approach to spoken dialog systems design and evaluation
Speech Communication
Efficient BP Algorithms for General Feedforward Neural Networks
IWINAC '07 Proceedings of the 2nd international work-conference on The Interplay Between Natural and Artificial Computation, Part I: Bio-inspired Modeling of Cognitive Tasks
ITSPOKE: an intelligent tutoring spoken dialogue system
HLT-NAACL--Demonstrations '04 Demonstration Papers at HLT-NAACL 2004
Conquest: an open-source dialog system for conferences
NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers
Agenda-based user simulation for bootstrapping a POMDP dialogue system
NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers
Gaze, conversational agents and face-to-face communication
Speech Communication
Talking Agents: A distributed architecture for interactive artistic installations
Integrated Computer-Aided Engineering
Hybrid user intention modeling to diversify dialog simulations
Computer Speech and Language
Statistical dialog management methodologies for real applications
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Dynamic level of detail for large scale agent-based urban simulations
The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
Modelling the immune system with situated agents
WIRN'05 Proceedings of the 16th Italian conference on Neural Nets
The Voice in the Machine: Building Computers That Understand Speech
The Voice in the Machine: Building Computers That Understand Speech
A probabilistic framework for dialog simulation and optimal strategy learning
IEEE Transactions on Audio, Speech, and Language Processing
| Hi-index | 0.00 |
In this paper, we present a technique for developing user simulators which are able to interact and evaluate conversational agents. Our technique is based on a statistical model that is automatically learned from a dialog corpus. This model is used by the user simulator to provide the next answer taking into account the complete history of the interaction. The main objective of our proposal is not only to evaluate the conversational agent, but also to improve this agent by employing the simulated dialogs to learn a better dialog model. We have applied this technique to design and evaluate a conversational agent which provides academic information in a multi-agent system. The results of the evaluation show that the proposed user simulation methodology can be used not only to evaluate conversational agents but also to explore new enhanced dialog strategies, thereby allowing the conversational agent to reduce the time needed to complete the dialogs and automatically detect new valid paths to achieve each of the required objectives defined for the task.