BEAT: the Behavior Expression Animation Toolkit
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Multimodality in Language and Speech Systems
Multimodality in Language and Speech Systems
The reliability of a dialogue structure coding scheme
Computational Linguistics
Recent improvements in the CMU spoken language understanding system
HLT '94 Proceedings of the workshop on Human Language Technology
Footing in human-robot conversations: how robots might shape participant roles using gaze cues
Proceedings of the 4th ACM/IEEE international conference on Human robot interaction
The RavenClaw dialog management framework: Architecture and systems
Computer Speech and Language
A finite-state turn-taking model for spoken dialog systems
NAACL '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Optimizing endpointing thresholds using dialogue features in a spoken dialogue system
SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
A probabilistic multimodal approach for predicting listener backchannels
Autonomous Agents and Multi-Agent Systems
Modeling norms of turn-taking in multi-party conversation
ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Middleware for incremental processing in conversational agents
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Turn-taking cues in task-oriented dialogue
Computer Speech and Language
A multimodal end-of-turn prediction model: learning from parasocial consensus sampling
The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 3
Conversation as action under uncertainty
UAI'00 Proceedings of the Sixteenth conference on Uncertainty in artificial intelligence
Spoken Dialog Challenge 2010: comparison of live and control test results
SIGDIAL '11 Proceedings of the SIGDIAL 2011 Conference
Multiparty turn taking in situated dialog: study, lessons, and directions
SIGDIAL '11 Proceedings of the SIGDIAL 2011 Conference
Turn taking for artificial conversational agents
CIA'06 Proceedings of the 10th international conference on Cooperative Information Agents
| Hi-index | 0.00 |
Even as progress in speech technologies and task and dialog modeling has allowed the development of advanced spoken dialog systems, the low-level interaction behavior of those systems often remains rigid and inefficient. Based on an analysis of human-human and human-computer turn-taking in naturally occurring task-oriented dialogs, we define a set of features that can be automatically extracted and show that they can be used to inform efficient end-of-turn detection. We then frame turn-taking as decision making under uncertainty and describe the Finite-State Turn-Taking Machine (FSTTM), a decision-theoretic model that combines data-driven machine learning methods and a cost structure derived from Conversation Analysis to control the turn-taking behavior of dialog systems. Evaluation results on CMU Let's Go, a publicly deployed bus information system, confirm that the FSTTM significantly improves the responsiveness of the system compared to a standard threshold-based approach, as well as previous data-driven methods.