A finite-state turn-taking model for spoken dialog systems

Authors:
Antoine Raux;Maxine Eskenazi
Affiliations:
Honda Research Institute, Mountain View, CA;Carnegie Mellon University, Pittsburgh, PA
Venue:
NAACL '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Year:
2009

Citing 4
Cited 18

Statecharts: A visual formalism for complex systems

Science of Computer Programming
Discourse obligations in dialogue processing

ACL '94 Proceedings of the 32nd annual meeting on Association for Computational Linguistics
Optimizing endpointing thresholds using dialogue features in a spoken dialogue system

SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
Turn taking for artificial conversational agents

CIA'06 Proceedings of the 10th international conference on Cooperative Information Agents

Importance-Driven Turn-Bidding for spoken dialogue systems

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Facilitating multiparty dialog with gaze, gesture, and speech

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Non-humanlike spoken dialogue: a design perspective

SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Generative modeling and classification of dialogs by a low-level turn-taking feature

Pattern Recognition
Turn-taking cues in a human tutoring corpus

HLT-SS '11 Proceedings of the ACL 2011 Student Session
Prosodic and temporal features for language modeling for dialog

Speech Communication
Decisions about turns in multiparty conversation: from perception to action

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Multiparty turn taking in situated dialog: study, lessons, and directions

SIGDIAL '11 Proceedings of the SIGDIAL 2011 Conference
Predicting the micro-timing of user input for an incremental spoken dialogue system that completes a user's ongoing turn

SIGDIAL '11 Proceedings of the SIGDIAL 2011 Conference
Optimizing the turn-taking behavior of task-oriented spoken dialog systems

ACM Transactions on Speech and Language Processing (TSLP)
Estimating a user’s internal state before the first input utterance

Advances in Human-Computer Interaction
Timing multimodal turn-taking for human-robot cooperation

Proceedings of the 14th ACM international conference on Multimodal interaction
Optimising incremental dialogue decisions using information density for interactive systems

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Optimising incremental generation for spoken dialogue systems: reducing the need for fillers

INLG '12 Proceedings of the Seventh International Natural Language Generation Conference
A temporal simulator for developing turn-taking methods for spoken dialogue systems

SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Triggering effective social support for online groups

ACM Transactions on Interactive Intelligent Systems (TiiS)
Avatar and Dialog Turn-Yielding Phenomena

International Journal of Technology and Human Interaction
Managing chaos: models of turn-taking in character-multichild interactions

Proceedings of the 15th ACM on International conference on multimodal interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper introduces the Finite-State Turn-Taking Machine (FSTTM), a new model to control the turn-taking behavior of conversational agents. Based on a non-deterministic finite-state machine, the FSTTM uses a cost matrix and decision theoretic principles to select a turn-taking action at any time. We show how the model can be applied to the problem of end-of-turn detection. Evaluation results on a deployed spoken dialog system show that the FSTTM provides significantly higher responsiveness than previous approaches.