BEAT: the Behavior Expression Animation Toolkit
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
3-D Articulated Pose Tracking for Untethered Diectic Reference
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
A shallow model of backchannel continuers in spoken dialogue
EACL '03 Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics - Volume 1
Contextual recognition of head gestures
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Natural behavior of a listening agent
Lecture Notes in Computer Science
Does the contingency of agents' nonverbal feedback affect users' social anxiety?
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1
SmartBody: behavior realization for embodied conversational agents
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1
IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Creating Rapport with Virtual Agents
IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Incremental Multimodal Feedback for Conversational Agents
IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Searching for Prototypical Facial Feedback Signals
IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Fluid Semantic Back-Channel Feedback in Dialogue: Challenges and Progress
IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
A spoken dialog system for chat-like conversations considering response timing
TSD'07 Proceedings of the 10th international conference on Text, speech and dialogue
Nonverbal behavior generator for embodied conversational agents
IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Teaching Computers to Conduct Spoken Interviews: Breaking the Realtime Barrier with Learning
IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Concensus of self-features for nonverbal behavior analysis
HBU'10 Proceedings of the First international conference on Human behavior understanding
A multimodal real-time platform for studying human-avatar interactions
IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Learning backchannel prediction model from parasocial consensus sampling: a subjective evaluation
IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Interaction strategies for an affective conversational agent
IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Real-time adaptive behaviors in multimodal human-avatar interactions
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Modeling wisdom of crowds using latent mixture of discriminative experts
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
A multimodal end-of-turn prediction model: learning from parasocial consensus sampling
The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 3
IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
Towards conversational agents that attend to and adapt to communicative user feedback
IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
Towards more comprehensive listening behavior: beyond the bobble head
IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
Affirmative cue words in task-oriented dialogue
Computational Linguistics
Interaction strategies for an affective conversational agent
Presence: Teleoperators and Virtual Environments
Modeling speaker behavior: a comparison of two approaches
IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents
Cultural study on speech duration and perception of virtual agent's nodding
IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents
Automatic imitation assessment in interaction
HBU'12 Proceedings of the Third international conference on Human Behavior Understanding
Gaze awareness in conversational agents: Estimating a user's conversational engagement from eye gaze
ACM Transactions on Interactive Intelligent Systems (TiiS) - Special issue on interaction with smart objects, Special section on eye gaze and conversation
Predicting next speaker and timing from gaze transition patterns in multi-party meetings
Proceedings of the 15th ACM on International conference on multimodal interaction
Timing and entrainment of multimodal backchanneling behavior for an embodied conversational agent
Proceedings of the 15th ACM on International conference on multimodal interaction
Hi-index | 0.00 |
During face-to-face interactions, listeners use backchannel feedback such as head nods as a signal to the speaker that the communication is working and that they should continue speaking. Predicting these backchannel opportunities is an important milestone for building engaging and natural virtual humans. In this paper we show how sequential probabilistic models (e.g., Hidden Markov Model or Conditional Random Fields) can automatically learn from a database of human-to-human interactions to predict listener backchannels using the speaker multimodal output features (e.g., prosody, spoken words and eye gaze). The main challenges addressed in this paper are automatic selection of the relevant features and optimal feature representation for probabilistic models. For prediction of visual backchannel cues (i.e., head nods), our prediction model shows a statistically significant improvement over a previously published approach based on hand-crafted rules.