Natural behavior of a listening agent
Lecture Notes in Computer Science
Fluid Semantic Back-Channel Feedback in Dialogue: Challenges and Progress
IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Predicting Listener Backchannels: A Probabilistic Multimodal Approach
IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
Dynamic movement and positioning of embodied agents in multiparty conversations
EmbodiedNLP '07 Proceedings of the Workshop on Embodied Language Processing
IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Modeling embodied feedback with virtual humans
ZiF'06 Proceedings of the Embodied communication in humans and machines, 2nd ZiF research group international conference on Modeling communication with robots and virtual humans
Multimodal backchannels for embodied conversational agents
IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Visual attention and eye gaze during multiparty conversations with distractions
IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Nonverbal behavior generator for embodied conversational agents
IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents
Predicting Speaker Head Nods and the Effects of Affective Information
IEEE Transactions on Multimedia
EMA: A process model of appraisal dynamics
Cognitive Systems Research
Exploration of affect detection using semantic cues in virtual improvisation
ITS'12 Proceedings of the 11th international conference on Intelligent Tutoring Systems
Incremental speech understanding in a multi-party virtual human dialogue system
NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Demonstration Session
SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents
Incremental dialogue understanding and feedback for multiparty, multimodal conversation
IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents
Contextual and active learning-based affect-sensing from virtual drama improvisation
ACM Transactions on Speech and Language Processing (TSLP)
Agent communication for believable human-like interactions between virtual characters
CAVE'12 Proceedings of the First international conference on Cognitive Agents for Virtual Environments
Affect detection from text-based virtual improvisation and emotional gesture recognition
Advances in Human-Computer Interaction
Hi-index | 0.00 |
Realizing effective listening behavior in virtual humans has become a key area of research, especially as research has sought to realize more complex social scenarios involving multiple participants and bystanders. A human listener's nonverbal behavior is conditioned by a variety of factors, from current speaker's behavior to the listener's role and desire to participate in the conversation and unfolding comprehension of the speaker. Similarly, we seek to create virtual humans able to provide feedback based on their participatory goals and their partial understanding of, and reaction to, the relevance of what the speaker is saying as the speaker speaks. Based on a survey of existing psychological literature as well as recent technological advances in recognition and partial understanding of natural language, we describe a model of how to integrate these factors into a virtual human that behaves consistently with these goals. We then discuss how the model is implemented into a virtual human architecture and present an evaluation of behaviors used in the model.