Two-handed gesture in multi-modal natural dialog
UIST '92 Proceedings of the 5th annual ACM symposium on User interface software and technology
Integrating simultaneous input from speech, gaze, and hand gestures
Intelligent multimedia interfaces
SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
Participating in explanatory dialogues: interpreting and responding to questions in context
Participating in explanatory dialogues: interpreting and responding to questions in context
Embodied conversational interface agents
Communications of the ACM
Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents
Embodied conversational agents
Deictic and emotive communication in animated pedagogical agents
Embodied conversational agents
Planning English Sentences
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
Mathematical and computational aspects of lexicalized grammars
Mathematical and computational aspects of lexicalized grammars
Designing illustrated texts: how language production is influenced by graphics generation
EACL '91 Proceedings of the fifth conference on European chapter of the Association for Computational Linguistics
Sentence planning as description using tree adjoining grammar
ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Unification-based multimodal integration
ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Never look back: an alternative to centering
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Unification-based multimodal parsing
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Discourse obligations in dialogue processing
ACL '94 Proceedings of the 32nd annual meeting on Association for Computational Linguistics
Creating Interactive Virtual Humans: Some Assembly Required
IEEE Intelligent Systems
Artificial Intelligence
A Computational Feature Analysis for Multilingual Character-to-Character Dialogue
CICLing '01 Proceedings of the Second International Conference on Computational Linguistics and Intelligent Text Processing
From a Typology of Gestures to a Procedure for Gesture Production
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Towards integrated microplanning of language and iconic gesture for multimodal output
Proceedings of the 6th international conference on Multimodal interfaces
Non-verbal cues for discourse structure
ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Representing coordination and non-coordination in an american sign language animation
Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
Levels of representation in the annotation of emotion for the specification of expressivity in ECAs
Lecture Notes in Computer Science
Modeling the impact of shared visual information on collaborative reference
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The effects of speech-gesture cooperation in animated agents' behavior in multimedia presentations
Interacting with Computers
Fully generated scripted dialogue for embodied agents
Artificial Intelligence
Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
EACL '06 Proceedings of the Eleventh Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop
GNetIc --- Using Bayesian Decision Networks for Iconic Gesture Generation
IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Converting text into agent animations: assigning gestures to text
HLT-NAACL-Short '04 Proceedings of HLT-NAACL 2004: Short Papers
IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
Language, embodiment and social intelligence
INLG '08 Proceedings of the Fifth International Natural Language Generation Conference
IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
Conversational agent model in intelligent user interface
WILF'03 Proceedings of the 5th international conference on Fuzzy Logic and Applications
Systematicity and idiosyncrasy in iconic gesture use: empirical analysis and computational modeling
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
CONTEXT'05 Proceedings of the 5th international conference on Modeling and Using Context
| Hi-index | 0.00 |
We describe the generation of communicative actions in an implemented embodied conversational agent. Our agent plans each utterance so that multiple communicative goals may be realized opportunistically by a composite action including not only speech but also coverbal gesture that fits the context and the ongoing speech in ways representative of natural human conversation. We accomplish this by reasoning from a grammar which describes gesture declaratively in terms of its discourse function, semantics and synchrony with speech.