Systematicity and idiosyncrasy in iconic gesture use: empirical analysis and computational modeling

Authors:
Kirsten Bergmann;Stefan Kopp
Affiliations:
SFB 673 Alignment in Communication, Bielefeld University, Bielefeld, Germany;Sociable Agents Group, CITEC, Bielefeld University, Bielefeld, Germany
Venue:
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Year:
2009

Citing 9
Cited 3

The EM algorithm for graphical association models with missing data

Computational Statistics & Data Analysis - Special issue dedicated to Toma´sˇ Havra´nek
Discourse and Information Structure

Journal of Logic, Language and Information
Towards integrated microplanning of language and iconic gesture for multimodal output

Proceedings of the 6th international conference on Multimodal interfaces
Synthesizing multimodal utterances for conversational agents: Research Articles

Computer Animation and Virtual Worlds
Coordination and context-dependence in the generation of embodied conversation

INLG '00 Proceedings of the first international conference on Natural language generation - Volume 14
Influence Diagrams

Decision Analysis
Gesture modeling and animation based on a probabilistic re-creation of speaker style

ACM Transactions on Graphics (TOG)
Increasing the expressiveness of virtual agents: autonomous generation of speech and gesture for spatial description tasks

Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
GNetIc --- Using Bayesian Decision Networks for Iconic Gesture Generation

IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents

Recreation of spontaneous non-verbal behavior on a synthetic agent EVA

AIKED'12 Proceedings of the 11th WSEAS international conference on Artificial Intelligence, Knowledge Engineering and Data Bases
Form-Oriented annotation for building a functionally independent dictionary of synthetic movement

COST'11 Proceedings of the 2011 international conference on Cognitive Behavioural Systems
Guest Editorial: Gesture and speech in interaction: An overview

Speech Communication

Quantified Score

Hi-index	0.00

Visualization

Abstract

Why an iconic gesture takes its particular form is a largely open question, given the variations one finds across both situations and speakers. We present results of an empirical study that analyzes correlations between contextual factors (referent features, discourse) and gesture features, and tests whether they are systematic (shared among speakers) or idiosyncratic (inter-individually different). Based on this, a computational model of gesture formation is presented that combines data-based, probabilistic and model-based decision making.