Form-Oriented annotation for building a functionally independent dictionary of synthetic movement

Authors:
Izidor Mlakar;Zdravko Kačič;Matej Rojc
Affiliations:
Roboti c.s. d.o.o, Slovenia;Faculty of Electrical Engineering and Computer Science, University of Maribor, Slovenia;Faculty of Electrical Engineering and Computer Science, University of Maribor, Slovenia
Venue:
COST'11 Proceedings of the 2011 international conference on Cognitive Behavioural Systems
Year:
2011

Citing 8
Cited 0

Levels of representation in the annotation of emotion for the specification of expressivity in ECAs

Lecture Notes in Computer Science
Time and space-efficient architecture for a corpus-based text-to-speech synthesis system

Speech Communication
Gaze and Gesture Activity in Communication

UAHCI '09 Proceedings of the 5th International on ConferenceUniversal Access in Human-Computer Interaction. Part II: Intelligent and Ubiquitous Interaction Environments
User preferences can drive facial expressions: evaluating an embodied conversational agent in a recommender dialogue system

User Modeling and User-Adapted Interaction
A comprehensive taxonomy of human motives: a principled basis for the motives of intelligent agents

IVA'10 Proceedings of the 10th international conference on Intelligent virtual agents
A multimodal database for mimicry analysis

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
Systematicity and idiosyncrasy in iconic gesture use: empirical analysis and computational modeling

GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Towards ECA's animation of expressive complex behaviour

COST'10 Proceedings of the 2010 international conference on Analysis of Verbal and Nonverbal Communication and Enactment

Quantified Score

Hi-index	0.00

Visualization

Abstract

Non-verbal behavior performed by embodied conversational agents still appears "wooden" and sometimes even "unnatural". Annotated corpora and high resolution annotations capturing the expressive details of movement, may improve the gradualness of synthetic behavior. This paper presents a non-functional, form-oriented annotation scheme based on informal corpora involving multi-speaker dialogues. This annotation scheme allows annotators to capture the expressive details of movement in high-resolutions. The expressive domains it captures are: spatial domain (movement-pose configuration on the level of articulators), fluidity (translations between movement-phases and phrases), temporal domain (movement variation in the form of movement phases), repetitivity (repetitive features of movement), and power (level of exposure). The presented annotation scheme can transform the encoded data into movement templates that can be directly reproduced by an embodied conversational agent.