How low level observations can help to reveal the user's state in HCI

Authors:
Stefan Scherer;Martin Schels;Günther Palm
Affiliations:
Institute of Neural Information Processing, Ulm University, Germany and Speech Communication Lab, Trinity College Dublin, Ireland;Institute of Neural Information Processing, Ulm University, Germany;Institute of Neural Information Processing, Ulm University, Germany
Venue:
ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
Year:
2011

Citing 3
Cited 2

On the use of nonverbal speech sounds in human communication

COST 2102'07 Proceedings of the 2007 COST action 2102 international conference on Verbal and nonverbal communication behaviours
Robust stereoscopic head pose estimation in human-computer interaction and a unified evaluation framework

ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing: Part I
Spotting laughter in natural multiparty conversations: A comparison of automatic online and offline approaches using audiovisual data

ACM Transactions on Interactive Intelligent Systems (TiiS) - Special Issue on Affective Interaction in Natural Environments

Spotting laughter in natural multiparty conversations: A comparison of automatic online and offline approaches using audiovisual data

ACM Transactions on Interactive Intelligent Systems (TiiS) - Special Issue on Affective Interaction in Natural Environments
A companion technology for cognitive technical systems

COST'11 Proceedings of the 2011 international conference on Cognitive Behavioural Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

For next generation human computer interaction (HCI), it is crucial to assess the affective state of a user. However, this respective user state is - even for human annotators - only indirectly inferable using background information and the observation of the interaction's progression as well as the social signals produced by the interlocutors. In this paper, coincidences of directly observable patterns and different user states are examined in order to relate the former to the latter. This evaluation motivates a hierarchical label system, where labels of latent user states are supported by low level observations. The dynamic patterns of occurrences of various social signals may in an integration step infer the latent user's state. Thus, we expect to advance the understanding of the recognition of affective user states as compositions of lower level observations for automatic classifiers in HCI.