The social signal interpretation (SSI) framework: multimodal signal processing and recognition in real-time

Authors:
Johannes Wagner;Florian Lingenfelser;Tobias Baur;Ionut Damian;Felix Kistler;Elisabeth André
Affiliations:
Lab for Human Centered Multimedia, University of Augsburg, Augsburg, Germany;Lab for Human Centered Multimedia, University of Augsburg, Augsburg, Germany;Lab for Human Centered Multimedia, University of Augsburg, Augsburg, Germany;Lab for Human Centered Multimedia, University of Augsburg, Augsburg, Germany;Lab for Human Centered Multimedia, University of Augsburg, Augsburg, Germany;Lab for Human Centered Multimedia, University of Augsburg, Augsburg, Germany
Venue:
Proceedings of the 21st ACM international conference on Multimedia
Year:
2013

Citing 9
Cited 0

Developing multimodal interactive systems with EyesWeb XMI

NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
The openinterface framework: a tool for multimodal interaction.

CHI '08 Extended Abstracts on Human Factors in Computing Systems
Human-Centred Intelligent Human Computer Interaction (HCI²): how far are we from attaining it?

International Journal of Autonomous and Adaptive Communications Systems
EmoVoice -- A Framework for Online Recognition of Emotions from Voice

PIT '08 Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems
An affective model of user experience for interactive art

ACE '08 Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology
Opensmile: the munich versatile and fast open-source audio feature extractor

Proceedings of the international conference on Multimedia
Exploring Fusion Methods for Multimodal Emotion Recognition with Missing Data

IEEE Transactions on Affective Computing
A sensing architecture for empathetic data systems

Proceedings of the 4th Augmented Human International Conference
Laugh-aware virtual agent and its impact on user amusement

Proceedings of the 2013 international conference on Autonomous agents and multi-agent systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Automatic detection and interpretation of social signals carried by voice, gestures, mimics, etc. will play a key-role for next-generation interfaces as it paves the way towards a more intuitive and natural human-computer interaction. The paper at hand introduces Social Signal Interpretation (SSI), a framework for real-time recognition of social signals. SSI supports a large range of sensor devices, filter and feature algorithms, as well as, machine learning and pattern recognition tools. It encourages developers to add new components using SSI's C++ API, but also addresses front end users by offering an XML interface to build pipelines with a text editor. SSI is freely available under GPL at http://openssi.net.