A Multimodal Approach to Communicative Interactivity Classification

Authors:
Tomasz M. Rutkowski;Danilo Mandic;Allan Kardec Barros
Affiliations:
Brain Science Institute, RIKEN, Saitama, Japan;Department of Electrical and Electronic Engineering, Imperial College of Science, Technology and Medicine, London, UK;Laboratory for Biological Information Processing, Universidade Federal do Maranhāo, Maranhão, Brazil
Venue:
Journal of VLSI Signal Processing Systems
Year:
2007

Citing 5
Cited 1

Visualizing the pulse of a classroom

MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
A Mathematical Theory of Communication

A Mathematical Theory of Communication
Communicative interactivity: a multimodal communicative situation classification approach

ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
Smart sensor mesh: intelligent sensor clusters configuration and location discovery for collaborative information processing

IMTCI'04 Proceedings of the Second international conference on Intelligent Media Technology for Communicative Intelligence
A comparison of methods for multiclass support vector machines

IEEE Transactions on Neural Networks

Interactive component extraction from fEEG, fNIRS and peripheral biosignals for affective brain-machine interfacing paradigms

Computers in Human Behavior

Quantified Score

Hi-index	0.00

Visualization

Abstract

The problem of modality detection in so called communicative interactivity is addressed. Multiple audio and video recordings of human communication are analyzed within this framework, based on fusion of the extracted features. At the decision level, support vector machines (SVMs) are utilized to segregate between the communication modalities. The proposed approach is verified through simulations on real world recordings.