Inclusion of Video Information for Detection of Acoustic Events Using the Fuzzy Integral

Authors:
Taras Butko;Andrey Temko;Climent Nadeu;Cristian Canton
Affiliations:
Department of Signal Theory and Communications, , and TALP Research Center,;Department of Signal Theory and Communications, , and TALP Research Center,;Department of Signal Theory and Communications, , and TALP Research Center,;Department of Signal Theory and Communications, ,
Venue:
MLMI '08 Proceedings of the 5th international workshop on Machine Learning for Multimodal Interaction
Year:
2008

Citing 8
Cited 0

Combining Pattern Classifiers: Methods and Algorithms

Combining Pattern Classifiers: Methods and Algorithms
Approximate Bayesian Multibody Tracking

IEEE Transactions on Pattern Analysis and Machine Intelligence
Fuzzy integral based information fusion for classification of highly confusable non-speech sounds

Pattern Recognition
HMM-Based Acoustic Event Detection with AdaBoost Feature Selection

Multimodal Technologies for Perception of Humans
Acoustic Event Detection: SVM-Based System and Evaluation Setup in CLEAR'07

Multimodal Technologies for Perception of Humans
CLEAR evaluation of acoustic event detection and classification systems

CLEAR'06 Proceedings of the 1st international evaluation conference on Classification of events, activities and relationships
A tutorial on particle filters for online nonlinear/non-GaussianBayesian tracking

IEEE Transactions on Signal Processing
A comparison of methods for multiclass support vector machines

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

When applied to interactive seminars, the detection of acoustic events from only audio information shows a large amount of errors, which are mostly due to the temporal overlaps of sounds. Video signals may be a useful additional source of information to cope with that problem for particular events. In this work, we aim at improving the detection of steps by using two audio-based Acoustic Event Detection (AED) systems, with SVM and HMM, and a video-based AED system, which employs the output of a 3D video tracking algorithm. The fuzzy integral is used to fuse the outputs of the three detection systems. Experimental results using the CLEAR 2007 evaluation data show that video information can be successfully used to improve the results of audio-based AED.