Queries and tags in affect-based multimedia retrieval

Authors:
Joep J. M. Kierkels;Mohammad Soleymani;Thierry Pun
Affiliations:
Computer Science Department, University of Geneva, Geneva, Switzerland;Computer Science Department, University of Geneva, Geneva, Switzerland;Computer Science Department, University of Geneva, Geneva, Switzerland
Venue:
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Year:
2009

Citing 3
Cited 3

The relationship between recall and precision

Journal of the American Society for Information Science
Multimedia indexing through multi-source and multi-language information extraction: the MUMIS project

Data & Knowledge Engineering - NLDB2002
Affective Characterization of Movie Scenes Based on Multimedia Content Analysis and User's Physiological Emotional Responses

ISM '08 Proceedings of the 2008 Tenth IEEE International Symposium on Multimedia

Implicit image tagging via facial information

Proceedings of the 2nd international workshop on Social signal processing
Single trial classification of EEG and peripheral physiological signals for recognition of emotions induced by music videos

BI'10 Proceedings of the 2010 international conference on Brain informatics
Categorical and dimensional affect analysis in continuous input: Current trends and future directions

Image and Vision Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

An approach for implementing affective information as tags for multimedia content indexing and retrieval is presented. The approach can be used for implicit as well as explicit tags and is presented here using data recorded during the viewing of movie fragments containing annotations and physiological signal recordings. For retrieval based on affective queries, a representation of the query-words is defined in the arousal-valence space in the form of a Gaussian probability distribution and a retrieval method based on this representation is presented. Validation of retrieval accuracy is performed using Precision and Recall parameters. Results show that the use of arousal and valence as affective tags can improve retrieval results.