Affective video segment retrieval for consumer generated videos based on correlation between emotions and emotional audio events

Authors:
Go Irie;Kota Hidaka;Takashi Satou;Toshihiko Yamasaki;Kiyoharu Aizawa
Affiliations:
NTT Cyber Solutions Laboratories, NTT Corp. and Department of Information and Communication Engeneering, The University of Tokyo;NTT Cyber Solutions Laboratories, NTT Corp.;NTT Cyber Solutions Laboratories, NTT Corp.;Department of Information and Communication Engeneering, The University of Tokyo;Department of Information and Communication Engeneering, The University of Tokyo
Venue:
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Year:
2009

Citing 5
Cited 1

Video summarisation based on the psychological content in the track structure

MULTIMEDIA '00 Proceedings of the 2000 ACM workshops on Multimedia
Applications of Video-Content Analysis and Retrieval

IEEE MultiMedia
A computation method for video segmentation utilizing the pleasure-arousal-dominance emotional information

Proceedings of the 15th international conference on Multimedia
Hierarchical movie affective content analysis based on arousal and valence features

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Affective video content representation and modeling

IEEE Transactions on Multimedia

The identification of slapstick comedy using automatic affective video indexing techniques

Proceedings of the 50th Annual Southeast Regional Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

A novel affective video segment retrieval method based on the correlation between emotion and emotional audio events (EAEs) is presented. The proposed method focuses on retrieving three types of affective video segments, joy, sadness and excitement, by utilizing correlations between emotions and EAEs. The correlation between these emotions and EAEs is investigated by a subjective evaluation. The proposed method detects EAEs and rates each EAE in terms of emotion levels. The EAEs are detected by using the Generalized State-Space Model (GSSM) and low-level audio features. Experiments conducted on Consumer Generated Videos (CGVs) show that the proposed EAE detection outperforms conventional HMM and GMM based methods in terms of accuracy, the agreement rate of the retrieved affective video segments reaches 73.3%.