Exploiting facial expressions for affective video summarisation

Authors:
Hideo Joho;Joemon M. Jose;Roberto Valenti;Nicu Sebe
Affiliations:
University of Glasgow;University of Glasgow;University of Amsterdam;University of Trento
Venue:
Proceedings of the ACM International Conference on Image and Video Retrieval
Year:
2009

Citing 13
Cited 8

Connected Vibrations: A Modal Analysis Approach for Non-Rigid Motion Tracking

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Joint processing of audio-visual information for the recognition of emotional expressions in human-computer interaction

Joint processing of audio-visual information for the recognition of emotional expressions in human-computer interaction
Integrating Highlights for More Complete Sports Video Summarization

IEEE MultiMedia
Semisupervised Learning of Classifiers: Theory, Algorithms, and Their Application to Human-Computer Interaction

IEEE Transactions on Pattern Analysis and Machine Intelligence
Affect-based indexing and retrieval of films

Proceedings of the 13th annual ACM international conference on Multimedia
The trecvid 2007 BBC rushes summarization evaluation pilot

Proceedings of the international workshop on TRECVID video summarization
Video Abrupt Transition Detection Based on K-L Transform

ICIG '07 Proceedings of the Fourth International Conference on Image and Graphics
Video summarisation: A conceptual framework and survey of the state of the art

Journal of Visual Communication and Image Representation
Pose Robust Face Tracking by Combining Active Appearance Models and Cylinder Head Models

International Journal of Computer Vision
Affective ranking of movie scenes using physiological signals and content analysis

MS '08 Proceedings of the 2nd ACM workshop on Multimedia semantics
Natural facial expression recognition using differential-AAM and manifold learning

Pattern Recognition
Investigating biometric response for information retrieval applications

ECIR'06 Proceedings of the 28th European conference on Advances in Information Retrieval
Affective video content representation and modeling

IEEE Transactions on Multimedia

Using affective parameters in a content-based recommender system for images

User Modeling and User-Adapted Interaction
Implicit image tagging via facial information

Proceedings of the 2nd international workshop on Social signal processing
An experience oriented video digesting method using heart activity and its applicable video types

PCM'10 Proceedings of the 11th Pacific Rim conference on Advances in multimedia information processing: Part I
Looking at the viewer: analysing facial activity to detect personal highlights of multimedia contents

Multimedia Tools and Applications
Impact of implicit and explicit affective labeling on a recommender system's performance

UMAP'11 Proceedings of the 19th international conference on Advances in User Modeling
Video classification and recommendation based on affective analysis of viewers

Neurocomputing
Perspectives on the evaluation of affective quality in social software

International Journal of Web Based Communities
'Mind the gap': evaluating user physiological response for multi-genre video summarisation

BCS-HCI '13 Proceedings of the 27th International BCS Human Computer Interaction Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents an approach to affective video summarisation based on the facial expressions (FX) of viewers. A facial expression recognition system was deployed to capture a viewer's face and his/her expressions. The user's facial expressions were analysed to infer personalised affective scenes from videos. We proposed two models, pronounced level and expression's change rate, to generate affective summaries using the FX data. Our result suggested that FX can be a promising source to exploit for affective video summaries that can be tailored to individual preferences.