Facial parameters and their influence on subjective impression in the context of keyframe extraction from home video contents

Authors:
Uwe Kowalik;Go Irie;Yasuhiko Miyazaki;Akira Kojima
Affiliations:
NTT Cyber Solutions Laboratories, Nippon Telegraph and Telephone Corporation;NTT Cyber Solutions Laboratories, Nippon Telegraph and Telephone Corporation;NTT Cyber Solutions Laboratories, Nippon Telegraph and Telephone Corporation;NTT Cyber Solutions Laboratories, Nippon Telegraph and Telephone Corporation
Venue:
MMM'10 Proceedings of the 16th international conference on Advances in Multimedia Modeling
Year:
2010

Citing 8
Cited 0

Face Recognition by Elastic Bunch Graph Matching

IEEE Transactions on Pattern Analysis and Machine Intelligence
The Perception of Visual Information, 2e

The Perception of Visual Information, 2e
Removing camera shake from a single photograph

ACM SIGGRAPH 2006 Papers
The Image Processing Handbook, Fifth Edition (Image Processing Handbook)

The Image Processing Handbook, Fifth Edition (Image Processing Handbook)
Video abstraction: A systematic review and classification

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Media objects for user-centered similarity matching

Multimedia Tools and Applications
Home Photo Content Modeling for Personalized Event-Based Retrieval

IEEE MultiMedia
Towards extracting semantically meaningful key frames from personal video clips: from humans to computers

IEEE Transactions on Circuits and Systems for Video Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we investigate the influence of facial parameters on the subjective impression that is created when looking at photographs containing people in the context of keyframe extraction from home video. Hypotheses about the influence of investigated parameters on the impression are experimentally validated with respect to a given viewing perspective. Based on the findings from a conducted user experiment, we propose a novel human-centric image scoring method based on weighted face parameters. As a novelty to the field of keyframe extraction, the proposed method considers facial expressions besides other parameters. We evaluate its effectiveness in terms of correlation between the image score and a ground truth user impression score. The results show that the consideration of facial expressions in the proposed method improves the correlation compared to image scores that rely on commonly used face parameters such as size and location.