An experience oriented video digesting method using heart activity and its applicable video types

Authors:
Satoshi Toyosawa;Takashi Kawai
Affiliations:
Global Information and Telecommunication Institute, Waseda University, Honjo, Saitama, Japan;Global Information and Telecommunication Institute, Waseda University, Honjo, Saitama, Japan
Venue:
PCM'10 Proceedings of the 11th Pacific Rim conference on Advances in multimedia information processing: Part I
Year:
2010

Citing 8
Cited 0

Toward Machine Emotional Intelligence: Analysis of Affective Physiological State

IEEE Transactions on Pattern Analysis and Machine Intelligence - Graph Algorithms and Computer Vision
User-oriented Affective Video Content Analysis

CBAIVL '01 Proceedings of the IEEE Workshop on Content-based Access of Image and Video Libraries (CBAIVL'01)
StartleCam: A Cybernetic Wearable Camera

ISWC '98 Proceedings of the 2nd IEEE International Symposium on Wearable Computers
Affective content detection using HMMs

MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Emotions and heart rate while sitting on a chair

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Video abstraction: A systematic review and classification

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Exploiting facial expressions for affective video summarisation

Proceedings of the ACM International Conference on Image and Video Retrieval
Video digest based on heart rate

VIIP '07 The Seventh IASTED International Conference on Visualization, Imaging and Image Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

An experience oriented, physiology based video digesting method is proposed, and its applicable video types are experimentally examined. The proposed method extracts shots that have made audiences most attentive by analysing two attention measures obtained from heart activity while watching. To assess its applicable types, three original videos that convey distinctive emotional quantity were prepared, and three test digests--shots selected randomly, subjectively and by the proposed method--were generated from each original. Then, the proposed method was evaluated not only by its precisions against the subjective selection, but also by digest viewing experience from subjective scores and a psychophysiological measure. The experiment showed that the proposed method was promising for those with arousing, event-driven contents. It was also suggested that use of multiple evaluation measures is important to exhibit applicability of a digesting method.