Automatic Summarization of Wearable Video - Indexing Subjective Interest

Authors:
Kiyoharu Aizawa;Kenichiro Ishijima;Makoto Shiina
Affiliations:
-;-;-
Venue:
PCM '01 Proceedings of the Second IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Year:
2001

Citing 5
Cited 3

Content-Based Image Retrieval at the End of the Early Years

IEEE Transactions on Pattern Analysis and Machine Intelligence
Video Skimming and Characterization through the Combination of Image and Language Understanding Techniques

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
StartleCam: A Cybernetic Wearable Camera

ISWC '98 Proceedings of the 2nd IEEE International Symposium on Wearable Computers
`WearCam' (The Wearable Camera): Personal Imaging Systems for long--term use in wearable tetherless computer--mediated reality and personal Photo/Videographic Memory Prosthesis

ISWC '98 Proceedings of the 2nd IEEE International Symposium on Wearable Computers
The PC goes ready-to-wear

IEEE Spectrum

A System for Retrieval and Digest Creation of Video Data Based on Geographic Objects

DEXA '02 Proceedings of the 13th International Conference on Database and Expert Systems Applications
PWS & PHA: posture web server and posture history archiver

Proceedings of the the 1st ACM workshop on Continuous archival and retrieval of personal experiences
Video digest based on heart rate

VIIP '07 The Seventh IASTED International Conference on Visualization, Imaging and Image Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

"We want to keep our entire life by video" is the motivation of this research. Recent development of wearable devices and huge storage devices will make it possible to keep entire life by video. We could capture 70 years of our life, however, the problem is how to handle such a huge data. Automatic summarization based on personal interest should be indispensable. In this paper we propose an approach to automatic structuring and summarization of wearable video. (Wearable video is our abbreviation of "video captured by a wearable camera"). In our approach, we make use of a wearable camera and a sensor of brain waves. Video is firstly structured by objective features of video, and the shots are rated by subjective measures based on brain waves. The approach was very successful for real world experiments and it automatically extracted all the events that the subjects reported they had felt interesting.