Multimodal summarization of meeting recordings

Authors:
B. Erol;D.-S. Lee;J. Hull
Affiliations:
Ricoh California Res. Center, Menlo Park, CA, USA;Ricoh California Res. Center, Menlo Park, CA, USA;Ricoh California Res. Center, Menlo Park, CA, USA
Venue:
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 3 (ICME '03) - Volume 03
Year:
2003

Citing 0
Cited 4

Video abstraction: A systematic review and classification

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Characteristics-based effective applause detection for meeting speech

Signal Processing
What are the most eye-catching and ear-catching features in the video?: implications for video summarization

Proceedings of the 19th international conference on World wide web
Distributed audio recorder using smart phones and proximity connections

Computer Standards & Interfaces

Quantified Score

Hi-index	0.02

Visualization

Abstract

Recorded meetings are useful only if people can find, access, and browse them easily. Key-frames and video skims are useful representations that can enable quick previewing of the content without actually watching a meeting recording from beginning to end. This paper proposes a new method for creating meeting video skims based on audio and visual activity analysis together with text analysis. Audio activity analysis is performed by analyzing sound directions-indicating different speakers-and audio amplitude. Detection of important visual events in a meeting is achieved by analyzing the localized luminance variations in consideration with the omni-directional property of the video captured by our meeting recording system. Text analysis is based on the term frequency-inverse document frequency measure. The resulting video skims better capture the important meeting content compared to the skims obtained by uniform sampling.