A content-based rapid video playback method using motion-based video time density function and temporal quantization

Authors:
Junfeng Jiang;Xiao-Ping Zhang
Affiliations:
Ryerson University, Toronto, ON, Canada;Ryerson University, Toronto, ON, Canada
Venue:
Proceedings of the 2010 ACM workshop on Social, adaptive and personalized multimedia interaction and access
Year:
2010

Citing 10
Cited 0

Applications of Video-Content Analysis and Retrieval

IEEE MultiMedia
A user attention model for video summarization

Proceedings of the tenth ACM international conference on Multimedia
Automatic Video Scene Extraction by Shot Grouping

ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 4
Hierarchical video content description and summarization using unified semantic and visual similarity

Multimedia Systems
A new motion histogram to index motion content in video segments

Pattern Recognition Letters
Video abstraction: A systematic review and classification

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
A Unified Framework for Video Summarization, Browsing & Retrieval: with Applications to Consumer and Surveillance Video

A Unified Framework for Video Summarization, Browsing & Retrieval: with Applications to Consumer and Surveillance Video
Hidden Markov Models for Video Skim Generation

WIAMIS '07 Proceedings of the Eight International Workshop on Image Analysis for Multimedia Interactive Services
A novel video summarization based on mining the story-structure and semantic relations among concept entities

IEEE Transactions on Multimedia - Special issue on integration of context and content
An ICA Mixture Hidden Markov Model for Video Content Analysis

IEEE Transactions on Circuits and Systems for Video Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a new content-based rapid video playback method using motion-based video time density function (MVTDF) and temporal quantization. In particular, we formulate the rapid video playback problem as a generic sampling problem. We present a novel MVTDF using the inter-frame mutual information in pixel level to describe the time density of video motion activities. A MVTDF-based temporal quantization method is then employed to find the best quanta and partition in time domain. The video frames that are the nearest neighbors to the quanta in the quantization codebook are sampled to navigate the video in a non-uniform way. By selecting the most salient set of frames, the technique is integrated into a video player for variable-rate rapid video playback that preserves content. The implementation of video player demonstrates the feasibility of proposed method in practice. Experimental results show that the proposed method is effective to capture the important semantic information of video data during rapid playback.