Shot-based video retrieval with optical flow tensor and HMMs

Authors:
Xinbo Gao;Xuelong Li;Jun Feng;Dacheng Tao
Affiliations:
School of Electronic Engineering, Xidian University, Xi'an 710071, China;School of Computer Science and Information Systems, Birkbeck College, University of London, London WC1E 7HX, UK;School of Electronic Engineering, Xidian University, Xi'an 710071, China;Biometrics Research Centre, Department of Computing, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China
Venue:
Pattern Recognition Letters
Year:
2009

Citing 14
Cited 5

Automatic Video Indexing and Full-Video Search for Object Appearances

Proceedings of the IFIP TC2/WG 2.6 Second Working Conference on Visual Database Systems II
Video Indexing and Retrieval for Archeological Digital Library, CLIOH

CIVR '02 Proceedings of the International Conference on Image and Video Retrieval
Image Browsing using Hierarchical Clustering

ISCC '99 Proceedings of the The Fourth IEEE Symposium on Computers and Communications
Adaptive color quantization based on perceptive edge protection

Pattern Recognition Letters
Concurrent Subspaces Analysis

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Asymmetric Bagging and Random Subspace for Support Vector Machines-Based Relevance Feedback in Image Retrieval

IEEE Transactions on Pattern Analysis and Machine Intelligence
Rank-one Projections with Adaptive Margins for Face Recognition

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Content-based retrieval of video shot using the-improved nearest feature line method

ICASSP '01 Proceedings of the Acoustics, Speech, and Signal Processing, 2001. on IEEE International Conference - Volume 03
Supervised tensor learning

Knowledge and Information Systems
General Tensor Discriminant Analysis and Gabor Features for Gait Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Discriminant Locally Linear Embedding With High-Order Tensor Data

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Robust color histogram descriptors for video segment retrieval and identification

IEEE Transactions on Image Processing
Unsupervised video-shot segmentation and model-free anchorperson detection for news video story parsing

IEEE Transactions on Circuits and Systems for Video Technology
A new key frame representation for video segment retrieval

IEEE Transactions on Circuits and Systems for Video Technology

Incremental tensor biased discriminant analysis: A new color-based visual tracking method

Neurocomputing
A web community-based video retrieval method using canonical correlation analysis

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
An integrated aurora image retrieval system: AuroraEye

Journal of Visual Communication and Image Representation
A survey of multilinear subspace learning for tensor data

Pattern Recognition
Shot retrieval based on fuzzy evolutionary aiNet and hybrid features

Computers in Human Behavior

Quantified Score

Hi-index	0.10

Visualization

Abstract

Video retrieval and indexing research aims to efficiently and effectively manage very large video databases, e.g., CCTV records, which is a key component in video-based object and event analysis. In this paper, for the purpose of video retrieval, we propose a novel method to represent video data by developing an optical flow tensor (OFT) and incorporating hidden Markov models (HMMs). As video is content-sensitive and normally carries rich motion information of objects, optical flow field is first employed to estimate such motion. Then, a shot HMMs tree is built to model video clips in different levels in a database. Experimental results demonstrate that the newly developed method inherits advantages of both optical flow and HMMs in video representation. With the newly developed video representation, in video retrieval and indexing tasks, no need to exhaustively compare a query video shot with all video shot records in the database. Moreover, the novel representation method works well when linear discriminant analysis (LDA) is utilized to reduce the feature dimensionality and further speed up the retrieval procedure.