LAVES: an instant mobile video search system based on layered audio-video indexing

Authors:
Wu Liu;Feibin Yang;Yongdong Zhang;Qinghua Huang;Tao Mei
Affiliations:
Institute of Computing Technology, Beijing, China;South China University of Technology, Guangzhou, China;Institute of Computing Technology, Beijing, China;South China University of Technology, Guangzhou, China;Microsoft Research Asia, Beijing, China
Venue:
Proceedings of the 21st ACM international conference on Multimedia
Year:
2013

Citing 3
Cited 0

Effective and Efficient Query Processing for Video Subsequence Identification

IEEE Transactions on Knowledge and Data Engineering
Mobile product search with Bag of Hash Bits and boundary reranking

CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Fast search in Hamming space with multi-index hashing

CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Quantified Score

Hi-index	0.00

Visualization

Abstract

This demonstration presents an innovative instant mobile video search system based on layered audio-video indexing, called "LAVES." Through the system, users can discover videos by simply pointing their phones at a screen to capture a very few seconds of what they are watching. Unlike most existing mobile video search applications which simply send the original video query to the cloud, the proposed mobile system is one of the first attempts towards instant and progressive video search leveraging the light-weight computing capacity of mobile devices. The system is able to index large-scale video data using the layered audio-video indexing technique on the cloud, as well as extract light-weight joint audio-video signatures in real time and perform bipartite-graph-based progressive search process on the devices. On a 600 hours video dataset, the system can outperform the state-of-the-arts by achieving 90.79% precision when the query video is less than 10 seconds.