The art of computer programming, volume 3: (2nd ed.) sorting and searching
The art of computer programming, volume 3: (2nd ed.) sorting and searching
On the detection and recognition of television commercials
ICMCS '97 Proceedings of the 1997 International Conference on Multimedia Computing and Systems
Real time repeated video sequence identification
Computer Vision and Image Understanding
Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
Finding and identifying unknown commercials using repeated video sequence detection
Computer Vision and Image Understanding
Real-Time Commercial Recognition Using Color Moments and Hashing
CRV '07 Proceedings of the Fourth Canadian Conference on Computer and Robot Vision
Mining repetitive clips through finding continuous paths
Proceedings of the 15th international conference on Multimedia
Fast and Effective Features for Recognizing Recurring Video Clips in Very Large Databases
ICIAPW '07 Proceedings of the 14th International Conference of Image Analysis and Processing - Workshops
Scalable detection of partial near-duplicate videos by visual-temporal consistency
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Proceedings of the international workshop on Very-large-scale multimedia corpus, mining and retrieval
Video sequence identification in TV broadcasts
MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part I
MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part I
TV program segmentation using multi-modal information fusion
Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Computational intelligence in multimedia processing
IWANN'11 Proceedings of the 11th international conference on Artificial neural networks conference on Advances in computational intelligence - Volume Part I
Simple low-dimensional features approximating NCC-based image matching
Pattern Recognition Letters
Efficient mining of repetitions in large-scale TV streams with product quantization hashing
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part I
Audio-Based copy detection in the large-scale internet videos
PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
Hi-index | 0.00 |
We introduce an algorithm and a real-time system for mining TV broadcasts for recurring video sequences. The algorithm is frame-accurate, i.e., it exactly identifies with which frame a repeating sequence starts and ends resulting in a temporal accuracy of 40ms for PAL videos and 33ms for NTSC videos. The algorithm is also efficient. A 24-hour live-stream can be processed on a standard PC in less than 4 hours including the computational expensive video decoding. This efficiency is partially achieved by means of an inverted index for identifying similar frames rapidly. Images are mapped to the index by first calculating a gradient-based image feature, which in turn is mapped to the index via a hash function. The search algorithm consists of two steps: (1) searching for recurring short segments of e.g. 1 second length (called clips), and (2) assembling these small segments into sets of repeating long and complete video sequences. In our experiments we investigate the sensitivity of the algorithm concerning all system parameters and apply it to the detection of unknown commercials within 24 and 48 hours of various TV channels. It is shown that the method is an excellent technique for searching for unknown commercials. Currently, the system is used 24 hours 7 days a week in various countries to log all broadcast commercials fully automatically.