An effective video text tracking algorithm based on sift feature and geometric constraint

Authors:
Yinan Na;Di Wen
Affiliations:
Department of Automation, Tsinghua University, Beijing, China;State Key Laboratory of Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology, Department of Electronic Engineering, Tsinghua University, Beijing, ...
Venue:
PCM'10 Proceedings of the 11th Pacific Rim conference on Advances in multimedia information processing: Part I
Year:
2010

Citing 3
Cited 0

A System for Automatic Text Detection in Video

ICDAR '99 Proceedings of the Fifth International Conference on Document Analysis and Recognition
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
SIFT Features Tracking for Video Stabilization

ICIAP '07 Proceedings of the 14th International Conference on Image Analysis and Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Video text provides important clues for semantic-based video analysis, indexing and retrieval. And text tracking is performed to locate specific text information across video frames and enhance text segmentation and recognition over time. This paper presents a multilingual video text tracking algorithm based on the extraction and tracking of Scale Invariant Feature Transform (SIFT) features description through video frames. SIFT features are extracted from video frames to correspond the region of interests across frames. Meanwhile, a global matching method using geometric constraint is proposed to decrease false matches, which effectively improves the accuracy and stability of text tracking results. Based on the correct matches, the motion of text is estimated in adjacent frames and a match score of text is calculated to determine Text Change Boundary (TCB). Experimental results on a large number of video frames show that the proposed text tracking algorithm is robust to different text forms, including multilingual captions, credits, scene texts with shift, rotation and scale change, under complex backgrounds and light changing.