ObjectSense: a scalable multi-objects recognition system based on partial-duplicate image retrieval

Authors:
Shuang Wang;Yunfeng Xue;Lingyang Chu;Yuhao Jiang;Shuqiang Jiang
Affiliations:
Key Lab of Intelligent Information Processing, Institute of Computing Tech., CAS, Beijing, China;Key Lab of Intelligent Information Processing, Institute of Computing Tech., CAS, Beijing, China;Key Lab of Intelligent Information Processing, Institute of Computing Tech., CAS, Beijing, China;College of Information Science and Engineering, Shandong University of Science and Technology, Qingdao, China;Key Lab of Intelligent Information Processing, Institute of Computing Tech., CAS, Beijing, China
Venue:
Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
Year:
2013

Citing 3
Cited 0

Video Google: A Text Retrieval Approach to Object Matching in Videos

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Scalable Recognition with a Vocabulary Tree

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this demo, we present ObjectSense, a scalable object recognition system that recognizes multiple objects present in a static image or in the camera frames. Instead of applying learning based recognition framework, this system identifies objects through Partial-Duplicate Image Retrieval (PDIR) based method. First, objects are identified by measuring the similarity between an incoming image and reference image corpus that are labeled with the objects. To compute image similarities, we explore the Consistency Graph Model (CGM), which robustly rejects spatially inconsistent feature matches with the advantage of orientations and positions of local features. Then a kNN voting method is used to decide the object category based on the quantized image similarities. ObjectSense is scalable with promisingly high recall and accuracy, which fits well into recognition-guided shopping and human computer interaction. We built ObjectSense on two platforms, PC and Android.