A picture is worth a thousand keywords: image-based object search on a mobile platform

Authors:
Tom Yeh;Kristen Grauman;Konrad Tollmar;Trevor Darrell
Affiliations:
MIT, CSAIL, USA;MIT, CSAIL, USA;Lund University, Sweden;MIT, CSAIL, USA
Venue:
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Year:
2005

Citing 5
Cited 11

Development of a real time image based object recognition method for mobile AR-devices

Proceedings of the 2nd international conference on Computer graphics, virtual Reality, visualisation and interaction in Africa
Color- and Texture-Based Image Segmentation Using EM and Its Application to Content-Based Image Retrieval

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
IDeixis: image-based Deixis for finding location-based information

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Doubleshot: an interactive user-aided segmentation tool

Proceedings of the 10th international conference on Intelligent user interfaces
Searching the web with mobile images for location recognition

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition

Photo-to-search: using multimodal queries to search the web from mobile devices

Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval
A picture is worth a thousand keywords: exploring mobile image-based web search

Proceedings of the 9th international conference on Human computer interaction with mobile devices and services
Photo-based question answering

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Proxima: a mobile augmented-image search system

MM '08 Proceedings of the 16th ACM international conference on Multimedia
iScope: personalized multi-modality image search for mobile devices

Proceedings of the 7th international conference on Mobile systems, applications, and services
Combining visual features and text data for medical image retrieval using latent semantic kernels

Proceedings of the international conference on Multimedia information retrieval
NMF-based multimodal image indexing for querying by visual example

Proceedings of the ACM International Conference on Image and Video Retrieval
Multimodal representation, indexing, automated annotation and retrieval of image collections via non-negative matrix factorization

Neurocomputing
Mobile museum guide based on fast SIFT recognition

AMR'08 Proceedings of the 6th international conference on Adaptive Multimedia Retrieval: identifying, Summarizing, and Recommending Image and Music
Multimodal information spaces for content-based image retrieval

FDIA'09 Proceedings of the Third BCS-IRSG conference on Future Directions in Information Access
PRiSMA: searching images in parallel

Proceedings of the 20th ACM international conference on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

Finding information based on an object's visual appearance is useful when specific keywords for the object are not known. We have developed a mobile image-based search system that takes images of objects as queries and finds relevant web pages by matching them to similar images on the web. Image-based search works well when matching full scenes, such as images of buildings or landmarks, and for matching objects when the boundary of the object in the image is available. We demonstrate the effectiveness of a simple interactive paradigm for obtaining a segmented object boundary, and show how a shape-based image matching algorithm can use the object outline to find similar images on the web.