TapTell: understanding visual intents on-the-go

Authors:
Ning Zhang;Tao Mei;Xian-Sheng Hua;Ling Guan;Shipeng Li
Affiliations:
Ryerson University, Toronto, ON, Canada;Microsoft Research Asia, Beijing, China;Microsoft, Redmond, WA, USA;Ryerson University, Toronto, ON, Canada;Microsoft Research Asia, Beijing, China
Venue:
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Year:
2011

Citing 3
Cited 0

Scalable Recognition with a Vocabulary Tree

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
The Probabilistic Relevance Framework: BM25 and Beyond

Foundations and Trends in Information Retrieval
TILT: transform invariant low-rank textures

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III

Quantified Score

Hi-index	0.00

Visualization

Abstract

This demonstration presents a mobile-based visual recognition and recommendation application on Windows Phone 7 called TapTell. This is different from other mobile-based visual search mechanisms which merely focus on the search process. TapTell firstly discovers and understands users' visual intents via a circle based natural user interaction called "O" gestures. Following, a Tap action is operated to choose the "O" gestured regions. The context-aware visual search mechanism is utilized for recognizing the intents and associating them with indexed metadata. Finally, the "Tell" action recommends relevant entities utilizing contextual information. The TapTell system has been evaluated at different scenarios on million scale images.