Sketch-based image similarity search with a pen and paper interface

Authors:
Ihab Al Kabary;Heiko Schuldt
Affiliations:
Basel University (unibas.ch), Basel, Switzerland;Basel University (unibas.ch), Basel, Switzerland
Venue:
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Year:
2012

Citing 2
Cited 0

Pen-based computing

XRDS: Crossroads, The ACM Magazine for Students - The Future of Interaction
An interactive paper and digital pen interface for query-by-sketch image retrieval

ECIR'12 Proceedings of the 34th European conference on Advances in Information Retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a novel and innovative user interface for query-by-sketching based image retrieval that exploits emergent interactive paper and digital pen technology. Users can draw sketches with a digital pen on interactive paper in a user-friendly way. The pen is able to capture the stroke vectors and to interactively stream them to the underlying content-based image retrieval (CBIR) system via the pen's Bluetooth interface. We present the integration of interactive paper/digital pen technology with QbS, our CBIR system tailored to Query-by-Sketching, and we demonstrate the use of the paper and pen interface together with QbS for three different collections: MIRFLICKR-25K, a cartoon collection, and a collection of medieval paper watermarks.