MagicBrush: image search by color sketch

Authors:
Xinghai Sun;Changhu Wang;Avneesh Sud;Chao Xu;Lei Zhang
Affiliations:
Key Laboratory of Machine Perception (Ministry of Education), Peking Univ., Beijing, China;Microsoft Research Asia, Beijing, China;Microsoft Corp., Redmond, USA;Key Laboratory of Machine Perception (Ministry of Education), Peking Univ., Beijing, China;Microsoft Research Asia, Beijing, China
Venue:
Proceedings of the 21st ACM international conference on Multimedia
Year:
2013

Citing 4
Cited 0

Fast multiresolution image querying

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Interactive Image Search by Color Map

ACM Transactions on Intelligent Systems and Technology (TIST)
Sketch-Based Image Retrieval: Benchmark and Bag-of-Features Descriptors

IEEE Transactions on Visualization and Computer Graphics
Edgel index for large-scale sketch-based image search

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we showcase the MagicBrush system, a novel painting-based image search engine. This system enables users to draw a color sketch as a query to find images. Different from existing works on sketch-based image retrieval, most of which focus on matching the shape structure without carefully considering other important visual modalities, MagicBrush takes into account the indispensable value of "color" related to "shape", and explores to make use of both the shape and color expectations that users usually have when they're imaging or searching for an image. To achieve this, we 1) develop a user-friendly interface to allow users to easily "paint out" their colorful visual expectations; 2) design a compact feature "color-edge word" to encode both shape and color information in a organic way; and 3) develop a novel matching and index structure to support a real-time response in 6.4 million images. By taking into account both shape and color information, the MagicBrush system helps users to vividly present what they are imagining, and retrieve images in a more natural way.